I Faked 8K 3D 360° with AI...and it looks *GOOD* 😵 | Insta360 X4 vs. Titan

Hugh Hou
27 May 202404:06

TLDRIn this video, we explore how AI was used to create a convincing 8K 3D 360° effect from footage captured on an Insta360 X4, a 2D camera. The 3D effect was generated using Immersity AI by Leia Inc., offering an immersive experience even without native 3D capabilities. The video compares this AI-generated footage with the Insta360 Titan, a professional 3D 360 camera. Tips are shared on how to use Immersity AI cost-effectively, including pricing strategies and best practices for optimizing video settings. The host also shares upcoming events and a tutorial on 2D to 3D conversion.

Takeaways

  • 📍 The video showcases a stunning view from the highest point in Barcelona, captured with the Insta360 X4.
  • 📷 The Insta360 X4 is not a 3D camera, but the 3D effect in the video was generated using AI via a service called Immersity AI by Leia Inc.
  • 🌅 AI-created 3D spatial effects enhance the immersive quality of the video, even under challenging conditions like low light, sunrise, and motion.
  • 🌵 For stationary shots at Joshua Tree, the AI performed impressively in depth estimation, with no visible stitch lines in the footage.
  • 🎥 The AI's capability is notable, as it has been trained on equirectangular 360 videos, including many 3D 360 videos posted by the creator.
  • 💰 The video compares the AI-generated 3D footage with that of a dedicated 3D 360 camera, the $20,000 Insta360 Titan, highlighting how AI is a cost-effective alternative.
  • 💡 Using AI for 8K 3D 360 content creation can save significant money, as traditional production is expensive.
  • 💵 Immersity AI pricing: converting a 1-minute 8K 360 video costs about $5, and for 60fps, it costs $10. There are free credits upon signing up.
  • ⚙️ Tips for using Immersity AI: keep videos around 50-60 seconds to maximize credits, and adjust 3D softness and convergence settings for optimal results.
  • ⏱️ The AI takes around 30 minutes to convert a 1-minute 8K video. The video concludes with a mention of the creator's upcoming events at Computex and AWE 2024.

Q & A

  • What is the Insta360 X4, and why is it mentioned in the video?

    -The Insta360 X4 is a camera used to capture high-quality 360-degree videos. It is mentioned in the video as the camera used to capture an 8K 3D 360 video, although the X4 itself is not a 3D camera.

  • How was the 3D effect created in the video if the Insta360 X4 is not a 3D camera?

    -The 3D effect was generated using AI through a service called Immersity AI by Leia Inc., which adds depth and spatial elements to a 2D video, making it feel more immersive.

  • What challenges were faced in creating the 3D effect in the video?

    -The main challenges in creating the 3D effect included low light conditions, the sunrise, and motion within the video, making it difficult for AI to generate depth accurately.

  • How did the AI perform when applied to stationary shots in the video?

    -For stationary shots, the AI performed well in depth estimation, with the added benefit of no visible stitch line, making the 3D effect appear seamless.

  • How does the AI-generated 3D effect compare to footage from a dedicated 3D 360 camera like the Insta360 Titan?

    -The AI-generated 3D effect offers a good alternative to footage from dedicated 3D 360 cameras like the Insta360 Titan, which costs $20,000. While not perfect, the AI has improved significantly, making it a cost-effective solution.

  • What are the cost implications of using Immersity AI to generate 8K 3D 360 content?

    -Using Immersity AI to convert 8K 360 videos is not cheap. Converting a 1-minute 8K video costs 900 credits (about $5), and for 60fps, it costs 1800 credits (about $10). There are free credits available upon sign-up.

  • What are some tips for saving credits when using Immersity AI?

    -To save credits, it is advised to upload edited videos around 50-60 seconds long since anything over 60 seconds will cost $10 instead of $5. Additionally, users should make use of MP4 Top and Bottom format and set the 3D softness to 1.1.

  • What is the recommended setting for 3D softness when using Immersity AI?

    -The recommended setting for 3D softness is 1.1, as higher values can make the effect too intense. It's also important to experiment with the Convergence setting to fine-tune the depth.

  • How long does it take for Immersity AI to process a 1-minute 8K video?

    -It takes about half an hour for Immersity AI to process a 1-minute 8K video and apply the full 3D conversion.

  • What is the video creator's future schedule and plans?

    -The video creator will be attending Computex in Taiwan and speaking at AWE 2024. They also mention an upcoming in-depth tutorial on 2D to Spatial Video conversion with AI.

Outlines

00:00

🏙️ Stunning Barcelona View with Tech Enhancements

The video introduces viewers to the highest point in Barcelona, Spain, captured with the Insta360 X4 camera in 8K 3D 360. However, the 3D effect wasn’t native to the camera but was generated by AI using Immersity AI by Leia Inc. This AI-created 3D spatial effect enhances immersion even though the footage was shot in 2D. The scene presented various challenges, such as low light and motion, but the AI helped to maintain a strong sense of depth and realism.

🌅 Transition to Joshua Tree: AI's Role in Depth Estimation

The video shifts focus to stationary shots filmed at Joshua Tree with the same Insta360 X4 camera. Here, the AI effectively handles depth estimation, performing commendably in static environments. A notable achievement of the AI is that there are no visible stitch lines in the 360-degree video, a testament to its training on actual equirectangular videos. The creator shares that the AI has learned from their extensive experience with 3D 360 content over the years.

💸 Comparing AI to High-End 3D Cameras

The video compares the AI-generated 3D effect with footage captured using the $20,000 Insta360 Titan, which is a dedicated 8K 3D 360 camera. The comparison invites viewers to consider the differences and weigh the potential of AI versus expensive hardware. Although AI isn't flawless yet, it's praised for making significant advancements. The discussion suggests that AI can be a cost-effective alternative to high-end equipment when producing immersive content.

🤑 How to Save Money Using Immersity AI

A detailed breakdown is provided on how to save costs when using Immersity AI for converting 8K 360 videos. Converting a 1-minute video in 8K costs 900 credits ($5), while 60fps video requires 1800 credits ($10). To optimize credit usage, it is suggested to keep video length under 60 seconds, as pricing increases by the minute. Additionally, the video emphasizes file limitations, preferred formats, and important settings like 3D softness and Convergence.

⏳ Conversion Tips and Upcoming Events

The final section covers technical tips for using Immersity AI, including optimal conversion settings and estimated processing times. A 1-minute 8K video takes about 30 minutes to convert fully. The creator wraps up by mentioning their upcoming appearances at Computex in Taiwan and AWE 2024, encouraging viewers to attend and engage. A tutorial on 2D to Spatial video conversion is also highlighted for further learning, along with a reminder to subscribe.

Mindmap

Keywords

💡8K 3D 360

This refers to high-definition, three-dimensional, 360-degree video content captured in 8K resolution. The video creator used AI to generate this immersive effect, even though the Insta360 X4 camera used is not a native 3D camera.

💡Insta360 X4

The Insta360 X4 is a camera mentioned in the video, but it is not designed for native 3D video. The creator showcases how AI is used to generate a 3D effect from footage shot with this camera.

💡AI

Artificial Intelligence (AI) is the central technology used in this video to create a 3D effect. The creator discusses how AI is applied through Immersity AI to simulate depth and immersion in otherwise 2D footage.

💡Immersity AI

Immersity AI by Leia Inc. is the service used to convert standard 2D footage into 3D 360 videos. The creator explains how this AI-driven tool enhances depth perception, making the visuals more immersive.

💡Depth estimation

Depth estimation refers to the process of calculating the distance of objects from the camera, essential for generating a convincing 3D effect. The video mentions how AI successfully estimated depth in stationary shots.

💡Equirectangular videos

These are panoramic videos that map a spherical image onto a 2D plane. The AI used in the video was trained on such videos, helping it to create seamless 360-degree experiences without visible stitch lines.

💡Insta360 Titan

A high-end camera used for 3D 360 videos, costing around $20,000. The creator compares footage from this camera with the AI-enhanced content, highlighting the potential of AI to save on expensive equipment.

💡Credits system

Immersity AI uses a credits-based system for video conversion. The creator explains how 900 credits are required for 1 minute of 8K 360 video conversion, and how costs increase with longer videos or higher frame rates.

💡Convergence

Convergence is a setting in Immersity AI that adjusts how objects at different depths align in the 3D effect. The creator suggests experimenting with this setting for optimal results, especially in complex shots.

💡Computex and AWE 2024

These are events where the video creator will be speaking, encouraging viewers to join them. This adds a personal touch, inviting the audience to continue engaging with the creator in real-world spaces.

Highlights

Welcome to the highest point in Barcelona, Spain!

This epic view was captured with the Insta360 X4 in stunning 8K 3D 360.

Wait a second! The Insta360 X4 isn’t a 3D camera, right?

The 3D effect was generated using AI with a new service called Immersity AI by Leia Inc.

Notice how 3D Spatial makes everything feel more immersive, even when it's created by AI.

This shot was particularly challenging due to low light, the sunrise, and motion.

Let’s check out some stationary shots at Joshua Tree from our latest X4 film.

For stationary shots, the AI did a commendable job with depth estimation.

If you look behind you, there’s no stitch line. The AI has been trained on actual equirectangular videos.

How does this compare to a dedicated 3D 360 camera like the $20,000 Insta360 Titan? Let’s find out.

Using AI to produce 8K 3D 360 content can be a real money-saver.

Converting a 1-minute 8K 360 video costs 900 credits, roughly $5.

For 60fps, it’s 1800 credits, about $10. They do offer some free credits when you sign up.

Upload edited videos around 50 to 60 seconds to maximize your credits.

Use MP4 Top and Bottom format, set 3D softness to 1.1, and turn on Convergence for best results.