Create FPV-Like Videos with Your Phone | 3D Scan Tutorial with Luma AI

MDMZ
15 Apr 202306:52

TLDRThis tutorial demonstrates how to use your smartphone to scan environments and create cinematic camera movements with Luma AI, even with a standard DJI drone for FPV-like videos. The video covers best practices for shooting in 4K, editing in Luma's browser-based editor, and manipulating camera movements. Tips for maximizing output quality and combining Luma scans with AI video tools like RunwayML's Gen1 are also provided, encouraging creativity in post-production.

Takeaways

  • 📱 Use your smartphone to scan surroundings and create cinematic camera movements with Luma AI.
  • 📷 If you're an iPhone user, use the dedicated Luma app for real-time guidelines; Android users can upload videos through the browser.
  • 🎥 Shoot in 4K, disable HDR and video stabilization for optimal results.
  • 🔄 Capture video loops from three different heights: chest level, above your head, and knee level.
  • 📐 Keep the subject in frame and centered for consistent camera tracking.
  • 💻 After recording, upload the video to lumalabs.ai, create a project, and process it.
  • 🌐 The 3D scene can be downloaded for use in other software, or edited directly in the browser-based editor.
  • 📹 Use camera tools to manipulate movements, and create keyframes for animation.
  • 👁️ Switch to first-person view and use preset trajectories or custom paths for camera movement.
  • 🛠️ Adjust camera settings such as position, focal length, and roll to create dynamic and interesting effects.
  • 🔄 Fill in unrecorded areas with a solid background color and adjust video resolution before exporting.
  • 📹 For vertical video output, edit keyframes to add a 90-degree roll for better quality after cropping to portrait mode.
  • 🛸 Scan with a drone by manually orbiting the subject or using the built-in orbit feature, then upscale to 4K for enhanced quality.

Q & A

  • What is the main purpose of the video?

    -The main purpose of the video is to demonstrate how to use a smartphone to scan surroundings and create cinematic camera movements in post-production with Luma AI, including creating FPV-like videos using a DJI drone.

  • Is there a specific app recommended for iPhone users to achieve real-time guidelines for scanning?

    -Yes, for iPhone users, the dedicated Luma app is recommended as it provides real-time guidelines for scanning.

  • Can Android users also use Luma AI for scanning?

    -Yes, Android users can capture their videos and upload them directly to Luma from their browser.

  • What camera settings are recommended before shooting?

    -It is recommended to shoot in 4K, disable HDR, and disable video stabilization. Using either a wide or normal focal length is suggested.

  • What is the significance of capturing video loops from three different heights?

    -Capturing video loops from three different heights helps in creating a more dynamic and comprehensive 3D scan of the surroundings.

  • What should be the focus when capturing the video loops?

    -The focus should be on keeping the subject in frame and centered throughout the video loops.

  • What is the process after recording the video for Luma AI processing?

    -After recording, one should go to lumalabs.ai, create an account, upload the video, give the project a descriptive name, and wait for it to process.

  • How can the 3D scene created by Luma AI be utilized?

    -The 3D scene can be downloaded as an object or mesh scene for use in other 3D software, or edited in a browser-based editor for camera movement manipulation.

  • What are the preset camera movement trajectories provided in the Luma AI editor?

    -The preset camera movement trajectories provided are 'orbit' and 'oscillate'.

  • Can the video resolution be adjusted in Luma AI before exporting?

    -Yes, the video resolution can be changed before exporting in Luma AI.

  • What is the recommended way to handle vertical video output on social platforms within Luma AI?

    -Since Luma AI cannot rotate videos, the recommended way is to render the video in landscape mode, then crop it in editing software, and rotate it to 90 degrees.

  • How can one enhance the quality of a video recorded with a drone?

    -One can enhance the quality by upscaling the video to 4K using tools like Topaz Video AI before processing it through Luma AI.

  • What additional AI video tool is mentioned in the video for creating unique effects?

    -The video mentions 'gen 1' from runwayml as an additional AI tool for creating unique and amazing effects.

Outlines

00:00

📱 Smartphone Cinematic Camera Movements with Luma AI

This paragraph introduces a tutorial on creating cinematic camera movements using a smartphone and Luma AI in post-production. It covers the basics of capturing video loops from different heights to maintain the subject in frame and centered. The tutorial also suggests disabling HDR and video stabilization for optimal results. For iPhone users, a dedicated Luma app is available for real-time guidelines, while Android users can upload videos through a browser. The paragraph concludes with a thank you note to Umar and Tarving from Product Nation for their assistance and a teaser to watch their behind-the-scenes video for additional insights.

05:02

🎥 Advanced Post-Production Techniques with Luma AI and DJI Drone

The second paragraph delves into advanced post-production techniques using Luma AI, including editing and exporting 3D scenes, manipulating camera movements, and using preset trajectories like orbit and oscillate. It also discusses customizing camera animations with keyframes and the importance of adjusting camera settings for dynamic effects. The paragraph mentions a workaround for upscaling 1080p drone footage to 4K using Topaz Video AI before processing with Luma AI. Additionally, it suggests combining Luma scans with AI video tools like RunwayML's Gen1 for unique video creations. The paragraph ends with an encouragement to stay creative and a sign-off for the next video.

Mindmap

Keywords

💡FPV (First Person View)

FPV refers to a type of video footage that is captured from a first-person perspective, as if the viewer is experiencing the action themselves. In the context of the video, FPV-like videos are created using a phone and Luma AI to simulate the immersive experience typically associated with drone racing or first-person video games. An example from the script is the mention of using a regular DJI drone to create FPV-looking videos.

💡Luma AI

Luma AI is a technology or software mentioned in the script that enables users to scan their surroundings with a phone and create cinematic camera movements in post-production. It plays a central role in the video's theme by providing a method to achieve professional-looking camera work with consumer-grade equipment. The script describes using Luma AI to upload and process videos, then edit and render them with various camera tools.

💡DJI Drone

A DJI Drone is a type of unmanned aerial vehicle (UAV) manufactured by the company DJI, known for its high-quality cameras and flight stability. In the video, the drone is used to capture video from different heights to create a 3D scan for generating FPV-like videos. The script specifically mentions using a DJI Mini 3 Pro with its built-in orbit feature.

💡3D Scan

A 3D scan is the process of analyzing a real-world object or environment to collect data on its shape and possibly color, which can then be used to create a three-dimensional digital model. In the script, the 3D scan is created by capturing video loops from different heights and using Luma AI to process these into a 3D scene for editing.

💡Post-production

Post-production refers to the stages of film production or video editing that occur after the content has been filmed. This includes editing, visual effects, sound design, and color correction. In the video, post-production involves using Luma AI to create cinematic camera movements from phone-captured footage.

💡4K Video

4K Video is a resolution standard for digital video, offering approximately 4,000 pixels of horizontal resolution, which is four times that of 1080p HD video. The script recommends shooting in 4K to ensure high-quality footage for the Luma AI processing, which can capture more detail for the 3D scanning and editing process.

💡HDR (High Dynamic Range)

HDR is a technology that allows for a greater dynamic range between the darkest and lightest areas of an image or video. In the context of the video, HDR is advised to be disabled when filming to avoid complications during the 3D scanning process with Luma AI.

💡Video Stabilization

Video stabilization is a technique used to reduce the effects of unwanted motion in video footage, resulting in smoother shots. The script suggests disabling video stabilization when filming for Luma AI processing, as the software may handle stabilization in post-production.

💡Keyframes

Keyframes are points in an animation or motion graphics sequence that mark the start and end of a transition or movement. In the video script, keyframes are used in Luma AI's browser-based editor to animate the camera movement over time, creating dynamic and smooth transitions.

💡Orbit Mode

Orbit mode is a camera movement setting that allows the camera to rotate around a central point or subject. In the script, orbit mode is used in Luma AI to make it easier to move the camera and focus on the subject, creating a dynamic and engaging video effect.

💡Motion Blur

Motion blur is a visual effect that occurs in still images or video when an object in motion is captured, giving the impression of speed and motion. The script mentions adding motion blur to the final video using a plugin called RSMB to enhance the realism and quality of the rendered video.

💡Upscaling

Upscaling is the process of increasing the resolution of a video or image, often using AI algorithms to improve the quality of the upscaled content. The script describes using Topaz Video AI to upscale a 1080p video to 4K before processing it through Luma AI to improve the final render's quality.

Highlights

Using a phone to scan surroundings and create cinematic camera movements with Luma AI.

Utilizing a regular DJI drone for scanning to create FPV-like videos.

Tips for achieving the best video quality with Luma AI despite average video quality.

Instructions for iPhone users on using the dedicated Luma app with real-time guidelines.

Guidance for Android users to capture videos and upload them to Luma via browser.

Camera settings recommendations: shooting in 4K, disabling HDR and video stabilization.

Technique of capturing video loops from three different heights for 3D scanning.

Importance of keeping the subject in frame and centered during video capture.

Gratitude expressed to friends from Product Nation for assistance and behind-the-scenes footage.

Process of uploading and processing videos on lumalabs.ai after account creation.

Downloading the 3D scene as an object or mesh for use in other 3D software.

Accessing a browser-based editor to manipulate camera movements and use camera tools.

Using preset trajectories like orbit and oscillate or creating custom camera animations.

Adjusting camera settings and creating motion with keyframes in the editor.

Technique of changing focal length between keyframes for dynamic camera movement.

Filling uncapture areas with a solid background color and adjusting video resolution before export.

Workaround for vertical video rendering by editing keyframes and adding camera roll.

Exporting the video and troubleshooting render queue display issues.

Post-processing vertical videos in editing software like Premiere Pro.

Adding motion blur effects using plugins for more realistic renders.

Combining Luma scans with AI video tools like Gen 1 from RunwayML for unique creations.

Encouragement to stay creative and an invitation to the next video.