New Tech! How I made PRO Level VFX in a BARN!

Compositing Academy
27 Mar 202408:53

TLDRIn a groundbreaking virtual production journey, a team transforms a simple barn in Canada into an innovative film set using the lcraft Jet Set, an iPhone, and a cine camera. Demonstrating that high-end virtual production doesn't necessitate multi-million dollar LED stages, they leverage craftiness and willpower to achieve cinematic magic. Through a detailed behind-the-scenes look, they explore set building, scene planning, practical effects, and a new virtual production pipeline involving tools like Nuke, Blender, and the Sony fx3. The video is a testament to the power of creativity and technology in filmmaking, showcasing a cost-effective yet visually stunning approach to virtual production.

Takeaways

  • 🎬 Transforming a simple barn in Canada into a virtual production set using innovative methods.
  • 📱 Utilizing a new product from lcraft Jet Set Cine, which only requires an iPhone and a cine camera for virtual production.
  • 🚀 Demonstrating that virtual production doesn't need expensive multi-million dollar LED stages, just creativity and determination.
  • 📹 Showcasing the entire behind-the-scenes process of creating the virtual production set in a video.
  • 🛠️ Discussing set building, scene planning, kit bashing, practical effects, and the VFX workflow.
  • 🔧 Crafting a catwalk using rubber mats and wood from eco centers as a cost-effective solution.
  • 🎥 Utilizing a variety of techniques and tools such as Nuke, Blender, and the Sony fx3 camera for production.
  • 🌫️ Incorporating different VFX elements like smoke, acid barrels, sparks, and Parallax to add motion and depth to the scenes.
  • 🎞️ Filming practical effects like smoke and acid barrels on black screens to enhance the realism of the CG environments.
  • 📱 Controlling on-set lighting from an iPhone using aperture lights for cinematic backlit shots.
  • 🔄 Highlighting the unique ability of Jet Set to have CG assets that pass in front of the character for a more immersive experience.
  • 🎨 Emphasizing the value of Jet Set's virtual production pipeline for speeding up the post-production process and allowing for more creative freedom.

Q & A

  • What is the main goal of the video?

    -The main goal of the video is to demonstrate that virtual production does not require expensive setups by using a simple barn in Canada and a new product from lcraft Jet Set Cine.

  • What new product is being used in the video?

    -The new product being used is lcraft Jet Set Cine, which simplifies virtual production by requiring only an iPhone and a cine camera.

  • How does the video address the challenge of creating a catwalk?

    -The challenge of creating a catwalk was addressed by using rubber mats with a pattern resembling a catwalk's surface and constructing a supporting structure with cheap wood from eco centers.

  • What is the significance of kit bashing in the video?

    -Kit bashing is significant as it allows for the creation of interesting compositions and lighting by combining various assets, similar to playing with Legos, which enhances the virtual environment.

  • What practical effects were used to add motion to the CG environments?

    -Practical effects such as smoke, acid barrels, sparks, and the Parallax of objects passing over each other were used to add motion and enhance the level of detail in the CG environments.

  • How was the issue of filming without a green screen stage addressed?

    -The issue was addressed by using a barn owned by the video creator's wife's grandparents, which provided a dark and large space suitable for cinematic backlit shots without needing to rent a green screen stage.

  • What technology was used to control the on-set lighting?

    -Aperture lights were used, and they could be controlled from the video creator's phone, allowing for relighting the actor based on their orientation to the virtual set.

  • How does Jet Set app enhance the virtual production process?

    -Jet Set app enhances the virtual production process by simplifying the placement of CG scenes, offering background replacement, and allowing CG assets to pass in front of characters, thus providing a complete virtual production pipeline.

  • What is the difference between the free version and the cine version of Jet Set?

    -The difference is that the cine version tracks the cine camera and calculates the offset between the iPhone and the cine lens after a lens calibration process, which is not available in the free version.

  • What is the main benefit of using the Jet Set app for filmmakers?

    -The main benefit is the ability to have a sense of spatial awareness and avoid shooting into a green void, as well as speeding up the post-production process by reducing manual and tedious work.

Outlines

00:00

🎬 Virtual Production Innovation

The paragraph discusses a groundbreaking method of virtual production that takes place in Canada, transforming a simple barn into a virtual set using a new product from lcraft Jet Set Cine. This product only requires an iPhone and a cine camera, challenging the notion that virtual production needs expensive LED stages. The video aims to showcase the entire behind-the-scenes process and the final result, emphasizing the use of craftiness and willpower. It also provides a reminder for safety during the production process. The content touches on the accessibility of virtual production techniques and the揭秘 (unveiling) of secrets through the video, highlighting a combination of techniques not commonly seen elsewhere. The tools used include nuke, blender, and Jet Set on an iPhone, alongside the Sony fx3 camera. The video is divided into three parts: set building and scene planning, practical effects and VFX workflow, and the introduction of a new virtual production pipeline that simplifies the production process, making it possible to create multiple set locations virtually with the same set pieces.

05:01

🚀 Cost-Effective Filmmaking Techniques

This paragraph delves into cost-effective filmmaking techniques, emphasizing the decision to not rent a green screen stage in favor of experimenting with new technology. The filmmaker utilizes a barn, transforming it into a cinematic backlit shot location. The narrative discusses the use of various aperture lights for on-set lighting controlled via an iPhone, allowing for the adjustment of lighting based on the actor's position relative to the virtual set. The integration of CG sets into the Jet Set app is highlighted, showcasing its simplicity and the ability to track the cine camera. The app's unique feature of having CG assets in front of the character is discussed, along with the benefits of the cine version of the app, which includes lens calibration and the ability to overlay real set scans onto virtual sets. The paragraph concludes with a mention of upcoming tutorials on the filmmaker's YouTube channel and a call to action for viewers to engage with the content.

Mindmap

Keywords

💡Virtual Production

Virtual production refers to the blend of physical and digital filmmaking techniques, enabling filmmakers to visualize complex scenes in real-time using computer graphics. In the video, the concept is illustrated by transforming a barn in Canada into a virtual production set with minimal equipment, showcasing how it's possible to create immersive environments without the need for expensive LED stages. This method combines traditional filmmaking tools with advanced digital technologies, such as smartphones and specialized software, to facilitate a more versatile and cost-effective production process.

💡Jet Set

Jet Set is introduced as a groundbreaking product that simplifies the virtual production process, requiring only an iPhone and a cine camera to create dynamic scenes. It represents a key tool in the video's narrative, demonstrating the accessibility and efficiency of modern virtual production techniques. Jet Set enables the integration of digital assets and environments with live-action footage, effectively bridging the gap between virtual and physical production elements.

💡Kit Bashing

Kit bashing is a creative process used in the video to design and assemble the virtual environment by combining pre-existing 3D models or 'assets'. This method is likened to playing with Legos, where different pieces are put together to form new, unique structures. The video highlights kit bashing as a crucial step in scene planning, allowing for the creation of complex and layered backgrounds that enhance the realism and depth of the virtual set.

💡Practical Effects

Practical effects in the video refer to physically created effects (as opposed to digital effects) used to add authenticity and texture to scenes. Examples include smoke, sparks, and custom-made acid barrels. These effects are captured using cameras and are later integrated into the virtual production to simulate real-world phenomena, thereby enriching the visual experience and adding layers of detail to the digital environment.

💡VFX Workflow

The VFX (Visual Effects) workflow describes the comprehensive process of creating, integrating, and refining digital effects within live-action footage. In the context of the video, it encompasses everything from the initial recording of practical effects to their enhancement and incorporation into the virtual set. The workflow is crucial for achieving seamless interaction between real and digital elements, ensuring that the final production is cohesive and visually striking.

💡Nuke

Nuke is a powerful compositing software mentioned in the video as part of the toolkit for creating visual effects. It plays a critical role in the post-production phase, where it is used to composite (combine) various elements, both filmed and CG (computer-generated), into a final scene. The video suggests that Nuke allows for sophisticated manipulation of visuals, contributing significantly to the video's overall production quality.

💡Blender

Blender is a free and open-source 3D creation suite used in the video for modeling, animating, and rendering virtual environments and elements. Its inclusion in the video's production process highlights the accessibility of high-quality tools for filmmakers and VFX artists. Blender facilitates the kit bashing and scene creation aspects of virtual production, allowing for the development of detailed and immersive digital worlds.

💡Green Screen

Green screen technology is crucial for virtual production, allowing filmmakers to replace the green background with digital environments in post-production. The video illustrates innovative uses of green screen, including elevating it with practical constructions to enhance realism. This technique enables the seamless integration of actors into virtual settings, highlighting the blend of traditional and modern filmmaking methods.

💡Previsualization

Previsualization, or 'previz', refers to the process of visualizing complex scenes before filming begins, using animations and digital storyboards. In the video, previsualization plays a key role in planning the virtual production, enabling the filmmaker to explore different angles and compositions within the virtual environment before the actual shooting. This process is facilitated by tools like Jet Set, which allow for real-time interaction with digital elements.

💡Compositing

Compositing is the process of combining visual elements from separate sources into single images, creating the illusion that all those elements are part of the same scene. In the video, compositing is a critical step in the VFX workflow, involving the integration of live-action footage with CG environments and effects. Tools like Nuke are used for compositing, allowing for the meticulous blending of real and virtual elements to produce the final cinematic effect.

Highlights

Transforming a simple barn in Canada into a virtual production set using a new product from lcraft Jet Set Cine.

The new product from lcraft Jet Set Cine only requires an iPhone and a cine camera, challenging the notion that virtual production needs expensive LED stages.

The video will showcase the entire behind-the-scenes process of creating the virtual production set.

Introducing a new combination of techniques in virtual production, including the use of Nuke, Blender, and Jet Set on an iPhone.

The video is divided into three parts: set building, practical effects and VFX workflow, and revealing a new virtual production pipeline.

Finding a cost-effective solution for the catwalk set piece by using rubber mats and wood from eco centers.

Kit bashing with various assets to create interesting compositions and lighting, aiming for a 3D layered Parallax effect.

Utilizing the main principle of repeating floor pieces to film in multiple set locations virtually, reusing the same set floor.

Incorporating practical effects like smoke, acid barrels, and sparks to add motion and interest to CG environments.

Using a variety of smoke machines and dry ice techniques filmed on black screens to capture different motions for compositing.

Experimenting with glow sticks and glow-in-the-dark paint mixed with liquid soap to create interesting effects for the acid barrels.

Choosing a barn as the filming location to take advantage of a large, dark space for cinematic backlit shots.

Investing in aperture lights for controlling the set lighting from a phone, allowing for precise adjustments based on the actor's position to the virtual set.

Loading the CG set into the Jet Set app for easy placement and orientation, with the ability to previs and adjust the scene.

Highlighting the unique capability of Jet Set to have CG assets pass in front of the character, enhancing the previs and directing process.

Discussing the benefits of the Jet Set Cine version for filmmakers, including camera tracking and a streamlined virtual production pipeline.

The upcoming release of tutorials on the YouTube channel for filmmakers, artists, and VFX compositors interested in learning Nuke compositing.