THIS Virtual Production App STUNNED Top Filmmakers

Joshua M Kerr
12 Mar 202408:58

TLDRAt the BSC Expo, a groundbreaking app called Likecraft Jet Set was showcased, enabling camera tracking for visual effects, green screen, and virtual production using just an iPhone. The demo included a blue screen scene with a live render preview, but technical issues with video lag were encountered and resolved. The app's affordability and comprehensive features, including lens calibration and integration with Unreal Engine, excited the indie filmmaking community, with some predicting it could revolutionize the industry.

Takeaways

  • 📱 The new app demonstrated is likecraft Jet Set, which enables camera tracking for visual effects, green or blue screen mixed reality, and virtual production using an iPhone mounted on a cinema camera.
  • 🎥 The app was launched at the BSC Expo, one of the biggest filmmaking events of the year, aiming to introduce it to the entire film industry.
  • 🕒 The preparation for the demo took about a month, but only 10 hours were available at the event to set up the entire rig.
  • 🎨 A blue screen scene with an Unreal Engine environment was set up, featuring a garage full of cars and an actress interacting with the setup.
  • 📱 The iPhone running the Jet Set app is calibrated to match the 29 mm Teina lens, providing the correct field of view for the camera.
  • 🔗 The iPhone outputs to an ACC transmitter and a monitor, with another iPhone serving as a clean feed monitor.
  • 🔧 Despite the complexity of the setup, the actual requirement for visual production is much simpler, primarily needing just a camera, a lens, and the app.
  • 🤔 The demo attracted a lot of attention and questions, especially regarding the potential impact on the film industry and the affordability for indie filmmakers.
  • 🛠️ A technical issue with the video signal was encountered, but it was resolved by refreshing the signal in the cam link 4K.
  • 🎬 The final composite result of the demo was well-received, showcasing the effectiveness of the app in a real-world scenario.
  • 💬 The reactions from the visitors were mostly positive, with many expressing excitement about the app's capabilities and affordability.

Q & A

  • What is the main purpose of the app being discussed in the script?

    -The app, Likecraft Jet Set, is designed for camera tracking for visual effects, green or blue screen mixed reality, and full-blown virtual production using an iPhone mounted on top of a main cinema camera.

  • Where was the app launched?

    -The app was launched at the BSC Expo, one of the biggest filmmaking events of the year.

  • What type of environment was set up for the Unreal Engine demo?

    -A garage full of cars was set up as the Unreal Engine environment for the demo.

  • Who is the actress featured in the demo?

    -The actress featured in the demo is Lucia.

  • What was Lucia doing in the demo?

    -Lucia was bolting an Axon transmitter to the front of one of the cars in the garage for the demo.

  • What was the issue encountered with the live render preview?

    -The live render preview experienced a lot of lag and stuttering, which was initially suspected to be due to the heavy load on the laptop and Unreal Engine, but it turned out to be a problem with the Cam Link 4K signal.

  • How was the problem with the live render preview resolved?

    -The problem was resolved by refreshing the signal on the Cam Link 4K by going to the menu and reselecting it.

  • What was the public's reaction to the app at the BSC Expo?

    -The public was excited and interested, especially after understanding that the app is cost-effective and offers a fully managed pipeline including tracking, lens calibration, and integration with other software like Unreal Engine and After Effects.

  • What is the pricing structure for the Likecraft Jet Set app?

    -The base level of the app is free, and it scales up to about $80 per month for the City level.

  • What additional features does the app offer besides camera tracking?

    -The app also offers lens calibration, file sending and sinking to Unreal Engine, and compatibility with other packages like After Effects, making it a comprehensive solution for filmmakers.

  • How did the filmmaker feel about the overall experience at the BSC Expo?

    -The filmmaker felt very positive about the experience, pleased with what they managed to pull off, and was glad to be a part of it. They were also excited to share more about Likecraft Jet Set in the future.

Outlines

00:00

📱 Introducing the Likecraft Jet Set App at BSC Expo

The first paragraph introduces the iPhone's integration with the Likecraft Jet Set app at the BSC Expo, a significant filmmaking event. The app enables camera tracking for visual effects, green or blue screen mixed reality, and virtual production. The speaker had a month to prepare a demo but faced a time crunch upon arrival, having only 10 hours to set up. The setup included a blue screen scene in an Unreal Engine environment and actress Lucia attaching an Axon transmitter to a car. The iPhone's live render preview showcased the composited environment and cinema camera feed. The rig was complex, involving multiple devices and cables, but the core requirements were simple: a camera, a lens, and the app. Despite the challenges, the demo was successful, and the speaker was able to address technical issues, such as video lag, by refreshing the signal. The paragraph concludes with the relief of resolving the problem and the excitement of meeting Philip Bloom at the event.

05:01

🎬 Reflecting on the BSC Expo Experience and Reactions

The second paragraph reflects on the BSC Expo experience, highlighting the challenges and successes of the event. The speaker expresses satisfaction with the demo and the positive reactions from visitors. Initially, attendees were curious about the technology, but once informed, they were excited about its potential impact on the film industry. The app's affordability was a significant talking point, with the basic level being free and the city level costing about 80 a month. The speaker also discusses the reactions of industry professionals who saw the potential of the app to disrupt the market, comparing it to expensive systems like the Mars and Moses. The paragraph ends with gratitude towards those who helped the speaker participate in the event and an anticipation for future coverage of the Likecraft Jet Set app.

Mindmap

Keywords

💡Virtual Production

Virtual Production is a filmmaking technique that integrates real-time computer-generated imagery (CGI) with live-action footage. It allows filmmakers to create complex scenes and environments that would be difficult or impossible to achieve on set. In the video, the author demonstrates how the Likecraft Jet Set app enables virtual production by tracking camera movements and integrating them with a CGI environment in real-time, revolutionizing the way filmmakers can create content.

💡Camera Tracking

Camera Tracking is the process of capturing and recording the movement and position of a camera in 3D space. This information is then used to match the CGI elements with the live-action footage seamlessly. In the context of the video, the iPhone running the Jet Set app performs camera tracking, which is essential for virtual production and creating realistic mixed reality scenes.

💡Green/Blue Screen

Green or blue screen is a technique used in film production where actors perform in front of a solid-colored background, usually green or blue. This chroma key background can then be replaced with any desired digital environment in post-production, allowing for extensive visual effects. In the video, the author discusses using the Jet Set app for green or blue screen mixed reality, where the iPhone is used to track the camera and composite the live footage with the CGI elements in real-time.

💡Unreal Engine

Unreal Engine is a powerful game engine developed by Epic Games, widely used in the gaming industry and increasingly in film production for creating realistic 3D environments and visual effects. In the video, the author uses Unreal Engine to create a virtual garage full of cars, which is then combined with live-action footage using the Jet Set app running on an iPhone.

💡iPhone

The iPhone is a series of smartphones designed and marketed by Apple Inc. In the context of the video, the iPhone is used as a tool for running the Likecraft Jet Set app, which enables camera tracking and real-time visual effects compositing. The iPhone's capabilities in this scenario demonstrate how consumer technology can be leveraged for professional filmmaking purposes.

💡Lens Calibration

Lens calibration is the process of adjusting the settings of a camera lens to ensure that the images it captures are in focus and accurately represent the scene being filmed. In the video, the author mentions that the iPhone app is calibrated to match with a specific lens, which is crucial for achieving precise camera tracking and integration with the virtual environment.

💡Live Render Preview

Live Render Preview refers to the real-time display of computer-generated imagery (CGI) combined with live-action footage during the filming process. This allows filmmakers to see the final result on-set, making adjustments as needed. In the video, the author demonstrates the live render preview feature of the Jet Set app, which is integral to the virtual production process and provides immediate feedback to the filmmakers.

💡Latency

Latency refers to the delay between a signal's initiation and its reception or between the moment an action is performed and the moment it is reflected in the system. In the context of the video, latency is critical in virtual production as it affects the real-time integration of CGI elements with live-action footage. The author had to address an issue with latency during the demo, highlighting the importance of minimal delay for a seamless virtual production experience.

💡Indie Filmmakers

Indie filmmakers are independent filmmakers who typically work outside the major film studio system, often with limited budgets and resources. The video discusses the impact of the Jet Set app on indie filmmakers, suggesting that it provides a cost-effective solution for high-quality virtual production techniques that were previously accessible only to those with substantial resources.

💡Mars System

The Mars System, as mentioned in the video, likely refers to a high-end, professional-grade camera tracking and virtual production system. These systems can be quite expensive, with costs ranging from thousands to tens of thousands of dollars. The video suggests that the Jet Set app offers a more affordable alternative to such systems, making advanced virtual production techniques accessible to filmmakers who might not have considered it otherwise.

Highlights

The introduction of an innovative app at the BSC Expo that revolutionizes virtual production.

The app, Likecraft Jet Set, enables camera tracking for visual effects, green or blue screen mixed reality, and full-blown virtual production.

A simple setup with an iPhone on top of a cinema camera is all that's needed for the app to function.

A demonstration at the event showcased a live render preview of an Unreal Engine environment composited with cinema camera footage.

The rig included a Z-Cam body with a Teina 29 mm lens, and the iPhone app was calibrated to match this lens's field of view.

The phone outputted to an ACC transmitter and monitor, with a clean feed monitor on another iPhone.

The demo setup was complex, with numerous cables and connections, to effectively show the capabilities of the app.

Industry professionals were intrigued by the app, with many questions about its functionality and potential applications.

The app's base level is free, with a monthly subscription scaling up to about $80 for the City level.

The app's capabilities extend beyond tracking, including lens calibration, file sending, and integration with Unreal and After Effects.

The event showcased a robot arm in operation, demonstrating the practical applications of the technology.

The positive reactions from attendees, especially indie filmmakers, highlight the app's potential to not break budgets while delivering desired features.

The event was a success, with the demo running smoothly after overcoming technical challenges.

The experience was positive and rewarding, with attendees excited to explore the app's features and potential.

The app's impact on the film industry is yet to be seen, but the strong reactions indicate its potential to be a game-changer.

The event demonstrated the power of collaboration, with key players in the industry coming together to make the demonstration possible.