From XR to AI: David Dowling Shares Pixotope's Latest Innovations
TLDRIn this episode from VP Land, David Dowling from Pixotope discusses the latest innovations in virtual production. Pixotope, a software company formerly a production company, has been enhancing virtual production for broadcasters and studios with their XR technologies and partnerships, like the one with UN Lum. David introduces Pixo Pocket, an app for students to blend tracking with video using mobile devices, and Pixo Fly, a markerless tracking solution for drones and steady cams that includes zoom capabilities and AR integration. The episode also teases a revolutionary AI chroma key technology that allows full body capture without green screens, set to launch soon. The discussion concludes by highlighting how virtual production is becoming a standard tool in broadcasting, simplifying processes and expanding creative possibilities.
Takeaways
- 🌟 Pixotope is a virtual production solution that has been in business for five years and comes from a production background.
- 📈 They have been focusing on extended reality (XR) applications, particularly in the context of sports and live events.
- 📱 Pixotope Pocket is a new application designed for students, allowing them to use their mobile phones for tracking and video, which is currently iOS-based but will soon support Android.
- 🚀 It is being adopted widely in the industry for various uses, including previz and AR element visualization without the need for studio space.
- 🤖 Pixo Fly is a system for markless tracking using drones or steadicams, which has become very popular and now includes zoom functionality.
- 📊 Pixo Fly uses machine learning to develop a point cloud for tracking, which can be done from a significant distance and with low latency.
- 🔍 An AI-driven innovation by Pixotope eliminates the need for a green screen by automatically detecting people and creating a map for AR elements to be placed.
- 📊 This AI technology is designed to be low on processing power, making it accessible and user-friendly for a broader range of users.
- 📡 The AI is still in the learning phase, with an expected first release towards the end of summer or beginning of fall.
- 🌐 Virtual production is becoming more mainstream, with Pixotope helping to demystify and simplify the process, making it another tool in the production toolkit.
- ⚽️ Pixotope's technology is used worldwide across various sports, including soccer, NFL, rugby, and cricket, as well as for election coverage.
Q & A
What is Pixotope and what does it specialize in?
-Pixotope is a virtual production solution that has been in business for five years as a software company. It was originally a production company and has developed its software to assist studios and broadcasters in realizing their virtual production visions and goals.
What is the significance of the extended reality (XR) stage at the UN Lum Booth?
-The XR stage at the UN Lum Booth is a demonstration of Pixotope's capabilities in extended reality. It features a 2.6 pitch LED panel and XR software, showcasing Pixotope's technology in action.
What is Pixotope Pocket and how is it used?
-Pixotope Pocket is an application designed for students, allowing them to combine tracking with video using a mobile phone. It is currently available for iOS and will soon be available for Android. It enables students to visualize AR elements and previs their projects without needing access to studio facilities.
How does Pixotope Fly work and what is its main application?
-Pixotope Fly is a system for markless tracking for drones or steady cams. It uses machine learning to develop a point cloud, which can be used for tracking and incorporating AR elements into live broadcasts. It is particularly popular for sports broadcasting, such as the NFL, where it allows for dynamic camera movements and AR overlays.
What is the AI Key and how does it differ from traditional chroma key techniques?
-The AI Key is an innovation by Pixotope that eliminates the need for a green screen in chroma key processes. It automatically detects people and creates a map to enable the placement of AR elements. This technology allows for full-body tracking without the need for a green screen and is expected to be released by the end of summer or the beginning of fall.
How does Pixotope's AI technology improve upon traditional methods in virtual production?
-Pixotope's AI technology improves upon traditional methods by providing real-time, low-latency tracking without the need for physical markers or extensive setup. It also reduces the processing power required, as it is designed with gaming engines in mind, making it more accessible and user-friendly.
What are some of the applications of Pixotope's technology beyond sports broadcasting?
-Beyond sports broadcasting, Pixotope's technology is used for election coverage, such as with CNN for displaying graphics during elections. It is also used in conjunction with other sports like rugby and cricket.
How does Pixotope's technology help in reducing the 'fear factor' associated with virtual production?
-Pixotope has worked to simplify and streamline virtual production processes, making it more accessible and less intimidating. Their user-friendly interfaces and solutions for complex problems, like tracking in outdoor environments, have helped to demystify virtual production and make it another tool in the production toolkit.
What is the future outlook for virtual production according to David from Pixotope?
-David is excited about the future of virtual production, as it is becoming more mainstream and less of a specialized field. He sees virtual production as just another tool in the production process and anticipates continued growth and adoption across various industries.
How does Pixotope ensure that its technology is user-friendly and accessible to operators without an engineering background?
-Pixotope designs its software with ease of use in mind, ensuring that it does not require an engineering degree to operate. The focus is on creating an intuitive interface where operators can simply press buttons without worrying about the technical complexities of how different components are connected.
What is the role of strategic partners like UN Lum in Pixotope's demonstrations and product development?
-Strategic partners like UN Lum play a crucial role in showcasing Pixotope's technology in real-world settings. They provide the hardware, such as LED panels, which, when combined with Pixotope's software, offer a complete solution for potential clients to see the technology in action.
What are the next steps for Pixotope in terms of product development and innovation?
-Pixotope is continuously working on improving its existing products and developing new ones. The upcoming release of the AI Key is a significant step forward, and the company is also looking to further integrate AI and machine learning into its offerings to enhance user experience and streamline virtual production processes.
Outlines
🎬 Introduction to Virtual Production with Pixo Real
The video begins with an introduction to the latest updates in virtual production by Pixo Real. The host expresses gratitude to sponsors and introduces David from Pixo Real. David provides an overview of Pixo Real, a five-year-old software company with a background in production. They discuss the company's mission to assist studios and broadcasters in achieving their virtual production goals. The conversation touches on various applications, including extended reality (XR), and the use of Pixo Real's software in conjunction with UN Lum's LED panels. Additionally, David talks about Pixo Pocket, a new application designed for students that combines tracking with video using mobile phones, which has seen significant uptake in the broadcast industry.
🚀 Innovations in Virtual Production: Pixo Fly and AI Advancements
The second paragraph delves into Pixo Fly, a system developed for markless tracking for drones and steady cams that has become incredibly popular. It has been enhanced with zoom capabilities, allowing for easy focusing on specific areas, such as the 10-yard line in NFL games. The discussion then shifts to the technical aspects of how Pixo Fly uses machine learning to create a point cloud for tracking, eliminating the need for physical setup within stadiums. The segment also introduces an AI development by Pixo Real that removes the need for a green screen in chroma key processes. This innovation allows for AR elements to be placed in front of and behind people, which is particularly useful for commentators and sports presenters. The AI is still in the learning phase but is expected to be released by the end of the summer or the beginning of fall. David expresses excitement about the future of virtual production, noting that it's becoming a standard part of the production process rather than a separate, intimidating entity.
Mindmap
Keywords
💡Virtual production
💡Extended Reality (XR)
💡Pixotope Pocket
💡Machine Learning
💡Pixo Fly
💡Chroma Key
💡AI Kia
💡Broadcast Industry
💡Real-time Tracking
💡Strategic Partners
💡Production Company
Highlights
Pixotope is a virtual production solution that has been in business for five years.
Pixotope has its roots in production, which influences its software development to assist studios and broadcasters.
Extended reality (XR) is a significant application area for Pixotope, demonstrated at the UN Lum Booth.
Pixotope Pocket is a new application designed for students, combining tracking with video using mobile phones.
Pixotope Pocket is currently available on iOS and will soon support Android.
The application is being adopted by the broadcast industry, videographers, and cinematographers for previs and AR element visualization.
Pixotope Fly is a markless tracking system for drones or steady cams, popular for sports broadcasting.
Pixotope Fly incorporates zoom functionality, allowing for dynamic AR marker placement on the field.
Traditional tracking required physical setup with sensor cameras and markers; Pixotope Fly uses machine learning for a more streamlined process.
The AI Kia is a new development that eliminates the need for a green screen and chroma key, allowing for AR elements to be placed in front of and behind subjects.
The AI Kia automatically detects people and creates a map for AR element placement, enhancing the functionality of traditional chroma key.
The AI Kia is expected to have its first release at the end of summer or beginning of fall.
Virtual production is becoming more mainstream, with Pixotope aiming to make it accessible and easy to use for a broader range of operators.
Pixotope's innovations are designed to solve tracking problems and simplify the user interface for graphics.
David Dowling is excited about the future of virtual production, expecting it to become an integral part of regular production workflows.
The embrace of virtual production by more broadcast productions is a significant trend in the industry.