From XR to AI: David Dowling Shares Pixotope's Latest Innovations

Joey /// VP Land
29 Apr 202409:16

TLDRIn this episode from VP Land, David Dowling from Pixotope discusses the latest innovations in virtual production. Pixotope, a software company formerly a production company, has been enhancing virtual production for broadcasters and studios with their XR technologies and partnerships, like the one with UN Lum. David introduces Pixo Pocket, an app for students to blend tracking with video using mobile devices, and Pixo Fly, a markerless tracking solution for drones and steady cams that includes zoom capabilities and AR integration. The episode also teases a revolutionary AI chroma key technology that allows full body capture without green screens, set to launch soon. The discussion concludes by highlighting how virtual production is becoming a standard tool in broadcasting, simplifying processes and expanding creative possibilities.

Takeaways

  • 🌟 Pixotope is a virtual production solution that has been in business for five years and comes from a production background.
  • 📈 They have been focusing on extended reality (XR) applications, particularly in the context of sports and live events.
  • 📱 Pixotope Pocket is a new application designed for students, allowing them to use their mobile phones for tracking and video, which is currently iOS-based but will soon support Android.
  • 🚀 It is being adopted widely in the industry for various uses, including previz and AR element visualization without the need for studio space.
  • 🤖 Pixo Fly is a system for markless tracking using drones or steadicams, which has become very popular and now includes zoom functionality.
  • 📊 Pixo Fly uses machine learning to develop a point cloud for tracking, which can be done from a significant distance and with low latency.
  • 🔍 An AI-driven innovation by Pixotope eliminates the need for a green screen by automatically detecting people and creating a map for AR elements to be placed.
  • 📊 This AI technology is designed to be low on processing power, making it accessible and user-friendly for a broader range of users.
  • 📡 The AI is still in the learning phase, with an expected first release towards the end of summer or beginning of fall.
  • 🌐 Virtual production is becoming more mainstream, with Pixotope helping to demystify and simplify the process, making it another tool in the production toolkit.
  • ⚽️ Pixotope's technology is used worldwide across various sports, including soccer, NFL, rugby, and cricket, as well as for election coverage.

Q & A

  • What is Pixotope and what does it specialize in?

    -Pixotope is a virtual production solution that has been in business for five years as a software company. It was originally a production company and has developed its software to assist studios and broadcasters in realizing their virtual production visions and goals.

  • What is the significance of the extended reality (XR) stage at the UN Lum Booth?

    -The XR stage at the UN Lum Booth is a demonstration of Pixotope's capabilities in extended reality. It features a 2.6 pitch LED panel and XR software, showcasing Pixotope's technology in action.

  • What is Pixotope Pocket and how is it used?

    -Pixotope Pocket is an application designed for students, allowing them to combine tracking with video using a mobile phone. It is currently available for iOS and will soon be available for Android. It enables students to visualize AR elements and previs their projects without needing access to studio facilities.

  • How does Pixotope Fly work and what is its main application?

    -Pixotope Fly is a system for markless tracking for drones or steady cams. It uses machine learning to develop a point cloud, which can be used for tracking and incorporating AR elements into live broadcasts. It is particularly popular for sports broadcasting, such as the NFL, where it allows for dynamic camera movements and AR overlays.

  • What is the AI Key and how does it differ from traditional chroma key techniques?

    -The AI Key is an innovation by Pixotope that eliminates the need for a green screen in chroma key processes. It automatically detects people and creates a map to enable the placement of AR elements. This technology allows for full-body tracking without the need for a green screen and is expected to be released by the end of summer or the beginning of fall.

  • How does Pixotope's AI technology improve upon traditional methods in virtual production?

    -Pixotope's AI technology improves upon traditional methods by providing real-time, low-latency tracking without the need for physical markers or extensive setup. It also reduces the processing power required, as it is designed with gaming engines in mind, making it more accessible and user-friendly.

  • What are some of the applications of Pixotope's technology beyond sports broadcasting?

    -Beyond sports broadcasting, Pixotope's technology is used for election coverage, such as with CNN for displaying graphics during elections. It is also used in conjunction with other sports like rugby and cricket.

  • How does Pixotope's technology help in reducing the 'fear factor' associated with virtual production?

    -Pixotope has worked to simplify and streamline virtual production processes, making it more accessible and less intimidating. Their user-friendly interfaces and solutions for complex problems, like tracking in outdoor environments, have helped to demystify virtual production and make it another tool in the production toolkit.

  • What is the future outlook for virtual production according to David from Pixotope?

    -David is excited about the future of virtual production, as it is becoming more mainstream and less of a specialized field. He sees virtual production as just another tool in the production process and anticipates continued growth and adoption across various industries.

  • How does Pixotope ensure that its technology is user-friendly and accessible to operators without an engineering background?

    -Pixotope designs its software with ease of use in mind, ensuring that it does not require an engineering degree to operate. The focus is on creating an intuitive interface where operators can simply press buttons without worrying about the technical complexities of how different components are connected.

  • What is the role of strategic partners like UN Lum in Pixotope's demonstrations and product development?

    -Strategic partners like UN Lum play a crucial role in showcasing Pixotope's technology in real-world settings. They provide the hardware, such as LED panels, which, when combined with Pixotope's software, offer a complete solution for potential clients to see the technology in action.

  • What are the next steps for Pixotope in terms of product development and innovation?

    -Pixotope is continuously working on improving its existing products and developing new ones. The upcoming release of the AI Key is a significant step forward, and the company is also looking to further integrate AI and machine learning into its offerings to enhance user experience and streamline virtual production processes.

Outlines

00:00

🎬 Introduction to Virtual Production with Pixo Real

The video begins with an introduction to the latest updates in virtual production by Pixo Real. The host expresses gratitude to sponsors and introduces David from Pixo Real. David provides an overview of Pixo Real, a five-year-old software company with a background in production. They discuss the company's mission to assist studios and broadcasters in achieving their virtual production goals. The conversation touches on various applications, including extended reality (XR), and the use of Pixo Real's software in conjunction with UN Lum's LED panels. Additionally, David talks about Pixo Pocket, a new application designed for students that combines tracking with video using mobile phones, which has seen significant uptake in the broadcast industry.

05:02

🚀 Innovations in Virtual Production: Pixo Fly and AI Advancements

The second paragraph delves into Pixo Fly, a system developed for markless tracking for drones and steady cams that has become incredibly popular. It has been enhanced with zoom capabilities, allowing for easy focusing on specific areas, such as the 10-yard line in NFL games. The discussion then shifts to the technical aspects of how Pixo Fly uses machine learning to create a point cloud for tracking, eliminating the need for physical setup within stadiums. The segment also introduces an AI development by Pixo Real that removes the need for a green screen in chroma key processes. This innovation allows for AR elements to be placed in front of and behind people, which is particularly useful for commentators and sports presenters. The AI is still in the learning phase but is expected to be released by the end of the summer or the beginning of fall. David expresses excitement about the future of virtual production, noting that it's becoming a standard part of the production process rather than a separate, intimidating entity.

Mindmap

Keywords

💡Virtual production

Virtual production is the use of virtual environments and digital assets in the filmmaking process to create scenes and effects that may not be feasible with traditional physical sets and on-location shooting. In the video, David Dowling discusses how Pixotope has been developing software to help studios and broadcasters realize their virtual production visions, highlighting its importance in the evolution of content creation.

💡Extended Reality (XR)

Extended Reality (XR) is an umbrella term that encompasses all real-world and virtual environments that are computer-generated and experienced through a device. In the context of the video, XR is a significant application of Pixotope's technology, demonstrated at the UN Lum Booth, where they showcase a 2.6 pitch LED panel combined with XR software for immersive experiences.

💡Pixotope Pocket

Pixotope Pocket is a mobile application developed by Pixotope that allows for tracking and video using a smartphone. It is particularly aimed at students, enabling them to visualize AR elements without the need for studio space. In the video, David mentions that it is currently available for iOS and will soon support Android, indicating its growing adoption in the industry.

💡Machine Learning

Machine Learning is a subset of artificial intelligence that provides systems the ability to automatically learn and improve from experience without being explicitly programmed. In the video, David discusses how Pixotope uses machine learning for markless tracking with Pixo Fly, which is a significant innovation as it eliminates the need for physical markers in a stadium for tracking.

💡Pixo Fly

Pixo Fly is a product developed by Pixotope that enables markless tracking for drones or steady cams. It is popular for sports broadcasting, especially for zooming into specific areas like the 10-yard line in NFL games. The system uses machine learning to create a point cloud for tracking, allowing for real-time, low-latency AR integration.

💡Chroma Key

Chroma key is a technique used in video production to superimpose images or scenes onto another through color separation. It is commonly used for weather forecasts and news segments where a presenter appears in front of a map or virtual set. In the video, David introduces a new AI-driven feature that eliminates the need for a green screen, allowing for AR elements to be placed in front of and behind the subject.

💡AI Kia

AI Kia, as mentioned in the video, is a new development by Pixotope that uses artificial intelligence to perform tasks traditionally requiring a green screen. It automatically detects people and creates a map to enable the placement of AR elements, which is a significant advancement in simplifying the process of incorporating AR into live broadcasts.

💡Broadcast Industry

The broadcast industry refers to the business of transmitting electronic information, including audio and video, to the public. In the video, David talks about how Pixotope's solutions are being adopted by the broadcast industry for applications like previs, live sports coverage, and election graphics, indicating the growing integration of virtual production tools in broadcasting.

💡Real-time Tracking

Real-time tracking is the ability of a system to follow and respond to the motion of objects or individuals instantaneously. In the context of the video, Pixotope's Pixo Fly uses real-time tracking for drone cameras, which is crucial for live sports broadcasting and ensuring that AR graphics align accurately with the physical environment.

💡Strategic Partners

Strategic partners are organizations that collaborate to achieve common goals, often bringing complementary skills and resources to the table. In the video, UN Lum is mentioned as one of Pixotope's strategic partners, highlighting the importance of partnerships in developing and showcasing advanced virtual production technologies.

💡Production Company

A production company is a business entity that produces content, typically for film, television, or other media. David mentions that before becoming a software company, Pixotope was a production company, which gave them insight into the needs of studios and broadcasters, guiding the development of their virtual production solutions.

Highlights

Pixotope is a virtual production solution that has been in business for five years.

Pixotope has its roots in production, which influences its software development to assist studios and broadcasters.

Extended reality (XR) is a significant application area for Pixotope, demonstrated at the UN Lum Booth.

Pixotope Pocket is a new application designed for students, combining tracking with video using mobile phones.

Pixotope Pocket is currently available on iOS and will soon support Android.

The application is being adopted by the broadcast industry, videographers, and cinematographers for previs and AR element visualization.

Pixotope Fly is a markless tracking system for drones or steady cams, popular for sports broadcasting.

Pixotope Fly incorporates zoom functionality, allowing for dynamic AR marker placement on the field.

Traditional tracking required physical setup with sensor cameras and markers; Pixotope Fly uses machine learning for a more streamlined process.

The AI Kia is a new development that eliminates the need for a green screen and chroma key, allowing for AR elements to be placed in front of and behind subjects.

The AI Kia automatically detects people and creates a map for AR element placement, enhancing the functionality of traditional chroma key.

The AI Kia is expected to have its first release at the end of summer or beginning of fall.

Virtual production is becoming more mainstream, with Pixotope aiming to make it accessible and easy to use for a broader range of operators.

Pixotope's innovations are designed to solve tracking problems and simplify the user interface for graphics.

David Dowling is excited about the future of virtual production, expecting it to become an integral part of regular production workflows.

The embrace of virtual production by more broadcast productions is a significant trend in the industry.