XK studio: Morphing Reality | XK studio | OFFF HIVE 2024

Houdini
17 Apr 202457:41

TLDRXK Studio, a London-based design and motion practice, discusses their innovative work in the field of futuristic visuals. Co-founder Lucas and designer Stefan present at OFFF HIVE 2024, showcasing projects that blend experimental R&D with a strong vision. They delve into 3D scanning, texture scanning, and split scanning, emphasizing the transformation of real-world inspiration into otherworldly visuals. Notable projects include a music video and installation for Matthew Wilock's song 'Out,' which explores graphic notation in a three-dimensional space, and a Google Deep Mind commission visualizing artificial general intelligence. The studio's love for flowers is evident in their campaigns, such as the alien floral campaign for MUGLER, where they combined 3D scanning with surreal aesthetics. The ongoing project 'Hydration Core' is a studio-wide endeavor exploring water as a medium, aiming to convey themes of renewal and environmental consciousness. The presentation also touches on technical aspects like Houdini's role in their creative process, the use of optical flow for smoothing animations, and the challenges of simulating fluid dynamics on thin petals.

Takeaways

  • 🎥 The presentation by Lucas and Stefan from XK Studio focused on their work in morphing reality through futuristic visuals and experimental R&D approaches.
  • 🌐 XK Studio, based in London, specializes in design and motion practice, serving clients in the beauty, fashion, and cultural sectors.
  • 🔍 They emphasized the importance of 3D scanning, texture scanning, and split scanning in their creative process to bring real-world data into digital spaces.
  • 🚴 A recent mini bike project showcased their use of Houdini for technical setups, where they morphed the bike and urban environment to create optical effects and visualize electricity.
  • 🎵 A music video and large-scale screen installation for the song by Matthew Willock was discussed, which involved breaking down the song into different music elements visualized through graphic notation.
  • 💍 A project for Ha Mass involved stylizing rings as planets, using tools like Gaia and Houdini to create surreal landscapes that maintained the materiality of the jewelry.
  • 🧠 A Google Deep Mind commission visualized artificial general intelligence (AGI), exploring collaborative processes between humans and potential future AGIs through kinetic clay and abstract digital sculptures.
  • 🌸 XK Studio's love for working with flowers was highlighted, with a detailed explanation of their process for creating realistic and abstract flowers using various scanning and simulation techniques.
  • 💧 The 'hydration core' project was introduced as an ongoing exploration of water as a medium, aiming to convey themes of renewal and environmental consciousness.
  • 🎨 The use of Octane and Karma for rendering beautiful gradients in their work was mentioned, indicating that most of the visual effects are achieved in-render rather than in post-production.
  • 📹 The process of creating slit scan effects, traditionally a photography technique, was demonstrated, showing how it can be achieved in Houdini for a unique visual outcome.

Q & A

  • What is the main focus of XK Studio's presentation at OFFF HIVE 2024?

    -XK Studio's presentation at OFFF HIVE 2024 focuses on their recent projects, technical Houdini breakdowns, and their approach to 3D scanning, texture scanning, and split scanning. They discuss their design philosophy, which involves mixing experimental R&D with a strong vision and attention to detail.

  • How does XK Studio utilize motion capture and brain activities in their projects?

    -XK Studio uses motion capture and brain activities to bring real data from reality into their digital space. For instance, they used motion capture of a conductor for London Symphony Orchestra campaigns and brain activities for Google Deep Mind commissions, enhancing the visualization and material fusion of their projects.

  • What is the concept behind the music video and large scale screen installation for the song by Matthew Wilock?

    -The music video and large scale screen installation for Matthew Wilock's song is a graphic score that weaves literal references to the 2020 Bayroot explosion with abstract and sculptural forms. It represents a narrative that travels between stars and galaxies, symbolizing the journey of the Hermes Pegasus.

  • How does the slit scanning technique create a unique visual effect?

    -The slit scanning technique creates a unique visual effect by sampling one line of pixels per frame from an animation, then combining these lines into a single image. This results in a distorted view of the animation where each line represents a different moment in time, creating a waveform-like or time-warped appearance.

  • What is the significance of Houdini in XK Studio's workflow?

    -Houdini is significant in XK Studio's workflow as it serves as a playground for ideas and allows for limitless technical setups. It is used for creating complex simulations, rendering high-resolution images, and is particularly useful for handling large amounts of data and intricate details in their designs.

  • How does XK Studio approach the design of abstract and surreal elements in their projects?

    -XK Studio approaches the design of abstract and surreal elements by starting with real-world references or scans and then transforming them into more stylized and playful versions. They use a combination of 3D scanning, texture scanning, and creative manipulation to achieve a balance between realism and surrealism.

  • What is the 'hydration core' project that XK Studio is currently working on?

    -The 'hydration core' is an ongoing exploration project at XK Studio that aims to involve as many people in the studio as possible. It revolves around a new trend they've conceptualized, which is centered around the exploration of water as a medium, conveying themes of renewal, introspection, and environmental consciousness.

  • How does the slit scan technique differ from traditional photography?

    -The slit scan technique differs from traditional photography by exposing only a small portion of the image to light at a time during a long exposure. This is achieved by having a thin slit between the subject and the camera. The result is a distortion of time and space, with different moments in time captured onto the film or digital medium without motion blur.

  • What software does XK Studio use for 3D scanning and processing high-poly scans?

    -XK Studio uses Reality Capture for 3D scanning and倾向于使用如ZBrush或Blender等程序来处理高多边形扫描。Houdini在处理扫描数据的特定步骤中仍然非常有用，尤其是在清理和细节增强方面。

  • Can you explain the process of creating a normal map using photometric stereo scanning?

    -The process involves placing a chrome sphere in the scene and taking multiple photos with a small light source from different directions. The sphere captures highlights that are used to reconstruct the light source's position. Using these images, a normal map is created by projecting the color information of the sphere, which corresponds to the normal direction, onto a 3D model to simulate the effect of light interaction.

  • How does XK Studio ensure the realism and detail in their scanned textures?

    -XK Studio ensures realism and detail by starting with real scan textures and then enhancing them for a more abstract look. They use a DIY scanning setup to capture different petals and leaves, and they employ techniques like photometric stereo scanning to capture normal maps. They also use software like Octane for rendering to achieve beautiful gradients and realistic visuals.

  • What challenges did XK Studio face when working with the slit scan technique in Houdini?

    -One of the challenges was handling a large number of textures at high resolutions. The team had to find a way to work with almost a thousand textures at 2K resolution efficiently. Houdini was beneficial in this case as it allowed them to work with extra attributes and add more complexity to the warps and distortions in the slit scan effect.

Outlines

00:00

🎥 Introduction to XK Studio and Creative Process

Lucas and Stefan from XK Studio in London discuss their design and motion practice, focusing on futuristic visuals for clients in various industries. They emphasize an experimental R&D approach combined with a strong vision and attention to detail. The talk covers their work with 3D scanning, texture scanning, and split scanning, and how they use Houdini as a tool to create realistic digital spaces from real-world data.

05:01

🎼 Music Video and Graphic Notation Exploration

The video script describes the creation of a music video and large-scale screen installation for a song by Matthew Wilock. The video is inspired by the 2020 Beirut explosion and uses graphic notation as a visual language. The process involves translating 2D graphic notation into a 3D world, with a focus on maintaining the graphic feel while adding tactility and motion detail. The challenge of a 4-minute video duration is addressed by treating the video as a system designed around data.

10:03

💎 Stylizing Jewelry as Planets for Editorial Work

The paragraph details a commission for a magazine editorial featuring rings stylized as planets. The goal is to represent the beauty of the jewelry by modeling and shading the rings and then morphing them into a planetary form with surrealistic and man-made textures. The process involves using Gaia and Houdini to create detailed landscapes that are then simplified to find a balance between planetary and ring materiality.

15:03

🚴‍♂️ Designing a Music Video with a Bike Transformation Theme

The script outlines the design process for a music video and screen installation that features a bike transformation. The project involves morphing the bike and urban environment, using various technical tools to create optical effects and visualize electricity. The video is a part of R&D for a mini bike project, showcasing the ability to manipulate and transform elements in the design process.

20:05

🌐 Visualizing Artificial General Intelligence with Google DeepMind

The paragraph discusses a project commissioned by Google DeepMind to visualize artificial general intelligence (AGI). The project, called 'Kinetic Clay,' explores a collaborative process between a human artist and a potential AGI, using motion capture gloves to record movements for the film. The goal is to represent the human element in the film and create abstract digital sculptures that resemble computer-generated graphics.

25:14

🌷 Creating and Manipulating Flowers in CG for Various Campaigns

The script describes the process of creating and manipulating flowers in computer graphics (CG) for different campaigns. It details the use of real scan textures and DIY scanning setups to capture various attributes like normal maps, diffuse maps, and translucency. The process involves using photometric stereo scanning to capture highlights from a chrome sphere, which are then used to reconstruct the light source direction and create a normal map. The flowers are made more abstract and assembled in 3D using software like Houdini, with techniques to give them a realistic yet surreal look.

30:16

🌿 Crafting a Wilted Flower Effect for Film

The paragraph explains the creation of a wilted flower effect for a film. It involves modifying the rest length of bend and stretch constraints to achieve a wrinkle effect. A second simulation with wind on a low-resolution proxy adds interest to the overall shape. The final step combines the high-resolution details from the first simulation with the motion from the second to create a wilted flower that transitions to its regular state.

35:16

🎨 Achieving Beautiful Gradients in Renders

The script touches on the techniques used to achieve beautiful gradients in renders, which are mostly achieved in the rendering process using software like Octane and Karma. The gradients are not post-processed but are a result of the rendering engine's capabilities.

40:19

🌌 The 'Hydration Core' Studio Endeavor

The 'Hydration Core' is an ongoing studio project that aims to involve as many people in the studio as possible. It explores the theme of water as a medium and muse, often conveying themes of renewal, introspection, and environmental consciousness. The project was part of an open studio exhibition and includes a breakdown of a flower, showcasing the technical challenges and creative process behind the effect.

45:21

📸 The Technique of Slit Scan in Modern Composition

The paragraph discusses the slit scan technique, which originated in old photography but has been adapted for modern compositing. It involves sampling one line of pixels per frame from an animation to create a distorted, time-based image. In Houdini, this is achieved by copying lines based on the number of frames and using UVs to map the position. The process is rendered using Karma CPU, allowing for interactive manipulation and exploration of the animation from a new perspective.

50:22

💬 Q&A Session on Creative Techniques and Software Usage

The final paragraph is a Q&A session where the speakers discuss various aspects of their work. Topics include the difference between using Houdini and After Effects for compositing, the use of Vellum fluids versus FLIP for simulating liquids on thin petals, and the approach to lighting in their scenes. They also talk about the use of optical flow in Nuke for smoothing out animations and the rendering process for achieving gradients in their work.

Mindmap

Keywords

💡Morphing Reality

Morphing Reality refers to the process of transforming or transitioning one visual form into another in a fluid and seamless manner. In the context of the video, it is a central theme that the XK studio explores through their design and motion practice, creating futuristic visuals by blending real-world inspiration with abstract, otherworldly elements. An example from the script is their project with Alexa, where they took real-world inspiration and morphed it into something more outlandish.

💡3D Scanning

3D Scanning is a technology used to capture the shape and appearance of real-world objects and translate them into three-dimensional digital models. It plays a significant role in the XK studio's work, as it allows them to bring an extra level of tactility and realism to their abstract digital worlds. The script mentions using 3D scanning in various projects, including capturing the details of a conductor for a London Symphony Orchestra campaign.

💡Texture Scanning

Texture Scanning is a process of creating detailed digital textures by scanning real-world surfaces. It is a technique that helps in achieving a high level of detail and realism in computer graphics. In the video, XK studio uses texture scanning to enhance the visual quality of their projects, such as by capturing the intricate details of jewelry for a magazine editorial piece.

💡Split Scanning

Split Scanning is a technique that involves capturing a scene by taking multiple photographs with a camera moving in a specific pattern, which can result in a unique, elongated perspective. It is mentioned in the context of creating an alternative, reduced version of a music video, where each line of pixels represents a different moment in time, resembling an mp4 waveform.

💡Houdini

Houdini is a 3D animation software that is widely used for creating complex visual effects and simulations. It is highlighted in the video as the perfect tool for the XK studio to experiment with, allowing them to build limitless technical setups and explore the boundaries of reality in their designs. Houdini is instrumental in their R&D process, as seen in the mini bike project reel.

💡Graphic Notation

Graphic Notation is a visual representation of music that goes beyond traditional musical notation, allowing for more abstract and creative interpretations. In the video, the XK studio discusses their exploration of graphic notation in the context of a music video, where they translated musical elements into a visual language that weaves literal references with abstract and sculptural forms.

💡Motion Capture

Motion Capture is a technology used to record and analyze movement. It is used in the video to refer to the process of capturing the movements of a conductor from the London Symphony Orchestra, which were then utilized in their campaigns. This technology helps in creating realistic animations by translating real-life movements into digital characters or elements.

💡Deep Learning

Deep Learning is a subset of machine learning that involves the use of artificial neural networks to model and solve complex problems. In the context of the video, XK studio used deep learning techniques in their work with Google Deep Mind, aiming to visualize artificial general intelligence through abstract and evolving sculptures, representing the potential benefits of AGI to humanity.

💡Gaia

Gaia is a software tool used for creating realistic 3D terrains and landscapes. It is mentioned in the video in relation to the XK studio's project where they stylized jewelry into planets. Gaia was used to create super realistic, mega-detailed landscapes that were later balanced with the materiality and look of the rings to achieve the desired aesthetic.

💡Vellum

Vellum is a physics simulation plugin for Autodesk Maya used for creating realistic cloth, rope, and soft body simulations. While not explicitly mentioned in the script, it is implied in the discussion about fluid simulations, where the studio might have used similar tools to achieve the effect of liquid interacting with thin petals in a perfume advertisement.

💡Optical Flow

Optical Flow is a technique used in video processing to create smooth motion between frames, often used in post-production. In the video, XK studio used Optical Flow in Nuke to interpolate between frames, creating a smoother playback of their animations when rendered at a higher frame rate.

Highlights

XK studio, a London-based design and motion practice, focuses on futuristic visuals for clients in beauty, fashion, and culture.

The studio's approach combines experimental R&D with a strong vision and attention to detail.

Lucas and Stefan from XK studio discuss their work involving 3D scanning, texture scanning, and split scanning.

Houdini is used as a key tool for technical setups and exploring the limits of reality in their designs.

The music video and large-scale screen installation for the song by Matthew Willock is a notable project, incorporating graphic notation and split scanning techniques.

XK studio's work for Google Deep Mind involved visualizing artificial general intelligence through abstract digital sculptures.

The studio's project 'Hydration Core' is an ongoing exploration involving the entire team and focuses on themes of renewal and environmental consciousness.

A slit scan effect, originally a photography technique, is reimagined in a Houdini setup for a unique visual outcome.

The studio's love for working with flowers is evident in their CG creations, combining real scan textures with abstract designs.

XK studio's DIY scanning setup allows them to capture high-quality textures for petals and leaves, enhancing the realism of their 3D models.

Photometric stereo scanning is used to capture normal maps, a technique that involves using a chrome sphere and multiple light directions.

The studio's work on the MUGLER campaign showcased their ability to blend fluid dynamics with delicate flower petals in a surreal setting.

For the L'Oréal 'Metal Detox' campaign, XK studio combined scanned assets with procedural flowers to create a blend of realism and otherworldliness.

The hydration core project is defined by AI as an emerging artistic movement centered around water as a medium and muse.

XK studio's presentation at OFFF HIVE 2024 included a live demonstration of their Houdini setup for creating normal maps from photometric stereo scanning.

The studio's commitment to innovation is shown through their willingness to explore new paths and push the boundaries of conventional design and motion practices.

Questions from the audience addressed specific technical aspects of the studio's work, such as the use of Houdini for slit scan effects and the challenges of fluid dynamics in flower simulations.