Creative Exploration - Flux - First Look with Midjourney Man

Purz
2 Aug 2024144:25

TLDRJoin hosts Pers and MJ, the Mid Journey Man, for a creative exploration of AI art generation. They discuss MJ's journey with AI, his background as an engineer, and their shared passion for tinkering with AI art tools. The duo excitedly tests the newly released AI model 'Flux' from Black Forest Labs, comparing it with 'Mid Journey', and shares their process of troubleshooting and experimenting with prompts to create unique visuals. The conversation is filled with enthusiasm for the endless possibilities of AI in the creative process.

Takeaways

  • 😀 The video is a 'Creative Exploration' session featuring a conversation with 'MJ', also known as 'Mid Journey Man', an artist and engineer who specializes in AI-generated art.
  • 🎨 MJ has been involved in the AI art scene for over two years, starting with 'mid Journey' and is known for his deep exploration and creation of AI art, particularly on Instagram.
  • 🔧 MJ's background as a mechanical engineer influences his approach to tinkering with AI art tools, appreciating the flexibility and hands-on aspect of 'comfy' over more automated tools.
  • 🤖 The discussion highlights the release of 'Flux', a new AI model developed by the team from Black Forest Labs, which was previously part of Stability AI.
  • 🆕 Flux offers both commercial and open-source versions of its models, with a unique licensing model that prohibits training on competing models but allows for commercial use of outputs.
  • 🔍 The hosts test the Flux model during the stream, comparing it with Mid Journey, and discuss its potential to be a game-changer in the AI art community.
  • 🎭 The conversation includes technical discussions about the setup process for using Flux in 'comfy', including the installation of necessary files and models.
  • 📚 Emphasis is placed on the importance of community and sharing knowledge, with mentions of other influential figures in the AI art space like Phil AKA 'machine delusions'.
  • 🎨 The hosts experiment with various prompts and resolutions to see how Flux handles different aspects and styles of AI-generated images.
  • 🔧 The video also explores the use of 'image damage' and 'upscaling' features in Flux, demonstrating its capabilities in enhancing and refining images.
  • 🌐 The closing remarks encourage viewers to engage with the community, share their creations, and utilize the new Flux model to push the boundaries of AI art.

Q & A

  • Who are the hosts of the 'Creative Exploration' show?

    -The hosts of the 'Creative Exploration' show are Pers and MJ, also known as Mid Journey Man.

  • How did Pers and MJ meet?

    -Pers and MJ met at the Comfy Conference in LA where they hit it off and had a great time.

  • What is MJ's background before getting into AI art?

    -MJ is an engineer by trade, with a brain wired to tinker and think, which led him to explore AI art.

  • What is the significance of the name 'Mid Journey Man'?

    -The name 'Mid Journey Man' signifies MJ's intention to put a lot of time and effort into exploring AI art, becoming a journeyman in the field.

  • What is the relationship between MJ and the AI tool 'Mid Journey'?

    -MJ is not affiliated with 'Mid Journey' officially, but he was inspired by the tool to create his online persona and explore AI art deeply.

  • What is the new AI model 'Flux'?

    -Flux is a new AI model released by Black Forest Labs, the team that left Stability AI, and it is potentially as good as, if not better than, Mid Journey.

  • What is the commercial aspect of Black Forest Labs' AI models?

    -Black Forest Labs offers a commercial side with pro models accessible via API for credits, while also releasing open versions of their models to the public with certain licensing restrictions.

  • What is the licensing stipulation for using the outputs from Black Forest Labs' models?

    -The licensing stipulation is that users cannot use the outputs to create competing models, but they can use the outputs for commercial work without the company owning the outputs.

  • What is the significance of the 'fp8' version of the Flux model?

    -The 'fp8' version of the Flux model allows for inference on systems with lower VRAM, making it accessible for users with less powerful GPUs.

  • What is the workflow for using the Flux model in Comfy UI?

    -The workflow involves downloading the appropriate model weights and Comfy UI workflow from the provided links, updating Comfy UI to support Flux, and placing the files in the correct folders within the Comfy UI directory structure.

Outlines

00:00

🎨 Artistic Collaboration and AI Introduction

The video script begins with a warm welcome to a creative exploration session featuring the host and his friend MJ, also known as Mid Journey Man. The host encourages viewers to follow MJ on social media and expresses excitement about their shared artistic wavelength. MJ introduces himself, discussing his journey into AI, starting with 'mid Journey' and his progression as an AI enthusiast and content creator. He clarifies that he is not affiliated with 'me Journey' despite the name and shares his background as a mechanical engineer, which fuels his passion for tinkering with AI tools like 'comfy' and 'noodles'.

05:01

🤖 Exploring AI in Art and New Developments

The conversation shifts to discussing the latest developments in AI art, specifically focusing on 'flux', a new model released by Black Forest Labs. The hosts express excitement about the potential of this model, which is positioned as a commercial alternative to existing AI tools. They discuss the licensing terms, the possibility of using the outputs for commercial work, and the restrictions against training competing models with the outputs. The hosts also mention other AI tools and their personal experiences with them, highlighting the appeal of being able to experiment with different AI models.

10:02

🚀 Launching into Technical Details and Model Setup

The script delves into the technical aspects of setting up and using the new AI model 'flux'. The hosts discuss the system requirements, the size of the model, and the potential challenges of running it on their computers. They talk about the different versions of the model, such as 'Dev' and 'Schnell', and the importance of having the right components like the T5 XXL clip and the VAE model. The hosts also share their process of downloading and setting up the necessary files for 'comfy' to work with 'flux', indicating a hands-on approach to engaging with AI art tools.

15:06

🔍 Troubleshooting and Testing AI Art Generation

The hosts encounter technical difficulties while trying to run the 'flux' model, leading to a discussion about troubleshooting and the challenges of working with AI art tools. They share their experiences with running out of VRAM and RAM, and the need to manage system resources effectively. The conversation also touches on the importance of having the right workflow and the potential for creative experimentation with AI, despite the technical hurdles.

20:07

🎭 Experimenting with AI Art Prompts and Techniques

The script moves into the experimental phase of using AI art generation, where the hosts discuss using prompts to guide the AI in creating specific images. They talk about the process of selecting prompts, the idea of chaining elements that might not typically make sense together, and the excitement of discovering unique and personal results. The hosts also mention other artists in the AI community and the value of learning from each other's techniques and approaches.

25:09

🖼️ Discussing AI Art Outputs and Creative Potential

The hosts share their thoughts on the outputs generated by the AI art model, discussing the quality, the composition, and the potential for further creative development. They talk about the possibility of using the generated images in animations and the unique approach MJ has to animation, emphasizing intention and choice over randomness. The conversation also includes a discussion about the community's reaction to the new 'flux' model and the excitement it has generated among AI art enthusiasts.

30:10

🛠️ Navigating Technical Challenges and Model Limitations

The script highlights the technical challenges the hosts face while trying to run the 'flux' model, including issues with memory usage and the need to switch to different versions of the model to accommodate their system's capabilities. They discuss the differences between the 'Dev' and 'Schnell' versions, the importance of selecting the right model for their needs, and the potential for using APIs for easier access to more powerful models.

35:13

🎨 Reflecting on Creative Process and AI Art Evolution

The hosts reflect on their creative process with AI art, discussing the evolution of the tools and the community's response to new developments. They share their excitement about the potential of AI in art and the opportunities it presents for creative exploration. The conversation also includes a discussion about the importance of community and collaboration in pushing the boundaries of what's possible with AI art.

40:13

🏆 Celebrating Achievements and Looking Forward to Future Projects

The script concludes with a celebration of achievements, including MJ's win in a project contest, and a look forward to future projects involving AI art. The hosts encourage each other and their audience to continue exploring and experimenting with AI art, highlighting the importance of community support and the potential for growth and development in the field.

Mindmap

Keywords

💡Creative Exploration

The term 'Creative Exploration' refers to the process of delving into new or existing areas of interest with a creative mindset. In the context of the video, it signifies the journey of the host and his guest, MJ, as they experiment with AI-generated art, exploring its capabilities and pushing boundaries.

💡Midjourney Man (MJ)

Midjourney Man, also known as MJ, is the nickname and online persona of Julian, a mechanical engineer who has been deeply involved with AI art for over two years. His involvement began with the beta version of a journey, and he has since become a prominent figure in the AI art community, known for his expertise and creative use of AI tools.

💡AI Scene

The 'AI Scene' refers to the community and environment surrounding the use of artificial intelligence in creative processes, particularly in art. In the script, MJ mentions being part of the AI scene, indicating his active participation and contribution to this emerging field.

💡Disco Diffusion

Disco Diffusion is a specific AI tool used for generating images based on textual prompts. It is mentioned in the script as one of the early AI art tools that captured MJ's interest, highlighting his early adoption of AI in his creative process.

💡Def Animations

Def Animations likely refer to 'Deepfake' animations, which are synthetic media created with AI algorithms that can make it appear as though a person in an existing image or video is doing something they are not. In the context of the video, it is one of the many AI-driven creative techniques that the host and MJ discuss.

💡Comfy

In the script, 'Comfy' refers to a user interface or platform for working with AI models, allowing users to experiment with different settings and parameters. It is highlighted as a flexible and customizable tool that appeals to 'tinkerers' like MJ and the host.

💡Flux

Flux is a new AI model released by Black Forest Labs, as mentioned in the script. It is a topic of excitement and exploration for both the host and MJ, who plan to test its capabilities and compare it with other AI models they have been using.

💡VRAM

VRAM, or Video Random Access Memory, is a type of memory used by graphics processing units. In the context of the video, it is a critical resource for running AI models that require substantial graphical processing power. The script discusses the limitations and challenges of working with large AI models and the VRAM they require.

💡Hugging Face

Hugging Face is a company that provides a platform for AI models, including those used in the video for AI-generated art. The script mentions it as the platform where the new Flux model was released, indicating its role in the distribution of AI tools for creative exploration.

💡Aspect Ratio

Aspect ratio is the proportional relationship between the width and height of an image or screen. In the video, the host and MJ discuss aspect ratios in the context of testing the AI model Flux's ability to generate images at unconventional resolutions, demonstrating the model's flexibility.

Highlights

Introduction of a new AI model called Flux by Black Forest Labs, the team behind the CompVis model from Stability AI.

Flux is available for commercial use with a unique licensing model that allows use of outputs for commercial work without ownership.

The model's large size of 25 gigabytes may pose challenges for users with limited VRAM.

MJ, the Mid Journey Man, shares his journey from being an engineer to becoming deeply involved with AI art and animation.

Discussion on the creative freedom and flexibility offered by Comfy UI for artists to experiment with AI models.

Comparison between automatic AI models and node-based systems like Comfy UI, emphasizing the latter's appeal to tinkerers.

The hosts experiment with different prompts and resolutions to test the capabilities of the Flux model.

MJ shares his approach to animation, emphasizing intention and planning over random generation.

The potential of Flux for creating high-quality images that can be used for commercial purposes is explored.

Technical difficulties and solutions when working with large AI models are discussed, including the use of FP8 versions to reduce VRAM usage.

The hosts compare the outputs of Flux with those of Mid Journey, noting differences in quality and detail.

A live demonstration of troubleshooting AI model issues, such as dealing with VRAM limitations and workflow updates.

The community's excitement and participation through chat prompts, leading to creative and humorous image generations.

The use of Comfy UI workflows to streamline the process of using AI models like Flux.

A showcase of the diverse and imaginative prompts provided by the community, resulting in unique AI-generated images.

The hosts' decision to switch to using the Dev model over Schnell due to superior image quality.

The potential of Flux as an upscaler, with impressive results shown in the live demonstration.

The conclusion of the session with a reflection on the capabilities of Flux and its impact on AI art creation.