A look at the NEW ComfyUI Samplers & Schedulers!

Nerdy Rodent
29 Jun 202413:53

TLDRThis video explores new additions to ComfyUI, focusing on samplers and schedulers for UI improvements. It introduces Oiler Plus+ and CFG Plus+, which aim to reduce artifacts in AI-generated images. The narrator tests these on a model, comparing different samplers and their effects on image quality at varying steps and guidance scales. The video also evaluates the performance of these tools at higher resolutions, noting that while some samplers excel, others like GITs struggle with increased detail, offering a comprehensive look at the latest advancements in AI image generation.

Takeaways

  • 🆕 A lot of new features have been added to ComfyUI, including new samplers and schedulers.
  • 📜 Links to the relevant research papers are available for those interested in the technical details.
  • 🔧 The CFG Plus+ sampler aims to reduce problematic artifacts like extra details.
  • 📸 Different samplers and guidance scales can significantly impact image quality, as demonstrated with the happy alien images.
  • ⚙️ Adjusting the guidance scale for the Oiler Plus+ sampler affects the output, with higher scales potentially causing unwanted artifacts.
  • 🔍 The ancestral version of Oiler Plus+ shows variations in image quality, especially when changing the step count.
  • 🧩 IP NDM produces varied results depending on the step count and guidance scale, showing different image qualities.
  • 🌀 DEIS (Diffusion Exponential Integrator Sampler) can produce decent quality images even with fewer steps, enhancing efficiency.
  • 🔄 The GITS scheduler works well in lower resolutions but struggles with higher resolutions, showing artifacts.
  • 📊 A summary of Pixart 2K results shows that higher resolutions challenge certain samplers, with some producing better quality images than others.

Q & A

  • What new features have been added to the UI?

    -The new features added to the UI include a git schedule and a variety of new Samplers, with links to the associated papers for more detailed information.

  • What is the purpose of the new Samplers mentioned in the script?

    -The new Samplers are designed to improve image generation quality and reduce problematic artifacts such as extra tails, providing a better workflow for users.

  • What model is used to test the new Samplers in the script?

    -Pixart Sigma 1K is used as the model to test the new Samplers and their effects on image generation.

  • How does the Oiler Plus+ Sampler differ from the baseline sampler in the script?

    -The Oiler Plus+ Sampler appears to produce similar images to the baseline sampler when the guidance scale is set to half of the baseline image. However, increasing the guidance scale can lead to a 'burnt' looking output, indicating a need for careful parameter adjustment.

  • What happens when the step count is changed in the ancestral version of Oiler Plus+?

    -Changing the step count in the ancestral version of Oiler Plus+ can result in noticeable differences in image quality, such as improved teeth detail or exaggerated features like large eyes.

  • How does the IP NDM Sampler behave with different step counts?

    -The IP NDM Sampler shows significant changes in image appearance when the step count is increased from 20 to 40, indicating sensitivity to step count adjustments.

  • What is the role of the guidance scale in the IP NDM Sampler?

    -The guidance scale in the IP NDM Sampler can significantly affect the final image's appearance. For example, setting it to 4.3 can make the image resemble the reference picture more closely.

  • What is the significance of the diffusion exponential integrator sampler (DEIS) mentioned in the script?

    -The DEIS sampler is highlighted as an efficient option that can produce quality images in fewer steps, such as 20, and can maintain image quality even with a reduced number of steps like 10.

  • How does the git scheduler impact the image generation process?

    -The git scheduler can produce images in fewer steps, similar to other samplers, but it may require more steps and adjustments to the guidance scale for optimal results.

  • What are the differences between the regular and alternative versions of the Oiler CFG Plus+ sampler?

    -The regular version of the Oiler CFG Plus+ sampler is designed to reduce artifacts, while the alternative version may produce slightly different results with the same settings, as seen in the script with variations in facial features like nostrils and smiles.

  • How do the Samplers perform at higher resolutions, such as 2K, according to the script?

    -At higher resolutions like 2K, some Samplers, including git, may not perform as well, with images showing artifacts and loss of detail, while others like DEIS maintain good image quality.

Outlines

00:00

🚀 Introduction to UI Updates and Samplers

The video script introduces a variety of new features added to the UI, focusing on the git schedule and several new Samplers. Links to research papers are provided for those interested in the technical details. The presenter uses the 'pixart Sigma 1K' model to demonstrate the capabilities of the new Samplers, creating a series of 'happy aliens' with different settings to illustrate their effects. The baseline image is established using an existing sampler, and then the script explores the impact of changing guidance scale and step count on image quality, noting the potential for artifacts such as 'burnt' outputs or exaggerated features like large eyes.

05:02

🔍 Comparative Analysis of Samplers and Artifact Reduction

This paragraph delves into the comparison of different Samplers, including Oiler Plus+, its ancestral version, IP NDM, and others, with a focus on how varying step counts and guidance scales can significantly alter the resulting images. The presenter discusses the use of alternative versions of Samplers like Oiler CFG Plus+ to reduce generation artifacts and provides a visual comparison with the standard version. The script also touches on the use of the gets scheduler and its impact on image quality and the necessity of adjusting guidance scales for optimal results.

10:03

🎨 High-Resolution Testing of Samplers and Dynamic Thresholding

The final paragraph of the script discusses testing the Samplers at a higher resolution, specifically using the 'Pix art 2K' model. The presenter aims to evaluate how well the Samplers perform when generating images at a resolution of 1792 by 2304 pixels. The results from different Samplers, including the standard KSampler, git-based versions, and others, are summarized, with a focus on the quality of the images produced at 10 and 20 steps. The presenter also experiments with dynamic thresholding and the use of the IPND DMore V sampler, concluding with a brief analysis of the performance of git-based Samplers at high resolutions and the overall effectiveness of the tested Samplers.

Mindmap

Keywords

💡ComfyUI

ComfyUI refers to a user interface design philosophy that emphasizes ease of use, simplicity, and a calming aesthetic. In the context of this video, ComfyUI is likely a brand or system being discussed, with 'Samplers' and 'Schedulers' being components or features of this system. The video explores new additions to ComfyUI, indicating that it is an evolving platform with ongoing development.

💡Samplers

In the video script, 'Samplers' are mentioned as part of the UI system. Samplers in a graphical or image processing context typically refer to algorithms or tools that select and process pixels or image data to create or modify an image. The script discusses various types of Samplers, such as 'Oiler Plus+' and 'Ancestral version of Oiler Plus+', which are used to improve image quality and reduce artifacts in the generated images.

💡Schedulers

Schedulers, in the context of the video, seem to be another set of tools or features within the ComfyUI system. They are likely responsible for managing the process or workflow of image generation, possibly determining the sequence of operations or the timing of certain processes within the system. The script mentions 'gits' as an example of a Scheduler.

💡Artifacts

In image processing, 'artifacts' refer to any visual anomalies or unintended effects that occur during the generation or manipulation of an image. The script mentions that the new Samplers are designed to reduce problematic artifacts such as 'extra tals', indicating that these features aim to improve the fidelity and accuracy of the generated images.

💡Guidance Scale

The 'Guidance Scale' appears to be a parameter or setting within the ComfyUI system that influences the process of image generation. The script suggests that adjusting the Guidance Scale can have significant effects on the output, such as changing the appearance of the generated image and affecting the balance between detail and artifacts.

💡Steps

'Steps' in the script likely refers to the number of iterations or stages in the image generation process. The video discusses how varying the number of steps can lead to different results, with more steps potentially leading to higher quality images but also requiring more processing time.

💡Oiler

In the context of the video, 'Oiler' seems to be the name of a Sampler or a related tool within the ComfyUI system. The script mentions 'Oiler Plus+' and its ancestral version, indicating that there are different iterations or versions of this tool, each with its own characteristics and effects on image generation.

💡IP NDM

IP NDM is mentioned in the script as a specific type of Sampler within the ComfyUI system. It is used to generate images, and the script provides examples of how adjusting the number of steps and the Guidance Scale can alter the appearance of the generated images, suggesting that IP NDM is a versatile tool within the system.

💡Diffusion Exponential Integrator Sampler

This term refers to a specific type of Sampler discussed in the video. It is likely a more advanced or specialized tool within the ComfyUI system, designed to improve the efficiency and quality of image generation. The script suggests that this Sampler can produce good results with fewer steps compared to other Samplers.

💡Gits

As mentioned earlier, 'gits' is referred to as a Scheduler in the script. It is used in conjunction with Samplers to manage the image generation process. The video provides examples of how using gits with different Samplers can yield varying results, indicating that it plays a crucial role in the overall performance and output of the ComfyUI system.

💡Resolution

In the context of the video, 'resolution' refers to the pixel dimensions of the generated images. The script discusses testing the Samplers at higher resolutions, such as 2K, to evaluate their performance and the quality of the images they produce. Higher resolution images are more detailed but also more challenging for image generation systems.

Highlights

Introduction of new ComfyUI Samplers & Schedulers for UI improvements.

Availability of links to academic papers for in-depth understanding.

Testing new Samplers on Pixart Sigma 1K model to demonstrate their capabilities.

Comparison of baseline image with new Samplers to evaluate performance.

Demonstration of Oiler Plus+ Sampler and its effect on image quality with different guidance scales.

Use of ancestral version of Oiler Plus+ and its impact on image differences with varying step counts.

IP NDM Sampler's unique behavior with step count adjustments.

Adjusting guidance scale to achieve closer resemblance to reference images.

Introduction of ipnd dmore V Sampler and its visual output variations.

Impact of low guidance scale on image generation with ipnd dmore V Sampler.

Diffusion exponential integrator sampler's performance in minimal steps.

GITS Scheduler's efficiency in reducing steps required for image generation.

Custom sampler Oiler CFG Plus+ and its versions' effectiveness in reducing artifacts.

Comparison of different versions of Oiler CFG Plus+ with and without GITS Scheduler.

Performance of IP NDM with GITS Scheduler and its image quality at different steps.

Evaluation of ipnd dmore V with GITS Scheduler and its visual clarity.

Use of dynamic thresholding and guidance scale adjustments for unique image compositions.

Testing Samplers at higher resolutions like 2K and their performance.

Summary of Sampler performance at 2K resolution and identification of best performers.

Final thoughts on the effectiveness of new Samplers and Schedulers in ComfyUI.