ComfyUI Relighting ic-light workflow #comfyui #iclight #workflow

12 May 202405:16

TLDRIn this video, the host introduces ComfyUI's ic-light workflow, a powerful tool for adjusting lighting on objects while considering color and shadow effects in relation to the background. The workflow is credited to lias, with a demo and necessary nodes available for download. The video demonstrates how to use the tool by loading an image, creating a mask, and adjusting proportions and lighting. The host also discusses optimizing the mask creation process, experimenting with blur radius, and using an IP adapter to enhance the atmosphere of the image. The final result showcases a harmonious blend of character and background lighting, emphasizing the tool's value in the creative process.


  • ๐ŸŽจ **ComfyUI Relighting Tool Introduction**: The video introduces a tool that allows users to adjust lighting, colors, and shadows on objects, with reference to the background and project settings.
  • ๐Ÿš€ **Credit to Contributors**: The project is credited to 'lias' and 'Kaji', with links to the repo and Comfy UI provided in the video description.
  • ๐Ÿ“š **Downloading Nodes and Models**: Users can download necessary nodes from the Comfy Manager and find models in the manager or download them manually to place under the 'unet' folder.
  • ๐Ÿ” **Workflow Overview**: The video demonstrates a workflow using a 'remove background' node instead of a disconnected object node, and loading an image for the model and background.
  • ๐ŸŽญ **Masking and Proportion Adjustment**: A mask is created for the object, and the 'keep proportion' setting is adjusted to correct image proportions.
  • ๐ŸŒ„ **Background Image Consideration**: The tool works better without a background image for some cases, as demonstrated in the video.
  • โ“ **Question Mark Feature**: Clicking the question mark provides information on how to add a background, which requires working with a specific model.
  • ๐Ÿ–Œ๏ธ **Custom Masking**: The presenter suggests optimizing the mask creation process by drawing directly on the image for more control.
  • ๐Ÿ”„ **Mask Positioning and Lighting Effects**: The mask's position significantly affects the lighting direction in the final render.
  • ๐Ÿ“ˆ **IP Adapter for Atmosphere**: An IP adapter is used to connect the image to the background and add atmosphere, with adjustable weights for effect strength.
  • ๐Ÿค– **Robot Example**: A demonstration of placing a robot on a night street background, adjusting the mask and IP adapter for the desired lighting effect.
  • ๐ŸŒ— **Transparency and Blur Radius Adjustment**: Modifying the transparency and blur radius can smooth transitions and enhance the final image.
  • โš™๏ธ **IC Light Conditioning**: The tool includes IC light conditioning to play with multipliers, affecting the contrast of the result.
  • ๐Ÿ“ˆ **Final Result with IP Adapter**: The video concludes with the final rendered image, showcasing the control and creativity the tool offers.

Q & A

  • What is the main purpose of the tool discussed in the video?

    -The main purpose of the tool is to change the lighting on a certain object while adjusting colors and shadows, with reference to the background and the project.

  • Who is credited with the development of this tool?

    -The credit for the development of this tool goes to lias.

  • How can one access the demo and the repository for this tool?

    -The presenter will leave a link to the demo and the repository in the description of the video.

  • What is the simplest way to install the necessary nodes for the tool?

    -The simplest way to install the necessary nodes is to load the workflows attached to the examples and install the missing nodes through the comfu manager.

  • Where can the models for the tool be found and downloaded?

    -The models can be found and downloaded manually from a specific page provided in the video description, and then placed under the 'unet' folder in the models folder.

  • What is the role of the red node in the workflow?

    -The red node, which is likely from another package, is responsible for disconnecting an object from the background.

  • How does the presenter suggest optimizing the mask creation process?

    -The presenter suggests using a 'load image' node to draw the mask on the image where desired, which allows for more freedom and comfort in the mask creation process.

  • What is the effect of changing the position of the mask?

    -Changing the position of the mask affects the lighting direction in the final image, as demonstrated when the lighting appears to come from the right side after adjustment.

  • How does the blur radius impact the final image result?

    -The blur radius impacts the spread and softness of the lighting effect in the final image, with higher blur radii creating softer transitions.

  • What is the purpose of the IP adapter in the process?

    -The IP adapter is used to adjust the atmosphere and lighting of the background, allowing for a more harmonious integration of the object with the background.

  • How can the presenter improve the transition between the robot and the background in the final image?

    -The presenter suggests changing the transparency to false and adjusting the blur radius and weights of the IP adapter to achieve a smoother transition.

  • What does the IC light conditioning allow the user to control?

    -IC light conditioning allows the user to control the multiplier, which affects the contrast of the final image.



๐ŸŽจ Customizing Lighting and Shadows in Images

The video introduces a tool that enables users to manipulate lighting, colors, and shadows on specific objects within an image while considering the background. The project, credited to 'lias', is available on Comfy, with a link provided in the video description. The presenter demonstrates how to use the tool with a workflow from the 'kiji' example. They discuss the process of loading images, creating and adjusting masks, and the impact of these masks on the final image's lighting and harmony. The video also covers the use of a 'remove background' node and the importance of keeping image proportions. The presenter experiments with different settings, such as blur radius and IP adapter weights, to achieve desired effects and improve the workflow for mask creation. The tool is showcased as a valuable addition to the creative process, offering more control over image editing.


๐Ÿ“ข Conclusion and Engagement Invitation

The presenter concludes the video by encouraging viewers to look forward to the next lessons. They invite the audience to subscribe to the channel, ask questions, and engage by liking the video if they enjoyed it. The presenter emphasizes the importance of having fun while learning and exploring the tool's capabilities. The tone is positive and welcoming, aiming to foster a community of learners and users interested in the discussed tool.




ComfyUI is a user interface tool or platform mentioned in the title and throughout the transcript. It is the context in which the lighting workflow is being discussed. In the video, it is used as a platform to facilitate the process of changing lighting on objects within a project, which is the main focus of the tutorial.


Relighting refers to the process of changing or adjusting the lighting of an object or scene within a digital or visual project. In the context of the video, it involves using the ComfyUI tool to manipulate the lighting effects on a certain object, which is a key aspect of the workflow being demonstrated.


A workflow is a series of connected steps or processes that are undertaken to complete a project or task. In the video, the term 'workflow' is used to describe the sequence of operations that the user goes through to achieve the desired lighting effects using the ComfyUI tool.


Lias is mentioned as the creator or contributor to the tool that allows changing the lighting on objects. The credit is given to Lias for the development of this functionality, indicating their role in the project's success.


Short for 'repository,' a repo is a storage location where digital files, such as code or documentation, are kept and can be accessed by multiple users. In the transcript, the speaker mentions leaving a link to the repo in the video description, which implies that viewers can access the source code or related files for the lighting tool discussed.

๐Ÿ’กComfyUI Manager

The ComfyUI Manager is a tool or interface through which users can download necessary nodes for their projects. It is mentioned as a resource for obtaining the components required to use the lighting workflow being discussed in the video.


In the context of this video, nodes represent individual components or modules within the ComfyUI tool that perform specific functions. They are used to construct the workflow for achieving the desired lighting effects on an object.


A mask, in this digital editing context, is a selection tool that allows for the isolation of certain parts of an image for specific effects. The video discusses creating a mask to control where the lighting effects are applied, which is crucial for the relighting process.

๐Ÿ’กIP Adapter

The IP Adapter seems to be a component or setting within the ComfyUI tool that allows for the adjustment of image properties, such as lighting and color. It is used to fine-tune the final appearance of the object within the scene, as demonstrated when the speaker tries to add atmosphere to the picture.

๐Ÿ’กBlur Radius

Blur radius refers to the extent of the blurring effect applied to an image or a selection within an image. In the video, the speaker discusses adjusting the blur radius to control the softness of the lighting transition, which affects the final visual outcome.

๐Ÿ’กIC Light Conditioning

IC Light Conditioning appears to be a feature or process within the ComfyUI tool that allows for the manipulation of lighting characteristics, such as contrast and brightness. It is mentioned as a way to further refine the lighting effects on the object after the initial adjustments.


Introduction to a new tool for changing lighting on objects with adjustments to colors and shadows.

Credit given to Lias for the development and Kaji for making the project available on Comfy.

Demonstration of the tool with a link to the repo and instructions on how to download and install necessary nodes.

Explanation on how to use the tool with a model and background image to create a harmonious result.

The importance of the mask in the lighting process and its role in creating a more natural look.

Adjusting the mask to affect lighting direction and improving the workflow for mask creation.

Optimizing the mask drawing process for more freedom and comfort in the creative workflow.

The impact of blur radius on the final lighting effect and how it can be adjusted for different results.

Using the IP adapter to connect lighting and atmosphere to the background for a more integrated look.

Adjusting the weights of the IP adapter to control the intensity of the lighting effect.

Experimenting with different images and lighting scenarios to showcase the tool's versatility.

Addressing issues with background transitions and improving the smoothness of the final image.

The use of IC light conditioning to play with the multiplier for contrast adjustments.

Final result demonstration with the addition of the IP adapter for enhanced lighting and atmosphere.

Emphasis on the tool's ability to add control to the creative process and its potential for various applications.

Invitation to subscribe, ask questions, and engage with the content for further learning and enjoyment.