Genmo.AI Create Animation Story Video With Kits AI (Tutorial Guide)

AI How To With Benji
18 Nov 202308:03

TLDRThis tutorial provides a step-by-step guide on using Genmo.AI to create animated storytelling videos. The video highlights Genmo.AI's superior ability to generate smooth animations without distorting character movements, unlike other AI tools. The process involves using ChatGPT for script creation and integrating Genmo.AI with Stable Diffusion for text-to-video and image-to-video animations. Additionally, Kits AI is used for voiceover creation, featuring voice cloning and audio enhancement. The video concludes with editing tips using CapCut to assemble the final animated video with voiceovers.

Takeaways

  • 🎥 Genmo AI is an animation generator used to create storytelling videos.
  • 🤖 Genmo AI excels at image-to-video conversion without distorting character body parts, unlike some other AI tools.
  • 💡 The example in the video focuses on creating a branding animation to convey positivity.
  • ✍️ ChatGPT was used to generate the script for the animation.
  • 🖼️ The video demonstrates both text-to-video and image-to-video animation approaches using Genmo AI.
  • ⚙️ Customization features like adjusting duration, motion, and batch generation are available in Genmo AI.
  • 🎨 Stable Diffusion models (e.g., SDXL) are used for generating scene images.
  • 🎙️ Kits AI was utilized for voice cloning and audio enhancement for the narration.
  • 🔊 Voice cloning allows users to replicate their voice tone for future audio recordings and voiceovers.
  • 🎬 CapCut was used to combine the animation with voiceovers, creating the final video.

Q & A

  • What is Genmo AI?

    -Genmo AI is an animation generator that creates storytelling videos by converting images into videos with less distortion of character body parts.

  • How does Genmo AI differ from other AI animation tools?

    -Unlike other tools like PCKA Labs, Genmo AI recreates characters' movement from scratch, reducing the chance of awkwardly twisted limbs.

  • What is the purpose of the example video being created?

    -The example demonstrates how to create a branding animation video that conveys a message of positivity.

  • What method is used for creating the animation scenes in Genmo AI?

    -The scenes are generated using text prompts from ChatGPT or by converting an initial image to video.

  • What is Stable Diffusion used for in the tutorial?

    -Stable Diffusion is used to generate images for the animation, providing greater control over the appearance of the scenes.

  • How does Genmo AI handle image-to-video transformation?

    -Genmo AI transforms images into animation without distorting people's body parts, unlike other tools where body parts may get twisted.

  • What tool is used for voiceovers in the video?

    -Kits AI is used for recording and enhancing audio, including voice cloning and vocal enhancement features.

  • What are the capabilities of Kits AI’s voice cloning feature?

    -Kits AI allows users to create a voice clone model by uploading audio files, which can then be used for future voice recordings or text-to-speech conversion.

  • What additional features does Kits AI offer to users?

    -Kits AI provides audio enhancement, voice cloning, and text-to-speech, with free accounts offering limited features and paid plans unlocking more options.

  • What is the final step in the tutorial after creating the animations and voiceover?

    -The final step is to use a video editor like CapCut to combine the animations and voiceover to produce the final storytelling video.

Outlines

00:00

🎬 Introduction to Genmo AI for Animation Creation

The video begins by introducing Genmo AI, an animation generator, and explaining its advantages for storytelling videos. Unlike other AI tools like PCKA Labs, Genmo AI avoids distorting character body parts during animation creation. The narrator demonstrates the tool by creating a branding animation to convey positivity and mentions that more information, including a script prompt, is available to Patreon supporters.

05:08

🖼️ Creating Animated Scenes Using Genmo AI

This section explains how to generate animated scenes using Genmo AI. The narrator inputs scene descriptions into Genmo AI, which are based on text prompts from ChatGPT, and adjusts settings like duration and motion. They explore the text-to-video approach and emphasize using Stable Diffusion (SDXL model) for better control over scene visuals, such as an urban city view. The tool avoids common animation issues like twisted body parts that occur with other tools.

🎤 Voice Over with Kits AI

The video moves on to creating voiceovers using Kits AI, which offers features like voice cloning and audio enhancement. The narrator highlights Kits AI’s ability to clone voices by analyzing an uploaded audio file, which allows users to match their voice tone for future recordings. The free account provides limited functionality (two voice models with 10 minutes of audio each), while the premium plan unlocks higher-quality audio and more slots for voice cloning.

🎙️ Using Kits AI for Enhanced Voiceovers

This part delves deeper into voiceover creation. After verifying the account via SMS, Kits AI trains the voice model using uploaded audio files. Users can either record voiceovers or use text-to-speech to generate audio in their cloned voice. The demo includes a Coca-Cola-themed narration generated from a voice model. Kits AI offers affordable subscription plans with unlimited conversion minutes for creators.

🎥 Final Touches: Editing and Integrating Animations

The final paragraph focuses on assembling the animated video. After creating the animations and generating the voiceover, the narrator uses a video editor (CapCut) to combine the elements. The example shows an animated Coca-Cola advertisement that emphasizes life’s celebratory moments, highlighting the brand’s role in shared joy and togetherness. Background music enhances the emotional impact of the final video.

Mindmap

Keywords

💡Genmo.AI

Genmo.AI is an AI animation generator tool used to create captivating storytelling videos. In the video, it is praised for its ability to convert images to video without distorting the characters' body parts, providing smoother animations compared to other tools.

💡Image to video conversion

This refers to the process of transforming static images into animated videos. In the context of Genmo.AI, the tool recreates the character's movement from scratch, avoiding common issues like twisted limbs that occur in other animation tools.

💡Stable Diffusion

Stable Diffusion is a machine learning model used to generate images from text prompts. The script mentions using the SDXL model in the Comi process to create images before animating them in Genmo.AI.

💡Kits AI

Kits AI is an AI tool used for voice recording, enhancement, and cloning. It provides features like voice cloning and audio enhancement, allowing users to create high-quality voiceovers for videos, as demonstrated in the tutorial.

💡Voice cloning

Voice cloning is a feature of Kits AI that allows users to replicate a voice using a sample audio file. In the video, this is used to create a consistent voiceover for the animated video by training the AI with past recordings.

💡Text to speech

Text to speech (TTS) refers to the conversion of written text into spoken words using AI. In this tutorial, Kits AI’s TTS function is used to produce voiceovers that match the voice clone created from the user’s previous recordings.

💡Script generation

Script generation is the process of creating the narrative and dialogues for the video. In this tutorial, ChatGPT is used to generate the script, which provides the foundation for the animation and voiceover in the branding video.

💡Branding animation

Branding animation refers to the creation of animated videos that convey a message or promote a brand. In the video, the tutorial demonstrates how to create a positive and engaging branding animation for Coca-Cola.

💡Customization

Customization involves adjusting settings like duration, motion, and batch size for each animation generation. The tutorial highlights how Genmo.AI allows for customization, giving users more control over the appearance of their animated scenes.

💡CapCut

CapCut is a video editing software mentioned in the video for finalizing the animation. After creating animations and voiceovers, CapCut is used to assemble everything into a cohesive storytelling video.

Highlights

Walkthrough of using Genmo.AI to create storytelling animation videos.

Genmo.AI excels at image-to-video conversion without distorting character movements.

Comparison with other AI tools like PCKA Labs, highlighting how Genmo.AI reduces awkward animations.

Use of ChatGPT for script creation for a branding animation video promoting positivity.

Text-to-video feature of Genmo.AI used for animation generation with scene descriptions from ChatGPT.

Ability to adjust duration, motion, and batch settings in Genmo.AI for customized animations.

Stable Diffusion integration with Genmo.AI for more control over image appearance.

Example of creating an urban city view scene in Genmo.AI using Stable Diffusion.

Discussion of how Genmo.AI maintains correct body proportions during animations.

Demonstration of using Kits.AI for voice-over creation and audio enhancement.

Voice cloning and vocal enhancement features recently introduced in Kits.AI.

Creating a voice clone model in Kits.AI with a free account, limited to 10 minutes of audio.

Using Kits.AI’s text-to-speech and voice clone features for audio narration in videos.

Combining animations from Genmo.AI with voice-over from Kits.AI to create a storytelling video.

Final output featuring Coca-Cola branding in a storytelling video showcasing friendship and joy.