Runway Gen 3 All Hype or The Real Deal?
TLDRRunway Gen 3, the latest AI video generation tool, impresses with its high fidelity and motion details in text-to-video conversion. Despite some imperfections like inaccurate character movements and occasional glitches, it shows significant advancement from Gen 2. The platform offers a user-friendly interface with prompt structure guidance and sample prompts. However, the cost of generating videos is high, with 10 credits per second, making it a pricey option for creators. The tool excels in natural landscapes but has room for improvement in character and motion accuracy.
Takeaways
- 😀 Runway Gen 3, Alpha is now available to all subscribers, offering improved text-to-video capabilities.
- 📹 The fidelity and consistency of the generated videos appear to be promising, with high motion and high fidelity in cherry-picked results.
- 🚀 It's a step forward in text-to-video technology, though there are still limitations and areas for improvement.
- 🌿 Nature and natural landscapes seem to render well, with realistic and smooth details in the generated videos.
- 👩🦰 An example of a woman in a leather jacket walking at night had some issues with perspective but showed good slow-motion effects.
- 🔄 There were instances of morphing errors, such as a person appearing to have two hands or a car passing through a person.
- 💻 To get started with Runway, one needs to log in at Runway ml.com and follow the interface prompts for creating videos.
- 📝 The platform provides a guide with a structure for prompts, including camera movement, scene establishment, and additional details.
- 💡 Users can utilize camera styles, lighting styles, and movement speeds to construct their prompts effectively.
- 💰 Generating videos on Runway can be expensive, with 10 credits per second of video, making short clips costly.
- 🚫 Currently, there is no image-to-video feature, and motion controls are limited to text prompts for motion and scene.
- 🎨 Text effects and transformations, such as dripping paint or smoke to text, can be attempted but may not always render as expected.
- 🐺 Wildlife and action scenes, like a wolf running in the forest, can capture details but may have inaccuracies in motion.
Q & A
What is Runway Gen 3 Alpha and what does it offer to its subscribers?
-Runway Gen 3 Alpha is a text-to-video AI technology that is now available to all subscribers. It promises high fidelity and consistency, with the ability to create videos based on text prompts, and is considered a step forward in text-to-video technology.
What are some of the limitations mentioned in the script about Runway Gen 3's capabilities?
-The script mentions that while Runway Gen 3 shows promise, there are still limitations, particularly in areas such as motion accuracy and handling complex prompts without producing anomalies in the video output.
Can you provide an example of a text prompt that was used to generate a video in the script?
-One example given in the script is a prompt for an FPV shot starting with an ice glacier cave that transitions into a natural rainforest, showcasing the system's ability to create realistic and smooth movements.
How does Runway Gen 3 handle prompts with specific details like 'ripped jeans' or changing 'ethnicity'?
-The script indicates that while Runway Gen 3 can pick up on some specific details like ethnicity, it may not always accurately incorporate all details, such as ripped jeans, and can sometimes result in odd visual anomalies.
What is the process for getting started with Runway Gen 3 according to the script?
-To get started with Runway Gen 3, one needs to visit runwayml.com, log in with their details, click on 'get started', and follow the interface prompts, including a guide that provides information on creating effective video prompts.
What are some of the camera styles and lighting styles mentioned in the guide for creating prompts?
-The guide mentions camera styles such as low angle, high angle, and overhead view, as well as lighting styles like diffused light, silhouette, lens flare, backlit, and side lit, which are helpful for constructing detailed prompts.
How much does it cost to generate a video with Runway Gen 3, and what is the standard plan like?
-Runway Gen 3 uses 10 credits per second of video generated. A 10-second clip would cost 100 credits. For a standard plan user, this could be quite expensive, as the monthly credit limit might not be very high.
What are the current limitations regarding motion and scene controls in Runway Gen 3?
-As of the script's recording, Runway Gen 3 does not offer image-to-video capabilities or motion brushes like in Gen 2. Users must prompt for motion and scene details, which may limit the control over the final video output.
Can you provide an example of a text effect prompt that was attempted in the script?
-The script mentions an attempt at a 'dripping paint' text effect prompt and a 'cloud of smoke transforming to text' prompt, both of which yielded visually interesting but not entirely expected results.
What feedback does the script provide on the results of the 'wolf running in the forest' and 'cheetah running' prompts?
-The script notes that while the details and camera movements in these prompts were good, the motion of the animals needed improvement, with the wolf appearing injured and the cheetah's tail morphing into a strange shape.
How can users utilize tools like chat GPT to assist in creating prompts for Runway Gen 3?
-Users can use chat GPT to help generate detailed prompts by providing it with information and a subject, such as 'a man running in the forest as a wolf chases him in hyper speed', to create a more structured and effective prompt.
Outlines
🎥 Runway Gen 3: Text to Video Advancements
This paragraph introduces Runway Gen 3, a text-to-video AI tool now available to all subscribers. The speaker discusses the high fidelity and promising consistency of the tool, comparing it to previous generations. They highlight the advancements in AI video, despite feeling that progress has been slow. The speaker shares examples of successful text-to-video conversions, such as an FPV shot of a glacier cave leading to a rainforest, and a woman walking in the city at night. They note the limitations, such as incorrect details like a car passing through a woman, and the morphing of people in another example. The paragraph concludes with instructions on how to get started with Runway, emphasizing the importance of following the provided guide for prompt structure.
💰 Cost and Limitations of Runway Gen 3
The second paragraph delves into the cost of using Runway Gen 3, noting the high credit consumption for video generation, especially for longer clips. The speaker mentions the lack of image-to-video capabilities and the absence of motion controls compared to Gen 2. They share their own experiences with the tool, including prompts for different scenes and styles, such as a Moody filmic style shot of a horse at sunset and a woman in a cafe. The speaker also attempts text effects like dripping paint and a cloud of smoke transforming into text, with mixed results. They conclude by sharing their thoughts on the tool's performance in creating nature landscape scenes and wildlife shots, pointing out areas for improvement in motion accuracy and creature depiction.
Mindmap
Keywords
💡Runway Gen 3
💡Fidelity
💡Text to Video
💡High Fidelity
💡Cherry-picked
💡FPV Shot
💡Prompt Structure
💡Camera Styles
💡Lighting Styles
💡Movement Speeds
💡Credits
💡Cinematic Scene
Highlights
Runway Gen 3, Alpha is now available to all subscribers, promising high fidelity and consistency in text-to-video conversion.
The advancement in AI video has been slow, but Runway Gen 3 is a step forward in text video.
Runway Gen 3's cherry-picked results show great motion and high fidelity.
The platform does well with natural landscapes in text-to-video conversion.
A demonstration of an FPV shot transitioning from a glacier cave to a rainforest showcases realistic movement and details.
A woman walking in the city at night with slow motion and hair details is presented, though with some inaccuracies.
Runway Gen 3's interface and guide provide structure for creating video prompts.
The guide offers examples of camera styles, lighting styles, and movement speeds for prompt construction.
Chat GPT can assist in creating detailed text-to-video prompts based on provided information.
Runway Gen 3 is expensive to use, with 10 credits per second of video generated.
There are no image-to-video capabilities or motion controls available yet in Gen 3.
A prompt for a night riding horse in the forest at sunset shows good details but inaccurate motion.
Text effects like dripping paint and neon signs are demonstrated with varying success.
A cinematic scene of a wolf running in the forest with fog shows good camera movement but needs improvement in the wolf's motion.
A wildlife scene with a cheetah running has some morphing issues and an odd tail.
Runway Gen 3 excels with nature landscape scenes, as shown in the FPV shot example.
The reviewer encourages viewers to share their thoughts on Runway Gen 3 in the comments.