As one of the pioneering AI Video Generators, Runway has developed dramatically in the last few months. Many content creators have invested in this amazing tool to generate videos and make short films.
However, recently, some users have reported that they have difficulty in writing prompts for Runway Gen-2. This might impact the quality of their projects and even waste their time and credits.
If you’re the one who is experiencing the same issue, you’ve come to the right place. In this tutorial, we’ll learn everything about Runway Gen-2 prompts. Whether you’re working on a short film, digital art, or any other multimedia project, you can use these strategies and tips to generate high-quality outputs.
Prompt Types for Runway Gen-2
To maximize the AI potential of Runway Gen-2, you should understand the prompt types first of all. Basically, Runway Gen-2 has 3 prompt types and these prompts serve as the foundation for generating videos that align with your vision.
Here is a brief introduction to each type of prompt.
- Video Prompts: Input descriptive text to specify the type of video you want to generate. Normally, it involves a subject, movement, background settings, and style. Combining these key elements, Runway Gen-2 transforms words into engaging videos. For instance, you might describe a character in a scene, and then AI will translate it into a video.
- Image Prompts: Upload an image and the image you uploaded will serve as the foundation for your video generation. The AI animates the uploaded image into a dynamic video format. You can apply this mode when you want the final video to closely resemble the image. For instance, you upload a scenery image and then it can be converted to an animated landscape video.
- Negative Prompts: Provide instructions to exclude elements that should be avoided in the video output. You can eliminate unexpected traits, styles, or elements. Negative prompts help refine the generation process and make the generated content better align with your vision. For instance, you enter “avoid violence” to avoid any scenes of violence or aggression.
Tips for Writing Effective Runway Gen-2 Prompts
Upon generating a large number of videos with Runway Gen-2, we summarize several essential tips for writing prompts. Whether you’re a novice who is exploring the basics of AI video creation or an experienced content creator who is looking to refine your techniques, you can apply these prompt strategies and skills to significantly enhance your results.
Start Simple
Begin with a simple prompt. For instance, you can start with a basic term like “dog”, because this can provide a foundation for other complex ideas.
Add Details
Once you’re satisfied with the initial general output, add specific content or details to your prompts. For example, if you’re describing an animal, explain its color, breed, movement, and background.
Specify the Type of Shot
Incorporate the type of shot you desire. For example, you can specify “an extreme close-up shallow depth of field portrait” to guide the frame and focus on the scene.
Focus on Appearance and Characteristics
When writing prompts, emphasize two aspects: what it is and what it looks like. For example, you could say “a textured historical oil painting of a bowl of fruit on a wooden table in a farmhouse kitchen.” instead of just saying “a bowl of fruit”.
Utilize Preview Functionality
Make use of the “preview” feature to see how your first prompt works. Based on the initial video preview, you can further refine your prompts.
Use Preset Video Styles
Check out the style presets at the bottom of the prompting box in Gen-2. This will give you an idea about how to get your prompt aligned with a particular artistic style.
Use Prompt Modifiers
Enhance your prompts by adding modifiers at the end. There are some effective modifiers: cinematic, shallow depth of field, warm color palette, moody, smooth texture imperfect, etc.
Keep Your Prompts Focused
You’re encouraged to cover many details in your prompts, though, always keep your description focused. Meanwhile, try to avoid overwhelming expressions.
Best Runway Gen-2 Prompt Examples
The key to making videos with Runway Gen-2 is to craft effective prompts. In this section, we’ll focus on some of the best examples of prompts for Runway Gen-2 and how different phrasing and AI types can lead to stunning visual works. Accordingly, you’ll get inspiration and insight into creating your next video.
Text to Video
A good text-to-video prompt includes a well-structured description of your vision. You can start from a specific subject and setting. Then use verbs to explain its action or movement. Additionally, it should cover the lighting conditions, mood, or atmosphere to express the visual style, as well as camera movements, such as panning or zooming.
Prompt example: A low-angle shot of an anime girl walking down a street at night, illuminated by the neon signs of the kawaii shops around her.
Output:
Text-to-video in 3D anime style with @runwayml Gen-2 🫠❤️🔥
— Claire Silver 🌸 (@ClaireSilver12) April 16, 2023
Adapted prompt from the website: “A low angle shot of an anime girl walking down a street at night, illuminated by the neon signs of the kawaii shops around her” pic.twitter.com/xortAugBr2
Image to Video
After uploading a high-quality image, you need to combine a vivid textual description of the image. Describe the subject’s action, and the setting depicted in the image.
| Prompt:
A sad man sitting on bench |
Image:
 |
|
|
Stylization
It refers to the process of converting the style of the image and prompts to all frames of your generated video. This may involve applying artistic techniques, color palettes, and thematic elements with your prompts.
| Prompt:
Gondolas going up a beautiful snowy mountain with snow-covered fir trees below, at sunset. Vantage from a gondola looking down the mountain. |
Image:
 |
|
|
Use Runway on Pollo AI
If you're looking for a smoother way to try Runway's capabilities, you can try it on Pollo AI.
Pollo AI is an innovative all-in-one AI video generator. It integrates a list of the popular AI video models including Runway, Kling AI, Hailuo AI, Vidu AI, Luma AI, and PixVerse AI.
Based on your favorite AI model, you can generate stunning videos from text, images, or video. Whether it is for social media, presentations, or work projects, you can use Pollo AI to transform your ideas into engaging visuals without special technical skills in minutes.
Here is how to use Runway in Pollo AI to generate a video:
Step 1. Navigate to Pollo AI's text to video generator or image to video generator, and select the “Runway” model.
Step 2. If you choose to generate video from your image, upload the image you want to animate from your device.
Step 3. Input a concise text prompt to describe the video you’d like to generate. For example, you could say “A fashionable woman walking through a Tokyo street”.
Step 4. Configure your customization options for your video generation.
Step 5. Click the “Create” button to initiate the video generation process.
Conclusion
As AI video generators continue to develop, it’s crucial to stay updated with the latest AI technology and the best practices. Once you‘ve understood the best practices for writing Runway Gen-2 prompts, you can use Runway Gen-2 to create a wide variety of innovative video content.
In addition, AI tools like Pollo AI have already integrated the latest AI video models including Runway. It automates video generation and thereby makes the entire process more effective. You can generate videos with ease by just entering a prompt.