Runway Image to Video

Dynamic Visuals with Natural Character Motion

With Runway AI, you can create dynamic video content based on a specific image character, style or composition that offers coherent and consistent appearance and motion across an extended sequence of video frames.

Prompt	Input Image	Output video
High-speed, dynamic angle, the camera locks onto a plastic bag floating through the air across a sandy scene. The bag is semi-transparent and floats up and down on the breeze, but remains clearly visible and in focus throughout the scene.	None
The gloved hands pull to stretch the face made of a bubblegum material
The sea anemones sway and flow naturally in the water. the camera remains still.

Smooth Interpolation Across Frames

Create smooth and fluid visual motion from still images using RunwayML's advanced interpolation capabilities that guarantee a coherent sequence of frames. This ensures any output looks like it was originally shot using an actual camera.

Image	Output video

Multiple Key Frames For Image Uploads

When generating videos with Gen-3 Alpha and Gen-3 Alpha Turbo, users can input multiple images to be used as keyframes giving you more control over the output. Gen-3 Alpha provides two keyframe slots, while the Turbo model offers three.

Varied Aspect Ratio

Instead of sticking to a standard frame size, you can select between landscape (1280x768) and portrait (768x1280). This enables you to convert images into videos that can cater to a wide range of platforms such as Instagram, X, TikTok, etc.

Additional Prompt Guidance For Tailored Results

Without any prompt guidance, the model will simply interpret the image and attempt to produce the best possible results. By providing an additional text prompt, this allows you to guide the result by adding new elements or movements for more precise video output. Click here to learn more about how to prompt RunwayML.

Runway Image to Video Techniques

With these techniques, you can ensure that you are maximizing the full extent of Runway's image-to-video generation capabilities.

• With Gen-2, use the Camera Movement feature to adjust various aspects before conversion from image to video. This can mean adjusting tilt, pan, zoom, roll, etc.

• Using Gen-2, access the Motion Brush feature to utilize different brushes and select individual parts of your image to implement controlled movement in certain directions. You can even combine Motion Brush with Camera Movements to produce videos that offer a more captivating cinematic effect.

Runway's motion brushed sample image	Output

• Add all kinds of animations and special effects in the final video by describing what you need in the additional text prompt, eg. lightning flashes, fire, etc.
• Without any additional text prompts, you may need to make repeated generations to get the result you want. Feel free to click ‘Generate' to see if the final result changes.
• Uploading vertical images can often lead to surprising and unpredictable video results, as the model will typically fill in the sides with randomly generated content.