6 min read
Lesson 3 of 6
Image-to-Video & Motion Brush
From the course Runway ML Video Masterclass
Image-to-video gives you much more control over the output by starting with a reference image.
Image-to-Video Workflow
- Upload a source image (photo, AI-generated image, artwork)
- Add a text prompt describing the desired motion
- Set camera movement and duration
- Generate the video
Why Image-to-Video is Often Better
- Predictable composition — The first frame matches your image exactly
- Style consistency — Maintain a specific visual style throughout
- Creative pipeline — Generate images in Midjourney/FLUX → animate in Runway
- Character consistency — The subject looks exactly how you designed them
Motion Brush
Motion Brush lets you paint motion onto specific areas of an image:
- Upload or select an image
- Use the brush tool to select areas
- For each painted region, set:
- Direction — Which way should it move?
- Speed — How fast should the motion be?
- Ambient — Add subtle environmental motion
- The rest of the image stays static
Example: A portrait where only the hair moves in the wind, or a landscape where the water flows but the mountains are still.
Multi-Region Motion
Paint different regions with different motions:
- Water flowing left
- Clouds drifting right
- Leaves falling down
- Subject remaining still
This creates sophisticated, controlled animations from a single still image.
Tips for Image-to-Video
- Use high-resolution images (at least 1280x720)
- Simple, clear compositions work better than busy scenes
- Describe motion relative to the image: "the person turns their head to the right"
- Combine with extend feature to create longer sequences
Key Takeaways
- •Image-to-video provides more control by starting from a specific first frame
- •Motion Brush lets you paint directional motion onto specific areas
- •Multi-region motion creates sophisticated animations from still images
- •Combine with Midjourney/FLUX for a powerful image → video pipeline
0 of 6 lessons marked complete
Progress is kept in this browser only.