API, Workflows & Advanced Techniques
From the course Luma AI: 3D & Video from Photos
Integrate Luma AI into production workflows using the API and advanced generation techniques.
Luma API
Programmatic Access
- Generate videos via API calls
- Submit 3D capture jobs programmatically
- Retrieve results with webhook notifications
- Scale generation for content pipelines
API Workflow Example
// Generate a video with Dream Machine API
const response = await fetch('https://api.lumalabs.ai/dream-machine/v1/generations', {
method: 'POST',
headers: { 'Authorization': 'Bearer YOUR_API_KEY' },
body: JSON.stringify({
prompt: "Cinematic aerial shot of a mountain lake at sunset",
aspect_ratio: "16:9",
keyframes: { frame0: { type: "image", url: "https://..." } }
})
});
Advanced Video Techniques
Keyframe Control
- Set start frame (image or generation)
- Set end frame for precise motion control
- Interpolate between keyframes naturally
- Create seamless loops by matching start and end
Video Extension
- Generate initial clip
- Use the last frame as input for extension
- Chain multiple extensions for longer videos
- Maintain visual consistency across extensions
Style Consistency
- Use reference images to maintain visual style
- Describe consistent lighting and color grading
- Reference the same "camera" across generations
- Build cohesive video series with matching aesthetics
Creative Applications
Music Videos
- Generate abstract and surreal visuals
- Create dreamlike scene transitions
- Animate album artwork for visual accompaniment
- Produce lyric videos with dynamic backgrounds
Film Pre-visualization
- Generate concept shots for storyboarding
- Test camera angles and movements before filming
- Create mood reels for client presentations
- Prototype visual effects sequences
Social Media Content
- Create attention-grabbing video posts
- Generate unique story and reel content
- Produce thumbnail previews for YouTube
- Design animated headers and backgrounds
Named Example: Warner Music Group & Adobe
Warner Music Group's marketing teams used Dream Machine to generate abstract visual content for artist social media campaigns — creating surreal, cinematic loops that match album aesthetics in hours instead of days. Adobe partnered with Luma AI to integrate Dream Machine's API into Adobe Premiere Pro's "Generate B-Roll" feature (in beta), letting video editors describe a shot they need and generate it without switching platforms.
Common Pitfall: Chaining too many Dream Machine video extensions (more than 4-5) causes progressive visual drift — colors shift, subjects morph, and the scene loses coherence from the original. For longer videos, periodically regenerate from a fresh keyframe rather than extending continuously.
Best Practice: When building music video visuals with Dream Machine, generate your hero clips at 16:9, then generate separate 9:16 vertical versions for Instagram Reels using the same prompt adapted with "vertical portrait framing." Many creators try to crop 16:9 footage to 9:16, which cuts out critical visual elements.
Key Takeaways
- •The Luma API enables programmatic video generation and 3D capture at scale
- •Keyframe control with start and end frames provides precise motion and composition guidance
- •Video extension chains multiple generations for longer content with visual consistency
- •Creative applications span music videos, film pre-visualization, and social media content
Progress is kept in this browser only.