Now loading...
Luma AI, a startup specializing in AI-generated video and 3D models with backing from Andreessen Horowitz, has launched Ray3 Modify, a new tool that enables creators to alter existing video clips by incorporating reference images of characters while keeping the original actor’s performance intact. The system also supports the input of initial and final frames to produce smooth connecting sequences.
The company announced on Thursday that Ray3 Modify addresses key challenges in AI editing for film and advertising production, particularly in maintaining authentic human elements like movement and expression. It allows production teams to film with real performers and then enhance the material digitally, ensuring consistency in the actor’s gestures, gaze direction, pacing, and emotional tone amid scene changes.
Creators can supply a character image to swap the performer’s look in the footage, preserving details such as attire, facial features, and overall persona throughout the production.
Additionally, by submitting starting and ending frames, users can generate clips that facilitate scene shifts or specific actions, helping to sustain narrative flow and character consistency.
Amit Jain, Luma AI’s co-founder and chief executive, stated, Generative video tools offer remarkable creativity but often lack precision. We are thrilled to unveil Ray3 Modify, which merges real-life captures with AI’s versatility while empowering artists with precise oversight. This lets teams record action on set and then adjust settings, outfits, or even redo takes virtually, skipping costly reshoots.
The tool is now accessible via Luma’s Dream Machine service, where it builds on video editing features the firm introduced in June this year. Luma competes in the AI video space against companies including Runway and Kling.
This rollout follows a major funding boost last month, when Luma secured 900 million dollars in a round led by Humain, an artificial intelligence venture owned by Saudi Arabia’s Public Investment Fund. Previous backers such as Andreessen Horowitz, Amplify Partners, and Matrix Partners joined the investment. The firm also aims to develop a two-gigawatt AI computing facility in Saudi Arabia in partnership with Humain.
