Get all your news in one place.
100’s of premium titles.
One app.
Start reading
Tom’s Guide
Tom’s Guide
Technology
Ryan Morrison

Meet LTX Studio — I just saw the future of AI video tools that can help create full-length movies

AI video from LTX Studio.

LTX Studio is a new generative AI video platform that allows creators to make an entire production from a single prompt. During a demo of the  tool I saw a full production appear in seconds with clips, sounds and characters.

Generative AI video has quickly gone from barely viewable short clips to near production-ready in under a year. We’ve got shots so close to reality its hard to tell fact from fiction, but for the most part they are still short three or four second shots with no sound.

While there is a multitude of generation tools, and new models on the horizon from OpenAI such as Sora that will transform the market, LTX Studio’s developers are focusing on production — the whole picture not just one clip.

Built by Lightricks, the team behind the Facetune and Photoleap apps, it utilizes a number of private, in-house and open source generative AI models to make AI video production easier and from what I've seen it is a game changing moment for AI.

How does LTX Studio work?

LTX Studio is a generative content platform. It allows you to create short video clips, music, sound effects and even dialogue from a text prompt. What makes it stand out is the fact you can do all of that from within a single interface.

The team utilize a range of generative AI tools and models then integrate them across the interface to make the creation of multi-shot AI video easier.

Starting with a prompt, such as "make a drama about a couple stranded on a beach after a plane crash", it generates character profiles complete with photo, style, name and voice. 

Once it has the profiles it then creates a series of scenes, each scene contains a series of 3-4 second shots made from generative videos. You can then customize any component.

How well does LTX Studio work?

(Image credit: LTX Studio)

As part of my job I create AI content on a regular basis, this includes making music videos, commercials and trailers to demonstrate how different models and tools work. This usually involves post-production in traditional apps like Adobe Premiere.

During a demo of LTX Studio with Lightricks CEO Zeev Farbman he took the basic idea behind one of my music videos and in a few words had dozens of shots spread over a handful of scenes and custom characters ready to go.

It wasn’t perfect, the characters needed some work but the fact it got from a basic idea to a full storyboard with generated content in seconds was astounding.

The fact it got from a basic idea to a full storyboard with generated content in seconds was astounding.

What makes it even more exciting is I could customize the characters once and it changed them in every shot. 

I could also change the style for any one shot or for the entire production — for example going from photorealism to anime. 

This meant there was no need to go back and regenerate new individual clips, load them back into Premiere Pro and start again as is the case at the moment.

Farbman told me there was a big market for content creation at scale, but that one of the more surprising was from directors looking to create rapid storyboarding of ideas that could be used in pitch meetings with investors or studios.

When will LTX Studio be available?

(Image credit: LTX Studio)

The Lightricks team are still developing LTX Studio and finalizing some of the features, including an impressive sounding ability to control the camera position and movement within a shot.

This feature effectively converts the still image into a 3D scene that you can move through to change the angle and motion of the camera. You will be able to do this to any shot in a scene.

They are also exploring the potential for lip synching but admitted “none are particularly good yet”. For now dialogue is more like a voice over than you’d see in a movie or TV show.

The waiting list is already open for people wanting to get in early and the first public access is expected sometime this month. From what I’ve seen it is already a useful storyboarding tool even without the generative video component.

Why does this matter?

This isn’t the only generative AI studio product I’ve had pitched to me recently. Some start with a story, others with an image — this is more a pure generative product starting with a simple prompt but then giving very fine-tuned granular control over every element.

Studio products are the next logical step for generative AI. Being able to make a fun video clip is great, but being able to make multiple clips, add music and sound effect and dialogue is a game changing moment — and gets us closer to “Netflix, make a movie about cats on the moon”.

More from Tom's Guide

Sign up to read this article
Read news from 100’s of titles, curated specifically for you.
Already a member? Sign in here
Related Stories
Top stories on inkl right now
One subscription that gives you access to news from hundreds of sites
Already a member? Sign in here
Our Picks
Fourteen days free
Download the app
One app. One membership.
100+ trusted global sources.