How AI-Generated Video is Changing Film


Welcome to the unsettling world of Artificial Intelligence moviemaking.

“We kind of hit a point where we just stopped fighting the desire for photographic accuracy and started leaning into the weirdness that is DALL-E,” says Stephen Parker at Waymark, the Detroit-based video creation company behind The Frost.

The Frost is a 12-minute movie in which every shot is generated by an image-making AI. It’s one of the most impressive—and bizarre—examples yet of this strange new genre.

To make The Frost, Waymark took a script written by Josh Rubin, an executive producer at the company who directed the film, and fed it to OpenAI’s image-making model DALL-E 2. After some trial and error to get the model to produce images in a style they were happy with, the filmmakers used DALL-E 2 to generate every single shot. Then they used D-ID, an AI tool that can add movement to still images, to animate these shots, making eyes blink and lips move.

“We built a world out of what DALL-E was giving back to us,” says Rubin. “It’s a strange aesthetic, but we welcomed it with open arms. It became the look of the film.”

Read More at MIT Technology Review

Read the rest at MIT Technology Review