NEW YORK (Reuters) – Facebook owner Meta (META.O) announced on Friday it had built a new AI model called Movie Gen that can create realistic-seeming video and audio clips in response to user prompts, claiming it can rival tools from leading media generation startups like OpenAI and ElevenLabs. #MetaAIVideoGeneration
Samples of Movie Gen’s creations provided by Meta showed videos of animals swimming and surfing, as well as videos using people’s real photos to depict them performing actions like painting on a canvas.
Movie Gen also can generate background music and sound effects synced to the content of the videos, Meta said in a blog post, and use the tool to edit existing videos.
In one such video, Meta had the tool insert pom-poms into the hands of a man running by himself in the desert, while in another it changed a parking lot where a man was skateboarding from dry ground into one covered by a splashing puddle.
Videos created by Movie Gen can be up to 16 seconds long, while audio can be up to 45 seconds long, Meta said. It shared data showing blind tests indicating that the model performs favorably compared with offerings from startups including Runway, OpenAI, ElevenLabs and Kling.
The announcement comes as Hollywood grapples with generative AI video technology this year. In February, OpenAI showcased its product Sora. Sora demonstrated the ability to create feature film-like videos from text prompts.
Technologists in the entertainment industry are eager to use these tools to enhance and expedite filmmaking. However, some worry about systems trained on copyrighted works without permission.
Lawmakers have expressed concerns about AI-generated fakes, known as deepfakes, impacting elections worldwide. These concerns include their influence in the U.S., Pakistan, India, and Indonesia.
Meta spokespeople indicated that the company might not release Movie Gen for open use by developers. They compared this decision to their Llama series of large-language models. Additionally, they did not provide details about Meta’s assessment for Movie Gen. #MetaAIVideoGeneration
Transforming Industries with Meta AI Video Generation
Furthermore, this advancement has far-reaching implications for various industries. For instance, marketing teams can now produce high-quality promotional materials rapidly. Similarly, educators can utilize Meta AI video generation to enhance online learning experiences, making lessons more interactive and engaging.
read more
