Meta's AI video generator tool is already giving me nightmares

Meta AI's generated video of a bear looking confused in algebra class.
(Image credit: Meta AI)

Meta is offering an AI video generation service via Twitter right now called Make-A-Video. Although it looks pretty horrendous right now, the number of comments in just a day suggests that soon the AI image generation fad will be superseded by AI video generation. It's a big leap, with researchers pushing the boundaries of generative art as we know it, in particular how much data is necessary to bring images to life.

"With just a few words, this state-of-the-art AI system generates high-quality videos from text prompts," Meta AI writes in the tweet, and calls for prompts. The trick to keeping heaps of unregulated gore and porn from being generated and posted on Twitter? Send the prompt to them, and they might post the results.

The alternative to waiting for the (likely scarred for life) Meta AI team to potentially select your prompt out of the thousands now piling into the comments is to head over to the Make-A-Video studio and sign up using the Google form to register your interest in the tool.

The accompanying research paper (PDF warning) calls the Make-A-Video process "an effective method that extends a diffusion-based T2I model to T2V through a spatiotemporally factorized diffusion model." That's a fancy way of saying they used an evolved version of diffusion's Text-to-Image generation model to make pictures move.

"While there is remarkable progress in T2I generation," the paper reads, "the progress of T2V generation lags behind largely due to two main reasons: the lack of large-scale datasets with high-quality text-video pairs, and the complexity of modelling higher-dimensional video data."

Screen queens

(Image credit: Future)

Best gaming monitor: Pixel-perfect panels for your PC
Best high refresh rate monitor: Screaming quick screens
Best 4K monitor for gaming: When only high-res will do
Best 4K TV for gaming: Big-screen 4K PC gaming

Essentially, the size and accuracy of the datasets needed to train current text to video AI models are just too vast to be viable.

The amazing thing about this evolution is that "it does not require paired text-video data," the paper notes. That's unlike many video and image generators out there that rely on galleries of content already paired with text. "This is a significant advantage compared to prior work," it explains, as it isn't as restricted and doesn't require as much data in order to work.

There are a few ways to use the tool, with it either filling in the motion between two images, simply adding motion to a single image, or creating new variations of a video based on the original. The results are fascinating. They're dreamy and psychedelic, and can be generated in a few different styles. 

Sure these are a little spooky, especially when you remember that the results are only going to get more realistic, but a little hike through uncanny valley never hurts on the lead up to Halloween. 

Katie Wickens
Hardware Writer

Screw sports, Katie would rather watch Intel, AMD and Nvidia go at it. Having been obsessed with computers and graphics for three long decades, she took Game Art and Design up to Masters level at uni, and has been rambling about games, tech and science—rather sarcastically—for four years since. She can be found admiring technological advancements, scrambling for scintillating Raspberry Pi projects, preaching cybersecurity awareness, sighing over semiconductors, and gawping at the latest GPU upgrades. Right now she's waiting patiently for her chance to upload her consciousness into the cloud.

Read more
A image representing a typical YouTube tech video thumbnail using joke elements to demonstrate the use of an AI tool
Is time too precious to waste making gurning thumbnails for your YouTube videos? Huzzah for this AI tool that does it all for you, then
Microsoft Muse-generated gaming in action
'A massive, massive moment of wow.' Microsoft CEO predicts AI-generated games are a 'CGI moment' for the industry
A young Asian woman opening visual aids to give her audience a better understanding while holding a podcast session.
Logitech has announced an 'intelligent streaming assistant' in Streamlabs to tell you when your live stream sucks
An Ai face looks down on a human.
Xbox announces 'a generative AI model for gameplay ideation' called Muse, but don't get too excited: Machines aren't about to make games for you just yet
CHONGQING, CHINA - OCTOBER 30: In this photo illustration - The Facebook app page is displayed on a smartphone in the Apple App Store in front of the Meta Platforms, inc. logo on October 30, 2024 in Chongqing, China. (Photo by Cheng Xin/Getty Images)
Meta might've done something useful, pioneering an AI model that can interpret brain activity into sentences with 80% accuracy
The OpenAI logo is being displayed on a smartphone with an AI brain visible in the background, in this photo illustration taken in Brussels, Belgium, on January 2, 2024. (Photo illustration by Jonathan Raa/NurPhoto via Getty Images)
OpenAI is working on a new AI model Sam Altman says is ‘good at creative writing’ but to me it reads like a 15-year-old's journal
Latest in AI
Image for
'No real human would go four links deep into a maze of AI-generated nonsense': Cloudflare's AI Labyrinth uses decoy pages to trap web-crawling bots and feed them slop 'as a defensive weapon'
CHINA - 2025/02/11: In this photo illustration, a Roblox logo is seen displayed on the screen of a smartphone. (Photo Illustration by Sheldon Cooper/SOPA Images/LightRocket via Getty Images)
'Humans still surpass machines': Roblox has been using a machine learning voice chat moderation system for a year, but in some cases you just can't beat real people
OpenAI logo displayed on a phone screen and ChatGPT website displayed on a laptop screen are seen in this illustration photo taken in Krakow, Poland on December 5, 2022.
ChatGPT faces legal complaint after a user inputted their own name and found it accused them of made-up crimes
Public Eye trailer still - dead-eyed police officer sitting for an interview
I'm creeped out by this trailer for a generative AI game about people using an AI-powered app to solve violent crimes in the year 2028 that somehow isn't a cautionary tale
Closeup of the new Copilot key coming to Windows 11 PC keyboards
Microsoft co-authored paper suggests the regular use of gen-AI can leave users with a 'diminished skill for independent problem-solving' and at least one AI model seems to agree
Still image of Bastion holding a bird, taken from Microsoft's Copilot for Gaming reveal trailer
Microsoft unveils Copilot for Gaming, an AI-powered 'ultimate gaming sidekick' that will let you talk to your console so you don't have to talk to your friends
Latest in News
Assassin's Creed Shadows promo image
Ubisoft scores a legendary ratio against Elon Musk on his own platform—which hopefully marks a final end to all the Assassin's Creed Shadows' culture war nonsense
Tzarina Katarin Bokha, the Ice Queen of Kislev
Total War: Warhammer 3 rolls out a cool Kislev overhaul, changes befitting Tzeench’s magic, new projectile units and creakier skeletal horses
An image of a golden first place award from Geoguessr
'We're actually getting GeoGuessr on Steam before GTA 6': the Google Street View puzzler arrives on Valve's platform this April
Napster client circa 1999
Former music-pirating platform Napster to be reborn rather ironically as a metaverse for musicians to connect with their fans after $207 million deal
The snazzy red and black HyperX Cloud Alpha wireless headphones float in a teal void. The microphone is attached to the headset.
The best wireless gaming headset is now even better in the Amazon Big Spring Sale, boasting a more than $50 discount
A chip being held up in an Intel fab
Intel is reportedly 'working to finalize commitments from Nvidia' as a foundry partner, suggesting gaming potential for the 18A node