Google is back at it with AI, this time generating interactive 3D game worlds—but you won't catch me playing ball

Seattle, USA - Jul 24, 2022: The South Lake Union Google Headquarter entrance at sunset.
(Image credit: 400tmax via Getty Images)

AI is a genie that refuses to go back in the bottle—no matter how much I plead, "Put that thing back where it came from, or so help me!" Enter Google's Genie 2, another generative model. However, rather than merely guessing which word might come next a la an LLM, or proffering a kind of sludgey-looking still image, this AI instead outputs 3D interactive environments.

Well, at least it's not calling me 'a stain on the universe' like Gemini AI allegedly told one user recently. Whereas Genie 1, revealed back in February, could only cobble together 2D scenes, the just announced Genie 2 is a step up, offering somewhat explorable 3D game environments (via PC World). I say 'somewhat' because it isn't long before the wheels come off.

For one thing, the player character model struggles to look consistent throughout movement. For another, playable worlds generated by Genie 2 don't last long; Google's writes, "Genie 2 can generate consistent worlds for up to a minute," though admits that most of the examples they show lasted between 10 and 20 seconds. So, no, you won't feed Genie 2 a prompt regarding that long awaited sequel and be satisfied by the results.

Google's prompting process is also not as straightforward as typing, "One Cyberpunk game, please," and diving into a Night City knockoff either. Genie 2 generates its game worlds in response to still images that were themselves generated by Imagen 3, a text-to-image model also from Google. That's a whole lot of snakes eating their own tail.

Genie 2 itself is a "an autoregressive latent diffusion model" that draws from "a large-scale video dataset" that Google doesn't really detail the content or source thereof otherwise. Google has also experimented with feeding photos of the real world to Genie 2, highlighting responses that "model grass blowing in the wind or water flowing in a river." The Gifs they share of these responses are about as muddy looking as you'd expect, though.

AI, explained

OpenAI logo displayed on a phone screen and ChatGPT website displayed on a laptop screen are seen in this illustration photo taken in Krakow, Poland on December 5, 2022.

(Image credit: Jakub Porzycki/NurPhoto via Getty Images)

What is artificial general intelligence?: We dive into the lingo of AI and what the terms actually mean.

Credit where some credit may be due though, Genie 2 does make strides in a number of things generative models often struggle with. While the player character model warps and blurs like a water damaged printout, the environments one can trundle through remain surprisingly consistent—definitely bland and generic, but consistently so.

For instance, Genie 2's "Long Horizon Memory" remembers aspects of the environment after they disappear from view. Say you're running between pyramids—when you look back, the pyramids will stand in the same spot you last saw them, rather than teleporting around behind you like it's a game of 'What's the time, Mr. Wolf?' Similarly, Google touts Genie 2's 'counterfactual' capabilities, which is really just a fancy way of saying that multiple players can play the same generated level and have a consistent experience.

Google has shared a mix of examples controlled by humans and SIMA, their own AI player "designed to complete tasks in a range of 3D game worlds by following natural-language instructions." Many of the shared excerpts show digital avatars controlled with typical WASD keyboard controls. Google writes, "Genie 2 responds intelligently to actions taken by pressing keys on a keyboard, identifying the character and moving it correctly. For example, our model has to figure out that arrow keys should move the robot and not the trees or clouds." Good for you, Genie 2.

But besides walking around these occasionally wonky looking levels, Genie 2 can also generate object interactions and even NPCs. Naturally, the NPCs have nothing of note to say, but Genie 2 can generate balloons to burst and barrels to explode—though that's hardly the most compelling gameplay loop.

While no one outside of Google can yet play around with Genie 2's output, the company is eager to tout its potential use cases, such as rapid prototyping based off of concept art. This may sound appealing—right up until you ask what happens when a developer wants to slightly adjust absolutely anything about their AI generated prototype.

While Genie 2's snatches of game may spark the imagination of AI-defenders, I'm far from convinced—and honestly, I'm just a wee bit concerned about its potential labour implications for game development. Earlier this year, Take-Two CEO Strauss Zelnick dismissed the claim that AI would take away jobs, arguing, "It's not going to make people irrelevant. It's going to change the nature of certain forms of employment. And that's a good thing." But as Andy Chalk points out in his news piece, industry transitioning to large scale automation is not always a painless process. It's my sincere hope that Google's little experiment doesn't end up motivating even more layoffs.

Best gaming PCBest gaming laptop


Best gaming PC: The top pre-built machines.
Best gaming laptop: Great devices for mobile gaming.

TOPICS
Jess Kinghorn
Hardware Writer

Jess has been writing about games for over ten years, spending the last seven working on print publications PLAY and Official PlayStation Magazine. When she’s not writing about all things hardware here, she’s getting cosy with a horror classic, ranting about a cult hit to a captive audience, or tinkering with some tabletop nonsense.

Read more
An Ai face looks down on a human.
Xbox announces 'a generative AI model for gameplay ideation' called Muse, but don't get too excited: Machines aren't about to make games for you just yet
Microsoft Muse-generated gaming in action
'A massive, massive moment of wow.' Microsoft CEO predicts AI-generated games are a 'CGI moment' for the industry
A robot girl from Judas looks skeptical, her synthetic skin peeling off to reveal metal below.
Bioshock's Big Daddy Ken Levine says that while he doesn't want to 'underestimate' AI, he's 'not overly impressed' by it, either
Aloy
'Creepy,' 'ghastly,' 'rancid': Viewers react to leaked video of Sony's AI-powered Aloy
Symbolic photo: Logo of the video platform YouTube on June 07, 2023 in Berlin, Germany.
'It’s a whole new kind of blerp': YouTube's AI-enhanced reply suggestions seem to be working as well as you might expect
NEW YORK, NEW YORK - NOVEMBER 08: CEO of Take-Two Interactive Software Strauss Zelnick attends Paley International Council Summit at Paley Museum on November 08, 2022 in New York City. (Photo by Steven Ferdman/Getty Images)
Take-Two CEO Strauss Zelnick takes a moment to remind us once again that 'there's no such thing' as artificial intelligence
Latest in AI
Aloy
'Creepy,' 'ghastly,' 'rancid': Viewers react to leaked video of Sony's AI-powered Aloy
Seattle, USA - Jul 24, 2022: The South Lake Union Google Headquarter entrance at sunset.
Google is rolling out an even more AI-heavy search engine mode because 'power users want AI responses for even more of their searches'
A digitally generated image of abstract AI chat speech bubbles overlaying a blue digital surface.
We need a better name for AI, or we risk talking past each other until actually intelligent AGI comes home mooing
MOUNTAIN VIEW, CALIFORNIA - AUGUST 22: A view of Google Headquarters in Mountain View, California, United States on August 22, 2024.
One educational company accuses Google's AI summary of leading to a 'hollowed-out information ecosystem of little use and unworthy of trust' in latest lawsuit
Nvidia Signs, its AI-led ASL teaching platform
Nvidia has built a free AI-led platform to help teach American Sign Language with '400,000 video clips representing 1,000 signed words' so far
Microsoft Muse-generated gaming in action
'A massive, massive moment of wow.' Microsoft CEO predicts AI-generated games are a 'CGI moment' for the industry
Latest in News
Pedro Pascal as Joel in a coat in winter looking unhappy
'Don't you know what he did?': The truth comes out in The Last of Us Season 2 trailer
Aloy
'Creepy,' 'ghastly,' 'rancid': Viewers react to leaked video of Sony's AI-powered Aloy
Split Fiction trailer still - Zoe and Mio standing side by side, wearing glowing neon sci-fi jammies
Split Fiction sells 1 million copies over 2 days
A soldier looks out over the Verdansk map, as a single tear rolls down his cheek.
The original Verdansk map is returning to Call of Duty: Warzone, to celebrate which we get a soldier crying to Nat King Cole
More than 5 years after launch, Control gets a surprise patch that lets everyone play the Hideo Kojima mission
Swen Vincke
Swen Vincke stamps seal of approval on Stardew Valley mod that yoinks the Baldur's Gate 3 cast out of D&D and into a cosy pastoral life