Google develops an AI that will actually play games with you

Google's DeepMind SIMA AI playing games
(Image credit: Google)

Google is developing a DeepMind based AI that could end up being the ultimate virtual co-op buddy. It's not some play-to-win opponent or super-bot, but a general, instructible game-playing AI agent.

Google presented a research article (via @rowancheung) on what it calls a Scalable Instructable Multiworld Agent (SIMA). The general idea is that it's a learning AI that can follow verbal instructions and understand the virtual world it's in. Rather than functioning as a hard-coded AI opponent or bot we've grown accustomed to over decades, Google's SIMA promises to a more natural and human-like gaming companion.

Google partnered with eight game studios to test its SIMA model in games including Valheim, Goat Simulator 3 and No Man's Sky. These are open-world games chosen to teach SIMA to learn general gaming skills. The current version of SIMA is capable of performing around 600 basic skills, including navigation, object interaction and menu use.

As a player of No Man's Sky, I'm very intrigued by the possibilities. Anyone that's played the game knows that resource gathering and construction is a tedious process, and telling an AI player to go out and find oxygen or build a base would really help to reduce the grinding aspect of it. I prefer exploration and things like dogfights more than traversing landscapes to find X, in order to craft Y to build Z. SIMA could really help with that.

Your next upgrade

Nvidia RTX 4070 and RTX 3080 Founders Edition graphics cards

(Image credit: Future)

Best CPU for gaming: The top chips from Intel and AMD.
Best gaming motherboard: The right boards.
Best graphics card: Your perfect pixel-pusher awaits.
Best SSD for gaming: Get into the game ahead of the rest.

The early results look promising. Google says a trained SIMA agent performed almost as well in an unseen game as an agent specifically trained for it. That is key if such an agent is to be useful for real gamers. If a typical game playthrough lasts tens to hundreds of hours, an AI companion needs to be capable from the opening scene, otherwise players just won't bother.

While this is an impressive and very interesting feat, I remain skeptical. Large-language AI models are very good at doing things that are based on knowledge, but their ability to react, adapt and appropriately behave in real-time as a human does remains limited. Just how good is it at landing a headshot on the other side of a map?

(Image credit: Google)

AI in video games is not a new concept. It goes back decades to things like boss fights, multiplayer bots, opponents and NPCs in single player games, but they are hard coded for each game. A properly implemented SIMA-like AI could dramatically impact general gameplay. And it doesn't require source-code access or an API to function. It instead relies on just two inputs: the images on screen, and the instructions provided by the user.

Google emphasizes that its research is still in its early phases. As it learns from more games, it's expected to become more versatile and adaptable. Could your next co-op companion be an AI? And an actually useful one at that? I look forward to seeing how this technology develops, and how it might impact the future of multiplayer gaming.

Chris Szewczyk
Hardware Writer

Chris' gaming experiences go back to the mid-nineties when he conned his parents into buying an 'educational PC' that was conveniently overpowered to play Doom and Tie Fighter. He developed a love of extreme overclocking that destroyed his savings despite the cheaper hardware on offer via his job at a PC store. To afford more LN2 he began moonlighting as a reviewer for VR-Zone before jumping the fence to work for MSI Australia. Since then, he's gone back to journalism, enthusiastically reviewing the latest and greatest components for PC & Tech Authority, PC Powerplay and currently Australian Personal Computer magazine and PC Gamer. Chris still puts far too many hours into Borderlands 3, always striving to become a more efficient killer.

Read more
pubg
PUBG teammates not good enough? Nvidia's new generative AI-led 'Co-Playable Character' aims to offer you an alternative
Razer Project Ava key visual
Razer has released a backseat gaming AI bot called Ava, and I'm not sure whether using it should be considered cheating or not
Microsoft Muse-generated gaming in action
'A massive, massive moment of wow.' Microsoft CEO predicts AI-generated games are a 'CGI moment' for the industry
Still image of Bastion holding a bird, taken from Microsoft's Copilot for Gaming reveal trailer
Microsoft unveils Copilot for Gaming, an AI-powered 'ultimate gaming sidekick' that will let you talk to your console so you don't have to talk to your friends
Inzoi - two characters pose for a selfie together in front of a blue convertible car
Inzoi is creating a newfangled life sim NPC that can 'grow and develop its own personality' with Nvidia's AI tech
An Ai face looks down on a human.
Xbox announces 'a generative AI model for gameplay ideation' called Muse, but don't get too excited: Machines aren't about to make games for you just yet
Latest in AI
Otter AI Meeting Agent
As if your work meetings weren't already fun enough, now Otter has a new all-hearing AI agent that remembers everything anyone has said and can join in the discussion
Image for
'No real human would go four links deep into a maze of AI-generated nonsense': Cloudflare's AI Labyrinth uses decoy pages to trap web-crawling bots and feed them slop 'as a defensive weapon'
CHINA - 2025/02/11: In this photo illustration, a Roblox logo is seen displayed on the screen of a smartphone. (Photo Illustration by Sheldon Cooper/SOPA Images/LightRocket via Getty Images)
'Humans still surpass machines': Roblox has been using a machine learning voice chat moderation system for a year, but in some cases you just can't beat real people
OpenAI logo displayed on a phone screen and ChatGPT website displayed on a laptop screen are seen in this illustration photo taken in Krakow, Poland on December 5, 2022.
ChatGPT faces legal complaint after a user inputted their own name and found it accused them of made-up crimes
Public Eye trailer still - dead-eyed police officer sitting for an interview
I'm creeped out by this trailer for a generative AI game about people using an AI-powered app to solve violent crimes in the year 2028 that somehow isn't a cautionary tale
Closeup of the new Copilot key coming to Windows 11 PC keyboards
Microsoft co-authored paper suggests the regular use of gen-AI can leave users with a 'diminished skill for independent problem-solving' and at least one AI model seems to agree
Latest in News
A goblin with sharp teeth, wearing goggles, lets out a mischievous cackle in WoW's latest patch: Undermine(d).
World of Warcraft's started swiping good ideas from one of its most popular user-made UI addons, and it's honestly about time
A female druidic figure clutches a heart riven with thorns in Hunt: Showdown
'We want to increase the cost of silence': Hunt: Showdown 1896's latest update brings a new event, a massive list of bugfixes and a tougher challenge for stealthy players
It's ENA! From the free adventure Dream BBQ!
Mindbending free multimedia adventure ENA: Dream BBQ is out now, has activated all my neurons and opened my third eye
PC Gamer magazine issue 408 Doom: The Dark Ages
PC Gamer magazine's new issue is on sale now: Doom: The Dark Ages
A gigantic terracotta sentinel made of living armor
Total War: Warhammer 3's army of Cathay has broken containment and is making its way to tabletop Warhammer at last
Two brightly colored stormtroopers dressed like Run-DMC stand in front of PAX Australia's WELCOME HOME banner.
Tickets for PAX Australia 2025 are on sale now