AI-driven NPCs are living lives and planning parties all on their own

AI NPCs chatting about their day.
(Image credit: Joon Sung Park et al.)

We may soon be entering a world where NPCs don't just run through lines of code, but form complex relationships with other NPCs even when we're away, or seem to, at least.

So far we've been subject to some pretty rudimentary NPC AI systems. Enemies and followers will react to their environment in real-time, making decisions based on your play style and so on, but a recent paper (PDF) by researchers at Stanford University and Google Research describes an impressive "architecture for generative agents" in open world environments. 

The paper is titled "Generative Agents: Interactive Simulacra of Human Behavior" and it goes over the clever way they've made NPCs behave in believable, spontaneous ways.

To test the capability of a generative framework they'd designed, the researchers built a little open world similar to "The Sims", as they say, though the graphics are more akin to a Stardew Valley. After adding a sprinkling of personality into the NPCs' seed data, they dropped the little agents into the world and watched them interact in impressively complex ways.

One NPC's given "intent" was to plan a Valentine's party, and plan she did. She ran around inviting her NPC friends, and spent the day before the party decorating the venue with her bestie. That friend, whose backstory included a secret crush on another character, invited her crush to the party.

Diagram of how generative agents interact throughout their day. (Image credit: Joon Sung Park et al.)

The social behaviors of spreading the word, decorating, asking each other out, arriving at the party, and interacting with each other at the party, were initiated by the agent architecture.

"The social behaviors of spreading the word, decorating, asking each other out, arriving at the party, and interacting with each other at the party, were initiated by the agent architecture," reads the paper.

Not only does the generative architecture allow the NPCs to "perceive" the environment around them, but also build up a believable understanding of their world with a "comprehensive record of the agent's experiences called the memory stream." By reflecting on their retrieved memories, and planning their actions accordingly, they can form complex relationships and coordinate large groups.

Underneath it all, the system uses a large language model—think ChatGPT—to generate the behaviors. As the paper observes, "large language models encode a wide range of human behavior represented in their training data" which can be used to narrate believable actions and conversations. And believability was the specific goal of the researchers; they aren't saying these are literally sentient agents, just characters who frequently seem real. In a sense, the characters speak their reality into existence, and are susceptible to certain errors, like making embellishments.

One of the main ethical concerns the paper notes over such "believable proxies of human behavior" is the potential for people to fall in love with the NPCs. Or as they call it: "forming parasocial relationships with generative agents even when such relationships may not be appropriate."

"Despite being aware that generative agents are computational entities, users may anthropomorphize them or attach human emotions to them," the paper warns. 

The way the researchers propose to tackle the issue is by ensuring NPCs "explicitly disclose their nature as computational entities," and for developers to ensure their designs are "value-aligned so that they do not engage in behaviors that would be inappropriate given the context, e.g., to reciprocate confessions of love."

The process of perceiving, accessing the memory stream, reflecting and planning before acting. (Image credit: Joon Sung Park et al.)
Peak Storage

SATA, NVMe M.2, and PCIe SSDs on blue background

(Image credit: Future)

Best SSD for gaming: the best solid state drives around
Best PCIe 4.0 SSD for gaming: the next gen has landed
The best NVMe SSD: this slivers of SSD goodness
Best external hard drives: expand your horizons
Best external SSDs: plug in upgrades for gaming laptops and consoles

Humans will literally pack-bond with anything, whether that be an AI that explicitly discloses its non-humanness, or an inanimate object with a face-like collection of grooves, so those measures may not help. (And believe it or not, this has already been a problem.)

I say bring on the human-AI relationships, but that's a conversation for another day.

If things continue the way they are, it looks like "emergent social dynamics" aren't too far away for game NPCs. One day you'll re-enter a village you ransacked to find mourning mothers holding funerals for their loved ones. You can bet they'll hold on to all those times you shouted "FUS" at their chickens, and they'll even have the capacity to plot revenge for their wronged avian compatriots.

While we wait, you can watch the replay of the simulation demo that accompanies the paper.

Katie Wickens
Hardware Writer

Screw sports, Katie would rather watch Intel, AMD and Nvidia go at it. Having been obsessed with computers and graphics for three long decades, she took Game Art and Design up to Masters level at uni, and has been rambling about games, tech and science—rather sarcastically—for four years since. She can be found admiring technological advancements, scrambling for scintillating Raspberry Pi projects, preaching cybersecurity awareness, sighing over semiconductors, and gawping at the latest GPU upgrades. Right now she's waiting patiently for her chance to upload her consciousness into the cloud.

Read more
Inzoi - two characters pose for a selfie together in front of a blue convertible car
Inzoi is creating a newfangled life sim NPC that can 'grow and develop its own personality' with Nvidia's AI tech
pubg
PUBG teammates not good enough? Nvidia's new generative AI-led 'Co-Playable Character' aims to offer you an alternative
Aloy
'Creepy,' 'ghastly,' 'rancid': Viewers react to leaked video of Sony's AI-powered Aloy
An Ai face looks down on a human.
Xbox announces 'a generative AI model for gameplay ideation' called Muse, but don't get too excited: Machines aren't about to make games for you just yet
Microsoft Muse-generated gaming in action
'A massive, massive moment of wow.' Microsoft CEO predicts AI-generated games are a 'CGI moment' for the industry
A robot girl from Judas looks skeptical, her synthetic skin peeling off to reveal metal below.
Bioshock's Big Daddy Ken Levine says that while he doesn't want to 'underestimate' AI, he's 'not overly impressed' by it, either
Latest in AI
Closeup of the new Copilot key coming to Windows 11 PC keyboards
Microsoft co-authored paper suggests the regular use of gen-AI can leave users with a 'diminished skill for independent problem-solving' and at least one AI model seems to agree
Still image of Bastion holding a bird, taken from Microsoft's Copilot for Gaming reveal trailer
Microsoft unveils Copilot for Gaming, an AI-powered 'ultimate gaming sidekick' that will let you talk to your console so you don't have to talk to your friends
BURBANK, CALIFORNIA - AUGUST 15: Protestors attend the SAG-AFTRA Video Game Strike Picket on August 15, 2024 in Burbank, California. (Photo by Lila Seeley/Getty Images)
8 months into their strike, videogame voice actors say the industry's latest proposal is 'filled with alarming loopholes that will leave our members vulnerable to AI abuse'
live action Jimbo the Jester from Balatro holding a playing card and addressing the camera
LocalThunk forbids AI-generated art on the Balatro subreddit: 'I think it does real harm to artists of all kinds'
Aloy
'Creepy,' 'ghastly,' 'rancid': Viewers react to leaked video of Sony's AI-powered Aloy
Seattle, USA - Jul 24, 2022: The South Lake Union Google Headquarter entrance at sunset.
Google is rolling out an even more AI-heavy search engine mode because 'power users want AI responses for even more of their searches'
Latest in News
Man facing camera
The Day Before studio reportedly sues Russian website for calling infamous disaster-game a 'scam'
Will Poulter holding a CD ROM
'What are most games about? Killing': Black Mirror Season 7 includes a follow-up to 2018 interactive film Bandersnatch
Casper Van Dien in Starship Troopers
Sony, which is making a Helldivers 2 movie, is also making a new Starship Troopers movie, but it's not based on the Starship Troopers movie we already have
Assassin's Creed meets PUBG
Ubisoft is reportedly talking to Tencent about creating a new business entity to manage Assassin's Creed and other big games
Resident Evil Village - Lady Dimitrescu
'It really truly changed my life in every possible way': Lady Dimitrescu actor says her Resident Evil Village role was just as transformative for her as it was for roughly half the internet in 2021
Storm trooper hero
Another live service shooter is getting shut down, this time before it even launched on Steam