This adventure game tech demo with AI-generated art is impressive and disconcerting

Jussi-Petteri Kemppainen, a veteran game dev based out of Finland, has recently started sharing early demos of a 2.5D point-and-click adventure game with art and assets sourced from Midjourney and Stable Diffusion, two machine learning text-to-image tools. The project convincingly shows how an individual artist with limited resources can use these controversial, questionably ethical tools to punch above their weight when developing a game.

In his first blog post discussing the prototype, Kemppainen describes wanting to see how far he could push these tools in the creation of a videogame prototype. To that end, he chose to make a 2.5D point and click adventure, allowing easy generation of 2D background art with a more challenging experiment in turning AI-generated assets into textures for 3D models.

Kemppainen used AI tools to generate a number of character concept art sheets, the likes of which you may have seen in a collector's edition artbook. He ultimately settled on a weird old bearded man he got out of Stable Diffusion⁠—the character basically looks like a stock "old coot but make it cyberpunk," someone I can imagine doing a sidequest for in Borderlands. Kemppainen then roughly aligned this art with a 3D model he made and touched it up by hand.

To turn AI-generated location art into a playable space, Kemppainen created 3D collision data in modelling software Blender, overlaid that on the 2D background, and lit the scene in Unity. The result is impressive, but in a discomfiting way. There's still some AI image gen weirdness⁠—our dirty Borderlands Santa's favorite convenience store seems to be named "PAICKTPPARRCTK: MIATIIKK PICAIKANKT," and Stable Diffusion birthed him with a rather incongruous set of pigtails. As a rough proof-of-concept of the labor-saving potential of AI tools, however, it's convincing.

It helps the project's credibility that Kemppainen isn't a fabulist producing images of dead-eyed anime ladies with eleven fingers on each hand and claiming that these tools will replace human artists, he's a veteran videogame developer with experience on the art side of things and credits on multiple games, including Remedy's Quantum Break. All together, he thinks his use of generative tools saved him at least five days of work vs creating similar background and character art by hand.

"[AI generation] enables the creation of games that would otherwise be left unmade because of budget or time constraints for sure," Kempainnen says.

The unresolved problem here is that PAICKTPPARRCTK and Dirty Borderlands Santa are a slurry of real people's artwork⁠—individual artists who may or may not have found success with the craft, but whose work has been fed to these AI algorithms to train them, probably without their knowledge or permission. Kemppainen himself is not precious with the AI generations that resulted from his prompts, stating that "they can be freely used by anyone, as replication of these images is pretty trivial." He also acknowledges that these assets derive from other artists' efforts, explaining that, for what it's worth, he avoids referencing specific artists, instead opting for as broad or generic results as possible. Whatever my own concerns, though, Kemppainen's success is further evidence that AI art isn't going away.

Associate Editor

Ted has been thinking about PC games and bothering anyone who would listen with his thoughts on them ever since he booted up his sister's copy of Neverwinter Nights on the family computer. He is obsessed with all things CRPG and CRPG-adjacent, but has also covered esports, modding, and rare game collecting. When he's not playing or writing about games, you can find Ted lifting weights on his back porch.

Read more
An Ai face looks down on a human.
Xbox announces 'a generative AI model for gameplay ideation' called Muse, but don't get too excited: Machines aren't about to make games for you just yet
A robot girl from Judas looks skeptical, her synthetic skin peeling off to reveal metal below.
Bioshock's Big Daddy Ken Levine says that while he doesn't want to 'underestimate' AI, he's 'not overly impressed' by it, either
live action Jimbo the Jester from Balatro holding a playing card and addressing the camera
LocalThunk forbids AI-generated art on the Balatro subreddit: 'I think it does real harm to artists of all kinds'
Microsoft Muse-generated gaming in action
'A massive, massive moment of wow.' Microsoft CEO predicts AI-generated games are a 'CGI moment' for the industry
The OpenAI logo is being displayed on a smartphone with an AI brain visible in the background, in this photo illustration taken in Brussels, Belgium, on January 2, 2024. (Photo illustration by Jonathan Raa/NurPhoto via Getty Images)
OpenAI is working on a new AI model Sam Altman says is ‘good at creative writing’ but to me it reads like a 15-year-old's journal
Aloy
'Creepy,' 'ghastly,' 'rancid': Viewers react to leaked video of Sony's AI-powered Aloy
Latest in Adventure
Inside
Limbo and Inside studio demands compensation from co-founder Dino Patti for alleged 'unauthorized use of Playdead's trademarks and copyrighted works'
Two characters sitting on a bench talking
Wanderstop review
Zoe showing off in front of Mio
Split Fiction review
Rusty Rabbit chomping a carrot like a cigar
Rusty Rabbit turns Yakuza's Kazuma Kiryu into a fluffy bunny
Pathologic 3 screenshot
Get ready to get weird in Pathologic 3: Quarantine, a free 'prologue chapter' about a young doctor looking for immortality in the world's most miserable town
A young woman's face bathed in light
Lost Records: Bloom & Rage Tape 1 review
Latest in News
Naoe looking at the wrist blade in Assassin's Creed Shadows
Ubisoft backflips, says Assassin's Creed Shadows will support Steam Deck at launch, but I doubt I'll actually want to play it there
Henry from KCD2 wearing nice outfits
'Diversify your fashion endgame' with this Kingdom Come: Deliverance 2 mod that gives Henry fly new gambesons, pourpoints, and caftans
Masked Counter-Terrorist in helmet in forefront with sunglasses and beret-wearing CT in background touching headset
There's hope yet for Classic Offensive after its Steam rejection: The team behind the Counter-Strike 1.6 revival mod is in touch with Valve about its 'concerns'
Recently appointed Intel CEO Lip-Bu Tan.
Here comes Intel's new CEO: a semiconductor veteran that won the same prestigious award as Jensen Huang and Lisa Su
BURBANK, CALIFORNIA - AUGUST 15: Protestors attend the SAG-AFTRA Video Game Strike Picket on August 15, 2024 in Burbank, California. (Photo by Lila Seeley/Getty Images)
8 months into their strike, videogame voice actors say the industry's latest proposal is 'filled with alarming loopholes that will leave our members vulnerable to AI abuse'
Orithopter shooting down another in Dune
Dune: Awakening confirms air-to-air combat in ornithopters