New Blizzard patent details an AI system to make art for its games

The Butcher in Diablo 3
(Image credit: Blizzard)

We here at PC Gamer can't stop admiring the balls of Blizzard's VFX artists, but it turns out that suits elsewhere at the developer have some pretty big kahunas too: And have applied for a patent that will see an AI generate artwork for use in-game, based on a specific style fed to it by Blizzard (spotted by GameRant).

Ruh-oh. Firstly, the patent itself is not necessarily an indication that Blizzard is or will be doing this anytime soon. But it is treading into some murky waters here, with the reputation of AI art among the public at something of a low: Only yesterday, people were getting upset at the System Shock remaster for creating a promotional image of its own evil AI using the AI software Midjourney.

But these technologies are rapidly spreading, to the extent that even modders are incorporating them into their work, and unlike for example NFTs (another much-maligned piece of contemporary tech) there are some compelling use cases for AI, especially when it comes to fleshing out the edges of worlds.

The patent is a technical document and is absolutely no fun to read, but essentially it explains an AI system that is fed a specific art style and emulates these images to create new art. The AI takes these initial inputs and, essentially, begins to construct a 3D model: Building a skeleton, texturing it, and adding detail. I suppose the crucial point here is that initial human input, which in this case would presumably be coming from Blizzard's internal art teams (one of the biggest controversies over AI art is its use of copyrighted imagery without credit to the human creators of it, to the extent Getty Images is suing one of the largest tools).

It's a tricky one. You can see why the idea of this system would appeal to some of those on the production side of videogames, especially on the scale Blizzard works at with some of its titles, and it's important to note that (for now at least) the focus seems to be on how AI can be used for things like NPC conversations and generating lots of minor variants from a single enemy design.

There are obviously hardliners who don't think a piece of AI-generated art should ever find its way into a videogame, but there are more nuanced worries about the potential impact of tsuch technology. Industry artists might hold the reasonable concern that, even if this thing needs to be fed Blizzard art to work, that could still mean a reduction in headcount for Blizzard's art department, and we're not even touching on how it could change the production process: Do we really want a future where the human artists are focused on touching up AI output?

These questions are going to become ever more pressing because, as this patent shows, companies like Blizzard are not going to wait around for permission to test these technologies, and we may see the outcomes sooner than we think. Whether companies will be upfront about using such technologies, and whether we'll even be able to tell, may end up as the bigger question.

Rich Stanton
Senior Editor

Rich is a games journalist with 15 years' experience, beginning his career on Edge magazine before working for a wide range of outlets, including Ars Technica, Eurogamer, GamesRadar+, Gamespot, the Guardian, IGN, the New Statesman, Polygon, and Vice. He was the editor of Kotaku UK, the UK arm of Kotaku, for three years before joining PC Gamer. He is the author of a Brief History of Video Games, a full history of the medium, which the Midwest Book Review described as "[a] must-read for serious minded game historians and curious video game connoisseurs alike."

Read more
A zombie santa with six fingers leaps at the screen.
Call of Duty admits it's using generative AI to 'help develop some in-game assets', and suddenly all those poorly made calling cards make sense
live action Jimbo the Jester from Balatro holding a playing card and addressing the camera
LocalThunk forbids AI-generated art on the Balatro subreddit: 'I think it does real harm to artists of all kinds'
An Ai face looks down on a human.
Xbox announces 'a generative AI model for gameplay ideation' called Muse, but don't get too excited: Machines aren't about to make games for you just yet
Nvidia RTX 5090 Founders Edition graphics card on different backgrounds
AI will be crammed in more of the graphics pipeline as Nvidia and Microsoft are bringing AI shading to a DirectX preview next month
Microsoft Muse-generated gaming in action
'A massive, massive moment of wow.' Microsoft CEO predicts AI-generated games are a 'CGI moment' for the industry
Nvidia RTX 4080 Super Founders Edition graphics card
'Neural Rendering' could be the new AI-powered sorcery in Nvidia's next-gen RTX 50-series GPUs
Latest in Gaming Industry
Assassin's Creed meets PUBG
Ubisoft is reportedly talking to Tencent about creating a new business entity to manage Assassin's Creed and other big games
Possibility Space concept art.
Possibility Space owners sue NetEase for $900 million over allegations it spread 'false and defamatory rumors' of fraud at the studio that ultimately forced it to close
Valve soldier man on a pc.
2024 was Steam's 'best year ever' of users buying newly released games—but I wouldn't celebrate the end of the forever game era just yet
Money money money.
Valve tracked 1.7 million Steam users who joined in 2023 to see if they stuck around—they did, and they spent $93 million
Gabe Newell in a Valve promotional video, on a yacht.
Go ahead and complain the discounts aren't as steep as they used to be, but Steam just had its biggest year ever for seasonal sales
Pirate Bay co-founder Carl Lundstrom
Pirate Bay co-founder and far-right politician found dead after plane crash
Latest in News
Man facing camera
The Day Before studio reportedly sues Russian website for calling infamous disaster-game a 'scam'
Will Poulter holding a CD ROM
'What are most games about? Killing': Black Mirror Season 7 includes a follow-up to 2018 interactive film Bandersnatch
Casper Van Dien in Starship Troopers
Sony, which is making a Helldivers 2 movie, is also making a new Starship Troopers movie, but it's not based on the Starship Troopers movie we already have
Assassin's Creed meets PUBG
Ubisoft is reportedly talking to Tencent about creating a new business entity to manage Assassin's Creed and other big games
Resident Evil Village - Lady Dimitrescu
'It really truly changed my life in every possible way': Lady Dimitrescu actor says her Resident Evil Village role was just as transformative for her as it was for roughly half the internet in 2021
Storm trooper hero
Another live service shooter is getting shut down, this time before it even launched on Steam