Blizzard's internal Diablo 4 playtests are a 'cursed problem' where 'to really test our game, you need to spend your life playing our game,' designer says

Diablo 4's lead class designer called trying to test an action RPG made to be played for hundreds of hours "a cursed problem" (referencing a 2019 Riot GDC talk) that would take "more hours than what you would normally expect someone to work at a job," in an interview today with Diablo 4 streamer Raxxanterax.

Jackson was answering a question about how the team incorporates player feedback and internal playtesting into Diablo 4's development. He said the live team regularly monitors feedback from Reddit, streams, and the forums but also spends every day playing the game on their own, keeping a list of things that could be better.

"We have the ability to see data all over the game of how many people are equipping different legendary aspects, how many people are engaging with certain types of content," Jackson says. "We can see what's working, what's not working, what people are actually doing versus what they say."

But player feedback and data don't exist for new systems that haven't been added to the game yet, which is "where things get a lot harder," Jackson says. He calls it a "cursed problem" trying to thoroughly test a game as complex as Diablo 4.

We have to use our guts and existing ideas and telemetry to figure out if the decisions we make are right.

Adam Jackson, lead class designer

"Diablo is a freakin' huge game that takes forever to play and really truly understand because our systems are so interconnected. So there is no substitute for actually going through that 80-hour experience and playing everything," he explained. "The part that makes that really hard, and where I think the community gives us a hard time sometimes … is that to really test our game you need to spend your life playing our game."

That's why they need the help of data analysts and QA testers, he says. "I would love to play season 5 200 hours before it comes out [but] I only get it for 50 hours. We have to use our guts and existing ideas and telemetry to figure out if the decisions we make are right."

(Image credit: Blizzard)

As an example, Jackson pointed to Diablo 4's new masterworking crafting system on the season 4 public test realm (PTR) last month. Every single time you upgraded an item, you were forced to watch a short animation of a circle filling up with molten metal. Players immediately revolted at the prospect of having to sit through it hundreds of times as they play.

Blizzard has since fixed that issue by including a skip button, but Jackson says it's an example of the kind of thing that's hard to test internally. "That kind of stuff is where sometimes things fall through the cracks," he said, and that you have to balance the feedback of "doing this thing 2000 times is actually terrible because you gotta wait forever versus well, we want to have a moment of celebration and for the cool thing to be cool."

Now, Jackson says, the team considers what every new feature should be like if you're doing it for 200 hours, while also thinking about the presentation of it for less-experienced players. "The answer is not always so obvious, but we are receptive to when the community tells us clearly 'hey, no, we want it this way,' we're going to do it that way."

Diablo 4 season 4 launches on May 14 with one of its biggest updates ever.

Tyler has covered videogames and PC hardware for 15 years. He regularly spends time playing and reporting on games like Diablo 4, Elden Ring, Overwatch 2, and Final Fantasy 14. While his specialty is in action RPGs and MMOs, he's driven to cover all sorts of games whether they're broken, beautiful, or bizarre.

Read more
An axe-wielding Enraged Headless Husk attacks a barbarian
Diablo 4 players pleasantly surprised to find the first boss of the new season is a challenge for once: 'it's nice to actually have to think and prepare for fights'
World of Warcraft Mythic Plus screenshot
World of Warcraft's competitive dungeon mode is struggling
Path of Exile 2 showing the Warbringer ascendancy class bludgeoning his way through a pack of hyenas
Path of Exile 2 devs acknowledge the endgame is 'too severe' but are sticking to their guns because 'the whole death actually mattering thing is actually important'
A maddened sicko raises a knife
Blizzard co-founder and Diablo designer thinks new ARPGs have 'cheapened' the genre with fast leveling, throwaway loot and enemies
The boss of Dawntrail's 4th raid, Wicked Thunder, holds an Electrope cube to the air and floods it with levin.
'It's simply impossible to make a difficulty level that's just right for all players': How Final Fantasy 14's lead battle designer has been playing a precarious balancing game for Dawntrail's dungeons and raids
Destiny 2: Season of Plunder promo image.
'We made one big mistake': Destiny 2 developer reveals how a small team dedicated to player retention led to a 20 hour server outage and character rollback
Latest in RPG
The heroes are attacked by monsters
Pillars of Eternity is getting turn-based combat to mark its 10th anniversary, and that means PC Gamer editors will soon be arguing about combat mechanics again
Junah beginning a battle in Metaphor: ReFantazio.
Today's RPG fans are 'very sensitive to feeling like they wasted time' when they die, says Metaphor: ReFantazio battle planner—but Atlus still made combat hard anyway
Image of Cersei Lanniser from Game of Thrones: Kingsroad Steam early access trailer
A new Game of Thrones RPG is coming to Steam today with a cast of 'familiar faces,' which is good because it's really the only way to tell it's a GoT game at all
A Viera looking confused in Final Fantasy 14.
Old armor continues to fall victim to Final Fantasy 14's bizarre two-channel dye system, unless you're super into changing the colour of teeny-tiny eyelets: 'Why even bother at this point?'
Starfield: Shattered Space
By the time Bethesda was on Starfield, you'd 'basically get in trouble' for breaking schedule, says former dev: 'A lot of the great stuff within Skyrim came from having the freedom to do what you want'
Sphene applauds in Final Fantasy 14's patch 7.2 story.
I'm not yelling 'we're so back!' yet, but Final Fantasy 14's patch 7.2 story could be the first sign the MMO is returning to what made it so critically-acclaimed
Latest in News
The heroes are attacked by monsters
Pillars of Eternity is getting turn-based combat to mark its 10th anniversary, and that means PC Gamer editors will soon be arguing about combat mechanics again
Image of Ronaldo from Fatal Fury: City of the Wolves trailer
It doesn't really make sense that soccer star Ronaldo is now a Fatal Fury character, but if you follow the money you can see how it happened
Junah beginning a battle in Metaphor: ReFantazio.
Today's RPG fans are 'very sensitive to feeling like they wasted time' when they die, says Metaphor: ReFantazio battle planner—but Atlus still made combat hard anyway
Image of Cersei Lanniser from Game of Thrones: Kingsroad Steam early access trailer
A new Game of Thrones RPG is coming to Steam today with a cast of 'familiar faces,' which is good because it's really the only way to tell it's a GoT game at all
The new Prime Asset featured in the upcoming update for the Outlast Trials.
The Outlast Trials puts its already paranoid players under surveillance for a time-limited story event
A Viera looking confused in Final Fantasy 14.
Old armor continues to fall victim to Final Fantasy 14's bizarre two-channel dye system, unless you're super into changing the colour of teeny-tiny eyelets: 'Why even bother at this point?'