Xbox Games Studios boss says artificial intelligence QA is his 'dream'

Matt Booty, head of Xbox Game Studios at Microsoft Corp., speaks during a Bloomberg interview at the E3 Electronic Entertainment Expo in Los Angeles, California, U.S., on Tuesday, June 11, 2019.
(Image credit: Patrick T. Fallon/Bloomberg via Getty Images)

Xbox Game Studios head Matt Booty has said it's his "dream" to turn to "transformational" AI and machine learning as an alternative to human QA testing.

Booty dove into his desire for AI testers during his "Storytime With Matt Booty" panel during PAX West. He said QA testing has "not really kept up with how quickly we can make content," as reported by VGC, and went on to compare changing something minor in a game as opposed to a movie.

"If we're working on a movie and you come in and say 'hey, this ending let's tighten this up, let's edit this, let's cut that scene,' it usually doesn't break anything at the beginning of the movie," he said. "But in a game you can be ready to ship and a designer's like 'I've got this one little feature, I'm just going to change the colour on this one thing' and then it somehow blows up something and now the first 10 minutes of the game doesn't play. So that testing aspect, every single time anything new goes into a big game the whole game has to be tested, front-to-back, side-to-side."

Booty continued by saying it's his "dream" to see AI testers become a reality, adding "there's a lot going on with AI and machine learning right now, and people using AI to generate all these images. What I always say when I bump into the AI folks is 'help me figure out how to use an AI bot to go test a game,' because I would love to be able to start up 10,000 instances of a game in the cloud. So there's 10,000 copies of the game running, deploy an AI bot to spend all night testing the game, then in the morning we get a report. Because that would be transformational."

It seems unlikely Booty is advocating for doing away with human QA testers entirely, so much as theorising about about how a new technology could be used in the QA process. It's not the best look at a time when the wider industry faces ongoing actions and controversies over QA testing practices: tester roles are a notoriously underpaid, underappreciated and overworked part of the development process (and sometimes don't even get appropriate in-game credits). QA units at both Raven Software and Bioware have formed unions this year to tackle unfair pay and dismissals. To suggest that the dream future of QA should be all about machine learning feels somewhat tone-deaf in such a context. 

TOPICS
Mollie Taylor
Features Producer

Mollie spent her early childhood deeply invested in games like Killer Instinct, Toontown and Audition Online, which continue to form the pillars of her personality today. She joined PC Gamer in 2020 as a news writer and now lends her expertise to write a wealth of features, guides and reviews with a dash of chaos. She can often be found causing mischief in Final Fantasy 14, using those experiences to write neat things about her favourite MMO. When she's not staring at her bunny girl she can be found sweating out rhythm games, pretending to be good at fighting games or spending far too much money at her local arcade.  

Read more
Microsoft Muse-generated gaming in action
'A massive, massive moment of wow.' Microsoft CEO predicts AI-generated games are a 'CGI moment' for the industry
An Ai face looks down on a human.
Xbox announces 'a generative AI model for gameplay ideation' called Muse, but don't get too excited: Machines aren't about to make games for you just yet
A photo of a monitor displaying the output screen of Razer's AI QA Copilot system
It's not for PC gamers but Razer's new AI QA Copilot could ultimately benefit every PC gamer out there, and it's looking like it could be a killer app that AI needs right now
Baldur's Gate 3 Karlach concept art
'The dream of the tech industry is to sell off your company at an overinflated price and retire,' says actor behind Baldur's Gate 3's Karlach, 'And I feel that's being done with game studios right now'
Vice President, Games at Netflix Mike Verdu speaks onstage during TechCrunch Disrupt 2022 on October 18, 2022 in San Francisco, California
4 short months after saying 'We'll have to adapt and change', Netflix's AI games VP adapts and changes into a person who isn't working there anymore
Apex Legends Final Fantasy 7
Over 30 Apex Legends voice actors refuse to sign an agreement that would see them 'give up our expertise to train the generative AI that will replace us tomorrow'
Latest in Gaming Industry
Lara Croft Unified Art
Tomb Raider developer Crystal Dynamics lays off 17 employees 'to better align our current business needs and the studio's future success'
Monster Hunter Wilds' stockpile master studying a manifest
As layoffs and studio closures continue to deathroll the western AAA industry, analyst points out 5 of 8 major Japanese companies hit all-time share prices this year
A still from a video announcement of Game Informer's return, featuring the magazine's Halo 2 issue.
Game Informer is back from the dead: 'The whole team has returned'
Typing on internet search toolbar: What am I doing?
How a Microsoft exec managed to pitch Microsoft Word through the genius tactic of being able to actually use it in a 'type-off' demanded by clients: 'I was the only one who'd actually been a secretary'
Half-Life wallpaper - Gordon Freeman
Former Valve exec says the company struggled to sell Half-Life until coming up with the ultimate 'one simple trick' of marketing manoeuvres: slapping a 'Game of the Year' sticker on the box
Gabe Newell looks into the camera, behind him is a prop of a turret from Team Fortress 2.
Gabe Newell's cult of personality is intense, but a Valve exec who worked with him says his superpower is how he 'delighted in people on the team just being really good at what they did'
Latest in News
A mech awakens.
Mecha Break developer is considering unlocking all mechs following open beta feedback
Lara Croft Unified Art
Tomb Raider developer Crystal Dynamics lays off 17 employees 'to better align our current business needs and the studio's future success'
A long bendy arm stealing money from people in a subway car
'You're a very long arm. You steal things. It's a comedy game,' explains developer of comedy game where you steal things with a very long arm
The heroes are attacked by monsters
Pillars of Eternity is getting turn-based combat to mark its 10th anniversary, and that means PC Gamer editors will soon be arguing about combat mechanics again
Image of Ronaldo from Fatal Fury: City of the Wolves trailer
It doesn't really make sense that soccer star Ronaldo is now a Fatal Fury character, but if you follow the money you can see how it happened
Junah beginning a battle in Metaphor: ReFantazio.
Today's RPG fans are 'very sensitive to feeling like they wasted time' when they die, says Metaphor: ReFantazio battle planner—but Atlus still made combat hard anyway