Google begins training DeepMind AI to dominate players in Starcraft II

Time and again we have seen machines triumph over humans in various competitions, such as when IBM's Watson beat the best Jeopardy players of all time. More recently, Google's DeepMind AI defeated the world's best Go player. Now AI researchers are setting their sights on StarCraft II, one of the most popular multiplayer games of all time, Wired reports.

This comes with Blizzard's blessing, as it has just released the tools necessary for AI researchers to build bots capable of playing against human players. In a partnership with DeepMind that was announced last year, Blizzard is also opening a cache of data from 65,000 past StarCraft II matches that could prove instrumental in training bots to compete. And that's just the beginning—Blizzard and DeepMind will add around half a million games to the cache each month.

Why focus on StarCraft II? While popular in the esports scene, StarCraft II also provides a bigger challenge for machine learning research that goes well beyond previously conquered games. For example, games like Go and chess are so-called perfect information games—the AI bot can see all of its opponents moves and calculate different outcomes. On a Go board, the number of valid positions is a 1 followed by 170 zeroes. But in StarCraft II, researchers estimate you'd need to add at least 100 more zeroes to account for its complexity.

"It's a big step up," says Oriol Vinyals, a DeepMind researcher working on StarCraft. "This game will require us to innovate in planning, memory, and how we deal with uncertainty."

While StarCraft II may seem like an easier game to conquer compared to Go or Chess, the additional challenge comes from not being able to see everything. The bots that compete will only see and do the things human players can see and do, so there won't be an unfair advantage. This will force bots to try and anticipate player strategies, and to develop their own styles of play.

Seeing an AI compete against a human in StarCraft II is interesting in and of itself, though there are bigger goals and potential outcomes here than just fun. Google has used machine learning from DeepMind to cut cooling costs in its datacenters. By developing AI that can one day defeat humans in StarCraft II, there is hope of taking on more complex jobs.

"From a scientific point of view, the properties of StarCraft are very much like the properties of life," says David Churchill, a professor at Memory University of Newfoundland and organizer of StarCraft bot competitions. "We're making a test bed for technologies we can use in the real world."

Researchers have a ways to go before getting to that point. Early results from bots that were trained with StarCraft data shows there is a significant gap between humans and machines.

Paul Lilly

Paul has been playing PC games and raking his knuckles on computer hardware since the Commodore 64. He does not have any tattoos, but thinks it would be cool to get one that reads LOAD"*",8,1. In his off time, he rides motorcycles and wrestles alligators (only one of those is true).

Latest in RTS
Immortal Pillars expansion for Age of Mythology: Retold
Age of Mythology Retold's new Chinese pantheon expansion takes a bold stance on updating an old game: Just make good new stuff
Earth vs Mars screenshot - Martian troopers vs Earth light tanks
Relic's new project is a 'smaller indie-style' game about a martian invasion of Earth
Age of Empires 3: Definitive Edition promo art
Age of Empires 3: Definitive Edition DLC promised last year is cancelled: 'We announced content before it had been built, and we now feel that announcement was premature'
Tempest Dynasty faction
The first multiplayer demo for my most anticipated RTS, Tempest Rising, is out now
Former Age of Empires developer says the RTS genre's stuck in a rut: 'you're still playing the same game'
Creeper World IXE
Creeper World IXE breaks the RTS mold and adds a dash of Noita's alchemy to the gooey war
Latest in News
An Enshrouded player in a recreation of Erebor from The Lord of the Rings
Kings under the Mountain! 33 Enshrouded players spent 10,000 hours to recreate this iconic location from The Lord of the Rings
A mech awakens.
Mecha Break developer is considering unlocking all mechs following open beta feedback
Lara Croft Unified Art
Tomb Raider developer Crystal Dynamics lays off 17 employees 'to better align our current business needs and the studio's future success'
A long bendy arm stealing money from people in a subway car
'You're a very long arm. You steal things. It's a comedy game,' explains developer of comedy game where you steal things with a very long arm
The heroes are attacked by monsters
Pillars of Eternity is getting turn-based combat to mark its 10th anniversary, and that means PC Gamer editors will soon be arguing about combat mechanics again
Image of Ronaldo from Fatal Fury: City of the Wolves trailer
It doesn't really make sense that soccer star Ronaldo is now a Fatal Fury character, but if you follow the money you can see how it happened