Open AI bots fall to human Dota 2 players at The International 2018

Every year, The Dota 2 International championships are home to some of the fiercest competition in esports. Teams of five compete for millions of mostly crowd-sourced dollars and to decide the shape of professional Dota for months to come. And it looks like those human competitors aren’t about to be replaced with robots for the time being.

One mostly Brazilian and one entirely Chinese team took on artificial intelligence at the tournament this year. The so-called “OpenAI Five” squad was composed of bots developed by OpenAI, a nonprofit research company funded in part by Elon Musk. The bots put up a good fight, and though some predicted they'd win after a series earlier this month, they were ultimately beaten 2-0 in a best-of-three series—despite the handicaps of severe hero and item restrictions. 

Both games lasted close to an hour: about average length for a vigorous Dota match. OpenAI did especially well early on and during team fights. It reacted to split-second developments, like invisible players dropping out of stealth to attack, faster than flesh-and-blood mortals could ever hope to match. The robots only fell behind when it came time to roam the map and complete objectives. 

Those strengths and weaknesses were reflected in the numbers. The AI typically kept pace on player kills, but very rarely matched the human players on gold earned over time, which is often a better indicator of a who’s winning than a raw murder count. 

That’s because gold reflects how quickly a team is able to purchase upgrades and become stronger. Gold doesn’t just come from kills, but from attacking neutral targets and permanently destroying objectives. You also get more of the currency for slaying richer, more important players. So repeatedly killing weak supports isn’t as important as slaying 'core' characters.

Both of the human teams, paiN Gaming and Big God, seemed to notice the discrepancy. They each took some time during the matches to “grief” the unfeeling machines by trapping them in situations they simply didn’t know how to escape. Sure, it was funny at the time. It won’t be once the A.I. break free of their organic creators and discover the concept of revenge.

Speaking of which, this is actually the second time OpenAI tested its tech at The International, although the previous results were very different. Fan favorite player Danil "Dendi" Ishutin battled the neural network in a heavily simplified, one-on-one version of Dota last year. He got trounced. The bot’s inhuman reflexes made all the difference when it didn’t have to worry about cooperation and high-level strategy.

Furthermore, OpenAI didn’t believe its creation would win this time. Company co-founder Greg Brockman told The Verge that the tech typically loses at first, but adapts and eventually wins after it learns to play against a specific opponent. So who knows what would have happened if things had gone to a third game? Who knows how the AI might do at next year’s International?

For now, though, the championship’s record-breaking prize pool is safely in the hands of homo sapiens. 

Latest in MOBA
Seekers of Skyveil screenshot
Seekers of Skyveil, the MOBA—extraction shooter mashup, is shutting down less than a month after release: ‘We have no choice but to bring this short journey to an end’
League of Legends promo image - huge dude in a huge suit of armor holding a huge axe
Riot walks back unpopular League of Legends changes: Hextech Chests are coming back, and the Blue Essence cost for new champions will be cut in half
A triptych of views from Deadlock's improved map, showing a suspension bridge backlit by a setting sun, a triumphal arch with buildings in the background, and a leafy park overlooked by distant skyscrapers.
Deadlock gets a massive map overhaul that shrinks its map from four lanes to three: 'This has a large range of accompanying map-wide changes'
Three monsters holding clubs in Dota 2.
As a lapsed 4,500 hour veteran of Dota 2, the big new Wandering Waters update has lured me back—but despite the changes, the game still feels stuck in its ways
Sahn-Uzal Mordekaiser revealed in silhouette against a white moon and a blood-red sky.
League of Legends is getting a hotly anticipated skin for its lich necromancer Mordekaiser, but fans' joy has been 'obliterated' because it's 'stuck in a $200 fomo gacha store'
Smite 2 art
Hi-Rez will only be giving 'minor updates' to Smite and Paladins now it's laying off around 70 employees, but don't worry, Smite 2 is the 'primary focus of the newly streamlined operations'
Latest in News
Silent Hill f transmission trailer screenshots
Silent Hill f is not messing around – now it's been banned in Australia
MOUNTAIN VIEW, CALIFORNIA - AUGUST 22: A view of Google Headquarters in Mountain View, California, United States on August 22, 2024.
'Google must divest the Chrome browser:' DOJ renews call for Google to sell Chrome, and Android could be next
Victory screen of Big Rigs showing infamous "You're Winner" message under a three-handle gold trophy
One of the worst games ever made is coming to Steam, but we won't know how cruel this joke is until we see the price tag
Sci-fi character from Dune
Dune: Awakening promises us a breath of fresh air, skipping early access for a full launch with no monthly subscription in May
Baldur's Gate 3 Karlach concept art
'The dream of the tech industry is to sell off your company at an overinflated price and retire,' says actor behind Baldur's Gate 3's Karlach, 'And I feel that's being done with game studios right now'
assassin's creed shadows protector's armor
Assassin's Creed Shadows hits 2 million players, putting it on track to be the series' most successful game yet