Facebook kills AI that invented its own language because English was slow

Some wonderful things are in development because of advances made in artificial intelligence and machine learning technologies. At the same time, there is perhaps an uncomfortable fear that machines may rise up and turn against humans. Usually the scenario is brought up in a joking matter, but it was no laughing manner to researchers at Facebook who shut down an AI they invented after it taught itself a new language, Digital Journal reports.

The AI was trained in English but apparently had grown fed up with the various nuances and inconsistencies. Rather than continue down that path, it developed a system of code words to make communication more efficient.

What spooked the researchers is that the phrases used by the AI seemed like gibberish and were unintelligible to them, but made perfect sense to AI agents. This allowed the AI agents to communicate with one another without the researchers knowing what information was being shared.

During one exchange, two bots named Bob and Alice abandoned English grammar rules and started communicating using the made up language. Bob kicked things off by saying, "I can i i everything else," which prompted Alice to respond, "balls have zero to me to me to me..." The conversation went on in that manner.

The researchers believe the exchange represents more than just a bunch of nonsense, which is what it appears to be on the surface. They note that repeating words and phrases such as "i" and "to me" are indicative of how AI works. In this particular conversation, they believe the bots were discussing how many of each item they should take.

AI technologies use a "reward" system in which they expect of a course of action to have a "benefit."

"There was no reward to sticking to English language," Dhruv Batra, a research scientists from Georgia Tech who was at Facebook AI Research (FAIR), told Fast Co. Design. "Agents will drift off understandable language and invent codewords for themselves. Like if I say 'the' five times, you interpret that to mean I want five copies of this item. This isn't so different from the way communities of humans create shorthands."

Facebook ultimately determined that it wanted its bots to speak in plain English, in part because the interest was in making bots that can talk with people. However, researchers at Facebook also admitted that they can't truly understand languages invented by AI.

Paul Lilly

Paul has been playing PC games and raking his knuckles on computer hardware since the Commodore 64. He does not have any tattoos, but thinks it would be cool to get one that reads LOAD"*",8,1. In his off time, he rides motorcycles and wrestles alligators (only one of those is true).

Latest in AI
Otter AI Meeting Agent
As if your work meetings weren't already fun enough, now Otter has a new all-hearing AI agent that remembers everything anyone has said and can join in the discussion
Image for
'No real human would go four links deep into a maze of AI-generated nonsense': Cloudflare's AI Labyrinth uses decoy pages to trap web-crawling bots and feed them slop 'as a defensive weapon'
CHINA - 2025/02/11: In this photo illustration, a Roblox logo is seen displayed on the screen of a smartphone. (Photo Illustration by Sheldon Cooper/SOPA Images/LightRocket via Getty Images)
'Humans still surpass machines': Roblox has been using a machine learning voice chat moderation system for a year, but in some cases you just can't beat real people
OpenAI logo displayed on a phone screen and ChatGPT website displayed on a laptop screen are seen in this illustration photo taken in Krakow, Poland on December 5, 2022.
ChatGPT faces legal complaint after a user inputted their own name and found it accused them of made-up crimes
Public Eye trailer still - dead-eyed police officer sitting for an interview
I'm creeped out by this trailer for a generative AI game about people using an AI-powered app to solve violent crimes in the year 2028 that somehow isn't a cautionary tale
Closeup of the new Copilot key coming to Windows 11 PC keyboards
Microsoft co-authored paper suggests the regular use of gen-AI can leave users with a 'diminished skill for independent problem-solving' and at least one AI model seems to agree
Latest in News
Crysis hero Prophet running down a beach while under fire
Crysis Remastered Trilogy activates maximum value mode as upgraded version of the legendary, hardware-crushing FPS series is currently 60% off
A goblin with sharp teeth, wearing goggles, lets out a mischievous cackle in WoW's latest patch: Undermine(d).
World of Warcraft's started swiping good ideas from one of its most popular user-made UI addons, and it's honestly about time
A female druidic figure clutches a heart riven with thorns in Hunt: Showdown
'We want to increase the cost of silence': Hunt: Showdown 1896's latest update brings a new event, a massive list of bugfixes and a tougher challenge for stealthy players
It's ENA! From the free adventure Dream BBQ!
Mindbending free multimedia adventure ENA: Dream BBQ is out now, has activated all my neurons and opened my third eye
PC Gamer magazine issue 408 Doom: The Dark Ages
PC Gamer magazine's new issue is on sale now: Doom: The Dark Ages
A gigantic terracotta sentinel made of living armor
Total War: Warhammer 3's army of Cathay has broken containment and is making its way to tabletop Warhammer at last