Twitch's new 'machine learning' ban evasion detector will be switched on by default

Twitch
(Image credit: PC Gamer)

This past July, Twitch added a multitude of tags to improve the discoverability of channels belonging to users of various identities, including trans, black, and disabled streamers. This also served as a lightning rod for harassers to find and direct their hate against those communities. Particularly egregious were so-called "hate raids," where automated accounts would flood chats with derogatory or violent speech.

Things came to a head on September 1st when a group of streamers staged a "#DayOffTwitch" to protest Twitch's inadequate response to the issue. Twitch responded with an option for streamers to require phone number-based verification to participate in their chats, and this seems to have mitigated the worst of the hate raids.

Twitch's latest addition to its privacy and security tools will hopefully give streamers further options for moderation, specifically for dealing with problem individuals getting past bans by making alternate accounts. In its announcement on November 30, Twitch outlined a machine-learning system that attempts to detect such users.

On default settings, when such an account is detected participating in the chat their input is either marked in the channel or muted pending moderator action, depending on how likely the algorithm believes they are an unwanted user. Streamers are able to adjust how harsh that initial automatic response is, with the most extreme option being an automatic ban on suspicious accounts.

The announcement included a caveat about the program's accuracy, elaborating:

"One thing to prepare for, particularly around launch, is that no machine learning will ever be 100% accurate, which means there is a possibility of false positives and false negatives. That's why Suspicious User Detection doesn’t automatically ban all possible or likely evaders… The tool will learn from the actions you take and the accuracy of its predictions should improve over time as a result."

I appreciate the tool's modularity and how much control it offers someone when moderating their own channel. Twitch owes streamers at least this much given the extent to which it allowed the hate raiding issue to persist, as well as the awful copyrighted music situation and its attendant purge of old videos last October. 

TOPICS
Associate Editor

Ted has been thinking about PC games and bothering anyone who would listen with his thoughts on them ever since he booted up his sister's copy of Neverwinter Nights on the family computer. He is obsessed with all things CRPG and CRPG-adjacent, but has also covered esports, modding, and rare game collecting. When he's not playing or writing about games, you can find Ted lifting weights on his back porch.

Read more
Twitch Nvidia NVENC encoding
Twitch is changing its suspension policy so that violations have an expiry date because the system 'didn’t acknowledge community members who had learned from their past mistakes'
CHINA - 2025/02/11: In this photo illustration, a Roblox logo is seen displayed on the screen of a smartphone. (Photo Illustration by Sheldon Cooper/SOPA Images/LightRocket via Getty Images)
'Humans still surpass machines': Roblox has been using a machine learning voice chat moderation system for a year, but in some cases you just can't beat real people
A young Asian woman opening visual aids to give her audience a better understanding while holding a podcast session.
Logitech has announced an 'intelligent streaming assistant' in Streamlabs to tell you when your live stream sucks
One YouTuber has been poisoning AI tools that access her videos with .ass subtitle files and you can too
Alisaie, a side character in Final Fantasy 14: Dawntrail, folds her arms with a confident smirk on her face.
Final Fantasy 14 communities panic as it turns out change to blacklisting, meant to help reduce stalking, also lets players use mods to track their alts
Discord key art showing a man handing a a scroll to the Discord mascot, but there's a mute symbol over the mascot's head.
Discord finally adds an Ignore feature so you can gently silence someone's rancid vibes
Latest in Platforms
A screenshot from game Mudborne of a little humanoid frog in a marsh
Five new Steam games you probably missed (March 24, 2025)
midnight murder club
Five new Steam games you probably missed (March 17, 2025)
Screenshot of Children of Clay showing a mysterious clay model
Five new Steam games you probably missed (March 10, 2025)
discord
Brace yourself for Discord to get worse: Reports swirl that the company is in talks with bankers about opening itself up to shareholders
The Spy from Team Fortress 2 holds up a folder with an accusatory expression.
Steam users react ecstatically to update that lets them access their heaving game notes via the web, also it fixes Monster Hunter Wilds video recording
HasanAbi
Twitch streamer Hasan Piker suspended after saying Republicans would 'kill Rick Scott' if they really cared about Medicare fraud
Latest in News
A mech awakens.
Mecha Break developer is considering unlocking all mechs following open beta feedback
Lara Croft Unified Art
Tomb Raider developer Crystal Dynamics lays off 17 employees 'to better align our current business needs and the studio's future success'
A long bendy arm stealing money from people in a subway car
'You're a very long arm. You steal things. It's a comedy game,' explains developer of comedy game where you steal things with a very long arm
The heroes are attacked by monsters
Pillars of Eternity is getting turn-based combat to mark its 10th anniversary, and that means PC Gamer editors will soon be arguing about combat mechanics again
Image of Ronaldo from Fatal Fury: City of the Wolves trailer
It doesn't really make sense that soccer star Ronaldo is now a Fatal Fury character, but if you follow the money you can see how it happened
Junah beginning a battle in Metaphor: ReFantazio.
Today's RPG fans are 'very sensitive to feeling like they wasted time' when they die, says Metaphor: ReFantazio battle planner—but Atlus still made combat hard anyway