Meta-funded regulator for AI disinformation on Meta's platform comes under fire: 'You are not any sort of check and balance, you are merely a bit of PR spin'

CHONGQING, CHINA - OCTOBER 30: In this photo illustration - The Facebook app page is displayed on a smartphone in the Apple App Store in front of the Meta Platforms, inc. logo on October 30, 2024 in Chongqing, China. (Photo by Cheng Xin/Getty Images)
(Image credit: Getty Images / Cheng Xin)

Just a few years ago it was easy to spot, at first glance, that an AI image wasn't real. Edges of items blended together, proportions didn't quite feel right, people had too many fingers, it never got cats right… yet it's now reaching the point that it can be harder to tell. Coming up to the US elections, TechCrunch hosted a talk with AI experts on AI disinformation (misinformation that has direct intent and malice) and Meta's self-regulation policies saw itself in the firing line.

This conversation around disinformation ended up on Meta's practices because Pamela San Martín, Co-chair of the Oversight Board for Meta, was one of the key speakers.

The Oversight, according to its own FAQ, "is a body of experts from around the world that exercises independent judgment and makes binding decisions on what content should be allowed on Facebook and Instagram".

However, just a few questions down the page, it declares that the board is funded directly by Meta, with $280 million in funding over the last five years alone. This declaration of independence, when paired with the knowledge of funding, implies a tension that the other members of the panel picked up.

San Martín, whilst acknowledging the problems of AI and Meta's own need to learn from it, praised AI as a tool for battling AI misinformation.

"Most social media content is moderated by automation and automation uses AI, either to flag certain content to be reviewed by humans, or to flag certain content to be actioned."

Off the back of this, she also suggested that the best way to combat disinformation isn't always to remove it, but sometimes to inform or label it correctly. Think of the X community notes function and you have a good idea of what that looks like. She also noted that public reports of disinformation are mostly a good tool for public figures and information, and do little to dissuade harm to private individuals.

She saw pushback when talking about regulation, specifically self-regulation of boards.

"Regulation is necessary. I'm very concerned when it's speech-related, but I'm completely for regulation when it has to do with transparency and accountability" San Martín told the group.

Brandie Nonnecke, the founding director of the CITRIS Policy Lab, responded to this claim with "I don't think these transparency reports really do anything".

The argument here is that, with the amount of AI disinformation out there, a report can show thousands of actioned examples without giving a broader understanding of what disinformation is left untouched. They can give "a false sense that they are actually doing due diligence". When those reports are created internally, it can also be hard to judge the intent of the report.

Imran Ahmed, the CEO of the Center for Countering Digital Hate(CCDC), is also critical of not only Meta but Meta's Oversight Board and its incentives.

"Self-regulation is not regulation, because the oversight board itself cannot answer the five fundamental questions you should always ask someone who has power. What power do you have, who gave you that power, in whose interests do you wield that power, to whom are you accountable, and how do we get rid of you if you're not doing a good job? If the answer to every single one of those questions is (Meta) you are not any sort of check and balance, you are merely a bit of PR spin."

This is an important point when talking about regulation, and one San Martín rebuffed by noting that she cannot be fired by Meta for her reports.

AI, explained

OpenAI logo displayed on a phone screen and ChatGPT website displayed on a laptop screen are seen in this illustration photo taken in Krakow, Poland on December 5, 2022.

(Image credit: Jakub Porzycki/NurPhoto via Getty Images)

What is artificial general intelligence?: We dive into the lingo of AI and what the terms actually mean.

As noted by session moderator, Kyle Wiggers, the Meta oversight board saw layoffs in April this year, though she assures the panel the funding for her work is overseen by a trust which has been given money from Meta irrevocably.

It can choose to not extend the terms of employees in this fund so, while they can't be fired, they can stop getting funding, and this touches on some of the weariness around transparency reports and self-regulation.

Meta's approach to AI has seen wide distrust, as can be shown by the Goodbye Meta AI chain mail, and self-regulation may not be the best way to tackle the misuse of AI.

Nonnecke suggests that transparency reports can, ironically, obfuscate the problems the report intends to tackle and questioning Meta's incentives to regulate itself feels like a necessary step in gaining a more intelligent and safe approach to AI on its platforms.

James Bentley
Hardware writer

James is a more recent PC gaming convert, often admiring graphics cards, cases, and motherboards from afar. It was not until 2019, after just finishing a degree in law and media, that they decided to throw out the last few years of education, build their PC, and start writing about gaming instead. In that time, he has covered the latest doodads, contraptions, and gismos, and loved every second of it. Hey, it’s better than writing case briefs.

Read more
Ryan Gosling looking worse for wear looking up lit by purple light
Meta wants AI characters to fill up Facebook and Instagram 'kind of in the same way accounts do,' but also had to delete a humiliating first run of its official bots
Mark Zuckerberg, chief executive officer of Meta Platforms Inc., during the Meta Connect event in Menlo Park, California, US, on Wednesday, Sept. 25, 2024. Meta Platforms Inc. debuted its first pair of augmented reality glasses, devices that show a combined view of the digital and physical worlds, a key step in Chief Executive Officer Mark Zuckerberg's goal of one day offering a hands-free alternative to the smartphone. Photographer: David Paul Morris/Bloomberg via Getty Images
Facebook and Instagram are ditching fact-checkers in favor of a Community Notes system inspired by X: 'Fact-checkers have just been too politically biased,' Zuckerberg says
Seal
Meta's deepfake-fighting AI video watermarking tool is here, and for some reason it's decided to call it the Video Seal
CHONGQING, CHINA - OCTOBER 30: In this photo illustration - The Facebook app page is displayed on a smartphone in the Apple App Store in front of the Meta Platforms, inc. logo on October 30, 2024 in Chongqing, China. (Photo by Cheng Xin/Getty Images)
Meta might've done something useful, pioneering an AI model that can interpret brain activity into sentences with 80% accuracy
A digitally generated image of abstract AI chat speech bubbles overlaying a blue digital surface.
We need a better name for AI, or we risk talking past each other until actually intelligent AGI comes home mooing
Symbolic photo: Logo of the video platform YouTube on June 07, 2023 in Berlin, Germany.
'It’s a whole new kind of blerp': YouTube's AI-enhanced reply suggestions seem to be working as well as you might expect
Latest in AI
Aloy
'Creepy,' 'ghastly,' 'rancid': Viewers react to leaked video of Sony's AI-powered Aloy
Seattle, USA - Jul 24, 2022: The South Lake Union Google Headquarter entrance at sunset.
Google is rolling out an even more AI-heavy search engine mode because 'power users want AI responses for even more of their searches'
A digitally generated image of abstract AI chat speech bubbles overlaying a blue digital surface.
We need a better name for AI, or we risk talking past each other until actually intelligent AGI comes home mooing
MOUNTAIN VIEW, CALIFORNIA - AUGUST 22: A view of Google Headquarters in Mountain View, California, United States on August 22, 2024.
One educational company accuses Google's AI summary of leading to a 'hollowed-out information ecosystem of little use and unworthy of trust' in latest lawsuit
Nvidia Signs, its AI-led ASL teaching platform
Nvidia has built a free AI-led platform to help teach American Sign Language with '400,000 video clips representing 1,000 signed words' so far
Microsoft Muse-generated gaming in action
'A massive, massive moment of wow.' Microsoft CEO predicts AI-generated games are a 'CGI moment' for the industry
Latest in News
A masked man with an axe in the woods
Rebellion CEO seems kind of awed by major studios making massive videogames: 'How do you organize a game that has 2,000 people working on it?'
A young witch watering a smiling mushroom in a magic garden
Here's a roguelite dungeon crawler Steam reviewers call 'a botanical Diablo' and 'like Cult of the Lamb' except you manage a mystical garden
Destiny 2 Rite of the Nine: The Emissary, massive, ominously standing at the edge of a water basin.
Oops! Bungie rolled out Destiny 2's Rite of the Nine event three weeks early, and new loot is already dropping
Chatacabra from Monster Hunter Wilds
The latest Monster Hunter Wilds event quest gives piles of Armor Spheres for hunting a Chatacabra, making this a very bad week to be a frog in the Forbidden Lands
No Rest for the Wicked Steam early access screenshots
No Rest for the Wicked developer Moon Studios is now 'fully independent' after acquiring the rights to the game from Take-Two
A hunter posing with an absurd Blangonga outfit in Monster Hunter Wilds.
Attention, fashion hunters: There's a Monster Hunter Wilds mod to disable all those obnoxious glowing buff effects that distract from your fits