Study claims that when a company's tech support adopted ChatGPT its staff got better at their jobs and became less likely to quit

AI image lady face.
(Image credit: Getty Images - Yuichiro Chino)

With the meteoric rise of generative AI tools like ChatGPT, Midjourney, and Dall-E, workers and companies are concerned, for different reasons, about how AI will affect them. While some organizations are banning them, others have added AI tools to their workflows, and in at least one case, the addition has reportedly improved productivity and morale.

Researchers from MIT and Stanford (via NPR) report that when a Fortune 500 enterprise company (which chose to remain nameless in the study) slowly implemented a customized version of ChatGPT to assist its IT support workers in late 2020/early 2021, not only did performance improve, but so did employee retention. And with a job that reports an over 60% turnover rate every year, it was a massive boon for the company. 

The process involved the representative interacting with the customer through an online chat in one window with the chatbot open in another. When a customer required help with software issues, the representative could feed the chatbot the question and use its output to troubleshoot the problem.

"At a technical level, customer support is well-suited for current generative AI tools," reads the report. "From an AI’s perspective, customer-agent conversations can be thought of as a series of pattern-matching problems in which one is looking for an optimal sequence of actions."

The chatbot was trained on the company's highly-rated support call conversations and could feed workers solutions and specific phrases that had worked in the past for more experienced employees. In theory, then, individuals with little to no IT experience could respond to customer inquiries as quickly and effectively as those with years of experience.

According to the report, there is "suggestive evidence that AI recommendations can make low-skilled workers communicate more like high-skilled workers." New workers could handle more calls per hour while providing more satisfactory customer responses. The study also reported that there was a decrease in requests to "speak to a manager," which is a dreaded phrase in any customer-facing environment.

Chip chillers

CPU Coolers

(Image credit: Corsair, Noctua)

Best CPU cooler: keep your chip chilled in style
Best PC fans: super-silent and plastered in RGB
Best PC cases: big, little, and everything in-between.

Veteran and high-skill employees found the chatbot tool less helpful because the AI's training data consisted of their five-star conversations—they already had the answers.

Erik Brynjolfsson, an economist at Stanford and one of the study's researchers, told NPR that this system "took people with just two months of experience and had them performing at the level of people with six months of experience."

In this case, AI seems to make a job easier rather than replace it. NPR suggests that even if they don't replace workers, AI tools could "de-skill" some jobs, potentially lowering wages since prior knowledge may not be necessary. (Although one wonders whether, on a large scale, we won't see lots of erroneous advice from support workers who don't know whether an AI is giving them genuine answers.)

There at least need to be some experts around to train the bot, so maybe that's good news? It may or may not console you that OpenAI published a study listing jobs that a chatbot could never replace.

Jorge Jimenez
Hardware writer, Human Pop-Tart

Jorge is a hardware writer from the enchanted lands of New Jersey. When he's not filling the office with the smell of Pop-Tarts, he's reviewing all sorts of gaming hardware, from laptops with the latest mobile GPUs to gaming chairs with built-in back massagers. He's been covering games and tech for over ten years and has written for Dualshockers, WCCFtech, Tom's Guide, and a bunch of other places on the world wide web. 

Read more
Closeup of the new Copilot key coming to Windows 11 PC keyboards
Microsoft co-authored paper suggests the regular use of gen-AI can leave users with a 'diminished skill for independent problem-solving' and at least one AI model seems to agree
OpenAI logo displayed on a phone screen and ChatGPT website displayed on a laptop screen are seen in this illustration photo taken in Krakow, Poland on December 5, 2022.
New research says ChatGPT likely consumes '10 times less' energy than we initially thought, making it about the same as Google search
PC building
ChatGPT vs DeepSeek: which AI can build me a better gaming PC?
SAN FRANCISCO, CALIFORNIA - NOVEMBER 06: OpenAI CEO Sam Altman speaks during the OpenAI DevDay event on November 06, 2023 in San Francisco, California. Altman delivered the keynote address at the first-ever Open AI DevDay conference.(Photo by Justin Sullivan/Getty Images)
In a mere decade 'everyone on Earth will be capable of accomplishing more than the most impactful person can today' says OpenAI boss Sam Altman
CHINA - 2025/02/11: In this photo illustration, a Roblox logo is seen displayed on the screen of a smartphone. (Photo Illustration by Sheldon Cooper/SOPA Images/LightRocket via Getty Images)
'Humans still surpass machines': Roblox has been using a machine learning voice chat moderation system for a year, but in some cases you just can't beat real people
SUQIAN, CHINA - JANUARY 27, 2025 - An illustration photo shows the logo of DeepSeek and ChatGPT in Suqian, Jiangsu province, China, January 27, 2025. (Photo credit should read CFOTO/Future Publishing via Getty Images)
China's DeepSeek chatbot reportedly gets much more done with fewer GPUs but Nvidia still thinks it's 'excellent' news
Latest in AI
Otter AI Meeting Agent
As if your work meetings weren't already fun enough, now Otter has a new all-hearing AI agent that remembers everything anyone has said and can join in the discussion
Image for
'No real human would go four links deep into a maze of AI-generated nonsense': Cloudflare's AI Labyrinth uses decoy pages to trap web-crawling bots and feed them slop 'as a defensive weapon'
CHINA - 2025/02/11: In this photo illustration, a Roblox logo is seen displayed on the screen of a smartphone. (Photo Illustration by Sheldon Cooper/SOPA Images/LightRocket via Getty Images)
'Humans still surpass machines': Roblox has been using a machine learning voice chat moderation system for a year, but in some cases you just can't beat real people
OpenAI logo displayed on a phone screen and ChatGPT website displayed on a laptop screen are seen in this illustration photo taken in Krakow, Poland on December 5, 2022.
ChatGPT faces legal complaint after a user inputted their own name and found it accused them of made-up crimes
Public Eye trailer still - dead-eyed police officer sitting for an interview
I'm creeped out by this trailer for a generative AI game about people using an AI-powered app to solve violent crimes in the year 2028 that somehow isn't a cautionary tale
Closeup of the new Copilot key coming to Windows 11 PC keyboards
Microsoft co-authored paper suggests the regular use of gen-AI can leave users with a 'diminished skill for independent problem-solving' and at least one AI model seems to agree
Latest in News
Image of Cersei Lanniser from Game of Thrones: Kingsroad Steam early access trailer
A new Game of Thrones RPG is coming to Steam today with a cast of 'familiar faces,' which is good because it's really the only way to tell it's a GoT game at all
The new Prime Asset featured in the upcoming update for the Outlast Trials.
The Outlast Trials puts its already paranoid players under surveillance for a time-limited story event
A Viera looking confused in Final Fantasy 14.
Old armor continues to fall victim to Final Fantasy 14's bizarre two-channel dye system, unless you're super into changing the colour of teeny-tiny eyelets: 'Why even bother at this point?'
Starfield: Shattered Space
By the time Bethesda was on Starfield, you'd 'basically get in trouble' for breaking schedule, says former dev: 'A lot of the great stuff within Skyrim came from having the freedom to do what you want'
Otter AI Meeting Agent
As if your work meetings weren't already fun enough, now Otter has a new all-hearing AI agent that remembers everything anyone has said and can join in the discussion
Monster Hunter Wilds' stockpile master studying a manifest
As layoffs and studio closures continue to deathroll the western AAA industry, analyst points out 5 of 8 major Japanese companies hit all-time share prices this year