Always keep backups: an 'unprecedented' Google Cloud debacle saw a $135 billion pension fund's entire account deleted and services knocked out for nearly two weeks

Google headquarters is seen in Mountain View, California, United States on September 26, 2022.
(Image credit: Tayfun Coskun/Anadolu Agency via Getty Images)

What's the worst thing you've accidentally deleted without meaning to? I can assure you that it wasn't anywhere near as bad as Google Cloud deleting the entire customer account (including all backups) of $135 billion Australian pension fund, UniSuper, putting services for its over 615,000 members on the fritz for nearly two weeks.

As reported by Ars Technica, UniSuper picking Google Cloud for its digital services was a big enough deal to get its own press release, with the fund outsourcing crucial infrastructure to the internet giant—many companies do the same with Amazon Web Services⁠⁠.

While UniSuper said that pension payments were not disrupted by the outage, customers were unable to log into their accounts on mobile or desktop, and the fund's outage update timeline implies that transactions were unable to be processed during the blackout, with a data rollback to the end of April required once everything was said and done. Thankfully, UniSuper had kept a backup of its cloud data through another service, which helped in the full resumption of its operations.

But it's still not clear just how this occurred: The deletion of a multi-billion dollar client's account and every backup therein, bypassing all safeguards, knocking out financial services to hundreds of thousands of pensioners for two weeks is, in the words of Brass Eye, the one thing we didn't want to happen.

A joint statement from Google Cloud and UniSuper describes the deletion as resulting "from an unprecedented sequence of events whereby an inadvertent misconfiguration during the provisioning of UniSuper's Private Cloud services ultimately resulted in the deletion of UniSuper's Private Cloud subscription." What, that wasn't crystal clear to you? Basically, "it was a freak accident."

Software developer Daniel Compton points out that the vague language in Google and UniSuper's statement does very little to explain how this occurred on a technical level. Compton argues that one likely explanation was some error on UniSuper's part when using a common cloud infrastructure tool, but Google Cloud seemed to admit fault on its end in a statement during the outage, implying it was a bug on Google's end.

My theory? Some hapless Google employee was chasing a chimpanzee through the server room (you know how those permissive tech offices are, ball pits and whatnot), slipped on a roller skate, and accidentally hit the big red "Delete the Australian pensioners' data" button. They really should have installed a flip cover on that thing. Whatever the explanation may be, clearly no tech service is too big to fail, and you should keep redundant backups of any data that matters to you⁠, he says, ignoring his 20 year-old, 308-game strong Steam Library.

Associate Editor

Ted has been thinking about PC games and bothering anyone who would listen with his thoughts on them ever since he booted up his sister's copy of Neverwinter Nights on the family computer. He is obsessed with all things CRPG and CRPG-adjacent, but has also covered esports, modding, and rare game collecting. When he's not playing or writing about games, you can find Ted lifting weights on his back porch.

Read more
Path of Exile 2 early access class key art
Around 66 accounts in Path of Exile 2 were compromised, due to a one-two punch of an old unused Steam account and a backend bug
Hacker
$1.5 billion crypto heist could be the biggest yet, more than doubling the previous record, but don't worry: The affected firm says it can take the hit
An ogre spreads his arms wide
What's the biggest game on your computer, and is it really worth the space?
An artistic image where a digital progress bar is represented by a physical wooden block.
The nail-biting, 100-hour BIOS update stream which garnered 88,000 peak views ends with a cut to black
A SpaceX rocket being launched into space carrying a payload with the first datacentre for the moon.
A rocket was just fired into space containing the first data center to land on the moon, which is both incredible and incredibly corporate in equal measure
Palworld Pal hammering on rocks with a pickaxe
'He was trying his best'—Palworld had a lone server guy trying to keep the game afloat during its 2 million player launch
Latest in Gaming Industry
Gabe Newell
Gabe Newell is hooked on Stalker 2 and once he's got the fourth ending (!) will 'figure out what I'm going to play next'
Valve logo with a man with a steam valve for an eye.
Valve's DRM was inspired by an exec's nephew, who 'used a $500 check I'd sent him for school expenses and bought himself a CD-ROM replicator… he sent me a lovely thank you note'
Max, from Life is Strange: Double Exposure, looks ponderingly off into the distance.
'We all got laid off', says former Deck Nine narrative designer, after no-one was around to pick up Life is Strange: Double Exposure's GDC Awards win
An edited Microsoft/Steam logo, illustrating the potential future integration Microsoft has for an Xbox app.
Microsoft crawls back to Steam ahead of schedule by leaking a screenshot of an app where you can launch Steam games through Xbox
The "mind blown" meme from Tim & Eric.
Friendship ended with human race: Boffins declare the 'meme Turing test' has been passed, and AI is now making funnier captions on average than you useless lumps
Gabe Newell in a Valve promotional video, on a yacht.
Valve CMO threatened the company would walk away from games if it didn't own the rights to Half-Life—'It wasn't an idle threat—we weren't going to take on all of the risk to make other people rich'
Latest in News
Minthara BG3 looking upset
Another round of Baldur's Gate 3 unearthing reveals Minthara can end up living in a sewer, an unused beach ending, and more
A shirtless man rides a big fish underwater
Ark devs distance themselves from AI-generated trailer: 'we did not know that they were doing it'
Team Fortress Spy being shocked
An FPS studio pulled its game from Steam after it got caught linking to malware disguised as a demo, but the dev insists it was actually the victim of a labyrinthine conspiracy
Neighbors Suburban Warfare screenshot a child aims a slingshot at a man from across a cul-de-sac.
A beta of backyard FPS Neighbors: Suburban Warfare is out now, and the balance discussion is hysterical: nerf trash can lids and children
Grand Theft Auto 6 trailer still - woman in the front seat of a car, looking out the back window while holding a wad of cash
The specter of a GTA 6 delay haunts the games industry: 'Some companies are going to tank' if they guess wrong, says analyst
Screenshot from Wreckfest 2
Wreckfest 2 has hit early access for your car-obliterating combat racing enjoyment