Modders are using AI to upscale pre-rendered PS1 backgrounds with phenomenal results

Final Fantasy 9 with AI-upscaled backgrounds and a light Reshade mod, via kennybones on Qhimm forums.

PC modders have a history of fixing and improving ports of Japanese games, and the latest case is one of the coolest, most exciting applications of technology to old games I've ever seen. We recently wrote about how some people are using neural networks to upscale the backgrounds of Final Fantasy 7, and in just a few weeks these projects have made enormous gains in quality and complexity, and for more than just Final Fantasy 7. Anyone can use these tools, and as a result we're at the start of what feels like a renaissance for PlayStation-era 2D art.

A little background: When 3D was in its infancy, PlayStation game developers compensated for the hardware's shortcomings by pairing 3D character models with pre-rendered 2D backgrounds. Many of them, from series like Final Fantasy, are still stunning today: Detailed, stylized, beautiful works of art you could walk through as you went on an adventure. But the art files on those discs were naturally low resolution, and sloppy archival meant that when Square Enix finally ported games like Final Fantasy 8 and 9 to PC in "HD" form, it didn't have the original art files to use for modern high-res displays. Square simply upscaled the low-res files from the original games to 1080p and called it a day.

The results weren't great. The backgrounds can be blurry or oversharpened—just like if you opened a jpeg in Photoshop and tried to blow it up to four times the original size. But what if ~the magic of AI~ could analyze the image and more intelligently resize it? That's what ESRGAN, or Enhanced Super Resolution Generative Adversarial Networks, are all about. OK, that name is a mouthful, and I'm not about to pretend I fully understand how it works. But there's a whole field of study around the concept of perceptual super resolution, and competing AI implementations for how to upscale images with the best results. ESRGAN is one of the most successful. 

Animated gif comparison of a normal upscale to ESRGAN. Via kingdomakrillic.tumblr.com.

Game fans have latched onto this technology and are dialing in how to best use it for low-resolution background images. Here's a blog that walks you through how to install ESRGAN on Windows and shows off a few results. This forum thread compiles even more examples of the AI applied to different game backgrounds and textures.

The most exciting project to me right now is for Final Fantasy 9, one of my favorite games and one with phenomenal art that doesn't look too hot upscaled to 1080p. Modder Ze PilOt is using this technique to upscale FF9's backgrounds and other textures, which is much more involved than upscaling a jpeg: 

As he tweeted in December, "every frame of the animation is on a different layer. Lighting is mixed with the background. I need to separate all these frames into single images."

But he's made huge progress already, and is rapidly iterating on a mod implementing these new backgrounds and making other touches, like throwing in the old PS1 font to replace the PC version's bland new one. You can grab version 4 of the mod, Moguri Memoria, here, and follow its development in this forum thread.

Here's a great example of an original texture next to an AI-upscaled one: 

These upscales will, of course, never be as good as having the original art assets in high resolution. They'll be blurrier in places and lose detail in others. Purists can argue they distort the original artistic intent, and a poor implementation definitely can. But from what I've seen, these AI-driven upscales are vastly better than the pixelated versions we've seen in some official releases, and could be the best way to modernize games with pre-rendered backgrounds for modern displays.

For now, the easiest targets for these upscales will be the PC ports of older games, but expect to see fans also upscaling backgrounds that can then be injected into games via emulators like Dolphin for the GameCube/Wii and PCSX2 for the PS2. For a long time, emulators have been able to greatly enhance 3D graphics but rendering them in higher resolutions—we're just beginning to see how technology can help us do the same with 2D graphics without destroying the style of the original artwork.

Wes Fenlon
Senior Editor

Wes has been covering games and hardware for more than 10 years, first at tech sites like The Wirecutter and Tested before joining the PC Gamer team in 2014. Wes plays a little bit of everything, but he'll always jump at the chance to cover emulation and Japanese games.

When he's not obsessively optimizing and re-optimizing a tangle of conveyor belts in Satisfactory (it's really becoming a problem), he's probably playing a 20-year-old Final Fantasy or some opaque ASCII roguelike. With a focus on writing and editing features, he seeks out personal stories and in-depth histories from the corners of PC gaming and its niche communities. 50% pizza by volume (deep dish, to be specific).

Latest in Final Fantasy
Honey B Lovely
The state of Final Fantasy 14 in 2025: It's in a weird spot, huh?
Final Fantasy 16
Final Fantasy 16 is the latest game to be freed from the shackles of Denuvo, though its 7-year-old predecessor still remains in DRM jail
Pint, a lalafellin mage, looks towards the sunset sky and closes his eyes in gracious defeat in Final Fantasy 14.
FF14 streamer yields to the MMO's bounciest catgirl, after inspiring them to beat his new speedrunning record 3 times before he could finish making a video about it
A Vanu Vanu munches on a soft taco
Final Fantasy 14 is, you guessed it, still making bank for Square Enix as Dawntrail rakes in the big bucks, though it might not be all sunshine and tacos
The boss of Dawntrail's 4th raid, Wicked Thunder, holds an Electrope cube to the air and floods it with levin.
Final Fantasy 14 promises crackdown on stalking exploits with actual solutions now, rather than politely asking the plugin creator to stop
A hyur in Final Fantasy 14: Dawntrail looks amazed, standing in a gorgeous forest city-scape.
In a sea of bad videogame clothing, I've already fallen in love with Final Fantasy 14's upcoming collaboration with BlackMilk
Latest in Features
Honey B Lovely
The state of Final Fantasy 14 in 2025: It's in a weird spot, huh?
Monster Hunter Wilds palico
One of the biggest victories of Monster Hunter Wilds' streamlining is I don't have to deal with those awful gimmick fights anymore
A vampire with a dark castle and swarms of bats in the background.
We need to decide on a genre name for Vampire Survivors-like games before a really terrible one sticks
Olivia, Alma and a palico
I wish Monster Hunter Wilds wasn't so afraid of letting me play Monster Hunter
SteelSeries QcK Performance mouse pads overlapping on a desk
The SteelSeries QcK Performance series has reignited my excitement over the simple pleasure of a quality mouse pad… and trying to click skulls with pinpoint accuracy
OneXPlayer 2 pro on a table
I never thought a handheld PC bloated with Windows could replace my Steam Deck, but after gaming on an old OneXPlayer 2 Pro I can see now I judged it too harshly