AI-generated Minecraft unveiled, showcasing AI's unlimited ability to copy things but worse

AI-generated Minecraft run in the Oasis engine from Decart
(Image credit: Decart)

AI has been up to some funny things in the last few years. People have declared the supposed merits of generative AI for creating textures, they have managed to get Doom running on a neural network, and, 'any day now', we're supposed to get user prompt-inspired games to play. As you might expect, today is not that day.

Decart, an AI company that seemingly popped up overnight, has unveiled Oasis, "the world's first real-time AI world model".

Oasis works via frame prediction. An AI model is given huge masses of data, which can then be used to predict the next frame. This is why the tool seems to invent blocks and doesn't seem to have object permanence. It doesn't store data from your world and loses track of things you've done after some time.

"Oasis takes in user keyboard and mouse input and generates real-time gameplay, internally simulating physics, game rules, and graphics," Decart says.

You aren't playing the game, per se, you are instead playing an approximation of the game.

In the announcement for this new model, Decart published where this tech can go, saying:

"Simply imagine a world where this integration is so tight that foundation models may even augment modern entertainment platforms by generating content on the fly according to user preferences. Or perhaps a gaming experience that provides new possibilities for the user interaction such as textual and audio prompts guiding the gameplay."

That last part suggests that users can generate their own experiences, by heightening stakes on the fly or manipulating the game as they go. However, the current model is much more limited than that.

Decart is seemingly generating a version of Minecraft, and a poor pixelated one at that. The end of the trailer for this new engine says "Imagine what AI experiences could look like if everyone had the power to create them" and that's exactly what I have to do as this game was created by Mojang almost two decades ago.

If everything is as Decart says here, the idea of AI-generating Minecraft could be quite impressive, but it's important to note this is not even close to the future envisioned. The work required to mimic a game that is widely accessible is different from the ability to effectively imagine and create bespoke experiences based on user prompts.

Decart says it wants to reach a point where a user can say "Imagine that there is a pink elephant chasing me down" and one appears, but right now it's struggling to make a look-a-like of a very old game using tons of training data from said game. Millions of hours of Minecraft gameplay, according to MIT Technology review.

This is before mentioning whether or not users even want this, the copyright implications of where that data is scraped from, and if the ability to frame all your art around yourself is particularly good for your media diet.

AI, explained

OpenAI logo displayed on a phone screen and ChatGPT website displayed on a laptop screen are seen in this illustration photo taken in Krakow, Poland on December 5, 2022.

(Image credit: Jakub Porzycki/NurPhoto via Getty Images)

What is artificial general intelligence?: We dive into the lingo of AI and what the terms actually mean.

This tool was created with Nvidia H100 cards, and if you thought Minecraft was a generally easy game to run, this isn't. It runs at 360p at 20 fps. Though the future of this hardware is proposed to be made with Etched ASICs, Decart's partner here. These will supposedly allow it to run this sort of tech at 4K.

Of course, not all uses of this kind of AI in games are intended to just copy other games, and some of it is, in fact, very good for the average gamer. AI-powered Frame Generation can give much better performance in games with the same basic gear, and in theory, also relies on generating future frames based on the previous information presented to it.

I thought I would try to give Oasis a go, by accessing the site, and after getting through the waiting time, the whole thing wouldn't load. This isn't to say you can't access it but that I couldn't, and, at this rate, I'd rather just boot up the real thing.

TOPICS
James Bentley
Hardware writer

James is a more recent PC gaming convert, often admiring graphics cards, cases, and motherboards from afar. It was not until 2019, after just finishing a degree in law and media, that they decided to throw out the last few years of education, build their PC, and start writing about gaming instead. In that time, he has covered the latest doodads, contraptions, and gismos, and loved every second of it. Hey, it’s better than writing case briefs.

Read more
An Ai face looks down on a human.
Xbox announces 'a generative AI model for gameplay ideation' called Muse, but don't get too excited: Machines aren't about to make games for you just yet
Microsoft Muse-generated gaming in action
'A massive, massive moment of wow.' Microsoft CEO predicts AI-generated games are a 'CGI moment' for the industry
A planet with trees and rocks
Black holes, buildings on poles, and a 'sea urchin planet': PUBG creator's world-sized tech demo may be hiding some bizarre machine learning 'hallucinations'
Aloy
'Creepy,' 'ghastly,' 'rancid': Viewers react to leaked video of Sony's AI-powered Aloy
Razer Project Ava key visual
Razer has released a backseat gaming AI bot called Ava, and I'm not sure whether using it should be considered cheating or not
A robot girl from Judas looks skeptical, her synthetic skin peeling off to reveal metal below.
Bioshock's Big Daddy Ken Levine says that while he doesn't want to 'underestimate' AI, he's 'not overly impressed' by it, either
Latest in AI
Aloy
'Creepy,' 'ghastly,' 'rancid': Viewers react to leaked video of Sony's AI-powered Aloy
Seattle, USA - Jul 24, 2022: The South Lake Union Google Headquarter entrance at sunset.
Google is rolling out an even more AI-heavy search engine mode because 'power users want AI responses for even more of their searches'
A digitally generated image of abstract AI chat speech bubbles overlaying a blue digital surface.
We need a better name for AI, or we risk talking past each other until actually intelligent AGI comes home mooing
MOUNTAIN VIEW, CALIFORNIA - AUGUST 22: A view of Google Headquarters in Mountain View, California, United States on August 22, 2024.
One educational company accuses Google's AI summary of leading to a 'hollowed-out information ecosystem of little use and unworthy of trust' in latest lawsuit
Nvidia Signs, its AI-led ASL teaching platform
Nvidia has built a free AI-led platform to help teach American Sign Language with '400,000 video clips representing 1,000 signed words' so far
Microsoft Muse-generated gaming in action
'A massive, massive moment of wow.' Microsoft CEO predicts AI-generated games are a 'CGI moment' for the industry
Latest in News
Pedro Pascal as Joel in a coat in winter looking unhappy
'Don't you know what he did?': The truth comes out in The Last of Us Season 2 trailer
Aloy
'Creepy,' 'ghastly,' 'rancid': Viewers react to leaked video of Sony's AI-powered Aloy
Split Fiction trailer still - Zoe and Mio standing side by side, wearing glowing neon sci-fi jammies
Split Fiction sells 1 million copies over 2 days
A soldier looks out over the Verdansk map, as a single tear rolls down his cheek.
The original Verdansk map is returning to Call of Duty: Warzone, to celebrate which we get a soldier crying to Nat King Cole
More than 5 years after launch, Control gets a surprise patch that lets everyone play the Hideo Kojima mission
Swen Vincke
Swen Vincke stamps seal of approval on Stardew Valley mod that yoinks the Baldur's Gate 3 cast out of D&D and into a cosy pastoral life