Roblox shows new 3D AI tool gunning for 'realtime creation integrated with gameplay'

The Roblox Developers Conference is underway, and at the keynote address CEO and co-founder David Baszucki came out all guns blazing. We're gonna have a billion daily users! 10% of all global gaming revenue! We already have your children! OK not the last one, though he might as well have, and you can read all about Roblox's rude health and even ruder goals here.

There was an element of pie-in-the-sky about some of the keynote. But one of the genuinely impressive touches came when Baszucki gave a flourish in the direction of AI, which Roblox has been gradually integrating into its creator development tools for years. It has a tool that helps automate creating textures, for example, but apparently we ain't seen nothing yet.

Roblox is developing an AI "3D foundational model" that will be open source and create 3D assets through text, video and 3D prompts. Baszucki describes this as an "incubation project" with around 40 dedicated employees, and says they're only three months down the road on it. He then shows an overhead view of a map being created through simple text prompts, then becoming a desert, then prompted into becoming a forest scene (with both a text and image prompt).

This is a pre-recorded element of a stage presentation, of course, so take the above evidence of this AI model's capabilities with a pinch of salt. 

“We’ve been building generative AI into Roblox for years with tools like Assistant, Texture Generator, and Avatar Auto Setup. But these are just beginning to scratch the surface of what we have planned,” said Baszucki. "We see a powerful future where Roblox experiences have extensive generative AI capabilities to power real-time creation integrated with gameplay—in a resource-efficient way so we can make this available for everyone on the platform."

[Unfortunately I can only currently embed the livestream: when the full video is available, I'll replace the below with a timestamped link]

Opening Keynotes | RDC 2024 - YouTube Opening Keynotes | RDC 2024 - YouTube
Watch On

The most intriguing promise is that idea of "realtime creation integrated with gameplay." These tools look impressive already (albeit in a stage demo), and Baszucki didn't put a timeframe on it, but if they can get there this is a leap forward in AI functionality for games that has enormous implications. Imagine a virtual D&D game where the world is coalescing into existence as the dungeon master describes it. OK, with Roblox graphics, but still.

As if this wasn't enough for the optimists among us, you could even tie-in the AI promises to a more sedate part of Baszucki's presentation. Improvements to the platform's backend and tech stack are not exactly headline news, even if things like improving app launch time, framerate and crash reduction make a big difference to players every day.

But Baszucki says the next stage in these "platform efforts" is making it possible for a developer "to host a high-performance, 100-player open world, sports or battle royale–type game on Roblox and have it run on 2 GB RAM devices anywhere in the world at good frame rates. We won’t stop until this is possible."

I'm still waiting for my flying car, but in the meantime I suppose taking part in 100-player experiences being created on-the-fly sounds totally awesome. It's the kind of feature that, if it wasn't in Roblox, would have most of us fulminating. Whether Roblox can deliver what it says it can, however, remains to be seen.

Rich Stanton
Senior Editor

Rich is a games journalist with 15 years' experience, beginning his career on Edge magazine before working for a wide range of outlets, including Ars Technica, Eurogamer, GamesRadar+, Gamespot, the Guardian, IGN, the New Statesman, Polygon, and Vice. He was the editor of Kotaku UK, the UK arm of Kotaku, for three years before joining PC Gamer. He is the author of a Brief History of Video Games, a full history of the medium, which the Midwest Book Review described as "[a] must-read for serious minded game historians and curious video game connoisseurs alike."

Read more
Microsoft Muse-generated gaming in action
'A massive, massive moment of wow.' Microsoft CEO predicts AI-generated games are a 'CGI moment' for the industry
An Ai face looks down on a human.
Xbox announces 'a generative AI model for gameplay ideation' called Muse, but don't get too excited: Machines aren't about to make games for you just yet
CHINA - 2025/02/11: In this photo illustration, a Roblox logo is seen displayed on the screen of a smartphone. (Photo Illustration by Sheldon Cooper/SOPA Images/LightRocket via Getty Images)
'Humans still surpass machines': Roblox has been using a machine learning voice chat moderation system for a year, but in some cases you just can't beat real people
Roblox CEO David Baszucki.
'Don't let your kids be on Roblox', Roblox CEO tells parents, before comparing himself to Walt Disney and declaring the platform 'the future of communication'
Nvidia GR00T N1 robotics
Nvidia's GTC keynote inevitably went all in on AI but I'm definitely here for the Isaac GR00T robots
A robot girl from Judas looks skeptical, her synthetic skin peeling off to reveal metal below.
Bioshock's Big Daddy Ken Levine says that while he doesn't want to 'underestimate' AI, he's 'not overly impressed' by it, either
Latest in Platforms
A screenshot from game Mudborne of a little humanoid frog in a marsh
Five new Steam games you probably missed (March 24, 2025)
midnight murder club
Five new Steam games you probably missed (March 17, 2025)
Screenshot of Children of Clay showing a mysterious clay model
Five new Steam games you probably missed (March 10, 2025)
discord
Brace yourself for Discord to get worse: Reports swirl that the company is in talks with bankers about opening itself up to shareholders
The Spy from Team Fortress 2 holds up a folder with an accusatory expression.
Steam users react ecstatically to update that lets them access their heaving game notes via the web, also it fixes Monster Hunter Wilds video recording
HasanAbi
Twitch streamer Hasan Piker suspended after saying Republicans would 'kill Rick Scott' if they really cared about Medicare fraud
Latest in News
A screenshot from SaGa Frontier 2, showing one of the protagonists wandering through a quaint fantasy village
One of Square Enix' most underrated PlayStation-era JRPGs just shadow dropped on Steam
The titular character from Princess Mononoke is depicted riding the wolf goddess Moro and carrying a spear.
Studio Ghibli AI image trend floods social media, cheered on by OpenAI and denounced by critics as an insult to Hayao Miyazaki
Marvel Rivals tier list - Wolverine
Marvel Rivals director says a future patch will reduce the shooter's insatiable hunger for RAM: 'It's a very big problem'
Hogwarts Legacy potions professor holding a potion
An unannounced Hogwarts Legacy expansion and 'definitive edition' have reportedly been cancelled
Story of Seasons - A cahacter in a purple tuxedo stands outside in a town square talking to the player
Story of Seasons is doing another Harvest Moon remake and it might be the best the series has ever looked
Assassin's Creed Shadows change seasons - An upper-body shot of Yasuke looking cheerfully up into the distance.
Assassin's Creed Shadows puts up the 'second highest day-one sales revenue in Assassin's Creed franchise history'