The dangers and unexpected benefits of crowdsourced game design

Img 5365[1]

Letting your players design the future of your game is a risky choice, but it can also have some unexpected benefits—even if it doesn't solve the problems you wanted it to. That's what David Osborne, the lead designer on RuneScape, had to say during his talk at GDC about RuneScape's experimental crowdsourced design program.

"From our experience," says Osborne, "a limited number of players are interested in developing ideas. And there's a limited shape of those ideas—you will not get a full, broad range."

Over the past few years, Jagex has been implementing ways to bring their players into the design process. From in-game polling to decide future updates, to the creative Runelabs, where players can pitch ideas and see them brought to life, RuneScape had over one third of its content released since 2013 dictated by the will of its players. But the program wasn't a complete success.

During the talk, Osborne profiled three ways Jagex tried to invite players into the design process. While extensive polling of every proposed update drove engagement, it also created problems because players couldn't always understand the intention of a feature—especially those meant for monetization. "Players do not value or understand everything in the game," Osborne says.

Img 5366[1]

Jagex then moved to publishing extensive design documents meant to educate players better, but found the process to be extremely taxing and exhaustive. That's when Runelabs was introduced to give players full control. Even then, Osborne says that engagement was so low that less than 0.01 percent of players were determining over one third of RuneScape's future updates. Many simply weren't interested. "[Players] were perfectly happy with the [existing] contract between developer and consumer," Osborne explains. "They liked being given game content and then playing it."

Even more disappointing was that many of the proposed ideas for Runelabs had little to do with creating new mechanics or systems. Instead, most ideas that were popular among the players had to do with bug fixes, creation of new story elements, and addition of simple content like "more dragons."

But by letting players peek past the curtain into the design process, a more meaningful relationship began to take form. "There is such value in bringing players into a design process," Osborne says. "There's more conversation, and we know that when players are talking, they are more engaged. When they're more engaged, they are more retained."

Img 5367[1]

For Jagex, their foray into crowdsourced game design was "trying to solve a problem that wasn't there." But it also led them to discover a huge, unintentional benefit. By being more transparent in the design process, Osborne has found that RuneScape's players are far more in tune with the struggles of designing a game. "The culture shift between the relationship with our playerbase and us is huge," says Osborne. "Our players now understand their own community, they understand their own player-types, and they understand the difficulties of design."

Moving forward, Osborne says that Runelabs will be slowly discontinued in favor of a system that better reflects the lessons they've learned during this experiment. By combining the positives of each branch, like polling, publishing design documents, and Runelabs, Jagex is creating a hybrid that still allows players to vote for big content updates while allowing Jagex the freedom to handle smaller initiatives independently.

Osborne isn't convinced that completely crowdsourced game design can work—at least not when stapled onto games that aren't built for it. But because the process created a closer relationship between Jagex and its audience, he considers Runelabs a big success. "The cost, for us, has been worth it. We do have a healthier game for it."

Steven Messner

With over 7 years of experience with in-depth feature reporting, Steven's mission is to chronicle the fascinating ways that games intersect our lives. Whether it's colossal in-game wars in an MMO, or long-haul truckers who turn to games to protect them from the loneliness of the open road, Steven tries to unearth PC gaming's greatest untold stories. His love of PC gaming started extremely early. Without money to spend, he spent an entire day watching the progress bar on a 25mb download of the Heroes of Might and Magic 2 demo that he then played for at least a hundred hours. It was a good demo.

Latest in MMO
A goblin with sharp teeth, wearing goggles, lets out a mischievous cackle in WoW's latest patch: Undermine(d).
The hooligan hacker guild that tore up WoW's newest raid (twice) just posted video evidence of the whole thing, and it's got me feeling weirdly nostalgic
Dune Awakening
Dune Awakening's latest trailer offers a glimpse of its massive coriolis storms, which reshape swathes of the map each week for 'infinite exploration'
Concept art of WoW's upcoming player housing system, showing a warm homestead with a welcoming figure in shade.
WoW flexes its MMO player housing system in a new blog post, and it really might just beat FF14's dated furniture placement into the dirt
Orithopter shooting down another in Dune
Dune: Awakening confirms air-to-air combat in ornithopters
Defiance players
A dead MMO that launched with a now-cancelled TV show in 2013 is coming back 4 years after servers were shut down
Gallywix wears an uneasy smile as he's confronted by Xal'atath in WoW: The War Within.
World of Warcraft guild uses exploits to get world 'first' on the game's new raid, gets banned, puts its name backwards and does it again
Latest in Features
midnight murder club
Five new Steam games you probably missed (March 17, 2025)
Geralt, two swords on his back, in the wilderness
2011 was an amazing comeback year for PC gaming
Alligator skull with glowing eyes on human body and cords coming out sitting at piano with "The Norwood Etudes" ready to play
My new most anticipated RPG let me be a kleptomaniac gourmand set loose in a noir city on a quest to make 'the perfect sandwich'
Monster Hunter Wilds' stockpile master studying a manifest
Monster Hunter Wilds' new gyro controls are a fantastic option for disabled and able-bodied players alike
Manhunt 2
I played the notoriously ratings-board-ravaged Manhunt 2 and was quite glad for the censorship actually
Wyrdsong concept art
Wyrdsong, the RPG from ex-Bethesda talent, isn't dead—but it's no longer an open world: 'We're down to a skeleton crew'