Nvidia wants to put an AI in charge of in-game haptics

Green Nvidia logo up close
(Image credit: Nvidia)

Every few years there's a renewed effort to bring immersive, meaningful haptics to the forefront of gaming. Just look at the DualSense, it's another step-up in a journey that's taken us from a Rumble Pak to full-body haptic vests. But so far many of these solutions have relied on pre-programmed or auditory response haptics, which according to a group of researchers from Nvidia, could be made even more dynamic and flexible with a little thing it likes to call machine learning.

Yes, Nvidia never fails to find another use for machine learning.

In a recently published patent, originally filed in September 2019, a team of researchers at Nvidia put forward a different approach for generating accurate haptics with machine learning. They believe an intelligent algorithm could learn to detect specific "features" in content, such as games, and then produce a fitting haptic response in whatever hardware it was hooked up to.

As far as uses for machine learning in gaming are concerned, this one sounds pretty darn great, at least if you ask me.

Here's the abstract from the paper from Albright et al:

"Haptic effects have long been provided to enhance content, such as by providing vibrations, rumbles, etc. in a remote controller or other device being used by a user while watching or listening to the content. To date, haptic effects have either been provided by programming controls for the haptic effects within the content itself, or by providing an interface to audio that simply maps certain haptic effects with certain audio frequencies. The present disclosure provides a haptic control interface that intelligently induces haptic effects for content, in particular by using machine learning to detect specific features in content and then induce certain haptic effects for those features."

The patent is a little light on the specifics, as they are often wont to be. The haptic control interface, as it's referred to in the paper, could operate with custom circuitry, your CPU or GPU, or some combination of hardware and software.

The door's very much open to a wide range of devices, as per the paper's rough vision of its possible uses. That includes wired and wireless units, and haptic interfaces located locally and those up in the cloud. There could be one haptic device or several, even, and it could be built to deal with different content sources, such as games and movies without further training.

Virtual reality

(Image credit: Valve)

Best VR headset: which kit should you choose?
Best graphics card: you need serious GPU power for VR
Best gaming laptop: don't get tied to your desktop in VR

The initial haptic control interface, whatever form it may take, would require some preliminary training to get up to speed, such as video images, objects, and audio signals. From there it would pick up the rest on the fly, and without prior knowledge of the game or movie at hand.

"The haptic effects may be predefined to correspond with the feature," the paper says, "such as a particular haptic effect for the gunshot. The haptic control interface then causes the remote controller to provide the determined haptic effect(s), thus coordinating the haptic effect(s) experienced by the user with the gunshot experienced by the user within the video game."

As with many up-and-coming machine learning concepts in gaming, the reality may differ somewhat from the initial concept. But I have to say of all the machine learning uses out there, clever haptics feels like a solid bet to actually make it into our gaming rigs one day.

TOPICS
Jacob Ridley
Managing Editor, Hardware

Jacob earned his first byline writing for his own tech blog. From there, he graduated to professionally breaking things as hardware writer at PCGamesN, and would go on to run the team as hardware editor. He joined PC Gamer's top staff as senior hardware editor before becoming managing editor of the hardware team, and you'll now find him reporting on the latest developments in the technology and gaming industries and testing the newest PC components.

Read more
Nvidia RTX 5090 Founders Edition graphics card on different backgrounds
AI will be crammed in more of the graphics pipeline as Nvidia and Microsoft are bringing AI shading to a DirectX preview next month
A screenshot taken from the 2025 Nvidia tech demo Zorah
Nvidia RTX 50-series and dev kit show that rasterization is old news and we're now firmly in the era of AI rendering
Collage of images to represent Nvidia's RTX AI PCs
I'll say it: The best thing I saw from Nvidia at CES wasn't its sweet new GPUs, but some tasty AI every RTX gamer can enjoy
A photo of a gaming laptop's screen, displaying the control panel for Razer's Sensa HD Haptics system
I honestly thought Razer's Sensa haptics stuff was just a gimmick until I tried it with a sim racing setup, and now I'm absolutely sold
Microsoft Muse-generated gaming in action
'A massive, massive moment of wow.' Microsoft CEO predicts AI-generated games are a 'CGI moment' for the industry
An Ai face looks down on a human.
Xbox announces 'a generative AI model for gameplay ideation' called Muse, but don't get too excited: Machines aren't about to make games for you just yet
Latest in Software
Otter AI Meeting Agent
As if your work meetings weren't already fun enough, now Otter has a new all-hearing AI agent that remembers everything anyone has said and can join in the discussion
Microsoft's iconic Bliss wallpaper
From pixels to pinot: The Windows XP 'Bliss' wallpaper hill was real and this is what it looks like now
Napster client circa 1999
Former music-pirating platform Napster to be reborn rather ironically as a metaverse for musicians to connect with their fans after $207 million deal
New Discord desktop client themes.
Discord drops big update with 'completely new' in-game overlay and new dark themes for the desktop client
Image for
'No real human would go four links deep into a maze of AI-generated nonsense': Cloudflare's AI Labyrinth uses decoy pages to trap web-crawling bots and feed them slop 'as a defensive weapon'
A screenshot from game Mudborne of a little humanoid frog in a marsh
Five new Steam games you probably missed (March 24, 2025)
Latest in News
A gigantic terracotta sentinel made of living armor
Total War: Warhammer 3's army of Cathay has broken containment and is making its way to tabletop Warhammer at last
Two brightly colored stormtroopers dressed like Run-DMC stand in front of PAX Australia's WELCOME HOME banner.
Tickets for PAX Australia 2025 are on sale now
An Enshrouded player in a recreation of Erebor from The Lord of the Rings
Kings under the Mountain! 33 Enshrouded players spent 10,000 hours to recreate this iconic location from The Lord of the Rings
A mech awakens.
Mecha Break developer is considering unlocking all mechs following open beta feedback
Lara Croft Unified Art
Tomb Raider developer Crystal Dynamics lays off 17 employees 'to better align our current business needs and the studio's future success'
A long bendy arm stealing money from people in a subway car
'You're a very long arm. You steal things. It's a comedy game,' explains developer of comedy game where you steal things with a very long arm