An experimental AI wearable recognises objects and tells visually-impaired users details of what they're holding

A man with a visual impairment using a wearable device to describe an object he is holding
(Image credit: National University of Singapore)

While technology has often sought to improve the lives of people living with disabilities, creative AI implementations may be the next logical step. The National University of Singapore has been demonstrating its experimental new wearable, and thanks to an AI helping hand and some creative use of existing technologies, it hopes to transform the experience of daily life with a visual impairment.

Called the AiSee, the wearable device is worn around the back of the neck like a regular set of headphones you might use for fitness, but hidden in the forward-facing section of the chassis is a 13-megapixel camera (via New Atlas). When the user picks up an item they can take a photo of it using a button on the side of the device, before that image is then processed using the onboard microprocessor and beamed to a cloud network using the internal wireless connection, which then uses AI algorithms to analyse the size, shape, colour and any visible text.

If the object is recognised the user is then told what the object is with a brief description, using a computer-generated voice relayed back through the bone-conduction headphones. This also allows anyone wearing the device to hear the world around them, a feature of vital importance to someone relying heavily on their sense of hearing to navigate. 

Should the user need more information on the scanned object, they can then ask the AI verbally for more description or help.

The device itself has been designed to be discreet and is unlikely to draw any more attention than someone wearing a regular set of linked headphones. It also makes use of an internal lithium battery pack and doesn't require a link to a smartphone or any other device to work.

Cut the cord...

(Image credit: Steelseries)

Best wireless gaming mouse: ideal cable-free rodents
Best wireless gaming keyboard: no wires, no worries
Best wireless gaming headset: top untethered audio

The AiSee is still currently a work in progress, and the researchers say they are now working on enhancements to make the technology more accessible and affordable, including speeding up the image recognition time and improving the visual recognition elements.

While it might be tempting to throw our collective hands up at some AI powered devices and critique their potential utility, in terms of making the world a more accessible place for those with disabilities there are some real and important use cases where AI can potentially do some real good. 

Similarly, wearable devices like the Apple Vision Pro may be drawing some ire, but the utility of similar wearable technology adapted for the differently-abled may well prove to be the key to unlocking a much more accessible world for everyone.

Andy Edser
Hardware Writer

Andy built his first gaming PC at the tender age of 12, when IDE cables were a thing and high resolution wasn't—and he hasn't stopped since. Now working as a hardware writer for PC Gamer, Andy's been jumping around the world attending product launches and trade shows, all the while reviewing every bit of PC hardware he can get his hands on. You name it, if it's interesting hardware he'll write words about it, with opinions and everything.

Read more
Cognixion’s AI powered headset
New headset reads minds and uses AR, AI and machine learning to help people with locked-in-syndrome communicate with loved ones again
A young man runs on the spot in a studio. The set contains a yellow post box, two yellow road signs, a set of traffic lights, and a bicycle haphazardly stren around. The man is wearing the Halliday smart glasses and a green text overlay attempts to artistically demonstrate how the man is using the smart glasses to give him directions while he runs.
The 'um, actually' guy you know just got infinitely more powerful with these AI glasses
CHONGQING, CHINA - OCTOBER 30: In this photo illustration - The Facebook app page is displayed on a smartphone in the Apple App Store in front of the Meta Platforms, inc. logo on October 30, 2024 in Chongqing, China. (Photo by Cheng Xin/Getty Images)
Meta might've done something useful, pioneering an AI model that can interpret brain activity into sentences with 80% accuracy
Razer Project Ava key visual
Razer has released a backseat gaming AI bot called Ava, and I'm not sure whether using it should be considered cheating or not
Nvidia Signs, its AI-led ASL teaching platform
Nvidia has built a free AI-led platform to help teach American Sign Language with '400,000 video clips representing 1,000 signed words' so far
Mark Zuckerberg, chief executive officer of Meta Platforms Inc., wears Orion augmented reality (AR) glasses during the Meta Connect event in Menlo Park, California, US, on Wednesday, Sept. 25, 2024. Meta Platforms Inc. debuted its first pair of augmented reality glasses, devices that show a combined view of the digital and physical worlds, a key step in Chief Executive Officer Mark Zuckerberg's goal of one day offering a hands-free alternative to the smartphone.
Meta's Orion AR glasses still have no 'killer use case' but want devices to hang out on your face, on your wrist, and now in your pocket too
Latest in AI
Otter AI Meeting Agent
As if your work meetings weren't already fun enough, now Otter has a new all-hearing AI agent that remembers everything anyone has said and can join in the discussion
Image for
'No real human would go four links deep into a maze of AI-generated nonsense': Cloudflare's AI Labyrinth uses decoy pages to trap web-crawling bots and feed them slop 'as a defensive weapon'
CHINA - 2025/02/11: In this photo illustration, a Roblox logo is seen displayed on the screen of a smartphone. (Photo Illustration by Sheldon Cooper/SOPA Images/LightRocket via Getty Images)
'Humans still surpass machines': Roblox has been using a machine learning voice chat moderation system for a year, but in some cases you just can't beat real people
OpenAI logo displayed on a phone screen and ChatGPT website displayed on a laptop screen are seen in this illustration photo taken in Krakow, Poland on December 5, 2022.
ChatGPT faces legal complaint after a user inputted their own name and found it accused them of made-up crimes
Public Eye trailer still - dead-eyed police officer sitting for an interview
I'm creeped out by this trailer for a generative AI game about people using an AI-powered app to solve violent crimes in the year 2028 that somehow isn't a cautionary tale
Closeup of the new Copilot key coming to Windows 11 PC keyboards
Microsoft co-authored paper suggests the regular use of gen-AI can leave users with a 'diminished skill for independent problem-solving' and at least one AI model seems to agree
Latest in News
The heroes are attacked by monsters
Pillars of Eternity is getting turn-based combat to mark its 10th anniversary, and that means PC Gamer editors will soon be arguing about combat mechanics again
Image of Ronaldo from Fatal Fury: City of the Wolves trailer
It doesn't really make sense that soccer star Ronaldo is now a Fatal Fury character, but if you follow the money you can see how it happened
Junah beginning a battle in Metaphor: ReFantazio.
Today's RPG fans are 'very sensitive to feeling like they wasted time' when they die, says Metaphor: ReFantazio battle planner—but Atlus still made combat hard anyway
Image of Cersei Lanniser from Game of Thrones: Kingsroad Steam early access trailer
A new Game of Thrones RPG is coming to Steam today with a cast of 'familiar faces,' which is good because it's really the only way to tell it's a GoT game at all
The new Prime Asset featured in the upcoming update for the Outlast Trials.
The Outlast Trials puts its already paranoid players under surveillance for a time-limited story event
A Viera looking confused in Final Fantasy 14.
Old armor continues to fall victim to Final Fantasy 14's bizarre two-channel dye system, unless you're super into changing the colour of teeny-tiny eyelets: 'Why even bother at this point?'