A new video encoding/decoding API can replace AMD and Nvidia's encoders on all platforms, truly one API to rule them all

Elgato's Stream Deck
(Image credit: Elgato)

The Khronos Group is a collaboration between nearly 200 companies, working together to produce various APIs for computing. Its most famous software, such as OpenGL, WebGL, and Vulkan, are all about graphics but for the past few years the consortium has been working on doing the same for video. It's just announced that Vulkan Video, a low-level API for handling video streams, now fully supports the hardware acceleration of the H.264 and H.265 standards for decoding and encoding.

If you're wondering what on Earth an API is, think of it as a translation service. It acts as a middleman between a developer's software and the hardware's drivers, making it far easier to produce an application that makes full use of a device's features. For example, games are typically written in C# or C++ but the instructions in the code are written for whatever API is being used. That could be Direct3D or Vulkan when it comes to the graphics.

Where Direct3D is restricted to Windows-based PCs, Vulkan is available across a range of platforms, such as Linux, Android, MacOS, iOS, and so on. Anything written with Vulkan in mind will work just the same on any of those systems, provided the hardware properly supports Vulkan. However, there hasn't really been a comprehensive cross-platform API for handling video decompression and compression.

That was until the Khronos Group released Vulkan Video a few years ago but the initial version only offered decoding, and even then it wasn't a core feature of the API: It was supported through the use of extensions, which are essentially API-snippets that are proprietary to one vendor's hardware.

With this new release, decoding and encoding of the H.264 and H.265 video format standards are now a core part of Vulkan Video. The decoding of the AV1 format will be coming soon, though exactly when isn't clear, and encoding will be for a later point in the future.

But right now, developers can write their video recording and streaming applications using Vulkan Video and it should work equally as well, no matter what system it's being run on.

A block diagram of the core feature support in the Vulkan Video API

(Image credit: Khronos Group)

I say 'should' because to make use of any hardware acceleration of video decoding/encoding, drivers need to be updated to recognise the API and its instructions. At the moment, only Nvidia has any drivers that support the new Vulkan Video update, and even then, just in its beta drivers. AMD and Intel will apparently update their drivers 'soon' but your guess is as good as mine as to when that will happen.

One of the first applications to be modified for the new API release will be FFmpeg, a free cross-platform tool for recording and streaming video. It's not fully ready yet but one of the developers has confirmed that it's currently being worked on.

You may well be thinking 'So what?' at this point, though.

After all, the number of games that use Vulkan for graphics, compared to Direct3D, is pretty small but having an API that isn't restricted to any one vendor's hardware or any specific platform means that developers will have a much easier time of things making software that will work the same, on any machine.

Thinking of upgrading?

Windows 11 Square logo

(Image credit: Microsoft)

Windows 11 review: What we think of the latest OS.
How to install Windows 11: Our guide to a secure install.
Windows 11 TPM requirement: Strict OS security.

If the makers of FFmpeg are happy to make the jump, you can be sure that others will follow too. It could potentially could mean your favourite streaming software works fast and bug-free, no matter what CPU or GPU you have in your gaming PC.

The only problem is that everything will still depend on how well vendors implement the new API in the drivers. No matter how good the app is, if the drivers aren't great then any software relying on them will struggle.

We'll certainly be keeping an eye on Vulkan Video to see how things pan out and if it turns out that AMD, Intel, and Nvidia have done a good job of things, we'll let you know.

TOPICS
Nick Evanson
Hardware Writer

Nick, gaming, and computers all first met in 1981, with the love affair starting on a Sinclair ZX81 in kit form and a book on ZX Basic. He ended up becoming a physics and IT teacher, but by the late 1990s decided it was time to cut his teeth writing for a long defunct UK tech site. He went on to do the same at Madonion, helping to write the help files for 3DMark and PCMark. After a short stint working at Beyond3D.com, Nick joined Futuremark (MadOnion rebranded) full-time, as editor-in-chief for its gaming and hardware section, YouGamers. After the site shutdown, he became an engineering and computing lecturer for many years, but missed the writing bug. Cue four years at TechSpot.com and over 100 long articles on anything and everything. He freely admits to being far too obsessed with GPUs and open world grindy RPGs, but who isn't these days? 

Read more
A photograph of the opening slide of a Microsoft lecture on Cooperative Vectors at GDC 2025
AMD, Intel, Microsoft, and Nvidia are all excited about cooperative vectors and what they mean for the future of 3D graphics, but it's going to be a good while before we really see their impact
Screenshots from Half-Life 2 RTX, showing the various new effects delivered by full ray tracing and enhanced assets.
Microsoft announces DirectX Raytracing 1.2 claiming 'game changing' performance benefits but it looks like the important stuff is already in Nvidia's RTX GPUs, even the old ones
Cyberpunk upscaling
New modder tool makes it easier than ever to swap AMD's FSR 4 scaling for Nvidia's DLSS or Intel's XeSS and vice versa
Star Wars Jedi: Survivor outfit locations
Epic talks shop about stuttering in games that use its Unreal Engine and offers solutions to the problem
Nvidia RTX 5090 Founders Edition graphics card on different backgrounds
AI will be crammed in more of the graphics pipeline as Nvidia and Microsoft are bringing AI shading to a DirectX preview next month
Qualcomm Snapdragon X Elite logo on a Samsung laptop
Eight months into the brave new world of Windows on ARM, and this is the state of play for PC gaming outside of the x86 arena
Latest in Hardware
A woman wearing a VR headset with dramatic, colourful lighting across the background
'World’s smallest LEDs' could lead to accurately lit screens with 127,000 pixels per inch and much more immersive VR
The NES themed 8BitDo Retro mechanical gaming keyboard on a blue background
I love the 8BitDo Retro C64 keyboard but I'd pick its cheaper NES-themed model near its lowest price ever during Amazon's Big Spring Sale
The snazzy red and black HyperX Cloud Alpha wireless headphones float in a teal void. The microphone is attached to the headset.
The best wireless gaming headset is now even better in the Amazon Big Spring Sale, boasting a more than $50 discount
A chip being held up in an Intel fab
Intel is reportedly 'working to finalize commitments from Nvidia' as a foundry partner, suggesting gaming potential for the 18A node
Amazon box
Don't panic! The 'Do Not Send Voice Recordings' option Amazon just removed was only used by 0.03% of customers and they can still have it
Digital generated image of people surrounded by interactive transparent and glowing panels with data. Visualising smart technology, blockchain and artificial intelligence
Now I shall demand the cookies! Proposed new browsing agreement turns the tables and lets users dictate terms to websites
Latest in News
A long bendy arm stealing money from people in a subway car
'You're a very long arm. You steal things. It's a comedy game,' explains developer of comedy game where you steal things with a very long arm
The heroes are attacked by monsters
Pillars of Eternity is getting turn-based combat to mark its 10th anniversary, and that means PC Gamer editors will soon be arguing about combat mechanics again
Image of Ronaldo from Fatal Fury: City of the Wolves trailer
It doesn't really make sense that soccer star Ronaldo is now a Fatal Fury character, but if you follow the money you can see how it happened
Junah beginning a battle in Metaphor: ReFantazio.
Today's RPG fans are 'very sensitive to feeling like they wasted time' when they die, says Metaphor: ReFantazio battle planner—but Atlus still made combat hard anyway
Image of Cersei Lanniser from Game of Thrones: Kingsroad Steam early access trailer
A new Game of Thrones RPG is coming to Steam today with a cast of 'familiar faces,' which is good because it's really the only way to tell it's a GoT game at all
The new Prime Asset featured in the upcoming update for the Outlast Trials.
The Outlast Trials puts its already paranoid players under surveillance for a time-limited story event