Nvidia's new GPU is so chonk its interconnect is almost the size of an RTX 3090 chip

NVSwitch and NVLink chips
(Image credit: Nvidia)

Nvidia's new Hopper server GPU architecture has spawned a mammoth chip. And I'm not even talking about the 80 billion transistor H100 graphics processor itself. Nope, the new NVSwitch baked into the DGX 100 server system is reportedly home to some 25 billion transistors—that's just shy of the number inside the GA102 GPU inside the RTX 3090.

The NVSwitch chip is the interconnect which allows multiple instances of NVLink—the direct chip-to-chip connection—to talk and enable lots of Nvidia graphics cards to work together. That means they can pool their resources to power through complex calculations faster than a single GPU, or even two GPUs, would be able to on their own. 

Think SLI, but connecting lots of chips and, y'know, effective.

This 3rd Gen version is built on the same TSMC 4N node as the H100 chip itself, and is able to directly connect up to eight GPUs with chip-to-chip bandwidth of 900GB/s and a total aggregate bandwidth of 7.2TB/s. 

I'm only really referencing those numbers because they are so damned big, not because they have any bearing on us or PC gaming. The Hopper architecture is one designed purely for the server environment, and the NVSwitch interconnect doubly so. 

Discrete GPUs didn't really game well together when SLI and CrossFire were actually a thing, and it's only in the more compute-centric environment that genuine multi-GPU processing exists. But even there you need seriously high-speed links to get the most out of these high-speed processors, and that's presumably why Nvidia has specced out the NVSwitch with so many damned 4nm transistors.

NVSwitch and NVLink chips

(Image credit: Nvidia)
Your next upgrade

(Image credit: Future)

Best CPU for gaming: The top chips from Intel and AMD
Best gaming motherboard: The right boards
Best graphics card: Your perfect pixel-pusher awaits
Best SSD for gaming: Get into the game ahead of the rest

For reference, the GA102 GPU, the biggest chip in the GeForce sphere, comes in at 28.3 billion transistors—so a few billion more than the NVSwitch. On the AMD side, the Navi 21 GPU running the RX 6900 XT, 6800 XT, and RX 6800 is closer at 26.8 billion. But it's still considerably more than the 17.4 billion transistors of the GA104 chip which powers the RTX 3070 Ti, down to some RTX 3060 cards.

So yes, a big ol' chip. 

But we're likely to see more big ol' chips coming in the next generation of graphics cards, and the red team is also going to bring back the idea of multi-GPU gaming, too. Not necessarily in the same way as CrossFire, however, think more like the chiplet design of its Ryzen processors and you'll be on the right track.

The key to multi-GPU gaming is for the OS to see it all as one single chip, and it looks like AMD has figured out an internal GPU interconnect that will do that, and enable its top Radeon RX 7000-series cards to sport a multi-chip design. And potentially out muscle the expected monolithic design of Nvidia's future Lovelace-based RTX 4000-series cards.

TOPICS
Dave James
Editor-in-Chief, Hardware

Dave has been gaming since the days of Zaxxon and Lady Bug on the Colecovision, and code books for the Commodore Vic 20 (Death Race 2000!). He built his first gaming PC at the tender age of 16, and finally finished bug-fixing the Cyrix-based system around a year later. When he dropped it out of the window. He first started writing for Official PlayStation Magazine and Xbox World many decades ago, then moved onto PC Format full-time, then PC Gamer, TechRadar, and T3 among others. Now he's back, writing about the nightmarish graphics card market, CPUs with more cores than sense, gaming laptops hotter than the sun, and SSDs more capacious than a Cybertruck.

Read more
Nvidia RTX 5090 Founders Edition graphics card on different backgrounds
This spectacular GB202 die shot shows just how massive Nvidia's RTX 5090 GPU is but it's not the largest chip it's ever shoehorned into a gaming graphics card
Nvidia RTX 5090
RTX 5090 prototype GPU with 24,576 cores reportedly leaks hinting at possible 800 W 5090 Ti or Titan monster
Three RTX 5090 graphics cards on display at the Asus suite, CES 2025.
The RTX 5090 Founders Edition might be svelte but the Asus ROG Astral cards are absolute chonkers
Nvidia RTX Blackwell family
Here's how the new RTX 50-series cards perform against the previous generation of GeForce GPUs
SUQIAN, CHINA - JANUARY 27, 2025 - An illustration photo shows the logo of DeepSeek and ChatGPT in Suqian, Jiangsu province, China, January 27, 2025. (Photo credit should read CFOTO/Future Publishing via Getty Images)
China's DeepSeek chatbot reportedly gets much more done with fewer GPUs but Nvidia still thinks it's 'excellent' news
MSI GeForce RTX 5090 32G Special Edition with five fans
The RTX 5090 might make triple-fan cards look light on cooling if these four-fan and five-fan versions from Gigabyte and MSI are anything to go by
Latest in Graphics Cards
Nvidia App
Hmmm, upgrades: Nvidia App gets an optional AI assistant and custom DLSS resolution scaling
A close-up photo of an Nvidia RTX 4070, with its heatsink removed, showing the AD104 GPU die and the surrounding Micron GDDR6X VRAM chips
With Nvidia Ace taking up 1 GB of VRAM in Inzoi, Team Green will need to up its memory game if AI NPCs take off in PC gaming
A collage of Radeon RX 9000 series graphics cards, as shown in AMD's promotional video for the launch of RDNA 4 at CES 2025
AMD's CEO claims 9070 XT sales are 10x higher than all previous Radeon generations but that's just for the first week of availability
Colorful iGame RTX 5070 Ti Vulcan OC graphics card from various angles
The RTX 5060 and RTX 5060 Ti are rumoured to be mere weeks away, with board partners reportedly required to ensure at least one MSRP model at launch
Nvidia headquarters
Nvidia CEO sets sights on making 'several hundred billion' dollars worth of electronics in the USA over the next four years, increasing the chance of your next GPU being made in America
The Asus ROG Astral GeForce RTX 5090 Dhahab Edition, a gold-plated graphics card on a sand dune background
A Jensen Huang-signed version of this golden Asus RTX 5090 will be auctioned off to support relief efforts for the California wildfires
Latest in News
A mech awakens.
Mecha Break developer is considering unlocking all mechs following open beta feedback
Lara Croft Unified Art
Tomb Raider developer Crystal Dynamics lays off 17 employees 'to better align our current business needs and the studio's future success'
A long bendy arm stealing money from people in a subway car
'You're a very long arm. You steal things. It's a comedy game,' explains developer of comedy game where you steal things with a very long arm
The heroes are attacked by monsters
Pillars of Eternity is getting turn-based combat to mark its 10th anniversary, and that means PC Gamer editors will soon be arguing about combat mechanics again
Image of Ronaldo from Fatal Fury: City of the Wolves trailer
It doesn't really make sense that soccer star Ronaldo is now a Fatal Fury character, but if you follow the money you can see how it happened
Junah beginning a battle in Metaphor: ReFantazio.
Today's RPG fans are 'very sensitive to feeling like they wasted time' when they die, says Metaphor: ReFantazio battle planner—but Atlus still made combat hard anyway