[Xav101]

Honestly, I think it could easily be called the world's largest GPU. The GA100 is an absolutely massive die, at 826mm^2 with 54 billion transistors.

Just to put that in comparison with some other HPC GPU parts:

- Nvidia Tesla P100 (Pascal) - 15.3 billion transistors
- Radeon Instinct Mi25 (Vega) - 12.5 billion transistors
- Nvidia Tesla V100 (Volta) - 21.1 billion transistors
- Radeon Instinct Mi50/60 (Vega 2) - 13.2 billion transistors

Just for fun, here are some CPU numbers:

- Intel Pentium 4 HT - 125 million transistors
- Intel 6 core Xeon (Westmere) - 1.17B transistors
- Oracle/Sun 6 core SPARC M4 - 3 billion transistors (of which almost 2.3 billion are its 48MB L3 cache)
- Intel 18 core Xeon E5-2699v3 (Haswell) - 5.69 billion transistors
- AMD 32 core Epyc 7601 (Zen 1) - 19.2 billion transistors
- IBM 20 core POWER9 - 8 billion transistors
- Intel 28 core Xeon Platinum 8180 (Skylake) - 8 billion transistors
- AMD 64 core Epyc 7742 (Zen 2) - 32 billion transistors

That being said I highly doubt you'll be seeing one of these on ebay in the next 10 years. Most of the Teslas you see on ebay that are 10 years old are (comparatively) high volume parts. The DGX-1 Released back in 2016 and I haven't seen one for sale anywhere, only individual P100 GPUs. That being said, I guess only time will really be able to tell how often DGX machines will pop up, as the DGX-1 most likely isn't quite at the end of its lifecycle yet.