Nvidia DGX

Short description: Line of Nvidia produced servers and workstations

This article contains promotional content. Please help improve it by removing promotional language and inappropriate external links, and by adding encyclopedic text written from a neutral point of view. (January 2024) (Learn how and when to remove this template message)

|

DGX

A rack containing five DGX-1 supercomputers

Manufacturer| Nvidia

The Nvidia DGX (Deep GPU Xceleration) is a series of servers and workstations designed by Nvidia, primarily geared towards enhancing deep learning applications through the use of general-purpose computing on graphics processing units (GPGPU). These systems typically come in a rackmount format, initially using high-performance x86 server CPUs, switching to ARMs around 2018, and releasing NUCs in 2025.

The core feature of a DGX system is its inclusion of 4 to 8 Nvidia Tesla GPU modules, which are housed on an independent system board. These GPUs can be connected either via a version of the SXM socket or a PCIe x16 slot, facilitating flexible integration within the system architecture. To manage the substantial thermal output, DGX units are equipped with heatsinks and fans designed to maintain optimal operating temperatures.

This framework makes DGX units suitable for computational tasks associated with artificial intelligence and machine learning models.[according to whom?]

## Contents

* 1 Models
* 1.1 Pascal - Volta
* 1.1.1 DGX-1
* 1.1.2 DGX Station
* 1.1.3 DGX-2
* 1.2 Ampere
* 1.2.1 DGX A100 Server
* 1.2.2 DGX Station A100
* 1.3 Hopper
* 1.3.1 DGX H100 Server
* 1.3.2 DGX GH200
* 1.3.3 DGX Helios
* 1.4 Blackwell
* 1.4.1 DGX GB200
* 1.4.2 DGX SuperPod
* 1.4.3 DGX Spark
* 2 Accelerators
* 3 See also
* 4 References

## Models

### Pascal - Volta

#### DGX-1

DGX-1 servers feature 8 GPUs based on the Pascal or Volta daughter cards[1] with 128 GB of total HBM2 memory, connected by an NVLink mesh network.[2] The DGX-1 was announced on 6 April 2016.[3] All models are based on a dual socket configuration of Intel Xeon E5 CPUs, and are equipped with the following features.

* 512 GB of DDR4-2133
* Dual 10 Gb networking
* 4 x 1.92 TB SSDs
* 3200W of combined power supply capability
* 3U Rackmount Chassis

The product line is intended to bridge the gap between GPUs and AI accelerators using specific features for deep learning workloads.[4] The initial Pascal-based DGX-1 delivered 170 teraflops of half precision processing,[5] while the Volta-based upgrade increased this to 960 teraflops.[6]

The DGX-1 was first available in only the Pascal-based configuration, with the first generation SXM socket. The later revision of the DGX-1 offered support for first generation Volta cards via the SXM-2 socket. Nvidia offered upgrade kits that allowed users with a Pascal-based DGX-1 to upgrade to a Volta-based DGX-1.[7][8]

* The Pascal-based DGX-1 has two variants, one with a 16 core Intel Xeon E5-2698 V3, and one with a 20 core E5-2698 V4. Pricing for the variant equipped with an E5-2698 V4 is unavailable, the Pascal-based DGX-1 with an E5-2698 V3 was priced at launch at $129,000[9]
* The Volta-based DGX-1 is equipped with an E5-2698 V4 and was priced at launch at $149,000.[9]

#### DGX Station

Designed as a turnkey deskside AI supercomputer, the DGX Station is a tower computer that can function completely independently without typical datacenter infrastructure such as cooling, redundant power, or 19 inch racks.

The DGX station was first available with the following specifications.[10]

* Four Volta-based Tesla V100 accelerators, each with 16 GB of HBM2 memory
* 480 TFLOPS FP16
* Single Intel Xeon E5-2698 v4[11]
* 256 GB DDR4
* 4x 1.92 TB SSDs
* Dual 10 Gb Ethernet

The DGX station is water-cooled to better manage the heat of almost 1500W of total system components, this allows it to keep a noise range below 35 dB under load.[12] This, among other features, made this system a compelling purchase for customers without the infrastructure to run rackmount DGX systems, which can be loud, output a lot of heat, and take up a large area. This was Nvidia's first venture into bringing high performance computing deskside, which has since remained a prominent marketing strategy for Nvidia.[13]

#### DGX-2

The Nvidia DGX-2, the successor to the DGX-1, uses sixteen Volta-based V100 32 GB (second generation) cards in a single unit. It was announced on 27 March 2018.[14] The DGX-2 delivers 2 Petaflops with 512 GB of shared memory for tackling massive datasets and uses NVSwitch for high-bandwidth internal communication. DGX-2 has a total of 512 GB of HBM2 memory, a total of 1.5 TB of DDR4. Also present are eight 100 Gbit/s InfiniBand cards and 30.72 TB of SSD storage,[15] all enclosed within a massive 10U rackmount chassis and drawing up to 10 kW under maximum load.[16] The initial price for the DGX-2 was $399,000.[17]

The DGX-2 differs from other DGX models in that it contains two separate GPU daughterboards, each with eight GPUs. These boards are connected by an NVSwitch system that allows for full bandwidth communication across all GPUs in the system, without additional latency between boards.[16]

A higher performance variant of the DGX-2, the DGX-2H, was offered as well. The DGX-2H replaced the DGX-2's dual Intel Xeon Platinum 8168's with upgraded dual Intel Xeon Platinum 8174's. This upgrade does not increase core count per system, as both CPUs are 24 cores, nor does it enable any new functions of the system, but it does increase the base frequency of the CPUs from 2.7 GHz to 3.1 GHz.[18][19][20]

### Ampere

#### DGX A100 Server

Announced and released on May 14, 2020. The DGX A100 was the 3rd generation of DGX server, including 8 Ampere-based A100 accelerators.[21] Also included is 15 TB of PCIe gen 4 NVMe storage,[22] 1 TB of RAM, and eight Mellanox-powered 200 GB/s HDR InfiniBand ConnectX-6 NICs. The DGX A100 is in a much smaller enclosure than its predecessor, the DGX-2, taking up only 6 Rack units.[23]

The DGX A100 also moved to a 64 core AMD EPYC 7742 CPU, the first DGX server to not be built with an Intel Xeon CPU. The initial price for the DGX A100 Server was $199,000.[21]

#### DGX Station A100

As the successor to the original DGX Station, the DGX Station A100, aims to fill the same niche as the DGX station in being a quiet, efficient, turnkey cluster-in-a-box solution that can be purchased, leased, or rented by smaller companies or individuals who want to utilize machine learning. It follows many of the design choices of the original DGX station, such as the tower orientation, single socket CPU mainboard, a new refrigerant-based cooling system, and a reduced number of accelerators compared to the corresponding rackmount DGX A100 of the same generation.[13] The price for the DGX Station A100 320G is $149,000 and $99,000 for the 160G model, Nvidia also offers Station rental at ~US$9000 per month through partners in the US (rentacomputer.com) and Europe (iRent IT Systems) to help reduce the costs of implementing these systems at a small scale.[24][25]

The DGX Station A100 comes with two different configurations of the built in A100.

* Four Ampere-based A100 accelerators, configured with 40 GB (HBM) or 80 GB (HBM2e) memory,
thus giving a total of 160 GB or 320 GB resulting either in DGX Station A100 variants 160G or 320G.
* 2.5 PFLOPS FP16
* Single 64 Core AMD EPYC 7742
* 512 GB DDR4
* 1 x 1.92 TB NVMe OS drive
* 1 x 7.68 TB U.2 NVMe Drive
* Dual port 10 Gb Ethernet
* Single port 1 Gb BMC port

### Hopper

#### DGX H100 Server

Announced March 22, 2022[26] and planned for release in Q3 2022,[27] The DGX H100 is the 4th generation of DGX servers, built with 8 Hopper-based H100 accelerators, for a total of 32 PFLOPs of FP8 AI compute and 640 GB of HBM3 Memory, an upgrade over the DGX A100s 640GB HBM2 memory. This upgrade also increases VRAM bandwidth to 3 TB/s.[28] The DGX H100 increases the rackmount size to 8U to accommodate the 700W TDP of each H100 SXM card. The DGX H100 also has two 1.92 TB SSDs for Operating System storage, and 30.72 TB of Solid state storage for application data.

One more notable addition is the presence of two Nvidia Bluefield 3 DPUs,[29] and the upgrade to 400 Gbit/s InfiniBand via Mellanox ConnectX-7 NICs, double the bandwidth of the DGX A100. The DGX H100 uses new 'Cedar Fever' cards, each with four ConnectX-7 400 GB/s controllers, and two cards per system. This gives the DGX H100 3.2 Tbit/s of fabric bandwidth across Infiniband.[30]

The DGX H100 has two Xeon Platinum 8480C Scalable CPUs (Codenamed Sapphire Rapids)[31] and 2 Terabytes of System Memory.[32]

The DGX H100 was priced at £379,000 or ~US$482,000 at release.[33]

#### DGX GH200

Announced May 2023, the DGX GH200 connects 32 Nvidia Hopper Superchips into a singular superchip, that consists totally of 256 H100 GPUs, 32 Grace Neoverse V2 72-core CPUs, 32 OSFT single-port ConnectX-7 VPI of with 400 Gbit/s InfiniBand and 16 dual-port BlueField-3 VPI with 200 Gbit/s of Mellanox [1] [2] . Nvidia DGX GH200 is designed to handle terabyte-class models for massive recommender systems, generative AI, and graph analytics, offering 19.5 TB of shared memory with linear scalability for giant AI models.[34]

#### DGX Helios

Announced May 2023, the DGX Helios supercomputer features 4 DGX GH200 systems. Each is interconnected with Nvidia Quantum-2 InfiniBand networking to supercharge data throughput for training large AI models. Helios includes 1,024 H100 GPUs.

### Blackwell

#### DGX GB200

Nvidia DGX B200 8 way GPU Board (air cooled) Nvidia GB200 72 GPU liquid cooled rack system

Announced March 2024,[35] GB200 NVL72 connects 36 Grace Arm Neoverse V2 72-core CPUs and 72 B200 GPUs in a rack-scale design.[36] The GB200 NVL72 is a liquid-cooled, rack-scale solution that boasts a 72-GPU NVLink domain that acts as a single massive GPU.[37] Nvidia DGX GB200 offers 13.5 TB HBM3e of shared memory with linear scalability for giant AI models, less than its predecessor DGX GH200.

#### DGX SuperPod

The DGX Superpod is a high performance turnkey supercomputer system provided by Nvidia using DGX hardware.[38] It combines DGX compute nodes with fast storage and high bandwidth networking to provide a solution to high demand machine learning workloads. The Selene supercomputer, at the Argonne National Laboratory, is one example of a DGX SuperPod-based system.

Selene, built from 280 DGX A100 nodes, ranked 5th on the TOP500 list for most powerful supercomputers at the time of its completion in June 2020,[39] and has continued to remain high in performance . The new Hopper-based SuperPod can scale to 32 DGX H100 nodes, for a total of 256 H100 GPUs and 64 x86 CPUs. This gives the complete SuperPod 20 TB of HBM3 memory, 70.4 TB/s of bisection bandwidth, and up to 1 ExaFLOP of FP8 AI compute.[28] These SuperPods can then be further joined to create larger supercomputers.

The Eos supercomputer, designed, built, and operated by Nvidia,[40][41][42] was constructed of 18 H100-based SuperPods, totaling 576 DGX H100 systems, 500 Quantum-2 InfiniBand switches, and 360 NVLink Switches, that allow Eos to deliver 18 EFLOPs of FP8 compute, and 9 EFLOPs of FP16 compute, making Eos the 5th fastest AI supercomputer in the world, according to TOP500 (November 2023 edition).

As Nvidia does not produce any storage devices or systems, Nvidia SuperPods rely on partners to provide high performance storage. Current storage partners for Nvidia Superpods are Dell EMC, DDN, HPE, IBM, NetApp, Pavilion Data, and VAST Data.[43]

#### DGX Spark

NVIDIA DGX Spark Rear ports of the DGX Spark, showing the ConnectX-7 NIC

In March 2025, Nvidia also announced the DGX Spark (previously DIGITS), a "desktop AI Supercomputer" based on Blackwell GPU and ARM CPUs. These machines are targeted at AI researchers and programmers and have 128 GB of integrated RAM, making it possible to train or fine-tune fairly large models ("up to 200 billion parameters" with quantization). Several partner manufacturers also offer versions of the DGX Spark. It is available as of late 2025.[44][45]

## Accelerators

Template:NvidiaDgxAccelerators

## See also

* Deep Learning Super Sampling

## References

1. ↑ "nvidia dgx-1". https://images.nvidia.com/content/technologies/deep-learning/pdf/61681-DB2-Launch-Datasheet-Deep-Learning-Letter-WEB.pdf. Retrieved 15 November 2023.
2. ↑ "inside pascal". 5 April 2016. https://devblogs.nvidia.com/parallelforall/inside-pascal/. "Eight GPU hybrid cube mesh architecture with NVLink"
3. ↑ "NVIDIA Unveils the DGX-1 HPC Server: 8 Teslas, 3U, Q2 2016". https://www.anandtech.com/show/10229/nvidia-announces-dgx1-server.
4. ↑ "deep learning supercomputer". 5 April 2016. https://www.engadget.com/2016/04/05/nvidia-dgx-1-deep-learning-supercomputer/.
5. ↑ "DGX-1 deep learning system". http://images.nvidia.com/content/technologies/deep-learning/pdf/Datasheet-DGX1.pdf. "NVIDIA DGX-1 Delivers 75X Faster Training...Note: Caffe benchmark with AlexNet, training 1.28M images with 90 epochs"
6. ↑ "DGX Server". Nvidia. https://www.nvidia.com/en-us/data-center/dgx-server/.
7. ↑ Volta architecture whitepaper nvidia.com
8. ↑ Use Guide nvidia.com
9. ↑ 9.0 9.1 Oh, Nate. "NVIDIA Ships First Volta-based DGX Systems". https://www.anandtech.com/show/11824/nvidia-ships-first-volta-dgx-systems.
10. ↑ "NVIDIA DGX Station Deep Learning System". https://www.compecta.com/dgxstation.html.
11. ↑ "Intel® Xeon® Processor E5-2698 v4 (50M Cache, 2.20 GHz) - Product Specifications" (in en). https://www.intel.com/content/www/us/en/products/sku/91753/intel-xeon-processor-e52698-v4-50m-cache-2-20-ghz/specifications.html.
12. ↑ Supercomputer datasheet nvidia.com
13. ↑ 13.0 13.1 "NVIDIA DGX Platform". https://www.nvidia.com/en-us/data-center/dgx-platform/.
14. ↑ "Nvidia launches the DGX-2 with two petaFLOPS of power". 28 March 2018. https://hexus.net/tech/news/systems/116672-nvidia-launches-dgx-2-two-petaflops-power/.
15. ↑ "NVIDIA DGX -2 for Complex AI Challenges" (in en-us). https://www.nvidia.com/en-us/data-center/dgx-2/.
16. ↑ 16.0 16.1 Cutress, Ian. "NVIDIA's DGX-2: Sixteen Tesla V100s, 30 TB of NVMe, only $400K". https://www.anandtech.com/show/12587/nvidias-dgx2-sixteen-v100-gpus-30-tb-of-nvme-only-400k.
17. ↑ "The NVIDIA DGX-2 is the world's first 2-petaflop single server supercomputer" (in en). 28 March 2018. https://www.hardwarezone.com.sg/tech-news-nvidia-dgx-2-world-s-first-2-petaflop-single-server-supercomputer.
18. ↑ DGX2 User Guide nvidia.com
19. ↑ "Product Specifications". https://www.intel.com/content/www/us/en/products/sku/120504/intel-xeon-platinum-8168-processor-33m-cache-2-70-ghz.html.
20. ↑ "Product Specifications". https://www.intel.com/content/www/us/en/products/sku/136874/intel-xeon-platinum-8174-processor-33m-cache-3-10-ghz.html.
21. ↑ 21.0 21.1 "NVIDIA Ampere Unleashed: NVIDIA Announces New GPU Architecture, A100 GPU, and Accelerator". AnandTech. May 14, 2020. https://www.anandtech.com/show/15801/nvidia-announces-ampere-architecture-and-a100-products.
22. ↑ "Nvidia's first Ampere GPU is designed for data centers and AI, not your PC". The Verge. May 14, 2020. https://www.theverge.com/2020/5/14/21258419/nvidia-ampere-gpu-ai-data-centers-specs-a100-dgx-supercomputer.
23. ↑ "Boston Labs welcomes the DGX A100 to our remote testing portfolio!". https://www.boston.co.uk/blog/2020/09/15/boston-labs-welcomes-the-dgx-a100.aspx.
24. ↑ "Nvidia will let you rent its mini supercomputers" (in en). 2021-04-13. https://www.techradar.com/news/nvidia-will-let-you-rent-its-mini-supercomputers.
25. ↑ "Nvidia Refreshes Expensive, Powerful DGX Station 320G and DGX Superpod" (in en). 2021-04-12. https://www.tomshardware.com/news/nvidia-dgx-station-320g.
26. ↑ "NVIDIA Announces DGX H100 Systems – World's Most Advanced Enterprise AI Infrastructure" (in en-us). http://nvidianews.nvidia.com/news/nvidia-announces-dgx-h100-systems-worlds-most-advanced-enterprise-ai-infrastructure.
27. ↑ Albert (2022-03-24). "NVIDIA H100: Overview, Specs, & Release Date" (in en-US). https://www.seimaxim.com/kb/gpu/nvidia-h100-overview-release-date.
28. ↑ 28.0 28.1 Walton, Jarred (2022-03-22). "Nvidia Reveals Hopper H100 GPU With 80 Billion Transistors" (in en). https://www.tomshardware.com/news/nvidia-hopper-h100-gpu-revealed-gtc-2022.
29. ↑ "NVIDIA Announces DGX H100 Systems – World's Most Advanced Enterprise AI Infrastructure" (in en-us). http://nvidianews.nvidia.com/news/nvidia-announces-dgx-h100-systems-worlds-most-advanced-enterprise-ai-infrastructure.
30. ↑ servethehome (2022-04-14). "NVIDIA Cedar Fever 1.6Tbps Modules Used in the DGX H100" (in en-US). https://www.servethehome.com/nvidia-cedar-fever-1-6tbps-modules-used-in-the-dgx-h100/.
31. ↑ "NVIDIA DGX H100 Datasheet" (in en). https://resources.nvidia.com/en-us-dgx-systems/ai-enterprise-dgx.
32. ↑ "NVIDIA DGX H100" (in en-us). https://www.nvidia.com/en-us/data-center/dgx-h100/.
33. ↑ (in en) Every NVIDIA DGX benchmarked & power efficiency & value compared, including the latest DGX H100., 8 December 2022, https://www.youtube.com/watch?v=ktNZLLZnjbk, retrieved 2023-03-01
34. ↑ "NVIDIA DGX GH200" (in en-us). https://www.nvidia.com/en-us/data-center/dgx-gh200/.
35. ↑ "Nvidia CEO Jensen Huang announces new AI chips: 'We need bigger GPUs'". 18 March 2024. https://www.cnbc.com/2024/03/18/nvidia-announces-gb200-blackwell-ai-chip-launching-later-this-year.html.
36. ↑ "Supermicro NVIDIA GB200 NVL72 SuperCluster". Supermicro. pp. 4. https://www.supermicro.com/manuals/brochure/Brochure-AI-SuperCluster-NVIDIA-GB200-NVL72.pdf.
37. ↑ "Nvidia Gb200 Nvl72". https://www.nvidia.com/en-eu/data-center/gb200-nvl72/.
38. ↑ "NVIDIA SuperPOD Datasheet". https://resources.nvidia.com/en-us-dgx-systems/dgx-ai-4. Retrieved 15 November 2023.
39. ↑ Trader, Tiffany (2020-06-22). "Nvidia Nabs #7 Spot on Top500 with Selene, Launches A100 PCIe Cards" (in en). https://www.hpcwire.com/2020/06/22/nvidia-nabs-7-spot-on-top500-with-selene-launches-a100-pcie-cards/.
40. ↑ Vincent, James (2022-03-22). "Nvidia reveals H100 GPU for AI and teases 'world's fastest AI supercomputer'" (in en). https://www.theverge.com/2022/3/22/22989182/nvidia-ai-hopper-architecture-h100-gpu-eos-supercomputer.
41. ↑ Mellor, Chris (2022-03-31). "Nvidia Eos AI supercomputer will need a monster storage system" (in en-GB). https://blocksandfiles.com/2022/03/31/nvidia-eos-ai-supercomputer-storage/.
42. ↑ Moss, Sebastian (23 March 2022). "Nvidia announces Eos, "world's fastest AI supercomputer"" (in en). https://www.datacenterdynamics.com/en/news/nvidia-announces-eos-supercomputer-worlds-fastest-ai-supercomputer/.
43. ↑ Mellor, Chris (2022-03-31). "Nvidia Eos AI supercomputer will need a monster storage system" (in en-GB). https://blocksandfiles.com/2022/03/31/nvidia-eos-ai-supercomputer-storage/.
44. ↑ "NVIDIA Announces DGX Spark and DGX Station Personal AI Computers". Nvidia press release. 2025-03-18. https://nvidianews.nvidia.com/news/nvidia-announces-dgx-spark-and-dgx-station-personal-ai-computers. Retrieved 2025-06-28.
45. ↑ "NVIDIA DGX Spark 4 TB". DGX Spark in an online shop. 2025-11-30. https://buyzero.de/products/nvidia-dgx-spark-4tb?_pos=1&_psq=dgx+spark&_ss=e&_v=1.0. Retrieved 2025-11-30.

* v
* t
* e

Nvidia

GeForce (List of GPUs)

| Fixed pixel pipeline|

| Pre-GeForce|

* NV1
* NV2

* RIVA 128
* RIVA TNT
* TNT2

|

* GeForce 256
* 2
* 4 MX

Vertex and pixel shaders|

* GeForce 3
* 4 Ti
* FX
* 6
* 7

Unified shaders|

* GeForce 8
* 9
* 100
* 200
* 300
* 400
* 500

Unified shaders & NUMA|

* GeForce 600
* 700
* 800M
* 900
* 10
* 16

Ray tracing|

* GeForce 20

Software and technologies

| Multimedia
acceleration|

* NVENC (video encoding)
* PureVideo (video decoding)

|

Software|

* Cg (shading language)
* CUDA
* Gelato (offline renderer)
* Nvidia GameWorks
* OptiX (ray tracing API)
* PhysX (physics SDK)
* Nvidia RTX (ray tracing platform)
* Nvidia System Tools
* VDPAU (video decode API)

Technologies|

* Nvidia 3D Vision (stereo 3D)
* Nvidia G-Sync (variable refresh rate)
* Nvidia Optimus (GPU switching)
* Nvidia Surround (multi-monitor)
* NVLink (protocol)
* Scalable Link Interface (multi-GPU)
* TurboCache (framebuffer in system memory)

GPU microarchitectures|

* Tesla
* Fermi
* Kepler
* Maxwell
* Pascal
* Volta
* Turing
* Ampere
* Hopper

Other products

| Graphics processing|

* Nvidia Quadro
* Quadro Plex

|

GPGPU|

* Nvidia Tesla
* DGX

Console components|

* NV2A (Xbox)
* RSX 'Reality Synthesizer' (PlayStation 3)
* Tegra NX-SoC (Nintendo Switch)

Nvidia Shield|

* Shield Portable
* Shield Tablet
* Shield Android TV
* GeForce Now

SoCs and embedded|

* GoForce
* Drive
* Jetson
* Tegra

CPUs|

* Project Denver

Computer chipsets|

* nForce

Company

| Key people|

* Jen-Hsun Huang
* Chris Malachowsky
* Curtis Priem
* David Kirk
* Bill Dally
* Debora Shoquist
* Ranga Jayaraman
* Jonah M. Alben

|

Acquisitions|

* 3dfx Interactive
* Ageia
* ULi
* Icera
* Mental Images
* PortalPlayer
* Exluna
* MediaQ
* Stexar

0.00

(0 votes)

Original source: https://en.wikipedia.org/wiki/Nvidia DGX. Read more

|

Retrieved from "https://handwiki.org/wiki/index.php?title=Nvidia_DGX&oldid=4415453"
*[v]: View this template
*[t]: Discuss this template
*[e]: Edit this template