NVIDIA DGX Systems

NVIDIA DGX H100

The gold standard of AI infrastructure

NVIDIA DGX™ H100

The NVIDIA DGX™ H100 helps you innovate and optimize your business. The latest addition to NVIDIA's legendary DGX system and the foundation of the NVIDIA DGX SuperPOD™, the DGX H100 is powered by the groundbreaking NVIDIA H100 Tensor Core GPU and accelerates the use of AI. Designed to maximize AI throughput, it provides enterprises with a highly sophisticated, systemized, and scalable platform to help them achieve breakthroughs in natural language processing, recommendation systems, data analytics, and more. Available on-premise or with a variety of access and deployment options, the NVIDIA DGX H100 delivers the performance enterprises need to solve their biggest challenges with AI.

Product spec

NVIDIA DGX™ H100

GPUs

8x NVIDIA H100 GPUs

TFLOPS

32 Peta FLOPS FP8

GPU memory

80GB per GPU/640GB per

DGX H100 Node

system memory

2TB

storage

Data cache drives: 30TB

(8x3.84TB)

OS drives: 2x 1.92TB NVME SSDs

network

4x OSFP ports serving 8x single-port

NVIDIA ConnectX-7

400Gb/s InfiniBand/Ethernet

2x dual-port NVIDIA ConnectX-7 VPI

400Gb/s InfiniBand/Ethernet

Detailed information on the NVIDIA DGX H100 is available.

Reference materials that explain the NVIDIA DGX H100 from a network perspective,

We have prepared a report entitled "A detailed analysis of the NVIDIA DGX™ H100 from a network perspective - The role of NVIDIA ConnectX®-7 in making the most of the GPU." Please make use of it.

You can view the full text without entering any personal information.

Contents of the materials (excerpts)

Click image to enlarge.

table of contents
NVIDIA DGX H100 Overview Page

Case study

Quote / Inquiry

AI TRY NOW PROGRAM

This is a support program that allows you to verify the latest AI solutions on an NVIDIA environment before introducing them into your company.

You can verify the benefits of implementing software products provided by NVIDIA, including NVIDIA AI Enterprise and NVIDIA Omniverse, as well as the AI learning environments and tools that we can provide, and the feasibility of applications before purchasing.

Related product page