NVIDIA DGX H100
THE WORLD’S PROVEN CHOICE FOR ENTERPRISE AI
NVIDIA DGX H100 powers business innovation and optimization. Part of the DGX platform and the latest iteration of NVIDIA’s legendary DGX systems, DGX H100 is the AI powerhouse that’s the foundation of NVIDIA DGX SuperPOD™, accelerated by the groundbreaking performance of the NVIDIA H100 Tensor Core GPU. The system is designed to maximize AI throughput, providing enterprises with a highly refined, systemized, and scalable platform to help them achieve breakthroughs in natural language processing, recommender systems, data analytics, and much more. Available on-premises and through a wide variety of access and deployment options, DGX H100 delivers the performance needed for enterprises to solve the biggest challenges with AI
→ Giới thiệu chi tiết NVIDIA DGX H100
SPECIFICATION
GPUS: 8x NVIDIA H100 Tensor Core GPUs
GPU Memory: 640GB total
Performance: 32 petaFLOPS FP8
CPU
- Dual Intel® Xeon® Platinum 8480C Processors
- 112 Cores total, 2.00 GHz (Base), 3.80 GHz (Max Boost)
NVIDIA NVSwitches: 4
System Power Usage: 10.2kW max
System Memory: 2TB
Networking
- 4x OSFP ports serving 8x single-port NVIDIA ConnectX-7 VPI
- 400Gb/s InfiniBand/Ethernet
- 2x dual-port NVIDIA ConnectX-7 VPI
- 1x 400Gb/s InfiniBand
- 1x 200Gb/s Ethernet
Management Network
- 10Gb/s onboard NIC with RJ45
- 50Gb/s Ethernet NIC
- Host baseboard management controller (BMC) with RJ45
Storage
Software
- NVIDIA AI Enterprise – Optimized AI software
- NVIDIA Base Command – Orchestration, scheduling, and cluster management
- DGX OS / Ubuntu / Red Hat Enterprise Linux / Rocky – Operating System
System Weight: 287.6lbs (130.45kgs)
System Dimensions
- Height: 14.0in (356mm)
- Width: 19.0in (482.2mm)
- Length: 35.3in (897.1mm)
Packing System Weight: 315 lbs (143kgs)