Products Solutions Industries For You SHOP DRIVERS SUPPORT CLOUD & DATA CENTER SOLUTIONS PRODUCTS DATA CENTER GPUS NVIDIA HGX PLATFORM DEEP LEARNING MACHINE LEARNING HPC SPECIFICATIONS NVIDIA HGX AI SUPERCOMPUTER The most powerful end-to-end AI supercomputing platform. Purpose-Built for the Convergence of Simulation, Data Analytics, and AI Massive datasets, exploding model sizes, and complex simulations require multiple GPUs with extremely fast interconnections and a fully accelerated software stack. The NVIDIA HGX™ AI supercomputing platform brings together the full power of NVIDIA GPUs, NVIDIA® NVLink®, NVIDIA InfiniBand networking, and a fully optimized NVIDIA AI and HPC software stack from the NVIDIA NGC™ catalog to provide highest application performance. With its end-to-end performance and flexibility, NVIDIA HGX enables researchers and scientists to combine simulation, data analytics, and AI to drive scientific progress. UNMATCHED END-TO-END ACCELERATED COMPUTING PLATFORM NVIDIA HGX combines NVIDIA A100 Tensor Core GPUs with high-speed interconnects to form the world’s most powerful servers. With 16 A100 GPUs, HGX has up to 1.3 terabytes (TB) of GPU memory and over 2 terabytes per second (TB/s) of memory bandwidth for unprecedented acceleration. Compared to previous generations, HGX provides up to a 20X AI speedup out of the box with Tensor Float 32 (TF32) and a 2.5X HPC speedup with FP64. NVIDIA HGX delivers a staggering 10 petaFLOPS, forming the world’s most powerful accelerated scale-up server platform for AI and HPC. DEEP LEARNING PERFORMANCE Up to 3X Higher AI Training on Largest Models DLRM Training DLRM on HugeCTR framework, precision = FP16 | NVIDIA A100 80GB batch size = 48 | NVIDIA A100 40GB batch size = 32 | NVIDIA V100 32GB batch size = 32. Deep learning models are exploding in size and complexity, requiring a system with large amounts of memory, massive computing power, and fast interconnects for scalability. With NVIDIA NVSwitch™ providing high-speed, all-to-all GPU communications, HGX can handle the most advanced AI models. With A100 80GB GPUs, GPU memory is doubled, delivering up to 1.3TB of memory in a single HGX. Emerging workloads on the very largest models like deep learning recommendation models (DLRM), which have massive data tables, are accelerated up to 3X over HGX powered by A100 40GB GPUs. MACHINE LEARNING PERFORMANCE 2X Faster than A100 40GB on Big Data Analytics Benchmark Big data analytics benchmark | 30 analytical retail queries, ETL, ML, NLP on 10TB dataset | V100 32GB, RAPIDS/Dask | A100 40GB and A100 80GB, RAPIDS/Dask/BlazingSQL Machine learning models require loading, transforming, and processing extremely large datasets to glean critical insights. With up to 1.3TB of unified memory and all-to-all GPU communications with NVSwitch, HGX powered by A100 80GB GPUs has the capability to load and perform calculations on enormous datasets to derive actionable insights quickly. On a big data analytics benchmark, A100 80GB delivered insights with 2X higher throughput over A100 40GB, making it ideally suited for emerging workloads with exploding dataset sizes. HPC PERFORMANCE HPC applications need to perform an enormous amount of calculations per second. Increasing the compute density of each server node dramatically reduces the number of servers required, resulting in huge savings in cost, power, and space consumed in the data center. For simulations, high-dimension matrix multiplication requires a processor to fetch data from many neighbors for computation, making GPUs connected by NVIDIA NVLink ideal. HPC applications can also leverage TF32 in A100 to achieve up to 11X higher throughput in four years for single-precision, dense matrix-multiply operations. An HGX powered by A100 80GB GPUs delivers a 2X throughput increase over A100 40GB GPUs on Quantum Espresso, a materials simulation, boosting time to insight. 11X More HPC Performance in Four Years Top HPC Apps Geometric mean of application speedups vs. P100: Benchmark application: Amber [PME-Cellulose_NVE], Chroma [szscl21_24_128], GROMACS [ADH Dodec], MILC [Apex Medium], NAMD [stmv_nve_cuda], PyTorch (BERT-Large Fine Tuner], Quantum Espresso [AUSURF112-jR]; Random Forest FP32 [make_blobs (160000 x 64 : 10)], TensorFlow [ResNet-50], VASP 6 [Si Huge] | GPU node with dual-socket CPUs with 4x NVIDIA P100, V100, or A100 GPUs. Up to 1.8X Higher Performance for HPC Applications Quantum Espresso Quantum Espresso measured using CNT10POR8 dataset, precision = FP64. NVIDIA HGX SPECIFICATIONS NVIDIA HGX is available in single baseboards with four or eight A100 GPUs, each with 40GB or 80GB of GPU memory. The 4-GPU configuration is fully interconnected with NVIDIA NVLink®, and the 8-GPU configuration is interconnected with NVSwitch. Two NVIDIA HGX A100 8-GPU baseboards can be combined using an NVSwitch interconnect to create a powerful 16-GPU single node. HGX is also available in a PCIe form factor for a modular, easy-to-deploy option, bringing the highest computing performance to mainstream servers, each with either 40GB or 80GB of GPU memory. This powerful combination of hardware and software lays the foundation for the ultimate AI supercomputing platform. A100 PCIe 4-GPU 8-GPU 16-GPU GPUs 1x NVIDIA A100 PCIe HGX A100 4-GPU HGX A100 8-GPU 2x HGX A100 8-GPU Form factor PCIe 4x NVIDIA A100 SXM 8x NVIDIA A100 SXM 16x NVIDIA A100 SXM HPC and AI compute (FP64/TF32*/FP16*/INT8*) 19.5TF/312TF*/624TF*/1.2POPS* 78TF/1.25PF*/2.5PF*/5POPS* 156TF/2.5PF*/5PF*/10POPS* 312TF/5PF*/10PF*/20POPS* Memory 40 or 80GB per GPU Up to 320GB Up to 640GB Up to 1,280GB NVLink Third generation Third generation Third generation Third generation NVSwitch N/A N/A Second generation Second generation NVSwitch GPU-to-GPU bandwidth N/A N/A 600GB/s 600GB/s Total aggregate bandwidth 600GB/s 2.4TB/s 4.8TB/s 9.6TB/s * With sparsity Accelerating HGX with NVIDIA Networking With HGX, it’s also possible to include NVIDIA networking to accelerate and offload data transfers and ensure the full utilization of computing resources. Smart adapters and switches reduce latency, increase efficiency, enhance security, and simplify data center automation to accelerate end-to-end application performance. The data center is the new unit of computing, and HPC networking plays an integral role in scaling application performance across the entire data center. NVIDIA InfiniBand is paving the way with software-defined networking, In-Network Computing acceleration, remote direct-memory access (RDMA), and the fastest speeds and feeds. Inside the NVIDIA Ampere Architecture Read this technical deep dive to learn what's new with the NVIDIA Ampere architecture and its implementation in the NVIDIA A100 GPU. READ BLOG Products NVIDIA A100 NVIDIA A2 NVIDIA A10 NVIDIA A16 NVIDIA A30 NVIDIA A40 NVIDIA BlueField DPU NVIDIA Converged Accelerators NVIDIA ConnectX SmartNIC NVIDIA V100 NVIDIA HGX A100 NVIDIA DGX A100 NVIDIA DGX Station A100 NVIDIA DGX Systems NVIDIA EGX Platform NVIDIA EGX A100 NGC Catalog EGX Server Ethernet Adaptors & Switches Virtual PC Virtual Apps RTX Virtual Workstation RTX Virtual Workstation Cloud Technologies CUDA-X NVIDIA Ampere Architecture NVIDIA Volta NVIDIA Pascal NVLink/NVSwitch Tensor Cores Multi-Instance GPU IndeX ParaView Plugin NVIDIA Morpheus AI framework Software Overview NVIDIA AI Enterprise DGX FOUNDRY CUDA-X DOCA EGX MAGNUM IO NGC Catalog Virtualization Resources Data Center Blogs GPU Apps Catalog Data Center GPUs Product Literature DGX Product Literature Virtual GPU Product Literature GPU Test Drive Qualified System Catalog NVIDIA GRID Community Advisors Virtual GPU Forum SIGN UP FOR DATA CENTER NEWS SUBSCRIBE Follow Data Center Facebook Twitter LinkedIn YouTube INDIA Privacy Policy Legal Info Accessibility Product Security Contact Copyright © 2021 NVIDIA Corporation NVIDIA websites use cookies to deliver and improve the website experience. See our cookie policy for further details on how we use cookies and how to change your cookie settings. ACCEPT