Revolutionizing Data Center
Performance withNVIDIA Grace™ CPU Superchip &GH200 Grace Hopper Superchip

NVIDIA Grace™ CPU Superchip

Bringing a Whole New Level of Performance and Eﬃciency to the Modern Data Center
In response to the rapidly growing demand for high performance and low power consumption, the Arm-based NVIDIA Grace™
CPU excels in modern data center workloads, emphasizing massive data processing capabilities. Its extraordinary performance
per watt, packaging density, and memory bandwidth sets a new standard for the industry. The NVIDIA Grace™ CPU Superchip
represents a comprehensive upgrade from the traditional dual-processor concept. By interconnecting the two CPUs on a single
module with NVIDIA® NVLink®-C2C, achieving an astonishing bandwidth of 900GB/s, and packing up to 960GB LPDDR5X memory
into the module, the superchip can eﬃciently handle various workloads, especially memory-intensive applications.

144 Arm Neoverse V2 Cores
Up to 960GB CPU LPDDR5X memory with ECC
Up to 8x PCIe Gen5 x16 links
NVIDIA® NVLink®-C2C Technology
NVIDIA Scalable Coherency Fabric (SCF)
InﬁniBand Networking Systems
NVIDIA CUDA® Platform

NVIDIA Grace™ Hopper SuperchipStepping Further into the Era of AI and GPU-Accelerated HPC
Moving beyond pure CPU applications, the NVIDIA GH200 Grace Hopper Superchip is built on a combination of an NVIDIA Grace™
CPU and an NVIDIA H100 Tensor Core GPU for giant-scale AI and HPC applications. Utilizing the same NVIDIA ® NVLink®-C2Ctechnology, combining the heart of computing on a single superchip, forming the most powerful computational module. Thecoherent memory design leverages both high-speed HBM3 or HBM3e GPU memory and the large-storage LPDDR5X CPUmemory. The superchip also inherits the capability of scaling out with InﬁniBand networking by adopting NVIDIA BlueField®-3DPUs or NICs, forming a system connected with a speed of 100GB/s for ML and HPC workloads. The upcoming NVIDIA GH200
NVL32 can further improve deep learning and HPC workloads by connecting up to 32 superchips through the NVLink Switch
System, a system built on NVLink switches with 900GB/s bandwidth between any two superchips, making the most use of thepowerful computing chips and extended GPU memory.

72 Arm Neoverse V2 CoresUp to 480GB CPU LPDDR5X memory with ECC96GB HBM3 or 144GB HBM3e GPU memory
Up to 4x PCIe Gen5 x16 links
NVIDIA® NVLink®-C2C Technology
InﬁniBand Networking Systems
Easy-to-Program Heterogeneous Platform
NVIDIA CUDA® Platform

Maximize Conﬁguration Flexibility with the GIGABYTE Server Lineup
Drawing from diverse product line experience, GIGABYTE provides various options supporting the NVIDIA Grace™ CPU & GH200
Grace Hopper Superchips in diﬀerent form factors, aiming for multiple target applications.
For the highest possible computing density, GIGABYTE designed the H263 and H223 series high-density servers to achieve thebest computing power in a single rack, in either 2U 2-Node or 2U 4-Node conﬁgurations and with both air cooling and direct
liquid cooling solutions.
For total NVIDIA package solutions, GIGABYTE also provides a series of X-series servers, which is based on the NVIDIA MGX™
Platform with a modularized design and support for multiple add-in cards. These servers ensure compatibility between diﬀerent
rack standards, ﬂexible cluster conﬁgurations, and compatibility with NVIDIA software and NVIDIA-deﬁned conﬁgurations.

GIGABYTE Servers for NVIDIA Grace™ CPU Superchip
XV23-VC0-AAJ1

H263-V60-AAW1

Form Factor

2U MGX server system(W438 x H87.5 x D900 mm)

2U 4-node rear access server system(W440 x H87.5 x D850 mm)

Motherboard

MVC3-MG0

MV63-HD0

NVIDIA Grace™ CPU Superchip:- 2 x Grace CPUs
- Connected with NVLink-C2C- TDP up to 500W (CPU + memory)

NVIDIA Grace™ CPU Superchip:- 2 x Grace CPUs
- Connected with NVLink-C2C- TDP up to 500W (CPU + memory)

Up to 960GB of LPDDR5X memory with ECC
Memory bandwidth up to 1TB/s

Up to 960GB of LPDDR5X memory with ECCMemory bandwidth up to 1TB/s

Networking

1 x Dedicated management port

4 x Dedicated management ports
1 x CMC port

Storage Bays2 x 2.5" Gen5 NVMe hot-swappable bays

16 x 2.5" Gen5 NVMe hot-swappable bays

Superchip

MemoryOptional 4 x 2.5" Gen5 NVMe hot-swappable bays
(require 2 x NVIDIA BlueField®-3 DPUs)

Expansion Slots

6 x FHFL PCIe Gen5 x16 slots for GPUs
2 x M.2 slots (PCIe 5.0 x4)

8 x LP PCIe Gen5 x16 slots
4 x OCP 3.0 Gen5 x16 slots
8 x M.2 slots (PCIe 5.0 x4)I/O Ports

2 x USB 3.2 Gen1
1 x Mini-DP
1 x MLAN

8 x USB 3.2 Gen1
4 x VGA
4 x MLAN
1 x CMC portSecurity

Optional TPM2.0 kit: CTM012

Optional TPM2.0 kit: CTM012

Power Supply

2+2 redundant power supplies
2000W 80 PLUS Titanium

2+1 redundant power supplies
3000W 80 PLUS Titanium

SystemManagement

Aspeed AST2600 BMC
GIGABYTE Management Console

Aspeed AST2600 BMC
GIGABYTE Management Console

Other Feature

Compatible with NVIDIA BlueField®-3 DPUs
Supports up to 6 x dual-slot Gen5 GPUs

Compatible with NVIDIA BlueField®-3 DPUs

GIGABYTE Servers for NVIDIA Grace™ Hopper Superchip
XH23-VG0-AAJ1

H223-V10-AAW1Form Factor

2U MGX server system(W438 x H87.5 x D900 mm)

2U 2-node rear access server system(W440 x H87.5 x D850 mm)

Motherboard

MVG3-MG0

MV13-HD0Superchip

NVIDIA Grace™ Hopper Superchip:- 1 x Grace CPU- 1 x Hopper H100 GPU- Connected with NVLink-C2C- TDP up to 1000W (CPU + GPU + memory)

NVIDIA Grace™ Hopper Superchip:- 1 x Grace CPU- 1 x Hopper H100 GPU- Connected with NVLink-C2C- TDP up to 1000W (CPU + GPU + memory)

MemoryGrace CPU:- Up to 480GB of LPDDR5X memory with ECC- Memory bandwidth up to 512GB/s

Grace CPU:- Up to 480GB of LPDDR5X memory with ECC- Memory bandwidth up to 512GB/s

Hopper H100 GPU:
- Up to 96GB HBM3 or 144GB HBM3e- Memory bandwidth up to 4TB/s (or 4.9TB/s)

Hopper H100 GPU:
- Up to 96GB HBM3 or 144GB HBM3e- Memory bandwidth up to 4TB/s (or 4.9TB/s)

2 x 10GbE LAN ports (1 x Intel® X550-AT2)- Support NCSI function

2 x 10GbE LAN ports (1 x Intel® X550-AT2)- Support NCSI function

1 x Dedicated management port

2 x Dedicated management ports
1 x CMC port

4 x 2.5" Gen5 NVMe bays

8 x 2.5" Gen5 NVMe hot-swappable bays

3 x FHFL PCIe Gen5 x16 slots
2 x M.2 slots (PCIe 5.0 x4)

2 x FHHL dual-slot PCIe Gen5 x16 slots
2 x FHHL single-slot PCIe Gen5 x16 slots
2 x OCP 3.0 Gen5 x16 slots
4 x M.2 slots (PCIe 5.0 x4)

I/O Ports

2 x USB 3.2 Gen1
1 x Mini-DP
2 x RJ45
1 x MLAN

4 x USB 3.2 Gen1
2 x Mini-DP4 x RJ45
2 x MLAN
1 x CMC portSecurity

Optional TPM2.0 kit: CTM012

Optional TPM2.0 kit: CTM012

Power Supply

Dual redundant power supplies
2000W 80 PLUS Titanium

2+1 redundant power supplies
3000W 80 PLUS Titanium

SystemManagement

Aspeed AST2600 BMC
GIGABYTE Management Console

Aspeed AST2600 BMC
GIGABYTE Management Console

Other Feature

Compatible with NVIDIA BlueField®-3 DPUs

Compatible with NVIDIA BlueField®-3 DPUs

Networking

Storage Bays
Expansion Slots

GIGABYTE Direct Liquid Cooling Solution
H263-V11-LAW1

H263-V60-LAW1Form Factor

2U 4-node rear access server system(W440 x H87.5 x D850 mm)

2U 4-node rear access server system(W440 x H87.5 x D850 mm)

Superchip

NVIDIA Grace™ Hopper Superchip

NVIDIA Grace™ CPU Superchip

Up to 480GB CPU LPDDR5X ECC memory per module
Up to 96GB HBM3 or 144GB HBM3e per module

Up to 960GB LPDDR5X ECC memory per module

Networking

8 x 10GbE LAN ports (Support NCSI function)
4 x Dedicated management ports
1 x CMC port

4 x Dedicated management ports
1 x CMC port

Storage Bays

16 x 2.5" Gen5 NVMe hot-swappable bays

16 x 2.5" Gen5 NVMe hot-swappable bays

4 x FHHL PCIe Gen5 x16 slots

4 x FHHL PCIe 5.0 x16 slots- Compatible with NVIDIA BlueField®-3 DPUs

- Compatible with NVIDIA BlueField®-3 DPUs

4 x OCP 3.0 Gen5 x16 slots
8 x M.2 slots (PCIe 5.0 x4)

4 x OCP 3.0 Gen5 x16 slots
8 x M.2 slots (PCIe 5 .0 x4)

Triple 3000W 80+ Titanium redundant power supply

2+1 3000W 80+ Titanium redundant power supplies

MemoryExpansion Slots

Power Supply

Applications for the NVIDIA Grace™ CPU/Hopper Superchip

AIHPC

Cloud Computing

With the fast-growing adoption ofAI, either for training massive
language models or real-time
responsive inference, theArm-based NVIDIA Superchips
beneﬁt from the seamless communication between CPUs and GPUs
and lower power consumptions onCPUs. Together with high-banwidth
chip-to-chip connections andcoherent memory design for large
AI model computations, thesesuperchips fulﬁll the computational
needs in modern AI applications.

As HPC developed throughout theyears, the applications have gradually
moved from traditional x86 platforms
to the more power eﬃcientArm-based platform. Based on theexisting Arm ecosystem, a range of
HPC applications can be transferredto the new platform with ease. Alongwith packaged high-bandwidth
low-power memory, the superchips
deliver outstanding performancewith low power consumption andencourage diverse platform choices
for those seeking new solutions.

Beneﬁting from much higher coredensity and better core scalability,
the NVIDIA Grace CPU Superchip
oﬀers outstanding performance,
power eﬃciency, and system
scalability in an era where the cloudhas become an essential part ofour daily lives. Providing
low-latency and high scalability
solutions to adapt to increasingneeds in private and public cloudcomputing services.

www.gigacomputing.com

Giga Computing

Designed byGigaComputing

GIGABYTEServer

GIGABYTEChannel* All intellectual property rights, including without limitation to copyright and trademark of this work
and its derivative works are the property of, or are licensed to, Giga Computing Technology Co., Ltd.
Any unauthorized use is strictly prohibited.
* The entire materials provided herein are for reference only. Giga Computing reserves the right tomodify or revise the content at anytime without prior notice.
* NVIDIA, the NVIDIA logo, Grace, Grace Hopper, Hopper, and NVLink are trademarks and/or registeredtrademarks of NVIDIA Corporation and aﬃliates in the U.S. and other countries. Other company andproduct names may be trademarks of the respective owners with which they are associated.

2024/04 V2.0