2024年6月27日 PCCC WS Jun.2024

Bringing AI everywhere in HPC(AI を HPC へ)
インテル株式会社
矢澤 克巳

HPC事業開発部長

2015

生成AI
想像を絶する
スピードで変化…

2016

2017

2018

2019

2020

2021

2022

2023

Source: Moore, S. (2022), “Nvidia’s Next GPU Shows That Transformers Are Transforming AI“, IEEE Spectrum.

科学分野にAIブームが到来... セキュリティ

製品設計

金融

科学的な生産性向上

AIを使った科学コードの記述

個別医療・創薬

気象モデリング/
気象予測

インテル

データセンター

Efficient -CoreCPU

ロードマップインテル® Xeon® 6 プロセッサー
with E-core

次世代インテル® Xeon® プロセッサー
with E-core

コードネーム Sierra Forest

コードネーム Clearwater Forest

第四世代 インテル® Xeon®
スケーラブル・プロセッサー

Performance-CoreCPU

インテル® Xeon®
CPU マックス・シリーズ

AI

Habana®
Gaudi® 2

専用アクセラレータ

第五世代 インテル® Xeon®
プロセッサーインテル® Xeon® 6 プロセッサー
with P-core

コードネーム Emerald Rapids

コードネーム Granite Rapids

Habana®
Gaudi® 3
次世代 GPU
コードネーム Falcon Shores

HPC & AI

インテル® Data Center GPU マックス・シリーズ

GPU
2023

2025+

2 p ro ces sors w i t h 288 co res

HPC とAI アクセラレーションに最適化された特徴的な新機能
第4世代インテル® Xeon® スケーラブル・プロセッサー

インテル® Xeon® CPU マックス

ブレークスルー・テクノロジー

DDR5
強化されたメモリバンド幅

PCIE 5CXL 1.1

高いスループット

次世代 IO

内蔵AI アクセラレーション

Advanced Matrix Extensions (AMX)
ディープラーニングの推論および学習処理性能を向上

広帯域メモリ

HBM2e
広帯域を必要とするワークロードの性能を飛躍的に向上インテル® Advanced Matrix Extensions (AMX)
ディープラーニングの推論および学習処理性能を向上
2048▪ int8▪ Bfloat16
1024

ISAレベルでの加速▪ 完全なインテルアーキテクチャのプログラマビリティ
▪ 低遅延
256

業界関連のフレームワーク
およびライブラリが利用可能

64
AVX-512 (2xFMA) FP32

AVX-512 (2xFMA) INT8

AMX (TMUL) BF16

AMX (TMUL) INT8

Results have been simulated. For workloads and configurations visit
www.intel.com/ArchDay21claims . Results may vary

Ops/Cycle per core @ 100% utilization

ディープラーニング
データータイプX86初
HBMを持つ唯一のCPU
最適なメモリ選択肢となりうる

最大

最大

64GB

220GF/s

2GB

HBM2e
4 stacks of 16GB

HPCG

HBM per CoreSee backup for workloads and configurations. Results may vary.

HBM Only

HBM Flat

HBM Caching

Bootable fromHBM

2 Memory Regions

HBM as cache for DDR

SW Optimization
NeededNo code change

No code change
HBM

DDR

HBM

DDR

HBM

DDR

Relative Perf. Higher is better6

Industry Standard

5.3
5

メモリ帯域を要求するベンチマーク 4
CPU MAXでは最大

5倍の性能

3.8

3

2

2S インテル® Xeon® CPU マックス・シリーズ vs.
2S 第三世代 インテル® Xeon® 8380 プロセッサー

1

1.5

1.4

1.4

1.6

1.0

0
Intel® Xeon®
8380
Processor

Stream Triad

HPL

第四世代 インテル® Xeon® スケーラブル・プロセッサー

See backup for workloads and configurations. Results may vary.

HPCG

インテル® Xeon® CPU マックス・シリーズ

AI向けにデザインされた第五世代 インテル® Xeon® プロセッサー
プロセッサあたり最大64コア
インテル® Advanced Matrix Extensions (インテル® AMX)
より高い AMX周波数と最適化されたソフトウェア群
メモリバンド幅の向上
最大5600 MT/s

大きなラストレベルキャッシュ(LLC)
前世代から最大3倍

CXLタイプ３メモリサポート

インテル® AI ソフトウェア
300以上の最適化された深層学習モデル
50以上の最適化された機械学習
およびグラフモデル
インテル® AI デベロッパーツール

5th Gen Intel® Xeon®
processors

PyTorch コンテナ
https://hub.docker.com/r/intel/intel-optimizedpytorch

TensorFlow コンテナ
https://hub.docker.com/r/intel/intel-optimizedtensorflow

10パフォーマンスの大幅な飛躍
第五世代インテル® Xeon® プロセッサ

CPUアップグレード
第四世代インテル® Xeon® プロセッサー
vs. 第五世代インテル Xeon プロセッサー

1.42倍

最大

1.4倍

最大

より高い推論性能

より高いHPC性能

AI

HPC

HPC

サーバープラットフォーム
アップグレード
第三世代インテル® Xeon® プロセッサー
vs. 第五世代インテル Xeon プロセッサー
5th Gen Intel® Xeon®
processors

最大14倍より高い推論および学習性能

最大2.1倍
平均性能向上3倍
より高い
LAMMPS性能

See [G1, A17, A16, H7, H1, N6, N13] at intel.com/processorclaims: 5th Gen Intel Xeon Scalable processors. Results may vary.

11幅広いワークロードの性能向上
第五世代インテル® Xeon® プロセッサー vs. 第三世代インテル Xeon プロセッサー
Web
5th Gen Intel Xeon 8592+(64c) vs
3rd Gen Intel Xeon 8380(40c)

Data Services

HPC

5th Gen Intel Xeon 8592+(64c) vs
3rd Gen Intel Xeon 8380(40c)AI

Network

5th Gen Intel Xeon 8592+(64c) vs
3rd Gen Intel Xeon 8380(40c)

5th Gen Intel Xeon 8592+(64c) vs
3rd Gen Intel Xeon 8380 (40c)

5th Gen Intel Xeon 8592+(64c)vs3rd Gen Intel Xeon
6338N(32c)

6.5
4.05
2.0

1.81

1.85

1.73

2.45

2.49

3.05
1.84

1.66

1.98

2.36

6.2
4.36

3.02

3.64

Normalized to 3rd Gen Intel Xeon-SP
Higher is better
See backup for workloads and configurations. Results may vary.

市場要求を十分満たすLLMレイテンシ性能
第五世代インテル® Xeon® プロセッサー
Single node 2S 5th Gen Xeon Large Language Model Next Token Latency
Chat bot

GPT-J
6B

INT8 Inference
Lower is better

MarketRequires<100msContent…
Coding…
SearchText…
Text…

Chat botContent…

Llama2
13B

Coding…
Search

Text…
Text…
0 ms

25 ms

50 ms

75 ms

100 ms

125 ms

150 ms5th Gen Intel® Xeon®
processors

See backup for workloads and configurations. Results may vary.

13

第五世代 インテル® Xeon® プロセッサー

Intel may make changes to specifications and product descriptions at any time, without notice.
Please visit intel.com/xeon or contact your Intel representative to obtain the latest product specifications. Intel processor numbers are not a measure of performance.
Processor numbers differentiate features within each processor family, not across different processor families. All processors support Intel Virtualization Technology(Intel VT-x).
Intel, the Intel logo, Xeon, and Optane are trademarks of Intel Corporation or its subsidiaries.

Y Supports Intel Speed Select Technology – Performance Profile 2.0 (Intel SST-PP)
Unless noted, all 8500, 6500 and 5500 processors, include support for Intel Speed Select technology (Intel SST) featuring Intel SST
Base Frequency (SST-BF), Intel SST Core Power (SST-CP) and Intel SST Turbo Frequency (SST-TF) capabilities.

© Copyright 2022. Intel Corporation.

5th Gen Intel® Xeon®
processors

14次世代データセンターソリューション

インテル Xeon 6 プロセッサー(Efficient-Core)

インテル Xeon 6 プロセッサー(Performance-Core)

インテル Gaudi 3 AI
アクセラレーター

高密度実装を実現する
消費電力あたりの性能に最適化

計算負荷の高い
ワークロードに向けコア性能を最適化

性能、スケーラビリティ、
効率性において
生成ＡＩのあらたな選択肢

Open Ecosystems

Open Software

Open Platforms
15

発売開始
2024年6月

Q3’2024``

Intel® Xeon® 6700E

Q1’2025

Intel® Xeon® 6900P

Intel® Xeon® 6900E

Intel® Xeon® 6700P
Intel® Xeon® 6500P
Intel® Xeon® 6 SoC
Intel® Xeon® 6300P

16

共通のソフトウェア・スタックで効率性と使いやすさを実現
Efficient-core(E-core)Performance-core(P-core)Base x86 ISAxxIntel® Advanced Vector Extensions 2 (Intel® AVX2)

x

x

カテゴリ

命令セットと
拡張機能

OSとハイパーバイザー

アプリケーションとライブラリ

ソフトウェアスタック構成要素

Intel® Advanced Vector Extensions 512 (Intel® AVX-512)xIntel® Advanced Matrix Extensions (Intel® AMX)

x

Linux kernel and commercial Linuxxx

Windowsx

x

VMware ESXixx

Database incl. common libraries (ex. ZStd)x

x

Network & media incl. common libraries (ex. DPDK)xx

General compute & storage incl. libraries (ex. SPDK)

x

x

17

インテル® Xeon® 6

インテル Xeon 6 プロセッサー(Performance-Core)

計算負荷の高い
ワークロードに向けコア性能を最適化

卓越した性能と効率性
AI

HPC

一般的な
計算

最大

最大

2倍

2.3倍

最大

2倍

より高い
ＡＩ推論性能より高い
OpenFOAM
性能

平均的により高い性能P-coreP-coreP-core前世代と比較してSee [7W4, 7N2, 7T2, 7D1. 9G10, 9H10] at intel.com/processorclaims: Intel® Xeon® 6. Results may vary18

INTEL® XEON® 6 PROCESSORSINTEL® XEON® 6 PROCESSORS

Performance Core

Efficient Coreup to 86 cores (6700) or 128 cores (6900)

Cores

up to 144 cores (6700) or 288 cores (6900)

1S, 2S, 4S, 8S

Sockets

1S, 2S

125 to 500W

Max TDP

205 to 500W

up to 12 channels DDR5 | MCR DIMM

Memoryup to 12 channels DDR56400 (1 DPC) | 5200 (2 DPC) | 8800 MCR (1 DPC)

Max Memory Speed

6400 (1 DPC) | 5200 (2 DPC)

up to 6 UPI 2.0 | up to 24 GT/s per lane

Intel® UPI

up to 4 UPI 2.0 | up to 24 GT/s per lane

up to 96 lanes PCIe 5.0 (x16, x8, x4, x2)
R1S: up to 136 lanes PCIe 5.0 for single socket
designs

PCI Express

up to 96 lanes PCIe 5.0 (x16, x8, x4, x2)

up to 64 lanes CXL 2.0

52/57
Intel Advanced Matrix Extensions (INT8, BF16, FP16)Intel Advanced Vector Extensions 512 (VNNI/INT8)

Compute Express Link
Physical/Virtual Address Bits
AI Acceleration
Intel® Deep Learning Boost

up to 64 lanes CXL 2.0

52/48
Intel Advanced Vector Extensions 2 (VNNI/INT8)Intel Software Guard Extensions,Intel Trusted Domain Extensions

SecurityIntel Software Guard Extensions,Intel Trusted Domain Extensions

Vector AES, SHA2-256 extensions, VPMADD52

CryptoVector AES, SHA2-256 extensions, VPMADD52Intel QuickAssist Technology, Intel Dynamic Load Balancer, Intel
Data Streaming Accelerator, Intel In-memory Analytics Accelerator

Integrated AcceleratorsIntel QuickAssist Technology, Intel Dynamic Load Balancer, Intel
Data Streaming Accelerator, Intel In-memory Analytics Accelerator

MCR DIMM
MemoryGranite Rapids向け2-Rank RDIMMによる同容量でより高いメモリバンド幅を持つ

最大

最大

2 socket

8800

83%

>1.5

MT/s

ピークB/W
向上

TB/s

DRAM

Bufferアクセラレータと GPU ロードマップ
HPC/AIIntel® Data Center
GPU Max Series
AI

Next Generation
GPU Codenamed
Falcon ShoresIntel® Gaudi® 2
Accelerator

Intel® Gaudi® 3 Accelerator

どういったモデルに適している？
スモール～ミディアムサイズのモデル（ビジネスアプリケーションのボリュームゾーン）

1e+09

ビッグサイズのモデル（先進技術）

学習処理コンピューティング (PFLOPS)

1e+08

1e+07

1e+06

1e+05

1e+04

1e+03

1e+02
2012年

2013年

2014年

2015年

2016年

2017年

2018年

2019年

2020年

2021年

2022年

出典: Moore, S. (2022年)、「Nvidia’s Next GPU Shows That Transformers Are Transforming AI」、IEEE Spectrum

柔軟で包括的なオープンソフトウェアスタック
インテルハードウェアの価値、アプリケーションのパフォーマンス、開発の生産性を最大化
HPC

AI

Rendering

Modeling & Simulation

Data Analytics at Scale

High-fidelity
Graphics

Scientific Computing

DL Inference and Training

Visualization/
VisualComputeClassical ML

Ray Tracing

Analytics

Powered by oneAPI
Performance
Libraries

oneMKL

oneDNN

Tools & Compilers

oneDAL

oneCCL

Direct Programming

oneTBB

oneDPL

oneVPLIntel® MPI

C++

Fortran

MPI

OpenMP

Hardware interface

CPU

GPU

AI

Bringing AI Everywhere in HPCの実現
エッジからデータセンター、クラウドまで、 あらゆるプラットフォームで AIをイノベーション
の促進

価値の最大化

あらゆる環境に対応

セキュアで、責任のあるAI

Notices and Disclaimers
Statements in this document that refer to future plans or expectations are forward-looking statements. These statements are based on current
expectations and involve many risks and uncertainties that could cause actual results to differ materially from those expressed or implied in suchstatements. For more information on the factors that could cause actual results to differ materially, see our most recent earnings release and SEC filings at
www.intc.com.
All product plans and roadmaps are subject to change without notice.
Performance varies by use, configuration and other factors. Learn more on the Performance Index site. Intel technologies may require enabled hardware,
software or service activation.
Performance results are based on testing as of dates shown in configurations and may not reflect all publicly available updates. See backup for configuration
details. No product or component can be absolutely secure.
Your costs and results may vary.
Intel does not control or audit third-party data. You should consult other sources to evaluate accuracy.
Code names are used by Intel to identify products, technologies, or Service that are in development and not publicly available. These are not "commercial"names and not intended to function as trademarks.
© Intel Corporation. Intel, the Intel logo, and other Intel marks are trademarks of Intel Corporation or its subsidiaries. Other names and brands may beclaimed as the property of others.

Configurations
Performance varies by use, configuration and other factors. Results may vary.
SVT-HEVC-1080p-preset1-avx2 and AVC-1080p-fast-avx2 :8592+: 1-node, 2x Intel® Xeon® Platinum 8592+, 64 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261931, microcode 0x21000161, 1x Ethernet Controller I225-LM,
1x 3.5T INTEL SSDPF2KX038TZ, Ubuntu 22.04.3 LTS, 5.15.0-84-generic, x264 Version-0.164.x,x265 Version-Release_3.5,SVT-HEVC Version-v1.3.0,SVT-AV1 Version-v0.8.7, Test by Intel as of 09/25/23
8380:. 1-node, 2x Intel(R) Xeon(R) Platinum 8380, 40 cores, HT On, Turbo On, Total Memory 512GB (16x32GB DDR4 3200 MT/s [3200 MT/s]), BIOS SE5C620.86B.01.01.0008.2305172341, microcode 0xd0003a5, 2x Ethernet Controller X710 for
10GBASE-T, 1x 57.3G Ultra USB 3.0, 1x 7T INTEL SSDPF2KX076TZ, Ubuntu 22.04.3 LTS, 5.15.0-84-generic, x264 Version-0.164.x,x265 Version-Release_3.5,SVT-HEVC Version-v1.3.0,SVT-AV1 Version-v0.8.7, Test by Intel as of 09/25/23
Server-Side Java Throughput :8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo On, NUMA 4, Integrated Accelerators Available [used]: DLB 2 [0], DSA 2 [0], IAA 2 [0], QAT 2 [0], Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600MT/s]), BIOS 3B05.TEL4P1, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.1 LTS, 5.15.0-78-generic, Server Side Java , JDK21, Test by Intel as of 10/05/23.
8380: 1-node, 2x Intel(R) Xeon(R) Platinum 8380 CPU @ 2.30GHz, 40 cores, HT On, Turbo On, NUMA 4, Integrated Accelerators Available [used]: DLB 0 [0], DSA 0 [0], IAA 0 [0], QAT 0 [0], Total Memory 1024GB (16x64GB DDR4 3200 MT/s
[3200 MT/s]), BIOS 1.5, microcode 0xd0003a5, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.15.0-78-generic,Server Side Java , JDK21, Test by Intel as of 10/13/23 .
Virtualization:
8592+: 1-node, 2x Intel® Xeon® Platinum 8592+, 64 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 2 [0], DSA 2 [0], IAA 2 [0], QAT 2 [0], Total Memory 4096GB (32x128GB DDR5 4800 MT/s [4400 MT/s]), BIOSEGSDCRB1.SYS.0105.D74.2308261931, microcode 0x21000161, 1x Ethernet Controller I225-LM, 4x Ethernet Controller E810-C for QSFP, 25x Ethernet Adaptive Virtual Function, 1x 3.5T INTEL SSDPF2KX038TZ, 9x 2.9T INTEL SSDPF21Q032TB,Red Hat Enterprise Linux 8.6 (Ootpa), 4.18.0-372.9.1.el8.x86_64, qemu-kvm-6.2.0-11, Test by Intel as of 09/24/23.
8380: 1-node, 2x Intel(R) Xeon(R) Platinum 8380 CPU @ 2.30GHz, 40 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 0 [0], DSA 0 [0], IAA 0 [0], QAT 0 [0], Total Memory 2048GB (32x64GB DDR4 3200 MT/s
[3200 MT/s]), BIOS SE5C620.86B.01.01.0008.2305172341, microcode 0xd0003a5, 73x Ethernet Adaptive Virtual Function, 2x Ethernet Controller 10G X550T, 4x Ethernet Controller E810-C for QSFP, 4x 3.5T INTEL SSDPF2KX038TZ, 1x 5.8T
INTEL SSDPE2KE064T8, 1x 894.3G INTEL SSDSC2KG96, 2x 447.1G INTEL SSDSC2KG48, 1x 7.3G Transcend 8GB, Red Hat Enterprise Linux 8.6 (Ootpa), 4.18.0-372.9.1.el8.x86_64, qemu-kvm-6.2.0-11,Test by Intel as of 09/20/23.
SPDK NVMe:
8592+: 1-node, 2x 5th Gen Intel Xeon Scalable processor (64 core) with integrated Intel Data Streaming Accelerator (Intel DSA), DSA device utilized=1(1 active socket), HT On, Turbo On, SNC Off, with 1024GB DDR5 memory (16x64 GB 5600),
microcode 0x21000161, Ubuntu 22.04.3 LTS, 5.15.0-78-generic, 1x 894.3G Micron 7450, 4x 3.84TB Samsung PM1733, 1x Intel® Ethernet Network Adapter E810-2CQDA2, 2x100GbE, FIO v3.34, SPDK 22.05, tested by Intel October 2023.
8380: 1-node, Intel platform with 2x 3rd Gen Intel Xeon Scalable processor (40 cores), HT On, Turbo On, SNC off, Total Memory 1024GB (16x64GB DDR4 3200), microcode 0xd0003a5, HT On, Turbo On, SNC Off, Ubuntu 22.04.3 LTS, 5.15.0-78generic, 1x 1x 1.7T Samsung PM9A3, 4x 3.84TB Samsung PM1733, 1x Intel® Ethernet Network Adapter E810-2CQDA2, 2x100GbE, 1x Ethernet Controller 10-Gigabit X540-AT2, FIO v3.34, SPDK 22.05, tested by Intel October 2023.
Clickhouse DB with IAA:
8592+: 1-node, 2x 5th Gen Intel Xeon Scalable processor 8592+ (64 cores) with integrated Intel In-Memory Analytics Accelerator (Intel IAA), Number of IAA device utilized=4(1 sockets active), HT On, Turbo On, SNC off, Total Memory 1024GB(16x64GB DDR5 5600), microcode 0x21000161, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 6.5.0-060500-generic, ZSTD v1.5.0, QPL v1.3dev, accel-config-v4.1.1, clang13,
Clickhouse 21dev, Star Schema Benchmark, Query 4.1, tested by Intel October 2023.
8380: 1-node, Intel platform with 2x 3rd Gen Intel Xeon Scalable processor (40 cores) withHT On, Turbo On, SNC off, Total Memory 1024GB (16x64GB DDR5 3200), microcode 0xd0003a5, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T
SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 6.5.0-060500-generic, ZSTD v1.5.0, clang13, Clickhouse 21dev, Star Schema Benchmark, Query 4.1, tested by Intel October 2023.

Configurations
Performance varies by use, configuration and other factors. Results may vary.
MYSQL Database:8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 8 [0], DSA 8 [0], IAX 8 [0], QAT 8 [0], Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600MT/s]), BIOS 2.0, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, 2x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, Ubuntu 22.04.3 LTS, 5.15.0-84-generic, HammerDB Multi Instance,
MySQL 8.0.33. Test by Intel as of 10/04/23.
8380: 1-node, 2x Intel(R) Xeon(R) Platinum 8380 CPU @ 2.30GHz, 40 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 0 [0], DSA 0 [0], IAX 0 [0], QAT 0 [0], Total Memory 1024GB (16x64GB DDR4 3200 MT/s
[3200 MT/s]), BIOS 1.4, microcode 0xd0003a5, 2x Ethernet Controller 10-Gigabit X540-AT2, 2x Ethernet Controller X710 for 10GBASE-T, 1x 894.3G INTEL SSDSC2KG96, Ubuntu 22.04.3 LTS, 5.15.0-84-generic, HammerDB Multi Instance,
MySQL 8.0.33, Test by Intel as of 10/05/23.
Monte Carlo:Intel Xeon 8380: 1-node, 2x 3rd Gen Intel Xeon 8380, HT On, Turbo On, SNC2, 1024 GB DDR4-3200, ucode=0xd0003a5, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_7.x86_64, Monte Carlo v1.2, cmkl:2023.2.0 icc:2023.2.0 tbb:2021.10.0. Test
by Intel as of October 2023.
Intel Xeon 8592+: 1-node 2x Intel Xeon 8592+, HT On, Turbo On, SNC2, 1024 GB DDR5-5600, ucode 0x21000161, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_7.x86_64, Monte Carlo v1.2, cmkl:2023.2.0 icc:2023.2.0 tbb:2021.10.0. Test by Intelas of October 2023.
WRF (Geomean of CONUS 2.5KM, CONUS 12KM) :Intel Xeon 8380: 1-node, 2x 3rd Gen Intel Xeon 8380, HT On, Turbo On, SNC2, 1024 GB DDR4-3200, ucode=0xd0003a5, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_7.x86_64, WRF v4.2.2, icc:2023.2.0 ifort:2021.10.0, impi:2021.10.0. Test byIntel as of October 2023.
Intel Xeon 8592+: 1-node 2x Intel Xeon 8592+, HT On, Turbo On, SNC2, 1024 GB DDR5-5600, ucode 0x21000161, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_7.x86_64, WRF v4.2.2, icc:2023.2.0 ifort:2021.10.0, impi:2021.10.0. Test by Intel asof October 2023.
LAMMPS (Geomean of Polyethylene,DPD,Copper, Liquid Crystal,Atomic Fluid,Protein, Stillinger-Weber,Tersoff, Water) :Intel Xeon 8380: 1-node, 2x 3rd Gen Intel Xeon 8380, HT On, Turbo On, SNC2, 1024 GB DDR4-3200, ucode=0xd0003a5, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_7.x86_64, LAMMPS v2021-09-29, cmkl:2023.2.0 icc:2023.2.0
tbb:2021.10.0, impi:2021.10.0. Test by Intel as of October 2023.
Intel Xeon 8490H: 1-node, 2x 4th Gen Intel Xeon 8490H, HT On, Turbo On, SNC4, 1024 GB DDR4-4800, ucode=0x2b0004d0, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_7.x86_64, LAMMPS v2021-09-29, cmkl:2023.2.0 icc:2023.2.0
tbb:2021.10.0, impi:2021.10.0. Test by Intel as of March 2023.
Intel Xeon 8592+: 1-node 2x Intel Xeon 8592+, HT On, Turbo On, SNC2, 1024 GB DDR5-5600, ucode 0x21000161, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_7.x86_64, LAMMPS v2021-09-29, cmkl:2023.2.0 icc:2023.2.0 tbb:2021.10.0,
impi:2021.10.0. Test by Intel as of October 2023.
Ansys LS-DYNA (Geomean of 3cars-150ms, ODB-10M, car2car/120ms)
Intel Xeon 8380: 1-node, 2x 3rd Gen Intel Xeon 8380, HT On, Turbo On, SNC2, 1024 GB DDR4-3200, ucode=0xd0003a5, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_7.x86_64, Ansys LS-DYNA R11, impi:2021.10.0. Test by Intel as of October
2023.
Intel Xeon 8592+: 1-node 2x Intel Xeon 8592+, HT On, Turbo On, SNC2, 1024 GB DDR5-5600, ucode 0x21000161, Red Hat Enterprise Linux 8.7, 4.18.0-425.10.1.el8_7.x86_64, Ansys LS-DYNA R11, impi:2021.10.0. Test by Intel as of October 2023.

Configurations
Performance varies by use, configuration and other factors. Results may vary.
BERT-large Inference:
8592+: 1-node, 2x Intel(R) Xeon(R) Platinum 8592+, 64 cores, HT On, Turbo On, NUMA 4, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261933, microcode 0x21000161, 1x Ethernet
Controller I225-LM, 1x 3.6T INTEL SSDPE2KX040T8, 1x 931.5G INTEL, CentOS Stream 9, 6.2.0-emr.bkc.6.2.3.6.31.x86_64. PyTorch: torch:2.1.0.dev20230825+cpu, oneDNN:v3.2.1 IPEX:2.1.0+git31b5ee1, Test by INTEL as of 09/07/2023.
8380: 1-node, 2x Intel(R) Xeon(R) Platinum 8380 CPU @ 2.30GHz, 40 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR4 3200 MT/s [3200 MT/s]), BIOS SE5C620.86B.01.01.0008.2305172341, microcode 0xd0003a5, 2x Ethernet
Controller 10G X550T, 3x 894.3G INTEL SSDSC2KG96, 1x 0B vmDisk, 1x 60G Flash Disk, 1x 1024M vmDisk-CD, 1x 3.6T INTEL SSDPE2KX040T8, 1x 931.5G INTEL SSDPE2KX010T8, Ubuntu 22.04 LTS, 5.15.0-78-generic, PyTorch:torch:2.1.0.dev20230825+cpu oneDNN:v3.2.1 IPEX:2.1.0+git31b5ee1. Test by INTEL as of 09/14/23.
Bert-Large, BS=x (batch): 1 instance/ numa node; Bert Large: SQuAD1.1 (seq len=384)
SSD-ResNet34 Inference:
8592+: 1-node, 2x Intel(R) Xeon(R) Platinum 8592+, 64 cores, HT On, Turbo On, NUMA 4, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261933, microcode 0x21000161, 1x Ethernet
Controller I225-LM, 1x 3.6T INTEL SSDPE2KX040T8, 1x 931.5G INTEL, CentOS Stream 9, 6.2.0-emr.bkc.6.2.3.6.31.x86_64. PyTorch: torch:2.1.0.dev20230825+cpu, oneDNN:v3.2.1 IPEX:2.1.0+git31b5ee1, Test by INTEL as of 09/07/2023.
8380: 1-node, 2x Intel(R) Xeon(R) Platinum 8380 CPU @ 2.30GHz, 40 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR4 3200 MT/s [3200 MT/s]), BIOS SE5C620.86B.01.01.0008.2305172341, microcode 0xd0003a5, 2x Ethernet
Controller 10G X550T, 3x 894.3G INTEL SSDSC2KG96, 1x 0B vmDisk, 1x 60G Flash Disk, 1x 1024M vmDisk-CD, 1x 3.6T INTEL SSDPE2KX040T8, 1x 931.5G INTEL SSDPE2KX010T8, Ubuntu 22.04 LTS, 5.15.0-78-generic, PyTorch:torch:2.1.0.dev20230825+cpu oneDNN:v3.2.1 IPEX:2.1.0+git31b5ee1. Test by INTEL as of 09/14/23.
SSD-ResNet34, BS=x: 1 instance/ numa node; SSD-Resnet34 coco 2017 (1200 x1200)
Distillbert inference :8592+: 1-node, 2x Intel(R) Xeon(R) Platinum 8592+, 64 cores, HT On, Turbo On, NUMA 4, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261933, microcode 0x21000161, 1x Ethernet
Controller I225-LM, 1x 3.6T INTEL SSDPE2KX040T8, 1x 931.5G INTEL, CentOS Stream 9, 6.2.0-emr.bkc.6.2.3.6.31.x86_64. PyTorch: torch:2.1.0.dev20230825+cpu, oneDNN:v3.2.1 IPEX:2.1.0+git31b5ee1, Test by INTEL as of 09/07/2023.
8380: 1-node, 2x Intel(R) Xeon(R) Platinum 8380 CPU @ 2.30GHz, 40 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR4 3200 MT/s [3200 MT/s]), BIOS SE5C620.86B.01.01.0008.2305172341, microcode 0xd0003a5, 2x Ethernet
Controller 10G X550T, 3x 894.3G INTEL SSDSC2KG96, 1x 0B vmDisk, 1x 60G Flash Disk, 1x 1024M vmDisk-CD, 1x 3.6T INTEL SSDPE2KX040T8, 1x 931.5G INTEL SSDPE2KX010T8, Ubuntu 22.04 LTS, 5.15.0-78-generic, PyTorch:torch:2.1.0.dev20230825+cpu oneDNN:v3.2.1 IPEX:2.1.0+git31b5ee1. Test by INTEL as of 09/14/23.
DistilBERT, BS=x: 1 instance/ numa node
AI Training :8592+: 1-node, 2x Intel(R) Xeon(R) Platinum 8592+, 64 cores, HT On, Turbo On, NUMA 4, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS EGSDCRB1.SYS.0105.D74.2308261933, microcode 0x21000161, 1x Ethernet
Controller I225-LM, 1x 3.6T INTEL SSDPE2KX040T8, 1x 931.5G INTEL, CentOS Stream 9, 6.2.0-emr.bkc.6.2.3.6.31.x86_64. PyTorch: torch:2.1.0.dev20230825+cpu, oneDNN:v3.2.1 IPEX:2.1.0+git31b5ee1, Test by INTEL as of 09/07/2023.
8380: 1-node, 2x Intel(R) Xeon(R) Platinum 8380 CPU @ 2.30GHz, 40 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR4 3200 MT/s [3200 MT/s]), BIOS SE5C620.86B.01.01.0008.2305172341, microcode 0xd0003a5, 2x Ethernet
Controller 10G X550T, 3x 894.3G INTEL SSDSC2KG96, 1x 0B vmDisk, 1x 60G Flash Disk, 1x 1024M vmDisk-CD, 1x 3.6T INTEL SSDPE2KX040T8, 1x 931.5G INTEL SSDPE2KX010T8, Ubuntu 22.04 LTS, 5.15.0-78-generic, PyTorch:torch:2.1.0.dev20230825+cpu oneDNN:v3.2.1 IPEX:2.1.0+git31b5ee1. Test by INTEL as of 09/14/23.
BS=x, 1 instance/ numa node [Using only one socket]. Resnet50 v1.5: ImageNet (224 x224), SSD Resnet34: COCO 2017, BERT-large: Wikipedia 2020/01/01 ( seq len =512), DLRM: Criteo Terabyte Dataset, RNNT: LibriSpeech, Mask RCNN: COCO2017

Configurations
Performance varies by use, configuration and other factors. Results may vary.
VPP Ipv4 FIB :8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo Off, NUMA 2, Total Memory 512GB (16x32GB DDR5 5600 MT/s [5600 MT/s]), BIOSEGSDCRB1.SYS.0105.D74.2308261933, microcode 0x21000161, 1x Ethernet Controller I225-LM, 1x 223.6G INTEL SSDSC2KB240G8, 1x 240M Disk, Ubuntu 22.04 LTS, 5.15.0-27generic, Workload: VPP ipv4-fib-1.25M flows 64B packets, VPP version 23.10-rc0~0-ga7dd04d73, score=505Gb/s, wall power 910WTest by Intel as of 09/25/23.
6338N: 1-node, 2x Intel(R) Xeon(R) Gold 6338N CPU @ 2.20GHz, 32 cores, HT On, Turbo Off, NUMA 2, Integrated Accelerators Available [used]: DLB 0 [0], DSA 0 [0], IAA 0 [0], QAT 0[0], Total Memory 256GB (16x16GB DDR4 2933 MT/s [2666 MT/s]), BIOS WLYDCRB1.KSM.0030.P26.2303301709, microcode 0xd0003a5, 1x I210 Gigabit Network Connection, 1x
240M Disk, 1x 223.6G KINGSTON SUV400S37240G, Ubuntu 22.04 LTS, 5.15.0-27-generic, Workload: VPP ipv4-fib-1M flows 64B packets, VPP version 23.10-rc0~0-ga7dd04d73.
score=167Gb/s, Test by Intel as of 10/02/23.
VPP IPSec :8592+:1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo Off, NUMA 2, Total Memory 512GB (16x32GB DDR5 5600 MT/s [5600 MT/s]), BIOSEGSDCRB1.SYS.0105.D74.2308261933, microcode 0x21000161, 1x Ethernet Controller I225-LM, 1x 223.6G INTEL SSDSC2KB240G8, 1x 240M Disk, Ubuntu 22.04 LTS, 5.15.0-27generic, Workload: VPP IPSec 120K tunnels 512B packets, VPP version 23.10-rc0~0-ga7dd04d73,.Test by Intel as of 09/25/23.
6338N: 1-node, 2x Intel(R) Xeon(R) Gold 6338N CPU @ 2.20GHz, 32 cores, HT On, Turbo Off, NUMA 2, Integrated Accelerators Available [used]: DLB 0 [0], DSA 0 [0], IAA 0 [0], QAT 0[0], Total Memory 256GB (16x16GB DDR4 2933 MT/s [2666 MT/s]), BIOS WLYDCRB1.KSM.0030.P26.2303301709, microcode 0xd0003a5, 1x I210 Gigabit Network Connection, 1x
240M Disk, 1x 223.6G KINGSTON SUV400S37240G, Ubuntu 22.04 LTS, 5.15.0-27-generic, Workload: VPP IPSec 56K tunnels 512B packets, VPP version 23.10-rc0~0-ga7dd04d73.
Test by Intel as of 10/02/23.

Configurations
5th Gen Xeon Large Language Model Latency

Llama2-13B
8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB
DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x Ethernet
interface, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.2 LTS, 5.15.0-78-generic, Test by Intel as of 10/10/23.
Llama2, gcc=12.3 gxx=12.3, python 3.9, intel-extension-for-pytorch 2.2.0+,git305fc52, torch 2.2.0.dev20230914+cpu, transformers
4.31.0, protobuf 3.20.3, neural-compressor 2.2, test on 1 socket, Batch Size(BS)=1, Corest per instance (CPI)=#cores/socket, searchalgorithm: BEAM4.
GPT-J 6B
8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo On, NUMA 2, Total Memory 1024GB (16x64GB
DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000161, 2x Ethernet Controller 10-Gigabit X540-AT2, 1x 1.7T
SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 5.15.0-83-generic, GPT-J 6B, gcc=12.3, python 3.9intel-extension-forpytorch 2.2.0+git305fc52torch 2.2.0.dev20230914+cputransformers 4.31.0protobuf 3.20.3neural-compressor 2.2, Test on 1
socket, BS1 CPI 64. Test by Intel as of 09/21/23.

Configurations
5th Gen Xeon Mainstream Workload Performance
Server Side Java SLAIntel Xeon 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo On, Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600MT/s]), BIOS 3B05.TEL4P1, microcode 0x21000161, 2x Ethernet Controller X710 for 10GBASE-T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.1
LTS, 5.15.0-78-generic, Server-side Java* SLA throughput. Test by Intel as of 10/06/23.
AMD EPYC 9554: 1-node, 2x AMD EPYC 9554 64-Core Processor, 64 cores, HT On, Turbo On, , Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800MT/s]), BIOS 1.5, microcode 0xa10113e, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZ1L21T9HCLS-00A07, Ubuntu 22.04.3 LTS, 5.15.0-78-generic,Server-side Java*SLA throughput. Test by Intel as of 10/24/23.
NGINX TLS
Intel Xeon 8592+: 1-node, 2x 5th Gen Intel Xeon Scalable processor (64 core) with integrated Intel Quick Assist Technology (Intel QAT), QAT device utilized=4 (1active socket), HT On, Turbo Off, SNC On, with 1024GB DDR5 memory (16x64 GB 5600), microcode 0x21000161, Ubuntu 22.04.3 LTS, 5.15.0-78-generic, 1x 1.7T
SAMSUNG MZWLJ1T9HBJR-00007, 1x Intel® Ethernet Network Adapter E810-2CQDA2, 1x100GbE, NGINX Async v0.5.1, OpenSSL 3.1.3, IPP Crypto 2021.8,
IPsec MB v 1.4, QAT _Engine v 1.4.0, QAT Driver 20.l.1.1..20-00030, TLS 1.3 Webserver: ECDHE-X25519-RSA2K, tested by Intel October 2023.
AMD EPYC 9554: 1-node, AMD platform with 2x 4th Gen AMD EPYC processor (64 cores), SMT On, Core Performance Boost Off, NPS1, Total Memory 1536GB(24x64GB DDR5 4800), microcode 0xa10113e, Ubuntu 22.04.3 LTS, 5.15.0-78-generic, 1x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, 1x Intel® Ethernet Network
Adapter E810-2CQDA2, 1x100GbE, NGINX Async v0.5.1, OpenSSL 3.1.3, TLS 1.3 Webserver: ECDHE-X25519-RSA2K,tested by Intel October 2023.
ClickHouseIntel Xeon 8592+: 1-node, 2x 5th Gen Intel Xeon Scalable processor 8592+ (64 cores) with integrated Intel In-Memory Analytics Accelerator (Intel IAA), Number of
IAA device utilized=4(1 sockets active), HT On, Turbo On, SNC off, Total Memory 1024GB (16x64GB DDR5 5600), microcode 0x21000161, 2x Ethernet Controller
10-Gigabit X540-AT2, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 6.5.0-060500-generic, ZSTD v1.5.0, QPL v1.3dev, accel-config-v4.1.1,
clang13, Clickhouse 21dev, Star Schema Benchmark, Query 4.1, tested by Intel October 2023.
AMD EPYC 9554: 1-node, AMD platform with 2x 4th Gen AMD EPYC processor (64 cores), SMT On, Core Performance Boost On, NPS1, Total Memory 1024GB(16x64GB DDR5 4800), microcode 0xa10113e, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 6.5.0060500-generic, ZSTD v1.5.0, clang13, Clickhouse 21dev, Star Schema Benchmark, Query 4.1, tested by Intel October 2023.

Configurations
5th Gen Xeon Mainstream Workload Performance

RocksDBIntel Xeon 8592+: 1-node, 2x 5th Gen Intel Xeon Scalable processor 8592+ (64 cores) with integrated Intel In-Memory Analytics Accelerator (Intel IAA), Number of IAA
device utilized=8(2 sockets active), HT On, Turbo On, SNC off, Total Memory 1024GB (16x64GB DDR5 5600), microcode 0x21000161, 2x Ethernet Controller 10Gigabit X540-AT2, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 6.5.0-060500-generic, QPL v1.2.0, accel-config-v4.0, iaa_compressor plugin
v0.3.0, ZSTD v1.5.5, gcc 10.4.0, RocksDB v8.3.0 trunk (commit 62fc15f) (db_bench), 4 threads per instance, 64 RocksDB instances, tested by Intel October 2023.
AMD EPYC 9554: 1-node, AMD platform with 2x 4th Gen AMD EPYC processor (64 cores), SMT On, Core Performance Boost On, NPS1, Total Memory 1024GB(16x64GB DDR5 4800), microcode 0xa10113e, 2x Ethernet Controller 10G X550T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, Ubuntu 22.04.3 LTS, 6.5.0-060500generic, ZSTD v1.5.5, gcc 10.4.0, RocksDB v8.3.0 trunk (commit 62fc15f) (db_bench), 4 threads per instance, 28 RocksDB instances, tested by Intel October 2023.
HammerDB MySQLIntel Xeon 8592+: 1-node, 2x INTEL(R) XEON(R) PLATINUM 8592+, 64 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 8 [0], DSA 8[0], IAX 8 [0], QAT 8 [0], Total Memory 1024GB (16x64GB DDR5 5600 MT/s [5600 MT/s]), BIOS 2.0, microcode 0x21000161, 2x Ethernet Controller X710 for
10GBASE-T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, 2x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, Ubuntu 22.04.3 LTS, 5.15.0-84-generic, HammerDB Mv4.4,
MySQL 8.0.33. Test by Intel as of 10/04/23.
AMD EPYC 9554: 1-node, 2x AMD EPYC 9554 64-Core Processor, 64 cores, HT On, Turbo On, NUMA 2, Integrated Accelerators Available [used]: DLB 0 [0], DSA 0[0], IAX 0 [0], QAT 0 [0], Total Memory 1536GB (24x64GB DDR5 4800 MT/s [4800 MT/s]), BIOS 1.5, microcode 0xa10113e, 2x Ethernet Controller X710 for
10GBASE-T, 1x 1.7T SAMSUNG MZQL21T9HCJR-00A07, 2x 1.7T SAMSUNG MZWLJ1T9HBJR-00007, Ubuntu 22.04.3 LTS, 5.15.125-0515125-generic, HammerDB
v4.4, MySQL 8.0.33. Test by Intel as of 10/05/23.
HammerDB Microsoft SQL Server + Backup
Intel Xeon 8592+: 1-node, 2x 5th Gen Intel Xeon Scalable processor 8592+ (64 cores) with integrated Intel Quick Assist Technology (Intel QAT), Number of IAA device
utilized=8(2 sockets active), HT On, Turbo On, SNC off, Total Memory 1024GB (16x64GB DDR5 5600), microcode 0x21000161, 2x Ethernet Controller 10-Gigabit
X540-AT2, 7x 3.5T INTEL SSDPE2KE032T807, QATZip 2.0.W.1.9.0-0008, Microsoft Windows Server Datacenter 2022, Microsoft SQL Server 2022, SQL ServerManagement Studio 19.0.1, HammerDB 4.5, tested by Intel October 2023.
AMD EPYC 9554: 1-node, AMD platform with 2x 4th Gen AMD EPYC processor (64 cores), SMT On, Core Performance Boost On, NPS1, Total Memory 1536GB(24x64GB DDR5 4800), microcode 0xa10113e, 2x Ethernet Controller 10G X550T, 7x 3.5T INTEL SSDPE2KE032T807, Microsoft Windows Server Datacenter 2022,
Microsoft SQL Server 2022, SQL Server Management Studio 19.0.1, HammerDB 4.5, tested by Intel October 2023.

Configurations
5th Gen Xeon Mainstream Workload Performance
SPDK 128K QD64 (large media files) / SPDK 16K QD256 (database requests)
Intel Xeon 8592+: 1-node, 2x 5th Gen Intel Xeon Scalable processor (64 core) with integrated Intel Data Streaming Accelerator (Intel DSA), DSA device utilized=1(1active socket), HT On, Turbo On, SNC Off, with 1024GB DDR5 memory (16x64 GB 5600), microcode 0x21000161, Ubuntu 22.04.3 LTS, 5.15.0-78-generic, 1x894.3G Micron 7450, 4x 3.84TB Samsung PM1733, 1x Intel® Ethernet Network Adapter E810-2CQDA2, 2x100GbE, FIO v3.34, SPDK 22.05, tested by Intel
October 2023.
AMD EPYC 9554: 1-node, AMD platform with 2x 4th Gen AMD EPYC processor (64 cores), SMT On, Core Performance Boost On, NPS2, Total Memory 1536GB(24x64GB DDR5 4800), microcode 0xa10113e, Ubuntu 22.04.3 LTS, 5.15.0-78-generic, 1x 1.7T Samsung PM9A3, 4x 3.84TB Samsung PM1733, 1x Intel® Ethernet
Network Adapter E810-2CQDA2, 2x100GbE, 1x Ethernet Connection X550T for 10GBASE-T, FIO v3.34, SPDK 22.05, tested by Intel October 2023.
LinpackIntel Xeon 8592+: 1-node 2x Intel Xeon 8592+, HT On, Turbo On, SNC2, 1024 GB DDR5-5600, ucode 0x21000161, Red Hat Enterprise Linux 8.7, 4.18.0425.10.1.el8_7.x86_64, HPL from MKL_v2022.1.0, cmkl:2023.2.0, icc:2023.2.0, impi:2021.10.0. . Test by Intel as of October 2023
AMD EPYC 9554: 1-node, 2x AMD EPYC 9554, SMT On, Turbo On, CTDP=360W, NPS=4, 1536GB DDR5-4800, ucode= 0xa101111, Red Hat Enterprise Linux 8.7,
Kernel 4.18, AMD official binary. Test by Intel as of March 2023
NAMD (Geomean of apoa1_npt_2fs, stmv_npt_2fs)
Intel Xeon 8592+: 1-node 2x Intel Xeon 8592+, HT On, Turbo On, SNC2, 1024 GB DDR5-5600, ucode 0x21000161, Red Hat Enterprise Linux 8.7, 4.18.0425.10.1.el8_7.x86_64, NAMD v2.15alpha, cmkl:2023.2.0 icc:2023.2.0 tbb:2021.10.0. Test by Intel as of October 2023.
AMD EPYC 9554: 1-node, 2x AMD EPYC 9554, SMT On, Turbo On, CTDP=360W, NPS=4, 1536GB DDR5-4800, ucode= 0xa101111, Red Hat Enterprise Linux 8.7,
Kernel 4.18, NAMD v2.15alpha, cmkl:2023.2.0 icc:2023.2.0 tbb:2021.10.0. Test by Intel as of March 2023.

Configurations
5th Gen Xeon Mainstream Workload Performance
LAMMPS (Geomean of Polyethylene,DPD,Copper, Liquid Crystal,Atomic Fluid,Protein, Stillinger-Weber,Tersoff, Water)Intel Xeon 8592+: 1-node 2x Intel Xeon 8592+, HT On, Turbo On, SNC2, 1024 GB DDR5-5600, ucode 0x21000161, Red Hat Enterprise Linux 8.7, 4.18.0425.10.1.el8_7.x86_64, LAMMPS v2021-09-29, cmkl:2023.2.0 icc:2023.2.0 tbb:2021.10.0, impi:2021.10.0. Test by Intel as of October 2023.
AMD EPYC 9554: 1-node, 2x AMD EPYC 9554, SMT On, Turbo On, CTDP=360W, NPS=4, 1536GB DDR5-4800, ucode= 0xa101111, Red Hat Enterprise Linux 8.7,
Kernel 4.18, LAMMPS v2021-09-29, cmkl:2023.2.0 icc:2023.2.0 tbb:2021.10.0, impi:2021.10.0. Test by Intel as of March 2023.
FSI Kernels (Geomean of Binomial Options, Monte Carlo, BlackScholes)
Binomial Options
Intel Xeon 8592+: 1-node 2x Intel Xeon 8592+, HT On, Turbo On, SNC2, 1024 GB DDR5-5600, ucode 0x21000161, Red Hat Enterprise Linux 8.7, 4.18.0425.10.1.el8_7.x86_64, Binomial Options v1.1, icc:2023.2.0 tbb:2021.10.0. Test by Intel as of October 2023.
AMD EPYC 9554: 1-node, 2x AMD EPYC 9554, SMT On, Turbo On, CTDP=360W, NPS=4, 1536GB DDR5-4800, ucode= 0xa101111, Red Hat Enterprise Linux 8.7,
Kernel 4.18, Binomial Options v1.1, icc:2023.2.0 tbb:2021.10.0. Test by Intel as of March 2023
Monte CarloIntel Xeon 8592+: 1-node 2x Intel Xeon 8592+, HT On, Turbo On, SNC2, 1024 GB DDR5-5600, ucode 0x21000161, Red Hat Enterprise Linux 8.7, 4.18.0425.10.1.el8_7.x86_64, Monte Carlo v1.2, cmkl:2023.2.0 icc:2023.2.0 tbb:2021.10.0. Test by Intel as of October 2023.
AMD EPYC 9554: 1-node, 2x AMD EPYC 9554, SMT On, Turbo On, CTDP=360W, NPS=4, 1536GB DDR5-4800, ucode= 0xa101111, Red Hat Enterprise Linux 8.7,
Kernel 4.18,Monte Carlo v1.2, cmkl:2023.2.0 icc:2023.2.0 tbb:2021.10.0. Test by Intel as of March 2023
BlackScholesIntel Xeon 8592+: 1-node 2x Intel Xeon 8592+, HT On, Turbo On, SNC2, 1024 GB DDR5-5600, ucode 0x21000161, Red Hat Enterprise Linux 8.7, 4.18.0425.10.1.el8_7.x86_64, Black Scholes v1.4, cmkl:2023.2.0 icc:2023.2.0 tbb:2021.10.0. Test by Intel as of October 2023.
AMD EPYC 9554: 1-node, 2x AMD EPYC 9554, SMT On, Turbo On, CTDP=360W, NPS=4, 1536GB DDR5-4800, ucode= 0xa101111, Red Hat Enterprise Linux 8.7,
Kernel 4.18, Black Scholes v1.4, cmkl:2023.2.0 icc:2023.2.0 tbb:2021.10.0. Test by Intel as of March 2023