Arm HPC Solutions andBeyond

Brent Gorda, Senior HPC Executive, Arm

Arm HPC Platform Workshop @ PCCC| August 26th , 2021
Confidential © 2021 Arm

Extreme Scale Compute System Design Objectives
CPU Per-CorePerformance

Performance
Efficiency

Memory Bandwidth& IO Flexibility
2© 2021 Arm Limited

TechnicalSovereignty

Arm Is the Driving Force Behind Innovation for HPC and AI

NVIDIA GRACESIPEARL RHEAMEITY SOCETRI K-AB21
ARM NEOVERSE V-SERIES CORES
SPECIALIZED PROCESSORSARM SCALABLE VECTOR EXTENSION (SVE)
HIGH BANDWIDTH MEMORY© 2021 Arm Confidential

FUJITSU A64FXCloudData Centers

5GEdgeCritical Data

Massive Amounts of Data
Edge

EdgezzCORTEXHPC© 2019 Arm Limited

4© 2021 Arm Limited

New infrastructure for support of 1T Arm devices… will be designed from the edge inCloud
datacenter
Virtualized
provideredge

Corenetwork
V2X

The New
Infrastructure will Be
Designed from theEdge in5© 2021 Arm Limited

Virtualized
customerpremiseIoT
gateways

1 Trillion
Autonomous
Machine & Smart
Devices

BTS

WiFi
Small cell

Cloud Native Software Development on Arm

7100s of OSS Projects
Native Build

Performance
Scalable Neoverse CPU Cores

100+ ISVsCommercial Support

Efficiency
Best $/throughput in the industry

100K+Docker Hub Images

Platform Diversity
Widest possible choice of Edge Platforms

1M+CI/CD Build Minutes
per MonthOptimization
Purpose built use cases

Confidential © 2021 Arm Limited

AWS Graviton2 is Quickly Expanding its EC2 Footprint
Steady growth and regional expansion since mid-2020
2020 AWS Instance Type Additions

Graviton49%

Vendor A
35%

Vendor B
16%

49% of AWS EC2 instance additions in 2020are based on AWS Graviton2AWS Graviton2 Customer Adoption

X2gd

R6g

C6g

NEW+ R6gd+ C6gd, C6gn
Source: Liftr Insights

8Confidential © 2021 Arm Limited

T4g

M6g+ M6gd

Securely scaling ML application across heterogenous HW
Edge

Aggregation
Centers

HPC Datacenter

App: Traffic detection
App: Traffic detection
App:App:
Traffic
detection
Smart
Cities
Arm runtime
Sensors
Arm runtime
Vendor providers
abstraction
Armruntime
Vendor providers
abstraction
Arm runtime
Vendor providers abstraction
Vendor provider abstraction
Arm IP
Arm IP
Arm IP
Arm IP / GPU / Accel

App: Digital Twin,
Data-Analytics, &Training
Metro:
Metro:Aggregation
Aggregation
Metro: Aggregation
ArmArmruntime
runtime& Distributed
Training

Arm runtime
NetworkVendor provider abstraction

Multi-tenant
Arm IP / DPU / GPUs

9Confidential © 2021 Arm LimitedVendor providers abstraction
Vendor providers abstraction

Arm runtime
ArmIP
ArmVendor
IP/ /A
A&&R-classR-class
providerabstraction
Arm IP / DPU

Network
App: Satellite/Treffic
App: Satellite/Treffic
App: Satellite/Treffic
Armruntime
App:Autonomous
Armruntime
Vendor providers
abstraction
Arm runtime
Vendor providers
abstraction
Arm runtime
Vendor providers abstraction
Vendor provider abstraction
Arm IPArm IP
Arm IP
Arm IP / GPUsSensors
LIDAR
SoftwareDefinedRadios
Hyperspectral
Imaging

AI @ Edge
PowerfulParallel Edge
Computing

Edge computing and deep learningwith feedback for continuous
improvement

Facilities

HPC
Reduced, Compressed data

Actuators

New inference (model)
Adaptive steering

ServosDynamic
adaptation

Artificial Intelligence
Deep Learning Inference
Lightweight Training

Deep Learning Training
Simulation / Forecast

SAGE Partner Instruments

HPWREN/WIFIRE:
Regional
Environmental
Conditions and Events.

AoT: Neighborhood scaleurban environment and activity.

HPWREN

NEON: Continental scaleecology and environment.

Closing Remarks• Arm brings mature SW stack (community driven) and competitive HW (licensees)• Arm’s business model empowers customers to design solutions for their markets• The A64FX is designed by Fujitsu to focus on RIKEN applications• Takes advantage of the software ecosystem (redhat, gnu, etc) from the community• Graviton2 & Ampere Altra leverage Arm IP: quick-to-market solutions that compete (+ use software)• Arm has a very healthy roadmap and will continue to create ISA and IP solutions for thedata center. Indeed growth in the hyperscalar market is a significant part of our future• Arm is growing into cloud & hpc, from the device where we enjoy a healthy business• The need of hyperscalers to innovate provides ever-more powerful Arm options forHPC• We continue to invest in software in collaboration with the community• A-HUG.org is the HPC community
12© 2021 Arm Limited

The Cloud to Edge Infrastructure Foundation
for a World of 1T Intelligent Devices

Thank You!