AMD Instinct GPU and ROCm
Technical Overview
PC Cluster Consortium 2022

Greg Oakes
AMD Senior HPC and AI Specialist◢[AMD Official Use Only]

CAUTIONARY STATEMENT
This presentation contains forward-looking statements concerning Advanced Micro Devices, Inc. (AMD) such as the features, functionality,performance, availability, timing and expected benefits of AMD products and AMD product roadmaps, which are made pursuant to the Safe
Harbor provisions of the Private Securities Litigation Reform Act of 1995. Forward-looking statements are commonly identified by words
such as "would," "may," "expects," "believes," "plans," "intends," "projects" and other terms with similar meaning. Investors are cautionedthat the forward-looking statements in this presentation are based on current beliefs, assumptions and expectations, speak only as of thedate of this presentation and involve risks and uncertainties that could cause actual results to differ materially from current expectations.
Such statements are subject to certain known and unknown risks and uncertainties, many of which are difficult to predict and generally
beyond AMD's control, that could cause actual results and other future events to differ materially from those expressed in, or implied orprojected by, the forward-looking information and statements. Investors are urged to review in detail the risks and uncertainties in AMD’sSecurities and Exchange Commission filings, including but not limited to AMD’s most recent reports on Forms 10-K and 10-Q.

AMD does not assume, and hereby disclaims, any obligation to update forward-looking statements made in this presentation, except as
may be required by law.​2

AMD HPC Solutions◢[AMD Official Use Only]

Agenda▪
▪
▪

3

AMD Instinct GPU
AMD ROCm Software Development Environment
Q &A

AMD HPC Solutions

AMD Instinct™ CDNA2Accelerators

Using AI to Develop Drug Therapy

Simulating 50 Years into the Future

Genetic Analysis to Model Symptoms & Effects

Building Safe Fusion Reactor

1EF

AMD Accelerates
Performance Curve

750PF

500PF

250PF
Titan
17.6 PF2010

Tianhe-2A
33.9 PF2015

Summit148.6 PF

2020

2025
Today

7 [AMD Official Use Only]◢7

AMD HPC Solutions

◢[AMD Official Use Only]

8

AMD HPC Solutions

[AMD Official Use Only]

9[AMD Official Use Only]

10

[AMD Official Use Only]11◢[AMD Official Use Only]

12

AMD HPC Solutions*MI250X. RESULTS MAY VARY. SEE ENDNOTES: MI200-15A, MI200-16A, MI200-17A, MI200-19A, MI200-20A, MI200-21A, MI200-22A, MI200-23A, MI200-24A, MI200-25A, MI200-26A

Top HPC Applications Supported
Molecular Dynamics(Available Now)

Quantum Chemistry(Available soon)

NAMD

CP2K (Now)

LAMMPS

Quantum Espresso

GROMACS

NWChem

AMBER

VASP

Oil & Gas
(Available Now)
Reverse Time Migration
AMD has RTM sample code and inhouse experts to help optimize
customer codes

OpenMM
Quantum Physics(Available now)

Other HPC Domains(Available Now)

ChromaOpenFoam (Fluid Dynamics)

TensorFlow

MILC

SPECFEM3D (Geophysics)

PyTorch

GRID

Relion (Life Sciences)

ONNX-Runtime

ION (Weather)
14

Machine Learning(Available Now)

AMD ROCm – Open Source Software
Development Environment◢[AMD Official Use Only]

HPC
Frameworks
ML
Frameworks

Mgmt Tools

Kernel /RuntimeCompilersOpen
Libraries

AMD HPC Solutions

OperatingSystems

ISV Apps

Open APIs

16

DeploymentTools

Open-Source
Codes

DeveloperTools

[AMD Official Use Only]

Deployment Tools

Libraries

Compilers & Tools
Programmingmodels

Drivers/Runtimes

ROCm Validation Suite

ROCm Data Center Tool

ROCm SMI

BLAS

RAND

FFTMIGraphX

MIVisionXPRIM

SOLVER

ALUTIONSPARSE

THRUST

MIOpenRCCL

Compiler

Profiler

TracerDebugger

hipifyTENSILE

OpenMP® API

HIP API

OpenCL™

RedHat®, CentOS, SLES & Ubuntu® Device Drivers and Run-Time

CUDA® Comparable Math & Comm Libraries
CUDA Library

ROCm Library

Description

cuBLAS

rocBLAS

Basic Linear Algebra Subroutines

cuFFT

rocFFT

Fast Fourier Transfer Library

cuSPARSE

rocSPARSE

Sparse BLAS + SPMV

cuSolver

rocSolver

Lapack Library

AMG-X

rocALUTION

Sparse iterative solvers & preconditioners with Geometric & Algebraic MultiGridThrust

rocThrustC++ parallel algorithms library

CUBrocPRIM

Low Level Optimized Parallel Primitives

cuDNN

MIOpenDeep learning Solver Library

cuRAND

rocRAND

Random Number Generator Library

EIGEN

EIGEN

C++ template library for linear algebra: matrices, vectors, numerical solvers

NCCL

RCCL

Communications Primitives Library based on the MPI equivalents

USE OF THIRD PARTY MARKS / LOGOS/ PRODUCTS IS FOR INFORMATIONAL PURPOSESONLY AND NO ENDORSEMENT OF OR BY AMD IS INTENDED OR IMPLIED.

HIPOpen Programming Models

HIP (Heterogeneous Interface for Portability) is an interface that provides
similar functionality to CUDA API◢ A CUDA-like API that is open-source and portable◢ Runtimes for targeting computing on GPU or CPU available◢ Developers write once for both GPU or CPU◢ GPU runtime included in ROCm™; CPU runtime available on GitHub

Supported By ROCmTM
Software Platform

OpenMP
OpenMP 5.0, an interface that supports both CPU or GPU shared-memory
multiprocessing programming◢ Compiles C/C++ code with OpenMP “target” pragmas◢ Open-source compiler implementation◢ Links with libomptarget to produce a binary that can offload work to the GPU◢ GPU runtime included in ROCm; CPU compiler & runtime available
separately

CODE CONVERSIONTOOLS

Hipify-perl

EXTEND YOUR APPLICATION
PLATFORM SUPPORT BY
CONVERTING CUDA® CODE

Hipify-clang

SINGLE SOURCE
MAINTAIN PORTABILITY
MAINTAIN PERFORMANCE

Easiest to use; point at a directory and it will hipify CUDA code
◢ Very simple string replacement technique; may require manual postprocessing◢ Recommended for quick scans of projects◢

More robust translation of the code
◢ Generates warnings and assistance for additional analysis◢ High quality translation, particularly for cases where the user isfamiliar with the make system◢

gpuFORT◢

Conversion tool to translate directive-based code to direct kernel
programing source code – early release available on github◢

Fortran + OpenACC and CUDA Fortran convert to:◢ Fortran + [GCC/AOMP OpenACC/MP runtime calls] + HIP C++◢ Fortran + OpenMP 4.5+

HIP: High-Performance, Open, and Portable“ Altair AcuSolve CFD, built on a modern framework for GPU

CUDA

computing, was ported in less than a month to the open-source
AMD ROCm platform using an AMD Radeon Pro VII and easily
migrated to a server running the new AMD Instinct™ MI100,
delivering a big boost in performance.

HIP Conversion

Portable HIP C++(Host & Device Code)Yi Chen”

Senior Development Manager, Altair AcuSolve#include “hip_runtime.h”

nvcc

hipcc

c/c++
compiler

NvidiaGPUAMDGPU

x86
CPU“ On the Nvidia systems, the performance of the HIP and CUDA
kernels are nearly identical, indicating there are no
performance losses from the ‘hipification’ process.

”

HIP Performance Comparisons: AMD and Nvidia GPUs
https://journal.fluidnumerics.com/hip-performance-comparisons-amd-and-nvidia-gpus

GPUFORT is a Source-to-Source Conversion Tool(for Existing FORTRAN Codes)
Conversion tool to translate directive-based code to direct kernel programing source code:
Fortran+OpenACC and CUDA Fortran -> Fortran + [GCC/AOMP OpenACC/MP runtime calls] + HIP C++
Fortran+OpenACC and CUDA Fortran -> Fortran + OpenMP 4.5+

ROCm Software Platform

[AMD Official Use Only]

SourceContainer

PIP Wheel

TensorFlow GitHub

Infinity Hubpypi.org

PyTorch GitHub

Infinity Hubpytorch.org

ONNX-RT GitHub

Docker Instructions

onnxruntime.ai

JAX

GitHub public fork

Docker Hub

Est 2022

DeepSpeed

Planned Q4-2021

Docker Hub

Est 2022

CuPycupy.dev

Docker Hubcupy.dev
TensorFlow, the TensorFlow logo and any related marks are trademarks of Google Inc.
PyTorch, the PyTorch logo and any related marks are trademarks of Facebook, Inc.

◢[AMD Official Use Only]

Focused on Targeted ML Use-Cases
Most common models on HuggingFace supported on AMD platform today

VIDEO & IMAGE RECOGNITIONLANGUAGE PROCESSING

RECOMMENDATION ENGINEOptimized Models

Optimized Models

Optimized Models

Resnet, VGG, Inception
GoogleNet, ResNext, Detectron2,RetinaNet, Mask R-CNN

GNMT, BERT, GPT-2,BART, DeBERTa,DistilBERT, RoBERTa, T5

DLRM

Markets
Markets
Automotive/Self Driving Cars
Healthcare/Medical Imaging
Public Safety

24

AMD HPC Solutions

Markets

Web Services/E-commerce
SaaS

Customer Service
Web Services/E-Commerce

USE OF THIRD PARTY MARKS / LOGOS/ PRODUCTS IS FOR INFORMATIONAL PURPOSESONLY AND NO ENDORSEMENT OF OR BY AMD IS INTENDED OR IMPLIED.

◢[AMD Official Use Only]

ROCm™ Accelerating Science & Discovery“One of the benefits of converting
to HIP is that unlike previous
CUDA versions of code that could
only run on Nvidia GPUs, thesame source code is now
portable between GPUs.

“At every step of the way, we wereable to say that there is a significant
increase in performance. A simulationthat took two months on the previous
Summit system might take less than
two weeks on Frontier…”“my simulation code runs twice as
fast. That means that I can run higher
resolution simulations. Having
access to this exascale machine isa game changer for the kinds ofproblems that we can simulate..”Daniel Jacobson, Computational Systems
Biologist, ORNL

Sunita Chandrasekaran, Asst Professor of Computer& Information Sciences at the University of Delaware

Evan Schneider, Asst Professor of Physics andAstronomy at the University of Pittsburgh

LINK

LINK

LINK
25

AMD HPC Solutions

◢[AMD Official Use Only]

26

•

•

•

•

•

•

AMD HPC Solutions

◢[AMD Official Use Only]

LLVM based•••27

C/C+ and Fortran languages
HIP and OpenMP offload
Compile CPU & GPU codewith one tool

AMD HPC Solutions•••

rocGDB for CPU and GPUDebug source level code for
HIP and OpenMP
GDB-enabled GUI integration•

rocProf API and CLI with
JSON output•

3rd party integrations underway(HPCToolKit, TAU, Vampir, ScoreP, ARM Forge, Likwid)◢[AMD Official Use Only]

MI200 Support•

HPC Apps: CHROMA, CP2K, GRID, GROMACS, HACC,LAMMPS, MILC, NAMD 3.0, OpenMM, Relion, SPECFEM3D(Cartesian), SPECFEM3D (Globe)•

Benchmarks: HPL, NBODY

Additional MI200 Support Planned for 1H22•

HPC Apps: AMBER*, ICON, MPAS, NWCHEM, OpenFOAM,PYFR, QuantumEspresso, WRF, NEMO•Benchmarks: MLPerf (SSD, Resnet50, Transformer), HPCG

Performance Results for Select Apps / Benchmarks
https://www.amd.com/en/graphics/server-acceleratorsbenchmarks
28

AMD HPC Solutions* Available on InfinityHub with MI100 support today◢[AMD Official Use Only]

ROCm™ Learning Center
Curated videos, webinars, labs and tutorials fordevelopers to learn how to use ROCm
developer.amd.com/resources/rocm-learning-center

AMD Accelerator Cloud
Remote access for customers and partners to test code
and applications on the latest AMD GPUs

29

AMD HPC Solutions

◢[AMD Official Use Only]

JAX30AMD HPC Solutions|DEEPSPEED|CUPY

TensorFlow, the TensorFlow logo and any related marks are trademarks of Google Inc.
PyTorch, the PyTorch logo and any related marks are trademarks of Facebook, Inc.

AMD GPU and ROCm Resources◢[AMD Official Use Only]

AMD Instinct MI200 GPU and ROCm
References
MI200 Product Video:
https://youtu.be/Bm2r4Z7qlcs
MI200 Brochure:https://www.amd.com/system/files/documents/amd-instinct-mi200-datasheet.pdf
CDNA 2 Whitepaper:https://www.amd.com/system/files/documents/amd-cdna2-white-paper.pdf

LAMMPS Combustion Simulation Video: https://youtu.be/zEKooI1UXYAAMD Infinity Hub: https://www.amd.com/en/technologies/infinity-hub
AMD MI250x OAM for Exascale: https://www.amd.com/en/products/server-accelerators/instinct-mi250
AMD MI250 OAM: AMD Instinct™ MI250 Accelerator | AMD32

AMD HPC Solutions

◢[AMD Official Use Only]

AMD HPC and AI Resources
AMD Infinity Hub: ROCm™ containers, learning center(AMD.com/InfinityHub)
AMD Developer Hub: Spack recipes, compiler, math libraries, µProf, andadditional resources (developer.amd.com)
AMD Tech Docs and Whitepapers
HPC Tuning Guide for AMD EPYC™ 7003 Series Processor

AMD Covid-19 HPC FundAMD Energy Efficiency goals for HPC and AI
AMD Instinct™ Education & Research Initiative

End user community forum driven by users for users

AMD Instinct™ Benchmarks | AMD33

AMD HPC Solutions▪

[AMD Official Use Only]