GPUコンピューティング最新情報
エヌビディア合同会社
エンタープライズソリューションプロダクト事業部
平野 幸彦

Data Center Infrastructure
System Solutions

Communication

InfrastructureManagement

Development
Programming
Languages

Development
Tools

SoftwareSolutions/GPUAccelerators

Interconnect

SystemManagement

CompilerSolutions

Profile andDebug

Libraries

GPU Boost…

GPU Direct
NVLink
…

NVML
…

LLVM
…

CUDA Debugging API…

cuBLAS…

Tesla Accelerated Computing Platform

Tesla: Platform with Open Ecosystem
Common Programming Models Across Multiple CPUs

Libraries

AmgX
cuBLAS

Compiler
Directives
Programming
Languages

x86/

TESLA K80
ビッグデータ解析と科学技術計算のための世界最速のアクセラレータ

2x FasterDual-GPU
Accelerator for
Max Throughput

Double the Memory

2.9 TF| 4992 Cores | 480 GB/s

Designed for Big Data Apps

Deep Learning: Caffe

24GB

25x
20x

Maximum Performance

Dynamically Maximize
Performance for Every Application

K40
12GB

15x
10x

Oil &Gas

5x

Data
Analytics

0x
CPUHPCViz

Tesla K40 Tesla K80

Caffe Benchmark: AlexNet training throughput based on 20 iterations, CPU: E5-2697v2 @ 2.70GHz. 64GB System Memory, CentOS 6.2

4

Performance Lead Continues to Grow
Peak Double Precision FLOPS

Peak Memory Bandwidth

GFLOPS

GB/s

3500600

K80

3000

K80500

2500

400

2000

K40

1500

K40300K20

M2090

200
1000

M1060

M2090

500

M1060

Westmere

K20

HaswellIvy Bridge
Sandy Bridge

100

Westmere

Haswell
Sandy Bridge Ivy Bridge

002008

20092010

2011

NVIDIA GPU2012

2013

2014

200820092010

2011

NVIDIA GPUx86 CPU2012

2013

2014

x86 CPU

510x Faster than CPU on Applications
15xK80CPU

10x5x0xBenchmarks

Molecular Dynamics

Quantum ChemistryCPU: 12 cores, E5-2697v2 @ 2.70GHz. 64GB System Memory, CentOS 6.2
GPU: Single Tesla K80, Boost enabled

Physics

6Tesla K80: Up to 2x Faster than K10 and K40
2.0xK80

K10

2.0x

1.8x

1.8x

1.6x1.6x

1.4x

1.4x

1.2x

1.2x

1.0x

1.0x

Seismic

Machine Learning

CFDK80

MolecularDynamics

K40

Quantum
Chemistry

Finance

Single K10 or K80, Boost enabled for K80. Actual boost level dependent on application profile.
RTM ISO R4 2x, RTM TTI R8 3 pass

Physics

7

High GPU Density Servers Now Mainstream

Cray CS-Storm
8 K80s per Node

Dell C4130
4 K80s per Node

HP SL270
8 K80s per Node

Quanta S2BV
4 K80s per Node8

CSCS Piz Daint

The World’s Largest In-situ Viz Enabled GPUSupercomputer
2048 GPU Nodes running Galaxyformation and Molecular Dynamics
Simulation + Visualization

Watch live at NVIDIA SC14 Booth

9Visualize Data Instantly for Faster Science
CPU Supercomputer

Viz Cluster

Simulation- 1 Week

Viz- 1 Day

Traditional
Slower Time to Discovery

Time to Discovery =Months

Multiple Iterations

GPU-Accelerated Supercomputer

Tesla Platform
Faster Time to Discovery

Visualize while
you simulate

Restart Simulation Instantly
Multiple Iterations

Time to Discovery = Weeks

10

US to Build Two Flagship Supercomputers

SUMMIT

SIERRA

150-300 PFLOPS
Peak Performance> 100 PFLOPS
Peak Performance

IBM POWER9 CPU + NVIDIA Volta GPU
NVLink High Speed Interconnect>40 TFLOPS per Node, >3,400 Nodes
2017

Major Step Forward on the Path to Exascale
11

Just 4 nodes in Summit

would make the Top500 list ofsupercomputers today

Similar Power as Titan
5-10x Faster1/5th the Size

150 PF = 3M Laptops

One laptop for Every Resident inState of Mississippi

12Accelerated Computing
5x Higher Energy Efficiency

IBM POWER CPU

NVIDIA NVLink

Most Powerful Serial Processor

NVIDIA Volta GPU

Fastest CPU-GPU Interconnect

Most Powerful Parallel Processor

GPU ロードマップ
Pascal20

統合メモリー
3次元メモリー
NVLink1816

SGEMM / W Normalized

14Maxwell12

DirectX 12108Kepler

ダイナミック並列処理

64Fermi2

倍精度浮動小数点演算

Tesla
CUDA02008

2010

2012

2014

2016

PASCAL

PCIe 3.0 の5倍から12倍

NVLink3次元メモリー 2倍から4倍のメモリバンド幅とサイズモジュール

PCIe カードの3分の1のサイズ

KEPLER GPU

PASCAL GPU
NVLinkNVLinkPOWER CPU

High-speed GPU
Interconnect

NVLinkPCIePCIe

X86 ARM64
POWER CPU

X86 ARM64
POWER CPU2014

2016
16

NVLink Unleashes Multi-GPU Performance
Over 2x Application Performance Speedup

GPUs Interconnected with NVLink

When Next-Gen GPUs Connect via NVLink Versus PCIe
Speedup vsPCIe based Server
2.25x

CPU2.00x
PCIe Switch

1.75x

TESLA
GPU

TESLAGPU
5x Faster than
PCIe Gen3 x16

1.50x

1.25x

1.00x
ANSYS Fluent

Multi-GPU Sort

LQCD QUDAAMBER

3D FFT17

17 configuration
3D FFT, ANSYS: 2 GPU configuration, All other apps comparing 4 GPU
AMBER Cellulose (256x128x128), FFT problem size (256^3)

GPU Technology Theater
Ian Buck with Oak Ridge and Livermore

www.nvidia.com/sc1418

US DoE Supercomputers Built on Tesla Platform
Data Center Infrastructure
System Solutions

Communication

InfrastructureManagement

Development
Programming
Languages

Development
Tools

SoftwareSolutions/GPU
Accelerators

Interconnect

SystemManagement

Compiler
Solutions

Profile andDebugLibraries

GPU Boost…

GPU Direct
NVLink
…

NVML
…

LLVM
…

CUDA Debugging API…

cuBLAS…

Tesla Accelerated Computing Platform
25

YOUR PLATFORM FOR DISCOVERY
Tesla Accelerated Computing