DDN – UPDATE for 20202019/12/12 @ PCCC19

DataDirect Networks Japan, Inc.
橋爪信明
nhashizume@ddn.com

At Scale Data Servicesfor AI, Big Data andHPC

Unlimited Performance foryour most DemandingWorkloads

Optimized AI Platforms For
Every Use CaseAT SCALE
ENTERPRISE

BYDDN

High Performance Flash &Hybrid Unified Storage

DDN Storage | © 2019 DDN Storage

SW Defined Storage forTelco 5G, IoT and theEnterprise

Simplicity and Control for
Virtualized Environments

DDN EXA5
EXASclaer 5.0

DDN Storage | © 2019 DDN Storage

DDN EXA5 X-APPLIANCES

ES200NVX

ES400NVX

ES7990X

ES18KX

24r/20w
1.5M IOPS

48r/30w>3M IOPS

24r/20w
800K IOPS

70r/70w>3M IOPSUP TO 24 DRIVESUP TO 384 DRIVESUP TO 450 DRIVESUP TO 1872 DRIVES+0 +1 +2 +4+0 +1, +2, +4+0 +5, +6, +8, +10, +16, +20

ALL NVMEDDN Storage | © 2019 DDN Storage

HYBRID

4

The Intelligent, Optimized
Environment for AI andHPC►►Deep Optimizations for both AI and HPC delivers
for the highest efficiencies and the rightcapabilities
Your data in the right place at the right time

S3User & Service Management

Data ManagementMulti-TenantedSecurity

Transparent Tiering

Optimizations
AIAIOptimizations
Security
Security

Preprocess

Classify

GPUGPUManageNFS SMB HDFS

NetworkNetwork

Train

Tune

HPC
Optimizations
HPC
Optimizations
ProtocolProtocolConcurrency

NetworkProtocol

Infer
Multi-Physics

DDN Storage | © 2019 DDN Storage

I/O Pattern

Supercomputing

Workflows

AMR

Checkpoint

Group A

Group B

Group CEnd to end Data Protection

Advanced Security and Data
Safety for a Distributed at
Scale World

Encryption►►►►►

Rogue clients, VMs and containers cannot gain root on filesystem
Secure Shared Key or Kerberized Auth. of Clients/Containers
Multi-Tenancy exports only specific datasets to users
Secure Audit Logging
Data at Rest Encryption for Drives and NVMe*

AUDIT*NVMe SED available Q1 2020

DDN Storage | © 2019 DDN Storage

EXA5 Stratagem Data Management Architecture

2019
Stratagem
Services

Hot
Pools

AutoPurge

2020
SearchFileSync

CloudSync

Snapshot

NodeLocal…

Parallel Actions

Stratagem Policy Engine
State of jobs kept
here with some
metadata aroundstratagem state andhistory

Stratagem
State

DDN Storage | © 2019 DDN Storage

Stratagem Scanning Engine
Parallel scanning

Changelogs

RESTand UIMGMTEXA5 HOT POOLS: At Scale Transparent Tiering
Incoming Application IO► Hot Pools V1 actively migrates old, leastaccessed files from flash tier to HDD tier
► API provided for use cases with externallydriven data movement (e.g. schedulerdirectives)► Hot Pools V2 adds capability for also
promoting hot objects in the HDD pool
into SSD pool
► Hot Pools uses Stratagem File Scanning &File Level Replication

DDN Storage | © 2019 DDN Storage

HOT POOL(ALL FLASH)
Auto migrate toHDD pool by LRU

Mirror to Hot Pool by API(job/request/policy) (V2)HDD POOLEXA5 S3 Data Services► Highly Available Scale-Out S3 Data Services With Single
S3/File Namespace► Initial v1 Release Requires at least 2 External Data Services
Nodes (min 32GB RAM, 8 Core (TBD))► Data stored via the S3 API shall be stored on EXAScaler as
files in the file system.
• V1: PUT/GET through S3 and read-only through EXAScaler Fileinterface.
• V2: adds write capability through EXAScaler as Files so that files areaccessible as S3 objects

EXAScaler Clients

Ethernet or
Infiniband

S3 Clients

Ethernet► Files located in EXA at“/s3_content/<bucket>/<filename>…"► S3 object metadata shall be written into EXAScaler as
extended attributes so that they are searchable throughfilesystem tools.
► Management REST API for system admin

DDN Storage | © 2019 DDN Storage

S3 DataServices Nodes
EXAScaler

DDN A3I
Accelerated, Any-Scale AI

DDN Storage | © 2019 DDN Storage

DDN A3I X-APPLIANCES
NEXT GENERATION AI DATA PLATFORMS

24r/20w
800K IOPS
32/64/128/256 TB

48r/32w
1.5M IOPS
32/64/128/256 TB

24r/20w
800K IOPS
1/2/4 PB

HDR100/EDR IB OR 100GbE • FULLY INTEGRATED AND OPTIMIZED FOR AI AND DL • VALIDATED UP TO 96 NVIDIA DGX-2s!

DDN Storage | © 2019 DDN Storage

11NVIDIA IS THE
LAUNCH CUSTOMERNVIDIA IS THE
LAUNCH CUSTOMER
10 APPLIANCES

4 HOURS TO DEPLOY
400 GB/s RD, 310 GB/s WR
40 AI400X IN 2020 – 15 PB ALL

NVME
JOINT IO500 SUBMISSIONSDDN A3I SOLUTIONS
Magnum IO (GPUDIRECT TO STORAGE)

DDN Storage | © 2019 DDN Storage

GPUDirectRAMTodayCPU

PCIe SW

PCIe SW

NetworkGPU

Bounce BufferCPUGPUPCIeNetworkRAM• EXAScaler Integration with GPUDirect* enables
Direct Memory Access from EXAScaler to GPUmemory• 2x-8x higher BW data transfers between Storageand GPU.
• 3.8x lower latency with no faulting and bouncebuffers• Stable and flat latencies as GPU concurrency
increases.
• Lower consumption of host CPU or memory
subsystem• The GPU is the computing element with thehighest IO bandwidth, e.g. 215 GB/s vs. theCPU’s 50 GB/s.
• Very fast access to petabytes of remote storage
faster than even the page cache in CPU memory.

GPUDirect

14

A3I WITH GPUDIRECTDOUBLE NVIDIA DGX-2 THROUGHPUT!
80 GB/s per client,20 X performance gains
Native client integration with EXA5, fullytransparent to users and applications
Enables a direct path to transfer data
between GPU memory and data storage
Eliminates unnecessary memory copies,lowers CPU overhead, reduces latency,
bypasses hardware architecture limitations
Improves AI, DL, HPC application
performance

DDN Storage | © 2019 DDN Storage

GPU READ THROUGHPUT WITH
AI400
80 GB/s
70 GB/s
60 GB/s
50 GB/s
40 GB/s
30 GB/s
20 GB/s
10 GB/s
0 GB/sNO GPUDirect

WITH GPUDirect®

5 DGX-2
10 AI400
400 GB/s

GPU READ THROUGHPUT SCALING WITHTEN AI400s
400 GB/s
350 GB/s
300 GB/s
250 GB/s
200 GB/s
150 GB/s

EXA5 GPUDirect integration delivers
up to 80 GB/s of throughput per DGX-2Enables a direct path to transfer data
between GPU memory and data storage
Performance scales linearly and provides
maximum at-scale application acceleration

DDN| ©2019
Networks,Inc.
DDNStorage
Storage| ©DataDirect
2019 DDNStorage

100 GB/s
50 GB/s
0 GB/s1 DGX-2

2 DGX-2

3 DGX-2

4 DGX-2

5 DGX-2

DDN DELIVERS LINEAR PERFORMANCE SCALINGDDN A3I SOLUTIONS – NVIDIA SUPERPOD REFERENCE
ARCHITECTURE• AI400 + DGX-2 SuperPOD at-scale testing andvalidation published by NVIDIA:► The AI400 All-flash appliance delivers incredible
sequential and random read performance, as
required by the heaviest DL workloads.
►►

Metadata performance scales well from 1 to 96
nodes, with no degradation as the number ofnodes and threads increases.

The AI400 is a fully-integrated platform that’seasy to deploy. DDN provides excellent
technical deployment and support services.

• RA document available from NVIDIA website►

https://www.nvidia.com/content/dam/enzz/solutions/data-center/documents/nvpodsuperpod-ddn-ra09734001.pdf

DDN Storage | © 2019 DDN Storage

NVIDIA DGX-2 SUPERPODREFERENCE ARCHITECTURE

Thank You!
Keep in touch with us

Team-JPSales@ddn.com

Tokyu Bancho Bldg. 8F
6-2 Yonbancho Chiyoda-ku,
Tokyo 102-0081@ddn_limitless+81-3-3261-9101+81-3-3261-9140

company/datadirect-networks

DDN Storage | © 2019 DDN Storage