第15回PCクラスタシンポジウム
ストレージ製品とデータ・ソリューションのご紹介
クレイ・ジャパン・インク

Safe Harbor Statement

This presentation may contain forward-looking statements that are
based on our current expectations. Forward looking statements may
include statements about our financial guidance and expected operating
results, our opportunities and future potential, our product development
and new product introduction plans, our ability to expand and penetrate
our addressable markets and other statements that are not historicalfacts. These statements are only predictions and actual results may
materially vary from those projected. Please refer to Cray's documentsfiled with the SEC from time to time concerning factors that could affect
the Company and these forward-looking statements.

第15回PCクラスタシンポジウム

2第15回PCクラスタシンポジウム

Computation
XC40システム
CS400システム

Analytics
Urika-XA
Urika-GD

Storage & Data Management

Big Data

Supercomputing

クレイ・アダプティブ・スーパーコンピューティング

3

Innovation
Cray 1
Los Alamos

Red Storm
DMI

NCAR

1972

1976-77

Cray YMP

Cray toSGI

1988

1996-2K

2004

2007

Cielo

NCSA Blue Trinity
iVEC / Waters
PGS
Pawsey2011-122013

Lustre

2014

2015

2016

Cray Sonexion

Cray DVS & Cray DataWarp

The Cray DataWarp technology in the Trinity
system will provide the first multi-petabyte
multi-terabyte/sec IO burst handlingcapability, ever.
--Gary Grider, HPC Division Leader, LANL
第15回PCクラスタシンポジウム

2012
4

Storage Trends
Convergence of Supercomputing and Big DataComputing Memory and Storage Trends
Current Model

Future Model

CPUCPU

Near Memory(HBM/HMC)

Memory(DRAM)

Far Memory(DRAM/NVDIMM)

Parallel Storage(HDD)

Near Storage(Flash)Archive Storage(HDD & Tape)

Parallel Storage(HDD)

On NodeOn Node

Off Node (External)

Off Node (Internal/HSN)

Off Node (External)
Archive Storage(HDD & Tape)

第15回PCクラスタシンポジウム

6Sonexion Tier:• Fast throughput• Fully parallel access• True scalability

Hours
第15回PCクラスタシンポジウム

Days

Cray TAS Connector

Weeks

TAS Tier:• Best cost efficiency• Data fully accessible• Extensive scalability

MonthsCapacity (PB)

Throughput (GB/sec)

Cray Storage Solutions - Span Data Lifecycle

Years
7

Cray Storage Offerings

High Performance Storage

I/O Acceleration•••

Pure performance
Breakthrough efficiencies
Balanced and cohesive design

第15回PCクラスタシンポジウム•••

Efficiently scale
Innovate fasterBe confident

Efficient Long-term Storage•••

Protect and store
Access data forever
Easily sustain long-term storage
8Summary – Optimized End-to-End StorageSolutions
End-to-End Optimization

Parallel File
Systems
Leadership

Scalable
NetworkingExperts

Aries, InfiniBand, 40GbE
Best in Class
Storage Systems

Performance Optimization

Cray System Architectures

Application I/O
Optimization

DataWarp, Sonexion, TAS
第15回PCクラスタシンポジウム

9High Performance Flash Storage &I/O Acceleration

第15回PCクラスタシンポジウム

Cray DataWarp™
Flash Storage IO Acceleration System for Cray XC40Performance• Scales from 70 thousand to 40 million
IOPS• Accommodate wide range of workloads

Efficiencies• 5x the performance of disk - same cost
• Offloads I/O intensive workloads

Cohesive• Flexible usage models• Automated workflows

Bridges the performance gap between compute and storage
第15回PCクラスタシンポジウム

11DataWarp Benefits
Spikesdrive up
cost ofstorage● DataWarp absorbs spikes● Reduces size of underlying PFS● Provision PFS for sustained

performance instead of peak
● Accommodates range ofapplications● Improves efficiency
DataWarp
absorbs
spikes &reduces
size ofPFS
第15回PCクラスタシンポジウム● Flash tier: 3-5x the performanceof disk at the same cost
● Machine efficiency improved● Better use of compute resources
12

Use Case: Local Storage on DemandPer Node Scratch• Each compute node in a job isassigned a private part of theallocated SSD space• Much faster than “faking it” with aparallel file system/tmp /tmp /tmp

Per Node Swap Space• Dynamic compute node swap space
第15回PCクラスタシンポジウム

13Use Case: Shared Fast /ssd
Shared Fast Scratch• High Bandwidth access toshared files• Files can be striped acrossmultiple DataWarp Nodes• Space can be temporary for thejob, or be marked as persistent
to work between jobs
第15回PCクラスタシンポジウム

/ssd

14

Use Case: Checkpoint / Restart
Fast Checkpoint / Restart• User asks for enough SSD to cover
the number of concurrently resident
checkpoints• High Bandwidth checkpoints arewritten to SSDs
• Followed by an asynchronous explicit
or transparent copy out to rotatingstorage
第15回PCクラスタシンポジウム

BurstSSD

15

Automated Coordination Across Storage Tiers

Automated Policies

Scheduler Directives

Cray HPC

Cray Sonexion Storage

Cray TAS

DataWarp

Lustre Parallel File System

Archive Storage

Data

Data

Loosely Coupled

Tightly Coupled

HDD Pool

Tape PoolPersistent Namespace

第15回PCクラスタシンポジウム

16

High Performance Primary Storage

第15回PCクラスタシンポジウム

Cray Sonexion™
Efficient, proven, scale-out Lustre system for any Linux HPC environment

Innovate
FasterScale
EfficientlyBe Confident• Deploy faster• Achieve results faster• Sustained performance over 1 TB/s
• 25% fewer components• Over 3 PBs usable in one 42U rack

• Proven Cray architectures• Single point of support

Optimize performance and capacity at maximum density
第15回PCクラスタシンポジウム

18Efficiency Comparison – 1TB/s Example
DeploymentComparison

Modular Storage withExternal Servers

Cray Sonexion(NCSA Blue Waters)

Monolithic Storage
with External Servers

CapacityBandwidth
LNET routers
Storage units
Hard drives
Externalservers
Director IBswitches
IB cables
Racks
Cost

22 PBytes
1 TByte/sec.
942
472
28,32022 PBytes
1 TByte/sec.
482
180
15,12032 PBytes
1 TByte/sec.
440
360
20,160

942

0294

60

2

5,468
94
$$$

482
30$

1512
40$

第15回PCクラスタシンポジウム

19Simplify Management

第15回PCクラスタシンポジウム

20Tiered Data Management

第15回PCクラスタシンポジウム

Cray Tiered Adaptive Storage (TAS)
Protect and access your high-value data when you need it, for as long as you need itProtect• Preserve assets efficiently• Transparently migrate dataAccess• Continuously accessible• Flexible access models
Powered BySustain• Break vendor lock-in• Multigenerational data preservation

Efficient storage management with tiers
第15回PCクラスタシンポジウム

22Traditional HSM for HPC – Complex
Data Ingest

fs1

fs2

fs3
QDR
FDR
FC
Ethernet

第15回PCクラスタシンポジウム

DM

HSM

Archive
Media

DM

HSM

Archive
Media

DM

HSM

ArchiveMedia

Ethernet

IB Fabric

Disk Cache

DM

HSM

Archive
MediaDM

HSM

Archive
MediaDM

HSM

Archive
Media

Lustre Movers

HSM Movers
23

Simplified Data Management for Big Data and HPC
Data Movement and Transparent User AccessCommon Access Protocols:
Lustre, NFS, SMB, HTTP, FTP
fs1
fs2
fs3

IB or FC
FabricShared Virtualized Storage
PoolPowered
By

QDR
FDRFC
Ethernet
第15回PCクラスタシンポジウム

24Protect Data over its Lifespan● Transparent tiering for users● Data always accessible regardless of tier
● File system appears infinitely large● Files always visible from the file system

Users and Applications

Lustre File System
Usersand Applications
Cray TAS
Connector● Automated data management● Policy-based data management● 24x7 data management● Multiple copies and disaster recovery● Works with any Lustre 2.5● Cray TAS Connector for Lustre HSM

第15回PCクラスタシンポジウム

File System
Policy EngineTier
1Tier
2

Tier
3Tier
4PoweredBy

25

Policy-based Data Movement● Familiar Actions & Policies
Archive● Transparently Archive fromdisk cache to archive media● Manage disk space or Releasearchived files from disk

● Automatically Stage released
files back when accessed

第15回PCクラスタシンポジウム

StageRelease26

Sustain Long-term Repositories● Open data format● Based on POSIX TAR● Data is accessible without TAS● No vendor lock-inthe default setting is● Data protected at scale● Support for 100’s of PB of managed data
● Integration with Lustre HSM

Open● Future-ready technology migration● Support for multigenerational data management● Migrate with technology
2000

第15回PCクラスタシンポジウム

2005

2010

2015

2020

2025

2030

2035

27

Parallel Archiving with Cray TASCustomer NetworkArchiver

A

L

1A

L

2A

L

3A

L

4A

L

5A

L

6A

L

7A

L

8A

L

9A

L

10A

L

11A

L

12A

L

13A

L

14A

L

15A

18
L
A

1719L

L

A

A

Storage Networks

16
L

0A

L

1A

L

2A

L3A

L

4A

L

5A

L

6A

7L

A

8L

A

9L

A

10L

A

11L

A

L

12A

L

1316
L

0A

L

1A

L

2A

L

3A

L

4A

L

5A

L

6A

L

7A

L

8A

L

9A

L

10A

L

11A

L

12A

L

13A

L

14A

L

15A

L

0A

L

1A

L

2A

L

3A

L

4A

L

5A

L

6A

L

7A

L

8A

L

9A

L

10A

L

11A

L

12A

L

13A

L

14A

L

15A

14A

L

15A

A

1719

L

L

A

A

18A

17L

1942

L

A

A

16L

18L

A

SANbox
5600

L

L

AL

SANbox
5600

41

A

18
L

A

L

SANbox
5600

42

第15回PCクラスタシンポジウム

ArchiverEST

0Archiver
EST

16L
A

L

SANbox
5600

Archiver
EST

EST

TAS
Gateway

A

1719

L

L

A

A

41

40

40

39

39

38

38

37

37

36

36

35

35

34

34

33

33

32

32

31

31

30

30

29

29

28

28

27

27

26

26

25

25

24

24

23

23

22

22

21

21

20

20

19

19

18

18

17

17

16

16

15

15

14

14

13

13

12

12

11

11

10

10

09

09

08

08

07

07

06

06

05

05

04

04

03

03

02

02

01

01

28

Cray TAS – Tiered Data Management SummaryProtect and access your high-value data when you need it, for as long as you need it● Store and Protect● Up to 5 copies—across any media● Transparently migrate data across tiers, fromingest to archive● Access Data Forever● All data always accessible to apps and users● Your choice of file protocol● Stay Open – Sustainable Infrastructure● Open formats break vendor lock-in● Data transparently migrates acrossPoweredBy

generations of storage infrastructure, disk andtape

第15回PCクラスタシンポジウム

29

● お問い合わせ先：
クレイ・ジャパン・インク
プリセールスチーム
礒野智之 isono@cray.com

第15回PCクラスタシンポジウム

30

The future isseldom the sameas the past
Seymour CrayJune 4, 1995

第15回PCクラスタシンポジウム