Welcome Back to Kashiwa !!
Kengo Nakajima
Professor, Information Technology Ctr.
The University of Tokyo
Deputy Director, RIKEN R-CCS
ADAC-8, October 30-31, 2019
Kashiwa, Japan

2

First of all,sorry for 2-hour trip from Shinagawa
We have a Big Event in Kashiwa Area

3

Three Major Campusesof University of Tokyo
Kashiwa

Hongo

Komaba4

Kashiwa（柏）： Oak
Kashiwa-no-Ha: Leaf of Oak“Kashi（樫）” isalso called “Oak”“Oak” covers many kinds of trees in Japan53rd TOP500 (June, 2019)
Site

Rmax: Performance of Linpack (TFLOPS)
Rpeak: Peak Performance (TFLOPS),Power: kW
http://www.top500.org/

Computer/Year Vendor

IBM Power System AC922, IBM POWER9
Summit, 2018, USA
22C 3.07GHz, NVIDIA Volta GV100, Dual-rail
DOE/SC/Oak Ridge National Laboratory
Mellanox EDR Infiniband
IBM Power System S922LC, IBM POWER9Sieera, 2018, USA
22C 3.1GHz, NVIDIA Volta GV100, Dual-rail
2
DOE/NNSA/LLNLMellanox EDR Infiniband

1

3

Sunway TaihuLight, 2016, China
Sunway MPP, Sunway SW26010 260C
National Supercomputing Center in Wuxi 1.45GHz, Sunway
Tianhe-2A, 2018, China

4 National Super Computer Center in
56
78

TH-IVB-FEP Cluster, Intel Xeon E5-2692v2
12C 2.2GHz, TH Express-2, Matrix-2000

Guangzhou
Frontera, 2019, USA
Dell C6420, Xeon Platinum 8280 28c 2.7GHz,
Texas Advanced Computing Center
Mellanox Infiniband HDR
Piz Daint, 2017, Switzerland
Cray XC50, Xeon E5-2690v3 12C 2.6GHz,
Swiss National Supercomputing Centre
Aries interconnect , NVIDIA Tesla P100
(CSCS)
Trinity, 2017, USA
Cray XC40, Intel Xeon Phi 7250 68C 1.4GHz,
DOE/NNSA/LANL/SNL
Aries interconnect
ABCI (AI Bridging Cloud
PRIMERGY CX2550 M4, Xeon Gold 6148
Infrastructure), 2018, Japan
20C 2.4GHz, NVIDIA Tesla V100 SXM2,National Institute of Advanced Industrial
Infiniband EDR
Science and Technology (AIST)

Cores

Rmax
Rpeak
Power
(TFLOPS) (TFLOPS) (kW)2,414,592

148,600(= 148.6 PF)

200,795

10,096

1,572,480

94,640125,712

7,438

10,649,600

93,015

125,436

15,371

4,981,760

61,445

100,679

18,482448,448

23,51638,746

387,872

21,23027,1542,384

979,072

20,15941,461

7,578

391,680

19,88032,577

1,649

9SuperMUC-NG, 2018, Germany
Leibniz Rechenzentrum

Lenovo, ThinkSystem SD650, Xeon Platinum
8174 24C 3.1GHz, Intel Omni-Path

305,856

19,477

26,87410

Lassen, 2019, USA
DOE/NNSA/LLNLIBM Power System S922LC, IBM POWER922C 3.1GHz, NVIDIA Volta V100, Dual-rail
Mellanox EDR Infiniband

288,288

18,20023,047PRIMERGY CX1640 M1, Intel Xeon Phi 7250
68C 1.4GHz, Intel Omni-Path

556,104

13,556

24,913

Oakforest-PACS, 2016, Japan

16 Joint Center for Advanced High
Performance Computing

2,719
5

Rmax: Performance of Linpack (TFLOPS)
Rpeak: Peak Performance (TFLOPS),Power: kW
http://www.top500.org/

Current No1. & No2
Systems in Japan

53rd TOP500 (June, 2019)
Site

Computer/Year Vendor

IBM Power System AC922, IBM POWER9
Summit, 2018, USA
22C 3.07GHz, NVIDIA Volta GV100, Dual-rail
DOE/SC/Oak Ridge National Laboratory
Mellanox EDR Infiniband
IBM Power System S922LC, IBM POWER9Sieera, 2018, USA
22C 3.1GHz, NVIDIA Volta GV100, Dual-rail
2
DOE/NNSA/LLNLMellanox EDR Infiniband

1

3

Sunway TaihuLight, 2016, China
Sunway MPP, Sunway SW26010 260C
National Supercomputing Center in Wuxi 1.45GHz, Sunway
Tianhe-2A, 2018, China

4 National Super Computer Center in
56
78

TH-IVB-FEP Cluster, Intel Xeon E5-2692v2
12C 2.2GHz, TH Express-2, Matrix-2000

Guangzhou
Frontera, 2019, USA
Dell C6420, Xeon Platinum 8280 28c 2.7GHz,
Texas Advanced Computing Center
Mellanox Infiniband HDR
Piz Daint, 2017, Switzerland
Cray XC50, Xeon E5-2690v3 12C 2.6GHz,
Swiss National Supercomputing Centre
Aries interconnect , NVIDIA Tesla P100
(CSCS)
Trinity, 2017, USA
Cray XC40, Intel Xeon Phi 7250 68C 1.4GHz,
DOE/NNSA/LANL/SNL
Aries interconnect
ABCI (AI Bridging Cloud
PRIMERGY CX2550 M4, Xeon Gold 6148
Infrastructure), 2018, Japan
20C 2.4GHz, NVIDIA Tesla V100 SXM2,National Institute of Advanced Industrial
Infiniband EDR
Science and Technology (AIST)

Cores

Rmax
Rpeak
Power
(TFLOPS) (TFLOPS) (kW)2,414,592

148,600(= 148.6 PF)

200,795

10,096

1,572,480

94,640125,712

7,438

10,649,600

93,015

125,436

15,371

4,981,760

61,445

100,679

18,482448,448

23,51638,746

387,872

21,23027,1542,384

979,072

20,15941,461

7,578

391,680

19,88032,577

1,649

9SuperMUC-NG, 2018, Germany
Leibniz Rechenzentrum

Lenovo, ThinkSystem SD650, Xeon Platinum
8174 24C 3.1GHz, Intel Omni-Path

305,856

19,477

26,87410

Lassen, 2019, USA
DOE/NNSA/LLNLIBM Power System S922LC, IBM POWER922C 3.1GHz, NVIDIA Volta V100, Dual-rail
Mellanox EDR Infiniband

288,288

18,20023,047PRIMERGY CX1640 M1, Intel Xeon Phi 7250
68C 1.4GHz, Intel Omni-Path

556,104

13,556

24,913

Oakforest-PACS, 2016, Japan

16 Joint Center for Advanced High
Performance Computing

2,719
6

Rmax: Performance of Linpack (TFLOPS)
Rpeak: Peak Performance (TFLOPS),Power: kW
http://www.top500.org/

Both are in Kashiwa !!
Kashiwa is the Home ofSupercomputers !!

53nd TOP500 (June, 2019)
Site

Computer/Year Vendor

IBM Power System AC922, IBM POWER9
Summit, 2018, USA
22C 3.07GHz, NVIDIA Volta GV100, Dual-rail
DOE/SC/Oak Ridge National Laboratory
Mellanox EDR Infiniband
IBM Power System S922LC, IBM POWER9Sieera, 2018, USA
22C 3.1GHz, NVIDIA Volta GV100, Dual-rail
2
DOE/NNSA/LLNLMellanox EDR Infiniband

1

3

Sunway TaihuLight, 2016, China
Sunway MPP, Sunway SW26010 260C
National Supercomputing Center in Wuxi 1.45GHz, Sunway
Tianhe-2A, 2018, China

4 National Super Computer Center in
56
78

TH-IVB-FEP Cluster, Intel Xeon E5-2692v2
12C 2.2GHz, TH Express-2, Matrix-2000

Guangzhou
Frontera, 2019, USA
Dell C6420, Xeon Platinum 8280 28c 2.7GHz,
Texas Advanced Computing Center
Mellanox Infiniband HDR
Piz Daint, 2017, Switzerland
Cray XC50, Xeon E5-2690v3 12C 2.6GHz,
Swiss National Supercomputing Centre
Aries interconnect , NVIDIA Tesla P100
(CSCS)
Trinity, 2017, USA
Cray XC40, Intel Xeon Phi 7250 68C 1.4GHz,
DOE/NNSA/LANL/SNL
Aries interconnect
ABCI (AI Bridging Cloud
PRIMERGY CX2550 M4, Xeon Gold 6148
Infrastructure), 2018, Japan
20C 2.4GHz, NVIDIA Tesla V100 SXM2,National Institute of Advanced Industrial
Infiniband EDR
Science and Technology (AIST)

Cores

Rmax
Rpeak
Power
(TFLOPS) (TFLOPS) (kW)2,414,592

148,600(= 148.6 PF)

200,795

10,096

1,572,480

94,640125,712

7,438

10,649,600

93,015

125,436

15,371

4,981,760

61,445

100,679

18,482448,448

23,51638,746

387,872

21,23027,1542,384

979,072

20,15941,461

7,578

391,680

19,88032,577

1,649

9SuperMUC-NG, 2018, Germany
Leibniz Rechenzentrum

Lenovo, ThinkSystem SD650, Xeon Platinum
8174 24C 3.1GHz, Intel Omni-Path

305,856

19,477

26,87410

Lassen, 2019, USA
DOE/NNSA/LLNLIBM Power System S922LC, IBM POWER922C 3.1GHz, NVIDIA Volta V100, Dual-rail
Mellanox EDR Infiniband

288,288

18,20023,047PRIMERGY CX1640 M1, Intel Xeon Phi 7250
68C 1.4GHz, Intel Omni-Path

556,104

13,556

24,913

Oakforest-PACS, 2016, Japan

16 Joint Center for Advanced High
Performance Computing

2,719
7

8

Oakforest-PACS (OFP): KNL & OPA• 8,208 Intel Xeon/Phi (KNL), 25 PF Peak Performance– Fujitsu– Full operation started in December 2016
• Just before ADAC-3• TOP 500 #16 (#2 in Japan/柏市),
HPCG #9 (#3) (June 2019)• JCAHPC: Joint Center for Advanced High
Performance Computing– University of Tsukuba– University of Tokyo• Kashiwa-no-Ha (Leaf of Oak) Campus/U.Tokyo,
which is between Tokyo and Tsukuba– http://jcahpc.jp• In spite of KNL & OPA, still an excellent system for
R&D on SW/Algorithms for large-scale computing

Another Important Role of OFP
Alternative National Flagship System• K computer has been shut
down in August 2019.
• OFP is the biggest system in
HPCI for shared usage• Very ImportantComputational
Resource in Japan until
the Fugaku (Post K)
starts its operation in
2020-2021– Manycore– Wide SIMD
– (Small) HBM

9Home of Nobel Prize Scientist
Prof. Takaaki KajitaNobel Prize in Physics 2015

• Neutrino experiments at
the Kamiokande and theSuper-Kamiokande

10

11

Kashiwa is Home of All Blacks !!
They stayed in Kashiwa from
Sept.10-14 before RWC 201912

Overview of Supercomputers
Information Technology Center
The University of Tokyo• Current Systems– Reedbush-U/H/L– Oakforest-PACS (OFP)– Oakbridge-CX (OBCX)• Future Systems towards Society 5.0(January-April 2021)– BDEC (Big Data & Extreme Computing)– Data Platform (DP)Now operating 3 Systems !!

13

2,000+ users (1,000 from outside of U.Tokyo)• Reedbush (HPE, Intel BDW + NVIDIA P100 (Pascal))– Integrated Supercomputer System for Data Analyses &Scientific Simulations• Jul.2016-Jun.2020– Our first GPU System, DDN IME (Burst Buffer)– Reedbush-U: CPU only, 420 nodes, 508 TF (Jul.2016)– Reedbush-H: 120 nodes, 2 GPUs/node: 1.42 PF (Mar.2017)– Reedbush-L: 64 nodes, 4 GPUs/node: 1.43 PF (Oct.2017)• Oakforest-PACS (OFP) (Fujitsu, Intel Xeon Phi (KNL))– JCAHPC (U.Tsukuba & U.Tokyo)– 25 PF, #16 in 53rd TOP 500 (June 2019) (#2 in Japan)– Omni-Path Architecture, DDN IME (Burst Buffer)• Oakbridge-CX (OBCX) (Fujitsu, Intel Xeon Platinum 8280, CLX)
– Massively Parallel Supercomputer System– 6.61 PF, #45 in 53rd TOP 500, July 2019-June 2023
– SSD’s are installed to 128 nodes (out of 1,368)

14

Recently Retired Systems
Fujitsu PRIMEHPC FX10
Commercial Version of K
• Oakleaf-FX (Fujitsu PRIMEHPC FX10)– 1.135 PF, Apr.2012-Mar.2018• Oakbridge-FX (Fujitsu PRIMEHPC FX10)– 136.2 TF, Apr.2014-Mar.2018– for long-time use (up to 168 hr’s)

15

All of Our Systems will be in the
Kashiwa Campus in Apr. 2021
• Asano/Hongo Campus– Reedbush (will be retired in March 2021)• Kashiwa Campus: Research Complex Bldg. II– 1F: Oakbridge-CX (op. started in July 2019)– 2F: Oakforest-PACS• Kashiwa II Campus (New Campus in Kashiwa)– A New Building (New Research Facility for
Integration of Large-Scale Network &Supercomputing by U.Tokyo and NII) will be
constructed by Fall 2020
• BDEC (Big Data & Extreme Computing)• Data Platform (8-Univ’s/NII/AIST Project)• Both starts op. in Jan.-Apr. 2021

– ABCI by AIST (Fastest Linpack system in Kashiwa,
Japan) is in the same campus

Supercomputers in ITC/U.Tokyo
2 big systems, 6 yr. cycle
FY11 12 13 14 15 16 17 18 19 20 21 22 23 24 25
Oakleaf-FX: Fujitsu PRIMEHPC
FX10, SPARC64 IXfx

Oakbridge-CXIntel Xeon CLX

1.13 PFLOPS, 150 TB

6.61 PFLOPS

Kashiwa

Oakforest-PACS (OFP)
Fujitsu, Intel Xeon Phi

Post OFP ?

25PFLOPS, 919.3TB

BDEC System
Big Data & Extreme Computing

60+ PFLOPS

Kashiwa-II

Data Platform (DP)
Reedbush-U/H, HPE

Hongo/
Asano

Intel BDW + NVIDIA P100
1.93 PFLOPS

Reedbush-L
HPE
1.43 PFLOPS

16

17

Utilization Rate (Apr. 2016 - Jul. 2019)
100
90
80

Utillization Rate (%)

70
60
50
40
30
20
10
0

Oakleaf-FX

Oakbridge-FX[R.Nakahari (ITC/U.Tokyo)]

Reedbush-U

Reedbush-H

Reedbush-L

OFP

Research Area based on CPU Hours
FX10 in FY.2017 (Commercial
Version of K)

18

Engineering
Material
Science
Earth & Space
ScienceEngineering
Earth/Space
Material
Energy/Physics
Information Sci.
Education
Industry
BioSocial Sci. & Economics
Data
Data Assimilation

Oakleaf-FX + Oakbridge-FX

19

Reedbush: Our First GPU System• Before 2015
– CUDA

Reedbush-H: 2-GPUs /Node• Not a Choice: We have 2,000+ users• Reasons of Changing Policy– Recent Improvement of
OpenACC• Similar Interface as OpenMP– New Types of Users in Data
Science, Deep Learning etc.

• Reedbush-H (our first GPU
cluster) started in March 2017

Reedbush-L: 4-GPUs /NodeResearch Area based on CPU Hours
Reedbush-H in FY.2018
2-GPU’s/Node20

Engineering

Medical Image
Recognition
医療画像処理Molecular Sim.
Biomechanics
生体力学[R.Nakahari (ITC/U.Tokyo)]Info. Sci:
AI

Engineering
Earth/Space
Material
Energy/Physics
Info. Sci. : System
Info. Sci. : Algrorithms
Info. Sci. : AI
Education
Industry
Bio
Bioinformatics
Social Sci. & Economics
Data• ARTED– Ab-initio Electron
Dynamics

Applications on OFP• Lattice QCD– Quantum Chrono
Dynamics• NICAM & COCO
– Atmosphere & Ocean
Coupling• GAMERA/GHYDRA– Earthquake Simulations• Seism3D– Seismic Wave Propagation

21

22

Research Area based on CPU Hours
Oakforest-PACS in FY.2017
Eng.

QCD

[R.Nakahari (ITC/U.Tokyo)]

Earth &Space

Material

Engineering
Earth/Space
Material
Energy/Physics
Information Sci.
Education
Industry
BioSocial Sci. & Economics
Data

23

Research Area based on CPU Hours
Oakforest-PACS in FY.2018
Eng.
Info. Sci:
Algorithms

QCD[R.Nakahari (ITC/U.Tokyo)]

Earth &Space
(moved from
FX10)

Material

Engineering
Earth/Space
Material
Energy/Physics
Info. Sci. : System
Info. Sci. : Algrorithms
Info. Sci. : AI
Education
Industry
Bio
Bioinformatics
Social Sci. & Economics
Data

24

Other Challenges on OFP• Collaboration with JAMA
– Japan Automobile
Manufactures Association（日本自動車工業会）– Optimization of LS-DYNA
on KNL under support byIntel (USA/France) and
S/W Vendors• Massively Parallel Deep
Learning– TensorFlow, Caffe, andChainer are available.

[LBNL SC17]

Oakbridge-CX (OBCX)• Intel Xeon Platinum 8280 (Cascade Lake, CLX), Fujitsu– 1,368 nodes, 6.61 PF peak，385.1 TB/sec, 4.2+ PF for HPL#45 in 53rd Top500– Fast Cache: SSD’s for 128 nodes: Intel SSD, BeeGFS• 1.6 TB/node, 3.20/1.32 GB/s/node for R/W• Staging, Check-Pointing, Data Intensive Application• 16 of these nodes can directly access external resources(server, storage, sensor network etc.) through SINET– Network: Intel Omni-Path, 100 Gbps, Full Bi-Section– Storage: DDN EXAScaler (Lustre) 12.4 PB, 193.9 GB/sec– Power
Consumption:
950.5 kVA

• Operation Start:
July 1st, 201925

26

128xSSD’s: Single Fast File System

・・・
SSD

SSD

SSD

SSD

SSD

Single Fast File System with 200+ TB

SSD

27

Overview of Supercomputers
Information Technology Center
The University of Tokyo• Current Systems– Reedbush-U/H/L– Oakforest-PACS (OFP)– Oakbridge-CX (OBCX)• Future Systems towards Society 5.0(January-April 2021)– BDEC (Big Data & Extreme Computing)– Data Platform (DP)Society 5.0 (= Super Smart Society)by the Cabinet Office of Japan• Paradigm Shift towards Knowledge-Intensive & Super
Smart Society by Digital Innovation (IoT, AI, Big Dataetc.)
5.0: Super Smart
4.0: Information
3.0: Industry
2.0: Agrarian
1.0: Hunting

28

29

Towards Society 5.0 in ITC/UTokyo• New Types of Users– Mostly CSE, so far– Data, ML, AI etc.
• Genome Analysis• Medical Image Recognition

Engineering
Material
Science
Earth & Space
ScienceEngineering
Earth/Space Data Engineering
MaterialImage
MedicalEnergy/Physics
Recognition
医療画像処理Information Sci.
Education
Industry
Bio Molecular Sim. Info. Sci: AI
Biomechanics
SocialSci. & Economics
Data生体力学
Data Assimilation

Commercial
Version of K

• New Paradigm for SupercomputingIntel BDW +NVIDIA P100

– Data Driven Approach– Utilization & Analyses of Various Types of Data
– Integration of (Simulations + Data + Learning)• S+D+L• Two Platforms in Kashiwa II Campus– BDEC (Big Data & Extreme Computing)• Platform for (S+D+L)• Reedbush & OBCX are prototypes of BDEC

– Data Platform (DP)– Both are starting in Jan.-Apr. 2021

Engineering
Earth/Space
Material
Energy/Physics
Info. Sci. : System
Info. Sci. : Algrorithms
Info. Sci. : AI
Education
Industry
Bio
Bioinformatics
Social Sci. & Economics
DataSupercomputers in ITC/U.Tokyo30

2 big systems, 6 yr. cycle
FY11 12 13 14 15 16 17 18 19 20 21 22 23 24 25
Yayoi: Hitachi SR16000/M1
IBM Power-7

Oakbridge-CXIntel Xeon CLX

54.9 TFLOPS, 11.2 TB

6.61 PFLOPS

T2K Manycore-basedTokyo
LargeHitachi
scale Supercomputer

Oakforest-PACS (OFP)
Fujitsu, Intel Xeon Phi

140TF,System,
31.3TB JCAHPC

Post OFP ?

25PFLOPS, 919.3TB

Integrated Supercomputer
Oakleaf-FX: Fujitsu PRIMEHPC
System for Simulation,
FX10, SPARC64 IXfx
1.13 PFLOPS, 150 TB
Data and Learning

Oakbridge-FX
Reedbush-U/H, HPEIntel BDW + NVIDIA P100

Supercomputer Systemwith Accelerators for LongTerm Executions

BDEC System
Big Data & Extreme Computing

60+ PFLOPS

Data Platform (DP)136.2 TFLOPS, 18.4 TB

Integrated Supercomputer
System for Data Analyses &Scientific Simulations

Massively Parallel
Supercomputer
System1.93 PFLOPS

Reedbush-L
HPE
1.43 PFLOPS31

BDEC (1/2): Apr. 2021 (or later)• 60+ PF, 3.5-4.5 MW including Cooling, ~360 m2– External Nodes for Data Acquisition/Analysis (EXN)– Internal Nodes for CSE/Data Analysis (INN) 50+PF, 6.3+PB/s– Integration Node for (S+D+L) (ITN)• Architecture of EXN could be different from that of (INN+ITN))– Shared File System (SFS) + Fast File System (FFS)BDEC (2/2): Possible Applications• Simulations/Data Assimilation• Atmosphere-Ocean Simulations
with Data Assimilation– AORI/U.Tokyo– RIKEN R-CCS• Earthquake Simulations with
Data Assimilation– ERI/U. Tokyo• Real-Time Disaster Simulations– Flood, TsunamiInternal Nodes
内部ノード

Integration Nodes
融合ノード

External Nodes
外部ノード

Simulation: INN
50+PF, 6.3+PB/s

S+D+L: ITN
5+PF, 650+TB/s

Data/Learning: EXN
5+PF, 650+TB/s

1.5+TB/s

32

Real-Time Sharing of Seismic
Observation is possible in Japan
by JDXnet with SINET• Seismic Observation Data (100Hz/3-dir’s/O(103) pts)
by JDXnet is available through SINET in Real Time
– Peta Server in ERI/U.Tokyo: O(102) GB/day⇒EXN of BDEC
– O(105) pts in future including stations operated by industry[c/o Prof. H.Tsuruoka (ERI/U.Tokyo)]33

Real-Time Earthquake Simulation
with Data Assimilation• EXN: Real-Time Data
Acquisition through
JDXnet• ITN: Real Time Data
Analyses/Assimilation
using Observed Data on
the FFS & Controlling the[c/o Prof. T.Furumura (ERI/U.Tokyo)]
Entire Program,
Parameter Optimization• INN: Large-Scale
Seismic Simulations• Improvement of the UG Model in Normal Operations
Internal Nodes
内部ノード

Integration Nodes
融合ノード

External Nodes
外部ノード

Simulation: INN
50+PF, 6.3+PB/s

S+D+L: ITN
5+PF, 650+TB/s

Data/Learning: EXN
5+PF, 650+TB/s

1.5+TB/s– by Obs. + Simulations + Data Assimilations + ML

34

35

h3-Open-BDEC• Towards the end of Moore's law, we need to develop
not only new HW, but also new algorithms & appl’s.
• Integration of (Simulation + Data + Learning) (S+D+L)• h3-Open-BDEC– Software Infrastructure for (S+D+L)– to extract the maximum performance of the supercomputerswith minimum energy consumption and minimum
computation time

• Target H/W Platform for (S+D+L): BDEC System• Adopted as “JSPS Grant-in-Aid for Scientific Research(S)” during FY.2019-2023 (PI: Kengo Nakajima)– Innovative Method for Computational Science by Integrationsof (Simulation + Data + Learning) in the Exascale Era– 152.7M JPY= 1.41M USD

h3-Open-BDEC

Hierarchical,
Hybrid,Heterogeneous

Big Data &ExtremeComputing

Extension of ppOpen-HPC for Integration of(Simulation + Data + Learning) in the Exa/Post
Moore Era, Initial Target: BDEC System@U.Tokyo36

Data Platform (DP)• Platform for Utilization of Data towards Society 5.0• Project supported by Japanese Government– Organization: National Univ’s and National Lab’s• 8 National Univ’s (Tokyo, Hokkaido, Tohoku, Tokyo Tech, Nagoya,
Kyoto, Osaka, Kyushu)• NII (National Instituteof Informatics)• AIST (National Instituteof Advanced Industrial
Science & Technology)– Starting Operation in
January 2021 (orlater)• In the Same
Building/Room where
the BDEC locates37

BDEC & DP
• BDEC– HPC System with Capabilities
of Data Analyses/Learning• 60+ PF Total• DP– Large-scale Cloud + Storages• 20-30 PF (DP-base)• 30-50% of BDEC– More focusing on Analyses &Utilization of Data
– Computing facility is similar to
the EXN of BDEC
• more flexible and more secure– On-demand Configuration– Resource Mgmt. & Scheduling• Kubernetes, OpenStack, …
• Slurm, PBS, …

38

Current Plan
• Schedule– Both of DP and BDEC will start operations in Jan-Apr. 2021
in the Same Room in the Same Building (Kashiwa II Campus)– Individual/Separate Procurement due to Restriction of
Budgets• Development of software (e.g. h3-Open-BDEC) started– Research Collaborations are welcome• BDEC-DP (Next Page)– Shared File System (SFS) of BDEC must be available from
DP: Baseline– Further developments for stronger coupling between
DP/BDEC are expected after staring op. in 2021
39

Shared File System (SFS) of BDEC
must be available from DP

40