Joint Usage of TSUBAME3.0

Partnership Resource Allocations
TSUBAME Industrial Use -Statistical InformationTSUBAME Services

TSUBAME is open to academia and industries. Industrial use started in FY2007.
TSUBAME Usage Profile2011
2012
2013
2014

75.63%

56.25%

Trial Use
(Fully Subsidized)

20.74%

72.34%
62.01%The Number of Industrial Projects

23.45%
15.36%22.63%

5040

How to Use TSUBAME?
User types

Pay Use-2015

Newly Accepted Continuations

2016-

HPCI (Full Year) HPCI (Half Year)Open

ClosedNon-Tokyo Tech Users(Permanent call for proposals)

55.40%All Students have TSUBAME
accounts.
Partnership Resource
Allocations

Academic and Industrial Use

HPCI/JHPCN

Academic and Industrial Use
Supported by MEXT

24.35% 19.40%
Industrial Users

2082017201620
1520
142013220
12007Internal Academia
External Academia
External Industry

20
10

11020
111.85%038.64%20
149.51%

92017

Remarks

Trial Use

OpenFreeSupported byMEXT

Pay UseOpen$0.88/NodeH

Closed$1.76/NodeHIntellectual properties are reserved completely by theusers and are not required to be shared with Tokyo Tech.
“NodeH” is the unit for pricing. 1 NodeH is equivalent to 1node for 1 hour.
For example, if you pay $88, you can use 100 nodes for 1 hour,or 1 node for 100 hours.

Each node has 2 Intel Xeon processors (28 cores) and 4
NVIDIA Tesla P100 GPUs, with 256GB Memory.
“Publicity: Open” requires company name, division, purpose to use and the report of result to be published.
“Publicity: Closed” only requires company name to bepublished.

HPCI/JHPCN (2016-)

20021.39% 20.30%

858.31%

2002016

Price

Exchange rate is calculated with $1 = ¥113.

Project for Creation ofIndustrial Use
Research Platforms andSupported by MEXTSharing of Advanced
Research Infrastructure (-2015)24.16% 20.44%

Publicity

Remarks column

Tokyo Tech Students andProfessors

302015ProgramsMenu

Foreign Researchers

International Collaboration

Collaborators with Tokyo
Tech Professors

Research Collaboration
based on Research Fund orIndustrial Contracts

Distributed Computing for Machine Learning on Large-Scale Image Dataset
Ikuro Sato*, Ryutaro Watanabe*, Hiroki Nishimura**, Akihiro Nomura***, Satoshi Matsuoka*** (*DENSO IT LABORATORY, INC., **DENSO CORPORATION, ***Tokyo Institute of Technology)(This article is extracted from TSUBAME e-Science Journal Vol 14.)

Intensive researches have been revealing that machine-learning methods known as
Deep Neural Networks (DNNs) show great classification capabilities through supervised
training on massive datasets. This research aims to quantify a condition that primarily
controls classification capabilities, and generate a high-performing ensemble classifierconsisting of plural DNN models. As for the training, we used node-distributed machine-learning program that we developed from scratch. As many as 96 GPUs are used
to train a single DNN model. Most models are trained during the TSUBAME Grand
Challenge, using 1146 GPUs simultaneously at peak, reaching about 1 TFLOPS (single)
per GPU in the cost derivative parts.
(a)
(b)
(c)

(a)

(b)

Figure 2. Validation images falsely classified byour model. (a) Arabian camel, (b) triceratops.
60
model#sampletop-5 error rate

55
50
45
40
35
30
25
20
150

Figure 1. Validation images correctly classified by our model.
(a) Unicycle, (b) paddle, (c) bubble.

510 15 20 25 30 35
number of parameters (1.0e6)

40

Figure 3. The relationship between the classification
accuracy and the number of training parameters. The
blue line indicates the number of training samples.

HPCI Confederation
HPCI : High Performance Computing Infrastructure- National grid infrastructure for HPC research
Resources- 11 supercomputers in Japan, including TSUBAME3.0- 100PB global shared storage to share data
Services- One-stop sign up to all resources- Single sign on to all resources using Shibboleth & GSI
Status- 13 projects and 144 users use
TSUBAME3.0 for the HPCI projecton FY2018
GSI-SSHFor more details,
please go to booth #1419“Research Organization
for Information Science &Technology (RIST)”

Kyushu University

Hokkaido University

JHPCN

JHPCN : Joint Usage/Research Centerfor Interdisciplinary Large-scale
Information Infrastructures- The Network-Type Research Center aims to contributeto the advancement and permanent developmentof the academic and research infrastructure of Japan
Global Shared Storage
Gfarm File System
Resources Provider- 8 supercomputer centers in Japan, including TSUBAME3.0
Call for Proposals of Joint Research Projects- Approximately 60 research projects in each year,including international & Industry joint research projects
Status- 16 projects uses TSUBAME3.0, and total 52 projects are adopetd as JHPCN projects on FY2018

Web Access(Shibboleth)File Access

GSI-SSH

Tohoku University

Single Sign On

HPCI CA(NII)

45PBStorage

HPCI Portal(HPCI Office)

45PB
Storage

University of Tsukuba
AIST
The University of Tokyo

Shared Storage / East Hub
The University of Tokyo (Kashiwa)

ISM

Tokyo Institute of Technology

Kyoto University

RIKEN, AICS

JAMSTEC

Nagoya University

Osaka University

Shared Storage / West Hub
RIKEN, AICS (Kobe)

http://www.gsic.titech.ac.jp/sc18