Title
The Path to Petascale Computing
in China
Xue-bin Chi
XueSuperComputing
iCenter, CNIC, CAS

Unit Name

Date
December 99-10, 2010, Tokyo, Japan

Supercomputing Center of Chinese Academy of Sciences

OutlineOverview the HPC History of China
Brief Introduction of SCCASGrid environment overview
Applications in science andengineeringFuture Plan on high performanceenvironment

Supercomputing Center of Chinese Academy of Sciences

Overview the HPC History of China
1. Started in the late of 1980’s
2. DevelopingD l i ini theh 1990’s
1990’

Supercomputing Center of Chinese Academy of Sciences

Parallel computers (1988‐1994)(1988 1994)
BJ‐01 (1988‐1992)– 4 processors, with global and local memmory, made by ICT, CAS
 Transputers (1991‐1994)– Several parallel systems,systems our group had a 17 transputer system
 KJ 8950 (1993‐1995)– 16 processors, with global and local memmory, made by ICT, CAS

1995 1st parallel computer Dawning 1000 occurred– Peak performance 2.5GFLOPS in single precision, HPL 50%– Similar to Paragon machine, NX parallel implementation environment– Intel i860

Supercomputing Center of Chinese Academy of Sciences

National High Performance computing Centers (1996(1996‐2000)
2000)National High Performance computing Center (Beijing)– In Institute of computing technology, CAS
 National High Performance computing Center (Wuhan)– Huazhong University of Science and Technology National High Performance computing Center (Chengdu)– Southwest Jiaotong University
 National High Performance computing Center (Hefei)()– University of Science and Technology of China
Supercomputing Center in Chinese Academy of Sciences (SCCAS)– 1996
 Shanghai Supercomputing Center (SSC)– 2001Supercomputing Center of Chinese Academy of Sciences

Clusters (2001‐2005)(2001 2005)
Lenovo DeepComp 6800 (SCCAS)– 2003, top500 rank 14th, peak performance 5.2TFLOPS– Itanium II, Linux OS, MPI, QsNet– Budget 60M RMB
9 MOST 15M, Lenovo 15M, CAS 30M
 Dawning 4000 (SSC)– 2004, top500 rank 10th, peak performance 11 TFLOPS– AMD Opteron, Linux Os, MPI, Merinet 2000
– Budget 60M RMB
9 MOST 30M, Shanghai Government 30M
 Many other clusters installed during that periodSupercomputing Center of Chinese Academy of Sciences

100TFLOPS HPCs (2006‐2010)(2006 2010)
Lenovo DeepComp 7000
– 150TFLOPS, our center, Dec., 2008
– Budget 180M RMB
9 MOST 80M80M, Lenovo 25M,25M CAS 75M
 Dawning 5000– Peak performance 200TFLOPS, AMD processors– Aug., 2009, in Shanghai Supercomputing Center– Top500 rank 10th on June of 2009
– Budget 200M RMB
9 MOST 100M, Shanghai Government 100M
– Software and environment
9 100MSupercomputing Center of Chinese Academy of Sciences

Peta Flops HPCs
Dawning Nebulae– 600TFLOPS CPU + 3PFLOPS GPU– Top500 Rank 2nd– Budget 600M RMB
9 MOST 200M, Shenzhen Government 400M
– Upgrade 1PFLOPS CPU, 200 TFLOPS Godson
 NUDT Tianhe– 200TFLOPS CPU + 1.2PFLOPS GPU– Top500 rank 7th– Budget 600M RMB
9 MOST 200M, Tianjin Government 400M
– Upgrade 1PFLOPS CPU + 4PFLOPS GPU
9 HPL 2.5PFLOPSSupercomputing Center of Chinese Academy of Sciences

Brief Introduction of SCCAS
1. Providing computing power andtechnical support for scientists
2 Training in HPC algorithm and2.
programming

Supercomputing Center of Chinese Academy of Sciences

SCCAS‐Computing
pg Resources During 1996
1996‐2000
2000 (9th 5 year plan)– In 1996, SGI Power Challenge XL
9 6.4Gflops
6 4Gflops
9 16 CPUs– In 1998: Hitachi SRR201
9 9.6GFlops
9 32CPUs– In 2000, Dawning 2000 II
9 111.7Gflops
111 7Gflops
9 164 CPUs

Supercomputing Center of Chinese Academy of Sciences

SCCAS‐Computing
SCCAS
Computing Resources During
D i 2001‐2005
2001 2005 (10th 5 year plan)l )– In 2003, Lenovo DeepComp6800
9 5Tflops,5Tfl
1024 CPUCPUs
9 TOP500：No.14；China TOP100：No. 1

 During 2006‐now (11th 5 year plan)–In 2008, Lenovo DeepComp7000
9 150Tflops, 13,000 cores
9 TOP500：No.19；China TOP100：No.2
9 3 kinds of nodes, Altix 4700, IBM 3950, IBM Blades–In 2009,
2009 300TFLOPS GPU

Supercomputing Center of Chinese Academy of Sciences

SCCAS‐Services:SCCASServices: Users
 Users in SCCAS has massively increased since 1996 (from 20 tomore than 320)user numberb350
300
250200150

1005001996

1998

2000

2001

2002

2003

2004

2005

2006

2007

2008

2009

Supercomputing Center of Chinese Academy of Sciences

SCCAS‐R&DSCCAS
R&D of Algorithms and software Parallel AMR ((Adaptivep
Mesh Refinement)) method
 Parallel Eigenvalue Problem
 Parallel Fast MultipolepMethod
 Parallel Computing Model Gridmol ScGrid middleware
 PSEPS FMM‐radar Transplant many open source software

Supercomputing Center of Chinese Academy of SciencesGrid environment overview
1. China National Grid (CNGrid)
2. China Scientific Computing Grid(ScGrid)Supercomputing Center of Chinese Academy of Sciences

China National GridSupercomputing Center of Chinese Academy of Sciences

China National Grid
CNGrid operation center– Supercomputing center of CNIC of CAS
 Northern major node
– Supercomputing center of CNIC of CAS
 Southern major node
– Shanghai supercomputing center Normal nodes– 9 sites, they are Tsinghua University, Beijing Institute of Applied Physics andComputational Mathematics, Shandong University, University of Science andTechnology of China, Huazhong University of Science and Technology,Shenzhen Institute of Advanced Technology of CAS, Hong Kong University,
Xi’an Jiaotong University, Gansu province Supercomputing CenterSupercomputing Center of Chinese Academy of Sciences

China Scientific Computing Grid (ScGrid)Supercomputing Center of Chinese Academy of Sciences

GPU Clusters within CAS
Site

VendorRpeak /Tflops

Institute of Electrical Engnineering
Institute.

Lenovo112

Shenzhen Institutes of Advanced
Technology

Lenovo200

USTC

Lenovo183

CNIC

Lenovo, Dawning

300

National Astronomical Observatories

Lenovo158

Institute of Geology and Geophysics

Lenovo, Dawning

200

Institute of Modern Physics

Lenovo202.5

Institute of High Energy Physics

Dawning

195.5

Instituteioff Metalsl ResearchhDawningi

183

Purple Mountain Observatory

Dawning180

SUM

1 914 Pflops
1.914
PflSupercomputing Center of Chinese Academy of Sciences

Windows / Linux Clients

Users

Administrator

Web Portal

SCE Middleware

HPC Cluster,HPC,
Cluster Workstation,Workstation Storage

Supercomputing Center of Chinese Academy of Sciences

Applications in Science andEngineering
1. Scientifici ifi Researchh
2 Industrial Computing2.

Supercomputing Center of Chinese Academy of Sciences

Prediction of Sandstorm
Real‐time prediction system of Sandstorms for China Meteorological
Administration
 DeepComp6800– 256 CPUs
– from 15hours
down to 8mins
Supercomputing Center of Chinese Academy of Sciences

Global Climate Model
Model‐FGOALSFGOALS
GAMIL

land::CLM
land

AGCM

Coupler
FGOALS(cpl5)

OGCM::LICOM
OGCM

CPU
1620

ICE:CICE

AGCM

LAND

OGCM

ICECoupler
p720

90

540

180

90

Supercomputing Center of Chinese Academy of Sciences

EM Scattering The surface currents and RCS of plane and destroyer models– UsedU d forf antennat
design,d i RCS analysis
l i– Stealth design of airplanes, etc.

Supercomputing Center of Chinese Academy of Sciences

G l ti Wind
Galactic
Wi d SiSimulationl ti8192 Computational cores,
Internationally advanced both in computational scaleand speed

Supercomputing Center of Chinese Academy of Sciences

C4: Computational Cosmology Consortium of China

Supercomputing Center of Chinese Academy of Sciences

Drug screening for Avian Influenza
 DeepComp7000
pp 2400 CPU cores Time consumed decreased

from 2 months to 8hours
 The compounds screened outby this computation is
forwarded to related
ddepartment
tt ffor further
f thbiological test

Supercomputing Center of Chinese Academy of Sciences

Phase Change on Titanium AlloySupercomputing Center of Chinese Academy of Sciences

P InsPecT/cuda‐InsPecT
P_InsPecT/cuda
InsPecT Software
 Software Introduction–––

Both are optimized InsPecT software
P_InsPecT is open source and can be downloaded
from SCBG
Cuda‐InsPecT will be open source Software Function–

InsPecT is an unrestricted identification software ofPTMs(post‐translational modifications)

Software Characteristics
P_InsPecT• via MPI
• run on CPU cluster or CPU nodes of HPC

cuda-InsPecT• via MPI+cuda C• run on GPU cluster

Software Performance
Software：P_InsPecT（one modification）
Database：36547 mass spectrometric;
107962 protein sequences
Environment：DeepComp7000

TimeOne Core（estimate）

2048 Cores

1177.7 h

0.4 h

Software：cuda-InsPecT（two modifications）
Database：62346 mass spectrometric;
107962 protein sequencesE
Environment：Dawn 6000ATime

One Core（estimate）（ti t ）

677 Fermi
C2050

6 years

2.034 hSupercomputing Center of Chinese Academy of Sciences

CAD/CAE/
Platform in Automation Industryy
Who we provide our service to– CAD/CAE engineers What we deliver to them– A high‐high‐performance service
9 DeepCompDC7000 forf parallelll l solverl9 HighHigh‐‐performance graphic workstations for pre/post processing– A high‐high‐usability cloud computing solution via internet
9 Remote graphical access to workstations
9 GridGrid‐‐computing based resources
9 Web portal integrated with CAE software– A high‐high‐safety environment
9 Secure access through VPN and firewall
9 Isolate unauthorized access from cluster by web portalSupercomputing Center of Chinese Academy of Sciences

Future Plan on High Performance
Environment

Supercomputing Center of Chinese Academy of Sciences

Petascale Supercomputers in CAS 1 PetaFlopsp computerpin 2012
– Budget 250M RMB– For scientific computingpg
 10 PetaFlops computer in 2015
– Collaboration with Beijing local government– Budget 700M RMB– For scientific computing and industry computing

Supercomputing Center of Chinese Academy of Sciences

100PFlops Supercomputers in China
2011‐2015– Many peta scale HPCs
– At least one 50‐100PFLOPS HPC– Budget 4B RMB
9 MOST 2.4B, Local Government 1.6B
 2016‐2020– 1‐10ExaFLOPS HPC– Budget
9 Can’t estimateSupercomputing Center of Chinese Academy of Sciences

Question & Suggestion
Thank you very much!