# Presentation: 707115

## Earth Simulator Center

-              Contents
- Introduction
- Outline of the system
- First results from the Earth Simulator
-     - LINPACK benchmark test    - Real applications
- PC Cluster applications
- Summary

## Earth Simulator Center 

** *****PC Cluster applications***

- Typical output data from a global atmospheric circulation model

| Total number of mesh : 10km mesh, 100 layers | 4000×2000×100=800M |
| --- | --- |
| Total number of I/O's : 1-10 years integration,                                 1 time output every 1day integration | 365 - 3650 |
| Number of variables per mesh point | 3 - 10 |
| Total data volume : half precision (data compression) | 1.75 - 58.4 TB |

- Note that PC cluster applications to the ES are still under examination.

- In the ES, only 1 or 2 nodes are available for interactive jobs.

## Earth Simulator Center

** *****PC Cluster applications***

- PC cluster : a cluster of self-contained PCs connected by                     an off-the-shelf interconnection network.

-  The cost performance is very high.- All the PCs are self-contained including disks.

-  Data throughput between PCs is low relatively to those systems  with a purpose-built interconnection network such as PVP and   MPP.

## Earth Simulator Center 

**Earth Simulator**

**T3E**

**VPP5000**

**ASCI-Q**

- PVP

- MPP

- PC cluster

**(IN performance)/(node performance) [GB/s/GFLOPS]**

- Number of nodes

**Origin3800**

**SX5**

**SR8000**

**T3E**

- Parallel supercomputer category

**Off-the-****shelf **

**purpose-built**

**IN**

**ASCI-W**

##  PC Cluster applications 

** *****PC Cluster applications***

- Arms and legs of the ES

- Graphics server #1IBM pServer 690 Model 681Disk 7 TB

- Graphics server #2,3HP J6700Disk 9.6 TB

- PC cluster Disk 8 TB

- User file server HP RP8400 Disk 12 TB

- CAVE like system

-    **×10**

-    **×5**

- 2D graphicsIBM IntelliStationsM Pro ×10

- 3D graphics ×5**via collaboration with ANU**

## An analogy between the human body and the ES system 

**An analogy between the human body and the ES system**** **

**Cerebrum**

**Cerebellum**

**Earth Simulator**

**User File Server,****Graphics Server,****PC Cluster**

**Spinal Cord**

**Arms &****hands**

**Legs &****feet**

**Graphics Servers,****CAVE,**
**3D graphic systems, GWS’s,****EWS’s,****PC’s**

## It takes all sorts to make the world.

**An analogy between the human body and a computer complex**

**Cerebrum**

**Cerebellum**

**High End Supercomputers**

**Special Purpose Computers**

**Spinal Cord**

**Small scale PC Clusters,**** GWS’s,****EWS’s,****PC’s**

**RightBrain**

**Left****Brain**

**PVP**

**MPP**

**Arms &****hands**

**Legs &****feet**

**Computational Grid**

**It takes all sorts to make the world.**

**Large scale PC Clusters**

## Earth Simulator Center

- http://www.asunam.com/mandara_worlds.htm

- Mandara shows an overlook of Buddha’s world on a tapestry.

**An analogy to the Buddha’s world (Mandara) **

- Nyorai sits in the center and is surrounded with many Bosatsu and other deities who support him.

**It takes all sorts ****to make the world.**

## Earth Simulator Center

- Myrinet2000

- Pentium III (1GHz)MM : 1GB×64

- Pentium III (1.2GHz)MM : 2GB

- Controller

- to ES

- Gigabit Ether

- Total disk volume  : about 8TB

** *****PC Cluster applications***

- The PC cluster system for ES** **** **

- 1. Hardware

## Earth Simulator Center 

** *****PC Cluster applications***

- The PC cluster system for ES (Cont.)

- 2. Basic software      SCore for Red Hat

- 3. Applications      management of distributed data storage     parallel visualization

- Performance comparison between the PC cluster and 1 node of the ES

|   | PC cluster | ES 1 node |
| --- | --- | --- |
| Total CPU | 128 GFLOPS | 64 GFLOPS |
| Total main memory | 64GB | 16GB |
| Total available disc volume | 8TB | <<12.5TB? |
| Total disk I/O performance |   2GB/s | 0.08GB/s |

## Earth Simulator Center 

** *****PC Cluster applications***

-  Application software      middle ware for  parallel I/O to manage distributed data storage       A candidate for immediate use          GFarm (_[http://datafarn.apgrid.org/](http://datafarn.apgrid.org/)_)	- Peta-to-Exascale global file system,           	- distributed parallel file system for Grid clusters,         	- single system image & parallel I/O, 	- Based on Grid and PC cluster technologies

- The ES needs a small scale GFarm.

## Earth Simulator Center 

** *****PC Cluster applications***

## Earth Simulator Center 

** *****PC Cluster applications***

-  Application software (cont.)
-      parallel visualization
-          PATLAS for 2D graphics
-            - Two styles (real-time and post processing)
-                           and two modes (interactive and batch) ,
-            - Developed by              the Japan Atomic             Energy Research             Institute
-          Vis5D for stereo graphics
-               A version for ES 1 node has been developed.              PC cluster version in future ?

## Earth Simulator Center 

** *****Summary***

- The development of the Earth Simulator system was successfully completed on schedule in the end of February, 2002.
- The ES achieved a LINPACK world record of 35.86 TFLOPS (87.5 % of its peak).
- The ES also achieved a 26.58TFLOPS sustained performance (64.9 % of its peak) on an atmospheric circulation model.  The performance is more than 5 times larger than the original target.
- Very exciting results on atmospheric and oceanographic sciences are coming out one after another.
- The management and interactive visual monitoring of many terabytes of simulation results are current key issues for the ES.The ES has introduced a prototype PC cluster to seek the best solution to these problems. The ES already employed PC(EWS) cluster technologies to control a large number of computing nodes.
- It takes all sorts to make the world. PC clusters are playing and will play very important roles in every world.

## Earth Simulator Center 

- Thank you for your attention !!!
- If you are interested in our project,
- please visit our web site.
- http://www.es.jamstec.go.jp