Osaka University, Japan
SC16 BOOTH 1437

Large-scale Computing and Visualization Systems at the Cybermedia Center
Overview of high-performance computing environment
at the CMC
L arge - s c ale c omputing systems (SX-ACE, VCC, and HCC), and large - s c alevisualizati on systems are depl oyed on CM C - Sup erc omputer net work, a .k.a
CMC-SCinet, a low-latency and wide-bandwidth network. This architectural design
allows users to ac c ess to large -scale storage systems, per form large -scale
high-performance computation and analysis on our large-scale computing systems,
and then visualize its computation and analysis results without loosing any important
information on our large-scale visualization system.

Large-scale Computing SystemThe large-scale computing systems at the CMC are classified into (1) Vector-typed Supercomputer and (2) Scalar-typed Supercomputer.

SX-ACE

VCC (PC Cluster for large-scale visualization)
Type: Vector
OS: Super UX

Type: Scalar
OS: Linux# of nodes: 1536
# of cores: 6144
Total memory: 96 TB
Peak performance: 423 TFlops

SX-ACE is a “clusterized” vector-t yped
supercomputer, composed of 3 cluster,each of which is composed of 512 nodes.
Each node equips 4-core multi-core CPU
and a 6 4 GB main memor y. These 512
nodes are interconnected on a dedicatedand specialized network switch, called IXS(Internode Crossbar Switch) and forms acluster. Note that IXS interconnects 512
nodes with a single lane of 2-layer fat-tree
structure and as a result exhibits 4 GB/s foreach direction of input and output between
nodes.
Library
MathKeisan(BLAS, LAPACK, etc)
ASL, ASLSTAT, ASLQUAD# of nodes: 65# of cores: 1300
Total memory: 4.160 TB
Peak performance: 26.0 TFlops
Accelerator: NVIDIA Tesla K20×59

PC cluster for large -scale visualization(VCC) is a cluster system composed of 65
nodes. Each node has 2 Intel Xeon
E5-2670v2 processors and a 64 GB main
memory. These 65 nodes are interconnected on InfiniBand FDR and forms a cluster.
Also, this system has introduced ExpEther, asystem hardware virtualization technology.
Each node can be connected with extension
I/O nodes with which GPU resource, andSSD on 20Gbps ExpEther network. A major
characteristic is that this cluster system isreconfigured based on user’s usage andpurpose by changing the combination ofnode and extension I/O node.

MPI/SX

Library

HPF/SXIntel MKL(BLAS, LAPACK, etc)

XMPIntel MPI, Open MPI

HCC (General-Purpose PC Cluster)

Type: Scalar (VM)
OS: Linux# of nodes: 575# of cores: 1150
Total memory: 2.6 TB
Peak performance: 16.6 TFlops

IPC-C (Image Processing PC Cluster on Campus)

Type: Scalar
OS: Windows/Linux# of nodes: 7# of cores: 84
Total memory: 448 GB
Peak performance: 1.68 TFlops
Accelerator: NVIDIA Quadro K5000×7IPC-U (Image Processing PC Cluster on Umekita)

Type: Scalar
OS: Windows/Linux# of nodes: 6# of cores: 72
Total memory: 384 GB
Peak performance: 1.44 TFlops
Accelerator: NVIDIA Quadro K5000×6

Application
GROMACS

Gaussian09

Marc / Mentat

Nastran

GROMACS
for GPU

IDL

Dytran

AVS/Express(DEV/PCE/MPE)

LAMMPS

NEC Remote
Debugger

PatranOpenFOAM

NEC Ftrace
viewerAdams

Large-scale Visualization System
The large-scale visualization systems at the CMC are set up on Campus and on CMC’s Umekita Office. Large-scale and interactive visualization
processing becomes possible through the dedicated use of PC cluster for large-scale visualization (VCC) on these systems.

24-screen Flat Stereo
Visualization System

The visualization system is composedof 24 5 0 - inc h Full HD (1920 x10 8 0)
stereo projection module (BarcoOLS-521), Image-Processing PC cluster(IPC-C) driving visualization processing
on 24 screens. A notable feature of thisvisualization system is that it enables
approximately 50 million high-definitions te r e o d i s p l ay w i t h h o r izo nt a l 15 0
degree view angle.

15-screen Cylindrical Stereo
Visualization System

This visualization system is composedof 15 46-inch WXGA (1366x768) LCD,an d Image - Proc es sing PC Cluster(IPC-U) driving visualization processing
on 15 screens. A notable characteristicof this visualization system is that it
enables approximately 16-million-pixel
very high-definition stereo display.

Contact : system@cmc.osaka-u.ac.jp Visit us at www.cmc.osaka-u.ac.jp