Introduction of New Open-use Data Analysis System of Astronomy Data Center- Its Replacement and the Updates
Kazuhisa Kamegai, Nobuhiro Tanaka, Makiko Fujikawa, Mizuki Isogai, Sin’itirou Makiuti, Takeaki Ozawa,
Satoshi Yamanaka, Shin-Ichi Ichikawa, Tadafumi Takata
Astronomy Data Center (ADC), National Astronomical Observatory of Japan (NAOJ)
Abstract: The Astronomy Data Center (ADC) in NAOJ provides the multi-wavelength data analysis system for researchers in astronomy and the related fields.
The users who have an account of the system are supported to carry out analytical research on astronomical observation data by using various kinds ofastronomical software covering a wide range of wavelengths, and other tools installed in the system. We are now in the process of replacing the computer
system to upgrade the computing performance (four times faster compared to the current system) and the disk capacity (two times larger). This allows users
to get a more powerful analysis environment. The renewed system will start its operation from March 2018.
Web Site:

Question & Request:

https://www.adc.nao.ac.jp/J/kaiseki_top.htm

consult@ana.nao.ac.jp

User Account Application
User ID application

Those who can apply:(1) Staff of NAOJ
(2) Researcher of astronomy and related field(3) The person who is allowed by the center chief

VPN ID application• required when a user login from out of NAOJ network• It is different from VPN for the NAOJ staff.

Japanese https://www.adc.nao.ac.jp/IDtoroku/index.html

Japanese https://www.adc.nao.ac.jp/IDtoroku/vpn.html

EnglishEnglishhttps://www.adc.nao.ac.jp/E/ID/IDtoroku_e.html

https://www.adc.nao.ac.jp/E/ID/vpn_e.html

ApplyClient Software

Personal PC

Loginoutside
NAOJ network
Userinside
NAOJ network

Data Analysis Servers (Current System)

VPNJob queuing

Login

Computers in Open-use Rooms
South Bldg. Open-use Rooms
13 Remote Login Terminal Computers

Batch Processing Analysis
Servers
 6 Middle-range servers

Interactive Data Analysis
Servers
 16 Middle-range servers

Subaru Bldg. Open-use Room
13 Terminal Workstations

CPU: 2.9GHz, 16core

CPU: 2.9GHz, 16core

RAM:128GB

 2 High-end servers

 10 High-end servers

ALMA Bldg. Open-use Room
9 Terminal Workstations

CPU: 2.9GHz, 16core

RAM:128GB

CPU: 2.9GHz, 16core

RAM:256GB

RAM:256GB

Refer to NFS
Large Volume File System for Temporary Use

Home Directories

Quota: 20 TB
Exp. Date: 6 months

Quota: 60 GB
Exp. Date: No

Network File System

Local Storage of Each Analysis Servers
Middle-range servers

High-range servers

Quota: 32 TB(16 TB per server)Exp. Date: 4 weeks

Quota: 16 TB(8 TB per server)Exp. Date: 2 weeks

Servres

Current System

Next System

System Replacement

CPUXeon E5 2690 2.9GHz

Xeon E5 2667
3.2GHz• System replacement is now on going.
• New System will be available on March 1st 2018.
• Following tables and graph are comparison between current and next systems.

Benchmark Score*1

14055

16654

Current
Next

Interactive Server (M)16 cores x 16 = 256

16 cores x 20 = 320

Current System

Next System

Interactive Server (H)

16 cores x 10 = 160

16 cores x 12 = 192

Home Area

16 [TB] x 2[machine] = 32TB

55 [TB] x 2 [machine] = 110 TB

Batch Server (M)16 cores x 6 = 96

16 cores x 2 = 32

Batch Server (H)

16 cores x 2 = 32

None

Total Num. of Core544

544

Local Storage of Servers

3PB(future plan)

3CoresStorage

Middle-Range Interactive Servers

16 [TB] x 2 [partition] x 16 [machine] = 512 TB 12.24 [TB] x 20 [machine] = 244.8 TB

High-End Interactive Servers

16 [TB] x 10[machine] = 160 TB

51 [TB] x 12 [machine] = 612 TB

Middle-Range Batch Servers

16 [TB] x 2[partition] x 6 [machine] = 192 TB

None

High-End Batch Servers

16 [TB] x 2[machine] =32 TB

None

RAM

Current System

Next System

SubTotal Capacity of Local Disks

896 TB

856.8 TBRAM Type

DDR3 1600 RDIMM

DDR4 2400 RDIMM

Large Volume File System

16 [TB] x 18 [partition] = 288 TB

102 [TB] x 16 [partition] = 1632 TB

Middle-Range Servers

128 GB / server

192 GB/server

Total

1.2 PB

2.6 PB

High-End Servers

256 GB /server

256 GB/serverSoftware

42.6PB2*1: From https://www.passmark.com

10
Total Performance*(* estimated from benchmark test)• OS: Red Hat Enterprise Linux 6 Workstation/Server (current system) à Red Hat Enterprise Linux 7 Workstation/Server (next system)• Following software packages for astronomy and science are installed on the analysis system.
• Many development environments, web browsers, editors, image processing software, programming languages are also available.

Name

VersionName

VersionName

VersionName

VersionName

VersionAIPS

31-Dec-16

ds97.4Java NewStar

20150422

NewStar20150422

starfinder

1.8.2

Astrometry.net

0.67

fv

5.4

Mathematica

9.0.1, 10.4.1

NOSTAR

20120528

STSDAS

3.17

CASA

3.3.0 – 5.1.1

GILDAS

sep16bMCSMDP

1.1.3

PBS Professional

13.1.2SWarp

2.38.0CASA pipeline

5.1.1

gnuplot

4.6.6, 5.0.6

MCSRED

20141205

Pgperl2.21

TABLES

3.17

cdsclient

3.8.0

gsl-devel

1.13-1 (64bit)

MCSRED2

20170515

Pgplot

5.2.2

VEDA

CFITSIO

3.39

Heasoft

6.13

MIDAS

13SEPpl1.2

Pmw

1.3.3

WCSTools

3.9.2

COMICS q_series 4.2

HyperZ

1.1

MIRIAD

4.3.8

Scamp

2.0.4

Cpgplot

IDL

8.2, 8.5.1

Montage

4.0

SDFRED

1.4.1, 2.0, 2.0.1

xpa

2.1.15IDL Astronomy
User's Library
IRAF

2013.01.03

MSCRED

5.05

SExtractor

2.19.5x11iraf

2.0beta

MultiNest

3.6

SkyCat3.1.2

Nero Linux

4.0.0.0SM

2.4.305.2.2

2.14.1, 2.16,2.16.1

Storage [PB]