平成17年発足特定領域研究公募研究 A01-23

最新情報技術を活用した超大規模天文データ解析機構の研究開発
研究代表者：
Masatoshi Ohishi / NAOJ, Sokendai & NII
大石雅寿 / 国立天文台，総合研究大学院大学，
国立情報学研究所
masatoshi.ohishi@nao.ac.jp

2Usrev
nioe

Ynr
uose
D

pokt

Overview of the JVO Portal Service
LDAP
解析
解析
解析
Analysis
Servers

MDS

Web Service
HTTP Get
FTP
LDAP
P. Reg.

In

JVO
voke

Se
Di rvic
sco e
very

Grid
SystemAuth.
eUstsequerR

SDSS

InvokePortalUser
Storage

S. Reg.

SkyNode1.0…

InvokeSubaru2MASSData ServiceOther VOs
ata gdta tin RegistryeM rves
HaQSO

P. Reg.

SIAP/SSAPSkyNode
0.7.4 3

Astronomical Virtual Observatories~ A Data Grid Environment ~Canada VO

China VO

Data Service Operations in JVO have just been started
March, 2008. 1300+ data resources are accessible.
2008 Dec 09

2008年度 A01研究会

4観測データの解析処理• 銀河団Cl0939+47の近赤外線画像– 生データでは何が撮像できたか分からない

キャリブレーション

観測生データ

処理済みデータ

電気ノイズ、熱ノイズを補正し、相関をとりながら画像40枚を積分処理 5

SuprimeCam Data from Subaru•SuprimeCam Data ~ 10TB. It takes 154
days to analyse all the data.  parallel
processing is crucial• Detailed analysis of all theSuprimeCam data could lead to: detection of the Cosmic Strings bymeans of the gravitational lens effectdetection of outliersetcSuprimeCam Field of View
SuprimeCam FOV0.2”/pix

160MB/shot~ tens GB/night

Upgrade toHyper SuprimeCam (2011?)> 10 x SuprimeCam
VIMOS/VLTWFPC2/HSTSubaru Data Archive
SkyNode
JVO
Dedicated LineMASTARS
18 month
SMOKA

Mitaka AdvancedSTARS

Subaru Mitaka Okayama
Kiso ArchiveSTARS
Subaru Telescope
Archive SystemSTARS: a sub-system of the Subaru
Telescope, not publicMASTARS: a mirror of STARSSMOKA: public archive system

2008 Dec 09

2008年度
2008年度 A01研究会
A01研究会8

JVO: Virtual Observatory Web Portal

Cumulative Data Volume ofSuprimeCamCumulative Data Size (TB)

15 TB/year

1.5 TB/year
Upgrade toHyper-SuprimeCam ?

Year

9

SuprimeCam CCD

CCD gap
Bad pixel /Cosmic Ray
Non-uniformity

An Example of Image Data
Processing
Raw Data

Flat correction

Coadd
imagesSky subtraction

Final Image

11

CCD Image Calibration / Reduction
Raw
Bias
Flat
CCD
Subtracted
Raw
Bias
Frame
Flat
Frame
Frame
CCD
SubtractedRaw
Bias
Frame
FlatFrame
Frame
CCD
Subtracted
Raw
Bias
Frame
FlatFrame
Frame
100~1,000
CCD
Subtracted
Raw
Bias
Frame
FlatFrame
Frame
100~1,000
CCDRaw
Subtracted
Bias
Frame
FlatFrame
Frame
100~1,000
CCD
Subtracted
1FrameFrame
30Framemin
100~1,000
130 min
100~1,000
Flatfield
130 min
100~1,000 Frame
Flatfield
130 minFrame
Flatfield
130 minFrame
Flatfield
1FrameFlatfield
Frame
Flatfield
Frame

40~400 min

10xN (N=3~100)

120 ~660 min

Mosaic Frame

One day for each observation nightCurrentsituation
inastronomy

ManualManual（Instr.A）（Instr.A）

ManualManual（Instr.B）（Instr.B）

ManualManual（Instr.C）（Instr.C）

Subaru Telescope
Data Archive（10TB）
Downloadby handSoftware for instr. A
Software for instr. B
Software for instr. C

Subaru Data Analysis
and Virtual Observatory
4. Retrieve
reduced data

User disk
disk space
spaceUser

1. Request Data

3. Save thereduced data

Subaru Telescope
Telescope
SubaruData Archive
Archive
Data（10TB）（10TB）

2. Reduceraw data
JVO Portal Service13Subaru Data Analysis GRID system
5. Data Transfer FTP~30 CPU CoresDAS
Data Analysis Service0. DAS server periodically report
its status (load average…)

MDS
Monitoring andDiscovering
Service

1 Gbps x 11ports

JVO
Portal48 Gbps

1 Gbps x 5 ports

SRS

2. Query an available
DAS server.

DSS

3. Job submit
6. Data Transfer FTP

1. DataRequestStorage Resource Service
30 TB

4. Search data location on SRS

14

Experiment (58mosaic/12CPU Core)

Raw Data
6872 files (120 GB)

All the archived
Data
data（～2000 fields） can Flat-field
581 files (20 GB)
be analyzed in 4 days !
（３０CPU Cores）

Access to the SuprimeCAM Data
•On-Demand
Mosaicing of images
and calibrations•Pre-processedmosaic images arealso accessible•~ 10 Tera bytes ofdata
Mostly used/downloaded
from the JVO portal
2008 Dec 09

2008年度 A01研究会

16

JVOアクセス統計 (2008 Nov)

JVO公式運用開始
2008 Dec 09

2008年度 A01研究会

17Computing Grid Services in VO• Subaru data reduction pipeline system– SuprimeCamデータを高速処理– On-Demand データ処理機構–…

• Backend computing system of the JVO– 画像やスペクトルからのカタログ生成– photo-z 計算  遠方銀河の距離を推定– 各種画像演算–…

各地の天文台に解析プログラムが存在
2008 Dec 09

2008年度 A01研究会

18

Testbed for NAOJ-KEK federation User Browsers
User Browsers
NAOJ Site

GridVM Eng

KEK Site

PortalPortalPortalSSSS

SuperSched

IS-NAS

IS-NAS

IS-CDAS

IS-CDAS

SINET3

Private network

Infosys-NAS

192.168.2.101~

Infosys-CDAS

GridVM Eng

GVM Ser

GridVM Ser

GridVM Serv
MDS

Computenodes

AMS

MDS

FireWall

AMS.
AMS

Gfarm

Gfarm

MetaData Serv
AccessManage
Gfarm
Storage

DataGrid part

NAT/DNS

NAT/DNS

UMS/VOMS

VOMS/KEK

Test VO: naokek
2008 Dec 09

2008年度 A01研究会

UMS/VOMS

NAT/DNS

UMS/VOMS

Compute nodes19Federation Experiment
between NAOJ-KEK•

Setup astro libraries at KEK site

•Job submission to KEK with Work
Flow Tool(WFT) at the NAOJ Portal•

Input data are transferred from NAOJ
and Output data are staged-out toNAOJ portal
NAOJjob sub

NAREGIServers
retrieve

SUBARU Telescope in Hawaii

Input Data:(2.7 GB)
10 CCD mosaic images
160MB x 17

KEK

NAREGIServers

Astro lib(1GB)
Data 2.7GB

Process: 10 Hours
flat, bias
correct distortion
astrometry
mosaicing
coadd 17 frames
Visualization•Output data was processed with vis.
software as shown in the right picture.

2050k+ objects identified in this frame.

Summary• A GRID computing system for Subaru dataanalysis– All the archived data (8 years)
More than one year (1CPU)  One week

– Web-based operational system has been
completed  most requested• Successful experimental federation between
NAOJ and KEK through the NAREGI Gridmiddleware• More Data Contents added
2008 Dec 09

2008年度 A01研究会

21