A Virtual Observation Network System
for Global Ground-Based Observatories

Ken T. MURATA, Tsutomu NAGATSUMA, andShinichi WATARI
National Institute of Information and Communications Technology
Applied Electromagnetic Research InstituteSpace Weather and Environment Informatics Laboratory
4-2-1 Nukui-kita, Koganei 184-8795 JAPANTwo methodologies for Space Weather

Spacecraft
Simulation

Groundbased

Activeexperiment

Observation
via Ground-based observatory
and satellite

Modeling
Test particle

Simulation
via super computer

NICT Space Weather Monitoring Networks

Magnetometer

HF radarMagnetometer & HF radarobservations in Far East SiberiaSouth-East Asia low
latitude IOnospheric
Network (SEALION)

Domestic Ionosonde
Network & Hiraiso
Solar Observatory

Ionosonde
Ionosphericobservation at
Syowa Station

Hiraiso Solar Observatory
Biak

4

NICT Space Weather Numerical Simulations
Solar Wind Monitoring(ACE satellite)

Mag. Field data
（SOHO satellite)

Sun/Solar Wind simulation

input

Sun

Vis.

Earth

Super Computer

telemetry

input

input

Vis.

ACE antenna

Magnetosphere simulation

Ionosphere simulation

NICT Web“Science Cloud”; A facility for the 3rd methodology
Informatics via “cloud system”
Data intensive
approach oflarge-scale data

Data
processing

Visualization

Database
Data

Data

Spacecraft
Simulation

Groundbased

Activeexperiment

Observation
via Ground-based observatory
and satellite

Modeling
Test particle

Simulation
via super computerIntegrated Database for SW data
Computer
Simulation

Real-time
Data

Archived
DB

Observatory

WWW

Database
Visualization

Data
processing

Integrated Database for SW data
Computer
Simulation

Real-time
Data

Archived
DB

My
present
talk

Observatory

WWW

Database
Visualization

Data
processing

Topics of Space
Weather Researchand Operation
Activities at NICTand Future
Outlook(byMurata et al.):(ST19)

Integrated Database for SW data
Computer
Simulation

Real-time
Data

Archived
DB

Observatory

Automaticdata
collection(download)

WWW

Database
Visualization

Data
processing

NiCTyDLA

NICT Technology
Automatic Data Collection System
for Science Data
Sept. 2010

Facilities(Data providers)TargetTarget Countries

7

DLA

Target Organizations

33

Target Data Types

345

FTP

Download AgentHTTP
FTPS/SFTP⑥ Download data files
RSS

RSS

#

Collected meta-data

5,724,175

Collected data files

1,058,047

Total data file size

370TB

For Space Weather data

RSS
⑦ SOAP Responsewith DIME-Attachment

Web application

Download Agent(DLA)⑤ SOAP Request with
Download Request② SQL Query① SOAP Request③ DataSet
Web Service

Meta-DB

NiCTy④ SOAP Responsewith Meta Data
User

9

9

Automatic Data CollectionMore than 11
million files

More than 12
tera bytes

Target Data:
More than 400

Integrated Database for SW data
Computer
Simulation

Real-time
Data

Archived
DB

Observatory

Automatic datacollection (download):
Example of GPS data
crawler

Visualization

WWW

Database

Data
processingGlobal GPS Receiver Network

As of April 2010, NICT is collecting all the available GPS receiver data(~5,000 receivers) which belong to GEONET, SOPAC, IGS, CORS, EPN, etc.
We plan to provide regional/global high-resolution maps of absolute TEC,
detrended TEC, ROTI, loss-of-lock on GPS signals.

13

GNSS Data providers（including future plan）
NICT GNSS TEC Data Service（5000 receivers）⇒5000 files/day
SOPAC（World）
CORS（USA）

EPN（Europe）

EPN Regional Networks

GEONET（Japan）

IGS（World）
Multi GNSS（JAXA/Japan）

AFREF（Africa)
KMITL・BAKO等（S-E Asia）

GeoScience等（Australia）

Trend of the number of GSP receivers
6000
5000
4000
3000
2000
1000
0



国外
World-wide
GEONET

Japanese(GEONET)

The annual trend of the number of GSP receivers (world-widesince 2000 and domestic (Japan) since 1997) .

15

Ionospheric Disturbance via High-Resolution GPS-TEC

Region# of GPS Rec.

~1,200 receivers~1,600 receivers~830 receivers

GPS
Receivers

TEC depletion due
to solar eclipse

Nighttime MSTID

Detrended
TEC Map(30sec,0.15x0.15)Asia-Oceania GPS-TEC map…

TEC variation due to
AuroraIntegrated Database for SW data
Real-time
Data

Computer
Simulation

Satellite
DB

Observatory

RemoteOperation

WWW

Database
Visualization

Data
processing

NICT Space Weather Monitoring Networks

Magnetometer

HF radarMagnetometer & HF radarobservations in Far East SiberiaSouth-East Asia low
latitude IOnospheric
Network (SEALION)

Domestic Ionosonde
Network & Hiraiso
Solar Observatory

Ionosonde
Ionosphericobservation at
Syowa Station

Hiraiso Solar Observatory
BiakMore than 4 operational policies

Virtualization of observation and
FW/Routerdata archive
Routing block

Virtualization
・VPN network
・Warning system
・Monitoring system

Server•HK monitor•routing•redundancy

Data transfer
monitoring server

VPN client

VPN
network

Distributed
disk

Data Transfer
・Automatic repeat-request(ARQ)・Data file consistency

Observatory

VPN server

Distributed storage
Management server

WWW server
Distributed
disk

L2 network

NICT

Warning (observatories)

Manager

Status monitoring (observatories)

Data transfer monitoring(observatories)

Monitoring server

Observatories

Observatory Equipment Monitoring Web
Green: Normal, Orange: Warning, Red: Mal-functional, Grey: unequippedSummary• Space Weather research works should be
separated from data collection.
– Researchers can simply analyze any types of data
without paying attention to data collection, data
management and data stewardship.

• NICT has successfully developed a virtual
database for space weather data.
– For (1) archived data over the Internet, (2) real-timedata from NICT observatories with remote operation,(3) real-time data from satellites and ground-based
observations, (4) large-scale data from supercomputers.
22

Thank you for your attention!

Weekly Space Weather News
http ://www.seg.nict.go.jp/wsw

24

Green: Normal, Orange: Warning, Red: Mal-functional,
Grey: unequippedTwo methodologies for Space Weather

Spacecraft
Simulation

Groundbased

Activeexperiment

Observation
via Ground-based observatory
and satellite

Modeling
Test particle

Simulation
via super computer

NICT Space Weather Monitoring Networks

Magnetometer

HF radarMagnetometer & HF radarobservations in Far East SiberiaSouth-East Asia low
latitude IOnospheric
Network (SEALION)

Domestic Ionosonde
Network & Hiraiso
Solar Observatory

Ionosonde
Ionosphericobservation at
Syowa Station

Hiraiso Solar Observatory
Biakhttp://www.seg.nict.go.jp(to be open Apr. 2012)

29

NICT Space Weather Numerical Simulations
Solar Wind Monitoring(ACE satellite)

Mag. Field data
（SOHO satellite)

Sun/Solar Wind simulation

input

Sun

Vis.

Earth

Super Computer

telemetry

input

input

Vis.

ACE antenna

Magnetosphere simulation

Ionosphere simulation

NICT Web

観測支援システムの概要
インターネット
独自ルーティング禁止

③一元管理
・VPN網
・ワーニングシステム
FW ・モニタリングシステム

所外NW(国内）

観測所

L3スイッチ

①マシン構成
・高耐性
・障害対策
・冗長化
所外NW(国外）
観測マシン／
VPNクライアント

所内研究系NW

Gfarmクライアント

通信管理
サーバ

VPN
網

Gfarm
ディスク

②データ転送・再送制御
・効率の良い帯域利用
・データ整合性の保証

VPNサーバ

One Space Net
グローバル観測網仮想化

TDW
VPN
セグメント

ユーザ
セグメント
30

グローバルGPS-TEC計画
世界のGPS（L0）データ公開サイト
SOPAC（世界）CORS（米国）

NICT開発アプリ（配布）EPN（欧州）

GPSdata(L0)GPSデータの守秘性（非公開データ）

変換アプリケーション（新規開発）

GPSdata(L1/L2)

EPN Regional
Networks

GEONET（日本）

IGS（世界）

GPS-TECデータの有用性（研究・実用）

GPS-TECデータの標準化（L1）（“RINEX準拠”）

GeoScience等（豪州）

L0/L1データ（メタデータ）
自動収集

GPSdata(L0)
変換アプリケーション（新規開発）

GPSdata(L1/L2)
サイエン
スクラウド
（WDS）DB

NICTから標準化提案へ（統合データシ
ステム室と協力）

GPS-TECプロット（L2）DB化

Multi GNSS（JAXA）

AFREF（アフリカ）
KMITL・BAKO等（東南アジア）

標準化/
DB化

研究・
共同研究

論文
10件
論文1件

論文2件

論文3件

論文2件

各地域・領域の電離圏先端研究へのGPS-TECデータの提供と共同研究
これまでの成果（2009年から）GPSdata(L0/L1/L2) DB化

シミュレーション融合（今中期～次期中期）
GPSデータファイル数（サイズ）
過去約10年⇒730万ファイル（3.5TB）
今後（予想）⇒360万ファイル（1.7TB）/年
ステーション数：約10,000⇒マニュアル収集は不可能⇒NICTYによる自動収集

定性的比較から定量的比較へ⇒データ同化モ
デル実現へ
GPS-TECマップ：
観測のグローバル化

GPS-TECシミュレーション：
高精度化・高機能化

31

観測ネットワークモニター

20120129(CX)

20120125(TBS)Space Weather Forecast Meeting@NICT

Broadcasting of S.W. news
on the Internet
http://swc.nict.go.jp/
Weekly SW news

NHK BSプレミアム「コズミックフロント（オーロラ）」

Tonight!
9:00 p.m.

NICT Global MHD simulation
on 2011 Oct. 7

topics• Brief introduction of NICT space weather
operations and researches• A new methodology for space weather
forecasting in NICT
• AOSWA: Asia-Oceania Space Weather Alliance

“Science Cloud”; A facility for the 3rd methodology

Big Data!
Data

Data

Spacecraft
Simulation

Groundbased

Activeexperiment

Observation
via Ground-based observatory
and satellite

Modeling
Test particle

Simulation
via super computer

“Science Cloud”; A facility for the 3rd methodology
Informatics via “cloud system”
Data intensive
approach oflarge-scale data

Data
processing

Visualization

Database
Data

Data

Spacecraft
Simulation

Groundbased

Activeexperiment

Observation
via Ground-based observatory
and satellite

Modeling
Test particle

Simulation
via super computer

Concept of NICT Science Cloud

Archived
database

Internet

VisualizationWeb Server

A variety ofObservation Data

Large-Scale
Simulation Data
Processing

Spacecraft
Groundbased

Observation

Analysis

Large-scalestoragewith many
core
Supercomputers

Informatics

Simulation

40

Ionospheric Disturbance via High-Resolution GPS-TEC

Region# of GPS Rec.

~1,200 receivers~1,600 receivers~830 receivers

GPS
Receivers

TEC depletion due
to solar eclipse

Nighttime MSTID

Detrended
TEC Map(30sec,0.15x0.15)Asia-Oceania GPS-TEC map…

TEC variation due to
AuroraGlobal GPS Receiver Network

As of April 2010, NICT is collecting all the available GPS receiver data(~5,000 receivers) which belong to GEONET, SOPAC, IGS, CORS, EPN,
etc.

We plan to provide regional/global high-resolution maps of absolute TEC,
detrended TEC, ROTI, loss-of-lock on GPS signals.

42

GNSS Data providers（including future plan）
NICT GNSS TEC Data Service（5000 receivers）⇒5000 files/day
SOPAC（World）
CORS（USA）

EPN（Europe）

EPN Regional Networks

GEONET（Japan）

IGS（World）
Multi GNSS（JAXA/Japan）

AFREF（Africa)
KMITL・BAKO等（S-E Asia）

GeoScience等（Australia）

Trend of the number of GSP receivers
6000
5000
4000
3000
2000
1000
0



国外
World-wide
GEONET

Japanese(GEONET)

The annual trend of the number of GSP receivers (world-widesince 2000 and domestic (Japan) since 1997) .

NiCTyDLA

NICT Technology
Automatic Data Collection System
for Science Data
Sept. 2010

Facilities(Data providers)TargetTarget Countries

7

DLA

Target Organizations

33

Target Data Types

345

FTP

Download AgentHTTP
FTPS/SFTP⑥ Download data files
RSS

RSS

#

Collected meta-data

5,724,175

Collected data files

1,058,047

Total data file size

370TB

For Space Weather data

RSS
⑦ SOAP Responsewith DIME-Attachment

Web application

Download Agent(DLA)⑤ SOAP Request with
Download Request② SQL Query① SOAP Request③ DataSet
Web Service

Meta-DB

NiCTy④ SOAP Responsewith Meta Data
User

44

44

Automatic Data CollectionMore than 11
million files

More than 12
tera bytes

National Institute of Information and Communications Technology

Multivariate AR Prediction (Input: + dyn. P, IMF Bz)

NEXT TALKWhat you do is only…

Archived
database(Capsulation)

Data analysis

Internet“getdata(date, data)”

A variety ofObservation Data
Processing

Spacecraft
Groundbased

Observation

Large-scalestoragewith many
core

Informatics
Web designer

Schematic Pictures of “convection” of magnetic field lines

48

Simulation data size
global MHD code by K. Fukazawa

SX-8・Spatial and time resolution
450(x)×300(y)×300(z) –uniform grid (dx=0.2Re, dt=0.5sec)
0.5 sec

Simulation

simulation

AVS

E, B , p,ρ, V(-1GB)

E, B , p,ρ, V(-1GB)

time

E, B , p,ρ, V(-1GB)

E, B , p,ρ, V(-1GB)

E, B , p,ρ, V(-1GB)

Visualization

visualization

15TB

2 hours (14400 steps)

E, B , p,ρ, V(-1GB)

50

Distributed Storage/ Parallel Visualization （data size: 15TB）
Traditional Method (36 days)

Parallel Visualization (2 days)

Data Read Time (I/O Time)

Data Read Time (I/O Time)

20MB/sec -> 1.5 million sec.-> 18 days

100MB/sec x 200 cores -> 1500 sec. -> 30 min.

Data Processing Time

Data Processing Time

14400 steps x Tracing time (10 sec.) -> 14thousands sec. -> 2 days

14400 steps x Chasing time (10 sec.) -> 14thousands sec. -> 2 days

Visualization Time

Visualization Time

14400 steps x120sec -> 16 days

14400 steps x 120sec./200 cores -> 4 hours

1G

NFS: -20MB/sec
10G

Middle end storage

10sec.

eSATA:-100MB/sec

Disk: Low end storage ($160/TB)

CPU: 200 cores

Super High Time-Resolution Visualization:
Milk Crown Visualization• time resolution: 60 sec. (not shown herein)• frozen-in broken• time resolution: 0.6 sec. (7,000 files)• frozen-in for one reconnection event• time resolution: 0.06 sec. (70,000 files)• reconnection captured!

Crown Milk可視化

Fixed points
T+200dt

Traditional Method

T+100dtT(vx, vy, vz)

Plasmaelement(vx, vy, vz)

dt

dt“Frozen-in theory”

 
dB
 2
   (V  B ) 
 B
dt
0

(vx, vy, vz)
dt

T
T+dt

T+2dt

T+3dt

Present Technique -Tracing (needs to store all time-step data)

Magnetic field lines via present technique(visualization time step = 0.5 sec.)
Global 3D MHD simulation
Crown Milk可視化

64bit 3D player
developed by
NICT

“Crown-milk view” of reconnections
at the dayside magnetospherethe first successful visualization of dayside reconnection!!

topics• Brief introduction of NICT space weather
operations and researches• A new methodology for space weather
forecasting in NICT
• AOSWA: Asia-Oceania Space Weather AllianceISWI (International Space
Weather Initiative) WG
2009~2011

UN (United Nations)

WMO（World Meteorological Organization)

56

Long-Term Sustainability WG
2011~2014
EG-C (SW)2011~
ICTSW (International
Coordinate Team for Space
Weather) 2009~
ISES

ICSU（the International Council for Science）
1931~

WDS (World Data
System)WDC

Regional Space Weather Week/Workshop

International SW (operation) organizations

FAGS

European Space Weather
Week
Asia-Oceania Space Weather
Alliance
Space Weather Workshop
NOAA

Space Weather Regional Warning Centers ofInternational Space Environment Service (ISES)Space Research Center(Warsaw, Poland)
Lund Space Weather Center

Hydrometeorological Service(Lund , Sweden)(Moscow, Russia)

RRA (Jeju-do,South Korea)

Royal Observatory of Belgium(Brussels, Belgium)

Natural Resource Canada(Ottawa, Canada)

NICT (Tokyo, Japan)

Institute of Atmospheric Physics

Beijing Astronomical Observatory(Beijing China)(Plague, Czech)

National Physical Laboratory(New Deli, India)

Hermanus Geomagnetic Observatory(Herumanus, South Africa)
IPS Radio and Space Services(Sydney, Australia)

NOAA/SWPC(Boulder , U.S.A.)

INPE (Sao Jose dos Campos, Brazil)

Space Weather
Workshop @USA

Space Weather
Week @Europe
58

AOSWA meetings
2010.12 - LAPAN workshop• The first kick-off meeting between Japan, Indonesia, Australia, India, and Malaysia
2010.01.2 - SEALION workshop @Thailand• Indonesia, Vietnam, Taiwan, USA, Brazil, Thailand, Laos, Philippine , China and Japan• 2nd Kick-off meeting of the AOSWA
2011.04 @NOAA, USA• Space Weather Workshop @NOAA, USA & ISES meeting 2011
• Local meeting between A-O ISES countries
2011.08 - AOGS @Taiwan• AOGS; “Collaborative Researches and Operations of Space Weather Forecasting in
Asia-Oceania region”• 3rd kick-off meeting of the AOSWA
2012.02 AOSWA 1st Workshop @Chiang Mai, Thailand• 10 countries, 25 organizations, 77 participants!
2012.08 AOGS2012 @Singapore• Asia-Oceania Space Weather Alliance: AOSWA session• AOSWA informal meeting2013 AOSWA 2nd Workshop• (To be fixed during the 1st workshop)

59

AOSWA 1st Workshop

Call for Paper

The First AOSWA Workshop
The First Asia-Oceania Space Weather Alliance Workshop

22 – 24 February 2012Imperial Mae Ping Hotel, Chiang Mai, Thailand
The Asia-Oceania Space Weather Alliance (AOSWA) is a regional forum for thedevelopment of collaboration and promotion of the space weather activities in the Asiaand Oceania region.
The AOSWA 2012 in Thailand will be held during 22 – 24 February 2012, in Chiang Mai,
Thailand.
The AOSWA 2012 is regional/international workshop, providing an excellent forum forresearchers and operators of space weather in Asia-Oceania and other countries to present
and discuss operational collaborations, data exchanges and some competitions, which leads
to the development of space weather activities in the region.
Everyone, who works in space weather fields in Asia-Oceania and other regions, isencouraged to submit a paper to the workshop. New research results and operational
issues are welcome. Significant discussions are expected, especially from the view of the
Asia-Oceania regional collaborations.

Possible Topics of Presentation
1.
2.
3.

Ionospheric Variations and Their Effect on Radio Propagation
Geospace Variations – Causes and Effects
Present status and future plan of operation, service, and modeling of space weather

Important dates
1.
2.

Abstract Submission: 20 Dec. 2011 – 4 Jan. 2012
Registration: 20 Dec. 2011 – 16 Jan. 2012

For more information / Contact
Web site: http://aoswa.nict.go.jp
Email address: sw-project-office@ml.nict.go.jp

Committee Chair:
TBD, Japan
Co-Committee Chair:
TBD, Thailand
General Committee:
Dr. Ken T. Murata (NICT, Japan)
Dr. Phil Wilkinson (IPS, Australia)
Dr. Huaning Wang (NAOC, China)
Dr. Rupesh M. Das (NPL, India)
Dr. Bae Seok-Hee (RRA, Korea)
Program and Organizing Committee:
Dr. Ken T. Murata (NICT, Japan)
Dr. Dave Neudegg (IPS, Australia)
Dr. Huaning Wang (NAOC, China)
Dr. Siqing Liu (NAOC, China)
Dr. Xiaoxin Zhang (NAOC, China)
Dr. A. K. Upadhayaya (NPL, India)
Dr. Bae Seok-Hee (RRA, Korea)
Dr. Shinichi Watari (NICT, Japan)
Dr. Tsutomu Nagatsuma (NICT, Japan)
Dr. Takuya Tsugawa (NICT, Japan)
M. Shikatani (NICT, Japan)
Dr. Takashi Maruyama (NICT, Japan)
Local Organizing Committee:
Dr. Tsutomu Nagatsuma (NICT, Japan)
Dr. Masayuki Fujise (NICT, Japan)
Dr. Akachai Sang-In(CMU, Thailand)
Dr. Suttichai Premrudeepreechachan(CMU, Thailand)
Dr. Tharadol Komolmis (CMU, Thailand)
Dr. Ukrit Mankong (CMU, Thailand)

AOSWA 1st Workshop
77 participants from 25 organizations of 10 countries
Australia, China, (India), Indonesia, Japan, Malaysia, Philippines,
South Korea, Thailand, and Vietnam

Magnetic Equator

Magnetic Equator

63

GPS-TEC at Sumatra island

Dense and wide-coverage GPS receiver
network can reveal their spatial structures,propagation directions, and temporal
evolutions.

GPS receivers all over the world 5000 receiver data available online

Current

Near Future Plan & Vision

TID?
EIA?

TID
EAI

Plasma Bubble?

EIA?
TID?

Plasma Bubble

EAI
TID

Associates (so far)
http://aoswa.nict.go.jp/associates.html

AOSWA mailing list
<AOSWA@ml.nict.go.jp>
Join Us!

64

AOGS 2012:
Asia-Oceania Space Weather Alliance: AOSWA (ST26)
submission deadline (extended) 21 Mar 2012

As summary…
Informatics via “cloud system”
Data intensive
approach oflarge-scale data

Data
processing

Visualization

Database
Data

Data

Spacecraft
Simulation

Groundbased

Activeexperiment

Observation
via Ground-based observatory
and satellite

Modeling
Test particle

Simulation
via super computerInvitation:
NICT Science Cloud User registration Web
http://www.seg.nict.go.jp

English site will beavailable on April, 2012.

Contact: ken.murata@nict.go.jp

Thank you for your attention!

Weekly Space Weather News
http ://www.seg.nict.go.jp/wsw

NICT Data Download Site
http://seg-stars-s01.nict.go.jp/STARS-DLWeb