Introduction of global data systems for Solar
Terrestrial science in Asia-Oceania
T. Iyemori, B. Ritschel,IUGONET Advisory Board andIUGONET Developer Team

Advanced space weather research and predictionneed interdisciplinary databases including real-time data served by proper data system.

Contents
1. Necessity of “data system” for space weather (SW)research and forecast.
2. Introduction of the “IUGONET” and “METADATA”,
and a plan of its extension and enhancement ofinteroperability with other data systems.
3. Collaboration in Asia/Oceania SW community
through “metadata exchange”
IUGONET: Inter-university Upper-atmosphere Global Observation
NETwork(2009-2015 MEXT project by 4 universities and a national institution)

Solar-Terrestrial science and space weather research/predictionneed “Global”, “Multi-scale”, “Multi-sphere”, “Interdisciplinary” data

However, essential databases are distributed in various countries and institutions,and finding the location and collecting other useful data sets are not easy.
For example,
Solar activity and Flare: SIDC, NOAA, etc.
Solar wind: NASA, NOAA
Geomagnetic disturbances: WDC for Geomagnetism, INTERMAGNET, etc.
Ionosphere/GPS TEC: NICT, RAL etc.

Necessity of a “Data System”

A History of “Data System”
1st Polar Year (1881-1884) 11 nations
2nd Polar Year (1932-1933) 40 nations
ICSU/World Data Centers establishedduring the IGY (International
Geophysical Year 1957-1958 67 nations)[Problems]・Mostly for geoscience
・Insufficient interoperability
among data centers

ICSU/World Data System
was established in 2009.
“System of data systems”
・Covers very wide discipline
・89 members (as of Sept. 2014)

Data Systems in Solar-Terrestrial Science～2005

・ Virtual Observatory (NASA/VOs)・ IUGONET (Japan)
・ ESPAS (EU)・ etc.

The IUGONET project aimed at building an “e-infrastructure” forresearchers to effectively find, get, and analyze various kinds ofupper atmospheric data spread over universities and institutions.
International
Users
KyushuUniv.
NagoyaUniv.
STELICSWSEDevelopers

MD

MD

WDC for Cosmic
Rays

IUGONET
Information Center

MD

Tohoku
Univ.
PPARC

MD

Kyoto Univ.

Director

MD

MD

NIPR
WDC for Aurora

MD

WDC forgeomagnetism
SpaceMagnetism

Kyoto Univ.
DACGSM

Chairperson

Kyoto Univ.
RISH

Astronomical
Observatories

Global observation network treated in the IUGONET6When we start IUGONET project in 2009Univ.-A

Inst.-B

Univ.-C

Geomag.
database

Auroradatabase

Solardatabase

Experts on
geomagnetic field

Experts on aurora
observation

Expert on solar
observation

I don’t know what data they have and how
to access them…

Basic idea 1: Synthetic use of distributed/
interdisciplinary databases with a “metadata database”
What is ‘metadata’?

Metadata describe (explain) the contents and context of each dataset.
(e.g., Instrument, Date, Location, Format, Name of PI, data policy, etc.)

Advantage of using metadata:・ Easy to exchange internationally and interdisciplinary.
Barrier of data policy is, in general, lower than exchanging real data.
Size of each metadata is small.
・Easy to construct a single database of metadata for distributed and variety ofdatabases with a common metadata format for searching necessary dataset.
・Useful to know the contents of a database(Many other formats)•ISO 19139, 19115
Metadata format:•Dublin CoreWe (IUGONET) adopt the “SPASE” data model•OpenSearchwhich is suitable for space weather research.
•WCS, WFS, WMS, WPS•GBIF• ・・・・・・・・

Format and Structure of IUGONET Metadata (SPASE)<NumericalData>…

Instrument

Observatory

Description of data set<Observatory>…

<Instrument>…

<DisplayData>…

Person data

<Catalog>…

…

Each data file<Granule>…

<Person>Repository<Repository>…

Metadata file
SPASE (Space Physics Archive Search and Extract) format
has been developed originally by a Heliophysics community
mainly in USA for satellite data. IUGONET contributed in its
extension to ground based observation data.
http://www.spase-group.org/

Basic idea 2: Constructing a common metadata databaseand Use de-fact standard software as much as possible
Metadata Database andsearch system

Analysis Software （UDAS)

Fiscal Year

“SPASE” data model for
metadata and “DSpace” fordataset search

THEMIS analysis software“TDAS” with extension forground based observation

http://search.iugonet.org/iugonet

http://www.iugonet.org/software.html

present

Common metadata database for synthetic use of
databases located at different institutions.

Univ.-A
Geomag.
database

Distributed real
data bases

xtraction of
metadata

Inst.-B

Univ.-C

Auroradatabase

Solardatabase

Common Metadata DBMetadata exchange
Experts on
geomagnetic field

Experts on aurora
observation

Experts on solar
observation

Now I know what data are available, and I can use
them with other data.

Necessity of extension to satellite observation data
・ IUGONET treats the data from ground-based observations
However, satellite observation is essential in Solar-TerrestrialScience.
・ The satellite data are also distributed and have much variety, i.e.,the situation is the same with that of the ground based
observation before IUGONET project started.

Red: IUGONET, Blue: US/Canadian databases
Green: Europian databases

Wide variety of satellite data

There must be much more for blue and green – We (IUGONET) do not know!

Promotion of the collaboration with ESPAS and IUGONET(ESPAS: Near Earth Space Data Infrastructure for e-Sciences)
Example: We have started a collaboration to have a common vocabulary

SPASE ontology

ESPAS ontology

Ontology
SS (structure of concepts) is different.

Proposed collaboration among IUGONET, ESPAS, NASA/Vo andAsia/Oceania institutions

ULTRA-IUGONETdatabases of other ministries)

Metadata search andweb based application
softwares
International Committee forpromotion of interoperability

23 Inst.
EUROPE ESPAS

Common Metadata format

Ontology conversion

8 Institutions of MEXT (+ some

Databases inSouth-East Asia,
India and Africancountries

9 VOs
US/Canada NASA VOs

A proposal of a data system for AOSWA: ULTRA-IUGONET

Common search

Asia/Oceania
STP community
RDA

ULTRA

Existing IUGONET andother geospace
databases in A/O inst.

Metadataexchange
ULTRA-IUGONET starts
from existing IUGONETand extends it to include
the databases in otherA/O countries

Possible process for realization
1. Metadata  Existing IUGONET metadata database
2. Open real data  Existing UDAS system
3. International operation of ULTRA-IUGONET ??

Summary and a proposal for AOSWA
・ Having a common metadata database is effective for space
weather research.
・ We plan to extend the IUGONET to satellite data.
・ Promotion of interoperability among internationally
distributed data systems such as the ESPAS, NASA/VOs
and the IUGONET is an important international collaboration.
・ To promote space weather research and collaboration inAsia/Oceania, a possible way is to enhance IUGONET metadata
database system.
・ For the open data sets, it is desirable to make them
downloadable through “UDAS” system from databases
at each institutions.

Thank you.
http://www.iugonet.org/en/software.html

http://wdc.kugi.kyoto-u.ac.jp/index.html[Some References]

About IUGONET project• Data Sci. J., 12, WDS179-WDS184, doi:10.2481/dsj.WDS-030, 2013.
• Data Sci. J., 13, PDA37-PDA43, 2014.
About IUGONET search system• Planets and Space, 66, doi:10.1186/1880-5981-66-133, 2014
About UDAS
• Adv. Polar Sci., 24, 231-240, doi: 10.3724/SP.J.1085.2013.00231, 2013.
[IUGONET Steering Committee]
T. Obara, T. Nakamura (chair), N. Sato, K. Shiokawa, R. Fujii, T. Ogino, T. Tsuda,
T. Iyemori, K. Shibata, A. Yoshikawa, K. Yumoto, T. Hada, Y. Takahashi,
I. Shinohara, Y. Kasahara[IUGONET Developer Team (2014)]
M. Yagi, Y. Tanaka, A. Yatagai, N. Umemura,
A. Shinbori, Y. Koyama, S. UeNo, S. Abe
Bernd Ritschel (GFZ, Potsdam)