東京大学 生産技術研究所 戦略情報融合国際研究センター

Data Integration
System Development

東京大学 生産技術研究所 戦略情報融合国際研究センター

CEOP Centralized Data
Integration System

国家基幹技術「海洋地球観測探査システム」データ統合・解析システム

Global Earth Observation System of Systems（GEOSS）

GroundObservation

OceanObservation

Satelltie
Data

WCRP CMIP3Simulation
Output

MetBroker

Prototype of Data Ingegration/Informatino Fusion Core System
Application layer
User Apps.

User Apps.

User Apps.

User Apps.

User Apps.

Common infrastructure software layer•Visualizer(w display wall)•Discovery Work Flow Assist•Data Quality Manager•Data Transformer•Data Crawler•ETL•Data Mingrator•Data Navigator•Meta Data Manger

Data management layer•DB management system•Storage management system
File system layer •PB scale logical file •Power management system

Storage layer

H18• Design offundamentalsystem• Starting dataarchive

H19• Implementationof experimentalsystem• Starting
operation

Disk Arrays

Kitsuregawa Laboratory Confidential. © 2007 Kitsuregawa Laboratory, IIS, The University of Tokyo.

System specification
introduced in 2007
• Consist of 5 subsystems• Capacity– 604TB（13D+2P RAID6）• Read performance– 2.4GB/s per subsystem at maximum, total 12GB/s• Cache– 2GB per subsystem, total 10GB

• Energy-saving function– Automatically turn off the power of inactive portions– Automatically turn on the power on access demand東京大学 生産技術研究所 戦略情報融合国際研究センター

Sensor Data
Visualization for
Agricultural Application

Field Server - Sensor network node NARC (National Agricultural Research Center),
NARO (National Agriculture and Food Research Organization), Japan

Component of Field Server
Weatherproof cabinet
Substrate of Web server¾

Field Server engine

Sensor¾

air temperature，humidity，solar radiation，soil moisture，UV， CO2Camera
WiFi based
Data collection / Remote control
agent
Middleware for data grid¾MetBroker

Data Collection and Server Control by Agent
Public Service

Application Server
Field servers in Private networks

Agent Box
Storage Server

VPN Router
Meta-AgentAgentsThe Internet

Current Workings
Collaboration with National Agricultural
Research Center (NARC), National
Agriculture and Food Research Organization(NARO)
Preparing a replica of FieldServer archives
at UT (Original is NARC)¾ Periodic data crawling (1 week)

Developing various tools that can support
the data analysis by the users

FS Data Archive and Service
Users

NARC
Observed Databy Field Serverinternet
Common software Application

NARC

Tsumagoi・・・•Visualizer(w display wall)•Discovery Work Flow Assist•Data Quality Manager•Data Transformer•Data Crawler•ETL•Data Manager•Data Navigator•Meta Data Manger

Registration of metadata

メタデータ

Database・・・・・・

Khon Kaen
観測データin Thai

•GIS App. (Spatial Access)•Model (Virtual Station)•Other Apps.

～8MB/s
Data
ArchiveStorage

Ccentralized data integration system ＠ UTNumber and Size of FS Scenes (13M scenes)
Nu mber of Nu mber ofGrowth of
Sce n e s " A" Sce n e s "B " Sc enes
Total Size (KB)
(Mar., 2007) (Nov., 2007) (B-A)
A zuma , Ts uk uba -s hi , Iba ra k i 2005/1 2007/6
374,350
422,393
48,043
16,723,720
Ch ina2004/7 Current
444,866
449,140
4,274
18,490,948
Pear farm, Chiba
2003/7 2007/10
309,612373,258
63,64620,801,544
Florida Un iv., USA
2005/5 Current
1,705,630
2,014,419
308,789
89,088,308
NARC, Niigata
2005/4 2006/10
244,817244,8170
11,474,736
Ibaraki Univ.
2004/11 2005/10
367,594
367,594
0
24,577,696
Ichikawa-shi, Ch iba
2005/7 Current
15,009139,480
124,471
8,730,860
UCC farm, Kona, Hawaii 2002/12 Current
1,191,152
1,886,225
695,073
76,742,972
M an dar in Far m , W akayam a 2005/7 2007/1
107,638
107,63805,081,076
File d, NARC
2003/1 Current
6,895,151
7,431,653
536,502845,990,216
Obuse , Nagan o
2006/5 Current
401,392
851,203449,81137,893,080
Mikkabi, Shizu oka
2004/9 Current
149,326
149,461
135
9,631,788
Peac h Farm, Fu kushima 2003/5 2006/1
231,771
231,7710250,009,900
G unma Ag ricult u ra l T ech. C ent er 2006/6Current
64,649305,590
240,941
9,981,480
Weste rn Re gion , NARC 2005/11 Current
488,917809,556
320,639
33,589,600
Rice field, Yawara
2004/7 2006/9
307,339
309,998
2,659
15,021,580
Himalayan
2007/11 Current
182
182
8,576
Yach imata, Ch iba
2007/4 Current
137,807
137,8075,894,908
JAXA
2007/7 2007/9
28,88528,885889,716
Khon Kae n, Th ai
2006/12 Current
10,241
10,241
597,052
Fac u lt y o f Agr ic u lt u r e , UT 2007/8 2007/10
30,14730,147
1,665,904
Installation SiteStart

EndTotal 13,299,213

16,301,458

3,002,245

Structure of FS Image Browser
ServerHTTP Server
JAVA

HTTP
HTTP

AJAX

DBMS

ClientWeb Browser

DataJAVA
AJAX
Disk Array(114TB)

1,482,885,660

FieldServer Image Browser

Slide Bar for
Image Zoom
Slide Bar forTime Resolution

Area for FS images(Images are paged asynchronously)

PeriodSite

Time Series Display
Page for Observation
Data of Each Sensor
Move to time series graph pageby clicking the link
Observation Data is exported andgraphed. Time range of graph is tendays (from seven days ago of target
day to two days after).

Blue point is the time of the selected image

When the area (blue square) is selectedby using mouse device, the graph iszoomed.

東京大学 生産技術研究所 戦略情報融合国際研究センター

A Prototype of JRA-25
JRA-25Visualization Tool

A Prototype ofJRA-25 Visualization Tool
¾ Analysis of moisture flow
¾ Verification of finding¾ Understanding characteristics of JRA-25

JRA-25 (Japanese 25-year Reanalysis)¾ Joint research project of Japan Meteorological Agency (JMA) andCentral Research Institute of Electric Power Industry (CRIEPI)¾ http://jra.kishou.go.jp/¾ Reanalysis Period : from Jan. 1979 to Dec. 2004 (26 years)¾ The global model resolution : T106L40 (110km grid, 40 pressurelevels, model top: 0.4hPa)¾ Element (Geopotential height [gpm], Air temperature [K], Specifichumidity [kg/kg], Zonal wind [m/s], Meridional wind [m/s], etc)
¾ About 8.0TB is archived in UT

JRA-25 Data Retrieval Page

Data element
PeriodPoints on arbitrary crosssection (latitude, longitude)

Ex.1：JRA-25 horizontal data display using VRML
•Clipping of horizontal plane forwind data•Overlay of wind and geopotentialheight•Topography display usingGTOPO30•UT18:00, 30 June, 2003•Visualization of windusing 3D arrows (length iswind intensity)•Geopotential height ofcontour chart•Perpendicular axis ispressure level

Change ofview and angle

Overlay of Specific humidity and Geopotential height¾ Specific humidity:
Shaded color image(red→high)¾ Geopotential height:
Contour chart

Ex.2：Overlay of JRA-25 data and AIRS data

¾ JRA-25: Specific humidityof horizontal plane¾ AIRS: Water vapor ratioof arbitrary cross section

Ex.3: Display of Arbitrary Cross Section
for Specific Humidity•Arbitrary cross section of specifichumidity•Overlay of other elements (wind,geopotential height)•UT18:00, 30
June, 2003
•specific
humidity ofcolor (red: high,purple：low)•Flexible
allocation ofvalue and color

River Management data

Satellite

Support of data interoperability

Ontology ofdictionary

Ontology of
Geographic information

GIS/Basin Info.

Water Resource
Management

Satellite Data
Assimilation

Numerical Weather
Prediction Model

Reference Site Data

Distributed
Hydrological Model

Heavy Rainfall
Prediction

Operation
Optimization

Flood Prediction

Flood/Inundations→Evacuation
Instruction