DATA COORDINATION AND
MANAGEMENT

Steve Williams
NCAR Earth Observing Laboratory (EOL)
Boulder, Colorado
3rd Asian Water Cycle SymposiumBeppu, Japan
2-4 December 2007

EOL CEOP work supported by NOAA Climate Projects Office

Coordinated Energy and water-cycle Observations Project

Convergence of Observations
A Prototype of the Global Water Cycle
Observation System of Systems

Coordinated Energy and water-cycle Observations Project

A Well Organized Data Archive System

Model Output Data Archiving
Center at the World Data
Center for Climate, Max-Planck
Institute for Meteorology ofGermany

In-Situ Data Archiving
Center at NCAR (NationalCenter for AtmosphericResearch) of USA
Data
Integrating/Archiving
Center at University ofTokyo and JAXA ofJapan

http://www.eol.ucar.edu
http://www.eol.ucar.edu//
projects/ceop/dm/
projects/ceop/dm/

INTEGRATED

IN-SITU

SATELLITE

MODEL

EOL work supported by NOAA/CPO

Reference Site Locations

CEOP Reference Site Data Release Guidelines

Data exchange guidelines:(1) To comply with WMO Resolutions 40 (CG-XII) and 25 (CGXIII) in particular: No financial implications.
(2) CDA and data users: Commercial exploitation of CEOP data
is prohibited.
(3) Data users: No transfer to third parties.
(4) Data release to data users: Turn-around period.
Category 1 data: 6 months Category 2 data: 15 months(5) Acknowledgement and citation(6) Co-Authorship for Reference Sites’ PIs recommended,
collaboration base required if PI requests co-authorship(in particular for category 2 data)(7) CEOP Publication Library at CDA

Reference Site Data Set Procedures Report(http://www.eol.ucar.edu/projects/ceop/dm)• Introduction• Data Set Description,
submission schedule, formats• Metadata• Gap filling• Quality Control/QualityAssurance• File naming convention• Submission instructions to CDA• CDA Composite formation• CDA Quality Assurance• Rawinsonde Data Sets
• Ancillary Data Sets

REFERENCE SITE SURFACE METEOROLOGICALAND RADIATION DATA SET FORMAT

Outline of the CAMP Data Management
CAMP Data center: UTSite ManagerFTP
E-mailPre-check the dataset

Observed Raw DataDatabase
QC Tools- User Management- Data selection
Quality Control- Data plot
QC Web Interface- Point out (Error & Noise)- Update Data, flag
Use Own research purpose- Format Conversion

FTP
E-mailUnified Format Dataset

NCAR(CEOP Data Center)5th CEOP Meeting in Pari

Reference Site Metadata
Individual Site Metadata includes:••••••Station (s)Contact (s)Links to relevant web pages
Station location (e.g. maps, photos)
Google Earth Files (.kmz)
Station description (e.g. vegetation
characteristics, soil types, climate,DEMs)• Parameters and Instrumentation
descriptions (SFC, TWR, STM, FLX,UA)• Links to presentations• Links to data sets and additional
documentation

CEOP LAND COVER AND SOILS QUESTIONNAIRE
Reference Site (Station)
Minimum Soils Information
Texture Class, Porosity
Minimum Land Cover
USGS Class, Site Changes
Enhanced Soils Information
Profile (texture, porosity,infiltration, bulk dry density,
saturated hydraulic conductivity,reference groups)
Enhanced Land Cover Information
Land cover (50m, 500m, 12km,seasonal changes
Elevation information (slope)

REFERENCE SITE GOOGLE EARTH (.KMZ) FILE

REFERENCE SITE GOOGLE EARTH (.KMZ) FILE

Model Data Content(as of 1 December 2007)

4.324 TByte

The most recent version of the data status (time line) can be found from:http://www.mad.zmaw.de/wdc-for-climate/ceop/

Satellite datasets for CEOPAt 3 type scales

1.Reference site:35 Points 2.Monsoon Region
Soil

250km

>West African

RS>North American250km

RainTB

3.Global>South American

Water Vapor>Asia- AustralianCoordinated Energy and water-cycle Observations Project

Data Management
Distributed- and Centralized- Data Integration Functions
NCAR

In-situIn-situIn-situ

GrADS/
DDDS
for Subsets

In-situIn-situIn-situIn-situ

ComputingPower

GrADS/DODS
for Subsets

Distributed
Integration
Services

model
model
model

MPI

model
model
model

http://jaxa.ceos.org/wtf_ceop/

http://monsoon.t.u-tokyo.ac.jp/ceop-dc/ceop-dc_top.htmsatellite
satellite
satellite

Centralized
Integration
Services

GrADS/DODS
for Subsets

satellite
UT/JAXA
satellite
satellite
satellite

ComputingPowerAMSR-E Soil Moisture Validation
at the Reference Site in Mongolia

87

RUSSIA

6MONGOLIAO UB

5SAO
MG

4O CY

3210

A B C D E F G

CHINA

H

I

40

0535

10Obs Mv
(Average)30
Est. Mv (Asc.)

15
20

Est. Mv (Des.)

25

25
20

30
35

1540

1045
50
IOP

55
60
7/1

7/6

7/11

7/16

7/21

7/26

7/31

5Ave. = 3.4
St.Dev. = 5.2

8/58/10

0
8/15

8/20

8/25

8/30

9/4

9/9

9/14

Soil Moisture [%] (3cm)

Percipitation [mm/day]

J

9/19

date

(Koike et al., 2003)

Oita International Center

THANK YOU!
QUESTIONS?