# Presentation: 671567

## NGDC &CLASSARC – 12/03Ted Habermann

## Question:

**How can NESDIS and NOAA effectively integrate / evolve existing programs and people to build environmental information systems that support NOAA’s strategic goals and serve existing and future customers?**
**Organizational Capabilities: Resources, Processes, Values**

## NGDC Future Directions & Priorities

**NGDC Future Directions & Priorities**

**Reemphasize Basic Mission **
**    ****of Scientific Data Stewardship.**
**Make All Digital Data **
**     ****Available Online for Free.**
**Focus on Critical Data Sets for**
**    ****Archive and Stewardship.**
**Develop Advanced Interactive **
**     ****Online Access.**
**Implement an Integrated Data **
**     ****Management Structure.**
**Support NESDIS Efforts     **
**    ****to Develop Integrated Data**
**    ****Systems for NOAA Data.**

**Consistent With CLASS Values**

## Large-Array Data – DMSP Archive

| Sensor | F10 | F11 | F12 | F13 | F14 | F15 |
| --- | --- | --- | --- | --- | --- | --- |
| OLS | 4/12/92 - 2/8/95 | 4/12/92 - 4/22/95 | 9/25/94 - 7/31/02 | 4/24/95 - Present | 4/28/97 - Present | 1/24/00 - Present |
| SSM/I | 4/12/92 - 11/14/97 | 4/12/92 - 4/22/95 4/21/97 - 5/16/00 | None | 4/24/95 - Present | 4/28/97 - Present | 8/15/00 - Present |
| SSM/T | 4/12/92 - 11/14/97 | 4/12/92 - 4/22/95 4/21/97 - 5/16/00 | 9/25/94 - 11/25/95 | 4/24/95 - Present | 4/28/97 - 7/24/97 | 8/15/00 - Present |
| SSM/T2 | None | 4/12/92 - 4/22/95 4/21/97 - 5/16/00 | 9/25/94 - 1/20/02 | None2 | 4/28/97 - Present | 8/15/00 - Present |
| SSJ/4 | 4/12/92 - 11/14/97 | 4/12/92 - 4/22/95 4/21/97 - 5/16/00 | 9/25/94 - 7/31/02 | 4/24/95 - Present | 4/28/97 - Present | 8/15/00 - Present |
| SSIES | 4/12/92 - 11/14/97 | 4/12/92 - 4/22/95 4/21/97 - 5/16/00 | 9/25/94 - 7/31/02 | 4/24/95 - Present | 4/28/97 - Present | 8/15/00 - Present |
| SSM | None | None | 9/25/94 - 7/31/02 | 4/24/95 - Present | 4/28/97 - Present | 8/15/00 - Present |

**Large-Array Data – DMSP Archive**

## Large-Array Datasets Are Growing

**  ****DMSP F16 launched on 18 Oct 2003**
**  ****NGDC received first data on 20 Oct 2003**
**  ****Seven F16 instruments:**
**  ****Three new – two ultraviolet imagers and a microwave imager/sounder.**
**  ****Two others that  measure the electrically changed properties of the local environment significantly altered from the previous.**
**  ****Substantial NGDC Impact:**
**  ****Data ingest increase from 6.5 to 10 GB/day**
**  ****Total archive increase from 16.5 to 27 GB/day**
**  ****New NGDC data/product distribution once F16 calibration ****	****and validation completed.**

**  ****NOAA multibeam and side-scan sonar data...**
**  ****Others?**

## NGDC Systems & CLASS

|  | SPIDR (Science Oriented Data Center System) | CLASS |
| --- | --- | --- |
| Ingest | Database-unique software generates BLOBS for a group of data sets
Data-model-unique software loads each BLOB and generates inventories, coverage maps and “canned” browse images | Data-set-unique software loads data granules and generates inventories, coverage maps and a few “canned” browse images |
| Data Management | Inventories, coverage maps and “canned” browse images reside in RDBMS
Large data granules stored in tape library
Each BLOB resides in RDBMS
For smaller data sets, each data value is addressable
Multiple data entries (operational, retrospectively validated) for smaller data sets | Inventories, coverage maps and “canned” browse images reside in RDBMS
Data granules stored in tape library |
| Web Services | Data Discovery by database, data set and data set inventory
Displays coverage maps 
Displays “canned” browse imagery
Data Delivery in standard formats
Shopping cart for data ordering
User registration required to receive data
All data sets are display-able and browse-able
Interactive GUI prepares station maps, data plots, multi-disciplinary co-plots, “on the- fly”
Interactive GUI allows users to navigate the satellite and to display and animate “canned” browse images  | Data Discovery by database, data set and data set inventory
Displays coverage maps
Displays “canned” browse imagery
Data Delivery in ??? formats
Shopping cart for data ordering
User registration required to receive data
Few data sets are browse-able |
| Applications | For smaller data sets, each data value is searchable
Facilitates quality assessment and allows analyst to flag, change or multiple entry values
Delivers data values for statistical analysis, quality assessment and fuzzy logic searches 
Delivers data values to numerical models;
COAMPS, AMIE, MSM, GITM | ?????? |

## NGDC Systems & CLASS

**Integrates low-resolution gridded data with fuzzy logic to create event-driven science data discovery system that supports natural language and behaves like Google.**

## Metadata Management

## Metadata Management

**Web interface supports remote metadata creation and management by scientists and data providers.**

**Metadata Management**

## Geospatial Data Integration

- A

- C

- Satellite footprints & in-situ observatories

- Zoom in and select a footprint

- Get a list of in-situ observatories that are in the selected satellite footprint.

## System Integration / Partnerships

## Model Cross Cutting Relationships

**Model Cross Cutting Relationships**

- CLASS
- ARCHIVE &
- DISTRIBUTION

- NOAA and International
- Observing Systems

- Data Centers

- University Partners

- Federal Partners

- CLASS $

- OTHER
- $

## Living Breathing Examples

- ESDIM Projects
*Bates / Habermann*: Application of Common Data Formats, Metadata, and FGDC standards to Historical Satellite Data and Products
*Kroehl* - Modernizing a DMSP Space Environmental Data Archive
- Other Projects
*Casey*: High Resolution Pathfinder SST’s
- NVDS, NOAA Enterprise GIS, NOSA, ...