# Presentation: 580397

## Harvesting Metadata for Use by the geodata.gov Portal

- Doug Nebert
- FGDC Secretariat
- Geospatial One-Stop Team

## NSDI: a Foundation for GOS

- Geospatial One-Stop (GOS) implements the principles of the NSDI spelled out in Executive Order 12906 (recently revised)
- GOS builds on the resources already available in the NSDI – FGDC and endorsed external Framework Standards, NSDI Clearinghouse Network
- Operated as project coordinated through FGDC Secretariat with many agency partners

## Geodata.gov and the NSDI Clearinghouse

-  Over 150 collections of metadata exist within searchable NSDI Clearinghouse Nodes in the US
-  All FGDC metadata records are searchable by fields and full-text through six replicated search gateways
-  geodata.gov will speed and simplify search and browse of these and other metadata through its portal interface

## What's different about One-Stop?

- GOS has a timeline for implementation of the various modules
- Standards are being developed with multi-sectoral stakeholders as national (ANSI) standards, not FGDC ones
- Visibility of the initiative as one of 24 e-gov initiatives from the Administration
- Goals include measures of costs and savings through cost-sharing in data acquisition, processing, and service of geospatial data

## What else is different?

- More explicit focus on including State and Local government as primary stakeholders
- Decisions in GOS are made by a governmental (non-FGDC) Board of Directors who advise the Executive Director
- GOS as an initiative is intended to sunset when all Modules are operational (2005+)
- Management partners from DOI and OMB are watching performance and capabilities (and budget effects) very closely

## GOS Expectations of Portal

- Search for geospatial data is 'easy-to-use‘ and would replace the primary search facilities of the NSDI Clearinghouse Gateways
- Metadata are harvested from remote collections into a single metadatabase
- Browsing for geospatial data is made possible through common ISO Categories and resource type assignments
- Descriptions of map and data services are also indexed from FGDC metadata entries
- Data descriptions are linked to an online map viewer where map services exist

## Portal at geodata.gov

- Initial release of the GOS portal is online with startup content selectively gathered from key providers and entered ‘by hand’
- New content will be harvested from the Web or individual metadata files may be uploaded as XML or via form input
- OGC Web Map Services (WMS) and ArcIMS ‘image’ services supported in viewer
- Data, map services, static maps, and applications are among the resource types indexed

## Slide 8

## Current Publication Options

-  Users may contribute metadata one of three ways:
- Enter FGDC metadata into a form at geodata.gov and they are stored and indexed there
- Upload metadata as FGDC XML to the geodata.gov site
- Register their existing metadata collection to be harvested into the GOS metadata repository

## metadata

**cache**

**geodata.gov**

**map viewer**

**data**

**data**

**data**

**data**

## How do I publish?

**Before you can publish metadata in geodata.gov, you need to register as a publisher**
** ****After your registration is completed, you will have username and password to access the portal as a publisher**

## Data Entry Form

**If you do not have any FGDC metadata and anticipate only a few records to be published to geodata.gov you can use an online entry form to collect abbreviated FGDC metadata that will be hosted at geodata.gov**

## Upload XML Metadata 

- Upload XML Metadata

**If you have access to a metadata editor such as ArcCatalog but do not have a Z39.50 server or ArcIMS Metadata Server you can upload a small set of FGDC metadata to geodata.gov**

## Harvesting Option

-  If you have or would like to maintain a collection of metadata at your site and can let geodata.gov know its location, geodata.gov can ‘harvest’ or fetch new and updated metadata to make it searchable
-  You can describe any type of resource (planned data activity, existing data, a map service, an application, etc.) using your published set of metadata

## Harvesting options

-  A provider wanting to have content harvested into in geodata.gov can register:
- Z39.50 “GEO” Metadata server (NSDI Clearinghouse Node)
- ArcIMS Metadata Server
- OAI-PMH (Open Archives Initiative, Protocol for Metadata Harvest)
- Web Accessible Folder

## Harvesting capabilities

-  Harvesting is a scheduled retrieval of metadata from a remote collection, such as an existing Clearinghouse Node
-  The harvester detects new content and brings it into a metadata ‘cache’ at geodata.gov for inclusion in search
-  Scheduling can be established in the registration profile of each provider

## If you have a Z39.50 Clearinghouse Node

- If your metadata collection is served on Z39.50 (such as Isite), you need to implement the new version of Isite
-  Update version for Isite is available at:
- _[ftp://ftp.awcubed.com/pub/Software/Isite2/](ftp://ftp.awcubed.com/pub/Software/Isite2/)_
- Other brands of Z39.50 software (Compusult, Intergraph, ESRI, Blue Angel) will be implementing the new features for harvest in coming months

## Inclusion Strategy

-  FGDC Staff will be working on an outreach and ‘inclusion’ schedule to get all domestic Clearinghouses (Z39.50 and otherwise) from State/Local, Federal, and Commercial sources
-  Encourage partnerships and community networking to include as many resources as possible