# Presentation: 541278

## The Benefits of Implementing a Corporate Metadata Repository at the Census Bureau

- Presenter:  Jerome M. Garrett
- 	        Systems Support Division

- April 29, 2003

## Agenda

- What is Metadata?
- What is a Metadata Repository?
- What is a Corporate Metadata Repository (CMR)?
- How Can a  CMR Benefit the Census Bureau?
- Developments Thus Far
- Next in Store
- Questions

## What is Metadata?

- Names and Definitions
- Valid values and codes
- Sample Frames
- Memoranda
- Procedures
- Edits
- Imputation Formulas
- Press Releases
- Questionnaires
- Dataset Definitions
- Specifications
- and much more...

_**Metadata**_: all of the information that makes our data understandable or can be re-used in our survey processes.

- Examples include:

## What is a Metadata Repository?

- Security
- User accounts
- User groups
- Workflow
- Roles
- Phases
- Web-enabled
- No client s/w
- Input/Output Mechanisms
- standard formats
- custom
-       requirements

_**Metadata Repository**_: an electronic catalog for controlled, secure access to metadata which encourages sharing, reuse and exchange.

## What is a Corporate Metadata Repository?

- Survey/Census Components
- BOC Survey Lifecycle Phases
- BOC-wide Document Categorization scheme
- BOC Intranet access
- A design which accommodates future requirements
- Functionality that can support Software Engineering principles and Project Management practices.

_**Corporate Metadata Repository**_: a metadata repository implementation targeted to specific business needs, organized with an enterprise taxonomy and designed to easily accommodate existing business practices.

- Includes:

## What is a Corporate Metadata Repository?  - cont’d

**	****	****Communication,**
**	****	****Coordination,**
**	****	****Efficiency,**
**	****	****Quality &**
**	****	****Productivity.**

**What is a Corporate Metadata Repository?  - cont’d**

## Corporate Metadata Repository Architecture

## How Can a  CMR Benefit the Census Bureau?

- Because a CMR can be used by all areas of the Bureau,  it is sometimes hard to comprehend how it may help each individual.

## Let’s ask Joan Sample

- Joan Sample works in the statistical sampling area.
- She is called upon to develop and document the sampling methodology for new survey programs.
- Joan also writes the requirements used by the programming area to code the sampling programs.

## The benefits for Joan

- Joan can enter the information on the universe, sampling frames and strata into a _**SAMPLE REGISTRY**_
- Joan can also route the sample information through the approval chain for sign off.
- Joan can upload any accompanying documents (memos, spreadsheets, etc.) onto the project _**PORTAL**_ site.

**All of the information is easily available to select members or the entire team.  When deemed appropriate, the information can also be made available to the entire BOC or reformatted to go to users of our data.**

## Let’s hear from Mary Forms

- Mary works in the questionnaire content development area.
- She is called upon to develop the content of new survey questionnaires and to work with the questionnaire layout area to develop the final form.
- Mary also works with the processing area to determine how data captured fields are represented.

## The benefits for Mary

- Mary can enter all of the information into the _**QUESTIONNAIRE REGISTRY**_ (including design spec information, instruction text, response labels,  and questions numbers)
- Mary can also route questionnaire information to the layout area and receive automatic notification when the layout is done.
- Mary can view a .PDF of the complete form.
- Mary can assign and define response cells for each field of the questionnaire with the _**RESPONSE CELL**_ tool.

**All of the information is easily available to select members or the entire team.  When deemed appropriate, the information can also be made available to the entire BOC or reformatted to go to users of our data.**

## A few words from Lisa Layout

- Lisa works in the questionnaire layout area.  She works a lot with Mary Forms
- She is called upon to develop the layouts of survey questionnaires for later printing by the print shop or by a print contractor.
- Lisa works with a COTS publication software tool to develop the professional looking BOC forms.

## The benefits to Lisa

- Lisa can import the questionnaire content directly into the COTS publication tool.  (The design specification is also imported)
- Since the content is imported directly, Lisa no longer has to cut and paste or transcribe content. This eliminates the possibility of transcription errors.
- When Lisa is done, a notification is sent to Mary Forms.  Also a .PDF  of the new form is output to the CMR.
- Lisa is notified by the CMR when additional changes are desired.

**All of the information is easily available to select members or the entire team.  When deemed appropriate, the information can also be made available to the entire BOC or reformatted to go to users of our data.**

## How about Lou HQ?

- Lou’s area makes sure the survey meets the sponsors needs.  He defines the objectives and terminology. He also develops the clerical procedures and computer programming requirements.
- Additionally, Lou’s area develops program schedules and resource requirements.
- Lou also coordinates the activities of all involved areas.

## Benefits to Lou HQ

- Lou can create and maintain all Data Items with the _**DATA ELEMENT REGISTRY**_.  (This includes formats, valid values and size information.)
- Lou can also define all files produced by the system, including record layouts, with the _**DATA SET REGISTRY**_.  (This includes information on the recipient of the data files and the location of the files.)
- Lou can enter and maintain all rules for editing data elements into the _**BUSINESS RULE REGISTRY.**_
- Lou can store all external documents (IE., requirements, procedures, schedules, etc.) in the _**PORTAL**_ site

**All of the information is easily available to select members or the entire team.  When deemed appropriate, the information can also be made available to the entire BOC or reformatted to go to users of our data.**

## Don’t forget Tina FieldRep

- Tina FieldRep has worked in the Field Division for years
- Tina is responsible for producing all Field materials including, recruiting pamphlets, training materials, clerical procedures, job aids, checklists, planning documents, etc.
- Whenever field enumeration is involved, Tina is there.

## Benefits to Tina FieldRep

- All documents that Tina has to either produce or reference can be accessed from the _**PORTAL**_ site.
- Tina can go to the _**DATA ELEMENT REGISTRY**_ to print out a Code Book of all valid values of the data elements for a particular survey.
- Tina can also go to the _**SAMPLE REGISTRY**_ for  information on the anticipated workload in a given Sampling Unit.

**All of the information is easily available to select members or the entire team.  When deemed appropriate, the information can also be made available to the entire BOC or reformatted to go to users of our data.**

## A word from Peter Capture

- Peter Capture has worked on data capture systems for years.
- Peter Capture develops the barcodes for scanning.
- Peter also is responsible for  check-in and check-out procedures in the processing offices.

## The benefits to Peter Capture

- Peter can enter/maintain pertinent capture information about each response cell into the CMR using the _**RESPONSE CELL TOOL**_.
- Peter can also output a specification for the ‘Key from Image’ system of data capture information using the _**RESPONSE CELL TOOL**_.
- All documents that Peter has to produce or access can be located on the _**PORTAL**_ site.

**All of the information is easily available to select members or the entire team.  When deemed appropriate, the information can also be made available to the entire BOC or reformatted to go to users of our data.**

## What about Larry Processing?

- Larry Processing handles all data that has been captured.
- Larry writes all software for Editing, Imputing, and other ways to improve data quality.
- Larry is also responsible for creating output files for analysis and publication.

## Benefits to Larry Processing

- Larry can go to the _**BUSINESS RULE REGISTRY**_ to retrieve the rules for editing, imputing and other ways of correcting the data.
- Larry can go to the _**DATA SET REGISTRY**_ for the layouts of all output files.  Larry will also input the file locations after files are created.
- Larry will update the _**DATA ELEMENT REGISTRY**_ with new fields created by his processing.
- Larry can go to the _**SAMPLE REGISTRY**_ for information needed to perform weighting.

**All of the information is easily available to select members or the entire team.  When deemed appropriate, the information can also be made available to the entire BOC or reformatted to go to users of our data.**

## How about Pam Tables?

- Pam Tables creates the publication tables.
- Pam provides the publication tables to the dissemination system (DADS/AFF) .
- Pam is also charged with  providing DADS/AFF with all of the other metadata that can be made available to the public.

## Benefits to Pam Tables

- Pam can use the _**MATRIX TABLE REGISTRY**_ to create Matrix tables or modify existing matrix tables.
- Pam can electronically solicit approval and  automatically output the matrix tables to DADS/AFF.
- Finally, Pam can use the _**TIER 2 PRODUCT REGISTRY**_ to create Tier 2 product files for DADS/AFF, and a _**QUALITY TOOL**_ to verify the files before sending to DADS/AFF.

**The technology utilized can be easily modified to output Matrix table and Tier 2 product metadata to systems other than DADS/AFF.**

## How about Tonya Block?

**How about Tonya Block?**

- Tonya Block has provided geographic support for years.
- In addition to developing the files for sampling, Tonya also produces the maps needed for Field activities.
- Tonya delivers map metadata to DADS/AFF.

## Benefits to Tonya Block

- Tonya can use the _**DATA ELEMENT REGISTRY**_ to maintain geographic definitions, concepts and variables.
- Tonya can use the _**DATA SET REGISTRY**_ to create the layouts of the various geographic reference files and sample universe files
- Tonya can also use the _**TIER 1 PRODUCT REGISTRY**_ to create the files for DADS/AFF and a _**QUALITY TOOL**_ to verify the files before sending to DADS/AFF.

**The technology utilized can be easily modified to output Tier 1 product metadata to systems other than DADS/AFF.**

## How about Bob and Jane Manager?

- Bob and Jane manage census and survey programs.
- Both report to executive level staff and prepare responses to congressional inquiries.
- Bob and Jane approve of changes when systems go into production.

## Benefits to Bob and Jane

- Bob and Jane can use the:
-     _**SAMPLE REGISTRY,**_**              **_**DATA ELEMENT REGISTRY, DATA SET REGISTRY, **_**          **_**QUESTIONNAIRE REGISTRY, MATRIX TABLE REGISTRY,**_**  **_**RESPONSE CELL TOOL, BUSINESS RULE REGISTRY,**_**   **_**PRODUCT REGISTRIES**_
-     to stay abreast of project progress and grant electronic approvals.
- Bob and Jane can also use the _**PORTAL**_ site to post and access project documents.

**All roles required to grant approvals can be assigned to multiple people so that progress is not hindered if a key team member is not available.   The designation of roles and responsibilities is determined by project managers.**

## And finally, Joe and Susie Public?

- Joe and Susie Public rely on metadata to make our data more understandable.
- Good Metadata empowers users to compare data from different sources.

## Benefits to Joe and Susie Public

- Thanks to a CMR, the data products received by Joe and Susie Public are accompanied by accurate and complete metadata with which they can draw sound conclusions about the data.
- Also, if Joe and Susie refer questions to BOC personnel, the questions can be quickly answered, even by BOC staff that did not work on the survey or census, thanks to a well administered CMR.

## A CMR Can Support All Areas of Survey/Census Program Development 

- Intranet

- Security

- Workflow

**Repository**

**Data Elements**

**Files**

**Pub. Tables**

**Forms**

**Rqmts**

**Specs**

**Procedures**

**Universe**

**Rules**

**Sampling**

**Form Content**

**Form Design**

**Program Development**

**Data Collection**

**Data Capture**

**Data Processing**

**Publication Tables**

**Geography Files & Maps**

**Program Management**

**Public Users**

## Developments Thus Far

- Data Element Registry
- Data Set Registry
- Questionnaire Registry
- Question Registry
- XML Interchange

- ACS Pilot
- ASM Pilot
- Econ 2002 Census Design
- Econ 2002 XML Interchange
- Tier 1 GEO Products cleansing/delivery to DADS/AFF
- Econ 2002 Data Capture System
- Tier 2 Table Products cleansing/delivery to DADS/AFF
- TMO SCIF
- Decennial 2003 IBEAM Pilot

- Current Population Survey Portal http://cmr.ssd.census.gov:1919
- Project Management Repository http://cmr.ssd.census.gov:8888/pls/portal30/url/page/pmr
- Quality Management Repository http://cmr.ssd.census.gov:8888/pls/portal30/url/page/qmr
- Corporate Metadata Repository http://cmr.ssd.census.gov
- Human Resources Division  http://cmr.ssd.census.gov:7979/pls/portal30/url/page/hr_portal
- Field Directorate http://cmr.ssd.census.gov:2929/pls/portalfld
- Policy Office http://cmr.ssd.census.gov:7979/pls/portal30/url/page/pol_portal

**CMR Core Service Components**

**Applications**

**Portal Sites**

- Additional information about  all software developed so far can be provided at a later time.

## Quick Look - CMR Home Page

## Quick Look – Data Element Registry

## Quick Look – Dataset Registry

## Quick Look – Econ 2002 Census Design

## Quick Look – Tier 1 Product Registry

## Quick Look – Tier 2 Matrix Table Registry

## Quick Look – TMO SCIF Application

## Next in Store 

- Business Rule Registry
- Response Cell Registry
- Sample Registry
- ....

- Economic Survey Design for Select Current Surveys
- Decennial 2004 Test IBEAM Pilot
- Decennial 2006 Test IBEAM
- TMO SCIF Enhancements
- .....

- Numerous sites slated for development

**CMR Core Service Components**

**Applications**

**Portal Sites**

- Future development can be influenced by yet unknown program area requirements.

- -  All registries can be enhanced to meet specific requirements.

- -  Applications can be developed to meet applications

## For further Information:

_**Goals**_
- Security
- Re Use
- Control
- Ease of Use

- Jerome M. Garrett
- Metadata Staff
- Systems Support Division
- 763 - 6624

- Portal

- Portal

- Portal

**Corporate Metadata Repository**

_**Focus**_
- Security
- Re Use
- Control
- Ease of Use

- Jerome M. Garrett
- Metadata Staff
- Systems Support Division
- 763 - 6624

**For further Information:**

- Jerome M. Garrett
- Metadata Staff
- Systems Support Division
- 763 - 6624

- We welcome your input on specific functions you require which may be delivered by the Corporate Metadata Repository.

- CMR

- CMR

- Give us a call

- Visit our Exhibits

- or

## Questions?