# Presentation: 406384

## Government TeamAlgorithm Assessment Activities

- Bonnie Reed
- NPOESS IPO – Algorithm Division

## Overview

-  IPO’s Algorithm Division
-  Established Infrastructure and Tools
-  Algorithm Activities and Resources
-  Next Steps

## IPO Algorithm Division

**Processing Algorithm Software**
- Development
- Cost, Schedule, Earned Value, Milestone Tracking and Reporting
- Performance Assessment
- Independent evaluation of SSPR product
- Development of ‘gap-filler’ algorithms
**System Guidance:  Hardware-Algorithm-Product Performance**
- Traditional Systems Engineering function: balance of pain
- Decision making throughout all phases of program (development-sustainment)
- Shorthand notation for this is “Sensor Science”
**Cal/Val**
- Verification of SSPR results
- Coordination of truth data resources
- Establishing operational viability of products
- Community infrastructure (GRAVITE)
**IGS and Technical Outreach**
- Enlist community support for algorithm refinement, Cal/Val
- Stimulate the user community to be prepared to fully exploit our data.

**Establishing the technical validity and operational **
**viability of the NPP and NPOESS Data Products**

## Infrastructure

**Utilizing CasaNOSA Framework**
- Open Source, web-based software project
- Version control, bug tracking,  task lists, and documentation
- Operates as a companion with Subversion
- Allows for overall configuration management of multiple projects
- Uses OpenSource programming languages in its application
- PHP (_[www.php.org](http://www.php.org/)_)
- MYSQL (www.mysql.org)
- Initially designed to support CLASS and NOSA efforts
- Currently a general purpose NOAA-wide collaborative project management site
**NPOES Algorithms Related Projects on CasaNOSA**
- NPOESS Algorithms
- NPOESS Algorithm Tracking System (NATS)
- NPOESS Cal/Val Tasks
- GRAVITE
- xOATs
- NPOESS IGS Program

## Algorithm Tools

**NPOESS Algorithms Project**
- Source Code
- Documents
- Science Code Data
- Proxy Data
- Simulated Data
- Sample HDF5 Data
**NPOESS Algorithm Tracking System (NATS) Project**
- Log/Assign/Track issues for investigation and resolution
- Capture the data flow through the NPP system from sensor to EDR
- Display inputs and outputs for each process
- Link relevant documentation for efficient access
- Allow collaboration within community to identify and define algorithm risks for resolution

## NATS ProjectNPP Overview

## Algorithm Activities Algorithm Workshop #1

**Initial Algorithm Workshop held to kick-off algorithm porting activity involving IPO and IGS funded PIs.**
- Provided overview of the structure of the NPP operational code
- Demonstrated the necessary steps to build and compile the operational algorithm code on the investigator’s own system outside of the IDPS infrastructure
- Assigned algorithms to area experts for familiarization with the way the operational code is and is not different from the science code
- Discussed how to provide feedback and report bugs/information on the code
- Discussed the next steps for distribution to the larger Cal/Val community

- _Algorithms Covered_
- VIIRS:  	VFM, VCM, AOT, SST, IST, LST, SurfRefl, SurfType, VI
- CrIMSS:	AVTP, AVPP, AVMP

## Algorithm ActivitiesAlgorithm Workshop #2

**Follow-up Workshop held to socialize achievements, challenges, and issues related to algorithm porting activity.**
- Code Porting Activity Status from each area expert and their given algorithm
- Progress
- Issues/Challenges
- Next Steps
- Utilizing CasaNOSA
- Subversion branches allow for collaboration
- “Bugs” Feature provides a common area for tracking issues related to the code
- Exercise feedback loop to NGST/Raytheon
- Preparing for next delivery of Operational Code

## Algorithm ActivitiesGRAVITE

**Government Resource for Algorithm Verification, Independent Test, and Evaluation installed at the NSOF in Suitland, MD.**
**GRAVITE Lab in the IPO’s  Algorithm “wing” of the 14****th**** floor.**
**Program office has the responsibility to **
- Validate SSPR results
- Establish operational viability of the Satellite Data Products
**IPO Algorithms Division is evaluating Algorithm threads**
- ANC data availability and quality
- Algorithm robustness with 24/7 routine processing
- Global performance
- Revisit behavior (16 day cycle)
**Prototyping and evaluations of assessment techniques**
- Data reduction
- Match-ups
- Time series analysis

## Algorithm ActivitiesAlgorithm Chains

**Initial Algorithm Chain Identified and Running (VIIRS SST)**
- Data Ingest     MODIS and Ancillary Data (24x7)
- Data Conversion     Input data-to-blob conversion
- Algorithm Processing     IDPS Operational Code Algorithms (B1.4.0.7)
- SST Chain:  VCM     AOT     SST
- Data Analysis     Statistics about Input Data
- Data reliability, availability, variability, ...
- Data Analysis     Statistics about Algorithm Products (Chain EDRs/IPs)
- Avg, Mean, Std Dev, % Missing Pixels, % Pixels out of range, ...
- Data Visualization and Interrogation
- X-Midas
- HDFView
- HDFLook
- GRASS (Geographic Resource Analysis Support System)

## Pre-Launch Algorithm Assessment

**Pre-Launch Algorithm**** ****Assessment**

- NSOF
- WAN

- GRAVITE

- LL

- STAR

- NGST

- UMBC

- CasaNOSA

**Correlative/ **
**Ancillary Data**

**Data**

**Ops&**
**Patch**
**Code**

**Performance Assessment**
**Algorithm Modifications**

- ACCB

- C/V Board

**Recommendations**
**& Supporting Data**

- . . .

- NASA
- (DAAC)

- EOS

- IDPS

- IPO Partner

- IPO

- NASA

- SSPR

- NOAA

## Upcoming Activities

**Algorithm Workshop #3**
- Fall/Winter 2006
**Continuous development on GRAVITE**
- Additional algorithm chains
- Integrating larger community