# Presentation: 310701

##  Algorithm Implementation Process 

** ****Algorithm Implementation Process**** **

**Pam Emch**
**NGST Algorithm Thread Lead**
**NPP Science Team Kick-off Meeting**
**Annapolis, MD**
**Nov 4-6, 2003 **

## Topics

-   **Introduction to the SSPR Organization**
-   **Algorithm Lifecycle for NPP/NPOESS**
**Top-Level Algorithm Status**
-   **Algorithm Configuration Management**
-   **Provision of Algorithms to OATs and NASA**

## SSPR Contractor Organization

**SSPR Contractor Organization**

**Vice President and NPOESS Program Director**
- Fred Ricker
**Vice President and NPOESS Assistant Program Director**
- Mike Mader

**System**
**Engineering &**
**Integration**
- Roy Tsugawa

**System**
**Test & **
**Evaluation**
- Steve Young

**Payloads**
- Tom Kolesar

**Space**
**Segment**
- Terry Larson

**Ground**
**Segments**
- Keith Reinke

- 8/29/02

**Raytheon Deputy Program Manager: **Gerard Wittman
**Operations Manager: **Bill Havens
**Technical Director: **Terry Larson
**Supply Chain Manager: **Brian Chappel
**Chief Engineer: **Ben James
**Project Scientist:** Michael Mussetto
**Chief SW Engineer: **Scott Yanke
**QA Manager: **Rick Ikemoto
**Raytheon Subcontract Manager: **Bill Rightmier

**Operations**
**& Support**
- Ben James

**System **
**Engineering**
- TBD

**System **
**Integration**
- Gary Waldeck

**Spacecraft**
- Don Adkins

**LSS**
- Rex Desilets

**IDPS, FTS**
- Kerry Grant

**C3S**
- Mark Sargent

**Ground O&S**
- Tom Baugh

**Flight O&S**
- Terry Watson

**SSPR presenters come from these organizations**

## NGST has a defined “cradle-to-grave” algorithm process
Prelaunch tools and processes are now in use
Algorithms placed under software configuration management (SCM) upon delivery to NGST
Maintained in common SCM environment throughout lifecycle
Science definition of algorithms controlled by Algorithm CCB throughout lifecycle
Developed a detailed definition of roles & responsibilities across program throughout algorithm lifecycle

**Prelaunch tools and processes are now in use**
**Algorithms placed under software configuration management (SCM) upon delivery to NGST**
**Maintained in common SCM environment throughout lifecycle**
**Science definition of algorithms controlled by Algorithm CCB throughout lifecycle**
**Developed a detailed definition of roles & responsibilities across program throughout algorithm lifecycle**

**Algorithm Lifecycle Defined for ****Life of NPP/NPOESS Program**

## Algorithm Lifecycle

**Algorithm Lifecycle**

**Science Algorithm Development/ Procurement**

**Science Algorithm Verification**

**Science to Operational Algorithm Migration**** **

**Operational Algorithm Performance Verification**

- Delivered Science Algorithms
-  ATBD
-  Science-grade code
-  Test Data Sets

- Operational Algorithms
-  Operational Algorithm Document
-  Operational-grade code

**Operational Algorithm Cal/Val**

**Long-Term Operational Algorithm Cal/Val**** **

- Verified Science Algorithms
-  ATBD
-  Science-grade code
-  Test Data Sets
-  OADs

- Discrepancy Reports
-  Operation
-  Performance

- Calibrated/Validated Operational Algorithms
- Calibration Coefficients
- Operational-grade code

-  Discrepancy reports
-  New calibration coefficients

- Correction requests
-  Incomplete delivery
-  Non-compliant products
-  Failure Analysis

- Science Discrepancy Reports
-  Timeliness failure
-  Quality failure
-  EDR Test output

- Verified Operational Algorithms
-  Operational-grade code

- Operational Verification Test Reports
-  Pass
-  Fail
-    - Timeliness failure
-    - Quality failure

**Specific IPTs have responsibility and budget for assigned algorithm activities within program phases**

**Payload IPT**

**SE IPT**

**IDPS IPT**

**IDPS, SE, ST&E IPTs**

**ST&E IPT**

**O&S IPT**

**Launch**

## Current Lifecycle Status of Algorithms

## Algorithm Lifecycle

**Science Algorithm Development/ Procurement**

**Science Algorithm Verification**

**Science to Operational Algorithm Migration**** **

**Operational Algorithm Performance Verification**

- Delivered Science Algorithms
-  ATBD
-  Science-grade code
-  Test Data Sets

- Operational Algorithms
-  Operational Algorithm Document
-  Operational-grade code

**Operational Algorithm Cal/Val**

**Long-Term Operational Algorithm Cal/Val**** **

- Verified Science Algorithms
-  ATBD
-  Science-grade code
-  Test Data Sets
-  OADs

- Discrepancy Reports
-  Operation
-  Performance

- Calibrated/Validated Operational Algorithms
- Calibration Coefficients
- Operational-grade code

-  Discrepancy reports
-  New calibration coefficients

- Correction requests
-  Incomplete delivery
-  Non-compliant products
-  Failure Analysis

- Science Discrepancy Reports
-  Timeliness failure
-  Quality failure
-  EDR Test output

- Verified Operational Algorithms
-  Operational-grade code

- Operational Verification Test Reports
-  Pass
-  Fail
-    - Timeliness failure
-    - Quality failure

**Algorithm Lifecycle**

**Phase I**** - ****Payload IPT**

**Phase 2**** -    ****SE IPT**

**Phase 3**** -  ****IDPS IPT**

**Phase 4 -   ****IDPS, ST&E IPTs**

**Phase 5 -  ****ST&E IPT**

**Phase 6 -  ****O&S IPT**

**VIIRS, OMPS, and CrIS algorithms are currently furthest along, in Phase 2 and Phase 3**
**All other algorithms are still in Phase 1**

**Launch**

## NPP Algorithm Status

_**Drop 1**_** **
**(up to 3-31-03)**

_**Drop 2**_** **
**(4-1-03 to 9-17-04)**

**On schedule**

**Not on schedule**

**Schedule Legend**

**Issue**

**Watch Area**

**Comment Legend**

## Provision of Algorithms, ATBDs, OADs and supporting documents to OATs and NASA 

## Copies of Science Algorithms Available

**NGST, IPO, and NASA collaborated to enable provision of copies of versions of science algorithms to OATs, etc.**
**These are copies of the delivery packages sent from SE IPT to IDPS IPT**
**All of these versions are at intermediate steps in the lifecycle and are **_**not final**_
**The algorithms are available via the NASA NEXT server**
**Deliveries from SE to IDPS to date are available**
**Individuals must be approved for access**
**NASA individuals contact Bruce Guenther, GSFC**

## Algorithm Lifecycle – Deliveries to the NASA NEXT Server

**Science Algorithm Development/ Procurement**

**Science Algorithm Verification**

**Science to Operational Algorithm Migration**** **

**Operational Algorithm Performance Verification**

- Delivered Science Algorithms
-  ATBD
-  Science-grade code
-  Test Data Sets

- Operational Algorithms
-  Operational Algorithm Document
-  Operational-grade code

**Operational Algorithm Cal/Val**

**Long-Term Operational Algorithm Cal/Val**** **

- Verified Science Algorithms
-  ATBD
-  Science-grade code
-  Test Data Sets
-  OADs

- Discrepancy Reports
-  Operation
-  Performance

- Calibrated/Validated Operational Algorithms
- Calibration Coefficients
- Operational-grade code

-  Discrepancy reports
-  New calibration coefficients

- Correction requests
-  Incomplete delivery
-  Non-compliant products
-  Failure Analysis

- Science Discrepancy Reports
-  Timeliness failure
-  Quality failure
-  EDR Test output

- Verified Operational Algorithms
-  Operational-grade code

- Operational Verification Test Reports
-  Pass
-  Fail
-    - Timeliness failure
-    - Quality failure

**Algorithm Lifecycle – Deliveries to the NASA NEXT Server**

**Phase I - ****Payload IPT**

**Phase 2 -    ****SE IPT**

**Phase 3 -  ****IDPS IPT**

**Phase 4 -   ****IDPS, ST&E IPTs**

**Phase 5 -  ST&E IPT**

**Phase 6 -  O&S IPT**

**“****Quicklook”: A copy of this delivery, consisting of untested and unverified algorithms, is delivered to the IDPS IPT.  An identical copy is to NASA NEXT. **

**An identical copy of the Verified Science Algorithm deliveries is sent to NASA NEXT.**

**Launch**

## Algorithm Configuration Control

## Roles and Responsibilities
The ACCB has authority to review and approve changes to the documents and items under its control that do not affect the baseline-released documents under Program CCB control. 

Items Controlled
Algorithm Theoretical Basis Documents (ATBDs)
Science Code
Algorithm Test Data
Operational Algorithm Documents (OADs)

ARB/ACCB meets weekly

**The ACCB has authority to review and approve changes to the documents and items under its control that do not affect the baseline-released documents under Program CCB control. **
**Items Controlled**
**Algorithm Theoretical Basis Documents (ATBDs)**
**Science Code**
**Algorithm Test Data**
**Operational Algorithm Documents (OADs)**
**ARB/ACCB meets weekly**

**Algorithm Configuration Control Board (ACCB)**

## Membership
Chairman (SE&I IPT: Algorithm Implementation Process Lead – Emch)
3 IPO Members (Haas, Duda, Baker) 
Reps for six IPTs (P/L, SE, SI, IDPS, ST&E, O&S)
Software Chief Engineer Rep

Other attendees
NGST Configuration Management 
Supporting individuals (additional members of the IPTs, including SSPR team, IPO, NASA)	

**Chairman (SE&I IPT: Algorithm Implementation Process Lead – Emch)**
**3 IPO Members (Haas, Duda, Baker) **
**Reps for six IPTs (P/L, SE, SI, IDPS, ST&E, O&S)**
**Software Chief Engineer Rep**
**Other attendees**
**NGST Configuration Management **
**Supporting individuals (additional members of the IPTs, including SSPR team, IPO, NASA)****	**

**Algorithm Configuration Control Board (ACCB), cont’d**

## Bi-weekly SE IPT VIIRS and CrIS/ATMS Algorithm Performance meetings
Discuss hardware and software topics of importance to algorithm and product performance

Weekly SE IPT M&S S/W CCB meetings 
Discuss and request changes to ACCB controlled items for work done within SE; strict CM processes applied

Regular IDPS IPT Software Peer Reviews
Discuss and request changes to ACCB controlled items (e.g. OADs) and other items during the sci to ops migration process for work done within IDPS

**Discuss hardware and software topics of importance to algorithm and product performance**
**Weekly SE IPT M&S S/W CCB meetings **
**Discuss and request changes to ACCB controlled items for work done within SE; strict CM processes applied**
**Regular IDPS IPT Software Peer Reviews**
**Discuss and request changes to ACCB controlled items (e.g. OADs) and other items during the sci to ops migration process for work done within IDPS**
**	**

**Precursor Meetings Flow Up Change Requests to ACCB****   **

## Following Presentations Touch on Aspects of Science and Operational Algorithms

**Science Algorithm Development/ Procurement**

**Science Algorithm Verification**

**Science to Operational Algorithm Migration**** **

**Operational Algorithm Performance Verification**

- Delivered Science Algorithms
-  ATBD
-  Science-grade code
-  Test Data Sets

- Operational Algorithms
-  Operational Algorithm Document
-  Operational-grade code

**Operational Algorithm Cal/Val**

**Long-Term Operational Algorithm Cal/Val**** **

- Verified Science Algorithms
-  ATBD
-  Science-grade code
-  Test Data Sets
-  OADs

- Discrepancy Reports
-  Operation
-  Performance

- Calibrated/Validated Operational Algorithms
- Calibration Coefficients
- Operational-grade code

-  Discrepancy reports
-  New calibration coefficients

- Correction requests
-  Incomplete delivery
-  Non-compliant products
-  Failure Analysis

- Science Discrepancy Reports
-  Timeliness failure
-  Quality failure
-  EDR Test output

- Verified Operational Algorithms
-  Operational-grade code

- Operational Verification Test Reports
-  Pass
-  Fail
-    - Timeliness failure
-    - Quality failure

**Phase I - ****Payload IPT**

**Phase 2 -    ****SE IPT**

**Phase 3 -  ****IDPS IPT**

**Phase 4 -   ****IDPS, ST&E IPTs**

**Phase 5 -  ST&E IPT**

**Phase 6 -  O&S IPT**

**Launch**