# Presentation: 023280

## Mission Assurance Forum

- March 2001

- Mission Assurance Forum - NASA/KSC ELV Launch Services

## Agenda

- Organization
- Mission Integration Teams
- Manifest
- Launch Vehicle Certification
- Insight & Approval
- Engineering Review Process
- Engineering Review Board
- Flight Anomaly Resolution
- Mission Analysis
- Verification Process
- Resident Offices
- Reviews
- Safety & Flight Assurance and Risk Management
- Launch Readiness Reviews
- Launch Operations
- Lessons Learned Process

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Organization

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Slide 4

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Mission Integration Teams

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Mission Integration Team

**Resident**
** ****Office**

**KSC**
**Vehicle**
**Systems**

**KSC**
**Mission **
**Analysis**

**ELV Engineering Division**

**Launch Sites Operations Division**

**Mission Mgmt Office**

**ELV Launch Services**

**Safety & Flight Assurance**

**Comm.& **
**Telemetry**

**NASA/KSC**
**MIM**

**NASA/KSC**
**IE**

**Customer**

**LSP**

**Shading / green color indicates external to NASA ELV Project Office**

**NASA/KSC**
**LSIM**

**NASA/KSC**
**LSM**

**S/C**
**Launch**
**Site**
**Team**

**Range **
**Safety**

**NASA**
**Budget**

**NASA**
**Contracts**

**S/C**
**Systems**
**Engineer**

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Technical Information flow into the MIT

- Integration &
- Test Facilities

- Vehicle Systems
- Lead

**Resident**
** ****Offices**

**KSC**
**Vehicle**
**Systems**

**Core Vehicle Team**

**Core Vehicle Test & Build**

**KSC**
**Mission **
**Analysis**

**Comm.& **
**Telemetry**

**NASA/KSC**
**MIM**

**NASA/KSC**
**IE**

**Customer**

**LSP**

**NASA/KSC**
**LSIM**

**NASA/KSC**
**LSM**

**S/C**
**Launch**
**Site**
**Team**

**Range **
**Safety**

**NASA**
**Budget**

**NASA**
**Contracts**

**S/C**
**Systems**
**Engineer**

**Mission Integration**

- ELV Chief
- Engineer

- Safety & Flight
- Assurance

- Integrated
- Product
- Teams

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Manifest

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Flight Planning Board/Manifest Status

- For NASA/KSC Internal Planning Purposes Only

- * Secondary Payload

- This Manifest Last Updated 3/8/01
- HQ Manifest Last Updated 3/1/01

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Flight Planning Board/Manifest Status

**Flight Planning Board/Manifest Status**

- For NASA/KSC Internal Planning Purposes Only

- * Secondary Payload

- This Manifest Last Updated 3/8/01
- HQ Manifest Last Updated 3/1/01

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Launch Vehicle Certification

- Mission Assurance Forum - NASA/KSC ELV Launch Services

## Launch Vehicle Certification

- Purpose:  To outline NASA Headquarters requirements for expendable launch services risk mitigation and to discuss KSC’s responses to requirements in terms of documentation and processes
- Key Documentation and Processes include:
- NPD 8610.7 “Launch Services Risk Mitigation Policy for NASA-Owned or NASA-Sponsored Payloads”
- K-ELV-10.2 “Expendable Launch Vehicle Certification”
- KDP-P-2837 “Expendable Launch Vehicle Certification Process”
- K-ELV-10.3 “Expendable Launch Vehicle Certification Plan”

- NASA Documentation (NPD, KPD)  referenced here can be found at the following web address:
- _[http://](http://nodis.hq.nasa.gov/)__[nodis](http://nodis.hq.nasa.gov/)__[.](http://nodis.hq.nasa.gov/)__[hq](http://nodis.hq.nasa.gov/)__[.](http://nodis.hq.nasa.gov/)__[nasa](http://nodis.hq.nasa.gov/)__[.](http://nodis.hq.nasa.gov/)__[gov](http://nodis.hq.nasa.gov/)__[/](http://nodis.hq.nasa.gov/)_
- A User Guide can be found at the following location;
- _[http://](http://nodis.hq.nasa.gov/Library/Directives/NASA-WIDE/MSWord_Docs/N_PG_1000_0002_.pdf)__[nodis](http://nodis.hq.nasa.gov/Library/Directives/NASA-WIDE/MSWord_Docs/N_PG_1000_0002_.pdf)__[.](http://nodis.hq.nasa.gov/Library/Directives/NASA-WIDE/MSWord_Docs/N_PG_1000_0002_.pdf)__[hq](http://nodis.hq.nasa.gov/Library/Directives/NASA-WIDE/MSWord_Docs/N_PG_1000_0002_.pdf)_.nasa.gov/Library/Directives/NASA-WIDE/MSWord_Docs/N_PG_1000_0002_.pdf
- NASA KSC ELV Documentation (K-ELV)  referenced here can be found at the following web address:
- http://tdsearch.ksc.nasa.gov/search/general.html

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Flow Down of Launch Vehicle Certification Documents

**NPD 8610.7**
**Launch Services Risk Mitigation Policy for NASA-Owned or NASA-Sponsored Payloads**

**Pegasus**
**Certification**
**Plan**

**PMI K-ELV-10.2**
**Expendable Launch Vehicle Certification**

**KDP P-2837**
**Expendable Launch Vehicle Certification Process**

**PMI K-ELV-10.3**
**Expendable Launch Vehicle Certification**
**Implementation Plan**

**Delta-II**
**Certification**
**plan**

**Delta-III**
**Certification**
**Plan**

**Delta-IV**
**Certification**
**Plan**

**Atlas-II**
**and IIAS**
**Certification**
- COMPLETE

**Atlas-III**
**Certification**
**Plan**

**Atlas-V**
**Certification**
**Plan**

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## NPD 8610.7, “Launch Services Risk Mitigation Policy for NASA-Owned or NASA-Sponsored Payloads”

- Requires U.S. launch services
- Exceptions:
- (1) Waiver by OSTP
- (2) Foreign cooperative
- Defines 3 categories of payloads:

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## NASA ELV Certification Requirements

**NASA ELV CERTIFICATION REQUIREMENTS**

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## PPMI K-ELV-10.2,  “Expendable Launch Vehicle Certification”

- Developed in response to NPD 8610.7 as KSC’s implementation requirements
- Initial release signed in 1999 to support NASA Launch Services (NLS) procurement
- Rev B signed February 2001
- Provides  key definitions
**Common Vehicle Configuration**:  A distinct combination of core propulsive stages and hardware used to deliver payloads to earth orbit or escape trajectories
**Core Propulsive Stages**:  All propulsive stages except strap-on motors, final stages (exclusively used for orbit circularization or escape), and trim stages
**Common Vehicle Configuration Changes**:  Items that substantially affect the airframe integrity, operating time, total impulse and/or thrust profile of one or more core propulsive stages...
**Successful Flight**:  A launch which met primary mission requirements

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## PPMI K-ELV-10.2,  “Expendable Launch Vehicle Certification” (continued)

- Delineates requirements in 8610.7 and establishes methodology for certifying launch services meet the requirements for the 3 categories of payloads
- Cat. 1 lead by MSFC per MSFC RQMT-3019
- Cat. 2  requires KSC comprehensive review of launch service provider’s qualification test program in addition to review of acceptance test results
- Flight margin verification for both Cat. 2 and Cat. 3 requires an anomaly  investigation of vehicle parameters which exceeded the 3 sigma predictions (regardless of mission success determination)
- Established an alternate method to obtain Cat. 3 certification
- Applies to new launch vehicles derived from previously certified Cat. 3 vehicles
- Requires 6 consecutive successful flights and certification for Cat. 2
- Expanded vehicle design assessment includes a heritage assessment, and a comprehensive analysis review
- Expanded audits include: Test Philosophy, Risk Mitigation, Documentation Systems, Program Management, Configuration Management, Design and Engineering
- Defines process for launch service provider to seek certification

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Revision B, released 2/2/01, included the following changes
Revised title from “Qualification” to “Certification” to avoid confusion by launch service providers.  KSC will “certify” that the vehicle meets the requirements/intent of 8610.7
Clarified original definitions for consistency 
Revised launch vehicle requirements for flying category 2 payloads to be consistent with NPD 8610.7; however, requires KSC investigation of launch vehicle component/system qualification testing in addition to acceptance testing
Moved some requirements from category 2 (those which were above requirements in 8610.7) to alternate category 3
Now requires alternate method category 3 to include category 2 requirements

- Revised title from “Qualification” to “Certification” to avoid confusion by launch service providers.  KSC will “certify” that the vehicle meets the requirements/intent of 8610.7
- Clarified original definitions for consistency
- Revised launch vehicle requirements for flying category 2 payloads to be consistent with NPD 8610.7; however, requires KSC investigation of launch vehicle component/system qualification testing in addition to acceptance testing
- Moved some requirements from category 2 (those which were above requirements in 8610.7) to alternate category 3
- Now requires alternate method category 3 to include category 2 requirements

**PPMI K-ELV-10.2,  “Expendable Launch Vehicle Certification” (continued)**

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## KDP-P-2837, “ELV Launch Vehicle Certification Process”

- Further defines the process flow for certifying the launch vehicle
- Utilizes existing ELV Project and Program decision forums
- Establishes roles and responsibilities within KSC organization for completing certification process

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## PPMI K-ELV-10.3, “Expendable Launch Vehicle Certification Plan”

- Recently developed - signature pending
- Inclusive of 10.2 requirements and KDP process, while providing engineering implementation details
- Generic enough to apply to any launch vehicle undergoing 8610.7 certification
- Generically defines the LV data and documentation required to meet Cat. 2, 3, and alternate method 3 requirements
- Refers to analysis and data products without regard to a launch service provider’s specific documentation
- Further defines responsibilities within ELV Program for data review
- Provides a phased approach and identifies relative timelines to implement certification
- Provides the baseline for developing LV specific plans as required

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Launch Vehicle Certification Plans

- A specific Launch Vehicle Certification Plan will be generated for each vehicle undergoing Cat. 2 or 3 certification
- Will reference launch service provider specific documentation nomenclature
- Will include planning schedule based on current development/flight status of the launch vehicle under consideration
- Will consider uniqueness of launch vehicle under consideration
- KSC Engineering intends to bring elements of the certification effort to the Engineering Review Board “as we go”
- Will facilitate manageable work elements
- Provides interested parties visibility into the progress of the certification effort

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Launch Vehicle Certification Today

- ELV Program has received three requests for Cat. 3 vehicle qualification:
- Lockheed Martin for Atlas II
- Boeing for Delta II
- Orbital for Pegasus XL
- In response, KSC has/is applying the K-ELV-10.2 Program Management Instruction, and the KDP-P-2837 process
- Review vehicle hardware configuration
- Verify ISO 9000 compliance
- Perform flight margin verification for 14 consecutive successful launches
- To date, the Program has granted certification to:
- Lockheed Martin for Atlas II series
- Boeing for Delta 792x series
- Boeing 732x and 742x series in work
- Orbital Pegasus effort to be initiated
- KSC Engineering is working on specific certification plans for Atlas III/V, and Delta III/IV

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Summary

- Meet intent of NASA Headquarters requirements in NPD 8710.7
- “launch services acquisition strategy shall seek to balance mission risk with launch vehicle demonstrated flight history and maturity”
- Recognize that absolute compliance may not be achievable for fleets in development or other emerging vehicles
- Alternate method for category 3 establishes additional requirements to balance the risk of having less than 14 consecutive successful flights
- Create the ability to quantify the extent to which the vehicle meets the certification requirements
- Determine the extent of the risk to be managed or accepted
- Provide a documented process
- Traceability
- Provide a consistent process
- Assure no appearance of favoritism

- KSC Goals for Launch Vehicle Certification

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Insight & Approval

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Insight and Approval

- Purpose:  To outline NASA Headquarters requirements for Launch Vehicle Technical Oversight and to discuss KSC’s responses to the requirements in terms of documentation and processes
- Key documentation and processes include:
- NPD 8610.7 	“Technical Oversight of ELV Launch Services”
- K-ELV-10.1 	“Implementation of NASA’s Insight and 					Approval Role for Expendable Launch Vehicle 				Services”
- K-ELV-02.6  	“Engineering Review Process”

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## NPD 8610.23

- NASA's technical oversight approach seeks to ensure the highest practicable probability of launch success by involvement in, and control of, the launch through technical oversight
**Technical oversight**- combination of focused approvals and technical insight of contractor launch activities
**Insight**-acquiring knowledge and understanding of contractor’s actions by monitoring of selected metrics and/or milestones through watchful observation, documentation review, meeting attendance, reviews, tests, and compliance evaluations.
**Approval**-providing the  contractor authority to proceed and/or formal acceptance of requirements, plans, tests, or success criteria in specified areas
- NASA retains the right to nonconcur with the contractor’s proposed actions based on knowledge obtained through insight
- Policy applies to all NASA managed launches.  Launches identified at the Flight Planning Board as able to tolerate higher risk may utilize a modified technical oversight approach

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## NPD 8610.23

**Specific areas requiring government approval is focused on the interface with the spacecraft**
- S/C to LV ICD’s documents and drawings
- Resolution/closeout  of MIWG, MRR and FRR action items
- Mission unique hardware/software design, analysis, manufacture, and test
- Top level test plans, requirements, and success criteria for Integrated Vehicle Systems and for tests that verify the integrated vehicle interfaces
- Spacecraft handling procedures and deviations
- Integrated S/C to LV mate, test and closeout procedures, as run procedures and deviations
- Anomaly resolutions that affect the integrated S/C to LV assembly
- Launch commit criteria and Launch Go/No-Go

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## NPD 8610.23

**Specific areas open to government insight are widespread**
- Baseline vehicle design, analyses, and configuration management
- Production, including reviews, plans, schedules, tests, post test data and MRB’s, Critical flight hardware pedigree
- Major system and integrated systems tests
- Post test data, anomaly resolution/closeout, failure analysis,
- Launch site schedules, plans, vehicle preparation, closeout data, walkdowns, operations and procedure discipline
- Post launch data and anomaly investigations/closeouts

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Defines the implementation by the ELV Program Office for the insight and approval of ELV services as required by NPD 8610.23, NPD 8610.24, and NASA Standard 8709.2
Provides applicability for all phases of ELV’s support to a mission

In considering the level of insight and approval to be applied to a particular mission, the maturity of the launch vehicle and the complexity and criticality of the mission will be considered

- Provides applicability for all phases of ELV’s support to a mission
- In considering the level of insight and approval to be applied to a particular mission, the maturity of the launch vehicle and the complexity and criticality of the mission will be considered

**K-ELV-10.1 “Implementation of NASA’s Insight and Approval Role for Expendable Launch Vehicle Services”**

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Slide 30

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Slide 31

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Slide 32

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## K-ELV-10.1 “Implementation of NASA’s Insight and Approval Role for Expendable Launch Vehicle Services”

**DEFINITIONS:**
_**Audit**_**:**  An independent review for the purpose of assessing compliance with hardware/software requirements, specifications, baselines, standards, procedures, instructions, codes, or contractual and licensing requirements.
_**Surveillance**_**:**  The continual monitoring and verification of status of an entity and analysis of records to ensure that specified requirements are being met.  Note:  Surveillance can be performed in an insight, oversight, or a combined mode as determined by NASA using a risk-based decision process (NPG 8735.2)

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Vehicle Engineering Division

**Vehicle Engineering Division**
**VB-A**
- Chief, Darren Bedell
- Chief Engineer, James Wood
- Mgr, Vehicle Enhancements
-                   Maria Littlefield
- Secretary, Patrice Thomas

**Mission Analysis Branch **
- Chief, Mike Carney
- Flight Design
- Flight Software/Guidance
- Loads/Dynamics
- Dynamic Environments
- Controls and Stability
- Thermodynamics/aerodynamics
- Stress
- EMI
- Tool Development

**Engineering Integration Branch**
- Chief, Jim Robinson

**Vehicle System Leads**
- Delta II, J.J. Joyner
- Atlas II, Dan  Johnson
- Small Vehicles, Tom DeLaet
- Delta III/IV,  DaveSollberger;
- Atlas IV/V, Doug Lindhorst
**GSE **
- Mechanical Fluids
- Electronics & Power
- Ground Software

**Electrical**
- Power
- GN&C
- RF and TM
- Instrumentation
**Mechanical**
- Structures
- Pneumatics
- Ordnance
- Contamination
**Propulsion**

**Huntington Beach**
- Systems
- Electrical
- Mechanical
- Propulsion
- Integration

**Denver**
- Manager** **
- Systems
- Mechanical
- Propulsion
- Electrical

**VB-A3**

**VB-A4**

**Vehicle Systems Branch**
- Chief, Pat Hanan

**VB-A7**

**VB-A8**

**Chandler  **
- Mechanical
**Pueblo**
- Mechanical
- Electrical
**VAFB**
- Mechanical
- Electrical
- Ground Software

**Engineering Field Offices Branch**
-  Chief, Mike  Hallett (HB)
- Secretary, Carole Renfro (HB)

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Engineering Review Process

**K-ELV-02.6**

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Engineering Review (ER) Process

- Establishes criteria for documenting and evaluating certain technical issues that require engineering disposition
- Process results in technical recommendations to the ELV Project
- Rationale exclusively considers technical adequacy
- Does not consider cost or schedule
- Process goal is to establish a “technically adequate” solution,  not the “best” solution
- May consider multiple courses of action as required due to cost and schedule considerations and evaluate each independently on technical merit
- Documented process released in Dec 2000 characterizes results of evolution since program consolidation in 1998, and adds near term improvements:
- Engineering Review Sheet and database to facilitate issue documentation and information management
- Additional attention to mission unique requirements
- Tie between launch service provider design reviews and the Engineering Review Board

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## ER Process Phases

- Initiation
- Acknowledge and document that an item requires engineering review
- Resolution
- Gather data to develop recommendations and rationale
- Disposition
- Senior engineers (or Engineering Review Board) concur with recommendations
- Disposition becomes a project record, along with resolution history
- Rationale and supporting data now captured for future reference

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Engineering Review Board

- Engineering Review Board (ERB) is a NASA GRC/LMA-heritage tool adapted by KSC ELV following consolidation
- Expanded by KSC ELV into a more-global process for engineering review
- Used to disposition and provide technical reccomendations and rationale for a subset of engineering issues
- ERB Membership
- Chaired by ELV Chief Engineer
- May designate alternate chair from permanent board membership
- Permanent board membership consists of Engineering Division Chief and Branch Chiefs
- Systems Engineering skills and a particular area of expertise required
- Each permanent board member may designate an alternate as required

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Engineering Review vs. ERB Trigger Criteria

- Engineering Review Trigger Criteria
- Any flight observation or anomaly occurring on any ELV providing NASA launch services
- Qual status change for any component
- New or upgraded component expected to be used on a NASA mission within the first 6 flights
- Significant non-conformances, test anomalies or process deviations that warrant investigation
- Mission-Specific technical requirements
- Class I change, deviation or waiver to a mission-specific requirement

- ERB Trigger Criteria
- Any flight anomaly occurring on any ELV providing launch services to NASA
- Qual status change for any component
- First Flight Item if expected to be used on a NASA mission within the first 6 flights
- Major non-conformance of any component to a degree that may threaten mission success
- Mission “Turn On” and ICD release
- Mission-Specific PDRs, CDRs and DCRs

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## ERB Reporting Path

- Board chairman reports recommendations to ELV Engineering Division Chief and ELV Project Director
- ELV Project Director dispositions recommendations
- May require action by engineering, integration, program office, or any combination thereof
- ERB recommendations are not technical direction to a contractor
- Recommendations may be referenced in direction provided by a NASA Contracting Officer or Contracting Officer’s Technical Representative
- Recommendations are provided to contractor for their insight to the NASA ERB process

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## ERB Participation

- NASA Vehicle Systems Lead and cognizant engineers are typically responsible for presentation of material
- ERB is a completely open process
- Launch Service Provider attendance always invited, either in person or by telecon
- Visibility encourages higher quality
- Purely engineering discussion needs no “government caucus”
- Launch Service Provider representatives are free to ask questions and recommend actions
- Launch Service Provider participation in an ERB is never interpreted to indicate contractor agreement with ERB recommendations
- Preserves freedom of the team to achieve maximum benefit from technical interchange

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Engineering Review ProcessGeneric Flow

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Engineering Review ProcessGeneric Flow (continued)

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Engineering Review ProcessGeneric Flow (continued)

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Flight Anomaly Resolution

- NASA Anomaly Identification and Resolution Process is typical of a Launch Service Provider’ (LSP) Process
- NASA identifies observations and anomalies by reviewing mission post-flight data, LSP post-flight reports, and normal insight practices and processes
**Observation**:  An event occurring during vehicle flight that is unusual or unexpected
- The ER Process will be initiated for all flight observations
- An observation is not considered a launch constraint
**Anomaly:**   A flight observation where concerns exist regarding the success of future missions
- An anomaly is a launch constraint until dispositioned otherwise by an ERB
- The determination whether a flight event is an observation or considered by NASA to be an anomaly is made by the NASA ELV Chief Engineer
- NASA  engineers and/or and Chief Engineer may or may not concur with a LSP’s determination
- In practice, the ELV engineering rarely disputes the LSP Chief Engineer’s determination of observation versus anomaly

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Mission Analysis

- Overall objective is to decrease mission risk thru review and verification of mission unique requirements/analyses and relevant fleet issues
- Baseline approach is to review Launch Service Provider (LSP) analyses and documentation
- Intend to obtain and/or develop launch vehicle models as practicable in all mission analyses areas
- Philosophy is to get the models, learn to run the models, so we don’t always have to run the models
- Detailed knowledge of models enables effective review of analyses
- Models and enhanced systems knowledge will help solve technical issues in conjunction with the LSP
- Use models for verification of critical mission unique requirements
- Current status of model capability is a result of vehicle maturity and GSFC/GRC heritage

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## KSC Verification Process

**KSC Verification Process**

**Mission Specification (MS)**

**Analysis**

**Test**

**Inspection**

**Test**
**Reports**

**Verification **
**Methods**

**Documentation**

**Interface Verification Complete**

**Interface **
**Documentation**

**Interface**
** ****Verification**

**Design **
**Reviews**
** ****(PDR, CDR, DCR)**

**ERB**

**Integration**

**Products**:

**Reviewers**

**Contractor**
** ****Reviews**

**Analysis/**
**Results**

**Drawings/**
**Build Paper**

**Lower level **
**requirements**

**MS Verification Matrix**

**Mission Analysis**
**Electrical**
**Mechanical**
**Integration**
**Ground Processing**
**Resident Office**

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Resident Offices

- The Huntington Beach Office provides leadership and direction to the other offices, while focusing primarily on requirements, design engineering and integration issues
- The Denver Resident Office focuses primarily on requirements, design engineering and integration issues
- The Pueblo and Chandler Offices focus primarily on manufacturing and test issues and their resolution
- Vandenberg focuses primarily on integration and launch issues.

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## R E V I E W   F L O W   D U R I N G   M I S S I O N   CYCLE

- Spacecraft Preliminary Design Review  (PDR)

- Spacecraft Critical Design Review  (CDR)

- Mission Integration Working Group (MIWG)

- Technical Interchange Meeting (TIM)

- Ground Operations Working Group (GOWG)

- Pre-Vehicle on Stand (Pre-VOS) or Systems Review or LV Mission Readiness Review

- Ground Operations Review (GOR)

- KSC Center Director Launch Vehicle Launch Readiness Review  (CD LVLRR)

- Spacecraft Mission Readiness Review (MRR)

- Launch Site Readiness Review or equivalent pre-mate review

- Flight Readiness Review (FRR)

- Launch Management Coordination Meeting (LMCM)

- Mission Dress Rehearsal (MDR)

- Launch Readiness Review (LRR)

- Critical Design Review (CDR)

- Preliminary Design Review (PDR)

**Launch Campaign Begins                                                  **

- The following table provides an overview of the meetings and reviews and their flow during mission cycle

- Launch
- Management
- Phase

- Launch Site
- Operations
- Phase

- Mission
- Design,
- Integration
- &
- Engineering
- Phase

- Vehicle
- Production
- Insight
- Phase

**(Approx. L-30 to 60 days)**

**(Approx. L-5 days)**

- Spacecraft Pre-Ship Review

- Design Certification Reviews (DCR)

- Integration Telecons

**R E V I E W   F L O W   D U R I N G   M I S S I O N   CYCLE**

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## M E E T I N G  /  R E V I E W   D E S C R I P T I O N   T A B L E

- The following table provides more detail to the meetings and reviews during mission processing.

**M E E T I N G  /  R E V I E W   D E S C R I P T I O N   T A B L E**

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## M E E T I N G  /  R E V I E W   D E S C R I P T I O N   T A B L E   (continued)

**M E E T I N G  /  R E V I E W   D E S C R I P T I O N   T A B L E   (continued)**

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Safety & Flight Assurance

**and**
**Risk Management**

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## SFAO Resources

**SFAO Resources**

- Civil Service (11)
- Contractor (8)
- DCMA LODs (13,000 hrs)
- Strategically Located
- Huntington Beach, CA Boeing Plant
- Denver, CO LMA Plant
- Chandler, AZ Orbital Plant
- VAFB Western Range
- CCAFS Eastern Range

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Roles And Responsibilities (Insight)

**NASA STD 8709.2**	Safety & Mission Assurance Roles & Responsibilities 			for ELV Launch Services
**Quality Assurance**	Quality Engineering, Reliability Engineering, 				surveillance, audits, process assessments, 				performance metrics, trend analysis, software 			assurance and numerous technical reviews.
**Safety Assurance**	Industrial Safety & System Safety Engineering
**Contingency Planning**
**Risk Management**

**Roles And Responsibilities (Insight)**

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Roles And Responsibilities (continued)

** ****Vehicle Assignments**
**Mission Assignments**
**Site Assignments**
**Developing Areas of Expertise**
**DCMA QAR**

**Roles And Responsibilities (continued)**

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Risk Management Paradigm

**Risk Management Paradigm**

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## ELV Risk Exposure

**ELV Risk Exposure**

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Risk Reviews

**Risk Reviews**

- Monthly Reviews - Discussion forum for red and new risks.
- Quarterly Reviews - Discussion forum for all open risks.
- Average risk flow - 6 new risks per month.
- From 10/99 to 2/01, 95 risks were submitted:
- 20 Red (10% Admin, 85% Mission, & 5% Vehicle);
- 53 Yellow (4% Admin, 79% Mission, & 17% Vehicle);
- 22 Green (0% Admin, 86% Mission, & 14% Vehicle);
- 60 were closed, and one, a Green risk, was “accepted” and closed.

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Launch Readiness Reviews

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Reviews

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Reviews (continued)

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## R E V I E W   F L O W   D U R I N G   M I S S I O N   CYCLE

- Spacecraft Preliminary Design Review  (PDR)

- Spacecraft Critical Design Review  (CDR)

- Mission Integration Working Group (MIWG)

- Technical Interchange Meeting (TIM)

- Ground Operations Working Group (GOWG)

- Pre-Vehicle on Stand (Pre-VOS) or Systems Review or LV Mission Readiness Review

- Ground Operations Review (GOR)

- KSC Center Director Launch Vehicle Launch Readiness Review  (CD LVLRR)

- Spacecraft Mission Readiness Review (MRR)

- Launch Site Readiness Review or equivalent pre-mate review

- Flight Readiness Review (FRR)

- Launch Management Coordination Meeting (LMCM)

- Mission Dress Rehearsal (MDR)

- Launch Readiness Review (LRR)

- Critical Design Review (CDR)

- Preliminary Design Review (PDR)

**Launch Campaign Begins                                                  **

- The following table provides an overview of the meetings and reviews and their flow during mission cycle

- Launch
- Management
- Phase

- Launch Site
- Operations
- Phase

- Mission
- Design,
- Integration
- &
- Engineering
- Phase

- Vehicle
- Production
- Insight
- Phase

**(Approx. L-30 to 60 days)**

**(Approx. L-5 days)**

- Spacecraft Pre-Ship Review

- Design Certification Reviews (DCR)

- Integration Telecons

**R E V I E W   F L O W   D U R I N G   M I S S I O N   CYCLE**

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## M E E T I N G  /  R E V I E W   D E S C R I P T I O N   T A B L E   (continued)

**M E E T I N G  /  R E V I E W   D E S C R I P T I O N   T A B L E   (continued)**

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## M E E T I N G  /  R E V I E W   D E S C R I P T I O N   T A B L E   (continued)

**M E E T I N G  /  R E V I E W   D E S C R I P T I O N   T A B L E   (continued)**

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Launch Operations

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Launch Operations & Flight Plan (Lockheed Martin-Atlas/GOES only)
Specific to the GOES contract
Describes
Launch Windows
Ground-Wind Restrictions
Flight-Wind Restrictions
Weather Launch Constraints
Tracking and Data Acquisition Requirements
Launch Vehicle Telemetry Go/No-Go
Launch countdown Hold Capability and Recycle Requirements
Launch Countdown Hold and Recycle Strategy
Launch Countdown Summary
Flight Sequence
Flight Mark Events
Orbital Parameter Messages

- Specific to the GOES contract
- Describes
- Launch Windows
- Ground-Wind Restrictions
- Flight-Wind Restrictions
- Weather Launch Constraints
- Tracking and Data Acquisition Requirements
- Launch Vehicle Telemetry Go/No-Go
- Launch countdown Hold Capability and Recycle Requirements
- Launch Countdown Hold and Recycle Strategy
- Launch Countdown Summary
- Flight Sequence
- Flight Mark Events
- Orbital Parameter Messages

**Launch Operations Plans**

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Mission Director Center (MDC) Console Notebook
Provides the launch operations details:
Communication Protocol
Communication Nets Summary
Launch Window
Anomaly Resolution
Launch Decision
MDC Seating / Displays
Call Signs
Mandatory Assets for Launch
Launch Winds Plan/Balloon Release Schedule
Includes the Terminal Count Documentation (Countdown Manual)

- Provides the launch operations details:
- Communication Protocol
- Communication Nets Summary
- Launch Window
- Anomaly Resolution
- Launch Decision
- MDC Seating / Displays
- Call Signs
- Mandatory Assets for Launch
- Launch Winds Plan/Balloon Release Schedule
- Includes the Terminal Count Documentation (Countdown Manual)

**Launch Operations Plans (continued)**

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Launch Management Coordination Meeting (LMCM)
Purpose:  Review all aspects of the launch countdown with key personnel to ensure the launch team is knowledgeable and properly trained for the wet dress rehearsal (WDR) and launch.
Presented prior to WDR by LSIM and NASA Launch Manager
Agenda
Launch Management Structure, Seating, and Communications Channel Availability
Launch Day Roles and Responsibilities
Status Checks and Protocol
Weather Constraints
Recycle Requirements
Mandatory Assets
Collision Avoidance (COLA)
Wet Dress Rehearsal Timeline/Countdown Summary
Range Calendar and Remaining Meetings

- Purpose:  Review all aspects of the launch countdown with key personnel to ensure the launch team is knowledgeable and properly trained for the wet dress rehearsal (WDR) and launch.
- Presented prior to WDR by LSIM and NASA Launch Manager
- Agenda
- Launch Management Structure, Seating, and Communications Channel Availability
- Launch Day Roles and Responsibilities
- Status Checks and Protocol
- Weather Constraints
- Recycle Requirements
- Mandatory Assets
- Collision Avoidance (COLA)
- Wet Dress Rehearsal Timeline/Countdown Summary
- Range Calendar and Remaining Meetings

**S/C Launch Ops **
**Training & Rehearsal Plans**

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Wet Dress Rehearsal (MDR)
Primary function of WDR is to verify the launch vehicle, facility, and GSE are sound by loading cryogenic propellants into the vehicle and performing a countdown
Secondary function of WDR is to assure readiness and to certify that the Mission Control Team, Mission Management Team, and applicable procedures are ready to enter the countdown
WDR will be performed at approximately L-14 days and will last approximately 5 hours
NASA, Lockheed Martin, and S/C Mission Control/Management supporting launch will participate in the WDR
The operation will adhere to the released WDR procedure
Readiness polling, weather briefs, wind assessments and final launch readiness poll will be included in the timeline 
T-0 will occur approximately 5 hours after the start of the procedure 
A debrief will follow at the conclusion of the WDR 

- Primary function of WDR is to verify the launch vehicle, facility, and GSE are sound by loading cryogenic propellants into the vehicle and performing a countdown
- Secondary function of WDR is to assure readiness and to certify that the Mission Control Team, Mission Management Team, and applicable procedures are ready to enter the countdown
- WDR will be performed at approximately L-14 days and will last approximately 5 hours
- NASA, Lockheed Martin, and S/C Mission Control/Management supporting launch will participate in the WDR
- The operation will adhere to the released WDR procedure
- Readiness polling, weather briefs, wind assessments and final launch readiness poll will be included in the timeline
- T-0 will occur approximately 5 hours after the start of the procedure
- A debrief will follow at the conclusion of the WDR

**S/C Launch Ops **
**Training & Rehearsal Plans (continued)**

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## NASA LAUNCH DAY MANAGEMENT

**NASA LAUNCH DAY MANAGEMENT**

** ****NASA ENGINEERING TEAM**

- ADVISORY

**NASA ADVISORY MANAGER**
**Mike Benik**

**NASA CHIEF ENGINEER**
**James Wood**

**       ****NASA ADVISORY TEAM**

**GO/NO GO**

**GO/NO GO**

**ANOMALY SYSTEM MNGR**
**Dave Lung**

**GO/NO GO**

**GOV’T  GO/NO GO**

**GO/NO GO**

**SPACECRAFT I&T MNGR**
**Ray McGlynn**

**SPACECRAFT  MISSION**
**DIRECTOR**
**Rob Lilly**

**NASA MISSION**
**INTEGRATION MANAGER**
**Mike Stelzer**

- G0/NO GO

- ADVISORY

**FLIGHT DIRECTOR**
**John Fiorello**

**GOES-L (EXAMPLE)**

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## ELV Mission Lessons Learned Process

_**Existing Process**_
- Lessons learned meeting held approximately 2 weeks following launch
- Meeting is combination of lessons learned throughout the entire mission flow
- Includes advanced planning, contract negotiations, mission integration, engineering, and launch campaign
- Spacecraft customer and Launch Service Provider inputs fed into system via MIM
- Lessons tracked within the ELV share drive database
_**Proposed New Process**_
- Lessons learned process divided into 3 areas
- MIT/LSP lessons
- Spacecraft customer lessons
- Launch campaign lessons
- Contributions to mission success separate from lessons but developed to track “finds and catches” throughout a mission flow
- External organization (XA) hired to track and trend lessons in common KSC database

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## NASA ELV Lessons Learned Process Flow

**NASA ELV Lessons Learned Process Flow**

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## NASA ELV Lessons Learned 

**NASA ELV Lessons Learned **
**Process Flow (continued)**

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## ELV Mission Lessons Learned Process  (proposed)

- Mission integration team/launch service provider lessons learned
- Contributions to mission success
- Spacecraft customer lessons learned
- Launch campaign lessons learned

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## ELV Mission Lessons Learned Schedule

**ELV Mission Lessons Learned Schedule**
**(proposed-not to scale)**

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## MIT/LSP Lessons Learned

- Satisfies ELV Project requirement
- Lessons Learned collected after key milestones while findings are “fresh”
- Identifies and corrects constraints that affect the next phase of the mission
- Lessons Learned fed into database for analysis and disposition
- New knowledge fed back into process changes and future MITs

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Contributions to Mission Success

- Satisfies requirement of NPD 8610.23
- Contributions collected throughout the mission
- Insight and Approval surveillance findings are dispositioned via the Engineering Review Process
- Mission-unique findings are collected with the MIT/LSP Lessons Learned
- All findings are fed into database for analysis and disposition

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Spacecraft Customer Lessons Learned

- Satisfies requirement of NPD 7120.4 for customer involvement
- Can be combined with MIT/LSP lessons or held separately, dependent on MIT
- Lessons learned fed into database for analysis and disposition

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## Launch Campaign Lessons Learned

- Satisfies requirement of NPD 8610.24
- Collects Launch Campaign-related Lessons Learned from other forums
- Identifies constraints to future launch campaigns

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001

## NASA ELV Launch Process

**NASA ELV Launch Process**
**Lessons Learned**

- Mission Assurance Forum - NASA/KSC ELV Launch Services

- March 2001