**DOWNLOADED AND/OR HARD COPY UNCONTROLLED**

Verify that this is the correct version before use.

  ---------------------------------- ----------------------- ------------
  **APPROVAL SIGNATURES**                                    **DATE**

  Gregory Blaney (original signature IMS Representative      12/03/2007
  on file)                                                   

                                                             
  ---------------------------------- ----------------------- ------------

+------+------------------------------------+------------+------------+
| **   |                                    |            |            |
| REVI |                                    |            |            |
| SION |                                    |            |            |
| H    |                                    |            |            |
| ISTO |                                    |            |            |
| RY** |                                    |            |            |
+======+====================================+============+============+
| Rev  | Description of Change              | Author     | Effective  |
| No.  |                                    |            | Date       |
+------+------------------------------------+------------+------------+
| B    | Initial Release                    | Greg       | 01/30/1998 |
| asic |                                    | Blaney     |            |
|      |                                    | IT/387     |            |
+------+------------------------------------+------------+------------+
| A    | Numerous changes in content        | Greg       | 04/07/1998 |
|      | throughout entire document         | Blaney     |            |
|      |                                    | IT/387     |            |
+------+------------------------------------+------------+------------+
| B    | Changed document format and added  | Greg       | 05/06/1998 |
|      | sections 6.3.5 & 6.3.6             | Blaney     |            |
|      |                                    | IT/387     |            |
+------+------------------------------------+------------+------------+
| C    | Added new terms in Section 3.0     | Greg       | 07/24/1998 |
|      | Definitions.                       | Blaney     |            |
|      |                                    |            |            |
|      | Added two new sections called      | IT/387     |            |
|      | "Inspection and Test of Product"   |            |            |
|      | as section 6.5.1.3 and "Inspection |            |            |
|      | and Test Status" as section        |            |            |
|      | 6.5.1.4.                           |            |            |
|      |                                    |            |            |
|      | The "Control of Nonconforming      |            |            |
|      | Product" section changed from      |            |            |
|      | 6.5.1.3 to 6.5.1.5; and Added      |            |            |
|      | references to SLPs IVV 09-1, IVV   |            |            |
|      | 09-2, and IVV 09-3.                |            |            |
|      |                                    |            |            |
|      | Added notes in sections 6.3, 6.4,  |            |            |
|      | and 6.5.2 referring to the OSMA    |            |            |
|      | SLP IVV 09-3 when areas of this    |            |            |
|      | SLP did not apply.                 |            |            |
+------+------------------------------------+------------+------------+
| D    | Quality Record - format changes    | Greg       | 08/26/1998 |
|      |                                    | Blaney     |            |
|      |                                    | IT/387     |            |
+------+------------------------------------+------------+------------+
| E    | Section 6.2 -- Removed electronic  | Greg       | 09/11/1998 |
|      | file req.                          | Blaney     |            |
|      |                                    | IT/387     |            |
|      | Sections 6.5.1.3 & 6.5.1.4 --      |            |            |
|      | Added reference to the 5-day grace |            |            |
|      | period and added "Deliverable      |            |            |
|      | Acceptability Status" email req.   |            |            |
|      |                                    |            |            |
|      | Section 6.5.2 -- Added "Monthly    |            |            |
|      | Financial Assessment" email req.   |            |            |
|      |                                    |            |            |
|      | Section 8 -- Added both records    |            |            |
|      | mentioned above.                   |            |            |
+------+------------------------------------+------------+------------+
| F    | Added IVV 01 to Referenced Docs.   | Greg       | 01/20/1999 |
|      |                                    | Blaney     |            |
|      | Sections 6.3.4, 6.4.1, 6.5.1.2,    | IT/387     |            |
|      | 6.5.1.4, and 8.0 are modified as   |            |            |
|      | follows: added a Formal Agreement  |            |            |
|      | checklist, a new section, some     |            |            |
|      | references, and changed the        |            |            |
|      | Concurrence Sheet responsibility.  |            |            |
+------+------------------------------------+------------+------------+
| G    | Added definition for Senior Staff  | Greg       | 04/14/1999 |
|      | (section 3.4), and modified        | Blaney     |            |
|      | section 6.5.1.4 to include a       | IT/387     |            |
|      | Senior Staff review process for    |            |            |
|      | high level documents.              |            |            |
+------+------------------------------------+------------+------------+
| H    | References to Ames Quality Manual  | Greg       | 09/10/1999 |
|      | replaced with references to IV&V   | Blaney     |            |
|      | Facility Quality Manual and        | IT/387     |            |
|      |                                    |            |            |
|      | Added Section 3.11                 |            |            |
+------+------------------------------------+------------+------------+
| I    | Format and Number changes; Delete  | John       | 12/06/2000 |
|      | Reference to Ames Research Center  | Griggs     |            |
+------+------------------------------------+------------+------------+
| J    | Significant re-write to            | Greg       | 04/03/2001 |
|      | accommodate current PM process     | Blaney     |            |
|      | based upon transition to GSFC      |            |            |
+------+------------------------------------+------------+------------+
| K    | Clarify requirement for Project    | John Gatto | 05/15/2002 |
|      | Managers to maintain copies of     |            |            |
|      | task orders.                       |            |            |
+------+------------------------------------+------------+------------+
| L    | Remove COTR requirements and       | John Gatto | 10/31/2002 |
|      | include instructions for Mission   |            |            |
|      | Tracking Matrix.                   |            |            |
+------+------------------------------------+------------+------------+
| M    | Expanded Control of Nonconforming  | John Gatto | 03/24/2003 |
|      | Product and added information      |            |            |
|      | regarding PMRs.                    |            |            |
+------+------------------------------------+------------+------------+
| N    | Expanded Control of Nonconforming  | John Gatto | 06/02/2003 |
|      | Products to include information    |            |            |
|      | regarding nonconformance's         |            |            |
|      | discovered by the organization.    |            |            |
+------+------------------------------------+------------+------------+
| O    | Added Senior lead duties, updated  | Raju       | 09/26/2003 |
|      | procedure flowchart and Metrics    | Raymond    |            |
|      | reference.                         |            |            |
+------+------------------------------------+------------+------------+
| P    | Added references to New Business   | Stephanie  | 03/27/2004 |
|      | Lead and Deputy PM.                | Ferguson   |            |
|      |                                    |            |            |
|      | Use of PM Tool and TOMS are        | Raju       |            |
|      | identified.                        | Raymond    |            |
|      |                                    |            |            |
|      | Added new Mission Model updating   | Ken        |            |
|      | process.                           | Vorndran   |            |
|      |                                    |            |            |
|      | Expanded PM's responsibility to    |            |            |
|      | manage and monitor                 |            |            |
|      | Customer-supplied data (Section    |            |            |
|      | 6.9).                              |            |            |
|      |                                    |            |            |
|      | Added reporting of Project related |            |            |
|      | risks in Section 6.13.             |            |            |
|      |                                    |            |            |
|      | Included references to Customer    |            |            |
|      | funded and IBD funded projects;    |            |            |
|      | added req. for annual review of    |            |            |
|      | Customer agreements; rewrote the   |            |            |
|      | section for controlling the        |            |            |
|      | nonconforming products; added new  |            |            |
|      | req. of monthly PMR updates; and   |            |            |
|      | updated the Evaluation of          |            |            |
|      | Deliverables section for clarity.  |            |            |
+------+------------------------------------+------------+------------+
| Q    | Clarified sections 6.3 and 6.4 to  | Stephanie  | 4/21/2004  |
|      | clearly state what information the | Ferguson   |            |
|      | PM is responsible for updating.    |            |            |
|      | Deleted "Facility cover page" from | Steve      |            |
|      | 6.12. Changed insure to ensure     | Raque      |            |
|      | throughout document.               |            |            |
+------+------------------------------------+------------+------------+
| R    | DCR 240                            | Melissa    | 11/2/2004  |
|      |                                    | Schmidt    |            |
|      | CARs 13260, 13261                  |            |            |
|      |                                    |            |            |
|      | PARs 13041, 13103, 13163, 13335,   |            |            |
|      | 13777, 13789                       |            |            |
|      |                                    |            |            |
|      | Deleted Mission Tracking Sheet     |            |            |
|      | requirements due to change in      |            |            |
|      | requirements by New Business Lead. |            |            |
|      |                                    |            |            |
|      | Updated Sec 3.0 for definitions    |            |            |
|      | unique to this SLP only            |            |            |
|      |                                    |            |            |
|      | Updated Sec 5.0 to include         |            |            |
|      | responsibilities for all           |            |            |
|      | applicable roles to this SLP       |            |            |
|      |                                    |            |            |
|      | New Process Flow Diagram to        |            |            |
|      | represent new organization of this |            |            |
|      | SLP                                |            |            |
|      |                                    |            |            |
|      | Deleted the PM Tool description    |            |            |
|      | section and added PM Tool to       |            |            |
|      | Section 3.0                        |            |            |
+------+------------------------------------+------------+------------+
| S    | Section Change                     | John       | 02/28/2005 |
|      |                                    | Marinaro   |            |
|      | PAR: 2005-P-111 Change Sections:   |            |            |
|      | 6.1.3.3                            |            |            |
|      |                                    |            |            |
|      | PAR: 2005-P-140 Change Sections:   |            |            |
|      | 5.5, 6.7, 6.8                      |            |            |
|      |                                    |            |            |
|      | Annual Review Updates Sections:    |            |            |
|      | 3.0, 6.6.2, 8.0                    |            |            |
+------+------------------------------------+------------+------------+
| T    | Update for organizational changes. | Steve      | 09/08/2005 |
|      | Added to/refined list of external  | Raque      |            |
|      | presentations/reviews. Clarified   |            |            |
|      | FA dependencies.                   |            |            |
+------+------------------------------------+------------+------------+
| U    | Updated to implement CMMI          | Steve      | 07/26/2006 |
|      | initiative (IV&V Services Baseline | Raque      |            |
|      | definition, Requirements           |            |            |
|      | Management section, Inspection of  |            |            |
|      | Product from Contractor section),  |            |            |
|      | Updated definitions, added         |            |            |
|      | references to IVVP Template,       |            |            |
|      | removed Establish Contractor       |            |            |
|      | Tasking section (now in IVV 09-8), |            |            |
|      | updated list of items that are     |            |            |
|      | captured in PM Tool, complete      |            |            |
|      | rework of Records section.         |            |            |
+------+------------------------------------+------------+------------+
| V    | Update process flow diagrams to    | Stephanie  | 09/21/2007 |
|      | align with Facility Management     | Ferguson   |            |
|      | paradigm                           |            |            |
+------+------------------------------------+------------+------------+
| W    | Update Quarterly/Annual            | Raju       | 12/05/2007 |
|      | Responsibilities flow to reflect   | Raymond    |            |
|      | correct PMER input intervals       |            |            |
+------+------------------------------------+------------+------------+
|      |                                    |            |            |
+------+------------------------------------+------------+------------+

  -----------------------------------------------------------------------
  **REFERENCE DOCUMENTS**            
  ---------------------------------- ------------------------------------
  Document Number                    Document Title

  Current versions posted by NASA    Federal Acquisition Regulations
                                     (FARs) and Supplements

  Current version posted by NASA     IV&V Export Control Policy/Procedure

  Form 1007                          Concurrence Sheet

  IVV QM                             IV&V Quality Manual

  IVV 07                             Financial Data Control

  IVV 08                             Contracting Officer Technical
                                     Representative (COTR)

  IVV 09-4-1                         IV&V Services Risk Management

  IVV 09-8                           Project Startup

  IVV 14                             Corrective and Preventative Action

  IVV 16                             Control of Quality Records

  NPR 1441.1                         NASA Records Retention Schedules

  T2101                              MOA Template

  T2103                              IPEP Template

                                     
  -----------------------------------------------------------------------

# Purpose

> The purpose of this system level procedure (SLP) is to establish a
> consistent and documented method of performing project management at
> the NASA IV&V Facility.

# Scope

> This SLP applies to all IV&V Services personnel who perform project
> management for IV&V or system/software engineering tasks for the NASA
> IV&V Facility.

# Definitions & Acronyms

> Official NASA IV&V Facility roles and terms are defined in the
> [Quality
> Manual](http://www.nasa.gov/centers/ivv/doc/170870main_IVV_QM.doc).
> Specialized definitions identified in this SLP are defined below.

## Deliverable

> A Deliverable is a product identified as a deliverable within task
> orders, contracts, or IV&V Project Execution Plans (IPEPs).

## Milestone

> A Milestone is an event in the life cycle of a project that is
> generally denoted by a formal, project-led review with IV&V
> participation (e.g., Preliminary Design Review).
>
> []{.mark}

## Project Artifacts

> Project Artifacts are those products delivered to or by the NASA IV&V
> Facility for use in performing IV&V or documenting the IV&V efforts on
> a project.
>
> []{.mark}

## Acronyms

> CAR Corrective Action Request
>
> COTR Contracting Officer Technical Representative
>
> FA Formal Agreement
>
> FY Fiscal Year
>
> GSFC Goddard Space Flight Center
>
> IBD IV&V Board of Directors
>
> IMS NASA IV&V Facility Management System
>
> IPEP IV&V Project Execution Plan
>
> MOA Memorandum of Agreement
>
> MSR Monthly Status Review
>
> NetOps Network Operations
>
> NPR NASA Procedural Requirements
>
> PM Project Manager
>
> PMER Performance Monitor Evaluation Report
>
> PMR Project Management Review
>
> POC Point of Contact
>
> QM Quality Manual
>
> RAC Resource Allocation Committee
>
> RMO Resource Management Office
>
> SLP System Level Procedure
>
> SMSR Safety and Mission Success Review

# Process Flow Diagrams

> The following diagrams depict processes described in this document,
> and the responsibilities and actions that shall be performed by
> process participants.

## Project Life Cycle

![](media/image2.wmf)

> For IV&V Project initiation, the Project Manager (PM) shall follow IVV
> 09-8, *Project Startup*. During the life cycle of the project, lessons
> learned, if any, should be compiled.
>
> Once an IV&V Project has been closed and all the tasks are completed
> for the Customer according to the IPEP, the PM shall ensure that the
> following closeout activities are completed:

-   Catalog and archive the Customer and Project Artifacts. For
    artifacts stored on the Shared Network Drive, inform Network
    Operations (NetOps) staff of the location of the artifacts to be
    archived (NetOps staff shall move the artifacts to the appropriate
    write-protected location).

-   Work with the appropriate Contracting Officer's Technical
    Representative (COTR) to initiate task order closeout process.

## Establish Formal Agreement (FA)

![](media/image3.wmf)

> The Formal Agreement (FA) will document the managerial, technical, and
> business aspects of the tasks to be performed for the Customer. The FA
> will also describe the type of agreement (e.g., Memorandum of
> Agreement (MOA), a task agreement, an Interagency Agreement,
> contract), the type of funding for the project (e.g., Customer-funded,
> IV&V Board of Directors \[IBD\]-funded), and the amount of funding by
> fiscal year (FY) for the life of the IV&V Project. Refer to T2101,
> *MOA Template*, for information regarding MOA preparation.
>
> The FA shall contain, but not be limited to, the following
> information:

-   Purpose

-   Duration

-   Points of Contact (POCs)

-   Roles and Responsibilities

-   Budget (for Customer-funded efforts)

-   Issue resolution protocol

-   Signature lines for both parties (NASA IV&V Facility and Customer)

> The PM shall review FAs annually. If modifications to FAs are needed,
> the PM shall follow the process described in this section of this
> document.

## Establish Baseline Revision/IV&V Project Execution Plan (IPEP)

![](media/image4.wmf)

> The PM shall review/update the Baseline Revision and IPEP
> semi-annually. Refer to T2103, *IPEP Template*, for information
> regarding IPEP preparation. Refer to IVV 07, *Financial Data Control*,
> for information regarding Baseline Revision preparation.

## Deliverable Processing and Distribution 

![](media/image5.wmf)

### Control of Customer Supplied Product, Product Identification, and Traceability

> The PM shall ensure that appropriate Customer-supplied products (e.g.,
> documents, code, databases) are used when performing tasks and that
> the Contractor identifies the product used in the resulting
> report/output (e.g., version, date). In addition, the PM shall
> identify and adhere to any privacy and/or security related
> requirements associated with Customer-supplied products, which
> includes NASA Export Control Regulations (see IV&V Export Control
> Policy located on the NASA IV&V Facility Services Web Site at
> <http://services.ivv.nasa.gov/docs.html>). The PM shall relay this
> information to the Contractor and ensure that the Contractor is
> following the appropriate procedures. For additional information,
> refer to IVV 08, *Contracting Officer's Technical Representative*.

### Inspection of Product from Contractor 

> The PM shall objectively evaluate all IV&V Project-related products
> required by a contract or task order that are delivered to the NASA
> IV&V Facility within ten working days of delivery. The PM shall
> objectively evaluate such products for quality using applicable
> criteria including, but not limited to, those identified in the
> contract and/or task order requirements. Results of these evaluation
> efforts shall be recorded in the PM Tool.

### Control of a Nonconforming Product

> If the NASA IV&V Facility identifies a problem with a product that has
> already been delivered to the Customer Project, the PM shall
> immediately inform the Customer Project of the problem. If the
> Customer identifies a product produced by the NASA IV&V Facility as
> nonconforming (e.g., an inappropriate format or because it was
> performed on the wrong Customer product), the PM shall resolve the
> issue with the Customer. Regardless of how the problem has been
> identified:

-   The PM shall complete a Corrective Action Request (CAR) form per IVV
    14, *Corrective and Preventive Action*.

-   The PM shall ensure that the problem is resolved and that the
    Customer is provided a full explanation of events.

-   The nonconforming product shall be subjected to its established
    verification process once the nonconforming product has been
    corrected.

-   The PM shall request closure of the CAR once the nonconforming
    product has been approved and sent to the Customer.

## Review and Approval Process

> The PM shall submit products for review and approval using Form 1007,
> *Concurrence Sheet*. Approval must be obtained prior to officially
> submitting the product to the Customer.

+----------------------+----------+-------------------+--------------+
| **Type of Product**  | **Orig   | **Reviewers**     | **Approver** |
|                      | inator** |                   |              |
+======================+==========+===================+==============+
| FAs: Customer        | PM       | Appropriate COTR  | Facility     |
| Project-Funded       |          |                   | Management   |
|                      |          | RMO               |              |
|                      |          |                   |              |
|                      |          | IV&V Services     |              |
|                      |          | Lead              |              |
+----------------------+----------+-------------------+--------------+
| FAs: IBD-Funded      | PM       | IV&V Services     | Facility     |
|                      |          | Lead              | Management   |
+----------------------+----------+-------------------+--------------+
| Customer             | Co       | None              | PM           |
| Deliverables         | ntractor |                   |              |
|                      | Name (No |                   |              |
|                      | Si       |                   |              |
|                      | gnature) |                   |              |
+----------------------+----------+-------------------+--------------+
| IV&V Presentations   | PM       | None              | IV&V         |
| for Customer Project |          |                   | Services     |
| Milestone Reviews    |          |                   | Lead         |
+----------------------+----------+-------------------+--------------+
| Safety and Mission   | PM       | IV&V Services     | Facility     |
| Success Review       |          | Lead              | Management   |
| (SMSR)               |          |                   |              |
+----------------------+----------+-------------------+--------------+
| Final Readiness      | PM       | IV&V Services     | Facility     |
| Review               |          | Lead              | Management   |
+----------------------+----------+-------------------+--------------+
| IPEP                 | PM       | IV&V Services     | IV&V         |
|                      |          | Lead              | Services     |
|                      |          |                   | Lead         |
+----------------------+----------+-------------------+--------------+

## Project Timetable

### Annual/Quarterly Responsibilities

![](media/image6.wmf)

### Monthly Responsibilities

> The PM shall perform the following responsibilities on a monthly
> basis:

-   Review/approve deliverables

-   Create and present Project Management Review (PMR) presentation

-   Update Goddard Space Flight Center (GSFC) Monthly Status Report
    (MSR) inputs

-   Review Resource Allocation Committee (RAC) reports

-   Review/update risks per IVV 09-4-1, *Work Instruction for IV&V
    Services Risk Management*

### Weekly Responsibilities

> The PM shall update the One-Liner file on a weekly basis.

# Metrics

> Any metrics associated with this SLP are established and tracked
> within the NASA IV&V Facility Metrics Program.

# Records

> The following records will be generated and filed in accordance with
> this SLP and IVV 16, *Control of Quality Records*, and in reference to
> NASA Procedural Requirements (NPR) 1441.1, *NASA Records Retention
> Schedules*.

  -----------------------------------------------------------------------------------------------
  **Record Name**     **Original**   **Vital**   **Responsible   **Retention       **Location**
                                                 Person**        Requirement**     
  ------------------- -------------- ----------- --------------- ----------------- --------------
  Concurrence Sheet   Y              N           PM              Retire at close   Filing System
  for associated FA                                              of                
  Submitted to                                                   program/project   
  Customer                                                       (8/101)           

  FA signed by        Y              Y           PM              Retire at close   Filing System
  Customer                                                       of                & Shared
                                                                 program/project   Network Drive
                                                                 (8/101)           

  Concurrence Sheet   Y              N           PM              Destroy when 2    Filing System
  for FA annual                                                  yrs old (8/109)   
  review                                                                           

  IPEP                Y              Y           PM              Retire at close   Filing System
                                                                 of                & Shared
                                                                 program/project   Network Drive
                                                                 (8/101)           

  Customer            Y              Y           PM              Retire at close   Shared Network
  Deliverable                                                    of                Drive
                                                                 program/project   
                                                                 (8/101)           

  Concurrence Sheet   Y              N           PM              Destroy when 2    Filing System
  for Customer                                                   yrs old (8/109)   
  Deliverables                                                                     

  Concurrence Sheet   Y              N           PM              Destroy when 2    Filing System
  for Review of IV&V                                             yrs old (8/109)   
  Presentations                                                                    
  -----------------------------------------------------------------------------------------------