# Presentation: 886349

## GSFC QMSSemi-Annual Management Review10/01/2002 -- 03/31/2003

**Richard Day****	**
**Management Representative**
**April 7, 2003**

## Agenda

- Product Conformity
- Process Performance
- Preventive and Corrective Actions
- Customer Feedback
- Actions from Previous Reviews
- QMS Changes and Improvement Recommendations

** ****Product Conformity**

## Product NCR’s

## SWIFT NCR’s

## Open Product NCR’s

## Product NCR Disposition

## Process Performance

## QMS Process NCR’s

## Internal Audits Performed

## NCR’s per Internal Audit

## QMS Process NCR’s Cause Codes

## Preventive and Corrective Actions

## QMSC Analysis of NCR Data

-  Number of NCR’s per audits has decreased
-  NCR’s written are now more substantive, fewer “nits”
-  AETD monthly analysis
-  Greater focus on product-oriented NCR’s
-  No systemic trends identified
-  FPPD pre-MSR review
-  No systemic trends identified
-  **No actions indicated**

## Open Registrar Findingsand Observations

- On-orbit, ground systems, DSN anomalies not analyzed for preventive action in missions or across Center.
- CA Plan (444/302) – Inter-Directorate team looking at current databases to determine common needs for either a single database (e.g. SOARS) or to accommodate an integrated data analysis process using multiple systems.
- Status – Open.
- Expected Completion – 8/22/03

## Open Registrar Findingsand Observations May 2002 Documentation Review

- Measurable component of the objectives cited in Quality Manual are unclear  (Observation).
- CA Plan (QMSC) – Establishing Directorate objectives and metrics aligned with Center SIP.  Directorate Objectives Plans to be documented.  Wayne Boswell will then map Directorate objectives into SIP.
- Status – Open.
- Expected Completion – 5/30/03

## Open Registrar Findingsand ObservationsMay 2002 ISO 9001:2000 Pre-Assessment

- Various WFF Offices did not have objectives established. Many objectives cited in 200, 300, 400, 500, and 800 did not have a measurable component.  Process effectiveness objectives not included in 300, 500, 600, and 900.
- CA Plan (QMSC) – Establishing Directorate objectives and metrics aligned with Center SIP.  Directorate Objectives Plans to be documented.  Wayne Boswell mapping Directorate objectives into SIP.
- Status – Open.
- Expected Completion – 5/30/03

## Open Registrar Findingsand ObservationsMay 2002 ISO 9001:2000 Pre-Assessment

- Center-based customer satisfaction data not present; data not collected for internal customers identified by 900 and 300; collected customer data in Code 800 offices not gathered and analyzed at Directorate level.
- CA Plan (QMSC) – Established Center-wide customer philosophy.  External customer satisfaction data gathering/analysis techniques being identified by Codes 600, 900, 400 and 800.  To be addressed in documented Directorate Objectives Plans.  QMSC determining methods to prepare Center-wide picture of customer satisfaction
- Status – Open.
- Expected Completion – 5/30/03

## Open Registrar Findingsand ObservationsMay 2002 ISO 9001:2000 Pre-Assessment

- Identified objectives did not have measures or evidence of analysis for preventive action.  In WFF offices many sources of data not used as a measure or analyzed for process effectiveness (statusing vs. process management).  It is unclear how WFF mission support activities measures analysis is communicated to mission management.
- CA Plan (QMSC) – Establishing Directorate objectives and metrics aligned with Center SIP.  Directorate Objectives Plans to be documented.
- Status – Open.
- Expected Completion – 5/30/03

## Customer Feedback

## Customer Feedback

**There are currently no open NCR’s entered as an external customer complaint.**
- Previously reported NCR GNC-WFF2002081901: Apparent high friction or partial binding discovered during post environmental functional testing of Balloon Gondola Solar Pointing System.  Customer: National Scientific Balloon Facility
**Status:  Closed 3/18/03. **System has been reassembled after further inspection and testing. Post assembly testing has been accomplished with positive results. Changes have been made in the top motor plate manufacturing process to assure tolerance control.

## Actions From Previous Reviews

## QMC2002-00011(open)

_**Action**_**:  *****From 1/28/02 review***** – **Code 200 expedite corrective action plan to close out complaint regarding disruption of PG County Emergency Communications.
_**Assigned to**_**:  **Code 200
_**Status**_**:  **Open.
- Code 200 tracking action milestones to close-out.  Reported in Code 200 MSR’s.  Completion of final remaining action pending PG County sign-off.

## QMC2003-00001(open)

_**Action**_**:  *****From 11/25/02 review***** – **QMSR pursue GSFC registration to ISO 9001:2000
_**Assigned to**_**:  **QMSR
_**Status**_**:  **Open.
- Action documents Center decision to pursue continued ISO compliance and registration in light of pending NPG 1280.1.

## QMS Changes, Improvement Recommendations and Transition Status

- Transition relies on documentation and implementation of:
- Directorate objectives plans addressing external customer satisfaction, process effectiveness measures, objectives measures, data analysis, and preventive action/continuous improvement process;
- A mapping of Directorate objectives and metrics into Center SIP leading to a scheduled assessment of Center objectives and customer satisfaction health;
- Internal audit of all Directorates for compliance to above.

**ISO 9001:2000 Transition**

**Directorate objectives plans need to be finalized by April 30.**
**Internal audits will be conducted during May**

- Quality Manual update issues
- QMS scope with respect to aircraft, balloon, sounding rocket payloads without external customers
- Role of the QMSC in collecting and/or analyzing Directorate objectives/process/customer data into an assessment of Center QMS  health and associated preventive actions and continuous improvement initiatives.
- Deployment of PR/PFR database for improved product nonconformance documentation and disposition
- Late May deployment schedule
- Systematic product nonconformance data analysis at both project and Center level needs to follow quickly

**QMS Changes Focus**

## QMS Changes Focus

- Fate of RITS
- Collection and analysis of on-orbit, ground, DSN data
- Centralized database
- Multiple databases, centralized analysis
- Regardless of the option selected, data analysis should be taking place now.
- Need to identify funding to return to annual publication of ***Orbital Anomalies in Goddard Spacecraft***.
- Last published in 1996 for CY95 data

## Backup

## Open Registrar Findingsand Observations

- Form 1680 not completed on completed contract NAS5-01098
- CA Plan (210) – Contract awarded before FAR 1680 requirement.  Exact timing of 1680 policy and previous evaluation guidelines will be researched and documented.  Suspected that cited contract falls outside 1680 requirement.
- Status – Open.  Spot-check of other contracts revealed similar problems
- Expected Completion – 4/30/03

## Open Registrar Findingsand Observations

- NAS5-00047 COTR on job for a year without completing COTR training
- CA Plan (210) – Individual will be scheduled for training.  CO’s will be requested to determine training status of all temporarily delegated COTR’s.
- Status – Open.  Individual’s training completed; notice sent to C.O.’s requesting COTR training record check.  Significant refresher training delinquencies discovered.  Process correction necessary.
- Expected Completion – 4/30/03

## Open Registrar Findingsand Observations

- Procurement organization has no approach for determining effectiveness of GSFC contractor oversight process. (Observation)
- CA Plan (210) – Conduct self-assessments of procurement transactions every six months. In addition, Code H (Headquarters) conducts a survey of the Goddard procurement operations every two years.** **
- Status – Open.  Code 210 must demonstrate implementation of this plan and use of results during ISO 9001:2000 registration audit.
- Expected Completion – 4/30/03

## Open Registrar Findingsand Observations

- GPG 8700.4D requirement for IIRT assessment of 13 Systems Management Process Areas does not clearly address how the process is implemented for reviews early in the project life cycle.
- CA Plan (300) – Revision to GPG in signature cycle.
- Status - Open
- Expected Completion – 4/30/03

## Open Registrar Findingsand Observations

- NCRCAS contains numerous major product NCR’s with insufficient root cause and cause correction.  Effectiveness determinations are re-inspections vs. an assessment of effective processes correction.
- CA Plan (300) – GPG 5340.2 and GPG 1710.1 revised.  NCRCAS design band-aids applied pending deployment of PR/PFR system.
- Status - Open
- Expected Completion – 9/30/03

## Open Registrar Findingsand Observations

- Receiving inspection results for P.O. S66611-G (Code 551) not entered into RITS.
- CA Plan (500/230) – Cited delivery entered into RITS (Code 551).  A sample of deliveries analyzed to determine extent of problem with failure of personnel to input RITS data (Code 230).
- Status – Open.  Sampling reveals significant failure to enter RITS receiving inspection/test results.  QMSC contemplating abandonment of mandatory RITS data entry requirement.  Applicable ISO requirement met by other existing processes.
- Expected Completion – 4/30/03

## Open Registrar Findingsand Observations

- Not clear how mission ops needs are communicated for inclusion in project development process (Observation).
- CA Plan (444) – MOA process between Code 444 and projects being developed.
- Status – Open.
- Expected Completion – 8/1/03

## Open Registrar Findingsand Observations

- No acceptance criteria established for evaluation of receiving review process in SSMO.
- CA Plan (444) – MOA process between Code 444 and projects being developed.
- Status – Open.
- Expected Completion – 8/1/03

## Open Registrar Findingsand Observations

- Internal audit reports not always clear whether audit performed to ISO 9001:1994 or ISO 9001:2000 (Observation).
- CA Plan (306) – Affected past audit reports have been revised.
- Status – Open.  Future ISO 9001:1994 audit reports will be so identified.  Very few of these expected in future.
- Expected Completion – 4/25/03

## Open Registrar Findingsand Observations

- Internal audit reports don’t show objective evidence to support claims of compliance. (Observation).
- CA Plan (306) – All audits initiated after 2/24/03 will address compliance objective evidence.  Process monitored by Audit Coordinator.  GPG will be revised at next opportunity.
- Status – Open.
- Expected Completion – 4/25/03

## Open Registrar Findingsand ObservationsMay 2002 Documentation Review

- Guidance for QMS continual improvement resource determination and provision is not addressed in QMS documentation.
- CA Plan (180) – GPG 1060.1G released to address issue.
- Status – Open.  (Code 180 has been requested to close NCR)
- Expected Completion – 1/13/03

## Open Registrar Findingsand ObservationsMay 2002 Documentation Review

- Personnel competencies not addressed.
- CA Plan (110) – GPG 3410.2 revision in review cycle.
- Status – Open.
- Expected Completion – 6/27/03

## Open Registrar Findingsand ObservationsMay 2002 Documentation Review

- Infrastructure activities applicable to QMS scope not addressed.
- CA Plan (QMSC) – Revised Quality Manual will address infrastructure scope.
- Status – Open.
- Expected Completion – 4/30/03

## Open Registrar Findingsand ObservationsMay 2002 Documentation Review

- Unclear how certain aspects of sounding rockets, aircraft and balloon payloads would be excluded from QMS if there is an obligation to apply in-scope control processes (e.g., safety, range safety)  (Observation).
- CA Plan (QMSC) – Applicable portion of QMS scope statement in Quality Manual will be revised to read: Systems Development - This includes space flight systems, sounding rocket, aircraft and balloon carrier systems, and ground based mission operating and data acquisition systems. *Sounding rocket and balloon experiment payload development is included where external commitments exist or where needed to meet the safety, interface control, or operational requirements of the carrier systems.*
- Status – Open.
- Expected Completion – 5/16/03