# Presentation: 492054

## The Evolution of Process Improvement at the Census Bureau

*November 8, 2005*
**Presented by:**  *Chrissy Milliken & Mark Davis*
**Division:**  *Systems Support Division (SSD)*
**Version:*** 1.0*

- 2005 Census Software Engineering
- Process Group (SEPG) Conference

## Agenda

- Introduction
- CSPI Program Past
- CSPI Program Future
- Common Census Bureau Issues
- Other Initiatives
- CMMI®--Version 1.2 and Beyond
- Where can I learn more?

## Introduction

**Introduction**
- CSPI Program Past
- CSPI Program Future
- Common Census Bureau Issues
- Other Initiatives
- CMMI®--Version 1.2 and Beyond
- Where can I learn more?

## The Census Software Process Improvement (CSPI) Program was founded in 2002.  It was established, authorized, & funded by the IT Governing Board (ITGB) to address the growing demand at the Census Bureau for better software development practices.  The CSPI program utilizes the Software Engineering Institute’s (SEI’s) Capability Maturity Model Integration (CMMI) framework (previously CMM) as the reference model to implement process-improvement. The CSPI program’s 5 key initiatives are:

Census Process Asset Library (PAL) & Portal
Census Process-Improvement Training Program 
CSPI Program Support 
Census Software Engineering Process Group (SEPG)
Census SEPG Conference

- Census Process Asset Library (PAL) & Portal
- Census Process-Improvement Training Program
- CSPI Program Support
- Census Software Engineering Process Group (SEPG)
- Census SEPG Conference

**What is the CSPI Program?**

- (1) – Introduction

## CSPI Program Past

- Introduction
**CSPI Program Past**
- CSPI Program Future
- Common Census Bureau Issues
- Other Initiatives
- CMMI®--Version 1.2 and Beyond
- Where can I learn more?

## CSPI Program Past

- (2) – CSPI Program Past

- Supported three pilot projects
- Established SEPG
- Assisted two projects in achieving CMM L-2
- Created PAL process assets based on CMM framework
- Coordinated CMM training
- Provided CMM ad-hoc consulting

- CMM

## CMM Pilot Program - 1

- Three Pilot Projects Jan 2001- Dec 2002

- (2) – CSPI Program Past

## CMM Pilot Program Goals

- Evaluate the effectiveness of CMM on three pilot projects representing a cross-section of Census Software Development.
- CPS March Supplement Report ProcessingDemographic Directorate/HHES
- American Time Use Survey (ATUS) Blaise AuthoringField Directorate/TMO
- Services Monthly and Annual Sample Maintenance (SMASM) Economic Directorate (ESMPD, EPCD, SSSD)
- Bring the three pilot projects from an undefined process (Level 1), to a repeatable process (Level 2).

**CMM Pilot Program - 2**

- (2) – CSPI Program Past

## CMM Pilot Program - 3

- _Pain:_
- Constant and last minute changes to software with underlying assumption that all changes will be incorporated immediately.
- _Pain Relief:_
- Established a Software Configuration Control Board (SCCB) with all affected parties.
- Developed a change tracking database to manage software changes.
- Formalized risk analysis process for requested changes.

**CMM Pilot Program - 3**

- (2) – CSPI Program Past

## Original SEPG

- Census Bureau wide group responsible for developing and deploying software process assets based on the CMM framework
- Coordinate software process-improvement activities throughout the Census Bureau

**Original SEPG**

- (2) – CSPI Program Past

## Original Census SEPG

- (2) – CSPI Program Past

## The “IT Standard 24.0.1” & the “Software Development & Maintenance Policy” were created to establish Census Bureau policies and standards that all software development projects would adhere to.

**Policy and Standard**

- (2) – CSPI Program Past

## Census PAL

**What is the Census Process Asset Library (PAL)?**

- 	The Census PAL is a _**repository of artifacts**_. This library _**contains process descriptions, templates, guidelines, examples**_, etc. to be used by project team members & their managers involved in software development & maintenance activities at the Census Bureau.

- (2) – CSPI Program Past

## Current CSPI Org. Chart

- (2) – CSPI Program Past

## CSPI Program Future

- Introduction
- CSPI Program Past
**CSPI Program Future**
- Common Census Bureau Issues
- Other Initiatives
- CMMI®--Version 1.2 and Beyond
- Where can I learn more?

## The “IT Standard 24.0.1” & the “Software Development & Maintenance Policy” are being replaced with a new “CSPI Directive”.

The “CSPI Directive” states:
Any area mandated to be CMMI compliant
Any area aspiring to implement CMMI best practices
will participate with the CSPI Program.

- The _**“IT Standard 24.0.1”**_ & the _**“Software Development & Maintenance Policy”**_ are _**being replaced**_ with a new “CSPI Directive”.
- The “CSPI Directive” states:
- Any area _**mandated**_ to be CMMI compliant
- Any area _**aspiring to implement CMMI**_ best practices
- will participate with the CSPI Program.

**2006 - CSPI Directive**

- (3) – CSPI Program Future

**CSPI Directive**

- Area mandated to be CMMI compliant

- Area aspiring to implement CMMI

_**Why?**_
- Different priorities
- Separate budgets
- Different types of projects
- Unenforceable

## Facilitate & maintain the Census SEPG
Coordinate monthly “Brown Bag Lunch Seminars”
Coordinate “CMMI Intro training”
Maintain the Census Portal (incl. PAL)
Coordinate and play a role in SCAMPI appraisals
Provide process-improvement support to the Census Bureau
Provide process-improvement contractor support vehicle
Coordinate & host the Census SEPG Conference

- Coordinate monthly “Brown Bag Lunch Seminars”
- Coordinate “CMMI Intro training”
- Maintain the Census Portal *(incl. PAL)*
- Coordinate and play a role in SCAMPI appraisals
- Provide process-improvement support to the Census Bureau
- Provide process-improvement contractor support vehicle
- Coordinate & host the Census SEPG Conference

**2006 - CSPI Program**

**Primary functions of the 2006 CSPI Program:**

- (3) – CSPI Program Future

- - Communicate – Communicate – Communicate – Communicate – Communicate - Communicate

- CMMI

## Provide learning sessions of new processes/best practices
Provide working sessions based on SEPG member’s needs
Review PAL assets as they are submitted
Bridge the gap across directorates or areas
Leverage implementation knowledge & experiences of fellow Census SEPG members to take back to their areas
Identify areas that perform similar types of development & share processes

- Provide working sessions based on SEPG member’s needs
- Review PAL assets as they are submitted
- Bridge the gap across directorates or areas
- Leverage implementation knowledge & experiences of fellow Census SEPG members to take back to their areas
- Identify areas that perform similar types of development & share processes

**2006 - Census SEPG**

**SEPG membership is rotating in January 2006*

- (3) – CSPI Program Future

- Directorate
- - or -
- area 1

- Directorate
- - or -
- area 2

**Primary functions of the 2006 Census SEPG:**

## Census SEPG Org. Flow

-   Business Goals

*Lessons Learned*

*SEPG Chair*

*Status & Metrics *

- ITGB
- (Steering Committee)

- CSPI Program

- Census SEPG

*Direction &*
*Resources*

- Integrated
- Teams

**Area 1**
**SEPG**

- Integrated
- Teams

**Census SEPG Org. Flow**

**Templates available**
**on PAL in  Jan 2006**
- Area SEPG Charter
- Policy
- SPI Plan
- PIIDs

- CSPI can Help!

- Census
- PAL/Portal

*SEPG Member*

*Status*

*CMMI Guidance*

*Communication Mechanism*

*Working Sessions*

- (3) – CSPI Program Future

## Example: Creating a Policy

**Each participating area will create & maintain a policy.  This will establish a starting point to implement process-improvement.**

- All projects will have a Project Plan
- All projects will identify and assign roles and responsibilities
- All projects will document and maintain requirements
- All projects will identify and maintain configuration items

- (3) – CSPI Program Future

## 2006 - Census Portal/PAL

- The _**CSPI website**_ (incl. the PAL) will be _**consolidated into one cohesive portal.**_  The Census PAL will be organized by CMMI category, process area, & maturity level.

- No current functionality will be lost
- Census PAL will be searchable
- Process Assets will be real-world Census Bureau examples
- Users can upload process assets

- (3) – CSPI Program Future

## Common Census Bureau Issues

- Introduction
- CSPI Program Past
- CSPI Program Future
**Common Census Bureau Issues**
- Other Initiatives
- CMMI®--Version 1.2 and Beyond
- Where can I learn more?

## 
Doing project work is more important so Process-Improvement (PI) effort is put on back burner
Resistance to change of any kind
Misunderstanding of what Process is (If you’re delivering a product or service you have a process)
“This doesn’t apply to me” syndrome
Some developers refer to themselves as analysts and don’t accept developer responsibilities

- Doing project work is more important so Process-Improvement (PI) effort is put on back burner
- Resistance to change of any kind
- Misunderstanding of what Process is (If you’re delivering a product or service you have a process)
- “This doesn’t apply to me” syndrome
- Some developers refer to themselves as analysts and don’t accept developer responsibilities

**Barriers you can Expect**

- (4) - Common Census Bureau Issues

## Things to Remember

- Identify where projects cross areas & address
- Identify & assign project roles & responsibilities (incl. the project manager)
- Decide what measurements should be taken to ensure progress toward business goals
- Audit checklists should be rolled out with processes* (& conducted)*
- Team members should have input on project procedures
- Team buy-in tends to be much more successful than the strong arm approach
- Don’t reinvent the wheel, start with what you have & incrementally improve
- Small wins, & be realistic
- Setup award & recognition system when goals are achieved

**Things to Remember**

- CSPI can Help!

- (4) - Common Census Bureau Issues

## Other Initiatives

- Introduction
- CSPI Program Past
- CSPI Program Future
- Common Census Bureau Issues
**Other Initiatives**
- CMMI®--Version 1.2 and Beyond
- Where can I learn more?

## PMBOK and CMMI

- Internationally recognized standard for _**project management best practices**_, which can be _**applied to any type of project.**_

**PMBOK and CMMI**

**CMMI:**
- CMMi is comprised of models that _**provide a structured view of process-improvement**_** consisting of **_**best practices that address the development and maintenance of products and services**_**, including a **_**standard appraisal method**_** (SCAMPI).**

| CMMI Continuous Representation |
| --- |
|  |

***Support******    ***
- CM, PPQA, MA, CAR, DAR, OEI

***Engineering******    ***
- REQM, RD, TS, PI, VER, VAL

***Project Management***
- PP, PMC, SAM, ISM, IPM, RSKM, QPM, IT

***Process Management****** ***
- OPF, OPD, OT, OPP, OID

****Project Management:  ****PM is the application of knowledge, skills, tools, & techniques to project activities to meet project requirements.*

- (5) – Other Initiatives

## What is ITIL?

- The IT Directorate is exploring a _**new process-improvement**_ initiative to address IT Service Management.  _**The Information Technology**__** **__**Infrastructure Library (ITIL)**_ was founded in Britain in the late 1980’s to _**improve the quality of IT services**_.  It consists of a series of books containing IT industry best practices for the support and delivery of IT services.

- (5) – Other Initiatives

- http://www.itil.co.uk

- For more information please go to the following URL:

## CMMI®-Version 1.2 and Beyond

- Introduction
- CSPI Program Past
- CSPI Program Future
- Common Census Bureau Issues
- Other Initiatives
**CMMI®-Version 1.2 and Beyond**
- Where can I learn more?

## CMMI®--Version 1.2 and Beyond!

- ® CMMI is registered in the U.S. Patent and Trademark Office by Carnegie Mellon University.

**CMMI**®**--Version 1.2 and Beyond!**
- Mike Phillips
- CMMI Program Manager
- Software Engineering Institute
- Carnegie Mellon University
- November 8, 2005

**Sponsored by the U.S. Department of Defense**
**© 2005 by Carnegie Mellon University**

**Notes:**

Familiarization with audience to help guide which slides to emphasize/de-emphasize:

Any black belts in the crowd?
CMM level 4&5?

## CMMI Today

- Version 1.1 CMMI Product Suite in use for over 3 years.
- Errata sheets cover known errors and changes with book publication; FAQs cover broader issues.
- CMMI web pages hits
- 1.5M/month
- 56K/day

**© 2005 by Carnegie Mellon University**

## Examples of Impact:  Return onInvestment

- 5:1 ROI for quality activities (Accenture)
- 13:1 ROI calculated as defects avoided per hour spent in training and defect prevention (Northrop Grumman Defense Enterprise Systems)
- Avoided $3.72M in costs due to better cost performance (Raytheon North Texas Software Engineering)
- - As the organization improved from SW-CMM level 4 to CMMI level 5
- 2:1 ROI over 3 years (Siemens Information Systems Ltd, India)
- 2.5:1 ROI over 1st year, with benefits amortized over less than 6 months (reported under non disclosure)

**© 2005 by Carnegie Mellon University**

**Notes:**
Non disclosure:  M&A result from a high tech, previously ML1, company reported to us by cognence inc – based on a measurement capability modeled explicitly  of M&A PA

## Maturity Profile by All Reporting Organizations

- Based on most recent appraisal of        organizations

**Maturity Profile by All Reporting Organizations**

**Number Of Appraisals**

**© 2005 by Carnegie Mellon University**

## CMMI Version 1.2 Plan

-  “Single book, single course” strategy begun
- V1.2, like the Addison-Wesley book, will consolidate both staged and continuous representations
- Single course for “Intro to CMMI” has been created
- New instructors are being trained in this single course
- Existing instructors are receiving upgrade training
- Staged and Continuous courses will be available until planned upgrade training is complete
- Phased SCAMPI refinements will complement strategy
- Pilot proposed V1.2 changes Dec 05 – Feb 06
- Release V1.2 Summer 2006
- “Sunset” V1.1 after a suitable transition period

**© 2005 by Carnegie Mellon University**

## Version 1.2 Changes - 1

- Eliminate concept of advanced practices and common features from text
- Bring ISM into baseline to eliminate separation from SAM, SS designation
- Add clearer “hardware” coverage in amplifications
- Recognize, given hardware additions, that providing separate development models no longer useful
- -“Single book” approach (CMMI-DEV+IPPD)
- “Not applicable” process areas (PAs) for maturity levels will be significantly constrained (SAM, ISM, IPPD only)

**© 2005 by Carnegie Mellon University**

## Version 1.2 Changes - 2

- Clarify material based on 1000+ Change Requests (e.g., improve high maturity verbiage)
- Work Environment material added to OPD and IPM
- Glossary improved (e.g., higher level management, bidirectional traceability, subprocess)
- Overview text improved
- IPPD coverage consolidated and simplified

**© 2005 by Carnegie Mellon University**

## Beyond V1.2

- First two constellations, CMMI-Services and CMMI-Acquisition, have been “commissioned” by CMMI Steering Group
- Northrop-Grumman is leading industry group for CMMI-Services
- Initial focus will be for organizations providing “DoD services” as well as internal IT
- System maintenance
- Network Management, IT Services
- IV&V
- Development will be in parallel with V1.2 effort; publication sequenced after V1.2 rollout

**© 2005 by Carnegie Mellon University**

## Current Appraisal Synopsis 

- Based on SCAMPI v1.1 Class A appraisals conducted since April 2002 release through August 2005 _and_ reported to the SEI by September 2005.
-    977      appraisals
-    878      organizations
-    206      participating companies
-      86      reappraised organizations
- 3,686      projects
-    60%     Non-USA organizations
- Additional charts providing different views and break down of this information will be added to this briefing as more of these types of appraisals are reported to the SEI over time.

**© 2005 by Carnegie Mellon University**

## Reporting Organizational Types

- Based on        organizations

**Reporting Organizational Types**

**© 2005 by Carnegie Mellon University**

## For More Information About CMMI

**Go to CMMI Website ****	****	**
**http://www.sei.cmu.edu/cmmi**
**http://seir.sei.cmu.edu/seir/**
**https://bscw.sei.cmu.edu/pub/bscw.cgi/0/79783**
**http://dtic.mil/ndia (first, second, and third annual CMMI Conferences)**
_**http://seir.sei.cmu.edu/pars **_**(publicly released SCAMPI summaries)**

**© 2005 by Carnegie Mellon University**

## Where can I learn more?

- Introduction
- CSPI Program Past
- CSPI Program Future
- Common Census Bureau Issues
- Other Initiatives
- CMMI®--Version 1.2 and Beyond
**Where can I learn more?**

## You can request support via the “CSPI Customer and Project Support” intranet website.
http://cww2.census.gov/it/ssd/cspi/proj_sup.asp

- Where can I learn more?

*You can request support via the “CSPI Customer and Project Support” intranet website.*
**http://cww2.census.gov/it/ssd/cspi/proj_sup.asp**

- (6) – Where can I learn more?

## CMMI Intro Drawing

- (6) – Where can I learn more?

## Name:  Chrissy Milliken
Division:  SSD
Phone Number:  763-2153
E-mail: Christine.L.Milliken@Census.gov

Name:  Mark Davis
Division:  SSD
Phone Number:  763-7080
E-mail: Mark.E.Davis@Census.gov

- Name:  **Chrissy Milliken**
- Division:  SSD
- Phone Number:  763-2153
- E-mail: Christine.L.Milliken@Census.gov
- Name:  **Mark Davis**
- Division:  SSD
- Phone Number:  763-7080
- E-mail: Mark.E.Davis@Census.gov

- * If you have any questions please come see us in the “Networking Lounge” RIGHT NOW, or contact our office.

- (6) – Where can I learn more?