Re-engineered SIPP 

– Progress Update –

Survey Redesign Seminar

January 20th, 1-3pm, BLS
Current SIPP Basics

National panel survey – Since 1984 with sample size between 

about 11,000 and 45,000 interviewed households

The duration of each panel varies from 21⁄2 yrs to 4 yrs

The SIPP sample is a multistage-stratified sample of 

the U.S. civilian noninstitutionalized population

The survey uses a 4-month recall period – 3 interviews / year

The sample is divided into 4 rotation groups for monthly 

interviewing

Interviews are conducted by personal visit and by 

decentralized telephone
The Save the SIPP Campaign

New York Times Editorials

Discovering What Happens Next

Save our SIPP

The Continuing Saga of SIPP 

NY Representative, Carolyn Maloney stated:

“I want to thank all of the policy groups and economists who 

worked so hard to help reverse the Administration’s original SIPP 

decision. Because of their dedication and hard work, the 

Administration came to understand how important SIPP is to 

creating and implementing good public policy.” 
SIPP Re-Engineering

Implement Improvements to SIPP

- reduce costs

- reduce R burden

- improve processing system

- modernize instrument

- expand/enhance use of admin records

Key Design Change:

- annual interview, 12-month reference pd., 

event history calendar methods

EHC Interviewing

Human Memory

- structured/organized

- links and associations

EHC Exploits Memory Structure

- links between the occurrence and timing of events

EHC Encourages Active Assistance to Rs

- flexible approach to help elicit an 

autobiographical “story”
Evaluations of EHC Methods 

Many EHC vs. “Q-List” Comparisons

- various methods

- in general: positive data quality results

BUT, Important Research Gaps

- data quality for need-based programs?

- comparison to 4-month reference period?
SIPP Re-engineering Field Test Plans

- Proof of concept test 

- - 2008 paper and pencil reinterview test

- EHC CAPI test

- - 2010 Integrated Blaise and C# instrument prototype

- CAPI Revised test

- - 2011 Test improvements to the wave 1 instrument, training, 

and expand sample to all regional offices.

- - 2012 Test wave 2 concepts and instrument, examine 

movers and attrition issues, and refine training procedures.
2008 Paper Field Test Goals & Design

Basic Goal:

Can an EHC interview collect data of comparable

quality to standard SIPP?

- month-level data

- one 12-month ref pd interview vs. three

4-month ref pd interviews

- especially for need-based programs

Basic Design:

EHC re-interview of SIPP sample HHs

Approximately 2000 HHs in IL and TX
First pg of EHC – 2008 Field Test Instrument
Field Test Overall Summary

Successful “Proof of Concept”

Overwhelming Finding: SIPP-EHC Agreement

Valuable Lessons to Inform Next Test

- larger, broader sample

- “correct” timing of field period

- automated questionnaire

Specific Data Comparisons are Instructive
2010 EHC CAPI Test Goals & Design

Basic Goal:

Can a CAPI Event History Calendar interview be:

- developed in-house (new/unknown requirements)

- integrated with survey management systems

- administered by regular field staff interviewers

Develop and test new processing system

Determine the comparability of data collected:

- month-level data

- (1) 12-month ref pd intvw vs. (3) 4-month ref pd intvws

- especially for need-based programs

Basic Design:

8000 HHs interviewed in 10 states limited to high poverty strata 

that can be matched to areas in 2008 Panel SIPP data.
Screenshot – 2010 EHC CAPI Instrument 
LANDMARKS

RESIDENCES

PRESENCE OF PARENT - MOM

PRESENCE OF PARENT - DAD

REFERENCE YEAR 20XX INTERVIEW YEAR 20XX+1

INTV

SCHOOL ENROLLMENT – (CURRENTLY ENROLLED fill)

JOBS/BUSINESSES – (fill name of emp/bus from ehc as entered)

+ Job/Bus 2 – (fill name of emp/bus from ehc as entered)

+ Job/Bus 3 – (fill name of emp/bus from ehc as entered)

+ Job/Bus 4 – (fill name of emp/bus from ehc as entered)

+ Job/Bus 5 – (fill name of emp/bus from ehc as entered)

ALL OTHER WORK FOR PAY

TIME NOT WORKING

MARITAL STATUS – (CURRENT MARITAL STATUS fill)

SSI - SUPPLEMENTAL SECURITY INCOME

SNAP - FOOD STAMPS/SUPPLEMENTAL NUTRITION ASSISTANCE PRGM

TANF - TEMPORARY ASSISTANCE FOR NEEDY FAMILIES

GA – GENERAL ASSISTANCE PROGRAM

WIC – WOMEN, INFANTS AND CHILDREN PROGRAM

HEALTH INSURANCE – PRIVATE COVERAGE

+ ADDITIONAL PRIVATE COVERAGE

MEDICARE COVERAGE

MEDICAID COVERAGE – (fill interview state program name)

MILITARY COVERAGE – (VA, CHAMPUS, CHAMPVA)

OTHER HEALTH INSURANCE COVERAGE

TIME WITHOUT HEALTH INSURANCE COVERAGE

Topic – (FILL TOPIC LABEL)

* INTRO TO TOPIC QUESTION FILL – ASKS ABOUT STATUS NOW OR DIRECTS FR TO PROCEED [ ] (1) YES/PROCEED (2) NO (3) REFUSED

* FOLLOW-UP ASKS ABOUT EVER DURING REFERENCE YEAR OR DIRECTS FR TO PROCEED [ ] (1) YES/PROCEED (2) NO (3) REFUSED

* IDENTIFY NEW PERIOD OF TIME [ ] 0-NEW [F4 – EDIT SPELL] [CTRL-X DELETE SPELL]

* WHEN DID THIS PERIOD OF (TOPIC FILL) END? [ ] CHOOSE MONTH 

* WHEN DID THIS PERIOD OF (TOPIC FILL) BEGIN? [ ] CHOOSE MONTH

ANY MORE PERIODS OF (TOPIC FILL) DURING REFERENCE YEAR? [ ] (1) YES (2) NO

IF YES TO ‘NOW’ INITIALIZE 

FIRST PERIOD AND FILL 

INTERVIEW MONTH IN THE 

‘TO’ BOX AND SET FOCUS 

ON THE ‘FROM’ BOX

RECORDING ‘NO’ ADDS STRIKEOUT TO ANY UNASSIGNED 

MONTHS IN THIS TOPIC – ANSWERING ‘YES’ CYCLES BACK 

TO NEW PERIOD – UPON SPELL COMPLETION YOU EXIT 

THE DETAILED QUESTIONS TO THE ‘ANY MORE’ ITEM.

DEPENDENT DATA FILL UP 

TO LAST WAVES ‘INTV’ 

MONTH

DATA ARE RECORDED UP TO THE MONTH OF 

INTERVIEW, WE ALLOW UP TO 6 MONTHS FROM THE 

END OF THE CALENDAR YEAR TO CONDUCT 

INTERVIEWS – MONTHS BEYOND THE INTERVIEW ARE 

GREY’ED OUT.

FILL’S ARE 

USED TO 

LABEL 

INTERVIEW 

MONTH 

STATUS OR 

NAMES FROM 

JOBS/PROGR

AM NAMES

(FILL NAME OF PERSON FOR THIS EHC)

Mockup (example of possible changes) for 

2011 EHC CAPI Instrument 
Challenges Faced

Developing new technical capacity.

- experimentation

- limitations

- evolution

Crisis planning.

- limited lead time / preparation

- changing goals and required flexibility

New procedures.

- training and acceptance

- development and refinement of procedures
Current Status

Interviewing in 6 of 12 regional office areas (10 States)

Interviews continue through March 13.

Recording 400-500 of the completed interviews –

transcription will begin shortly.

Reviewing and making changes to content and design.

Reviewing and revising training materials and methods

Planning for 2013 Production implementation
Comments:

Jason Fields – Jason.M.Fields@Census.Gov
Assessing Users’ Needs

URL: http://www.census.gov/sipp