Can high-quality health policy data be 

collected using a probability 

panel sample? 

Results from a National Bridge Study

Jazmyne Sutton | SSRS

Ashley Kirzinger | KFF

Cameron McPhee | SSRS
2023 Research and Policy Conference 

Background

ssrs.com | @ssrs_research | 2

• Rising cost of telephone surveys driving move to less resource-intensive methods

• Probability-based online panel provides opportunity for:

– Representative sample

– Shorter field periods

– Reduced Costs

– Reach non-internet users with small sample reached by phone

• Augment with random-digit dial prepaid (PPD) cell phone sample to reach

– Lower income

– Less educational attainment

– Lower English proficiency
• Probability-based

• Nationally Representative of U.S. Adults 18 and Older

• Recruited via ABS

• Multi-mode Capability

– Internet respondents participate online.

– Web-reluctant and non-internet respondents 

participate by phone. 

GET MORE INFO

SSRS.COM/OPINION - PANEL 

ssrs.com/opinion-panel | @ssrs_research
2023 Research and Policy Conference 

KFF Health Tracking Poll and 

COVID-19 Vaccine Monitor

ssrs.com | @ssrs_research | 4

• Monthly survey tracking public opinion and experiences on healthcare including favorability of 

ACA and other health policies among US adults since 2008

• Began monitoring COVID-19 vaccine uptake in December 2020

• Traditionally dual-frame RDD until March 2021

• Rising costs of RDD led KFF and SSRS to seek out other modes for data collection starting in 2021

• March 2022 experimented with same survey instrument on both ABS and the Opinion Panel along 

with supplement of PPD to compare data quality and trend
2023 Research and Policy Conference 

Study Design

ssrs.com | @ssrs_research | 5

Address-based 

Sample

(N=883)

Prepaid Cell 

Phone

(N=239)

Opinion 

Panel/PPD

(N=1,273)

Opinion Panel

(N=1,034)

ABS/PPD

(N=1,122)
2023 Research and Policy Conference 

ABS Prepaid Cell Opinion Panel

• Random stratified sample of US residential 

addresses from USPS database

• Oversampling areas with higher incidence of 

Hispanic and Black residents as well as those 

with lower levels of education

• Initial invitation letter, postcard, final reminder 

letter

• Push to web and phone (toll-free number)

• Outbound dialing to non-responders 

with appended phone number

• Stratified random sample of 

cell phone numbers flagged 

as prepaid or pay-as-go

• Oversampling phone 

numbers in areas with higher 

incidence Hispanic and Black 

residents

• Multiple call attempts 

varying time of day

• Random sample of 

previously recruited 

panelists

• Email invitation and 

reminders to web 

panelists

• Multiple dial attempts to 

non-internet users

Study Design

ssrs.com | @ssrs_research | 6
2023 Research and Policy Conference ssrs.com | @ssrs_research | 7

46%

53%

46%

53% 54%

45%

Female Male

GENDER

Key Demographics

10%

30% 30% 30%

17%

33%

24% 27%

20%

31% 29%

21%

18-29 30-49 50-64 65+

AGE

25%

32%

42%

29% 33% 28%

49%

26% 26%

HS or less Some College College

EDUCATION

71%

11% 10% 7%

64%

13% 15%

7%

45%

23% 24%

6%

White,

non-Hispanic

Black,

non-Hispanic

Hispanic Other race,

non-Hispanic

RACE/ETHNICITY

ABS Opinion Panel Prepaid Cell
2023 Research and Policy Conference ssrs.com | @ssrs_research | 8

ABS/PPD

• Base weight to adjust for probability of selection 

• Post-stratification/Raking to:

– Gender, education, age, race/ethnicity and region 

from 2021 CPS

– Population density from CPDB

– Internet Frequency from NPORS for Pew Research 

Center

Opinion Panel/PPD

• Base weight adjusted for probability of selection and 

recruitment into the Opinion Panel

• Post-stratification/Raking to:

– Gender, education, age, race/ethnicity and region 

from 2021 CPS

– Population density from CPDB

– Internet Frequency from NPORS for Pew Research 

Center

– Civic engagement from Sept 2017 CPS Volunteering 

and Public Life Supplement

Weighting
Key Outcomes

2023 Research and Policy Conference
2023 Research and Policy Conference 

43%

51% 52% 49%

56%

49% 48%

RDD-Jan 2022* ABS/PPD Opinion

Panel/PPD

CDC/BRFSS^

FLU VACCINE

Got Flu Vaccine Did not get

ssrs.com | @ssrs_research | 10

Vaccine Uptake

77% 79% 79%

22% 20% 20%

RDD-Jan 2022* ABS/PPD Opinion Panel/PPD

COVID - 19 VACCINE

Received at least one dose Not vaccinated

*RDD – Jan 2022: Shown for reference. Dual frame RDD sample of N=1,536 US adults.

^ CDC/BRFSS: Result from CDC analysis of BRFSS data among adults 18+: 

https://www.cdc.gov/flu/fluvaxview/coverage-2022estimates.htm
2023 Research and Policy Conference 

ACA Favorability

ssrs.com | @ssrs_research | 11

53% 54% 55%

35%

43% 42%

13%

4% 2%

RDD-May 2021* ABS/PPD Opinion Panel/PPD

As you may know a health reform bill was signed into law in 2010, known commonly as 

the Affordable Care Act or Obamacare. Given what you know about the health reform 

law, do you have a generally favorable or generally unfavorable opinion of it? 

Favorable Unfavorable No opinion

*RDD – May 2021: Shown for reference. 

Dual frame RDD sample of N=1,526 US adults.
2023 Research and Policy Conference 

Medicaid Expansion

ssrs.com | @ssrs_research | 12

32% 33% 34%

66% 65% 65%

RDD-May 2020* (n=390) ABS/PPD (n=368) Opinion Panel/PPD (n=393)

Asked of those who live in states that have not expanded Medicaid:

“Do you think your state should keep Medicaid as it is today or expand Medicaid to 

cover more low-income uninsured people?”

Keep as it is Expand

*RDD – May 2020: Shown for reference. Dual frame RDD sample of US adults in states 

that have not expanded Medicaid.
2023 Research and Policy Conference ssrs.com | @ssrs_research | 13

Insurance Status & Chronic Health Conditions

87% 90% 90%

13% 10% 10%

RDD - Jan 2022 ABS/PPD Opinion Panel/PPD

INSURANCE STATUS AMONG 

ADULTS 18 - 6 4

Insured <65 Uninsured <65

*RDD – Jan 2022: Shown for reference. 

Dual frame RDD sample of N=1,536 US adults.

29% 33% 33%

70% 67% 67%

RDD - Jan 2022 ABS/PPD Opinion Panel/PPD

HAS A CHRONIC HEALTH 

CONDITION

Yes No
2023 Research and Policy Conference 

MOST IMPORTANT ISSUE FOR 2022 

CONGRESSIONAL ELECTION VOTE

ssrs.com | @ssrs_research | 14

31%

4%

4%

3%

3%

38%

4%

2%

4%

3%

Economy/Inflation/Rising Costs

Climate Change

Voting Republican/Voting out Democrats

Voting Democrat/progressive

Crime

Among Registered Voters

ABS/PPD Opinion Panel
2023 Research and Policy Conference 

Other Considerations:

ssrs.com | @ssrs_research | 15

Quicker Turnaround 

for Panel and Phone 

Samples

6 days for

Opinion Panel

vs.

16 days for ABS 

Less Time Intensive 

Pre-field Preparation

ABS Materials 

Must be Created, 

Proofed, Printed

and Mailed

vs. 

Email Invites and

Reminders Sent 

Prepaid Cell 

Addresses 

Nonresponse Bias

Reaches 

respondents with 

different 

demographic 

characteristics
THANK YOU

Jazmyne Sutton | SSRS

Ashley Kirzinger | KFF

Cameron McPhee | SSRS