Orientation Webinar

Friday, November 17

2:00-3:30 EDT

1
2
3
HISTORY OF COLLABORATION

The issue of coordination across systems to serve 

disadvantaged youth has been the focus of bipartisan and federal attention for decades:

o Coordinating Council on Juvenile Justice and 

Delinquency Prevention

o White House Task Force for Disadvantaged 

Youth

o Shared Youth Vision

o Interagency Working Group on Youth Programs

o My Brothers Keeper

4
CONSOLIDATED APPROPRIATIONS ACT OF 2014

Allows for the development of P3 Pilot sites 

using funds received from multiple Federal 

streams while measuring and tracking specific 

cross-program outcomes:

o pooling of discretionary funds

o regulatory waivers for non mandatory 

program rules

5
• overcome program silos and fragmented systems 

to use existing resources 

• to help disconnected youth improve in the areas of 

education, employment, and other key areas that 

help develop protective factors.

o Individuals between the ages of 14 and 24

o Meet low-income eligibility

o Either homeless, in foster care, involved in the juvenile justice system

o Unemployed, or not enrolled in or at risk of dropping out of an 

educational institution.

6

PROGRAM GOALS
FEDERAL PARTNERS

7

• Department of Education (Lead Agency)

• Departments of Labor

• Department of Health and Human Services 

• Corporation for National and Community 

Service

• Department of Justice

• Department of Housing and Urban 

Development

• Institute of Museum and Library Sciences
PILOT SITES

• Cohort I 

Los Angeles City | Broward County | Chicago 

| Indianapolis | Eastern Kentucky | Baton 

Rouge | Oklahoma| Ysleta del Sur Pueblo | 

Seattle

• Cohort II

Maricopa County 

• Cohort III

New York State| Sacramento| Los Angeles 

County | New York City | Hartford | Sandoval 

County

8
PROGRAM DATA

9

Participant data are captured two ways:

o Evaluation and Data Sharing Agreements

o Quarterly Reporting ED 524B - Demographic 

Data Supplement

Participant data are used:

o Share our story with stakeholders

o Identify gaps in services or areas of need 

o Highlight successes
DATA AT A GLANCE*

10

45%

53%

0% 2%

Gender

Male

Female

Other

Unknown

*Q1 data. For point of 

reference only. Not all 

grantees data included. 
DATA AT A GLANCE*

11
12
13
FEDERAL PARTNER AGENCIES

• Lead Administering Agency (U.S. Department of Education)

• Manage pilot selection process

• Monitor expenditure of “start-up” grant funds by pilots

• Collect performance reports and disseminate them to Federal agencies

• Coordinate technical assistance contract (Jobs for the Future)

• Lead Agency for Evaluation (U.S. Department of Labor)

• Manage the national evaluation of P3

• Provide technical assistance to pilots on evaluation-related issues

• Consulting Agency

• Lead monitoring of the pilot and serve as principal point of contact

• Seek to resolve implementation challenges

• Participating Agency

• Assist with monitoring pilot performance

• Inform the Consulting Agency of issues and concerns involving its programs

14
P3 ROUND 3 AGENCY ROLES

Pilot Consulting Agency Participating Agency

Hartford Labor Health & Human 

Services

Los Angeles County Labor --

New York City Health & Human 

Services

Labor

New York State 

Education Department

Education Justice

Sacramento Health & Human

Services

Labor

15
Tara Smith

Jobs for the Future

tsmith@jff.org

16
TECHNICAL ASSISTANCE TEAM

17
TECHNICAL ASSISTANCE ACTIVITIES

Targeted, strategic technical assistance will be developed 

based on the needs and priorities of the P3 grantees. 

18

Assigned TA Coach and 

regularly scheduled 

coaching calls

Peer Exchange Network 

(PEN) meetings

Peer sharing calls with 

other Round 2/3 P3 

grantees

Peer learning calls with 

Round 1 P3 grantees

Webinars Affinity Groups and 

Communities of 

Practice
TOOLS FOR COMMUNITY-BASED INITIATIVES

19

Resources developed by the TA Team to support community-based initiatives

Available at: http://www.jff.org/initiatives/place-based-initiatives-andperformance-partnership-pilots/tools
FISCAL MAPPING FOR COMMUNITY-BASED 

INITIATIVES

Fiscal mapping technical assistance includes:

 Fiscal mapping tool and guide memo (available 

at: http://www.jff.org/initiatives/place-basedinitiatives-and-performance-partnershippilots/fiscal-mapping-tool)

 Webinar series and resources for communities 

getting started with fiscal mapping 

 Subject matter expert site visits (select 

communities) 

20
RESOURCES TO SUPPORT COMMUNITY-BASED 

INITIATIVES

 Youth.Gov: https://youth.gov/

 JFF Webpages on the PBI & P3 Initiative: 

http://www.jff.org/initiatives/place-basedinitiatives-and-performance-partnership-pilots

 Forum for Youth Investment’s Website: 

http://forumfyi.org/

21
22
NATIONAL EVALUATION CONTACTS

• Christina Yancey, Project Officer

• U.S. Department of Labor, Chief Evaluation Office

• Yancey.Christina.L@dol.gov

• Linda Rosenberg, Project Director

• Mathematica Policy Research

• LRosenberg@mathematica-mpr.com

• Cay Bradley, Evaluation Technical Assistance Lead

• Mathematica Policy Research 

• CBradley@mathematica-mpr.com

Study overview: 

https://www.dol.gov/asp/evaluation/currentstudies/Performance_Partnership_Pilot

s_for_Disconnected_Youth_National_Evaluation.htm

23
WHAT IS THE NATIONAL EVALUATION OF P3? 

• Overall objective is to fully document the P3 effort. Further, based on the results 

from local evaluations at each of the nine cohort 1 pilots, the study will highlight 

effective and promising practices for achieving employment-related outcomes for 

youth.

• Four main components

• Implementation and systems study (all pilots)

• Evaluation technical assistance (all pilots with local evaluations)

• Pilot data reporting (cohort 1)

• Synthesis of local P3 pilot evaluations (cohort 1)

24

SOCIAL POLICY RESEARCH

ASSOCIATES
IMPLEMENTATION AND SYSTEMS STUDY

• Objectives

• Learn how individual pilots are using their granted flexibilities to improve the 

outcomes of disconnected youth

• Examine how flexibilities enhance community partnerships and systems

• Identify lessons and promising areas for building on the P3 approach

• Data collected through a site visit to each Cohort 2/3 pilot

• Interviews with program administrators and staff

• Interviews with partner administrators and staff

• Short survey of partner administrators

• Group discussions with P3 participants

• In 2018, evaluation team member will contact pilots to discuss plans for the visit

25
EVALUATION TECHNICAL ASSISTANCE: 

AN IMPORTANT RESOURCE FOR PILOTS

• Objectives of evaluation technical assistance (eval TA)

• To support P3 pilots’ local evaluations

• To develop evidence of successful models that meet research clearinghouse 

standards

• For pilots with local evaluations, including:

• Experimental and quasi-experimental studies

• Implementation studies

• Key eval TA staff: 

• Cay Bradley, cbradley@mathematica-mpr.com

• Diana McCallum, dmccallum@mathematica-mpr.com

26
EVAL TA: KEY ACTIVITIES FOR PILOTS WITH A 

LOCAL EVALUATION

• Prepare a logic model

• Summarize the evaluation design in either:

• An implementation evaluation plan (no comparison group) 

• An impact evaluation plan (comparison or control group)

• Discuss evaluation plan with eval TA liaison(s) and revise as needed

• Meet with eval TA liaison(s) to discuss evaluation as it begins and as needed

• Raise questions, problems, or concerns with eval TA liaisons

27
EVAL TA: NEXT STEPS FOR PILOTS WITH A 

LOCAL EVALUATION

• Join an initial call of the pilot project director and local evaluator, consulting agency 

staff, eval TA liaison, and JFF programmatic coach

• Purpose: to discuss intervention (program), timing of programming, and 

evaluation plans

• Prepare logic model to document the program

• Purpose: to articulate how program is expected to change youths’ outcomes

• Webinar on logic models was presented in October (Recording is available at: 

https://youtu.be/celN4uY-PvQ.)

• TA available as part of early calls

• Join Eval TA Webinar on the evaluation plan 

• Purpose: to walk through template, expectations, and timing

• Date: TBD but after logic model calls

28
RECAP: P3’S MULTIPLE RESOURCES AND 

CONTACTS

• Federal team

• Lead administering agency (Education)

• Consulting agency (Education, Health & Human Services, or Labor)

• Participating agency (Health & Human Services, Justice, or Labor)

• Programmatic technical assistance

• Jobs for the Future

• The Forum for Youth Investment

• Performance Excellence Partners

• National evaluation and evaluation technical assistance

• Mathematica Policy Research

• Social Policy Research Associates

29
30