# **Archived Information**

#### 

\[Slide 1\]

High School Reform: Learning From Rigorous Evaluations

Prepared for the U.S. Department of Education

High School Initiative

Regional High School Summit

Boston, Massachusetts -- May 21 and 22, 2004

Contact: Corinne Herlihy at <corinne.herlihy@mdrc.org>

\[Slide 2\]

How Evaluations Can Help You

-   They can clarify the problem and help you focus on key points to
    intervene.

-   They can identify promising approaches to address the problems you
    face.

-   They can help you figure out whether what you're doing is making a
    difference.

-   In this presentation,

    -   Zero in on a key point for intervention- Ninth grade

    -   Discuss some program design principles emerging from existing
        studies

\[Slide 3\]

Transitions From Ninth Grade to Twelfth Grade

In Four Large Urban School Districts

Ninth-Grade Students in Comprehensive High Schools, 1999

This is a process flow chart of what happened to one hundred ninth
graders over three years. Of the one hundred ninth graders, fifty-six
went on to tenth grade without incident. Twenty-four had to repeat the
ninth grade. Twenty ninth graders dropped out of school at the end of
the year.

Of the fifty-six ninth graders promoted to the tenth grade, after three
years, thirty-six went on to completion of high school without incident,
seven repeated the tenth, eleventh, and/or the twelfth grade but still
completed school, and thirteen more ultimately dropped out of school.

Of the twenty-four students who had to repeat ninth grade, after three
years, twelve or fully one half completed high school but repeated the
ninth grade or others, and twelve or fully one half ultimately dropped
out of school.

-   All together, thirty-six students completed high school without
    repeating a grade. Forty-five dropped out of school, including the
    twenty who dropped out after grade nine, twelve who repeated grade
    nine and eventually dropped out, and thirteen who were successfully
    promoted to the tenth grade but eventually dropped out. Nineteen
    graduated despite having to repeat at least one grade, including the
    twelve who repeated ninth grade who completed high school and the
    seven who had to repeat a later grade or grades but completed high
    school. End of flow chart.

\[Slide 4\]

Ninth Grade: A Critical Transition Point

Therefore:

-   High school reforms should address the problems of ninth-graders.

-   Successful completion of ninth grade is an early marker of a
    reform's success.

\[Slide 5\]

Evaluation Insights on What to Do

-   Some kinds of evaluations offer more convincing findings about
    program *effectiveness* than others

    -   Highlight the current discussion on standards of evidence

    ```{=html}
    <!-- -->
    ```
    -   Examples of "gold standard" studies and their lessons

    -   Insights on design principles from other research

\[Slide 6\]

The "Gold Standard":\
Experimental Studies Using\
Random Assignment

-   Provide the most solid evidence about whether an intervention
    *caused* the outcomes observed

-   Are feasible when there are more students/schools that need or want
    the intervention than can be served

-   Require close coordination between evaluators and district/school
    administrators

\[Slide 7\]

The Career Academies Concept

-   Schools within schools \-- small groups of students and teachers who
    remain together

-   Organized around a career-related theme, with students taking both
    academic and career-oriented classes

-   Employer partnerships

\[Slide 8\]

The Career Academies Evaluation

-   Involved nine schools

-   1,764 (one thousand seven hundred and sixty four) students randomly
    assigned to program and control groups

-   Follow-up for eight years

\[Slide 9\]

Career Academies' Effects on Students In-School Experiences

Those in the program group

-   Reported more support from teachers

-   Participated in more vocational classes but didn't reduce their
    academic course load

-   Got more work experience

\[Slide 10\]

Career Academies' Effects on Educational and Labor Market Outcomes

-   Higher post-high school earnings for young men, especially those at
    high risk of dropping out

-   No impacts on high school graduation

-   No effects on college enrollment

-   BUT rates for controls were already high.

\[Slide 11\]

Other Random Assignment Studies: Upward Bound and Career Beginnings

-   Reduced dropout rates/increased college enrollment among low-income
    students

-   Offered program enrollees academic counseling, tutoring in high
    school subjects, enrichment activities

\[Slide 12\]

"Silver-Standard Studies"

-   Expeditionary Learning, High Schools That Work, Talent Development
    High School

-   Rigorous curriculum requirements

-   Professional development to strengthen instruction

-   Expeditionary Learning: project-based

-   High Schools That Work: college prep + vocational courses, workplace
    learning

-   Talent Development: "Success Academy" for Ninth Graders, Career
    Academies for grades ten to twelve

\[Slide 13\]

Small Schools

-   Important for enabling, facilitating other changes: more
    personalization, more challenging instruction, more accountability,
    a safer environment

\[Slide 14\]

What's Important -- A Summary

-   Strong student-teacher ties

-   Special attention to the needs of ninth-graders

-   Demanding curricula and high teacher expectations

-   Tutoring and other opportunities for students who are behind to
    catch up

-   Individual counseling around academic as well as personal matters

-   High-quality work-based learning

-   Professional development to support teachers' efforts to deliver
    rigorous, engaging instruction

-   EVALUATE what you are doing