# Ramp

- Up Implementation Study Focus Group Protocol

Introduction and Welcome (5 min.)

Hello, my name is [fill in name] . Thank you for coming in tod ay.

I am from the Midwest Regional Educational Laboratory and helping me today is [fill in name of assistant]. REL Midwest is conducting this focus group as part of our study of the Ramp

- Up to Readiness intervention, a study in which your school is partici pating. Today, we want to better understand the programs, services, activities, and resources provided to students in [fill in name of high school] to prepare them for college. We also want to understand your experiences this year in implementing the Ramp

- Up to Readiness program. This information will become part of a study report describing the effects of the Ramp

- Up to Readiness program.

Please note that when we say “ college, ” we mean a two

- year college, four

- year college or university, community college, or career or technical college. To begin, I have to go over some logistics with you. We’ve estimated that this focus group will take 90 minutes. During these 90 minutes, I will ask questions about the Ramp

- Up program and other college

- readiness supports

o ffered in your school. We hope that you will feel free to attempt to answer the questions as best you can based on the experiences you have had here at [fill in name of high school] . Some of these questions will ask you to estimate the percentage of studen ts who participate in a particular activity. Please just do your best to provide an estimate. We will have a 10

- minute break at [XXXX time, 50

- minute mark]

. My role and the role of [fill in name of assistant] will be to ask questions, moderate the

discussi on, and record major themes and feelings expressed by focus group participants.

Consent

As stated in the study consent form that you have previously signed, all data being collected will be kept confidential by REL M idwest and American Institutes for Resea rch (the third

- party evaluator). You have the right to discontinue your participation in this data collection process at any time without consequences.

Confidentiality

Let me just highlight one issue that is discussed in the consent forms. It is impossible to write down everything that you say today, so we will be recording the focus group conversation so that we can go back and listen to the discussion to make sure that we did not miss anything. Anything

that is discussed will remain confidential. The audi orecordings will be transcribed and then erased. We will not identify any focus group participants in the transcriptions.

Are there any questions before I begin?

According to the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it displays a valid

OMB control number. The valid OMB control number for this information collection is XXXX.XXXX, OMB expiration date is XXXX, XX, 2014. The time required to complete this information collection is estimated to average 90 minutes per respondent, including the t ime to review instructions, gather the data needed, and complete and review the information collected. Participation in this data collection task is voluntary. Per the policies and procedures required by the Education Sciences Reform Act of 2002, Title I, Part E, Section 183, response s to this data collection will be used only for statistical purposes. The reports prepared for this study will summarize findings across the sample and will not associate responses with a specific school, district, or individual. Any willful disclosure of such information for nonstatis tical purposes, except as required by law, is a class E felony. If you have any comments concerning the accuracy of the time estimate(s) or suggestions for improving this form, please write to: U.S. Department of Ed ucation, Washington, DC 20202. If you have comments or concerns regarding the status of your individual submission of this form, write directly to: U.S. Department of Education, Institute of Education Sciences, 555 New Jersey Avenue, NW, Washingto n, DC 20208.Introductions

Before beginning with the questions and turning on the audiorecorder, let’s go a round the room and introduce ourselves. Please say your name and your role here at [fill in name of high school]

. Now, we are beginning with the questions. I’ll turn on the audiorecorder and start asking questions.

Background Information

The Ramp

- Up to Readiness program is offered to high schools throughout Minnesota. The developers note that there is no single way to implement the program because of variations in local context, but there are elements of Ramp

- Up that are to be implemented in all settings

. Today, we’d like to gather a better understanding of how the program has been implemented at [fill in name of high school] . First, I’ll ask questions about whether and when you completed key implementation activities. This will be followed by questions o n the Ramp

- Up curriculum, tools, professional development, your school culture, the challenges and success of implementation, and to what extent you think Ramp

- Up is changing the college readiness of students’ in your school.

Thank you for joining us today

. Notes to focus group moderator : The purposes of this focus group are to understand (1) the extent to which treatment schools faithfully adopt the program model, and what enables them or prevents them from doing so; and (2) the degree to which the intervention model differs from the services and activities underlying the business

- as

- usual comparison

condition. If participants are reluctant to estimate percentages when asked, probe for more than 25 percent or less than 25 percent, more than 50 percent or less than 50 percent, or more than 75 percent or less than 75 percent.Fidelity of Implementation Questions for Early Implementing Ramp

- Up Schools

A. Ramp

- Up Annual Plan Activities

In the fall, your school filled out the Ramp

- Up to Readiness Annual Plan indicating when your school was planning to complete key actions. I woul d like to discuss some of these actions. [Note to moderator: have a copy of the Annual Plan to refer to]

1. Have there been any changes over the school year in who serves on the Ramp

- Up leadership team or who serves as the Ramp

- Up coordinator?

[Probe if yes: Why did a change occur?]

1. How often did the Ramp

- Up leadership team meet this school year to guide and monitor Ramp

- Up implementation in your school?

[Probe if no: What challenges did you face in meeting quarterly?]

2. Do all students at [ name of high school ] use a technology platform (e.g., Naviance or MCIS) as part of the Ramp

- Up program?

[Probe if yes:

a. Which platform?

b. Did students use this platform prior to implementing Ramp

- Up?

c. To what extent is the technology platform integrated with Ramp

- Up advisories o r workshops?

Probe if no:

d. What challenges have you faced in adopting a technology platform?]

3. Have you conducted any internal evaluation of your school’s implementation of Ramp

Up or progress on improving college

- readiness indicators (e.g., taking advanced courses, completing college enrollment activities)?

[Probe if yes:

a. Have you discussed your findings with staff at the College Readiness Consortium?

b. Did you make any changes to instructional practices based on your review of the

data?

Probe if no:

c. What ch allenges have you faced in conducting internal evaluations of the Ramp

- Up program?]

B. Ramp

- Up Curriculum

Now, I would like to talk about the Ramp

- Up advisories and workshops.

5. Thinking about the Ramp

- Up weekly advisories...

a. What percentage of students do you es timate received all 28 lessons?[Probe if less than 100 percent: Which students did not receive all 28 lessons and why?]

b. How long did the lessons last?

[Probe if less than 30 minutes: Why did the lessons last less than the planned 30
minutes?]

c. How much tim

e were advisors provided to prepare and learn about the lesson content prior to teaching it?

d. Was the amount of time provided to advisors to prepare and learn the lesson content adequate?

[Probe if not: How much time would have been adequate?]

6. Thinking abou t the Ramp

- Up workshops...

a. How many workshops were held over the course of the year?

[Probe: Did the number of workshops differ by gra de

- level (i.e., did Grade 10 students receive fewer than Grade 12 students)?

Probe if less than five: What challenges did yo u face in delivering all five workshops?

Probe if more than five: Most Ramp

- Up schools schedule five workshops. Why did

your school decide to have additional ones?]

b. What were the topics of these workshops?

[Probe: Were they differentiated by grade?]

c. When were the workshops offered?

d. On average, how long did these workshops last?

e. Who taught the workshops (i.e., the same staff teaching th e Ramp

- Up advisories or different staff)?

f. What percentage of students do you estimate attended all the workshops?

[Probe if less than 100 percent: Which students did not attend and why?]

C. Ramp

- Up Tools

Next, I would like to talk about the tools used in the Ramp

- Up program, specifically the Readiness Rubric or Postsecondary Plan.

7. Thinking specifically about the Postsecondary Pla n...

[Note to moderator: Show an example of the Postsecondary Plan to remind participants what it is]

a. What percentage of all students completed a Postsecondary Plan this school year?

[Probe if less than 100 percent: Which students did not complete a Postseco ndary Plan and why?]b. What percentage of students discussed the Postsecondary Plan with a teacher/advisor or counselor as part of the course registration process?

[Probe if less than 100 percent: Which students did not review their Postsecondary

Plan with a teacher/advisor or counselor? Why? Were there times other than course registration when the Postsecondary Plan was reviewed with students?]

c. Can you pr ovide an example of how you discussed the Postsecondary Plan with a

student?

d. How do school staff engage with parents using the Postsecondary Plan?

[Probe: How often do school staff talk with parents about their student’s Postsecondary Pl an? What percentage of parents talks to school staff about their student’s Postsecondary Plan?]

e. Is the student’s Postsecond ary Plan stored electronically for your review and review by students or par ents?

[Probe if not: Why?]

8. Thinking specifically about the Readiness Rubric...

[Note to moderator: Show an example of the Readiness Rubric to remind participants what it is]

a. What per centage of students completed the Readiness Rubric three times this year?

[Probe if less than 100 percent: What percentage o f students completed the Readiness Rubric at least twice? What percentage of students completed it at least once? Which

students did not complete the Readiness Rubric three times this year? Why not?]

b. How often did school staff review the rubric with studen ts this school year?

c. Can you provide an example of how you discussed the Readiness Rubric with a

student?

d. How do school staff engage with parents using the Readiness Rubric?

[Probe: How often do school staff talk with parents about their student’s Readiness Rubric? What percentage of parents talks to school staff about their student’s Readiness Rubric?]

e. Is the student’s Readiness Rubri c stored electronically for your review and review by students or parents?

9. Did school staff experience barriers in talking to parents about their child’s Readiness Rubric or Postsecondary Plan (e.g., language barriers)?

[Probe if yes: How did your school a ddress those?]

D. Professional Development

10. At the beginning of the school year, were four hours spent introducing staff to the Ramp

- Up program?a. Can you describe the content covered that day?

b. Which teachers had the opportunity to attend this four

- hour training ?

c. How did staff respond to the introduction of the Ramp

- Up to Readiness program?

[Probe if some staff were not receptive: What were the concerns of staff about Ramp

Up?]

11. How often does the Ramp

- Up leadership team or coordinator provide professional develop ment related to Ramp

- Up?

a. How long do these professional development sessions last?

b. Which teachers have the opportunity to attend pro fessional development?

c. How engaged are school staff during these meetings (e.g., the extent to which they participate in dis cussions)?

d. How challenging has it been to provide regularly scheduled professional development on Ramp

- Up to teachers?

12. Have you had or are you planning a one

- hour feedback session where school staff can provide feedback to the leadership team on program im plementation?

E. Overall Experiences With Implementation

13. How have the goals or beliefs of school staff changed during the school year, if at all, with the introduction of Ramp

- Up?

14. Has the introduction of Ramp

- Up changed the way that school staff interact with parents?

15. What aspects of Ramp

- Up worked well as you implemented the program?

[Probe: Why did they work well?]

16. What aspects of the program did not work well?

[Probe: Why did they not work well?]

F. Ramp

- Up to Readiness: Contrast Between Implementing and Non

- Implementing

Schools

In February , we talked about the college

- readiness programs, services, activities, and resources that [ name of high school ] provides to prepare students to enroll and succeed in college. I have a list of the supports that you named, an d now I would like to ask some specific questions about each of these activities. If the school no longer offers a support that I read, please let me know.

[ Instructions to moderator: complete the following matrix by asking questions 1 7

– 2 2 for each sup port listed. Probe as necessary to be able to complete the matrix ]Matrix of College

- Readiness Supports

College

- Readiness Support Participation

Rate

Frequency Intensity Corresponding

Readiness Dimension

10th 11th 12th

Academic Admissions Career Financi al Personal/Social

Program 1
Program 2
Program 3

Program 4
Program 5

Service 1

Service 2

Service 3

Service 4

Service 5 Activity 1 Activity 2 Activity 3 Activity 4 Activity 5

Resource 1

Resource 2

Resource 3

Resource 4

Resource 5

17. Which grade does [ name of support ] target? [moderator to check each grade targeted]

18. What percentage of Grade 10, Grade 11, and Grade 12 students participate in or receive
[ name of support ]?

19. How often has [ name of support ] been offered this school year?

20. How long does [ name of support ] last?

21. Which of the following does [ name of support ] primarily address: students’ academic preparation, the college admissions process, career planning, how to pay for college, or on goal setting or achievement?22. Are there any other college

- readiness programs, services, activities, or resources that

[name of high school] offers but that we haven’t talked about?

I want to wrap up with a few more general questions.

G. Professional Development

23. So far thi s school year, has the school provided staff any professional development related to preparing students for college?

a. Can you describe what was provided?

b. How long did each professional development session last?

c. Who received this professional development?

[P robe: What percentage of teachers ?]

d. What did you find helpful or unhelpful about these materials or this professional development?

H. College Culture

Next, I would like to talk about the expectations and practices of school staff for preparing

students for c ollege.

24. Thinking about the goals and beliefs of school staff...

a. To what extent do school personnel here share a common goal to prepare all students for college?* 1

b. To what extent do school personnel believe that college counseling is the job of

school counsel

ors, not teachers?*

25. Thinking about the practices in your school...

a. How are students encouraged to take advanced coursework (e.g., honors, dual

- credit, AP, IB, or College in the Schools classes)?

b. To what extent is the curriculum at this school focused on help ing students get ready for college?*

c. Does your school collect data to assess students’ college readiness?

[Probe if yes: How do you use this information?

26. Thinking about parents...

a. To what extent do parents of students in this school expect their children to go to college?*

1 An * indicates that this question is based on a question included on a survey from the Center for Applied Research and Educational Improvement (CAREI) at the University of Minnesota.I. Barriers to Implementing a Schoolwide College Readiness Program

Finally , let’s talk about implementing a schoolwide college readiness program.

27. What educational initiatives, if any, has [ name of high school ] been involved in implementing t his year?

[ Clarify :

a. Is this initiative school

- wide? What is the format of these communications (e.g.,

one

- way versus two

- way conversation)?

b. [If this is an early implementing school] Are staff able to successfully implement

more than one initiative at a ti me?

c. [If this is a late implementing school] Do you foresee any barriers to implementing a schoolwide college

- readiness initiative next year ? Thank you again for participating in today’s focus group !