**Appendix A : MTSS**  **- B Coach Interview Protocol**  **Protocol A: MTSS**  **- B Coach**  **( es**  **) in Each District**  **( Fall 2015**  **)** Date: Interviewer_ID: District_ID: Coach_ID:
**Introduction** Good morning/good afternoon. My name is [name] and Iwork with the Multi

- Tiered Sy stems of Support for Behavior (MTSS

- B) study team. We are conducting interviews with MTSS

- B coaches to learn their thoughts about the training and support they have receive d to help school staff to implement the MTSS

- B program. Iam here today to hear from yo u about how the CSBS trainers who have been working with y ou have helped you to implement the MTSS
- B program in the schools that y ou coach in and about the usefulness of the implementation supports. We anticipate that the interview will take about 20 minutes. Before we begin, I would like to ask y ou to review this consent form and let me know if you agree to be interviewed and I can audio

- record the interview. We record the interviews to ensure that we do not miss any relevant information. All the information we collect is confidential, and y ou, your school, or an yone working at or attending your school will not be identified by name in an y of the reports that will be pu blished. You can ask me to stop recording at any time. ( Review consent form.) Do y ou have an y questions before we begin? **Interview** ICE BREAKER: How is the MTSS

- B program implementation going? I would like to ask y ou a few questions about the readiness activities that were conducted last spring and earl y summer and the trainings and supports you received to be able to help schools to implement the MTSS
- B program. 1. As a part of the readiness activities last spring, yo u were recruited to work as an MTSS

- B coach. Did y ou find the CSBS trainer helpful in understanding your role and responsibilities? a. If **Yes,** then ask: How did he/she help y ou to establish y our position as the MTSS

- B coach for this study

and in schools? [Probe: For example, did y ou see a webinar about the MTSS

- B study in general and about the role of the MTSS

- B coach? Did you discuss y our role as a coach and the roles and functions of the team members with the CSBS trainer?] b. If **No,** then ask: What kind of additional support would have been helpf ul in establishing yo ur position as the MTSS

- B coach?2. Did the CSBS trainer provide an y training specifically about being an MTSS

- B coach and the

coaching model (e.g. instead of covering the MTSS

- B approach more generally)? a. If **Yes,** then ask: What kind of trainings or activities did you do with the CSBS trainer? [Probe: For example, group discussions about the coaching model, practice activities?] b. If **No,** then ask: What kind of additional activities would have been helpful earl y on? 3. Did y ou get support from the CSBS trainer in how to assist schools in changing their office referral sy stem(s)? For example, did the CSBS trainer: i) give you an example ODR form? ii) explain why the forms needed to be changed? a. If **Yes,** then ask: Was the support helpful? Can y ou giv e examples? Can you think of any additional supports that could have been helpful? b. If **No,** then ask: What kind of support would have been helpful for you? I would now like to ask you a few questions about the support activities that have taken place in **the last**  **few months** to implement MTSS

- B in the schools where you coach. 4. Most schools participating in the stud y were encouraged to change their rewards and consequences sy stem regarding student behavior and discipline. Did y ou work with any of the schools wh ere you coach to change their s ys tem? a. If **Yes,** then ask: In those schools where the sy stem changed, can you briefly describe how the sy stem changed? Did the CSBS trainer provide guidance/information to y ou on how to modify

the s ys tem? i. If **Yes** then ask: What kind of supports did he/she provide? Can you give examples? [Probe: Did the trainer discuss the benefits of or reasoning for having positive reinforcement s ys tems in place, changing the focus from negative consequences to positive reinforce ments, examples of sy stems other schools have established, etcetera? For example, technical assistance via email, phone calls] Can you think of any other supports that could have been helpful? ii. If **No,** then ask: What kind of additional support would have bee n helpful for you? b. If **No,** then ask: What were the reasons for not modifying the current rewards/consequences s ystem? [Probe: Did the current s ys tem alread y align with the MTSS
- B approach; was changing the s ys tem not necessary , etc.] 4. As a part of this stud y, SLTs and MTSS

- B coach(es) were trained during the summer b y CSBS in the MTSS

- B approach. Did y ou help, after the summer trainings, any of the schools that y ou coach in to finalize their implementation plans and to prepare for the kick

- off meeting? a. If **Yes,** then ask: Did y ou help all the schools in which y ou coach? Did y ou receive support from the CSBS trainer to help the school staff to finalize the implementation plan? Was the support helpful? Can you give examples? [Probe: For ex ample, technical assistance via email, phone calls] Can you think of any other supports that could have been helpful?b. If **No** then ask: What kind of additional support would have been helpful for you to help

with this task? 5. In your opinion, in how many of th e schools you coach in do the staff feel read y to use SWI S at this stage? In how man y schools are staff not ready ? a. For schools where staff appear read y, then ask: Can y ou give examples of how they are showing this? [Probe: For example, have you or staff i n these schools started to use the sy stem? Has someone been assigned to enter ODRs? How about to regularly print out reports? Are y ou or the staff using or planning to use the data reports during SL T or other meetings?] Are there other indicators that show staff members are ready to use SWI S? b. For schools where staff do not appear read y, then ask: In your opinion, why do you think they are not ready

to use SWI S at this point? [Probe: Were the right staff trained? Did the trained staff leave the school? Was the training not sufficient? I would like to learn about the activities you have engaged in **since the start of the school -**  **year** to help school staff implement the MTSS

- B program and the kind of supports that you received from the CSBS trainer to do that. I would like to ask a set of questions about the kind of activities y ou may have been engaged in. 6. Did y ou help the SLT in any of y our schools get established and become part of the school’s decision

- making infrastructure? a. If **Yes,** then ask: What did you do to help? Did you receive support from the CSBS trainer? Was it helpful? Can you give examples? [Probe: Did the CSBS trainer explain the role and functioning of SLTs and their different members; how to incorporate the MTSS

- B coach into the school infras tructure; technical assistance via email, phone calls] Can you think of any other supports that could have been helpful? b. If **No,** then ask: Why

not? Have you discussed this with the CSBS trainer? [Probe: what is the trainer’s take on it? Were these schools moving without y ou? What kind of additional support would have been helpful for you to assume a more active role? 7. Have you been participating in the SLT meetings in any of the schools you work with? a. If **Yes,** then ask: i. In how man y of your schools? ii. How o ften did you participate in these meetings on average across these schools? iii. What was y our role in the meeting? For example, did y ou keep the meeting minutes, or help to anal yz e data? iv. What kind of supports have y ou received from the CSBS trainer for your ro le in the SL T?
v. If you did not participate in SLT meetings in all schools, why did you not attend in some schools? Have you discussed this with the CSBS trainer?b. If **No,** then ask: Why have y ou not been attending these meetings? Have y ou discussed this with the CSBS trainer? [Probe: What is the trainer’s take on it? Should you attend these meetings?] 8. Did y ou help the SLT or other school staff anal yz e student data and/or use data to modify the school’s implementation plan in any of y our schools? a. If **Yes,** then ask: In how many school did you help with the data? Did you receive support from the CSBS trainer? Was the support helpful? Can you give examples? [Probe: For example, went through examples based on your school’s data, printed out and interpreted example r eports, answered questions about SWI S] Can y ou think of an y other supports that could have been helpful? b. If **No,** then ask: Have yo u discussed this with the CSBS trainer? [Probe: What is the trainer’s take on it? Should you help the schools with data?] What kind of additional support would have been helpful for yo u? These were all the questions that Ihave. Is there any thing else you would like to share with me about the support y ou have received for implementing the MTSS

- B program? Thank y ou so much for y our time.**Protocol B: MTSS**  **- B Coach(es) in Each District**  **( S**  **pring 2016)** Date: Interviewer_ID: District_ID: Coach_ID: **Introduction** Good morning/good afternoon. My name is [name] and Iwork with the Multi

- Tiered Sy stems of Support for Behavior (MTSS

- B) study team. We are conducting interviews with MTSS

- B coaches to learn their thoughts about the training and support they have receive d to help school staff to implement the MTSS

- B program. Iam here today to hear from yo u about how the CSBS trainers who have been working with y ou have helped you to implement the MTSS
- B program in the schools that y ou coach in and about the usefulness of the implementation supports. We anticipate that the interview will take about 20 minutes. Before we begin, I would like to ask y ou to review this consent form and let me know if you agree to be interviewed and I can audio

- record the interview. We record the interviews to ensure that we do not miss any relevant information. All the information we collect is confidential, and y ou, your school, or an yone working at or attending your school will not be identified by name in an y of the reports that will be pu blished. You can ask me to stop recording at any time. ( Review consent form.) Do y ou have an y questions before we begin? **Interview** ICE BREAKER: How the MTSS

- B program going? I would like to ask y ou a few questions about the support activities that have taken place **over the last two**  **mo nths**  to implement MTSS

- B in the schools where you coach. I would especiall y like to learn about the activities you engaged in over the last two months and what kind of supports y ou received from the CSBS trainer to conduct these activities. Iwould like to ask a set of questions about the kind of activities the CSBS trainer and you were engaged in. Are you ready ? 1. Most schools participating in the stud y were encouraged to change their rewards and consequences sy stem regardin g student behavior and discipline. Did you work with any of the schools where you coach to change their s ys tem? c. If **Yes,** then ask: In those schools where the sy stem changed, can you briefly describe how the sy stem changed? Did the CSBS trainer provide guid ance/information to you on how to modify the s ys tem? i. If **Yes** then ask: What kind of supports did he/she provide? Can you give examples? [Probe: Did the trainer discuss the benefits of or reasoning for having positive reinforcement s ys tems in place, changing the focus from negative consequences to positive reinforce ments, examples of sy stems other schools have established,etcetera? For example, technical assistance via email, phone calls] Can you think of any other supports that could have been helpful? ii. If **No,** then ask: What kind of additional support would have bee n helpful for you? d. If **No,** then ask: What were the reasons for not modifying the current rewards/consequences sy stem? [Probe: Did the current s ys tem alread y align with the MTSS

- B approach; was changing the s ys tem not necessary , etc.]
2. Has the CSBS trainer c onducted webinars about the classroom components in any of the schools where you coach **over the last two months** ? a. If **Yes,** then ask: Did y ou participate in the webinars? Do you think the staff and teachers have found the information in the webinars to be use ful? Do you think they are using the specific strategies and tools? Can you think of any other supports that could have been helpful? b. If **No,** then ask: Has there not been an y trainings yet? Have you discussed this with the CSBS trainer? [What is the trainer ’s take on it? Should you have attended the trainings as well?] 2. Have there been an y other trainings b y the CSBS provider in an y of the schools where you coach **over the last two months** ? a. If **Yes,** then ask: Did y ou participate in the trainings? What was the co ntent of the trainings? Do y ou think y our staff and teachers have found the trainings useful? How do you know? Do y ou think they

are using the specific strategies and tools covered in the trainings? Can yo u think of an y other supports that could have been helpful? b. If **No,** then ask: Has there not been an y trainings yet? Have you discussed this with the CSBS trainer? [What is the trainer’s take on it? Should y ou have attended the trainings as well?] 3. Have you been participating in the SLT meetings in any of the schools you work with? a. If **Yes,** then ask: i. In how man y of your schools? ii. How often did you participate in these meetings on average across these schools? iii. What was y our role in the meeting? For e xample, did you keep the meeting minutes, or help to anal yz e data? iv. What kind of supports have y ou received from the CSBS trainer for your role in the SL T? v. If you did not participate in SLT meetings in all schools, why did you not attend in some schools? Have you discussed this with the CSBS trainer?b. If **No,** then ask: Why have y ou not been attending these meetings ? Have y ou discussed this with the CSBS trai ner? [Probe: What is the trainer’s take on it? Should you attend these meetings?] 4. Did y ou help the SLT or other school staff anal yz e student data and/or use data to modify the school’s implementation plan in any of y our schools? a. If **Yes,** then ask: In how many school did you help with the data? Did you receive support from the CSBS trainer? Was the support helpful? Can you give examples? [Probe: For example, went through examples based on your school’s data, printed out and interpreted example reports, answer ed questions about SWI S] Can y ou think of an y other supports that could have been helpful? b. If **No,** then ask: Have yo u discussed this with the CSBS trainer? [Probe: What is the trainer’s take on it? Should you help the schools with data?] What kind of additi onal support would have been helpful for yo u? 5. Did y ou conduct any

trainings for teachers in an y of y our schools **over the last two months** ? (For example, during grade level meetings?) a. If **Yes,** then ask: In how many schools? What was the content of the trainin gs? Can you give examples? [Probe:] i. Phy sical arrangement of the classroom ii. Explicitly

defining, teaching, and reinforcing teaching behavior expectations (support in creating behavior matrices, etc.) iii. How to provide praise in the classroom (contingent and exp licit; implementing reward consequence s ys tem

—including new ODR process, positive vs. negative comments) iv. General classroom routines
v. Classwide group contingencies vi. Error correction vii. Multiple opportunities to respond viii. Active supervision ix. Positive Behavior Game b. If **Yes,** then ask: Have CSBS trainers provided support for the training of teachers in MTSS

B implementation? I f so, can y ou tell me more about those supports? [Probe: For example, materials, consultation, and problem solving about specific issues or challe nges (e.g., what content to cover in the training, how to make the training hands on, etc.)] c. If **No,** then ask: Have yo u discussed this with the CSBS trainer? [Probe: What is the trainer’s take on it? Should you engage in direct coaching with the teachers?]6. Did y ou provide any individualized coaching to the classroom teachers in any of your schools **over the last two months**  ? a. If **Yes,** then ask: What was the content of the coaching? Can you give examples? [Probe:] i. Phy sical arrangement of the classroom ii. Explicitl y defining, teaching, and reinforcing teaching behavior expectations (support in creating behavior matrices, etc.) iii. How to provide praise in the classroom (contingent and explicit; implementing reward consequence s ys tem

—including new ODR process, positive v s. negative comments) iv. General classroom routines
v. Classwide group contingencies vi. Error correction vii. Multiple opportunities to respond viii. Active supervision ix. Positive Behavior Game b. Can y ou give examples of the ty pe of activities you engaged in? i. Observations for coaching purposes ii. Observations for checking on implementation fidelity iii. Modelling an y of the classroom strategies iv. Providing teachers feedback on their implementation
v. Consulting with teachers about the Positive Behavior Game vi. Other: c. How did y ou pick which tea chers to coach? d. What kind of supports has the CSBS trainer provided for coaching the teachers in the MTSS
- B implementation? [Probe: For example, materials, consultation, and problem solving about specific challenges or issues (e.g., how to model a specifi c strategy , how to create productive relationships with teachers)]. e. If **No,** then ask: Have yo u discussed this with the CSBS trainer? [Probe: what is the trainer’s take on it? Should you engage in direct coaching with the teachers?] 7. What barriers or obstac les do y ou believe have hindered the implementation of the MTSS

- B program in your school? Was the CSBS trainer helpful in addressing these obstacles? How?8. In your opinion, in any the schools where you coach, did the staff feel well supported b y the

provide r regarding MTSS

- B implementation during the last school ye ar? In how many schools do yo u think the staff felt well supported? These were all the questions Ihad. Is there any thing else yo u would like to share with me about the support yo u have received f

or implementing the MTSS

- B program? Thank y ou so much for y our time.**Protocol C: MTSS**  **- B Coach**  **( es**  **) in**  **E ach District**  **(Spring 2017)** Date: Interviewer_ID: District_ID: Coach_ID: **Introduction** Good morning/good afternoon. My name is [name] and Iwork with the Multi

- Tiered Sy stems of Support for Behavior (MTSS

- B) study team. We are conducting interviews with MTSS

- B coaches to learn their thoughts about the training and support they have receive d to help school staff to implement the MTSS

- B program. Iam here today to hear from yo u about how the CSBS trainers who have been working with y ou have helped you to implement the MTSS
- B program in the schools that y ou coach in and about the usefulness of the implementation supports. We anticipate that the interview will take about 20 minutes. Before we begin, I would like to ask y ou to review this consent form and let me know if you agree to be interviewed and I can audio

- record the interview. We record the interviews to ensure that we do not miss any relevant information. All the information w e collect is confidential, and you, your school, or an yone working at or attending your school will not be identified by name in an y of the reports that will be published. You can ask me to stop recording at any time. ( Review consent form.) Do y ou have an y questions before we begin? **Interview** ICE BREAKER: How is the MTSS

- B program going? I s there a difference compared to last y ear? [Probe: Is it getting easier? I s the staff better prepared to implement?] I would like to learn about the support activities that have taken place over the last few months to implement MTSS

- B in the schools where you coach. I would especially

like to learn about the activities yo u engaged in over the last two months and what kind of supports y ou received from the CSBS trainer to conduct these activities. Are you read y? 1. Has the CSBS trainer conducted webinars about the classroom components in any of the schools where you coach **over the last two months** ? a. If **Yes,** then ask: Did y ou participate in the webinars? Do you think the staff and teachers have found the information in the webinars to be useful? Do you think they are using the specific strategies and tools? Can you think of any other supports that could have been helpful? b. If **No,** then ask: Has there not been an y trainings yet? Have you discussed this with the CSBS trainer? [What is the trainer’s take on it? Should y ou have attended the trainings as well?] 2. Have there been an y other trainings b y the CSBS provider in an y of the schoo ls where you coach **over the last two months** ?a. If **Yes,** then ask: Did y ou participate in the trainings? What was the content of the trainings?

Do y ou think y our staff and teachers have found the trainings useful? How do you know? Do y ou think they

are using the specific strategies and tools covered in the trainings? Can yo u think of an y other supports that could have been helpful? b. If **No,** then ask: Has there not been an y trainings yet? Have you discussed this with the CSBS trainer? [What is the trainer’s take o n it? Should you have attended the trainings as well?] 3. Have you been participating in the SLT meetings in any of the schools you work with? a. If **Yes,** then ask: i. In how man y of your schools? ii. How often did you participate in these meetings on average across these schools? iii. What was y our role in the meeting? For example, did y ou keep the meeting minutes, or help to anal yz e data? iv. What kind of supports have y ou received from the CSBS trainer for your role in the SL T? v. If you did not participate in SLT meetings in all schools, why did you not attend in some schools? Have you discussed this with the CSBS trainer? b. If **No,** then ask: Why

have you not been attending these meetings ? Have y ou discussed this with the CSBS trainer? [Probe: What is the trainer’s take on it? Should you attend these meetings?] 4. Did y ou help the SLT or other school staff anal yz e student data and/or use data to modify the school’s implementation plan in any of y our schools? a. If **Yes,** then ask: In how many school did you help with the data? Did you r eceive support from the CSBS trainer? Was the support helpful? Can you give examples? [Probe: For example, went through examples based on your school’s data, printed out and interpreted example reports, answered questions about SWI S] Can y ou think of an y o ther supports that could have been helpful? b. If **No,** then ask: Have yo u discussed this with the CSBS trainer? [Probe: What is the trainer’s take on it? Should y ou help the schools with data?] What kind of additional support would have been helpful for you? 5. D id y ou conduct any

trainings for teachers in an y of y our schools **over the last two months** ? (For example, during grade level meetings?) a. If **Yes,** then ask: In how many schools? What was the content of the trainings? Can you give examples? [Probe:] i. Phy sical arrangement of the classroomii. Explicitly defining, teaching, and reinforcing teaching behavior expectations (support in creating behavior matrices, etc.) iii. How to provide praise in the classroom (contingent and explicit; implementing reward consequence s ys tem

—including new ODR process, positive vs. negative comments) iv. General classroom routines
v. Classwide group contingencies vi. Error correction vii. Multiple opportunities to respond viii. Active supervision ix. Positive Behavior Game b. If **Yes,** then ask: Have CSBS trainers provided support for the training of teachers in MTSS
- B implementation? I f so, can you tell me more about those supports? [Probe: For example, materials, consultation, and problem solving about specific issues or challenges (e.g., what content to cover in the trai ning, how to make the training hands on, etc.)] c. If **No,** then ask: Have yo u discussed this with the CSBS trainer? [Probe: What is the trainer’s take on it? Should y ou engage in direct coaching with the teachers?] 6. Did y ou provide any

individualized coaching to the classroom teachers in any of your schools **over the last two months**  ? a. If **Yes,** then ask: What was the content of the coaching? Can you give examples? [Probe:] i. Phy sical arrangement of the classroom ii. Explicitly

defining, teaching, and reinforcing teachin g behavior expectations (support in creating behavior matrices, etc.) iii. How to provide praise in the classroom (contingent and explicit; implementing reward consequence s ys tem

—including new ODR process, positive vs. negative comments) iv. General classroom routi nes v. Classwide group contingencies vi. Error correction vii. Multiple opportunities to respond viii. Active supervision ix. Positive Behavior Game b. Can y ou give examples of the ty pe of activities you engaged in?i. Observations for coaching purposes

ii. Observations for checking on implementation fidelity iii. Modelling an y of the classroom strategies iv. Providing teachers feedback on their implementation
v. Consulting with teachers about the Positive Behavior Game vi. Other: c. How did y ou pick which teachers to coach? d. What kind of supports has the CSBS trainer provided for coaching the teachers in the MTSS
- B implementation? [Probe: For example, materials, consultation, and problem solving about specific challenges or issues (e.g., how to model a specific strategy , how to create productive relationsh ips with teachers)]. e. If **No,** then ask: Have yo u discussed this with the CSBS trainer? [Probe: what is the trainer’s take on it? Should y ou engage in direct coaching with the teachers?] 7. Have there been an y trainings b y the CSBS provider about the Tier II i ntervention [CI CO] in any of y our schools **over the last two months** ? a. If **Yes,** then ask: In how many schools there have been trainings? Did you participate in the trainings? What was the content of the trainings? Do you think the staff found the trainings use ful? How do you know? Do you think they are using the specific strategies and tools covered in the trainings? Can y ou think of an y other supports that could have been helpful? b. If **No,** then ask: Have yo u discussed this with the CSBS trainer? [Probe: What is the trainer’s take on it? Should there have been training at this point? Should you participate in the trainings?] ? 8. Have you worked with the SL T or the Targeted Team regarding implementation of [CI CO] in ay of the schools where you coach? a. If **Yes,** then as k: In how many of them? What kind of supports have y ou provided? Can y ou give examples? [Probe:] i. Did y ou help the SLT and/or the Targeted Team to identify students who are not responsive to Tier I and who would benefit from [CI CO]? ii. Did y ou help the SLT or the Targeted Team to create behavior expectations for students? iii. Did y ou help to enter the [CI CO] data into SWI S? iv. Did y ou help anal yz e the SWI S [CI CO] data? v. Did y ou help with progress monitoring and adjusting the implementation? vi. Did you model how to give feedback to students regarding their expectations and behavior?b. What kind of support did y ou receive from CSBS to help the school staff with CI CO

implementation? [Probe: Did the CSBS trainer answer your questions, provide additional materials (e.g., examples of student score cards), brainstormed to solve issues, etc.) c. If **No,** then ask: Have yo u discussed this with the CSBS trainer? [Probe: What is the trainer’s take on it? Should y ou be helping the SLT and TT with CI CO at this point?] 9. What barriers or obstacles do y ou believe hindered the implementation of the MTSS

- B program in the schools in which y ou coach? Was the CSBS trainer helpful in addressing these obstacles? How? These were all the questions Ihad. Is there any thing else yo u would like to share with me about the support yo u have received for implementing the MTSS

- B program? Thank you so much for y our time.