## Interview	Protocol**– Survey	Pilot** 

**Instructions** Thank the interviewee for agreeing to participate in the interview. Hand out a copy of the survey (with questions numbered to correspond to this protocol) and a highlighter. Read the following instructions to the participant: Handing the survey to the interviewee, “This is the survey on feedback in teacher evaluation surveys that you recently completed
. I would like you to review the questions and directions in this survey and provide feedback on their clarity
. Our purpose is to see if the content of the survey is understood consistently among teachers
. I will ask you to read through a section of the survey and then respond to a series of questions following each section. As you read through the section, please highlight any questions that you find difficult to answer because they are unclear or contain language that is not relevant or appropriate for teachers. Your responses will be used to help modify the survey to make it easier to understand and be more consistently understood
. ” **Introduction and Question**  **2 , 3, 4**  Please read the introduction and question 2, 3, and 4
. 1. Was the introduction clear? a. If not, what was unclear? 2. In question 2, w hat does the term “designated evaluator” mean to you ? 3. In question 3 and 4, are the questions clear? a. How did you interpret “written feedback”? b. How did you interpret “feedback conversation”?

4. Do the options for question 2, 3, and 4 cover the major possible options? **Question 5**  Please read the directions for question 5 and read and respond to questions 5 a through 5 g. Highlight any questions that you find difficult to answer, because they are unclear or contain language that is not relevant or appropriate for teachers. 1. Were the directions clear? a. If not, what was unclear? b. What does “feedback you received as part of the teacher evaluation system in your district” mean to you? 2. For the question ( s ) that you highlighted, please explain why the question was difficult to answer . a. How would you phrase the question in your own words? Following the response, the interviewer explains the intent of the question(s) as needed.3. This section is trying to capture the extent to which the feedback was useful. Are there items

that should be included or deleted to better describe the useful ness of the feedback? **Question 6**  Please read and respond to questions 6 a through 6 d . Highlight any questions that you find difficult to answer because they are unclear or contain language that is not relevant or appropriate for teachers. 1. For the question ( s ) that you highlighted, please explain why the question was difficult to answer . a. How would you phrase the question in your own words? Following the response, the interviewer explains the intent of the question(s) as needed. 2. This section is trying to capture the extent to which the feedback was accurate. Are there items that should be included or deleted to better describe the accuracy of the feedback? **Question 7**  Please read and respond to questions 7 a through 7 d . Highlight any questions that you find difficult to answer because they are unclear or contain language that is not relevant or appropriate for teachers. 1. For the questions that you highlighted, please explain why the question was difficult to answer. a. How would you phrase the question in your own words? Following the response, the interviewer explains the intent of the question(s) as needed. 2. This section is trying to capture the extent to which the person providing the feedback was credible . Are there items that should be included or deleted to better describe the credibility of the person providing the feedback ? **Question 8**  Please read and respond to questions 8 a through 8 d . Highlight any questions that you find difficult to answer because t hey are unclear or contain language that is not relevant or appropriate for teachers. 1. For the question ( s ) that you highlighted, please explain why the question was difficult to answer. a. How would you phrase the question in your own words? Following the response, the interviewer explains the intent of the question(s) as needed. 2. This section is trying to capture the extent to which you had access to learning opportunities related to you r feedback. Are there items that should be included or deleted to bette r describe the learning opportunities you had access to that were related to your feedback? **Question 9**  Please read and respond to questions 9 a through 9 d . Highlight any questions that you find difficult to answer because they are unclear or contain language that is not relevant or appropriate for teachers.1. For the question ( s ) that you highlighted, please explain why the question was difficult to

answer. a. How would you phrase the question in your own words? Following the response, the interviewer explains the intent of the question(s) as needed. 2. This section is trying to capture the extent to which you used or responded to the feedback. Are there items that should be included or deleted to better describe the how you used or responded to the feedba ck?

**Question 10**  Please read the instructions for question 10 and read and respond to questions 10a through 10g . These items are very similar to the items in question s 5 so you may identify similar challenges. Highlight any questions that you find difficult to answer because they are unclear or contain language that is not relevant or appropriate for teachers. 1. Were the directions clear? a. If not, please explain what was unclear. 2. For the question ( s ) that you highlighted, please explain why the question was difficult to answer. ( If the same challenges are identified as in question 5 , skip to next question
. ) **Question 11**  Please read the instructions for question 11 and read and respond to questions 11 a through 11 d . These items are very similar to the items in question s 6 so you may identify similar challenges. Highlight any questions that you find difficult to answer because they are unclear or contain language that is not relevant or appropriate for teachers. 1. Were the directions clear? a. If not, please explain what was unclear. 2. For the question(s) that you highlighted, please explain why the question was difficult to answer. ( If the same challenges are identified as in questions 6 , skip to next question
. ) **Question 1** **2** Please read the instructions for question 1 2 and read and respond to questions 1 2 a through 1 2 d . These items are very similar to the items in question s 7 so you may identify similar challenges. Highlight any questions that you find difficult to answer becau se they are unclear or contain language that is not relevant or appropriate for teachers. 1. Were the directions clear? a. If not, please explain what was unclear. 2. For the question(s) that you highlighted, please explain why the question was difficult to answer. ( If the same challenges are identified as in questions 7 , skip to next question
. )**Question 1** **3**

Please read the instructions for question 1 3 and read and respond to questions 1 3 a through 1 3 d . These items are very similar to the items in question s 8 so you may identify similar challenges. Highlight any questions that you find difficult to answer because they are unclear or contain language that is not relevant or appropriate for teachers. 1. Were the directions clear? a. If not, please explain what was unclear. 2. Fo r the question(s) that you highlighted, please explain why the question was difficult to answer. ( If the same challenges are identified as in questions 8 , skip to next question
. ) **Question s**  **14** Please read questions 14
. 1. Is the question clear? 2. If not, please explain what was unclear
. Do the options for questions 14 cover the major possible options? **Question s**  **15, 16,**  **17** Please read questions 15, 16, and 17
. 1. Are the questions clear? a. If not, please explain what was unclear
. 2. Do the options for the questions cover the major possible options? **General** 1. Do you have any other comments or suggestions about the clarity of the survey? **Thank you for taking time to participate in this interview.**