## 4 Case Study: NSS Data from a UK University
### Phase 2: Teaching Intervention and Evaluation
#### 4.2.3 Evaluation: Discussion on Questionnaire Results  
We chose a questionnaire as our evaluation method as it is used by NSS and is an effective way to gather large numbers of students' feedback [60]. We extended the department's end-of-year module survey for the purpose of our evaluation. The survey design is in alignment with the NSS survey, offering five Likert-scale options: Strongly disagree; Disagree; Neither agree nor disagree; Agree; and Strongly agree. The full questionnaire, corresponding issues and actions are shown in Table 5. Questions 1 to 7 are part of the set of standard questions from the department's end-of-year survey. Questions 8 to 18 are the additional ones put to the students in the modules under study. Finally, the surveys were conducted at the end of the spring semester, and the results are shown in Table 6. The satisfaction rate was calculated by combining the 'Agree' and 'Strongly agree' responses (note: the Level 5 result does not include Module B, since only one of its four students returned the questionnaire). \begin{table}
\begin{tabular}{c c c c c c c c c c c} \hline \hline \multicolumn{1}{c}{**ActionIssue**} & **I1** & **I2** & **I3** & **I4** & **I5** & **I6** & **I7** & **I8** & **I9** & **I10** \\ \hline A1 & x & & & & & & & & & & \\ A2 & x & x & & & & & & & & & \\ A3 & & & & x & x & x & & & & & \\ A4 & & & & & & & x & & & & \\ A5 & & x & x & & & & & x & & \\ A6 & & x & x & & & & & x & & \\ A7 & & & & & x & x & & & & & \\ A8 & & & & & x & x & & & & & \\ A9 & & & & & x & x & & & & & x \\ A10 & & & & & & & & x & x & x & x \\ A11 & & & & & & & & x & & & x \\ A12 & & & & & & & & x & & x & \\ A13 & & x & & & & & x & x & & \\ \hline \hline \end{tabular}
\end{table} 
Table 4: Issues addressed by actions. \begin{table}
\begin{tabular}{c c c} \hline \hline \multicolumn{1}{c}{**Question**} & **Related Issue** & **Related Action** \\ \hline
1. & The assessment brief helped me understand what was required from the assessment & 2, 3 & 1, 4 \\ \hline
2. & The criteria used in marking assessments have been made clear in advance (e.g., in module handbooks, & 2, 3 & 4, 5 \\  & via Blackboard, in class) & & & \\ \hline
3. & Feedback supported me in terms of aiding my learning and development & 7, 8 & 10, 12, 13 \\ \hline
4. & Tutors/lecturers were supportive & 4, 8, 9 & 8, 9, 10, 12, 13 \\ \hline
5. & Formative feedback supported my learning & 7, 8 & 10, 12, 13 \\ \hline
6. & Staff were available and easy to contact during office hours and the working week & 9, 10 & 9, 11 \\ \hline
7. & Overall, I am satisfied with the quality of the module & All \\ \hline
8. & Real-life examples helped me better understand the content of the module & 4, 5, 6 & 3, 6, 7 \\ \hline
9. & The number of real-life examples provided in class is adequate & 4, 5, 6 & 6 \\ \hline
10. & Real-life examples increased my motivation and engagement with the module & 4, 5, 6 & 3, 6, 7 \\ \hline
11. & Marking criteria are stated in a clearer way in the module handbook compared to previous years & 3, 7 & 5 \\ \hline
12. & Marking criteria are better explained by the tutor compared to previous years & 3, 7 & 4, 5 \\ \hline
13. & In-class feedback on my coursework draft was helpful & 6, 7, 8 & 10 \\ \hline
14. & Coursework deadlines were clearly communicated & 1, 2 & 1, 2 \\ \hline
15. & Regular check of coursework progress by tutor helped me to better manage my time & 7, 8 & 10, 12 \\ \hline
16. & Regular check of coursework progress helped me to improve the quality of my coursework assignment & 7, 8 & 10, 12, 13 \\ \hline
17. & Tutor communicated clearly the expected outcomes of the coursework assignments & 2, 3, 8 & 4, 5, 13 \\ \hline
18. & Tutor communicated clearly what should be done to improve the quality of my coursework & 8 & 10, 12 \\ \hline \hline \end{tabular}
\end{table} 
Table 5: Questions used in the survey. The results of the Level 6 modules show an average rating of 92%; 13 of 18 questions received 90%+ ratings, and five questions achieved 100%.