Table 7: Mean effect sizes on summary measures of classroom observation – Matched sample

|<br>Dependent variable|<br>(1)|<br>(2)|<br>(3)|<br>(4)|<br>Control<br>Average|
|---|---|---|---|---|---|
|A. Instructional activities|0.066***<br>[0.014]|0.066***<br>[0.014]|0.063***<br>[0.014]|0.056***<br>[0.013]|0.698|
|B. Classroom management activities|-0.038***<br>[0.010]|-0.038***<br>[0.010]|-0.038***<br>[0.010]|-0.032***<br>[0.010]|0.216|
|C. Off-task activities|-0.028***<br>[0.008]|-0.028***<br>[0.007]|-0.025***<br>[0.007]|-0.024***<br>[0.007]|0.086|
|D. Instructional activities all students engaged|0.003<br>[0.021]|-0.002<br>[0.021]|-0.001<br>[0.022]|-0.004<br>[0.022]|0.262|
|E. Big group (>6) of student off-task|-0.050***<br>[0.019]|-0.043**<br>[0.017]|-0.042**<br>[0.018]|-0.037**<br>[0.018]|0.196|
|Control for baseline||x|x|x||
|Student, teacher and classroom covariates<br>School covariates<br>_Note_: Sample size 3121. Robust standard errors in<br>time teacher was instructing. These variables assu<br>p<0.10 ** p<0.05 *** p<0.01|brakets, clustere<br>mes missing value|d at the school le<br>s if the teacher di|x<br>vel. Variables D a<br>d not spend any|x<br>x<br>nd E only consid<br>time instructing|er the<br>. *|

Table 7 shows ITT estimates for the matched sample, using the same model presented in equation (1). Results are similar to results for the whole sample, but slightly stronger. The treatment increased teachers’ time on instruction 5.6-6.6% (0.262-0.313 SD), and reduced time on classroom management and time offtask by 3.2-3.8% (0.189-0.225 SD), and 2.4- 2.8% (0.185-0.221 SD), respectively. The share of time that a large group of students was off task went down in the range of 3.7% to 5% (0.129-0.173 SD). Except for instructional time with all students engaged, coefficients are strong and significant at a 5% level. As we would expect, estimates of �� change little as the list of control variables changes.

_d. Intent to treat effect – intra-school variation_ Given the program’s emphasis on promoting diffusion of good practices within schools, an expected result is decreased variation in teacher practice within treated schools. To test this impact, we calculate the standard deviation of each of the main summary variables at the school level and use it as a dependent variable. The ITT effect is then estimated from the equation below:

# �� = �� + ����,��� + �′��� + ���� + ��      (2)

where �� is the standard deviation of the classroom observation variable for school i; ��,��� is the baseline standard deviation of the classroom observation variable collected in November of 2014; �� represents a vector of pre-intervention characteristics at the school level; �� is an indicator for whether the classroom was in a treatment school; and �� is the error term, clustered at the school level. The coefficient of interest is ��. We estimate (2) using the same four sets of control variables described above. Results are reported in Table 8.<sup>10</sup> Table 8: Intra-school variation in summary measures of classroom observation

|<br>Dependent variable|<br>(1)|<br>(2)|<br>(3)|<br>(4)|<br>Control<br>Average|
|---|---|---|---|---|---|
|A. Instructional activities|-0.022***<br>[0.008]|-0.022***<br>[0.007]|-0.018**<br>[0.007]|-0.016**<br>[0.007]|0.166|
|B. Classroom management activities|-0.017**<br>[0.007]|-0.017**<br>[0.007]|-0.014*<br>[0.007]|-0.012*<br>[0.007]|0.138|
|C. Off-task activities|-0.020***<br>[0.007]|-0.020***<br>[0.006]|-0.020***<br>[0.007]|-0.018***<br>[0.006]|0.093|
|D. Instructional activities all students engaged|-0.009<br>[0.012]|-0.017<br>[0.011]|-0.005<br>[0.012]|-0.003<br>[0.012]|0.243|
|E. Big group (>6) of student off-task|-0.037**<br>[0.014]|-0.024*<br>[0.014]|-0.024*<br>[0.013]|-0.021<br>[0.013]|0.209|
|Control for baseline||x|x|x||
|Student, teacher and classroom covariates|||x|x||
|School covariates<br>_Note_: Sample size 292. Note: Robust standard err|ors in brackets, clu|stered at the sch|ool level. * p<0.1|x<br>0 ** p<0.05 *|** p<0.01|

10 Regression tables unpacking intra-school variation for each of the summary measures using the four specifications are shown in the appendix, tables A8 to A12.

17