Performance in Science on the Minnesota Comprehensive Assessments--Series II for Students in Grades 5 and 8. Issues &amp; Answers. REL 2012-No. 138
Author: Condon, Chris
Date: 2012-04-00
Type: Reports - Research
Subjects: Science Achievement,Educational Assessment,Science Tests,Scores,Grade 5,Grade 8,Elementary School Students,Middle School Students,Gender Differences,Racial Differences,Economically Disadvantaged,Special Education,Institutional Characteristics,Academic Standards,Limited English Speaking,Teaching Experience,Teacher Student Ratio,Teacher Characteristics

Policymakers in Minnesota have made assessing and improving student science performance a priority (Minnesota High Tech Association 2010a,b). Minnesota has supported several statewide initiatives to promote science, technology, engineering, and math (STEM)--including a grant from the National Governors Association to increase science learning opportunities, align K-12 STEM education requirements with postsecondary workplace expectations, improve the quality and quantity of STEM teachers, benchmark standards, and identify best practices in STEM education (National Governors Association 2007). To gauge student progress toward the state's academic science standards, the Minnesota Department of Education introduced the Minnesota Comprehensive Assessments-Series II (MCA-II) science assessment in 2008. Regional Educational Laboratory Midwest responded to a request by the Minnesota Department of Education to study elementary and middle school science achievement. The current study addresses three research questions: (1) How does student achievement on the 2009/10 MCA-II science assessment in grades 5 and 8 differ by student demographic characteristics?; (2) How does schoolwide achievement on the 2009/10 MCA-II science assessment in grades 5 and 8 relate to school characteristics?; and (3) To what extent do school characteristics explain differences in student achievement on the 2009/10 MCA-II science assessment in grades 5 and 8, after accounting for the influence of student characteristics? This study used data for 51,510 grade 5 students in 786 schools and 52,421 grade 8 students in 469 schools. Students' levels of science achievement depended on their demographic characteristics for both the grade 5 and grade 8 assessment: (1) Students who were not identified for special education services scored higher than students who were; (2) Students who were not eligible for free or reduced-price lunch scored higher than students who were; (3) White students scored higher than students of other racial/ethnic groups; and (4) Male students scored higher than female students. Eight of the nine school characteristics examined were related to schoolwide science achievement: (1) Science achievement tended to be lower in schools with higher percentages of students eligible for free or reduced-price lunch, limited English proficient students, students identified for special education services, and non-White students; (2) Science achievement tended to be higher in schools that had more experienced teachers, higher percentages of teachers with an advanced degree, larger student-teacher ratios, and higher levels of prior-year academic achievement; and (3) Science achievement tended to be higher in schools with a higher proportion of female students in grade 8, but this relationship was not observed in grade 5. About 80 percent of the variation in students' scores (79 percent in grade 5 and 84 percent in grade 8) was due to differences among students within schools; differences between schools accounted for the remaining variation. However, after accounting for student-level characteristics, the school characteristics examined explained less than 3 percent of the variation between schools (2.1 percent in grade 5 and 2.7 percent in grade 8). For both grades, after accounting for student characteristics, science achievement tended to be higher in schools with a smaller percentage of students eligible for free or reduced-price lunch and a larger percentage of White students. Specifically, the following results were evident for both grades: (1) A 1 percentage point increase in the percentage of White students was associated with an estimated increase in science assessment scores of 3.24 percentage points in grade 5 and 2.31 percentage points in grade 8; and (2) A 1 percentage point increase in the percentage of students eligible for free or reduced-price lunch was associated with an estimated decrease in science assessment scores of 2.33 percentage points in grade 5 and 2.65 percentage points in grade 8. None of the school characteristics based on teacher composition examined in this study were related to student science achievement after other student and school characteristics were accounted for. This report provides Minnesota policymakers with insights into factors related to science achievement, as measured by the MCA-II. Appended are: (1) Minnesota K-12 academic standards in science; (2) Data procedures; (3) Student demographic and school characteristics for grades 5 and 8; (4) Data analysis; (5) Variance decomposition from multilevel models; and (6) Additional analyses. (Contains 3 boxes, 2 figures, 16 tables and 12 notes.) [For &quot;Performance in Science on the Minnesota Comprehensive Assessments--Series II for Students in Grades 5 and 8. Summary. Issues &amp; Answers. REL 2012-No. 138,&quot; see ED531424.]