**TEXAS READING FIRST INITIATIVE**

**SUMMARY YEar FOur (2006-2007) EVALUATION REPORT**

A report prepared for the Texas Education Agency

By

Coleen D. Carlson, Ph.D.

Lee Branum-Martin, Ph.D.

Angie Durand, Ed.D.

Chris Barr, Ph.D.

David J. Francis, Ph.D.

Texas Institute for Measurement, Evaluation, and Statistics

University of Houston

c

  ---------------------------------------------------- ---------------------------------------------------------
  ![](media/image1.png){width="0.9083333333333333in"   ![](media/image2.png){width="4.666666666666667in"
  height="1.0in"}                                      height="0.7243055555555555in"}

  ---------------------------------------------------- ---------------------------------------------------------

This report in divided into 4 major sections: 1) **Background
Information**: 2) **Performance Analyses Summary**; 3) **Performance
Analyses;** and 4) **Appendix A: Performance Analyses Detailed Model
Results**. **Background Information** presents information regarding the
Outcome and Benchmark (Diagnostic) assessments analyzed across grades
and languages, the definition of proficiency used in this report to
determine the percentage of students at each campus that were performing
at or above acceptable levels, and a description the analytic models
used to examine student performance. The **Performance** **Analyses
Summary** provides a brief synopsis of the results discussed in detail
in the Performance Analyses section. This section is useful for those
who prefer to read a condensed, simple summary of the primary findings,
limitations and future directions. The **Performance** **Analyses**
section presents the analyses of student performance by grade level and
language and focuses explicitly on analyses designed to answer questions
about the impact of RF on student achievement. **Appendix A:**
**Performance** **Analyses Detailed model Results** presents the model
statistics for each set of analyses conducted for this report.

**BACKGROUND INFORMATION**

**[Outcome Assessments]{.underline}**

***Outcome Measures.*** The student performance outcomes examined in
this report were typically measured in the language of the student's
primary literacy instruction (English or Spanish). Decisions regarding
the language of assessment for each student were made at the campus or
district level. In addition, the assessments used to measure student
outcomes varied by grade and language. In Kindergarten, English outcome
performance was measured using the *Texas Primary Reading Inventory*
(TPRI), and Spanish outcome performance was measured using the *Tejas
LEE.* In Grades 1 and 2, English performance outcomes were assessed
using the *Iowa Test of Basic Skills* (ITBS)/Logramos (Riverside
Publishing) or the *Stanford Achievement Test -- 10,* (SAT10)/Aprenda
(Harcourt). In Grade 3, outcome performance was measured using the state
mandated *Texas Assessment of Knowledge and Skills (*TAKS) *English or
Spanish*. The language of assessment for students with limited English
proficiency was determined by the student's Language Proficiency
Assessment Committee (LPAC).

The decision to allow schools to use either ITBS or SAT10 in first and
second grade, rather than require all schools in the state to use the
same assessment, was based on the fact that both tests were in
widespread use prior to the onset of Reading First. In fact, at the time
that Reading First began in Texas, ITBS was being used with roughly
21,000 students on 114 campuses in 22 districts and the SAT9 (precursor
to SAT10) was being used with approximately 20,000 students on 88
campuses in 6 districts. While a few other norm referenced tests were
also in use at that time, (e.g., Terra Nova), these were not in
widespread use and schools using these assessments were required to
switch to ITBS. Schools with no prior assessment program were also
required to adopt ITBS. However, we did not require schools previously
using the SAT series to switch to ITBS or add ITBS to their assessment
program. The decision to adopt ITBS was made based on the cost per
student difference between the publishers. Spanish outcomes in grades 1
and 2 were assessed using the Spanish counterpart to the English
assessment in use at each campus (*Logramos*, Riverside Publishing for
campuses using ITBS, or *Aprenda*, Harcourt Publishing for campuses
using SAT10).

***Definition of Proficiency for Outcome Measures.*** In Kindergarten,
the proficiency criteria followed the recommendations of the developers
of the TPRI and *Tejas LEE*. Specifically, a student was considered to
be on grade level if they scored at or above the Developed/*Desarollado*
level on all measured skill domains required at the end of the school
year. This index is referred to as the Total Reading Composite score and
is fairly stringent in that a student is considered to be proficient
[only]{.underline} if they score at passing levels on all three domains
examined (i.e., Phonological Awareness (PA), Graphophonemic Knowledge
(GK), and Comprehension (CO)).

Proficiency criteria in grades 1 and 2 were based on the recommendations
of the Assessment Committee in the National Reading First Technical
Assistance presentations. Specifically, a student was considered
proficient if they scored at or above the 40^th^ percentile based on
national norms for the test on which they had been assessed
(ITBS/*Logramos*, or SAT10/*Aprenda*). This definition was used in
recognition of the different scales used to report performance on the
different assessments.

The reader should note that the National Percentile Ranks (NPRs)
reported by the publisher to campuses may, in fact, differ from those
used in these analyses. In first and second grade, campuses and/or
districts were allowed to independently choose their spring (outcome)
testing window because of the large number of schools using norm
referenced tests in these grades regardless of RF. As a result, testing
windows for spring outcomes ranged from mid-February to late-April. In
addition, some districts chose different time point norms (i.e.,
mid-year versus spring norms). More importantly, the testing window did
not always relate in a uniform way to the choice of norming time period
across districts and campuses. That is, assessments administered at
similar points in time were not necessarily referenced to the same
norming tables. In addition, some districts self-scored (i.e., they did
not send data to the publisher for scoring). In some instances, these
districts applied local norms instead of national norms to scaled
scores, or converted scaled scores to NPRs in a manner that was
inconsistent across different test forms. To address these equivalency
issues, this evaluation used the scaled scores for each test to anchor
performance to the 40^th^ NPR for the *spring* norms for each test. That
is, for each test (ITBS, *Logramos*, SAT-10, and *Aprenda*), the scaled
score which corresponded to the 40^th^ NPR for the spring norming period
for each grade was identified (these scaled score values are listed in
Table SO1). In Table SO1, it can be seen that the metric for the scaled
scores is test-specific. That is, the scaled scores equivalent to a
40^th^ NPR for any given grade differ across the Riverside tests (ITBS &
*Logramos*) and the Harcourt tests (SAT-10 & *Aprenda*). However, each
publisher has constructed their developmental scale such that scores on
these scales have the desirable property of being comparable across
semesters and across grades. For example, a student getting a scaled
score of 146 on the ITBS in the fall of Grade 1 is reading at the same
level as a student who gets a 146 on the ITBS in the spring of Grade 1.
Details about the development of the scaled scores for each test can be
found in the respective publishers' technical manuals.

The developmental scales referenced in Table SO1 relate directly to the
NPRs for each grade in the spring semester. That is, the publishers use
the scaled scores from their developmental scales to establish the NPRs
for each grade and semester. Thus, using the scale-score cut-offs in
Table SO1 implies that the proficiency standard is always interpretable
as the 40^th^ NPR in the spring semester for a given grade, regardless
of the grade, district, test form, or time of test administration. For
the purpose of this evaluation, NPRs for all grade 1 and 2 tests were
calculated by the evaluators based on the scaled score that was provided
by the publisher (for centrally scored tests) or the district (for
locally scored tests) and the value in Table SO1 that aligns with the
40^th^ NPR in the spring for the student's grade, test, and language.
The decision to use the spring norm eliminates any advantage of testing
late in the mid-year norming window and holds all students to an
end-of-year performance standard. It is possible that some students
tested at the end of the mid-year window might be found to be at
grade-level using mid-year norms, but found to be not at grade-level
using spring norms, and that these students might have been found to be
at grade-level if tested later in the year. However, any student tested
in the mid-year window and found to be at grade-level relative to the
spring norms would be expected to be found at grade-level if they had
been tested in the spring testing window. Since the objective of Reading
First is that students perform at grade-level at the end of the year,
and since most schools tested in the spring window, we adopted a
consistent criterion tied to performance at the end of the school year.

We assessed the impact of these scoring rules by examining the
percentage of students in each grade and language whose score was
changed from proficient to non-proficient or vice-versa as a result of
using the spring scale score attached to the 40^th^ NPR as the
criterion. In general, fewer than 8% of the students contributing to an
analysis had their scores reclassified, and for English outcomes, the
percentage of students whose scores were reclassified was 1% to 4%.

Harcourt released a new version of their Spanish assessment, *Aprenda 3*
in 2007. Using the conversion tables provided by the publisher, the
scale scores for *Aprenda* and *Aprenda 2* were adjusted to be
equivalent to *Aprenda 3*. The spring 40^th^ NPR for *Aprenda 3* was
then applied to all versions. A similar process was applied to all
*Logramos* scores when the publisher released the new version --
*Logramos 2* -- in 2007.

**Table SO1: Scaled scores for the spring 40^th^ NPR for first and
second grade assessments**

  -------------------- ---------- ---------- ---------------- ------------
  Language             English               Spanish          

  Assessment           ITBS       SAT-10     *Logramos2*      *Aprenda 3*

  First Grade          146        542        157              530

  Second Grade         164        586        173              548
  -------------------- ---------- ---------- ---------------- ------------

[]{.mark}

In third grade, in Texas, students are afforded multiple opportunities
to complete the TAKS assessment. Students who fail the first assessment
are administered a second assessment approximately two months later, and
those who fail the second assessment are administered a third assessment
after attending summer school. Because a student is considered, by the
state, to be proficient if they pass any of the three attempts, this
evaluation considered a student proficient if the student scored above
the state-determined passing standard by the third assessment. In
addition, the passing standard on the TAKS changed from spring 2004 to
spring 2005. This change complicates the evaluation of Reading First
because the criterion for third grade proficiency was made more
difficult in the second year of Reading First. Because the passing
standard is based on the underlying scaled score distribution of the
TAKS, it was possible to define proficiency in 2003-2004 using the new
proficiency standard. Although application of the new standard to the
2003-2004 data will undoubtedly lower the proficiency levels of some
schools for the 2003-2004 year relative to what was reported for those
schools in 2003-2004, the failure to use a consistent standard across
years could mask changes in student performance due to RF. Thus, for the
sake of the current report, the new proficiency standard (scaled score =
2100) was applied to all years of data. Given this decision, the percent
proficient is defined to be the number of students who scored above 2100
on the TAKS divided by the total number of students who took the TAKS.
Each student is counted only once in determining the percent proficient.

[**Benchmark** (**Diagnostic) Assessments**]{.underline}

***Benchmark Measures.*** Reading First in Texas does not require the
administration of one standard benchmark assessment or the use of a
common vendor (provider of electronic data capturing services) across
all RF campuses. Districts and campuses are free to choose any
combination of assessments published by the Texas Education Agency
Commissioner's List. As such, not all RF campuses choose to administer
the same assessment, or to use the same vendors when selecting
assessments. However, the vast majority of the RF campuses in the state
do use the TPRI and *Tejas LEE* as their benchmark assessment.
Specifically, in the 2004-2005 to 2006-2007 school years, all but two
campuses used these assessments, with the remaining two campuses using
the DIBELS/VIP and GRADE. For the purposes of this report, analyses of
benchmark data were completed using those campuses with TPRI and/or
*Tejas LEE* data. The specific assessment used (TPRI or *Tejas LEE*) was
determined by the student's primary literacy instruction (English or
Spanish). Decisions regarding the language of instruction for each
student were made at the district/campus level.

***Definition of Proficiency for Benchmark Measures.*** In all grades
and both languages, the proficiency criteria followed the
recommendations of the developers of the TPRI and *Tejas LEE*.
Specifically, a student was considered to be on grade level within a
specific skill domain if the student scored at or above the
Developed/*Desarollado* level on [all]{.underline} required tasks within
that skill domain at the end of the school year. The domains assessed in
Kindergarten and first grade include Phonological Awareness (PA),
Graphophonemic Knowledge (GK), and Comprehension (CO). The domains
assessed in second and third grade include Graphophonemic Knowledge
(GK), and Comprehension (CO).

**[Analyses]{.underline}**

***Outcomes Measures*.** The outcome performance analyses examined the
percentage of students at each campus who met the proficiency criteria
for their grade level. Analyses for Kindergarten included end of year
outcomes from spring 2005 to 2007 and examined overall performance
(Total Reading) as determined by proficiency in all three domains
assessed (PA, GK, and CO). While scores were requested in the first year
of the program (2004), too few comparison campuses were administering
the assessment at this time, and relatively few of those administering
the assessment submitted data for the evaluation. As a result, the
analysis of Kindergarten outcome performance encompass years 2-4.

For Grades 1 through 3, analyses included outcomes from spring 2004 to
2007. In first and second grade, the Total Reading Score from the
standardized assessments (SAT10/Aprenda, ITBS/Logramos) was analyzed as
well as the two subtests included in the composite -- Reading
Comprehension and Word Reading/Vocabulary. In third grade, the Total
Reading Score from the state TAKS assessment was analyzed. For all three
grades, analyses were conducted separately by language of assessment
(English or Spanish). Table SO2 below outlines the subtests examined for
each grade and language.

**Table SO2: Student Outcome Performance Scores by Language and Grade**

***Benchmark Measures.*** The benchmark performance analyses examined
the percentage of students at each campus who met the proficiency
criteria for each skill domain for their grade level. Analyses for
Kindergarten and first grade included outcomes from 2005-2007 and
examined performance in the Phonological Awareness (PA), Graphophonemic
Knowledge (GK), and Comprehension (CO) domains separately. Analyses for
second and third grade also included outcomes from 2005-2007 and
examined performance in the Graphophonemic Knowledge (GK), and
Comprehension (CO) domains.

The state evaluation originally outlined the collection and analysis of
outcome data, and did not include the collection or analysis of
diagnostic assessment data. However, in year 2 of RF (2004-2005), the
responsibilities of this external evaluator were modified to include
some aspects of internal evaluation. As such, the evaluation plan was
altered to include collection of benchmark data for formative and
technical assistance. This data is now being presented in the evaluation
report to provide additional end of year performance information. The
analysis of benchmark data included in this report encompass years 2-4
of RF (spring 2005 to 2007). For all grades, analyses were conducted
separately by language of assessment (English or Spanish). Table SO3
below outlines the subtests examined for each grade and language.

**Table SO3: Student Benchmark Performance Scores by Language and
Grade**

***All Analyses.*** Multilevel logistic regression models of students
within campuses were examined for each grade and language. Specifically,
the models allowed for determination of:

1\) **funding differences in average level of performance** across RF
and comparison campuses at the end of year 4 (spring 2007) (no
significant differences indicate that campuses in RF and Comparison
groups are performing at the same level, on average, in the spring of
2007, and significant differences indicate that campuses in RF and
Comparison groups are performing at the different levels, on average, in
the spring of 2007); and

2\) **funding differences in the average rate of change** **over time**
across RF and comparison campuses (no differences indicate that campuses
in RF and Comparison groups are changing at the same rate, on average,
over time, and significant differences indicates that there is
variability in the rate of change across campuses over time, on average,
as a function of years of RF funding).

The primary outcome of interest in Reading First is student achievement.
However, in the context of Reading First, student achievement is
measured on a continuum, but acted upon based on dichotomous decisions
regarding proficiency. That is, for each grade a criterion of
proficiency in reading is established and each child's achievement is
measurement against that criterion and judged to be either proficient or
not proficient. In turn, these decisions are accumulated at the school
level to determine the number and percentage of students that are
proficient in a given grade in a given school. These school-level
statistics must be further accumulated across schools in order to
estimate the percent of students who are proficient at Reading First
campuses and at comparison campuses.

The percent proficient was compared across campuses as a function of
years of RF funding (i.e., 1, 2, 3 or 4 years of RF funding or
comparison -- 0 years of funding) using a multi-level analysis designed
for dichotomous outcomes. In these analyses, the outcome for each
student is a score of 0 or 1 depending on the student's proficiency
status, with "1" indicating that the student met the proficiency
standard and "0" indicating that they did not. The multi-level analysis
took into account the nesting of students within campuses, and was
carried out through the computer program MPlus (Detailed model
statistics for each set of analyses are provided in Appendix A). For all
grades, analyses were conducted separately by language of assessment
(English or Spanish). Briefly, the models were set up in a manner that
compared outcomes in 2005-2006 for the RF-funded groups individually to
the comparison group, and also compared the average of the RF-funded
groups to the comparison group.

***Comparison Campuses.*** A comparison group of non-funded campuses is
included in the evaluation to provide a comparison set of campuses that
did not participate in RF, but were similar to RF campuses at the onset
of RF. Comparison campuses included:

1)  randomly selected campuses from eligible LEAs that were eligible for
    RF funding at the onset, but not awarded funding; and

2)  campuses in funded LEAs that were barely below the eligibility
    cut-off, and therefore not included in the RF program.

Analyses were conducted in the first RF evaluation report indicating
that there were no significant differences baseline differences between
RF and funded campuses on the standardized outcome assessments examined
in this report. As such, these analyses will not be represented again in
the current report.

**[Performance Analyses Summary]{.underline}**

**[English]{.underline}**

[Kindergarten]{.underline}

In Kindergarten, RF campuses showed higher performance scores, on
average, on English Total Reading than comparison campuses at the end of
year 4. Examination of the component domains skills that comprise the
Total Reading score (benchmark domains) indicated that performance
differences between these groups are likely due to higher average scores
at RF campuses in English Phonological Awareness and Graphophonemic
Knowledge. There were no significant performance differences between RF
and comparison campuses on Listening Comprehension. Overall, it appears
that RF is having a significant impact on Kindergarten English
performance in the domains of PA and GK.

Approximately 2/5 of the students at RF campuses, on average, assessed
in English are proficient in all three skills domains upon exiting
Kindergarten (35-42%). The vast majority of the students being
instructed in English are exiting Kindergarten in RF proficient in
English GK (92-03%) (letter naming and sound identification), and about
1/2 of the students are proficient in PA (50-57%). Between 56-63% of
students, on average are exiting Kindergarten with proficiency in
English Listening Comprehension. Based on these findings, GK and CO are
areas that deserve additional attention on RF campuses.

[First Grade]{.underline}

In first grade, students being instructed in English at RF campuses, on
average, are performing at levels on the outcome assessment comparable
to Comparison campuses and on average, performance levels of campuses
(RF and CO) are declining over time (although RF declines at slightly
slower rates than comparison c campuses). The breakdown of English Total
Reading Scores into component skills indicates that students are
performing at higher levels in English Reading Comprehension than
English Word/Reading/Vocabulary. In fact, performance on the Reading
Comprehension component of the outcome assessment indicates that RF
students are exiting first grade at levels that are only slightly lower
than national norms.

First grade benchmark data analyses indicate that the majority of
students at RF campuses, on average, are exiting first grade proficient
in each of the domains assessed (PA = 69-74%, GK = 83-86%, and CO =
69-76). In addition, Students from RF campuses, on average, are
performing at higher levels than comparison campuses in PA and GK, and
both RF and CO show relatively stable growth over time. Benchmark
comprehension performance does not significantly differ between RF and
comparison campuses and performance tends to decline over time.

It is interesting that results for comprehension across the outcome and
benchmark measures show different patterns of results. Most likely,
these results are a reflection of the different focus of the assessments
-- one being a national normed assessment and the other being an
assessment focusing on assessment to guide instruction. Furthermore, the
reliability and validity of the comprehension assessments differs in
that the standardized assessment includes many more items and is a more
stable and thorough measure of comprehension than is the benchmark
assessment. The benchmark assessment also includes questions directed
specifically at vocabulary, whereas vocabulary is assessed in the
outcome measure through the Word Reading/Vocabulary subtest. Given that
the two areas where lower performance levels are noted are those that
include a vocabulary component, it may be that vocabulary performance is
lowering these performance scores. Regardless, it is apparent that in
the domains of PA and GK, at the end of year 4, RF campuses are
performing at relatively high levels (high percent proficient) and at
levels higher than those of the comparison campuses. Thus, it seems as
if RF is positively impacting English performance, at least in the areas
of early reading in first grade. In addition, it is also apparent that
reading comprehension and likely vocabulary are two areas that deserve
additional attention on RF campuses.

[Second Grade]{.underline}

In second grade, students being instructed in English at RF campuses, on
average, are performing at levels on the outcome assessment comparable
to Comparison campuses and on average, performance levels of campuses
(RF and CO) are declining over time (although RF declines at slightly
slower rates than comparison c campuses). The breakdown of English Total
Reading Scores into component skills indicates that students are
performing at higher levels in English Reading Comprehension than
English Word/Reading/Vocabulary. In fact, performance on the Reading
Comprehension component of the outcome assessment indicates that RF
students are exiting first grade at levels that are slightly lower than
national norms. However, comparison of second grade performance to first
grade indicates that, on average, at both RF and comparison campuses,
percent proficient decrease from the end of first to the end of second
grade in both comprehension and word reading/vocabulary.

Second grade benchmark data analyses indicate that students from RF
campuses, on average, are performing at higher levels than comparison
campuses in GK and that performance has been increasing over time.
Benchmark comprehension performance does not differ between RF and
comparison campuses, and both groups show declines in performance over
time.

It is encouraging that performance in the GK domain shows increases in
performance as this is an area where significant PD was provided in the
past year to year and a half of RF. Thus, it is reasonable to suggest
that the additional focus on GK may be a catalyst for this improved
performance and that RF activities may be positively impacting English
GK performance in second grade. In addition, it is apparent that second
grade reading comprehension and likely vocabulary, are two areas that
deserve additional attention on RF campuses.

[Third Grade]{.underline}

In third grade, students being instructed in English at RF campuses, on
average, are performing at levels (88%-91%) on the outcome assessment
comparable to Comparison campuses (92%) as well as to the state average
(89%). On average, performance levels of campuses (RF and CO) are
increasing over time (although the rate of change is very small). It
must be noted that these proficiency rates cannot be directly compared
to those seen in first and second grade. The third grade outcome
assessment is the state mandated, criterion referenced, minimum
proficiency test, whereas in first and second grade, outcomes are
measured using standardized, nationally normed assessments. Furthermore,
because of the nature of the third grade assessment, the proficiency
rates tend to be high overall, resulting in a ceiling effect that leaves
very little variability to be explained across campuses.

Analyses of third grade benchmark data indicate no significant
differences in GK performance between RF and comparison campuses in GK
although all campuses, on average showed increased performance over
time. Reading comprehension (benchmark) showed significant performance
differences in favor of the comparison campuses at end of year 4,
although all campuses, on average, showed relative comparable increases
in performance over time.

Taken together, these results indicate that the majority of the
students, in English and Spanish, are meeting proficiency criteria on
the state minimum skills assessment. It is also encouraging that
performance in the GK domain shows increases in performance as
significant PD was provided in this area in the past year to year and a
half of RF. Thus, it is reasonable to suggest that the additional focus
on GK may be a catalyst for this improved performance and that RF
activities may be positively impacting English GK performance in third
grade. However, it is apparent that third grade spelling is an area of
needed continued improvement, as does reading comprehension, although to
a lesser extent.

**[Spanish]{.underline}**

In all grades there were few to no significant Spanish performance
differences between RF and comparison at the end of year 4 as well as in
rates of growth in proficiency over time on either the standardized
outcome or benchmark assessments. However, approximately 2/3 to 3/4 of
the students being instructed in Spanish are exiting Kindergarten
through Grade 2 proficient in the benchmark skills being assessed.

In third grade, the majority of the students, on average, are meeting
proficiency criteria on the state minimum skills assessment. At the same
time, however, performance on the third grade benchmark is significantly
lower especially in the domain of GK. Regardless, performance has
improved significantly for both RF and comparison campus students over
the course of RF.

**[Limitations]{.underline}**

All results for Spanish must be interpreted with caution as there are
several issues that affect Spanish assessment scores that do not exist
in English. First, it must be noted that the sample of students
instructed in Spanish is not consistent over time. As students become
proficient, they are transitioned into English and no longer instructed
or assessed in Spanish. Because decisions regarding transitioning are
made based on individual student performance, as well as district and/or
campus policies, this transitioning does not occur in a systematic
fashion. As a result, over time, the sample of students being instructed
and assessed in Spanish becomes more densely populated with students who
are performing at lower levels (and hence not transitioning), and new
students who are arriving on campus in higher grade levels. Therefore,
decreases in performance as grade levels increase is not an uncommon
phenomenon and is most likely a reflection of the changing nature of the
sample itself. Second, on the standardized, nationally normed
assessments, the results of the evaluation depend on assumptions about
the distribution of Spanish scores and the appropriateness of the
Spanish national norms for *Logramos* and *Aprenda*. Third, Spanish
performance differences between RF and Comparison campuses depend on
local campus decisions about the language of instruction and the
language of assessment. It is possible that differences reflect
differences in the rate of schools exiting students from Spanish
language instruction, with RF Funded campuses exiting students into
English instruction more quickly, or exiting students who are doing well
in Spanish at higher frequency.

An additional complication in designing and conducting this evaluation
was the recruitment, selection, and monitoring of the comparison
campuses, as well as the "bleeding" of the treatment to the comparison
campuses. At present, the Comparison group has been compared to the RF
funded groups without regard for the demographic composition of the RF
funded groups and the Comparison groups. It is possible that analyses
which adjust for student demographic characteristics, will allow for a
better basis for comparing RF Funded and Comparison schools,
particularly as multiple years of data are examined and attrition of
campuses within the Comparison sample is taken into account. However, we
have not attempted to use models of this type at this time because a
fundamental tenet of RF is that all students will be held to the same
accountability standards. Still, because student performance can vary
widely across campuses serving different subgroups of students, changes
in the demographic composition of study samples over time can
significantly impact estimates of passing rates, such that aggregate
passing rates can decline even though passing rates in all individual
subgroups have improved.

In addition, differences between RF and comparison campuses are likely
diminished due to the implementation of many RF practices and at the
comparison campuses. As RF has progressed, and as RF campuses strive
toward independent sustainability, professional development and
practices within RF LEAs are being provided and implemented at all
campuses, not just RF campuses. In addition, regional educational
centers have become more involved in RF professional development and
dissemination of RF PD and practices over time. Since the regional
centers service primarily non-RF campuses, the likelihood that non-RF
campuses will begin to appear more like RF campuses increases
significantly.

**[Future Directions]{.underline}**

Examination of the student performance outcome and benchmark data
illustrates highest needs in the areas of English vocabulary/oral
language (all grades), higher level English graphophonemic knowledge
(grades 2 and 3) and English listening/reading comprehension skills
(grade K-3). In addition, Spanish performance in most areas of skill
would also benefit from focused and systematic attention to PD and
instruction in future RF years.

Future analyses of RF performance will focus on identifying the
characteristics associated with successful RF campuses, such that
"profiles" of successful and less successful RF campuses will be
examined.

**Performance Analyses**

Not all campuses in RF serve all grade levels, and not all campuses test
in both English and Spanish. As such, the actual sample numbers used in
each set of analyses is outlined in tables presented in each section. In
each grade level section below, results are presented in a series of
tables and graphs that show: 1) the number of campuses and students
included in each set of analyses (table); 2) the percent proficient on
the grade level outcome assessment by year of funding and year of RF
(table and graph); and 3) the percent proficient on the grade level end
of year benchmark assessment by years of funding, year of RF and skill
domain (table and graph).

**[Kindergarten]{.underline}**

***English Outcome Performance.*** Table SO4 presents the campus and
student samples included in the Kindergarten outcome and benchmark
analyses by years of funding and year of RF (time). Statistical results
for comparison of kindergarten Total Reading (Table SO5) shows
significant differences in performance across RF campuses by funding
year and comparison campuses in the spring of 2007. All RF funded
campuses (2-4 years of funding) are performing at higher levels in the
spring of 2007 than Comparison campuses on English overall outcomes
(campuses with only 1 year of RF funding in the spring of 2007 were not
included in the analyses as the sample number was low too low (n \< 10)
and change over time was not estimable with only one time point). In
addition, all RF funded campuses (2-4 years of funding), showed more
growth from year 2 to year 4 of RF than comparison campuses on the
overall outcome assessment. In fact, comparison campuses showed declines
in overall performance across this time period while RF funded campuses
show increased performance levels (See Graph KE1).

It is important to note that the Total Reading Composite score for
Kindergarten is fairly stringent in that a student is considered to be
proficient only if they score at passing levels on all three domains
examined (PA, GK and CO). Because the same assessment is used in
Kindergarten for the end of year outcome and benchmark assessments,
analyses of benchmark performance within each skill domain (below)
included in the Total Reading Composite allows for further examination
of performance.

***English Benchmark Performance.*** Table SO4 presents the campus and
student samples included in the Kindergarten outcome and benchmark
analyses by years of funding and year of RF (time). Statistical results
for comparison of kindergarten end of year benchmark performance (Table
SO6) shows significant differences in performance across RF campuses by
funding year and comparison campuses in the spring of 2007. All RF
funded campuses (2-4 years of funding) are performing at higher levels
in the spring of 2007 than Comparison campuses on English benchmark
phonological awareness (PA) and graphophonemic knowledge (GK) (campuses
with only 1 year of RF funding in the spring of 2007 were not included
in the analyses as the sample number was low too low (n \< 10) and
change over time is not estimable with only one time point). In
addition, all RF funded campuses (2-4 years of funding), showed more
growth from year 2 to year 4 of RF than comparison campuses on benchmark
PA and GK assessments. In fact, comparison campuses showed average
declines in PA and GK performance across this time period while RF
funded campuses showed, on average, increased performance levels.
Performance on the benchmark comprehension (CO) assessment showed no
significant differences in spring 2007 performance levels or change in
performance over time (See Graph KE2).

Examination of the percent proficient in each skill benchmark category
indicates that while RF kindergartners are performing at higher overall
levels and showing more growth over time, on average, than comparison
campuses, there is still room for improvement on some skills. The
majority (92-93%) of the kindergarten students, on average, are
mastering English GK (letter names and sounds) prior to exiting
Kindergarten. To score proficient in the PA domain in Kindergarten,
students must master Kindergarten level rhyming, blending onset rime,
blending three phoneme words, and deleting initial and final sounds in
one syllable words. Therefore, while it is encouraging that a little
over half (50-57%) of the RF sample being instructed and tested in
English exited Kindergarten with mastery of these beginning level PA
skills, this is still being an area of additional need. English
Listening Comprehension (CO) performance in Kindergarten is also an area
of additional need as 56-63% of the RF students, on average, are showing
comprehension of text read aloud to them.

It is important to note the general trend of increased proficiency by
years of RF funding in Kindergarten PA and CO performance. While not
statistically significant, percent proficient in PA increases
incrementally with years of RF funding such that campuses with 1 year
show 50% proficient while campuses with 4 years show 57% proficient.
Similarly, percent proficient in CO increases incrementally with years
of RF funding such that campuses with 1 year show 56% proficient while
campuses with 4 years show 63% proficient.

**Table SO4. Kindergarten English Sample: By years of funding (0-4) and
funding year (2-4)**

***\*** Campuses with 1 year of funding are not included in analyses of
slopes as there is no slope to be estimated.*

***\*\*** Campuses with 1 year of funding were not included in the
analyses due to the low sample size -- n \< 10.*

Table SO5. Kindergarten English Analyses: Overall Outcomes: By years of
funding (0-4) and funding year (2-4)

+--------------------+-------+-------+-------+-----------+-----------+
| *Years of RF       | *Ove  |       |       | >         | > **      |
| Funding*           | rall* |       |       | ***Spring | *Slope*** |
|                    |       |       |       | > 2007*** |           |
+====================+=======+=======+=======+===========+===========+
| *Year of RF*       | *2*   | *3*   | *4*   |           |           |
+--------------------+-------+-------+-------+-----------+-----------+
| Control (C)        | 0.36  | 0.42  | 0.29  |           | **D**     |
+--------------------+-------+-------+-------+-----------+-----------+
| 4                  | 0.40  | 0.39  | 0.43  | **\> C**  | **I /     |
|                    |       |       |       |           | \>C**     |
+--------------------+-------+-------+-------+-----------+-----------+
| 3                  | 0.37  | 0.39  | 0.42  | **\> C**  | **I /     |
|                    |       |       |       |           | \>C**     |
+--------------------+-------+-------+-------+-----------+-----------+
| 2                  |       | 0.25  | 0.37  | **\> C**  | **I /     |
|                    |       |       |       |           | \>C**     |
+--------------------+-------+-------+-------+-----------+-----------+
| 1\* \*\*           |       |       | 0.35  | **\*\***  | **\***    |
+--------------------+-------+-------+-------+-----------+-----------+

***\*** Campuses with 1 year of funding are not included in analyses of
slopes as there is no slope to be estimated.*

***\*\*** Campuses with 1 year of funding were not included in the
analyses due to the low sample size -- n \< 10.*

*C = Control; I = Increase; D = Decrease; Ns = Non-Significant*

Table SO6. Kindergarten English Analyses: Benchmark Outcomes: By years
of funding (0-4) and funding year (2-4)

<table>
<colgroup>
<col style="width: 12%" />
<col style="width: 5%" />
<col style="width: 5%" />
<col style="width: 5%" />
<col style="width: 6%" />
<col style="width: 6%" />
<col style="width: 5%" />
<col style="width: 5%" />
<col style="width: 5%" />
<col style="width: 6%" />
<col style="width: 6%" />
<col style="width: 5%" />
<col style="width: 5%" />
<col style="width: 5%" />
<col style="width: 6%" />
<col style="width: 6%" />
</colgroup>
<thead>
<tr class="header">
<th><em>Years of RF Funding</em></th>
<th colspan="3"><em>PA</em></th>
<th rowspan="2"><blockquote>
<p><em><strong>Spring 2007</strong></em></p>
</blockquote></th>
<th rowspan="2"><blockquote>
<p><em><strong>Slope</strong></em></p>
</blockquote></th>
<th colspan="3"><em>GK</em></th>
<th rowspan="2"><blockquote>
<p><em><strong>Spring 2007</strong></em></p>
</blockquote></th>
<th rowspan="2"><blockquote>
<p><em><strong>Slope</strong></em></p>
</blockquote></th>
<th colspan="3"><em>CO</em></th>
<th rowspan="2"><blockquote>
<p><em><strong>Spring 2007</strong></em></p>
</blockquote></th>
<th rowspan="2"><blockquote>
<p><em><strong>Slope</strong></em></p>
</blockquote></th>
</tr>
<tr class="odd">
<th><em>Year of RF</em></th>
<th><em>2</em></th>
<th><em>3</em></th>
<th><em>4</em></th>
<th><em>2</em></th>
<th><em>3</em></th>
<th><em>4</em></th>
<th><em>2</em></th>
<th><em>3</em></th>
<th><em>4</em></th>
</tr>
</thead>
<tbody>
<tr class="odd">
<td>Control (C)</td>
<td>0.54</td>
<td>0.57</td>
<td>0.48</td>
<td></td>
<td><strong>D</strong></td>
<td>0.90</td>
<td>0.91</td>
<td>0.87</td>
<td></td>
<td><strong>D</strong></td>
<td>0.55</td>
<td>0.64</td>
<td>0.55</td>
<td></td>
<td><strong>S</strong></td>
</tr>
<tr class="even">
<td>4</td>
<td>0.52</td>
<td>0.53</td>
<td>0.57</td>
<td><strong>&gt; C</strong></td>
<td><strong>I / &gt;C</strong></td>
<td>0.91</td>
<td>0.91</td>
<td>0.92</td>
<td><strong>&gt; C</strong></td>
<td><strong>I / &gt;C</strong></td>
<td>0.61</td>
<td>0.59</td>
<td>0.63</td>
<td><strong>Ns</strong></td>
<td><strong>I/Ns</strong></td>
</tr>
<tr class="odd">
<td>3</td>
<td>0.49</td>
<td>0.54</td>
<td>0.56</td>
<td><strong>&gt; C</strong></td>
<td><strong>I / &gt;C</strong></td>
<td>0.92</td>
<td>0.93</td>
<td>0.93</td>
<td><strong>&gt; C</strong></td>
<td><strong>I / &gt;C</strong></td>
<td>0.61</td>
<td>0.59</td>
<td>0.61</td>
<td><strong>Ns</strong></td>
<td><strong>S/Ns</strong></td>
</tr>
<tr class="even">
<td>2</td>
<td></td>
<td>0.36</td>
<td>0.53</td>
<td><strong>&gt; C</strong></td>
<td><strong>I / &gt;C</strong></td>
<td></td>
<td>0.87</td>
<td>0.92</td>
<td><strong>&gt; C</strong></td>
<td><strong>I / &gt;C</strong></td>
<td></td>
<td>0.53</td>
<td>0.56</td>
<td><strong>Ns</strong></td>
<td><strong>I/Ns</strong></td>
</tr>
<tr class="odd">
<td>1</td>
<td></td>
<td></td>
<td>0.50</td>
<td><strong>**</strong></td>
<td><strong>*</strong></td>
<td></td>
<td></td>
<td>0.93</td>
<td><strong>**</strong></td>
<td><strong>*</strong></td>
<td></td>
<td></td>
<td>0.56</td>
<td><strong>**</strong></td>
<td><strong>*</strong></td>
</tr>
</tbody>
</table>

***\*** Campuses with 1 year of funding are not included in analyses of
slopes as there is no slope to be estimated.*

***\*\*** Campuses with 1 year of funding were not included in the
analyses due to the low sample size -- n \< 10.*

*C = Control; I = Increase; D = Decrease; Ns = Non-Significant*

![](media/image3.wmf){width="4.8180555555555555in"
height="4.372916666666667in"}

![](media/image4.wmf){width="4.767361111111111in"
height="4.436805555555556in"}

***Spanish Outcome Performance.*** Table SO7 presents the campus and
student samples included in the Kindergarten Spanish analyses by years
of funding and year of RF. Statistical results for comparison of
kindergarten outcome performance (Table SO8) show very few significant
differences in performance across RF campuses by funding year and
comparison campuses in the spring of 2007. RF campuses with 3 years of
funding show slightly lower performance levels than comparison campuses,
while all other RF campuses show performance levels comparable to those
of comparison campuses (campuses with only 1 year of RF funding in the
spring of 2007 were not included in the analyses as the sample number
was low too low (n \< 10) and change over time is not estimable with
only one time point). In addition, while campuses, on average, showed
growth over the time period examined, RF campuses with three and four
years of funding showed less growth than comparison campuses on the
overall outcome assessment.

It is important to note that the Total Reading Composite score for
Kindergarten is fairly stringent in that a student is considered to be
proficient only if they score at passing levels on all three domains
examined (PA, GK and CO). Because the same assessment is used in
Kindergarten for the end of year outcome and benchmark assessments,
analyses of benchmark performance within each skill domain (below)
included in the Total Reading Composite allows for further examination
of performance.

***Spanish Benchmark Performance.*** Table SO7 presents the campus and
student samples included in the Kindergarten Spanish analyses by years
of funding and funding year.

Statistical results for comparison of kindergarten Spanish end of year
benchmark performance (Table SO9) also show few significant differences
in performance across RF campuses by funding year and comparison
campuses in the spring of 2007. In general, RF funded campuses are
performing at levels comparable to those of comparison campuses, on
average. In addition, there are few significant differences in growth
over the period of time examined -- especially in the PA and GK domains.
In the CO domain, RF campuses, with 3 and 4 years of funding, on
average, show less growth than comparison campuses over time.

Further examination of the percent proficient in each benchmark skill
category indicates that there are few differences in average performance
levels between kindergarten Spanish performance in RF and comparison
campuses, and all campuses showed significant increases in performance
over time. The average percent proficient for kindergarten Spanish PA
performance in the spring of 2007 across RF campuses was between 95-99%.
This indicates that the vast majority of students assessed in Spanish
exit kindergarten mastering Spanish PA at the kindergarten level,
indicating that the majority of the students are exiting kindergarten
well prepared for the higher level phonological awareness skill
development that occurs in first grade.

While the percent proficient in GK is lower (84-99%), it is important to
keep in mind that Spanish GK in Kindergarten includes the identification
of letter names and sounds as well as single syllable, high frequency
word reading. Therefore, it is very encouraging to see that the majority
of the RF sample being instructed and tested in Spanish are exiting
Kindergarten with a beginning level of word reading skills. Proficiency
in Listening Comprehension, while showing room for additional
improvement, is also encouragingly high in that 68-88% of student on RF
campuses, on average, are passing this portion of the assessment at the
end of Kindergarten.

**Table SO7. Kindergarten Spanish Sample: By years of funding (0-4) and
funding year (2-4)**

***\*** Campuses with 1 year of funding are not included in analyses of
slopes as there is no slope to be estimated.*

***\*\*** Campuses with 1 year of funding were not included in the
analyses due to the low sample size -- n \< 10.*

Table SO8. Kindergarten Spanish Analyses: Overall Outcomes: By years of
funding (0-4) and funding year (2-4)

+--------------------+-------+-------+-------+-----------+-----------+
| *Years of RF       | *Ove  |       |       | >         | > **      |
| Funding*           | rall* |       |       | ***Spring | *Slope*** |
|                    |       |       |       | > 2007*** |           |
+====================+=======+=======+=======+===========+===========+
| *Year of RF*       | *2*   | *3*   | *4*   |           |           |
+--------------------+-------+-------+-------+-----------+-----------+
| Control (C)        | 0.46  | 0.51  | 0.67  |           | **I**     |
+--------------------+-------+-------+-------+-----------+-----------+
| 4                  | 0.53  | 0.53  | 0.66  | **Ns**    | **I /     |
|                    |       |       |       |           | \<C**     |
+--------------------+-------+-------+-------+-----------+-----------+
| 3                  | 0.45  | 0.44  | 0.63  | **\<C**   | **I /     |
|                    |       |       |       |           | \<C**     |
+--------------------+-------+-------+-------+-----------+-----------+
| 2                  |       | 0.49  | 0.68  | **Ns**    | **I/Ns**  |
+--------------------+-------+-------+-------+-----------+-----------+
| 1*\**              |       |       | .88   | *         | ***\****  |
|                    |       |       |       | **\*\**** |           |
+--------------------+-------+-------+-------+-----------+-----------+

***\*** Campuses with 1 year of funding are not included in analyses of
slopes as there is no slope to be estimated.*

***\*\*** Campuses with 1 year of funding were not included in the
analyses due to the low sample size -- n \< 10.*

*C = Control; I = Increase; D = Decrease; Ns = Non-Significant*

Table SO9. Kindergarten Spanish Analyses: Benchmark Outcomes: By years
of funding (0-4) and funding year (2-4)

<table>
<colgroup>
<col style="width: 12%" />
<col style="width: 5%" />
<col style="width: 5%" />
<col style="width: 5%" />
<col style="width: 6%" />
<col style="width: 6%" />
<col style="width: 5%" />
<col style="width: 5%" />
<col style="width: 5%" />
<col style="width: 6%" />
<col style="width: 6%" />
<col style="width: 5%" />
<col style="width: 5%" />
<col style="width: 5%" />
<col style="width: 6%" />
<col style="width: 6%" />
</colgroup>
<thead>
<tr class="header">
<th><em>Years of RF Funding</em></th>
<th colspan="3"><em>PA</em></th>
<th rowspan="2"><blockquote>
<p><em><strong>Spring 2007</strong></em></p>
</blockquote></th>
<th rowspan="2"><blockquote>
<p><em><strong>Slope</strong></em></p>
</blockquote></th>
<th colspan="3"><em>GK</em></th>
<th rowspan="2"><blockquote>
<p><em><strong>Spring 2007</strong></em></p>
</blockquote></th>
<th rowspan="2"><blockquote>
<p><em><strong>Slope</strong></em></p>
</blockquote></th>
<th colspan="3"><em>CO</em></th>
<th rowspan="2"><blockquote>
<p><em><strong>Spring 2007</strong></em></p>
</blockquote></th>
<th rowspan="2"><blockquote>
<p><em><strong>Slope</strong></em></p>
</blockquote></th>
</tr>
<tr class="odd">
<th><em>Year of RF</em></th>
<th><em>2</em></th>
<th><em>3</em></th>
<th><em>4</em></th>
<th><em>2</em></th>
<th><em>3</em></th>
<th><em>4</em></th>
<th><em>2</em></th>
<th><em>3</em></th>
<th><em>4</em></th>
</tr>
</thead>
<tbody>
<tr class="odd">
<td>Control (C)</td>
<td>0.84</td>
<td>0.89</td>
<td>0.95</td>
<td></td>
<td><strong>I</strong></td>
<td>0.68</td>
<td>0.64</td>
<td>0.85</td>
<td></td>
<td><strong>I</strong></td>
<td>0.59</td>
<td>0.68</td>
<td>0.73</td>
<td></td>
<td><strong>I</strong></td>
</tr>
<tr class="even">
<td>4</td>
<td>0.89</td>
<td>0.90</td>
<td>0.96</td>
<td><strong>Ns</strong></td>
<td><strong>I/Ns</strong></td>
<td>0.68</td>
<td>0.70</td>
<td>0.89</td>
<td><strong>&gt;C</strong></td>
<td><strong>I/Ns</strong></td>
<td>0.68</td>
<td>0.66</td>
<td>0.70</td>
<td><strong>Ns</strong></td>
<td><strong>I / &lt;C</strong></td>
</tr>
<tr class="odd">
<td>3</td>
<td>0.86</td>
<td>0.89</td>
<td>0.95</td>
<td><strong>Ns</strong></td>
<td><strong>I/Ns</strong></td>
<td>0.61</td>
<td>0.60</td>
<td>0.86</td>
<td><strong>Ns</strong></td>
<td><strong>I/Ns</strong></td>
<td>0.64</td>
<td>0.62</td>
<td>0.68</td>
<td><strong>&lt;C</strong></td>
<td><strong>I / &lt;C</strong></td>
</tr>
<tr class="even">
<td>2</td>
<td></td>
<td>0.91</td>
<td>0.95</td>
<td><strong>Ns</strong></td>
<td><strong>I/Ns</strong></td>
<td></td>
<td>0.65</td>
<td>0.84</td>
<td><strong>Ns</strong></td>
<td><strong>I/Ns</strong></td>
<td></td>
<td>0.67</td>
<td>0.74</td>
<td><strong>Ns</strong></td>
<td><strong>I/Ns</strong></td>
</tr>
<tr class="odd">
<td>1<em>*</em></td>
<td></td>
<td></td>
<td>.99</td>
<td><em><strong>**</strong></em></td>
<td><em><strong>*</strong></em></td>
<td></td>
<td></td>
<td>.99</td>
<td><em><strong>**</strong></em></td>
<td><em><strong>*</strong></em></td>
<td></td>
<td></td>
<td>.88</td>
<td><em><strong>**</strong></em></td>
<td><em><strong>*</strong></em></td>
</tr>
</tbody>
</table>

***\*** Campuses with 1 year of funding are not included in analyses of
slopes as there is no slope to be estimated.*

***\*\*** Campuses with 1 year of funding were not included in the
analyses due to the low sample size -- n \< 10.*

*C = Control; I = Increase; D = Decrease; Ns = Non-Significant*

![](media/image5.wmf){width="4.8180555555555555in"
height="4.372916666666667in"}

![](media/image6.wmf){width="4.767361111111111in"
height="4.436805555555556in"}

**[First Grade]{.underline}**

***English Outcome Performance.*** Table SO10 presents the campus and
student samples included in the first grade outcome analyses by years of
funding and year of RF. Statistical results for comparison of first
grade outcome performance (Table SO11) show no significant differences
in Total Reading scores across RF campuses by funding year and
comparison campuses in the spring of 2007, as well as no significant
differences in change over time between RF and comparison campuses.

Examination of the two separate components of the Total Reading score
showed similar results for Word Reading/Vocabulary. However, analyses of
the Comprehension component showed that RF funded campuses (2-4 years of
funding) are performing at higher levels in the spring of 2007 than
Comparison campuses. While there are no significant differences, on
average, across RF and comparison campuses, in terms of growth over
time, and while all campuses, on average, show declines in standardized
outcome scores, the RF campuses tend to decline at slightly lower rates
than comparison campuses.

Examination of the average RF campus performance in spring of 2007
indicates that English performance is relatively comparable to national
norms in Comprehension in that, the average percent proficient at the
end of year 4 is between 51-58% (60% = national average). Performance in
Word Reading/Vocabulary is lower than national averages with 37-41%
performing at or above the 40^th^ percentile, on average. It is
important to note that on these outcome assessments, the Word
Reading/Vocabulary subtest is a combination of skills in first grade --
including decoding and oral language. Therefore, the influence of
decoding versus vocabulary on overall performance cannot be determined.

***English Benchmark Performance.*** Table SO12 presents the campus and
student samples included in the first grade of benchmark performance
analyses by years of funding and year of RF.

Unlike the standardized outcome results, statistical results for
comparison of first grade end of year benchmark performance (Table SO13)
show significant differences in performance across RF campuses by
funding year and comparison campuses in the spring of 2007. All RF
funded campuses (2-4 years of funding) are performing at higher levels
in the spring of 2007 than Comparison campuses on English benchmark
Phonological Awareness (PA) and Graphophonemic Knowledge (GK) (campuses
with only 1 year of RF funding in the spring of 2007 were not included
in the analyses as the sample number was low too low (n \< 10) and
change over time is not estimable with only one time point). While
comparison campuses, on average, showed declines in PA performance over
time, RF campuses showed relatively stable performance in PA over time.
Growth in GK performance over time for both comparison and RF campuses,
on average, was relatively stable, whereas growth in CO, on average for
all campuses declines over time.

Further examination of the percent proficient in each skill benchmark
category indicates that while RF campuses are performing at higher
overall levels in first grade PA (69-74%) and GK (83 -86%) than
comparison campuses, there is still room for improvement in these
skills. It is apparent that, on average, the majority of RF first
graders are exiting the year with mastery of expected English GK
(initial, medial and final consonant substitution, and initial and final
sound blending), and PA (first grade level blending multi-phoneme words,
and deleting initial and final sounds) skills. Benchmark comprehension
performance in first grade also indicates that the majority of the RF
students (69-76%) are showing comprehension of the text they are
reading.

**Table SO10. First Grade English Outcome Sample: By years of funding
(0-4) and funding year (2-4)**

***\*** Campuses with 1 year of funding are not included in analyses of
slopes as there is no slope to be estimated.*

***\*\*** Campuses with 1 year of funding were not included in the
analyses due to the low sample size -- n \< 10.*

**Table SO11. First Grade English Outcome Analyses: Overall Outcomes: By
years of funding (0-4) and funding year (2-4)**

***\*** Campuses with 1 year of funding are not included in analyses of
slopes as there is no slope to be estimated.*

***\*\*** Campuses with 1 year of funding were not included in the
analyses due to the low sample size -- n \< 10.*

*C = Control; I = Increase; D = Decrease; Ns = Non-Significant*

**Table SO12. First Grade English Benchmark Sample: By years of funding
(0-4) and funding year (2-4)**

***\*** Campuses with 1 year of funding are not included in analyses of
slopes as there is no slope to be estimated.*

***\*\*** Campuses with 1 year of funding were not included in the
analyses due to the low sample size -- n \< 10.*

**Table SO13. First Grade English Benchmark Analyses: Benchmark
Outcomes: By years of funding (0-4) and funding year (2-4)**

***\*** Campuses with 1 year of funding are not included in analyses of
slopes as there is no slope to be estimated.*

***\*\*** Campuses with 1 year of funding were not included in the
analyses due to the low sample size -- n \< 10.*

*C = Control; I = Increase; D = Decrease; Ns = Non-Significant*

![](media/image7.wmf){width="4.748611111111111in"
height="4.372916666666667in"}

![](media/image8.wmf){width="4.767361111111111in"
height="4.436805555555556in"}

***Spanish Outcome Performance.*** Table SO14 presents the campus and
student samples included in the Spanish first grade outcome analyses by
years of funding and year of RF. Statistical results for comparison of
first grade Spanish outcome performance (Table SO15) show no significant
differences in Total Reading scores across RF campuses by funding year
and comparison campuses in the spring of 2007, as well as no significant
differences in change over time between RF and comparison campuses.
Examination of the two separate components of the Total Reading score
showed similar results for Word Reading/Vocabulary as well as
Comprehension.

While there are no significant differences, on average, across RF and
comparison campuses, in terms of growth over time, comparison campuses
tended to chow declines in growth over time while RF campuses, on
average, showed stable or increased performance over time.

Examination of the average RF campus performance indicates that Spanish
performance is significantly higher than national norms with 69-74%, on
average, performing at or above the 40^th^ percentile. Spanish outcome
performance levels must be interpreted with caution, as the sample in
Texas is most likely a sub-sample of the norming sample for these
assessments. Meaning, that the norming sample consists of students whose
native language is Spanish, regardless of language of instruction. In
Texas, the students in the Spanish assessment sample are primarily those
who are receiving instruction in Spanish, Therefore, it is possible that
these higher performance levels are a result of the differences between
the two samples. Regardless, the comparison to national norms is still
useful as it provides a base population gauge against which to compare
these students.

***Spanish Benchmark Performance.*** Table SO16 presents the campus and
student samples included in the first grade Spanish benchmark
performance analyses by years of funding and year of RF. Unlike the
standardized outcome results, statistical results for comparison of
first grade end of year benchmark performance (Table SO17) show
significant differences in performance across RF campuses by funding
year and comparison campuses in the spring of 2007 in PA, GK and CO.
Specifically, RF campuses with 2 and 4 years of funding, on average,
show higher levels of first grade Spanish PA, GK and CO performance than
comparison campuses. Interestingly, the same pattern is not found for RF
campuses with 3 years of funding.

While comparison campuses, on average, showed declines in PA performance
over time, RF campuses showed relatively stable performance in PA over
time. Growth in GK and CO performance over time for both comparison and
RF campuses, on average, was relatively stable.

Examination of the percent proficient in each skill benchmark category
indicates that RF campuses are performing at higher overall levels in
first grade PA (71-89%) and GK (93-96%) making it apparent that, on
average, the majority of RF first graders are exiting the year with
mastery of expected English GK (initial, medial and final consonant
substitution, and initial and final sound blending), and PA (first grade
level blending multi-phoneme words, and deleting initial and final
sounds) skills. Benchmark comprehension performance in first grade also
indicates that the majority of the RF students (72-81%) are showing
comprehension of the text they are reading.

**Table SO14. First Grade Spanish Outcome Sample: By years of funding
(0-4) and funding year (2-4)**

***\*** Campuses with 1 year of funding are not included in analyses of
slopes as there is no slope to be estimated.*

***\*\*** Campuses with 1 year of funding were not included in the
analyses due to the low sample size -- n \< 10.*

**Table SO15. First Grade Spanish Outcome Analyses: Overall Outcomes: By
years of funding (0-4) and funding year (2-4)**

***\*** Campuses with 1 year of funding are not included in analyses of
slopes as there is no slope to be estimated.*

***\*\*** Campuses with 1 year of funding were not included in the
analyses due to the low sample size -- n \< 10.*

*C = Control; I = Increase; D = Decrease; Ns = Non-Significant*

**Table SO16. First Grade Spanish Benchmark Sample: By years of funding
(0-4) and funding year (2-4)**

***\*** Campuses with 1 year of funding are not included in analyses of
slopes as there is no slope to be estimated.*

***\*\*** Campuses with 1 year of funding were not included in the
analyses due to the low sample size -- n \< 10.*

**Table SO17. First Grade Spanish Benchmark Analyses: Benchmark
Outcomes: By years of funding (0-4) and funding year (2-4)**

***\*** Campuses with 1 year of funding are not included in analyses of
slopes as there is no slope to be estimated.*

***\*\*** Campuses with 1 year of funding were not included in the
analyses due to the low sample size -- n \< 10.*

*C = Control; I = Increase; D = Decrease; Ns = Non-Significant*

![](media/image9.wmf){width="4.8180555555555555in"
height="4.372916666666667in"}

![](media/image10.wmf){width="4.767361111111111in"
height="4.436805555555556in"}

**[Second Grade]{.underline}**

***English Outcome Performance.*** Table SO18 presents the campus and
student samples included in the second grade outcome analyses by years
of funding and year of RF. Statistical results for comparison of second
grade outcome performance (Table SO19) show no significant differences
in Total Reading scores across RF campuses by funding year and
comparison campuses in the spring of 2007, as well as no significant
differences in change over time between RF and comparison campuses.
Examination of the two separate components of the Total Reading score
showed similar results for the Word Reading/Vocabulary and Comprehension
components.

While there are no significant differences, on average, across RF and
comparison campuses, in terms of growth over time, and while campuses,
on average, showed declines in standardized outcome scores, the RF
campuses tend to decline at slightly lower rates than comparison
campuses. Examination of the average RF campus performance in spring of
2007 indicates that English performance is lower than that of national
norms in that the average percent proficient at the end of year 4 is
between 44-46% (60% = national average). In terms of the components of
the Total Reading score, Comprehension shows higher proficiency levels
(47-53%) than Word Reading/Vocabulary (34-35%). It is important to note
that on these outcome assessments, the Word Reading/Vocabulary subtest
is a combination of skills in second grade -- including decoding and
oral language. Therefore, while the influence of decoding versus
vocabulary on overall performance cannot specifically be determined,
since comprehension is higher, it is most likely that the lower word
reading/vocabulary scores are due to significantly lower levels of
vocabulary.

***English Benchmark Performance.*** Table SO20 presents the campus and
student samples included in the second grade benchmark performance
analyses by years of funding and year of RF.

Unlike the standardized outcome results, statistical results for
comparison of second grade end of year benchmark performance (Table
SO21) show significant differences in performance across RF campuses by
funding year and comparison campuses in the spring of 2007. RF funded
campuses with 3-4 years of funding are performing at higher levels in
the spring of 2007 than Comparison campuses on English benchmark
Graphophonemic Knowledge (GK) and Comprehension (CO). RF funded campuses
with 2 years of funding are performing at lower levels in the spring of
2007 than Comparison campuses on English benchmark Graphophonemic
Knowledge (GK) but higher levels on Comprehension (CO) (campuses with
only 1 year of RF funding in the spring of 2007 were not included in the
analyses as the sample number was low too low (n \< 10) and change over
time is not estimable with only one time point). While there were no
statistically significant differences in growth over time between RF
campuses and comparison campuses, on average, second grade GK skills
improved over time whereas CO skills declined over time.

Examination of the percent proficient in each skill benchmark category
indicates that, on average, about half (31-57%) of the second grade
students, are exiting the year with mastery of expected English GK
(spelling) skills, and a little less than 2/3 (50-66%) are exiting with
the expected levels of comprehension skills.

***Spanish Outcome Performance.*** Table SO22 presents the campus and
student samples included in the Spanish second grade outcome analyses by
years of funding and year of RF. Statistical results for comparison of
second grade Spanish outcome performance (Table SO23) show no
significant differences in Total Reading scores across RF campuses by
funding year and comparison campuses in the spring of 2007, as well as
no significant differences in change over time between RF and comparison
campuses. Examination of the two separate components of the Total
Reading score showed similar results for the Comprehension component.
For the Word Reading/Vocabulary component, RF campuses with 2 and 4
years of funding, on average, were performing at higher levels than
comparison campuses in the spring of 2007, and showed less decline in
scores over time than comparison campuses.

Examination of the average RF campus percent proficient indicates that
Spanish performance is significantly higher than national norms with
64-91%, on average, performing at or above the 40^th^ percentile on
Total Reading in Spanish. Spanish outcome performance levels must be
interpreted with caution, as the sample in Texas is most likely a
sub-sample of the norming sample for these assessments. Meaning, that
the norming sample consists of students whose native language is
Spanish, regardless of language of instruction. In Texas, the students
in the Spanish assessment sample are primarily those who are receiving
instruction in Spanish, Therefore, it is possible that these higher
performance levels are a result of the differences between the two
samples. Regardless, the comparison to national norms is still useful as
it provides a base population gauge against which to compare these
students.

***Spanish Benchmark Performance.*** Table SO24 presents the campus and
student samples included in the second grade Spanish benchmark
performance analyses by years of funding and year of RF.

Similar to the standardized outcome results, statistical results for
comparison of second grade end of year benchmark performance (Table
SO25) showed few or no significant differences in performance across RF
campuses by funding year and comparison campuses in the spring of 2007
in GK and CO. While comparison campuses, on average, showed increases in
GK and CO performance over time, RF campuses showed relatively stable
performance in these skills over time (3-4 year funded campuses).

Examination of the percent proficient in each benchmark skill category
indicates a little less than 2/3 of RF second graders (58-66%) at
campuses with 3-4 years of funding are exiting the year with mastery of
expected English GK skills (spelling), and the majority are exiting with
the expected level of Comprehension skills (76-77%). RF campuses with 2
years of funding show significantly different patterns than those with
3-4 years of funding; however the results are not as stable in that
there is a significant level of variability and error in the measurement
of these estimates given the small number of campuses included in this
group. For those purpose, the 2 year campus results are not discussed in
detail.

**Table SO18. Second Grade English Outcome Sample: By years of funding
(0-4) and funding year (2-4)**

***\*** Campuses with 1 year of funding are not included in analyses of
slopes as there is no slope to be estimated.*

***\*\*** Campuses with 1 year of funding were not included in the
analyses due to the low sample size -- n \< 10.*

**Table SO19. Second Grade English Outcome Analyses: Overall Outcomes:
By years of funding (0-4) and funding year (2-4)**

***\*** Campuses with 1 year of funding are not included in analyses of
slopes as there is no slope to be estimated.*

***\*\*** Campuses with 1 year of funding were not included in the
analyses due to the low sample size -- n \< 10.*

*C = Control; I = Increase; D = Decrease; Ns = Non-Significant*

**Table SO20. Second Grade English Benchmark Sample: By years of funding
(0-4) and funding year (2-4)**

***\*** Campuses with 1 year of funding are not included in analyses of
slopes as there is no slope to be estimated.*

***\*\*** Campuses with 1 year of funding were not included in the
analyses due to the low sample size -- n \< 10.*

**Table SO21. Second Grade English Benchmark Analyses: Benchmark
Outcomes: By years of funding (0-4) and funding year (2-4)**

***\*** Campuses with 1 year of funding are not included in analyses of
slopes as there is no slope to be estimated.*

***\*\*** Campuses with 1 year of funding were not included in the
analyses due to the low sample size -- n \< 10.*

*C = Control; I = Increase; D = Decrease; Ns = Non-Significant*

![](media/image11.wmf){width="4.8180555555555555in"
height="4.372916666666667in"}

![](media/image12.wmf){width="4.767361111111111in"
height="4.436805555555556in"}

**Table SO22. Second Grade Spanish Outcome Sample: By years of funding
(0-4) and funding year (2-4)**

***\*** Campuses with 1 year of funding are not included in analyses of
slopes as there is no slope to be estimated.*

***\*\*** Campuses with 1 year of funding were not included in the
analyses due to the low sample size -- n \< 10.*

**Table SO23. Second Grade Spanish Outcome Analyses: Overall Outcomes:
By years of funding (0-4) and funding year (2-4)**

***\*** Campuses with 1 year of funding are not included in analyses of
slopes as there is no slope to be estimated.*

***\*\*** Campuses with 1 year of funding were not included in the
analyses due to the low sample size -- n \< 10.*

*C = Control; I = Increase; D = Decrease; Ns = Non-Significant*

**Table SO24. Second Grade Spanish Benchmark Sample: By years of funding
(0-4) and funding year (2-4)**

**e**

***\*** Campuses with 1 year of funding are not included in analyses of
slopes as there is no slope to be estimated.*

***\*\*** Campuses with 1 year of funding were not included in the
analyses due to the low sample size -- n \< 10.*

**Table SO25. Second Grade Spanish Benchmark Analyses: Benchmark
Outcomes: By years of funding (0-4) and funding year (2-4)**

***\*** Campuses with 1 year of funding are not included in analyses of
slopes as there is no slope to be estimated.*

***\*\*** Campuses with 1 year of funding were not included in the
analyses due to the low sample size -- n \< 10.*

*C = Control; I = Increase; D = Decrease; Ns = Non-Significant*

![](media/image13.wmf){width="4.46875in" height="4.372916666666667in"}

![](media/image14.wmf){width="4.767361111111111in"
height="4.436805555555556in"}

**[Third grade]{.underline}**

***English Outcome Performance.*** Table SO26 presents the campus and
student samples included in the third grade outcome analyses by years of
funding and year of RF. Statistical results for comparison of third
grade outcome performance (Table SO27) show no significant differences
in Total Reading scores across RF campuses by funding year and
comparison campuses in the spring of 2007, as well as no significant
differences in change over time between RF and comparison campuses.
While there are no significant differences, on average, across RF and
comparison campuses, in terms of growth over time, the majority of all
groups, on average, show stable performance or slight increases slight
increases in the state mandated outcome assessment score over time.

Examination of the average RF campus performance in spring of 2007
indicates that English performance is comparable to the state average in
that the average percent proficient at the end of year 4 is between
88-91% (89% = state average in 2007). It is important to note that
performance in both groups, on average, is very high, and the
variability in scores is rather limited. Thus, while the difference
between RF and Comparison campuses is statistically significant, it is
not significantly meaningful. It is also important to note that the TAKS
assessment and proficiency cut-point is a minimal skills assessment, and
therefore, higher performance rates are not comparable to those seen in
earlier grades. Furthermore, the assessment has a ceiling effect in that
there tends to be relatively high performance across campuses, leaving
minimal variance in performance to be explained.

***English Benchmark Performance.*** Table SO28 presents the campus and
student samples included in the third grade benchmark performance
analyses by years of funding and year of RF. Unlike the state assessment
outcome results, statistical results for comparison of third grade end
of year benchmark performance (Table SO29) show some significant
differences in performance across RF campuses by funding year and
comparison campuses in the spring of 2007. Specifically, RF funded
campuses with 4 years of funding are performing at higher levels in the
spring of 2007 than Comparison campuses on English benchmark
Graphophonemic Knowledge (GK). There are no significant differences in
growth in GK over time between RF funded and comparison campuses.

Comprehension (CO) benchmark outcomes show a different pattern in that,
all RF funded campus groups, on average are performing slightly lower
levels than comparison campuses and while performance increases over
time, on average, it increases at a faster rate for comparison versus RF
funded campus groups.

Examination of the percent proficient in each skill benchmark category
indicates that, on average, less than half (24-40%) of the third grade
students, are exiting the year with mastery of expected English GK
(spelling) skills, and about 2/3 are exiting with the expected levels of
comprehension skills (50-69%).

***Spanish Outcome Performance.*** Table SO30 presents the campus and
student samples included in the Spanish third grade outcome analyses by
years of funding and year of RF. Statistical results for comparison of
third grade Spanish outcome performance (Table SO31) show no significant
differences in Total Reading scores across RF campuses by funding year
and comparison campuses in the spring of 2007, as well as no significant
differences in change over time between RF and comparison campuses.

Examination of the average RF campus performance indicates that Spanish
performance is significantly higher than the state average with 86-100%,
on average, showing proficiency (state average = 81% in 2007). It is
also important to note that the TAKS assessment and proficiency
cut-point is a minimal skills assessment, and therefore, higher
performance rates are not comparable to those seen in earlier grades.
Furthermore, the assessment has a ceiling effect in that there tends to
be relatively high performance across campuses, leaving minimal variance
in performance to be explained.

***Spanish Benchmark Performance.*** Table SO32 presents the campus and
student samples included in the third grade Spanish benchmark
performance analyses by years of funding and year of RF. Similar to the
standardized outcome results, statistical results for comparison of
third grade end of year benchmark performance (Table SO33) showed no
significant differences in performance across RF campuses by funding
year and comparison campuses in the spring of 2007 in GK and CO. While
comparison campuses, on average, showed increases in GK and CO
performance over time, there were no significant differences between RF
funded and comparison campus groups.

Examination of the percent proficient in each skill benchmark category
indicates that about 24-35% of RF third graders are exiting the year
with mastery of expected English GK skills (spelling), and approximately
half (47-57%) are exiting with the expected level of Comprehension
skills.

**Table SO26. Third Grade English Outcome Sample: By years of funding
(0-4) and funding year (2-4)**

***\*** Campuses with 1 year of funding are not included in analyses of
slopes as there is no slope to be estimated.*

***\*\*** Campuses with 1 year of funding were not included in the
analyses due to the low sample size -- n \< 10.*

**Table SO27. Third Grade English Outcome Analyses: Overall Outcomes: By
years of funding (0-4) and funding year (2-4)**

***\*** Campuses with 1 year of funding are not included in analyses of
slopes as there is no slope to be estimated.*

***\*\*** Campuses with 1 year of funding were not included in the
analyses due to the low sample size -- n \< 10.*

*C = Control; I = Increase; D = Decrease; Ns = Non-Significant*

**Table SO28. Third Grade English Benchmark Sample: By years of funding
(0-4) and funding year (2-4)**

***\*** Campuses with 1 year of funding are not included in analyses of
slopes as there is no slope to be estimated.*

***\*\*** Campuses with 1 year of funding were not included in the
analyses due to the low sample size -- n \< 10.*

**Table SO29. Third Grade English Benchmark Analyses: Benchmark
Outcomes: By years of funding (0-4) and funding year (2-4)**

***\*** Campuses with 1 year of funding are not included in analyses of
slopes as there is no slope to be estimated.*

***\*\*** Campuses with 1 year of funding were not included in the
analyses due to the low sample size -- n \< 10.*

*C = Control; I = Increase; D = Decrease; Ns = Non-Significant*

**Table SO30. Third Grade Spanish Outcome Sample: By years of funding
(0-4) and funding year (2-4)**

***\*** Campuses with 1 year of funding are not included in analyses of
slopes as there is no slope to be estimated.*

***\*\*** Campuses with 1 year of funding were not included in the
analyses due to the low sample size -- n \< 10.*

**Table SO31. Third Grade Spanish Outcome Analyses: Overall Outcomes: By
years of funding (0-4) and funding year (2-4)**

***\*** Campuses with 1 year of funding are not included in analyses of
slopes as there is no slope to be estimated.*

***\*\*** Campuses with 1 year of funding were not included in the
analyses due to the low sample size -- n \< 10.*

*C = Control; I = Increase; D = Decrease; Ns = Non-Significant*

**Table SO32. Third Grade Spanish Benchmark Sample: By years of funding
(0-4) and funding year (2-4)**

***\*** Campuses with 1 year of funding are not included in analyses of
slopes as there is no slope to be estimated.*

***\*\*** Campuses with 1 year of funding were not included in the
analyses due to the low sample size -- n \< 10.*

**Table SO33. Third Grade Spanish Benchmark Analyses: Benchmark
Outcomes: By years of funding (0-4) and funding year (2-4)**

***\*** Campuses with 1 year of funding are not included in analyses of
slopes as there is no slope to be estimated.*

***\*\*** Campuses with 1 year of funding were not included in the
analyses due to the low sample size -- n \< 10.*

*C = Control; I = Increase; D = Decrease; Ns = Non-Significant*

*\*\*\*It is important to note that no Comparison campuses submitted
third grade Tejas LEE data in the spring of 2005. This lack of
submission is a reflection of the fact that third grade benchmark
testing was not required at the comparison campuses, and a third grade
Spanish assessment was not yet widely available.*

![](media/image15.wmf){width="4.8180555555555555in"
height="4.372916666666667in"}

![](media/image16.wmf){width="4.767361111111111in"
height="4.436805555555556in"}

**Appendix A**

**Performance Analyses -- Detailed Model Results**

**[Kindergarten English Analyses]{.underline}**

Overall Outcome

  -------------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*   *effect*           *un_est*    *un_se*    *un_ratio*   *sig*    *oddsratio*   *corr*
  --------- ------------ ----------- ------------------ ----------- ---------- ------------ -------- ------------- --------
  0         English      Overall     RFYR1 intercept    0.48        0.38       1.27                  1.62          
                                     effect                                                                        

                                     **RFYR2 intercept  **0.64**    **0.20**   **3.23**     **\***   1.90          
                                     effect**                                                                      

                                     **RFYR3 intercept  **0.55**    **0.12**   **4.60**     **\***   1.73          
                                     effect**                                                                      

                                     **RFYR4 intercept  **0.60**    **0.11**   **5.45**     **\***   1.83          
                                     effect**                                                                      

                                     **CTMAJOR          **-0.44**   **0.06**   **-6.87**    **\***   0.64          
                                     intercept effect**                                                            

                                     **RFYR2 slope      **0.85**    **0.19**   **4.61**     **\***   2.35          
                                     effect**                                                                      

                                     **RFYR3 slope      **0.34**    **0.09**   **3.91**     **\***   1.41          
                                     effect**                                                                      

                                     **RFYR4 slope      **0.27**    **0.08**   **3.25**     **\***   1.31          
                                     effect**                                                                      

                                     CTMAJOR slope      -0.07       0.04       -1.69                 0.93          
                                     effect                                                                        

                                     Covariance         0.10        0.03       3.30         \*                     0.46

                                     Control Intercept  -0.76       0.11       -7.13        \*       0.47          

                                     Control Slope      -0.16       0.08       -2.01        \*       0.85          

                                     Residual variance, 0.29        0.05       5.62         \*                     
                                     year 2                                                                        

                                     Residual variance, 0.18        0.02       7.85         \*                     
                                     year 3                                                                        

                                     Residual variance, 0.12        0.04       2.73         \*                     
                                     year 4                                                                        

                                     Residual variance, 0.46        0.05       9.50         \*                     
                                     intercept                                                                     

                                     Residual variance, 0.10        0.02       3.93         \*                     
                                     slope                                                                         
  -------------------------------------------------------------------------------------------------------------------------

***Phonological Awareness***

  --------------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*   *Effect*            *un_est*    *un_se*    *un_ratio*   *sig*    *oddsratio*   *corr*
  --------- ------------ ----------- ------------------- ----------- ---------- ------------ -------- ------------- --------
  0         English      Domain PA   RFYR1 intercept     0.45        0.40       1.12                  1.56          
                                     effect                                                                         

                                     **RFYR2 intercept   **0.54**    **0.21**   **2.62**     **\***   1.71          
                                     effect**                                                                       

                                     **RFYR3 intercept   **0.33**    **0.12**   **2.67**     **\***   1.38          
                                     effect**                                                                       

                                     **RFYR4 intercept   **0.38**    **0.11**   **3.35**     **\***   1.46          
                                     effect**                                                                       

                                     **CTMAJOR intercept **-0.57**   **0.07**   **-8.54**    **\***   0.57          
                                     effect**                                                                       

                                     **RFYR2 slope       **0.93**    **0.28**   **3.34**     **\***   2.54          
                                     effect**                                                                       

                                     **RFYR3 slope       **0.40**    **0.09**   **4.20**     **\***   1.49          
                                     effect**                                                                       

                                     **RFYR4 slope       **0.33**    **0.09**   **3.64**     **\***   1.39          
                                     effect**                                                                       

                                     **CTMAJOR slope     **-0.21**   **0.05**   **-4.68**    **\***   0.81          
                                     effect**                                                                       

                                     Covariance          0.11        0.03       3.35         \*                     0.41

                                     Control Intercept   0.17        0.11       1.56                  1.18          

                                     Control Slope       -0.15       0.09       -1.74                 0.86          

                                     Residual variance,  0.31        0.06       5.06         \*                     
                                     year 2                                                                         

                                     Residual variance,  0.27        0.03       9.16         \*                     
                                     year 3                                                                         

                                     Residual variance,  0.11        0.05       2.20         \*                     
                                     year 4                                                                         

                                     Residual variance,  0.51        0.06       9.08         \*                     
                                     intercept                                                                      

                                     Residual variance,  0.15        0.03       5.21         \*                     
                                     slope                                                                          
  --------------------------------------------------------------------------------------------------------------------------

Graphophonemic Knowledge

  --------------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*   *effect*            *un_est*    *un_se*    *un_ratio*   *sig*    *oddsratio*   *corr*
  --------- ------------ ----------- ------------------- ----------- ---------- ------------ -------- ------------- --------
  0         English      Domain GK   RFYR1 intercept     0.99        0.39       2.56         \*       2.68          
                                     effect                                                                         

                                     **RFYR2 intercept   **0.74**    **0.20**   **3.77**     **\***   2.10          
                                     effect**                                                                       

                                     **RFYR3 intercept   **0.73**    **0.11**   **6.46**     **\***   2.08          
                                     effect**                                                                       

                                     **RFYR4 intercept   **0.68**    **0.10**   **6.53**     **\***   1.97          
                                     effect**                                                                       

                                     **CTMAJOR intercept **-0.52**   **0.06**   **-8.65**    **\***   0.59          
                                     effect**                                                                       

                                     **RFYR2 slope       **0.65**    **0.22**   **2.93**     **\***   1.91          
                                     effect**                                                                       

                                     **RFYR3 slope       **0.37**    **0.08**   **4.37**     **\***   1.45          
                                     effect**                                                                       

                                     **RFYR4 slope       **0.32**    **0.08**   **4.01**     **\***   1.38          
                                     effect**                                                                       

                                     CTMAJOR slope       -0.03       0.04       -0.79                 0.97          
                                     effect                                                                         

                                     Covariance          0.04        0.02       1.99         \*                     0.34

                                     Control Intercept   2.16        0.10       21.51        \*       8.68          

                                     Control Slope       -0.23       0.08       -2.97        \*       0.79          

                                     Residual variance,  0.02        0.04       0.63                                
                                     year 2                                                                         

                                     Residual variance,  0.07        0.02       3.77         \*                     
                                     year 3                                                                         

                                     Residual variance,  0.08        0.03       2.23         \*                     
                                     year 4                                                                         

                                     Residual variance,  0.28        0.04       7.33         \*                     
                                     intercept                                                                      

                                     Residual variance,  0.05        0.02       2.92         \*                     
                                     slope                                                                          
  --------------------------------------------------------------------------------------------------------------------------

***Listening Comprehension***

  -------------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*   *effect*            *un_est*   *un_se*    *un_ratio*   *sig*    *oddsratio*   *corr*
  --------- ------------ ----------- ------------------- ---------- ---------- ------------ -------- ------------- --------
  0         English      Domain CO   RFYR1 intercept     0.02       0.35       0.07                  1.02          
                                     effect                                                                        

                                     RFYR2 intercept     -0.05      0.18       -0.26                 0.95          
                                     effect                                                                        

                                     RFYR3 intercept     0.10       0.11       0.91                  1.10          
                                     effect                                                                        

                                     RFYR4 intercept     0.15       0.10       1.52                  1.16          
                                     effect                                                                        

                                     CTMAJOR intercept   -0.09      0.06       -1.52                 0.91          
                                     effect                                                                        

                                     RFYR2 slope effect  0.07       0.17       0.42                  1.08          

                                     RFYR3 slope effect  -0.04      0.08       -0.49                 0.96          

                                     RFYR4 slope effect  -0.03      0.08       -0.43                 0.97          

                                     **CTMAJOR slope     **0.09**   **0.03**   **2.67**     **\***   1.10          
                                     effect**                                                                      

                                     Covariance          0.06       0.02       2.73         \*                     0.43

                                     Control Intercept   0.44       0.10       4.54         \*       1.56          

                                     Control Slope       0.03       0.07       0.42                  1.03          

                                     Residual variance,  0.15       0.04       4.08         \*                     
                                     year 2                                                                        

                                     Residual variance,  0.17       0.02       8.38         \*                     
                                     year 3                                                                        

                                     Residual variance,  0.11       0.04       3.16         \*                     
                                     year 4                                                                        

                                     Residual variance,  0.36       0.04       9.20         \*                     
                                     intercept                                                                     

                                     Residual variance,  0.05       0.02       2.86         \*                     
                                     slope                                                                         
  -------------------------------------------------------------------------------------------------------------------------

**[Kindergarten Spanish Analyses]{.underline}**

***Overall Outcome***

  -------------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*   *effect*           *un_est*    *un_se*    *un_ratio*   *sig*    *oddsratio*   *corr*
  --------- ------------ ----------- ------------------ ----------- ---------- ------------ -------- ------------- --------
  0         Spanish      Overall     RFYR2 intercept    -0.40       0.31       -1.29                 0.67          
                                     effect                                                                        

                                     **RFYR3 intercept  **-0.43**   **0.18**   **-2.45**    **\***   0.65          
                                     effect**                                                                      

                                     RFYR4 intercept    -0.20       0.15       -1.29                 0.82          
                                     effect                                                                        

                                     **CTMAJOR          **0.26**    **0.10**   **2.65**     **\***   1.30          
                                     intercept effect**                                                            

                                     RFYR2 slope effect 0.09        0.41       0.21                  1.09          

                                     **RFYR3 slope      **-0.28**   **0.13**   **-2.11**    **\***   0.76          
                                     effect**                                                                      

                                     **RFYR4 slope      **-0.28**   **0.12**   **-2.34**    **\***   0.75          
                                     effect**                                                                      

                                     **CTMAJOR slope    **-0.13**   **0.06**   **-2.13**    **\***   0.88          
                                     effect**                                                                      

                                     Covariance         0.04        0.05       0.75                                0.17

                                     Control Intercept  0.64        0.15       4.12         \*       1.89          

                                     Control Slope      0.69        0.12       5.77         \*       1.99          

                                     Residual variance, 0.21        0.10       2.10         \*                     
                                     year 2                                                                        

                                     Residual variance, 0.33        0.05       6.06         \*                     
                                     year 3                                                                        

                                     Residual variance, 0.34        0.09       3.54         \*                     
                                     year 4                                                                        

                                     Residual variance, 0.53        0.09       5.78         \*                     
                                     intercept                                                                     

                                     Residual variance, 0.11        0.05       2.18         \*                     
                                     slope                                                                         
  -------------------------------------------------------------------------------------------------------------------------

***Phonological Awareness***

  -------------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*   *effect*            *un_est*   *un_se*    *un_ratio*   *sig*    *oddsratio*   *corr*
  --------- ------------ ----------- ------------------- ---------- ---------- ------------ -------- ------------- --------
  0         Spanish      Domain PA   RFYR2 intercept     -0.15      0.33       -0.45                 0.86          
                                     effect                                                                        

                                     RFYR3 intercept     0.07       0.17       0.39                  1.07          
                                     effect                                                                        

                                     RFYR4 intercept     0.16       0.15       1.07                  1.18          
                                     effect                                                                        

                                     **CTMAJOR intercept **0.28**   **0.10**   **2.74**     **\***   1.32          
                                     effect**                                                                      

                                     RFYR2 slope effect  -0.15      0.51       -0.29                 0.86          

                                     RFYR3 slope effect  -0.09      0.14       -0.62                 0.92          

                                     RFYR4 slope effect  -0.14      0.13       -1.09                 0.87          

                                     CTMAJOR slope       0.00       0.07       0.03                  1.00          
                                     effect                                                                        

                                     Covariance          0.12       0.04       3.27         \*                     0.40

                                     Control Intercept   2.94       0.15       19.61        \*       18.99         

                                     Control Slope       0.66       0.13       5.21         \*       1.93          

                                     Residual variance,  0.00       0.12       0.03                                
                                     year 2                                                                        

                                     Residual variance,  0.57       0.08       7.59         \*                     
                                     year 3                                                                        

                                     Residual variance,  0.00       0.00       0.00                                
                                     year 4                                                                        

                                     Residual variance,  0.44       0.07       6.71         \*                     
                                     intercept                                                                     

                                     Residual variance,  0.22       0.05       4.69         \*                     
                                     slope                                                                         
  -------------------------------------------------------------------------------------------------------------------------

***Graphophonemic Knowledge***

  --------------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*   *effect*            *un_est*    *un_se*    *un_ratio*   *sig*    *oddsratio*   *corr*
  --------- ------------ ----------- ------------------- ----------- ---------- ------------ -------- ------------- --------
  0         Spanish      Domain GK   RFYR2 intercept     -.10        -.11       -.85                  0.56          
                                     effect                                                                         

                                     RFYR3 intercept     -0.04       0.13       -0.31                 0.96          
                                     effect                                                                         

                                     **RFYR4 intercept   **.59**     **.22**    **2.71**     **\***   1.10          
                                     effect**                                                                       

                                     **CTMAJOR intercept **0.28**    **0.08**   **3.67**     **\***   1.32          
                                     effect**                                                                       

                                     RFYR2 slope effect  0.18        0.46       0.39                  1.19          

                                     RFYR3 slope effect  -0.07       0.11       -0.61                 0.93          

                                     RFYR4 slope effect  -0.07       0.10       -0.69                 0.93          

                                     **CTMAJOR slope     **-0.20**   **0.06**   **-3.53**    **\***   0.82          
                                     effect**                                                                       

                                     Covariance          -0.07       0.05       -1.41                               -0.74

                                     Control Intercept   1.76        0.11       16.36        \*       5.80          

                                     Control Slope       0.84        0.10       8.78         \*       2.32          

                                     Residual variance,  0.07        0.14       0.54                                
                                     year 2                                                                         

                                     Residual variance,  0.67        0.08       8.05         \*                     
                                     year 3                                                                         

                                     Residual variance,  0.24        0.10       2.43         \*                     
                                     year 4                                                                         

                                     Residual variance,  0.15        0.09       1.67                                
                                     intercept                                                                      

                                     Residual variance,  0.06        0.06       1.14                                
                                     slope                                                                          
  --------------------------------------------------------------------------------------------------------------------------

***Listening Comprehension***

  --------------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*   *effect*            *un_est*    *un_se*    *un_ratio*   *sig*    *oddsratio*   *corr*
  --------- ------------ ----------- ------------------- ----------- ---------- ------------ -------- ------------- --------
  0         Spanish      Domain CO   RFYR2 intercept     -0.18       0.32       -0.57                 0.84          
                                     effect                                                                         

                                     **RFYR3 intercept   **-0.45**   **0.18**   **-2.48**    **\***   0.64          
                                     effect**                                                                       

                                     RFYR4 intercept     -0.24       0.16       -1.53                 0.79          
                                     effect                                                                         

                                     **CTMAJOR intercept **0.22**    **0.10**   **2.16**     **\***   1.25          
                                     effect**                                                                       

                                     RFYR2 slope effect  -0.09       0.34       -0.26                 0.92          

                                     **RFYR3 slope       **-0.35**   **0.14**   **-2.59**    **\***   0.71          
                                     effect**                                                                       

                                     **RFYR4 slope       **-0.36**   **0.12**   **-2.89**    **\***   0.70          
                                     effect**                                                                       

                                     CTMAJOR slope       -0.02       0.07       -0.26                 0.98          
                                     effect                                                                         

                                     Covariance          0.09        0.06       1.51                                0.27

                                     Control Intercept   1.00        0.16       6.30         \*       2.73          

                                     Control Slope       0.42        0.12       3.47         \*       1.53          

                                     Residual variance,  0.24        0.11       2.19         \*                     
                                     year 2                                                                         

                                     Residual variance,  0.34        0.05       6.40         \*                     
                                     year 3                                                                         

                                     Residual variance,  0.23        0.09       2.49         \*                     
                                     year 4                                                                         

                                     Residual variance,  0.69        0.10       6.80         \*                     
                                     intercept                                                                      

                                     Residual variance,  0.15        0.05       2.95         \*                     
                                     slope                                                                          
  --------------------------------------------------------------------------------------------------------------------------

**[First Grade English Analyses]{.underline}**

***Total Reading*** Outcome

  -------------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*        *effect*         *un_est*   *un_se*   *un_ratio*   *sig*   *oddsratio*   *corr*
  --------- ------------ ---------------- ---------------- ---------- --------- ------------ ------- ------------- --------
  1         English      Total Reading    RFYR1 intercept  0.09       0.20      0.45                 1.10          
                                          effect                                                                   

                                          RFYR2 intercept  0.25       0.15      1.71                 1.29          
                                          effect                                                                   

                                          RFYR3 intercept  0.06       0.08      0.79                 1.07          
                                          effect                                                                   

                                          RFYR4 intercept  0.13       0.07      1.83                 1.14          
                                          effect                                                                   

                                          CTMAJOR          -0.23      0.05      -4.75        \*      0.80          
                                          intercept effect                                                         

                                          RFYR2 slope      0.12       0.09      1.27                 1.12          
                                          effect                                                                   

                                          RFYR3 slope      0.02       0.04      0.47                 1.02          
                                          effect                                                                   

                                          RFYR4 slope      0.02       0.03      0.47                 1.02          
                                          effect                                                                   

                                          CTMAJOR slope    -0.04      0.02      -2.04        \*      0.96          
                                          effect                                                                   

                                          Covariance       0.00       0.01      0.26                               0.03

                                          Control          0.05       0.07      0.79                 1.05          
                                          Intercept                                                                

                                          Control Slope    -0.05      0.03      -1.47                0.96          

                                          Residual         0.12       0.02      6.53         \*                    
                                          variance, year 1                                                         

                                          Residual         0.04       0.01      4.54         \*                    
                                          variance, year 2                                                         

                                          Residual         0.07       0.01      7.77         \*                    
                                          variance, year 3                                                         

                                          Residual         0.11       0.02      6.80         \*                    
                                          variance, year 4                                                         

                                          Residual         0.27       0.02      11.84        \*                    
                                          variance,                                                                
                                          intercept                                                                

                                          Residual         0.01       0.00      3.50         \*                    
                                          variance, slope                                                          
  -------------------------------------------------------------------------------------------------------------------------

***Reading Comprehension*** Outcome

  ----------------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *Outcome*         *effect*         *un_est*   *un_se*    *un_ratio*   *sig*    *oddsratio*   *corr*
  --------- ------------ ----------------- ---------------- ---------- ---------- ------------ -------- ------------- --------
  1         English      Comprehension     RFYR1 intercept  0.04       0.21       0.21                  1.04          
                                           effect                                                                     

                                           **RFYR2          **0.46**   **0.16**   **2.94**     **\***   1.58          
                                           intercept                                                                  
                                           effect**                                                                   

                                           **RFYR3          **0.23**   **0.14**   **2.24**     **\***   1.14          
                                           intercept                                                                  
                                           effect**                                                                   

                                           **RFYR4          **0.22**   **0.07**   **3.07**     **\***   1.24          
                                           intercept                                                                  
                                           effect**                                                                   

                                           CTMAJOR          -0.38      0.05       -7.72        \*       0.68          
                                           intercept effect                                                           

                                           RFYR2 slope      0.07       0.12       0.60                  1.08          
                                           effect                                                                     

                                           RFYR3 slope      -0.02      0.04       -0.41                 0.98          
                                           effect                                                                     

                                           RFYR4 slope      0.02       0.03       0.67                  1.02          
                                           effect                                                                     

                                           CTMAJOR slope    0.02       0.02       0.96                  1.02          
                                           effect                                                                     

                                           Covariance       -0.02      0.01       -3.08        \*                     -0.40

                                           Control          0.36       0.07       5.30         \*       1.43          
                                           Intercept                                                                  

                                           Control Slope    -0.13      0.03       -4.13        \*       0.88          

                                           Residual         0.16       0.03       6.15         \*                     
                                           variance, year 1                                                           

                                           Residual         0.05       0.01       4.53         \*                     
                                           variance, year 2                                                           

                                           Residual         0.12       0.01       8.93         \*                     
                                           variance, year 3                                                           

                                           Residual         0.12       0.02       6.97         \*                     
                                           variance, year 4                                                           

                                           Residual         0.27       0.02       11.77        \*                     
                                           variance,                                                                  
                                           intercept                                                                  

                                           Residual         0.01       0.00       3.15         \*                     
                                           variance, slope                                                            
  ----------------------------------------------------------------------------------------------------------------------------

***Word Reading/Vocabulary*** Outcome

  ------------------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*            *effect*          *un_est*   *un_se*   *un_ratio*   *sig*   *oddsratio*   *corr*
  --------- ------------ -------------------- ----------------- ---------- --------- ------------ ------- ------------- --------
  1         English      Word                 RFYR1 intercept   0.07       0.21      0.32                 1.07          
                         Reading/Vocabulary   effect                                                                    

                                              RFYR2 intercept   0.28       0.16      1.70                 1.32          
                                              effect                                                                    

                                              RFYR3 intercept   0.05       0.08      0.60                 1.05          
                                              effect                                                                    

                                              RFYR4 intercept   0.11       0.07      1.59                 1.12          
                                              effect                                                                    

                                              CTMAJOR intercept -0.27      0.05      -5.42        \*      0.77          
                                              effect                                                                    

                                              RFYR2 slope       0.16       0.15      1.07                 1.17          
                                              effect                                                                    

                                              RFYR3 slope       -0.01      0.04      -0.18                0.99          
                                              effect                                                                    

                                              RFYR4 slope       0.02       0.03      0.52                 1.02          
                                              effect                                                                    

                                              CTMAJOR slope     -0.08      0.02      -4.46        \*      0.92          
                                              effect                                                                    

                                              Covariance        0.01       0.01      0.89                               0.11

                                              Control Intercept -0.40      0.07      -5.92        \*      0.67          

                                              Control Slope     -0.03      0.03      -0.94                0.97          

                                              Residual          0.11       0.02      6.31         \*                    
                                              variance, year 1                                                          

                                              Residual          0.04       0.01      4.40         \*                    
                                              variance, year 2                                                          

                                              Residual          0.06       0.01      7.22         \*                    
                                              variance, year 3                                                          

                                              Residual          0.10       0.01      6.69         \*                    
                                              variance, year 4                                                          

                                              Residual          0.29       0.02      12.91        \*                    
                                              variance,                                                                 
                                              intercept                                                                 

                                              Residual          0.01       0.00      3.42         \*                    
                                              variance, slope                                                           
  ------------------------------------------------------------------------------------------------------------------------------

***Phonological Awareness End of Year Benchmark***

  ---------------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*   *effect*            *un_est*    *un_se*     *un_ratio*   *sig*    *oddsratio*   *corr*
  --------- ------------ ----------- ------------------- ----------- ----------- ------------ -------- ------------- --------
  1         English      Domain PA   RFYR1 intercept     0.18        0.34        0.55                  1.20          
                                     effect                                                                          

                                     **RFYR2 intercept   **0.43**    **0.19**    **2.24**     **\***   1.54          
                                     effect**                                                                        

                                     **RFYR3 intercept   **0.42**    **0.18**    **2.22**     **\***   1.15          
                                     effect**                                                                        

                                     **RFYR4 intercept   **0.26**    **0.11**    **2.43**     **\***   1.29          
                                     effect**                                                                        

                                     CTMAJOR intercept   -0.43       0.06        -7.13        \*       0.65          
                                     effect                                                                          

                                     **RFYR2 slope       **-0.38**   **-0.19**   **-2.02**    **\***   1.45          
                                     effect**                                                                        

                                     **RFYR3 slope       **0.14**    **0.11**    **1.74**     **\***   1.15          
                                     effect**                                                                        

                                     **RFYR4 slope       **0.12**    **0.10**    **1.53**     **\***   1.12          
                                     effect**                                                                        

                                     CTMAJOR slope       -0.14       0.04        -3.88        \*       0.87          
                                     effect                                                                          

                                     Covariance          0.12        0.01        8.79         \*                     0.54

                                     Control Intercept   1.10        0.10        10.78        \*       3.01          

                                     Control Slope       -0.06       0.07        -0.79                 0.94          

                                     Residual variance,  0.05        0.03        1.46                                
                                     year 2                                                                          

                                     Residual variance,  0.22        0.02        10.49        \*                     
                                     year 3                                                                          

                                     Residual variance,  0.00        0.00        0.01                                
                                     year 4                                                                          

                                     Residual variance,  0.49        0.03        15.17        \*                     
                                     intercept                                                                       

                                     Residual variance,  0.11        0.01        9.03         \*                     
                                     slope                                                                           
  ---------------------------------------------------------------------------------------------------------------------------

***Graphophonemic Knowledge End of Year Benchmark***

  -------------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*   *effect*            *un_est*   *un_se*    *un_ratio*   *sig*    *oddsratio*   *corr*
  --------- ------------ ----------- ------------------- ---------- ---------- ------------ -------- ------------- --------
  1         English      Domain GK   RFYR1 intercept     0.27       0.36       0.75                  1.31          
                                     effect                                                                        

                                     **RFYR2 intercept   **0.53**   **0.20**   **2.64**     **\***   1.70          
                                     effect**                                                                      

                                     **RFYR3 intercept   **0.35**   **0.12**   **2.94**     **\***   1.41          
                                     effect**                                                                      

                                     **RFYR4 intercept   **0.40**   **0.11**   **3.75**     **\***   1.50          
                                     effect**                                                                      

                                     CTMAJOR intercept   -0.69      0.06       -10.89       \*       0.50          
                                     effect                                                                        

                                     RFYR2 slope effect  0.15       0.10       1.65                  1.41          

                                     RFYR3 slope effect  0.10       0.08       1.27                  1.11          

                                     RFYR4 slope effect  0.16       0.11       1.75                  1.06          

                                     CTMAJOR slope       -0.11      0.04       -3.25        \*       0.89          
                                     effect                                                                        

                                     Covariance          0.10       0.02       4.20         \*                     0.52

                                     Control Intercept   1.93       0.11       18.28        \*       6.90          

                                     Control Slope       0.01       0.08       0.15                  1.01          

                                     Residual variance,  0.04       0.04       1.27                                
                                     year 2                                                                        

                                     Residual variance,  0.13       0.02       6.49         \*                     
                                     year 3                                                                        

                                     Residual variance,  0.01       0.04       0.30                                
                                     year 4                                                                        

                                     Residual variance,  0.47       0.05       10.22        \*                     
                                     intercept                                                                     

                                     Residual variance,  0.08       0.02       4.28         \*                     
                                     slope                                                                         
  -------------------------------------------------------------------------------------------------------------------------

***Comprehension End of Year Benchmark***

  -------------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*   *effect*            *un_est*   *un_se*    *un_ratio*   *sig*    *oddsratio*   *corr*
  --------- ------------ ----------- ------------------- ---------- ---------- ------------ -------- ------------- --------
  1         English      Domain CO   RFYR1 intercept     0.02       0.33       0.06                  1.02          
                                     effect                                                                        

                                     **RFYR2 intercept   **0.52**   **0.19**   **2.73**     **\***   1.68          
                                     effect**                                                                      

                                     RFYR3 intercept     0.16       0.11       1.49                  1.17          
                                     effect                                                                        

                                     RFYR4 intercept     0.17       0.10       1.77                  1.19          
                                     effect                                                                        

                                     CTMAJOR intercept   -0.15      0.06       -2.57        \*       0.87          
                                     effect                                                                        

                                     RFYR2 slope effect  -0.05      0.24       -0.21                 0.95          

                                     RFYR3 slope effect  -0.04      0.07       -0.61                 0.96          

                                     RFYR4 slope effect  -0.06      0.07       -0.93                 0.94          

                                     CTMAJOR slope       0.01       0.03       0.23                  1.01          
                                     effect                                                                        

                                     Covariance          0.01       0.02       0.39                                0.11

                                     Control Intercept   0.97       0.09       10.38        \*       2.65          

                                     Control Slope       -0.18      0.07       -2.59        \*       0.84          

                                     Residual variance,  0.08       0.04       2.24         \*                     
                                     year 2                                                                        

                                     Residual variance,  0.13       0.02       6.33         \*                     
                                     year 3                                                                        

                                     Residual variance,  0.20       0.04       5.31         \*                     
                                     year 4                                                                        

                                     Residual variance,  0.26       0.04       7.26         \*                     
                                     intercept                                                                     

                                     Residual variance,  0.02       0.02       1.03                                
                                     slope                                                                         
  -------------------------------------------------------------------------------------------------------------------------

**[First Grade Spanish Analyses]{.underline}**

***Total Reading*** Outcome

  -------------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*        *effect*         *un_est*   *un_se*   *un_ratio*   *sig*   *oddsratio*   *corr*
  --------- ------------ ---------------- ---------------- ---------- --------- ------------ ------- ------------- --------
  1         Spanish      Total Reading    RFYR1 intercept  -1.59      0.33      -4.77        \*      0.20          
                                          effect                                                                   

                                          RFYR2 intercept  -0.11      0.25      -0.42                0.90          
                                          effect                                                                   

                                          RFYR3 intercept  0.04       0.15      0.23                 1.04          
                                          effect                                                                   

                                          RFYR4 intercept  -0.00      0.14      -0.02                1.00          
                                          effect                                                                   

                                          CTMAJOR          0.55       0.08      6.90         \*      1.73          
                                          intercept effect                                                         

                                          RFYR2 slope      -0.12      0.19      -0.63                0.89          
                                          effect                                                                   

                                          RFYR3 slope      0.09       0.10      0.90                 1.09          
                                          effect                                                                   

                                          RFYR4 slope      -0.05      0.09      -0.50                0.96          
                                          effect                                                                   

                                          CTMAJOR slope    -0.01      0.04      -0.22                0.99          
                                          effect                                                                   

                                          Covariance       0.05       0.02      3.53         \*                    0.49

                                          Control          1.61       0.14      11.77        \*      4.98          
                                          Intercept                                                                

                                          Control Slope    0.15       0.09      1.67                 1.16          

                                          Residual         0.16       0.06      2.51         \*                    
                                          variance, year 1                                                         

                                          Residual         0.58       0.07      8.89         \*                    
                                          variance, year 2                                                         

                                          Residual         0.28       0.04      6.94         \*                    
                                          variance, year 3                                                         

                                          Residual         0.00       0.00      0.00                               
                                          variance, year 4                                                         

                                          Residual         0.40       0.04      9.00         \*                    
                                          variance,                                                                
                                          intercept                                                                

                                          Residual         0.03       0.01      3.27         \*                    
                                          variance, slope                                                          
  -------------------------------------------------------------------------------------------------------------------------

***Reading Comprehension*** Outcome

  --------------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*         *effect*         *un_est*   *un_se*   *un_ratio*   *sig*   *oddsratio*   *corr*
  --------- ------------ ----------------- ---------------- ---------- --------- ------------ ------- ------------- --------
  1         Spanish      Comprehension     RFYR1 intercept  -1.63      0.31      -5.22        \*      0.20          
                                           effect                                                                   

                                           RFYR2 intercept  0.04       0.23      0.19                 1.04          
                                           effect                                                                   

                                           RFYR3 intercept  0.06       0.14      0.45                 1.07          
                                           effect                                                                   

                                           RFYR4 intercept  0.08       0.12      0.64                 1.08          
                                           effect                                                                   

                                           CTMAJOR          0.52       0.08      6.92         \*      1.68          
                                           intercept effect                                                         

                                           RFYR2 slope      -0.01      0.15      -0.05                0.99          
                                           effect                                                                   

                                           RFYR3 slope      0.06       0.09      0.64                 1.06          
                                           effect                                                                   

                                           RFYR4 slope      -0.04      0.07      -0.50                0.96          
                                           effect                                                                   

                                           CTMAJOR slope    0.00       0.03      0.08                 1.00          
                                           effect                                                                   

                                           Covariance       0.03       0.01      2.23         \*                    0.33

                                           Control          1.42       0.13      11.30        \*      4.14          
                                           Intercept                                                                

                                           Control Slope    0.13       0.08      1.68                 1.13          

                                           Residual         0.08       0.05      1.52                               
                                           variance, year 1                                                         

                                           Residual         0.69       0.07      9.82         \*                    
                                           variance, year 2                                                         

                                           Residual         0.23       0.03      6.66         \*                    
                                           variance, year 3                                                         

                                           Residual         0.00       0.01      0.08                               
                                           variance, year 4                                                         

                                           Residual         0.35       0.04      8.50         \*                    
                                           variance,                                                                
                                           intercept                                                                

                                           Residual         0.02       0.01      3.12         \*                    
                                           variance, slope                                                          
  --------------------------------------------------------------------------------------------------------------------------

***Word Reading/Vocabulary*** Outcome

  ------------------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*            *effect*          *un_est*   *un_se*   *un_ratio*   *sig*   *oddsratio*   *corr*
  --------- ------------ -------------------- ----------------- ---------- --------- ------------ ------- ------------- --------
  1         Spanish      Word                 RFYR1 intercept   -1.55      0.33      -4.72        \*      0.21          
                         Reading/Vocabulary   effect                                                                    

                                              RFYR2 intercept   -0.27      0.25      -1.06                0.77          
                                              effect                                                                    

                                              RFYR3 intercept   0.03       0.16      0.18                 1.03          
                                              effect                                                                    

                                              RFYR4 intercept   -0.07      0.14      -0.51                0.93          
                                              effect                                                                    

                                              CTMAJOR intercept 0.58       0.08      7.13         \*      1.78          
                                              effect                                                                    

                                              RFYR2 slope       0.02       0.19      0.10                 1.02          
                                              effect                                                                    

                                              RFYR3 slope       0.23       0.10      1.78                 1.26          
                                              effect                                                                    

                                              RFYR4 slope       0.09       0.09      1.04                 1.10          
                                              effect                                                                    

                                              CTMAJOR slope     -0.00      0.04      -0.04                1.00          
                                              effect                                                                    

                                              Covariance        0.07       0.02      4.52         \*                    0.63

                                              Control Intercept 1.66       0.14      12.14        \*      5.28          

                                              Control Slope     -0.01      0.09      -0.13                0.99          

                                              Residual          0.14       0.06      2.21         \*                    
                                              variance, year 1                                                          

                                              Residual          0.36       0.06      5.86         \*                    
                                              variance, year 2                                                          

                                              Residual          0.30       0.04      7.00         \*                    
                                              variance, year 3                                                          

                                              Residual          0.00       0.00      0.01                               
                                              variance, year 4                                                          

                                              Residual          0.44       0.05      9.17         \*                    
                                              variance,                                                                 
                                              intercept                                                                 

                                              Residual          0.03       0.01      3.66         \*                    
                                              variance, slope                                                           
  ------------------------------------------------------------------------------------------------------------------------------

***Phonological Awareness End of Year Benchmark***

  -------------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*   *effect*            *un_est*   *un_se*    *un_ratio*   *sig*    *oddsratio*   *corr*
  --------- ------------ ----------- ------------------- ---------- ---------- ------------ -------- ------------- --------
  1         Spanish      Domain PA   **RFYR2 intercept   **0.29**   **0.28**   **2.01**     **\***   1.22          
                                     effect**                                                                      

                                     RFYR3 intercept     0.07       0.16       0.45                  1.07          
                                     effect                                                                        

                                     **RFYR4 intercept   **0.27**   **0.14**   **1.99**     **\***   1.31          
                                     effect**                                                                      

                                     CTMAJOR intercept   0.35       0.09       4.05         \*       1.42          
                                     effect                                                                        

                                     **RFYR2 slope       **0.51**   **0.28**   **1.97**     **\***   1.67          
                                     effect**                                                                      

                                     RFYR3 slope effect  -0.08      0.12       -0.67                 0.92          

                                     RFYR4 slope effect  -0.02      0.11       -0.21                 0.98          

                                     CTMAJOR slope       -0.11      0.06       -1.80                 0.90          
                                     effect                                                                        

                                     Covariance          0.14       0.05       2.78         \*                     0.52

                                     Control Intercept   0.78       0.14       5.70         \*       2.18          

                                     Control Slope       0.19       0.11       1.70                  1.21          

                                     Residual variance,  0.27       0.09       3.05         \*                     
                                     year 2                                                                        

                                     Residual variance,  0.27       0.05       5.68         \*                     
                                     year 3                                                                        

                                     Residual variance,  0.05       0.07       0.73                                
                                     year 4                                                                        

                                     Residual variance,  0.52       0.08       6.39         \*                     
                                     intercept                                                                     

                                     Residual variance,  0.13       0.04       3.15         \*                     
                                     slope                                                                         
  -------------------------------------------------------------------------------------------------------------------------

***Graphophonemic Knowledge End of Year Benchmark***

  -------------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*   *effect*            *un_est*   *un_se*    *un_ratio*   *sig*    *oddsratio*   *corr*
  --------- ------------ ----------- ------------------- ---------- ---------- ------------ -------- ------------- --------
  1         Spanish      Domain GK   **RFYR2 intercept   **0.34**   **0.34**   **2.00**     **\***   1.15          
                                     effect**                                                                      

                                     **RFYR3 intercept   **0.38**   **0.19**   **2.01**     **\***   1.46          
                                     effect**                                                                      

                                     **RFYR4 intercept   **0.45**   **0.16**   **2.76**     **\***   1.56          
                                     effect**                                                                      

                                     CTMAJOR intercept   0.46       0.11       4.27         \*       1.58          
                                     effect                                                                        

                                     **RFYR2 slope       **0.78**   **0.34**   **2.27**     **\***   2.18          
                                     effect**                                                                      

                                     RFYR3 slope effect  0.17       0.15       1.11                  1.18          

                                     RFYR4 slope effect  0.07       0.14       0.48                  1.07          

                                     CTMAJOR slope       -0.16      0.07       -2.10        \*       0.86          
                                     effect                                                                        

                                     Covariance          0.12       0.04       2.91         \*                     0.42

                                     Control Intercept   2.44       0.16       15.14        \*       11.51         

                                     Control Slope       0.20       0.13       1.46                  1.22          

                                     Residual variance,  0.27       0.11       2.50         \*                     
                                     year 2                                                                        

                                     Residual variance,  0.21       0.05       4.14         \*                     
                                     year 3                                                                        

                                     Residual variance,  0.00       0.02       0.04                                
                                     year 4                                                                        

                                     Residual variance,  0.58       0.08       7.51         \*                     
                                     intercept                                                                     

                                     Residual variance,  0.13       0.04       3.49         \*                     
                                     slope                                                                         
  -------------------------------------------------------------------------------------------------------------------------

***Comprehension End of Year Benchmark***

  -------------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*   *Effect*            *un_est*   *un_se*    *un_ratio*   *sig*    *oddsratio*   *corr*
  --------- ------------ ----------- ------------------- ---------- ---------- ------------ -------- ------------- --------
  1         Spanish      Domain CO   **RFYR2 intercept   **0.34**   **0.19**   **2.15**              1.40          
                                     effect**                                                                      

                                     RFYR3 intercept     0.18       0.17       1.07                  1.20          
                                     effect                                                                        

                                     **RFYR4 intercept   **0.40**   **0.15**   **2.77**     **\***   1.49          
                                     effect**                                                                      

                                     CTMAJOR intercept   0.48       0.09       5.15         \*       1.62          
                                     effect                                                                        

                                     RFYR2 slope effect  0.09       0.29       0.33                  1.10          

                                     RFYR3 slope effect  -0.11      0.12       -0.87                 0.90          

                                     **RFYR4 slope       **0.23**   **0.11**   **1.30**     **\***   1.03          
                                     effect**                                                                      

                                     CTMAJOR slope       -0.01      0.06       -0.17                 0.99          
                                     effect                                                                        

                                     Covariance          0.23       0.05       4.63         \*                     0.67

                                     Control Intercept   0.67       0.15       4.61         \*       1.96          

                                     Control Slope       0.14       0.11       1.32                  1.15          

                                     Residual variance,  0.19       0.07       2.63         \*                     
                                     year 2                                                                        

                                     Residual variance,  0.26       0.04       6.06         \*                     
                                     year 3                                                                        

                                     Residual variance,  0.06       0.07       0.82                                
                                     year 4                                                                        

                                     Residual variance,  0.63       0.09       7.31         \*                     
                                     intercept                                                                     

                                     Residual variance,  0.18       0.04       4.79         \*                     
                                     slope                                                                         
  -------------------------------------------------------------------------------------------------------------------------

**[Second Grade English Analyses]{.underline}**

***Total Reading*** Outcome

  -------------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*        *effect*         *un_est*   *un_se*   *un_ratio*   *sig*   *oddsratio*   *corr*
  --------- ------------ ---------------- ---------------- ---------- --------- ------------ ------- ------------- --------
  2         English      Total Reading    RFYR1 intercept  -0.06      0.20      -0.28                0.95          
                                          effect                                                                   

                                          RFYR2 intercept  -0.02      0.16      -0.14                0.98          
                                          effect                                                                   

                                          RFYR3 intercept  -0.14      0.08      -1.84                0.87          
                                          effect                                                                   

                                          RFYR4 intercept  -0.08      0.07      -1.13                0.93          
                                          effect                                                                   

                                          CTMAJOR          -0.13      0.05      -2.69        \*      0.88          
                                          intercept effect                                                         

                                          RFYR2 slope      -0.01      0.18      -0.03                0.99          
                                          effect                                                                   

                                          RFYR3 slope      0.01       0.03      0.24                 1.01          
                                          effect                                                                   

                                          RFYR4 slope      0.03       0.03      1.02                 1.03          
                                          effect                                                                   

                                          CTMAJOR slope    -0.03      0.02      -1.51                0.97          
                                          effect                                                                   

                                          Covariance       0.01       0.01      1.44                               0.13

                                          Control          -0.00      0.07      -0.01                1.00          
                                          Intercept                                                                

                                          Control Slope    -0.08      0.03      -2.74        \*      0.92          

                                          Residual         0.08       0.02      4.96         \*                    
                                          variance, year 1                                                         

                                          Residual         0.04       0.01      4.75         \*                    
                                          variance, year 2                                                         

                                          Residual         0.07       0.01      8.18         \*                    
                                          variance, year 3                                                         

                                          Residual         0.04       0.01      3.74         \*                    
                                          variance, year 4                                                         

                                          Residual         0.30       0.02      14.00        \*                    
                                          variance,                                                                
                                          intercept                                                                

                                          Residual         0.02       0.00      5.75         \*                    
                                          variance, slope                                                          
  -------------------------------------------------------------------------------------------------------------------------

***Reading Comprehension*** Outcome

  --------------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*         *effect*         *un_est*   *un_se*   *un_ratio*   *sig*   *oddsratio*   *corr*
  --------- ------------ ----------------- ---------------- ---------- --------- ------------ ------- ------------- --------
  2         English      Comprehension     RFYR1 intercept  -0.05      0.18      -0.28                0.95          
                                           effect                                                                   

                                           RFYR2 intercept  0.08       0.13      0.58                 1.08          
                                           effect                                                                   

                                           RFYR3 intercept  -0.10      0.07      -1.43                0.90          
                                           effect                                                                   

                                           RFYR4 intercept  -0.04      0.06      -0.57                0.97          
                                           effect                                                                   

                                           CTMAJOR          -0.24      0.04      -5.61        \*      0.79          
                                           intercept effect                                                         

                                           RFYR2 slope      0.11       0.10      1.09                 1.11          
                                           effect                                                                   

                                           RFYR3 slope      0.02       0.03      0.72                 1.02          
                                           effect                                                                   

                                           RFYR4 slope      0.01       0.03      0.32                 1.01          
                                           effect                                                                   

                                           CTMAJOR slope    -0.08      0.02      -4.94        \*      0.92          
                                           effect                                                                   

                                           Covariance       0.01       0.01      1.34                               0.10

                                           Control          0.23       0.06      3.85         \*      1.25          
                                           Intercept                                                                

                                           Control Slope    0.02       0.03      0.82                 1.02          

                                           Residual         0.02       0.01      1.85                               
                                           variance, year 1                                                         

                                           Residual         0.04       0.01      5.81         \*                    
                                           variance, year 2                                                         

                                           Residual         0.07       0.01      8.40         \*                    
                                           variance, year 3                                                         

                                           Residual         0.03       0.01      3.04         \*                    
                                           variance, year 4                                                         

                                           Residual         0.24       0.02      13.46        \*                    
                                           variance,                                                                
                                           intercept                                                                

                                           Residual         0.02       0.00      7.35         \*                    
                                           variance, slope                                                          
  --------------------------------------------------------------------------------------------------------------------------

***Word Reading/Vocabulary*** Outcome

  ------------------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*            *Effect*          *un_est*   *un_se*   *un_ratio*   *sig*   *oddsratio*   *corr*
  --------- ------------ -------------------- ----------------- ---------- --------- ------------ ------- ------------- --------
  2         English      Word                 RFYR1 intercept   -0.02      0.36      -0.05                0.98          
                         Reading/Vocabulary   effect                                                                    

                                              RFYR2 intercept   0.08       0.20      0.42                 1.09          
                                              effect                                                                    

                                              RFYR3 intercept   -0.20      0.08      -2.45                0.82          
                                              effect                                                                    

                                              RFYR4 intercept   -0.08      0.07      -1.12                0.92          
                                              effect                                                                    

                                              CTMAJOR intercept -0.27      0.06      -4.95        \*      0.76          
                                              effect                                                                    

                                              RFYR2 slope       -0.06      0.11      -0.54                0.94          
                                              effect                                                                    

                                              RFYR3 slope       -0.07      0.04      -2.02        \*      0.93          
                                              effect                                                                    

                                              RFYR4 slope       0.00       0.03      0.06                 1.00          
                                              effect                                                                    

                                              CTMAJOR slope     -0.04      0.02      -2.09        \*      0.96          
                                              effect                                                                    

                                              Covariance        0.00       0.01      0.34                               0.04

                                              Control Intercept -0.38      0.07      -5.56        \*      0.68          

                                              Control Slope     -0.11      0.03      -3.40        \*      0.90          

                                              Residual          0.08       0.02      4.40         \*                    
                                              variance, year 1                                                          

                                              Residual          0.09       0.01      7.17         \*                    
                                              variance, year 2                                                          

                                              Residual          0.09       0.01      7.45         \*                    
                                              variance, year 3                                                          

                                              Residual          0.06       0.02      3.94         \*                    
                                              variance, year 4                                                          

                                              Residual          0.31       0.02      13.38        \*                    
                                              variance,                                                                 
                                              intercept                                                                 

                                              Residual          0.01       0.00      3.20         \*                    
                                              variance, slope                                                           
  ------------------------------------------------------------------------------------------------------------------------------

***Graphophonemic Knowledge End of Year Benchmark***

  --------------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*   *effect*            *un_est*    *un_se*    *un_ratio*   *sig*    *oddsratio*   *corr*
  --------- ------------ ----------- ------------------- ----------- ---------- ------------ -------- ------------- --------
  2         English      Domain GK   RFYR1 intercept     0.85        0.43       1.99         \*       2.34          
                                     effect                                                                         

                                     **RFYR2 intercept   **-0.43**   **0.20**   **-2.09**    **\***   0.65          
                                     effect**                                                                       

                                     **RFYR3 intercept   **0.22**    **0.12**   **2.05**     **\***   1.13          
                                     effect**                                                                       

                                     **RFYR4 intercept   **0.29**    **0.11**   **2.74**     **\***   1.21          
                                     effect**                                                                       

                                     CTMAJOR intercept   -0.14       0.06       -2.28        \*       0.87          
                                     effect                                                                         

                                     RFYR2 slope effect  -0.31       0.21       -1.43                 0.74          

                                     RFYR3 slope effect  -0.03       0.10       -0.31                 0.97          

                                     RFYR4 slope effect  -0.11       0.09       -1.17                 0.90          

                                     CTMAJOR slope       -0.17       0.04       -3.90        \*       0.85          
                                     effect                                                                         

                                     Covariance          0.07        0.03       2.65         \*                     0.39

                                     Control Intercept   -0.18       0.11       -1.71                 0.84          

                                     Control Slope       0.34        0.09       3.85         \*       1.41          

                                     Residual variance,  0.15        0.05       3.42         \*                     
                                     year 2                                                                         

                                     Residual variance,  0.21        0.02       9.16         \*                     
                                     year 3                                                                         

                                     Residual variance,  0.31        0.05       6.60         \*                     
                                     year 4                                                                         

                                     Residual variance,  0.30        0.04       6.85         \*                     
                                     intercept                                                                      

                                     Residual variance,  0.11        0.02       4.61         \*                     
                                     slope                                                                          
  --------------------------------------------------------------------------------------------------------------------------

***Comprehension End of Year Benchmark***

  -------------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*   *effect*            *un_est*   *un_se*    *un_ratio*   *sig*    *oddsratio*   *corr*
  --------- ------------ ----------- ------------------- ---------- ---------- ------------ -------- ------------- --------
  2         English      Domain CO   RFYR1 intercept     -0.54      0.41       -1.33                 0.58          
                                     effect                                                                        

                                     **RFYR2 intercept   **0.27**   **0.21**   **1.91**     **\***   1.21          
                                     effect**                                                                      

                                     **RFYR3 intercept   **0.23**   **0.12**   **1.96**     **\***   1.25          
                                     effect**                                                                      

                                     **RFYR4 intercept   **0.32**   **0.11**   **2.94**     **\***   1.37          
                                     effect**                                                                      

                                     CTMAJOR intercept   -0.06      0.06       -1.02                 0.94          
                                     effect                                                                        

                                     RFYR2 slope effect  -0.04      0.23       -0.19                 0.96          

                                     RFYR3 slope effect  0.11       0.09       1.22                  1.11          

                                     RFYR4 slope effect  0.09       0.09       1.04                  1.09          

                                     CTMAJOR slope       0.03       0.04       0.84                  1.03          
                                     effect                                                                        

                                     Covariance          -0.00      0.01       -0.14                               -1.00

                                     Control Intercept   0.61       0.11       5.84         \*       1.84          

                                     Control Slope       -0.37      0.08       -4.42        \*       0.69          

                                     Residual variance,  0.34       0.04       9.57         \*                     
                                     year 2                                                                        

                                     Residual variance,  0.09       0.02       4.61         \*                     
                                     year 3                                                                        

                                     Residual variance,  0.34       0.03       10.06        \*                     
                                     year 4                                                                        

                                     Residual variance,  0.30       0.03       8.89         \*                     
                                     intercept                                                                     

                                     Residual variance,  0.00       0.00       0.07                                
                                     slope                                                                         
  -------------------------------------------------------------------------------------------------------------------------

**[Second Grade Spanish Analyses]{.underline}**

***Total Reading*** Outcome

  -------------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*        *Effect*         *un_est*   *un_se*   *un_ratio*   *sig*   *oddsratio*   *corr*
  --------- ------------ ---------------- ---------------- ---------- --------- ------------ ------- ------------- --------
  2         Spanish      Total Reading    RFYR1 intercept  -2.03      0.41      -5.00        \*      0.13          
                                          effect                                                                   

                                          RFYR2 intercept  -0.19      0.35      -0.54                0.83          
                                          effect                                                                   

                                          RFYR3 intercept  -0.16      0.19      -0.85                0.85          
                                          effect                                                                   

                                          RFYR4 intercept  0.02       0.16      0.15                 1.02          
                                          effect                                                                   

                                          CTMAJOR          0.66       0.10      6.53         \*      1.93          
                                          intercept effect                                                         

                                          RFYR2 slope      -0.34      0.30      -1.13                0.71          
                                          effect                                                                   

                                          RFYR3 slope      -0.12      0.12      -0.99                0.88          
                                          effect                                                                   

                                          RFYR4 slope      -0.12      0.10      -1.21                0.89          
                                          effect                                                                   

                                          CTMAJOR slope    -0.08      0.05      -1.61                0.92          
                                          effect                                                                   

                                          Covariance       0.11       0.03      4.08         \*                    0.54

                                          Control          2.01       0.17      11.81        \*      7.49          
                                          Intercept                                                                

                                          Control Slope    0.23       0.10      2.27         \*      1.26          

                                          Residual         0.00       0.00      0.00                               
                                          variance, year 1                                                         

                                          Residual         0.98       0.11      9.31         \*                    
                                          variance, year 2                                                         

                                          Residual         0.34       0.06      5.69         \*                    
                                          variance, year 3                                                         

                                          Residual         0.00       0.00      0.01                               
                                          variance, year 4                                                         

                                          Residual         0.52       0.08      6.68         \*                    
                                          variance,                                                                
                                          intercept                                                                

                                          Residual         0.08       0.02      5.17         \*                    
                                          variance, slope                                                          
  -------------------------------------------------------------------------------------------------------------------------

***Reading Comprehension*** Outcome

  --------------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*         *effect*         *un_est*   *un_se*   *un_ratio*   *sig*   *oddsratio*   *corr*
  --------- ------------ ----------------- ---------------- ---------- --------- ------------ ------- ------------- --------
  2         Spanish      Comprehension     RFYR1 intercept  -1.86      0.40      -4.69        \*      0.16          
                                           effect                                                                   

                                           RFYR2 intercept  -0.13      0.33      -0.39                0.88          
                                           effect                                                                   

                                           RFYR3 intercept  -0.22      0.18      -1.21                0.81          
                                           effect                                                                   

                                           RFYR4 intercept  -0.03      0.15      -0.20                0.97          
                                           effect                                                                   

                                           CTMAJOR          0.63       0.10      6.61         \*      1.89          
                                           intercept effect                                                         

                                           RFYR2 slope      -0.32      0.31      -1.05                0.72          
                                           effect                                                                   

                                           RFYR3 slope      -0.14      0.12      -1.26                0.87          
                                           effect                                                                   

                                           RFYR4 slope      -0.14      0.09      -1.52                0.87          
                                           effect                                                                   

                                           CTMAJOR slope    -0.13      0.05      -2.58        \*      0.88          
                                           effect                                                                   

                                           Covariance       0.09       0.03      3.76         \*                    0.55

                                           Control          1.94       0.16      12.29        \*      6.97          
                                           Intercept                                                                

                                           Control Slope    0.24       0.09      2.53         \*      1.27          

                                           Residual         0.11       0.09      1.33                               
                                           variance, year 1                                                         

                                           Residual         0.73       0.09      8.46         \*                    
                                           variance, year 2                                                         

                                           Residual         0.27       0.05      5.50         \*                    
                                           variance, year 3                                                         

                                           Residual         0.00       0.00      0.00                               
                                           variance, year 4                                                         

                                           Residual         0.46       0.07      6.27         \*                    
                                           variance,                                                                
                                           intercept                                                                

                                           Residual         0.06       0.02      4.02         \*                    
                                           variance, slope                                                          
  --------------------------------------------------------------------------------------------------------------------------

***Word Reading/Vocabulary*** Outcome

  --------------------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*            *effect*          *un_est*   *un_se*    *un_ratio*   *sig*    *oddsratio*   *corr*
  --------- ------------ -------------------- ----------------- ---------- ---------- ------------ -------- ------------- --------
  2         Spanish      Word                 RFYR1 intercept   -0.10      1.00       -0.10                 0.90          
                         Reading/Vocabulary   effect                                                                      

                                              **RFYR2 intercept **0.38**   **0.34**   **2.11**     **\***   1.46          
                                              effect**                                                                    

                                              RFYR3 intercept   0.24       0.18       1.35                  1.27          
                                              effect                                                                      

                                              **RFYR4 intercept **0.30**   **0.15**   **2.00**     **\***   1.35          
                                              effect**                                                                    

                                              CTMAJOR intercept 0.42       0.10       4.38         \*       1.52          
                                              effect                                                                      

                                              **RFYR2 slope     **0.35**   **0.39**   **1.97**     **\***   1.42          
                                              effect**                                                                    

                                              **RFYR3 slope     **0.32**   **0.13**   **2.49**     **\***   1.38          
                                              effect**                                                                    

                                              **RFYR4 slope     **0.26**   **0.12**   **2.22**     **\***   1.29          
                                              effect**                                                                    

                                              CTMAJOR slope     -0.13      0.05       -2.46        \*       0.88          
                                              effect                                                                      

                                              Covariance        0.11       0.03       3.96         \*                     0.67

                                              Control Intercept 1.47       0.15       9.56         \*       4.36          

                                              Control Slope     -0.26      0.12       -2.28        \*       0.77          

                                              Residual          0.41       0.15       2.77         \*                     
                                              variance, year 1                                                            

                                              Residual          0.23       0.07       3.05         \*                     
                                              variance, year 2                                                            

                                              Residual          0.25       0.05       5.20         \*                     
                                              variance, year 3                                                            

                                              Residual          0.00       0.00       0.00                                
                                              variance, year 4                                                            

                                              Residual          0.50       0.06       7.82         \*                     
                                              variance,                                                                   
                                              intercept                                                                   

                                              Residual          0.05       0.02       3.01         \*                     
                                              variance, slope                                                             
  --------------------------------------------------------------------------------------------------------------------------------

***Graphophonemic Knowledge End of Year Benchmark***

  --------------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*   *effect*            *un_est*    *un_se*    *un_ratio*   *sig*    *oddsratio*   *corr*
  --------- ------------ ----------- ------------------- ----------- ---------- ------------ -------- ------------- --------
  2         Spanish      Domain GK   **RFYR2 intercept   **-1.12**   **0.41**   **-2.72**    **\***   0.33          
                                     effect**                                                                       

                                     RFYR3 intercept     -0.22       0.20       -1.14                 0.80          
                                     effect                                                                         

                                     RFYR4 intercept     -0.13       0.17       -0.77                 0.88          
                                     effect                                                                         

                                     CTMAJOR intercept   0.52        0.11       4.97         \*       1.69          
                                     effect                                                                         

                                     **RFYR2 slope       **-1.40**   **0.52**   **-2.73**    **\***   0.25          
                                     effect**                                                                       

                                     **RFYR3 slope       **-0.32**   **0.16**   **-2.09**    **\***   0.72          
                                     effect**                                                                       

                                     **RFYR4 slope       **-0.31**   **0.14**   **-1.97**    **\***   0.81          
                                     effect**                                                                       

                                     CTMAJOR slope       -0.25       0.07       -3.52        \*       0.78          
                                     effect                                                                         

                                     Covariance          -0.02       0.06       -0.27                               -0.09

                                     Control Intercept   0.44        0.17       2.54         \*       1.55          

                                     Control Slope       0.40        0.14       2.83         \*       1.49          

                                     Residual variance,  0.17        0.12       1.38                                
                                     year 2                                                                         

                                     Residual variance,  0.30        0.06       5.26         \*                     
                                     year 3                                                                         

                                     Residual variance,  0.51        0.12       4.25         \*                     
                                     year 4                                                                         

                                     Residual variance,  0.36        0.10       3.56         \*                     
                                     intercept                                                                      

                                     Residual variance,  0.10        0.06       1.63                                
                                     slope                                                                          
  --------------------------------------------------------------------------------------------------------------------------

***Comprehension End of Year Benchmark***

  -----------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*   *effect*            *un_est*   *un_se*   *un_ratio*   *sig*   *oddsratio*   *corr*
  --------- ------------ ----------- ------------------- ---------- --------- ------------ ------- ------------- --------
  2         Spanish      Domain CO   RFYR2 intercept     0.16       0.43      0.38                 1.18          
                                     effect                                                                      

                                     RFYR3 intercept     -0.04      0.17      -0.22                0.96          
                                     effect                                                                      

                                     RFYR4 intercept     -0.13      0.14      -0.88                0.88          
                                     effect                                                                      

                                     CTMAJOR intercept   0.22       0.09      2.44         \*      1.25          
                                     effect                                                                      

                                     RFYR2 slope effect  0.21       0.98      0.22                 1.23          

                                     RFYR3 slope effect  -0.21      0.14      -1.58                0.81          

                                     RFYR4 slope effect  -0.23      0.12      -1.84                0.80          

                                     CTMAJOR slope       -0.23      0.07      -3.62        \*      0.79          
                                     effect                                                                      

                                     Covariance          0.07       0.06      1.22                               0.30

                                     Control Intercept   1.29       0.14      8.93         \*      3.62          

                                     Control Slope       0.36       0.12      2.95         \*      1.44          

                                     Residual variance,  0.12       0.11      1.12                               
                                     year 2                                                                      

                                     Residual variance,  0.30       0.06      4.75         \*                    
                                     year 3                                                                      

                                     Residual variance,  0.14       0.09      1.60                               
                                     year 4                                                                      

                                     Residual variance,  0.41       0.09      4.36         \*                    
                                     intercept                                                                   

                                     Residual variance,  0.14       0.05      2.74         \*                    
                                     slope                                                                       
  -----------------------------------------------------------------------------------------------------------------------

**[Third Grade English Analyses]{.underline}**

***Total Reading*** Outcome

  -------------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*        *effect*         *un_est*   *un_se*   *un_ratio*   *sig*   *oddsratio*   *corr*
  --------- ------------ ---------------- ---------------- ---------- --------- ------------ ------- ------------- --------
  3         English      Total Reading    RFYR1 intercept  -0.24      0.25      -0.94                0.79          
                                          effect                                                                   

                                          RFYR2 intercept  -0.31      0.19      -1.66                0.74          
                                          effect                                                                   

                                          RFYR3 intercept  -0.17      0.10      -1.64                0.85          
                                          effect                                                                   

                                          RFYR4 intercept  -0.09      0.09      -1.05                0.91          
                                          effect                                                                   

                                          CTMAJOR          -0.29      0.06      -4.53        \*      0.75          
                                          intercept effect                                                         

                                          RFYR2 slope      -0.13      0.14      -0.89                0.88          
                                          effect                                                                   

                                          RFYR3 slope      0.00       0.05      0.04                 1.00          
                                          effect                                                                   

                                          RFYR4 slope      0.11       0.04      2.80         \*      1.11          
                                          effect                                                                   

                                          CTMAJOR slope    -0.07      0.03      -3.02        \*      0.93          
                                          effect                                                                   

                                          Covariance       0.08       0.01      6.08         \*                    0.76

                                          Control          2.79       0.08      33.60        \*      16.35         
                                          Intercept                                                                

                                          Control Slope    0.06       0.04      1.58                 1.06          

                                          Residual         0.06       0.03      2.37         \*                    
                                          variance, year 1                                                         

                                          Residual         0.09       0.02      5.59         \*                    
                                          variance, year 2                                                         

                                          Residual         0.07       0.02      4.53         \*                    
                                          variance, year 3                                                         

                                          Residual         0.09       0.03      3.37         \*                    
                                          variance, year 4                                                         

                                          Residual         0.46       0.04      11.43        \*                    
                                          variance,                                                                
                                          intercept                                                                

                                          Residual         0.03       0.01      4.41         \*                    
                                          variance, slope                                                          
  -------------------------------------------------------------------------------------------------------------------------

***Graphophonemic Knowledge End of Year Benchmark***

  -------------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*   *effect*            *un_est*   *un_se*    *un_ratio*   *sig*    *oddsratio*   *corr*
  --------- ------------ ----------- ------------------- ---------- ---------- ------------ -------- ------------- --------
  3         English      Domain GK   RFYR1 intercept     0.31       0.45       0.69                  1.36          
                                     effect                                                                        

                                     RFYR2 intercept     -0.11      0.25       -0.43                 0.90          
                                     effect                                                                        

                                     RFYR3 intercept     0.25       0.18       1.37                  1.28          
                                     effect                                                                        

                                     **RFYR4 intercept   **0.45**   **0.18**   **2.56**     **\***   1.57          
                                     effect**                                                                      

                                     CTMAJOR intercept   -0.32      0.07       -4.51        \*       0.73          
                                     effect                                                                        

                                     RFYR2 slope effect  -0.04      0.25       -0.18                 0.96          

                                     RFYR3 slope effect  0.28       0.15       1.83                  1.32          

                                     RFYR4 slope effect  0.03       0.15       0.16                  1.03          

                                     CTMAJOR slope       -0.18      0.05       -3.85        \*       0.83          
                                     effect                                                                        

                                     Covariance          0.17       0.04       4.66         \*                     0.66

                                     Control Intercept   -0.76      0.17       -4.52        \*       0.47          

                                     Control Slope       0.36       0.15       2.41         \*       1.43          

                                     Residual variance,  0.36       0.06       6.18         \*                     
                                     year 2                                                                        

                                     Residual variance,  0.32       0.03       10.47        \*                     
                                     year 3                                                                        

                                     Residual variance,  0.14       0.05       2.68         \*                     
                                     year 4                                                                        

                                     Residual variance,  0.51       0.06       8.71         \*                     
                                     intercept                                                                     

                                     Residual variance,  0.13       0.03       4.39         \*                     
                                     slope                                                                         
  -------------------------------------------------------------------------------------------------------------------------

***Comprehension End of Year Benchmark***

  --------------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*   *effect*            *un_est*    *un_se*    *un_ratio*   *sig*    *oddsratio*   *corr*
  --------- ------------ ----------- ------------------- ----------- ---------- ------------ -------- ------------- --------
  3         English      Domain CO   RFYR1 intercept     -1.07       0.40       -2.66        \*       0.34          
                                     effect                                                                         

                                     **RFYR2 intercept   **-0.58**   **0.23**   **-2.52**    **\***   0.56          
                                     effect**                                                                       

                                     **RFYR3 intercept   **-0.51**   **0.16**   **-3.08**    **\***   0.60          
                                     effect**                                                                       

                                     **RFYR4 intercept   **-0.50**   **0.16**   **-3.09**    **\***   0.61          
                                     effect**                                                                       

                                     CTMAJOR intercept   0.11        0.06       1.64                  1.11          
                                     effect                                                                         

                                     RFYR2 slope effect  -0.43       0.24       -1.78                 0.65          

                                     RFYR3 slope effect  -0.17       0.16       -1.05                 0.85          

                                     RFYR4 slope effect  -0.21       0.16       -1.36                 0.81          

                                     CTMAJOR slope       0.08        0.05       1.49                  1.08          
                                     effect                                                                         

                                     Covariance          0.11        0.05       2.49         \*                     0.67

                                     Control Intercept   1.20        0.15       7.80         \*       3.31          

                                     Control Slope       0.26        0.15       1.67                  1.29          

                                     Residual variance,  1.36        0.12       11.79        \*                     
                                     year 2                                                                         

                                     Residual variance,  0.16        0.03       6.11         \*                     
                                     year 3                                                                         

                                     Residual variance,  0.13        0.06       2.27         \*                     
                                     year 4                                                                         

                                     Residual variance,  0.40        0.06       6.98         \*                     
                                     intercept                                                                      

                                     Residual variance,  0.07        0.04       1.89                                
                                     slope                                                                          
  --------------------------------------------------------------------------------------------------------------------------

**[Third Grade Spanish Analyses]{.underline}**

***Total Reading*** Outcome

  -------------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*        *effect*         *un_est*   *un_se*   *un_ratio*   *sig*   *oddsratio*   *Corr*
  --------- ------------ ---------------- ---------------- ---------- --------- ------------ ------- ------------- --------
  3         Spanish      Total Reading    RFYR2 intercept  -0.60      0.35      -1.70                0.55          
                                          effect                                                                   

                                          RFYR3 intercept  -0.32      0.17      -1.90                0.73          
                                          effect                                                                   

                                          RFYR4 intercept  -0.18      0.14      -1.32                0.84          
                                          effect                                                                   

                                          CTMAJOR          0.41       0.10      4.19         \*      1.51          
                                          intercept effect                                                         

                                          RFYR2 slope      -0.55      0.44      -1.26                0.58          
                                          effect                                                                   

                                          RFYR3 slope      0.05       0.10      0.46                 1.05          
                                          effect                                                                   

                                          RFYR4 slope      0.08       0.08      1.02                 1.08          
                                          effect                                                                   

                                          CTMAJOR slope    0.06       0.05      1.27                 1.06          
                                          effect                                                                   

                                          Covariance       0.09       0.02      3.59         \*                    0.66

                                          Control          2.35       0.14      16.91        \*      10.52         
                                          Intercept                                                                

                                          Control Slope    0.02       0.08      0.23                 1.02          

                                          Residual         0.00       0.00      0.00                               
                                          variance, year 1                                                         

                                          Residual         0.26       0.05      5.10         \*                    
                                          variance, year 2                                                         

                                          Residual         0.05       0.03      1.77                               
                                          variance, year 3                                                         

                                          Residual         0.14       0.10      1.44                               
                                          variance, year 4                                                         

                                          Residual         0.38       0.06      5.97         \*                    
                                          variance,                                                                
                                          intercept                                                                

                                          Residual         0.05       0.01      3.48         \*                    
                                          variance, slope                                                          
  -------------------------------------------------------------------------------------------------------------------------

***Graphophonemic Knowledge End of Year Benchmark***

  -----------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*   *effect*            *un_est*   *un_se*   *un_ratio*   *sig*   *oddsratio*   *Corr*
  --------- ------------ ----------- ------------------- ---------- --------- ------------ ------- ------------- --------
  3         Spanish      Domain GK   RFYR2 intercept     -0.01      0.77      -0.01                1.00          
                                     effect                                                                      

                                     RFYR3 intercept     0.34       0.51      0.67                 1.40          
                                     effect                                                                      

                                     RFYR4 intercept     0.74       0.49      1.51                 2.09          
                                     effect                                                                      

                                     CTMAJOR intercept   0.09       0.19      0.49                 1.10          
                                     effect                                                                      

                                     RFYR2 slope effect  -0.54      1.01      -0.53                0.59          

                                     RFYR3 slope effect  0.86       0.65      1.32                 2.36          

                                     RFYR4 slope effect  0.72       0.64      1.13                 2.05          

                                     CTMAJOR slope       -0.13      0.14      -0.94                0.88          
                                     effect                                                                      

                                     Covariance          0.21       0.15      1.43                               1.00

                                     Control Intercept   -1.92      0.46      -4.15        \*      0.15          

                                     Control Slope       -0.38      0.63      -0.60                0.69          

                                     Residual variance,  1.19       0.24      4.90         \*                    
                                     year 2                                                                      

                                     Residual variance,  1.18       0.19      6.10         \*                    
                                     year 3                                                                      

                                     Residual variance,  1.09       0.27      4.09         \*                    
                                     year 4                                                                      

                                     Residual variance,  1.25       0.29      4.39         \*                    
                                     intercept                                                                   

                                     Residual variance,  0.04       0.04      0.83                               
                                     slope                                                                       
  -----------------------------------------------------------------------------------------------------------------------

***Comprehension End of Year Benchmark***

  -----------------------------------------------------------------------------------------------------------------------
  *grade*   *language*   *outcome*   *effect*            *un_est*   *un_se*   *un_ratio*   *sig*   *oddsratio*   *Corr*
  --------- ------------ ----------- ------------------- ---------- --------- ------------ ------- ------------- --------
  3         Spanish      Domain CO   RFYR2 intercept     -0.25      0.55      -0.45                0.78          
                                     effect                                                                      

                                     RFYR3 intercept     -0.21      0.35      -0.59                0.81          
                                     effect                                                                      

                                     RFYR4 intercept     0.09       0.34      0.27                 1.10          
                                     effect                                                                      

                                     CTMAJOR intercept   0.16       0.13      1.18                 1.17          
                                     effect                                                                      

                                     RFYR2 slope effect  -0.35      0.82      -0.42                0.71          

                                     RFYR3 slope effect  0.17       0.57      0.30                 1.19          

                                     RFYR4 slope effect  0.24       0.57      0.42                 1.27          

                                     CTMAJOR slope       -0.32      0.10      -3.33        \*      0.73          
                                     effect                                                                      

                                     Covariance          0.15       0.10      1.61                               0.61

                                     Control Intercept   -0.04      0.32      -0.13                0.96          

                                     Control Slope       0.19       0.56      0.34                 1.21          

                                     Residual variance,  0.37       0.17      2.22         \*                    
                                     year 2                                                                      

                                     Residual variance,  0.35       0.07      5.16         \*                    
                                     year 3                                                                      

                                     Residual variance,  0.48       0.16      3.06         \*                    
                                     year 4                                                                      

                                     Residual variance,  0.63       0.14      4.35         \*                    
                                     intercept                                                                   

                                     Residual variance,  0.10       0.09      1.16                               
                                     slope                                                                       
  -----------------------------------------------------------------------------------------------------------------------