Source: https://nycrubberroomreporter.blogspot.com/2015_08_07_archive.html
Timestamp: 2019-04-22 16:04:32+00:00

Document:
A federal judge on Friday ruled that a new licensing exam for teachers given by New York State did not discriminate against minorities, saying that even though they tended to score poorly, the test evaluated skills necessary to do the job.
The ruling is a departure from earlier decisions by the same judge, Kimba M. Wood of Federal District Court in Manhattan, in which she threw out past certification exams. It also symbolizes a significant moment in a long-running tug of war between two policy goals in education: making tests for new teachers more rigorous, and increasing the diversity of the nation’s teaching force.
The exam, the Academic Literacy Skills Test, often called the ALST, was first given in the 2013-14 school year, and is meant to assess a potential teacher’s reading and evidence-based writing skills, and ability to master the Common Core standards for English.
In New York, the exam is one of four tests new teachers must take to become certified.
But some schools of education in New York complained that the literacy skills test was not a true measure of what makes a good teacher, and that many of their black and Hispanic students were failing it. An analysis last year found that 46 percent of Hispanic candidates and 41 percent of black candidates passed the test on the first try, while 64 percent of white candidates did so. Students may retake the exams.
More than 80 percent of the country’s public schoolteachers are white, according to the federal Education Department, and there has been a longstanding push to try to increase diversity among teachers, as minorities now account for more than half of the public school student population.
If an employment test has a disparate racial impact, courts have ruled that officials must prove that it measures skills crucial to the job at hand. Judge Wood had ruled that two earlier exams, both called the Liberal Arts and Sciences Test, had not met that standard. About 4,000 people who at some point were denied full teaching jobs in New York City because they had not passed those tests have filed claims seeking compensation as a result of those rulings.
Joshua Sohn, a partner at the firm Mishcon de Reya, who represents the prospective teachers in the case, echoed the that sentiment.
Bruce Lederman is representing his wife, Sheri Lederman, a fourth grade teacher in Great Neck, New York, in a legal challenge to New York State's teacher evaluation system. Several readers asked to see the court papers, and I will post some of the affidavits from nationally recognized experts in a day or two. For now, here is Bruce Lederman's explanation of the theory behind the legal claim on behalf of Sheri Lederman. The New York State Education Department sought to have the case dismissed without a hearing, but the state Supreme Court accepted the case. There will be oral arguments on August 12 at 10 a.m. in Albany in the court of Judge McDonough, 10 Eagle Street. If you are interested, please attend.
Several of your readers have asked for an explanation of the legal theories behind the Lederman v. King lawsuit. I am attaching the reply memorandum of law which explains in detail the evidence and expert opinions in the case, as well as the legal arguments at issue. I also attached reply expert and facts affidavits from Aaron Pallas (Columbia), Linda Darling-Hammond (Stanford), Audrey Amrein-Beardsley (ASU), and Sean Patrick Corcoran (NYU), Jesse Rothstein (Berkeley), Carol Burris, Sharon Fougner and myself (which has an important email exchange with Professor John Friedman, co-author of the widely cited Chetty, Friedman & Rockoff studies).
To summarize for your readers the legal theories, we are proceeding based upon three theories. First, seek to have Sheri’s Growth Score Rating of 1 out of 20 points declared null and void under New York law on the grounds that it is “arbitrary and capricious.” Under New York law, any actions by a State Agency (in this case the Dept. of Education) can be challenged as “arbitrary and capricious” which is generally defined by the Courts as irrational and unreasonable based upon the facts. Second, we are asserting that the New York Growth Model (a VAM program) actually violates the New York law because it does not measure growth as defined in Education Law §3012-c(2)(i), is also not transparent and available to teachers before the beginning of the school year as required by Education Law § 3012-c(2)(j)(1) and does not allow all teachers to get all points as required by Education Law § 3012-c(2)(j)(2). Third, we argue that if Sheri is not allowed to have the individual facts of her case reviewed and is rated by a computer program whose results are not reviewable by a human being base upon real life facts, then she has been denied due process of law in violation of the Constitution. We ask, rhetorically, is this 2001 a space odyssey where the computer is always right and common sense has gone out the window?
One specific thing we are challenging is that she got a growth score of 14 out of 20 in year 2012/13 and a growth score of 1 out of 20 in 2013/14, even though the proficiency of her students (i.e., Students whose scores meet or exceed state standards) was virtually identical and there is no rational explanation for such wild swings in scores year to year. Another thing her case illustrates is the problem of ceiling effect when teaching high performing students. For one student, she got a failing student growth percentile (SGP) of 27 out of 100 because the student got 60 out of 60 questions right on a 3rd grade test, and got 64 out of 66 questions right on his 4th grade test while in Sheri’s class. Even though the student was in the 98th percentile, the teacher was rated in the 27th percentile because a child got 2 questions wrong. Is that rational?
The issues of why New York’s Growth Model does not comply with the law is that the law tells the Department of Education to measure change in student achievement between two points in time. New York’s Growth Model does not do this because instead of measuring growth, it creates what we are calling a “survivor-type” competition where the computer predicts what children should do and evaluates teachers on a bell-curve for whose students met the computer predictions. There are many problems with this, most notably that the computer is comparing apples and oranges. The fact that a child got a score of 300 on a 3rd grade math test and a score of 295 on a 4th grade math test does not prove that the child did not learn substantial amounts in 4th grade. This is explained very well by Professor Aaron Pallas in his reply affidavit, which I highly recommend reading. Sheri and I suggest that all our experts provide important information and I suggest that people read their affidavits.
Another significant fact is a series of statistics located by Dr. Carol Burris. Dr. Burris found that there were wild swings in teacher ratings between 2012/13 and 2013/14 which made absolutely no sense. For example, Scarsdale, which is generally highly regarded, went from having 0% ineffective teachers and 13% highly effective teachers to 19% ineffective teachers and 0% highly effective teachers in one year. Something is obviously wrong. There are additional examples in Dr. Burris’ reply affidavit which your readers may find interesting.
Finally, a very important issue which is presented is the defense of New York State which claims that there are academic studies recommending the use of VAM-type programs for these types of high stakes teacher evaluations. All of our experts do a great job of explaining that there are no studies that suggest that VAM-type programs can accurately rate teachers in individual cases. Professor Sean Patrick Corcoran from NYU explains that studies have found that VAM is unbiased, not that it is accurate. New York’s Education Department is misunderstanding the difference in their position in our case. Professor Corcoran provides a simple example that if you throw darts at a dart board and always miss, but miss as much to the left as to the right, and as much to the top as to the bottom, you are not biased, but you are also neither precise nor accurate. Also, I had an interesting email exchange with John Friedman, co-author of the widely discussed Chetty, Friedman Rockoff studies where he readily acknowledged that his studies were only saying that VAM-type scores tend to be accurate “on average” which he explained means over the lifetime of teacher. He suggested considering VAM scores like a type of lifetime batting average in baseball. Professor Friedman specifically said that VAM scores can be too high or too low in any year, and that they may be wrong because a particular student had a bad day when the test was taken. Following this logic (which comes from one of the leading VA researchers) rating teachers based upon VAM generated scores is like rating a baseball player based upon a single randomly chosen at bat.
We are scheduled to have an oral argument on August 12, 2015, and are optimistic that the Judge will recognize that something is terribly wrong with New York’s Growth Model and the rating of 1 out of 20 points given to Sheri. We believe we have established that New York’s Growth Model (which it paid a contractor $3.48 million to develop) is a statistical black box which no rational person could find fair or accurate.
We thank all those who have supported us.
It also contains statements from Sheri Lederman's superintendent in Great Neck, New York, her principal, her former students, and parents, all testifying to her effectiveness as a teacher. It also includes an affidavit by an economist at AIR attempting to explain New York's method of calculating teacher effectiveness, defending Sheri Lederman's rating as ineffective.
Just reading all these affidavits should be enough to earn course credits at any college or university.
If Sheri Lederman should win, her victory will have statewide impact and even national impact.
If she should lose, it is the triumph of an incoherent and punitive status quo.
In the Matter of the Application of Sheri G. Lederman, Ed. D. Petitioner v. John B. King, Jr., Commissioner, New York State Education Department, Candace H. Shyer, Assistant Commissioner, office of State Assessment of the New York State Education Department Respondents to Declare Petitioner's Growth Score and Rating for the 2013-2014 School Year (Rating Petitioner as "Ineffective") to be Arbitrary and Capricious and an Abuse of Discretion.
Attorneys for Petitioner: Bruce Lederman, Esq., of Counsel, D'Agostino, Levine, Landesman & Lederman, LLP, New York, NY.
Attorney for Respondents: Colleen D. Galligan, Esq., Assistant Attorney General, Eric T. Schneiderman, Attorney General, State of New York, Albany, NY.
Measures ("growth measures") as implemented by the Office of Assessment are arbitrary and capricious and an abuse of discretion; and (3) permanently enjoining the use of said "growth measures" unless they are modified to rationally evaluate teacher performance. Respondents seek dismissal of the petition based upon petitioner's purported lack of standing. Specifically, respondents maintain that petitioner has not suffered a harm in fact.
Petitioner cross-moves for discovery and to supplement her petition. Respondents oppose the discovery relief but have not opposed the request to supplement the petition.
Petitioner is a fourth (4th) grade teacher employed by the Great Neck Public School District in the State of New York. She has been so employed since September of 1997. For the school year 2013-2014, she received a "growth score" of 1 out of a possible 20 points. Said score correlates to a rating of "Ineffective". The score/rating sheet with petitioner's 1 point score defines "Ineffective" as: "Results are well-below State average for similar students". For the school year 2012-2013, she received a "growth score" of 14 out of 20 points. Said score correlates to a rating of "Effective", defined as: "Results meet State average for similar students". Petitioner, via her counsel, confirmed with the New York State Education Department ("Education Department") that neither an administrative appeal nor an appeal to the Education Commissioner was available. The instant proceeding ensued.
Counsel for the parties appeared before the Part I Justice (Justice Platkin) as to the issues of temporary relief and discovery. Justice Platkin struck all temporary relief from the Order to Show Cause as well as the relief seeking discovery. The parties appeared before this Court for oral argument as to respondents' motion to dismiss and petitioner's cross-motion to conduct discovery.
of Association for a Better Long Is., Inc. v. New York State Dept. of Envtl. Conservation, 23 N.Y.3d 1, 6 ).1 The injury in fact component must rise above the level of conjecture or speculation (see, Matter of Animal Legal Defense Fund, Inc. v. Aubertine, 119 AD3d 1202, 1203 [3rd Dept. 2014]). Petitioner must demonstrate an actual legal stake in this litigation's outcome, meaning "an injury in fact worthy and capable of judicial resolution" (Matter of La Barbera v. Town of Woodstock, 29 A.D.3d 1054, 1055 [3rd Dept. 2006]).
Respondents maintain that petitioner's allegations are insufficient to confer standing because they do not allege an injury in fact. In support, respondents note that petitioner's 1 point "growth score" is confidential and cannot be disclosed even pursuant to a Freedom of Information Act request. Respondents also point out that petitioner is the only one publicizing her otherwise confidential "growth score". They further argue that petitioner's overall composite rating is "Effective" and that said rating would not give rise to any adverse employment or disciplinary actions. Finally, respondents characterize petitioner's claims of potential harm as highly speculative.
In opposition, petitioner asserts that the 1 point growth score has had a direct, personal adverse impact by: (1) lowering her overall Annual Professional Performance Review ("APPR") rating from Highly Effective to Effective; (2) impugning her reputation among certain parents; (3) de-faming her directly to her employer; (4) putting her ability to earn the designation of Master Teacher at risk as well as her eligibility for certain bonus pay; and (5) demoralizing her as a professional based on her prior track record of top ratings. In sum, petitioner maintains that she has a direct and personal stake in challenging her 1 point "growth score" because it directly and adversely affects her career, professional standing, reputation and self-image.
In reply, respondents re-emphasize the speculative and hypothetical nature of petitioner's purported injuries. Additionally, respondents note that petitioner is now improperly raising injuries that were not set forth in the petition. Finally, respondents argue that being demoralized is not a sufficiently real and concrete injury to warrant standing.
drop in her growth score from 14 points out of 20 (or 70 percent ) to 1 point out of 20 (or 5 percent ) from the 2012/2013 year to the 2013/2014 year. Said drop directly correlates to a drop in her growth score rating from "Effective" to "Ineffective". Additionally, said drop directly resulted in petitioner's drop in her APPR from "Highly Effective" to "Effective". The drastic, statistically significant drop in a component that makes up 20 percent of petitioner's 100 point annual rating strikes the Court as adequate to constitute an injury in fact. Additionally, respondents have not established that said injury in fact is either incapable or unworthy of judicial resolution. Accordingly, the Court finds that petitioner has adequately established the threshold issue of standing.
returned to the counsel for petitioner who is directed to enter this Decision and Order without notice and to serve respondents' counsel with a copy of this Decision and Order with notice of entry. The Court will transmit a copy of the Decision and Order to the County Clerk. The Court will retain the papers considered at this time. The signing of the Decision and Order and delivery of a copy of the Decision and Order shall not constitute entry or filing under CPLR Rule 2220. Counsel is not relieved from the applicable provisions of that rule respecting filing, entry and notice of entry.
Affirmation of Colleen D. Galligan, Esq., A.A.G., dated March 13, 2015.
1. Respondents' submissions make clear that respondents are solely arguing that petitioner has neither asserted nor suffered an injury in fact.
2. The Court notes that petitioner has already, without the benefit of the record, procured four expert affidavits wherein the authors conclude that respondents have acted irrationally herein as to the ratings, processes at calculating the ratings, etc.
3. Upon completion of the briefing schedule, the parties are directed to confer and submit to the Court four potential dates for oral argument.
4. Petitioner and respondents also submitted memoranda of law.
Suit challenges computer rating as "ineffective"
So how did it happen? The state uses a computer program to compare student growth based on standardized tests that are said to reflect the impact teachers have on their students over the course of a year. Lederman's students, although high achieving, were evaluated at a growth rating "well below average for similar students" with prior academic achievement and similar demographics, according to state teacher growth score definitions. Her own school district awarded her a perfect score in its evaluation.
"It's dehumanized us," she said of the teaching scores. "It really takes away my significance in terms of my human interaction with the kids and their parents and it's turned every one of us into nothing more than a number."
Her story is just one example of what some say can happen as the state continues to rely on a computerized scoring system to evaluate teachers. They worry the situation could worsen if Gov. Andrew Cuomo's proposals to rely more heavily on the growth tests in teacher evaluations is passed in his 2015 budget.
Spokesmen did confirm that there is an appeal process for teachers at Great Neck public schools specific to the district, but under state Education Law, teachers can only challenge the "substance of the annual professional performance review" and the district's adherence to the review process and implementation of the State Education Department's regulations. Teachers who receive an overall "ineffective" rating must submit an appeal to the superintendent, but the district can't evaluate or repeal the state's growth rating subcomponent.
Since Lederman's overall rating was effective and her "ineffective" score was in the growth subcomponent of her assessment, she cannot appeal.
It's not just the impact of this year's score that has Lederman concerned though.
Cuomo's plan to is to evenly split between the weight of in-person district observations of teachers and the computerized state test growth in teacher evaluations. Currently, the system bases 60 percent of the score on district observations, 20 percent on state growth evaluations and 20 percent on local testing.
"Last year, less than 1 percent of teachers in New York state were rated ineffective; but state test results show that statewide only 35.8 percent of our students in third through eighth grades were proficient in math and 31.4 percent were proficient in English Language Arts," Cuomo wrote in his budget proposal. "We must ask ourselves: How can so many of our students be failing if our teachers are all succeeding?"
The growth test uses a computer software program created by the American Institutes for Research that compares student test scores of one teacher to those of similar students across the state. The program — which has cost the state more than $3.4 million, according to State Education Department invoices — classifies and compares students based on similar demographics, prior academic history and learning classifications.
By comparing student performance in this way, the state test system "ensures that all educators have a chance to do well regardless of the composition of their schools or classrooms," according to the education department.
But the American Statistical Association in an April 2014 statement advised "wise use" of these "value-added models" like the growth rating system for teachers, especially when it comes to making high-stakes decisions like hiring and firing educators.
Bruce Lederman said his wife is publicly acknowledging that the state awarded her an "F" for her ability to help students grow when compared to those across the state.
And though Lederman typically deals with real estate and commercial litigation, he said it has been alarming to see how unwilling the State Education Department has been to even discuss the effect these ratings have on teachers. The Ledermans are currently setting up meetings with state legislators to get their story heard. They have had no response from the governor or the governor's office.
"We come at this from a very small piece of the puzzle, but since the governor has made (teacher evaluations) the centerpiece of the puzzle... it needs to be made known how inaccurate the tests are," Bruce Lederman said.
Sheri Lederman isn't the only teacher affected by low ratings. Her husband said he has received numerous calls from teachers across the state fighting the same battle but lacking the financial means — typically upward of six figures when entering into a lawsuit.
Educational organizations across the state want to throw out teacher evaluations based on standardized test scores, none more so than the New York State United Teachers union. NYSUT argues the governor's proposal places increased pressure on students and teachers whose achievement is dictated by a numerical test score. Others have said it relies on a flaky evaluation system that will turn teachers away from the profession.
But Lederman isn't giving up. She intends to have the scoring system removed from New York completely in an effort to keep teachers judged on qualities like confidence and critical thinking.
"You get to a point where if you're seeing something that's just wrong, I feel like, as Americans, we have an obligation to stand up and say something. It's a battle that I think has to be fought — not just for the teachers, but for the kids," Lederman said.
The state Education Department, with the approval of the Board of Regents, creates rules that school districts legally have to follow. But in doing so, the department has failed to follow the laws that tell it how to make these rules.
Over the past two years, the majority of the Education Department's rules have been temporary "emergency" rules, which then become permanent — but the vast bulk of these rules haven't been real emergencies at all. Typically, SED’s reason for the "emergency" is simply that it has run out of time to get something done, and following the legal requirements would take too long. So, SED fast tracks the rules’ adoption process by improperly labeling them as "emergency.” But the law is specific that an “emergency” is rare, and exists only when "necessary for the preservation of the public health, safety or general welfare," not simply because something is time-sensitive.
Why is this important? Because the legal process for SED to make rules, set forth in the State Administrative Procedure Act, ensures that the public has a right to offer input before rules are finalized, typically in a 45-day window. Also, SED must respond to each of the public’s comments. This is central to our democracy, as this is the only voice the public has in situations where non-elected officials, like the Board of Regents and the Education Department, which the board oversees, make binding rules.
The Board of Regents, which is supposed to set state education policy, and SED could have sought an extension to the Legislature’s deadline or presented an alternative vision for creating a better evaluation system. Instead, SED claimed "emergency" — a designation reserved for the “preservation of the general welfare," even though it was clear that there was no such threat — and pushed the rules through, without any opportunity for public give and take. For this reason, those emergency evaluation rules should be declared invalid.
In its follow-up efforts to make the emergency teacher evaluation rules permanent, SED still continues to disregard the law. The law requires that SED provide the public with critical information about how the rules were created, specifically identifying for the public "each scientific or statistical study, report or analysis that served as the basis for the rule … and the name of the person that produced each study, report or analysis."
What research, if any, supports the new teacher evaluation rules is at the heart of the public’s concerns. But instead of providing what the law requires, SED offers only the following non-response: "The statute requires the Commissioner to adopt regulations necessary to implement the new evaluation system for teachers and principals by June 30, 2015, after consulting with experts and practitioners in the fields of education, economics and psychometrics." SED fails to provide what the law demands, and instead, merely acknowledges its obligation to consult with experts.
The time has come for the Board of Regents and SED to follow the law, to stop claiming false “emergencies,” and to provide the essential information the law clearly requires. The time is particularly ripe because New York has a new Education Commissioner, MaryEllen Elia, who the public is very much hoping will operate in the kind of collaborative and transparent manner that has been lacking from that post. More specifically, she should immediately call to halt the new evaluation rules, and allow experts to create a viable, research-based plan, that provides the best for children. She should further declare that “emergency” rule-making will no longer be the norm, and will only be used in the narrow categories allowed by law. And she should ensure that the public is informed of all the details that the law requires.
By doing so, Commissioner Elia will not only make huge strides in gaining the trust and respect of a discouraged public, but she will be doing the right thing for New York's millions of public school students and for their teachers.
The writer, a lawyer, is co-president of the Hastings on Hudson PTSA and co-chair of the New York Suburban Consortium for Public Education.

References: v. 
 §3012
 § 3012
 § 3012
 v. 
 v. 
 v. 
 v.