Case Name: THE ASSOCIATION OF MEXICAN-AMERICAN EDUCATORS; California Association for Asian-Pacific Bilingual Education, on behalf of themselves, their members, and all others similarly situated; Oakland Alliance Of Black Educators, on behalf of themselves, their members, and all others similarly situated; Sara Macneil Boyd; Sam Genis; Toua Yang; Bob Williams; Marta Leclaire; Antoinette Williams; Diana Kwan and Agnes Haynes, on behalf of themselves and all others similarly situated, Plaintiffs-Appellants-Cross-Appellees, v. STATE OF CALIFORNIA; The California Commission on Teacher Credentialing, Defendants-Appellees-Cross-Appellants
Court: United States Court of Appeals for the Ninth Circuit
Jurisdiction: United States
Decision Date: 1999-07-12
Citations: 195 F.3d 465
Docket Number: Nos. 96-17131, 97-15422
Parties: THE ASSOCIATION OF MEXICAN-AMERICAN EDUCATORS; California Association for Asian-Pacific Bilingual Education, on behalf of themselves, their members, and all others similarly situated; Oakland Alliance Of Black Educators, on behalf of themselves, their members, and all others similarly situated; Sara Macneil Boyd; Sam Genis; Toua Yang; Bob Williams; Marta Leclaire; Antoinette Williams; Diana Kwan and Agnes Haynes, on behalf of themselves and all others similarly situated, Plaintiffs-Appellants-Cross-Appellees, v. STATE OF CALIFORNIA; The California Commission on Teacher Credentialing, Defendants-Appellees-Cross-Appellants.
Judges: Before: ROBERT BOOCHEVER and ANDREW J. KLEINFELD, Circuit Judges, and STEPHEN V. WILSON, District Judge.
Reporter: Federal Reporter 3d Series
Volume: 195
Pages: 465–501

Head Matter:
THE ASSOCIATION OF MEXICAN-AMERICAN EDUCATORS; California Association for Asian-Pacific Bilingual Education, on behalf of themselves, their members, and all others similarly situated; Oakland Alliance Of Black Educators, on behalf of themselves, their members, and all others similarly situated; Sara Macneil Boyd; Sam Genis; Toua Yang; Bob Williams; Marta Leclaire; Antoinette Williams; Diana Kwan and Agnes Haynes, on behalf of themselves and all others similarly situated, Plaintiffs-Appellants-Cross-Appellees, v. STATE OF CALIFORNIA; The California Commission on Teacher Credentialing, Defendants-Appellees-Cross-Appellants.
Nos. 96-17131, 97-15422.
United States Court of Appeals, Ninth Circuit.
Argued and Submitted Nov. 5, 1997.
Decided July 12, 1999.
Amended Oct. 28, 1999,
John T. Affeldt, Public Advocates, Inc., San Francisco, California, for plaintiffs-appellants-cross-appellees The Association of Mexican-American Educators, et al.
Stephanie Wald (briefed), Deputy Attorney General, San Francisco, California, for defendants-appellees-cross-appellants The State of California and The California Commission On Teacher Credentialing.
R. Lawrence Ashe, Jr., Paul, Hastings, Janofsky & Walker, Atlanta, Georgia, for defendants-appellees-cross-appellants The State of California and The California Commission On Teacher Credentialing.
Peter Ross (briefed), META, Inc., San Francisco, CA, for amicus California Association for Bilingual Education, Educational coalition for Hispanics in Oakland and Chicano Federation of San Diego County, Inc.
Paul J. Dostart (briefed), Dostart, Clapp, Sterrett & Coveney, San Diego, CA, for amicus California Federation of Teachers.
Stewart Weinberg (briefed), Van Bourg, Weinberg, Roger & Rosenfeld, Oakland, CA, for amicus California Federation of Teachers.
Martin Bienstock (briefed), United States Attorney General’s Office, New York, New York, for amicus The New York State Education Department, The Alabama State Department, and the States of Oregon and Nevada.
John L. Bukey (briefed), West Sacramento, California, for amicus Education Legal Alliance.
Before: ROBERT BOOCHEVER and ANDREW J. KLEINFELD, Circuit Judges, and STEPHEN V. WILSON, District Judge.
The Honorable Stephen V. Wilson, United States District Judge for the Central District of California, sitting by designation.

Opinion:
Opinion by Judge WILSON; Dissent by Judge BOOCHEVER.
WILSON, District Judge:
Plaintiff class of minority educators appeals the District Court's finding that the Defendant California Commission on Teacher Credentialing's CBEST exam did not violate Title VI or Title VII of the 1964 Civil Rights Act ("Plaintiffs' Appeal"). Defendants cross-appeal the District Court's earlier finding on summary judgment that Title VI and Title VII apply to California's credentialing of public school teachers, and appeal the District Court's denial of their costs ("Defendants' Appeal").
I. Facts and Procedural History
Effective February 1, 1983, the California State Legislature amended the California Education Code to bar the California Commission for Teacher Preparation and Licensing ("CTPL") from issuing any credential, permit, or certificate to any applicant unable to demonstrate basic reading, writing and mathematics skills in the English language as measured by a basic skills proficiency test. Association of Mexican-American Educators v. State of California, 836 F.Supp. 1534, 1538 (N.D.Cal.1993) ("AMAE I"). In May 1983, after three test administrations, the CTPL assumed full responsibility for revising and administering the CBEST. AMAE I, 836 F.Supp. at 1539.
The United States has long provided California, through its Board of Education ("Board"), with financial assistance for educational purposes; it is undisputed that the Board has received such federal financial assistance continuously since 1983. AMAE I, 836 F.Supp. at 1537. During that same time period, the California Department of Education ("DOE") has distributed most of that federal money to local school boards. Id.
At the same time, however, neither the CPTL nor its successor the CTC have received any federal funds. AMAE I, 836 F.Supp. at 1538. Indeed, the District Court found that in the entire history of California's credentialing authorities, the federal government has provided financial assistance only to one project and that aid for that project ceased in 1979. Id.
Proportionately more of the minorities taking the CBEST have failed it, compared to Caucasians. This pattern appeared in the first administration of the test and has persisted. The Plaintiff class of minority educators brought suit to enjoin the use of the CBEST, alleging that it has a disproportionate adverse impact on racial minorities, that the Defendants failed to properly validate the test, and that the Defendants failed to adopt equally effective screening procedures with a lesser adverse impact.
In 1993, the District Court ruled on summary judgment that both Title VI and Title VII applied to the Commission's use of the CBEST as an employment screening device. Association of Mexican-American Educators v. State of California, 836 F.Supp. 1534 (N.D.Cal.1993) ("AMAE I"). Following a bench trial, in 1996 the District Court held (1) that Plaintiffs had established a prima facie case by showing that the CBEST has a disparate impact on minorities; (2) that all three studies of the CBEST submitted to the court proved it to be a valid measure of job-related skills; (3) that the passing score reflected professionally reasonably judgments about minimum skill levels of basic knowledge, skills and abilities for teaching jobs; and (4) that Plaintiffs had failed to show the existence of an equally effective alternate screening device. Association of Mexican-American Educators v. State of California, 937 F.Supp. 1397 (N.D.Cal.1996) ("AMAE II"). The District Court subsequently denied the Defendants' costs in an Order filed on February 12,1997 ("Order").
On appeal, Plaintiffs contend that the District Court erred in holding that the CBEST was properly validated, and that the court violated Federal Rule of Evidence 706 by relying upon the advice of an expert witness who was' not subject to cross-examination and did not prepare an expert's report. The Defendants contend that the District Court erred in holding that Title VI and Title VII apply to its administration of the CBEST, and that it abused its discretion when it denied their costs of $216,443.67.
We review de novo the district court's summary judgment ruling that Title VI and Title VII apply to the Commission's testing activities and review the District Court's factual findings for clear error. Under those standards, we conclude that Title VI and Title VII do not apply to the Commission's administration of the CBEST and we therefore grant Defendants' Appeal. As an alternative ground for upholding the District Court's judgment, we find that the District Court's factual findings were not clearly in error and we therefore deny Plaintiffs' Appeal. However, because we conclude that a court may only deny a prevailing party all costs when the party has engaged in misconduct, we remand the case to the District Court to reconsider Defendants' application for costs.
II. Legal Analysis
A. Standard of Review
We review de novo the District Court's conclusion of law that Title VI and Title VII apply to the Commission's testing activities, Bagdadi v. Nazar, 84 F.3d 1194, 1197 (9th Cir.1996), and review the District Court's factual findings for clear error. Clady v. County of Los Angeles, 770 F.2d 1421, 1427 (9th Cir.1985).
B. Application of Title VI to the CBEST
1. General Applicability of Title VI
Title VI was originally passed as part of the 1964 Civil Rights Act, and it contains a prohibition on the use of federal dollars to subsidize racial discrimination:
No person in the United States shall, on the ground of race, color, or national origin, be excluded from participation in, or be denied the benefits of, or be subject to discrimination in any program or activity receiving Federal financial assistance.
42 U.S.C.A. § 2000d.
The purpose of Title VI is clear: Congress wanted to avoid the use of federal resources to support discriminatory practices and it wanted to provide effective protection against those practices. Cannon v. University of Chicago, 441 U.S. 677, 704 n. 36, 99 S.Ct. 1946, 60 L.Ed.2d 560 (1979).
In the Civil Rights Restoration Act of 1987, Congress amended Title VI to include a definition of "program or activity." As amended, Title VI provides that:
For the purposes of this subchapter, the terms "program or activity" and the term "program" mean all of the operations of —
(1)(A) a department, agency, special purpose district, or other instrumentality of a State or of a local government; or
(B) the entity of such State or local government that distributes such assistance and each such department or agency (and each other State or local 'government entity) to which the assistance is extended, in the case of assistance to a State or local government; or
(2) (A) a college, university, or other postsecondary institution, or a public system of higher education; or
(B) a local educational agency (as defined in section 8801 of Title 20), system of vocational education, or other school system; or
(3)(A) .
(4) any other entity which is established by two or more of the entities described in paragraph (1), (2), or (3);
any part of which is extended Federal financial assistance.
42 U.S.C.A. § 2000d-4a.
In other words, the definition of "program or activity" provided by Con gress means that if any part of a listed entity receives federal funds, the entire entity is covered by Title VI. Grimes v. Superior Home Health Care, 929 F.Supp. 1088, 1092 (M.D.Tenn.1996).
2. Application of Title VI to the CTC: Title VI Does Not Apply to the CTC Simply By Virtue of Its Existence as Part of the "Public School System" in California because the term "School System" Is Used More Expansively By The California State Constitution Than by 42 U.S.C.A. § 2000d-4a(2)(B)
The District Court's Order of August 25, 1993 found that neither the CTC nor its predecessor, the CTPL, had received federal funds after January 1, 1980. AMAE I, 836 F.Supp. at 1538. The District Court went on to observe that — although not a direct recipient of federal funds — the CTC could nevertheless be liable under Title VI if it was a part of a school system and any part of that system received federal funds. Id. at 1544 (citing 42 U.S.C.A. § 2000d-4a(2)(B)). Reviewing the structure of public education in California, the District Court held that public education in California was, in fact, a single school system and that as a State agency concerned with education, the CTC was a part of that single school system. Id. at 1544-45. Since public education in California receives federal funds, the District Court held that CTC was therefore "part of a 'school system' referred to in subsection (2)(B)" of § 2000d-4a. Id. at 1544.
In concluding that public education in California is part of a single school system, the District Court placed particular emphasis on a provision from the California State Constitution, which refers to public education in California as "the Public School System." AMAE I, 836 F.Supp. at 1544 (citing Cal. Const., art. IX, § 6, ¶ 2 ). Although the Defendants below apparently argued that the CTC was outside of the "Public School System," the District Court rejected the argument. Looking both to the Constitutional provision itself and to the state decisions interpreting that provision, the District Court concluded that the California State Constitution establishes an "entire, unified school system" and that such a system included regulatory bodies like the CTC and the Board of Education. AMAE I, 836 at 1544 (citing Kennedy v. Miller, 97 Cal. 429, 432, 32 P. 558 (1893) and California Teachers Ass'n v. Board of Trustees, 82 Cal.App.3d 249, 253-54, 146 Cal.Rptr. 850 (1978)).
We do not disagree with the District Court's conclusion that the CTC falls within the "Public School System" established by the California Constitution. We do, however, disagree with a critical assumption apparently made by the parties. We do not assume that the "Public School System" defined by the California Constitution necessarily qualifies as the sort of "school system" to which Congress referred in § 2000d-4a(2)(B). In other words, we do not assume that the term "school system" is used in the same manner by Congress and the California State Constitution. As a result, we must determine whether the whole edifice of public education in the State of California would qualify under the federal definition of "school system" embodied in § 2000d-4a(2)(B).
To begin, we must determine the appropriate definition of "school system" as used in subsection (2)(B) of § 2000d-4a. For this purpose, we start with the language of the statute. As quoted above, § 2000d-4a(2)(B) applies to the operations of:
a local educational agency (as defined in section 8801 of Title 20), system of vocational education, or other school system.
42 U.S.C.A. § 2000d-4a(2)(B).
Of the three terms included in subsection (2)(B), "local educational agency" is both the only defined term and the only term to which any substantial jurisprudence has attached. To understand the meaning of subsection (2)(B), then, we naturally begin by looking to the definition and history of the term "local educational agency." Pursuant to Section 8801 of Title 20, that term is defined as:
a public board of education or other public authority legally constituted within a State for either administrative control or direction of, or to perform a service function for, public elementary or secondary schools in a city, county, township, school district, or other political subdivision of a State, or for such combination of school districts or counties as are recognized in a State as an administrative agency for its public elementary or secondary schools.
The term includes any other public institution or agency having administrative control and direction of a public elementary or secondary school.
20 U.S.C.A. § 8801(18)(A-B).
We also observe that 20 U.S.C.A. § 8801 contains a definition for a "State educational agency," which it describes as "the agency primarily responsible for the State supervision of public elementary and secondary schools." 20 U.S.C.A. § 8801(28).
The distinction between "local educational agency" and "State educational agency" is important in this case. It is true that the definition of "local educational agency," read broadly, could include any agency that had any regulatory control over a public school. However, such an expansive reading would ignore the fact that Congress has drawn a distinction between the State educational agencies that regulate schools and the local educational agencies that administer those schools. Los Angeles Branch NAACP v. Los Angeles Unified Sch. Dist., 714 F.2d 946, 951 (9th Cir.1983) (observing that an "educational agency" is either a "local educational agency" or a "State educational agency"); United States v. City of Yonkers, 96 F.3d 600, 619 (2d Cir.1996) (same). This distinction is well established in the structure of numerous federal educational statutes that place different requirements on State educational agencies and local educational- agencies. See, e.g., 20 U.S.C.A. § 1414(a) (providing for local educational agencies to submit applications to State educational agencies under Education of the Handicapped Act); 20 U.S.C.A. § 1103c (same for Teacher Corps); 20 U.S.C.A. § 1415(c) (providing for review by State educational agency of decisions by local educational agency); Beard v. Teska, 31 F.3d 942, 954 (10th Cir.1994) (distinguishing between "local educational agencies" and "State educational agencies"). After reviewing the statutory roles of State educational agencies and local educational agencies and the case law relating to those roles, it is apparent that "local educational agencies" are those which actually administer the local schools.
In determining what constitutes an agency which actually administers the local schools, the Court is required to look to state law and practice to determine what entity is "recognized in a State as an administrative agency for its public elementary or secondary schools." 20 U.S.C.A. § 8801(18)(A-B). In this case, notwithstanding the State Constitutional provision that public education is a part of "the Public School System," we find that public schools in the State of California are administered by school districts. Such school districts are responsible for the receipt and payment of bills and debts, and maintain their own accounting and payroll procedures. School districts purchase their own supplies, equipment, and transportation units. They separately negotiate employment agreements and separately hire, pay, and oversee the employees who teach and administer California's public schools. School districts not only manage the schools on a daily basis, they also plan and execute the acquisition, management, and disposal of facilities. They are responsible for the safety and security conditions in their schools. In short, the school districts — and not the entire edifice of public education in California — -constitute the primary agencies which manage schools within the meaning of "local educational agency" as used in 20 U.S.C.A. § 8801(18).
Of course, neither the parties nor the District Court have asserted that the California "Public School System" is a "local educational agency" within the meaning of § 8801 and it might seem obvious that it is not. Nevertheless, we think this discussion is important because we think that it sheds light on the proper interpretation of § 2000d-4a(2)(B).
Looking at the structure of § 2000d-4a(2)(B), it appears to us that Congress meant to expand "program or activity" to all activities within administrative units like school districts. Aside from the catchall phrase, to which we will turn momentarily, § 2000d-4a(2)(B) speaks only of "local educational agencies" and "systems of vocational education." We have just dis cussed the limitations inherent in "local educational agency" and we think that the same limitation is obviously inherent in "system of vocational education." By a "system of vocational education" Congress meant any set of vocational schools or programs that were administered by a central body, with management over supplies, facilities, and personnel. It is naturally possible (particularly in a smaller state) that a system of vocational education could be a statewide system, but such a system would still be a discrete system whose management characteristics are similar to school districts.
We think that the catch-all term "other school system" cannot be interpreted independently, but must be interpreted in the context of the previous two terms. In determining whether something qualifies as an "other school system" within the meaning of § 2000d-4a(2)(B), we do not simply ask whether it calls itself a "school system." Labels alone are frequently misleading. Instead, we must ask whether its essential characteristics are similar enough to those school systems addressed above that we would consider them a single unit for practical purposes. For example, an educational authority which focused upon adult education might not call itself a "school system" but might nevertheless operate with the sort of centralized management akin to a school district. Likewise, a private or religious entity might run a group of schools which operate with the sort of centralized management akin to a school district. By contrast, a loosely-affiliated group of private schools might refer to themselves as a "school system" for the purpose of creating a sports league, but we would think it clear that this alone, without more, would not subject every facet of every school in the league to Title VI if one school alone received Federal funds. Indeed, the Supreme Court has very recently made clear that not even the league itself is subject to Title VI merely because one member of the league received federal funds. National Collegiate Athletic Association v. Smith, 525 U.S. 459, 119 S.Ct. 924, 926, 142 L.Ed.2d 929 (1999). The critical issue is whether the schools are managed in relevant respects as a connected unit.
The legislative history of § 2000d-4a(2)(B) supports this conclusion. The Congressional Report on the Civil Rights Restoration Act of 1987 cautions that "[f]or two or more schools to be considered a 'school system', there must be some significant linkage between them. Thus, for example, any group of schools whose only connection to each other is that they belong to some umbrella advocacy or membership group, or that they are accredited by one central accrediting agency, would not constitute a school system." S.Rep. No. 100-64 at 17 (1987), reprinted in 1988 U.S.C.C.A.N. 3, 19 (emphasis added).
A second comment from the Report deserves attention here. The Report states that "[i]f federal financial assistance is extended to one of three secondary schools which comprise a system operated by a Catholic Diocese, all of the operations within all three of the schools in the sys tem are covered." Id. This follows naturally from the fact that such a system would be similar to a school district. We observe, however, that while Title VI coverage would be extended to the entire school system within that Diocese (which is traditionally a metropolitan area), such coverage would not be extended to all schools in the country under the auspices of the Catholic church, nor even all schools under the auspices of a particular Catholic Metropolitan (the Catholic organizational unit that is territorially equivalent to a State). From this we conclude that Title VI extends to all activities within a school district or its equivalent, regardless of whether the system calls itself a "school system" or not.
In the present case, we find that the State Constitutional requirement of a single "Public School System" in California does not mean that public education in California is a "school system" within the meaning of § 2000d-4a(2)(B). Although California requires that all of its public schools be chartered under State authority, Kennedy v. Miller, 97 Cal. 429, 436, 32 P. 558 (1893), the fact that they all derive from State power is not enough to make all such schools and school districts together a single "system" in the sense required for Title VI coverage. Cf. Gonzales v. State, 29 Cal.App.3d 585, 590, 105 Cal.Rptr. 804 (1972) (holding that while school districts exercise state power, they are each independent entities). As a consequence, we conclude that CTC is not covered by Title VI solely by virtue of its existence as part of the "Public School System" of the State of California.
3. Application of Title VI to the CTC: Title VI Does Not Apply to the CTC Simply by Virtue of Its Existence as Part of the State of California because Receipt of Federal Funds ' by One State Entity Does Not Automatically Subject the Entire State Government to Coverage.
Because the District Court found that § 2000d-4a(2)(B) resulted in coverage of the CTC under Title VI, the District Court declined to consider whether the CTC was covered under subsection (4) of § 2000d-4a. AMAE I, 836 F.Supp. at 1545 n. 8. As we have reached the opposite conclusion, we must proceed to consider whether § 2000d-4a(4) applies to the CTC.
As quoted above, § 2000d-4a(4) extends the definition of program or activity to "any other entity which is established by two or more of the entities described in paragraph (1), (2), or (3)." 42 U.S.C.A. § 2000d-4a(4). In essence, Plaintiffs allege that the State of California is subject to Title VI as a recipient of federal funds and that the CTC is covered under Title VI because the CTC is established by the State of California.
We disagree. Because the State itself cannot be considered a "program or activity" under § 2000d-4(a), only subsections of the State and not the State as a whole can be subject to Title VI. The CTC was not established by any subsection of the State subject to Title VI, and consequently the CTC is not covered under § 2000d-4a(4).
As laid out above, § 2000d-4a(l) extends the definition of "program or activity" to ah of the operations of "a department, agency, special purpose district, or other instrumentality of a State or local government" and to all of the operations of "the entity of such State or local government that distributes such assistance and each such department or agency (and each other State or local government entity) to which the assistance is extended." 42 U.S.C.A. § 2000d-4a(1)(A & B). In other words, § 2000d-4a(1) applies to any department or agency of the State which has received federal funds, whether the State entity receives such funds directly from the government or via another State entity-
At the same time, however, nothing in § 2000d-Ata would include the State, as such, in the enumeration of entities listed in the definition of "program or activity." This omission cannot be accidental. Although we could begin with the interpretive cannon, expressio unius, the structure of the statute is direct and conclusive proof that Congress did not mean to subject an entire State to Title VI. Congress went to great lengths in subsection (1)(B) to detail the fact that each department or agency of a State which received federal funds would be subject to Title VI, even if they received such funds via another agency. Subsection (1)(B) would be superfluous if receipt by one agency of the State subjected the entire State to Title VI, and we strive to avoid any construction that would render some of the statute superfluous. Burrey v. Pacific Gas and Elec. Co., 159 F.3d 388, 393 (9th Cir.1998). Congress simply could not have meant to extend Title VI to the entire State government because one department or agency received aid (even aid intended for the State).
Again, the legislative history supports our conclusion. The Congressional Report explicitly concluded that "[f]or State and local governments, only the department or agency which receives the aid is covered." S. Rep. 100-64 (1987), reprinted in 1988 U.S.C.C.A.N. 3, 6. Although this is an issue of first impression in our Circuit, other Circuits interpreting the Civil Rights Restoration Act have also come to this conclusion. Schroeder v. City of Chicago, 927 F.2d 957, 961 (7th Cir.1991); Lightbourn v. County of El Paso, Texas, 118 F.3d 421, 427 (5th Cir.1997). In sum, we hold that while Title VI may apply to any subsection of the State which receives federal funds, Title VI will not apply to the State as a whole simply because one subsection receives such funds.
The District Court found that "the United States has long provided the State, through its Board of Education, financial assistance for use in education." AMAE I, 836 F.Supp. at 1537. The District Court also found that "the California Department of Education ("DOE") has distributed most of that money to local school boards." Id. These findings indicate that the California Board of Education, the Department of Education, and the local school boards are all subject to Title VI under § 2000d-4a(1)(A) & (B). However, although the money may have been given to the Board of Education on behalf of the State, it is that agency and not the State as a whole which is covered by Title VI as a result.
The CTC was not created by the Board of Education, the Department of Education, or the local school boards. As a result, although such agencies are covered by Title VI, the CTC is not covered by virtue of § 2000d-4a(4).
In sum, we conclude that the Plaintiffs have not demonstrated that the CTC is covered by Title VI and we order the District Court to dismiss Plaintiffs' Title VI claim against the CTC.
4. Application of Title VI to California's Statutory Requirement that Prospective Teachers Pass the CBEST: As Neither the Legislature Nor the CTC Receives Federal Funding, Title VI Does Not Attach to the State's Requirement For Teacher Certification
Our conclusion in the previous section that the State of California is not automatically subject to Title VI compels the conclusion that the State of California is not liable under Title VI for imposing the CBEST as a statutory requirement for a public teacher's credential. The receipt of federal funds by the California Board of Education subjects the Board to Title VI, but it does not extend the coverage of Title VI into all of the operations of the entire State. Likewise, the receipt of federal funds by the California Department of Education subjects that Department to Title VI, but it does not extend coverage of Title VI into all operations of the entire State. In this case, the statutory requirement was imposed by the California Legislature. It is clear that Title VI coverage does not attach directly to the requirement as imposed by the Legislature.
As we have found that the CTC is not a covered program or activity, and as there is no evidence that the Legislature is a covered program or activity, no Title VI liability could possibly result from their actions.
C. Application of Title VII to the State Requirement that School Districts May Only Employ Credentialed Individuals
1. Title VII Applies to Relationships Between Government Employers and Government Employees
Title VII was also originally passed as part of the 1964 Civil Rights Act, and Title VII makes it "an unlawful employment practice for an employer . to fail or refuse to hire . any individual . because of such individual's race, color, religion, sex, or national origin." 42 U.S.C.A. § 2000e—2(a)(1). It is well established that Title VII applies "to governmental and private employers alike." Dothard v. Rawlinson, 433 U.S. 321, 332 n. 14, 97 S.Ct. 2720, 53 L.Ed.2d 786 (1977); Blake v. City of Los Angeles, 595 F.2d 1367, 1372 (9th Cir.1979).
2. Title VII Does Not Apply to the State's Requirement of the CBEST for Potential Teachers Because the CBEST is a Licensing Exam
Defendants argued below that the CBEST was part of the State's licensing process for public school teachers, relying upon the fact that Title VII does not apply to governmental licensing activities. See Haddock v. Board of Dental Exam'rs, 111 F.2d 462, 464 (9th Cir.1985) (holding that Title VII did not apply to licensing activities of California's Board of Dental Examiners).
Although the District Court agreed that Title VII does not apply to governmental licensing activities, AMAE I, 836 F.Supp. at 1549, the District Court concluded that the CBEST was not a licensing exam because it only licensed public school teachers. Id. The District Court observed that one could be a teacher in a private school without having passed the CBEST, and that the CBEST only stood as a barrier to employment in the State's "own schools." Id. For that reason, the District Court determined that "the CBEST is an examination that tests an individual's qualification for a job with a particular employer (the State), not an examination that tests minimal competence for the job of teaching." Id.
We agree with the District Court that, if the State requires an exam solely for its own employees, such an exam constitutes an employment exam. We also think it evident that Title VII applies even if the purpose of the exam is to improve the quality of the State's service to the public, because virtually any State employment exam could be cast as an attempt to improve the quality of the State's service to the public.
a. The CBEST Is Not an Employment Exam Because the State Is Not the Potential Employer
Nevertheless, we do not agree with the characterization of the CBEST as testing for a "particular employer (the State)," We note that, immediately after determining that the CBEST was an employment exam, the District Court then discussed the fact that teachers are not employed by the Defendants. AMAE I, 836 F.Supp. at 1550. The parties and the lower court agree that teachers are "employees" of the various school districts, rather than employees of the State or of the CTC. Id.
As such, we cannot agree that the State is the "employer" in this instance. We recognize that school districts in California are instrumentalities of the State, Belanger v. Madera Unified Sch. Dist., 963 F.2d 248, 251-54 (9th Cir.1992); First Interstate Bank of California v. State of California, 197 Cal.App.3d 627, 633, 243 Cal.Rptr. 8 (1987), but we view the relationship between school districts and the State as analogous to the par-enVsubsidiary relationship. It is well established that a parent company will not usually be considered the "employer" under Title VII for the employees of its subsidiary. Watson v. Gulf & Western, 650 F.2d 990, 993 (9th Cir.1981). It is likewise well-established in California that the school districts, although "exercising a portion of the state's powers of government, are not the state or a part of the state," Gonzales v. State of California, 29 Cal.App.3d 585, 590, 105 Cal.Rptr. 804 (1972), and that employees of the school districts are not employees of the State. Id. at 590-91, 105 Cal.Rptr. 804 (observing that employee "compensation is fixed by the district and not the state," that the employee "is paid by the district and not the state," that "the scope of his employment is determined by the district and not by the state," that "the right to control and supervise him is vested exclusively in the district by the state without reservation," and that "he may be discharged by the district for cause, and not by the state."); see also Norton Sound Health v. Bering Strait Sch. Dist., 138 F.3d 1281, 1284 (9th Cir.1998) (holding that, in applying federal statute, Alaska school districts constitute an "arm of the State" but not the "State" itself). As the State is not itself the potential employer for the Plaintiffs in this case, we do not believe'that the CBEST should be characterized as an employment exam.
b. The CBEST Is A Valid Licensing Exam Because The CBEST Is Required Under the State's Police Power and Not Its Proprietary Power
The question still remains whether the CBEST is a valid licensing exam. The District Court was of course cognizant of the fact that the school districts are the direct employers, and not the State. AMAE I, 836 F.Supp. at 1550. Nevertheless, the District Court found that the CBEST was not a licensing exam because it focused solely on public employees and not private employees. Id. at 1550.
We agree with the District Court that the limitation of the examination to public school teachers raises a question as to whether it is a true licensing exam. Nevertheless, we do not think that such a limitation is necessarily dispositive. Although previous federal courts to uphold teacher licensing exams have not discussed the consequences of the fact that such exams were restricted to public employees, see, e.g., Fields v. Hallsville Indep. Sch. Dist., 906 F.2d 1017 (5th Cir.1990), we think that the critical issue is whether the State is exercising its police powers or its proprietary powers. The clear principle behind the licensing exception is that a State will not be liable under Title VII for "interference" with an employment relationship if the alleged interference is an exercise of its regulatory responsibilities. See, e.g., George v. New Jersey Bd. of Veterinary Medical Exam'rs, 794 F.2d 113, 114 (3rd Cir.1986) (holding that Title VII does not reach licensing under police powers of a state).
Although a limitation of an examination to public employees will inevitably raise the question of whether the State is exercising its proprietary power, it does not inherently require such a conclusion. For example, imagine that the State were to conclude that criminal courts were frequently convicting indigent citizens because their defense attorneys were insufficiently versed in the law of the Fourth Amendment. Furthermore, imagine that the California Legislature were to pass a law addressed to this problem, requiring that all attorneys employed by public defender offices of the various cities or counties in California were required to pass an exam on the Fourth Amendment as a condition of employment.
We think that such an exam would be an exercise of the State's police power, and would therefore be a valid licensing exam despite the fact that it was not extended to private criminal defense attorneys. At least two factors would support such a conclusion. First, we would consider the fact that the requirements extend beyond State employees to all similar professionals in any public agency to be evidence that the State is employing its police power. Second, we would consider the fact that this requirement was mandated by the Legislature (rather than by an administrator responsible for managing the positions at issue) as providing additional evidence that the State is acting in its sovereign capacity rather than its proprietary capacity.
Returning to the CBEST exam, we think this is a very close question. Nevertheless, we think that the State is exercising its police powers and not its proprietary powers when it requires that public school teachers be certificated employees. First, although the public schools are in-strumentalities of the State under California law, California law establishes that teachers are not State employees. Gonzales v. State of California, 29 Cal.App.3d 585, 590-91, 105 Cal.Rptr. 804 (1972). Second, the CBEST was mandated by the Legislature and not an administrator or administrative agency responsible for overseeing the employees at issue. Although these factors are not necessarily dispositive, we find in this case that they tip the balance in favor of the Defendants. See generally Fields v. Hallsville Indep. Sch. Dist., 906 F.2d 1017, 1020 (5th Cir.1990) (holding that Texas teacher's exam did not make State of Texas into an employer and rejecting claim that the State of Texas was subject to Title VII liability for any effect of exam).
The District Court found that the CBEST was not a valid licensing exam, and that as such it constituted an actionable interference with the employment relationship. AMAE I, 836 F.Supp. at 1551 (citing Sibley Mem. Hosp. v. Wilson, 488 F.2d 1338 (D.C.Cir.1973)). As we conclude that it is a valid licensing exam, and therefore exempt from liability under Title VII, we need not decide whether Sibley would otherwise apply to this situation.
In sum, we conclude that Title VII does not apply to either the State of California or the CTC as them actions relate to the licensing of public school teachers in the State of California.
D. The District Court's Findings That the Test Was Discriminatory
Although our conclusion that Title VI and Title VII do not apply to the CBEST could resolve the case, we have reviewed the District Court's factual findings in response to Plaintiffs' Appeal and we find no reversible error in those factual findings. As such, we approve the District Court's factual findings as an alternative ground on which we affirm the District Court's judgment.
1. This Court Reviews Determinations on Test Validation Under the Clearly Erroneous Standard
As a general matter, this Court reviews a district court's determination of law de novo and determinations of fact for clear error. United States v. McConney, 728 F.2d 1195, 1202 (9th Cir.1984) (en banc). Where a determination is a mixed question of fact and law, the Court must decide whether the mixed question is predominately a legal determination or a factual determination. Id.
Although this Circuit has never discussed at length the appropriate standard of review for test validation, we have applied the clearly erroneous standard in the past. See, e.g., Clady v. County of Los Angeles, 770 F.2d 1421, 1434 (9th Cir.1985) (upholding district court where plaintiffs "failed to demonstrate that the [district] court's finding of job-relatedness was clearly erroneous"). In this respect, we are in accord with all of the circuits which have examined this issue. See, e.g., Bernard v. Gulf Oil Corp., 890 F.2d 735, 743 (5th Cir.1989); Hamer v. City of Atlanta, 872 F.2d 1521, 1526 (11th Cir.1989); Ensley Branch of N.A.A.C.P. v. Seibels, 616 F.2d 812, 818 (5th Cir.1980) (citing cases for clearly erroneous standard); Guardians Ass'n of New York City Police Dept., Inc. v. Civil Serv. Comm. of City of New York, 633 F.2d 232, 242 (2d Cir.1980); United States v. City of Chicago, 549 F.2d 415, 429 (7th Cir.1977); Kirkland v. New York State Dept. Of Correctional Servs., 520 F.2d 420, 426 (2d Cir.1975); see also Newark Branch, N.A.A.C.P. v. City of Bayonne, 134 F.3d 113, 120 (3rd Cir.1998) (citing Bernard for clearly erroneous standard); Melendez v. Illinois Bell Tel. Co., 79 F.3d 661, 669 (7th Cir.1996) (reviewing determination on validity of test under clearly erroneous analysis).
The question of whether a test has been appropriately validated is primarily a factual question. Although Plaintiffs argue that "validation" is a legal concept, the underlying determinations such a job-relatedness are factual determinations. The question of "validation" also depends upon other factual determinations such as the thoroughness and professionalism of the study. As such, this Court reviews test validity determinations under a clearly erroneous standard.
2. General Requirement of Test Validation
"Discriminatory tests are impermissible unless shown, by professionally acceptable methods, to be predictive of or significantly correlated with important elements of work behavior which comprise or are relevant to the job or jobs for which candidates are being evaluated." Albemarle Paper Co. v. Moody, 422 U.S. 405, 431, 95 S.Ct. 2362, 45 L.Ed.2d 280 (1975). In evaluating tests under Title VII that allegedly have a disparate racial impact, we apply a burden-shifting approach. In the first step of the approach, the plaintiff must establish a prima facie case by demonstrating that the test causes a disparate impact on the basis of race. If the plaintiff makes a prima facie case, the burden shifts to the defendant to demonstrate that the test was properly "validated" to be "job related for the position in question and consistent with business necessity." 42 U.S.C. § 2000e-2k(1)(A)(i); see also Albemarle Paper, 422 U.S. at 425, 95 S.Ct. 2362.
The District Court found that Plaintiffs met their burden of proving that the CBEST has a disparate impact on the plaintiff class. AMAE II, 937 F.Supp. 1397, 1403 (N.D.Cal.1996), and this finding is not challenged on appeal. Proceeding to validation, the District Court found that Defendants had successfully rebutted the prima facie case. The District Court found that the CBEST had been properly validated in three studies: (1) the 1982 Wheeler & Elias study, (2) the 1985 Practitioner's Review, and (3) the 1995 Lund-quist study. Plaintiffs is their appeal challenge this finding by the District Court that the CBEST was properly validated.
Steps to Validate Employment Criteria: As we have previously explained, the validation of an employment criteria involves a three-step process:
The employer must first specify the particular trait or characteristic which the selection device is being used to identify or measure. The employer must then determine that that particular trait or characteristic is an important element of work behavior. Finally, the employer must demonstrate by "professionally acceptable methods" that the selection device is "predictive of or significantly correlated" with the element of work behavior identified in the second step.
Craig v. County of Los Angeles, 626 F.2d 659, 662 (9th Cir.1980) (quoting Albemarle Paper, 422 U.S. at 431, 95 S.Ct. 2362). Subsequently in Clady, we endorsed a slightly different test for determining whether a disparate impact defendant has satisfied the burden of showing job relatedness:
This circuit has held that the employer's burden is satisfied by showing "by professionally acceptable methods" that the test is "predictive of or significantly correlated with important elements of work behavior which comprise or are relevant to the job or jobs for which candidates are being evaluated."
Clady v. County of Los Angeles, 770 F.2d 1421, 1430 (9th Cir.1985) (as amended) (quoting Contreras v. City of Los Angeles, 656 F.2d 1267, 1280 (9th Cir.1981)).
Uniform Guidelines and Content Validation: Both the District Court and the parties measure the defendants' test validation procedures against the EEOC's Uniform Guidelines on Employee Selection Procedures ("Uniform Guidelines"). The Uniform Guidelines "are not legally binding. They have not been promulgated as regulations and do not have the force of law." Clady, 770 F.2d at 1428 (citation omitted). Nevertheless, they are "entitled to great deference." Albemarle Payer, 422 U.S. at 431, 95 S.Ct. 2362 (quoting Griggs v. Duke Power Co., 401 U.S. 424, 434, 91 S.Ct. 849, 28 L.Ed.2d 158 (1971)). We have previously held that "while noncompliance [with the Uniform Guidelines] is not necessarily fatal, it diminishes the probative value of the defendants' validation study." Clady, 770 F.2d at 1430 (internal quotations omitted).
The Uniform Guidelines describe and approve three alternative methods of validating employment tests: (1) content validity studies; (2) criterion-related validity studies; and (3) construct validation studies. The District Court evaluated the CBEST validation studies as "content validity" studies, so we turn to the requirements of a content validity.
Content validation establishes whether the content of a test closely approximates the tasks to be performed on the job by the applicant. "Evidence of the validity of a test or other selection procedure by a content validation study should consist of data showing that the content of the selection procedure is representative of important aspects of performance on the job for which the candidates are to be evaluated." 29 C.F.R. § 1607.5(B).
3. CBEST Test Validation Studies
a. Job Relatedness
Plaintiffs contend that the two pre-litigation studies of the CBEST, the 1982 Wheeler & Elias study and the 1985 Practitioner's Review study, failed to undertake any job analyses to identify work behaviors or job duties and thus could not have determined by "professionally acceptable methods" whether the CBEST is "predictive of or significantly correlated" to any job related duties. Plaintiffs also challenge the skills identified in the 1995 Lundquist study, arguing that Dr. Lund-quist erred in her methods for distinguishing skills which are "important" or "critical" from those which are neither. In a detailed and carefully reasoned opinion, the District Court found that all three studies adequately validated the CBEST. As we uphold the District Court's findings for the 1985 Practitioner's Review and the 1995 Lundquist study, we need focus only upon those two studies and we do not need to address the 1982 Wheeler & Elias study.
The 1985 Practitioners' Review
The Practitioners' Review was conducted by Dr. Richard Watkins in 1985. The District Court found that "the Practitioners' Review in 1985 involved the 'pooled judgments of informed persons such as . job incumbents' about the relevance of the skills tested on the CBEST to the jobs for which it is required, an appropriate form of job analysis under the professional standards of the time." AMAE II, 937 F.Supp. at 1419.
The Practitioners' Review polled "234 teachers, administrators, teacher educators, and other school employees," thirty-six percent of whom were members of minority groups. AMAE II, 937 F.Supp. at 1413. "The participants took part in nine review panels, in which they judged the relevance of both the skills assessed by the CBEST and the test items themselves." Id. The educators were asked to rate the importance of "skills" according to fairly broad categories. For example, the three CBEST reading skills categories are: "literal comprehension," "logical comprehension," and "critical comprehension." In mathematics, the three CBEST skills are "problem solving skills," "applied problem solution," and "concepts and relationships." Id. Educators were asked to rate how relevant each of the skills tested would be to four jobs: (a) elementary school teachers, (b) secondary school teachers, (c) pupil personnel and librarians, and (d) school administrators. Id. These ratings ranged from "not relevant" to "very relevant." Id.
The Practitioner's Review thus took steps to learn from teachers and administrators which categories of skills they would identify as relevant to their jobs. Moreover, although such steps might have run a risk of identifying skills at too abstract a level, the categories were defined in detail on the forms which panel members used to rate the categories. For example, the category "Mathematical concepts and relationships" was defined as follows:
Questions in this category test the understanding of basic concepts, such as the meaning of certain terms (area, for example), order among numbers, relationships shown by graphs, elementary probability, and the like. Questions in this category may be from arithmetic, algebra, or elementary geometry.
It is true that the Practitioner's Review measured skills at a slightly higher level of abstraction than the Lundquist Study addressed below. Nevertheless, the educators who rated skill categories for job relevance were guided by the specific definitions provided for each category, and were instructed to rate the importance of the skills tested for teaching and non-teaching jobs. These steps are not clearly inadequate under the Craig test, that the employer must "first specify the particular trait or characteristic" and "then determine that that particular trait or characteristic is an important element of work behavior." Craig, 626 F.2d at 662. Thus, the District Court did not clearly err when it found that the Practitioners' Review included "an appropriate form of a job analysis under the professional standards of the time."
1995 Lundquist Study
As we noted above, Plaintiffs do not challenge Dr. Lundquist's methodology for identifying job-related skills. Plaintiffs do, however, challenge Dr. Lundquist's methods for distinguishing skills that are "important" or "critical" from those which are neither.
Dr. Lundquist's validation study polled experts and interviewed and observed teachers to develop a list of 59 activities, 39 reading skills, 27 writing skills, and 37 math skills used by teachers. AMAE II, 937 F.Supp. at 1414. Dr. Lundquist then surveyed 1,100 teachers and 230 administrators, asking each to rate the importance of those skills and activities on a four-point scale from 0 ("not applicable") to 3 ("critical"). Id. Skills and activities were retained only if "at least 80 percent of the survey respondents rated the activity or skill as applicable to the job and the mean importance rating was 1.5 or higher on the importance scale." AMAE II, 937 F.Supp. at 1414-15. Applying that standard led to the elimination of several job activities and skills, including 21 of 37 math skills.
Plaintiffs focus on the fact that skills were retained with only a mean rating of 1.5 on a scale that designated 1 as "minor" and 2 as "important." Plaintiffs contend that using the rating of 1.5 thereby retained teacher skills and activities that are less important. The plaintiffs argue that, as a result, the Lundquist study violated the command reflected by Craig and by the Uniform Guidelines that only important or critical skills be tested.
The District Court disagreed with Plaintiffs, finding that "Dr. Lundquist's decisions reflect manifestly reasonable professional judgments.... With respect to the 1.5 mean, as Dr. Lundquist testified at trial, a 1.5 rating rounds up to 2.0. It must be remembered that the mean rating of 1.5 was coupled with an 80 percent endorsement criterion, which is quite stringent." AMAE II, 937 F.Supp. at 1418 n. 35.
We admit that it is possible to conjure up a scenario that illustrates the plaintiffs' concern. Assume, for example, that 80% of the teachers surveyed agreed that the skill of solving quadratic equations ("skill QE") is "relevant" to the job of teaching, but that 75% of those surveyed rated the importance of skill QE as only minor. If the remaining 25% rated the skill as "critical," the mean importance rating of skill QE would be calculated as 1.5 and therefore skill QE would be retained despite the fact that three-quarters of the educators considered it of minor importance. However, although this scenario is possible, it is clearly an extreme case and demonstrates that only under anomalous circumstances would an outlying question find its way into the CBEST. Plaintiffs have provided no evidence that any such outlying questions did, in fact, make its way into the CBEST.
In sum, although Dr. Lunquist's methodology is not free of any possible error, the mere possibility of error does not demonstrate that the District Court's findings were clearly erroneous. . As we have previously observed, validation studies "are by their nature difficult, expensive, time consuming and rarely, if ever, free of error." Cleghorn v. Herrington, 813 F.2d 992, 996 (9th Cir.1987). Plaintiffs' challenge rests on the theoretical possibility that error could have existed in the writing and reading sections, and no such error has been shown. We conclude that the District Court did not commit clear error in upholding Dr. Lundquist's content validation study despite its possible retention of slightly less "important" skills on the reading or writing portions of the exam.
b. Job-Specific Validation
Title VII requires that a defendant using a test with a racially disparate adverse impact demonstrate that the test is "job related for the position in question." 42 U.S.C. § 2000e—2(k)(1)(A)(i). The Uniform Guidelines provide that "[a]ny validity study should be based upon a review of information about the job for which the selection procedure is to be used." 29 C.F.R. § 1607.14(A).
The 1985 Practitioners' Study
The 1985 study defined the jobs it sought to analyze as (1) elementary school teachers, (2) secondary school teachers, (3) librarians and pupil personnel (counselors and attendance officers), and (4) school administrators. All panel members were asked to judge the relevance of the CBEST skills by category for those jobs, ranking them from "not relevant" to "very relevant." Although one might argue that the job classifications were too broad, we note that, teachers are not infrequently called upon to teach outside of their area of primary expertise. As such, we cannot conclude that the District Court clearly erred in finding the job analysis in the Practitioners' Review to be sufficiently particularized.
1995 Lundquist Study
Dr. Lundquist identified teachers' job activities through several means, including literature reviews, observation of teachers on the job, and interviews with teachers regarding their "job activities, their use of reading, writing, and mathematics skills, and other knowledge, skills and abilities used on the job." AMAE II, 937 F.Supp. at 1414. The Lundquist study began with an initial list of 103 specific reading, writing, and mathematics skills. From that list Lundquist created a survey in which 1,100 educators ranked the relevance and importance of those skills to the job of teaching. According to the District Court, "[a] version of those survey for administrators was also created to determine whether they shared a common set of skill requirements with classroom teachers.... Based on her comparisons of teachers' and administrators' responses, Dr. Lundquist concluded that 'all of the skills identified as important for teachers were also important for administrators.' " Id. at 1414-15.
Dr. Lundquist's study reports:
Basic skill ratings were examined for administrators to determine if the same skill sets applied to both teacher and administrator jobs. Results showed all but one skill item (a math item) retained for teachers also applied to the administrator group. Thus the basic skill requirements identified for teachers were found to be job-related for administrators as well, and the same test specifications may be used to test basic skills for teachers and administrators.
Dr. Lundquist classified jobs as either "teacher" or "administrator" and determined that the CBEST, validated for teachers, was also valid for administrative positions. The District Court accepted this validation, concluding that "the CBEST has been adequately validated with respect to non-teaching jobs." Id. at 1418. Reviewing the record, we find no clear error in that conclusion and we therefore uphold it.
c. Actual Measurement of Skills
Plaintiffs contend that no study has shown that the CBEST actually measures the job skills it purports to measure. "[T]he employer must demonstrate by 'professionally acceptable methods' that the selection device is 'predictive of or significantly correlated' with the element of work behavior identified [by the job analysis]." Craig, 626 F.2d at 662 (quoting Albemarle Paper Co., 422 U.S. at 431, 95 S.Ct. 2362). Plaintiffs claim that the District Court merely accepted the facial validity of the CBEST without any evidence in support when it concluded that the CBEST has been shown to be a valid measure of the basic skills tested.
The District Court did not explain the basis for its findings but unambiguously concluded that "the CBEST actually measures . basic skills [in reading, writing, and mathematics]" and repeated later that "the skills tested on the CBEST are job-related, and that the CBEST has been shown to be a valid measure of those basic skills." AMAE II, 937 F.Supp. at 1411, 1419.
In Contreras, this Court held that "a key requirement of [the] third step [of Craig], a requirement essential to the proof of job relatedness generally, is that the validation method be professionally ac ceptable." 656 F.2d at 1282. There is evidence in the record from experts in the field to support the District Court's conclusions. Dr. William A. Mehrens, whose writings on test validity issues include a section titled "Writing and validating the item" reported that:
ETS personnel wrote some of the original items and assisted the test development committees in writing other items. ETS is well known and respected as a developer of standardized tests. They have well trained item writers and an impressive internal set of guidelines they follow with respect to item writing.
Asked whether "the CBEST development [was] appropriate with respect to writing and evaluating the items," Dr. Mehrens testified:
It has been. Many of the items came from an existing ETS pool. Others "were written specifically for CBEST by members of the test development committee in concert with ETS test development specialists." The individuals on the committees
"worked with specialists from ETS to further develop and define the content specifications, to review an existing ETS test item pool, to write new test items, and to review the items submitted by fellow committee members. In addition, the committees studied all of the data from the field testing, made recommendations for revisions as they felt necessary, and reviewed all of the final test results."
(citations omitted).
Even if the test items are expertly developed, they still need to be matched to skills shown to be important to the job via a job analysis. The District Court described the "Curriculum Matching project, in which two ETS employees . matched CBEST test specifications to material found in textbooks purportedly used in California public schools." AMAE II, 937 F.Supp. at 1412 n. 21. The District Court criticized the study as "unscientific" and "not particularly helpful" but noted that "the study did support the overall conclusion that the kinds of skills tested on the CBEST can be found in elementary and secondary school textbooks." Id.
Because there was some evidence that the CBEST development was appropriate with respect to writing and evaluating the items, the District Court did not clearly err in finding that the test items had been shown by professionally acceptable methods to be predictive of or significantly correlated with elements of work behavior.
d. Passing Score Standards
The Uniform Guidelines provide: "Where cutoff scores are used, they should normally be set so as to be reasonable and consistent with normal expectations of acceptable proficiency within the work force." 29 C.F.R. § 1607.5(H). We have previously applied that standard in our own cases. See, e.g., Craig, 626 F.2d at 665 (upholding a passing score cutoff as "reasonable and consistent with normal expectations of performance in the . program").
Courts reviewing cutoff scores on exams with a disparate impact frequently quote from a thorough discussion that appears in the Second Circuit's decision in Guardians Ass'n of New York City Police Dept., Inc. v. Civil Service Commission of City of New York, 630 F.2d 79, 105 (2d Cir.1980):
When a cutoff score unrelated to job performance produces disparate racial results, Title VII is violated. Consequently, there should generally be some independent basis for choosing the cutoff.... [A] criterion-related study is not necessarily required; the employer might establish a valid cutoff score by using a professional estimate of the requisite ability levels, or, at the very least, by analyzing the test results to locate a logical "break-point" in the distribution of scores.
(internal citations omitted).
In Guardians, the Second Circuit rejected a cutoff score when the employer "merely chose as many candidates as it needed, and then set the cutoff score so that the remaining candidates would fail." Id. The cutoff was derived solely from the employer's staffing needs, without any reference to the job requirements.
Plaintiffs allege that the District Court erred in upholding a twelve-of-sixteen cutoff score on the reading component of the CBEST when an empirical study demonstrates that the proper, job-related passing score on the CBEST writing sub-test is nine or ten.
The District Court concluded that "the passing scores on the CBEST reflect reasonable judgments about the minimum level of basic skills competence that should be required of teachers." AMAE II, 937 F.Supp. at 1420. The District Court described in detail the process used to develop passing score cutoffs for the original CBEST. The District Court found that then-California Superintendent of Education Bill Honig, who had the ultimate responsibility for setting the score cutoffs, "had before him the results of the Wheeler and Elias study, the results of the field test, and the recommendations of the [Commission] and the [CBEST] Advisory Board." Id. at 1421.
Superintendent "Honig testified that he did consider both the results of the Wheeler and Elias study and the [Commission]'s advice when he made his decision, though he ultimately disagreed with both recommendations." Id. at 1422. The data show that almost twenty percent of educators polled either thought a score of eleven-out-of-sixteen was not passing or were not certain. The Superintendent located a logical breaking point based upon professional estimates when he established the bottom passing score at twelve out of sixteen instead, which all readers agreed was a passing score. In the terminology of Guardians, the Superintendent concluded that twelve of sixteen was a "logical break point." As such, District Court did not clearly err in finding Superintendent Hon-ig's score cutoffs were reasonable.
E. The District Court's Appointment of a Technical Advisor
Plaintiffs claim that the trial court's rulings were proeedurally tainted by the "unreported influence of Dr. Stephen Klein," a RAND Corporation scientist who advised the District Court through ex parte communications with the judge but was not appointed by the court as an expert witness, was not subject to cross-examination, and did not supply an expert's report.
According to the Order Appointing Technical Advisor, the District Court appointed Dr. Klein as a technical advisor, not as an expert witness. Courts have inherent authority to appoint technical ad-visors, although "such appointments should be the exception and not the rule, and should be reserved for truly extraordinary cases where the introduction of outside skills and expertise, not possess by the judge, will hasten . just adjudication." Reilly v. United States, 863 F.2d 149, 156 (1st Cir.1988). Recently, in General Electric Co. v. Joiner, Justice Breyer wrote separately to endorse such a practice:
I therefore want specially to note that, as cases presenting significant science-related issues have increased in number . judges have increasingly found in the Rules of Evidence and Civil Procedure ways to help them overcome the inherent difficulty of making determinations about complicated scientific or otherwise technical evidence. Among these techniques are . the appointment of special masters and specially trained law clerks.
522 U.S. 136, 118 S.Ct. 512, 520, 139 L.Ed.2d 508 (1997) (Breyer, J., concurring).
This case involves the highly technical field of psychometrics, and presents problems of unusual complexity beyond the normal questions of fact and law with which judges routinely grapple. Under the approach identified by Justice Breyer and applied by the First Circuit in Reilly, this case is a fitting case for the use of a technical advisor. The District Court invited the parties to object to Dr. Klein's appointment and plaintiffs did not do so.
The District Court advised the parties that, consistent with its usual practice, it expected to put Dr. Klein on the stand towards the end of the trial, ask him his views, and permit the parties to cross-examine him. Had the District Court done so, Dr. Klein would have become an expert witness and his testimony would therefore have become a part of the evidence considered by the Court in its role as the finder of fact. In addition, under Fed.R.Evid. 706(a), the parties could have cross-examined Dr. Klein as a matter of right to test this evidence.
However, the District Court did not call Dr. Klein, and there is no evidence that the District Court relied on Dr. Klein's opinions as a source of evidence. To the extent that the District Court relied on Dr. Klein to assist the Court in understanding the evidence submitted by the parties, Dr. Klein remained within the role of a technical advisor as defined in Reilly, similar to the role of a specialized law clerk. Because Rule 706 does not apply to technical advisors, Reilly, 863 F.2d at 155, the District Court no more erred in refusing cross examination of Dr. Klein than it would have erred in refusing cross examination of its law clerks. Likewise, the District Court did not err in not requiring that Dr. Klein furnish an expert's report.
F. The District Court's Denial of Costs to the Defendants
1. This Court Reviews the Denial of Costs For An Abuse of Discretion
Pursuant to Rule 54(d)(1) of the Federal Rules of Civil Procedure, "costs shall be allowed as a matter of course to the prevailing party unless the court directs otherwise." F.R.C.P. 54(d)(1). Rule 54 thus creates a presumption in favor of awarding costs to the prevailing party. National Info. Servs., Inc. v. TRW, 51 F.3d 1470, 1471 (9th Cir.1995). The District Court's denial of costs is reviewed by this Court for an abuse of discretion. United States ex rel. Newsham v. Lockheed Missiles & Space Co., Inc., 171 F.3d 1208, 1213 (9th Cir.1999).
2. The District Court Abused Its Discretion When It Entirely Denied Costs to the Defendants
Although the decision to award costs resides within the discretion of the district court, a court "generally must award costs unless the prevailing party is guilty of some fault, misconduct, or default worthy of punishment." National Info. Servs., 51 F.3d at 1472.
In this case, the District Court explicitly found that the Defendants had not committed any misconduct that would require a denial of costs. Order filed Feb. 12, 1997 at ¶ 2 ("Order"). Nevertheless, the District Court observed that our holding that a court "generally must award costs" implied that there were exceptional cases in which the court might deny costs. Id. (Emphasis added in original Order). In this case, the District Court found that the suit involved an issue of substantial public importance, that the issues were reasonably close and difficult, and that there was some merit to the Plaintiffs' case. Order, ¶ 3—4, 6-7. The District Court also noted the substantial disparity of resources between the resources of the parties. Order, ¶ 5 (citing National Org. for Women v. Bank of California, 680 F.2d 1291, 1294 (9th Cir.1982) and Moore v. Hughes Helicopters, Inc., 708 F.2d 475, 478 (9th Cir.1983)). On this basis, the District Court concluded that it was within its discretion to completely deny costs to Defendants, and thereupon did so. Order, ¶ 8.
We agree with the District Court that our precedent allows a court to consider the limited resources of a Title YII plaintiff when assessing costs. Moore, 708 F.2d at 478; Wrighten v. Metropolitan Hosp., Inc., 726 F.2d 1346, 1358 (9th Cir.1984). However, these precedents must be read in Tight of our more recent decision in National Info. Servs. We held in National Info. Servs. that the denial of costs is "by nature a penalty," 51 F.3d at 1472, and that such punitive measures cannot be imposed absent wrong-doing because "a district court cannot punish a party by denying costs unless the party has done something to deserve it." Id. Congress has included nothing in the language of Title VII that would justify the imposition of such a penalty on an exonerated defendant. As a consequence, we conclude that a court may consider the limited resources of a Title VII plaintiff, but may not entirely deny costs to a prevailing defendant as a result.
We also conclude that there is no exception to Hule 54(d) that entitles a court to punish a defendant simply because the case involves an issue of national importance. The District Court relied heavily upon a sliver of language contained in two Seventh Circuit cases, which both mentioned "landmark cases of national importance." Delta Air Lines, Inc. v. Colbert, 692 F.2d 489, 490 (7th Cir.1982) and Popeil Bros., Inc. v. Schick Elec., Inc., 516 F.2d 772, 776 (7th Cir.1975). However, neither case suggested that an exception to Rule 54(d) in fact existed for landmark cases; rather, both cases expressly declined to consider the possibility of such an exception because neither case could have been considered a landmark case of national importance. Delta Air Lines, 692 F.2d at 490; Popeil Bros., 516 at 776. One could not even characterize as dicta the Seventh Circuit's position on this point, because the Seventh Circuit simply has not expressed any opinion. Turning to our own cases and to the text of Rule 54(d), we find nothing that would support such an exception, and we explicitly hold today that there is no such general exception to Rule 54(d) beyond the exception for civil rights plaintiffs.
Turning to the District Court's remaining grounds for the denial of costs, we observe that National Info. Servs. specifically rejected the denial of costs on the basis, that the plaintiffs position had " 'merit.' " National Info. Servs., 51 F.3d at 1471. It also specifically held that " 'difficulty' alone does not justify penalizing the prevailing parties." Id. at 1473. These factors should not be considered in the assessment of costs and it was an abuse of discretion for the District Court to consider those factors.
Finally, none of the precedents relied upon by the District Court involved the complete denial of costs to a prevailing party, and to the extent that they might suggest a complete denial of costs, such a suggestion would not survive our holding in National Info. Servs. As with the defendants in National Info. Servs., "there is no impropriety on the part of the defendants in this case that would justify denying them their due costs under Rule 54(d)(1)." Id. We therefore remand the ease to the District Court for a determination of the proper costs.
III. Conclusion
For the reasons discussed above, we deny Plaintiffs' Appeal, and we grant Defendants' Appeal. The Judgment of the District Court in favor of the Defendants is AFFIRMED, but the case is remanded to the District Court for a determination of the proper costs in light of our discussion.
. The introduction and portions of the factual and procedural history were authored by Judge Boochever, and have been incorporated into this opinion with his permission.
. The name of the CTPL was actually changed on January Í, 1983 to the Commission on Teacher Credentialing ("CTC"). AMAE I, 836 F.Supp. at 1538. The CTC remained responsible for administering the test. Id.
. After we issued our original opinion, counsel for the Defendants informed the Court that, as he had recently learned, the CTC signed an agreement in 1995 that permitted the CTC to receive federal funds beginning in 1996.
As Plaintiffs have argued that Defendants are liable for actions before 1995, our findings as to the non-applicability of Title VI before 1995 are still relevant. To the extent that Plaintiffs have sought recovery under Title VI after 1995, we rely upon the alternative holding that Title VI was satisfied.
. The full provision reads:
The Public School System shall include all kindergarten schools, elementary schools, secondary schools, technical schools, and State colleges, established in accordance with law, and, in addition, the school districts and the other agencies authorized to maintain them. No school or college or any other part of the Public School System shall be, directly or indirectly, transferred from the Public School System or placed under the jurisdiction of any authority other than one included within the Public School System.
Cal. Const., art. IX, § 6, ¶ 2.
. Indeed, we believe that it is the only term to which any jurisprudence has attached.
. We note that, despite the statute's suggestion that there is only one "State educational agency," this Court has previously found that different State departments and agencies can together constitute a "State educational agency." Los Angeles Branch NAACP v. Los Ange-les Unified Sch. Dist., 714 F.2d 946, 951 (9th Cir.1983); see also Upper Valley Ass'n for Handicapped Citizens v. Mills, 928 F.Supp. 429, 432 (D.Vt.1996) (holding that Vermont Board of Education and Department of Education "collectively constitute a State educational agency").
. Even at the Constitutional level, the California State Constitution currently reflects the fact that school districts are the primary administrative units for the schools. In 1972, California modified its State Constitution so that, while public schooling continued to be part of the "Public School System," the Legislature was authorized "to permit school districts 'to initiate and carry on any programs, activities, or to otherwise act in any manner which is not in conflict with the laws and purposes for which the school districts are established.'" Hartzell v. Connell, 35 Cal.3d 899, 916, 201 Cal.Rptr. 601, 679 P.2d 35 (1984) (quoting Cal. Const., art. IX, § 14). To the extent that the State Constitution before 1972 might have been understood as-requiring centralized control, it is clear that after 1972 the State Constitution permitted the school districts to exist as largely autonomous systems. Moreover, the Court notes that California's Education Code § 35160, enacted in 1976, embodies the intent of article IX, § 14 and allows the school districts to "initiate and carry on any program, activity or [ ] otherwise act in any manner which is not in conflict with . any law and which is not in conflict with the purposes for which school districts are established." Cal. Ed. Code § 35160; Choice-In-Education League v. Los Angeles Unified Sch. Dist., 17 Cal.App.4th 415, 423, 21 Cal.Rptr.2d 303 (1993).
. We note that we have previously concluded that the California State Board of Education and the California State Department of Education fall within the definition of "State educational agency." Los Angeles Branch NAACP v. Los Angeles Unified Sch. Dist., 714 F.2d 946, 951 (9th Cir.1983).
. We note that Congress selected the term "local educational agency" rather than the larger and more inclusive term "educational agency," which is defined to include both local educational agencies and " 'the state board of education or other agency or officer primarily responsible for the state supervision of public elementaiy and secondary schools.' " Idaho Migrant Council v. Board of Educ., 647 F.2d 69, 71 (9th Cir.1981) (quoting 20 U.S.C. § 1720(a), 881(k)).
. Of course, whether or not an entity refers to itself as a "school system" may be a useful piece of evidence in determining whether or not the schools in that entity are closely enough linked to qualify as a "school system" for the purposes of § 2000d-4a(2)(B). However, while such a self-description would constitute evidence pointing in one direction, it is not necessarily determinative on the question.
. We note that the term "Local Educational Agencies" applies only to public entities. Without the "other school systems" language of § 2000d-4a(2)(B), private and parochial school systems would not come within the ambit of Title VI. It is clear that Congress intended the "other school systems" language to cover such school systems that were similar to public school systems.
. The Court notes that no House Report was submitted for this bill. The Senate Report is therefore the sole Congressional Report.
. Plaintiffs argue in their motion for reconsideration that the Public School System established by the California state Constitution must qualify within the " 'catch-all''' of § 2000d-4a(4) as "any other entity" receiving federal assistance. However, § 2000d-4a(4) does not apply simply to "any other entity," but applies only to an entity created by a covered entity. The fact that the CTC was not created by any covered entity is discussed at length in the text. Plaintiffs simply ignore the second half of the sentence.
. This is not to say that a State may not be the proper defendant under a Title VI suit. The plain language of Title VI demonstrates that a State agency or department may be covered by Title VI. 42 U.S.C.A. § 2000d-4a(l)(A-B). To the extent that one would bring suit against the State for violations by such an agency or a department, the State would be the proper defendant.
As a result, it is clear that an entity need not itself be a "program or activity" to be named as a defendant for Title VI. AMAE I, 836 F.Supp. at 1541-43. This conclusion is confirmed within the statute by the structure of subsections 3(A) and (B) of § 2000d-4a. Whereas subsection 3(A) provides for corporation-wide coverage when funding is extend ed to the corporation as a whole, subsection 3(B) limits the definition of "program or activity" to a particular plant or comparable facility when assistance is extended directly to the plant. 42 U.S.C.A. § 2000d-4a(3)(A) & (B). In the later case, the "program or activity" would be limited to the plant, but the corporation would nevertheless be the proper defendant. For example, were a Ford plant in Dearborn, MI to receive federal funds, Title VI coverage would be limited to the operations of the Dearborn plant and not thereby automatically extend to all of the Ford Motor Company. Nevertheless, any victim of a Title VI violation under the plant-wide "program or activity" would file suit against the Ford Motor Company, which would be a proper defendant despite failing to qualify itself as a "program or activity."
Our conclusion that the State as a whole is not subject to Title VI means only that receipt of federal funds by an agency of the State does not automatically extend Title VI coverage to the entire State government. Of course, the State may nevertheless be sued in the proper circumstances for a violation in a covered program or activity.
. The District Court found that the CTPL (predecessor to the CTC) was created by the Legislature by statute, and that the Governor appoints fifteen of the sixteen voting members of the Commission. AMAE I, 836 F.Supp. at 1538. Moreover, although the CTC is required to notify the Board of Education and the Superintendent of any proposed policies and regulations, the CTC is not subject to the authority of either entity. Id.
. In their motion for reconsideration, Plaintiffs argue that the CTC should be covered under Title VI because it interferes with a covered program or activity even if it does not itself count as a covered program or activity. Plaintiffs cite only two district court cases for this proposition—both of which were subsequently vacated by the Second Circuit.
More importantly, Plaintiffs ignore the fact that Title VI was passed under the spending clause. Ferguson v. City of Phoenix, 157 F.3d 668, 674 (9th Cir.1998). A party only becomes subject to Title VI when it receives federal funds. Davis v. Monroe County Board of Educ., 526 U.S. 629, -, 119 S.Ct. 1661, 1670, 143 L.Ed.2d 839 (1999) ("The Govemment's enforcement power [under spending clause] may only be exercised against the funding recipient"); see also Pennhurst State School & Hosp. v. Halderman, 451 U.S. 1, 17, 101 S.Ct. 1531, 67 L.Ed.2d 694 (1981) (noting that spending clause legislation is "much in the nature of a contract: in return for federal funds, the [recipients] agree to comply with federally imposed conditions"). In other words, a party is not subject to Title VI unless it receives federal funds, even if it allegedly "interferes" with a covered program or activity. The CTC did not become subject to the requirements imposed by Title VI until, either directly or indirectly, it accepted federal funds.
. We do note that a parent corporation may be liable under Title VII where it interferes with the employment practices of the subsidiary. Watson, 650 F.2d at 993. However, as we discuss below, we do not consider the CBEST to be the State's proprietary involvement with its "subsidiary" reviewable under Title VII but rather an exercise of its licensing power, reviewable only under the Constitution.
. In evaluating the Texas Exam for Current Administrators and Teachers ("TECAT"), the Fifth Circuit held that a state requirement of the TECAT did not make the State of Texas into an employer and rejected a claim that the State of Texas was potentially subject to Title VII liability for any effect of the exam. Fields v. Hallsville Indep. Sch. Dist., 906 F.2d 1017, 1020 (5th Cir.1990). Although the scope of the TECAT is not explicitly discussed in Fields, the teacher's exam upheld in Fields was required only for public school teachers. See State v. Project Principle, Inc., 724 S.W.2d 387, 389-90 (Tex.1987) (holding that the new requirement that existing Texas public school teachers pass the TECAT constituted a licensing requirement and not a change in the contractual relationship between teachers and school districts).
. The dissent questions the viability of the proprietary/regulatory distinction, citing J.L. v. Social Sec. Admin., 971 F.2d 260 (9th Cir.1992). While we did acknowledge in that case that "[n]ot all actions may be so easily classified," we nevertheless went on to acknowledge that the dichotomy served a limited function. Id. at 272. In this case, we employ the distinction in a very limited setting: Is a particular exam a licensing exam or a regulatory exam? This question can only arise in a certification context where the State is not the employer.
Finally, we would note that the distinction between proprietary and regulatory actions is a long established distinction, and we believe that the courts will be able to adequately distinguish between such functions. See generally Reeves, Inc. v. Stake, 447 U.S. 429, 436, 100 S.Ct. 2271, 65 L.Ed.2d 244 (1980) ("The basic distinction drawn in Alexandria Scrap between States as market participants and States as market regulators makes good sense and sound law.").
. We do note, of course, that the CBEST constitutes State action, and could be challenged were the CBEST to violate Plaintiffs' Constitutional rights. There is, however, no allegation that the CBEST violates any Constitutional right.
. The dissent argues that, having found Title VI and Title VII inapplicable, the remainder of our discussion on the merits is merely dicta. However, our discussion is not dicta where, as here, it constitutes an alternative basis for our decision. " '[WJhere a decision rests on two or more grounds, none can be relegated to the category of obiter dictum.' " Export Group v. Reef Industries, Inc., 54 F.3d 1466, 1471 (9th Cir.1995) (per curiam) (quoting Woods v. Interstate Realty Co., 337 U.S. 535, 537, 69 S.Ct. 1235, 93 L.Ed. 1524 (1949)); see also MacDonald, Sommer & Frates v. Yolo County, 477 U.S. 340, 346 n. 4, 106 S.Ct. 2561, 91 L.Ed.2d 285 (1986).
We also note that our finding that Title VI and Title VII do not apply to the CTC is not a jurisdictional finding. It is merely a finding that those statutes are inapplicable to the current circumstance. See Steel Co. v. Citizens for a Better Env't, 523 U.S. 83, 118 S.Ct. 1003, 1013, 140 L.Ed.2d 210 (1998) (holding that "nonexistence of a cause of action was no proper basis for a jurisdictional dismissal"); Haddock v. Board of Dental Examiners, 777 F.2d 462, 464 n. 4 (9th Cir.1985)(rejecting characterization of dismissal as "jurisdictional" where Title VII claim failed pursuant to licensing exception). We may therefore base our conclusion on these alternative grounds.
. Of course, the Court would review de novo were it clear that the district court used an improper legal standard. However, Plaintiffs have not argued that the District Court used the wrong legal standard, but rather that the District Court did not reach the proper conclusion under the proper standard. This is a mixed question of fact and law that is primarily a factual determination.
. The Uniform Guidelines were jointly adopted by the EEOC, the Civil Service Commission, the Department of Labor, and the Department of Justice in 1978, and are codified at 29 C.F.R. § 1607. They have remained unchanged since that date.
. The Uniform Guidelines do not preclude the use of other validation methods, but rather provide that "[n]ew strategies for showing the validity of selection procedures will be evaluated as they become accepted by the psychological profession." 29 C.F.R. § 1607.5(A).
. The Uniform Guidelines used the term "content" to describe both the "content of the job," 29 C.F.R. § 1607.14(C)(1), and the "content of the selection procedure." 29 C.F.R. § 1607.5(B).
. We note that the 1982 study raised somewhat different questions than the latter two studies. We explicitly do not reach that study because the fact that the latter two studies survive this appeal makes the 1982 study redundant and relieves us of the additional burden of evaluating the District Court's findings on that study.
. If the defendant establishes that the test is job-related, the burden would then shift back to the plaintiff to show that other selection devices without a similar discriminatory effect would also "serve the employer's legitimate interest in efficient and trustworthy workmanship." Albemarle Paper, 422 U.S. at 425, 95 S.Ct. 2362 (internal quotations omitted). In the appeal before this Court, however, Plaintiffs challenge is limited to the validation, and we do not need to address whether other tests could achieve equivalent desirable results without any disparate impact.
. The District Court's opinion provides a detailed background on the methodology used in each study, AMAE II, 937 F.Supp. 1412-16, and we will not repeat that material here except where necessary to a particular issue in the appeal.
. The other two options were 1 (''minor") and 2 ("important").
. In addition, even if Dr. Lundquist's results were called into question by the initial retention of some skills that were slightly less "important," the mathematics portion of her content validity study was saved by a subsequent step she took. When faced with the prospect that 21 of the 37 math skills would be eliminated, the Commission engaged Dr. Lundquist to conduct a focused content validity study on the math segment. Lundquist employed a panel of twenty teacher educators who conducted a fresh review of the 37 math skills. For a skill to be retained, 80 percent of the panel had to rate it as "applicable and required at entry, and the skill had to have average and future importance ratings equal to or greater than two (out of a three-point scale, one being 'minor,' and three being 'critical')." AMAE II, 937 F.Supp. at 1416. Thus, on the math section, only skills rated "important" on average were retained.
. Indeed, both Reilly and the District Court explicitly liken the role of a technical advisor to that of a law clerk.
. Quite recently, we held that a district court abused its discretion by awarding especially high costs without considering that such high costs would render the civil rights plaintiff indigent. Stanley v. University of Southern California, 178 F.3d 1069, 1079 (9th Cir.1999). We therefore remanded the case so that the district court could consider the possibility of indigence and the effects of imposing "such high costs" on civil rights litigants. Id.
Stanley teaches - that," in balancing the amount of costs to be awarded, a district court must consider the hardships that extreme costs may impose on the people involved. These considerations will naturally vary from plaintiff to plaintiff, and financial burdens imposed on organizations may create less hardship than similar burdens imposed on natural persons. This balancing will of course depend on the evidence of hardship presented to the district court.
We note only that our holding in Stanley does not eviscerate the holding of National Info. Servs. that the denial of costs is generally punitive. Stanley does require courts in extreme circumstances to reduce costs so as not to render an individual civil rights plaintiff indigent. On remand in this case, the District Court should consider the different hardships that would be imposed on each particular Plaintiff.
. In the only cited appellate case in which costs were completely denied, Pursche v. Atlas Scraper & Eng'g Co., 300 F.2d 467, 489 (9th Cir.1961), we affirmed a finding that neither party would be considered the "prevailing party" where one claim of the plaintiff's patent was declared invalid. Id. In the current case, the District Court appears to have found that Defendants were the prevailing party.