June 5, 2000

THE HIGH-STAKES TESTING MANIA HURTS POOR AND MINORITY STUDENTS THE MOST.

Testing, Testing

by GARY ORFIELD and JOHANNA WALD

See below for background and related information.

With education among the electorate's top priorities, the phrase "higher standards" has become ubiquitous in political campaigns across the country. Ever since the publication of the Reagan Administration's A Nation at Risk in 1983, the standards-based school reform movement has galvanized a broad coalition from right to left. Conservatives and business leaders are drawn to its pledge to improve the accountability of a public school system they see as an entrenched bureaucracy, as well as to its goal of preparing a more globally competitive work force. At the same time, the movement's underlying premise, that all children can learn at high levels, has won over many liberals and civil rights advocates, who are rightly concerned about teachers and schools lowering their expectations for poor and minority students.

Unfortunately, this movement has all too frequently been reduced to a single policy: high-stakes testing. This policy links the score on one set of standardized tests to grade promotion, high school graduation and, in some cases, teacher and principal salaries and tenure decisions. To date, about twenty-five states have adopted some version of this policy, and the number of legislatures considering similar measures is growing. Both Al Gore and George W. Bush vigorously promote the use of standardized tests. President Clinton recommended in his State of the Union address that test-preparation manuals be made available to all children.

Yet despite the political popularity of the testing "solution," many educators and civil rights advocates are suggesting that it has actually exacerbated the problems it sought to alleviate. They claim that these policies discriminate against minority students, undermine teachers, reduce opportunities for students to engage in creative and complex learning assignments, and deny high school diplomas because of students' failure to pass subjects they were never taught. They argue that using tests to raise academic standards makes as much sense as relying upon thermometers to reduce fevers. Most compellingly, they maintain that these tests are directing sanctions against the victims, rather than the perpetrators, of educational inequities.

The implications of these arguments were serious enough to lead The Civil Rights Project at Harvard University to commission a series of studies on the educational and social impact of high-stakes testing policies from some of the nation's top scholars in this field. Some of their most significant findings include:

§ High-stakes tests attached to grade promotion and high school graduation lead to increased dropout rates, particularly for minority students. George Madaus and Marguerite Clarke of Boston College discovered a strong association between high-stakes testing and increased dropout rates. They cite studies showing that in 1986 half of the ten states with the lowest dropout figures used no high-stakes tests. The other half employed testing programs that could be characterized as low stakes. Nine of the ten states with the highest dropout rates used standardized tests in decisions about high school graduation.

The effects for minority students can be discerned from a study by Aaron Pallas of Michigan State University and Gary Natriello of Columbia University, who examined the racial and ethnic disparities in performance on the Texas Assessment of Academic Skills (TAAS) between 1996 and 1998. By the spring of their senior year, almost twice as many black and Hispanic students as white students had not passed the TAAS exit-level tests required to obtain a Texas high school diploma. The authors concluded that "these tests are, and will remain for some time, an impediment to the graduation prospects of African American and Hispanic youth." In another study, Columbia's Jay Heubert points out that students of color are almost always overrepresented among those who are denied diplomas on the basis of test scores.

§ Using tests to retain students in the same grade produces no lasting educational benefits. Robert Hauser of the University of Wisconsin has found that retaining students in the same grade creates huge management problems in the classroom, is extremely expensive for the school system and dramatically increases the likelihood that the retained student will eventually drop out. Moreover, African-American males are disproportionately represented among those who are held back. The Congressionally mandated 1999 National Academy of Sciences report High Stakes: Testing for Tracking, Promotion and Graduation cites five other studies that draw similar conclusions about the negative effects of retaining students.

§ High-stakes tests narrow the curriculum by encouraging a "teach to the test" approach in the classroom. Most curriculum experts recommend that students approach topics from a variety of perspectives, using all of their senses, over extended periods of time. Many high-stakes tests, however, rely upon multiple-choice questions, ask students to interpret isolated passages unrelated to larger themes or units, and require them to adhere to rigid writing formats that allow little room for deviation. Linda McNeil of Rice University and Angela Valenzuela of the University of Texas argue that while increasing numbers of students in poor schools in Houston may be passing the TAAS reading section, they "are not able to make meaning of literature...nor to connect reading assignments to other parts of the course such as discussion and writing." As Clifford Hill of Columbia University wrote recently in a New York Times Op-Ed, test preparation has come to "invade" the school day in poor schools in New York City, with worrisome effects: "Learning to take reading and writing tests is not the same as learning to read and write, especially when test prep materials do not meet basic standards."

Moreover, test preparation is far more likely to dominate teaching in high-poverty schools than in affluent ones. Such instruction has all but replaced the curriculum in Houston's poor schools, according to McNeil and Valenzuela's research. Also, high-poverty schools hire a large number of uncertified and inexperienced teachers who tend to focus exclusively on test preparation, as John Lee of the University of Maryland has found.

§ There is very little evidence linking test scores with economic productivity. According to Henry Levin of Columbia, the US economy is highly competitive despite the fact that our students lag behind other countries in test performance on some international comparisons. In fact, those countries that do score particularly well on tests may be suffering in the global economy because their curriculum is too narrow and does not yet offer the range of learning opportunities available to students in US schools.

Many states are using tests in ways that directly contradict the recommendations of the National Academy of Sciences, the Department of Education's Office for Civil Rights and other experts. The Office for Civil Rights' 1999 resource guide states that "a decision or characterization that will have major impact on a student should not be made on the basis of a single test score." Even one of the nation's most prominent advocates for the standards movement, Robert Schwartz, president of ACHIEVE, wrote recently, "Common sense suggests that states should not rely solely on the results of one-shot assessments." Educational testing service leaders also strongly warn against using test scores alone to make high-stakes judgments about students. Yet many school districts, according to Columbia's Heubert, use tests designed for other purposes to make tracking, promotion and graduation decisions.

If, as all these studies suggest, high-stakes tests both discriminate against poor and minority students and are educationally unsound, we are still left with the dilemma of how to achieve the dual goals of equity and excellence. Dozens of studies offer convincing evidence that children in poor schools make academic gains when they have access to quality early-childhood education programs, when they are taught in small classes by skilled and committed teachers, and when they are given assessments linked to appropriate and immediate responses.

The single most important factor in raising academic performance in poor schools appears to be the presence of experienced, competent and caring teachers. Disadvantaged youths currently are taught by the least prepared and most transient instructors in the system. Devising incentives for recruiting and maintaining highly qualified teachers and for retraining existing staff in high-poverty schools should be the top priority of those serious about raising standards.

Student assessments, of course, are essential to realizing improvements in students and schools. Several groups and individuals, including Clifford Hill, Project Zero at the Harvard Graduate School of Education, the New York Performance Standards Consortium and the Coalition for Authentic Reform in Education (CARE) in Massachusetts have developed alternative modes of evaluating student performance. These share the following characteristics: (1) they are designed in collaboration with--rather than imposed upon--teachers; (2) they are varied enough to reflect the differing learning styles of students; (3) they address the curriculum actually taught in the classroom; and (4) they provide timely feedback linked to both student remediation, when necessary, and curriculum revisions. Standardized tests can play a role in such a restructured system. As recommended in High Stakes, test scores, combined with other assessments, can be very useful in identifying curricular weaknesses and in targeting students in need of additional support.

It is also possible to hold schools accountable for academic performance without penalizing students unfairly. One obvious way is to measure progress as well as outcome. By taking only standardized scores--which are heavily correlated with parents' income and level of education--into account, most current systems automatically reward schools in affluent areas. They also set up a destructive dynamic between teachers and struggling students. With their livelihood and reputations riding on scores alone, faculty are motivated to dismiss low performers in favor of those more likely to score well. One principal in Chicago even admitted that he expelled chronically truant students to boost his schools' test scores. A focus on improvement over outcome will alleviate that dynamic. Tennessee, for example, puts a central focus on the "Value Added" by a school's program.

Unfortunately, despite recent revelations of the high numbers of likely student "casualties" to high-stakes testing policies--especially among poor and minority children--many politicians have discovered that vows to bring about "world-class standards" and to "end social promotion" play well on the evening news. For the most part, the media continue to accept at face value claims that high-stakes tests represent a necessary form of tough love for struggling schools. Still, there are indications that the movement to suspend the high-stakes aspect of testing is gaining momentum. It has found an ally in Senator Paul Wellstone, who recently introduced legislation prohibiting the misuse of these tests. Delaware just decided, under intense protest, to postpone its new testing policies, and Virginia, Massachusetts and other states are currently experiencing fierce opposition to their testing requirements. Hopefully such public pressure will lead to the adoption of more effective and equitable uses of assessments within a restructured school reform movement.

Gary Orfield is a professor of education and social policy at the Harvard Graduate School of Education and Kennedy School of Government, and co-director of the Civil Rights Project at Harvard University. He recently co-edited Religion, Race and Justice in a Changing America (Century Foundation) and Chilling Admissions: The Affirmative Action Crisis and the Search for Alternatives (HEPG), and is currently co-editing a book on high-stakes testing. Johanna Wald is a researcher and writer/
editor for the Civil Rights Project.

Background and Related Information

Rethinking Schools
Rethinking Schools helps shape progressive reform throughout the public school system in the United States, analyzing education issues such as vouchers, charter schools and merit pay schemes.
http://www.rethinkingschools.org
Educators for Social Responsibility
ESR, a source of innovative curriculum materials and teacher training programs, attempts to integrate the teaching of social responsibility into the education system.
http://www.esrnational.org
Network of Educators on the Americas
NECA promotes peace, justice and human rights nationwide through critical, antiracist, multicultural education. A source for multicultural, social justice books, teaching guides, videos and posters for the K-12 classroom and staff development.
http://www.teachingforchange.org
Center for Commercial-Free Public Education
The Center for Commercial-Free Public Education is committed to public schools that encourage young people to become active world citizens.
http://www.commercialfree.org
Media Literacy Online Project
This project offers resources that explore issues relating to advertising to youth in schools.
http://interact.uoregon.edu/MediaLit/FA/MLadvertschool.html
Education First
Education First is dedicated to providing need-based college scholarships to exceptional seniors attending high schools with historically low percentages of college applicants.
http://www.educationfirst.org
National Center for Fair and Open Testing
The National Center for Fair and Open Testing works to end the abuses, misuses and flaws of standardized testing.
http://fairtest.org
National Coalition of Education Activists
NCEA is a multiracial network of families, school staff, union and community activists and others organizing for equity and fundamental changes in local school districts.
http://members.aol.com/NCEAWeb
Teach For America
Teach For America is the national teacher corps of outstanding recent college graduates of all academic majors and cultural backgrounds who commit two years to teaching in under-resourced urban and rural public schools.
http://www.teachforamerica.org
United Federation of Teachers
The UFT is the sole bargaining agent for most of the non-supervisory educators who work in the New York City public schools.
http://www.uft.org
American Federation of Teachers
The AFT, affiliated with the AFL-CIO, is a trade union representing workers in education, healthcare and public service.
http://www.aft.org
American Association of University Professors
This organization was founded in 1915 to circumvent attacks on academic freedom.
http://www.aaup.org
International Readers Association
The International Readers Association promotes high levels of literacy by improving the quality of reading instruction.
http://www.reading.org
Chronicle of Higher Education
The Chronicle focuses on education issues, especially for professors and students in academia.
http://chronicle.com
Office of Indian Education Program
The Office of Indian Education Programs is one of the largest program components in the Bureau of Indian Affairs. It is responsible for direction and management of all bureau education functions including the formation of policies and procedures.
http://www.oiep.bia.edu
Indian Community School of Milwaukee
The ICS is a national leader in innovative education for Indian students, with a link to the Urban Indian Education Research Center.
http://www.ics-milw.org
Open Society Institute
The Open Society Institute promotes the development and maintenance of open societies around the world by supporting an array of programs dealing with educational, social and legal reform.
http://www.soros.org/osi
National Association for the Advancement of Colored People
The NAACP is the oldest and largest civil rights organization in the United States.
http://www.naacp.org
National Urban League
The mission of the National Urban League is to assist African-Americans in the achievement of social and economic equality.
http://www.nul.org
Politically Black
Politically Black promotes economic, political, civic and technological participation among African-Americans.
http://www.politicallyblack.com
US Department. of Education
The government's official site for the Department of Education.
http://www.ed.gov

Copyright ©2000 The Nation Company, L.P. All rights reserved. Unauthorized redistribution is prohibited.

If you liked what you just read, you can subscribe to The Nation by calling 1-800-333-8536 or by following this link.

Please attach this notice in its entirety when copying or redistributing material from The Nation. The Nation encourages activists and friends of the magazine to share our articles with others. However, it is mandatory that academic institutions, publications and for-profit institutions seeking to reprint material contact us for permission. Click here for further information or to make a request.