Seattle Education

For the news and views you might have missed

What’s wrong with standardized tests?

Julie Woestehoff, who is Executive Director of PURE, developed this fact sheet regarding standardized testing which will be published on the Parents Across America website.

I wanted to share this with you now.

Dora

What’s wrong with standardized tests?


  • They are designed to rank and sort children. Many use a scoring system in which half of all children in the nation always score below average.

  • There is a well-known achievement gap between the test scores of white and Asian students and African-American and Latino students. Rather than help all children achieve, this overemphasis on standardized tests simply labels more minority children and their schools as failures.

  • Standardized tests can be biased. A study by Jay Rosner in 2002 showed that sample questions which were answered correctly by more African-American students were not chosen for use in the tests; this was done so that test results – showing African-Americans scoring lower than whites – would be “consistent” from year to year (more on this research and test bias below).

  • Tests always contain errors. The fact that most of these tests are kept secret from the community makes it likely that even more mistakes happen – we just never find out about them.

  • Overemphasis on standardized tests can lead to a dumbed-down curriculum. These tests are made up mostly of multiple choice and short answer questions which can’t and don’t measure higher-order thinking, creativity, speaking or artistic skills, or many other important areas our children need to learn about. Unfortunately, areas which are not tested are becoming less and less a part of school, especially under the pressure of NCLB.

Test bias

Decades of research have documented the biases in standardized tests, with students of color bearing the brunt of that discrimination. Across age groups, standardized tests discriminate against low-income students, English language learners, and students of color.

Although in recent years test makers have attempted to address concerns about test bias by establishing review committees to “scour” the tests for bias, and by using statistical procedures, significant problems remain in the content of the questions, the cultural assumptions inherent in the “wanted” answers, etc. Here are just a few examples:

Discriminatory item selection: Jay Rosner, executive director of the Princeton Review Foundation, which provides test preparation programs for the college-entrance Scholastic Aptitude Test (SAT), reported in 2003 that potential SAT questions which are answered correctly more often by black students than white students are rejected by the test makers. This was apparently done to assure that test results (showing African-Americans scoring lower than whites) would be “consistent” from year to year.

Outright racism: A series of questions on the 2006 global history New York State Regents exam asked students to describe how Africa “benefited” from imperialism. Using this 150-year-old quote: “We are endeavoring … to teach the native races to conduct their own affairs with justice and humanity, and to educate them alike in letters and in industry,” students were asked to name “two ways the British improved the lives of Africans.”

Socio-economic bias masquerading as cultural diversity: The 2006 New York State Regents third grade reading practice test used the example of African-American tennis stars Serena and Venus Williams to ask children questions about tennis “doubles” and country clubs.

Accidental (?) bias: In 2001, the Illinois Standards Achievement Test (ISAT) included a reading passage taken from Ann Cameron’s book, More Stories Julian Tells. The book is about an African-American family and is familiar to many African-American children, but the illustrations showed a white family.

Lack of cultural awareness: A Latina “bias reviewer” caught this item while reviewing questions prepared for the Iowa Test of Basic Skills. “I remember one question that showed a picture of a couch on a porch and asked, ‘What doesn’t fit?’ ” she says. “I started laughing…the way I grew up, everyone had a couch outside.”

Watch for the increasing use of “feeling” questions which supposedly evaluate the student’s ability to construct meaning from the text but may also evoke a wide variety of life experiences resulting in “wrong” answers.

5 comments on “What’s wrong with standardized tests?

  1. seattleducation2010
    February 2, 2011

    Chelsea,

    I like the website.

    My concern about standardized testing is that there can be so much focus on test scores that very little else including critical thinking skills are developed. I saw this happen with NCLB. Now, with teacher evaluations being tied to student scores, it will further decrease the scope of learning that a child experiences.

    Dora

  2. Chelsea
    February 2, 2011

    standardized testing is a tough subject. I agree that it isn’t the answer but coming up with ways to easily and in mass check on the progress of students is also difficult. I just finished researching the topic if you want to check out what I found and let me know what you think. http://bit.ly/hRNEVq+

  3. Demian
    January 31, 2011

    The reasons outlined in the fact sheet are reason enough to drastically reduce or eliminate the use of and high-stakes associated with standardized tests. There are additional compelling reasons described in the new book “The Myths of Standardized Tests” (http://www.amazon.com/Myths-Standardized-Tests-They-Think/dp/1442208090).

  4. India Carlson
    January 30, 2011

    Having taught full inclusion ELL science the past 2 years I know how easy it is to unknowingly have a question that a non-native speaker would misinterpret. My first year I had a pre-assessment that asked what is table salt composed of, and every single ELL student had an answer that included wood. I realized that writing questions for class and tests would be especially challenging and my co-teacher and I have worked hard on seeing a problem before we had out an assignment and correcting it.

    Cultural bias is everywhere and to pretend that standardized tests don’t reinforce the “gap” between races is naive.

  5. Pingback: Tweets that mention What’s wrong with standardized tests? | Seattle Education 2010 -- Topsy.com

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Information

This entry was posted on January 29, 2011 by in High Stakes Testing and tagged .
Follow

Get every new post delivered to your Inbox.

Join 886 other followers

%d bloggers like this: