Here’s my favorite example of cultural bias in tests. These researchers were teaching sign language to a gorilla. They hypothesized that the gorilla’s IQ was similar to that of a human child, so they administered a multiple-choice IQ test to the gorilla designed for children. One question was: which of these items is good to eat. The gorilla selected “flowers”. According to the rules they had to mark it wrong.
So “they” gave a human child’s IQ test to a gorilla and scored it precisely as they would for a child? This is a perfect example of our narrow, biased human-centric view of what defines “intelligence”. It also sounds suspiciously like a made up fact I would very hard to believe unless this is also a story of the world’s stupidest grad students trying to make some silly point about speciest relativism. Do you have a direct cite of any kind for this purported happenstance?
Unfortunately, if you read Jonothan Kozel’s Savage Inequalities, you would see that you don’t have to go to another country. There are remarkable differences in the way inner-city and suburban kids are educated. One tends to place rigid emphasis on rote memorization, whereas the other allows for more independent thought and exploration. I’m not saying this explains all disparities on the SAT, but I’m sure differences in the way different demographics are educated play a huge part.
If this is the Famous Tech School that I’m familiar with, I can vouch for ftg because I remember reading something similar a few years ago.
But even if I hadn’t, I don’t think what ftg said is wrong. Actually, it supports what the College Board has found through its own study.
I don’t think anyone is questioning ftg’s claims about minority students doing well (or having the capacity to do so) in a particular academic environment. It’s the claim that the University in question (or any University) would find it advisable or necessary to quash these results in a conspiracy of silence, because it showed their current institutional admissions model was flawed. Most schools would grab results like these and run with them to obtain favorable media and academic attention and potential grant monies.
bnorton and Opus1 might disagree with you, astro.
Why do you think so many schools have made SAT scores optional on their applications?
I also think you’re giving schools too much credit. It doesn’t matter what certain studies have shown; there is a perception out there that minorities–particularly black and Hispanic students–are remedial learners (at best). I’ve overheard people denigrating certain schools just because they have more than a minuscule percentage of minority enrollment (I actually heard a white guy say he didn’t want to go to a satellite campus here in NJ because it had a lot of brothers…and yet this guy wouldn’t know an atom from an apple). It’s sad but true: the more whites and Asians are enrolled at your school, the more prestigious that school will appear. So if you’re working under this assumption (and I believe most people do–whether they are conscious of it or not), why would you try to bring in more minority students, even if they are “good”? There’s an advantage in keeping your minority student body low. If you have a few tokens, you can pass yourself off as diverse. And if that’s all they are–just a few tokens–then you don’t have to worry about damaging your reputation.
Finally, people still hold up the SAT as the end-all, be-all to whether or not you’re qualified for college. If a student with a low SAT fares well in college, it’s chalked up to a fluke, not to a direct challenge of the validity of the exam. So if a college increases its “special admins”, it’s going to hurt a lot of feelings for those students who are not special admins and feel that a double-standard was applied. We’re already seeing those hurt feelings in the form of suits against AA policies. I’m guessing most universities don’t want to be bothered.
I’m not really trying to get into the GQ here but the above example and some of the thoughts in this thread all deal with economic bias. You can bet than an upper class black student would know what a tea cup is. When this is dicsussed in terms of inner city vs. suburbs the suburbs will almost always have higher scores beacuse I’m guessing the suburbanites have more resources for things like test guides, preparation, etc… Does anyone have anything to offer about suburbanite minority test scores vs. suburbanite white test scores and inner city minority test scores vs. inner city white test scores?
I also remember having the questions that were very odd obviously trying to remove cultural bias. “All Zig-Zogs and Flip-Flaps are Woogie-Woogies but not all Woogie-Woogies are Zig-Zogs or Flip-Flaps, this is an example of?” sorts of questions.
I managed to find one more example of a questionable questions
"STRAWBERRY:RED
(A) peach:ripe (B) leather:brown © grass:green (D) orange:round (E) lemon:yellow
This is a sample analogy from the SAT (Scholastic Aptitude Test). For most, the answer seems straightforward, (E) lemon:yellow, but this question has been “flagged” and dropped from the test because of its racial bias against individuals of Hispanic ethnicity. These individuals, as proposed by one SAT panel member, may or may not be familiar with yellow lemons, but green lemons, thereby making this question unfair to a particular group (ETS, 1997)." from http://tc.unl.edu/jaevans/curr330_testingbias.html
Off to Great Debates.
If I remember correctly, there was a study done that shows that cultural bias really does affect the results. That is, women are better able to answer a math questions about dolls better than they could answer the same question about star wars figurines. And vice-versa, with boys.
It’s probably not a huge shock to find that our brains can process ideas about familiar objects better than ideas about unfamiliar ones.
Are SAT exams more culturally biased than personal interviews and evaluations? After all, if colleges give less weight to SAT exams, then they have to give more weight somewhere else.
If you take the POV that honkies tend to be closet racists, then it follows that SAT exams ought be less biased than personal interviews, because they’re anonymous. (I chose an actuarial career partly because advancement depended on anonymous tests, which helped insulate against anti-semitism.)
IMHO people complain about SAT exams because African Americans don’t do as well on average. Cultural bias is an appealing excuse, but the real problem is the condition of inner-city education.
Even if the story you tell is true, how does that contradict the claim that SAT scores predict sucess in college?
I, too, find this story hard to believe. For one thing, this sounds like the sort of study liberals would conduct, and would therefore not want to “hide”. For another, there are many groups that would like to find the results you mention. Where are the studies from them?
How so?
Fretful Porcupine:
How is that cultural bias? What you’re presenting is a situation in which people from a certain culture really are better at some skills than others. A test on which they do better would therefore be accurate.
quote:
When combined with high school grades, it is a better predictor of college grades than high school grades alone.
When I taught college and we were accepting students/giving out scholarships, we put very,very little weight on high school grades. It was our experience that there was little correlation between high school grades and college success but a huge correlation between SAT and college success. We even had some statistics from studies to verify this (to defend our actions) but cannot remember these studies for a cite. (it was 10+ years ago!)
If you are referring to a school that is in Downtown Atlanta across the street from the world’s largest fast food resturant then I know a little bit about this test group. If you mean another school, then Georgia Tech did the same thing and the results were as you indicated. One thing you did not mention is that these “special admissions” cases were extensively screened and interviewed prior to admittance and were also given tutoring and guiodance in noted problem areas (not special tutoring unavailable to other students, just that they were given more encouragement to take advantage of learning success centers on campus). Figure in that these students were the few selected from the many applicants who impressed the selection comitte the most then it is of little surprise that they did better than the average student at the same school, especially as they made an effort to improve in student success centers because they knew before hand they needed to work harded and that this was a lucky shot to even get into this school.
**
If you are talking about Georgia Tech then you are spouting the kind of conspiracy nonsense that usually I’d expect from my fundamentalist Cgristian relatives. GT asked the state for additional funding for inner city or “urban” scholarship development and got it. It was an academic coup for the program and the school and the political benefits of a southern school researching how to assist minority students was a boon.
**
**
This is nice and all, but the process to determine if a student is worthy of this special status is a lot more intensive than the typical admissions essay or SAT standard (or transcript basis for transferring students). It is probably a better idea to work toward making all K-12 education systems work properly to prepare those with the ability and inclination for college. Also consider than there is in most states an excellent community college program which does make it much easier to get into major universities despite SAT scores by booting your acedemic transcript as well as learning how to compete in a college environment.
**
**
You are right. There is no such thing as reverse bias, there is just bias. Revers bias means unbiased which is what we all say we want. People who say reverse bias are morons. Still, with limited seating, you do need some sort of standars as long as we have more money going to prisons than education. I was considering going pre-med with a dual enrollement at PSU and OHSU but there is a ridiculous waiting list at OHSU and that is with acedemic standards. Thankfully I audited an autopsy corse and discovered that I’m nauseus and am therefore more suited to psychology than phychiatry and can therefore get my Masters w/o vomiting my way through school. And as a bonus I don’t have to lose a year of my life to MCAT preparations.
**
I see the same thing in school all the time. What subject do you teach and is it possible or likely that it is a lack of preparation which can be blamed on the elementary school system?
**
I think this just goes to prove than those who make it to grad school have learned how to work harder. Think Forrest Gump working all those years to overcome his leg braces, then he is sans-brace and has developed greater than averave strenght from learning to cope. Minority students who make it usually tend to make it big because they have the determination to do it that kids who didn’t have to work as hard to get there often lack.
Am I going to be the only one to ask about these “green lemons”? I was honestly curious so I did a googe search for “green lemons” and one of the only good references that showed up was to this very article saying that it is a ridiculous example and there is no such thing as a ripe green lemon.
http://www.yaleherald.com/archive/xxviii/1999.10.29/opinion/p08sats.html
I have been to Mexico and Central America and I too have never seen these green lemons of which they speak. Could they be thinking of limes. If that is it then I am throwing my hands up in the air right now because you just cannot fight that kind of logic.
I’ve seen green lemons. They weren’t ripe, though.
There is only one word for lemon and lime in Spanish (limón) and lemons are rare in Latin America. If you learn that the word in English for lemon is limón, you’re going to be confused when someone tells you a lemon is yellow, when a limón is green.
Um, actually lime is la cal in Spanish.
Are you sure that’s lime-the-fruit and not lime-the-chemical-substance?
To answer The Ryan’s question about whether my example would really constitute cultural bias, I agree that there’s room for argument. However, the SAT tests a fairly narrow and limited range of the many skills that may help students succeed in college, and the selection of which skills those are is somewhat arbitrary. I’m inclined to say it would be a biased test if the testmakers relied heavily on a particular type of problem which one ethnic group was consistently better prepared to solve; the testmakers, after all, have the option of substituting a different type of problem where the discrepancies are not so great.
Undoubtedly there are some regional differences. My dictionary has the word tilo for lime, but I’ve only heard them called limones. In any case, you’re not going to get anything asking for cales in the market.
Aren’t IQ tests actually pretty similar to some parts of the SAT?
Yes. Some of the math questions especially are almost exactly what you would find on an IQ test. In fact it is only recently that there is more emphasis on what you actually know. The SAT II tests require that you have taken more advanced classes. Saying that the SAT only tests what you know is not accurate. I didn’t miss a single question on the SAT, but it wasn’t because I knew more than anyone else. On many of the math problems I used methods that I had never been taught, but that I knew were logical. On many of the verbal questions I made guesses based on knowing what some of the words meant.
What the SAT really measures is how well you can take tests. This is useful in predicting college success, because many college classes have tests.