Are IQ Tests an accurate measure of a person's real intelligence?

The short answer to the question Are IQ tests an accurate measure of a person’s real intellicence would be no.

The long answer is that it depends both of the definition of intelligence, the definition of IQ and the psychometric properties of the test used. Unfortunatly I have no idea what kind of IQ tests you use in the US schools,

IQ, or intelligence quota, in the classical sense, is a very outdated concept as a measure of the construct we call “intelligence” in normal language.

The classical IQ tests are the Stanford-Binet test and the large amount of similar test. They measure some logic, analytic and verbal reasoning, as well as short term memory functions. To understand what these tests measure, we must take a look into the boring world of psychometric. Are you familiar with the terms stability, reliability and validity? If so, skip the next paragraph:

Stability is a measure of how stable the variable you want to measure is across time. In the beginning of the 20th century when the classical IQ tests were born, intelligence was supposed to be stable, inherent trait rather than something you can aquire. Thus, the classic IQ tests are supposed to show high stability, ie an individual should score about the same result in the test when taking it at different ages - simply put, your IQ should not change a lot with age.
Reliability is a measure of how accurately you measure the variable you want to measure. As you understand, high stability is a requirement for high reliability if you measure something you expect to be stable. If intelligence is stable, but a person scores IQ 98 at age 10, IQ 120 at age 20 and IQ 70 at age 40, then there’s either something wrong with the person, or the test is not accurate, or it lacks validity. There’s also something called test-retest reliability. If you give the same test to the same person let’s say 2 days in a row, the score should be about the same. If it’s not, something is also clearly wrong.
Validity is a measure of whether the test is measuring what you want it to measure, or something else. How to aquire validity is a long story, but one common way is to correlate your test to other measures you think are relevant to the variable you want to measure.

Classical IQ tests are a very good measurement of current level of education in the Western culture educational system, and it’s also a good predictor of aptitude for future studying in our educational system. Why is this? It’s because most of the classical IQ tests were validated against educational level to start with. We want to measure intelligence. Here’s a test. How do we know it measures intelligence? People who have a high educational level must be intelligent. Therefore, if highly educated people score high on the test, whereas people with low education score low, we are measuring intelligence. Thus, the majority of the IQ tests were validated.

The index “IQ” was obtained by giving the test to a lot of kids in different ages and calculating the mean for each age group. Thus you set norms to your test. 5-year olds scores X points, 10-year olds score Y points. IQ is the quota between the chronologic (real) age of the kid and the “intelligence age” or “mental age” as points in the test * 100. If a 5-year old scores Y points, ie the result that is usually scored by 10-year olds, the kids IQ would be 10/5 * 100 = 200. This is the reason why it’s children and young people can score extremely high on classical IQ tests, whereas a 60-year old can never score as high. Does this mean the 60-year old Nobel proze winners are not very intelligent?

Much has happened since the classical IQ tests. The Stanford-Binet has been revised many times, and corrections for error sources have been made. The Weschler scales were introduced in 1939 or thereabouts, and they use a different way of calculating intelligence, based on norm samples and standardized scoring. The WAIS and WISC score are not usually called IQ by professionals, but there is a way of transforming WAIS/WISC results to IQ although the test constructors strongly advice caution in doing so. IIRC the roof is set to IQ 140 in WAIS, since it’s not regarded meaningful to differentiate higher than that. Still, the Weschler scales also correlates highly with level of education, and it can’t be used for cross-cultural even between European countries or Europe/US. The US norms for instance, are significantly lower than the norm in my country. If the US norms was used here, a majority of people would score above the mean, and thus the mean would not be the mean. (Actually, the US norms are only used for forensic populations, ie criminals who have committed crimes with a minimum of 2 years prison as a penatly.) Does this mean my countrymen are more intelligent than Americans?

Here, classical IQ test are only used by the military (for recruitment) and by MENSA. Tests like WISC and NEPSY are used for children, mostly to identify special learning disabilities or as a part of a diagnostic procedure. For adults, “intelligence” tests are almost exclusively used for clinical assessment, as tools of diagnosis. But the tests are not called intelligence tests any longer, they are called neuropsychological or cognitive tests.

In research, the term “intelligence” is far to vague to be useful. In the 1960’s “intelligence” used to be defined as “what is measured with an IQ test” just as depression was once defined as “the condition that improves by giving TCA antidepressants”. Nowadays, the term cognitive functions is used when we refer to abilites like different memory functions, ability to concentrate, ability of learning, process-speed, logical reasoning etc. “Cognitive functions” is a much broader concept that what people in general mean by “intelligence”, and it includes a lot of functions that is not correlated to aptitude for academic studying.

The more modern concept G-factor is probably the closest you can get to what is commonly meant by “intelligence”. If you want to know more about the G-factor or other things related to “intelligence” ask, and I’ll try to answer your questions.

Btw, what IQ test are used in American schools?

One Cell, I know this post was not for me, but since my long post deals with your questions, I could as well answer this.

  1. Mental age is the term used to refer to the expected perfomance for a certain age. See my post about how the classical IQ tests were constructed, and ask again if I was unclear about the age norm construction.
  2. Yes, your example illustrated one of the major problems with the classical IQ tests. Of course a 0 year old baby can’t take a classical IQ test, but the principle is correct. Also the Weschler scales show age decrease although IQ is not used in these tests. The peak for WAIS-R score is 20 years of age, and decline starts after 30.
  3. If those comments are referring to Legolas post as quoted here, I think you might have misunderstood something. In classical IQ tests, IQ is calculated as Legolas says. Please read my post above.

Usually the Stanford-Binet and the WISC. I think the WISC might currently be the more popular one.

I think IQ tests can sometimes help indicate a person’s intelligence, but they are too unreliable (IMO) to really definitively prove anything.

I have taken several online IQ tests, and my scores varied on all of them. But one thing was consistent - I always scored “above average”. Sometimes I was scored as a frickin’ genius, other times I was just “above average”. But never have I been “average” or below. So at least there is that small amount of consistency. And yeah, in real life, my intelligence is generally considered “above average”, as were my grades in school. (Though I sometimes don’t have a lick of common sense!)

And adding to the long string of antecdotes - I also have a friend who is (IIRC) a genius, and is well-versed in many topics, and is obviously intelligent and well-educated. But she lacks some basic common sense, and does some immensely stupid and deluded things. DUMB, dumb things. So, a high IQ (or low IQ) really cannot define the whole person.

Re the Op: Absolutely. Those test measure the intelligence of the test taker precisely. I should know: I score high every time.

In most sciences, you propose a method of measuring the quantitative presence of a thing, say, Z, by first defining the thing. Then you show a reliable proportional relationship between the quantity of Z that is present and the alteration in value by the system of measure you are using.

Social sciences have always skipped the first step. Having done so, the troublesome need to demonstrate any relationship can be likewise dismissed. What is left is simply a method that provides a set of values for each member of any group. Statistical analysis can provide any additional data, which might be needed.

Tris

“As far as the laws of mathematics refer to reality, they are not certain; and as far as they are certain, they do not refer to reality.” ~ Albert Einstein ~

Why are they used? Are they used to determine aptitude for study, to identify learning problems, for diagnostic purposes or something else? What are they believed to predict, if anything?

SB LM is used to identify exceptionally and profoundly gifted children who hit the ceiling in the Weschler tests. 3 or more scores of 17, 18 or 19 on the sub tests.

SB IV is used to measure IQ. I’m not sure that it is routinely used for identifying learning disabilities.

WPPSI-R is used with kids younger than 6 for IQ testing. It’s not useful for identifying learning disabilities or much else.

WISC III is used for IQ testing. It’s used for identifying learning disabilities. Certain patterns of scatter in the subtests can indicate learning disabilities. It’s also beginning to be used as a screening tool for Asperger’s syndrome which is IMO a dubious use.

I’m curious if someone who doesn’t think there’s a correlation between the ability to score high on an IQ test and the ability to learn, how do you explain kids such as Justin Chapman or Michael Kearney or any of the kids who score high on the SB LM and who are at college at a young age?

BTW pushy parents is not an acceptable answer :wink:

Primaflora: Cognitive tests are obviously used quite differently in the US than where I live.

WISC III is often used as a screening test to identify learning disability and even neuropsychiatric conditions, but especially in case of the latter, further area specific tests are used.

I agree with you that WISC III is not a very suitable Aspberger screening instrument. There are other well validated scales around specifically for the autism-Aspberger spectrum.

These days I believe they are generally used to identify both gifted and learning disabled or mentally handicapped children. An IQ above a certain score is required for admission into gifted programs in many school districts.

My mother tells me that when she was growing up schoolchildren were given IQ tests just as if they were any other standardized test (they were not administered by a trained psychologist in a one-on-one setting, but were paper-and-pencil tests given to the entire class or even the entire grade at once), and that these were intended to measure scholastic aptitude. As far as I know this is no longer SOP anywhere in the US and has not been for some time, but I’m sure many adults remember this. I believe these tests are the source of many of the “celebrity IQ” figures that get passed around as trivia.

It’s ASPERGER! Sorry just minor spelling nitpick. Actually Aspergers doesn’t really have a well validated scale. It’s pretty new in the DSM IV in the scheme of things and it is fairly lightly dx’ed in most places.

Where do you live Wiwaxia? I don’t know of a country where the Weschler tests are often used as a screening test for LD and for neuropsychiatric screening. What sort of neuropsychiatric conditions is it useful for screening for?

BTW Lamia, group testing is still used in the US and it’s still fairly inaccurate on an individual level.

See the following thread:

http://boards.straightdope.com/sdmb/showthread.php?threadid=90737

We’re going to be creating an FAQ on I.Q.

Hey december

I’ve got another book recommendation for you. Measured Lies: The Bell Curve Examined. It’s an excellent analysis of the science and politics behind Herrnstein and Murray’s book, and of Social Darwinism, pedagogy, and IQ theory besides. I have no doubt, december, that you will read this book diligently and with an open mind. Check back afterward, 'kay?

(As an added bonus, check out the first two reviews of the book in the Amazon link above. Funny stuff.)

IQ tests do only measure how well you take IQ tests, but they also are a source for great arrogance. Notice how few people actually say “I’ve got an extremely low IQ score, but I am intelligent.”

Personally, I have always done well on IQ tests and regular tests in school, but my grades were terrible. I often had at least one (often more) missed assignment in each class, which knocks down the averages significantly. I am a very unorganized person, but is one’s ability to arrange things a part of intelligence? Think so I do not.

I always thought that intelligence was immeasurable, except within a slight ballpark (ie. really smart, normal, and idiots). It seems that a complete idiot with a perfect memory could graduate with honors because this could allow them o skate through any class. Memory is the prime thing we measure. Even math skills require the memorization of formulas. I do have to wonder about measuring the application of knowledge beyond memorization.

Does it make you intelligent if you can figure out a safe following distance from the car in front of you? If not mathematically, your mind may be able to find a distance visually that would be safe. If someone put you in a hole with all the parts to build a ladder out of strange tools you’ve never seen, could you get out?

I think it all comes down to someone’s personal definition of the word “intelligence.” I’ve decided not to use the word “intelligent” to describe anyone because I’ve heard some people say “but he/she is intelligent,” to which I respond, “an intelligent person wouldn’t do what he/she is doing/has done.” Consequences for one’s actions is a very basic concept, and some supposedly “intelligent” people still don’t understand it.

My conclusion: You can’t measure intelligence. But I’m just a lowly fool whose grades were low, but what do I know?

Dale you seem to be assuming that achievement equals intelligence and that IQ tests set out to measure acquired knowledge.

They don’t.

Thanks for the reference, Gaderene. I’ll look for the book. I have a vague memory of having glanced at it several years ago. If this is the book I’m thinking of, I, like one of the reviewers, got the impression that some of the writers included hadn’t actually read The Bell Curve.

I appreciate your pointing out the first two reviews, but I’m puzzled by your word “funny.” Is it your thesis that Measured Lies is so obviously excellent that criticism of the book is “funny”? As I understood the first two reviewers, they found the book disappointing. Can you elaborate on why you judged Measured Lies to be excellent?

I can elaborate on why I found the first two reviews to be so funny. Throughout Measured Lies, the essayists cite chapter and verse of The Bell Curve in explaining how the science, the theory, and the logic is flawed. Part III of the book, pages 109-404, is entitled, “Responding to The Bell Curve: Chapter by Chapter.” The notion that the authors of Measured Lies hadn’t really read the book they were critiquing is so transparently and obviously wrong that it makes me laugh. That’s why I found the first reviewer to be funny–the fact that you shared his perception does nothing for my opinion of your reading comprehension.

As for the second reviewer…well, the guy sounds like a thinly veiled racist. He defends Herrnstein and Murray by pointing out that they’re not claiming that blacks are inferior to whites, but just that "Blacks are ON AVERAGE less inteligent [sic] than Whites (And whites less inteligent [sic] on average that [sic] Asians, and Asians less inteligent [sic] on average that [sic] Jews. What a strange racist-nazis [sic], they say that jews are the smartest people in the world and that we caucasians are the third group in inteligence [sic]). Mmhmm. Later he calls Philippe Rushton’s racist screed Race, Evolution, and Behavior “very interesting”–Rushton’s the guy who posited an inversely proportional relationship between brain size and penis size.

Satisfied? Read the book, december. I think it goes into more direct detail about The Bell Curve than you think it does.

For what it’s worth, I read the “Bell Curve Examined” book a couple years ago, and I was pretty disappointed. It seemed to me that many or most of the authors were interested in taking every possible shot, fair or not, at a book that offended them.

In fairness, “The Bell Curve” too is, IMHO, an advocacy piece with a not-so-hidden agenda.

BTW, Gaderene, have you read The Bell Curve?

Sure have, 'cembie. (I suppose if I hadn’t, though, it would have freed you up–in your mind–from having to respond to my post above. Tit for tat, and all that.)