# Lying with statistics

**URL:** <https://boards.straightdope.com/t/lying-with-statistics/627453>\
**Category:** Miscellaneous and Personal Stuff I Must Share\
**Created:** [July 6, 2012, 6:49pm UTC](https://boards.straightdope.com/t/lying-with-statistics/627453 "2012-07-06T18:49:09Z")\
**Posts on this page:** 20\
**Page:** 1

<div class="post-metadata">

**Author:** ![purple\_cow](https://avatars.discourse-cdn.com/v4/letter/p/b487fb/32.png) [@purple\_cow](https://boards.straightdope.com/u/purple_cow)\
**Post date:** [July 6, 2012, 6:49pm UTC](https://boards.straightdope.com/t/lying-with-statistics/627453/1 "2012-07-06T18:49:09Z")

</div>

We all know the old quote (Twain or whoever). What are your favorite (or most hated) examples. Many will be political but i’d like to keep value judgements out of it and focus how the statistics are fudged to make them say something they don’t really support.

My current one is, of course, unemployment is higher now than when Obama took office. I don’t go a day without hearing it. Well yes, it was 7.8% when he was inaugurated. But it was 6.1% in September 2008 and 9.4% by May 2009 and over 10% by July so the trend wasn’t exactly positive.

One of my favorites from the past was “Al Gore’s house in TN uses 254 times more energy in one year than the average person’s house does per month.” People of course focus on the 254 and completely miss the juxtaposition of a year and a month. So, the statement is true, but it’s really a lie. (there were lots of other fudges that brought the actual value down to like 3X average but the year vs month was the really egregious part)

---

<div class="post-metadata">

**Author:** ![Harmonious\_Discord](https://avatars.discourse-cdn.com/v4/letter/h/74df32/32.png) [@Harmonious\_Discord](https://boards.straightdope.com/u/Harmonious_Discord)\
**Post date:** [July 6, 2012, 7:30pm UTC](https://boards.straightdope.com/t/lying-with-statistics/627453/2 "2012-07-06T19:30:01Z")

</div>

It’s misdirection. The media is always using misdirection, and I don’t credit any statistic I can’t see the data for and it’s collection process.

---

<div class="post-metadata">

**Author:** ![Napier](https://avatars.discourse-cdn.com/v4/letter/n/ce73a5/32.png) [@Napier](https://boards.straightdope.com/u/Napier)\
**Post date:** [July 6, 2012, 7:37pm UTC](https://boards.straightdope.com/t/lying-with-statistics/627453/3 "2012-07-06T19:37:08Z")

</div>

I think “lie” could fairly be taken to include everything said with the intent to mislead, so I think the 254 comment could count; yes, it’s a judgement, but being too fussy with the definition of lying encourages saying things intended to mislead in such a clever way that they are not lies in a purely logical sense.

Since a confidence level 95% is a very common criterion used by statisticians, if you can dig up 2000 statistical statements, you should have about 100 incorrect ones to choose from, for which the data and its collection process are proper.

---

<div class="post-metadata">

**Author:** ![TriPolar](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/tripolar/32/3008_2.png) [@TriPolar](https://boards.straightdope.com/u/TriPolar)\
**Post date:** [July 6, 2012, 8:17pm UTC](https://boards.straightdope.com/t/lying-with-statistics/627453/4 "2012-07-06T20:17:21Z")

</div>

My favorite now is a poll that shows 15% in favor of something, 20% against, and 65% not sure. Now the pros say 80% don’t oppose it, and the cons say 85% aren’t in favor of it.

I’ve mentioned ths old story before: A group of seminary students were polled about whether or not it was alright to smoke while praying. They responded 100% that it was not. When the question was rephrased as whether or not it was alright to pray while smoking, 100% agreed that it was.

---

<div class="post-metadata">

**Author:** ![billfish678](https://avatars.discourse-cdn.com/v4/letter/b/7bcc69/32.png) [@billfish678](https://boards.straightdope.com/u/billfish678)\
**Post date:** [July 6, 2012, 8:34pm UTC](https://boards.straightdope.com/t/lying-with-statistics/627453/5 "2012-07-06T20:34:00Z")

</div>

I seem to recall a new story years ago (and I doubt it is unique) along the lines of “20 percent of Americans live in poverty!”

Which sounds bad until you realize that the definition of poverty was litterally the bottom 20 percent (economics wise) of the population.

Or whatever the actual percentage was…

---

<div class="post-metadata">

**Author:** ![Shark](https://avatars.discourse-cdn.com/v4/letter/s/73ab20/32.png) [@Shark](https://boards.straightdope.com/u/Shark)\
**Post date:** [July 6, 2012, 9:23pm UTC](https://boards.straightdope.com/t/lying-with-statistics/627453/6 "2012-07-06T21:23:58Z")

</div>

I like to point out that half of all kids at performing below average at any given school.

People have come to think of “below average” as worse than it really is and that “below average” is unacceptable. Oh my god, how can half the kids be performing at an unacceptable level?

---

<div class="post-metadata">

**Author:** ![Malacandra](https://avatars.discourse-cdn.com/v4/letter/m/45deac/32.png) [@Malacandra](https://boards.straightdope.com/u/Malacandra)\
**Post date:** [July 6, 2012, 9:40pm UTC](https://boards.straightdope.com/t/lying-with-statistics/627453/7 "2012-07-06T21:40:15Z")

</div>

And then the modal score of Australian cricketer Don Bradman was (probably - I don’t have all the figures to hand) 0.

He was out 70 times in his international career, of which 8 were for 0. Since his other scores spanned a wide range, up to 334, it’s perfectly possible he was never out for any given non-zero score more than once, and very likely no other score as many as eight times, making zero his commonest. The more usual measure of a batsman’s prowess is the mean; Bradman’s is 99.94 and almost any other cricketer would be delighted to have an average literally half as good.

---

<div class="post-metadata">

**Author:** ![ultrafilter](https://avatars.discourse-cdn.com/v4/letter/u/3d9bf3/32.png) [@ultrafilter](https://boards.straightdope.com/u/ultrafilter)\
**Post date:** [July 6, 2012, 10:34pm UTC](https://boards.straightdope.com/t/lying-with-statistics/627453/8 "2012-07-06T22:34:47Z")

</div>

Mark Twain’s full quote says something pretty different from what people normally think he said:

> [@](#):
>
> I was deducing from the above that I have been slowing down steadily in these thirty-six years, but I perceive that my statistics have a defect: three thousand words in the spring of 1868, when I was working seven or eight or nine hours at a sitting, has little or no advantage over the sitting of to-day, covering half the time and producing half the output. Figures often beguile me, particularly when I have the arranging of them myself; in which case the remark attributed to Disraeli would often apply with justice and force:  
> “There are three kinds of lies: lies, damned lies, and statistics.”

---

<div class="post-metadata">

**Author:** ![Dr.Love](https://avatars.discourse-cdn.com/v4/letter/d/e8c25b/32.png) [@Dr.Love](https://boards.straightdope.com/u/Dr.Love)\
**Post date:** [July 7, 2012, 11:28pm UTC](https://boards.straightdope.com/t/lying-with-statistics/627453/9 "2012-07-07T23:28:53Z")

</div>

> [@Shark](#):
>
> I like to point out that half of all kids at performing below average at any given school.

I like to point out that the above statement is incorrect. And changing “average” to “median” or "below’ to “no better than” won’t fix the problem.

---

<div class="post-metadata">

**Author:** ![Max\_the\_Immortal](https://avatars.discourse-cdn.com/v4/letter/m/6de8d8/32.png) [@Max\_the\_Immortal](https://boards.straightdope.com/u/Max_the_Immortal)\
**Post date:** [July 7, 2012, 11:50pm UTC](https://boards.straightdope.com/t/lying-with-statistics/627453/10 "2012-07-07T23:50:29Z")

</div>

nm

---

<div class="post-metadata">

**Author:** ![msmith537](https://avatars.discourse-cdn.com/v4/letter/m/d9b06d/32.png) [@msmith537](https://boards.straightdope.com/u/msmith537)\
**Post date:** [July 7, 2012, 11:54pm UTC](https://boards.straightdope.com/t/lying-with-statistics/627453/11 "2012-07-07T23:54:55Z")

</div>

60% it works EVERY time!

---

<div class="post-metadata">

**Author:** ![don\_t\_ask](https://avatars.discourse-cdn.com/v4/letter/d/e68b1a/32.png) [@don\_t\_ask](https://boards.straightdope.com/u/don_t_ask)\
**Post date:** [July 8, 2012, 12:03am UTC](https://boards.straightdope.com/t/lying-with-statistics/627453/12 "2012-07-08T00:03:59Z")

</div>

My favorite has always been the Pepsi taste challenge from many years ago on TV.

What I admired was the clever wording of the stated facts at the end. Having shown a few avowed Coke lovers choosing Pepsi in a blind test, the voice over said, “In recent blind taste tests the majority of Coke lovers preferred the taste of Pepsi.”

So what does that mean? Let’s say I break up all my Coke lovers into groups of 3 and call each group a “test.” Whenever 2 or 3 people prefer Pepsi that is one test where “the majority of Coke lovers preferred the taste of Pepsi.” So how many do I need to make my tagline true? Only two, even if in 2000 cases it’s not true.

Beautiful. An apparently compelling stat that tells you nothing at all.

---

<div class="post-metadata">

**Author:** ![Ambivalid](https://avatars.discourse-cdn.com/v4/letter/a/a5b964/32.png) [@Ambivalid](https://boards.straightdope.com/u/Ambivalid)\
**Post date:** [July 8, 2012, 12:15am UTC](https://boards.straightdope.com/t/lying-with-statistics/627453/13 "2012-07-08T00:15:59Z")

</div>

> [@TriPolar](#):
>
> A group of seminary students were polled about whether or not it was alright to smoke while praying. They responded 100% that it was not. When the question was rephrased as whether or not it was alright to pray while smoking, 100% agreed that it was.

That’s great. I’m stealing this.

---

<div class="post-metadata">

**Author:** ![Dr.Love](https://avatars.discourse-cdn.com/v4/letter/d/e8c25b/32.png) [@Dr.Love](https://boards.straightdope.com/u/Dr.Love)\
**Post date:** [July 8, 2012, 12:40am UTC](https://boards.straightdope.com/t/lying-with-statistics/627453/14 "2012-07-08T00:40:27Z")

</div>

Similar to the OP, there was [This critique of a claim by the Obama compaign on Good Math Bad Math](http://scientopia.org/blogs/goodmath/2012/03/07/obama-campaign-lies-with-bad-math/) not too long ago:

> [@](#):
>
> The letter starts by complaining about a Romney campaign fundraiser, saying:
> 
> > [@](#):
> >
> > It may not take the Romney camp very long to get to a million – they announced today that just 9 percent of their money comes from donors giving less than $200.
> 
> Take note of the fundamental point there. Of the money collected, 9% came from small donors.
> 
> Then they attempt to contrast themselves against Romney:
> 
> > [@](#):
> >
> > Our campaign is different. It’s about bringing people together to protect the progress we’ve made and make a lot more in a second term. And 98 percent of the donations people like you make to this campaign are $250 or less.
> 
> The main point: of the people donating, 98% were small donors.

By looking alternately at the number of donors vs. the amount of donations they’re obscuring the actual differences between the campaigns. It’s entirely possible that both of those statistics could describe the same campaign.

---

<div class="post-metadata">

**Author:** ![Dave\_Hartwick](https://avatars.discourse-cdn.com/v4/letter/d/7feea3/32.png) [@Dave\_Hartwick](https://boards.straightdope.com/u/Dave_Hartwick)\
**Post date:** [July 8, 2012, 12:40am UTC](https://boards.straightdope.com/t/lying-with-statistics/627453/15 "2012-07-08T00:40:48Z")

</div>

One that I used to see in charts for managed funds or brand vs brand performance is fooling with the Y axis. The variance might only be 2%, so change the unit to dollars, say, or days, whatever, and then start the axis at a few points below the worst performer. That way the 2% variance might take up 70% of the axis.

Not sure if I explained it very well and don’t feel like looking for an example, sorry.

---

<div class="post-metadata">

**Author:** ![notfrommensa](https://avatars.discourse-cdn.com/v4/letter/n/f14d63/32.png) [@notfrommensa](https://boards.straightdope.com/u/notfrommensa)\
**Post date:** [July 8, 2012, 1:25am UTC](https://boards.straightdope.com/t/lying-with-statistics/627453/16 "2012-07-08T01:25:23Z")

</div>

"Figures don’t lie, but liars figure. "

---

<div class="post-metadata">

**Author:** ![Arabella\_Flynn](https://avatars.discourse-cdn.com/v4/letter/a/8491ac/32.png) [@Arabella\_Flynn](https://boards.straightdope.com/u/Arabella_Flynn)\
**Post date:** [July 9, 2012, 6:09am UTC](https://boards.straightdope.com/t/lying-with-statistics/627453/17 "2012-07-09T06:09:50Z")

</div>

Any report of a medical finding that says X “doubled the risk” of Y, without revealing that this means it took the risk from 0.000004% to 0.000008% over the course of a lifetime. Technically, it’s true. Functionally, it’s scare-mongering.

---

<div class="post-metadata">

**Author:** ![Joey\_P](https://avatars.discourse-cdn.com/v4/letter/j/919ad9/32.png) [@Joey\_P](https://boards.straightdope.com/u/Joey_P)\
**Post date:** [July 9, 2012, 6:17am UTC](https://boards.straightdope.com/t/lying-with-statistics/627453/18 "2012-07-09T06:17:29Z")

</div>

Seems like a good place to drop in this [XKCD](http://xkcd.com/925/).

---

<div class="post-metadata">

**Author:** ![Mangetout](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/mangetout/32/19_2.png) [@Mangetout](https://boards.straightdope.com/u/Mangetout)\
**Post date:** [July 9, 2012, 7:20am UTC](https://boards.straightdope.com/t/lying-with-statistics/627453/19 "2012-07-09T07:20:02Z")

</div>

> [@Shark](#):
>
> I like to point out that half of all kids at performing below average at any given school.
> 
> People have come to think of “below average” as worse than it really is and that “below average” is unacceptable. Oh my god, how can half the kids be performing at an unacceptable level?

It varies from subject to subject, but typically, 90% or more of the kids at my local school are performing above average. Really. See if you can work out how.

---

<div class="post-metadata">

**Author:** ![denquixote](https://avatars.discourse-cdn.com/v4/letter/d/b9bd4f/32.png) [@denquixote](https://boards.straightdope.com/u/denquixote)\
**Post date:** [July 9, 2012, 8:03am UTC](https://boards.straightdope.com/t/lying-with-statistics/627453/20 "2012-07-09T08:03:59Z")

</div>

> [@Mangetout](#):
>
> It varies from subject to subject, but typically, 90% or more of the kids at my local school are performing above average. Really. See if you can work out how.

It appears to me as if Shark was comparing students at one school only against each other while you are using some standardized performance chart or evaluation.

[Next page](https://boards.straightdope.com/t/lying-with-statistics/627453.md?page=2)
