# Explain Friday's XKCD

**URL:** <https://boards.straightdope.com/t/explain-fridays-xkcd/580202>\
**Category:** Factual Questions\
**Created:** [April 29, 2011, 7:40pm UTC](https://boards.straightdope.com/t/explain-fridays-xkcd/580202 "2011-04-29T19:40:26Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![Chessic\_Sense](https://avatars.discourse-cdn.com/v4/letter/c/7c8e57/32.png) [@Chessic\_Sense](https://boards.straightdope.com/u/Chessic_Sense)\
**Post date:** [April 29, 2011, 7:40pm UTC](https://boards.straightdope.com/t/explain-fridays-xkcd/580202/1 "2011-04-29T19:40:26Z")

</div>

I don’t [get it](http://xkcd.com/892/). There’s some inference going on here, and I just can’t grasp it. Is “the null hypothesis” supposed to be a generic stand-in for an outdated idea? Or is the guy mistakenly thinking that there’s only one null hypothesis because we call it the null hypothesis? Is it some commentary about our school system being slow to update? If so, what’s that have to do with the null, as opposed to any hypothesis, persisting? Perhaps he’s making fun of people who read a single study and dismiss something that should require some more rigor to be dismissed?

And what’s any of this have to do with the mouse-over about 8th graders and mega-research teams?

---

<div class="post-metadata">

**Author:** ![Spatial\_Rift\_47](https://avatars.discourse-cdn.com/v4/letter/s/a8b319/32.png) [@Spatial\_Rift\_47](https://boards.straightdope.com/u/Spatial_Rift_47)\
**Post date:** [April 29, 2011, 7:41pm UTC](https://boards.straightdope.com/t/explain-fridays-xkcd/580202/2 "2011-04-29T19:41:12Z")

</div>

> [@Chessic\_Sense](#):
>
> Or is the guy mistakenly thinking that there’s only one null hypothesis because we call it the null hypothesis?

It’s this one.

---

<div class="post-metadata">

**Author:** ![Munch](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/munch/32/5281_2.png) [@Munch](https://boards.straightdope.com/u/Munch)\
**Post date:** [April 29, 2011, 7:52pm UTC](https://boards.straightdope.com/t/explain-fridays-xkcd/580202/3 "2011-04-29T19:52:26Z")

</div>

> [@](#):
>
> And what’s any of this have to do with the mouse-over about 8th graders and mega-research teams?

The null hypothesis usually comes up in about 7th or 8th grade science. StickMan apparently had an 8th grade class that performed an experiment that disproved _that particular experiment’s_ null hypothesis. He mistook the conclusion as disproving _every null hypothesis ever_, and is perplexed that some researcher spent millions of dollars conducting experiments that couldn’t manage that much.

---

<div class="post-metadata">

**Author:** ![Kimmy\_Gibbler](https://avatars.discourse-cdn.com/v4/letter/k/bbe5ce/32.png) [@Kimmy\_Gibbler](https://boards.straightdope.com/u/Kimmy_Gibbler)\
**Post date:** [April 29, 2011, 8:30pm UTC](https://boards.straightdope.com/t/explain-fridays-xkcd/580202/4 "2011-04-29T20:30:10Z")

</div>

My surmise is that the joke is about (1) people who use statistical language without understanding what it means joined with (2) the observation that, generally, a study is only “interesting” when the null hypothesis can be rejected and (3) only “interesting” results get published. Thus if you pursue science journals knowing certain buzzwords, but not really being clear on the scientific method, experimental design, and rules for statistical inference (where might this happen?!?), you might, like poor benighted StickMan, think that “the null hypothesis is therefore rejected” means something other than it really does. To coin a phrase: “Hurr durr.”

As to the eigth-graders: perhaps this.

---

<div class="post-metadata">

**Author:** ![friedo](https://avatars.discourse-cdn.com/v4/letter/f/8edcca/32.png) [@friedo](https://boards.straightdope.com/u/friedo)\
**Post date:** [April 29, 2011, 9:08pm UTC](https://boards.straightdope.com/t/explain-fridays-xkcd/580202/5 "2011-04-29T21:08:40Z")

</div>

The joke is that the guy assumes there is only one _the_ null hypothesis. Therefore, if one experiment proves the null hypothesis wrong, all such hypotheses must be wrong, and it makes no sense to continue testing them.

---

<div class="post-metadata">

**Author:** ![Civil\_Guy](https://avatars.discourse-cdn.com/v4/letter/c/d78d45/32.png) [@Civil\_Guy](https://boards.straightdope.com/u/Civil_Guy)\
**Post date:** [April 30, 2011, 4:19am UTC](https://boards.straightdope.com/t/explain-fridays-xkcd/580202/6 "2011-04-30T04:19:35Z")

</div>

“You’re looking for the lowest common denominator? Haven’t they found that yet? They were looking for that when _I_ was in grade school!”

But it’s still as funny as it ever was.

---

<div class="post-metadata">

**Author:** ![Mosier](https://avatars.discourse-cdn.com/v4/letter/m/7ea924/32.png) [@Mosier](https://boards.straightdope.com/u/Mosier)\
**Post date:** [April 30, 2011, 5:34am UTC](https://boards.straightdope.com/t/explain-fridays-xkcd/580202/7 "2011-04-30T05:34:13Z")

</div>

> [@Civil\_Guy](#):
>
> But it’s still as funny as it ever was.

Snort. 🙂

---

<div class="post-metadata">

**Author:** ![Hari\_Seldon](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/hari_seldon/32/5173_2.png) [@Hari\_Seldon](https://boards.straightdope.com/u/Hari_Seldon)\
**Post date:** [April 30, 2011, 2:14pm UTC](https://boards.straightdope.com/t/explain-fridays-xkcd/580202/8 "2011-04-30T14:14:34Z")

</div>

My take on it is that it claims that a big study years ago demonstrated that there is no such thing as a null hypothesis. The irony comes from the fact that such a demo must have started with a null hypothesis. What could it possibly be? Only that there is no null hypothesis, but how could you possible reject that?

Just for the record, the null hypothesis comes when you ask a question, could such and such an effect be real? Can prayer really affect healing? The null hypothesis is that there is no effect of prayer on healing. You then set up an experiment in which half the patients are prayed for and half aren’t and see if there is any effect on healing. If there is, then you can reject the null hypothesis. Such an experiment was carried out a few years ago and the first results suggested that prayer did affect healing, but it turned out to be unrepeatable and had to be a statistical anomaly. After all, if effects found with p = .05 will still be wrong one time in 20. And effects found at p = .1 will be routinely rejected by people who misunderstand probability even though the effect should be real 9 times out of 10.

Anyway, I think the cartoon is pretty funny in the same way as CS books that have an index entry to “infinite loop” that says “See `loop, infinite'" and an entry to "loop, infinite" that says "See `infinite loop’”. It is assuredly self-referential.
