# Is Nate Silver just in an "I can never be wrong" position.

**URL:** <https://boards.straightdope.com/t/is-nate-silver-just-in-an-i-can-never-be-wrong-position/639287>\
**Category:** Politics & Elections\
**Created:** [October 30, 2012, 2:19am UTC](https://boards.straightdope.com/t/is-nate-silver-just-in-an-i-can-never-be-wrong-position/639287 "2012-10-30T02:19:41Z")\
**Posts on this page:** 20\
**Page:** 7

<div class="post-metadata">

**Author:** ![Tarwater](https://avatars.discourse-cdn.com/v4/letter/t/9de0a6/32.png) [@Tarwater](https://boards.straightdope.com/u/Tarwater)\
**Post date:** [November 1, 2012, 4:26pm UTC](https://boards.straightdope.com/t/is-nate-silver-just-in-an-i-can-never-be-wrong-position/639287/122 "2012-11-01T16:26:30Z")

</div>

The most pressing question isn’t whether Silver is an effeminate gay idiot or whether liberals rely too heavily on his opinion, but rather what 538’s logo is meant to denote. I’ve held that it’s a very patriotic duck. My friends have recently tried pointing out that it’s actually a calculator, which is shocking if true.

---

<div class="post-metadata">

**Author:** ![Simplicio](https://avatars.discourse-cdn.com/v4/letter/s/c37758/32.png) [@Simplicio](https://boards.straightdope.com/u/Simplicio)\
**Post date:** [November 1, 2012, 4:32pm UTC](https://boards.straightdope.com/t/is-nate-silver-just-in-an-i-can-never-be-wrong-position/639287/123 "2012-11-01T16:32:07Z")

</div>

> [@Tarwater](#):
>
> The most pressing question isn’t whether Silver is an effeminate gay idiot or whether liberals rely too heavily on his opinion, but rather what 538’s logo is meant to denote. I’ve held that it’s a very patriotic duck. My friends have recently tried pointing out that it’s actually a calculator, which is shocking if true.

I used to see a calculator, but now that I’ve seen the nightmarish three-eyed ultra-American duck, I can’t unsee it.

---

<div class="post-metadata">

**Author:** ![drew870mitchell](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/drew870mitchell/32/3946_2.png) [@drew870mitchell](https://boards.straightdope.com/u/drew870mitchell)\
**Post date:** [November 1, 2012, 4:50pm UTC](https://boards.straightdope.com/t/is-nate-silver-just-in-an-i-can-never-be-wrong-position/639287/124 "2012-11-01T16:50:14Z")

</div>

> [@Exapno\_Mapcase](#):
>
> They both can’t right. Not even “right.” One will be wrong, and I mean _ **wrong** _. The actual results may wind up somewhere in the middle, of course, **but the odds are that one of them will be totally discredited.** It’s simply not true that either is in a real “I can never be wrong” position. That misunderstands the situation.

I strongly disagree. If they published their methodology, what more do you want? Their hypotheses will be proven false but as long as they own up, look at their system honestly, and fix some things, the actual analysts (neither Colorado nor Nate Silver) shouldn’t be discredited.

The Colorado prediction lives in a world where people know that, but even Nate Silver has built up enough of a reputation such that, if he’s very wrong but still desires to, he’ll have another respected prediction operation again in 2016.

---

<div class="post-metadata">

**Author:** ![ultrafilter](https://avatars.discourse-cdn.com/v4/letter/u/3d9bf3/32.png) [@ultrafilter](https://boards.straightdope.com/u/ultrafilter)\
**Post date:** [November 1, 2012, 5:12pm UTC](https://boards.straightdope.com/t/is-nate-silver-just-in-an-i-can-never-be-wrong-position/639287/125 "2012-11-01T17:12:12Z")

</div>

Andrew Gelman has a nice piece in the NY Times about [what too close to call really means](http://campaignstops.blogs.nytimes.com/2012/10/30/what-too-close-to-call-really-means/):

> [@](#):
>
> What I’m saying is that I can simultaneously (a) accept that Obama has a 72 percent chance of winning and (b) say the election is too close to call. What if the weatherman told you there was a 30 percent chance of rain — would you be shocked if it rained that day? No. To put it another way, suppose Mitt Romney pulls out 51 percent of the popular vote and wins the election. That doesn’t mean that Nate Silver skews the polls (as is suggested by this repulsive article at [Examiner.com](http://Examiner.com), which, among other things, criticizes Silver for being thin and having a soft voice). Romney winning the election with 51 percent of the vote is well within the margin of error, as Silver clearly indicates. That’s what too close to call is all about.
> 
> But, as psychologists like Daniel Kahneman, Paul Slovic and Amos Tversky have shown, people aren’t so good at thinking about probability and uncertainty. I struggle with this every day, and I can only imagine how difficult this sort of thing is for non-statisticians. An example from my own life: every semester I find myself surprised that some students who perform well on the midterm fall down on the final exam, while others who struggle at first end up performing very well. As a statistician, I know that a midterm exam is a noisy signal — but as a human, it’s hard for me to avoid falling into the trap of thinking of measurements as perfect.

This is pretty much required reading if you’re at all interested in probabilistic forecasting.

---

<div class="post-metadata">

**Author:** ![wonky](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/wonky/32/393_2.png) [@wonky](https://boards.straightdope.com/u/wonky)\
**Post date:** [November 1, 2012, 6:17pm UTC](https://boards.straightdope.com/t/is-nate-silver-just-in-an-i-can-never-be-wrong-position/639287/126 "2012-11-01T18:17:15Z")

</div>

> [@Simplicio](#):
>
> I used to see a calculator, but now that I’ve seen the nightmarish three-eyed ultra-American duck, I can’t unsee it.

This may show the sad state of my psyche, but I always see it as a bed. A sexy, sexy statistics bed. Bow chicka bow.

---

<div class="post-metadata">

**Author:** ![Enderw24](https://avatars.discourse-cdn.com/v4/letter/e/ba9def/32.png) [@Enderw24](https://boards.straightdope.com/u/Enderw24)\
**Post date:** [November 1, 2012, 6:50pm UTC](https://boards.straightdope.com/t/is-nate-silver-just-in-an-i-can-never-be-wrong-position/639287/127 "2012-11-01T18:50:38Z")

</div>

> [@Omg\_a\_Black\_Conservative](#):
>
> Yet the same people who adore Silver seem to ignore the fact that he was just okay in 2010. In fact, he was no more accurate than Rasmussen (who everyone around here loves to denigrate).

Of the 37 Senate seats contested in the November 2, 2010 elections, 36 were resolved by November 4, including very close outcomes in several states. Of these 36, the FiveThirtyEight model had correctly predicted the winner in 34.

Of the 37 gubernatorial races, FiveThirtyEight correctly predicted the winner of 36.

In final vote tallys as of December 10, 2010, the Republicans had a net gain of 63 seats in the House, 8 more than the total predicted on election eve though still within the reported confidence interval.

Cite: [FiveThirtyEight - Wikipedia](http://en.wikipedia.org/wiki/FiveThirtyEight)

So if we’re charitable and say he missed the House race by 8, that’s a total of ten errors in 508 tracked races. Or an accuracy rate of 98%.

That’s your definition of “just okay”? You’re worse than the Asian Dad meme.

---

<div class="post-metadata">

**Author:** ![Merneith](https://avatars.discourse-cdn.com/v4/letter/m/57b2e6/32.png) [@Merneith](https://boards.straightdope.com/u/Merneith)\
**Post date:** [November 1, 2012, 7:43pm UTC](https://boards.straightdope.com/t/is-nate-silver-just-in-an-i-can-never-be-wrong-position/639287/128 "2012-11-01T19:43:12Z")

</div>

> [@Simplicio](#):
>
> I used to see a calculator, but now that I’ve seen the nightmarish three-eyed ultra-American duck, I can’t unsee it.

Dammit! You got me, too!

---

<div class="post-metadata">

**Author:** ![HurricaneDitka](https://avatars.discourse-cdn.com/v4/letter/h/96bed5/32.png) [@HurricaneDitka](https://boards.straightdope.com/u/HurricaneDitka)\
**Post date:** [November 1, 2012, 8:12pm UTC](https://boards.straightdope.com/t/is-nate-silver-just-in-an-i-can-never-be-wrong-position/639287/129 "2012-11-01T20:12:32Z")

</div>

> [@Enderw24](#):
>
> So if we’re charitable and say he missed the House race by 8, that’s a total of ten errors in 508 tracked races. Or an accuracy rate of 98%.

You’re mixing and matching numbers in an utterly screwy way here.

He was 34 / 37 in the Senate, right? that’s 91.9%

In the governorships, he was 36 / 37, so that’s 97.3%

In the House, predicting how many seats the Republicans will pick up is not remotely the same as predicting the winners of individual House races. You can’t just combine the Senate and Governor’s mansions (where he did pick individual winners of particular races) with his House number and call them all “tracked races”. Not even close. It’s not that he correctly forecasted the winner in 427 out of 435 races. He took his best estimate of how many House seats the Republicans would pick up, knowing full well that some that he thought were likely pickups would not happen, and some that he thought were leaning Dem would fall.

You can’t lump the Houses 435 races in with “tracked races”, and you certainly can’t give him credit for calling 427/435 of them correctly when, to my knowledge, he didn’t predict a winner in _any_ individual House races.

---

<div class="post-metadata">

**Author:** ![Enderw24](https://avatars.discourse-cdn.com/v4/letter/e/ba9def/32.png) [@Enderw24](https://boards.straightdope.com/u/Enderw24)\
**Post date:** [November 1, 2012, 8:27pm UTC](https://boards.straightdope.com/t/is-nate-silver-just-in-an-i-can-never-be-wrong-position/639287/130 "2012-11-01T20:27:46Z")

</div>

> [@HurricaneDitka](#):
>
> You’re mixing and matching numbers in an utterly screwy way here.

Fair enough. I couldn’t find his 2010 Rep predictions but I wasn’t sure if it was because he didn’t have any or because my Google-Fu wasn’t strong enough. Turns out it’s the former.

He’s still at 94.5% accuracy in his selections for 2010. Better than “just okay.” Better than Rasmussen (34/37 in Gov, 33/37 Senate, 90.5%).

> **[Final Rasmussen Poll Results - 2010 Governor Elections - Rasmussen Reports®](https://www.rasmussenreports.com/public_content/politics/elections/election_2010/election_2010_governor_elections/final_rasmussen_poll_results_2010_governor_elections)**

> **[Final Rasmussen Poll Results - 2010 Senate Elections - Rasmussen Reports®](https://www.rasmussenreports.com/public_content/politics/elections/election_2010/election_2010_senate_elections/final_rasmussen_poll_results_2010_senate_elections)**

---

<div class="post-metadata">

**Author:** ![hajario](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/hajario/32/171_2.png) [@hajario](https://boards.straightdope.com/u/hajario)\
**Post date:** [November 1, 2012, 8:39pm UTC](https://boards.straightdope.com/t/is-nate-silver-just-in-an-i-can-never-be-wrong-position/639287/131 "2012-11-01T20:39:52Z")

</div>

> [@Enderw24](#):
>
> So if we’re charitable and say he missed the House race by 8, that’s a total of ten errors in 508 tracked races. Or an accuracy rate of 98%.
> 
> That’s your definition of “just okay”? You’re worse than the Asian Dad meme.

But it is “just ok” if all of the other guys were at 99.8%. How well he does has to be measured against the other guys.

---

<div class="post-metadata">

**Author:** ![HurricaneDitka](https://avatars.discourse-cdn.com/v4/letter/h/96bed5/32.png) [@HurricaneDitka](https://boards.straightdope.com/u/HurricaneDitka)\
**Post date:** [November 1, 2012, 8:48pm UTC](https://boards.straightdope.com/t/is-nate-silver-just-in-an-i-can-never-be-wrong-position/639287/132 "2012-11-01T20:48:37Z")

</div>

> [@Enderw24](#):
>
> He’s still at 94.5% accuracy in his selections for 2010. Better than “just okay.” Better than Rasmussen (34/37 in Gov, 33/37 Senate, 90.5%).

I didn’t bother to check all the Rasmsussen races, but I believe you and I’m not surprised by that either. I’d hope that anyone who aggregates polls would be more accurate than virtually all individual pollsters. Just curious, do you know how RealClearPolitics averages did in 2010?

---

<div class="post-metadata">

**Author:** ![GrandWino](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/grandwino/32/67_2.png) [@GrandWino](https://boards.straightdope.com/u/GrandWino)\
**Post date:** [November 1, 2012, 8:50pm UTC](https://boards.straightdope.com/t/is-nate-silver-just-in-an-i-can-never-be-wrong-position/639287/133 "2012-11-01T20:50:11Z")

</div>

> [@Enderw24](#):
>
> That’s your definition of “just okay”? You’re worse than the Asian Dad meme.

OMG! An Asian Dad Conservative!

---

<div class="post-metadata">

**Author:** ![HurricaneDitka](https://avatars.discourse-cdn.com/v4/letter/h/96bed5/32.png) [@HurricaneDitka](https://boards.straightdope.com/u/HurricaneDitka)\
**Post date:** [November 1, 2012, 8:50pm UTC](https://boards.straightdope.com/t/is-nate-silver-just-in-an-i-can-never-be-wrong-position/639287/134 "2012-11-01T20:50:46Z")

</div>

And, in Rasmussen’s defene, they were apparently the best individual pollster in 2008: [http://www.fordham.edu/images/academics/graduate\_schools/gsas/elections\_and\_campaign\_/poll%20accuracy%20in%20the%202008%20presidential%20election.pdf](http://www.fordham.edu/images/academics/graduate_schools/gsas/elections_and_campaign_/poll%20accuracy%20in%20the%202008%20presidential%20election.pdf)

---

<div class="post-metadata">

**Author:** ![iiandyiiii](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/iiandyiiii/32/7924_2.png) [@iiandyiiii](https://boards.straightdope.com/u/iiandyiiii)\
**Post date:** [November 1, 2012, 8:52pm UTC](https://boards.straightdope.com/t/is-nate-silver-just-in-an-i-can-never-be-wrong-position/639287/135 "2012-11-01T20:52:34Z")

</div>

> [@HurricaneDitka](#):
>
> And, in Rasmussen’s defene, they were apparently the best individual pollster in 2008: [http://www.fordham.edu/images/academics/graduate\_schools/gsas/elections\_and\_campaign\_/poll%20accuracy%20in%20the%202008%20presidential%20election.pdf](http://www.fordham.edu/images/academics/graduate_schools/gsas/elections_and_campaign_/poll%20accuracy%20in%20the%202008%20presidential%20election.pdf)

Well that was accuracy based on the final poll only. I wonder if anyone did an analysis to see who had the most consistent as well as accurate polling- because IIRC, in 2008, Rasmussen was off by quite a bit for most of the race between McCain and Obama, and at the end it “suddenly” became accurate.

---

<div class="post-metadata">

**Author:** ![Gyrate](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/gyrate/32/3588_2.png) [@Gyrate](https://boards.straightdope.com/u/Gyrate)\
**Post date:** [November 1, 2012, 11:08pm UTC](https://boards.straightdope.com/t/is-nate-silver-just-in-an-i-can-never-be-wrong-position/639287/136 "2012-11-01T23:08:31Z")

</div>

> [@iiandyiiii](#):
>
> Well that was accuracy based on the final poll only. I wonder if anyone did an analysis to see who had the most consistent as well as accurate polling- because IIRC, in 2008, Rasmussen was off by quite a bit for most of the race between McCain and Obama, and at the end it “suddenly” became accurate.

As Silver has repeatedly noted and factored into his model.

---

<div class="post-metadata">

**Author:** ![iiandyiiii](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/iiandyiiii/32/7924_2.png) [@iiandyiiii](https://boards.straightdope.com/u/iiandyiiii)\
**Post date:** [November 1, 2012, 11:09pm UTC](https://boards.straightdope.com/t/is-nate-silver-just-in-an-i-can-never-be-wrong-position/639287/137 "2012-11-01T23:09:42Z")

</div>

> [@Gyrate](#):
>
> As Silver has repeatedly noted and factored into his model.

Do you have a link? Not that I don’t believe you, I just didn’t know that and would like to read about it.

---

<div class="post-metadata">

**Author:** ![Measure\_for\_Measure](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/measure_for_measure/32/557_2.png) [@Measure\_for\_Measure](https://boards.straightdope.com/u/Measure_for_Measure)\
**Post date:** [November 2, 2012, 12:48am UTC](https://boards.straightdope.com/t/is-nate-silver-just-in-an-i-can-never-be-wrong-position/639287/138 "2012-11-02T00:48:55Z")

</div>

iiandyiiii This is for 2010, not 2008, but you might be interested. Nate Silver: For Rasmussen, however, the Republican lean in its polls ran pretty much wire to wire. It had a significant Republican house effect early in the election cycle and a significant Republican house effect late in the election, and it would up turning into a significant Republican bias on Election Day. [When 'House Effects' Become 'Bias' - The New York Times](http://fivethirtyeight.blogs.nytimes.com/2010/11/06/when-house-effects-become-bias/)

---

<div class="post-metadata">

**Author:** ![President\_Johnny\_Gentle](https://avatars.discourse-cdn.com/v4/letter/p/5f9b8f/32.png) [@President\_Johnny\_Gentle](https://boards.straightdope.com/u/President_Johnny_Gentle)\
**Post date:** [November 2, 2012, 2:20am UTC](https://boards.straightdope.com/t/is-nate-silver-just-in-an-i-can-never-be-wrong-position/639287/139 "2012-11-02T02:20:03Z")

</div>

> [@HurricaneDitka](#):
>
> And, in Rasmussen’s defene, they were apparently the best individual pollster in 2008: [http://www.fordham.edu/images/academics/graduate\_schools/gsas/elections\_and\_campaign\_/poll%20accuracy%20in%20the%202008%20presidential%20election.pdf](http://www.fordham.edu/images/academics/graduate_schools/gsas/elections_and_campaign_/poll%20accuracy%20in%20the%202008%20presidential%20election.pdf)

That was a preliminary report. The author updated his work after final election numbers came in and Rasmussen [fell to the median](http://www.fordham.edu/images/academics/graduate_schools/gsas/elections_and_campaign_/2008%20poll%20accuracy%20panagopoulos.pdf) in the final rankings.

---

<div class="post-metadata">

**Author:** ![Enderw24](https://avatars.discourse-cdn.com/v4/letter/e/ba9def/32.png) [@Enderw24](https://boards.straightdope.com/u/Enderw24)\
**Post date:** [November 2, 2012, 1:45pm UTC](https://boards.straightdope.com/t/is-nate-silver-just-in-an-i-can-never-be-wrong-position/639287/140 "2012-11-02T13:45:53Z")

</div>

> [@HurricaneDitka](#):
>
> I didn’t bother to check all the Rasmsussen races, but I believe you and I’m not surprised by that either. I’d hope that anyone who aggregates polls would be more accurate than virtually all individual pollsters. Just curious, do you know how RealClearPolitics averages did in 2010?

I thought about that, but, in the end, I determined that it was irrelevant. Let’s assume Rasmussen is the best pollster. Rasmussen certainly believes that it is or else, why be in the pollster business?  
So you have a choice between Rasmussen, the best and most accurate, or an average (or conglomeration) of a bunch of polls, all of whom would, by definition, have to be inferior to the best.  
So if one poll is THE most accurate, an aggregate of all polls would only serve to drive the accuracy down as compared to the best.

Or, to flip it, I’d ask the question of why Nate Silver would bother to do all the work he does if there’s one pollster who’s more accurate than he could be. Why not just have a blog that says “here’s Rasmussen’s numbers. Enjoy!”

---

<div class="post-metadata">

**Author:** ![iiandyiiii](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/iiandyiiii/32/7924_2.png) [@iiandyiiii](https://boards.straightdope.com/u/iiandyiiii)\
**Post date:** [November 2, 2012, 1:54pm UTC](https://boards.straightdope.com/t/is-nate-silver-just-in-an-i-can-never-be-wrong-position/639287/141 "2012-11-02T13:54:53Z")

</div>

Speaking of Rasmussen, their poll today shows Obama and Romney tied at 48.

[Previous page](https://boards.straightdope.com/t/is-nate-silver-just-in-an-i-can-never-be-wrong-position/639287.md?page=6)

[Next page](https://boards.straightdope.com/t/is-nate-silver-just-in-an-i-can-never-be-wrong-position/639287.md?page=8)
