# FiveThirtyEight.com decimated by Disney layoffs **URL:** \ **Category:** Politics & Elections\ **Created:** [April 27, 2023, 1:23am UTC](https://boards.straightdope.com/t/fivethirtyeight-com-decimated-by-disney-layoffs/983242 "2023-04-27T01:23:57Z")\ **Posts on this page:** 20\ **Page:** 5
**Author:** ![Atamasama](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/atamasama/32/12961_2.png) [@Atamasama](https://boards.straightdope.com/u/Atamasama)\ **Post date:** [April 30, 2023, 7:40pm UTC](https://boards.straightdope.com/t/fivethirtyeight-com-decimated-by-disney-layoffs/983242/81 "2023-04-30T19:40:37Z")
I have never looked at a poll and felt confident I knew the winner. That would be foolish. They might make me optimistic or pessimistic, but they don’t convince me that I know the outcome. No more than odds of a sporting event convince me of the outcome before the event concludes. Meteorologists seem to have a better track record in my experience. Weather is a lot easier to predict than people. You might then ask, what is the point of a poll? I don’t think the conclusion (the odds) is all that important, because it is just a guess. I think what matters is how that conclusion is drawn. Let’s say a candidate polls at 30%. Why? If it’s lack of experience, a scandal, a tendency to not honor promises, if it’s being a bad public speaker, all of those things matter. That 30% figure on its own isn’t more than a curiosity to me. Maybe it means more to someone else but not me. ---
**Author:** ![Aeschines](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/aeschines/32/16251_2.png) [@Aeschines](https://boards.straightdope.com/u/Aeschines)\ **Post date:** [April 30, 2023, 7:42pm UTC](https://boards.straightdope.com/t/fivethirtyeight-com-decimated-by-disney-layoffs/983242/82 "2023-04-30T19:42:03Z")
Here is Silver looking at his results in 2017. He has no regrets: > **[Nate Silver says conventional wisdom, not data, killed 2016 election forecasts](https://news.harvard.edu/gazette/story/2017/03/nate-silver-says-conventional-wisdom-not-data-killed-2016-election-forecasts/)** > > Don’t blame data analytics for Trump’s unexpected victory, Nate Silver says, blame political reporting’s conventional wisdom. I think this is a key quote: > [@](#): > > We think our general election model was really good. It said there was a pretty good chance of Trump winning, and it correctly captured that the Electoral College was a big vulnerability for Clinton. So our viewpoint is that, in terms of the general election, if everyone says “Trump has no chance” and you use modeling to say “Hey, look at this more rigorously; he actually has a pretty good chance. Not 50 percent, but 30 percent is pretty good.” To me, that’s a highly successful application of modeling. That doesn’t mean you can’t go back and look at things. **We provided a lot of insight to our readers to not be complacent about the general election outcome,** whereas I think that wasn’t true for a lot of places. Emphasis added. This is perhaps the crux of the debate in this thread. I think the site, through its structure and presentation, was misleading on this point (though there were hedgey things to be found), and I think Silver could have been more emphatic about how that 30% chance Trump had ought to be perceived. But in order to be totally fair to Silver, I would need to go back to his media appearances in 2016 and see what he was saying on that account. E.g., whether he needed to correct others’ false impressions that the Hillary’s 70%+ chance on the site meant other than it did, etc. ---
**Author:** ![Aeschines](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/aeschines/32/16251_2.png) [@Aeschines](https://boards.straightdope.com/u/Aeschines)\ **Post date:** [April 30, 2023, 7:50pm UTC](https://boards.straightdope.com/t/fivethirtyeight-com-decimated-by-disney-layoffs/983242/83 "2023-04-30T19:50:44Z")
Well, I was accused of making up a statistic, but I won’t accuse you of making up a conversation that didn’t happen. We’d have to go back and look at what Silver was saying in the media up to election day. By the way, I think the general assumption in this thread (since this is the Dope) is that I am an idiot, and therefore was also an idiot in 2016, and I therefore totally didn’t understand 538, never saw the hedgey messages, etc. Actually, I did understand what he was doing, and I read those messages. I understood that it was a tight race and that success in the dodgy institution known as the Electoral College was necessary. I actually read 538 on a daily basis, not just looking at the numbers but reading a lot of the blog-like content on the site. After Hillary lost, my conclusion is that site wasn’t useful to me. I never thought about it again and certainly never had a debate about its usefulness with anyone. In a tight race, in a model like Silver’s, you’re going to get things like that 70/30 split. Is that cognitively useful? In a race that isn’t tight, you won’t really need the site in the first place. That’s my issue with it. ---
**Author:** ![Aeschines](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/aeschines/32/16251_2.png) [@Aeschines](https://boards.straightdope.com/u/Aeschines)\ **Post date:** [April 30, 2023, 8:01pm UTC](https://boards.straightdope.com/t/fivethirtyeight-com-decimated-by-disney-layoffs/983242/84 "2023-04-30T20:01:21Z")
Another take-down of Silver: > **[Why You Should Never, Ever Listen To Nate Silver ❧ Current Affairs](https://www.currentaffairs.org/2016/12/why-you-should-never-ever-listen-to-nate-silver)** > > Part I of our “How The Press Failed You” Series… It also gets into his specific statements and predictions. ---
**Author:** ![Stranger\_On\_A\_Train](https://avatars.discourse-cdn.com/v4/letter/s/13edae/32.png) [@Stranger\_On\_A\_Train](https://boards.straightdope.com/u/Stranger_On_A_Train)\ **Post date:** [April 30, 2023, 8:05pm UTC](https://boards.straightdope.com/t/fivethirtyeight-com-decimated-by-disney-layoffs/983242/85 "2023-04-30T20:05:07Z")
@Aeschines, here is a threat for you to \*\*\*\* all over: > [@Aeschines, Statistician Extraordinaire](https://boards.straightdope.com/t/aeschines-statistician-extraordinaire/983380): > > Well, given that you are wrong (FiveThirtyEight projections never had anything near a 95% projection for Clinton, and [certainly not past November 2016 when it gave Trump a over 30% probabilty](https://projects.fivethirtyeight.com/2016-election-forecast/)) I’m sure you’ll retract the claim that the “model is dogshit”. Still looking for that retraction, chief. Stranger Stranger ---
**Author:** ![Aeschines](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/aeschines/32/16251_2.png) [@Aeschines](https://boards.straightdope.com/u/Aeschines)\ **Post date:** [April 30, 2023, 8:06pm UTC](https://boards.straightdope.com/t/fivethirtyeight-com-decimated-by-disney-layoffs/983242/86 "2023-04-30T20:06:21Z")
> [@Stranger\_On\_A\_Train](#): > > @Aeschines, here is a threat for you to \*\*\*\* all over: Like yo momma? I don’t actually know what the sentence means, sorry. ---
**Author:** ![Stranger\_On\_A\_Train](https://avatars.discourse-cdn.com/v4/letter/s/13edae/32.png) [@Stranger\_On\_A\_Train](https://boards.straightdope.com/u/Stranger_On_A_Train)\ **Post date:** [April 30, 2023, 8:08pm UTC](https://boards.straightdope.com/t/fivethirtyeight-com-decimated-by-disney-layoffs/983242/87 "2023-04-30T20:08:29Z")
> [@Aeschines](#): > > I don’t actually know what the sentence means, sorry. It means you’ve sidelined this thread with your continued hijack about the 2016 election, and are now tossing out insults and trying to bait people into response, so there is now a Pit thread for you to do exactly that. Stranger ---
**Author:** ![Aeschines](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/aeschines/32/16251_2.png) [@Aeschines](https://boards.straightdope.com/u/Aeschines)\ **Post date:** [April 30, 2023, 8:20pm UTC](https://boards.straightdope.com/t/fivethirtyeight-com-decimated-by-disney-layoffs/983242/88 "2023-04-30T20:20:12Z")
> [@Stranger\_On\_A\_Train](#): > > It means you’ve sidelined this thread with your continued hijack about the 2016 election, If it’s a hijack, then it’s one that everyone wanted to talk about. Was there more to say about the layoffs? ---
**Author:** ![Sam\_Stone](https://avatars.discourse-cdn.com/v4/letter/s/ecccb3/32.png) [@Sam\_Stone](https://boards.straightdope.com/u/Sam_Stone)\ **Post date:** [April 30, 2023, 8:23pm UTC](https://boards.straightdope.com/t/fivethirtyeight-com-decimated-by-disney-layoffs/983242/89 "2023-04-30T20:23:15Z")
> [@Atamasama](#): > > Meteorologists seem to have a better track record in my experience. Weather is a lot easier to predict than people. Meteorologists do no not make forecasts that are valid for more than a few days. ‘Long Term’ forecasts are usually just regression-to-the-mean (Seasonal average is 16, it’s 12 today. We forecast it will be moving towards 16 in the longer term, but for now we can make a better short-term forecast based on system movements, radar, weather in nearby areas, etc." Weather forecasters learned the lesson of the futility of predicting the future. That’s the domain of the Farmer’s Almanac. > [@Atamasama](#): > > You might then ask, what is the point of a poll? To feed the insatiable desire of people to know the future. See also: macroeconomists, the CBO, and fortune tellers. All of whom are approximately the same in accuracy over a 10 year period - zero. No better than a coin flip. Yet we will listen to them when they prognosticate about the future, because we have a burning desire to know. The fact that we can’t possibly know doesn’t enter into it. People have a huge desire to know what’s going to happen, and the media and various academic types are happy to supply it. Those that are unwilling to predict the future soon find they don’t get interviewed by the media any more, don’t get book deals, aren’t celebrated by partisans, etc. All the incentives push people to try to predict the future. The fault is on those who believe they can actually do it and pay attention to them. The Fortune tellers are the smart ones. They make a gazillion predictions every year, confident that through sheer luck one or more will come true. Then they memory-hole the wrong ones and hype the accurate ones, making them look prescient. Come to think of it, that’s what pollsters do, too. > [@Aeschines](#): > > Well, I was accused of making up a statistic, but I won’t accuse you of making up a conversation that didn’t happen. Well that’s good because A) I didn’t make the accusation, and B) calling me out on a clearly fictional conversation would be silly. That’s why I used “Forecaster” and “Reporter” rather than actual names, to make it clear that it’s an example, not a literal conversation. > [@Aeschines](#): > > By the way, I think the general assumption in this thread (since this is the Dope) is that I am an idiot, and therefore was also an idiot in 2016, and I therefore totally didn’t understand 538, never saw the hedgey messages, etc. I didn’t get that at all. I don’t think anyone on this board thinks you are an idiot. They may be having a hard time understanding your argument in this case, however. > [@Aeschines](#): > > In a tight race, in a model like Silver’s, you’re going to get things like that 70/30 split. Is that cognitively useful? In a race that isn’t tight, you won’t really need the site in the first place. That’s my issue with it. If other pollsters are saying 95% and Silver says 70%, that seems like an interesting difference worthy of analysis - especially if you are involved in the campaigns. One of the problems pollsters have is that they are giving information to partisans who love to attack the messenger. I seem to recall Silver taking a lot of flak for not agreeing with other pollsters that Hillary was a lock. And it was Democrats who were angry with him. The interesting thing is that Democrats should have ben happy with him, because he might have helped kill the complacency that was partly what did Hillary in. It’s way better from a motivational standpoint to under-represent the support of your candidate than to over-represent it. But Democrats got angry, probably because the average person sees such a poll as bad news they don’t like, or representative of something they refuse to believe (widespread support for Trump). We’d all be a lot better off if we focused on resiliancy in the face of an uncertain future rather than turning to our ‘thought leaders’ to tell us what the future will be. Because the future is still going to be unpredictable no matter what they say, but at least if we don’t listen to them we might have a better grasp of the risks of an uncertain future. ---
**Author:** ![Aeschines](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/aeschines/32/16251_2.png) [@Aeschines](https://boards.straightdope.com/u/Aeschines)\ **Post date:** [April 30, 2023, 8:34pm UTC](https://boards.straightdope.com/t/fivethirtyeight-com-decimated-by-disney-layoffs/983242/90 "2023-04-30T20:34:29Z")
Again, I largely agree. Thank you for debating in a polite manner! > [@Sam\_Stone](#): > > If other pollsters are saying 95% and Silver says 70%, that seems like an interesting difference worthy of analysis - especially if you are involved in the campaigns. I would refer you and others again to the link I just posted. It gets into the things he was saying before election day and how he hedges everything he says so he can never be wrong. Saying 70% instead of 95% is preferable in the relative sense, yes, but is it _virtuous_ in the absolute sense in terms of both statistics and communications? That is a difficult question. Re statistics, there are PhDs who criticize his methods (I can’t say who is right; I don’t know enough). Re communications, I have rendered my opinion, but in order to present my opinion more strongly (and hold it myself more forcefully), I’d really have to go back and study all of the site content from the time and things Silver was saying in the media. I do feel strongly, however, that the front page of the site was lacking in clear caveats that could give a layperson a better understanding of what the big numbers presented up top meant or didn’t mean. > [@](#): > > We’d all be a lot better off if we focused on resiliancy in the face of an uncertain future rather than turning to our ‘thought leaders’ to tell us what the future will be. Because the future is still going to be unpredictable no matter what they say, but at least if we don’t listen to them we might have a better grasp of the risks of an uncertain future. I agree. Great point! ---
**Author:** ![What\_Exit](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/what_exit/32/10652_2.png) [@What\_Exit](https://boards.straightdope.com/u/What_Exit)\ **Post date:** [April 30, 2023, 8:36pm UTC](https://boards.straightdope.com/t/fivethirtyeight-com-decimated-by-disney-layoffs/983242/91 "2023-04-30T20:36:41Z")
> [@Aeschines](#): > > Same one yo momma went to. **Modnote** : This is over the line and also Really? Momma jokes? ## To everyone, don’t make this personal. ---
**Author:** ![Aeschines](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/aeschines/32/16251_2.png) [@Aeschines](https://boards.straightdope.com/u/Aeschines)\ **Post date:** [April 30, 2023, 8:37pm UTC](https://boards.straightdope.com/t/fivethirtyeight-com-decimated-by-disney-layoffs/983242/92 "2023-04-30T20:37:32Z")
> [@What\_Exit](#): > > **Modnote** : This is over the line and also Really? Momma jokes? > > ## To everyone, don’t make this personal. Acknowledged. Mea culpa. ---
**Author:** ![Andy\_L](https://avatars.discourse-cdn.com/v4/letter/a/c67d28/32.png) [@Andy\_L](https://boards.straightdope.com/u/Andy_L)\ **Post date:** [April 30, 2023, 8:46pm UTC](https://boards.straightdope.com/t/fivethirtyeight-com-decimated-by-disney-layoffs/983242/93 "2023-04-30T20:46:18Z")
I’m going to miss the weekly Riddler. ---
**Author:** ![Buck\_Godot](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/buck_godot/32/6573_2.png) [@Buck\_Godot](https://boards.straightdope.com/u/Buck_Godot)\ **Post date:** [April 30, 2023, 9:01pm UTC](https://boards.straightdope.com/t/fivethirtyeight-com-decimated-by-disney-layoffs/983242/94 "2023-04-30T21:01:38Z")
> [@Sam\_Stone](#): > > The only way to validate a statistical model is to run enough trials to get statistically valid results. We can’t do that with election forecasting, because underlying conditions change too much between elections. While with things like elections, you aren’t going to get enough data to really check that accuracy of the final prediction, what you can look at is what assumptions went into the model and how did those pan out. The basic modeling that most people were using was to estimate the voter precentages in each state, and in an an estimate for variability and then put all those together to determine the likelihood of individual scenarios which result in one or the other candidate winning. The main difference that I saw in Nate predictor versus the others, is that Nate took into account wave phenomena, where the results of individual states weren’t independent coin tosses, but instead were correlated, if Trump did well in one state he is more likely to do well in another state. Looking at the states results in detail, Nate looks very good, all of the states polls were within the margin of error of where he said they would be, but they all had a general red-ward shift from the average, exactly as Nate’s model suggested might happen. This is why I say that even though his model suggested that Clinton was more likely to win than Trump, the election supported the accuracy of his model. ---
**Author:** ![Chronos](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/chronos/32/134_2.png) [@Chronos](https://boards.straightdope.com/u/Chronos)\ **Post date:** [April 30, 2023, 9:04pm UTC](https://boards.straightdope.com/t/fivethirtyeight-com-decimated-by-disney-layoffs/983242/95 "2023-04-30T21:04:35Z")
So, @Aeschines , if I’m reading you correctly, your criticism is that Silver shouldn’t have given the most accurate form of information possible in his field, the probability of each candidate winning, because people are likely to misinterpret accurate information, and that he should therefore have given less accurate information? ---
**Author:** ![Atamasama](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/atamasama/32/12961_2.png) [@Atamasama](https://boards.straightdope.com/u/Atamasama)\ **Post date:** [April 30, 2023, 9:04pm UTC](https://boards.straightdope.com/t/fivethirtyeight-com-decimated-by-disney-layoffs/983242/96 "2023-04-30T21:04:46Z")
> [@Sam\_Stone](#): > > Meteorologists do no not make forecasts that are valid for more than a few days. Fair, but are election polls valid a few days before the election? ---
**Author:** ![Aeschines](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/aeschines/32/16251_2.png) [@Aeschines](https://boards.straightdope.com/u/Aeschines)\ **Post date:** [April 30, 2023, 9:10pm UTC](https://boards.straightdope.com/t/fivethirtyeight-com-decimated-by-disney-layoffs/983242/97 "2023-04-30T21:10:32Z")
> [@Chronos](#): > > So, @Aeschines , if I’m reading you correctly, your criticism is that Silver shouldn’t have given the most accurate form of information possible in his field, the probability of each candidate winning, because people are likely to misinterpret accurate information, and that he should therefore have given less accurate information? You’re not reading me correctly. Scroll up. ---
**Author:** ![puzzlegal](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/puzzlegal/32/3827_2.png) [@puzzlegal](https://boards.straightdope.com/u/puzzlegal)\ **Post date:** [May 1, 2023, 11:54am UTC](https://boards.straightdope.com/t/fivethirtyeight-com-decimated-by-disney-layoffs/983242/98 "2023-05-01T11:54:23Z")
> [@Banquet\_Bear](#): > > …I think Nate Silver, politics and statistics wonk is just fine. > > I think Nate Silver, pretending to be a public health expert and denigrating the work of epidemiologists and those working to keep us all safe is bad…and dangerous. Not sorry to see him gone at all. Huh. I completely missed that avatar. > [@Banquet\_Bear](#): > > I thought his election analysis and his political punditry was pretty good a few years ago. But my gosh…I don’t trust him any more. Thank you for bringing this to my attention. And thanks to the posters who found links. I followed Silver on polls, and liked him. It’s good to know about the rest. ---
**Author:** ![Thing.Fish](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/thing.fish/32/9168_2.png) [@Thing.Fish](https://boards.straightdope.com/u/Thing.Fish)\ **Post date:** [May 1, 2023, 10:28pm UTC](https://boards.straightdope.com/t/fivethirtyeight-com-decimated-by-disney-layoffs/983242/99 "2023-05-01T22:28:38Z")
Yes, 538 regularly assesses their overall performance and shares the data. They do a pretty good job; of all the things they give a 75% chance of happening, about three out of four of them do in fact happen. That’s how you have to judge probabilistic predictions; for any one prediction you are correct, there is no way to ever meaningfully say it was “wrong”. ---
**Author:** ![Pleonast](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/pleonast/32/1183_2.png) [@Pleonast](https://boards.straightdope.com/u/Pleonast)\ **Post date:** [May 1, 2023, 10:41pm UTC](https://boards.straightdope.com/t/fivethirtyeight-com-decimated-by-disney-layoffs/983242/100 "2023-05-01T22:41:23Z")
Indeed. > **[How Good Are FiveThirtyEight Forecasts?](https://projects.fivethirtyeight.com/checking-our-work/)** > > We checked all of our sports and election predictions since 2008. They’re reliable. Choice quotes: > Forecasts have always been a core part of FiveThirtyEight’s mission. They force us (and you) to think about the world probabilistically, rather than in absolutes. > We’re not trying to pick winners, though; we’re trying to model the games, which means including in our predictions all of the randomness inherent in baseball. (Note that although preview panel says “4 Apr 2019”, the metrics are routinely updated.) [Previous page](https://boards.straightdope.com/t/fivethirtyeight-com-decimated-by-disney-layoffs/983242.md?page=4)