# Polling is broken, right? Or is it the news? Or all of the US?

**URL:** <https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779>\
**Category:** Politics & Elections\
**Tags:** trump\
**Created:** [November 27, 2023, 5:30pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779 "2023-11-27T17:30:18Z")\
**Posts on this page:** 20\
**Page:** 13

<div class="post-metadata">

**Author:** ![FlikTheBlue](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/fliktheblue/32/10972_2.png) [@FlikTheBlue](https://boards.straightdope.com/u/FlikTheBlue)\
**Post date:** [April 29, 2024, 4:18pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/241 "2024-04-29T16:18:34Z")

</div>

Have there been some polls favorable to Tester in Montana? That’s going to be the tipping point senate race, unless Colin Allred pulls off a shocker and knocks off Cruz.

---

<div class="post-metadata">

**Author:** ![bordelond](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/bordelond/32/150_2.png) [@bordelond](https://boards.straightdope.com/u/bordelond)\
**Post date:** [April 29, 2024, 4:26pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/242 "2024-04-29T16:26:59Z")

</div>

> [@FlikTheBlue](#):
>
> Have there been some polls favorable to Tester in Montana?

Polls for this race seem thin on the ground, **[but here’s a few](https://projects.fivethirtyeight.com/polls/senate/2024/montana/)**. Tester was doing very well in February, but Sheehy seems to have caught up going _strictly_ by the very few polls available. I wouldn’t draw any conclusions yet.

The most recent poll is from the end of March, so an update is sorely needed.

---

<div class="post-metadata">

**Author:** ![PhillyGuy](https://avatars.discourse-cdn.com/v4/letter/p/ed655f/32.png) [@PhillyGuy](https://boards.straightdope.com/u/PhillyGuy)\
**Post date:** [April 30, 2024, 12:44pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/243 "2024-04-30T12:44:38Z")

</div>

[Trump might be a felon before the election. Does that mean the polls are worthless?](https://www.natesilver.net/p/sbsq-8-trump-might-be-a-felon-before)

> [@](#):
>
> Look, whenever someone says an election development is unprecedented, I’m suspicious, because people _always_ say that about _every_ election, as this [XKCD cartoon](https://xkcd.com/1122/) reminds us: . . .
> 
> And the [general heuristic advice](https://www.campbellps.com/the-broken-leg) is that people are too liberal about this — too eager to engage in [special pleading](https://www.google.com/search?q=special+pleading&rlz=1C5CHFA_enUS962US962&oq=special+pleading&gs_lcrp=EgZjaHJvbWUyBggAEEUYOdIBCDE1NzJqMGo0qAIAsAIA&sourceid=chrome&ie=UTF-8) in declaring some reason why the ordinary rules don’t apply. . . .
> 
> And the public seems to be pretty habituated to tolerating Trump’s various schemes and scams, and his even actual alleged crimes. I mean, if people are willing to vote for Trump despite January 6, are they really going to care about Stormy Daniels? If people cared that much about these criminal cases, would Trump be [ahead in the Electoral College](https://www.natesilver.net/p/bidens-position-in-the-polls-is-improving) in the first place?

---

<div class="post-metadata">

**Author:** ![bordelond](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/bordelond/32/150_2.png) [@bordelond](https://boards.straightdope.com/u/bordelond)\
**Post date:** [April 30, 2024, 2:45pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/244 "2024-04-30T14:45:33Z")

</div>

I wish this op-ed had been around when the OP was written. From the _Boston Globe_, no paywall.

> **[Why polling is so often wrong - The Boston Globe](https://www.bostonglobe.com/2024/04/03/opinion/why-are-presidential-polls-wrong-biden-trump/)**
>
> If political pollsters were physicians, large numbers of them would be getting hauled before medical disciplinary boards for misdiagnosing their patients.

> The problems with political polls are multiple:
> 
> - The dominance of cell phones and caller ID programs on landlines has made what statisticians call the “response rate” plummet. A generation ago, few Americans would let their phones ring without answering. Now many calls go unanswered as we ignore unrecognized numbers. Such screening means that pollsters must place thousands more calls to reach enough respondents, which increases their costs and adds pressure to shrink their sample sizes. On top of that, folks who do answer skew older than the overall electorate, making it even harder to gather a survey group that accurately represents the nation’s complex and shifting demographics.
> - There are too many political pollsters conducting too many polls. When John F. Kennedy and Richard Nixon waged a historically close race in 1960, Gallup was virtually the only national polling organization tracking the contest. Three years later Louis Harris started surveying political opinion. For decades they remained the dominant political pollsters, with few competitors. Today there are dozens of polling groups using different methodologies. Nathaniel Rakich, a FiveThirtyEight senior elections analyst, in March 2023 [examined hundreds of poll results](https://fivethirtyeight.com/features/2022-election-polling-accuracy/) going back to 1998 in elections for president, the Senate, the House, and governor. During their final three weeks, pollsters predicted the winner only 78 percent of the time. In 2022, they got just 72 percent of the races right, a steep drop from the 88 percent high-water mark of 2008. Focusing on the 2022 elections, Rakich found big disparities among 33 pollsters. Only six called at least 90 percent of their contests correctly.
> - Now, 80 or 90 percent accuracy might seem like pretty high scores, given the volatility of many elections. But consider that three firms, SurveyUSA, the University of New Hampshire, and Alaska Survey Research, were 100 percent accurate in 2022. Why can’t more firms reach that level? Also consider that 10 groups got less than two-thirds of their predictions right, which should not be a passing grade. And bringing up the rear were Morning Consult at 8 percent correct and Ipsos at 17 percent. Journalists vet their sources carefully, but these numbers suggest that they should be more careful in covering polls.
> - The internet, with its voracious appetite and greatly expanded space for new information no matter how incremental, has made some political journalists less discriminating and fueled more questionable polling. The financial pressures on news organizations have increased the need for digital readers, which has led to election articles that are little more than click-bait.
> - Issue polls have their own problems. Immediately after the Supreme Court overturned the constitutional right to abortion in June 2022, many newscasters and reporters predicted the ruling would have minimal electoral impact. They cited old surveys showing that majorities of voters ranked the economy, health care, crime, and other concerns ahead of reproductive rights. Yet those polls failed to measure the intensity of anger the high court ruling would prompt among scores of women, whose increased turnout in subsequent elections has proven decisive.

---

<div class="post-metadata">

**Author:** ![JKellyMap](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/jkellymap/32/15880_2.png) [@JKellyMap](https://boards.straightdope.com/u/JKellyMap)\
**Post date:** [April 30, 2024, 3:31pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/245 "2024-04-30T15:31:56Z")

</div>

Indeed. Thanks!

---

<div class="post-metadata">

**Author:** ![PhillyGuy](https://avatars.discourse-cdn.com/v4/letter/p/ed655f/32.png) [@PhillyGuy](https://boards.straightdope.com/u/PhillyGuy)\
**Post date:** [April 30, 2024, 8:27pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/246 "2024-04-30T20:27:58Z")

</div>

Except for the judicious captain obvious conclusion, the Boston Globe op-ed linked two posts above is mostly misleading. Polls tell where the race is now. Pollsters do not make the broad claims James Rosen sees himself to be debunking.

As documented earlier in the thread, final pre-election polling averages are about as accurate, or inaccurate, as they ever have been. Rosen claims otherwise by taking a few data points from a long 538 article he links to while ignoring the thesis.

As for the three pollsters Rosen points to as being accurate in 2022, consider this by Nathaniel Rakich in the [linked article](https://fivethirtyeight.com/features/2022-election-polling-accuracy/):

> [@](#):
>
> Correct calls are a lousy way to measure polling accuracy.

---

<div class="post-metadata">

**Author:** ![bordelond](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/bordelond/32/150_2.png) [@bordelond](https://boards.straightdope.com/u/bordelond)\
**Post date:** [April 30, 2024, 9:14pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/247 "2024-04-30T21:14:54Z")

</div>

> [@PhillyGuy](#):
>
> Pollsters do not make the broad claims James Rosen sees himself to be debunking.

It doesn’t matter that the pollsters aren’t making these claims. Other parties are. Popular media use this poll or that one to sell eyeball-and-click-attracting narratives. And this cycle, for whatever reason … “_Trump’s an easy shoo-in – the polls say so!_” drives A LOT of traffic.

---

<div class="post-metadata">

**Author:** ![bordelond](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/bordelond/32/150_2.png) [@bordelond](https://boards.straightdope.com/u/bordelond)\
**Post date:** [May 6, 2024, 7:28pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/248 "2024-05-06T19:28:47Z")

</div>

Everyone’s favorite liberal election guy, Simon Rosenberg, **[made a good point in his Substack](https://www.hopiumchronicles.com/p/biden-leads-49-45-in-new-abc-poll)** this past Sunday: _Pay attention to the **specific “likely voters” polling** more than “registered voters” or “all respondents”._

> A new [**ABC News**](https://abcnews.go.com/Politics/6-months-out-tight-presidential-race-trump-biden-poll/story?id=109909175) poll has Biden leading Trump 49%-45% (+4) with likely voters. This result is similar to this week’s [**NPR/Marist poll**](https://maristpoll.marist.edu/polls/2024-race-for-the-white-house-may01/) which had Biden up 52%-47% (+5) with likely voters:
> 
> > ABC News Biden 49%-Trump 45% (+4) _[graphic below]_
> > 
> > NPR/Marist Biden 52%-Trump 47% (+5)
> 
> In both polls Biden does signifcantly better with likely voters than the broader electorate of registered voters.

[![](https://i.abcnewsfe.com/a/eba5ffc8-cb63-45c1-a814-efff556c69a1/VotePreference_v02_KA_1714772314546_hpEmbed_1x1.jpg) ](https://i.abcnewsfe.com/a/eba5ffc8-cb63-45c1-a814-efff556c69a1/VotePreference_v02_KA_1714772314546_hpEmbed_1x1.jpg)

…

Trump had a nice week last week in the RealClear Polling average as the two polls with Biden furthest ahead aged off while a Trump +6 and +4 were added in. That got Trump up 1.5 points in the average. Today, though, RealClear picked up the two Biden-leading polls Rosenberg links above. Right now, that puts **[Trump ahead in the RCP average 1.1 points](https://www.realclearpolling.com/polls/president/general/2024/trump-vs-biden)**, with a big Trump-leading Rasmussen poll potentially dropping this week.

EDIT: For some reason, RCP doesn’t show the number of respondents and the margin-of-error for the recent ABC News/Ipsos poll linked above. ABC News’ link doesn’t have that information, either, but **[Ipsos has it on their website](https://www.ipsos.com/en-us/most-americans-say-economy-and-inflation-are-most-important-issues-determining-who-they-will-support-for-president-in-november)** – 2,260 respondents and a margin-of-error of 2.1%.

---

<div class="post-metadata">

**Author:** ![Atamasama](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/atamasama/32/12961_2.png) [@Atamasama](https://boards.straightdope.com/u/Atamasama)\
**Post date:** [May 6, 2024, 9:47pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/249 "2024-05-06T21:47:51Z")

</div>

> [@bordelond](#):
>
> Everyone’s favorite liberal election guy, Simon Rosenberg, **[made a good point in his Substack](https://www.hopiumchronicles.com/p/biden-leads-49-45-in-new-abc-poll)** this past Sunday: _Pay attention to the **specific “likely voters” polling** more than “registered voters” or “all respondents”._

That’s why turnout is important. If you have a district with 50 Biden supporters and 50 Trump supporters, but 45 of the Biden voters are motivated to vote while only 35 of the Trump voters are, Biden wins by 10 votes, despite not having more supporters.

A general poll would show Biden having no advantage.

---

<div class="post-metadata">

**Author:** ![Dr.Winston\_OBoogie](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/dr.winston_oboogie/32/2945_2.png) [@Dr.Winston\_OBoogie](https://boards.straightdope.com/u/Dr.Winston_OBoogie)\
**Post date:** [May 7, 2024, 5:22pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/250 "2024-05-07T17:22:08Z")

</div>

> [@bordelond](#):
>
> Everyone’s favorite liberal election guy, Simon Rosenberg, **[made a good point in his Substack](https://www.hopiumchronicles.com/p/biden-leads-49-45-in-new-abc-poll)** this past Sunday: _Pay attention to the **specific “likely voters” polling** more than “registered voters” or “all respondents”._
> 
> > A new [**ABC News**](https://abcnews.go.com/Politics/6-months-out-tight-presidential-race-trump-biden-poll/story?id=109909175) poll has Biden leading Trump 49%-45% (+4) with likely voters. This result is similar to this week’s [**NPR/Marist poll**](https://maristpoll.marist.edu/polls/2024-race-for-the-white-house-may01/) which had Biden up 52%-47% (+5) with likely voters:
> > 
> > > ABC News Biden 49%-Trump 45% (+4) _[graphic below]_
> > > 
> > > NPR/Marist Biden 52%-Trump 47% (+5)
> > 
> > In both polls Biden does signifcantly better with likely voters than the broader electorate of registered voters.

I took a quick look at the NPR poll. It appeared to me that it was an overall nationwide poll. Unfortunately, the election is not nationwide - it’s state-by-state. Yes, I feel much better that Biden is 4-5% over Trump, but that nagging little voice in my head says "How is he doing in Pennsylvania? In Michigan? In Wisconsin?

---

<div class="post-metadata">

**Author:** ![bordelond](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/bordelond/32/150_2.png) [@bordelond](https://boards.straightdope.com/u/bordelond)\
**Post date:** [May 7, 2024, 6:51pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/251 "2024-05-07T18:51:55Z")

</div>

> [@Dr.Winston\_OBoogie](#):
>
> Yes, I feel much better that Biden is 4-5% over Trump, but that nagging little voice in my head says "How is he doing in Pennsylvania? In Michigan? In Wisconsin?

Rosenberg addressed these states specifically last week. **[The words after the colon in the post preview below are Rosenberg’s](https://www.hopiumchronicles.com/p/new-cbs-poll-shows-biden-gaining)**.

> [@President Joe Biden and the runup to the 2024 election](https://boards.straightdope.com/t/president-joe-biden-and-the-runup-to-the-2024-election/954384/1265):
>
> Regarding the battleground states, Rosenberg offers this (same link as in post above): A [new series of polls](https://www.cbsnews.com/news/biden-trump-poll-michigan-pennyslvania-wisconsin/?ftag=CNM-00-10aab7e&linkId=412687759) released by CBS News have very good news for Joe Biden and the Democrats: Michigan Biden 51-49 Pennsylvania, Wisconsin Trump 50-49 These polls represent at least a 4 point Biden gain (and perhaps as much as 6-7 pts) from CBS’ last poll which had the Trump up 52-48 nationally. They also confirm trends I’ve been writing here for weeks now - the election is changing, it’s getting bluer,…

---

<div class="post-metadata">

**Author:** ![PhillyGuy](https://avatars.discourse-cdn.com/v4/letter/p/ed655f/32.png) [@PhillyGuy](https://boards.straightdope.com/u/PhillyGuy)\
**Post date:** [May 7, 2024, 7:57pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/252 "2024-05-07T19:57:58Z")

</div>

Most pollsters only switch to likely voter screens closer to the election. The reason usually given is that such screens only work closer to the election.

Last time, Trump polled better with likely voter screens.

I can think of one reason why likely voter screens may favor Biden this time. Suppose your screen is primarily based on asking whether the voter voted in 2020. Biden won that year!

As a Democrat, I do not believe in seeking reasons to be optimistic. But it is a positive sign for a candidate to do better with a likely voter screen.

---

<div class="post-metadata">

**Author:** ![bordelond](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/bordelond/32/150_2.png) [@bordelond](https://boards.straightdope.com/u/bordelond)\
**Post date:** [May 7, 2024, 8:19pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/253 "2024-05-07T20:19:28Z")

</div>

> [@PhillyGuy](#):
>
> I can think of one reason why likely voter screens may favor Biden this time. Suppose your screen is primarily based on asking whether the voter voted in 2020. Biden won that year!

**[ABC News shared their ‘likely voter’ methodology](https://abcnews.go.com/Politics/6-months-out-tight-presidential-race-trump-biden-poll/story?id=109909175)**:

> ## Likely voters
> 
> The poll tests a few versions of likely voters, e.g., those who say they are registered to vote or will register and are certain to vote in November; and those who fit that definition and also say they voted in 2020, if old enough to have done so.
> 
> Trump is +2 points among all adults (excluding nonvoters) while Biden is +4 among likely voters. While neither is a statistically significant difference, the reason for the Biden bump is that more educated people are more likely to vote, and, as noted, Biden leads Trump by 19 points among college graduates. Among all adults in the survey, 35% have a college degree. Among likely voters, it’s 45%.

---

<div class="post-metadata">

**Author:** ![Jas09](https://avatars.discourse-cdn.com/v4/letter/j/d07c76/32.png) [@Jas09](https://boards.straightdope.com/u/Jas09)\
**Post date:** [May 8, 2024, 2:36pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/254 "2024-05-08T14:36:22Z")

</div>

> [@ABC News](#):
>
> Among all adults in the survey, 35% have a college degree. Among likely voters, it’s 45%.

The reality is likely to be somewhere in between. In 2016 College degree or higher was 37% in 2020 it was 40%. So 45% is likely too high, and 35% likely too low.

Which tracks with the race pretty much begin a tie nationally. Which will not be enough - Clinton won by 2% nationally and Biden by 4%, and we know both of those were extremely close in the EV.

What I’m still struggling to understand when it comes to polling is the extent to which Biden is running behind Democratic Senate candidates. In some cases I think it’s just that the candidates are pretty strong (Casey, Baldwin, Rosen, even Gallegos), but the gaps are significantly larger than what we’ve seen in recent strongly-partisan elections.

I would be very surprised, for example, if Biden loses PA by 4 points while Casey wins by 4 (which is what the [AARP](https://www.aarp.org/content/dam/aarp/research/topics/voter-opinion-research/politics/pennsylvania-older-voter-survey-2024-report.doi.10.26419-2fres.00813.001.pdf) poll out today shows). That’s a level of ticket-splitting we just don’t see these days.

Maybe Biden is a uniquely weak candidate (in some ways he surely is), but Trump is as well so it’s a bit of a movable object v. stoppable force situation.

---

<div class="post-metadata">

**Author:** ![bordelond](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/bordelond/32/150_2.png) [@bordelond](https://boards.straightdope.com/u/bordelond)\
**Post date:** [May 8, 2024, 2:49pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/255 "2024-05-08T14:49:33Z")

</div>

> [@Jas09](#):
>
> Which tracks with the race pretty much begin a tie nationally.

This gets us back to the title of the thread: **Polling is broken, right?**

Posed another way: **Can aggregated 2024 poll numbers be accepted at face value?**

---

<div class="post-metadata">

**Author:** ![bordelond](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/bordelond/32/150_2.png) [@bordelond](https://boards.straightdope.com/u/bordelond)\
**Post date:** [May 8, 2024, 3:02pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/256 "2024-05-08T15:02:13Z")

</div>

Liberal commentator Jay Kuo threw this into **[his recent column](https://statuskuo.substack.com/p/republicans-for-biden)** about former Georgia lieutenant governor Geoff Duncan’s endorsement of Joe Biden:

> For Duncan, voting for Biden is a “binary choice” in an election and a practical necessity to save our country from Trump. _He cited polls showing that Trump is leading nationally ( **he actually isn’t, even according to the polling averages** ) and in the battleground states ( **again, not necessarily** )._ But if these misleading polls can convince Republicans who are frightened of a second Trump term to cast their votes for Biden, then so be it.

Kuo doesn’t show his work in this particular column, but addresses the faults of 2024 polling in some of his other recent pieces. Some of it is quoted upthread – could probably search this thread for “Kuo” and capture it all at one shot.

EDIT: See also **James Rosen’s _Boston Globe_ column upthread** about the pitfalls of polling today.

---

<div class="post-metadata">

**Author:** ![RitterSport](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/rittersport/32/6326_2.png) [@RitterSport](https://boards.straightdope.com/u/RitterSport)\
**Post date:** [May 8, 2024, 3:06pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/257 "2024-05-08T15:06:31Z")

</div>

> [@Jas09](#):
>
> it’s a bit of a movable object v. stoppable force situation

I love this!

---

<div class="post-metadata">

**Author:** ![bordelond](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/bordelond/32/150_2.png) [@bordelond](https://boards.straightdope.com/u/bordelond)\
**Post date:** [May 10, 2024, 3:18pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/258 "2024-05-10T15:18:40Z")

</div>

**[Simon Rosenberg is shaking the pom-poms again](https://www.hopiumchronicles.com/p/biden-up-in-new-wi-poll-great-american)**, getting ready to drop an article specifically about the unreliability of polling-numbers aggregation. Today’s teaser is not about the 2024 presidential election, but looks back at the 2022 U.S. senate polling:

> **Be Careful of Real Clear Politics and Polling Averages -** In the coming days I’m going to write about what I think is questionable utility of polling averages. To whet your appetite a bit, let’s revisit Real Clear Politics last Senate map from 2022 (below). These predicted results were based on RCP’s polling averages in each state. As we all know Republicans didn’t get to 54 seats in the Senate. They got to 49. What went wrong? More soon.

[![](https://substackcdn.com/image/fetch/w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0683bee3-efae-4d5d-9a38-07c03106a8dc_873x1280.png) ](https://substackcdn.com/image/fetch/w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0683bee3-efae-4d5d-9a38-07c03106a8dc_873x1280.png)

---

<div class="post-metadata">

**Author:** ![Dinsdale](https://avatars.discourse-cdn.com/v4/letter/d/97f17d/32.png) [@Dinsdale](https://boards.straightdope.com/u/Dinsdale)\
**Post date:** [May 10, 2024, 3:35pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/259 "2024-05-10T15:35:20Z")

</div>

> [@bordelond](#):
>
> **[ABC News shared their ‘likely voter’ methodology](https://abcnews.go.com/Politics/6-months-out-tight-presidential-race-trump-biden-poll/story?id=109909175)**:

I appreciate that polling is far from an exact science. But isn’t this stacking one inexact factor (how accurately “likely voters” are identified) atop another (the poll results themselves)?

---

<div class="post-metadata">

**Author:** ![Dr.Winston\_OBoogie](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/dr.winston_oboogie/32/2945_2.png) [@Dr.Winston\_OBoogie](https://boards.straightdope.com/u/Dr.Winston_OBoogie)\
**Post date:** [May 10, 2024, 4:02pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/260 "2024-05-10T16:02:05Z")

</div>

Polling is an inexact science; poll aggregating moreso. And the way it is viewed by the public is wrong.

Nate Silver was absolutely correct in 2016. Remember - all vote projections have a “margin of error”, and the results were within that margin. There are massive recent shifts in polls - accuracy, responses, etc. Any unbiased poll agency is constantly looking at past polls vs. actual results and using that analysis to modify their current polling results. Same thing with the aggregators. It’s tough, though, when those indicators are constantly changing.

Election polling is actually very similar to weather forecasting. Both rely heavily on statistics and interpreting factors. Both give you an expectation within a margin of error. Both are more correct the closer to the actual event. And, the American public, not understanding statistics, howls when the results are in the “unlikely” end of the probability zone. 90% of the time they get it right, but the perception that “wrong” happens half the time. It doesn’t, it just feels that way.

ETA - for years, pollsters relied on phone polls. With the move to cell phones and people not answering if they don’t recognize the number, phone polls are now skewed. Polling agencies are working on how to massage the results of existing tactics while finding new, more exact tactics. Might take a while.

[Previous page](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779.md?page=12)

[Next page](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779.md?page=14)
