# Polling is broken, right? Or is it the news? Or all of the US?

**URL:** <https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779>\
**Category:** Politics & Elections\
**Tags:** trump\
**Created:** [November 27, 2023, 5:30pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779 "2023-11-27T17:30:18Z")\
**Posts on this page:** 20\
**Page:** 20

<div class="post-metadata">

**Author:** ![PhillyGuy](https://avatars.discourse-cdn.com/v4/letter/p/ed655f/32.png) [@PhillyGuy](https://boards.straightdope.com/u/PhillyGuy)\
**Post date:** [June 25, 2024, 1:48am UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/386 "2024-06-25T01:48:48Z")

</div>

> [@TeroSunbear](#):
>
> Wikipedia ranked them 24th out of 28. For predicting results.

I may be missing the linked information. How many elections did that ranking include?

A year ago, Nate Silver wrote that Rasmussen’s accuracy is average:

[Polling averages shouldn’t be political litmus tests](https://www.natesilver.net/p/polling-averages-shouldnt-be-political)

> [@](#):
>
> Many pollsters have strong political opinions — if they didn’t, they’d probably have chosen another profession — and they are friendly with political operatives of one stripe or another. Some of them, of course, poll for campaigns themselves.
> 
> If you wanted to argue that pollsters and other people working in public opinion should be more austere about disclosing their political opinions, I could _maybe_ get on board with that. But if that were the basis for banning pollsters, you’d have to wipe out dozens of pollsters from the FiveThirtyEight ledger.

---

<div class="post-metadata">

**Author:** ![TeroSunbear](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/terosunbear/32/14748_2.png) [@TeroSunbear](https://boards.straightdope.com/u/TeroSunbear)\
**Post date:** [June 25, 2024, 2:16am UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/387 "2024-06-25T02:16:48Z")

</div>

I can’t find the ranking list anymore. Rasmussen criticisms here and under that. [Rasmussen Reports - Wikipedia](https://en.wikipedia.org/wiki/Rasmussen_Reports#Evaluations_of_accuracy_and_performance)

---

<div class="post-metadata">

**Author:** ![bordelond](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/bordelond/32/150_2.png) [@bordelond](https://boards.straightdope.com/u/bordelond)\
**Post date:** [June 26, 2024, 4:35pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/388 "2024-06-26T16:35:12Z")

</div>

Since this article bases many of its arguments on 2022 (mid-term) and 2024 polling, I’ll cross-post this here.

> [@Trump's reported increases in minority-voter support are - at best - heavily exaggerated](https://boards.straightdope.com/t/trumps-reported-increases-in-minority-voter-support-are-at-best-heavily-exaggerated/1003157/47):
>
> ( @PhillyGuy , The New Republic’s Susan Milligan went with “vastly” - see below ) Milligan asks the reader a question I find myself asking over and over again: Is polling itself dispositive? Beyond mere musing, however, Milligan brings receipts: Democrats have weathered similar scares in recent cycles. In 2022, a preelection poll by the nonpartisan National Association of Latino Elected Officials found that [57 percent of Latinos favored Democratic](https://naleo.org/wp-content/uploads/2022/10/10_26_22_-_NEF_Release_-_Tracking_Poll_-_Week_7_-_FINAL-1.pdf) candidates for Congress. [Exit polls determin…](https://2022electionpoll.us/wp-content/uploads/2022/11/5-Midterm-Survey-Latino-National-Crosstab.pdf)

> **[Reports of Biden’s Black and Hispanic Problem Are Vastly Overstated](https://newrepublic.com/article/182841/biden-black-hispanic-voters-trump-2024)**
>
> Yes, the president has work to do with Black and Hispanic voters, but no, they’re not flocking to Donald Trump.

Looking at the OP of this thread … this article makes more the case that “_it’s the news_” – that the problem is coverage about poll results and an apparent unwillingness to dig below surface interpretation of the numbers.

---

<div class="post-metadata">

**Author:** ![PhillyGuy](https://avatars.discourse-cdn.com/v4/letter/p/ed655f/32.png) [@PhillyGuy](https://boards.straightdope.com/u/PhillyGuy)\
**Post date:** [June 26, 2024, 8:47pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/389 "2024-06-26T20:47:59Z")

</div>

Nate Silver today posted a [66 per cent](https://www.mediaite.com/politics/elections-guru-nate-silver-gives-trump-a-66-chance-of-winning-the-election-not-a-toss-up/) chance for Trump to win, while 538, using some of the same intellectual property, has Biden with a [51 percent chance](https://projects.fivethirtyeight.com/2024-election-forecast/) to win.

I would say that fundamentals (incumbency and objective economic conditions) favor Biden, while swing state polls, and 2020-2024 same day polling comparisons, favor Trump.

And popular vote polling is a tie.

---

<div class="post-metadata">

**Author:** ![bordelond](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/bordelond/32/150_2.png) [@bordelond](https://boards.straightdope.com/u/bordelond)\
**Post date:** [July 1, 2024, 2:57pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/390 "2024-07-01T14:57:52Z")

</div>

Curious to see how/if this changes over the next week or two. All of the feeder polls but one came before the debate.

> # Who Is Favored To Win The 2024 Presidential Election?
> 
> ## 538 uses polling, economic and demographic data to explore likely election outcomes.
> 
> Biden wins 51 times out of 100
> 
> in our simulations of the 2024 presidential election.
> 
> Trump wins 49 times out of 100.

> **[Who Is Favored To Win The 2024 Presidential Election?](https://projects.fivethirtyeight.com/2024-election-forecast/?cid=rrpromo)**
>
> 538’s 2024 presidential election forecast model showing Democrat Joe Biden’s and Republican Donald Trump’s chances of winning.

---

<div class="post-metadata">

**Author:** ![TeroSunbear](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/terosunbear/32/14748_2.png) [@TeroSunbear](https://boards.straightdope.com/u/TeroSunbear)\
**Post date:** [July 3, 2024, 12:41am UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/391 "2024-07-03T00:41:39Z")

</div>

They have polls that match a good number of candidates. If you present it the right way, the voters will probably say what they think, Kamala vs Trump for instance. However, the voters know the actual situation. If Biden drops out, you will get a realistic answer about two weeks later. Now, the Democrats may be planning something. And Biden will be presented with a successor. We will quickly have one candidate, despite the fact that the convention will need to vote. So if done well, it may work and calm the Democratic voters. May even need to have Biden give a couple of speeches. But then he is out. The new candidate will need to take an agressive stand to Trump immediately.

---

<div class="post-metadata">

**Author:** ![bordelond](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/bordelond/32/150_2.png) [@bordelond](https://boards.straightdope.com/u/bordelond)\
**Post date:** [July 12, 2024, 4:28pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/392 "2024-07-12T16:28:44Z")

</div>

Full acknowledgement that small fluctuations in aggregate poll numbers don’t mean much \*\* . All the same, **[Trump’s lead in RealClear Polling’s aggregate dropped 20% this week](https://www.realclearpolling.com/polls/president/general/2024/trump-vs-biden)**.

Gosh … that was weaselly. More straightforwardly: Trump led Biden by 3.4% on Sunday, July 7th and leads by 0.7% less today (2.7%). A 20.58-percent reduction in the size of the lead.

All 14 of the polls used to calculate the average are post-debate polls. The [NPR/PBS/Marist](https://maristpoll.marist.edu/wp-content/uploads/2024/07/NPR_PBS-News_Marist-Poll_USA-NOS-and-Tables_202407101544.pdf) poll added today is the first Biden-plus poll added to the aggregate in two weeks.

\*\* _OK, so maybe my fingers are crossed behind my back. Harumph._

---

<div class="post-metadata">

**Author:** ![DSeid](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/dseid/32/20194_2.png) [@DSeid](https://boards.straightdope.com/u/DSeid)\
**Post date:** [July 12, 2024, 5:45pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/393 "2024-07-12T17:45:49Z")

</div>

This came up in another thread but the inside baseball methodology question is maybe best asked here.

Past cycle underestimates of Trump support had been explained not by “shy Trumper” but by those who supported Trump being somewhat less likely to participate in polls.

Have the pollsters adjusted methodologies to attempt to compensate for that effect? Some yes some no?

Another question as I try to talk myself down from panic in the case Biden sticks it out - there have been several articles, and some discussion here, about Trump’s lead being greatest in the disengaged voter group. I seem to recall that in general polls tend to narrow their definitions of likely voters as the election gets closer. Is that so? And if so maybe the numbers look better as that happens? Of course if so I am sure aggregators like Silver are already aware.

---

<div class="post-metadata">

**Author:** ![bordelond](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/bordelond/32/150_2.png) [@bordelond](https://boards.straightdope.com/u/bordelond)\
**Post date:** [July 12, 2024, 6:08pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/394 "2024-07-12T18:08:44Z")

</div>

> [@DSeid](#):
>
> Past cycle underestimates of Trump support had been explained not by “shy Trumper” but by those who supported Trump being somewhat less likely to participate in polls.
> 
> **Have the pollsters adjusted methodologies to attempt to compensate for that effect?** Some yes some no?

(my bolding)

The post below contains indirect support for the idea that “_yes, they have compensated_”. Or else are getting more representative sampling of Trump voters.

Namely: Trump’s 2024 polling results – in both national and battleground-state polling – are in line with his actual vote percentages in 2016 and 2020.

> [@Biden considering dropping out (Update: Biden drops out)](https://boards.straightdope.com/t/biden-considering-dropping-out-update-biden-denies/1003690/990):
>
> Plausibly, Trump is likely locked in to around 46.5 - 47.0 percent of the voters in the 2024 general election. There are a lot of inputs for that: Trump’s popular-vote percentages in 2016 (46.1) and 2020 (46.8); his rolling aggregate in RealClear Polling ([vacillating between 44.6 and 47.8](https://www.realclearpolling.com/polls/president/general/2024/trump-vs-biden), with the mean for the year around 46.5); July 2024 polls via FiveThirtyEight [sticking firm around 43% - 44%](https://projects.fivethirtyeight.com/2024-election-forecast/?cid=rrpromo). Now, I’m aware that’s popular vote, not Electoral College counts. I’m merely using the popular-vot…

---

<div class="post-metadata">

**Author:** ![dtilque](https://avatars.discourse-cdn.com/v4/letter/d/d6d6ee/32.png) [@dtilque](https://boards.straightdope.com/u/dtilque)\
**Post date:** [July 12, 2024, 8:53pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/395 "2024-07-12T20:53:52Z")

</div>

> [@bordelond](#):
>
> Full acknowledgement that small fluctuations in aggregate poll numbers don’t mean much

It’s possible that that change _is_ meaningful. I’m not a enough of a statistician to say one way or another, but I do know that the larger the data set, the smaller the error bar. Which means that a change in a poll with a larger sample size doesn’t have to be as big to be meaningful. Aggregation is a way of artificially increasing the sample size, so that change could be significant.

---

<div class="post-metadata">

**Author:** ![TeroSunbear](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/terosunbear/32/14748_2.png) [@TeroSunbear](https://boards.straightdope.com/u/TeroSunbear)\
**Post date:** [July 15, 2024, 12:43am UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/396 "2024-07-15T00:43:00Z")

</div>

Polling rated. Rasmussen does not get listed.  
[What are the best pollsters in America? - ABC News](https://abcnews.go.com/538/best-pollsters-america/story?id=105563951#:~:text=The%20New%20York%20Times%2FSiena,most%20accurate%20pollster%20in%20America).

---

<div class="post-metadata">

**Author:** ![PhillyGuy](https://avatars.discourse-cdn.com/v4/letter/p/ed655f/32.png) [@PhillyGuy](https://boards.straightdope.com/u/PhillyGuy)\
**Post date:** [July 15, 2024, 1:57am UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/397 "2024-07-15T01:57:27Z")

</div>

> [@DSeid](#):
>
> Past cycle underestimates of Trump support had been explained not by “shy Trumper” but by those who supported Trump being somewhat less likely to participate in polls.

I agree. It is tempting for me to use the brief vivid “shy trumper” phrase, since the real explanation is wordy.

> [@DSeid](#):
>
> Have the pollsters adjusted methodologies to attempt to compensate for that effect? Some yes some no?

Some discussion here:

[How 2024 pollsters are trying to avoid their 2020 mistakes](https://www.axios.com/2024/06/15/2024-election-polls-trump-biden)  
Despite the headiline, the real push was [done in 2020](https://wapo.st/3YltHk7). The fix was to weight by education, since we know Trump voters are less educated. And it only worked a little.

---

<div class="post-metadata">

**Author:** ![bordelond](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/bordelond/32/150_2.png) [@bordelond](https://boards.straightdope.com/u/bordelond)\
**Post date:** [July 15, 2024, 1:59pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/398 "2024-07-15T13:59:54Z")

</div>

The article below covers **[just one recent poll (NPR/PBS/Marist)](https://maristpoll.marist.edu/polls/contest-for-president-still-up-for-grabs/)**, and for better or worse it took place before the assassination attempt. While I don’t think this particular poll result is determinative, I do think it makes a lot of things that _people think are determinative_ seem less, um, determinative.

> **[Shocker Poll Suggests Trump’s Lying May Be Huge Weakness for Him](https://newrepublic.com/article/183784/poll-trump-lying-huge-weakness)**
>
> One possible reason the polls haven’t moved as much as pundits expected: Voters still don’t like or trust Trump. Can the Democrats shift the focus to that?

> The poll asked: Which is more concerning in a president, someone who doesn’t tell the truth, or someone who might be too old to serve? The results were lopsided: By 68 to 32 percent, respondents were more concerned about the lying than the aging. Given the relentless media focus on presidential age of late, that’s simply remarkable.
> 
> While the poll doesn’t directly compare Trump and Biden on that particular question, it also finds that 52 percent of Americans say Biden has the “character to serve as president,” whereas only 43 percent say this about Trump. Fifty-six percent say Trump lacks the character to serve, which surely reflects public perceptions of Trump’s dishonesty.

---

<div class="post-metadata">

**Author:** ![TeroSunbear](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/terosunbear/32/14748_2.png) [@TeroSunbear](https://boards.straightdope.com/u/TeroSunbear)\
**Post date:** [July 22, 2024, 2:56pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/399 "2024-07-22T14:56:04Z")

</div>

Wikipedia article on 2024 polls.

> **[Nationwide opinion polling for the 2024 United States presidential election](https://en.wikipedia.org/wiki/Nationwide_opinion_polling_for_the_2024_United_States_presidential_election)**
>
> .mw-parser-output .hover-highlight tr:hover,.mw-parser-output .mw-datatable tr:hover{background-color:var(--background-color-progressive-subtle,#eaf3ff);color:var(--color-base,#333)}.mw-parser-output .mw-datatable{background-color:var(--background-color-base,#fff);color:var(--color-base,#333)}
>  
> This is a list of nationwide public opinion polls that were conducted relating to the general election for the 2024 United States presidential election. The people named in the polls are declared candida...

---

<div class="post-metadata">

**Author:** ![bordelond](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/bordelond/32/150_2.png) [@bordelond](https://boards.straightdope.com/u/bordelond)\
**Post date:** [July 22, 2024, 3:09pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/400 "2024-07-22T15:09:25Z")

</div>

> [@TeroSunbear](#):
>
> Wikipedia article on 2024 polls.

Wikipedia is a good “see it all” tool for polling. You can also see dedicated Wikipedia articles about polling in past election cycles – although if you go back far enough, Wikipedia roll the polling information into a sub-section of the article about a given year’s general presidential election (**[1988 polling](https://en.wikipedia.org/wiki/1988_United_States_presidential_election#Polling)**, for example).

---

<div class="post-metadata">

**Author:** ![bordelond](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/bordelond/32/150_2.png) [@bordelond](https://boards.straightdope.com/u/bordelond)\
**Post date:** [July 26, 2024, 9:46pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/401 "2024-07-26T21:46:35Z")

</div>

> [@iiandyiiii](#):
>
> Rasmussen and RCP are essentially Trump campaign outlets.

Ah-yup.

Every other Trump-Harris poll in the RCP aggregate since Biden dropped out (6 polls): Each within margin of error, Trump up in four, Harris in two.

The seventh poll since Biden dropped out, Rasmussen? Trump +7

(_link below changes frequently_)

> **[2024 General Election: Trump vs. Harris Polls | RealClearPolling](https://www.realclearpolling.com/polls/president/general/2024/trump-vs-harris)**
>
> Explore poll data on the 2024 General Election between Trump and Harris with RealClearPolling. Uncover trends and gain insight into electoral dynamics for key races and decisive outcomes.

---

<div class="post-metadata">

**Author:** ![TeroSunbear](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/terosunbear/32/14748_2.png) [@TeroSunbear](https://boards.straightdope.com/u/TeroSunbear)\
**Post date:** [July 28, 2024, 12:51pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/402 "2024-07-28T12:51:24Z")

</div>

Polling in flux. [https://www.politico.com/news/2024/07/27/polling-kamala-harris-trump-00171514](https://www.politico.com/news/2024/07/27/polling-kamala-harris-trump-00171514)

---

<div class="post-metadata">

**Author:** ![JKellyMap](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/jkellymap/32/15880_2.png) [@JKellyMap](https://boards.straightdope.com/u/JKellyMap)\
**Post date:** [July 30, 2024, 11:27am UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/403 "2024-07-30T11:27:07Z")

</div>

Helpful summary — thanks.  
Mainly good news for Democrats, but two observations are worrisome:

1. RFK’s polling has plummeted — just as he (according to other data I’ve read) seemed to be drawing disproportionately from would-be Trump voters.

2. “Harris is still short of Biden’s 2020 numbers among young voters and voters of color, and the former president is still running well ahead of his 2016 and 2020 numbers among those groups” — despite Harris’ significant gains for these demographics over post-debate (and even pre-debate) Biden.

---

<div class="post-metadata">

**Author:** ![DSeid](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/dseid/32/20194_2.png) [@DSeid](https://boards.straightdope.com/u/DSeid)\
**Post date:** [July 30, 2024, 2:27pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/404 "2024-07-30T14:27:46Z")

</div>

I’ll play those both as positives.

RFK numbers dropped some after the assassination attempt as Trump leaners there moved back.

Now they are dropping as D leaners move back. I think those left still overall lean Trump.

The second is the opportunity for a much higher ceiling than Biden had. She has strong potential to get back to Biden ‘20 levels or beyond; Biden was stuck. She has already mostly caught up without doing that. The possibility of getting comfortably ahead with that makes a heart flutter!

---

<div class="post-metadata">

**Author:** ![bordelond](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/bordelond/32/150_2.png) [@bordelond](https://boards.straightdope.com/u/bordelond)\
**Post date:** [July 30, 2024, 2:45pm UTC](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779/405 "2024-07-30T14:45:48Z")

</div>

> [@JKellyMap](#):
>
> _Politico:_ “Harris is still short of Biden’s 2020 numbers among young voters and voters of color, and the former president is still running well ahead of his 2016 and 2020 numbers among those groups” — despite Harris’ significant gains for these demographics over post-debate (and even pre-debate) Biden.

The offset per _**[The New Republic](https://newrepublic.com/post/184335/trump-picked-jd-vance-fear-support-white-men)**_:

> Former President Donald Trump has a serious problem with white men: They don’t want to vote for him. At least, not the way they did in 2016.
> 
> …
> 
> In April, an NPR/PBS NewsHour/Marist survey found that the demographics that historically supported Trump have begun to shift and the groundswell of support from white male voters that Trump had experienced in 2016 was dissipating.
> 
> …
> 
> Things only got worse from there. According to NPR, between 2020 and 2024, Biden saw a 24-point bump among white men with college degrees, a group that has historically backed Republicans.
> 
> Trump has begun to experience a slip in swing states, as well.

[Previous page](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779.md?page=19)

[Next page](https://boards.straightdope.com/t/polling-is-broken-right-or-is-it-the-news-or-all-of-the-us/993779.md?page=21)
