# Hurricane models and accuracy

**URL:** <https://boards.straightdope.com/t/hurricane-models-and-accuracy/821221>\
**Category:** Factual Questions\
**Created:** [September 12, 2018, 1:19pm UTC](https://boards.straightdope.com/t/hurricane-models-and-accuracy/821221 "2018-09-12T13:19:05Z")\
**Posts on this page:** 13\
**Page:** 1

<div class="post-metadata">

**Author:** ![MikeF](https://avatars.discourse-cdn.com/v4/letter/m/45deac/32.png) [@MikeF](https://boards.straightdope.com/u/MikeF)\
**Post date:** [September 12, 2018, 1:19pm UTC](https://boards.straightdope.com/t/hurricane-models-and-accuracy/821221/1 "2018-09-12T13:19:05Z")

</div>

Is there anywhere on the web that shows predicted vs. actual paths for hurricanes according to model? Can I go to a site that will show me what the European model predicted for the last 24, 48, 72 hrs. etc as compared for the actual path? It seems the European model predicted Florence to turn south before the others and still differs by enough to make a pretty big difference to those likely to be impacted, at least wind direction-wise. While it doesn’t much matter if your roof blows off from the front or back, tides can be greatly impacted by wind direction.

---

<div class="post-metadata">

**Author:** ![Kzbre5m](https://avatars.discourse-cdn.com/v4/letter/k/f08c70/32.png) [@Kzbre5m](https://boards.straightdope.com/u/Kzbre5m)\
**Post date:** [September 12, 2018, 2:38pm UTC](https://boards.straightdope.com/t/hurricane-models-and-accuracy/821221/2 "2018-09-12T14:38:32Z")

</div>

[spaghettimodels.com](http://spaghettimodels.com/)

It doesn’t show actual vs predicted, but it does show all the different model paths, in different variations of predictive maps. I’m guessing there are no maps showing where it went in history. Weather people probably don’t like to brag how right or wrong they were.

It’s a very busy website. Right now it’s five times as busy.

I still haven’t figured out the abbreviations of the different models. The best guess is in the green lines. Beware the black triangle line (XTRP). It’s only the current direction the hurricane is pointing to. I first noticed this when the other models were going up the coast, and XTRP was headed to the west coast.

---

<div class="post-metadata">

**Author:** ![Jasmine](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/jasmine/32/2964_2.png) [@Jasmine](https://boards.straightdope.com/u/Jasmine)\
**Post date:** [September 12, 2018, 2:43pm UTC](https://boards.straightdope.com/t/hurricane-models-and-accuracy/821221/3 "2018-09-12T14:43:39Z")

</div>

Well, if all else fails, you can take a screen shot every day and save them as image files. Then, for example, you can compare the one you took five days ago to the one that they are displaying today.

---

<div class="post-metadata">

**Author:** ![Kzbre5m](https://avatars.discourse-cdn.com/v4/letter/k/f08c70/32.png) [@Kzbre5m](https://boards.straightdope.com/u/Kzbre5m)\
**Post date:** [September 12, 2018, 2:49pm UTC](https://boards.straightdope.com/t/hurricane-models-and-accuracy/821221/4 "2018-09-12T14:49:24Z")

</div>

> [@](#):
>
> I still haven’t figured out the abbreviations of the different models. The best guess is in the green lines.

Sorry, that should be the European models are the green lines.

---

<div class="post-metadata">

**Author:** ![MikeF](https://avatars.discourse-cdn.com/v4/letter/m/45deac/32.png) [@MikeF](https://boards.straightdope.com/u/MikeF)\
**Post date:** [September 12, 2018, 4:45pm UTC](https://boards.straightdope.com/t/hurricane-models-and-accuracy/821221/5 "2018-09-12T16:45:20Z")

</div>

A little digging turned up an article from 2014 stating that the U.S. computers needed to be updated and that that was going to take place over the next two years. Any idea if that ever happened? The European model out performed the U.S. model during Sandy and highlighted the need. If I were a weather guy and my model was consistently accurate, I’d be bragging about it.

---

<div class="post-metadata">

**Author:** ![kenobi\_65](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/kenobi_65/32/13178_2.png) [@kenobi\_65](https://boards.straightdope.com/u/kenobi_65)\
**Post date:** [September 12, 2018, 5:02pm UTC](https://boards.straightdope.com/t/hurricane-models-and-accuracy/821221/6 "2018-09-12T17:02:55Z")

</div>

> [@MikeF](#):
>
> A little digging turned up an article from 2014 stating that the U.S. computers needed to be updated and that that was going to take place over the next two years. Any idea if that ever happened? The European model out performed the U.S. model during Sandy and highlighted the need. If I were a weather guy and my model was consistently accurate, I’d be bragging about it.

Do you have a link to that article? I’m curious to see exactly what it said.

It’s important to realize that upgrading the computers themselves (which would let the meteorologists run their models more quickly) are different from updating or enhancing the actual prediction models. The meteorologists who create these models regularly fine-tune them, using past results to learn from what they got right, and what they didn’t get right.

So, if the European model got Sandy right (or other models got it wrong), they learn from that, and use that knowledge to create what they hope will be more accurate models going forward.

Also, as I understand it, no model is consistently “the best.” Some seem to have a better handle on certain types of storms than others (and these models are use for far more than hurricane forecasts). And, weather forecasting is simply a hugely complex task – our models are far better than they were in the past, but even the better ones are still only approximations, and there are variables that even the most skilled meteorologists can’t estimate. Just because the European model may have gotten one storm “right,” doesn’t mean that it’s going to be the one that accurately predicts the next storm.

---

<div class="post-metadata">

**Author:** ![kenobi\_65](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/kenobi_65/32/13178_2.png) [@kenobi\_65](https://boards.straightdope.com/u/kenobi_65)\
**Post date:** [September 12, 2018, 5:11pm UTC](https://boards.straightdope.com/t/hurricane-models-and-accuracy/821221/7 "2018-09-12T17:11:37Z")

</div>

Here’s a Mashable article from last year on the topic:

> **[Hurricane Irma again demonstrated the inferiority of the top U.S. weather model](https://mashable.com/article/hurricane-irma-weather-forecast-models-gfs-vs-european)**
>
> The European model won. Again.

What I take away from this:

- Yes, NOAA’s primary model, GFS, is known to **generally** be inferior to models from non-US agencies, including the European model, particularly when it comes to longer-range forecasts, and they’re in the midst of a multi-year program to upgrade their hardware and their model.

- Part of why the US models aren’t as good as the European model is that NOAA is working with lower levels of funding and smaller staff than the European agency has, and does not have a centralized agency for atmospheric / meteorological models.

- Even with this general statement, GFS did well in predicting Harvey’s track, while both GFS and the European model did poorly on Irma.

- This is why forecasters try to never rely on a single model, but instead, develop “ensemble” forecasts based on what all of the models are saying.

---

<div class="post-metadata">

**Author:** ![MikeF](https://avatars.discourse-cdn.com/v4/letter/m/45deac/32.png) [@MikeF](https://boards.straightdope.com/u/MikeF)\
**Post date:** [September 12, 2018, 7:06pm UTC](https://boards.straightdope.com/t/hurricane-models-and-accuracy/821221/8 "2018-09-12T19:06:41Z")

</div>

Here’s the one I was talking about. 2013, not 2014.

> **[US vs. European hurricane model: Which is better? - The Boston Globe](https://www.bostonglobe.com/news/science/2013/05/29/european-hurricane-model-which-better/uDEDtWAy8g3yP0lsFaU4mK/story.html)**
>
> ST. PETERSBURG, Fla. — When forecasters from the National Weather Service track a hurricane, they use models from several different supercomputers located around the world to create their predictions.

Given the vulnerability of our coasts, you’d think they throw some more money at forecasting.

---

<div class="post-metadata">

**Author:** ![kenobi\_65](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/kenobi_65/32/13178_2.png) [@kenobi\_65](https://boards.straightdope.com/u/kenobi_65)\
**Post date:** [September 12, 2018, 7:20pm UTC](https://boards.straightdope.com/t/hurricane-models-and-accuracy/821221/9 "2018-09-12T19:20:09Z")

</div>

> [@MikeF](#):
>
> Given the vulnerability of our coasts, you’d think they throw some more money at forecasting.

Yes, you would absolutely think so. But, as the Mashable article notes, the administration is actually trying to cut the forecast model budget.

---

<div class="post-metadata">

**Author:** ![Sage\_Rat](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/sage_rat/32/399_2.png) [@Sage\_Rat](https://boards.straightdope.com/u/Sage_Rat)\
**Post date:** [September 12, 2018, 7:37pm UTC](https://boards.straightdope.com/t/hurricane-models-and-accuracy/821221/10 "2018-09-12T19:37:22Z")

</div>

> [@kenobi\_65](#):
>
> Do you have a link to that article? I’m curious to see exactly what it said.
> 
> It’s important to realize that upgrading the computers themselves (which would let the meteorologists run their models more quickly) are different from updating or enhancing the actual prediction models. The meteorologists who create these models regularly fine-tune them, using past results to learn from what they got right, and what they didn’t get right.
> 
> So, if the European model got Sandy right (or other models got it wrong), they learn from that, and use that knowledge to create what they hope will be more accurate models going forward.
> 
> Also, as I understand it, no model is consistently “the best.” Some seem to have a better handle on certain types of storms than others (and these models are use for far more than hurricane forecasts). And, weather forecasting is simply a hugely complex task – our models are far better than they were in the past, but even the better ones are still only approximations, and there are variables that even the most skilled meteorologists can’t estimate. Just because the European model may have gotten one storm “right,” doesn’t mean that it’s going to be the one that accurately predicts the next storm.

It’s also worth noting that these are all probabilistic models, so it’s like saying that your prediction that two dice rolled together would most likely add up to 7 was wrong: Well, no, adding up to 7 is the most likely result, and any model that said otherwise would be wrong, but that doesn’t mean that every dice roll will add up to 7. And if there’s a model that says that it will add up to 6, and the dice actually add up to 6, that’s probably not a matter that this model was more accurate. If you try to match it, you’ll just be wrong more often.

---

<div class="post-metadata">

**Author:** ![bump](https://avatars.discourse-cdn.com/v4/letter/b/7c8e57/32.png) [@bump](https://boards.straightdope.com/u/bump)\
**Post date:** [September 12, 2018, 7:46pm UTC](https://boards.straightdope.com/t/hurricane-models-and-accuracy/821221/11 "2018-09-12T19:46:07Z")

</div>

> [@kenobi\_65](#):
>
> This is why forecasters try to never rely on a single model, but instead, develop “ensemble” forecasts based on what all of the models are saying.

That’s the smart thing to do- it’s the meteorological modeling equivalent of crowdsourcing.

Another thing to consider is that these models are really only accurate in fairly short time frames- hence the “cone” getting wider for times further out.

And I’d wager that the models’ accuracy varies with the time frame as well- for a hypothetical example, the GFS model could possibly be more accurate between days 3 and 5 than the European model, and less accurate between days 0 and 3, and equal outside of 5.

---

<div class="post-metadata">

**Author:** ![kenobi\_65](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/kenobi_65/32/13178_2.png) [@kenobi\_65](https://boards.straightdope.com/u/kenobi_65)\
**Post date:** [September 12, 2018, 7:48pm UTC](https://boards.straightdope.com/t/hurricane-models-and-accuracy/821221/12 "2018-09-12T19:48:23Z")

</div>

> [@Sage\_Rat](#):
>
> It’s also worth noting that these are all probabilistic models, so it’s like saying that your prediction that two dice rolled together would most likely add up to 7 was wrong: Well, no, adding up to 7 is the most likely result, and any model that said otherwise would be wrong, but that doesn’t mean that every dice roll will add up to 7. And if there’s a model that says that it will add up to 6, and the dice actually add up to 6, that’s probably not a matter that this model was more accurate. If you try to match it, you’ll just be wrong more often.

Exactly so. That’s one of the reasons why those “spaghetti maps” can be misleading to the layman – the “center line” of any model’s forecast storm path is the equivalent of the “7” in what you describe. It’s the most likely path that the model is predicting, and there’s a fairly high confidence that the storm will take a path that’s reasonably close to that line (particularly in the near term), but the actual output of the model is more like a cone, as uncertainty in any model increases the further out that they attempt to model.

The other reason that some meteorologists hate the “spaghetti map” (and forecasters who focus overly much on where the center of the storm is going), is that it can lead laymen into a false sense of security if they see that the forecast doesn’t put the storm center over their heads. Yes, a direct hit by the center of a hurricane can be devastating, but hurricanes are massive storms, and deal lots of damage to areas that are nowhere near the center.

---

<div class="post-metadata">

**Author:** ![Dobbs](https://avatars.discourse-cdn.com/v4/letter/d/5f9b8f/32.png) [@Dobbs](https://boards.straightdope.com/u/Dobbs)\
**Post date:** [September 12, 2018, 8:07pm UTC](https://boards.straightdope.com/t/hurricane-models-and-accuracy/821221/13 "2018-09-12T20:07:07Z")

</div>

It’s not model by model comparison, but is related.

This shows how the NWS forecast track for Florence has changed over time. There are archives of other storms if you dig around.

[https://www.nhc.noaa.gov/archive/2018/FLORENCE\_graphics.php?product=5day\_cone\_with\_line](https://www.nhc.noaa.gov/archive/2018/FLORENCE_graphics.php?product=5day_cone_with_line)
