[QUOTE=jshore]
This link doesn’t work for me.
[/quote]
My apologies, that’s where I originally got the document, let me chase it down … OK, try here.
The method consists in using the lag-1 autocorrelation to reduce the number of degrees of freedom. The formula is:
EffectiveN =
(1 - R - 0.68 / Sqr(N))
N * -------------------------------
(1 + R + 0.68 / Sqr(N))
where N is the number of data points, and R is the lag-1 autocorrelation.
The effect on the standard error of the trend is to increase it by
Sqr(N-1) / Sqr(EffectiveN-1).
I have tested this method by using it to calculate the standard error of both monthly and the corresponding annually-averaged yearly data. In general, there is little difference between the standard error of the two when using Nychka’s method, which is as it should be.
[QUOTE=jshore]
[QUOTE=intention]
Right on both counts, my friend. And dang, looks like we have another person suckered into believing that the paper looks at 16 years of temperature data versus scenarios (1990 - 2006). Let me know if you can’t figure out why it’s only about a ridiculously short 6 years of out-of-sample data.
[/QUOTE]
Well, I imagine what you are going to say which is that the models run for the 2001 report were tuned to fit to the 1990-2000 data. However, if this were the case, they didn’t do the tuning very well since it looks like the temperature observations were already right at the high end of the model envelope by that time…Or, did they diabolically tune the models to underpredict this so that they could later claim things are more dire than the models are showing?!?
For the record, here is what the paper itself says on this issue:
[/QUOTE]
jshore, you have to learn to parse these folk’s statements very carefully. They are written and edited by half a dozen authors, and are crafted with precision.
For example, they say the models are “essentially independent” of the data … which means what, exactly? Either they are independent or they are not, there is no middle ground, it’s like being a bit pregnant, not possible. Either there is what is rather inelegantly called “data snooping” or not.
Here’s another example. They claim that the models “are not ‘tuned’ to reproduce the most recent temperatures”. I have to take my hat off to that statement, it’s a work of art. It sounds absolutely scientific, and it says absolutely nothing. I guess to be fair it does say something, it clearly means that the models are tuned to reproduce the “less recent” temperatures … but that says nothing either. A scientific statement has numbers. Are the models tuned to the data up to 1990? To 1995? To 2000? Each of these answers would mean very different things to our understanding of their results.
But that’s not my point.
With tuned models, until you make it clear whether you are working on out-of-sample data or not, you are not telling me anything. So in fact, they are saying the models are not independent of some of the climate data, while making it look like they are independent, without a single citation to back up or explain their claim, or even a number so it could be falsified. But that’s not my point
They also say “global sea level data were not available at the time” … not sure how that can be, since they are using satellite data since 1990 which is available in realtime … maybe their watches are set slow or something, but it is simply not true that 1999 sea level data was not available in 2000. However, true or not, this claim seems to indicate that whatever data the models are not independent of, they’re either not independent of temperature or CO2 data or both. Why do I suspect it’s not CO2?
These kinds of not-scientific, very carefully worded number-free pseudo-claims drive me spare. It is clear from the statement that the models are not independent of the data … but exactly where and how?
But that wasn’t my point either.
Next, it is worth noting that the models used in this exercise were not the GCMs which were used by the IPCC to forecast our impending doom. Instead, they are the results of a simplified model which the IPCC claims was “tuned” to the various GCMs. So they are the results of a model which is tuned to a model which is tuned to historical data … except of course it’s not tuned to the “recent temperatures”. Regrettably, the paper makes no mention that we’re not looking a model results, but a model of model results. But also, not my point.
My point was that (as near as I can tell using their pathetic references) they are using the IPCC Fig. 9-14 results, but they have made an important change in the graphic.
In the IPCC figure, the 1990 - 2000 jump in temperature is not all the model results of different scenarios. You can tell because it is a single line with no grey error bars. It is a result of a single scenario … which (as the IPCC is fond of telling us) is no more or less probable than any other scenario. So there is no expectation that it be accurate.
In fact, this scenario for the decade 1990-2000 was chosen in 1999, based on data up to that point. Now, Rahmstorf et al. are claiming that we should examine it as though it were a forecast, to see how well the IPCC can forecast temperature changes. But it’s not a forecast, it’s a hindcast. Which is why I say they are suckering people into believing they are comparing 15 years of forecasts and data, when in fact they are not.
Which scenario was used by the IPCC for the period 1990 - 2000? Well … all of them. All of the various scenarios have the same forcing 1990 - 2000. This forcing was known at the time to be low, but nobody worried about that, because it was in the past. Nobody was considering it to be anything other than a baseline scenario to give everyone a common starting point for the splitting into various scenarios in 2000.
After 2000, as you can see, the model results from the different scenarions go in different directions, the A1 and B1 and the rest all go their own way.
But before 2000, there is no such diversity.
This is because when the 2001 report was written, 1900-2000 was in the past. It is the starting point for the various scenarios. That’s why in Figure 9.14, there is no grey area surrounding the 1990-2000 results … so why have Rahmstorf changed the IPCC figure to include a gray area not shown by the IPCC? Inquiring minds wonder …
Unless, of course, Rahmstorf et al. were using a whole other list of model results, in which case all bets are off … but then they very carefully have not said which results they are using. It would have been nice, and trivially easy, if they had actually said where the model results were to be found in the 2001 TAR, instead of referencing the entire IPCC report and expecting us to guess which of the hundreds of model results they are talking about… but that kind of petty nonsense is to be expected in climate science. So it’s possible they are using some other model results from some unknown place.
For me, a climate scientist giving a citation like
[QUOTE=Rahmstorf et al.]
- IPCC, Climate Change 2001: The Scientific Basis (Cambridge Univ. Press, Cambridge, 2001)
[/QUOTE]
is identical to a creationist saying “the answer’s right there in the Bible”. Well, maybe so, but where? Chapter and verse are necessary for science. When I see a citation to the entire IPCC report like that, danger flags start flying and warning horns start blaring. Real scientists give real citations, they don’t just wave at the IPCC Bible and say “The answer’s in there, you go find it”.
w.
PS - until I originally researched Rahmstorf et al.'s claims, I was unaware that they were not referring to the models used by the IPCC. Instead, they are reporting the results from a model of the models, called MAGICC, and not the actual model results (see 2001 TAR Appendix 9.1. Seems like the paper might have mentioned that tiny detail …
This whole “model of the model” concept is actually quite interesting. According to the IPCC, any of the various GCM models can be modeled with good fidelity using only six variables (forcing from doubling, temperature change from doubling, magnitude of warming needed to collapse the THC, vertical diffusivity, ratio of the equilibrium temperature changes over land versus ocean, and land/ocean and Northern Hemisphere/Southern Hemisphere exchange coefficients.)
The fact that the model results can be simulated using only these six variables brings up interesting questions, such as:
-
How are the differences in feedbacks simulated by MAGICC? None of those variables directly affects the clouds, for example. How are the differences in feedbacks handled?
-
If, as the IPCC claims, MAGICC can successfully simulate all of the models … why are we messing with the models? Why not just run MAGICC and be done with it?
-
If the models can be successfully emulated with only six variables, and yet contain hundreds of parameters, doesn’t this mean that they are wildly overdetermined?
As always, more questions than answers …
PPS - Using a single chosen baseline 1990 - 2000 scenario as the IPCC does, all of the scenarios and all the models are identical until 2000. The reason the modeled results of the scenarios are all low in 2000 is not from poor model tuning or any other such reason involving models as you speculate, jshore.
It is not that the models or their tuning are wrong. It is because the first decade of all the scenarios are identical and identically wrong (from the models’ perspective). That proves nothing about the models. All that proves is that the IPCC is not very good at picking a single scenario to represent reality. Which they know, and that’s why they give us a whole host of scenarios during the actual period of interest (which of course is the future, not the past).
To test the model responses to the various scenarios, it is useless to look at the single scenario that the IPCC happened to choose to represent 1990-2000. They could have picked any scenario for that, and they make no claims about the accuracy of the chosen scenario. To see the range of how the models respond to the scenarios, we need to look at their post - 2000 performance, when the scenarios are different.
The actual observed temperature trend 2000 - present is not statistically different from zero. Since the IPCC scenarios do not show the temperature falling 2000 -2006, I fail to see how this lack of warming substantiates the claim in the paper that the IPCC may have “underestimated the change” in temperature. In order to underestimate a change of zero, you’d have to predict cooling, and the IPCC has not done that.
And yes, that is far too short a period to make any hard conclusions, it’s only six years … which is what I said to start this off. They act like they are considering sixteen years of forecasts, but ten years of that is a hindcast.
w.