Upon reading my post, I realized that the story of the CENSORED directory might be of interest to some. It’s a bit of a hijack, but as it deals with an icon of the claimed evidence for AGW, it does address the OP. It’s a brief and ugly tale, full of the usual human flaws that sell tabloid newspapers.
In 1998, Dr. Michael Mann, then a rising young climate scientist, was the lead author of a paper purporting to show that if you took a wide range of proxy temperature data (tree rings, ice core data, and the like), the temperature history since 1400 was shaped like a hockey stick. There was a long shaft of level temperatures for hundreds of years, with a blade rising abruptly in the last century or so. Mann, in his capacity as one of the authors of the IPCC Third Annual Report of 2000, inserted it in that report. It soon became a beloved icon of the AGW movement, showing how humans had ruined a climate Eden where the average temperature never changed much.
There was only one problem with the study. Let me say the Hockeystick was built entirely of pine, and then explain what I mean. It was like the perfect storm, where bad math meets bad data.
The “bad math” part, the math error, is now acknowledged by everyone, including Mann. The result of the error was that the procedure actively mined for hockeystick shaped datasets. When it found them, it gave them high weights in the final results, so the output was, voila, a hockeystick.
The bad data is where the CENSORED directory comes in. For the bad math to make a hockystick, it needs hockeystick shaped data to start with. Unfortunately, most of the temperature proxies didn’t have hockeystick shapes.
Curiously, the only proxies that did have that hockeystick shape were tree ring cores of some related species of pine trees found in the American Southwest (bristlecone, foxtail, and limber pines) which collectively are called “stripbark pines”. More curiously, almost every one of the tree ring cores were collected by a man named Graybill, who was trying to show that ring width was increasing because of increasing CO2. This seems to have unconsciously affected his selection of tree ring cores with the hockeystick shape. But I digress, because for whatever reason, unlike almost all the other proxies, they were hockeystick shaped.
So, in the perfect storm, Mann’s hockeystick mining math meets up with Graybill’s hockeystick shaped trees, and a famous hockeystick icon is born.
And eventually, its flaws are discovered, and eventually, it is acknowledged by everyone to have been flawed, and science moves on.
So what’s the big deal?
Well, the big deal is, as was first famously said of US President Nixon regarding the Watergate Breakin, “What did he know, and when did he know it?”.
In the original Hockeystick paper, the authors made the following statement:
Translating from science speak, he says the results are “robust to inclusion”. This means that you can take out some of the proxies, and the results don’t change much. In particular, he says this means that if say some trees have a growth spurt in recent centuries, it doesn’t change the results much whether you include them or not. Thus, “robust to the inclusion of dendroclimatic indicators” means that the results don’t depend too much on some given subset of the data. This "robustness’ is a quality much desired in this type of statistical analysis. It means the conclusions are reliable, that they are scientifically solid.
The way you determine if the data is robust is to pull some of the proxies out of the group, and repeat the calculations without them, and see what the result looks like. You repeat that process a number of times, until you are satisfied that the results don’t change much with different groups of proxies included and excluded.
Again, what’s the big deal? That’s standard science.
Well, the big deal is that Mann knew all along that the hockeystick shape depended entirely and completely on the stripbark pines of American Southwest. That’s what I meant when I said that the Hockeystick was made out of pine. No stripbark pines, no hockeystick, simple as that. Those few proxies are the key to the hockeystick shape.
And to finally get to the initial question, in the directory called CENSORED were the results of one of the studies that Mann did to determine whether the results were robust. These studies were of what happens when the stripbarks were pulled out of the group of proxies. The results did not show the hockeystick shape.
So rather than put those results with the results from the other robustness studies that did show the hockeystick shape, he pulled those results aside, put them in a folder called “CENSORED”, balanced honesty with effectiveness, and published anyway. He knew the whole thing was made of pine. He knew it depended entirely on the inclusion of the stripbark pine data. But he went ahead and not only published the analysis. He also claimed it was robust to the inclusion of various groups of tree ring data, when he had already done (and stowed away) the analysis that showed that claim to be untrue.
Since then, various studies (Wahl and Amman, Mann 2005, etc.) have claimed to resurrect the hockeystick, saying “we’re not repeating Mann’s math error and we still get a hockeystick”. And it’s true, they’re not.
But they haven’t gotten rid of the bad data, data so bad that the NAS panel considering the subject recommended that they not be used. When you use that bad data, even without the use of Mann’s bad math, the bad data ends up with inordinately high weights.
Because of the bad data, all of these papers have ended up claiming that we can tell the Northern Hemisphere temperature hundreds of years ago, to an amazing accuracy, based mostly on the tree rings of a small group of Southwestern semi-desert pine trees … heck, if that’s the case, we can throw away our thermometers and close the ground stations, we’ll just continue to monitor those trees and we’ll know the Northern Hemisphere average temperature. Makes sense to me.
I see this as a perfect example of the folly of the Schneider school of ethics. I’m sure that Dr. Mann is convinced that there is a grave danger from CO2, and that it is vital that he get the message out to people. At the end, he balanced honesty and effectiveness, and honesty lost.
So, that’s the sordid story of the contents of the CENSORED directory. They showed that Mann knew that the Hockeystick was not scientifically valid, that it was not robust, and that he published anyway, including a specific claim of robustness that he knew was false. Truly, a scientific and human tragedy, and a cautionary tale.
My regards to everyone,
w.