# How many people take Global Warming totally on faith? **URL:** \ **Category:** Great Debates\ **Created:** [August 21, 2007, 1:06pm UTC](https://boards.straightdope.com/t/how-many-people-take-global-warming-totally-on-faith/416356 "2007-08-21T13:06:49Z")\ **Posts on this page:** 20\ **Page:** 29
**Author:** ![intention](https://avatars.discourse-cdn.com/v4/letter/i/e95f7d/32.png) [@intention](https://boards.straightdope.com/u/intention)\ **Post date:** [September 6, 2007, 3:53am UTC](https://boards.straightdope.com/t/how-many-people-take-global-warming-totally-on-faith/416356/561 "2007-09-06T03:53:23Z")
[QUOTE=jshore] **intention** , the idea of sensitive dependence to initial conditions, chaos, turbulence, and such is not a new idea. It has been known since Lorenz first wrote down some very simplified equations to model the weather back in like the 1950s or 60s. And, in fact, modern computer forecasting, particularly on the medium- to long-range scale makes use of ensembles of runs with perturbed initial conditions in order to assess the confidence that the forecasters can have in the model solution. If the ensemble is clustered around one basic solution, they have a lot of confidence in that solution. If the ensembles are all over the map, then they have very little confidence. You can read daily discussions of this applied to the 6-10 and 8-14 day weather forecasts [here](http://www.cpc.noaa.gov/products/predictions/610day/fxus06.html). [/QUOTE] The citations I sent were not about “the idea of sensitive dependence to initial conditions, chaos, turbulence, and such”, so it is not clear why you are discussing that question. Please read the citations. [QUOTE=jshore] And, with climate models they do similar ensemble runs. What these runs tend to show is that while the year-to-year jiggles vary amongst the ensemble members, the general climate features…and particularly, the basic response of the climate to a perturbation such an increase in the concentrations of greenhouse gases is quite robust. [/QUOTE] You are confusing models with reality when you say “the basic response of the climate to a perturbation such an increase in the concentrations of greenhouse gases is quite robust.” What you mean is that the models generally agree with each other … is that supposed to impress me? Since (as I have repeatedly pointed out) the models use very different forcings, they should give very different answers. The fact that they agree means only that they are tuned to reproduce the past climate … like the song says, “that don’t impress me much”. [QUOTE=jshore] This whole issue is often summarized a bit simplistically by saying that forecasting weather and climate are two very different things. And, while such sensitivities are important to weather prediction, they are not very important to climate prediction. Intuitively, you know that while you would never trust me to predict what the weather will be 5 months from now here in Rochester, you would trust the climate prediction that the month of February will have a considerably lower average temperature than the current month of September. [/QUOTE] This is nonsense and you know it. Climate models and the discussion of climate are about anomalies, not absolute temperatures. If you have a model that can tell me if the anomaly for next March will be larger than the anomaly for next September, let me know. Until then, give this argument up, it means nothing. [QUOTE=jshore] V&V and SQA may be well-suited to testing models that have specific well-defined missions to perform but it is not to my knowledge ever used, at least in such a formal way, in testing models in the physical sciences and that is because it is neither useful nor appropriate to do so. Look, what has basically happened is that your side has lost the scientific debate so you are trying to change the rules by which the science is played. It is similar to Michael Crichton’s demand that there be double-blind testing and all this nonsense, which is important and useful in the field he is trained in (medicine) but again is neither necessary nor appropriate in the physical sciences. [/QUOTE] Contrary to your claim, validation and verification of models and simulations is well known, applied, and studied in the physical sciences. It even has its own name, “M&S V&V”. NASA applies it to, inter alia, such physical models as those dealing with spatial response of temperatures at the edges of surface discontinuities, positional accuracy, thermal radiometry, atmospheric radiometry, full-sky imaging, hyperspectral radiometry, and bidirectional reflectance. [Here](http://www.acims.arizona.edu/EVENTS/MSV&V_ACIMS.pdf) is a paper on “Implications of M&S Foundations for the V&V of Large Scale Complex Simulation Models” … I could give you many more examples of the use of V&V for models of physical systems, or you could find them yourself. You keep asking why I should not accept the judgement of the consensus of scientists? Your entirely specious claim, that V&V is not used for models in the physical sciences, is a perfect example of why I don’t. You put it out there as though it were verified scientific fact, based on your experience as a scientist, and yet it is 100% wrong … [QUOTE=jshore] It is reasonable for some scientists to disagree with the current general consensus in the field regarding AGW and to work on doing serious scientific work to come up with alternate hypotheses and to find evidence against the AGW theory. However, it is not reasonable for these scientists to demand that the rest of the world sit and wait until every last one of them are all convinced that AGW is correct. The reason our society has been able to make progress in many areas is because it is accepted that science should inform public policy decisions that they are relevant to and that certain bodies, like the National Academy of Sciences (NAS), will implement processes to do this. The National Academy, along with its analogous bodies [has clearly spoken on this issue](http://nationalacademies.org/onpi/06072005.pdf). [/quote] Yes … and you have clearly spoken as a scientist about how physical models don’t need or receive V&V … > [@jshore](#): > > While you are welcome to disagree with their conclusions, it continues to mystify me why you believe that we should take your opinion very seriously and, in particular, not take any prudent actions that the NAS has advised we do because **intention** doesn’t think the science justifies it. What do you propose as a general plan of action for the U.S. government…that they act not on the advice of the NAS but rather on the advice of **intention**? We’ve been over this ground many times, jshore, and I have laid out for you exactly what I think we should do, starting with performing V&V and SQA on the models and moving on from there. Your claim is a straw man, and your pretense that I have not laid out my thoughts in detail does not become you. [Quote=intention] PS - the fact that a variety of models give us similar results for climate sensitivity only shows that they are tuned to reproduce the past climate record. Given the assumption that the temperature changes are due to CO2, even the simplest model will give that result. [/quote] > [@jshore](#): > > You have never been able to substantiate this claim because it is simply not true of climate models. And, when asked why noone has thus demonstrated that they can produce the warming we have seen in the last 30 years with a climate model that includes only natural forcings, you fall back on some lame excuse that is essentially that all the climate modelers are so wedded to AGW that they won’t tune it this way and none of the skeptics can get their hands on a climate model. This is simply baloney!! Say what? I claim models are tuned to reproduce the past climate record. Are you seriously claiming that the models are not so tuned? Heck, even Gavin Schmidt admits that they are tuned. Or perhaps you think they are tuned so as _ **not** _ to reproduce the past record? w. ---
**Author:** ![intention](https://avatars.discourse-cdn.com/v4/letter/i/e95f7d/32.png) [@intention](https://boards.straightdope.com/u/intention)\ **Post date:** [September 6, 2007, 7:39am UTC](https://boards.straightdope.com/t/how-many-people-take-global-warming-totally-on-faith/416356/562 "2007-09-06T07:39:13Z")
jshore, a further thought about tuning the climate models to match reality, which you say doesn’t happen. In all of the climate models, both the clouds and the albedo are parameterized. In the GISSE model, the cloud coverage is low by about 11% (58% modeled, 69% measured). Now the albedo is a function of the amount of cloud cover … but the model gets the albedo just right, about 29.5%. How do they do that? To quote Gavin Schmidt (ibid), > [@](#): > > The model is tuned (using the threshold relative humidity > U00 for the initiation of ice and water clouds) to > be in global radiative balance (i.e., net radiation at > TOA within ±0.5 W m 2 of zero) and a reasonable > planetary albedo (between 29% and 31%) for the control > run simulations. In these experiments we use U00 = > 0.59, 0.57, and 0.59 for ice clouds and 0.82, 0.82, and > 0.83 for water clouds in M20, F20, and M23, respectively. Perhaps you might want to reconsider your claim that the models are not tuned to match reality … w. ---
**Author:** ![GIGObuster](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/gigobuster/32/421_2.png) [@GIGObuster](https://boards.straightdope.com/u/GIGObuster)\ **Post date:** [September 6, 2007, 9:30pm UTC](https://boards.straightdope.com/t/how-many-people-take-global-warming-totally-on-faith/416356/563 "2007-09-06T21:30:36Z")
[QUOTE=intention] GIGObuster, I know that NASA has a V&V center, which they use for things like the software used to run the space shuttle … I’ve just never been able to find any citation that they have used it for climate models. Since you say it has, I’ve asked for a citation. w. [/QUOTE] I did not say that, I said you are not aware of what NASA is doing with V&V, and it is not only for the Space Shuttle, the main point was that the focus of the testing in models is the physics and the chemistry, checking the coding is important, but it is not the only reason why you come to trust a model. V&V is not used\* much in climate modeling, but there are other reasons why it is so, and on the documents from NASA I see that the V&V department sees not much of a reason to check the climate models, but thinks the data going to them is the most important thing. (\*but logic tells me that it is being implemented in more areas as computer power increases) [http://www.nasa.gov/centers/ivv/pdf/138422main\_NASA\_IVV\_2004.pdf](http://www.nasa.gov/centers/ivv/pdf/138422main_NASA_IVV_2004.pdf) > [@](#): > > AIM mission. > IV&V Project Manager: Ken Vorndran > IV&V Contractor: SAIC > The AIM mission is part of NASA’s Small Explorers (SMEX) program and is currently slated for launch in Fall 2006. The AIM mission will provide unprecedented advances in the understanding of noctilucent or “night shining clouds.” The overall goal of the AIM mission is to study why noctilucent clouds form and why they vary.1 > By measuring noctilucent clouds and the environment in which they form, we will learn more about the connection between these clouds and the meteorology of the mesosphere. In the end, this will provide the basis for study of long-term variability in the > mesospheric climate and its relationship to global climate changes.1 > The results of the AIM mission will be a rigorous validation of predictive models that can reliably use past changes and present trends > of noctilucent clouds as indicators of global change. This goal can only be achieved by a complement of instruments on-board the AIM satellite which will be orbiting Earth at an altitude of 550 km. These instruments will take wide angle photos of noctilucent clouds, > measure their temperatures and chemical abundances, monitor dusty aerosols, and count meteoroids raining down on Earth, all of > which are critical factors associated with the formation of noctilucent clouds. 1 > The IV&V Facility is performing IV&V on the AIM spacecraft and three on-board instruments, including the Solar Occultation for > Ice Experiment (SOFIE), Cloud Imaging and Particle Size (CIPS), and Cosmic Dust Experiment (CDE). To date, IV&V has completed > requirements analysis efforts and has begun design analysis activities. > IV&V has identified and documented non-compliances to the NASA Software Safety Standard. These non-compliances are currently > being worked on by Project and Safety personnel as part of their efforts in developing the overall Pre-Launch Safety Data Package. > In addition, as part of IV&V requirements analysis efforts, IV&V has identified and documented several technical issues associated > with system and software requirements which the AIM project has agreed to address. > 1“Strange Clouds” [http://science.nasa.gov/headlines/y2003/18feb\_nlc.htm](http://science.nasa.gov/headlines/y2003/18feb_nlc.htm). > For further information about AIM, visit [http://aim.hamptonu.edu/mission/1mission.html](http://aim.hamptonu.edu/mission/1mission.html). > > AURA Mission > IV&V Project Manager: Marcus Fisher > IV&V Contractor: Titan > Earth Observing System (EOS) Aura is a NASA mission to study the Earth’s ozone, air quality, and climate. This mission is designed > to conduct research on the composition, chemistry, and dynamics of the Earth’s upper and lower atmosphere employing multiple > instruments on a single satellite. EOS Aura is the third in a series of major Earth-observing satellites to study the environment and > climate change, and is part of NASA’s Earth Science Enterprise. The first and second missions, Terra and Aqua, are designed to study > the land, oceans, and the Earth’s radiation budget, which represents the incoming energy from the Sun and outgoing thermal and > reflected energy from the Earth. Aura’s chemistry measurements will also follow up on measurements that began with NASA’s > Upper Atmospheric Research Satellite and continue the record of satellite ozone data collected from the > Total Ozone Mapping Spectrometer (TOMS) missions. > The IV&V team has performed analysis on the requirements, source code, and tests of the Aura spacecraft and instrument flight software. Specifically, the IV&V team verified that all software requirements were allocated to one or more test cases and that the selected verification method was appropriate. The team also verified the Spacecraft Flight Software (FSW), Microwave Limb Sounder (MLS), Ozone Monitoring Instrument (OMI), High Resolution Dynamics Limb Sounder (HIRDLS), and Tropospheric Emission Spectrometer (TES) test procedures were complete, and adequately addressed the software requirements associated with them. The team verified > that Comprehensive Performance Test (CPT) procedures exercised key spacecraft and instrument functions. Through static analysis of the MLS source code, the IV&V team provided additional assurance that the software will perform reliably within the project’s defined mission scenarios. > The IV&V team’s efforts have improved the robustness and confidence of the Aura Test Program. The program launched the spacecraft on July 15, 2004, and the spacecraft and software continue to operate nominally. > For further information about Aura, visit [http://aura.gsfc.nasa.gov/](http://aura.gsfc.nasa.gov/). [http://www.nasa.gov/centers/ivv/pdf/138420main\_Mapping\_Our\_Progress\_FINAL\_330.pdf](http://www.nasa.gov/centers/ivv/pdf/138420main_Mapping_Our_Progress_FINAL_330.pdf) > [@](#): > > National Polar-Orbiting Operational > Environmental Satellite System (NPOESS): > Satellite missions that will provide systemati > measurements of key environmental variables > to study long-term climate and global > change. > [@](#): > > The IV&V Team performed analysis on the requirements, source code, and tests of the Aura spacecraft > and instrument flight software. Analysis on the source code is supported with the following tools; > Polyspace Code Verifier, Flexelint, and Source Navigator. In house tools have also been developed in > order to perform analysis on the test cases, which were written in the CSTOL scripting language. The > tool set enables our analysts to determine whether software requirements have been adequately tested > as well as assessing the spacecraft commands that have been exercised. Now, even though is clear V&V is being used by climate researchers in the collecting of the data, why not do this before with climate models? I do not think one should jump in the rapidly shrinking anti-global warming bandwagon, and assume nefarious ideals from the climate researchers. It seems to me there are more mundane reasons why V&V was not a big deal before with climate researchers. I agree with **jshore** : > [@](#): > > Look, what has basically happened is that your side has lost the scientific debate so you are trying to change the rules by which the science is played. While you have found a flaw on that \*\*jshore \*\* said, (that is not accurate to say V&V is not used the physical sciences) It is accurate to say it is not used much in climate modeling, and the more I check, the more I’m convinced the reason is that the testing has been done in other ways and there are more mundane reasons why V&V has not been implemented at large. > **[RealClimate: Why global climate models do not give a realistic description of...](https://www.realclimate.org/index.php/archives/2007/05/climate-models-local-climate/)** > > RealClimate: Global climate Global climate statistics, such as the global mean temperature, provide good indicators as to how our global climate varies (e.g. see here). However, most people are not directly affected by global climate statistics. They... > [@](#): > > Tim McDermott Says: > 30 May 2007 at 10:50 PM > re 106, V&V and SQA of the models: > > First, saying “Then we should …” immediately raises the question of who the “we” are. V&V is seldom used, even on military applications, except for highly mission critical or human safety systems. This is because V&V can come close to doubling the cost of a project. This is evident from the sort of questions in the quote, “… error propagation analysis…,” “…complete list…,” “make sure … converge…,” “thoroughly investigated.” These questions are asked in a “prove it to me” tone of voice. The modelers now not only have to build models that match observed phenomena, they have to provide evidence (that would not otherwise have been developed) to satisfy the V&Vers. You are going to need as many V&Vers as you have developers (they are going to verify all of the analytical work) and the V&Vers themselves need to be qualified climate scientists to understand what they are looking at. > > So who pays? > > Is any of this of any benefit? No. There are better, cheaper ways to assess the quality of software. In this particular case, the fact that the couple dozen climate models in the world all pretty much agree shows that they are free of disqualifying defects (assuming that they were designed and coded independently.) > > By way of reference, in the 7 years I spent at NASA Goddard, I never heard of a project, even for flight software, that used real IV&V (Independent V&V). They called using a separate test team IV&V, and calculated that it added 5% to 15% to the cost of a project. Note that an independent test team can’t answer any of the questions in the original post. This was the shop that built the flight control software for nearly all of NASA’s earth satellites for decades. They understood software quality. > > The second thing that a call for V&V does is misunderstand scientific, and perhaps all, modeling. V&V’s goal is to answer two questions: Was the system built correctly? and Does the system as built meet the requirements? But notice that the goal of any model building is to better understand the thing being modeled. So where are the requirements specified? In Nature? How do we trust the V&V team to better understand the subject than the modelers? > > I reluctantly conclude that the call for V&V is either deeply ignorant of real-world software development, or is just another piece of FUD trying to impeach climate models. > > Tim McDermott Says: > 30 May 2007 at 11:03 PM > In the process of composing my previous comment, I downloaded modelE from the giss site and took a quick look at the code. From a completely non-rigourous assessment of two modules, it looks like it was written by fully competent programmers. The code is modular. I didn’t see any overly-long subroutines. There are plenty of comments that look like they would mean something to somebody who understands the domain. I didn’t notice any routines with excessive cyclomatic complexity. > > It’s been 18 years since I worked with FORTRAN, so I’m not competent to thoroughly evaluate the code, but it certainly passes my quick look. > I wish the Java I’m working on now was as well written. What I conclude of all this is that you may have a good point, V&V is important; however, it is clear that it is ignorant to claim no testing has been done, as there are other ways to test. V&V is there to check the coding, not the science involved. It is clear to me cost was one big reason why it was not implemented yet in many climate models; however, it is clear also that organizations like NASA have been involved on it and it is beginning to show in their climate research. [http://www.nasa.gov/centers/ivv/research/research\_infusion\_technologies.html](http://www.nasa.gov/centers/ivv/research/research_infusion_technologies.html) > [@](#): > > Reactis automates the generation of test data from, and validation of, Simulink and Stateflow\* models. Reactis will help cut both the costs and time associated with model-based verification and development tasks, such as model validation, unit and system testing, and model debugging and revision. By automating testing and validation, Reactis enables a quicker, more thorough analysis of models and systems. - Those items do appear in climate models. And yet, since V&V deals with the quality of the coding I have to conclude that applying it at large in climate models will change the results very little. For as it has been pointed before, computer power is increasing for everyone, even skeptics. Seeing that climate models have been here for decades it is important to notice that that critics would already have shown not only the flaws in past models that were declared good by climate scientists and physisists, but also show that the corrected models have definitive contradictory evidence. Instead we recently got errors that, as much as the extreme right media tried to puff up as a way to discredit the research, turned to still confirm the overall findings of today’s climate researchers. ---
**Author:** ![brazil84](https://avatars.discourse-cdn.com/v4/letter/b/8491ac/32.png) [@brazil84](https://boards.straightdope.com/u/brazil84)\ **Post date:** [September 6, 2007, 10:35pm UTC](https://boards.straightdope.com/t/how-many-people-take-global-warming-totally-on-faith/416356/564 "2007-09-06T22:35:52Z")
> [@](#): > > you are trying to change the rules by which the science is played. Actually I think it’s the warmers who are trying to change the rules by replacing bedrock concepts like prediction, disclosure, and reproducibility with _vaticinium ex eventu_, proprietary software, and a “trust us, we’re scientists” attitude. ---
**Author:** ![jshore](https://avatars.discourse-cdn.com/v4/letter/j/b5e925/32.png) [@jshore](https://boards.straightdope.com/u/jshore)\ **Post date:** [September 6, 2007, 11:19pm UTC](https://boards.straightdope.com/t/how-many-people-take-global-warming-totally-on-faith/416356/565 "2007-09-06T23:19:57Z")
[QUOTE=intention] The citations I sent were not about “the idea of sensitive dependence to initial conditions, chaos, turbulence, and such”, so it is not clear why you are discussing that question. Please read the citations. [/quote] In fact, I did and the citation you wanted me to read ([here](http://www.climateaudit.org/?p=1124)) starts out with the quote: “If a time dependent equation has a solution that grows exponentially in time, then that solution is very sensitive to errors in the initial condition, i.e., any error in the initial condition will cause an exponential deviation in time from the true solution.” Perhaps you meant to link a different cite? > [@](#): > > This is nonsense and you know it. Climate models and the discussion of climate are about anomalies, not absolute temperatures. If you have a model that can tell me if the anomaly for next March will be larger than the anomaly for next September, let me know. Until then, give this argument up, it means nothing. Well, then take the difference between the March temperature and the average temperature and call it a seasonal anomaly. My point is simply that predicting weather and climate are two different things and I illustrated this using the example of a climate prediction based on the seasonal cycle. > [@](#): > > Contrary to your claim, validation and verification of models and simulations is well known, applied, and studied in the physical sciences. It even has its own name, “M&S V&V”. NASA applies it to, inter alia, such physical models as those dealing with spatial response of temperatures at the edges of surface discontinuities, positional accuracy, thermal radiometry, atmospheric radiometry, full-sky imaging, hyperspectral radiometry, and bidirectional reflectance. [Here](http://www.acims.arizona.edu/EVENTS/MSV&V_ACIMS.pdf) is a paper on “Implications of M&S Foundations for the V&V of Large Scale Complex Simulation Models” … I could give you many more examples of the use of V&V for models of physical systems, or you could find them yourself. Basically, what **GIGObuster** said (and most especially, the quotes from Tim McDermott who frames the issue much better than I have). I will admit that my original statement was too sweeping. And, yes, there do seem to be some examples in the physical sciences where the decision has been made to jump through these hoops. And, perhaps for the particular application, it was the right decision. However, I contend that this sort of formal process is still most useful for certain applications where the scope of the mission that the code is supposed to perform is narrowly defined and quite easily testable. It is not well-suited for science at the forefront of our knowledge where more creative testing and less formalism is required. As you yourself noted, climate modeling is very complex and noone is contending that climate models are anything but approximations to reality. The best way for scientists to determine the extent to which they think their models are getting certain features right is to leave the testing in their hands rather than put it into the hands of a bureaucracy. And to encourage scientists to do lots of intercomparisons among the models and such. I think it might be useful for funding agencies to consider how best to facilitate scientists testing and intercomparing models. However, I think it is counterproductive for them and others to dictate upon them a formalism and bureaucracy that is ill-suited for the task. > [@](#): > > Say what? I claim models are tuned to reproduce the past climate record. Are you seriously claiming that the models are not so tuned? Heck, even Gavin Schmidt admits that they are tuned. Or perhaps you think they are tuned so as _ **not** _ to reproduce the past record? > > w. Okay…I think I need to clarify what I (and presumably Gavin) are saying here. I am not claiming that there is no tuning of parameters whatsoever. I have said before that there is. However, I am saying that this tuning is not to reproduce the past global temperature history but rather to get some basic things right. One of those basic things is, of course, having the system be in radiative balance when it reproduces a reasonable climatology and in the absence of variations in external forcings. It is obvious that if you are not getting the right radiative effects down to very high precision (as you have correctly noted they are not) then you will get drift in the climate because of this lack of radiative balance. So, yes, it is not surprising that they have to tune some parameter to get that. However, my contention (well, not just mine, but the climate science community who has studied this) is that there is no alternate way they can find to do this tuning that would reproduce the past record in the absence of including anthropogenic forcings. In particular, if you just use the known natural forcings, you are not going to be able to see the sort of temperature rise that we have seen over the past ~35 years because the natural forcings simply do not have the right time dependence to produce this. It is only by including anthropogenic forcings that you are able to produce this. So, if one believes it is not due to anthropogenic effects, one has to come up with another natural forcing mechanism that has been missed by the scientists and has the right time dependence…and one also has to find a way that the climate model has a significantly lower sensitivity to the known forcing due to greenhouse gases. Admittedly, in an ideal world, one could calculate everything from first principles and could do so with such precision that all the absolute errors were well less than the forcings of interest. However, science at the forefront of our knowledge seldom exists in such an ideal world…It exists in the real world where nature challenges us to work harder and we have to assemble a large array of evidence because no one test or model is ever alone going to be definitive. Welcome to the real world of science. ---
**Author:** ![jshore](https://avatars.discourse-cdn.com/v4/letter/j/b5e925/32.png) [@jshore](https://boards.straightdope.com/u/jshore)\ **Post date:** [September 6, 2007, 11:23pm UTC](https://boards.straightdope.com/t/how-many-people-take-global-warming-totally-on-faith/416356/566 "2007-09-06T23:23:47Z")
[QUOTE=brazil84] Actually I think it’s the warmers who are trying to change the rules by replacing bedrock concepts like prediction, disclosure, and reproducibility with _vaticinium ex eventu_, proprietary software, and a “trust us, we’re scientists” attitude. [/QUOTE] Well, I would say that the National Academy of Sciences (or the Royal Society or …) might be in a better position to judge such things than, say, some non-scientist or amateur scientist on a messageboard. Why do you think that they don’t seem to agree with you? ---
**Author:** ![intention](https://avatars.discourse-cdn.com/v4/letter/i/e95f7d/32.png) [@intention](https://boards.straightdope.com/u/intention)\ **Post date:** [September 6, 2007, 11:26pm UTC](https://boards.straightdope.com/t/how-many-people-take-global-warming-totally-on-faith/416356/567 "2007-09-06T23:26:49Z")
GIGObuster, thanks for your post. You seem to be saying that V&V costs to much to do. I wasn’t very reassured by your quote from Tim McDermott, who said: > [@](#): > > This is because V&V can come close to doubling the cost of a project. and > [@](#): > > By way of reference, in the 7 years I spent at NASA Goddard, I never heard of a project, even for flight software, that used real IV&V (Independent V&V). They called using a separate test team IV&V, and calculated that it added 5% to 15% to the cost of a project. So which is it … 5%-15%, or 100%? w. ---
**Author:** ![brazil84](https://avatars.discourse-cdn.com/v4/letter/b/8491ac/32.png) [@brazil84](https://boards.straightdope.com/u/brazil84)\ **Post date:** [September 6, 2007, 11:29pm UTC](https://boards.straightdope.com/t/how-many-people-take-global-warming-totally-on-faith/416356/568 "2007-09-06T23:29:58Z")
[QUOTE=jshore] Well, I would say that the National Academy of Sciences (or the Royal Society or …) might be in a better position to judge such things than, say, some non-scientist or amateur scientist on a messageboard. Why do you think that they don’t seem to agree with you? [/QUOTE] First things first: Please quote the National Academy of Science’s statements that contradict my point. ---
**Author:** ![jshore](https://avatars.discourse-cdn.com/v4/letter/j/b5e925/32.png) [@jshore](https://boards.straightdope.com/u/jshore)\ **Post date:** [September 7, 2007, 2:36am UTC](https://boards.straightdope.com/t/how-many-people-take-global-warming-totally-on-faith/416356/569 "2007-09-07T02:36:23Z")
[QUOTE=brazil84] First things first: Please quote the National Academy of Science’s statements that contradict my point. [/QUOTE] Well, you said, > [@](#): > > it’s the warmers who are trying to change the rules by replacing bedrock concepts like prediction, disclosure, and reproducibility with vaticinium ex eventu, proprietary software, and a “trust us, we’re scientists” attitude. One would imagine that if the NAS agreed with you, they would be decrying such a horrible distortion of the scientific process rather than speaking out strongly, in concert with their counterparts in other countries that the science on AGW is certain enough that it is time to take action. ---
**Author:** ![intention](https://avatars.discourse-cdn.com/v4/letter/i/e95f7d/32.png) [@intention](https://boards.straightdope.com/u/intention)\ **Post date:** [September 7, 2007, 6:00am UTC](https://boards.straightdope.com/t/how-many-people-take-global-warming-totally-on-faith/416356/570 "2007-09-07T06:00:52Z")
[QUOTE=jshore] > [@intention](#): > > intention > The citations I sent were not about “the idea of sensitive dependence to initial conditions, chaos, turbulence, and such”, so it is not clear why you are discussing that question. Please read the citations. In fact, I did and the citation you wanted me to read ([here](http://www.climateaudit.org/?p=1124)) starts out with the quote: “If a time dependent equation has a solution that grows exponentially in time, then that solution is very sensitive to errors in the initial condition, i.e., any error in the initial condition will cause an exponential deviation in time from the true solution.” Perhaps you meant to link a different cite? [/quote] My apologies for my lack of clarity. We were discussing the question of whether increasing the resolution would improve the forecasts. The citations discuss the difficulty, perhaps insoluble, of the way that the computer models address the problem of “the idea of sensitive dependence to initial conditions, chaos, turbulence, and such” that you mention. They were not about the problem, which is what you had were referring to. They were about how the solution used by the modelers (an artificially increased turbulence) does not work, as evidenced by the fact that when you increase the resolution, the “solution” no longer works. [QUOTE=jshore] Well, then take the difference between the March temperature and the average temperature and call it a seasonal anomaly. My point is simply that predicting weather and climate are two different things and I illustrated this using the example of a climate prediction based on the seasonal cycle. [/quote] Let me see if I can make it clear why your argument is meaningless. Your argument is > [@jshore](#): > > Intuitively, you know that while you would never trust me to predict what the weather will be 5 months from now here in Rochester, you would trust the climate prediction that the month of February will have a considerably lower average temperature than the current month of September. Temperature is cyclical on two scales, daily and annual. Replacing your annual cycle with the daily cycle, we can say: _“Intuitively, you know that while you would never trust me to predict what the weather will be 5 months from now here in Rochester, you would trust the prediction that 2AM have a considerably lower average temperature than 3PM.”_ Yes, but … so what? We’re not trying to predict whether afternoon is warmer than night time, or whether September is warmer than February. The fact that we can say that in seven years nighttime will still be colder than the afternoon, and September will still be warmer than February, proves nothing about predicting either the climate or the weather. [QUOTE=jshore] [QUOTE=intention] Contrary to your claim, validation and verification of models and simulations is well known, applied, and studied in the physical sciences. It even has its own name, “M&S V&V”. NASA applies it to, inter alia, such physical models as those dealing with spatial response of temperatures at the edges of surface discontinuities, positional accuracy, thermal radiometry, atmospheric radiometry, full-sky imaging, hyperspectral radiometry, and bidirectional reflectance. Here is a paper on “Implications of M&S Foundations for the V&V of Large Scale Complex Simulation Models” … I could give you many more examples of the use of V&V for models of physical systems, or you could find them yourself. [/quote] Basically, what **GIGObuster** said (and most especially, the quotes from Tim McDermott who frames the issue much better than I have). I will admit that my original statement was too sweeping. And, yes, there do seem to be some examples in the physical sciences where the decision has been made to jump through these hoops. And, perhaps for the particular application, it was the right decision. However, I contend that this sort of formal process is still most useful for certain applications where the scope of the mission that the code is supposed to perform is narrowly defined and quite easily testable. It is not well-suited for science at the forefront of our knowledge where more creative testing and less formalism is required. [/quote] jshore, V&V is designed to make sure the code is correct, the input data is correct, and the various algorithms actually work. This is not an undue, onerous task, it’s not rocket science, it’s a necessity. Having correct code and data is not an option, it is a requirement, _even in the simplest applications_, as James Hansen recently found out to his cost. [QUOTE=jshore] As you yourself noted, climate modeling is very complex and noone is contending that climate models are anything but approximations to reality. The best way for scientists to determine the extent to which they think their models are getting certain features right is to leave the testing in their hands rather than put it into the hands of a bureaucracy. And to encourage scientists to do lots of intercomparisons among the models and such. I think it might be useful for funding agencies to consider how best to facilitate scientists testing and intercomparing models. However, I think it is counterproductive for them and others to dictate upon them a formalism and bureaucracy that is ill-suited for the task. [/quote] You seem to think that the best person to put in charge of the chicken house is the fox … in other words, you think the best people to check and verify the calculations are the scientists that did the calculations. But why should the person who made the error be the best person to find the error, _when they didn’t notice the error when they made it?_ In fact, the person who originally did the work is the worst person to check the work. That’s why newspapers have proof readers, because it’s too easy for the original author to overlook the same error twice. And as the recent experience with Hansen showed, your recommended process (let the scientists do it) has proven inadequate to find even the simplest errors. In addition, Hansen has repeatedly refused to reveal the code that he uses for the simplest of tasks, that of creating the global temperature average. Why not reveal it? While you might trust a very opinionated man who won’t show his code to verify that same code … me, I don’t. Nor is he unique. I’ve been unable to get Phil Jones’ HadCRUT data, even with a Freedom of Information request. Mann, and Osborne, and Briffa, have all refused to show their data. Thompson won’t reveal his glacier core numbers, the list goes on and on. A six year old child might trust those folks to make sure their own code is correct, but here in the real world of science, reasonable people expect more than that. In addition, there is an open question as to whether the various approximations used in the models actually converge to the right answer. This question is discussed in the citations I gave above. Perhaps you trust that the scientists running the models have verified that their code converges. I don’t. In the main, they don’t even seem to have acknowledged the problem. Finally, these models are huge, and each one has been worked on by a large number of programmers over a number of years. As a programmer yourself, I’m sure you know that the odds that there are no bugs in the program is vanishingly small. jshore, if this was just some random model that didn’t have much riding on it, I’d be the last man to ask for V&V and SQA … but it’s not. You are asking us to bet billions of dollars on the model results, but you are extremely unwilling to even consider subjecting the models to the normal, usual testing that mission critical software receives. Instead, you ask us to take it on trust … Why your reticence? Why not test the models, just as we routinely test other models of equal importance? As far as I’m concerned, with billions of dollars on the line, the need to test the models is a given. If you think they should not be tested, you need to justify that in the strongest possible terms. Saying ‘It’s not usually done’ doesn’t cut it when gigabucks are at stake. [QUOTE=jshore] Okay…I think I need to clarify what I (and presumably Gavin) are saying here. I am not claiming that there is no tuning of parameters whatsoever. I have said before that there is. However, I am saying that this tuning is not to reproduce the past global temperature history but rather to get some basic things right. One of those basic things is, of course, having the system be in radiative balance when it reproduces a reasonable climatology and in the absence of variations in external forcings. It is obvious that if you are not getting the right radiative effects down to very high precision (as you have correctly noted they are not) then you will get drift in the climate because of this lack of radiative balance. So, yes, it is not surprising that they have to tune some parameter to get that. However, my contention (well, not just mine, but the climate science community who has studied this) is that there is no alternate way they can find to do this tuning that would reproduce the past record in the absence of including anthropogenic forcings. In particular, if you just use the known natural forcings, you are not going to be able to see the sort of temperature rise that we have seen over the past ~35 years because the natural forcings simply do not have the right time dependence to produce this. It is only by including anthropogenic forcings that you are able to produce this. So, if one believes it is not due to anthropogenic effects, one has to come up with another natural forcing mechanism that has been missed by the scientists and has the right time dependence…and one also has to find a way that the climate model has a significantly lower sensitivity to the known forcing due to greenhouse gases. Admittedly, in an ideal world, one could calculate everything from first principles and could do so with such precision that all the absolute errors were well less than the forcings of interest. However, science at the forefront of our knowledge seldom exists in such an ideal world…It exists in the real world where nature challenges us to work harder and we have to assemble a large array of evidence because no one test or model is ever alone going to be definitive. Welcome to the real world of science. [/QUOTE] Welcome to the real world of science? Perhaps you could give us one other example of advocates asking us to spend multi-billions of dollars based on the results of untested, disputed, parameterized, poorly understood models of an immensely complex system … I can’t think of one other example of that. That’s not the real world of science, that’s the fantasy world of modelers. I pointed out elsewhere on SDMB that the GISSE model parameterizes ice-melt pools (liquid water on the surface of the ice) by restricting them to an exact six-month period. This, of course, is not how the world works – in fact, ice-melt pools are not constrained by the calendar. Now, why did they put in that parameterization? To “get some basic things right”? No, because ice-melt pools by the calendar is not right. They put it in to make the model more accurately reflect reality, as exemplified by the historical record. You and Gavin say that there is no way to get the models to fit the historical record because they are too complex. But the same process used with the ice-melt pools has been followed from the beginning, starting with the simplest of models. A new forcing is added, and the parameters are adjusted to make the new output fit the record. Then another forcing is added, and the parameters are readjusted. Another example. The dip in temperatures from ~ 1945-1957 is explained in the models as being from low-level, tropospheric aerosols. We don’t know, however, what the combination of the direct and indirect effect of aerosols is, the level of understanding of this is very low. So the aerosols are added to the model, and a value is chosen for the aerosol effect. What value is chosen? Yes, you guessed it, the value that makes the aerosols balance out the CO2 and reproduce the historical record. All this is done despite the facts that: 1. We don’t know the size of the aerosol effects from actual observations – the estimates of the size of the effects comes from the very climate models in question. 2. The majority of the aerosols are in the Northern Hemisphere, but the majority of the 1945-1975 cooling did not occur there. 3. The model estimates for the regions where the aerosols have had the major effects shows no relationship to the actual temperature changes in those regions. 4. A recent study shows that low level aerosols in Asia result in warming, not cooling. 5. Given that the majority of the aerosols are in the Northern Hemisphere, we’d expect the Northern Hemisphere land to warm less than the Southern Hemisphere land. This has not happened. 6. We have very poor data for the historical levels of aerosols, and there is evidence that the particular aerosol levels chosen by the modelers may not represent the true changes in aerosols. So the aerosol explanation simply doesn’t hold water. It assumes facts not in evidence, contradicts facts in evidence, and requires a careful selection of parameters to make it work. Yes, the models match the past … but whether you like it or not, it is because they are tuned to do so. w. ---
**Author:** ![brazil84](https://avatars.discourse-cdn.com/v4/letter/b/8491ac/32.png) [@brazil84](https://boards.straightdope.com/u/brazil84)\ **Post date:** [September 7, 2007, 7:52am UTC](https://boards.straightdope.com/t/how-many-people-take-global-warming-totally-on-faith/416356/571 "2007-09-07T07:52:26Z")
[QUOTE=jshore] One would imagine that if the NAS agreed with you, they would be decrying such a horrible distortion of the scientific process rather than speaking out strongly, in concert with their counterparts in other countries that the science on AGW is certain enough that it is time to take action. [/QUOTE] A more likely possibility is that the NAS would take the position that the deviations from the best practices are justified or excusable. But that’s not what you seem to be claiming. You seem to be claiming that according to the NAS, the science supporting AGW does not deviate from the normal best practices of science in general. Please quote the NAS to back up your claim. Also, why are you ignoring my earlier question?: Why do you think that a climate modeler should disclose the results of all tests, whether good or bad? What’s wrong with just disclosing good results and throwing the bad results down the memory hole? ---
**Author:** ![GIGObuster](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/gigobuster/32/421_2.png) [@GIGObuster](https://boards.straightdope.com/u/GIGObuster)\ **Post date:** [September 7, 2007, 10:32am UTC](https://boards.straightdope.com/t/how-many-people-take-global-warming-totally-on-faith/416356/572 "2007-09-07T10:32:38Z")
[QUOTE=intention] Welcome to the real world of science? Perhaps you could give us one other example of advocates asking us to spend multi-billions of dollars based on the results of untested, disputed, parameterized, poorly understood models of an immensely complex system … I can’t think of one other example of that. That’s not the real world of science, that’s the fantasy world of modelers. [/QUOTE] Care to retract this generalization? I can call it when \*\*jshore \*\* does it, and here you really lose any respect anyone could have for your position. Since my searches also have found evidence that climate models have been tested (and not just with historical data) I have to conclude once again that you are discussing in bad faith. [QUOTE=intention] jshore, V&V is designed to make sure the code is correct, the input data is correct, and the various algorithms actually work. This is not an undue, onerous task, it’s not rocket science, [/quote] Actually, as you mentioned before, it is. 🙂 ---
**Author:** ![brazil84](https://avatars.discourse-cdn.com/v4/letter/b/8491ac/32.png) [@brazil84](https://boards.straightdope.com/u/brazil84)\ **Post date:** [September 7, 2007, 11:58am UTC](https://boards.straightdope.com/t/how-many-people-take-global-warming-totally-on-faith/416356/573 "2007-09-07T11:58:24Z")
I’d love to see evidence that AGW has been really put to the test. ---
**Author:** ![jshore](https://avatars.discourse-cdn.com/v4/letter/j/b5e925/32.png) [@jshore](https://boards.straightdope.com/u/jshore)\ **Post date:** [September 7, 2007, 12:03pm UTC](https://boards.straightdope.com/t/how-many-people-take-global-warming-totally-on-faith/416356/574 "2007-09-07T12:03:50Z")
[QUOTE=intention] 1. The majority of the aerosols are in the Northern Hemisphere, but the majority of the 1945-1975 cooling did not occur there. [/QUOTE] To me, [it looks quite clearly like in fact it did](http://data.giss.nasa.gov/gistemp/graphs/Fig.A3.lrg.gif). (See also [here](http://data.giss.nasa.gov/gistemp/graphs/Fig.B.lrg.gif).) ---
**Author:** ![jshore](https://avatars.discourse-cdn.com/v4/letter/j/b5e925/32.png) [@jshore](https://boards.straightdope.com/u/jshore)\ **Post date:** [September 7, 2007, 12:09pm UTC](https://boards.straightdope.com/t/how-many-people-take-global-warming-totally-on-faith/416356/575 "2007-09-07T12:09:29Z")
[QUOTE=brazil84] A more likely possibility is that the NAS would take the position that the deviations from the best practices are justified or excusable. But that’s not what you seem to be claiming. You seem to be claiming that according to the NAS, the science supporting AGW does not deviate from the normal best practices of science in general. Please quote the NAS to back up your claim. [/QUOTE] Well, I suppose that your explanation is possible…but then why would the NAS still feel justified in saying what they said? At the very least, they must think these deviations are not very relevant. However, there is no evidence that such deviations have occurred except for your claims. At any rate, if you are trying to argue that the NAS might think that your opinion is correct but completely and utterly irrelevant then I guess I would not dispute that as a conceivable interpretation. ---
**Author:** ![intention](https://avatars.discourse-cdn.com/v4/letter/i/e95f7d/32.png) [@intention](https://boards.straightdope.com/u/intention)\ **Post date:** [September 7, 2007, 12:27pm UTC](https://boards.straightdope.com/t/how-many-people-take-global-warming-totally-on-faith/416356/576 "2007-09-07T12:27:17Z")
[QUOTE=jshore] To me, [it looks quite clearly like in fact it did](http://data.giss.nasa.gov/gistemp/graphs/Fig.A3.lrg.gif). (See also [here](http://data.giss.nasa.gov/gistemp/graphs/Fig.B.lrg.gif).) [/QUOTE] I don’t trust James Hansen’s figures, for the obvious reasons. Here is the [HadCRUT data.](http://cdiac.ornl.gov/trends/temp/jonescru/graphics/nhshgl.jpg) It shows the Southern Hemisphere cooling more than the Northern. The myriad differences between HadCRUT and GISS, which are the premium global temperature datasets, and which are both based on the same raw data, should give you a clue about the relative maturity of climate science. We don’t even have an established baseline to work from. When you claim that the models reproduce the historical record … exactly which record are you talking about? Consensus? How can you say we have a consensus? We don’t even have scientific consensus about the past temperature, to say nothing about the future temperature. w. ---
**Author:** ![brazil84](https://avatars.discourse-cdn.com/v4/letter/b/8491ac/32.png) [@brazil84](https://boards.straightdope.com/u/brazil84)\ **Post date:** [September 7, 2007, 12:33pm UTC](https://boards.straightdope.com/t/how-many-people-take-global-warming-totally-on-faith/416356/577 "2007-09-07T12:33:15Z")
[QUOTE=jshore] Well, I suppose that your explanation is possible…but then why would the NAS still feel justified in saying what they said? At the very least, they must think these deviations are not very relevant. [/quote] It’s not for me to speculate. I pointed out that it was actually “your side” that is trying to change the normal rules of science. You claim the NAS disagrees with me? Fine, quote some actual language that contradicts my point. I’m not interested in your guesswork. > [@](#): > > However, there is no evidence that such deviations have occurred except for your claims. There is plenty of evidence in this very thread. Evidence that climate models are tested on historical (as opposed to future) data and evidence that the testers in many cases refuse to release their source code and/or data which would allow people to check, verify, and reproduce their results. > [@](#): > > Scientists are appalled that they could be suspected of distorting the evidence to enhance their reputations or funding opportunities. i.e. trust us, we’re scientists. By the way, why do you continue to ignore my earlier question? ---
**Author:** ![GIGObuster](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/gigobuster/32/421_2.png) [@GIGObuster](https://boards.straightdope.com/u/GIGObuster)\ **Post date:** [September 7, 2007, 1:20pm UTC](https://boards.straightdope.com/t/how-many-people-take-global-warming-totally-on-faith/416356/578 "2007-09-07T13:20:22Z")
[QUOTE=brazil84] There is plenty of evidence in this very thread. Evidence that climate models are tested on historical (as opposed to future) data and evidence that the testers in many cases refuse to release their source code and/or data which would allow people to check, verify, and reproduce their results. [/quote] The evidence so far is that the historical tests are only a part of the testing. And the best you could say about testers not releasing source code is one example were already the data was released. And the checking the critics made of that data showed to me that indeed, the critics looked better when they could made the point the tester was not releasing the data. As it is now, I’m still waiting for them to credibly point to what was the big flaw in the original research. (And with computer power getting accessible as it is nowadays, there is really no excuse for this weak counter argument IMO) What this last post of your showed is that you are very selective on the evidence presented. > [@](#): > > i.e. trust us, we’re scientists. So you should trust me more then? 🙂 ---
**Author:** ![brazil84](https://avatars.discourse-cdn.com/v4/letter/b/8491ac/32.png) [@brazil84](https://boards.straightdope.com/u/brazil84)\ **Post date:** [September 7, 2007, 3:04pm UTC](https://boards.straightdope.com/t/how-many-people-take-global-warming-totally-on-faith/416356/579 "2007-09-07T15:04:39Z")
[QUOTE=GIGObuster] The evidence so far is that the historical tests are only a part of the testing. [/quote] Please describe how AGW has been tested, keeping in mind the gold standard of testing a scientific hypothesis, which is to make interesting predictions about future events. > [@](#): > > And the best you could say about testers not releasing source code is one example were already the data was released. How many examples of failure to publicize source code and/or data would it take to convince you? ---
**Author:** ![GIGObuster](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/gigobuster/32/421_2.png) [@GIGObuster](https://boards.straightdope.com/u/GIGObuster)\ **Post date:** [September 7, 2007, 4:31pm UTC](https://boards.straightdope.com/t/how-many-people-take-global-warming-totally-on-faith/416356/580 "2007-09-07T16:31:48Z")
[QUOTE=brazil84] Please describe how AGW has been tested, keeping in mind the gold standard of testing a scientific hypothesis, which is to make interesting predictions about future events. [/quote] Just about all the basis of the New Scientist articles already posted that you did not bother to explain away. > [@](#): > > How many examples of failure to publicize source code and/or data would it take to convince you? As I pointed several times already, you do not bother to bring good examples. And you do not bring any new evidence to discuss about. [Previous page](https://boards.straightdope.com/t/how-many-people-take-global-warming-totally-on-faith/416356.md?page=28) [Next page](https://boards.straightdope.com/t/how-many-people-take-global-warming-totally-on-faith/416356.md?page=30)