Forget for a moment that it’s prayer we’re talking about; the same idea would apply to any procedure, drug, or medical treatment that claims to help—not to produce extraordinary effects, but to make ordinary effects more probable or more effective.
Suppose, for example, you have one group given megadoses of Vitamin Q, and a control group given no Vitamin Q. And in each group, some people recover and some don’t (or, some experience complications and some don’t or whatever). But suppose the recovery rate is 80% in the Vitamin Q group and 30% in the control group. This would be evidence that Vitamin Q has some real, beneficial effect, even though no one individual shows anything out of the ordinary.
Or suppose everybody recovers, but the time for recovery can take anywhere from 10 to 90 days. Within the group given Vitamin Q, some recover in as few as 10 days and some take as long as 90, but the average recovery time is 20 days. In the control group, recovery times also range from 10 to 90 days, but their average is 70 days. Again, no individual case is extraordinary, but the data as a whole suggest a beneficial effect from the Vitamin Q.
You also can’t prove that it’s ever rained without somebody doing a rain dance.
As Voyager said, the defaut assumption is that there is that ritualistic chanting should have no effect on the healing rates of the human body. This study shows that there is no reason to move off of that assumption. Only one side has a burden here.
Luke (quoting Deuteronomy) actually uses a word that’s better translated as “test thoroughly.” Sometimes you see that verse translated as “You will not put God to the test,” i.e. you’re not supposed to ask him to prove himself.
My question is, why ever not? Why is it not kosher to demand proof? If you ask me, that sounds kind of weaselly on God’s part.
I think Apos pretty much hit the nail on the head. The experiment is ill-defined. In strictly anlytical terms the study is very narrow, in the sense that under the conditions and assumptions of the study, prayer has been shown to have no effect. The study does not show prayer has no effect, ever. But there is nothing to prove that it does have an effect either, which I guess is Dio’s point. I don’t think many of us who are debating the study are arguing that prayer works,I think we are just ponting out the limits of the conclusion. From a scientific standpoint, since there is no theorized reason why prayer should help (except maybe in a mental health sense), the default supposition should be, “Prayer doesn’t do anything, as far as we know”. Even if the study is narrow, that doesn’t mean the standing “truth” is “Prayer helps”. That hypothesis cannot be the default waiting to be disproved, and has clearly been shown to not be true, under the assumptions of this study.
To make it more like the experiment, we have to then say, “We don’t know if the control group also received Vitamin Q; it may have been in the food they were eating, and more than it was in the food the people who were given Vitamin Q got.”
I am willing to say that it has rained without someone doing a rain dance because there is geological evidence of rain before there were people.
Will everybody own up to the fact they didn’t control the control group? They didn’t tell friends and relatives not to pray because “that would have been unethical” (see the article).
So you can’t draw any conclusions from this study.
How do you know that someone on another planet wasn’t doing a rain dance before there were humans?
Like I said, there is no theoretical reason why prayer should promote physical healing so the assumption is that it does not. This is no more unreasonable than assuming that dancing can’t make it rain.
Except of course that God got pissed off at Moses for not putting him to the test when he smote the rock to produce water.
So it sounds more like “pay no attention to the priest behind the curtain” to me. Not that we should ever expect consistency from religion.
Anyhow, isn’t asking for something putting god to the test, since if you get it you’ll believe more in god? That’s why I distinguished that case from prayers of thanks which can’t be interpreted as putting god to the test.
I think for the null result (seen between the control and one experimental group) to somehow be generated by prayer contamination, you’d have to evoke a mechanism by which uncontrolled prayer rather nicely cancelled the difference one would have seen if the result deviated significantly from the null hypothesis. To assert otherwise is to assume prayer does something to begin with, perhaps only if done in secret, or only if done by the individual, or a host of other possibilities that fine-tune this cancelling. I’m not sure how such assumptions can be justified.
I must admit being baffled by the result showing decreased benefit. To me that says there’s likely some systematic error here, though I rather doubt prayer contamination is the cause.
I follow that. You’re ready to dismiss the claim out of hand.
You’re missing the criticism, though, which is a valid one. It is plausible, and altogether likely, that every person in that study got prayed for. It’s a hell of a lot more common than rain dancing.
The default assumption was prayer doesn’t work before the study. The default assumption afterward is that it does nothing, but not because the study demonstrated anything. They didn’t even figure out how to test the hypothesis cleanly.
Given the number of credulous people in the world today, and the amount of crap that people believe, I think this was a very good study. I just read about a study on chiropractic in England, where it was found not only did chiropractic not heal any diseases, it didn’t even help back pain. I assume the PI didn’t believe in chiropractic. We could use more studies about these “herbal remedies” now on the shelves.
Yeah the study isn’t perfect - none are. But now the nuts can’t claim that science is scared to test their claims of prayer working. And maybe someone will be convinced.
You’re wrong about that. You had a null hypothesis, and a flawed experiment, so you’re claiming the study demonstrated you can’t reject the null. It did no such thing.
There was no reason to reject the null hypthesis before the study, and because the study was done sloppily, it didn’t demonstrate anything.
I never said that the study demonstrated that you can’t reject the null. What I did say (in a garbled way) was that the study showed there was no reason to reject the null hypothesis. I did say this kind of study never can disprove anything.
And I dispute the notion that the experiment was done sloppily - at least for the reason you mention. all experiments are bound by the limits of the practical. I’d assume that the paper, in the Conclusions section, mentions the impossibility of preventing anyone from praying for the control population. I don’t see anyway of getting around this.
You mentioned praying for rats. But a negative conclusion might just mean God doesn’t care about rats. It might mean that prayers for rats can’t be sincere.
The experiment is certainly not conclusive - but it is interesting, and worthwhile.
My point is simply this. Given the excuses that are being made after the fact as to why the experiment doesn’t prove anything about prayer, the people who suggested the study were litterally pissing 2 million dollars down the drain. If they were ready with those objections for any negative result, then the entire study was pointless, and they should have known that from the start. The exact same excuses would invalidate any positive result as well.
The experiment was not sloppy. It was very good: it’s methodology was sound, it was well funded, the assignments were well done. The problem is the underlying element of study: something not only intangible and unmeasurable (making any sort of consistent “dose/effect” measure impossible) but without any underlying mechanism to make the study plausible in the first place (in the abscence of any plausible effects to explain).
We are left with: nothing to explain, and no way or willingness to explain it. In other words, a complete boondoggle.
From a scientific point of view, I’d say this test was a good one.
But from a philosophical viewpoint, I don’t think this question can ever be resolved.
Since we can’t detect the presence/absence of a prayer for or by any one individual, how do we know that someone, somewhere in the world, isn’t praying for the opposite of what someone else is? If someone prays that subject X dies, and someone else prays that he lives, do these cancel each other out? Is a general prayer for “all souls everywhere” as powerful for one subject as a single prayer for that subject only from ten people?
Suppose (just being a Devil’s Advocate here) that 10 anti-prayers (die, sickie!) were said for one group, exactly balancing out the 10 pro-prayers (get well, sickie!) for the same subject. Then we could get exactly the same outcome as this test. Preposterous? Sure. Impossible? No.
I like Bup’s idea that a bunch of mice, who no one knows exist, be the subjects of a prayed-for and not-prayed for group. But even that has a flaw – what if someone, somewhere in the world, is praying, “God, let all of your creatures live a long life.” Whoops – the mice have just been prayed for.
And what if the prayer is said by someone like a Mother Theresa? Would her prayers have more weight than a skid row junkie’s?
If you can’t detect it and can’t measure it, you can’t handle it.
I still say the fact they did see an effect in the group who knew they were being prayed for likely reveals an uncontrolled flaw in the study. The investigators suggest it might be some kind of performance anxiety, but don’t really seem to have a good explanation. My guess is there is a naturalistic explanation, though, and that alone would trash the whole effort.
I suspect it is natural variation. Heads won’t come up exactly 500 times every 1000 coin tosses, either. Do enough studies, and you will find some small differences in some samples. They already said it wasn’t statistically significant.
But imagine what would have happened if the difference went the OTHER way. “Study shows 8% improvement in prayed-for patients. Prayer works!”