IzzyR and RickJay, I have to say that I agree with almost everything that IzzyR says. Certainly all the statistical stuff. You can’t look at a 99% result and pretend it has no meaning at all. To do so is to lay yourself open to precisely the type of wilful blindness charges that skeptics lay so often at the feet of dowsers etc.
The meaning such a test has is that further testing is warranted. Of course, Randi and others have done such further testing on numerous occasions, and overall nothing significant has ever been found. I think that this knowledge colours Randi’s comments. Which is why I second Philster when I say that to suggest (as a result of this) that Randi is in any sense a fraud for failing to acknowledge the meaning of this result is just way, way, too strong. For several reasons.
Firstly, as Philster says, fraud suggests deliberate misleading. The dowser applicants said what they could do, the test was prepared accordingly, the applicants failed. Absolutely nothing fraudulent in that at all. To throw around allegations of “liar” and “fraud” willy nilly as you-know-who has done against that background of openness is utterly unjustified.
Secondly, there is a very good discussion of the statistical issues involved in the sci.skeptics newsgroup, to which I don’t have access from here (at work). There is a post by an Eric somebody which makes a very good point, which I will attempt to make although his post is probably clearer.
If you come to Randi and say that you can achieve 80-90%, then he sets his test accordingly. Because of the very high rate you say you can achieve Randi sets the test at only 10 iterations.
If you had said in the first place that you could consistently achieve only slightly better than chance (eg that you could achieve 22% on a 10% chance test) then, to draw out a reliable result, Randi would have set the test at 100 or 500 or whatever iterations.
To illustrate, say someone said to you they could flip heads 99% of the time. You might say “OK, 5 bucks says you can’t flip heads 6 times in a row”. You would set the iterations so low because achieving 99% is so hard to do, and very easy to disprove. Say the guy then gets 5 out of 6. You then say, “Sorry you fail, and you haven’t demonstrated jack shit with any degree of conclusivity.” He then turns on you and says “chance would have predicted that I only get 3 heads, but I got 5, so I do have magical powers” and when you fail to recognise this, he says “you are a fraud”.
This is peter’s argument. He has made it several times in the sci.skeptic newsgroup. It is crap because he is taking an isolated test, designed to test a very strong claim (80-90%) and then extrapolating from a strong but not very strong result, to suggest that the person setting the test is a fraud for failing to recognise a result that the test was not designed to test.
The third point (and one where I do object to IzzyR’s position) is that Randi does not anywhere on the quoted page say that the 22% result for water dowsing is not significant or that it debunks all water dowsing or anything of the sort. Randi was doing a test of all sorts of dowsing (water, bronze, gold). The results for the day were 13.5% which means jack shit, and Randi goes on to discuss what really is the most interesting aspect which is the enormous disparity between what dowsers think they can do, and what they can actually do. Nowhere does he say “none of the results have any statistical significance”.
At the absolute worst, you could accuse Randi of a slight omission in failing to acknowledge the strong result for water.
Against that background, IzzyR, to say:
is, of itself, a misrepresentation.
And to say, IzzyR:
is the worst sort of careless mudslinging. Because there are no other instances, and even the one instance you cite is pissweak.
There are plenty of dowsers out there who say they can achieve 80-90% on a pipe test. All they have to do, if their claims are genuine, is approach Randi and say that they can achieve 22% on a 10% test, leaving themselves a huge margin for error[sup]*[/sup]. If/when Randi designs a test with a suitable number of iterations to test that claim, and if/when the dowser passes but Randi fails to pay then he’ll be a fraud.
Alternatively, if Randi was to notice that water dowsers had a pattern (over a long period of testing) of achieving better than chance (but less than their own claims) I would be disappointed in him if he failed to report that.
But there is no evidence of either of these things.
[sup]*[/sup][sub]It’s kinda funny that no dowser has ever done this. I wonder why that could be…[/sub]