What could a professional baseball player claim? Let’s use this. Clearly, pro players are above and beyond “average”. Their history is available for all to see. What could they claim? What test makes sense here? What does “chance” mean here?
Suppose I had precognition. Suppose further the underlying mechanism for this requires the acceptance of the many-worlds theory, and that what I am “actually” doing is examining a subset of possible futures. Suppose that this is even a literal “observation”, i.e., I go into a trance and “see” from a disembodied perspective what may happen. I can’t control which reality manifests itself to me, so I will be wrong. How often will I be wrong? I will do much better than chance at reporting what I see. But whether or not that future comes to pass is, for all intents and purposes, outside my control.
Suppose that, somehow, a brain maintains a set of particles that are entangled with the environment. Over the course of one’s life, one gets “flashes” about what is happening around them, sometimes in dreams, sometimes when waking. The entangled particles only yield sporadic information about the environment they are in, and only reveal information the moment their entanglement fades. Can you see what is happening in distant places? Can you pass a test?
Suppose there are subatomic wormholes that allow the transfer of information. Further suppose that only certain people have the ability to use one end of these wormholes to get information about the other end: it happens when that portion of the brain passes over one, or a group of them, that gives meaningful information. Some may give information about the future, or the past. Others about what is going on right now. Still others about alternate realities that seem like ours but aren’t (let’s call them ‘writers’ :p). What test could they pass?
Let’s face it. I don’t think most people here would think for a moment that John Edwards communicates with the dead. Hell, I doubt people can exhibit any reliable form of ESP, or precognition, or telekenisis, or… But that doesn’t mean 100% accuracy, or anything approaching it, is any more plausible than the effect itself. That is, in absence of any proposed mechanism, there is no reason why any particular mark should be set… including “better than chance,” for non-charlatans, should they, of course, exist. Ask me what criteria should be set for a particle accellerator to work. How the hell should I know? I don’t know how they work, so how could I test that they do?
For the paranormal, the existence of a mechanism, including its a description of how it fuctions, is precisely what is in question. It makes as much sense to ask an ignorant psychic as it does to ask an ignorant skeptic. What does the caveman suggest a good gas mileage is? Etc.
Again: I don’t believe there are any such activities. The BS I spelled out above is hack science fiction and tortured examples. It is only meant to illustrate that one must have a grasp of the phenomenon in question before one can meaningfully test for it, or even decide what a meaningful test is. I have no doubt about the veracity of organic chemistry. That doesn’t mean if you took a mass spec to me tinkering with chemicals you’d see a great synthesis, and if you didn’t know how to make or read the results from a mass spec, then the whole thing, to me, is ridiculous on its face.