The Amazing Test makes me hopeless

datta_godbole

Student
Joined
May 15, 2010
Messages
38
Saw the Connie Sonne's test, TAM 7 on youtube. I was blown away by the elegance of the procedure And disillusioned with myself as a Skeptic.

How could they come up with customized decisive tests for each and every claim? I would certainly like to know, the whole thought process that goes behind it.

Even if I knew, it would be almost useless because i'm not equipped to catch trickery. So, practically I can't convince anyone on any stand.

I've tried reading things on it for simple explanation like null hypothesis, statistically significant, etc., and after a point it becomes too complex.:jaw-dropp [Note: I read it from wikipedia, it was accessible]

Now I know why is it easier to just believe blindly, being the amount of things skeptic should know is just so overwhelming .

Hats off! to The Truly Amazing Randi to pull it off so neatly and on such a scale. Across the countries, through that many trickeries (How can one know every trick? or be confident to catch it) and devise test with all the foresight, without any amendment. Just how?
 
Read through the mammoth MDC threads to see the amount of discussion that goes on in the developing of individual tests. :)
 
Yeah, it's a bit daunting sometimes, the task of catching people in tricks or lies. Thankfully what helps out best with this group is that not every single member needs to know all the tricks. In this case, with so many people working together who have different experiences with different forms and levels of trickery, smoke and mirrors, etc, the foundation can put together these great tests to cover every angle that can be found from the collective knowledge of its members :)
 
I hear you.

The only advice I could offer to ease your concern is to take that burden off your shoulders and put it back on theirs.

The tricks are impossible to catch every time, even when you expect them, so all people making ludicrous claims should have to explain and prove in a deliberate manner.

Nothing that actually works as it's intended has to be presented in a manner that makes it difficult to follow. The process can slowed down, taken apart, and displayed time and time again.

Make them do the same. If they refuse, that's often all the evidence you need to know they're full of it.
 
Right on it.
Well hopefully it won't do your head in too much, it is a very good source to start to understand the amount of negotiations and problems regularly occurring with attempting to test the 'paranormal'.

It seems that the biggest hurdle to overcome is finding out exactly what the claimant is claiming they can do. As shown by the amount of changes in the actual claim when people realise that under proper controlled conditions, what ever it was they thought they could, isn't really going to happen. :)

Have fun.
 
Some things you will find reading the sub forum are that many claimants will
- refuse to specify what they can actually do
- back out before the test
- not practice using the agreed test procedure before the test.
- not get tested by other people, either before or after the test.


Not one person has passed the preliminary test.
 
datta_godbole,

Where do you live? I'm willing to bet that there are skeptics groups located near you. If not, it seems pretty easy to get a meet-up group going. It's almost impossible to mount even a simple test like the Connie Sonne test (simple compared to elaborate tests that Randi has set up for water dowsers or the IIG set up for VisionFromFeeling) without help from lots of people. Some help can come online in a forum like this one, but nothing beats face to face shoulder to shoulder help.

Good luck,
Ward
 
datta_godbole,

Where do you live? I'm willing to bet that there are skeptics groups located near you. If not, it seems pretty easy to get a meet-up group going. It's almost impossible to mount even a simple test like the Connie Sonne test (simple compared to elaborate tests that Randi has set up for water dowsers or the IIG set up for VisionFromFeeling) without help from lots of people. Some help can come online in a forum like this one, but nothing beats face to face shoulder to shoulder help.

Good luck,
Ward

yeah, I just found out that there is. I'll visit there as soon as I can.
 
I like this thread. Interesting OP and helpful replies. A belated "Welcome to the forum", datta godbole. :)
 
I like this thread. Interesting OP and helpful replies. A belated "Welcome to the forum", datta godbole. :)

Thanks Orphia.

rjh01:Some things you will find reading the sub forum are that many claimants will
- refuse to specify what they can actually do
- back out before the test
- not practice using the agreed test procedure before the test.
- not get tested by other people, either before or after the test.


Not one person has passed the preliminary test.

Bang on target, rjh01. Reading applications, alone demands a lot of patience. Its really frustrating to see most of them back out abruptly.
 
I was going through applications, protocols of some were quite obvious. But there were some which I'd like discuss here (as an exercise and for further understanding).
 
Last edited:
<snip>

Bang on target, rjh01. Reading applications, alone demands a lot of patience. Its really frustrating to see most of them back out abruptly.

Thanks. My knowledge is from reading and contributing to the threads while the threads were active. Our role, as I see it is to get them to work out for themselves that they do not have any ability. Then that saves everyone a lot of trouble. Sometimes, like with Connie we fail.
 
I'll start with Eileen Mckusick, only the protocol was written in MDC applications thread. Now I'll try to write in bold what might have been the thought behind it, correct me wherever I am wrong or add the finer points wherever required. For convenient reading, I'll divide into two parts 1. Testing Protocols 2. Materials Required and Stipulation

Testing Protocol

An online questionnaire will be provided through randi.org for individuals experiencing major, chronic pain who are located in Vermont. All individuals who fill out the questionnaire will be informed that, should they be chosen for a test, they will need to provide their own transportation to the testing site. All individuals should provide dates and times that they know they will be unavailable for a test.

All individuals should provide information on all chronic pain they experience, but should have a source of major, chronic pain, which they will identify.

For a decisive answer, the one that Eileen theoretically shouldn't miss.

The questionnaire should include information on height, weight, and gender. All individuals will be informed that, if they are chosen for a test, they will be required to sign a statement in front of JREF staff swearing that they have had no prior contact of any kind with the claimant. All individuals must provide telephone and e-mail contact information.

For data collection, which will be used to find suitable candidates


JREF staff will choose, out of the pool of potential volunteers, seven volunteers to be used in the test. The seven should be of roughly the same height, weight, and gender where possible and should absolutely have seven different sources of major chronic pain.

I don't know for sure what purpose does patients being similar serve. My best guess is that it is nearest to optimum conditions where chance could operate, for eg: Problems with Identical balls in probability

Ms. McKusick will be provided with the questionnaire information, minus personal identifying and contact information, regarding the volunteers. Ms. McKusick will either approve the responses, which will mean that she agrees that from amongst the different types of pain described by each volunteer, she will be able to definitely find the particular sufferer of the major chronic pain described. If Ms. McKusick does not approve the seven volunteers chosen, JREF staff will choose different responders and present those cases to Ms. McKusick. If JREF staff and Ms. McKusick are unable to find seven volunteers suffering from chronic pain to use within the test, the test will be voided and considered an impasse and the Challenge file will be closed until such time that a new protocol can be formulated using a different testing method.
Fair and considerate enough

On the day of testing, the seven volunteers will meet at the testing facility after Ms. McKusick has arrived and been sequestered in an area where the arrival of the volunteers is not visible to her. If Ms. McKusick chances to see the arrival of the volunteers, the test will be considered void and the Challenge file closed with the potential to re-apply one year from the date of the failed test.

Not only that I don't know why she should not see patients arriving, I don't understand why its so important that it could lead to termination of challenge. Please help on this one.

After they have arrived, the volunteers will each be assigned a number by drawing the identical slips of paper numbered 1-7 from the opaque bag. The volunteers will draw the numbers as close to simultaneously as possible, and should not open the slip of paper with their number inside until all seven volunteers have drawn. Each of the volunteers will then be given a full page that has their number written on it in a large, visible font. The digital camera will be used to photograph each of the volunteers with their number. A list will be made, by JREF staff, which will contain the seven numbers and their corresponding chronic pain locations. This list will not enter the testing room and cannot be viewed by the other volunteers until the test is fully complete. The volunteers will be asked not to share their source of chronic pain with one another until the test is fully complete.

Ms. McKusick will be provided with an abbreviated list of the seven volunteers' pain issues. This list will contain only the major, chronic source of pain for each of the volunteers, and will not be numbered.

The volunteers will be held in a separate room from Ms. McKusick, which will also be separate from the testing room.

The testing room will contain a cot or bed with an opaque sheet. On the floor, near the bed, will be a clipboard containing the seven pieces of paper that are numbered at the top in a centered 48pt font. The bed will have a buzzer lying in it, which will be handed to the volunteer being tested upon their entrance. The volunteers will enter and be read by Ms. McKusick each as follows.

The volunteer will enter the testing room with JREF staff or other assigned tester in order; 1-7. They will duct tape their full page number to the side of the cot. They will get into the bed and JREF staff will take a timestamped digital photograph of the volunteer with their number lying in the bed. The volunteer will lie comfortably on the bed, in a pre-arranged position chosen by JREF staff and Ms. McKusick.
Photographs for reference purposes. I don't get emphasis on position, probably they give out some cues, I'd like to know a few hypothetical cases

They will be required to lie still for the duration of their portion of the test, and will not be permitted to speak. If the volunteer feels they are so uncomfortable during the test that they must move or speak, they will be asked to instead press the buzzer at which point JREF staff will escort Ms. McKusick from the room while the volunteer is made more comfortable. If the volunteer moves while still in sight of Ms. McKusick, the test will be halted and re-conducted beginning with the step where the identical slips of paper are chosen from the opaque bag.

This one is obviously for prevention of cues. For rigorousness sake, which absolutely important so that claimant does not manipulate testers, even a single doubtful incident will mean a repeat test.

Ms. McKusick will enter the room and run her tuning forks over the body of the volunteer without speaking to them, and without in any way touching the volunteer or the sheet they are lying under or the bed they are lying on. She will then pick up the clipboard from the floor and write the source of chronic, major pain the volunteer suffers from on the piece of paper corresponding to the number duct taped to the side of the bed.

Ms. McKusick will exit the room.

The volunteer will get up from the bed, assisted by JREF staff, and exit the room.

This process will be repeated for all seven volunteers.

Ms. McKusick may, if she desires and the volunteers desire, speak to the volunteers following the test. However, if any interview between them reveals another source of chronic pain, it will not be counted as a hit, and will not affect the test.

Ms. McKusick's clipboard responses will be compared to the list created by JREF staff in advance of the test.

If five or more of Ms. McKusicks's responses are identical to the list created by JREF staff, the test will be considered a success and Ms. McKusick will proceed to negotiations for the final Challenge test.
I'd certainly like to know the math behind how they arrived at this figure, of course 5:2 seems obvious. But still would like to know if there's any math behind it.


Time Required: 3.5 hours
 
I was going through applications, protocols of some were quite obvious. But there were some which I'd like discuss here (as an exercise and for further understanding).

So pick one.

From my experience in those threads, it's just many people poking holes into the idea that these people can do what they claim they can do.

Very often you will find that the applicants insist on seemingly nonsensical details for for their test - and there you can find a key to what it is they are actually doing.

In other cases all you have to do is come up with a sound protocol that takes into account confirmation biases or potential information leaks. So thorough blinding and tracking of the results is what you need,

I think there have been proposed tests on homoeopathy that were extremely simple and which the claimant could have performed from home, even: They would just get receive packages with randomized samples and would have to decide if the samples were homoeopathic remedies or simply water.
 
While writing the above post I realized that, Materials part was fairly obvious. Stipulations were also obvious enough to prevent cheating but unsaid part is that it would require some conditioned individuals who are adept at catching trickery and resistant to misdirection.
 
I don't know for sure what purpose does patients being similar serve. My best guess is that it is nearest to optimum conditions where chance could operate, for eg: Problems with Identical balls in probability


This is to prevent any "number games": If just one of the applicants is overweight, e.g. and just one is very tall one could match a number of symptoms to their respective conditions:

The overweight person could have problems with their knees, the tall one could have back problems, etc.

Likewise, gender and age: Some ailments are more typical for one gender than the other; some ailments only typically develop at a certain age. (Or there might have been cures developed at a specific time, so that anyone younger than a specific age would have received treatment. Not related to chronic pain, but if you have a 70 year old and a 25 year old, only the 70 year old could have had polio. Likewise, older candidates will be more likely to have suffered strokes, heart attacks or cancer.)
Not only that I don't know why she should not see patients arriving, I don't understand why its so important that it could lead to termination of challenge. Please help on this one.

Because you can diagnose a lot of things from just looking at people and how they walk. Is anyone using a cane? Walking with stiff knees? Holding their heads or hips, pressing a hand in their back, etc?

With only a small number of test subjects, the applicant only has to get certain clues about one or two of them to drastically increase their chances of getting things right.

7 people and 7 forms of chronic pain give you over 5000 different combinations. If somehow you figure out two of them and are left with only 5 people and 5 conditionsa to match, you're down to 120. (720 for 6)

Then, there is the off chance that she might be able to somehow communicate with the candidates or find out other things about them: Suppose one of them arrives by car - not unlikely. She could just inform someone about the number plates and have them investigate who that person is. (Always keep in mind that there is a million dollars at stake and that cheating would be very worthwhile. Never mind what money you'd be able to rake in afterwards. Look at the insane amounts of money psychics are making now. Imagine how much they could ask if Randi had shown that they are the real deal!)
 
Because you can diagnose a lot of things from just looking at people and how they walk. Is anyone using a cane? Walking with stiff knees? Holding their heads or hips, pressing a hand in their back, etc?

With only a small number of test subjects, the applicant only has to get certain clues about one or two of them to drastically increase their chances of getting things right.

7 people and 7 forms of chronic pain give you over 5000 different combinations. If somehow you figure out two of them and are left with only 5 people and 5 conditionsa to match, you're down to 120. (720 for 6)

Then, there is the off chance that she might be able to somehow communicate with the candidates or find out other things about them: Suppose one of them arrives by car - not unlikely. She could just inform someone about the number plates and have them investigate who that person is. (Always keep in mind that there is a million dollars at stake and that cheating would be very worthwhile. Never mind what money you'd be able to rake in afterwards. Look at the insane amounts of money psychics are making now. Imagine how much they could ask if Randi had shown that they are the real deal!)

That had never occurred to me. Thanks.
 
Last edited:
Taking the null hypothesis 'she can't identify the chronic disease by tuning fork', the chances of her getting at least five correct is 42/5040 which is almost 0.0083 and hence is statistically significant (as a rule of thumb p<= 0.05). Just making sure that now with even at least 4 hits her chances are 210/5040 which is 0.04167, would also have sufficed (again I haven't learned maths beyond XII class, so i may be wrong here). Is there any reason for this that i should know?
 
Taking the null hypothesis 'she can't identify the chronic disease by tuning fork', the chances of her getting at least five correct is 42/5040 which is almost 0.0083 and hence is statistically significant (as a rule of thumb p<= 0.05). Just making sure that now with even at least 4 hits her chances are 210/5040 which is 0.04167, would also have sufficed (again I haven't learned maths beyond XII class, so i may be wrong here). Is there any reason for this that i should know?

You seriously think that a chance of 1 in 24 would be sufficient enough to bet a million dollars on? Assuming that is is your million dollars and that you gain nothing but can lose it all?

At those odds, I'd *instantly* apply for the MDC myself. I am allowed to re-take a failed test at yearly intervals. At that rate, I'll be rich before I hit 60...
 

ISF - Join now!

Every member here is approved by hand. No bots, no spam, just people who care about evidence and honest debate.

Membership is free!

Create your free account

Back
Top Bottom