|
Welcome to the International Skeptics Forum, where we discuss skepticism, critical thinking, the paranormal and science in a friendly but lively way. You are currently viewing the forum as a guest, which means you are missing out on discussing matters that are of interest to you. Please consider registering so you can gain full use of the forum features and interact with other Members. Registration is simple, fast and free! Click here to register today. |
2nd November 2022, 10:41 AM | #2521 |
Penultimate Amazing
Join Date: Sep 2011
Location: The great American West
Posts: 24,911
|
This is not ostensibly a problem. In the classic Zener card deck, for example, the participants have to choose from a small, well-defined set of drawn figures--five figures, five of each in a deck of 25. Later we can go down the rabbit hole of all the ways one could cheat at Zener guessing. But those aside, it's a valid test. The question is simply whether the guesses statistically fit an expected distribution. Having a finite set of possible outcomes allows us to create that model. Your suggestion does that too.
Having given the example of the Zener deck, I want to shift to a simpler protocol using a different variable. A typical Zener run does have a well-defined statistical basis, but it's a poor example for trying to explain the concept. It's not intuitive. So I'll pick one that is. Consider instead a fair six-sided die. A single trial is a single fair throw of the die. The conductor throws the die, and visualizes the result. Separately, out of sight, the participant tries to guess which number came up on the die. In the single trial, the null hypothesis says the participant should guess correctly 1 out of every six times. Or rather, that the naked probability of a correct guess is p = 1/6. But to test properly in statistics, we need a distribution. So we define a run as 60 trials. The score for that run is the number of times the participant correctly guessed the die number. In theory it will be 10 if the null holds. But in practice, even under the null, the scores from a series of runs will form a normal distribution around 10. Getting to that normal distribution is what's important. We could define a run as 6 (cluster around 1), or as 600 trials (cluster around 100). The former gives us too few degrees of freedom. The distribution will cluster around 1, but since the numbers in the vicinity are 0, 1, and 2, it will be hard to see whether the actual experimental distribution fits the curve or not. 600 (clustered around 100) will let the data vary a lot more smoothly, but would probably be onerous for the participant. So let's say 60. But we need more than one run. We might end up doing a large number of total trials, but they could be, say, 20 runs of 60 trials each. That gives us 20 data points for this participant. Then we try to fit the experimental data to a standard normal distribution with a mean of 10. If the result is p < 0.05 that the correctly parameterized normal curve can still explain the experimental data, then we will have shown a scientifically significant effect.1 We won't have proven ESP. We will simply have shown that there is an effect that we can then study further. Michel isn't even to that stage. With proper controls in place, and a defensible (if simplistic) statistical model, he can't show that there is an effect. Without an effect to explain, it's meaningless to think about any possible cause. _______________________ 1 But in this case the effect we're interested in is a shift in the μ > 10 direction. A shift in the other direction would possibly indicate a problem in the protocol. This is the correct way to diagnose methodology problems by looking at the results, not navel-gazing at subjective "credibility." |
2nd November 2022, 12:06 PM | #2522 |
Scholar
Join Date: Dec 2017
Location: United Kingdom
Posts: 76
|
In statistics the phrases "normal distribution" and "standard normal distribution" have meanings different from your usage - see Wikipedia. Your example(s) would be expected to fit binomial distributions (Bernoulli for n = 1), perhaps approximated by Poisson distributions. [/pedant]
|
2nd November 2022, 01:54 PM | #2523 |
Muse
Join Date: Nov 2004
Location: Santa Barbara, CA
Posts: 686
|
|
2nd November 2022, 02:52 PM | #2524 |
Scholar
Join Date: Dec 2017
Location: United Kingdom
Posts: 76
|
Approximately Wikipedia. But the binomial is easy to use and exact for the null hypothesis. It is very inappropriate to use an approximate distribution to test a null hypothesis when the exact distribution is available.
|
4th November 2022, 10:34 AM | #2525 |
Penultimate Amazing
Join Date: Sep 2011
Location: The great American West
Posts: 24,911
|
Yes, thanks, you are correct: the example must use a discrete distribution. This is not actually an example I invented, but my recollection of an actual statistical model used in telekinesis research. I tried to find the original paper, but it's been too long. I thought it Jeffers' double-slit experiments, but that model is wildly different. The original paper did use a normal distribution, and now I recall that it's because the authors performed a normalizing transformation on the run outcomes that resulted in a real-valued set of means. That's not the case here: the means are countable data.
For a single run we can use the binomial distribution. Here n is somewhat large, but p is not especially small, so we should probably not look to any of the convergent behavior in any of the discrete distributions. If the experiment consisted only of a single run, we could indeed use the binomial test and reason about the statistical significance directly in that fashion. However, the practical design of the original experiment broke it up into multiple runs for various sound methodology reasons. It also had the side-effect of allowing for greater variance, albeit at the cost of requiring a second step to the model for aggregating the results. My set of means is still discrete values, since it is count data. Ideally I should tweak the number of trials in the individual runs to give a suitably large λ at this stage for the Poisson distribution, allowing us greater variance. This is the statistical advantage. But it requires each run to have the same n, which was not the case in the original study I'm (badly) abstracting to make a point. In the original study the normalization step was required because run size was governed by limits on the protocol, apparatus, and participant factors, and needed to vary. By the way, your correction was not pedantic. It was an elementary error that you caught and corrected. Thank you for pointing it out. The lesson is that this is how science works. We put something out there, and our peers correct us. A conscientious scientist doesn't argue with the plainly-evident facts. A conscientious scientist is concerned not with ego or personal reputation, but solely with getting the facts right -- and in this case, getting the protocol and model right. A conscientious scientist doesn't try to argue in vain around the criticism, or make excuses aimed at trying "somehow" to still be right. I was wrong and you were right, and you spoke up. |
4th November 2022, 12:21 PM | #2526 |
Critical Thinker
Join Date: Apr 2005
Posts: 388
|
|
4th November 2022, 12:28 PM | #2527 |
Penultimate Amazing
Join Date: Sep 2011
Location: The great American West
Posts: 24,911
|
|
4th November 2022, 12:30 PM | #2528 |
Muse
Join Date: Nov 2004
Location: Santa Barbara, CA
Posts: 686
|
KAJ is certainly correct, and since it's just as easy to use the binomial why not? And you both provide an example or a constructive scientific discussion that might serve as a useful model to others.
As a note, if the probability of a hit is 25% and we run 60 trials, then according to the binomial we expect that 95% of the time we'll see between 9 and 22 hits. If we used the normal approximation, we would have said between 8.42 and 21.57 hits. |
4th November 2022, 01:13 PM | #2529 |
Scholar
Join Date: Dec 2017
Location: United Kingdom
Posts: 76
|
|
1st December 2022, 02:34 PM | #2530 |
Banned
Join Date: May 2012
Location: Belgium
Posts: 3,398
|
I remind you of my latest test:
which hasn't received a single answer so far. A nearly identical test on Spiritual Forums: https://www.spiritualforums.com/vb/s...d.php?t=145202 has already received 3 interesting answers. Three interesting answers in a similar test (but without the four sentences) have also been given on Psience Quest, a specialized forum devoted to Parapsychology: https://psiencequest.net/forums/thre...er-did-i-write. The first response was given by Ninshub, one of the administrators of this forum, a honor for me. By participating to this test, you can contribute, not only to Science, but also perhaps to Peace in the world, and, as you know, we live in a time when peace is very much needed. |
1st December 2022, 04:08 PM | #2531 |
Philosopher
Join Date: Aug 2002
Location: Denmark
Posts: 7,259
|
There is no science here whatsoever. You have proved this quite clearly with the methodology and the treatment of the results.
|
__________________
Steen -- Jack of all trades - master of none! |
|
1st December 2022, 04:57 PM | #2532 |
Graduate Poster
Join Date: Jun 2016
Location: Behind you
Posts: 1,991
|
|
1st December 2022, 06:20 PM | #2533 |
Banned
Join Date: May 2012
Location: Belgium
Posts: 3,398
|
Possibly, yes.
I remember that one of the admins of this forum (I mean, Psience Quest) has already given a good answer to one of my tests in the past (however, I don't remember if this admin was Ninshub or another one). And you certainly remember the famous answer given by one of the mods of this forum (when it was still called the forum of the James Randi Educational Foundation, and was less radically skeptical). On this forum, arthwollipot, who gave a correct answer to a similar test a few months ago, has also had an administration job on another forum. |
1st December 2022, 06:22 PM | #2534 |
Observer of Phenomena
Pronouns: he/him Join Date: Feb 2005
Location: Ngunnawal Country
Posts: 87,214
|
|
__________________
So take that quantum equation and recalculate the wave by a factor of hoopty doo! The answer is not my problem, it's yours. Three Word Story Wisdom |
|
1st December 2022, 06:40 PM | #2535 |
Banned
Join Date: May 2012
Location: Belgium
Posts: 3,398
|
|
1st December 2022, 07:26 PM | #2536 |
Graduate Poster
Join Date: Jun 2016
Location: Behind you
Posts: 1,991
|
|
1st December 2022, 07:29 PM | #2537 |
Observer of Phenomena
Pronouns: he/him Join Date: Feb 2005
Location: Ngunnawal Country
Posts: 87,214
|
|
__________________
So take that quantum equation and recalculate the wave by a factor of hoopty doo! The answer is not my problem, it's yours. Three Word Story Wisdom |
|
1st December 2022, 09:48 PM | #2538 |
Schrödinger's cat
Join Date: May 2004
Location: Malmesbury, UK
Posts: 16,140
|
I remind you of the reason for that: because it stopped being funny when we realised you could not detect sarcasm.
Only one of your tests was taken remotely seriously here, the one where we persuaded you to use a protocol that met the minimum standards of the scientific method. All the others were jokes. |
__________________
"If you trust in yourself ... and believe in your dreams ... and follow your star ... you'll still get beaten by people who spent their time working hard and learning things" - Terry Pratchett |
|
2nd December 2022, 01:58 AM | #2539 |
Bandaged ice that stampedes inexpensively through a scribbled morning waving necessary ankles
Join Date: Jan 2007
Location: Cair Paravel, according to XKCD
Posts: 34,249
|
|
__________________
There is truth and there are lies. - President Joseph R. Biden, January 20th, 2021 |
|
2nd December 2022, 08:03 AM | #2540 |
Master Poster
Join Date: Jul 2016
Location: Purgatory, PA
Posts: 2,815
|
At this point everyone sees through your "tests". There is nothing to be gained here for you or any of us. I would recommend you stop unless you become willing/capable of an honest test.
|
2nd December 2022, 08:15 AM | #2541 |
Penultimate Amazing
Join Date: Sep 2011
Location: The great American West
Posts: 24,911
|
|
2nd December 2022, 09:10 AM | #2542 |
Mistral, mistral wind...
Join Date: Aug 2013
Location: Embedded and embattled, reporting from Mississippi
Posts: 5,203
|
My guess is that he quite literally can not stop- it's part of his problem- and can not conduct or submit to an honest, objective test, that would be to discard an identity he needs for self-affirmation.
But, what the hell- maybe the horse will learn to sing (cf. The Mote In God's Eye). The horse (of course) being Michel, though I'm sure he'd like to think otherwise. |
__________________
I'm tired of the bombs, tired of the bullets, tired of the crazies on TV; I'm the aviator, a dream's a dream whatever it seems Deep Purple- "The Aviator" Life was a short shelf that came with bookends- Stephen King |
|
6th February 2023, 01:58 AM | #2543 |
Banned
Join Date: May 2012
Location: Belgium
Posts: 3,398
|
|
6th February 2023, 02:33 AM | #2544 |
Penultimate Amazing
Join Date: Aug 2008
Posts: 10,215
|
|
__________________
"I know my brain cannot tell me what to think." - Scorpion "Nebulous means Nebulous" - Adam Hills |
|
6th February 2023, 03:03 AM | #2545 |
Safely Ignored
Join Date: Oct 2009
Posts: 16,394
|
|
13th February 2023, 12:13 AM | #2546 |
Observer of Phenomena
Pronouns: he/him Join Date: Feb 2005
Location: Ngunnawal Country
Posts: 87,214
|
|
__________________
So take that quantum equation and recalculate the wave by a factor of hoopty doo! The answer is not my problem, it's yours. Three Word Story Wisdom |
|
13th February 2023, 12:54 AM | #2547 |
Schrödinger's cat
Join Date: May 2004
Location: Malmesbury, UK
Posts: 16,140
|
Interestingly Michel H does not appear to have visited the forum since making that post a week ago.
|
__________________
"If you trust in yourself ... and believe in your dreams ... and follow your star ... you'll still get beaten by people who spent their time working hard and learning things" - Terry Pratchett |
|
13th February 2023, 02:41 PM | #2548 |
Philosopher
Join Date: Aug 2003
Location: Detroit
Posts: 8,843
|
|
__________________
When I spoke out against the bullies, they called me woke. When I lashed them with a length of chain, they called me sir. |
|
14th February 2023, 02:31 AM | #2549 |
Penultimate Amazing
Join Date: Aug 2008
Posts: 10,215
|
And when he is, he'll be claiming those sarcastic, throwaway jokes as legitimate endorsements of his imaginary powers.
|
__________________
"I know my brain cannot tell me what to think." - Scorpion "Nebulous means Nebulous" - Adam Hills |
|
Thread Tools | |
|
|