Dana Ullman's Homeopathy Studies Thread

Bump and,

I was just reading this,

http://apgaylard.wordpress.com/2007/11/28/the-myth-of-the-secret-eight/

Never mind the issue of whether any homeopathy works, if you take the published data and really believe we are dealing with a therapy that is capable of working in some instances, do we see any evidence of the homs winnowing their pharmacopoeia to separate the good (or at least, not proven to be useless) remedies from those with strong negative evidence? No we do not.

As far as the homs are concerned, every remedy ever dreamt up is effective and does precisely what they claim it to do. It must be wonderful to be right 100% of the time. I wish I could just pull random medical ideas out of my backside and have them work every time. What are Pfizer and GSK playing at, sifting through thousands of 'discovery' compounds? If they just moved over to homeopathy everything would work first time.
 
As far as the homs are concerned, every remedy ever dreamt up is effective and does precisely what they claim it to do. It must be wonderful to be right 100% of the time. I wish I could just pull random medical ideas out of my backside and have them work every time. What are Pfizer and GSK playing at, sifting through thousands of 'discovery' compounds? If they just moved over to homeopathy everything would work first time.

Indeed.

And pace those perfect martinis, where the shadow of the vermouth bottle is allowed briefly to traverse one's glass (surely an example of homeopathy in action....?), you wouldn't even have to go to the trouble of synthesising the compounds themselves. You need merely project a pictorial representation of the structure of the NCE on to a vial of solvent, and Voila!
 
From the other thread:

Paul Wilson’s defense of the Shang “comparison” doesn’t answer several important questions:

Shang self-selected the 110 conventional medical studies. Because Shang and Egger (his co-author) are known antagonists to homeopathy, how can anyone feel confident that they didn’t choose certain conventional trials that showed particularly positive results?

The written report states that the 110 conventional medical studies were chosen using a random number generator, and were chosen without knowledge of the trial results. If you wish to claim that all of the researchers are lying, it becomes a trivial exercise to dismiss the scant support for homeopathy with the same claim. Your other criticisms actually support the veracity of the report. If Shang had gone through and selected out the best conventional medicine trials, then they would have fared better in measures of quality.

Ironically, the 110 conventional medical trials had only 9 that Shang defined to be of a “high quality.” Because Shang found 21 of the 110 homeopathic trials to be a “high quality,” this finding alone suggests that TWICE as many homeopathic studies were designed and conducted to a higher level of scientific investigation. Because Shang choose to generalize his conclusion from 6 conventional trials and 8 homeopathic trials, how come one of Shang’s conclusion wasn’t that homeopathic investigations are substantially more scientifically based?

There are only 110 homeopathy trials, out of thousands, that meet the standard of reasonable quality (controlled, double-blind, randomized). At the time of the study, there were 353,809 medical trials that met that standard. And the only real difference in measures of quality were in the area of “adequate concealment of allocation”; a minor characteristic which wouldn’t be considered substantive. So, how come? Because to do so would have been foolish.

The most glaring error of the Shang analysis (and one that Paul Wilson purposefully chose to ignore, despite the fact that many homeopaths, including myself, have persistently pointed it out) is what was Shang’s results of comparing the 21 high quality homeopathic and the 9 conventional ones? Curious minds want to know. It is also intriguing to know that apgaylard highlighted that he uncovered the “missing 8 trials,” but curiously enough, he too completely ignores ask what were the results of the high quality 21 and 9 trials. The fact that Paul and apgaylard are obviously smart and scientifically-oriented people, their omission seems to be pre-meditated and purposefully secretive (not exactly good science at work).

Shang found that both the 21 homeopathic studies and the 9 conventional studies had substantial (and this time the word is appropriate) bias present. Who cares what the studies show? You cannot draw valid conclusions about the treatment in the presence of substantial bias.

Why did Shang’s definition of large enough trials happen to include Wallach’s trial of 98, but not several larger trials that tested, for example, Oscillococcinum (there have been 3 trials testing this medicine in the treatment of influenza, but he only included one of the these 3 trials). Shang also only selected 1 of the 3 trials that Jacobs conducted on childhood diarrhea, and he didn’t include the pooled data from these 3 trials that have been published in a major pediatric journal…and he didn’t include her high quality study that was published in PEDIATRICS.

Because they were not higher quality studies, and because independent studies should be treated…well…independently.

Just selecting the largest trials isn’t always the best way to evaluate whether homeopathy worked or not. While it is certainly true that sometimes there is one single medicine that can be effective in treating a specific ailment, homeopaths find that this is an exception, not the rule. For instance, Oscillococcinum seems to be effective in the TREATMENT of the flu, but not in its prevention. One of these large trials that was a part of the “magic 8” was one that tested one medicine (potentized thyroid hormone) for weight-loss. The fact that it didn’t work didn’t surprise anyone I know…and the negative result doesn’t disprove anything about the system of homeopathy.

The largest trials were selected because they were the least influenced by bias. If you continue to insist that large trials cannot be done in homeopathy, then I will continue to point out that it is difficult to draw conclusions from your little trials due to bias.

There are many other sharp criticisms that I can give of the Shang article and of Wilson’s defense of it, but the above is simply a good place to start.

Really? But none of your complaints are valid.

The bottomline here is that skeptics of homeopathy tend to be extremely critical of various homeopathic studies, but whenever “junk science” comparison articles, like Shang’s, suggest a negative result to homeopathy, the skeptics seem to forget their high scientific standards

I personally think that skeptics and advocates of homeopathy should join together to sharply condemn the Lancet for publishing this piece of junk science. Skeptics and advocates of homeopathy should join together to encourage high quality scientific investigations.

None of your criticisms stand up to scrutiny, though.
 
Ah yes I see that I posted in the wrong thread. Sorry about that, and thanks for the link shpalman.
 
Actually I have the pdf of the entire article if anyone is interested, but Im not sure how I post a link to that.
 
Last edited:
Actually I have the pdf of the entire article if anyone is interested, but Im not sure how I post a link to that.

Probably best not to, for copyright reasons and all that. (You'll be allowed to post links generally after 15 posts as it says in the PM you get when you join.)
 
Of course, what needs to be remembered at all times is that the pathetic bleating noises emanating from Ullman as he quibbles away at the minutiae of the Shang study is that the mere fact that he has to engage in such barrel-scraping tactics at the absolute margins of the statistical noise means that he has already lost the argument. Homeopathy is supposed to produce deep permanent cures for real diseases. The emperor is prancing about stark bollock naked and making a fuss about whether he is really wearing a transparent thong. Not a pretty sight.
 
Of course, what needs to be remembered at all times is that the pathetic bleating noises emanating from Ullman as he quibbles away at the minutiae of the Shang study is that the mere fact that he has to engage in such barrel-scraping tactics at the absolute margins of the statistical noise means that he has already lost the argument. Homeopathy is supposed to produce deep permanent cures for real diseases. The emperor is prancing about stark bollock naked and making a fuss about whether he is really wearing a transparent thong. Not a pretty sight.

I find it interesting how smoothly Dana went from "Perhaps, SOMEONE can finally tell us which were the 21 homeopathic trials and the 9 allopathic ones. Shang NEVER divulged" to general complaining about how the choice was made, based on apgaylard pointing out that the information has been available for two years.
 
As for studies, the critique of the COPD study is simply too weak to have been published in a peer-review journal.


And yet you seem to be unable to state why it is weak. I don't think anyone is going to rely on your unsupported assertion.

The worst thing that was said about the allergy research by David Reilly et al was that it was "isopathic" rather than homeopathic.


Try looking around the forum a little. There are so few "positive" studies of homoeopathy that the same ones get brought up over and over again. A recent discussion of some of Reilly's work started here, when a homoeopathy proponent's misquoting of the the name of one of the authors failed to prevent it being identified.
 
Last edited:
From the other thread:

Friends,
It is interesting to note that no one on this list chose to acknowledge that the Shang comparison article is a classic example of data dredging.

Data dredging refers to a specific activity. Large amounts of information are collected, then the parameters of interest are chosen based on which fall furthest from the mean. Homeopathic studies are rife with examples - the childhood diarrhea studies where the very specific outcome just happens to coincide with the one point where statistically significant differences were found, the allergic rhinitis studies where the parameter of interest is suddenly changed at the end of the study when it is discovered that the parameter chosen a priori is not statistically significant, etc.

Shang et. al. is not an example of data dredging. The parameters were chosen a priori and the only information collected relates to those parameters. And they were those necessary to minimize chance and bias (randomized, controlled, double-blind), and to make the comparison fair for homeopathy (matched on the basis of disorder and outcome).

You have demonstrated (by failing to provide a single example otherwise) that homeopathy is used in situations where improvement is expected in the absence of effective treatment. And the tendency is to measure 'soft' outcomes. It would be unfair to compare that to medicine trials which achieve differences in hard outcomes in situations that would otherwise be unremitting. It would be like comparing the mortality rate in a group that consists of frail, elderly people (homeopathy) with a group that consists of a general population (medicine). What would be fair is to select out the frail, elderly people from the general population, and to take a sample from them for comparison.

The only way that Shang would have gotten a negative result against homeopathy is by selecting the parameters he established...and because he previously contacted the Lancet and formally told him that his hypothesis was to prove that homeopathic medicines have no effect, he self-selected his parameters and his data to prove it.

That would not be possible as they did not have the information from other parameters available to them. The only information they collected was that based on their pre-selected parameters. Your criticism makes no sense.

Is it interesting that he chose 98, not 100, subjects as his minimim definition for inclusion...just so that he could include a headache trial with a negative result.
At least one of you above acknowledged that s/he wondered why only 1 of the 3 studies with 300+ subjects was included in the trial. Linda asserted that the study in the Journal of Alternative and Complementary Medicine was granted a high rating than the trial in PEDIATRICS. That speaks volumes about the rating system that Shang used.

No it doesn't. It says that while there is a trend for higher quality studies to be published in higher impact journals, there is variation on this characteristic. The rating system that Shang et. al. used is a standard system that is commonly used.

Anyway, because the 3 trials were conducted with the same design, and even though this pooled data was published in a major pediatrics journal, Shang chose to ignore that (whooops).

Not a 'whoops'. To have done so would be unjustifiable. Pooling the data leaves the biases intact - the very biases that Shang et. al. are trying to avoid with their choice of larger trials. It would have been a gross error to include those studies.

I loved Dr. Peter Fisher's response to the Shang work:
http://ecam.oxfordjournals.org/cgi/content/full/3/1/145
His assertion below is worthy:
"Shang et al. (1) state that ‘eight trials of homoeopathic remedies in acute infections of the upper respiratory tract ... indicated a substantial beneficial effect ... sensitivity analyses might suggest that there is robust evidence that the treatment under investigation works. However, the biases that are prevalent in these publications, as shown by our study, might promote the conclusion that the results cannot be trusted’. They state that eight studies is too few to question their conclusion about the whole set of publications. Their conclusion about the whole set, however, was also based on eight studies. Is eight enough for a conclusion or not? Or does it depend on what that conclusion is?"

It depends on what that conclusion is. It's the difference between ruling-in an alternative explanation and ruling-out all other alternative explanations. Homeopathy is without any other evidentiary support. In order to prove that it is effective, all reasonable alternative explanations must be ruled-out. Ruling-in the possibility that the effects are due to placebo means that homeopathy studies fail to provide proof of effectiveness.

And yet, Shang's final conclusion are based 8 homeopathic studies and 6 allopathic ones. Remember...the mission of this article was to compare MATCHED studies. Please someone tell me (us) how the final studies were matched in any way? Was one of the allopathic studies a test of a drug for weight-loss (as was done with the homeopathic studies)? Curious minds want to know...

That is wrong. The purpose was to compare matched groups. Your criticism is irrelevant.

Come on...you folks claim to be good in evaluating data, and you've barely started to provide an adequate review of this comparison article. Go for it...

So far I have demonstrated that all your criticisms are invalid, erroneous or irrelevant. I'm happy to continue going for it. Next?

Linda
 
Linda has already done an excellent job picking apart Dana Ullman's assertions, but I wanted to say one thing about this statement of Peter Fisher's:

"Shang et al. (1) state that ‘eight trials of homoeopathic remedies in acute infections of the upper respiratory tract ... indicated a substantial beneficial effect ... sensitivity analyses might suggest that there is robust evidence that the treatment under investigation works. However, the biases that are prevalent in these publications, as shown by our study, might promote the conclusion that the results cannot be trusted’. They state that eight studies is too few to question their conclusion about the whole set of publications. Their conclusion about the whole set, however, was also based on eight studies. Is eight enough for a conclusion or not? Or does it depend on what that conclusion is?"

Again, this is a misunderstanding of what Shang et al. were doing. With their subset of 8 studies of upper respiratory tract infections, they're showing that 8 studies was too few to look at bias in the studies. That's why they've done the study with 110 matched trials. By stating that 'their conclusion about the whole set, however, was also based on eight studies', Fisher is showing that he doesn't understand what Shang et al. did. Their conclusion was based on comparing the results of the eight best studies with the results from 110 studies. The beneficial effect reported for whole set disappears when you look at the best eight studies. The authors showed that bias could account for the positive reuslts reported in some trials of homeopathy. This is quite a subtle point, to be fair, but Fisher's criticism is not valid.
 
Shhh...Dana doesn't know this thread is here so we can say what we like behind his back.

Mind you, he could learn so much if he could just find his way here through the trackless wastes of the internet guided only, well I say only, by numerous specific invitations, exasperated demands and hyperlinks.

You can lead to woo to water but you can't make him think.

Don't worry, he'll never see that. He's too busy curing AIDS and keeping it secret.
 
What also gets missed in all this is that the comparison of the 8 homeopathy and 6 medicine trials was a small part of the overall analysis. Analyzing the 110 homeopathy and 110 medicine trials shows that both are subject to a similar, significant bias. And that the characteristic with the strongest association with this bias is study size, with all other characteristics (including study quality) attenuating and becoming non-significant when a measure of study size was taken into account. In order to see what effect this bias had on the results they did two things. They did a meta-regression to take the effect of bias into account (which left homeopathy with no treatment effect, but left medicine with a statistically significant treatment effect), and they looked at those studies which would have the least effect from bias (the 8 and 6 studies). In addition, the 110 medicine studies had significantly more heterogeneity than the homeopathy studies. That is, something made the medicine studies show greater variation in the results. This would make sense if in addition to the bias which was present in both studies, the medicine studies were also influenced by a real treatment effect.

So, by several different measure, there was a consistent confirmation of the idea that homeopathic trials do not demonstrate an effect beyond that of placebo and bias, whereas medicine trials do. Homeopaths don't mention the other analyses, though. They attack the only measure which superficially appears the weakest because it is based on a relatively small number of trials. However, even if you reject that analysis, you are still left with the other analyses that lead to the same conclusion.
 
I wonder why Ullman hasn't cited his own paper:"Controlled Clinical Trials Evaluating the Homeopathic Treatment of People with Human Immunodeficiency Virus or Acquired Immune Deficiency Syndrome"?

(THE JOURNAL OF ALTERNATIVE AND COMPLEMENTARY MEDICINE, Volume 9, Number 1, 2003, pp. 133–141)
 
Last edited:
Hey...can't you gave a guy a little break? It is challenging enough being ganged up by dozens of you. I'm glad that someone acknowledged some reality by calling me "Sir Brave Dana." Thanx.

For the record, I didn't previously mention my own AIDS article, nor have I made reference to many many other studies.

Also...you're not remembering: there is a simple reason that I have commented upon the Rao/Roy spectroscopy study, I do not know the answers to this very technical study, though I did correctly acknowledge the high respect that Roy's lab at Penn State University is known for. Whether you agree with him or not, please consider his body of work.

And pleeeeeze, don't expect me or any homeopath to provide free treatment to you as a "test subject." At the best (or worst, depending upon your point of view), you would lose your crediblity if homeopathy was helpful, and no one would consider a single case to be an example of anything.

Here's another one for you all...the walrus was Paul...arsenic poisoning is not a self-limiting condition:
http://ecam.oxfordjournals.org/cgi/content/abstract/2/4/537

Although this is a preliminary trial due to the limited number of people who agreed to be in the placebo group, it is a part of a larger body of environmental toxicology. Hopefully, there are people on this list who have an interest in this subject. Although prevention must obviously be the first priority, we must also consider ways to treat people who have already been exposed. Will homeopathic doses of environmental poisons be one solution to consider?

Just don't look at the clinical results, check out the liver enzymes between the treated group and the control group.
 

ISF - Join now!

Every member here is approved by hand. No bots, no spam, just people who care about evidence and honest debate.

Membership is free!

Create your free account

Back
Top Bottom