Dana Ullman's Homeopathy Studies Thread

I couldn't find anything stating whether or not any of the patients were receiving other treatment. Is this info in there anywhere?

I couldn't find it. The information given is inadequate to confirm that the diagnoses were correct, or that the course of disease was any different from what you'd expect in the absence of treatment. Other benign conditions can have the same appearance on CT. Meningiomas and gliomas can be asymptomatic. The patients could have received other forms of treatment. As is, it doesn't serve to tell us that anything remarkable or unexpected happened to these patients.

The means of diagnosis and follow-up, the length of follow-up, and the types of conditions were so heterogeneous, I suspect that these were simply patients pulled from their case files long after the fact.

Linda
 
As a general point on the various homeopathy papers I've seen recently, my impression is that the statistical methods employed often seem to have been chosen after the fact to try to tease out the teeniest bit of significance from otherwise noisy data. Call me old-fashioned, but one of the first things I remember learning as a neophyte researcher is that the point of stats is to show that what seems at first sight to be significant, ain't. Caution is the watchword, so you use the simplest analysis you can get away with, rather than trying lots of methods until you get the answer you want. Is there an expert statistician around who can comment on the statistical methods used in these papers?
 
Ultracrepidarian, welcome. And you're darn right too. One of their favourite tricks is very simple though. Just do lots and lots of t-tests and sure as God made little green apples, you'll get a couple or so coming out at p<0.05. Then you crow about your "significant" findings. You get all these tests by measuring lots of variables, and doing that at as large a number of time points as seems practical. I'm sure there's one out there that trumpets the "significant" effect of some shaken-up water on childhood diarrhoea because the verum group had one fewer loose stool on one day of the trial (day 3 I think), but not on the preceding or subsequent days. Similarly, diluted-out-of-existence duck liver apparently shortened the duration of influenza significantly - by about an hour and a half! These are significant findings, you know, so they prove homoeopathy can cure these conditions!

That's when they do statistics at all, that is. The Rao et al. paper we were discussing claims to have made sufficient measurements that they should have been able to present a decent statistical treatment of their findings. However, instead they just threw away 80% of the data and presented "typical" (or was that extreme? - the same traces seem to do duty for both) results and just wave vaguely that there are "differences". A particular bugbear of mine, a study of (alleged - the diagnoses were very suspect) Cushing's disease in dogs and horses didn't make any measurements at all - no lab work was done whatsoever, to go with the no control group and the no blinding and the no defined endpoints and the no ethical approval as far as I can see. The researcher (in the loosest possible meaning of the term) just announced at various times after beginning the treatment that the patients seemed a bit better. One way of avoiding criticism of the statistics I suppose.

Rolfe.
 
Now I was scanning down the thread, and I was right. No sign of DullMan anywhere. Dana, why don't you want to debate these papers? I have to say I won't even look at them until he engages in some meaningful dialogue about them, and quoting what other people said doesn't count. You see, I'm not at all convinced he's actually read them, his habit is just to quote an abstract and imagine that we'll all fall at his feet.

But before then, I want Dana's comments on our letter to Homeopathy about the Rao paper. You were full of yourself when it was published, and even before. So, you must be familiar with the content (hah, who am I kidding!). So, do you have no response to our detailed demolition of the data presented? Are you going to ignore this completely, apart from muttering on another forum that you're still right about it being great work?

Come on, first show some scientific chops and assess our critique of Rao (you should be proud, it was at least partly your championing of the paper that stimulated us to examine it closely enough to be able to make such a detailed refutation and submit it for publication). Then we can move on to these other papers - one at a time, please.

You have read them, right?



Right?




Rolfe.
 
Last edited:
I looked at the part involving treatment of the brain cancer patients. It's not blinded, there are no controls, and there isn't any information given that would allow you to guess what we'd expect to see in the absence of the homeopathic treatment. One cannot conclude that homeopathy had any effect based on that information.


I'm afraid I commented (or rather ranted) about that on the other thread, only having access to the abstract (my Acrobat is playing up again). I said just about what you said here, but took much longer to say it. And what do you think was the chance these patients had no conventional treatment if they were really in a cancer centre in Houston?

Sorry, I'm a bad person, but I was trying to make the point that this study didn't fit the criteria either. I'll try to look at the full text tomorrow, but I don't feel like taking much trouble until Dana gives us his feedback on the very first paper he was pimping. Dana, do you agree now that the Roy data (Rao et al.) are spurious, or do you want to tell us in which respects you disagree with the letter we wrote?

Rolfe.
 
I'm afraid I commented (or rather ranted) about that on the other thread, only having access to the abstract (my Acrobat is playing up again). I said just about what you said here, but took much longer to say it. And what do you think was the chance these patients had no conventional treatment if they were really in a cancer centre in Houston?

The patients were in India. Which is why I suspect that they were simply part of one of more homeopath's case files.

Sorry, I'm a bad person, but I was trying to make the point that this study didn't fit the criteria either.

It doesn't. The documentation is too poor. For example, they state that they determined remission by clinical exam and/or serial CT scans. But they only state that one of the patients had serial CT scans, suggesting that in the rest it was based on symptoms. They state that diagnoses were made by radiology and/or histopathology. But I must admit that I don't have any confidence that any more than one tumor was biopsied (in order to make their statement true), and the rest were guesses based on CT (I hope. I also wouldn't be surprised to discover that some diagnoses were based on plain sella turcica radiographs.). I also have no confidence that what a homeopath means by "advanced" is anything similar to what an oncologist means.

Linda
 
Study from the other thread which belongs here....

fls said:
The COPD study at the University of Vienna Hospital and published in CHEST (2005) is one such good piece of research despite what minor critique has been given to it. Although some weak critique was made about the treatment group and the control group were not perfectly comparable, there was not statistical difference between the groups,

However, I previously performed a power analysis, and there was a 70% chance that any significant differences between the groups would be missed. But I already told you this.

Call it weak if you like. It's sufficient to account for any differences in outcome without bringing magic water into it.

Linda

Hey Linda...
Below are some of the differences between the treatment group and the control group. On which data was your power analysis made?

That's a silly question considering that a) I told you the power analysis was made on the comparison of the groups before treatment, and 2) there's no point in doing a power analysis when you find a significant difference (well, there is, but it's not relevant); it's done when you don't find a significant difference.

The amount of tracheal secretions was reduced significantly in group 1 (the homeopathic treatment group) (p < 0.0001). Extubation (the removal of obstructive mucus from the lung with a tube) could be performed significantly earlier in group 1 (p < 0.0001). Similarly, length of stay was significantly shorter in group 1 (4.20 +/- 1.61 days vs 7.68 +/- 3.60 days, p < 0.0001 [mean +/- SD]). This data suggest that potentized (diluted and vigorously shaken) Kali bichromicum 30C may help to decrease the amount of stringy tracheal secretions in COPD patients.

In this study, all patients underwent a trial of extubation, but none (!) of the patients in group 1 had to be reintubated or needed even noninvasive ventilation to improve breathing. The amount of secretions remained stable and did not increase for patients in group 1. Also, the blood gas analyses after extubation remained stable in group 1. In contrast, four patients in group 2 had to be reintubated due to deterioration of blood gas analysis that was caused by tracheal secretions of grade 2 or 3.

All of these differences (nice of you to fail to mention those outcomes that did not show any significant difference) are expected when you have a few patients that have more severe disease and more co-morbid disease in one group but not in the other. And a detailed look at the data presented in the study shows that to be the case, as outlined above by Orac. And your claim that those differences were trivial because the groups were not significantly different at the start, has a 70% chance of being wrong (as per my calculation above).

Linda
 
Bump. C'mon, Dana!

You know, in spite of dissecting all these papers with a jaundiced eye, I still say we're too trusting. Time and time again homoeopaths come out with some statement, and we immediately react with the assumption that at least the facts are true.

Every single time Dana has declared that Darwin was a homoeopathy fan, the inital reaction has been, well, so what? Along the lines of Newton being used to support astrology, or Linus Pauling to support vitamin C. Great men have their little blind spots, so what?

But it wasn't true. Darwin was a thoroughgoing homoeopathy sceptic, as actually reading Dana's sources makes clear. (And the best he can do when this is pointed out is to claim that there is still some Deeper Source Before the Dawn of Reason that proves him right all along). It took Mojo checking up to reveal that one.

Even here's we're not really alert for and prepared for people who lie as constantely and as casually as many of the homoeopaths have been shown to do. And dana takes full advantage of that.

So really, if he says it's daylight outside, at noon, I'd still step out to check.

Rolfe.
 
Darwin was a thoroughgoing homoeopathy sceptic, as actually reading Dana's sources makes clear. (And the best he can do when this is pointed out is to claim that there is still some Deeper Source Before the Dawn of Reason that proves him right all along).


I've invited him (in the appropriate thread, of course) to post references or links for these sources that "adequate homework" would have revealed. No sign of them so far.
 
On t'other thread, Dana Ullman wrote:

I am STILL waiting for someone (!) to speak in defense of the Shang "study." Waiting...waiting...

I'll speak in defense of it. I think your criticisms are incorrect and misguided. The eight studies of homeopathy that were deemed large and of high quality are identified in Lancet 366, p. 2083, in the authors reply to published comments on their original article. You can find a lot more on this here.

Also, you seem to be concerned that the study uses 8 homeopathic trials out of 105 to conclude that homeopathy shows no benefit beyond placebo. This is the whole point of the study: to compare the complete set of homeopathic trials with the ones that are large and of good quality. This allows the authors to strip out the effects of poor study design and bias. In other words, the original 105 papers contain a number of lousy studies from which no useful conclusions can be drawn. When these studies are excluded, homeopathy shows no effect.

You also claim that the study did not test what you call true homeopathy, using individualised remedies. In fact, the study includes 18 such trials, of which 2 were deemed to be large and high quality. The study also divided homeopathic trials into four types (clinical, classical and compex homeopathy, and isopathy). The study found that there was no significant difference in effect between these four types. That is, your classical homeopathy is no more effective than any other type of homeopathy.

More on me blog...
 
He won't answer, Wilsontown. He doesn't want to discuss these papers. He only posts them as a smoke screen to hide the fact that after 200 years of practice, and ever so many poorly or non-documented anecdotes of miracle cures, this supposedly complete system of medicine does not have one single properly-documented case report of a patient suffering from a non-self-limiting condition recovering following homoeopathic treatment alone.

Rolfe.
 
Last edited:
Yes, I don't imagine there will be any useful reply. Still, he did bother to criticise the paper, so it seems worth rebutting the criticisms. Especially as they're criticisms that are quite commonly made of Shang et al.

If only he'd apply the same critical stance to Rao et al. and their memory of water nonsense, or the Chest study he keeps going on about.
 
Indeed. (Nice blog article, by the way.)

There's a particular piece of veterinary homoeopathic drivel which homoeopaths like to boast about. It even got its author in front of the TV cameras as part of the Horizon programme, complete with All Creatures Great and Small musical accompaniment. It's a train wreck in normal scientific terms, but it's an even bigger train wreck in homoeopathic terms. BSM tells me that a homoeopath once rejected a negative-result paper he mentioned because it wasn't individualised and so on. BSM then mildly pointed out that lack of individualism was common practice, and cited Elliott in that respect. So, if the homoeopath was going to reject another paper because of lack of individualisation, then surely Elliott had to be rejected too? The homoeopath replied, no, that was OK because he had obtained a positive result, so obviously whatever he'd done had worked!

Dana, like so many homoeopaths, is at the same game. Anything that has the word "homoeopathy" in it (even if it really isn't homoeopathy) and describes a positive effect is fine, great, a superb piece of work. But as soon as anyone finds anything negative, out come the criticisms that are held to invalidate the paper - criticisms one finds could be levelled with equal justification against his pet studies!

As you so rightly said in the blog piece, there's pretty much no such thing as a perfect study. Everything can be criticised to some extent or another. The question is, are the criticisms of sufficient seriousness to cast doubt on the conclusions of the study? For that, we have to read the paper carefully and critically. Good authors will often actually include in the text mention of what they feel might be imperfections in the study. I've noticed homoeopaths leaping on any tiny little quibble in basically well-conducted studies and announcing that this completely invalidates them - when of course it does not. I remember one negative study which had a small point of concern regarding the blinding - which nevertheless had almost certainly not been broken. Frustrated homoeopaths leaped on this to denounce the study. Er, how might a problem with blinding have caused a potentially positive result to become obscured, tell me that?

The main point of course is that, if even a tenth of what homoeopaths claim anecdotally has any basis in reality, why in 200 years have they not managed to build up a decent body of published evidence to support their claims? Nothing's perfect, but even a decent number of respectably-performed studies without fatal errors, showing an effect, would have been bound to get someone's attention.

But where are they? Nowhere.

Rolfe.
 
I'll speak in defense of it. I think your criticisms are incorrect and misguided.

and they will also be repeated endlessly.

Ullman is doing the same now as they have done for some time with the Linde meta-analysis, which is to continue with a misguided criticism long after the misconception has been cleared up by the authors.

But this is homeopathy and homeopaths never let the facts get in the way of a good story.

Or, to look at it another way, it's homeopathic duckspeak, a reflex response to criticism that exits via the typing fingers when a criticism is detected by the visual system without any tedious detouring via higher thought areas of a normal human brain.

Functional decerebrates can always find work as homeopaths.
 
I think Rolfe called the International Journal of Oncology "second rate".

It is not; ....


Point of information. I called it "crap".

Wonderful what you realise when you see an actual paper as opposed to an abstract. Almost anyone can make an abstract look presentable. Once you see the full text, however, things get a lot clearer.

Or not.

Quite clever to use a respectable-sounding journal title, though, rather than something like the Proceedings af the Society for the Abolition of Cancer, which would ring bells right away.

Then all it needs is some comedian appending the word "prestigious" to it, and they're off!

Rolfe.
 
Bump again for Dana.

Dana, please give us your thoughts on our letter to Homeopathy? Do you still maintain that Roy's work supports your case? If so, why?

Rolfe.
 

ISF - Join now!

Every member here is approved by hand. No bots, no spam, just people who care about evidence and honest debate.

Membership is free!

Create your free account

Back
Top Bottom