Showing posts with label clinical trials. Show all posts
Showing posts with label clinical trials. Show all posts

Thursday, 25 September 2008

Fear and Vaccination in London

Author's note: After my successful foray into soapboxing with the LHC story, I decided to get back up on the box again to trumpet my current hypothesis. Science, the scientific method and scepticism are misunderstood by almost everyone and something has to be done. For more evidence of just how bad things are, check out the ongoing research into the dangers of dihydrogen monoxide. The research itself is satire (sorry to spoil the fun, but I certainly don't want people to think I don't get it). The reactions of the public are the really frighetning part. Anyway, on to the self-righteous ranting.

In 1998 a British-based surgeon, Dr. Andrew Wakefield published a research paper in which he and his team tentatively identified a bowel disorder associated with autism which he coined “autistic enterocolitis” and speculated (a very important word there) that this might be caused by vaccination with the MMR vaccine. Most people are roughly aware of what MMR is. The measles, mumps and rubella triple vaccine. It is a mixture of the three viruses, alive but weakened to the point that they’re not even able to infect infants. They do however cause the recipient’s immune system to generate lots of cells and antibodies that will basically squash the three viruses should they ever be seen again. The need for vaccination against these three diseases is an easy case to make. Measles in adults can cause brain damage. Mumps may cause infertility in males, especially kids. Rubella, if it infects the unborn through the mother, can cause a wide range of birth defects. These complications don’t occur often- but the viruses are so infectious that those rare cases would be a big deal in any highly populated country.

Cause and Effect

So MMR was suggested to have an influence on autistic intestinal inflammation, but there was more. According to Wakefield’s paper, there also appeared to be a connection between the time of administration of MMR to a child and emergence of autism, though that element of the study was retrospective. The paper itself did not rock the boat in the mainstream media, th
ough the scientific community began criticising it immediately. The connection between MMR and autism was not clear, and the study group was small. Just twelve children, all selected because they had autism. At best, that sort of study would represent a starting point for some more solid research. To be meaningful and to make that connection really clear we’d need thousands of examples, and we’d to be able to compare our results with loads of non-autistic kids.

It wasn’t until Wakefield decided to jump outside of the peer-review system that things began to go bad. I discussed in a previous posting how science makes its way into the mainstream media. I even included a flow chart, which I’ll reproduce now. What Dr. Wakefield did was follow the path on the far right. Skipping all external controls and critique he instead decided to talk directly to the press. And what he had to say would cause a sensation. He called for a halt to administration of the MMR vaccine in favour of vaccinating for each of the three diseases separately over an extended time of several years. His stated reasoning was that he believed that MMR might be causing Autism. The initial response in the media was muted. The press release and an accompanying video released by Wakefield’s hospital drew some attention. Wakefield found himself defending his work in letters to the journal that had published his paper, Lancet. In 2000, Wakefield published more papers pushing his MMR hypothesis. Then in 2001, something snapped. Perhaps it was the publicity, the momentum built in the last couple of years. Perhaps Wakefield’s recent high-profile exit from his hospital position (a “mutual decision”) was noticed. Perhaps some of his new research papers pushed the right buttons. Whatever it was, the MMR and autism story hit the mainstream.

What Grows in Darkness

The newspapers went wild, particularly in the UK. By 2002, the stories in the press questioning the safety of MMR numbered in the thousands. Few dealt with the inconvenient peer-reviewed research papers that refuted Wakefield’s findings and the controversy dominated health reporting for several years. Here was a piece of news based on the (very carefully worded) concerns of a single surgeon. But somehow the line (in the Daily Mail at least) became “Scientists Fear MMR Link to Autism”. “One Scientist Cautiously and Inappropriately Suggests MMR Link to Autism” is not very catchy perhaps, but the fear mongering sentiment went further than headlines and permeated the reporting. As a direct result, MMR vaccination rates in the UK fell to 80% by 2003. In some urban areas of London, the rate was as low as 65%. When we learn a little about how vaccination works these, figures become even more alarming.

Vaccination is not 100% effective on a person-to-person basis, though it is usually above 99% effective. This is generally not an issue however, as vaccination also serves to protect the unvaccinated by eliminating the pool possible hosts for a given virus. Because your neighbours are all immune, your chances of even encountering the virus, let alone contracting it, are dramatically reduced. The virus is much less likely to be passed around by accident. This effect is called “herd immunity”. For the three viruses that MMR protects against, the threshold for good herd immunity is around 95% of the population. With the rate of uptake so low in 2005, the risk was rapidly increasing that herd immunity would collapse, resulting in large scale epidemics amongst the roughly 20% of unvaccinated children and the 1% for whom the vaccine had failed to take.

Predictably, the epidemics began around 2000, when the earliest signs of concern had begun to filter through to the public. Measles epidemics were reported in Ireland, Austria and Italy. Most significantly, measles incidences in the UK have increased steadily over the last eight years. Although the increase may appear minimal (from 56 cases per year in 1998 to an estimated 900 cases per year by 2006) the disease was declared “endemic” in the British population earlier this year. This means that the virus is now circulating freely in the population without need for re-infection from outside sources. So anyone without immunity is immediately at much greater risk. Herd immunity is degenerating. There is also evidence that travellers to and from Europe triggered minor outbreaks in the United States. Mumps is on the rise again also, primarily hitting age-groups who passed through infancy prior to the introduction of MMR. Some 70,000 cases were reported between 2004 and 2006. There were a handful of deaths as a result of the measles and mumps resurgences. Three deaths were reported in Ireland, one death in the UK and two cases of brain damage. Not many, but a reminder to us of times when these diseases were a true threat.

The degeneration of herd immunity is just the first step, there is another risk associated with allowing these viruses to become endemic. For every infected person there are literally billions of mumps, measles or rubella viruses in their system. The more viruses there are, the faster they reproduce. The faster they reproduce, the more often they mutate. With part of the population vaccinated and part not vaccinated, what we are doing is presenting the mutating viruses with an obstacle to overcome. The risk is growing that one of these three viruses may undergo the mutation required to evade MMR entirely.

In 2004, ten of Wakefield’s co-authors on the 1998 paper withdrew their support for the work. Since the first publication, at least twenty peer-reviewed research or review papers have discredited the MMR link to autism. Wakefield’s suggested new “autistic enterocolitis” has been dismissed by autism researchers as a common symptom of the condition. Ten years after the controversy began, MMR is not the only vaccine to fall victim to the resurgent paranoia and disillusionment with modern medicine, though this is a trend which predates the MMR scare. Some papers continue to lead a crusade against any proposals for new “multivalent” vaccines that, like MMR, would combine protection from several diseases.

Apportioning Blame

It was a need for a simple cause which ultimately brought the MMR crisis into being. But the fact is, there’s no known single cause for autism. And nor are the causes of the vaccination crisis as clear as they seem. It would be easy to point the finger at Dr. Wakefield. He’s certainly not free of blame. Wakefield’s 1998 study was prompted when he was approached by solicitors representing a group planning to sue MMR manufacturers for causing the autism. According to a Sunday Times report in 2006, Wakefield received money from that group to perform his 1998 study and it appears that some of the study participants were sourced by them too. It is also alleged that Wakefield’s hospital, who were quick to back his findings and arrange press contact, also received money in the form of legal aid. It seems clear from interviews at the time that Wakefield was aware of the fine balance of risks associated with his bold statement. He was aware that switching from the use of MMR to using three vaccines over a number of years very significantly increases a child’s risk of contracting one of the diseases in that time. Wakefield’s point was that the risk of autism outweighed both the fact that his results were unclear and the fact that his suggested course of action brought great risks. He should absolutely not have been going public with his poorly-conceived idea, yet his language in the press release and interviews was actually quite suitably cautious. The subtlety was lost on many news outlets. Rather than exhibit caution themselves, they perpetuated a fear-laden story that has done incalculable damage to public health in Europe. Many of these are the same papers that, years later, are now assassinating Wakefield’s character in light of professional misconduct charges. Ultimately we have to blame pretty much everybody; parents looking for simple answers, lawyers looking for litigation, a surgeon with a bias, a hospital looking for publicity, a media willing to spin anythi
ng to sell papers. Not to mention the confused reactions of most GPs and politicians (a blog in itself). And then there’s us. The scientists fought the good fight on the day, sure. But it could be argued that our aloofness from the public has created a culture in which science is only noticed when it is sensational; a culture in which the people have neither the education nor the inclination to view science with proper scepticism. It’s conceivable that just one of those groups had it in them to prevent this whole huge mess. Instead we are now facing continued vaccine paranoia and a dangerous resurgence of diseases we once had on the run.

Monday, 18 August 2008

Alternative Expectations

Scepticism is a balancing act. It’s not about a dismissive nature, any more than a credulous one. I like to think of myself as being a balanced, quite open-minded sceptic. Doubt, but don’t reject without evidence. Mind you, I get it wrong sometimes. Watching a fairly mindless piece of entertainment TV last week, I was introduced to the concept of light therapy, in particular for the treatment of depression as well as skin conditions. I could barely contain a snort of mockery as the wide-eyed presenter explained the serotonin-inducing and antibiotic wonders of various shades of intense light. Actually, I’m pretty sure I didn’t contain it at all. My automatic mistrust of the concept was hasty. After all, it is quite well established that sunlight may have all manner of influences on us, both emotional and physical. However, my scepticism led me to investigate further, which is never a bad thing. I visited Google Scholar to browse some of the peer-reviewed journals on light therapy. My aim; to find out if any evidence of the effectiveness of this therapy actually exists. Sure enough, there is some manner of science in there. Broadly, the studies performed to date have tended to be pretty inadequate in terms of sample size (rarely more than 20 patients) and time scale (weeks when we’d like years). So let’s say that the jury is still out, but that I look more favourably on the concept now than I did previously. I’m still a little dubious as to whether such treatments should already be available in clinics, when it appears as if a full-scale trial has yet to be conducted. It wouldn’t happen with a drug, after all. The wide-eyed presenter, perhaps familiar with the concept of “scepticism”, ensured us that the treatment was “scientifically proven”. Whatever that means.

So I figure that light therapy should not be dismissed. But it should certainly not be accepted on the basis of a TV personality’s assessment of what constitutes “scientific proof”. While light therapy may not be something that would conventionally be classed as “alternative medicine”, it did get me thinking about the topic. The very concept of alternative medicine is often offensive to many medics and scientists. It is a notion that thrives on the modern public’s disillusionment with science in general and the misguided concept that “another way” exists. The disillusionment is not entirely unjustified. And the philosophical rejection of reason shouldn’t prejudice our scientific judgement of the individual therapies classed under the blanket term of “alternative”.
Just where did this sense of disillusionment with conventional medicine come from? I have some notions on that. Following the sudden revolution that began with the sanitation practices of the late 19th century, the western world witnessed an unprecedented improvement in public health. The work of scientists such as Koch and Pasteur did away with vague notions of the nature of disease. Ever hear of miasma theory? Nope, because it’s rubbish. Koch and Pasteur, giants of medicine, saw to it that the war upon germs could begin in earnest. Within a century the world’s greatest killers, smallpox, tuberculosis and polio, were either utterly destroyed or reduced to a shadow of their former threat. It was a true revolution. It was the end result of a paradigm shift in biology; the formulation of germ theory. But things have settled down now, we’re back to normal science. Cancer, once largely unheard of, is now the big killer. Many blame modern life, and the science that brought it, for putting things into their food and environment. The newspapers are obsessed with reporting on “things that cause cancer”, which apparently is almost everything. It’s easy to forget of course that 100 years ago very few people lived long enough to get cancer. Modern medicine’s perceived inability to “cure” cancer, heart disease and AIDS, has lead people to lose faith, even to become cynical about the means and even motives of doctors and the health industry. Of course, we scientists and doctors have not helped. Our curious culture of maintaining aloof superiority has fuelled the common man’s sense that science has become disconnected from humanity. In the absence of understandable contact from us, what has anybody to go on other than the caricatures of the media?

So, the “other way” becomes attractive. Dismissive scepticism, the worst kind of scepticism, now rules when dealing with doctors. Many have come to the assumption that alternative medicine forms part of what They Don’t Want You to Know, for reasons that are never entirely clear. A grand conspiracy. This attitude is no better than the average scientist’s blanket views on alternative therapy. It’s really just a matter of getting more information, and if we actually look for it, the beginnings of what we need to know are often already there in the journals. What should the average prospective patient look out for? The journals don’t make for an easy read, but I’ll try to summarise what makes for good testing.

In evidence-based medicine, efficacy and safety are tested using clinical studies. Because humans are so very unique and variable, the only way to be sure that a technique or drug is effective and safe is to go large. To use the biggest study groups possible. We also have to ensure that we study the effects over extended time periods. Both features are vital for the statistical analysis needed to make sense of all that human unpredictability. Most importantly of all we must use what scientists call “controls”. A control in a clinical study is essentially a group, as large and as similar as possible to the group receiving the test treatment, which is treated differently for the sake of comparison. To properly test acupuncture, for example, the bare minimum would be a study of several thousand patients with one group receiving conventional treatment, one receiving acupuncture and one receiving “sham” acupuncture in which the needles are applied but applied incorrectly. The last two groups must be “blinded”, which is to say that neither group should be aware of which is receiving real acupuncture.

A recent-ish study of acupuncture for back-pain followed this very template. They found that acupuncture beat conventional therapy for pain relief. But that isn’t the full story. Firstly, the volunteers consisted of patients for whom conventional therapy had failed. Secondly, they found that the sham acupuncture was just as effective as real acupuncture. This may be an indication of what is called the placebo effect. This is an apparent beneficial effect caused by a fake control treatment, be it the administration of a sugar pill or random pinpricks. Or perhaps there’s some peculiar value to being poked with needles in general. Put simply, it’s not clear what’s going on there. Acupuncture must remain in the realms of the untested for now and we should treat it as such. With doubt, but not with contempt.


On the flip side, we can ditch reiki and reflexology as they have been tested quite thoroughly and found to have no greater benefit than a massage. “Allergy tests” based upon applied kinesiology (the one where bottles of varies substances are held near your muscles) are pure and utter witchcraft in my view. There’s no connection between the results of these and the standard medical allergy test. Hell, some of those tests use sealed bottles, so quite how your body could ever react to the contents is a mystery. As for chiropractic... don’t get me started. Few studies have been able to demonstrate anything more than a placebo effect. Most damningly of all, as pointed out by Ben Goldacre, some chiropractors would rather block the process of scientific criticism of their field. The New Zealand Chiropractors Association has taken the highly suspicious step of attempting to sue a peer-reviewed journal. With your health on the line, is this the sort of carry-on you should accept from your doctor? (Author's Note 21 Aug 2008: The British Chiropractic Association are also sueing journalist Simon Singh for an allegedly libellous article on their faith. I mean, science.)You can be quite sure that no reputable scientist has ever sued in response to academic criticism. Proper studies such as I outlined above are hard to conduct on chiropractic spinal manipulation. This is primarily because the medics who usually run studies are not trained in the methods and chiropractors are reluctant to get involved. What information there is tends to be both limited and self-contradictory. This isn’t a nail in the coffin by any means, but it’s clear that the professionals could be doing more to make us trust them. The general folk and herbal medicine scene is a whole can of worms in its own right. It’s quite clear that some of it works, after all many modern drugs are derived from plant and fungal components. But it’s clear that we don’t know enough about the complex mixture of active ingredients in many such preparations to draw generalisations. Much like light therapy and acupuncture, it remains for me at the fringes of reason for the time being.
Ultimately, the advice for navigating the maze that is alternative medicine is much the same as my advice regarding the reading of science in the mainstream media. Scepticism, but open scepticism. Demand evidence, statistics and hard facts. Mechanisms must be rooted in what we can observe. As for doctors, expect more from them too. Ask for explanations, don’t just accept prescriptions. Doctors are often impatient with patient questioning and take a dim view of patients coming to them with their own research from books or the internet. This needs to change. Try to open a dialogue, one that is respectful and yet still sceptical. Never forget that your doctor has some ten years of training and perhaps decades of practical experience. The relationship should ideally be a two-way communication.

As for “alternative medicine”, the term encompasses too wide a range of ideas and carries too much prejudice. To my mind there should be only two kinds of medicine. Tested and not. Only the successfully tested has a place in our lives. Much of what is now untested may one day be worthy of our trust, but right now our health and our lives are at stake. Nothing is more valuable, and nothing is more worthy of healthy scepticism.