Tags: atlantic, medical research, misinformation, research
1 comment so far
Today I experienced one of those small miracles where it seems like the entire universe has converged to say “Yes, I agree with you!” when I was e-mailed an article that expresses everything I have been examining and thinking for the last 8 months–“can any medical-research studies be trusted?” In recent months I have become increasingly involved in researching various medical discussions. While initially disgusted by the number of the people quoting statistics and “they say” aphorisms on the internet without citing any kind of research, my turn to peer-reviewed medical journals, government agencies, and well-established professional societies seemed promising. Boy was I wrong.
The first problem I encountered was a marked dearth of research on certain topics even when preliminary research and letters to the editor stressed the need for follow-up studies. Why had no one taken on the topics so easily presented to them?
My second problem was faulty or insufficient research. How were “peer-reviewed” journals approving studies that used narrow demographics or extremely limited participants as their population of study? And what about the literature reviews and topic analyses that incorporated data over ten years old (or older)? How about the number of studies that measure long-term effects of a drug/procedure when the “long-term” lasts six months?
The final straw was the directly contradictory data between comparable research studies. What could account for one study claiming that vaccinating pregnant women in the third trimester prevents influenza in newborns 63% of the time, while another study claims that the protection is negligible (both supplying method and hard numbers)? While the bias of certain professional organizations (often funded by pharmaceutical companies) was obvious in some, even bias cannot sway hard numbers, or so I believed.
So when “Lies, Damned Lies, and Medical Science” by David H. Freeman in the November issue of the Atlantic showed up in my inbox, I was more than thrilled to know I was not alone. The article follows self-proclaimed “meta-researcher” John Ioannidis who, along with his team, has proven, “that much of what biomedical researchers conclude in published studies—conclusions that doctors keep in mind when they prescribe antibiotics or blood-pressure medication, or when they advise us to consume more fiber or less meat, or when they recommend surgery for heart disease or back pain—is misleading, exaggerated, and often flat-out wrong.”
We have become so accustomed to the way doctors, nutritionists, and scientists later retract studies, or the refutation of older studies by newer ones, that we rarely question why this has happened. Most people, I would surmise, make the assumption that science and research have improved over time and thus provided us with new evidence and information. But, according to Ioannidis, this is not the case. Faulty research, again and again, is. The common errors he lists range from “what questions researchers posed, to how they set up the studies, to which patients they recruited for the studies, to which measurements they took, to how they analyzed the data, to how they presented their results, to how particular studies came to be published in medical journals.”
Does this mean scientists and researchers are lazy? Ignorant? Inherently evil? Why would such important and literally life-altering work be composed so shoddily? Bias. (Hmm…sound familiar?) Turns out that even unintentionally, bias has a way of making itself into every step of the research process, influencing outcomes greatly and it doesn’t matter if this bias is self-inflicted or the product of an outside pressure such as those funding the research. (I cannot help but to point out the irony here, in that we must question whether bias played a role in Ioannidis’ research on research.) And while bias is the source of the faulty research, a number of factors perpetuate the misinformation, including sensationalism, lack of thorough research (i.e. ignoring/missing later refuting studies), and lack of duplication of the experiment.
So what is the point of research refuting research? I’ll stop summarizing the article and give you a chance to decide for yourself. But let me leave you with this last thought: Ioannidis’ research, like medical research, provokes us to examine things we held to be true. And just like medical research, it seems to come up short, leaving us with the question, “well what can we do about it?” Perhaps further research is needed. ; )
The Age of Misinformation: Part 2 October 20, 2010Posted by pupfiction in InformationIssues.
Tags: CBS, confirmation bias, FOX, misinformation, NBC, NPR, politics
add a comment
There was recently an interesting conversation on (my new obsession) the Brian Lehrer Show (broadcast on WNYC and via XM’s NPR channel 134) on the prevalent and growing bias in news coverage. The host and his guest were discussing CNN‘s decline in ratings over recent years due to, they surmised, the outlet’s attempt to remain neutral. On the other hand, stations like NBC, CBS, and Fox News Channel are gaining popularity as the former two are known for leaning liberal and the latter, notoriously conservative. It seems, historically as well as recently, that people tend to seek out information that agrees with their own belief systems, better known as confirmation bias. I know I am as guilty of this as the next person.
So is there a danger in watching solely Fox or only NBC? Does such a practice really perpetuate our enemy–misinformation? An exhaustive study on confirmation bias done by Raymond S. Nickerson of Tufts University would overwhelmingly say yes. Nickerson’s research (presented in a 46 page paper) claims that confirmation bias, “can contribute to delusions of many sorts, to the development and survival of superstitions,and to a variety of undesirable states of mind, including paranoia and depression. It can be exploited…to press unsubstantiated claims.” Nickerson later discusses another problem compounded by confirmation bias–inadequate research. Nickerson argues that confirmation bias leads people to accept the first plausible solution to a problem rather than to engage in thorough research. This, in turn, leads to a phenomenon that he will neither categorize as positive or negative–the perseverance of long-held beliefs.
You know you are guilty of it whether you’re a Democrat wincing at the site of Fox News Channel or a Republican who will only watch Fox News. You were probably also aware (on some level) that this is not the most intellectually engaging way of consuming information. So what are you going to do about it? Let me know in what ways we can all attempt to heal the growing divisiveness of American political television and thus thwart the pandemic of Misinformation!
The Age of Misinformation October 18, 2010Posted by pupfiction in InformationIssues.
Tags: dumbing down, information, internet, search engines, wikipedia, yahoo answers
add a comment
Alas, here I am after months of avoiding blogging. The problem is that my head has been way too caught up with personal matters. But more recently I find myself time and time again consumed with anger during routine Google searches and so it is that I turn to the more savvy netizens (our fickle and fleeting reader base?) to uphold and support my cause–the death of Yahoo! Answers.
As a librarian and self-declared “information specialist” I have no problem admitting that I frequently turn to Wikipedia. While it is certainly no Encyclopedia Britannica, there are references that one can check. So when Wikipedia is returned by Google as the first or second hit, I can deal with it.
However, when Yahoo! Answers is returned in the first page of results (as it increasingly is) I wince inside, and then click on it. I can’t help it. It’s like driving past an accident; you can’t help but look. Not only have I found numerous highly-biased erroneous answers voted “best” by fellow commenters, but the subject matter of the questions concerns me even more. As a pregnant woman who often uses the internet to find quick answers (knowing, of course, that calling the doctor is the best and final way to go), I am shocked by how many people ask crucial, health-related questions.
What are the requirements for people submitting answers? There are none. And to add insult to injury, Yahoo! supplements answers with responses from their “Knowledge Partners”, aka corporate sponsors. As much as we librarians and savvier internet users try to stress the inaccuracy and dubiousness of such sites to our more trusting friends, we are often shrugged off as fuddy-duddy Luddites (have I mentioned I’m 27 by the way?). At the risk of sounding like a sensationalist, isn’t this just another step (or large leap) in the “dumbing down” of our country? I plead with you, as a fellow American, don’t click on Yahoo! Answers; don’t support it. And maybe someday in the not-so-distant-future it will just be a bad memory!