Peer-review fails patients

Dr. Weeks’ Comment: The peer-reviewed scientific journals are funded by corporations no less the media which the journal editors are complaining about.

To Maintain Trust in Science, Lose the Peer Review

Benjamin Mazer, MD, MBA; John M. Mandrola, MD DISCLOSURES

February 19, 2019

“Trust me, I’m a doctor.” In the Internet age, that phrase has never been more fraught. Uncertainty is the rule in medicine and science. In an ideal world, doctors, scientists, and laypeople would independently evaluate the evidence behind any scientific or medical statement. Instead, scientific and medical evidence increasingly comes from small groups of subspecialists who write in obscure prose for academic publications that few can access. That leaves the media to disseminate findings from thinly read scientific journal articles that are held up as totems of authority.

Editors-in-Chief Blame the Media

But there’s a hitch. The Internet’s democratization of all voices allows misinformation—unintentional or malicious—to easily spread. Experts are scared. Recently, the editors-in-chief of the world’s top cardiology journals issued a joint statement warning about the spread of medical misinformation.[1]Their examples were patient distrust in statins and vaccines. These editors warn us that “individuals who are neither physicians nor scientists, but often with a specific agenda, have outsized influence over our lives.” They exhort the media to “do a better job.” The editors claim that they carefully evaluate each piece of information their journals publish because “lives are at stake.”

In truth, scientific journals have always been a weak check on misinformation. For every journal article published, only a few volunteer reviewers evaluate the work before publication. The vulnerabilities of “peer review” have been described even by those charged with managing it, such as former BMJ editor Richard Smith.[2] He and his colleagues have intentionally introduced errors into manuscripts sent for peer review, and found that these deliberate errors were often missed.[3] Reviewers vary greatly in how closely they examine a manuscript; they often have their own agenda and conflicts biasing their evaluation; if flaws are identified after publication, the study is almost never retracted.[4]

Social Media Didn’t Create Antivaxxers

Using distrust in statins and vaccines as examples undermines the editors’ point. The modern antivaccine movement was not started on Facebook or Twitter, but by a peer-reviewed study published in the Lancet, one of the world’s leading medical journals. Even as the harm of this fraudulent study became clear, it took more than a decade for the journal to retract it. Also, equating vaccine denialism and statin hesitancy hurts their case, because the choice to take a statin represents a near-perfect example of a decision that is sensitive to patient preferences.

Vulnerabilities in our scientific publishing system have not gone unnoticed by malign actors. For-profit “predatory journals” allow anyone to garner the authority of a scientific publication for a fee, often bypassing peer review. Individuals with fringe agenda even create their own journals to give an air of credibility to antiscientific views, such as creationism or climate change denial.

Peer Review Reimagined

Is the solution to “fake news” in science and medicine for social media to emulate journals? We don’t think so. Traditional scientific checks and balances don’t always work, and they can’t keep up with the pace of social media. A prominent editor and researcher recently wrote that “journals as we have known them are approaching their final act.”[5] To bolster trust, radical changes are needed in the way we share evidence-based information with each other and the public.

Leave a Comment

Your email address will not be published. Required fields are marked *