Why Traditional Peer Review Is Broken (And How Open Science Fixes It)

 

Open Science vs Traditional Publishing: Which Wins?

The current landscape of scientific publishing is facing a profound credibility crisis. While researchers traditionally view the publication cycle as a straightforward path from submission to peer review and ultimate acceptance, the reality behind the scenes is much more complex. High-profile retractions, systemic flaws in traditional peer review, and a growing lack of confidence in published literature have pushed the scientific community toward a defining crossroads: Should we stick to traditional publishing models, or is it time for Open Science to take over?

The Broken Mechanics of Traditional Peer Review

Traditional publishing relies heavily on a single-blind peer review process where reviewers remain completely anonymous while knowing the author’s identity. This dynamic creates an unfair power imbalance, giving undue influence to reviewers and editors over authors.

Furthermore, traditional review takes place behind a wall of anonymity, which can lead to unchecked personal biases, unhelpful reprimands, and undisclosed conflicts of interest. We know the traditional peer review system is structurally broken because hundreds of papers are retracted annually due to serious integrity flaws, and entire journals have been forced to close down when their internal assessments failed.

When flawed or fraudulent research slips through traditional filters into the public domain, it actively harms society. A clear example of this occurred during the COVID-19 pandemic, where retracted, low-integrity studies initially recommended certain antimalarials. When subsequent high-integrity meta-analyses were conducted, they revealed that these medications were actually increasing patient mortality rather than helping them.

The Open Science Solution: Transparency as a Metric

Responsible research conduct requires three critical elements: moral values, strict professional standards, and a healthy research culture within academic institutions and journals. Open Science addresses these pillars directly by replacing hidden gates with radical, front-facing transparency.

To build genuine confidence in scientific output, modern publishing must prioritize several core Open Science practices:

• Prospective Registration: Trials must be registered publicly before patient recruitment begins to prevent the manipulation of hypotheses through the benefit of hindsight.
• Public Statistical Analysis Plans: Sharing analysis frameworks ahead of study completion ensures that data is not manipulated or selectively reported.
• Mandatory Data Sharing: Making raw datasets responsibly available at the time of publication allows for authentic peer scrutiny and independent verification.
• Open Peer Review: Moving toward an open model where reviewer identities and their full evaluation reports are completely public to both authors and readers. This transforms reviewers from anonymous gatekeepers into collaborative partners working alongside authors to minimize integrity flaws.

Preprints and the Rise of "Living" Publications

One of the most revolutionary shifts in the Open Science framework is the widespread adoption of preprints. Major research funders are now actively bypassing traditional journal delays by instructing scientists to publish preliminary versions of their manuscripts with a Digital Object Identifier (DOI) immediately.

By embracing preprints and open platforms (such as F1000 and eLife), the scientific community is moving toward a model of continuous, post-publication peer review. Under this framework, there may soon be no such thing as a fixed "final version" of a paper. Instead, scientific publications become living objects that can be transparently amended, updated, and improved over time based on ongoing reader evaluation and feedback.

Conclusion: Which Model Wins?

While traditional publishing offers established institutional structures, its lack of transparency and reliance on one-sided peer review have significantly contributed to the falling public confidence in science.

Open Science wins because it shifts medical research publication from a hidden, gatekeeping exercise into a transparent, co-produced, and highly accountable global dialogue. For editors, authors, and reviewers alike, transitioning to open data, preprints, and open peer review is no longer optional—it is the only way to safeguard scientific integrity.

---

Written by Professor Khalid Khan, Distinguished Investigator at the University of Granada and author of "Integrity of Randomized Clinical Trials" and "Systematic Reviews to Support Evidence-Based Medicine". To access specialized courses in research writing and clinical integrity, visit profkhalidkhan.com. 

---