To the content
1 . 2018

The rush to publication. An editorial and scientific mistake

Abstract

DOI: 10.24411/2308-1198-2018-00001

Howard Bauchner

The rush to publication. An editorial and scientific mistake*

The world moves at a far faster pace than even a decade ago. Instantaneous access to electronic communication via email and social media is available 24 hours a day, virtually anywhere in the world, on the ground and in the air, with video and audio on demand. Thus, no one ever needs to be – or ever is – disconnected from the world.

The speed of communication has clearly affected clinical and laboratory research. There appears to be an increasing rush to publish, or at least to make the results of studies immediately publicly available. It is unclear if flawed science is more common than in the past, but the number of accounts of serious problems with scientific reports appears to be increasing, with more high-profile retractions and increasing numbers of retractions with replacements (major inadvertent errors with a change in the findings and conclusions) [1]. However, because more research is being published, it is difficult to obtain precise numerator (retractions) and denominator data (all research conducted, published and unpublished) [2].

Nonetheless, concerns about the reproducibility of laboratory-based experiments [3] and the need to reanalyze clinical data [4] certainly suggest increasing challenges regarding the quality and transparency of research. High-visibility examples leave an impression of questionable science that is likely contributing to the public discourse over the meaning and definition of facts. For example, an experiment that created stem cells in an acid bath was questioned shortly after being published and re- tracted within months [5, 6]. A number of articles reporting nutritional research on food preferences have been corrected and at least 1 has been retracted [7]. A published analysis of flaws in baseline data distribution raised concern about the validity of thousands of randomized clinical trials [8], but in turn, concerns about majors flaws in this analysis were raised almost immediately after publication [9, 10]. These are but a limited number of examples, and coupled with the rise in predatory journals [11], contribute to the perception that the standards of science are slipping. As a result, the trust that the public and policy makers have in science may be jeopardized.

Yet, funders, professional societies, investigators, and journals contribute to this environment, and indeed this may be affecting the quality of published research. Journals proudly announce they will conduct peer review in a matter of days and publish the results of studies in a few weeks, even though most studies take many years to conceptualize, conduct, and complete. Professional societies create more and more late-breaking science sessions at their research meetings, often now including observational studies that are of interest, but not likely to change practice. Investigators, responding to requests from funders and sponsors, the desire to publish simultaneously with presentation, and their own internal motivations, often request rapid review and publication by journals. Many journals acquiesce to these requests, in turn, placing more pressure on peer reviewers, most of whom are investigators, to complete review in a matter of days, and more pressure on journal staff and resources to expedite article preparation and distribution.

New interest in preprint servers in clinical medicine increases the likelihood of premature dissemination and public consumption of clinical research findings prior to rigorous evaluation and peer review. At JAMA and throughout the JAMA Network journals, the conclusions and interpretations of many research articles change substantially between the initially submitted manuscript and the published article as a direct result of careful peer review, editorial assessment, author revision, and post acceptance editing. For most articles, public consumption of research findings prior to peer review will have little influence on health, but for some articles, the effect could be devastating for some patients if the results made public prior to peer review are wrong or incorrectly interpreted.

Progress in human health is measured in years, not days, weeks, or months. Major breakthroughs in clinical medicine are rare, with very few research findings likely to be implemented immediately. No drug or device, regardless of how effective, is likely to improve health outcomes more than many common and important clinical practices such as measuring blood pressure and treating hypertension with well-known drugs that have been proven to be safe and effective.

It usually takes years for interventions that improve patient outcomes to become part of routine practice and few novel interventions are likely to be more important than those already known to be effective. Improving the health of the world’s population has little to do with the speed of publication (except in the case of major public health emergencies) [12], but rather with effective interventions that have been properly tested, appropriate implementation of known or new interventions, and sustainable improvements in health systems.

Life is conducted at a far faster pace than in the past, and so too, the pace of science and scientific communication also has accelerated. But indeed if the desire for speed has contributed to poorer quality research, trust in science will erode. Funders, authors, societies, and journals need to move more deliberately; ensure appropriate rigorous external peer review and internal scientific and editorial scrutiny; redouble efforts to ensure that shortening the time to publication does not adversely affect scientific quality and accuracy; and perhaps, of necessity in some cases, slow the process of scientific publication.

JAMA and the JAMA Network journals continually monitor times from submission to acceptance and from acceptance to publication with the goal of ensuring timely editorial decisions and publication, and each journal publishes an annual audit with this information [13, 14]. Over the past 5 years, the time from manuscript submission to article publication has been halved for all of the journals. We will continue to evaluate requests for expedited review and publication and honor those that are appropriate, focusing on clinical trials and reports of public health emergencies.

In addition, when articles are judged to make critically important contributions to clinical care, public health, or public policy, the editors will ensure expedited peer review, moving quickly but without compromising thorough and rigorous evaluation. Sacrificing adequate and thoughtful peer review and editorial assessment is a mistake for research in medicine. Timely assessment and dissemination of medical research findings is certainly important, but for most articles, rushing to publication in days or weeks will not improve health outcomes.

 Article information

Author Affiliation: Editor in Chief, JAMA and The JAMA Network, Chicago, Illinois.

Corresponding Author

Howard Bauchner, MD, JAMA and the JAMA Network, 330 N Wabash Ave, Chicago, IL 60611 (howard.bauchner @jamanetwork.org).

Conflict of Interest Disclosures

The author has completed and submitted the ICMJE Form for Disclosure of Potential Conflicts of Interest and none were reported.

Additional Contributions

I thank and acknowledge the contributions of Eric D. Peterson, MD, MPH, and Derek C. Angus, MD, MPH (Associate Editors, JAMA), Philip Greenland, MD, and Mary McGrae McDermott, MD (Senior Editors, JAMA), Phil B. Fontanarosa, MD, MBA (Executive Editor, JAMA), and Annette Flanagin, RN, MA (Executive Managing Editor, JAMA and the JAMA Network). 

_______________________________________________

* The article was first published: JAMA. 2017; 318 (12): 1109–10. 

References

1. Heckers S., Bauchner H., Flanagin A. Retracting, replacing, and correcting the literature for pervasive error in which the results change but the underlying science is still reliable. JAMA Psychiatry. 2015; 72 (12):1170-1.

2. Van Noorden R. Science publishing: the trouble with retractions. Nature. 2011; 478 (7367): 26-8.

3. Gorski D. How reproducible is basic lab research in cancer biology? https://sciencebasedmedicine.org/how-reproducible-isbasic-lab-research-in-cancer-biology/. Accessed July 8, 2017.

4. Bauchner H., Golub R.M., Fontanarosa P.B. Data sharing: an ethical and scientific imperative. JAMA. 2016; 315 (12): 1237-9.

5. Castelvecchi D. Misconduct verdict stands for Japanese stem-cell researcher. http://blogs.nature.com/news/2014/05/ misconduct-verdict-stand-for-japanese-stem-cell-researcher.html. Accessed July 8, 2017.

6. CyranoskiD.Paperson“stress-induced”stemcellsareretracted. https://www.nature.com/news/papers-on-stress-induced-stem-cells-are-retracted-1.15501. Accessed July 7, 2017.

7. McCook A. The correct values are impossible to establish: embattled nutrition researcher adds long fix to 2005 paper. http:// retractionwatch.com/2017/07/04/correct-values-impossible-establish-embattled-nutrition-researcher-adds-long-fix-2005-paper/. Accessed July 9, 2017.

8. Carlisle J.B.. Data fabrication and other reasons for non-random sampling in 5087 randomised, controlled trials in anaesthetic and general medical journals. Anaesthesia. 2017; 72 (8): 944-52.

9. Brown N. Exploring John Carlisle's “bombshell” article about fabricated data in RCTs. http://steamtraen.blogspot.com/2017/06/exploring-john-carlisles-bombshell.html. Accessed June 9, 2017.

10. Wilson FP. Fraud in medical research: understanding the Carlisle approach. https://www.methodsman.com/blog/fraudcarlisle. Accessed June 13, 2017.

11. Beall J. What I learned from predatory publishers. Biochem Med (Zagreb). 2017; 27 (2): 273-8.

12. Gostin L.O., Lucey D., Phelan A. The Ebola epidemic: a global health emergency. JAMA. 2014; 312 (11): 1095-6.

13. Fontanarosa P.B., Bauchner H., Golub R.M. Thank you to JAMA authors, peer reviewers, and readers. JAMA. 2017; 317 (8): 812-3.

14. Bonow R.O. JAMA Cardiology inaugural year in review. JAMA Cardiol. 2017; 2 (5): 473-4. 

 

All articles in our journal are distributed under the Creative Commons Attribution 4.0 International License (CC BY 4.0 license)

CHIEF EDITOR
CHIEF EDITOR
Sergey L. Dzemeshkevich
MD, Professor (Moscow, Russia)

Journals of «GEOTAR-Media»