scholarly journals Dealing with the positive publication bias: Why you should really publish your negative results

2017 ◽  
Vol 27 (3) ◽  
Author(s):  
Ana Mlinarić ◽  
Martina Horvat ◽  
Vesna Šupak Smolčić
2006 ◽  
Vol 165 (6) ◽  
pp. 623-625 ◽  
Author(s):  
Sara Rockwell ◽  
Bruce F. Kimler ◽  
John E. Moulder

eLife ◽  
2016 ◽  
Vol 5 ◽  
Author(s):  
Silas Boye Nissen ◽  
Tali Magidson ◽  
Kevin Gross ◽  
Carl T Bergstrom

Science is facing a “replication crisis” in which many experimental findings cannot be replicated and are likely to be false. Does this imply that many scientific facts are false as well? To find out, we explore the process by which a claim becomes fact. We model the community’s confidence in a claim as a Markov process with successive published results shifting the degree of belief. Publication bias in favor of positive findings influences the distribution of published results. We find that unless a sufficient fraction of negative results are published, false claims frequently can become canonized as fact. Data-dredging, p-hacking, and similar behaviors exacerbate the problem. Should negative results become easier to publish as a claim approaches acceptance as a fact, however, true and false claims would be more readily distinguished. To the degree that the model reflects the real world, there may be serious concerns about the validity of purported facts in some disciplines.


2019 ◽  
Vol 35 (3) ◽  
pp. 274-280
Author(s):  
Dmitry Tumin ◽  
Uduak S. Akpan ◽  
John A. Kohler ◽  
Joshua C. Uffman

This study evaluated progress to publication of pediatric quality improvement (QI) projects initially presented as national conference abstracts, according to project findings and other characteristics. QI abstracts were identified among presentations at the 2010-2015 American Academy of Pediatrics National Conference & Exhibition, and publications were tracked through June 2018. Positive findings (improvement on at least 1 quantitative project outcome), interventions, and analyses were correlated with journal publication. Of 142 abstracts, 128 (90%) reported positive findings. Forty-nine positive abstracts and 3 abstracts reporting negative results resulted in publication (38% vs 21%, respectively; P = .256). Median time to publication was 1.2 years for projects with positive findings, compared to >3 years for abstracts with negative findings ( P = .029). Ninety percent of abstracts reported positive findings, and these abstracts progressed to publication more quickly. Overcoming publication bias for pediatric QI projects may enhance selection of promising interventions as new projects are designed.


2010 ◽  
Vol 30 (7) ◽  
pp. 1263-1264 ◽  
Author(s):  
Ulrich Dirnagl ◽  
Martin Lauritzen

PEDIATRICS ◽  
1989 ◽  
Vol 84 (2) ◽  
pp. 374-380
Author(s):  
Jini Hetherington ◽  
Kay Dickersin ◽  
Iain Chalmers ◽  
Curtis L. Meinert

Investigations in which statistically significant differences between treatment groups have not been observed are less likely than others to be reported in scientific journals. In clinical research, this selective suppression of "negative" results may lead to the adoption of ineffective or hazardous treatments. In an attempt to obtain information about unpublished trials in perinatal medicine, letters were sent to 42 000 obstetricians and pediatricians in 18 countries. As a result, we were notified of 395 unpublished randomized trials. Only 18 of the trials had been completed more than 2 years before the survey, a period during which at least 2300 reports of perinatal trials had been published. Of the 395 unpublished trials, 125 had ceased recruitment within the 2 years prior to the survey, 193 were actively recruiting at the time of the survey, and 59 were about to begin recruitment. It was concluded that publication bias will not be addressed successfully by attempts to obtain information about unpublished trials retrospectively. However, since the response rate to our request for details about ongoing and planned trials was good, prospective registration of trials at inception appears to be a feasible approach to reducing publication bias and its adverse consequences. An additional merit of prospective registration of clinical trials is that it should reduce unnecessary duplication (as opposed to necessary replication) in research and promote more effective collaboration.


Sign in / Sign up

Export Citation Format

Share Document