scholarly journals Outcome reporting bias in trials: a methodological approach for assessment and adjustment in systematic reviews

BMJ ◽  
2018 ◽  
pp. k3802 ◽  
Author(s):  
Jamie J Kirkham ◽  
Douglas G Altman ◽  
An-Wen Chan ◽  
Carrol Gamble ◽  
Kerry M Dwan ◽  
...  
BMJ ◽  
2010 ◽  
Vol 340 (feb15 1) ◽  
pp. c365-c365 ◽  
Author(s):  
J. J Kirkham ◽  
K. M Dwan ◽  
D. G Altman ◽  
C. Gamble ◽  
S. Dodd ◽  
...  

PLoS ONE ◽  
2020 ◽  
Vol 15 (1) ◽  
pp. e0227580
Author(s):  
Abimbola A. Ayorinde ◽  
Iestyn Williams ◽  
Russell Mannion ◽  
Fujian Song ◽  
Magdalena Skrybant ◽  
...  

BMJ Open ◽  
2020 ◽  
Vol 10 (3) ◽  
pp. e032497
Author(s):  
Kieran Shah ◽  
Gregory Egan ◽  
Lawrence (Nichoe) Huan ◽  
Jamie Kirkham ◽  
Emma Reid ◽  
...  

BackgroundDiscrepancies in outcome reporting (DOR) between protocol and published studies include inclusions of new outcomes, omission of prespecified outcomes, upgrade and downgrade of secondary and primary outcomes, and changes in definitions of prespecified outcomes. DOR can result in outcome reporting bias (ORB) when changes in outcomes occur after knowledge of results. This has potential to overestimate treatment effects and underestimate harms. This can also occur at the level of systematic reviews when changes in outcomes occur after knowledge of results of included studies. The prevalence of DOR and ORB in systematic reviews is unknown in systematic reviews published post-2007.ObjectiveTo estimate the prevalence of DOR and risk of ORB in all Cochrane reviews between the years 2007 and 2014.MethodsA stratified random sampling approach was applied to collect a representative sample of Cochrane systematic reviews from each Cochrane review group. DOR was assessed by matching outcomes in each systematic review with their respective protocol. When DOR occurred, reviews were further assessed if there was a risk of ORB (unclear, low or high risk). We classified DOR as a high risk for ORB if the discrepancy occurred after knowledge of results in the systematic review.Results150 of 350 (43%) review and protocol pairings contained DOR. When reviews were further scrutinised, 23% (35 of 150) of reviews with DOR contained a high risk of ORB, with changes being made after knowledge of results from individual trials.ConclusionsIn our study, we identified just under a half of Cochrane reviews with at least one DOR. Of these, a fifth were at high risk of ORB. The presence of DOR and ORB in Cochrane reviews is of great concern; however, a solution is relatively simple. Authors are encouraged to be transparent where outcomes change and to describe the legitimacy of changing outcomes in order to prevent suspicion of bias.


Biostatistics ◽  
2013 ◽  
Vol 15 (2) ◽  
pp. 370-383 ◽  
Author(s):  
J. Copas ◽  
K. Dwan ◽  
J. Kirkham ◽  
P. Williamson

Sign in / Sign up

Export Citation Format

Share Document