Workshop on Publishing for Biomedical Journal Editors and Reviewers:The Journal Evaluation Criteria of Thomson Scientific

ObjectiveMany journals permit authors to submit supplementary material for publication alongside the article. We explore the value, use and role of this material in biomedical journal articles from the perspectives of authors, peer reviewers and readers.Design and settingWe conducted online surveys (November–December 2016) of corresponding authors and peer reviewers at 17 BMJ Publishing Group journals in a range of specialities.ParticipantsParticipants were asked to respond to one of three surveys: as authors, peer reviewers or readers.ResultsWe received 2872/20340 (14%) responses: authors 819/6892 (12%), peer reviewers 1142/6682 (17%) and readers 911/6766 (14%). Most authors submitted (711/819, 87%) and 80% (724/911) of readers reported reading supplementary material with their last article, while 95% (1086/1142) of reviewers reported seeing these materials sometimes. Additional data tables were the most common supplementary material reported (authors: 74%; reviewers: 89%; readers: 67%). A majority in each group indicated additional tables were most useful to readers (61%–77%); 20%–36% and 3%–4% indicated they were most useful to peer reviewers and journal editors, respectively. Checklists and reporting guidelines showed the opposite: higher proportions of each group regarded these as most useful to journal editors. All three groups favoured the publication of additional tables and figures on the journal’s website (80%–83%), with <4% of each group responding that these do not need to be available. Approximately one-fifth (16%–23%) responded that raw study data should be available on the journal’s website, while 24%–33% said that these materials should not be made available anywhere.ConclusionsAuthors, peer reviewers and readers agree that supplementary materials are useful. Supplementary tables and figures were favoured over reporting checklists or raw data for reading but not for study replication. Journals should consider the roles, resource costs and strategic placement of supplementary materials to ensure optimal usage and minimise waste.Trial registration numberNCT02961036.

Download Full-text

A survey exploring biomedical editors’ perceptions of editorial interventions to improve adherence to reporting guidelines

F1000Research ◽

10.12688/f1000research.20556.3 ◽

2019 ◽

Vol 8 ◽

pp. 1682 ◽

Cited By ~ 1

Author(s):

David Blanco ◽

Darko Hren ◽

Jamie J. Kirkham ◽

Erik Cobo ◽

Sara Schroter

Keyword(s):

Reporting Guidelines ◽

Administrative Staff ◽

Biomedical Journal ◽

Adherence To Guidelines ◽

Journal Editors ◽

Medical Institutions ◽

Peer Reviewers ◽

Completeness Of Reporting

Background: Improving the completeness of reporting of biomedical research is essential for improving its usability. For this reason, hundreds of reporting guidelines have been created in the last few decades but adherence to these remains suboptimal. This survey aims to inform future evaluations of interventions to improve adherence to reporting guidelines. In particular, it gathers editors’ perceptions of a range of interventions at various stages in the editorial process. Methods: We surveyed biomedical journal editors that were knowledgeable about this topic. The questionnaire included open and closed questions that explored (i) the current practice of their journals, (ii) their perceptions of the ease of implementation of different interventions and the potential effectiveness of these at improving adherence to reporting guidelines, (iii) the barriers and facilitators associated with these interventions, and (iv) suggestions for future interventions and incentives. Results: Of the 99 editors invited, 24 (24%) completed the survey. Involving trained editors or administrative staff was deemed the potentially most effective intervention but, at the same time, it was considered moderately difficult to implement due to logistic and resource issues. Participants believed that checking adherence to guidelines goes beyond the role of peer reviewers and were concerned that the quality of peer review could be compromised. Reviewers are generally not expected to focus on reporting issues but on providing an expert view on the importance, novelty, and relevance of the manuscript. Journals incentivising adherence, and publishers and medical institutions encouraging journals to take action to boost adherence were two recurrent themes. Conclusions: Biomedical journal editors generally believed that engaging trained professionals would be the most effective, yet resource intensive, editorial intervention. Also, they thought that peer reviewers should not be asked to check RGs. Future evaluations of interventions can take into account the barriers, facilitators, and incentives described in this survey.

Download Full-text