Comparison of Altmetrics with Conventional Bibliometrics in the Surgical Literature (Preprint)
BACKGROUND The impact of a research publication has traditionally been quantified by its citation count. Newer bibliometric indices such as Altmetric Attention Score (AAS) and article page views are emerging as supplementary measures to quantify the academic influence of research. OBJECTIVE The aim of the current study was to interrogate the relationship between novel and traditional bibliometric indices for research published in a leading surgical journal and evaluate the role of these newer indices in measuring the impact of surgical research. METHODS All articles published in JAMA Surgery between 1 January 2019 and 1 September 2021 were examined. The literature database PubMed was used to identify all articles published within the specified time period. The cumulative citation count, AAS, and article page views were retrieved from the journal website. Statistical analysis using the Pearson rank correlation coefficient (r) was performed on Minitab 19. RESULTS : A total of 1,071 articles were retrieved for further analysis. The correlation (95% CI) between ranks for all articles was 0.396 (0.344-0.445) for AAS and citation scores, 0.541 (0.497-0.582) for citations and article page views, and 0.413 (0.362-0.461) for AAS and article page views. CONCLUSIONS We demonstrated a medium correlation between citations and AAS for articles published in a leading surgical journal. The inter-year correlation between 2019 and 2021 was similar, suggesting that AAS could be predictive of future citations. AAS may be useful in evaluating the wider societal impact of the surgical literature and could serve to promote greater public engagement in surgical research.