Spin in Abstracts of Systematic Reviews and Meta-Analyses of Melanoma Therapies: A Cross-Sectional Analysis (Preprint)

2021 ◽  
Author(s):  
Ross Nowlin ◽  
Alexis Wirtz ◽  
David Wenger ◽  
Ryan Ottwell ◽  
Courtney Cook ◽  
...  

BACKGROUND Spin is defined as the misrepresentation of a study’s results, which may lead to misperceptions or misinterpretation of the findings. Spin has previously been found in randomized controlled trials and systematic reviews of acne vulgaris treatments and treatments of various non-dermatological conditions. OBJECTIVE The purpose of this study was to quantify the presence of spin in abstracts of systematic reviews and meta-analyses of melanoma therapies and identify any related secondary characteristics of these articles. METHODS e used a cross-sectional approach on June 2, 2020, to search the MEDLINE and Embase databases from their inception. To meet inclusion criteria, a study was required to be a systematic review or meta-analysis pertaining to the treatment of melanoma in human subjects, and reported in English. We used the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocols (PRISMA) definition of systematic reviews and meta-analyses. Data were extracted in a masked, duplicate fashion. We conducted a powered bivariate linear regression and calculated odds ratios for each study characteristic. RESULTS A total of 200 systematic reviews met the inclusion criteria. We identified spin in 38% of the abstracts. The most common type of spin found was type 3, occurring 40 times; the least common was type 2, which was not present in any included abstracts. We found that abstracts pertaining to pharmacologic interventions were 3.84 times more likely to contain spin than the reference group. The likelihood of an article containing spin has decreased annually (AOR: 0.91; 95% CI, 0.84-0.99). No significant correlation between funding source, other study characteristics, and the presence of spin was identified. CONCLUSIONS We have found that spin is fairly common in the abstracts of systematic reviews of melanoma treatments, but is improving.

2013 ◽  
Vol 31 (15_suppl) ◽  
pp. 1516-1516
Author(s):  
Sara Gandini ◽  
Brandy M. Heckman-Stoddard ◽  
Matteo Puntoni ◽  
Barbara k Dunn ◽  
Leslie Ford ◽  
...  

1516 Background: Previous meta-analyses have shown that the anti-diabetic agent metformin is associated with reduced cancer incidence and mortality. However, this effect has not been consistently demonstrated in animal models and recent epidemiological studies. Here we update the meta-analyses of observational studies with a focus on confounders and biases. Methods: We identified 47 articles published between 1966 to August 2012 that were related to metformin and cancer incidence or mortality. Study characteristics and outcomes were abstracted for each study that met inclusion criteria. Results: The analysis is based on a total of 32,647 cancer events and 1,198 cancer deaths. Cancer incidence was reduced by 34% (SRR=0.66, 95%CI: 0.42-1.03) in subjects taking metformin compared with other antidiabetic medications. Cancer mortality was reduced by 49% (SRR=0.51, 95%CI: 0.30-0.86). The SRR estimates for liver (SRR=0.40, 95%CI: 0.20-0.80) and lung cancer incidence (SRR=0.87, 95%CI: 0.83-0.93) were significant. Adjustment for BMI and exclusion of studies with time-related biases showed a significant reduction in cancer incidence of 26% (95%CI: 1% to 45%) or 10% (95%CI: 9% to 11%), respectively (Table). Breast cancer was significantly reduced by 24% (95%CI: 7% to 38%) in BMI-adjusted studies and the reduction remains significant in prospective studies and in studies without time-related biases. Conclusions: Metformin is a promising agent for cancer prevention, although it may not benefit all populations equally. Clinical trials are needed to determine if the observations seen in diabetic populations apply to pre-diabetic or non-diabetic populations and to optimize the benefit/risk ratio. [Table: see text]


2021 ◽  
Vol 6 (1) ◽  
pp. 247301142110006
Author(s):  
Marvin Carr ◽  
David Dye ◽  
Wade Arthur ◽  
Ryan Ottwell ◽  
Byron Detweiler ◽  
...  

Background: Approximately 18 in every 100 000 people have experienced a ruptured Achilles tendon. Despite the prevalence of this condition, treatment options remain contested. Hypothesis/purpose: The objective of this study was to evaluate the use of spin—reporting practices that may exaggerate benefit or minimize harm—in abstracts of systematic reviews related to Achilles tendon repair. We also evaluated whether particular study characteristics were associated with spin. Study design: Cross-sectional. Methods: We developed a search strategy for Ovid MEDLINE and Ovid Embase for systematic reviews focused on Achilles tendon treatment. Following title and abstract screening of these search returns, these reviews were evaluated for spin (according to a previously developed classification scheme) and received AMSTAR-2 (A Measurement Tool to Assess Systematic Reviews–2) appraisals by 2 investigators in a masked, duplicate manner. Study characteristics for each review were also extracted in duplicate. Results: Our systematic search returned 251 articles of which 43 systematic reviews and meta-analyses were eligible for data extraction. We found that 65.1% of included studies contained spin (28/43). Spin type 3 was the most common type, occurring in 53.5% (23/43) of abstracts. Spin types 5, 6, 1, and 4 occurred in 16.3% (7/43), 9.3% (4/43), 7% (3/43), and 5.3% (1/43), respectively. Spin types 2, 7, 8, and 9 did not occur. AMSTAR-2 appraised 32.6% (14/43) of the studies as “moderate” quality, 32.6% (14/43) as “low” quality, and 34.9% (15/43) as “critically low” quality. No systematic reviews were rated as “high” quality. There was no significant association between the presence of spin and the following study characteristics: intervention type, article discussing Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) adherence, journal recommending PRISMA adherence, funding sources, journal 5-year impact factor, year the review was received for publication, or AMSTAR-2 critical appraisals. Conclusion: Spin was present in abstracts of systematic reviews and meta-analyses—covering Achilles tendon tear treatment. Steps should be taken to improve the reporting quality of abstracts on Achilles tendon treatment as well as other common orthopedic conditions. Clinical relevance: In order to avoid negative patient outcomes, articles should be free of spin within the abstract.


2021 ◽  
pp. postgradmedj-2020-139392
Author(s):  
Rachel Wurth ◽  
Michelle Hajdenberg ◽  
Francisco J Barrera ◽  
Skand Shekhar ◽  
Caroline E Copacino ◽  
...  

AimThe aim of this study was to systematically appraise the quality of a sample of COVID-19-related systematic reviews (SRs) and discuss internal validity threats affecting the COVID-19 body of evidence.DesignWe conducted a scoping review of the literature. SRs with or without meta-analysis (MA) that evaluated clinical data, outcomes or treatments for patients with COVID-19 were included.Main outcome measuresWe extracted quality characteristics guided by A Measurement Tool to Assess Systematic Reviews-2 to calculate a qualitative score. Complementary evaluation of the most prominent published limitations affecting the COVID-19 body of evidence was performed.ResultsA total of 63 SRs were included. The majority were judged as a critically low methodological quality. Most of the studies were not guided by a pre-established protocol (39, 62%). More than half (39, 62%) failed to address risk of bias when interpreting their results. A comprehensive literature search strategy was reported in most SRs (54, 86%). Appropriate use of statistical methods was evident in nearly all SRs with MAs (39, 95%). Only 16 (33%) studies recognised heterogeneity in the definition of severe COVID-19 as a limitation of the study, and 15 (24%) recognised repeated patient populations as a limitation.ConclusionThe methodological and reporting quality of current COVID-19 SR is far from optimal. In addition, most of the current SRs fail to address relevant threats to their internal validity, including repeated patients and heterogeneity in the definition of severe COVID-19. Adherence to proper study design and peer-review practices must remain to mitigate current limitations.


2021 ◽  
Author(s):  
Vasileios P. Papadopoulos ◽  
Peny Avramidou ◽  
Stefania-Aspasia Bakola ◽  
Dimitra-Geogia Zikoudi ◽  
Ntilara Touzlatzi ◽  
...  

AbstractPurposeLittle is known on the mortality rate in COVID-19 related acute metabolic emergencies, namely diabetic ketoacidosis (DKA), hyperglycaemic hyperosmolar state (HHS), combined DKA/HHS, and euglycaemic diabetic ketoacidosis (EDKA).MethodsA systematic literature review was conducted using EMBASE, PubMed/Medline, and Google Scholar from January 1, 2020 to January 9, 2021 to identify all case report series, cross-sectional studies, and meta-analyses of case reports describing mortality rate in DKA, HHS, and EDKA, in COVID-19 patients. The Joanna Briggs Institute critical appraisal checklist for case reports was used for quality assessment.ResultsFrom 313 identified publications, 4 fulfilled the inclusion criteria and analyzed qualitatively and quantitatively. A systematic review and meta-analysis with subgroup analyses examined mortality rate in a total of 152 COVID-19 patients who had developed DKA, HHS, combined DKA/HHS, or EDKA. Combined mortality rate and confidence intervals (CI) were estimated using random effects model. The study was registered to PROSPERO database (ID: 230737).ResultsCombined mortality rate was found to be 27.1% [95% CI: 11.2-46.9%]. Heterogeneity was considerable (I2=83%; 95% CI: 56-93%), corrected to 67% according to Von Hippel adjustment for small meta-analyses. Funnel plot presented no apparent asymmetry; Egger’s and Begg’s test yielded in P=0.44 and P=0.50, respectively. Sensitivity analysis failed to explain heterogeneity.ConclusionCOVID-19 related acute metabolic emergencies (DKA, HHS, and EDKA) are characterized by considerable mortality; thus, clinicians should be aware of timely detection and immediate treatment commencing.


10.2196/16978 ◽  
2020 ◽  
Vol 3 (1) ◽  
pp. e16978 ◽  
Author(s):  
Ryan Ottwell ◽  
Taylor C Rogers ◽  
J Michael Anderson ◽  
Austin Johnson ◽  
Matt Vassar

Background Spin is the misrepresentation of study findings, which may positively or negatively influence the reader’s interpretation of the results. Little is known regarding the prevalence of spin in abstracts of systematic reviews, specifically systematic reviews pertaining to the management and treatment of acne vulgaris. Objective The primary objective of this study was to characterize and determine the frequency of the most severe forms of spin in systematic review abstracts and to evaluate whether various study characteristics were associated with spin. Methods Using a cross-sectional study design, we searched PubMed and EMBASE for systematic reviews focusing on the management and treatment of acne vulgaris. Our search returned 316 studies, of which 36 were included in our final sample. To be included, each systematic review must have addressed either pharmacologic or nonpharmacologic treatment of acne vulgaris. These studies were screened, and data were extracted in duplicate by two blinded investigators. We analyzed systematic review abstracts for the nine most severe types of spin. Results Spin was present in 31% (11/36) of abstracts. A total of 12 examples of spin were identified in the 11 abstracts containing spin, with one abstract containing two instances of spin. The most common type of spin, selective reporting of or overemphasis on efficacy outcomes or analysis favoring the beneficial effect of the experimental intervention, was identified five times (5/12, 42%). A total of 44% (16/36) of studies did not report a risk of bias assessment. Of the 11 abstracts containing spin, six abstracts (55%) had not reported a risk of bias assessment or performed a risk of bias assessment but did not discuss it. Spin in abstracts was not significantly associated with a specific intervention type, funding source, or journal impact factor. Conclusions Spin is present in the abstracts of systematic reviews and meta-analyses covering the treatment of acne vulgaris. This paper raises awareness of spin in abstracts and emphasizes the importance of its recognition, which may lead to fewer incidences of spin in future studies.


2019 ◽  
Vol 19 (1) ◽  
Author(s):  
Xiao Wang ◽  
Yuexuan Li ◽  
Haoliang Fan

Abstract Background The use of computers/TV has become increasingly common worldwide after entering the twenty-first century and depression represents a growing public health burden. Understanding the association between screen time-based sedentary behavior (ST-SB) and the risk of depression is important to the development of prevention and intervention strategies. Methods We searched the electronic databases of Medline, Embase and the Cochrane Library. The odds ratio (OR) with corresponding 95% confidence intervals (CIs) was adopted as the pooled measurement. Subgroup analyses were investigated by stratified meta-analyses based on age, gender and reference group (reference category of screen time, e.g. 2 h/day, 4 h/day). Results There were 12 cross-sectional studies and 7 longitudinal studies met the inclusion criteria. Overall, the pooled OR was 1.28 with high heterogeneity (I2 = 89%). Compared to those who reported less SB, persons reporting more SB had a significantly higher risk of depression. When the gender was stratified, the pooled OR was 1.18 in female groups while no significant association was observed in males. Among the 19 studies, 5 studies used a reference group with ST = 2 h/days (pooled OR = 1.46), 9 studies used ≥4 h as a reference group (pooled OR = 1.38), 2 studies used 1 h as a reference group (pooled OR = 1.07) and for the remaining 3 studies, hours of ST were calculated as a continuous variable (pooled OR = 1.04). Conclusions ST-SB is associated with depression risk and the effects vary in different populations. In addition, valid objective measures of SB should be developed in future studies.


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Britt Frisk Pados ◽  
Rebecca R. Hill ◽  
Joy T. Yamasaki ◽  
Jonathan S. Litt ◽  
Christopher S. Lee

Abstract Background Difficulties related to eating are often reported in children born preterm. The objective of this study was to quantitatively synthesize available data on the prevalence of problematic feeding in children under 4 years of age who were born preterm. Methods Literature was identified from PubMed, CINAHL, and PsycInfo. The search was limited to English language and publication years 2000–2020. To be included in the meta-analysis, the article had to report the prevalence of problematic oral feeding within a population of children born prematurely (< 37 weeks’ gestation), and the child age at the time of study had to be between full-term corrected age and 48 months. For studies meeting inclusion criteria, the following data were extracted: sample size and subsamples by gestational age and/or child age at time of study; definition of problematic feeding; measures used for assessment of feeding; gestational age at time of birth of sample; child age at time of study; exclusion criteria for the study; and prevalence of problematic feeding. Random-effects meta-analyses were performed to estimate the prevalence of problematic feeding across all studies, by gestational age at birth, and by child age at time of study. Results There were 22 studies that met inclusion criteria. Overall prevalence of problematic feeding (N = 4381) was 42% (95% CI 33–51%). Prevalence was neither significantly different across categories of gestational age nor by child age at the time of study. Few studies used psychometrically-sound assessments of feeding. Conclusion Problematic feeding is highly prevalent in prematurely-born children in the first 4 years of life regardless of degree of prematurity. Healthcare providers of children born preterm should consider screening for problematic feeding throughout early childhood as a potential complication of preterm birth. Systematic review registration number Not applicable.


F1000Research ◽  
2020 ◽  
Vol 9 ◽  
pp. 33
Author(s):  
Peter Lee ◽  
Jan Hamling ◽  
John Fry ◽  
Sonja Vandyke ◽  
Rolf Weitkunat

Meta-analyses often combine covariate-adjusted effect estimates (odds ratios or relative risks) and confidence intervals relating a specified endpoint to a given exposure.  Standard techniques are available to do this where the exposure is a simple presence/absence variable, or can be expressed in defined units.  However, where the definition of exposure is qualitative and may vary between studies, meta-analysis is less straightforward.  We introduce a new “Uniform Scale” approach allowing expression of effect estimates in a consistent manner, comparing individuals with the most and least possible exposure.  In 2008, we presented methodology and made available software to obtain estimates for specific pairwise comparisons of exposure, such as any versus none, where the source paper provides estimates for multiple exposure categories, expressed relative to a common reference group.  This methodology takes account of the correlation between the effect estimates for the different levels.  We have now extended our software, available in Excel, SAS and R, to obtain effect estimates per unit of exposure, whether the exposure is defined or is to be expressed in the “Uniform Scale”.  Examples of its use are presented.


Nutrients ◽  
2018 ◽  
Vol 10 (8) ◽  
pp. 1049 ◽  
Author(s):  
Christian Juhl ◽  
Helle Bergholdt ◽  
Iben Miller ◽  
Gregor Jemec ◽  
Jørgen Kanters ◽  
...  

A meta-analysis can help inform the debate about the epidemiological evidence on dairy intake and development of acne. A systematic literature search of PubMed from inception to 11 December 2017 was performed to estimate the association of dairy intake and acne in children, adolescents, and young adults in observational studies. We estimated the pooled random effects odds ratio (OR) (95% CI), heterogeneity (I2-statistics, Q-statistics), and publication bias. We included 14 studies (n = 78,529; 23,046 acne-cases/55,483 controls) aged 7–30 years. ORs for acne were 1.25 (95% CI: 1.15–1.36; p = 6.13 × 10−8) for any dairy, 1.22 (1.08–1.38; p = 1.62 × 10−3) for full-fat dairy, 1.28 (1.13–1.44; p = 8.23 × 10−5) for any milk, 1.22 (1.06–1.41; p = 6.66 × 10−3) for whole milk, 1.32 (1.16–1.52; p = 4.33 × 10−5) for low-fat/skim milk, 1.22 (1.00–1.50; p = 5.21 × 10−2) for cheese, and 1.36 (1.05–1.77; p = 2.21 × 10−2) for yogurt compared to no intake. ORs per frequency of any milk intake were 1.24 (0.95–1.62) by 2–6 glasses per week, 1.41 (1.05–1.90) by 1 glass per day, and 1.43 (1.09–1.88) by ≥2 glasses per day compared to intake less than weekly. Adjusted results were attenuated and compared unadjusted. There was publication bias (p = 4.71 × 10−3), and heterogeneity in the meta-analyses were explained by dairy and study characteristics. In conclusion, any dairy, such as milk, yogurt, and cheese, was associated with an increased OR for acne in individuals aged 7–30 years. However, results should be interpreted with caution due to heterogeneity and bias across studies.


2018 ◽  
Vol 34 (S1) ◽  
pp. 107-108
Author(s):  
Gerlinde Pilkington ◽  
Juliet Hounsome ◽  
Tara Renton ◽  
Rumona Dickson

Introduction:Impacted third molars (I3Ms) are blocked from fully erupting; many I3Ms are asymptomatic, however there could be pain and pathological changes. Historically, I3Ms were removed prophylactically. Current options in the United Kingdom include either retention with standard care (watchful waiting), or removal due to pathological changes. We conducted a systematic review of the prophylactic removal of asymptomatic impacted mandibular third molars (IM3Ms) compared with standard care.Methods:We searched five electronic databases from 1999 onwards. Inclusion criteria: randomized and non-randomized trials, observational studies, and systematic reviews (SRs) comparing the prophylactic removal of IM3Ms with standard care or studies assessing the outcomes of either approach; outcomes included pathology associated with retention, postoperative complications, adverse effects of treatment and health-related quality of life. Two reviewers independently screened all titles and/or abstracts, applied inclusion criteria to potentially relevant publications, and quality assessed and data extracted the included studies. No meta-analysis or network meta-analyses were undertaken.Results:Following screening of 11,373 references, 13 studies (four cohort studies and nine SRs) were included. One cohort study investigated the prophylactic removal of asymptomatic IM3Ms in comparison with standard care and retention, two investigated the prophylactic removal of asymptomatic IM3Ms, and one studied the retention and standard care of asymptomatic IM3Ms. Two studies reporting surgical complications found no serious complications; however, one study reported intense pain and postoperative infection. Pathological changes due to retention of asymptomatic IM3Ms were reported by three studies. Nine SRs of the management of third molars were included in this review, however none focused solely on IM3Ms.Conclusions:Consistent with previous systematic reviews, we found no RCT data to support or refute the prophylactic removal of asymptomatic IM3Ms, despite extensive searching of the literature. The review however did identify evidence from two longitudinal studies demonstrating the outcomes when asymptomatic IM3Ms are left in situ.


Sign in / Sign up

Export Citation Format

Share Document