scholarly journals Trial sequential analysis: novel approach for meta-analysis

2021 ◽  
Vol 16 (2) ◽  
pp. 138-150
Author(s):  
Hyun Kang

Systematic reviews and meta-analyses rank the highest in the evidence hierarchy. However, they still have the risk of spurious results because they include too few studies and participants. The use of trial sequential analysis (TSA) has increased recently, providing more information on the precision and uncertainty of meta-analysis results. This makes it a powerful tool for clinicians to assess the conclusiveness of meta-analysis. TSA provides monitoring boundaries or futility boundaries, helping clinicians prevent unnecessary trials. The use and interpretation of TSA should be based on an understanding of the principles and assumptions behind TSA, which may provide more accurate, precise, and unbiased information to clinicians, patients, and policymakers. In this article, the history, background, principles, and assumptions behind TSA are described, which would lead to its better understanding, implementation, and interpretation.

BMJ Open ◽  
2017 ◽  
Vol 7 (12) ◽  
pp. e018544 ◽  
Author(s):  
Xiaoqin Wang ◽  
Liang Yao ◽  
Long Ge ◽  
Lun Li ◽  
Fuxiang Liang ◽  
...  

IntroductionPostoperative atrial fibrillation (POAF) is the most common complication following cardiac surgery, and randomised clinical trials (RCTs) and systematic reviews have been conducted to compare and evaluate different pharmacological interventions for preventing POAF. This study aimed to explore the effect of different pharmacological interventions for prophylaxis against POAF after cardiac surgery using network meta-analysis (NMA).Methods and analysisA systematic search will be performed in PubMed, EMBASE and the Cochrane Library to identify RCTs, systematic reviews, meta-analyses or NMA of different pharmacological interventions for POAF. We will evaluate the risk of bias of the included RCTs according to the Cochrane Handbook V.5.1.0, and use GRADE to assess the quality of evidence. Standard pairwise meta-analysis, trial sequential analysis and Bayesian network meta-analysis will be used to compare the efficacy of different pharmacological interventions.Ethics and disseminationEthics approval and patient consent are not required as this study is a meta-analysis based on published studies. The results of this NMA and trial sequential analysis will be submitted to a peer-reviewed journal for publication.Protocol registration numberCRD42017067492.


BMJ Open ◽  
2017 ◽  
Vol 7 (11) ◽  
pp. e015888 ◽  
Author(s):  
Josep M Garcia-Alamino ◽  
Clare Bankhead ◽  
Carl Heneghan ◽  
Nicola Pidduck ◽  
Rafael Perera

ObjectiveTo estimate the proportion of systematic reviews that meet the optimal information size (OIS) and assess the impact heterogeneity and effect size have on the OIS estimate by type of outcome (eg, mortality, semiobjective or subjective).MethodsWe carried out searches of Medline and Cochrane to retrieve meta-analyses published in systematic reviews from 2010 to 2012. We estimated the OIS usingTrial Sequential Analysissoftware (TSA V.0.9) and based on several heterogeneity and effect size scenarios, stratifying by type of outcome (mortality/semiobjective/subjective) and by Cochrane/non-Cochrane reviews.ResultsWe included 137 meta-analyses out of 218 (63%) potential systematic reviews (one meta-analysis from each systematic review). Of these reviews, 83 (61%) were Cochrane and 54 (39%) non-Cochrane. The Cochrane reviews included a mean of 6.5 (SD 6.1) studies and the non-Cochrane included a mean of 13.2 (SD 10.2) studies. The mean number of patients was 2619.1 (SD 6245.8 or median 586.0) for the Cochrane and 19 888.5 (SD 32 925.7 or median 6566.5) patients for the non-Cochrane reviews. The percentage of systematic reviews that achieved the OIS for all-cause mortality outcome were 0% Cochrane and 25% for non-Cochrane reviews; for semiobjective outcome 17% for Cochrane and 46% for non-Cochrane reviews and for subjective outcome 45% for Cochrane and 72% for non-Cochrane reviews.ConclusionsThe number of systematic reviews that meet an optimal information size is low and varies depending on the type of outcome and the type of publication. Less than half of primary outcomes synthesised in systematic reviews achieve the OIS, and therefore the conclusions are subject to substantial uncertainty.


Author(s):  
Ali Hatem Manfi Al-Rudayni ◽  
Divya Gopinath ◽  
Mari Kannan Maharajan ◽  
Sajesh K. Veettil ◽  
Rohit Kunnath Menon

Oral mucositis is a debilitating complication of chemotherapy, characterized by erythema, ulcers and oedema of the oral mucosa. This review aimed to evaluate the efficacy of Photobiomodulation in the treatment of oral mucositis using meta-analysis and trial sequential analysis, and also to assess the quality of the results by Grading of Recommendations, Assessment, Development and Evaluation (GRADE). A comprehensive search of three databases, including Embase, Medline and Central, was performed to identify randomized controlled trials studying the efficacy of Photobiomodulation in the treatment of cancer chemotherapy-induced oral mucositis. The primary outcome was reduction in the severity of oral mucositis. Secondary outcomes were pain relief, duration of oral mucositis and adverse effects. The meta-analysis was performed using the random-effects model, and random errors of the meta-analyses were detected by trial sequential analysis. A total of 6 randomized controlled trials with 398 participants were included in our analysis. Photobiomodulation significantly reduced the severity of oral mucositis when compared to sham radiation (RR 0.43, 95% CI 0.20 to 0.93; p < 0.05). Sensitivity analysis by excluding trials with high risk of bias reiterated the robustness of our results (RR 0.28, 95% CI 0.16 to 0.48). Trial sequential analysis illustrated that the evidence from the meta-analysis was conclusive. The result of the meta-analyses with trial sequential analysis illustrated that Photobiomodulation is an effective therapeutic intervention for the treatment of oral mucositis, and the evidence gathered can be considered conclusive with a moderate level of certainty according to GRADE. Further trials are recommended to standardize the laser parameters required for the optimal effect.


2021 ◽  
Author(s):  
Andrew Bryant ◽  
Theresa A Lawrie ◽  
Therese Dowswell ◽  
Edmund J. Fordham ◽  
Mitchell Scott ◽  
...  

Background Re-purposed medicines may have a role against the SARS-CoV-2 virus. The antiparasitic ivermectin, with anti-viral and anti-inflammatory properties, has now been tested in numerous clinical trials.Areas of uncertainty We assessed the efficacy of ivermectin treatment in reducing mortality, in secondary outcomes, and in chemo-prophylaxis, among people with, or at high risk of, covid-19 infection. Data sourcesWe searched bibliographic databases up to April 25 2021. Two review authors sifted for studies, extracted data and assessed risk of bias. Meta-analyses were conducted and certainty of the evidence was assessed using the GRADE approach and additionally in trial sequential analyses for mortality.Twenty-four RCTs involving 3406 participants met review inclusion. Therapeutic Advances Meta-analysis of 15 trials found ivermectin reduced risk of death compared with no ivermectin (average Risk Ratio 0.38, 95% confidence interval (CI) 0.19 to 0.73; n=2438; I2=49%; moderate-certainty evidence). This result was confirmed in a trial sequential analysis (TSA) using the same DerSimonian-Laird method that underpinned the unadjusted analysis. This was also robust against a TSA using the Biggerstaff-Tweedie method. Low-certainty evidence found ivermectin prophylaxis reduced covid-19 infection by an average 86% (95% CI 79% to 91%). Secondary outcomes provided less certain evidence. Low certainty evidence suggested that that there may be no benefit with ivermectin for ‘need for mechanical ventilation’, whereas effect estimates for ‘improvement’ and ‘deterioration’ clearly favoured ivermectin use. Severe adverse events were rare among treatment trials and evidence of no difference was assessed as low certainty. Evidence on other secondary outcomes was very low certainty.Conclusions Moderate-certainty evidence finds that large reductions in covid-19 deaths are possible using ivermectin. Employing ivermectin early in the clinical course may reduce numbers progressing to severe disease. The apparent safety and low cost suggest that ivermectin is likely to have a significant impact on the SARS-CoV-2 pandemic globally.


BMJ Open ◽  
2019 ◽  
Vol 9 (11) ◽  
pp. e032389 ◽  
Author(s):  
Naqash Sethi ◽  
Arushma Imran Naqash ◽  
Niklas Nielsen ◽  
Janus Christian Jakobsen

IntroductionFever is an integral part of the inflammatory response and has therefore likely a physiological role in fighting infections. Nevertheless, whether fever in itself is beneficial or harmful in adults is unknown. This protocol for a systematic review aims at identifying the beneficial and harmful effects of fever control interventions in adults.Methods and analysisThis protocol for a systematic review was conducted following the recommendations of Cochrane, GRADE and the eight-step assessment suggested by Jakobsen and colleagues for better validation of meta-analytical results in systematic reviews. We plan to include all relevant randomised clinical trials comparing any fever control intervention with placebo, sham or no intervention in adults. We plan to search CENTRAL, MEDLINE, Embase, LILACS, BIOSIS, CINAHL, Scopus and Web of Science Core Collection to identify relevant trials. Any eligible trial will be assessed and classified as either at high risk of bias or low risk of bias, and our primary conclusions will be based on trials at low risk of bias. We will perform our meta-analyses of the extracted data using Review Manager 5.3 and Trial Sequential Analysis. For all our outcomes, we will create a ‘Summary of Findings’ table based on GRADE assessments of the certainty of the evidence.Ethics and disseminationNo formal approval or review of ethics is required for this systematic review as individual patient data will not be included. This systematic review has the potential to highlight (1) whether one should believe fever to be beneficial, harmful or neither in adults; (2) the existing knowledge gaps on this topic; and (3) whether the recommendations from guidelines and daily clinical practice are correct. These results will be disseminated through publication in a leading peer-reviewed journal.PROSPERO registration numberCRD42019134006


2021 ◽  
Author(s):  
Christian Gunge Riberholt ◽  
Markus Harboe Olsen ◽  
Joachim Birch Milan ◽  
Christian Gluud

Abstract Background: Adequately conducted systematic reviews with meta-analyses are considered the highest level of evidence and thus directly defines many clinical guidelines. However, the risk of type I and II errors in meta-analyses are substantial. Trial Sequential Analysis is a method for controlling these risks. Erroneous use of the method might lead to research waste or misleading conclusions. Methods: The current protocol describes a systematic review aimed to identify common and major mistakes and errors in the use of Trial Sequential Analysis by evaluating published systematic reviews and meta-analyses that include this method. We plan to include all studies using Trial Sequential Analysis published from 2018 to 2021, an estimated 400 to 600 publications. We will search Medical Literature Analysis and Retrieval System Online (MEDLINE) and the Cochrane Database of Systematic Reviews (CDSR), including studies with all types of participants, interventions, and outcomes. The search will begin in July 2021. Two independent reviewers will screen titles and abstracts, include relevant full text articles, extract data from the studies into a predefined checklist, and evaluate the methodological quality of the study using the AMSTAR 2 (Assessing the methodological quality of systematic reviews). Discussion: This protocol follows the Preferred Reporting Items for Systematic Reviews and Meta-Analysis Protocols (PRISMA-P). The identified mistakes and errors will form the basis of a reviewed guideline for the use of Trial Sequential Analysis. Appropriately controlling for type I and II errors might reduce research waste and improve quality and precision of the evidence that clinical guidelines are based upon.


PLoS ONE ◽  
2021 ◽  
Vol 16 (3) ◽  
pp. e0248132
Author(s):  
Sophie Juul ◽  
Emil Eik Nielsen ◽  
Joshua Feinberg ◽  
Faiza Siddiqui ◽  
Caroline Kamp Jørgensen ◽  
...  

Background COVID-19 is a rapidly spreading disease that has caused extensive burden to individuals, families, countries, and the world. Effective treatments of COVID-19 are urgently needed. This is the second edition of a living systematic review of randomized clinical trials assessing the effects of all treatment interventions for participants in all age groups with COVID-19. Methods and findings We planned to conduct aggregate data meta-analyses, trial sequential analyses, network meta-analysis, and individual patient data meta-analyses. Our systematic review was based on PRISMA and Cochrane guidelines, and our eight-step procedure for better validation of clinical significance of meta-analysis results. We performed both fixed-effect and random-effects meta-analyses. Primary outcomes were all-cause mortality and serious adverse events. Secondary outcomes were admission to intensive care, mechanical ventilation, renal replacement therapy, quality of life, and non-serious adverse events. According to the number of outcome comparisons, we adjusted our threshold for significance to p = 0.033. We used GRADE to assess the certainty of evidence. We searched relevant databases and websites for published and unpublished trials until November 2, 2020. Two reviewers independently extracted data and assessed trial methodology. We included 82 randomized clinical trials enrolling a total of 40,249 participants. 81 out of 82 trials were at overall high risk of bias. Meta-analyses showed no evidence of a difference between corticosteroids versus control on all-cause mortality (risk ratio [RR] 0.89; 95% confidence interval [CI] 0.79 to 1.00; p = 0.05; I2 = 23.1%; eight trials; very low certainty), on serious adverse events (RR 0.89; 95% CI 0.80 to 0.99; p = 0.04; I2 = 39.1%; eight trials; very low certainty), and on mechanical ventilation (RR 0.86; 95% CI 0.55 to 1.33; p = 0.49; I2 = 55.3%; two trials; very low certainty). The fixed-effect meta-analyses showed indications of beneficial effects. Trial sequential analyses showed that the required information size for all three analyses was not reached. Meta-analysis (RR 0.93; 95% CI 0.82 to 1.07; p = 0.31; I2 = 0%; four trials; moderate certainty) and trial sequential analysis (boundary for futility crossed) showed that we could reject that remdesivir versus control reduced the risk of death by 20%. Meta-analysis (RR 0.82; 95% CI 0.68 to 1.00; p = 0.05; I2 = 38.9%; four trials; very low certainty) and trial sequential analysis (required information size not reached) showed no evidence of difference between remdesivir versus control on serious adverse events. Fixed-effect meta-analysis showed indications of a beneficial effect of remdesivir on serious adverse events. Meta-analysis (RR 0.40; 95% CI 0.19 to 0.87; p = 0.02; I2 = 0%; two trials; very low certainty) showed evidence of a beneficial effect of intravenous immunoglobulin versus control on all-cause mortality, but trial sequential analysis (required information size not reached) showed that the result was severely underpowered to confirm or reject realistic intervention effects. Meta-analysis (RR 0.63; 95% CI 0.35 to 1.14; p = 0.12; I2 = 77.4%; five trials; very low certainty) and trial sequential analysis (required information size not reached) showed no evidence of a difference between tocilizumab versus control on serious adverse events. Fixed-effect meta-analysis showed indications of a beneficial effect of tocilizumab on serious adverse events. Meta-analysis (RR 0.70; 95% CI 0.51 to 0.96; p = 0.02; I2 = 0%; three trials; very low certainty) showed evidence of a beneficial effect of tocilizumab versus control on mechanical ventilation, but trial sequential analysis (required information size not reached) showed that the result was severely underpowered to confirm of reject realistic intervention effects. Meta-analysis (RR 0.32; 95% CI 0.15 to 0.69; p < 0.00; I2 = 0%; two trials; very low certainty) showed evidence of a beneficial effect of bromhexine versus standard care on non-serious adverse events, but trial sequential analysis (required information size not reached) showed that the result was severely underpowered to confirm or reject realistic intervention effects. Meta-analyses and trial sequential analyses (boundary for futility crossed) showed that we could reject that hydroxychloroquine versus control reduced the risk of death and serious adverse events by 20%. Meta-analyses and trial sequential analyses (boundary for futility crossed) showed that we could reject that lopinavir-ritonavir versus control reduced the risk of death, serious adverse events, and mechanical ventilation by 20%. All remaining outcome comparisons showed that we did not have enough information to confirm or reject realistic intervention effects. Nine single trials showed statistically significant results on our outcomes, but were underpowered to confirm or reject realistic intervention effects. Due to lack of data, it was not relevant to perform network meta-analysis or possible to perform individual patient data meta-analyses. Conclusions No evidence-based treatment for COVID-19 currently exists. Very low certainty evidence indicates that corticosteroids might reduce the risk of death, serious adverse events, and mechanical ventilation; that remdesivir might reduce the risk of serious adverse events; that intravenous immunoglobin might reduce the risk of death and serious adverse events; that tocilizumab might reduce the risk of serious adverse events and mechanical ventilation; and that bromhexine might reduce the risk of non-serious adverse events. More trials with low risks of bias and random errors are urgently needed. This review will continuously inform best practice in treatment and clinical research of COVID-19. Systematic review registration PROSPERO CRD42020178787.


2021 ◽  
Author(s):  
Steven Kwasi Korang ◽  
Sanam Safi ◽  
Christian Gluud ◽  
Janus C Jakobsen

Abstract Background: Glucocorticosteroids are widely used to treat severe sepsis in pediatric intensive care units. However, the evidence on the clinical effects is unclear.Objective: To assess the benefits and harms of glucocorticosteroids for children with sepsis. Data Sources: We conducted a systematic review of randomized clinical trials with meta-analysis and Trial Sequential Analysis (TSA) (PROSPERO CRD42017054341). We searched CENTRAL, MEDLINE, Embase, LILACS, SCI-Expanded, and more. Study Selection: Randomized clinical trials assessing the effects of adding glucocorticosteroids to standard care for children with sepsis. Data Extraction: Two independent reviewers screened studies and extracted data. Evidence was assessed by GRADE according to our published protocol.Data Synthesis: We included 24 trials randomizing 3073 participants. Meta-analyses showed no evidence of an effect of adding glucocorticosteroids for children with sepsis with a mixed focus for any of our outcomes. Meta-analyses suggested evidence of a beneficial effect of dexamethasone for children with meningitis when assessing serious adverse events (risk ratio (RR) 0.68, 95% confidence interval (CI) 0.53 to 0.86; P = 0.001, very low certainty of evidence) and ototoxicity (RR 0.63, 95% CI 0.45 to 0.88; P = 0.007, low certainty of evidence). TSAs showed that we did not have sufficient data to confirm or reject these results. We found insufficient evidence to confirm or reject an effect on mortality or our other outcomes. No trials reported quality of life or organ failure. Most trials were at high risks of bias. We found high clinical heterogeneity between participants. None of our TSAs showed benefits, harms or futility. Conclusions: Generally, we found no evidence of an effect of glucocorticosteroids for children with sepsis without meningitis. Dexamethasone for sepsis in children due to meningitis may decrease serious adverse events and ototoxicity.


2016 ◽  
Vol 124 (4) ◽  
pp. 846-869 ◽  
Author(s):  
Abdullah S. Terkawi ◽  
Dimitris Mavridis ◽  
Pamela Flood ◽  
Jørn Wetterslev ◽  
Rayan S. Terkawi ◽  
...  

Abstract Background Disagreement among many underpowered studies has led to an equivocal understanding of the efficacy of the 5-HT3 antagonist ondansetron in preventing the consequences of sympathectomy after subarachnoid anesthesia. The authors assessed the efficacy of ondansetron with respect to the overall quality and statistical power of the meta-analyses. Methods The authors used a standard and a newer method of meta-analysis, trial sequential analysis (TSA), to estimate adjusted CIs based on how much information has been accrued. They also used random-effects meta-analyses techniques, small trial bias assessment, selection models, sensitivity analyses, and the Grading of Recommendations on Assessment, Development, and Evaluation system. These results from the aforementioned techniques were compared, and importance of consideration of these factors was discussed. Results Fourteen randomized placebo-controlled trials (1,045 subjects) were identified and analyzed. By using conventional meta-analyses, the authors determined that ondansetron was associated with reduction in the incidence of hypotension (relative risk = 0.62 [95% CI, 0.46 to 0.83], P = 0.001; TSA-adjusted CI, 0.34 to 1.12; I2 = 60%, P = 0.002) and bradycardia (relative risk = 0.44 [95% CI, 0.26 to 0.73], P = 0.001; TSA-adjusted CI, 0.05 to 3.85; I2 = 0%, P = 0.84). However, the authors found indications of bias among these trials. TSAs demonstrated that the meta-analysis lacked adequate information size and did not achieve statistical significance when adjusted for sparse data and repetitive testing. The Grading of Recommendations on Assessment, Development, and Evaluation system showed that the results had low to very low quality of evidence. Conclusions The analyses fail to confirm evidence that ondansetron reduces the incidence of hypotension and bradycardia after subarachnoid anesthesia due to the risk of bias and information sizes less than the required. As results from meta-analysis are given significant weight, it is important to carefully evaluate the quality of the evidence that is input.


Sign in / Sign up

Export Citation Format

Share Document