scholarly journals Appraisal of meta-analysis

1998 ◽  
Vol 22 (11) ◽  
pp. 698-701
Author(s):  
Apu Chakraborty ◽  
James P. Warner ◽  
Robert Blizard

Aims and methodPrompted by a clinical question, we critically appraised a meta-analysis of neuroimaging in our evidence-based journal club.ResultsThe results of the meta-analysis suggested differences in ventricular size and sulcal width between controls and people with schizophrenia and mood disorders. However, we were unable to answer the question that prompted this exercise.Clinical implicationsAlthough the evidence-based medicine approach facilitates appraisal of complex articles, some clinical questions are not yet answerable.

Author(s):  
Ann Merete Møller

Evidence-based medicine (EBM) is defined as ‘The judicious use of the best current evidence in making decisions about the care of individual patients’. Evidence-based medicine (EBM) is meant to integrate clinical expertise with the best available research evidence and patient values. The purpose of EBM is to assist clinicians in making the best decisions. Practising EBM includes asking an answerable, well-defined clinical question, searching for information, critically appraising information retrieved, extracting data, synthesizing data, and making conclusions about the overall effect. The clinical question includes information of the following elements: the population, the intervention, and the clinically relevant outcomes in focus. The clinical question is a tool to make the focus of the question clearer, and an aid to build the following search strategy. A comprehensive and reproducible literature search is essential for conducting a high-quality and up-to-date search. The search should include all relevant clinical databases. Papers retrieved after the search must be critically appraised and evaluated for the risk of bias. Evidence-based methods are used in the production of systematic reviews, and the development of clinical guidelines. Whether a meta-analysis should be performed depends on the quality and nature of the extracted data. Practising EBM may be challenged by a lack of well-performed trials, various types of bias (including publication bias), and heterogeneity between existing trials. Several tools have been constructed to help the process; examples are the CONSORT statement, the PRISMA statement, and the AGREE instrument.


PRiMER ◽  
2018 ◽  
Vol 2 ◽  
Author(s):  
Thomas W. Hahn ◽  
Caitlin D'Agata ◽  
Jennifer Edgoose ◽  
Jennifer Mastrocola ◽  
Larissa Zakletskaia ◽  
...  

Introduction: Inpatient training and evidence-based medicine (EBM) curricula are fundamental components of medical education. Teaching EBM And Clinical topics in the Hospital (TEACH) Cards is an inpatient curricular tool developed to help guide efficient, discussion-based teaching sessions. TEACH Cards aims to increase frequency of inpatient teaching, improve exposure to the breadth of inpatient topics, advance EBM skills, and improve efficiency in answering clinical questions. Methods: TEACH Cards is a set of 25 topic-based cards, each addressing an adult inpatient medicine topic by asking background questions and encouraging learners to write and answer foreground questions. Residents and faculty from a family medicine residency rotating on an adult inpatient medicine service during the 6-month study period were invited to complete a prerotation survey, use the TEACH Cards, and then complete a postrotation survey. Results: Out of 54 potential participants, 35% completed both the pre- and postrotation surveys. Respondents used TEACH Cards on average three times per week, reporting significantly stronger agreement that they were both learning (P=0.034) and teaching (P=0.006) core inpatient topics. Respondents reported greater confidence in using EBM resources (P=0.006) and significantly shorter time to find an evidence-based answer to a clinical question (pretest median=6-10 minutes vs posttest median=2-5 minutes, P=0.002). Conclusion: Use of TEACH Cards increased self-reported exposure to the breadth of core inpatient topics, confidence with EBM skills, and efficiency in finding answers to clinical questions.  


2007 ◽  
Vol 33 (1) ◽  
pp. 63-103 ◽  
Author(s):  
Dina Demner-Fushman ◽  
Jimmy Lin

The combination of recent developments in question-answering research and the availability of unparalleled resources developed specifically for automatic semantic processing of text in the medical domain provides a unique opportunity to explore complex question answering in the domain of clinical medicine. This article presents a system designed to satisfy the information needs of physicians practicing evidence-based medicine. We have developed a series of knowledge extractors, which employ a combination of knowledge-based and statistical techniques, for automatically identifying clinically relevant aspects of MEDLINE abstracts. These extracted elements serve as the input to an algorithm that scores the relevance of citations with respect to structured representations of information needs, in accordance with the principles of evidence-based medicine. Starting with an initial list of citations retrieved by PubMed, our system can bring relevant abstracts into higher ranking positions, and from these abstracts generate responses that directly answer physicians' questions. We describe three separate evaluations: one focused on the accuracy of the knowledge extractors, one conceptualized as a document reranking task, and finally, an evaluation of answers by two physicians. Experiments on a collection of real-world clinical questions show that our approach significantly outperforms the already competitive PubMed baseline.


2001 ◽  
Vol 178 (S41) ◽  
pp. s191-s194 ◽  
Author(s):  
John Geddes ◽  
Guy Goodwin

BackgroundThe increasing use of the methods of evidence-based medicine to keep up-to-date with the research literature highlights the absence of high-quality evidence in many areas in psychiatry.AimsTo outline current uncertainties in the maintenance treatment of bipolar disorder and to describe some of the decisions involved in designing a large simple trial.MethodWe describe some of the strategies of evidence-based medicine, and how they can be applied in practice, focusing specifically on the area of bipolar disorder.ResultsOne of the key clinical uncertainties in the treatment of bipolar disorder is the place of maintenance drug treatments and their relative efficacy. A large-scale study, the Bipolar Affective Disorder: Lithium Anticonvulsant Evaluation (BALANCE) trial, is proposed to compare the effectiveness of lithium, valproate and the combination of lithium and valproate.ConclusionsProviding reliable answers to key clinical questions in psychiatry will require new approaches to clinical trials. These will need to be far larger than previously appreciated and will therefore need to be collaborative ventures involving front-line clinicians.


2012 ◽  
Vol 21 (2) ◽  
pp. 151-153 ◽  
Author(s):  
A. Cipriani ◽  
C. Barbui ◽  
C. Rizzo ◽  
G. Salanti

Standard meta-analyses are an effective tool in evidence-based medicine, but one of their main drawbacks is that they can compare only two alternative treatments at a time. Moreover, if no trials exist which directly compare two interventions, it is not possible to estimate their relative efficacy. Multiple treatments meta-analyses use a meta-analytical technique that allows the incorporation of evidence from both direct and indirect comparisons from a network of trials of different interventions to estimate summary treatment effects as comprehensively and precisely as possible.


2020 ◽  
Vol 108 (2) ◽  
Author(s):  
Joey Nicholson ◽  
Adina Kalet ◽  
Cees Van der Vleuten ◽  
Anique De Bruin

Objective: Evidence-based medicine practices of medical students in clinical scenarios are not well understood. Optimal foraging theory (OFT) is one framework that could be useful in breaking apart information-seeking patterns to determine effectiveness and efficiency of different methods of information seeking. The aims of this study were to use OFT to determine the number and type of resources used in information seeking when medical students answer a clinical question, to describe common information-seeking patterns, and identify patterns associated with higher quality answers to a clinical question.Methods: Medical students were observed via screen recordings while they sought evidence related to a clinical question and provided a written response for what they would do for that patient based on the evidence that they found.Results: Half (51%) of study participants used only 1 source before answering the clinical question. While the participants were able to successfully and efficiently navigate point-of-care tools and search engines, searching PubMed was not favored, with only half (48%) of PubMed searches being successful. There were no associations between information-seeking patterns and the quality of answers to the clinical question.Conclusion: Clinically experienced medical students most frequently relied on point-of-care tools alone or in combination with PubMed to answer a clinical question. OFT can be used as a framework to understand the information-seeking practices of medical students in clinical scenarios. This has implications for both teaching and assessment of evidence-based medicine in medical students.


1996 ◽  
Vol 20 (11) ◽  
pp. 673-675 ◽  
Author(s):  
Simon Gilbody

Evidence-based medicine is an approach to clinical training and practice that is increasing in popularity. When introduced into the journal club format, it provides an opportunity to integrate real clinical problems with critical evaluation of the psychiatric research literature. The principles of evidence-based medicine and the practicalities of its introduction into the Journal club format are described.


2008 ◽  
Vol 5;12 (5;9) ◽  
pp. 819-850
Author(s):  
Laxmaiah Manchikanti

Observational studies provide an important source of information when randomized controlled trials (RCTs) cannot or should not be undertaken, provided that the data are analyzed and interpreted with special attention to bias. Evidence-based medicine (EBM) stresses the examination of evidence from clinical research and describes it as a shift in medical paradigm, in contrast to intuition, unsystematic clinical experience, and pathophysiologic rationale. While the importance of randomized trials has been created by the concept of the hierarchy of evidence in guiding therapy, much of the medical research is observational. The reporting of observational research is often not detailed and clear enough with insufficient quality and poor reporting, which hampers the assessment of strengths and weaknesses of the study and the generalizability of the mixed results. Thus, in recent years, progress and innovations in health care are measured by systematic reviews and meta-analyses. A systematic review is defined as, “the application of scientific strategies that limit bias by the systematic assembly, clinical appraisal, and synthesis of all relevant studies on a specific topic.” Meta-analysis usually is the final step in a systematic review. Systematic reviews and meta-analyses are labor intensive, requiring expertise in both the subject matter and review methodology, and also must follow the rules of EBM which suggests that a formal set of rules must complement medical training and common sense for clinicians to integrate the results of clinical research effectively. While expertise in the review methods is important, the expertise in the subject matter and technical components is also crucial. Even though, systematic reviews and meta-analyses, specifically of RCTs, have exploded, the quality of the systematic reviews is highly variable and consequently, the opinions reached of the same studies are quite divergent. Numerous deficiencies have been described in methodologic assessment of the quality of the individual articles. Consequently, observational studies can provide an important complementary source of information, provided that the data are analyzed and interpreted in the context of confounding bias to which they are prone. Appropriate systematic reviews of observational studies, in conjunction with RCTs, may provide the basis for elimination of a dangerous discrepancy between the experts and the evidence. Steps in conducting systematic reviews of observational studies include planning, conducting, reporting, and disseminating the results. MOOSE, or Meta-analysis of Observational Studies in Epidemiology, a proposal for reporting contains specifications including background, search strategy, methods, results, discussion, and conclusion. Use of the MOOSE checklist should improve the usefulness of meta-analysis for authors, reviewers, editors, readers, and decision-makers. This manuscript describes systematic reviews and meta-analyses of observational studies. Authors frequently utilize RCTs and observational studies in one systematic review; thus, they should also follow the reporting standards of the Quality of Reporting of Meta-analysis (QUOROM) statement, which also provides a checklist. A combined approach of QUOROM and MOOSE will improve reporting of systematic reviews and lead to progress and innovations in health care. Key words: Observational studies, evidence-based medicine, systematic reviews, metaanalysis, randomized trials, case-control studies, cross-sectional studies, cohort studies, confounding bias, QUOROM, MOOSE


Sign in / Sign up

Export Citation Format

Share Document