scholarly journals Quality and reporting standards, resources, training materials and information for realist evaluation: the RAMESES II project

2017 ◽  
Vol 5 (28) ◽  
pp. 1-108 ◽  
Author(s):  
Geoff Wong ◽  
Gill Westhorp ◽  
Joanne Greenhalgh ◽  
Ana Manzano ◽  
Justin Jagosh ◽  
...  

BackgroundMany of the problems confronting policy- and decision-makers, evaluators and researchers today are complex, as are the interventions designed to tackle them. Their success depends both on individuals’ responses and on the wider context of people’s lives. Realist evaluation tries to make sense of these complex interventions. It is a form of theory-driven evaluation, based on realist philosophy, that aims to understand why these complex interventions work, how, for whom, in what context and to what extent.ObjectivesOur objectives were to develop (a) quality standards, (b) reporting standards, (c) resources and training materials, (d) information and resources for patients and other lay participants and (e) to build research capacity among those interested in realist evaluation.MethodsTo develop the quality and reporting standards, we undertook a thematic review of the literature, supplemented by our content expertise and feedback from presentations and workshops. We synthesised findings into briefing materials for realist evaluations for the Delphi panel (a structured method using experts to develop consensus). To develop our resources and training materials, we drew on our experience in developing and delivering education materials, feedback from the Delphi panel, the RAMESES JISCMail e-mail list, training workshops and feedback from training sessions. To develop information and resources for patients and other lay participants in realist evaluation, we convened a group consisting of patients and the public. We built research capacity by running workshops and training sessions.ResultsOur literature review identified 152 realist evaluations, and when 37 of these had been analysed we were able to develop our briefing materials for the Delphi panel. The Delphi panel comprised 35 members from 27 organisations across six countries and five disciplines. Within three rounds, the panels had reached a consensus on 20 key reporting standards. The quality standards consist of eight criteria for realist evaluations. We developed resources and training materials for 15 theoretical and methodological topics. All resources are available online (www.ramesesproject.org). We provided methodological support to 17 projects and presentations or workshops to help build research capacity in realist evaluations to 29 organisations. Finally, we produced a generic patient information leaflet for lay participants in realist evaluations.LimitationsOur project had ambitious goals that created a substantial workload, leading to the need to prioritise objectives. For example, we truncated the literature review and focused on standards and training material development.ConclusionsAlthough realist evaluation holds much promise, misunderstandings and misapplications of it are common. We hope that our project’s outputs and activities will help to address these problems. Our resources are the start of an iterative journey of refinement and development of better resources for realist evaluations. The RAMESES II project seeks not to produce the last word on these issues, but to capture current expertise and establish an agreed state of the science. Much methodological development is needed in realist evaluation but this can take place only if there is a sufficient pool of highly skilled realist evaluators. Capacity building is the next key step in realist evaluation.FundingThe National Institute for Health Research Health Services and Delivery Research programme.

2014 ◽  
Vol 2 (30) ◽  
pp. 1-252 ◽  
Author(s):  
Geoff Wong ◽  
Trish Greenhalgh ◽  
Gill Westhorp ◽  
Ray Pawson

BackgroundThere is growing interest in theory-driven, qualitative and mixed-method approaches to systematic review, such as realist and meta-narrative review. These approaches offer the potential to expand the knowledge base in policy-relevant areas. However, the quality of such reviews can be difficult to assess.ObjectivesThe aim of this project was to produce methodological guidance, publication standards and training resources for those seeking to undertake realist and/or meta-narrative reviews.Methods/designWe (1) collated and summarised existing literature on the principles of good practice in realist and meta-narrative systematic reviews; (2) considered the extent to which these principles had been followed by published and in-progress reviews, thereby identifying how rigour may have been lost and how existing methods could be improved; (3) used an online Delphi method with an interdisciplinary panel of experts from academia and policy, to produce a draft set of methodological steps and publication standards; (4) produced training materials with learning objectives linked to these steps; (5) refined these standards and training materials prospectively on real reviews in progress, capturing methodological and other challenges as they arose; (6) synthesised expert input, evidence review and real-time problem analysis into more definitive guidance and standards; and (7) disseminated outputs to audiences in academia and policy.ResultsAn important element of this study was the establishment of an e-mail mailing list to bring together researches in the field (www.jiscmail.ac.uk/RAMESES). Our literature review identified 35 and nine realist and meta-narrative reviews respectively. Analysis and discussion within the project team produced a summary of the published literature, and common questions and challenges into briefing materials for the Delphi panel, comprising 37 and 33 members (for realist and meta-narrative reviews respectively). Within three rounds this panel had reached a consensus on 19 (realist) and 20 (meta-narrative) key publication standards, with an overall response rate of 90% and 91% respectively. The Realist And Meta-narrative Evidence Syntheses – Evolving Standards (RAMESES) publication standards for realist syntheses and meta-narrative reviews were published in open-access journals and quickly became highly accessed. The RAMESES quality standards and training materials drew together the following sources of data: (1) personal expertise as researchers and trainers; (2) data from the Delphi panels; (3) feedback from participants at training sessions we ran; and (4) comments made on RAMESES mailing list. The quality standards and training materials are freely available online (www.ramesesproject.org).DiscussionThe production of these standards and guidance drew on multiple sources of knowledge and expertise, and a high degree of a consensus was achieved despite ongoing debate among researchers about the overall place of these methodologies in the secondary research toolkit. As with all secondary research methods, guidance on quality assurance and uniform reporting is an important step towards improving quality and consistency of studies. We anticipate that as more reviews are undertaken, further refinement will be needed to the publication and quality standards and training materials.LimitationsThe project’s outputs are not definitive and in the future updating and further development is likely to be needed.ConclusionAn initial set of publication standards, quality standards and training materials have been produced for researchers, users and funders of realist or meta-narrative reviews. As realist and meta-narrative reviews are relatively new approaches to evidence synthesis, methodological development is needed for both review approaches.FundingThe National Institute for Health Research Health Services and Delivery Research programme.


2014 ◽  
Vol 3 (1) ◽  
pp. 1
Author(s):  
Agus Prasetyo ◽  
Sifrid Pangemanan

ABSTRAK Penelitian ini bertujuan untuk mengetahui mekanisme reviu Laporan Keuangan Pemerintah Daerah oleh Inspektorat Kabupaten Minahasa Tenggara pada setiap tahap perencanaan pelaksanaan dan pelaporan. Berdasarkan hasil penelitian ini, pelaksanaan reviu LKPD oleh Inspektorat Tahun Anggaran 2010 dan 2011 belum memberikan dampak signifikan terhadap peningkatan akuntabilitas LKPD. Pemerintah Daerah Kabupaten Minahasa Tenggara harus menyiapkan langkah-langkah perbaikaan mekanisme reviu pada setiap tahap perencaanaan, pelaksanaan dan pelaporan dengan mengikuti standar pedoman reviu (Peraturan Menteri Dalam Negeri Nomor 4 Tahun 2008), pendidikan dan pelatihan tenaga Inspektorat melalui koordinasi dengan BPKP, pemenuhan kuantitas, kualitas dan standar SDM Inspektorat serta identifikasi setiap permasalahan yang telah menyebabkan disclaimer opinion LKPD TA 2010 dan 2011 sebagai prioritas penentuan langkah perbaikan melalui koordinasi dengan pihak DPPKAD dan BPK RI. Kata Kunci :  Reviu Inspektorat, Akuntabilitas, Laporan Keuangan Pemerintah Daerah (LKPD) ABSTRACT This study aims to determine the mechanism of review of financial statements the Government Financial Reportby InspektoratKab. Minahasa Tenggara at every stage of planning, execution and reporting. Based on these results, the implementation of Review LKPD by Inspektorat for Year 2010 and 2011 has not been a significant impact on increasing accountability LKPD. The Goverment Minahasa Tenggara should prepare measures improvement review of mechanisms at each stage planning, execution and reporting standards by following the guideline of Review (Peraturan Menteri Dalam Negeri No. 4 Tahun 2008), the education and training Inspektorat personnel in coordination with BPK, fulfillment quantity, human resources and quality standards as well as the identification of any problems Inspektorat which has led disclaimer opinions LKPD year 2010 and 2011 as a priority determining corrective actions in coordination with the DPPKAD and BPK RI. Keywords: Review Inspektorat, Accountability, Government Finance Report (LKPD)


2013 ◽  
Vol 20 (3) ◽  
pp. 91-106 ◽  
Author(s):  
Rachel Pizarek ◽  
Valeriy Shafiro ◽  
Patricia McCarthy

Computerized auditory training (CAT) is a convenient, low-cost approach to improving communication of individuals with hearing loss or other communicative disorders. A number of CAT programs are being marketed to patients and audiologists. The present literature review is an examination of evidence for the effectiveness of CAT in improving speech perception in adults with hearing impairments. Six current CAT programs, used in 9 published studies, were reviewed. In all 9 studies, some benefit of CAT for speech perception was demonstrated. Although these results are encouraging, the overall quality of available evidence remains low, and many programs currently on the market have not yet been evaluated. Thus, caution is needed when selecting CAT programs for specific patients. It is hoped that future researchers will (a) examine a greater number of CAT programs using more rigorous experimental designs, (b) determine which program features and training regimens are most effective, and (c) indicate which patients may benefit from CAT the most.


Author(s):  
P. Bhavani ◽  
T. G. Amuthavally

The research for the review of literature is one of the first and foremost important steps in the research process. The search for related literature is a time consuming but fruitful phase of any research programme. In this article, the researcher was made an attempt to present findings from the collected related literature on parenting styles and emotional intelligence of adolescents. The main motto behind this article is to review of related literature from 1990 to till date. The paper also summarizes the findings of the studies on Emotional Intelligence and Parenting Styles giving a direction for future research.


BMJ Open ◽  
2021 ◽  
Vol 11 (3) ◽  
pp. e047118
Author(s):  
Joanne Welsh ◽  
Mechthild M Gross ◽  
Claudia Hanson ◽  
Hashim Hounkpatin ◽  
Ann-Beth Moller

IntroductionMaternal and neonatal mortality are disproportionally high in low-and middle-income countries. In 2017 the global maternal mortality ratio was estimated to be 211 per 100 000 live births. An estimated 66% of these deaths occurred in sub-Saharan Africa. Training programmes that aim to prepare providers of midwifery care vary considerably across sub-Saharan Africa in terms of length, content and quality. To overcome the shortfalls of pre-service training and support the provision of quality care, in-service training packages for providers of midwifery care have been developed and implemented in many countries in sub-Saharan Africa. We aim to identify what in-service education and training materials have been used for providers of midwifery care between 2000 and 2020 and map their content to the International Confederation of Midwives’ Essential Competencies for Midwifery Practice (ICM Competencies), and the Lancet Midwifery Series Quality Maternal and Newborn Care (QMNC) framework.Methods and analysisA search will be conducted for the years 2000–2020 in Cumulative Index of Nursing and Allied Health Literature, PubMed/MEDLINE, Social Sciences Citation Index, African Index Medicus and Google Scholar. A manual search of reference lists from identified studies and a hand search of literature from international partner organisations will be performed. Information retrieved will include study context, providers trained, focus of training and design of training. Original content of identified education and training materials will be obtained and mapped to the ICM Competencies and the Lancet Series QMNC.Ethics and disseminationA scoping review is a secondary analysis of published literature and does not require ethical approval. This scoping review will give an overview of the education and training materials used for in-service training for providers of midwifery care in sub-Saharan Africa. Mapping the content of these education and training materials to the ICM Competencies and The Lancet Series QMNC will allow us to assess their appropriateness. Findings from the review will be reflected to stakeholders involved in the design and implementation of such materials. Additionally, findings will be published in a peer-reviewed journal, and used to inform the design and content of an in-service training package for providers of midwifery care as part of the Action Leveraging Evidence to Reduce perinatal morTality and morbidity (ALERT) study, (https://alert.ki.se/) a multi-country study in Benin, Malawi, Tanzania and Uganda.Trial registration numberPACTR202006793783148; Post-results.


2021 ◽  
pp. 019394592110238
Author(s):  
Winnie Sun ◽  
Magda Grabkowski ◽  
Ping Zou ◽  
Bahar Ashtarieh

The purpose of this article is to report the literature review findings of our larger deprescribing initiative, with the goal of developing a competency framework about deprescribing to be incorporated into the future geriatric nursing education curriculum. A literature review was conducted to examine the facilitators and barriers faced by nurses with regard to the process of deprescribing for older adults, and the development of deprescribing competency in nursing education. We adopted the seven steps of the Comprehensive Literature Review Process Model, which is sub-divided into the following three phases (a) Exploration; (b) Interpretation; and (c) Communication. A total of 24 peer-reviewed documents revealed three major facilitating factors: (a) Effective education and training in deprescribing; (b) Need for continuing education and professional development in medication optimization; and (c) Benefits of multi-disciplinary involvement in medication management.


2020 ◽  
Vol 13 (11) ◽  
pp. 400
Author(s):  
Arnold G. Vulto ◽  
Jackie Vanderpuye-Orgle ◽  
Martin van der Graaff ◽  
Steven R. A. Simoens ◽  
Lorenzo Dagna ◽  
...  

Introduction: Biosimilars have the potential to enhance the sustainability of evolving health care systems. A sustainable biosimilars market requires all stakeholders to balance competition and supply chain security. However, there is significant variation in the policies for pricing, procurement, and use of biosimilars in the European Union. A modified Delphi process was conducted to achieve expert consensus on biosimilar market sustainability in Europe. Methods: The priorities of 11 stakeholders were explored in three stages: a brainstorming stage supported by a systematic literature review (SLR) and key materials identified by the participants; development and review of statements derived during brainstorming; and a facilitated roundtable discussion. Results: Participants argued that a sustainable biosimilar market must deliver tangible and transparent benefits to the health care system, while meeting the needs of all stakeholders. Key drivers of biosimilar market sustainability included: (i) competition is more effective than regulation; (ii) there should be incentives to ensure industry investment in biosimilar development and innovation; (iii) procurement processes must avoid monopolies and minimize market disruption; and (iv) principles for procurement should be defined by all stakeholders. However, findings from the SLR were limited, with significant gaps on the impact of different tender models on supply risks, savings, and sustainability. Conclusions: A sustainable biosimilar market means that all stakeholders benefit from appropriate and reliable access to biological therapies. Failure to care for biosimilar market sustainability may impoverish biosimilar development and offerings, eventually leading to increased cost for health care systems and patients, with fewer resources for innovation.


2000 ◽  
Vol 63 (2) ◽  
pp. 65-75 ◽  
Author(s):  
Trish Wielandt ◽  
Jenny Strong

This article describes a literature review that examined the topic of the postdischarge compliance of individuals with prescribed adaptive equipment. Assisting individuals to accomplish tasks relevant to their activities of daily living and thereby achieve functional independence is central to the role of occupational therapy. The prescription of adaptive equipment is a frequently used intervention. The rationale for prescribing adaptive equipment is that it maximises a client's functional potential, allows for independence in activities of daily living and fosters confidence as a result of being able to accomplish such tasks. All studies that surveyed compliance with prescribed adaptive equipment between 1963 and 1996 were reviewed. The factors that reportedly affect compliance by individuals can be considered under five discrete categories: medical-related, client-related, equipment-related, assessment-related and training-related. On the basis of the findings of this literature review, recommendations are made for further research, specifically investigating methods that therapists could incorporate into current practice to address the problem of non-compliance with prescribed adaptive equipment.


2021 ◽  
Vol 25 (05) ◽  
pp. 641-645
Author(s):  
Ajay Kohli ◽  
Samantha Castillo ◽  
Uma Thakur ◽  
Avneesh Chhabra

AbstractMusculoskeletal (MSK) radiologists are predominantly consultants in the service departments of health care. Unlike the manufacturing industry, quality controls are difficult to institute in a service industry and more variability is expected. Structured reporting is a unique way to institute quality standards, and by using the checklist approach with uniform terminology, it can lead to more homogeneity and consistency of reporting, concise lexicon use within and across practices, minimization of errors, enhancement of divisional and departmental branding, improvement of interdisciplinary communications, and future data mining. We share our experience from more than a decade of structured reporting in the domain of MSK radiology, our practice standards, and how reporting has evolved in our MSK practice. Further discussions include future directions aided by machine learning approaches with augmented reality and the possibility of virtual fellowship and training using consistent lexicons and structured reporting.


Sign in / Sign up

Export Citation Format

Share Document