A Web-Based Delphi Study on the Indications of Chest Radiographs for Patients in ICUs

CHEST Journal ◽  
2008 ◽  
Vol 133 (5) ◽  
pp. 1107-1112 ◽  
Author(s):  
Gilles Hejblum ◽  
Vincent Ioos ◽  
Jean-François Vibert ◽  
Pierre-Yves Böelle ◽  
Ludivine Chalumeau-Lemoine ◽  
...  
2013 ◽  
Vol 33 (11) ◽  
pp. 1322-1328 ◽  
Author(s):  
Fenella J. Gill ◽  
Gavin D. Leslie ◽  
Carol Grech ◽  
Jos M. Latour

2020 ◽  
Author(s):  
Cason Schmit ◽  
Kobi V Ajayi ◽  
Alva O Ferdinand ◽  
Theodoros Giannouchos ◽  
Gurudev Ilangovan ◽  
...  

BACKGROUND There is substantial prior research on the perspectives of patients on the use of health information for research. Numerous communication barriers challenge transparency between researchers and data participants in secondary database research (eg, waiver of informed consent and knowledge gaps). Individual concerns and misconceptions challenge the trust in researchers among patients despite efforts to protect data. Technical software used to protect research data can further complicate the public's understanding of research. For example, MiNDFIRL (Minimum Necessary Disclosure For Interactive Record Linkage) is a prototype software that can be used to enhance the confidentiality of data sets by restricting disclosures of identifying information during the record linkage process. However, software, such as MiNDFIRL, which is used to protect data, must overcome the aforementioned communication barriers. One proposed solution is the creation of an interactive web-based frequently asked question (FAQ) template that can be adapted and used to communicate research issues to data subjects. OBJECTIVE This study aims to improve communication with patients and transparency about how complex software, such as MiNDFIRL, is used to enhance privacy in secondary database studies to maintain the public's trust in researchers. METHODS A Delphi technique with 3 rounds of the survey was used to develop the FAQ document to communicate privacy issues related to a generic secondary database study using the MiNDFIRL software. The Delphi panel consisted of 38 patients with chronic health conditions. We revised the FAQ between Delphi rounds and provided participants with a summary of the feedback. We adopted a conservative consensus threshold of less than 10% negative feedback per FAQ section. RESULTS We developed a consensus language for 21 of the 24 FAQ sections. Participant feedback demonstrated preference differences (eg, brevity vs comprehensiveness). We adapted the final FAQ into an interactive web-based format that 94% (31/33) of the participants found helpful or very helpful. The template FAQ and MiNDFIRL source code are available on GitHub. The results indicate the following patient communication considerations: patients have diverse and varied preferences; the tone is important but challenging; and patients want information on security, identifiers, and final disposition of information. CONCLUSIONS The findings of this study provide insights into what research-related information is useful to patients and how researchers can communicate such information. These findings align with the current understanding of health literacy and its challenges. Communication is essential to transparency and ethical data use, yet it is exceedingly challenging. Developing FAQ template language to accompany a complex software may enable researchers to provide greater transparency when informed consent is not possible.


2021 ◽  
Vol 94 (1123) ◽  
pp. 20210435
Author(s):  
Gavin E Duggan ◽  
Joshua J Reicher ◽  
Yun Liu ◽  
Daniel Tse ◽  
Shravya Shetty

Objective: Demonstrate the importance of combining multiple readers' opinions, in a context-aware manner, when establishing the reference standard for validation of artificial intelligence (AI) applications for, e.g. chest radiographs. By comparing individual readers, majority vote of a panel, and panel-based discussion, we identify methods which maximize interobserver agreement and label reproducibility. Methods: 1100 frontal chest radiographs were evaluated for 6 findings: airspace opacity, cardiomegaly, pulmonary edema, fracture, nodules, and pneumothorax. Each image was reviewed by six radiologists, first individually and then via asynchronous adjudication (web-based discussion) in two panels of three readers to resolve disagreements within each panel. We quantified the reproducibility of each method by measuring interreader agreement. Results: Panel-based majority vote improved agreement relative to individual readers for all findings. Most disagreements were resolved with two rounds of adjudication, which further improved reproducibility for some findings, particularly reducing misses. Improvements varied across finding categories, with adjudication improving agreement for cardiomegaly, fractures, and pneumothorax. Conclusion: The likelihood of interreader agreement, even within panels of US board-certified radiologists, must be considered before reads can be used as a reference standard for validation of proposed AI tools. Agreement and, by extension, reproducibility can be improved by applying majority vote, maximum sensitivity, or asynchronous adjudication for different findings, which supports the development of higher quality clinical research. Advances in knowledge: A panel of three experts is a common technique for establishing reference standards when ground truth is not available for use in AI validation. The manner in which differing opinions are resolved is shown to be important, and has not been previously explored.


2018 ◽  
Author(s):  
Jodie L Matar ◽  
Darryl J Maybery ◽  
Louise A McLean ◽  
Andrea Reupert

BACKGROUND Young people who have a parent with a mental illness face elevated risks to their mental health and well-being. However, they may not have access to appropriate interventions. Web-based interventions may reach and meet the needs of this at-risk group, yet their preferences regarding the features of this medium are unknown. OBJECTIVE This study sought to determine the utility of a Web-based intervention to meet the needs of young people who have a parent with a mental illness and their perspectives regarding the types of features of such a website. METHODS A systematic, 2-round Delphi study was employed to solicit the views of 282 young people aged 16 to 21 years (Round 1, n=14; Round 2, n=268) from urban and regional settings in Australia who self-reported that their parent has a mental illness. “Regional” was used to refer to nonurban participants in the study. After ascertaining whether a Web-based intervention was warranted, Web-based intervention features were identified, including how the site might be facilitated, topics, duration and frequency, and the nature of the professional contact. The extent to which young people agreed on the importance of these factors was assessed. Differences and similarities across gender and location were investigated. A mixed method analytic framework was employed using thematic analysis as well as 2-way between-groups analysis of covariance (ANCOVA) controlling for age and chi-square test of independence analysis. RESULTS Both rounds highlighted a strong preference for a Web-based intervention. Consensus was reached for a professionally monitored site, young people and professionals having equal input into the weekly facilitated sessions (eg, sharing the lead role in discussions or deciding on relevant session content), unlimited time access, 1-hour, open discussion, weekly sessions over 6 weeks, psychoeducation about mental illness, and considerations for the management of safety violations. There were significant main effects of location type and several of the preferred features for a Web-based intervention for young people who have a parent with a mental illness. However, effect sizes were small to moderate, limiting practical application. CONCLUSIONS Young people aged 16 to 21 years indicated a need for a professionally monitored, psychoeducational, Web-based intervention, with input from professional facilitators and other young people who have a parent with a mental illness, in addition to recommendations to external resources. These findings may inform the development of future Web-based interventions for this highly vulnerable group.


2021 ◽  
Vol 30 (2) ◽  
pp. 179-195
Author(s):  
JC Muldoon ◽  
JM Williams

Many animal welfare organisations deliver education programmes for children and young people, or design materials for schoolteachers to use. However, few of these are scientifically evaluated, making it difficult for those working in this field to establish with any certainty the degree of success of their own programmes, or learn from others. There has been no guidance specifically tailored to the development and evaluation of animal welfare education interventions. Accordingly, a three-stage online Delphi study was designed to unearth the expertise of professionals working in this field and identify degree of consensus on various aspects of the intervention process: design, implementation and evaluation. Thirty-one experts participated in Round 1, representing eleven of 13 organisations in the Scottish Animal Welfare Education Forum (SAWEF), and eleven of 23 members of the wider UK-based Animal Welfare Education Alliance (AWEA). Seven further professionals participated, including four based in Canada or the US. Eighty-four percent of the original sample participated in Round 2, where a high level of consensus was apparent. However, the study also revealed areas of ambiguity (determining priorities, the need for intervention structure and degree of success). Tensions were also evident with respect to terminology (especially around cruelty and cruelty prevention), and the common goal for animal welfare to be part of school curricula. Findings were used to develop a web-based framework and toolkit to enable practitioners to follow evidence-based guidance. This should enable organisations to maximise the quality and effectiveness of their interventions for children and young people.


2009 ◽  
Vol 11 (2) ◽  
pp. 42-52 ◽  
Author(s):  
Justine N. Whitham ◽  
Kylie Eddy ◽  
Darryl Maybery ◽  
Andrea Reupert ◽  
Elizabeth Fudge

2014 ◽  
Vol 2014 ◽  
pp. 1-8
Author(s):  
Xiaona Liu ◽  
Vicki Erasmus ◽  
Xinying Sun ◽  
Rui Cai ◽  
Yuhui Shi ◽  
...  

This study is a step towards a behavioral intervention to prevent HIV transmission among Chinese internal migrants. To explore important and changeable determinants of condom use and inspect effective and feasible methods to increase condom use for the target population, we conducted a three-round web-based Delphi study among a panel of 62 experts between October 2012 and March 2013. The panelists were purposely selected using a stepwise procedure to represent topic-related areas of expertise. The response rate per round ranges from 21% to 81%. The panelists identified 19 possible determinants of condom use and reported 16 intervention methods they considered successful. They agreed that attitude towards condom use was the most important and changeable determinant, while applying behavioral theory, increasing sexual education and condom access, performing worksite health promotion, detecting risk factors, and working closely with relevant organizations and the government were effective and feasible methods to increase condom use among internal migrants in China. In conclusion, results of this study highlight the importance of attitude in changing condom use and underscore the need to apply behavior theory and integrate multiple educational approaches for developing behavioral HIV prevention interventions targeting internal migrants in China.


Sign in / Sign up

Export Citation Format

Share Document