scholarly journals An Assessment Framework for e-Mental Health Apps in Canada: Results of a Modified Delphi Process

10.2196/10016 ◽  
2018 ◽  
Vol 6 (7) ◽  
pp. e10016 ◽  
Author(s):  
Jennifer Zelmer ◽  
Krystle van Hoof ◽  
MaryAnn Notarianni ◽  
Trevor van Mierlo ◽  
Megan Schellenberg ◽  
...  
Keyword(s):  
Mental Health ◽  
Delphi Process ◽  
Assessment Framework ◽  
Health Apps ◽  
Modified Delphi

scholarly journals An Assessment Framework for e-Mental Health Apps in Canada: Results of a Modified Delphi Process (Preprint)

2018 ◽  
Author(s):  
Jennifer Zelmer ◽  
Krystle van Hoof ◽  
MaryAnn Notarianni ◽  
Trevor van Mierlo ◽  
Megan Schellenberg ◽  
...  
Keyword(s):  
Mental Health ◽  
Delphi Process ◽  
Security And Privacy ◽  
Rapid Review ◽  
Evidence Based ◽  
Assessment Framework ◽  
Health Apps ◽  
Modified Delphi ◽  
Mapping Process ◽  
Guiding Principles

BACKGROUND The number of e-mental health apps is increasing rapidly. Studies have shown that the use of some apps is beneficial, whereas others are ineffective or do not meet users’ privacy expectations. Individuals and organizations that curate, recommend, host, use, or pay for apps have an interest in categorizing apps according to the consensus criteria of usability and effectiveness. Others have previously published recommendations for assessing health-related apps; however, the extent to which these recommendations can be generalized across different population groups (eg, culture, gender, and language) remains unclear. This study describes an attempt by Canadian stakeholders to develop an e-mental health assessment framework that responds to the unique needs of people living in Canada in an evidence-based manner. OBJECTIVE The objective of our study was to achieve consensus from a broad group of Canadian stakeholders on guiding principles and criteria for a framework to assess e-mental health apps in Canada. METHODS We developed an initial set of guiding principles and criteria from a rapid review and environmental scan of pre-existing app assessment frameworks. The initial list was refined through a two-round modified Delphi process. Participants (N=25) included app developers and users, health care providers, mental health advocates, people with lived experience of a mental health problem or mental illness, policy makers, and researchers. Consensus on each guideline or criterion was defined a priori as at least 70% agreement. The first round of voting was conducted electronically. Prior to Round 2 voting, in-person presentations from experts and a persona empathy mapping process were used to explore the perspectives of diverse stakeholders. RESULTS Of all respondents, 68% (17/25) in Round 1 and 100% (13/13) in Round 2 agreed that a framework for evaluating health apps is needed to help Canadian consumers identify high-quality apps. Consensus was reached on 9 guiding principles: evidence based, gender responsive, culturally appropriate, user centered, risk based, internationally aligned, enabling innovation, transparent and fair, and based on ethical norms. In addition, 15 informative and evaluative criteria were defined to assess the effectiveness, functionality, clinical applicability, interoperability, usability, transparency regarding security and privacy, security or privacy standards, supported platforms, targeted users, developers’ transparency, funding transparency, price, user desirability, user inclusion, and meaningful inclusion of a diverse range of communities. CONCLUSIONS Canadian mental health stakeholders reached the consensus on a framework of 9 guiding principles and 15 criteria important in assessing e-mental health apps. What differentiates the Canadian framework from other scales is explicit attention to user inclusion at all stages of the development, gender responsiveness, and cultural appropriateness. Furthermore, an empathy mapping process markedly influenced the development of the framework. This framework may be used to inform future mental health policies and programs.

Veterans Affairs and the Department of Defense mental health apps: A systematic literature review.

2019 ◽  
Vol 16 (2) ◽  
pp. 196-207 ◽  
Author(s):  
Christine E. Gould ◽  
Brian C. Kok ◽  
Vanessa K. Ma ◽  
Aimee Marie L. Zapata ◽  
Jason E. Owen ◽  
...  
Keyword(s):  
Mental Health ◽  
Literature Review ◽  
Systematic Literature Review ◽  
Department Of Defense ◽  
Veterans Affairs ◽  
Health Apps

Nutrition in Primary Health Care: Using a Delphi Process To Design New Interdisciplinary Services

2006 ◽  
Vol 67 (S1) ◽  
pp. S14-S29 ◽  
Author(s):  
Paula Brauer ◽  
Linda Dietrich ◽  
Bridget Davidson ◽  
Keyword(s):  
Primary Care ◽  
Health Care ◽  
Health Care Providers ◽  
Administrative Support ◽  
Care Service ◽  
Delphi Process ◽  
Care Providers ◽  
Modified Delphi ◽  
Nutrition Services ◽  
Key Features

Purpose: A modified Delphi process was used to identify key features of interdisciplinary nutrition services, including provider roles and responsibilities for Ontario Family Health Networks (FHNs), a family physician-based type of primary care. Methods: Twenty-three representatives from interested professional organizations, including three FHN demonstration sites, completed a modified Delphi process. Participants reviewed evidence from a systematic literature review, a patient survey, a costing analysis, and key informant interview results before undertaking the Delphi process. Statements describing various options for services were developed at an in-person meeting, which was followed by two rounds of e-mail questionnaires. Teleconference discussions were held between rounds. Results: An interdisciplinary model with differing and complementary roles for health care providers emerged from the process. Additional key features addressing screening for nutrition problems, health promotion and disease prevention, team collaboration, planning and evaluation, administrative support, access to care, and medical directives/delegated acts were identified. Under the proposed model, the registered dietitian is the team member responsible for managing all aspects of nutrition services, from needs assessment to program delivery, as well as for supporting all providers’ nutrition services. Conclusions: The proposed interdisciplinary nutrition services model merits evaluation of cost, effectiveness, applicability, and sustainability in team-based primary care service settings.

Identifying the capabilities most important for veterinary employability using a modified Delphi process

2021 ◽  
Author(s):  
Melinda A. Bell ◽  
Martin A. Cake ◽  
Laura T. King ◽  
Caroline F. Mansfield
Keyword(s):  
Delphi Process ◽  
Modified Delphi

scholarly journals Development of an explicit tool assessing potentially inappropriate medication use in Hong Kong elder patients

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Huanyu Zhang ◽  
Eliza LY Wong ◽  
Eng-kiong Yeoh ◽  
Bosco HM Ma
Keyword(s):  
Hong Kong ◽  
Inappropriate Medication ◽  
Delphi Process ◽  
Potentially Inappropriate Medication ◽  
Medical Conditions ◽  
Modified Delphi ◽  
Adverse Health Outcomes ◽  
Elder Patients ◽  
Prescribing Quality ◽  
Prescribing Practice

Abstract Background Potentially inappropriate medication (PIM) use has adverse effects on health, particularly in elder patients. Various country-specific explicit criteria have been developed to measure the appropriateness of prescribing worldwide. However, it is difficult to apply the criteria developed from other regions to measure and guide the local prescribing practice in Hong Kong. This study aims to develop a Hong Kong-specific PIM assessing tool from previously published criteria and validate this tool using the modified Delphi method. Methods A disease-oriented Hong Kong-specific preliminary PIM list was developed based on nine sets of reference criteria selected from a literature review. Any medication or medication class appeared in at least two sets of the reference criteria as well as its related medical conditions were selected as PIM candidates. After examining the availability of PIM candidates by the Hong Kong Hospital Authority drug formulary, the Hong Kong-specific preliminary PIM list was validated by a two-round of modified Delphi process. Eight experts from different specialties were invited to rate the degree of inappropriateness of each PIM candidate using a five-point Likert scale. The experts were also encouraged to propose therapeutic alternatives and new PIM candidates not covered by the preliminary PIM list. The PIM candidates that the expert panel didn’t reach consensus on were excluded from the final Hong Kong-specific PIM list. Results After two rounds of the Delphi process, eight PIM candidates remained questionable and thus were excluded from the PIM list. The final Hong Kong-specific PIM list included a total of 164 statements applicable to older adults aged 65 years or above, among which 77 were under PIMs independent of diagnoses, and 87 were under PIMs considering specific medical conditions. Conclusions The Hong Kong-specific PIM list can be used as a quality measure and an educational tool to improve the local prescribing quality. Further studies should validate its association with adverse health outcomes in clinical and research settings.

The effects of mobile apps on stress, anxiety, and depression: overview of systematic reviews

2020 ◽  
pp. 1-11
Author(s):  
Fatemeh Khademian ◽  
Azam Aslani ◽  
Peivand Bastani
Keyword(s):  
Mental Health ◽  
Systematic Reviews ◽  
Behavioral Activation ◽  
Behavioral Therapy ◽  
Mobile Apps ◽  
Conclusive Evidence ◽  
Anxiety And Depression ◽  
Health Apps ◽  
Acceptance And Commitment ◽  
Overview Of Systematic Reviews

Abstract Objectives Despite a large number of mobile apps in the field of mental health, it is difficult to find a useful and reliable one, mainly due to the fact that the effectiveness of many apps has not been assessed scientifically. The present study aimed to assess the effects of mental health apps on managing the symptoms of stress, anxiety, and depression. Methods A comprehensive literature search was conducted in PubMed, Scopus, EMBASE, Cochrane, and Web of Science databases for the papers published from 2000 to 2019. Studies were included if they reviewed articles or mobile apps for their effectiveness in stress, anxiety, and depression. The reviews that had considered mobile apps or web-based mobile applications as an intervention or part of intervention were included, as well. Results A total of 4,999 peer-reviewed articles were identified, out of which nine systematic reviews met the inclusion criteria. Seven systematic reviews measured depression outcomes, three measured stress, and five systematic reviews measured anxiety symptoms. The applications that used behavior change strategies, such as Cognitive Behavioral Therapy, Acceptance and Commitment Therapy, and Behavioral Activation, reported significant effects on depression, anxiety, and stress. Conclusion It seems that mental health apps can be promising media for reducing depressive symptoms. This field is an emerging area of mobile health, and further research should be done in future in order to reach conclusive evidence.

scholarly journals Development of an international standard set of patient-centred outcome measures for overall paediatric health: a consensus process

2020 ◽  
pp. archdischild-2020-320345
Author(s):  
Beatrix Algurén ◽  
Jessily P Ramirez ◽  
Matthew Salt ◽  
Nick Sillett ◽  
Stacie N Myers ◽  
...  
Keyword(s):  
Outcome Measures ◽  
Healthcare Delivery ◽  
Well Being ◽  
Delphi Process ◽  
Global Perspective ◽  
Modified Delphi ◽  
Starting Point ◽  
Patient Reported ◽  
Standard Set ◽  
Paediatric Health

ObjectiveTo develop an Overall Pediatric Health Standard Set (OPH-SS) of outcome measures that captures what matters to young people and their families and recognising the biopsychosocial aspects of health for all children and adolescents regardless of health condition.DesignA modified Delphi process.SettingThe International Consortium for Health Outcomes Measurement convened an international Working Group (WG) comprised of 23 international experts from 12 countries in the field of paediatrics, family medicine, psychometrics as well as patient advisors. The WG participated in 11 video-conferences, through a modified Delphi process and 9 surveys between March 2018 and January 2020 consensus was reached on a final recommended health outcome standard set. By a literature review conducted in March 2018, 1136 articles were screened for clinician and patient-reported or proxy-reported outcomes. Further, 4315 clinical trials and 12 paediatric health surveys were scanned. Between November 2019 and January 2020, the final standard set was endorsed by a patient validation (n=270) and a health professional (n=51) survey.ResultsFrom a total of 63 identified outcomes, consensus was formed on a standard set of outcome measures that comprises 10 patient-reported outcomes, 5 clinician-reported measures, and 6 case-mix variables. The four developmental age-specific packages (ie, 0–5, 6–12, 13–17, 18–24 years) include either five or six measures with an average time for completion of 20 min.ConclusionsThe OPH-SS is a starting point to drive value-based paediatric healthcare delivery from a global perspective for enhancing child and adolescent physical health and psychosocial well-being.

Interdisciplinary Development of a Transdiagnostic Mobile App to Enhance Children’s Emotion Regulation: Sharing Insights and Lessons Learned (Preprint)

2021 ◽  
Author(s):  
Bettina Moltrecht ◽  
Praveetha Patalay ◽  
Holly Alice Bear ◽  
Jessica Deighton ◽  
Julian Edbrooke-Childs
Keyword(s):  
Mental Health ◽  
Emotion Regulation ◽  
Young People ◽  
Design Process ◽  
Public Engagement ◽  
Mobile Apps ◽  
High Tech ◽  
Classroom Observations ◽  
Health Apps ◽  
Interdisciplinary Framework

BACKGROUND Digital interventions, including mobile apps represent promising means to provide effective mental health support to young people. Despite the increased availability of mental health apps, there is a significant gap for this age group, especially for younger children. Research investigating the effectiveness and development process of child mental health apps is limited, and the field faces persistent issues in relation to low user up-take and engagement, which is assumed to be a result of lacking interdisciplinary approaches. OBJECTIVE We present the development and design process of a new mental health app for children that targets their emotion regulation abilities. We describe the creation of a new interdisciplinary development framework, to guide the design process, and explain how each activity informed different app features. METHODS The first two stages of the framework employed a variety of methods, including: 1) classroom observations, 2) public-engagement events with the target group (N=21), 3) synthesis of the existing evidence as part of a meta-analysis, 4) a series of co-design and participatory workshops with young users (N=33), clinicians (N=7), researchers (N=12), app developers (N=1) , designers (N=2), and lastly 5) testing of the first high-tech prototype (N=15). RESULTS For the interdisciplinary framework we drew on methods derived from the medical research council framework for complex interventions, the patient-clinician-framework and Druin’s cooperative inquiry. The classroom observations, public-engagement events, and synthesis of the existing evidence informed the first key pillars of the app and wireframes. Subsequently, a series of workshops shaped and reshaped the content and app features, including games, psychoeducational films, and practice modules. Based on the prototype testing sessions we made further adjustments to improve the app. CONCLUSIONS Although mobile apps could be highly suitable to support young people’s mental health on a wider scale, there is little guidance on how these interventions could be designed. The involvement of the different methods and especially the young users was very valuable. We hope that the interdisciplinary framework and multiple methods that we applied will be helpful to others who are also aiming to develop suitable apps for young people.

Sign in / Sign up

Export Citation Format

Share Document