Quality Principles of App Description Texts and Their Significance in Deciding to Use Health Apps as Assessed by Medical Students: Survey Study (Preprint)

2019 ◽  
Author(s):  
Urs-Vito Albrecht ◽  
Christin Malinka ◽  
Sarah Long ◽  
Tobias Raupach ◽  
Gerd Hasenfuß ◽  
...  
Keyword(s):  
Medical Students ◽  
Data Storage ◽  
Conflicts Of Interest ◽  
Relevant Information ◽  
Survey Study ◽  
Sufficient Information ◽  
Health Apps ◽  
Quality Principles ◽  
University Of Göttingen ◽  
The University

BACKGROUND Currently, there are no binding requirements for manufacturers prescribing which information must be included in the app descriptions of health apps. OBJECTIVE The aim of this study was to investigate how medical students perceive a selection of quality principles, intended for usage decisions in the app context, and establish whether the information presented in a sample of app descriptions is perceived as sufficient for facilitating an informed usage decision. METHODS A total of 123 students (mean age 24.2 years, SD 3.4) participating in a 6-week teaching module covering cardiology and pulmonology at the University of Göttingen (original enrollment 152 students, response rate 80.9%) were included. Students were asked to read 3 store description texts of cardiological or pneumological apps and initially assess whether the descriptions sufficed for a usage decision. Subsequently, they were queried on their perception of the relevance of 9 predefined quality principles, formulated for usage decisions. An appraisal of whether the app description texts contained sufficient information to satisfy these quality principles followed. By means of 20 guiding questions, participants were then asked to identify relevant information (or a lack thereof) within the descriptions. A reassessment of whether the description texts sufficed for making a usage decision ensued. A total of 343 complete datasets were obtained. RESULTS A majority of the quality principles were described as “very important” and “important” for making a usage decision. When accessed via the predefined principles, students felt unable to identify sufficient information within the app descriptions in 68.81% (2124/3087) of cases. Notably, information regarding undesired effects (91.8%, 315/343), ethical soundness (90.1%, 309/343), measures taken to avert risks (89.2%, 306/343), conflicts of interest (88.3%, 303/343), and the location of data storage (87.8%, 301/343) was lacking. Following participants’ engagement with the quality principles, statistically significant changes in their assessment of whether the app descriptions sufficed for a usage decision can be seen—McNemar-Bowker test (3)=45.803919, P<.001, Cohen g=.295. In 34.1% (117/343) cases, the assessment was revised. About 3 quarters of changed assessments were seen more critically (76.9%, 90/117). Although, initially, 70% (240/343) had been considered “sufficient,” this rate was reduced to 54.2% (186/343) in the second assessment. CONCLUSIONS In a considerable number of app descriptions, participants were unable to locate the information necessary for making an informed usage decision. Participants’ sensitization to the quality principles led to changes in their assessment of app descriptions as a tool for usage decisions. Better transparency in app descriptions released by manufacturers and the exposure of users to quality principles could collectively form the basis for well-founded usage decisions.

scholarly journals Quality Principles of App Description Texts and Their Significance in Deciding to Use Health Apps as Assessed by Medical Students: Survey Study

10.2196/13375 ◽  
2019 ◽  
Vol 7 (2) ◽  
pp. e13375 ◽  
Author(s):  
Urs-Vito Albrecht ◽  
Christin Malinka ◽  
Sarah Long ◽  
Tobias Raupach ◽  
Gerd Hasenfuß ◽  
...  
Keyword(s):  
Medical Students ◽  
Survey Study ◽  
Health Apps ◽  
Quality Principles

scholarly journals Prioritization of Quality Principles for Health Apps Using the Kano Model: Survey Study (Preprint)

2020 ◽  
Author(s):  
Christin Malinka ◽  
Ute von Jan ◽  
Urs-Vito Albrecht
Keyword(s):  
Online Survey ◽  
Test Group ◽  
Resource Efficiency ◽  
Point Of View ◽  
Survey Study ◽  
Kano Model ◽  
Lower Priority ◽  
Health Apps ◽  
Quality Principles ◽  
Survey Methodologies

BACKGROUND Health apps are often used without adequately taking aspects related to their quality under consideration. This may partially be due to inadequate awareness about necessary criteria and how to prioritize them when evaluating an app. OBJECTIVE The aim of this study was to introduce a method for prioritizing quality attributes in the mobile health context. To this end, physicians were asked about their assessment of nine app quality principles relevant in health contexts and their responses were used as a basis for designing a method for app prioritization. Ultimately, the goal was to aid in making better use of limited resources (eg, time) by assisting with the decision as to the specific quality principles that deserve priority in everyday medical practice and those that can be given lower priority, even in cases where the overall principles are rated similarly. METHODS A total of 9503 members of two German professional societies in the field of orthopedics were invited by email to participate in an anonymous online survey over a 1-month period. Participants were asked to rate a set of nine app quality principles using a Kano survey with functional and dysfunctional (ie, positively and negatively worded) questions. The evaluation was based on the work of Kano (baseline), supplemented by a self-designed approach. RESULTS Among the 9503 invited members, 382 completed relevant parts of the survey (return rate of 4.02%). These participants were equally and randomly assigned to two groups (test group and validation group, n=191 each). Demographic characteristics did not significantly differ between groups (all <i>P</i>&gt;.05). Participants were predominantly male (328/382, 85.9%) and older than 40 years (290/382, 75.9%). Given similar ratings, common evaluation strategies for Kano surveys did not allow for conclusive prioritization of the principles, and the same was true when using the more elaborate approach of satisfaction and dissatisfaction indices following the work of Timko. Therefore, an extended, so-called “in-line-of-sight” method was developed and applied for this evaluation. Modified from the Timko method, this approach is based on a “point of view” (POV) metric, which generates a ranking coefficient. Although the principles were previously almost exclusively rated as <i>must-be</i> (with the exception of resource efficiency), which was not conducive to their prioritization, the new method applied from the <i>must-be</i> POV resulted in identical rankings for the test and validation groups: (1) legal conformity, (2) content validity, (3) risk adequacy, (4) practicality, (5) ethical soundness, (6) usability, (7) transparency, (8) technical adequacy, and (9) resource efficiency. CONCLUSIONS Established survey methodologies based on the work of Kano predominantly seek to categorize the attributes to be evaluated. The methodology presented here is an interesting option for prioritization, and enables focusing on the most important criteria, thus saving valuable time when reviewing apps for use in the medical field, even with otherwise largely similar categorization results. The extent to which this approach is applicable beyond the scenario presented herein requires further investigation.

scholarly journals Prioritization of Quality Principles for Health Apps Using the Kano Model: Survey Study

10.2196/26563 ◽  
2022 ◽  
Vol 10 (1) ◽  
pp. e26563
Author(s):  
Christin Malinka ◽  
Ute von Jan ◽  
Urs-Vito Albrecht
Keyword(s):  
Online Survey ◽  
Test Group ◽  
Resource Efficiency ◽  
Point Of View ◽  
Survey Study ◽  
Kano Model ◽  
Lower Priority ◽  
Health Apps ◽  
Quality Principles ◽  
Survey Methodologies

Background Health apps are often used without adequately taking aspects related to their quality under consideration. This may partially be due to inadequate awareness about necessary criteria and how to prioritize them when evaluating an app. Objective The aim of this study was to introduce a method for prioritizing quality attributes in the mobile health context. To this end, physicians were asked about their assessment of nine app quality principles relevant in health contexts and their responses were used as a basis for designing a method for app prioritization. Ultimately, the goal was to aid in making better use of limited resources (eg, time) by assisting with the decision as to the specific quality principles that deserve priority in everyday medical practice and those that can be given lower priority, even in cases where the overall principles are rated similarly. Methods A total of 9503 members of two German professional societies in the field of orthopedics were invited by email to participate in an anonymous online survey over a 1-month period. Participants were asked to rate a set of nine app quality principles using a Kano survey with functional and dysfunctional (ie, positively and negatively worded) questions. The evaluation was based on the work of Kano (baseline), supplemented by a self-designed approach. Results Among the 9503 invited members, 382 completed relevant parts of the survey (return rate of 4.02%). These participants were equally and randomly assigned to two groups (test group and validation group, n=191 each). Demographic characteristics did not significantly differ between groups (all P>.05). Participants were predominantly male (328/382, 85.9%) and older than 40 years (290/382, 75.9%). Given similar ratings, common evaluation strategies for Kano surveys did not allow for conclusive prioritization of the principles, and the same was true when using the more elaborate approach of satisfaction and dissatisfaction indices following the work of Timko. Therefore, an extended, so-called “in-line-of-sight” method was developed and applied for this evaluation. Modified from the Timko method, this approach is based on a “point of view” (POV) metric, which generates a ranking coefficient. Although the principles were previously almost exclusively rated as must-be (with the exception of resource efficiency), which was not conducive to their prioritization, the new method applied from the must-be POV resulted in identical rankings for the test and validation groups: (1) legal conformity, (2) content validity, (3) risk adequacy, (4) practicality, (5) ethical soundness, (6) usability, (7) transparency, (8) technical adequacy, and (9) resource efficiency. Conclusions Established survey methodologies based on the work of Kano predominantly seek to categorize the attributes to be evaluated. The methodology presented here is an interesting option for prioritization, and enables focusing on the most important criteria, thus saving valuable time when reviewing apps for use in the medical field, even with otherwise largely similar categorization results. The extent to which this approach is applicable beyond the scenario presented herein requires further investigation.

scholarly journals Survey of Palliative Care Concepts among Medical Students and Interns in Austria: A Comparison of the Old and the New curriculum of the Medical University of Vienna

2008 ◽  
Vol 2 ◽  
pp. PCRT.S925
Author(s):  
G. Pohl ◽  
C. Marosi ◽  
K. Dieckmann ◽  
G. Goldner ◽  
K. Elandt ◽  
...  
Keyword(s):  
Palliative Care ◽  
Medical Students ◽  
Study Data ◽  
Survey Study ◽  
Care Education ◽  
University Of Vienna ◽  
Palliative Care Education ◽  
New Curriculum ◽  
The University ◽  
Medical University

Background To improve the level of awareness in palliative care concepts, the new curriculum at the University of Vienna includes sixteen hours of palliative care education. The old curriculum did not include palliative care education. Aim To compare the level of awareness in palliative care concepts among 4th year students of the new curriculum of the Medical University of Vienna with interns who finished their studies in the old curriculum. Materials and methods: 440 medical students in their 4th year and 149 interns participated in a survey study. Data were collected after the survey and the responses were analyzed. Results Data analysis consists of completed survey obtained from 83% and 67% of the students and interns. We observed that students reported higher theoretical knowledge of palliative care concepts as compared to interns, whereas interns were better in performing practical aspects of palliative care. A significant percentage of students and interns would like to learn more about palliative care in their curriculum, although this was more present among interns (72.7% students and 92.6% interns, p < 0.0001, respectively). Conclusion Although palliative care education is already included in a compulsory manner in the new curriculum of the Medical University of Vienna, almost two third of all students would support more implementation of palliative care issues throughout the curriculum. To further improve attitudes and skills towards patients at end of life, palliative care education should be augmented in the new curriculum.

A Quantitative Assessment of the Need for Offering Counselling Services to Medical Students attending University of Zambia, School of Medicine.

2020 ◽  
Vol 7 (2) ◽  
pp. 93-103
Author(s):  
Gretchen Slover
Keyword(s):  
Medical Students ◽  
Counseling Services ◽  
Student Responses ◽  
Counselling Services ◽  
School Of Medicine ◽  
Comprehensive Picture ◽  
Fourth Year Medical Students ◽  
The Subject ◽  
The University ◽  
Therapy Sessions

Background: This research was birthed in 2017 during a trip to Lusaka, Zambia, with the purpose of offering fourth-year, medical students attending the University of Zambia, School of Medicine, lectures on psychology topics as part of their clinical studies.  Students were also offered brief therapy sessions where they could process thoughts and feelings causing them internal struggles.  The subject of offering counseling on a regular basis was randomly discussed with the students.  From these discussions the need for this research became evident, with the intent of becoming the launching pad to brainstorm the most effective ways of developing a plan to offer counseling services for all medical students attending the University of Zambia School of Medicine. Methods: An-experimental research design, consisting of completion of a 12-item questionnaire administered by paper and pen. The inclusion criteria were the fourth year, medical students attending the University of Zambia, School of Medicine. Results:  The student responses revealed that most of them had little to no experience with counseling services, but a strong desire for them. Discussion: The goal of this study was to simply establish a need for an on-campus counseling service, the need of which has been established by the very students who would benefit.  With the acceptance of this need, the future plan is to explore the different ways in which this need can be fulfilled with minimal costs to the Medical School Program. Conclusion:  This study is the first step towards identifying the needs of the medical students and sets the ground-work for further research into the specific areas of need and mental health challenges.  More specificity in the area of demographics of students will produce a more comprehensive picture of the areas of concentration for the therapists offering services.

scholarly journals Mentors' experiences in an osteopathic medical student research program

2021 ◽  
Vol 0 (0) ◽  
Author(s):  
Tyler Hamby ◽  
W. Paul Bowman ◽  
Don P. Wilson ◽  
Riyaz Basha
Keyword(s):  
Medical Students ◽  
Research Program ◽  
Online Survey ◽  
Medical Schools ◽  
Systematic Instruction ◽  
Medical Student Research ◽  
Research Programs ◽  
Student Mentor ◽  
The University

Abstract Context Medical students, especially at osteopathic medical schools, have limited research exposure. Systematic instruction in research, supervised by qualified mentors, could motivate osteopathic medical students to pursue research in their careers, thereby increasing the number of future clinician-scientists. Recruiting and retaining suitable research mentors are crucial to sustaining such programs, but this task is also particularly challenging for osteopathic medical schools. Objectives To assess mentors' experiences in a voluntary student-mentor medical research program. Methods An online survey was sent to 76 university- or hospital-based participants who previously mentored 219 medical students between 2014 and 2019. The questionnaire consisted of 13 items with responses in checklist, five-point Likert scale, and categorical multiple-choice formats, assessing motivation for participation, satisfaction with the program, and interest in future participation. Data were analyzed descriptively, and responses from mentors at the university and hospital were compared using univariate logistic and ordinal regression analyses. Results Among 70 (92.1%) mentors who responded to the survey, 61 (87.1%) reported being motivated by a desire to help medical students learn research. Forty-nine (70.0%) mentors indicated that furthering their own research productivity was a motivation, and hospital-based mentors were statistically significantly more likely to endorse this source of motivation (OR=2.02; 95% CI=1.18–3.45; p=0.01). Most respondents were satisfied with the quality of the students' work (59 [84.3%]) and with the program (59 [85.5%]). However, 46 (65.7%) suggested the program could be enhanced by requiring medical students to be physically present in the clinic or laboratory for a minimum amount of time. Importantly, most (58 [84.1%]) mentors reported that they would be interested in participating in future mentored research programs. Conclusions Mentors were motivated to participate in the voluntary research program for both altruistic and professional reasons. Since most mentors reported being satisfied with the program, it is likely they would participate in future mentored research programs. Our results suggest that mentors viewed this voluntary research program as mutually beneficial.

scholarly journals Required Longitudinal Service-Learning and Its Effects on Medical Students’ Attitudes Toward the Underserved

2021 ◽  
Author(s):  
Monica Rose Arebalos ◽  
Faun Lee Botor ◽  
Edward Simanton ◽  
Jennifer Young
Keyword(s):  
Medical Education ◽  
Medical Students ◽  
Service Learning ◽  
Student Attitudes ◽  
Underserved Populations ◽  
Preclinical Phase ◽  
School Of Medicine ◽  
Students Attitudes ◽  
Medical Student Attitudes ◽  
The University

AbstractAlthough medical students enter medicine with altruistic motives and seek to serve indigent populations, studies show that medical students’ attitudes towards the undeserved tend to worsen significantly as they go through their medical education. This finding emphasizes the need for medical educators to implement activities such as service-learning that may help mitigate this negative trend.All students at the University of Nevada Las Vegas (UNLV) School of Medicine are required to participate in longitudinal service-learning throughout medical school, and a majority of students interact with the underserved at their service-learning sites. Using the previously validated Medical Student Attitudes Towards the Underserved (MSATU), independent sample T-tests showed that students who interact with underserved populations at their sites scored with significantly better attitudes towards the underserved at the end of their preclinical phase. Subjects included 58 medical students with 100% taking the MSATU. This result indicates that longitudinal service-learning, particularly when it includes interaction with the underserved, can be one method to combat the worsening of medical students’ attitudes as they complete their medical education.

scholarly journals Sustainability and Stakeholder Awareness: A Case Study of a Scottish University

2021 ◽  
Vol 13 (8) ◽  
pp. 4186
Author(s):  
Abdulhakeem Raji ◽  
Abeer Hassan
Keyword(s):  
Signaling Theory ◽  
Relevant Information ◽  
Voluntary Exercise ◽  
Communication Tool ◽  
Individual Interviews ◽  
Study Approach ◽  
Research Findings ◽  
Definition Of ◽  
The University

This paper adopted a case study approach to investigate the sustainability practices of a Scottish university in order to understand if sustainability forms part of its central policy agenda. As such, the paper focuses on the levels of awareness and disclosure of their sustainable practices, measuring the impacts and effectiveness of those initiatives. This paper introduces signaling theory to explore the idea that appropriate communication via integrated thinking can close the gap between the organization and its stakeholders. We believe that the provision of this relevant information will lead to better communication between the organization and its stakeholders, supporting a signaling theory interpretation. Therefore, we are suggesting that integrated thinking is an internal process that organizations can follow to increase the level of disclosure as a communication tool with stakeholders. From the literature reviewed, four themes were identified (definition of university sustainability, sustainability awareness, disclosure framework within universities, and level of accountability). The research adopted a pragmatic view and conducted individual interviews with participants belonging to three stakeholder groups (members of the university’s senior management, the governing council, and the student union executive). Although this study focused on just one Scottish university, it should still provide some insight for the better understanding of the underpinning issues surrounding the sustainability accountability practices of Scottish universities in general. The research findings indicated that the university prioritized only two sustainability dimensions—economic and environmental—and that the university still perceived sustainability as a voluntary exercise. Additionally, it is evident that the university had no framework in place for measuring its sustainability delivery—and therefore had no established medium of communicating these activities to its stakeholders. Moreover, research findings showed that the social and educational context of sustainability was lacking at the university. The university has done little or nothing to educate its stakeholders on sustainability.

An Open Source Solution for “Hands-on” teaching of PET/CT to Medical Students under the COVID-19 Pandemic

2020 ◽  
Author(s):  
Martin Biermann ◽  
Salim Kanoun ◽  
Trond Davidsen ◽  
Robert Gray
Keyword(s):  
Medical Students ◽  
Student Satisfaction ◽  
Student Survey ◽  
Technical Challenge ◽  
Course Work ◽  
Pet Ct ◽  
Hands On ◽  
Hands On Learning ◽  
Central Image ◽  
The University

Abstract Aims Since 2017, medical students at the University of Bergen were taught PET/CT “hands-on” by viewing PET/CT cases in native format on diagnostic workstations in the hospital. Due to the COVID-19 pandemic, students were barred access. This prompted us to launch and evaluate a new freeware PET/CT viewing system hosted in the university network. Methods We asked our students to install the multiplatform Fiji viewer with Beth Israel PET/CT plugin (http://petctviewer.org) on their personal computers and connect to a central image database in the university network based on the public domain orthanc server (https://orthanc-server.com). At the end of course, we conducted an anonymous student survey. Results The new system was online within eight days, including regulatory approval. All 76 students (100 %) in the fifth year completed their course work, reading five anonymized PET/CT cases as planned. 41 (53 %) students answered the survey. Fiji was challenging to install with a mean score of 1.8 on a 5-point Likert scale (5 = easy, 1 = difficult). Fiji was more difficult to use (score 3.0) than the previously used diagnostic workstations in the hospital (score 4.1; p < 0.001, paired t-test). Despite the technical challenge, 47 % of students reported having learnt much (scores 4 and 5); only 11 % were negative (scores 1 and 2). 51 % found the PET/CT tasks engaging (scores 4 and 5) while 20 % and 5 % returned scores 2 and 1, respectively. Conclusion Despite the initial technical challenge, “hands-on” learning of PET/CT based on the freeware Fiji/orthanc PET/CT-viewer was associated with a high degree of student satisfaction. We plan to continue running the system to give students permanent access to PET/CT cases in native format regardless of time or location.

Sign in / Sign up

Export Citation Format

Share Document