scholarly journals User Experience, Engagement, and Popularity in Mental Health Apps: Secondary Analysis of App Analytics and Expert App Reviews (Preprint)

10.2196/30766 ◽  
2021 ◽  
Author(s):  
Benjamin T Kaveladze ◽  
Akash R Wasil ◽  
John B Bunyi ◽  
Veronica Ramirez ◽  
Stephen M Schueller
2021 ◽  
Author(s):  
Benjamin T Kaveladze ◽  
Akash R Wasil ◽  
John B Bunyi ◽  
Veronica Ramirez ◽  
Stephen M Schueller

BACKGROUND User experience and engagement are critical to mental health apps’ abilities to support users. However, limited work has examined the relationship between user experience, engagement, and app popularity. Given that apps vary immensely in their popularity, understanding why some mental health apps are more appealing or engaging to users can inform efforts to develop better apps. OBJECTIVE We aimed to examine relationships between user experience, engagement, and popularity. To do so, we examined links between subjective measures of user experience and objective measures of app popularity and engagement. METHODS We conducted a pre-registered secondary data analysis in a sample of 56 mental health apps. To measure user experience, we used expert ratings on the Mobile App Rating Scale (MARS) and consumer ratings from the Apple app store and Google Play app store. To measure engagement, we acquired estimates of measures of monthly active users (MAU) and user retention. To measure app popularity, we used download count, total app revenue, and MAU again. RESULTS MARS total score was significantly and positively correlated with app-level revenue (T=0.30, P=.002), MAU (T= 0.39, P<.001), and downloads (T=0.41, P<.001). However, neither the MARS total score nor any of its subscales (Engagement, Functionality, Aesthetics, nor Information) were significantly correlated with user retention 1, 7, or 30 days after downloading. Also, MARS total score was not significantly correlated with app store rating. CONCLUSIONS Popular mental health apps receive better ratings of user experience than less popular ones. However, user experience (as operationalized by the MARS) does not predict sustained engagement with mental health apps. Collaboration between industry and academic teams may better advance a science of engagement and help to make mental health apps more effective and appealing.


10.2196/23447 ◽  
2021 ◽  
Vol 8 (4) ◽  
pp. e23447
Author(s):  
Howard W Wong ◽  
Brian Lo ◽  
Jenny Shi ◽  
Elisa Hollenberg ◽  
Alexxa Abi-Jaoude ◽  
...  

Background There is growing interest in using mobile apps and online tools to support postsecondary student mental health, but most of these solutions have suboptimal user engagement in real-world settings. Poor engagement can limit long-term effectiveness and usefulness of these tools. Previous literature has proposed several theories that link factors such as low usability and poor user-centered design to app disengagement. However, few studies provide direct evidence showing what factors contribute to suboptimal user engagement in the context of mobile mental health apps for postsecondary students. Objective This study focuses on understanding postsecondary students’ attitudes and behaviors when using Thought Spot, a co-designed mental health app and online platform, to understand factors related to engagement and user experience. Methods Students who were given access to Thought Spot for 6 months during a randomized trial of the intervention were invited to participate in one-on-one semistructured interviews. The interviews explored participants’ overall experiences and perceptions of the app, along with factors that affected their usage of various features. All interviews were recorded, and template analysis was used to analyze transcripts. Results User satisfaction was mixed among users of Thought Spot. The degree of engagement with the app appeared to be affected by factors that can be grouped into 5 themes: (1) Students valued detailed, inclusive, and relevant content; (2) Technical glitches and a lack of integration with other apps affected the overall user experience and satisfaction with the app; (3) Using the app to support peers or family can increase engagement; (4) Crowdsourced information from peers about mental health resources drove user engagement, but was difficult to obtain; and (5) Users often turned to the app when they had an immediate need for mental health information, rather than using it to track mental health information over time. Conclusions Content, user experience, user-centeredness, and peer support are important determinants of user engagement with mobile mental health apps among postsecondary students. In this study, participants disengaged when the app did not meet their expectations on these determinants. Future studies on user engagement should further explore the effectiveness of different features and the relative importance of various criteria for high-quality apps. Further focus on these issues may inform the creation of interventions that increase student engagement and align with their mental health needs. Trial Registration ClinicalTrials.gov NCT03412461; https://clinicaltrials.gov/ct2/show/NCT03412461 International Registered Report Identifier (IRRID) RR2-10.2196/resprot.6446


2020 ◽  
Author(s):  
Howard W Wong ◽  
Brian Lo ◽  
Jenny Shi ◽  
Elisa Hollenberg ◽  
Alexxa Abi-Jaoude ◽  
...  

BACKGROUND There is growing interest in using mobile apps and online tools to support postsecondary student mental health, but most of these solutions have suboptimal user engagement in real-world settings. Poor engagement can limit long-term effectiveness and usefulness of these tools. Previous literature has proposed several theories that link factors such as low usability and poor user-centered design to app disengagement. However, few studies provide direct evidence showing what factors contribute to suboptimal user engagement in the context of mobile mental health apps for postsecondary students. OBJECTIVE This study focuses on understanding postsecondary students’ attitudes and behaviors when using Thought Spot, a co-designed mental health app and online platform, to understand factors related to engagement and user experience. METHODS Students who were given access to Thought Spot for 6 months during a randomized trial of the intervention were invited to participate in one-on-one semistructured interviews. The interviews explored participants’ overall experiences and perceptions of the app, along with factors that affected their usage of various features. All interviews were recorded, and template analysis was used to analyze transcripts. RESULTS User satisfaction was mixed among users of Thought Spot. The degree of engagement with the app appeared to be affected by factors that can be grouped 5 themes: (1) Students valued detailed, inclusive, and relevant content; (2) Technical glitches and a lack of integration with other apps affected overall user experience and satisfaction with the app; (3) Using the app to support peers or family can increase engagement; (4) Crowdsourced information from peers about mental health resources drove user engagement, but was difficult to obtain; and (5) Users often turned to the app when they had an immediate need for mental health information, rather than using it to track mental health information over time. CONCLUSIONS Content, user experience, user-centeredness, and peer support are important determinants of user engagement with mobile mental health apps among postsecondary students. In this study, participants disengaged when the app did not meet their expectations on these determinants. Future studies on user engagement should further explore the effectiveness of different features and the relative importance of various criteria for high-quality apps. Doing so may inform the creation of interventions that best engage students and align with their mental health needs. CLINICALTRIAL ClinicalTrials.gov NCT03412461; https://clinicaltrials.gov/ct2/show/NCT03412461 INTERNATIONAL REGISTERED REPORT RR2-10.2196/resprot.6446


2020 ◽  
Vol 26 (3) ◽  
pp. 2042-2066 ◽  
Author(s):  
Felwah Alqahtani ◽  
Rita Orji

Mental health applications hold great promise as interventions for addressing common mental issues. Although many people with mental health issues use mobile app interventions, their adherence level remains low. Low engagement affects the effectiveness of mobile interventions. However, there is still a dearth of research to explain the reasons for low engagement. User experience and usability are two factors that determine the adoption and usage of apps. Analyzing user reviews of mobile apps for mental health issues reveals user experience and what features users liked and disliked in the apps and hence informs future app design and refinements. This research aims to analyze user reviews of publicly available mental health applications to uncover their strengths, weaknesses, and gaps, hence revealing why users are likely to cease using these applications. We mined reviews of 106 mental health apps retrieved from Apple’s App Store and Google Play and employed thematic analysis on 13,549 reviews. The review analysis shows that users placed more emphasis on the user interface and the user-friendliness of the app. Users also appreciated apps that present them with a variety of options, functionalities, and content that they can choose. Again, apps that offer adaptive functionalities that allow users to adapt some app features also received high ratings. In contrast, poor usability emerged as the most common reason for abandoning mental health apps. Other pitfalls include lack of a content variety, lack of personalization, lack of customer service and trust, and security and privacy issues.


2019 ◽  
Vol 16 (2) ◽  
pp. 196-207 ◽  
Author(s):  
Christine E. Gould ◽  
Brian C. Kok ◽  
Vanessa K. Ma ◽  
Aimee Marie L. Zapata ◽  
Jason E. Owen ◽  
...  

2020 ◽  
Author(s):  
Isabelle Counson ◽  
Alexandra Bartholomew ◽  
Joanna Crawford ◽  
Katherine Petrie ◽  
Geetanjali Basarkod ◽  
...  

BACKGROUND Junior doctors report higher levels of psychological distress than more senior doctors and report several barriers to seeking professional mental health support, including concerns about confidentiality and career progression. Mobile health applications (mHealth apps) may be utilised to help overcome these barriers to assist the emotional wellbeing of this population and encourage help-seeking. OBJECTIVE We describe the development and pilot trial of the Shift mHealth app to provide an unobtrusive avenue for junior doctors to seek information about, and help for, wellbeing and mental health concerns that is sensitive to workplace settings. METHODS A 4-phase iterative development process was undertaken to create the content and features of Shift involving junior doctors, using principles of user-centered design. These four phases were: I) Needs assessment, based on interviews with 12 junior doctors; II) Prototype development with user experience feedback from two junior doctors; III) Evaluation, consisting of a pilot trial with 22 junior doctors to assess usability and acceptability of the initial prototype; and IV) Redesign, including user experience workshops with 51 junior doctors. RESULTS Qualitative results informed the content and design of Shift to ensure the app was tailored to junior doctors’ needs. The Shift app prototype contained cognitive-behavioural, mindfulness, value-based actions, and psychoeducational modules, as well as a tracking function visualising patterns of daily variations in mood and health behaviours. Pilot testing revealed possible issues with the organisation of the app content, which were addressed in a thorough restructuring and redesign of Shift with the help of junior doctors across three user experience workshops. CONCLUSIONS The current research demonstrates the importance of ongoing end-user involvement in the creation of a specialised mHealth app for a unique working population experiencing profession-specific stressors and barriers to help-seeking. The development and pilot trial of this novel Shift mHealth app are first steps in addressing the mental health and support-seeking needs of junior doctors, although further research is required to validate its effectiveness and appropriateness on a larger scale.


Healthcare ◽  
2021 ◽  
Vol 9 (6) ◽  
pp. 676
Author(s):  
Yutaka Owari

Background: Too much sitting is associated with low mental health in elderly individuals. We clarified the relationship between psychological distress and the rate of prolonged sedentary bouts (PSBs) among the elderly over four periods. Methods: In a secondary analysis, a sample population of 68 adults aged 65 years or older in Japan was used. The following proxy variables were used: PSB (mental health) and the Kessler 6 scale; K6 scores (psychological distress). Results: Using the cross-lagged effects models, from “2016 K6” to “2017 PSB” (p = 0.004), from “2017 K6” to “2018 PSB” (p < 0.001), and from “2018 K6” to “2019 PSB” (p = 0.021) were all significant; however, the reverse were not all significant in one period. In four periods, from “2016 PSB” to “2019 K6” (p = 0.025) was significant; however, the reverse was not significant. Fit indices were obtained: χ2 = 7.641 (p = 0.182), goodness of fit index (GFI) = 0.891, comparative fit index (CFI) = 0.901, and root mean square error of approximation (RMSEA) = 0.121 in structural equation modelling. Conclusions: Psychological distress may affect the rate of PSB after one year, and the rate of PSB may affect the rate of psychological distress after three years in elderly individuals.


Author(s):  
Fatemeh Khademian ◽  
Azam Aslani ◽  
Peivand Bastani

Abstract Objectives Despite a large number of mobile apps in the field of mental health, it is difficult to find a useful and reliable one, mainly due to the fact that the effectiveness of many apps has not been assessed scientifically. The present study aimed to assess the effects of mental health apps on managing the symptoms of stress, anxiety, and depression. Methods A comprehensive literature search was conducted in PubMed, Scopus, EMBASE, Cochrane, and Web of Science databases for the papers published from 2000 to 2019. Studies were included if they reviewed articles or mobile apps for their effectiveness in stress, anxiety, and depression. The reviews that had considered mobile apps or web-based mobile applications as an intervention or part of intervention were included, as well. Results A total of 4,999 peer-reviewed articles were identified, out of which nine systematic reviews met the inclusion criteria. Seven systematic reviews measured depression outcomes, three measured stress, and five systematic reviews measured anxiety symptoms. The applications that used behavior change strategies, such as Cognitive Behavioral Therapy, Acceptance and Commitment Therapy, and Behavioral Activation, reported significant effects on depression, anxiety, and stress. Conclusion It seems that mental health apps can be promising media for reducing depressive symptoms. This field is an emerging area of mobile health, and further research should be done in future in order to reach conclusive evidence.


2014 ◽  
Vol 71 (1) ◽  
pp. 85-92 ◽  
Author(s):  
Tamsin Brownell ◽  
Beate Schrank ◽  
Zivile Jakaite ◽  
Charley Larkin ◽  
Mike Slade

Sign in / Sign up

Export Citation Format

Share Document