scholarly journals A Wearable Sensor-Based Exercise Biofeedback System: Mixed Methods Evaluation of Formulift (Preprint)

2017 ◽  
Author(s):  
Martin Aidan O'Reilly ◽  
Patrick Slevin ◽  
Tomas Ward ◽  
Brian Caulfield
Keyword(s):  
Rating Scale ◽  
Subjective Quality ◽  
Measurement Unit ◽  
Great Promise ◽  
Wearable Sensor ◽  
Strength And Conditioning ◽  
Biofeedback System ◽  
System Usability Scale ◽  
Perceived Impact

BACKGROUND Formulift is a newly developed mobile health (mHealth) app that connects to a single inertial measurement unit (IMU) worn on the left thigh. The IMU captures users’ movements as they exercise, and the app analyzes the data to count repetitions in real time and classify users’ exercise technique. The app also offers feedback and guidance to users on exercising safely and effectively. OBJECTIVE The aim of this study was to assess the Formulift system with three different and realistic types of potential users (beginner gym-goers, experienced gym-goers, and qualified strength and conditioning [S&C] coaches) under a number of categories: (1) usability, (2) functionality, (3) the perceived impact of the system, and (4) the subjective quality of the system. It was also desired to discover suggestions for future improvements to the system. METHODS A total of 15 healthy volunteers participated (12 males; 3 females; age: 23.8 years [SD 1.80]; height: 1.79 m [SD 0.07], body mass: 78.4 kg [SD 9.6]). Five participants were beginner gym-goers, 5 were experienced gym-goers, and 5 were qualified and practicing S&C coaches. IMU data were first collected from each participant to create individualized exercise classifiers for them. They then completed a number of nonexercise-related tasks with the app. Following this, a workout was completed using the system, involving squats, deadlifts, lunges, and single-leg squats. Participants were then interviewed about their user experience and completed the System Usability Scale (SUS) and the user version of the Mobile Application Rating Scale (uMARS). Thematic analysis was completed on all interview transcripts, and survey results were analyzed. RESULTS Qualitative and quantitative analysis found the system has “good” to “excellent” usability. The system achieved a mean (SD) SUS usability score of 79.2 (8.8). Functionality was also deemed to be good, with many users reporting positively on the systems repetition counting, technique classification, and feedback. A number of bugs were found, and other suggested changes to the system were also made. The overall subjective quality of the app was good, with a median star rating of 4 out of 5 (interquartile range, IQR: 3-5). Participants also reported that the system would aid their technique, provide motivation, reassure them, and help them avoid injury. CONCLUSIONS This study demonstrated an overall positive evaluation of Formulift in the categories of usability, functionality, perceived impact, and subjective quality. Users also suggested a number of changes for future iterations of the system. These findings are the first of their kind and show great promise for wearable sensor-based exercise biofeedback systems.

scholarly journals Wearable Sensor-Based Exercise Biofeedback for Orthopaedic Rehabilitation: A Mixed Methods User Evaluation of a Prototype System

Sensors ◽  
2019 ◽  
Vol 19 (2) ◽  
pp. 432 ◽  
Author(s):  
Rob Argent ◽  
Patrick Slevin ◽  
Antonio Bevilacqua ◽  
Maurice Neligan ◽  
Ailish Daly ◽  
...  
Keyword(s):  
User Experience ◽  
Rating Scale ◽  
Structured Interview ◽  
Adherence Rate ◽  
Prototype System ◽  
User Evaluation ◽  
Wearable Sensor ◽  
Biofeedback System ◽  
System Usability Scale ◽  
The Mean

The majority of wearable sensor-based biofeedback systems used in exercise rehabilitation lack end-user evaluation as part of the development process. This study sought to evaluate an exemplar sensor-based biofeedback system, investigating the feasibility, usability, perceived impact and user experience of using the platform. Fifteen patients participated in the study having recently undergone knee replacement surgery. Participants were provided with the system for two weeks at home, completing a semi-structured interview alongside the System Usability Scale (SUS) and user version of the Mobile Application Rating Scale (uMARS). The analysis from the SUS (mean = 90.8 [SD = 7.8]) suggests a high degree of usability, supported by qualitative findings. The mean adherence rate was 79% with participants reporting a largely positive user experience, suggesting it offers additional support with the rehabilitation regime. Overall quality from the mean uMARS score was 4.1 out of 5 (SD = 0.39), however a number of bugs and inaccuracies were highlighted along with suggestions for additional features to enhance engagement. This study has shown that patients perceive value in the use of wearable sensor-based biofeedback systems and has highlighted the benefit of user-evaluation during the design process, illustrated the need for real-world accuracy validation, and supports the ongoing development of such systems.

Quality of a Supporting Mobile App for Rheumatic Patients: Assessment Using the User Version of the Mobile Application Scale (uMARS) and Associated Patient Characteristics (Preprint)

2021 ◽  
Author(s):  
Antonia Lambrecht ◽  
Nicolas Vuillerme ◽  
Christina Raab ◽  
David Simon ◽  
Eva-Maria Messner ◽  
...  
Keyword(s):  
Rheumatoid Arthritis ◽  
Psoriatic Arthritis ◽  
Rating Scale ◽  
End Users ◽  
Quality Score ◽  
Mobile App ◽  
Subjective Quality ◽  
Ehealth Literacy ◽  
Rheumatic Patients

BACKGROUND Mobile applications promise to improve current health care. A growing number app quality studies exist to help patients and physicians choose appropriate, helpful and useful applications. However, current mobile app quality ratings are mostly physician-based. They exclude patients although as end-users, patients are able to provide the most relevant feedback. In a recent physician-based review of rheumatic apps, Rheuma Auszeit received the best overall rating (4.2/5), however this app has never been systematically evaluated by the intended end-users, rheumatic patients. OBJECTIVE The aim of this study was (1) to assess the quality of Rheuma Auszeit by rheumatic patients and (2) to evaluate the association between uMARS (User Version of the Mobile App Rating Scale) scores and patients’ characteristics. METHODS Consecutive patients with rheumatoid arthritis, psoriatic arthritis and spondyloarthritis were seen at the rheumatology clinic at university hospital Erlangen, Germany. They were asked to evaluate the app Rheuma Auszeit using the uMARS and to complete a paper-based survey evaluating the individual preferences, attitudes and ehealth literacy. uMARS assesses the dimensions of engagement, functionality, aesthetics, information, and subjective quality on 5-point scales. The association between uMARS scores and patients’ characteristics was further explored. RESULTS Between December 2018 and January 2019, a total of 126 patients evaluated Rheuma Auszeit using uMARS and filled out the paper-based survey. The median uMARS score was 3.9, IQR 0.7. Functionality was the domain with the highest rating (median 4.8, IQR 0.8), followed by aesthetics (median 4.0, IQR 0.7), information (median 3.5, IQR 0.8), and engagement (median 3.2, IQR 1.0). Subjective quality was average (median 3.0, IQR 1.0). The lowest scoring individual item was customization with a median of 2.5/5. Lower functionality scores were reported among older female rheumatic patients (P<.004). Older male rheumatic patients reported a higher subjective quality score (P<.024). Perceived disease activity and disease duration did not significantly correlate with any uMARS subdomain scores. eHealth literacy significantly correlated with functionality uMARS subdomain ratings (Rho=0.18; P<.042). Preferred time of app usage significantly correlated with engagement (Rho=0.20; P<.024), functionality (Rho=0.19; P<.029), total uMARS score (Rho=0.21; P<.017) and subjective quality score (Rho=0.21; P<.017). The vast majority of rheumatic patients would consider recommending Rheuma Auszeit to other patients (117/126; 92.9%). CONCLUSIONS Rheuma Auszeit was well accepted by patients suffering from rheumatoid arthritis, psoriatic arthritis and ankylosing spondyloarthritis. Lacking customization could lead to low app compliance and should be improved. The study highlights the potential and feasibility of therapeutic complementary digital solutions in rheumatology.

Subjective quality of life in schizophrenic patients living in the community. Relationship to clinical and social characteristics

1999 ◽  
Vol 14 (5) ◽  
pp. 256-263 ◽  
Author(s):  
A. Bengtsson-Tops ◽  
L. Hansson
Keyword(s):  
Quality Of Life ◽  
Rating Scale ◽  
Life Quality ◽  
Subjective Quality ◽  
Social Characteristics ◽  
Clinical Factors ◽  
Subjective Quality Of Life ◽  
Social Interventions ◽  
Schizophrenic Patients

SummaryThe aims of this study were to assess the quality of life among 120 schizophrenic patients who were attending a psychiatric outpatient department and to investigate which socio-demographic and clinical factors influenced their subjective quality of life. Quality of life was assessed by the Lanchashire quality of life profile, social functioning was judged according to the Global Assessment of Functioning (GAF) scale, and psychopathology was rated by means of the Brief Psychiatric Rating Scale (BPRS). Both objective and subjective life conditions indicated an impaired quality of life for the patients. The areas of finance and work had the largest proportion of dissatisfied patients. Socio-demographic indicators showed to have a weak influence on the patient's self-assessed quality of life while clinical factors, such as psychopathology, strongly influenced the patient's life satisfaction. It is concluded that there is a need for further emphasise on the clinical, financial, and social interventions for this group of patients.

scholarly journals A content analysis of the quality and behaviour change techniques of smartphone apps promoting the Mediterranean diet

2020 ◽  
Vol 79 (OCE2) ◽  
Author(s):  
Daniel McAleese ◽  
Angeliki Papadaki
Keyword(s):  
Content Analysis ◽  
Mediterranean Diet ◽  
Behaviour Change ◽  
Rating Scale ◽  
Mobile App ◽  
Subjective Quality ◽  
Behaviour Change Techniques ◽  
Smartphone Apps ◽  
The Mediterranean

AbstractThe popularity of smartphone apps is rising globally. However, the quality of widely available health apps and their effectiveness to promote behaviour change, by incorporating behavioural change techniques (BCTs) that have been suggested to result in behaviour change, is questionable. The aim of this study was to conduct a content analysis of smartphone apps that utilise the Mediterranean diet (MD), a dietary pattern linked to numerous health benefits, to promote healthy dietary behaviours. The specific objectives were to evaluate the quality of these apps and their use of BCTs. The iTunes Store and Google Play were searched for all available apps (free and requiring payment to download) promoting the MD. Apps were excluded if they were not available in English, did not focus only on the MD or the download process was corrupt. The Mobile App Rating Scale (MARS) was used to assess app engagement, functionality, aesthetics and information quality (the average of which represents a quality mean score (QMS)) and subjective quality. The Abraham & Michie behaviour change taxonomy was adapted to create a 20-item checklist to assess the presence of BCTs in the eligible apps. Thirty nine apps (64.1% of which were free to download) were analysed. The overall QMS was 2.96 ± 0.46. The lowest and highest scored QMS constructs were engagement (2.42 ± 0.62) and functionality (3.95 ± 0.45), respectively, whilst the overall mean subjective quality score was 1.71 ± 0.51 (scores’ range 1–5). Apps were scored higher for aesthetics if they required payment (3.14 vs. 2.78, p = 0.047). Apps incorporated an average of 3.10 ± 1.87 BCTs, with no difference in the number of BCTs present according to platform or cost. From the five BCTs that have been suggested to promote behaviour change, ‘self-monitoring’ was present in six apps, ‘intention formation’ in 15 and ‘goal setting’ in one. None of the apps incorporated the ‘review of behavioural goals’ and ‘feedback on performance’ BCTs. The total QMS score was positively associated with the presence of BCTs (r = 0.409, p = 0.008). Based on the MARS assessment, apps promoting the MD that are available in the public domain were of moderate quality. In contrast, the low presence, particularly of efficacious, BCTs and low subjective quality scores suggest that apps are actually of poor quality and potentially not effective in promoting behaviour change towards an MD diet. These findings provide important insights for the future development of high-quality apps to promote the MD at population level.

scholarly journals Quality evaluation of smartphone applications for laboratory medicine

2018 ◽  
Vol 57 (3) ◽  
pp. 388-397 ◽  
Author(s):  
Snežana Jovičić ◽  
Joanna Siodmiak ◽  
Ian D. Watson
Keyword(s):  
Quality Evaluation ◽  
Rating Scale ◽  
Laboratory Medicine ◽  
Mobile App ◽  
Subjective Quality ◽  
Total Quality ◽  
Technical Aspects ◽  
Health Apps ◽  
Significant Difference

Abstract Background Many of the mobile applications (apps) used for delivering health interventions involve laboratory medicine data. This survey was conducted to search the online market for health apps that manage laboratory medicine data. The aim was to review them and perform a quality evaluation. Methods Apps search criteria were “Lab results blood work”, “Lab results”, and “Health apps”. After the stepwise exclusion process, 52 selected apps were downloaded and analyzed. For review and content analysis of the apps, a multidimensional tool for classifying and rating the quality of mobile health apps – Mobile App Rating Scale (MARS), was used. Results Selected apps were classified into five categories according to their intended use by patients or physicians, and the type of data engaged. Spearman’s correlation analysis found significant correlations between MARS individual scoring items, as with the subjective quality and number of technical aspects. Kruskal-Wallis analysis showed a significant difference in the number of technical aspects employed, MARS engagement and informational quality score items, total score, and subjective quality. The lowest values for all of these items were in the category of apps designed for patients, and the post hoc test showed that the difference was statistically significant between this and the values in all other categories. Conclusions Apps designed for patients, are of the poorest quality, considering the total quality of the content and information they provide, estimated using the MARS tool. This estimation needs to be validated for laboratory medicine apps, and eventually modified after consideration of specific quality benchmarks.

scholarly journals Quality of a Supporting Mobile App for Rheumatic Patients: Patient-Based Assessment Using the User Version of the Mobile Application Scale (uMARS)

2021 ◽  
Vol 8 ◽  
Author(s):  
Antonia Lambrecht ◽  
Nicolas Vuillerme ◽  
Christina Raab ◽  
David Simon ◽  
Eva-Maria Messner ◽  
...  
Keyword(s):  
Rheumatoid Arthritis ◽  
Psoriatic Arthritis ◽  
Rating Scale ◽  
Quality Score ◽  
Mobile App ◽  
Subjective Quality ◽  
University Hospital ◽  
Ehealth Literacy ◽  
Rheumatic Patients

Introduction: Mobile applications promise to improve current health care. However, current mobile app quality ratings are mostly physician-based. The aim of this study was (1) to assess the quality of the self-management app Rheuma Auszeit using the validated uMARS (User Version of the Mobile App Rating Scale) app quality assessment tool and (2) to evaluate the association between uMARS scores and patients' characteristics.Materials and Methods: Consecutive patients with rheumatoid arthritis, psoriatic arthritis and spondyloarthritis were seen at the rheumatology clinic at university hospital Erlangen, Germany. They were asked to test Rheuma Auszeit, evaluate its quality using uMARS and complete a paper-based survey evaluating the individual preferences, attitudes and ehealth literacy. The association between uMARS scores and patients' characteristics was further explored.Results: Between December 2018 and January 2019, a total of 126 patients evaluated Rheuma Auszeit using uMARS and filled out the paper-based survey. The median uMARS score was 3.9, IQR 0.7. Functionality was the domain with the highest rating (median 4.8, IQR 0.8), followed by aesthetics (median 4.0, IQR 0.7), information (median 3.5, IQR 0.8), and engagement (median 3.2, IQR 1.0). Subjective quality was average (median 3.0, IQR 1.0). The lowest scoring individual item was customization with a median of 2.5/5. Lower functionality scores were reported among older female rheumatic patients (P &lt; 0.004). Older male rheumatic patients reported a higher subjective quality score (P &lt; 0.024). Perceived disease activity and disease duration did not significantly correlate with any uMARS subdomain scores. eHealth literacy significantly correlated with functionality uMARS subdomain ratings (Rho = 0.18; P &lt; 0.042). Preferred time of app usage significantly correlated with engagement (Rho = 0.20; P &lt; 0.024), functionality (Rho = 0.19; P &lt; 0.029), total uMARS score (Rho = 0.21; P &lt; 0.017) and subjective quality score (Rho = 0.21; P &lt; 0.017). The vast majority of rheumatic patients would consider recommending Rheuma Auszeit to other patients (117/126; 92.9%).Conclusion: Rheuma Auszeit was well-accepted by German patients suffering from rheumatoid arthritis, psoriatic arthritis and ankylosing spondyloarthritis. Lacking customization could lead to low app compliance and should be improved. Lower functionality scores among older female rheumatic patients highlight the need for patient education. The study underlines the potential and feasibility of therapeutic complementary digital solutions in rheumatology.

scholarly journals Measuring the Quality of Mobile Apps for the Management of Pain: Systematic Search and Evaluation Using the Mobile App Rating Scale (Preprint)

2018 ◽  
Author(s):  
Alejandro Salazar ◽  
Helena de Sola ◽  
Inmaculada Failde ◽  
Jose Antonio Moral-Munoz
Keyword(s):  
New Technologies ◽  
Rating Scale ◽  
Mobile Apps ◽  
Scientific Evidence ◽  
Mobile App ◽  
Subjective Quality ◽  
Global Quality ◽  
Final Score ◽  
Biopsychosocial Model Of Pain

BACKGROUND Chronic pain is a major health issue requiring an approach that not only considers medication, but also many other factors included in the biopsychosocial model of pain. New technologies, such as mobile apps, are tools to address these factors, although in many cases they lack proven quality or are not based on scientific evidence, so it is necessary to review and measure their quality. OBJECTIVE The aim is to evaluate and measure the quality of mobile apps for the management of pain using the Mobile App Rating Scale (MARS). METHODS This study included 18 pain-related mobile apps from the App Store and Play Store. The MARS was administered to measure their quality. We list the scores (of each section and the final score) of every app and we report the mean score (and standard deviation) for an overall vision of the quality of the pain-related apps. We compare the section scores between the groups defined according to the tertiles via analysis of variance (ANOVA) or Kruskal-Wallis test, depending on the normality of the distribution (Shapiro-Wilk test). RESULTS The global quality ranged from 1.74 (worst app) to 4.35 (best app). Overall, the 18 apps obtained a mean score of 3.17 (SD 0.75). The best-rated sections were functionality (mean 3.92, SD 0.72), esthetics (mean 3.29, SD 1.05), and engagement (mean 2.87, SD 1.14), whereas the worst rated were app specific (mean 2.48, SD 1.00), information (mean 2.52, SD 0.82), and app subjective quality (mean 2.68, SD 1.22). The main differences between tertiles were found on app subjective quality, engagement, esthetics, and app specific. CONCLUSIONS Current pain-related apps are of a certain quality mainly regarding their technical aspects, although they fail to offer information and have an impact on the user. Most apps are not based on scientific evidence, have not been rigorously tested, and the confidentiality of the information collected is not guaranteed. Future apps would need to improve these aspects and exploit the capabilities of current devices.

scholarly journals Assessing the Quality of Mobile Phone Apps for Weight Management: User-Centered Study With Employees From a Lebanese University (Preprint)

2018 ◽  
Author(s):  
Marco Bardus ◽  
Ahmed Ali ◽  
Farah Demachkieh ◽  
Ghassan Hamadeh
Keyword(s):  
Weight Management ◽  
Weight Control ◽  
Information Quality ◽  
Rating Scale ◽  
Mode Of Delivery ◽  
Nonparametric Tests ◽  
Mobile App ◽  
Subjective Quality ◽  
User Centered

BACKGROUND Evaluating the quality of mobile health apps for weight loss and weight management is important to understand whether these can be used for obesity prevention and treatment. Recent reviews call for more research on multidimensional aspects of app quality, especially involving end users, as there are already many expert reviews on this domain. However, no quantitative study has investigated how laypersons see popular apps for weight management and perceive different dimensions of app quality. OBJECTIVE This study aimed to explore how laypersons evaluate the quality of 6 free weight management apps (My Diet Coach, SparkPeople, Lark, MyFitnessPal, MyPlate, and My Diet Diary), which achieved the highest quality ratings in a related and recent expert review. METHODS A user-centered study was conducted with 36 employees of a Lebanese university. Participants enrolled in the study on a rolling basis between October 2016 and March 2017. Participants were randomly assigned an app to use for 2 weeks. App quality was evaluated at the end of the trial period using the Mobile App Rating Scale user version (uMARS). uMARS assesses the dimensions of engagement, functionality, aesthetics, information, and subjective quality on 5-point scales. Internal consistency and interrater agreement were examined. The associations between uMARS scores and users’ demographic characteristics were also explored using nonparametric tests. Analyses were completed in November 2017. RESULTS Overall, the 6 apps were of moderately good quality (median uMARS score 3.6, interquartile range [IQR] 0.3). The highest total uMARS scores were achieved by Lark (mean 4.0 [SD 0.5]) and MyPlate (mean 3.8 [SD 0.4]), which also achieved the highest subjective quality scores (Lark: mean 3.3 [SD 1.4]; MyPlate: mean 3.3 [SD 0.8]). Functionality was the domain with the highest rating (median 3.9, IQR 0.3), followed by aesthetics (median 3.7, IQR 0.5), information (median 3.7, IQR 0.1), and engagement (median 3.3, IQR 0.2). Subjective quality was judged low (median 2.5, IQR 0.9). Overall, subjective quality was strongly and positively related (P<.001) with total uMARS score (ρ=.75), engagement (ρ=.68), information, and aesthetics (ρ=.60) but not functionality (ρ=.40; P=.02). Higher engagement scores were reported among healthy (P=.003) and obese individuals (P=.03), who also showed higher total uMARS (P=.04) and subjective quality (P=.05) scores. CONCLUSIONS Although the apps were considered highly functional, they were relatively weak in engagement and subjective quality scores, indicating a low propensity of using the apps in the future. As engagement was the subdomain most strongly associated with subjective quality, app developers and researchers should focus on creating engaging apps, holding constant the functionality, aesthetics, and information quality. The tested apps (in particular Lark and MyPlate) were perceived as more engaging and of higher quality among healthy, obese individuals, making them a promising mode of delivery for self-directed interventions promoting weight control among the sampled population or in similar and comparable settings.

The functionality and quality of nutrition-related mobile applications in China (Preprint)

2018 ◽  
Author(s):  
Yuan Li ◽  
Jingmin Ding ◽  
Yishan Wang ◽  
Chengyao Tang ◽  
Puhong Zhang
Keyword(s):  
Disease Management ◽  
Nutrition Education ◽  
Mobile Applications ◽  
Rating Scale ◽  
Dietary Guidelines ◽  
Diet Analysis ◽  
Innovative Technology ◽  
Nutritional Knowledge ◽  
Food Record

BACKGROUND There are an increasing number of mobile applications that provide dietary guidance in supporting healthy lifestyle and disease management. However, the characteristics of these nutrition-related apps are not well analyzed. OBJECTIVE This study aimed to evaluate the functionality and quality of nutrition-related apps in China. METHODS Mobile apps providing dietary guidance were screened in Chinese iOS and android app stores using stepwise searching criteria in November 2017. Primary review was conducted by extracting information from the description of apps. Free apps that contain all the information of diet and nutrition, with the last update after 1st Jan 2016 were downloaded for further analysis on the nutritional functionality features based on the framework of Chinese Dietary Guidelines and on the market related features as well. The user version of the Mobile Application Rating Scale (uMARS) was used to assess the quality of apps. RESULTS Among the 44 downloaded nutrition-related apps screened from 628 apps with dietary guidance content, only 11(25%) were aimed exclusively for dietary guidance, the others were aimed for fitness guidance (17, 39%), disease management (11, 25%) and maternal health (5, 11%) respectively. The nutritional functionalities of the 44 apps included nutritional information enquiry (40, 91%), nutrition education (35, 80%), food record (34, 77%), diet analysis (34, 77%), and personalized recipes (21, 48%). Twelve out of 44 apps contained all of the above five nutrition related functionalities. The diet analysis and suggestions were mainly focused on energy (33/44, 75%), less on other factors like dietary structure (10/44, 23%). About 96% (42/44) of the apps provided social communication functionality and 59% (26/44) of the apps supported user incentives. Eight out of 44 apps (18%) also applied intelligent recognition technology. Using 5-point uMARS as scales of quality, the median scores of the 44 apps was 3.6 (IQR = 0.7). CONCLUSIONS Most nutrition-related apps are developed in the service of health management other than for dietary guidance exclusively. Although basic energy balance theory was generally applied, the nutritional functionality of the nutrition-related apps is relatively limited and not individualized. More efforts should be taken to integrate with the scientific nutritional knowledge and innovative technology in developing an app followed with complete and personalized dietary guidance.

Psychometric evaluation of the Mobile Application Rating Scale (MARS) (Preprint)

2020 ◽  
Author(s):  
Yannik Terhorst ◽  
Paula Philippi ◽  
Lasse Sander ◽  
Dana Schultchen ◽  
Sarah Paganini ◽  
...  
Keyword(s):  
Health Care ◽  
Construct Validity ◽  
Mobile Application ◽  
Concurrent Validity ◽  
Rating Scale ◽  
Psychometric Evaluation ◽  
Confirmatory Factor ◽  
Health Domains ◽  
Psychometric Quality

BACKGROUND Mobile health apps (MHA) have the potential to improve health care. The commercial MHA market is rapidly growing, but the content and quality of available MHA are unknown. Consequently, instruments of high psychometric quality for the assessment of the quality and content of MHA are highly needed. The Mobile Application Rating Scale (MARS) is one of the most widely used tools to evaluate the quality of MHA in various health domains. Only few validation studies investigating its psychometric quality exist with selected samples of MHAs. No study has evaluated the construct validity of the MARS and concurrent validity to other instruments. OBJECTIVE This study evaluates the construct validity, concurrent validity, reliability, and objectivity, of the MARS. METHODS MARS scoring data was pooled from 15 international app quality reviews to evaluate the psychometric properties of the MARS. The MARS measures app quality across four dimensions: engagement, functionality, aesthetics and information quality. App quality is determined for each dimension and overall. Construct validity was evaluated by assessing related competing confirmatory models that were explored by confirmatory factor analysis (CFA). A combination of non-centrality (RMSEA), incremental (CFI, TLI) and residual (SRMR) fit indices was used to evaluate the goodness of fit. As a measure of concurrent validity, the correlations between the MARS and 1) another quality assessment tool called ENLIGHT, and 2) user star-rating extracted from app stores were investigated. Reliability was determined using Omega. Objectivity was assessed in terms of intra-class correlation. RESULTS In total, MARS ratings from 1,299 MHA covering 15 different health domains were pooled for the analysis. Confirmatory factor analysis confirmed a bifactor model with a general quality factor and an additional factor for each subdimension (RMSEA=0.074, TLI=0.922, CFI=0.940, SRMR=0.059). Reliability was good to excellent (Omega 0.79 to 0.93). Objectivity was high (ICC=0.82). The overall MARS rating was positively associated with ENLIGHT (r=0.91, P<0.01) and user-ratings (r=0.14, P<0.01). CONCLUSIONS he psychometric evaluation of the MARS demonstrated its suitability for the quality assessment of MHAs. As such, the MARS could be used to make the quality of MHA transparent to health care stakeholders and patients. Future studies could extend the present findings by investigating the re-test reliability and predictive validity of the MARS.

Sign in / Sign up

Export Citation Format

Share Document