scholarly journals The mHealth App Usability Questionnaire (MAUQ): Development and Validation Study (Preprint)

2018 ◽  
Author(s):  
Leming Zhou ◽  
Jie Bao ◽  
I Made Agus Setiawan ◽  
Andi Saptono ◽  
Bambang Parmanto
Keyword(s):  
Reliability And Validity ◽  
Correlation Coefficients ◽  
Internal Consistency Reliability ◽  
Mobile App ◽  
Target User ◽  
System Usability Scale ◽  
System Usability ◽  
Study Participants ◽  
Development And Validation ◽  
Mhealth Apps

BACKGROUND After a mobile health (mHealth) app is created, an important step is to evaluate the usability of the app before it is released to the public. There are multiple ways of conducting a usability study, one of which is collecting target users’ feedback with a usability questionnaire. Different groups have used different questionnaires for mHealth app usability evaluation: The commonly used questionnaires are the System Usability Scale (SUS) and Post-Study System Usability Questionnaire (PSSUQ). However, the SUS and PSSUQ were not designed to evaluate the usability of mHealth apps. Self-written questionnaires are also commonly used for evaluation of mHealth app usability but they have not been validated. OBJECTIVE The goal of this project was to develop and validate a new mHealth app usability questionnaire. METHODS An mHealth app usability questionnaire (MAUQ) was designed by the research team based on a number of existing questionnaires used in previous mobile app usability studies, especially the well-validated questionnaires. MAUQ, SUS, and PSSUQ were then used to evaluate the usability of two mHealth apps: an interactive mHealth app and a standalone mHealth app. The reliability and validity of the new questionnaire were evaluated. The correlation coefficients among MAUQ, SUS, and PSSUQ were calculated. RESULTS In this study, 128 study participants provided responses to the questionnaire statements. Psychometric analysis indicated that the MAUQ has three subscales and their internal consistency reliability is high. The relevant subscales correlated well with the subscales of the PSSUQ. The overall scale also strongly correlated with the PSSUQ and SUS. Four versions of the MAUQ were created in relation to the type of app (interactive or standalone) and target user of the app (patient or provider). A website has been created to make it convenient for mHealth app developers to use this new questionnaire in order to assess the usability of their mHealth apps. CONCLUSIONS The newly created mHealth app usability questionnaire—MAUQ—has the reliability and validity required to assess mHealth app usability.

scholarly journals Spanish Version of the System Usability Scale for the Assessment of Electronic Tools: Development and Validation

10.2196/21161 ◽  
2020 ◽  
Vol 7 (4) ◽  
pp. e21161
Author(s):  
Magdalena Del Rocio Sevilla-Gonzalez ◽  
Lizbeth Moreno Loaeza ◽  
Laura Sofia Lazaro-Carrera ◽  
Brigette Bourguet Ramirez ◽  
Anabel Vázquez Rodríguez ◽  
...  
Keyword(s):  
Mobile App ◽  
Spanish Version ◽  
Face Validity ◽  
Electronic Systems ◽  
Validity Index ◽  
Clinical Counseling ◽  
System Usability Scale ◽  
System Usability ◽  
The Face ◽  
Development And Validation

Background The System Usability Scale (SUS) is a common metric used to assess the usability of a system, and it was initially developed in English. The implementation of electronic systems for clinical counseling (eHealth and mobile health) is increasing worldwide. Therefore, tools are needed to evaluate these applications in the languages and regional contexts in which the electronic tools are developed. Objective This study aims to translate, culturally adapt, and validate the original English version of the SUS into a Spanish version. Methods The translation process included forward and backward translation. Forward translations were made by 2 native Spanish speakers who spoke English as their second language, and a backward translation was made by a native English speaker. The Spanish SUS questionnaire was validated by 10 experts in mobile app development. The face validity of the questionnaire was tested with 10 mobile phone users, and the reliability testing was conducted among 88 electronic application users. Results The content validity index of the new Spanish SUS was good, as indicated by a rating of 0.92 for the relevance of the items. The questionnaire was easy to understand, based on a face validity index of 0.94. The Cronbach α was .812 (95% CI 0.748-0.866; P<.001). Conclusions The new Spanish SUS questionnaire is a valid and reliable tool to assess the usability of electronic tools among Spanish-speaking users.

scholarly journals Spanish Version of the System Usability Scale for the Assessment of Electronic Tools: Development and Validation (Preprint)

2020 ◽  
Author(s):  
Magdalena Del Rocio Sevilla-Gonzalez ◽  
Lizbeth Moreno Loaeza ◽  
Laura Sofia Lazaro-Carrera ◽  
Brigette Bourguet Ramirez ◽  
Anabel Vázquez Rodríguez ◽  
...  
Keyword(s):  
Mobile App ◽  
Spanish Version ◽  
Face Validity ◽  
Electronic Systems ◽  
Validity Index ◽  
Clinical Counseling ◽  
System Usability Scale ◽  
System Usability ◽  
The Face ◽  
Development And Validation

BACKGROUND The System Usability Scale (SUS) is a common metric used to assess the usability of a system, and it was initially developed in English. The implementation of electronic systems for clinical counseling (eHealth and mobile health) is increasing worldwide. Therefore, tools are needed to evaluate these applications in the languages and regional contexts in which the electronic tools are developed. OBJECTIVE This study aims to translate, culturally adapt, and validate the original English version of the SUS into a Spanish version. METHODS The translation process included forward and backward translation. Forward translations were made by 2 native Spanish speakers who spoke English as their second language, and a backward translation was made by a native English speaker. The Spanish SUS questionnaire was validated by 10 experts in mobile app development. The face validity of the questionnaire was tested with 10 mobile phone users, and the reliability testing was conducted among 88 electronic application users. RESULTS The content validity index of the new Spanish SUS was good, as indicated by a rating of 0.92 for the relevance of the items. The questionnaire was easy to understand, based on a face validity index of 0.94. The Cronbach α was .812 (95% CI 0.748-0.866; <i>P</i><.001). CONCLUSIONS The new Spanish SUS questionnaire is a valid and reliable tool to assess the usability of electronic tools among Spanish-speaking users.

scholarly journals The QardioArm App in the Assessment of Blood Pressure and Heart Rate: Reliability and Validity Study (Preprint)

2017 ◽  
Author(s):  
Victoria Mazoteras Pardo ◽  
Marta E Losa Iglesias ◽  
José López Chicharro ◽  
Ricardo Becerro de Bengoa Vallejo
Keyword(s):  
Blood Pressure ◽  
Heart Rate ◽  
European Society ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Correlation Coefficients ◽  
Mobile App ◽  
Blood Pressure Monitor ◽  
Pressure Monitor ◽  
Mean Values

BACKGROUND Self-measurement of blood pressure is a priority strategy for managing blood pressure. OBJECTIVE The aim of this study was to evaluate the reliability and validity of blood pressure and heart rate following the European Society of Hypertension’s international validation protocol, as measured with the QardioArm, a fully automatic, noninvasive wireless blood pressure monitor and mobile app. METHODS A total of 100 healthy volunteers older than 25 years from the general population of Ciudad Real, Spain, participated in a test-retest validation study with two measurement sessions separated by 5 to 7 days. In each measurement session, seven systolic blood pressure, diastolic blood pressure, and heart rate assessments were taken, alternating between the two devices. The test device was the QardioArm and the previously validated criterion device was the Omron M3. Sessions took place at a single study site with an evaluation room that was maintained at an appropriate temperature and kept free from noises and distractions. RESULTS The QardioArm displayed very consistent readings both within and across sessions (intraclass correlation coefficients=0.80-0.95, standard errors of measurement=2.5-5.4). The QardioArm measurements corresponded closely to those from the criterion device (r>.96) and mean values for the two devices were nearly identical. The QardioArm easily passed all validation standards set by the European Society of Hypertension International Protocol. CONCLUSIONS The QardioArm mobile app has validity and it can be used free of major measurement error.

scholarly journals Malay Version of the mHealth App Usability Questionnaire (M-MAUQ): Translation, Adaptation, and Validation Study

10.2196/24457 ◽  
2021 ◽  
Vol 9 (2) ◽  
pp. e24457
Author(s):  
Norashikin Mustafa ◽  
Nik Shanita Safii ◽  
Aida Jaffar ◽  
Nor Samsiah Sani ◽  
Mohd Izham Mohamad ◽  
...  
Keyword(s):  
Reliability And Validity ◽  
General System ◽  
Kappa Statistic ◽  
Ease Of Use ◽  
Face Validity ◽  
Validity Index ◽  
Good Reliability ◽  
Target User ◽  
Forward Translation ◽  
Mhealth Apps

Background Mobile health (mHealth) apps play an important role in delivering education, providing advice on treatment, and monitoring patients’ health. Good usability of mHealth apps is essential to achieve the objectives of mHealth apps efficiently. To date, there are questionnaires available to assess the general system usability but not explicitly tailored to precisely assess the usability of mHealth apps. Hence, the mHealth App Usability Questionnaire (MAUQ) was developed with 4 versions according to the type of app (interactive or standalone) and according to the target user (patient or provider). Standalone MAUQ for patients comprises 3 subscales, which are ease of use, interface and satisfaction, and usefulness. Objective This study aimed to translate and validate the English version of MAUQ (standalone for patients) into a Malay version of MAUQ (M-MAUQ) for mHealth app research and usage in future in Malaysia. Methods Forward and backward translation and harmonization of M-MAUQ were conducted by Malay native speakers who also spoke English as their second language. The process began with a forward translation by 2 independent translators followed by harmonization to produce an initial translated version of M-MAUQ. Next, the forward translation was continued by another 2 translators who had never seen the original MAUQ. Lastly, harmonization was conducted among the committee members to resolve any ambiguity and inconsistency in the words and sentences of the items derived with the prefinal adapted questionnaire. Subsequently, content and face validations were performed with 10 experts and 10 target users, respectively. Modified kappa statistic was used to determine the interrater agreement among the raters. The reliability of the M-MAUQ was assessed by 51 healthy young adult mobile phone users. Participants needed to install the MyFitnessPal app and use it for 2 days for familiarization before completing the designated task and answer the M-MAUQ. The MyFitnessPal app was selected because it is one among the most popular installed mHealth apps globally available for iPhone and Android users and represents a standalone mHealth app. Results The content validity index for the relevancy and clarity of M-MAUQ were determined to be 0.983 and 0.944, respectively, which indicated good relevancy and clarity. The face validity index for understandability was 0.961, which indicated that users understood the M-MAUQ. The kappa statistic for every item in M-MAUQ indicated excellent agreement between the raters (κ ranging from 0.76 to 1.09). The Cronbach α for 18 items was .946, which also indicated good reliability in assessing the usability of the mHealth app. Conclusions The M-MAUQ fulfilled the validation criteria as it revealed good reliability and validity similar to the original version. M-MAUQ can be used to assess the usability of mHealth apps in Malay in the future.

scholarly journals Translation, Cross-Cultural Adaptation, and Validation of the Malay Version of the System Usability Scale Questionnaire for the Assessment of Mobile Apps (Preprint)

2018 ◽  
Author(s):  
Muhamad Fadhil Mohamad Marzuki ◽  
Nor Azwany Yaacob ◽  
Najib Majdi Yaacob
Keyword(s):  
Cultural Adaptation ◽  
Mobile Apps ◽  
Mobile App ◽  
Cross Cultural ◽  
Face Validity ◽  
Validity Index ◽  
Cross Cultural Adaptation ◽  
System Usability Scale ◽  
System Usability ◽  
The Face

BACKGROUND A mobile app is a programmed system designed to be used by a target user on a mobile device. The usability of such a system refers not only to the extent to which product can be used to achieve the task that it was designed for, but also its effectiveness and efficiency, as well as user satisfaction. The System Usability Scale is one of the most commonly used questionnaires used to assess the usability of a system. The original 10-item version of System Usability Scale was developed in English and thus needs to be adapted into local languages to assess the usability of a mobile apps developed in other languages. OBJECTIVE The aim of this study is to translate and validate (with cross-cultural adaptation) the English System Usability Scale questionnaire into Malay, the main language spoken in Malaysia. The development of a translated version will allow the usability of mobile apps to be assessed in Malay. METHODS Forward and backward translation of the questionnaire was conducted by groups of Malay native speakers who spoke English as their second language. The final version was obtained after reconciliation and cross-cultural adaptation. The content of the Malay System Usability Scale questionnaire for mobile apps was validated by 10 experts in mobile app development. The efficacy of the questionnaire was further probed by testing the face validity on 10 mobile phone users, followed by reliability testing involving 54 mobile phone users. RESULTS The content validity index was determined to be 0.91, indicating good relevancy of the 10 items used to assess the usability of a mobile app. Calculation of the face validity index resulted in a value of 0.94, therefore indicating that the questionnaire was easily understood by the users. Reliability testing showed a Cronbach alpha value of .85 (95% CI 0.79-0.91) indicating that the translated System Usability Scale questionnaire is a reliable tool for the assessment of usability of a mobile app. CONCLUSIONS The Malay System Usability Scale questionnaire is a valid and reliable tool to assess the usability of mobile app in Malaysia.

Development and Validation of the Japanese Version of the Consensus Auditory-Perceptual Evaluation of Voice

2021 ◽  
pp. 1-8
Author(s):  
Kanako Kondo ◽  
Masanobu Mizuta ◽  
Yoshitaka Kawai ◽  
Tohru Sogami ◽  
Shintaro Fujimura ◽  
...  
Keyword(s):  
Intraclass Correlation ◽  
Voice Quality ◽  
Reliability And Validity ◽  
Correlation Coefficients ◽  
Japanese Version ◽  
Evaluation Instrument ◽  
Intraclass Correlation Coefficients ◽  
Perceptual Evaluation ◽  
Highly Correlated ◽  
Development And Validation

Purpose: Auditory-perceptual evaluation is essential for the assessment of voice quality. The Consensus Auditory-Perceptual Evaluation of Voice (CAPE-V) provides a standardized protocol and assessment form for clinicians to analyze the voice quality and has been adapted into several different languages. The aims of this study were to develop the Japanese version of the CAPE-V and to investigate its reliability and validity. Method: The Japanese CAPE-V consisted of the same three speech contexts (vowels, sentences, and conversation) as developed in the original English version. The sentences were designed according to the concepts of the original version and reviewed by Japanese phoneticians. To validate the usefulness of the Japanese CAPE-V, voices of 173 Japanese-speaking subjects (76 subjects with dysphonia and 97 without voice complaints) were evaluated by five experienced judges, according to the Japanese CAPE-V as well as the GRBAS (Grade, Roughness, Breathiness, Asthenia, Strain) scale. Results: The Japanese CAPE-V provided a high interrater reliability (intraclass correlation coefficients [ICCs] > .85 for all the parameters) as well as a high intrarater reliability (ICCs > .85 for all the parameters). In addition, overall severity, roughness, and breathiness in the Japanese CAPE-V were highly correlated with the corresponding dimensions in the GRBAS scale, having Spearman correlation coefficients greater than .8. Conclusion: This study demonstrated the reliability and validity of the newly developed Japanese CAPE-V as an auditory-perceptual evaluation instrument.

Is It Time to Go Positive? Assessing the Positively Worded System Usability Scale (SUS)

2020 ◽  
pp. 001872081988155 ◽  
Author(s):  
Philip Kortum ◽  
Claudia Ziegler Acemyan ◽  
Frederick L. Oswald
Keyword(s):  
Cognitive Load ◽  
Reliability And Validity ◽  
Subjective Assessment ◽  
Spoken Language ◽  
Viable Alternative ◽  
Psychometric Methods ◽  
System Usability Scale ◽  
System Usability ◽  
Subjective Usability ◽  
Larger Sample

Objective: The goal of the research presented in this paper was to determine if the positively worded System Usability Scale (SUS) can be used in place of the positively and negatively worded standard SUS instrument for the subjective assessment of usability, and whether the results found here replicate those of Sauro and Lewis. Background: Sauro and Lewis’ previous study found no evidence that responses to SUS items differed across the standard SUS and the modified, positively worded version of the SUS when participants assessed websites. This study replicates and extends this work by examining a large number of different systems with larger sample sizes to add to the generalizability of previous findings. Methods: So that participants could retrospectively assess 20 products, the standard SUS was administered to 268 participants and the positive SUS to 698 participants. SUS scores were computed and the data analyzed using psychometric methods to explore how the two versions of the SUS differed. Results: The standard and positive versions of the SUS yielded similar SUS scores. In addition, both versions of the scale demonstrated evidence in support of reliability and validity. Conclusion: Either version of the SUS can be used with confidence to measure subjective usability. Furthermore, the scores generated from both versions of the SUS can be directly compared. Applications: In situations where cognitive load, participants’ spoken language, or item consistency with other surveys being given may be a factor, the positive SUS is a viable alternative to the standard SUS.

Development and Validation of a Clinical Scale for the Evaluation of Forearm Skin Photoaging

2015 ◽  
Vol 19 (4) ◽  
pp. 380-387 ◽  
Author(s):  
C.O.Z. Guimarães ◽  
E. Bagatin ◽  
L.R.S. Guadanhim ◽  
F. Sternberg ◽  
F.R. Picosse ◽  
...  
Keyword(s):  
Internal Consistency ◽  
Reliability And Validity ◽  
Internal Consistency Reliability ◽  
Skin Aging ◽  
Faculty Members ◽  
Clinical Scale ◽  
Forearm Skin ◽  
Skin Photoaging ◽  
High Internal Consistency ◽  
Development And Validation

Background: Despite the focus on facial photoaging ratings, there are few classifications developed for forearm skin aging assessment. Objective: To develop and validate a clinical scale for the evaluation of forearm skin aging. Methods: Three clinical dermatology faculty members selected, discussed, and appraised the main signs of forearm photoaging. The validation of the resulting scale was performed by 5 assessors who were previously trained to classify 102 photographs of forearms with different degrees of aging. Retests were performed in 15 days. Results: There was significant correlation between the selected variables and the subjective global aging scale. The developed scale showed high internal consistency (Cronbach’s α = 0.87) and high correlation with the global photoaging scale (rho = 0.92). Inter- and intraobserver final scores showed high agreement. Conclusion: A validated clinical photoaging scale for forearms with internal consistency, reliability, and validity was developed.

scholarly journals Development and validation of the Health-Friendly Activity Index: an assessment tool to comprehensively measure health-friendly activities of corporations or organisations

BMJ Open ◽  
2021 ◽  
Vol 11 (7) ◽  
pp. e048768
Author(s):  
Young Ho Yun ◽  
Si Nae Oh ◽  
Jin-Ah Sim ◽  
Sujee Lee ◽  
Eun-Jung Sohn
Keyword(s):  
Assessment Tool ◽  
Activity Index ◽  
Reliability And Validity ◽  
Correlation Coefficients ◽  
Field Testing ◽  
Cross Sectional Study ◽  
Cross Sectional ◽  
Corporate Managers ◽  
Health Related ◽  
Development And Validation

ObjectivesWe developed the Health-Friendly Activity Index (HFAI) to comprehensively measure the health-friendly activities of corporations or organisations. We validated the developed tool and reported on its use as an assessment tool to improve consumers’ health-related outcomes.DesignThis was a cross-sectional study.SettingDevelopment of the HFAI questionnaire followed a three-phase process: item generation, item construction and validation with field testing. Using relevance and feasibility criteria, we developed a 105-item questionnaire with six domains (Governance and Infrastructure, Needs Assessment, Planning, Implementation, Monitoring and Feedback, and Outcomes).ParticipantsTo assess the sensitivity and validity of the questionnaire, the HFAI and Contribution Assessment Tool for Consumer’s Health (CATCH) were administered to 302 participants (151 employers and 151 employees) from 151 Korean companies.Primary outcome measuresThe CATCH measured the contribution of each company to the physical, mental, social and spiritual health of its consumers. To estimate the reliability and validity of all six HFAI domains and their respective scales, Cronbach’s α coefficients and correlation coefficients were used.ResultsEach domain and scale of the HFAI exhibited a Cronbach’s α coefficient between 0.80 and 0.98 for the employers and employees. The overall HFAI and its six domains correlated significantly and positively with all health outcomes such as physical, mental, social and spiritual status scores evaluated using the CATCH (Spearman’s correlation range: 0.37–0.68).ConclusionThe HFAI, a unique assessment tool with acceptable psychometric properties, can help corporate managers assess their health-friendly activities.

scholarly journals Barriers to and Facilitators of the Use of Mobile Health Apps From a Security Perspective: Mixed-Methods Study (Preprint)

2018 ◽  
Author(s):  
Leming Zhou ◽  
Jie Bao ◽  
Valerie Watzlaf ◽  
Bambang Parmanto
Keyword(s):  
Mobile Health ◽  
Health Management ◽  
Mobile App ◽  
Security And Privacy ◽  
Semistructured Interview ◽  
Privacy Concerns ◽  
Validated Questionnaire ◽  
Short Period ◽  
Study Participants ◽  
Mhealth Apps

BACKGROUND A large number of mobile health (mHealth) apps have been created to help users to manage their health or receive health care services. Many of these mHealth apps have proven to be helpful for maintaining or improving their users’ health. However, many people still choose not to use mHealth apps or only use them for a short period. One of the reasons behind this lack of use is the concern for their health information security and privacy. OBJECTIVE The goal of this study was to determine the relationship between users’ characteristics and their security and privacy concerns and to identify desired security features in mHealth apps, which could reduce these concerns. METHODS A questionnaire was designed and validated by the research team. This questionnaire was then used to determine mobile app users’ security and privacy concerns regarding personal health data in mHealth apps as well as the security features most users’ desire. A semistructured interview was used to identify barriers to and facilitators of adopting mHealth apps. RESULTS In total, 117 randomly selected study participants from a large pool took part in this study and provided responses to the validated questionnaire and the semistructured interview questions. The results indicate that most study participants did have concerns about their privacy when using mHealth apps. They also expressed their preferences regarding several security features in mHealth apps, such as regular password updates, remote wipe, user consent, and access control. An association between their demographic characteristics and their concerns and preferences in security and privacy was identified; however, in most cases, the differences among the different demographic groups were not statistically significant, except for a few very specific aspects. These study participants also indicated that the cost of apps and lack of security features in mHealth apps were barriers for adoption, whereas having free apps, strong but easy-to-use security features, and clear user protection privacy policies might encourage them to use mHealth apps in their health management. CONCLUSIONS This questionnaire and interview study verified the security and privacy concerns of mHealth app users, identified the desired security and privacy features, and determined specific barriers to and facilitators of users adopting mHealth apps. The results can be used to guide mHealth app developers to create apps that would be welcomed by users.

Sign in / Sign up

Export Citation Format

Share Document