scholarly journals A Mobile Patient-Reported Outcome Measure App With Talking Touchscreen: Usability Assessment

10.2196/11617 ◽  
2019 ◽  
Vol 3 (3) ◽  
pp. e11617 ◽  
Author(s):  
Marlies Welbie ◽  
Harriet Wittink ◽  
Marjan J Westerman ◽  
Ilse Topper ◽  
Josca Snoei ◽  
...  

Background In the past years, a mobile health (mHealth) app called the Dutch Talking Touch Screen Questionnaire (DTTSQ) was developed in The Netherlands. The aim of development was to enable Dutch physical therapy patients to autonomously complete a health-related questionnaire regardless of their level of literacy and digital skills. Objective The aim of this study was to evaluate the usability (defined as the effectiveness, efficiency, and satisfaction) of the prototype of the DTTSQ for Dutch physical therapy patients with diverse levels of experience in using mobile technology. Methods The qualitative Three-Step Test-Interview method, including both think-aloud and retrospective probing techniques, was used to gain insight into the usability of the DTTSQ. A total of 24 physical therapy patients were included. The interview data were analyzed using a thematic content analysis approach aimed at analyzing the accuracy and completeness with which participants completed the questionnaire (effectiveness), the time it took the participants to complete the questionnaire (efficiency), and the extent to which the participants were satisfied with the ease of use of the questionnaire (satisfaction). The problems encountered by the participants in this study were given a severity rating that was used to provide a rough estimate of the need for additional usability efforts. Results All participants within this study were very satisfied with the ease of use of the DTTSQ. Overall, 9 participants stated that the usability of the app exceeded their expectations. The group of 4 average-/high-experienced participants encountered only 1 problem in total, whereas the 11 little-experienced participants encountered an average of 2 problems per person and the 9 inexperienced participants an average of 3 problems per person. A total of 13 different kind of problems were found during this study. Of these problems, 4 need to be addressed before the DTTSQ will be released because they have the potential to negatively influence future usage of the tool. The other 9 problems were less likely to influence future usage of the tool substantially. Conclusions The usability of the DTTSQ needs to be improved before it can be released. No problems were found with satisfaction or efficiency during the usability test. The effectiveness needs to be improved by (1) making it easier to navigate through screens without the possibility of accidentally skipping one, (2) enabling the possibility to insert an answer by tapping on the text underneath a photograph instead of just touching the photograph itself, and (3) making it easier to correct wrong answers. This study shows the importance of including less skilled participants in a usability study when striving for inclusive design and the importance of measuring not just satisfaction but also efficiency and effectiveness during such studies.

2018 ◽  
Author(s):  
Marlies Welbie ◽  
Harriet Wittink ◽  
Marjan J Westerman ◽  
Ilse Topper ◽  
Josca Snoei ◽  
...  

BACKGROUND In the past years, a mobile health (mHealth) app called the Dutch Talking Touch Screen Questionnaire (DTTSQ) was developed in The Netherlands. The aim of development was to enable Dutch physical therapy patients to autonomously complete a health-related questionnaire regardless of their level of literacy and digital skills. OBJECTIVE The aim of this study was to evaluate the usability (defined as the effectiveness, efficiency, and satisfaction) of the prototype of the DTTSQ for Dutch physical therapy patients with diverse levels of experience in using mobile technology. METHODS The qualitative Three-Step Test-Interview method, including both think-aloud and retrospective probing techniques, was used to gain insight into the usability of the DTTSQ. A total of 24 physical therapy patients were included. The interview data were analyzed using a thematic content analysis approach aimed at analyzing the accuracy and completeness with which participants completed the questionnaire (effectiveness), the time it took the participants to complete the questionnaire (efficiency), and the extent to which the participants were satisfied with the ease of use of the questionnaire (satisfaction). The problems encountered by the participants in this study were given a severity rating that was used to provide a rough estimate of the need for additional usability efforts. RESULTS All participants within this study were very satisfied with the ease of use of the DTTSQ. Overall, 9 participants stated that the usability of the app exceeded their expectations. The group of 4 average-/high-experienced participants encountered only 1 problem in total, whereas the 11 little-experienced participants encountered an average of 2 problems per person and the 9 inexperienced participants an average of 3 problems per person. A total of 13 different kind of problems were found during this study. Of these problems, 4 need to be addressed before the DTTSQ will be released because they have the potential to negatively influence future usage of the tool. The other 9 problems were less likely to influence future usage of the tool substantially. CONCLUSIONS The usability of the DTTSQ needs to be improved before it can be released. No problems were found with satisfaction or efficiency during the usability test. The effectiveness needs to be improved by (1) making it easier to navigate through screens without the possibility of accidentally skipping one, (2) enabling the possibility to insert an answer by tapping on the text underneath a photograph instead of just touching the photograph itself, and (3) making it easier to correct wrong answers. This study shows the importance of including less skilled participants in a usability study when striving for inclusive design and the importance of measuring not just satisfaction but also efficiency and effectiveness during such studies.


2019 ◽  
Author(s):  
Marlies Welbie ◽  
Harriet Wittink ◽  
Sahin Bozkurt ◽  
Tugba Coban ◽  
Walter LJM Devillé

BACKGROUND The Turkish translation of the Dutch Talking Touch Screen Questionnaire (TTSQ) has been developed to help physical therapy patients with a Turkish background in the Netherlands to autonomously elucidate their health problems and impairments and set treatment goals, regardless of their level of health literacy. OBJECTIVE The aim of this study was to evaluate the usability of the Turkish TTSQ for physical therapy patients with a Turkish background with diverse levels of health literacy and experience in using mobile technology. METHODS The qualitative Three-Step Test-Interview method was carried out to gain insight into the usability of the Turkish TTSQ. A total of 10 physical therapy patients participated. The interview data were analyzed using a thematic content analysis approach aimed at determining the accuracy and completeness with which participants completed the questionnaire (effectiveness), the time it took participants to complete the questionnaire (efficiency), and the extent to which the participants were satisfied with the ease of use of the questionnaire (satisfaction). The problems encountered by the participants in this study were given a severity rating, which was used to provide a rough estimate of the need for additional usability improvements. RESULTS No participant in this study was able to complete the questionnaire without encountering at least one usability problem. A total of 17 different kinds of problems were found. On the basis of their severity score, 3 problems that should be addressed during future development of the tool were “Not using the navigation function of the photo gallery in Question 4 causing the participant to not see all presented response items;” “Touching the text underneath a photo in Question 4 to select an activity instead of touching the photo itself, causing the activity not to be selected;” and “Pushing too hard or tapping too softly on the touch screen causing the touch screen to not respond.” The data on efficiency within this study were not valid and are, therefore, not reported in this study. No participant was completely satisfied or dissatisfied with the overall ease of use of the Turkish TTSQ. Two participants with no prior experience of using tablet computers felt that, regardless of what kinds of improvement might be made, it would just be too difficult for them to learn to work with the device. CONCLUSIONS As with the Dutch TTSQ, the Turkish TTSQ needs improvement before it can be released. The results of this study confirm the conclusion of the Dutch TTSQ study that participants with low levels of education and little experience in using mobile technology are less able to operate the TTSQ effectively. Using a Dutch speaking interviewer and Turkish interpreter has had a negative effect on data collection in this study.


10.2196/14189 ◽  
2020 ◽  
Vol 4 (2) ◽  
pp. e14189
Author(s):  
Marlies Welbie ◽  
Harriet Wittink ◽  
Sahin Bozkurt ◽  
Tugba Coban ◽  
Walter LJM Devillé

Background The Turkish translation of the Dutch Talking Touch Screen Questionnaire (TTSQ) has been developed to help physical therapy patients with a Turkish background in the Netherlands to autonomously elucidate their health problems and impairments and set treatment goals, regardless of their level of health literacy. Objective The aim of this study was to evaluate the usability of the Turkish TTSQ for physical therapy patients with a Turkish background with diverse levels of health literacy and experience in using mobile technology. Methods The qualitative Three-Step Test-Interview method was carried out to gain insight into the usability of the Turkish TTSQ. A total of 10 physical therapy patients participated. The interview data were analyzed using a thematic content analysis approach aimed at determining the accuracy and completeness with which participants completed the questionnaire (effectiveness), the time it took participants to complete the questionnaire (efficiency), and the extent to which the participants were satisfied with the ease of use of the questionnaire (satisfaction). The problems encountered by the participants in this study were given a severity rating, which was used to provide a rough estimate of the need for additional usability improvements. Results No participant in this study was able to complete the questionnaire without encountering at least one usability problem. A total of 17 different kinds of problems were found. On the basis of their severity score, 3 problems that should be addressed during future development of the tool were “Not using the navigation function of the photo gallery in Question 4 causing the participant to not see all presented response items;” “Touching the text underneath a photo in Question 4 to select an activity instead of touching the photo itself, causing the activity not to be selected;” and “Pushing too hard or tapping too softly on the touch screen causing the touch screen to not respond.” The data on efficiency within this study were not valid and are, therefore, not reported in this study. No participant was completely satisfied or dissatisfied with the overall ease of use of the Turkish TTSQ. Two participants with no prior experience of using tablet computers felt that, regardless of what kinds of improvement might be made, it would just be too difficult for them to learn to work with the device. Conclusions As with the Dutch TTSQ, the Turkish TTSQ needs improvement before it can be released. The results of this study confirm the conclusion of the Dutch TTSQ study that participants with low levels of education and little experience in using mobile technology are less able to operate the TTSQ effectively. Using a Dutch speaking interviewer and Turkish interpreter has had a negative effect on data collection in this study.


2021 ◽  
Vol 264 ◽  
pp. 394-401
Author(s):  
Mary Kate Luddy ◽  
Rachel Vetter ◽  
Jessica Shank ◽  
Whitney Goldner ◽  
Anery Patel ◽  
...  

2021 ◽  
Author(s):  
David Putrino ◽  
Laura Tabacof ◽  
Jenna Tosto-Mancuso ◽  
Jamie Wood ◽  
Mar Cortes ◽  
...  

Abstract Post-acute COVID-19 syndrome (PACS) is a collection of persistent and debilitating symptoms lasting weeks to months after acute COVID-19 infection, with fatigue most commonly reported. There is controversy surrounding the role of exercise programs for this condition, due to concerns over the potential to worsen fatigue. We developed a novel physical therapy program known as Autonomic Conditioning Therapy (ACT) for PACS, and report on the preliminary patient-reported outcome (PRO) data from individuals who completed ACT for PACS, compared with those who did not. Seventy-eight (55 [71%] female, median [range] age 43 [12 to 78]) met the inclusion criteria and consented to have their data included in the analyses. A total of 31 (40%) individuals completed ACT for PACS. There was within-group improvement in fatigue in individuals who completed ACT for PACS (mean difference [95% CI] -14 [-27 to -1], p = 0.03), as well as greater between-group impression of change measured on the Patient Global Impression of Change scale (ACT for PACS median [range] 5 [1 to 7], no ACT for PACS 4 [1 to 7], p < 0.01). ACT for PACS is a novel physical therapy program that can reduce fatigue in individuals with PACS.


Neurology ◽  
2018 ◽  
Vol 90 (23) ◽  
pp. e2034-e2041 ◽  
Author(s):  
Kelly G. Gwathmey ◽  
Reza Sadjadi ◽  
William B. Horton ◽  
Mark R. Conaway ◽  
Carolina Barnett-Tapia ◽  
...  

ObjectiveWe studied the performance of a 15-item, health-related quality-of-life polyneuropathy scale in the clinic setting in patients with diabetic distal sensorimotor polyneuropathy (DSPN).MethodsPatients with DSPN from 11 academic sites completed a total of 231 Chronic Acquired Polyneuropathy Patient-Reported Index (CAPPRI) scales during their clinic visits. Conventional and modern psychometric analyses were performed on the completed forms.ResultsConventional and modern analyses generally indicated excellent psychometric properties of the CAPPRI in patients with DSPN. For example, the CAPPRI demonstrated unidimensionality and performed like an interval-level scale.ConclusionAttributes of the CAPPRI for DSPN include ease of use and interpretation; unidimensionality, allowing scores to be summed; adequate coverage of disease severity; and the scale's ability to address relevant life domains. Furthermore, the CAPPRI is free and in the public domain. The CAPPRI may assist the clinician and patient with DSPN in estimating disease-specific quality of life, especially in terms of pain, sleep, psychological well-being, and everyday function. The CAPPRI may be most useful in the everyday clinical setting but merits further study in this setting, as well as the clinical trial setting.


Sign in / Sign up

Export Citation Format

Share Document