Demonstration of remote usability testing practices and procedures

Background Technology can benefit older adults in many ways, including by facilitating remote access to services, communication, and socialization for convenience or out of necessity when individuals are homebound. As people, especially older adults, self-quarantined and sheltered in place during the COVID-19 pandemic, the importance of usability-in-place became clear. To understand the remote use of technology in an ecologically valid manner, researchers and others must be able to test usability remotely. Objective Our objective was to review practical approaches for and findings about remote usability testing, particularly remote usability testing with older adults. Methods We performed a rapid review of the literature and reported on available methods, their advantages and disadvantages, and practical recommendations. This review also reported recommendations for usability testing with older adults from the literature. Results Critically, we identified a gap in the literature—a lack of remote usability testing methods, tools, and strategies for older adults, despite this population’s increased remote technology use and needs (eg, due to disability or technology experience). We summarized existing remote usability methods that were found in the literature as well as guidelines that are available for conducting in-person usability testing with older adults. Conclusions We call on the human factors research and practice community to address this gap to better support older adults and other homebound or mobility-restricted individuals.

Download Full-text

Remote Usability Testing in Portal Web Perpustakaan Nasional Republik Indonesia

Record and Library Journal ◽

10.20473/rlj.v1-i1.2015.68-76 ◽

2018 ◽

Vol 1 (1) ◽

pp. 68

Author(s):

Ari Zuntriana

Keyword(s):

Interface Design ◽

Research Result ◽

Data Gathering ◽

Usability Testing ◽

Test Method ◽

Web Portal ◽

Online Questionnaire ◽

Usability Test ◽

Research Findings ◽

Remote Usability Testing

Portal Web Perpustakaan Nasional Republik Indonesia(PNRI) or Indonesian National Library Web Portal is one of the best resources that support education in Indonesia. With the large collection of librarians, PNRI can reach millions of librarian with various education background and area. To ensure its sustainability, we need to conduct research to know how good is the usability this web portal to the remote user. One of the way is using web usability testing. By using this test, PNRI will get the information about what is needed to be fixed and for the next step it can be used as recommendation in redesigning of the portal. PNRI web portal test will be held using remote usability test method. The research is conducted by combining inquiry with formal usability test, like giving a task to the participant. The sampling method used is random sampling by using 32 participant. Data gathering technique used is using online questionnaire. The research result shows that: (1) most of the participant get difficulties in finding information about service schedule; (2) most of the participant dissatisfied in interface design and arrangement in the homepage of PNRI portal. This research is intended as the starting research. It needs the next research to deepen and complete the information and research findings, especially about portal efficiency.

Download Full-text

A Proposed Web Based Real Time Brain Computer Interface (BCI) System for Usability Testing

International Journal of Online and Biomedical Engineering (iJOE) ◽

10.3991/ijoe.v15i08.10406 ◽

2019 ◽

Vol 15 (08) ◽

pp. 108

Author(s):

Hewawasam Puwakpitiyage C. A. ◽

Paramesura Rao V. R. ◽

Muhammad Azizi M. S. A. ◽

Tee W. J. ◽

Murugesan R. K. ◽

...

Keyword(s):

Real Time ◽

Brain Computer Interface ◽

Usability Testing ◽

Computer Interface ◽

Web Based ◽

Expert Review ◽

Usability Test ◽

Usability Tests ◽

Remote Usability Testing ◽

Bci System

<p class="Abstract">Hallway testing, Remote Usability testing, Expert review, Automated expert review and A/B testing are the methods commonly used for Usability testing. However, there is no reliable system that integrates Brain Computer Interface (BCI) into the testing process with focus given towards user emotion analysis using electroencephalography (EEG) signals. This paper proposes a system that would be able to identify user emotions while they are conducting usability tests and the results would be able to increase the accuracy of the usability test. In the proposed system the results of the usability test would be displayed in real time on a dashboard and a summary report can be generated for distribution.</p>

Download Full-text

A Proposed Web Based Real Time Brain Computer Interface (BCI) System for Usability Testing

International Journal of Online and Biomedical Engineering (iJOE) ◽

10.3991/ijoe.v15i07.10447 ◽

2019 ◽

Vol 15 (07) ◽

pp. 111

Author(s):

Hewawasam Puwakpitiyage Chamode Anjana ◽

Paramesura Rao Vegnish Rao ◽

Muhammad Azizi Muhammad Syahir Amali bin ◽

Tee Wee Jing ◽

Murugesan Raja Kumar ◽

...

Keyword(s):

Real Time ◽

Brain Computer Interface ◽

Usability Testing ◽

Computer Interface ◽

Web Based ◽

Expert Review ◽

Usability Test ◽

Usability Tests ◽

Remote Usability Testing ◽

Bci System

<strong>Hallway testing, Remote Usability testing, Expert review, Automated expert review and A/B testing are the methods commonly used for Usability testing. However, there is no reliable system that integrates Brain Computer Interface (BCI) into the testing process with focus given towards user emotion analysis using electroencephalography (EEG) signals. This paper proposes a system that would be able to identify user emotions while they are conducting usability tests and the results would be able to increase the accuracy of the usability test. In the proposed system the results of the usability test would be displayed in real time on a dashboard and a summary report can be generated for distribution. </strong>

Download Full-text

Effect of Type of Information on Real Time Usability Evaluation: Implications for Remote Usability Testing

Proceedings of the Human Factors and Ergonomics Society Annual Meeting ◽

10.1177/154193120004403710 ◽

2000 ◽

Vol 44 (37) ◽

pp. 585-588 ◽

Cited By ~ 5

Author(s):

Erin M. Lesaigle ◽

David W. Biers

Keyword(s):

Real Time ◽

Usability Testing ◽

Usability Evaluation ◽

Video Data ◽

Questionnaire Data ◽

Problem Space ◽

Viewing Condition ◽

The Face ◽

Audio Data ◽

Remote Usability Testing

Fifteen usability professionals participated in a usability test under one of three simulated real time viewing conditions: (1) Screen data (S) where the evaluators saw only the image of the user's computer screen; (2) Screen plus Audio data (SA) where the user's verbalizations could be heard in addition to viewing the screen image; and (3) Screen plus Audio plus Video data (SAV) where the evaluator's additionally saw an image of the user's face in real time. Results indicated no significant differences in the total number of problems found under the three viewing conditions although there was some evidence that the problem space differed particularly from the subjective questionnaire data collected directly from the users. In rating the severity of the problems encountered, the agreement among the usability professionals was low and did not vary as a function of the number of years of the usability professional's experience. More importantly, however, ratings of severity varied as a function of viewing condition with those usability professionals in the face condition perceiving the same problems to be more severe. When considering only the most severe problems (on which there was agreement in severity ratings), the number of severe problems uncovered was less with the questionnaires than under the three real-time viewing conditions. The results are discussed in terms of real time usability evaluation and terms of the implications for remote usability testing.

Download Full-text