Usability evaluation with the cognitive walkthrough

1995 ◽  
Author(s):  
John Rieman ◽  
Marita Franzke ◽  
David Redmiles
Keyword(s):  
Usability Evaluation ◽  
Cognitive Walkthrough

scholarly journals Comparison of heuristic and cognitive walkthrough usability evaluation methods for evaluating health information systems

2016 ◽  
Vol 24 (e1) ◽  
pp. e55-e60 ◽  
Author(s):  
Reza Khajouei ◽  
Misagh Zahiri Esfahani ◽  
Yunes Jahani
Keyword(s):  
Information Systems ◽  
Evaluation Methods ◽  
Usability Evaluation ◽  
Health Care Information ◽  
Office Management ◽  
Usability Problems ◽  
Significant Difference ◽  
Health Care Information Systems ◽  
Cognitive Walkthrough ◽  
Usability Evaluation Methods

Objective: There are several user-based and expert-based usability evaluation methods that may perform differently according to the context in which they are used. The objective of this study was to compare 2 expert-based methods, heuristic evaluation (HE) and cognitive walkthrough (CW), for evaluating usability of health care information systems. Materials and methods: Five evaluators independently evaluated a medical office management system using HE and CW. We compared the 2 methods in terms of the number of identified usability problems, their severity, and the coverage of each method. Results: In total, 156 problems were identified using the 2 methods. HE identified a significantly higher number of problems related to the “satisfaction” attribute (P = .002). The number of problems identified using CW concerning the “learnability” attribute was significantly higher than those identified using HE (P = .005). There was no significant difference between the number of problems identified by HE, based on different usability attributes (P = .232). Results of CW showed a significant difference between the number of problems related to usability attributes (P < .0001). The average severity of problems identified using CW was significantly higher than that of HE (P < .0001). Conclusion: This study showed that HE and CW do not differ significantly in terms of the number of usability problems identified, but they differ based on the severity of problems and the coverage of some usability attributes. The results suggest that CW would be the preferred method for evaluating systems intended for novice users and HE for users who have experience with similar systems. However, more studies are needed to support this finding.

scholarly journals COMPARISON OF HEURISTIC EVALUATION AND COGNITIVE WALKTHROUGH METHODS IN DOING USABILITY EVALUATION OF MOBILE-BASED DEL EGOV CENTRE HOSPITAL INFORMATION SYSTEM

SEMINASTIKA ◽  
2021 ◽  
Vol 3 (1) ◽  
pp. 99-106
Author(s):  
Gracella Tambunan ◽  
Lit Malem Ginting
Keyword(s):  
Mobile Application ◽  
Evaluation Method ◽  
Likert Scale ◽  
Usability Evaluation ◽  
Heuristic Evaluation ◽  
Usability Problems ◽  
Interactive Product ◽  
Cognitive Walkthrough ◽  
Centre Hospital ◽  
Usability Evaluation Methods

Usability is a factor that indicates the success of an interactive product or system, such as a mobile application. The increasing use of smartphones demands a more accurate and effective usability evaluation method to find usability problems, so that they can be used for product improvement in the development process. This study compares the Cognitive Walkthrough method with Heuristic Evaluation in evaluating the usability of the SIRS Del eGov Center mobile application. Evaluation with these two methods will be carried out by three evaluators who act as experts. Finding problems and recommending improvements from each method will produce an improvement prototype made in the form of a high-fidelity prototype. Each prototype will be tested against ten participants using the Usability Testing method, which will generate scores through the SUS table. From the test scores, the percentage of Likert scale and the success rate of each prototype will be found. The results show that between the two usability evaluation methods, the Heuristic Evaluation method is the more effective method, finds more usability problems, and has a higher Likert scale percentage, which is 66.5%, while Cognitive Walkthrough is 64.75%.

Determining the Effectiveness of the Usability Problem Inspector: A Theory-Based Model and Tool for Finding Usability Problems

2003 ◽  
Vol 45 (3) ◽  
pp. 455-482 ◽  
Author(s):  
Terence S. Andre ◽  
H. Rex Hartson ◽  
Robert C. Williges
Keyword(s):  
Interface Design ◽  
Cost Effective ◽  
Usability Evaluation ◽  
Heuristic Evaluation ◽  
Evaluation Tool ◽  
Stage Of Development ◽  
Usability Problems ◽  
Usability Problem ◽  
Potential Applications ◽  
Cognitive Walkthrough

Despite the increased focus on usability and on the processes and methods used to increase usability, a substantial amount of software is unusable and poorly designed. Much of this is attributable to the lack of cost-effective usability evaluation tools that provide an interaction-based framework for identifying problems. We developed the user action framework and a corresponding evaluation tool, the usability problem inspector (UPI), to help organize usability concepts and issues into a knowledge base. We conducted a comprehensive comparison study to determine if our theory-based framework and tool could be effectively used to find important usability problems in an interface design, relative to two other established inspection methods (heuristic evaluation and cognitive walkthrough). Results showed that the UPI scored higher than heuristic evaluation in terms of thoroughness, validity, and effectiveness and was consistent with cognitive walkthrough for these same measures. We also discuss other potential advantages of the UPI over heuristic evaluation and cognitive walkthrough when applied in practice. Potential applications of this work include a cost-effective alternative or supplement to lab-based formative usability evaluation during any stage of development.

scholarly journals Usability Evaluation Using Multi-Method for Improvement Interaction in M-Commerce

2018 ◽  
Vol 218 ◽  
pp. 03003
Author(s):  
Daniel Hadrian Yohandy ◽  
DjokoBudiyanto Setyohadi
Keyword(s):  
Data Collection ◽  
Qualitative Data ◽  
Evaluation Process ◽  
Usability Evaluation ◽  
Depth Interview ◽  
The Common ◽  
Cognitive Walkthrough

Today, M-Commerce has become one of the common choices as a way of shopping for society. Therefore, the transaction in m-commerce grows significantly. Moreover, the competition of M-Commerce increases and the performance should be improved primarily for the satisfaction of buyers. These conditions are seen from an improvement of the features and service options that can be used by users, even outside the process of buying and selling goods. Increasing amount of features may reduce the usability of the application which may impact on the performance of M-Commerce. Therefore, this study aims to evaluate the usability of M-Commerce service. Our study addressed to evaluate the usability of one famous M-Commerce in Indonesia. The evaluation process was performed by using cognitive walkthrough and heuristic usability method. Data collection is done by using depth interview and questionnaire to collect quantitative and qualitative data. Our findings show some new insight for designers and developers about M-Commerce especially about usability and the potential of usability to improving the satisfaction of users in terms of using the M-Commerce application overall.

scholarly journals Usability evaluation of obstetrics and gynecology information system using cognitive walkthrough method

10.19082/6682 ◽  
2018 ◽  
Vol 10 (4) ◽  
pp. 6682-6688
Author(s):  
Azadeh Kamel Ghalibaf ◽  
Majid Jangi ◽  
Mohammad Reza Mazaheri Habibi ◽  
Sara Zangouei ◽  
Reza Khajouei
Keyword(s):  
Information System ◽  
Usability Evaluation ◽  
Obstetrics And Gynecology ◽  
Cognitive Walkthrough

scholarly journals Evaluación de la usabilidad en aplicaciones domóticas móviles usando el método de recorrido cognitive

2021 ◽  
Vol 4 (1) ◽  
pp. 53-63
Author(s):  
M.A. Coronado Arjona ◽  
V. M. Bianchi Rosado ◽  
J. A. Vivas Burgos
Keyword(s):  
Young People ◽  
The Elderly ◽  
Target Population ◽  
Usability Evaluation ◽  
Software Systems ◽  
Home Automation ◽  
Cognitive Walkthrough ◽  
At Home

La domótica es un conjunto de tecnologías hardware y software que se utiliza en la automatización de los hogares. A través de un software llamado aplicación domótica, las personas pueden acceder a los electrodomésticos independientemente si están dentro o fuera del hogar. La falta de aplicaciones que consideren las necesidades de la gente de la tercera edad, representa una problemática en el ámbito de acción de la domótica toda vez que la mayoría de los sistemas software están diseñados por gente joven y para gente joven [1], esto conlleva a que en muy pocas ocasiones sean tomadas en cuenta las características, necesidades y problemas de las personas de la tercera edad y consideradas en el diseño de aplicaciones que automaticen el hogar y por consecuencia no se alcancen los objetivos que la domótica promueve de proteger y facilitar la vida del adulto mayor. Considerándolos como población objetivo de este estudio, se optó por la evaluación de la usabilidad utilizando el método de recorrido cognitivo. Domotics is a set of hardware and software technologies that is used in home automation. With software called domotics applications, people can access to appliances, regardless of whether they are at home or outside them. The lack of applications that consider the needs of the elderly represents a problem in the field of domotics, since most software systems are designed by young people to young people. This means that the characteristics, needs and problems of the elderly are considered in very few occasions in the design of applications that automate the home. Consequently, the goals that domotics promotes to protect and facilitate the life of the elderly are not achieved. Considering them as the target population of this study, we chose the usability evaluation through the cognitive walkthrough method.  

scholarly journals An Evaluation of the Usability of a Computerized Decision Support System for Nursing Homes

2011 ◽  
Vol 02 (04) ◽  
pp. 420-436 ◽  
Author(s):  
M. Ehnfors ◽  
A. Fruhling ◽  
A. Ehrenberg ◽  
M. Fossum
Keyword(s):  
Nursing Home ◽  
Decision Support ◽  
Nursing Homes ◽  
Qualitative Content Analysis ◽  
Usability Evaluation ◽  
Nursing Personnel ◽  
Computerized Decision Support ◽  
Potential Health ◽  
Cognitive Walkthrough ◽  
Group Interviews

SummaryBackground: Computerized decision support systems (CDSSs) have the potential to significantly improve the quality of nursing care of older people by enhancing the decision making of nursing personnel. Despite this potential, health care organizations have been slow to incorporate CDSSs into nursing home practices.Objective: This study describes facilitators and barriers that impact the ability of nursing personnel to effectively use a clinical CDSS for planning and treating pressure ulcers (PUs) and malnutrition and for following the suggested risk assessment guidelines for the care of nursing home residents.Methods: We employed a qualitative descriptive design using varied methods, including structured group interviews, cognitive walkthrough observations and a graphical user interface (GUI) usability evaluation. Group interviews were conducted with 25 nursing personnel from four nursing homes in southern Norway. Five nursing personnel participated in cognitive walkthrough observations and the GUI usability evaluation. Text transcripts were analyzed using qualitative content analysis.Results: Group interview participants reported that ease of use, usefulness and a supportive work environment were key facilitators of CDSS use. The barriers identified were lack of training, resistance to using computers and limited integration of the CDSS with the facility’s electronic health record (EHR) system. Key findings from the usability evaluation also identified the difficulty of using the CDSS within the EHR and the poorly designed GUI integration as barriers.Conclusion: Overall, we found disconnect between two types of nursing personnel. Those who were comfortable with computer technology reported positive feedback about the CDSS, while others expressed resistance to using the CDSS for various reasons. This study revealed that organizations must invest more resources in educating nursing personnel on the seriousness of PUs and poor nutrition in the elderly, providing specialized CDSS training and ensuring that nursing personnel have time in the workday to use the CDSS.

scholarly journals Comparison Usability Evaluation Methods in a Health Information System: Heuristic Evaluation versus Cognitive Walkthrough Method

2021 ◽  
Author(s):  
Mehrdad Farzandipour ◽  
Ehsan Nabovati ◽  
Hamidreza Tadayon ◽  
Monireh Sadeqi Jabali
Keyword(s):  
Information System ◽  
Evaluation Method ◽  
Health Information System ◽  
Evaluation Methods ◽  
Usability Evaluation ◽  
Heuristic Evaluation ◽  
Usability Problems ◽  
Significant Difference ◽  
Cognitive Walkthrough ◽  
Usability Evaluation Methods

Abstract Background There are some inconsistencies regarding the selection of the most appropriate usability evaluation method. The present study aimed to compare two expert-based evaluation methods in a nursing module, as the most widely used module of a Hospital Information System (HIS). Methods The Heuristic Evaluation (HE) and Cognitive Walkthrough (CW) methods were used by five independent evaluators to evaluate the nursing module of Shafa HIS. In this regard, the number, severity and ratio of the recognized problems according to the usability attributes were compared using two evaluation methods. Results The use of the HE and CW evaluation methods resulted in the identification of 104 and 24 unique problems, respectively. The average severity of the recognized problems was 2.32 in the HE method and 2.77 in the CW evaluation method; however, there was a significant difference between the number and severity of recognized usability problems by these methods (P < 0.001). Some problems, which were associated with effectiveness, satisfaction and error, were better recognized by the HE method; however, CW evaluation method was more successful in recognizing problems of learnability, efficiency and memorability. Conclusion The HE method recognized more problems with a lower average severity. On the other hand, CW could recognize fewer problems with a higher average severity. Regarding the evaluation goal, HE method would be used to improve effectiveness, increase satisfaction and decrease the number of errors. Furthermore, CW evaluation method is recommended to be used to improve the learnability, efficiency and memorability of the system.

Sign in / Sign up

Export Citation Format

Share Document