scholarly journals Impact of Think-Aloud on Eye-Tracking: A Comparison of Concurrent and Retrospective Think-Aloud for Research on Decision-Making in the Game Environment

Sensors ◽  
2020 ◽  
Vol 20 (10) ◽  
pp. 2750 ◽  
Author(s):  
Michal Prokop ◽  
Ladislav Pilař ◽  
Ivana Tichá

Simulations and games bring the possibility to research complex processes of managerial decision-making. However, this modern field requires adequate methodological procedures. Many authors recommend the use of a combination of concurrent think-aloud (CTA) or retrospective think-aloud (RTA) with eye-tracking to investigate cognitive processes such as decision-making. Nevertheless, previous studies have little or no consideration of the possible differential impact of both think-aloud methods on data provided by eye-tracking. Therefore, the main aim of this study is to compare and assess if and how these methods differ in terms of their impact on eye-tracking. The experiment was conducted for this purpose. Participants were 14 managers who played a specific simulation game with CTA use and 17 managers who played the same game with RTA use. The results empirically prove that CTA significantly distorts data provided by eye-tracking, whereas data gathered when RTA is used, provide independent pieces of evidence about the participants’ behavior. These findings suggest that RTA is more suitable for combined use with eye-tracking for the purpose of the research of decision-making in the game environment.

Author(s):  
Hélder Fanha Martins

This chapter reflects on the concept of educational simulations and games applied to business and aims at describing how a Web-based competitive management game has helped to achieve that. The authors discuss their objectives and those of the game and outline their reasons for choosing it. They describe the context at ISCAL and the game’s main features, showing how it is played over a semester. The authors consider, as online simulation facilitators of what is predominantly a student-led learning process, that the game helps students to gain a real feel for collaboration, managerial decision-making, and teamwork.


Author(s):  
Andrea Révész

Abstract This paper argues that TBLT researchers should dedicate more effort to investigating the cognitive processes in which L2 learners engage during task work to facilitate theory-construction and to inform pedagogical practices. To help achieve this, a review follows of various subjective (questionnaires, interviews, think-aloud/stimulated recall protocols) and objective (dual-task methodology, keystroke-logging, eye-tracking) methods that are available to TBLT researchers to examine cognitive processes underlying task-based performance. The paper concludes that, to obtain a more valid understanding of task-generated cognitive processes, it is best to combine various methods to overcome the limitations of each. Finally, some methodological recommendations are provided for future cognitively-oriented TBLT research.


Author(s):  
Hélder Fanha Martins

With a new degree on Management, a new course called Management Simulation Project was created and started in the summer semester of 2006-2007 at the Lisbon School of Accountancy and Administration (ISCAL). The teaching team wanted to explore ways to bring the realities of business decision-making and action into the curriculum. This chapter reflects on the concept of educational simulations and games and aims at describing how a web-based competitive management game helped to achieve that. The authors discuss their objectives and those of the game and outline their reasons for choosing it. They describe the context at ISCAL and the game’s main features, showing how it is played over a semester. The authors consider, as online simulation facilitators of what is predominantly a student-led learning process, that the game helps students to gain a real ‘feel’ for collaboration, managerial decision-making and teamwork. An exploratory study was carried out. A questionnaire was designed to tap students’ perceptions of the effectiveness of the use of a simulation/game as a new teaching method in five areas: career preparation, traditional educational goals, use of time, involvement and satisfaction, and a set of specific skill competencies. The results of the authors’ empirical study show that students perceive the simulation course as superior to the lecture-centered method. On the overall dimensions, the simulation course was seen as a better vehicle in helping students make career preparations, achieve educational goals, and utilize time. The results are presented and discussed.


2016 ◽  
Vol 283 (1832) ◽  
pp. 20160475 ◽  
Author(s):  
Pablo Varona ◽  
Mikhail I. Rabinovich

Traditional studies on the interaction of cognitive functions in healthy and disordered brains have used the analyses of the connectivity of several specialized brain networks—the functional connectome. However, emerging evidence suggests that both brain networks and functional spontaneous brain-wide network communication are intrinsically dynamic. In the light of studies investigating the cooperation between different cognitive functions, we consider here the dynamics of hierarchical networks in cognitive space. We show, using an example of behavioural decision-making based on sequential episodic memory, how the description of metastable pattern dynamics underlying basic cognitive processes helps to understand and predict complex processes like sequential episodic memory recall and competition among decision strategies. The mathematical images of the discussed phenomena in the phase space of the corresponding cognitive model are hierarchical heteroclinic networks. One of the most important features of such networks is the robustness of their dynamics. Different kinds of instabilities of these dynamics can be related to ‘dynamical signatures’ of creativity and different psychiatric disorders. The suggested approach can also be useful for the understanding of the dynamical processes that are the basis of consciousness.


2018 ◽  
pp. 1-11
Author(s):  
Vishakha Sharma ◽  
Allan Fong ◽  
Robert A. Beckman ◽  
Shruti Rao ◽  
Simina M. Boca ◽  
...  

Purpose We conducted usability studies on commercially available molecular diagnostic (MDX) test reports to identify strengths and weaknesses in content and form that drive clinical decision making. Given routine genomic testing in cancer medicine, oncologists must interpret MDX reports as well as evidence concerning clinical utility of biomarkers accurately for treatment or trial selection. This work aims to evaluate effectiveness of MDX reports in facilitating cancer treatment planning. Methods Fourteen clinicians at an academic tertiary care medical facility, with a wide range of experience in oncology and in the use of molecular testing, participated in this study. Three commercially available, widely used, Clinical Laboratory Improvement Amendments (CLIA)–certified, College of American Pathologists (CAP)–accredited test reports (labeled Laboratories A, B, and C) were used. Eye tracking, surveys, and think-aloud protocols were used to collect usability data for these MDX reports focusing on ease of comprehension and actionability Results Clinicians found two primary areas in molecular diagnostic reports most useful for patient care: therapy options with benefit or lack of benefit to patients, including enrolling clinical trials; and pathogenic tumor molecular anomalies detected. Therapeutic implications and therapy classes such as US Food and Drug Administration–approved off-label, on-label, clinical trials were critical for decision making. However, all reports had usability and comprehension issues in these areas and could be improved. Conclusion Focused usability studies can help drive our understanding of the clinical workflow for use of molecular diagnostic tests in cancer care. This in turn can have major effects on quality of care, outcomes, costs, and patient satisfaction. This study demonstrates the use of specific usability techniques (eye tracking and think-aloud protocols) to help clinical laboratories improve MDX report design in a precision oncology treatment setting.


2018 ◽  
Vol 68 (4) ◽  
pp. 261-270
Author(s):  
Thi Minh Hang Vu ◽  
Viet Phu Tu ◽  
Klaus Duerrschmid

Summary Recent research has revealed a correlation between consumer gazing behaviour and decision-making in eye-tracking tests, which suggested a predictability decision-making from gazing behaviour. Since the eye-tracking test design has been reported to have an effect on gazing behaviour, the objective of this work is therefore to study systematically whether the test design influences the relationship between choice and gazing. Using a Tobii-T60 Eye Tracker, 100 persons participated in eye-tracking tests working on food images. Two design factors were tested: 1) Type of evaluation (maximum choice, minimum choice, ranking, and rating); 2) Question content (deliciousness, healthiness,prices, and familiarity). The results showed that the correlation between decision-making and gazing behaviour is influenced by both Type of evaluation and Question content. Only in the choice tests, a significant correlation between gazing behaviour and consumer decision-making was found. No correlation was found in the question content group Prices, but a very strong correlation existed in the three other question content groups. The results are discussed considering the relationship between visual attention and cognitive processes in decision-making.


CJEM ◽  
2017 ◽  
Vol 19 (S1) ◽  
pp. S121
Author(s):  
M. White ◽  
D. Howes ◽  
R. Egan ◽  
H. Braund ◽  
A. Szulewski

Introduction: Resuscitation is a dynamic, complex and time-sensitive field which encompasses management of both critically-ill patients as well as large multidisciplinary teams. Expertise in this area has not been adequately defined, and to date, no research has directly examined the decision-making and cognitive processes involved. The evolving paradigm of competency-based medical education (CBME) makes better defining expertise in this field of critical importance to aid in the development of both educational and assessment methods. The technique of cognitive task analysis (CTA) has been used in a variety of fields to explicate the cognitive underpinnings of experts. Experts, however, often have limited insight and incomplete recall of their decision-making processes. We hypothesized that the use of eye-tracking, which provides the combination of first-person video as well as an overlying gaze indicator, could be used to enhance CTA to better understand the defining characteristics of experts in resuscitation. Methods: Over an 18-month period a sample of 11 traumatic resuscitations were obtained, each led by one of four pre-selected expert physicians outfitted with the Tobii Pro Eye-Tracking Glasses. After each resuscitation, the participant was debriefed using a cued-recall, think-aloud protocol while watching his or her corresponding eye-tracking video. A subsequent qualitative analysis of the resulting video and debrief transcript was performed using an ethnographic approach to establish emerging themes and behaviours of the expert physicians. Results: The expert participants demonstrated specific, common patterns in their cognitive processes. In particular, participants exhibited similar anticipatory and visual behaviours, dynamic communication strategies and the ability to distinguish between task-relevant and task-redundant information. All participants reported that this technique uncovered otherwise subconscious aspects of their cognition. Conclusion: The novel combination of eye-tracking technology to supplement the CTA of expert resuscitationists enriched our understanding of expertise in this field and yielded specific findings that can be applied to better develop and assess resuscitation skills.


2018 ◽  
Vol 41 ◽  
Author(s):  
Kevin Arceneaux

AbstractIntuitions guide decision-making, and looking to the evolutionary history of humans illuminates why some behavioral responses are more intuitive than others. Yet a place remains for cognitive processes to second-guess intuitive responses – that is, to be reflective – and individual differences abound in automatic, intuitive processing as well.


Sign in / Sign up

Export Citation Format

Share Document