scholarly journals Tracking the mind’s eye: Primate gaze behavior during virtual visuomotor navigation reflects belief dynamics

2019 ◽  
Author(s):  
Kaushik J Lakshminarasimhan ◽  
Eric Avila ◽  
Erin Neyhart ◽  
Gregory C DeAngelis ◽  
Xaq Pitkow ◽  
...  
Keyword(s):  
Eye Movements ◽  
Task Performance ◽  
Latent Variables ◽  
Gaze Behavior ◽  
Take The Best ◽  
Natural Behaviour ◽  
Visible Target ◽  
Goal Tracking ◽  
Belief Dynamics ◽  
Mind's Eye

SUMMARYTo take the best actions, we often need to maintain and update beliefs about variables that cannot be directly observed. To understand the principles underlying such belief updates, we need tools to uncover subjects’ belief dynamics from natural behaviour. We tested whether eye movements could be used to infer subjects’ beliefs about latent variables using a naturalistic, visuomotor navigation task. We observed eye movements that appeared to continuously track the goal location even when no visible target was present there. Accurate goal-tracking was associated with improved task performance, and inhibiting eye movements in humans impaired navigation precision. By using passive stimulus playback and manipulating stimulus reliability, we show that subjects’ eye movements are likely voluntary, rather than reflexive. These results suggest that gaze dynamics play a key role in action-selection during challenging visuomotor behaviours, and may possibly serve as a window into the subject’s dynamically evolving internal beliefs.

scholarly journals Tracking the Mind’s Eye: Primate Gaze Behavior during Virtual Visuomotor Navigation Reflects Belief Dynamics

Neuron ◽  
2020 ◽  
Vol 106 (4) ◽  
pp. 662-674.e5 ◽  
Author(s):  
Kaushik J. Lakshminarasimhan ◽  
Eric Avila ◽  
Erin Neyhart ◽  
Gregory C. DeAngelis ◽  
Xaq Pitkow ◽  
...  
Keyword(s):  
Gaze Behavior ◽  
Belief Dynamics ◽  
Mind's Eye

scholarly journals Saliency-Based Gaze Visualization for Eye Movement Analysis

Sensors ◽  
2021 ◽  
Vol 21 (15) ◽  
pp. 5178
Author(s):  
Sangbong Yoo ◽  
Seongmin Jeong ◽  
Seokyeon Kim ◽  
Yun Jang
Keyword(s):  
Eye Movements ◽  
Visual Attention ◽  
Eye Movement ◽  
Visual Stimuli ◽  
Saliency Map ◽  
Gaze Behavior ◽  
The Gaze ◽  
Movement Data ◽  
Visual Clues ◽  
Human Visual Attention

Gaze movement and visual stimuli have been utilized to analyze human visual attention intuitively. Gaze behavior studies mainly show statistical analyses of eye movements and human visual attention. During these analyses, eye movement data and the saliency map are presented to the analysts as separate views or merged views. However, the analysts become frustrated when they need to memorize all of the separate views or when the eye movements obscure the saliency map in the merged views. Therefore, it is not easy to analyze how visual stimuli affect gaze movements since existing techniques focus excessively on the eye movement data. In this paper, we propose a novel visualization technique for analyzing gaze behavior using saliency features as visual clues to express the visual attention of an observer. The visual clues that represent visual attention are analyzed to reveal which saliency features are prominent for the visual stimulus analysis. We visualize the gaze data with the saliency features to interpret the visual attention. We analyze the gaze behavior with the proposed visualization to evaluate that our approach to embedding saliency features within the visualization supports us to understand the visual attention of an observer.

scholarly journals Modelling Gaze Behaviour in Subtitle Processing

2021 ◽  
Vol 4 (1) ◽  
pp. 71-95
Author(s):  
Juha Lång ◽  
Hana Vrzakova ◽  
Lauri Mehtätalo
Keyword(s):  
Eye Movements ◽  
Cognitive Processing ◽  
Audiovisual Material ◽  
Gaze Behavior ◽  
Contributing Factors ◽  
Movement Data ◽  
Starting Point ◽  
Gaze Behaviour ◽  
Television Documentary ◽  
Participant Group

  One of the main rules of subtitling states that subtitles should be formatted and timed so that viewers have enough time to read and understand the text but also to follow the picture. In this paper we examine the factors that influence the time viewers spend looking at subtitles. We concentrate on the lexical and structural properties of subtitles. The participant group (N = 14) watched a television documentary with Russian narration and Finnish subtitles (the participants’ native language), while their eye movements were tracked. Using a linear mixed-effects model, we identified significant effects of subtitle duration and character count on the time participants spent looking at the subtitles. The model also revealed significant inter-individual differences, despite the fact that the participant group was seemingly homogeneous. The findings underline the complexity of subtitled audiovisual material as a stimulus of cognitive processing. We provide a starting point for more comprehensive modelling of the factors involved in gaze behaviour when watching subtitled content. Lay summary Subtitles have become a popular method for watching foreign series and films even in countries that have traditionally used dubbing in this regard. Because subtitles are visible to the viewer a short, limited time, they should be composed so that they are easy to read, and that the viewer has time to also follow the image. Nevertheless, the factors that have impact the time it takes to read a subtitle is not very well known. We wanted to find out what makes people who are watching subtitled television shows spend more time gazing at the subtitles? To answer this question, we recorded the eye movements of 14 participants when they were watching a short, subtitled television documentary. We created a statistical model of the gaze behavior from the eye movement data and found that both the length of the subtitle and the time the subtitle is visible are separate contributing factors. We also discovered large differences between individual viewers. Our conclusion is that people process subtitled content in very different ways, but there are some common tendencies. Our model can be seen as solid starting point for comprehensive modelling of gaze behavior of people watching subtitled audiovisual material.

scholarly journals Using gaze behavior to parcellate the explicit and implicit contributions to visuomotor learning

2018 ◽  
Vol 120 (4) ◽  
pp. 1602-1615 ◽  
Author(s):  
Anouk J. de Brouwer ◽  
Mohammed Albaghdadi ◽  
J. Randall Flanagan ◽  
Jason P. Gallivan
Keyword(s):  
Individual Differences ◽  
Eye Movements ◽  
Target Location ◽  
Cognitive Strategies ◽  
Sensorimotor Learning ◽  
Gaze Behavior ◽  
Visuomotor Rotation ◽  
Fast Learning ◽  
Gaze Patterns ◽  
Reach Planning

Successful motor performance relies on our ability to adapt to changes in the environment by learning novel mappings between motor commands and sensory outcomes. Such adaptation is thought to involve two distinct mechanisms: an implicit, error-based component linked to slow learning and an explicit, strategic component linked to fast learning and savings (i.e., faster relearning). Because behavior, at any given moment, is the resultant combination of these two processes, it has remained a challenge to parcellate their relative contributions to performance. The explicit component to visuomotor rotation (VMR) learning has recently been measured by having participants verbally report their aiming strategy used to counteract the rotation. However, this procedure has been shown to magnify the explicit component. Here we tested whether task-specific eye movements, a natural component of reach planning, but poorly studied in motor learning tasks, can provide a direct readout of the state of the explicit component during VMR learning. We show, by placing targets on a visible ring and including a delay between target presentation and reach onset, that individual differences in gaze patterns during sensorimotor learning are linked to participants’ rates of learning and their expression of savings. Specifically, we find that participants who, during reach planning, naturally fixate an aimpoint rotated away from the target location, show faster initial adaptation and readaptation 24 h later. Our results demonstrate that gaze behavior cannot only uniquely identify individuals who implement cognitive strategies during learning but also how their implementation is linked to differences in learning. NEW & NOTEWORTHY Although it is increasingly well appreciated that sensorimotor learning is driven by two separate components, an error-based process and a strategic process, it has remained a challenge to identify their relative contributions to performance. Here we demonstrate that task-specific eye movements provide a direct read-out of explicit strategies during sensorimotor learning in the presence of visual landmarks. We further show that individual differences in gaze behavior are linked to learning rate and savings.

Baseball Players’ Eye Movements and Higher Coincident-Timing Task Performance

2020 ◽  
Vol 127 (3) ◽  
pp. 571-586
Author(s):  
Ikumi Tochikura ◽  
Daisuke Sato ◽  
Daiki Imoto ◽  
Atsuo Nuruki ◽  
Koya Yamashiro ◽  
...  
Keyword(s):  
Decision Making ◽  
Information Processing ◽  
Eye Movements ◽  
Task Performance ◽  
Visual Information ◽  
Absolute Error ◽  
Visual Information Processing ◽  
Baseball Players ◽  
Mobile Targets ◽  
Timing Task

Previous studies have reported that baseball players have higher than average visual information processing abilities and outstanding motor control. The speed and position of the baseball and the batter are constantly changing, leading skilled players to acquire highly accurate visual information processing and decision-making. This study sought to clarify how movement of the eyes is associated with baseball players’ higher coincident-timing task performance. We recruited 15 right-handed baseball players and 15 age-matched track and field athletes. On a computer-based coincident-timing task, we instructed participants to stop a computer image of a moving target by pressing a button at a designated point. We presented bidirectional moving targets with various velocities, presented in a random order. The targets’ moving angular velocity varied between 100, 83, 71, 63, 56, 50, and 46 deg/s. We conducted 168 repetitions (42 reps × 4 sets) of this coincident-timing task and measured participants’ eye movements during the task using Pupil Centre Corneal Reflection. Mixed-design analysis of variance results revealed participant group effects in favor of baseball players for timing absolute error and low absolute error, as predicted from prior visual processing and decision-making research with baseball players. However, in contrast to prior research, we found significantly shorter smooth-pursuit onset latency in elite baseball players, and there were no significant group differences for saccade onset and offset latencies. This may be explained by the difference in our research paradigm with mobile targets randomly presented at various velocities from the left and right. Our data showed baseball players’ higher than normal simultaneous timing execution for making decisions and movements based on visual information, even under laboratory conditions with randomly moving mobile targets.

scholarly journals Inferring task performance and confidence from displays of eye movements

2020 ◽  
Vol 34 (6) ◽  
pp. 1430-1443
Author(s):  
Selina N. Emhardt ◽  
Margot Wermeskerken ◽  
Katharina Scheiter ◽  
Tamara Gog
Keyword(s):  
Eye Movements ◽  
Task Performance

scholarly journals I Can See It in Your Eyes: Gaze as an Implicit Cue of Uncanniness and Task Performance in Repeated Interactions With Robots

2021 ◽  
Vol 8 ◽  
Author(s):  
Giulia Perugia ◽  
Maike Paetzel-Prüsmann ◽  
Madelene Alanenpää ◽  
Ginevra Castellano
Keyword(s):  
Task Performance ◽  
Measurement Techniques ◽  
Implicit Measure ◽  
Gaze Behavior ◽  
Gaze Patterns ◽  
Joint Task ◽  
People’S Perception ◽  
Perception Of Robots ◽  
Over Time ◽  
And Task

Over the past years, extensive research has been dedicated to developing robust platforms and data-driven dialog models to support long-term human-robot interactions. However, little is known about how people's perception of robots and engagement with them develop over time and how these can be accurately assessed through implicit and continuous measurement techniques. In this paper, we explore this by involving participants in three interaction sessions with multiple days of zero exposure in between. Each session consists of a joint task with a robot as well as two short social chats with it before and after the task. We measure participants' gaze patterns with a wearable eye-tracker and gauge their perception of the robot and engagement with it and the joint task using questionnaires. Results disclose that aversion of gaze in a social chat is an indicator of a robot's uncanniness and that the more people gaze at the robot in a joint task, the worse they perform. In contrast with most HRI literature, our results show that gaze toward an object of shared attention, rather than gaze toward a robotic partner, is the most meaningful predictor of engagement in a joint task. Furthermore, the analyses of gaze patterns in repeated interactions disclose that people's mutual gaze in a social chat develops congruently with their perceptions of the robot over time. These are key findings for the HRI community as they entail that gaze behavior can be used as an implicit measure of people's perception of robots in a social chat and of their engagement and task performance in a joint task.

scholarly journals Directing voluntary temporal attention increases fixational stability

2018 ◽  
Author(s):  
Rachel N. Denison ◽  
Shlomit Yuval-Greenberg ◽  
Marisa Carrasco
Keyword(s):  
Eye Movements ◽  
Visual Perception ◽  
Task Performance ◽  
Visual Information ◽  
Perceptual Sensitivity ◽  
Temporal Attention ◽  
Relevant Stimulus ◽  
Gaze Stabilization ◽  
Cortical Areas ◽  
Fixational Eye Movements

AbstractOur visual input is constantly changing, but not all moments are equally relevant. Temporal attention, the prioritization of visual information at specific points in time, increases perceptual sensitivity at behaviorally relevant times. The dynamic processes underlying this increase are unclear. During fixation, humans make small eye movements called microsaccades, and inhibiting microsaccades improves perception of brief stimuli. Here we asked whether temporal attention changes the pattern of microsaccades in anticipation of brief stimuli. Human observers (female and male) judged brief stimuli presented within a short sequence. They were given either an informative precue to attend to one of the stimuli, which was likely to be probed, or an uninformative (neutral) precue. We found strong microsaccadic inhibition before the stimulus sequence, likely due to its predictable onset. Critically, this anticipatory inhibition was stronger when the first target in the sequence (T1) was precued (task-relevant) than when the precue was uninformative. Moreover, the timing of the last microsaccade before T1 and the first microsaccade after T1 shifted, such that both occurred earlier when T1 was precued than when the precue was uninformative. Finally, the timing of the nearest pre- and post-T1 microsaccades affected task performance. Directing voluntary temporal attention therefore impacts microsaccades, helping to stabilize fixation at the most relevant moments, over and above the effect of predictability. Just as saccading to a relevant stimulus can be an overt correlate of the allocation of spatial attention, precisely timed gaze stabilization can be an overt correlate of the allocation of temporal attention.Significance statementWe pay attention at moments in time when a relevant event is likely to occur. Such temporal attention improves our visual perception, but how it does so is not well understood. Here we discovered a new behavioral correlate of voluntary, or goal-directed, temporal attention. We found that the pattern of small fixational eye movements called microsaccades changes around behaviorally relevant moments in a way that stabilizes the position of the eyes. Microsaccades during a brief visual stimulus can impair perception of that stimulus. Therefore, such fixation stabilization may contribute to the improvement of visual perception at attended times. This link suggests that in addition to cortical areas, subcortical areas mediating eye movements may be recruited with temporal attention.

Sign in / Sign up

Export Citation Format

Share Document