scholarly journals A new comprehensive Eye-Tracking Test Battery concurrently evaluating the Pupil Labs Glasses and the EyeLink 1000

2019 ◽  
Author(s):  
Benedikt V. Ehinger ◽  
Katharina Groß ◽  
Inga Ibs ◽  
Peter König

ABSTRACTEye-tracking experiments rely heavily on good data quality of eye-trackers. Unfortunately, it is often that only the spatial accuracy and precision values are available from the manufacturers. These two values alone are not sufficient enough to serve as a benchmark for an eye-tracker: Eye-tracking quality deteriorates during an experimental session due to head movements, changing illumination or calibration decay. Additionally, different experimental paradigms require the analysis of different types of eye movements, for instance smooth pursuit movements, blinks or microsaccades, which themselves cannot readily be evaluated by using spatial accuracy or precision alone. To obtain a more comprehensive description of properties, we developed an extensive eye-tracking test battery. In 10 different tasks, we evaluated eye-tracking related measures such as: the decay of accuracy, fixation durations, pupil dilation, smooth pursuit movement, microsaccade detection, blink detection, or the influence of head motion. For some measures, true theoretical values exist. For others, a relative comparison to a gold standard eye-tracker is needed. Therefore, we collected our gaze data simultaneously from a gold standard remote EyeLink 1000 eye-tracker and compared it with the mobile Pupil Labs glasses.As expected, the average spatial accuracy of 0.57° for the EyeLink 1000 eye-tracker was better than the 0.82° for the Pupil Labs glasses (N=15). Furthermore, we detected less fixations and shorter saccade durations for the Pupil Labs glasses. Similarly, we found fewer microsaccades using the Pupil Labs glasses. The accuracy over time decayed only slightly for the EyeLink 1000, but strongly for the Pupil Labs glasses. Finally we observed that the measured pupil diameters differed between eye-trackers on the individual subject level but not the group level.To conclude, our eye-tracking test battery offers 10 tasks that allow us to benchmark the many parameters of interest in stereotypical eye-tracking situations, or addresses a common source of confounds in measurement errors (e.g. yaw and roll head movements).All recorded eye-tracking data (including Pupil Labs’ eye video files), the stimulus code for the test battery and the modular analysis pipeline are available (https://github.com/behinger/etcomp).BVE, KG, IIandPKconceived the experiment.IIandBVEcreated the experiment and recorded the gaze data.BVEandKGperformed the analysis.BVE, KGandPKreviewed the manuscript critically.

PeerJ ◽  
2019 ◽  
Vol 7 ◽  
pp. e7086 ◽  
Author(s):  
Benedikt V. Ehinger ◽  
Katharina Groß ◽  
Inga Ibs ◽  
Peter König

Eye-tracking experiments rely heavily on good data quality of eye-trackers. Unfortunately, it is often the case that only the spatial accuracy and precision values are available from the manufacturers. These two values alone are not sufficient to serve as a benchmark for an eye-tracker: Eye-tracking quality deteriorates during an experimental session due to head movements, changing illumination or calibration decay. Additionally, different experimental paradigms require the analysis of different types of eye movements; for instance, smooth pursuit movements, blinks or microsaccades, which themselves cannot readily be evaluated by using spatial accuracy or precision alone. To obtain a more comprehensive description of properties, we developed an extensive eye-tracking test battery. In 10 different tasks, we evaluated eye-tracking related measures such as: the decay of accuracy, fixation durations, pupil dilation, smooth pursuit movement, microsaccade classification, blink classification, or the influence of head motion. For some measures, true theoretical values exist. For others, a relative comparison to a reference eye-tracker is needed. Therefore, we collected our gaze data simultaneously from a remote EyeLink 1000 eye-tracker as the reference and compared it with the mobile Pupil Labs glasses. As expected, the average spatial accuracy of 0.57° for the EyeLink 1000 eye-tracker was better than the 0.82° for the Pupil Labs glasses (N= 15). Furthermore, we classified less fixations and shorter saccade durations for the Pupil Labs glasses. Similarly, we found fewer microsaccades using the Pupil Labs glasses. The accuracy over time decayed only slightly for the EyeLink 1000, but strongly for the Pupil Labs glasses. Finally, we observed that the measured pupil diameters differed between eye-trackers on the individual subject level but not on the group level. To conclude, our eye-tracking test battery offers 10 tasks that allow us to benchmark the many parameters of interest in stereotypical eye-tracking situations and addresses a common source of confounds in measurement errors (e.g., yaw and roll head movements). All recorded eye-tracking data (including Pupil Labs’ eye videos), the stimulus code for the test battery, and the modular analysis pipeline are freely available (https://github.com/behinger/etcomp).


Concussion ◽  
2020 ◽  
Vol 5 (1) ◽  
pp. CNC69 ◽  
Author(s):  
Melissa Hunfalvay ◽  
Claire-Marie Roberts ◽  
Nicholas P Murray ◽  
Ankur Tyagi ◽  
Kyle W Barclay ◽  
...  

Aim: Neural deficits were measured via the eye tracking of vertical smooth pursuit (VSP) as markers of traumatic brain injury (TBI). The present study evaluated the ability of the eye tracking tests to differentiate between different levels of TBI severity and healthy controls. Methodology: Ninety-two individuals divided into four groups (those with mild, moderate or severe TBI and healthy controls) participated in a computerized test of VSP eye movement using a remote eye tracker. Results: The VSP eye tracking test was able to distinguish between severe and moderate levels of TBI but unable to detect differences in the performance of participants with mild TBI and healthy controls. Conclusion: The eye-tracking technology used to measure VSP eye movements is able to provide a timely and objective method of differentiating between individuals with moderate and severe levels of TBI.


Author(s):  
Jesús Morenas Martín ◽  
Vicente Luis del Campo ◽  
Luis Jesús Manso Fernández-Argüelles

The aim of the study was to build a low-cost mask-type eye tracker with accuracy and precision levels similar to those reported for commercial eye tracking devices. To this end, head-mounted hardware was designed and developed, while open-source software was modified for digital image capture, manipulation, and fixation analysis. An image recognition application was also included with different lighting scenarios. Moreover, parallax and viewing perspective errors were controlled to ensure the quality of data collection. The device was wireless and lightweight (99 g) to allow for natural movement and avoid participant discomfort. After calibration of a 9-target monocular grid, spatial accuracy and precision of the eye tracker was evaluated by 30 participants, at four different lighting setups, both before and after a climbing task. Validity tests showed high levels of accuracy in all conditions as evidenced by a systematic error for a 13-target grid of <0.5°. The reliability tests also showed consistent measurements with no differences in accuracy recorded between participants, lighting conditions, and visual behaviors for the pre- versus post-climbing task. These results suggest that the present eye tracker reports spatial accuracy similar to other commercial systems with levels of high quality. Altogether, this innovative user interface is suitable for research purposes and/or performance analysis in physical activity and sport-related activities. Also, features of this mask-type eye tracking system make it a suitable perceptual user interface to investigate human–computer interactions in a large number of other research fields including psychology, education, marketing, transportation, and medicine.


2020 ◽  
Vol 36 (3) ◽  
pp. 277-305 ◽  
Author(s):  
Aline Godfroid ◽  
Bronson Hui

Eye tracking has become an increasingly popular research methodology among language researchers to examine online cognitive processing of second-language (L2) speakers and bilinguals. As the scope of eye-tracking research expands, there is a need to ensure that the methodology is used properly, so as to safeguard the validity of research findings and the empirical basis upon which theories are built. We present five pitfalls in eye-tracking research that may threaten the internal or external validity of the study. We offer concrete recommendations to avoid each pitfall and demonstrate how these recommendations can be implemented so researchers may take full advantage of the opportunities of eye-tracking research. The five pitfalls occur at all stages of the research cycle. We emphasize (1) adopting a confirmatory (theory-driven, hypothesis-testing) approach to research, (2) selecting and handling eye-movement measures in a principled manner, (3) aligning the research design with the eye tracker properties (spatial accuracy, precision), (4) inspecting raw, sample-level eye-tracking data and their preprocessing by the eye-tracking software. We conclude by inviting eye-tracking researchers (5) to embrace open science practices to enhance the replication and reproducibility of their work.


2016 ◽  
Vol 116 (4) ◽  
pp. 1859-1870 ◽  
Author(s):  
Caroline Landelle ◽  
Anna Montagnini ◽  
Laurent Madelain ◽  
Frederic Danion

Previous work has shown that the ability to track with the eye a moving target is substantially improved when the target is self-moved by the subject's hand compared with when being externally moved. Here, we explored a situation in which the mapping between hand movement and target motion was perturbed by simulating an elastic relationship between the hand and target. Our objective was to determine whether the predictive mechanisms driving eye-hand coordination could be updated to accommodate this complex hand-target dynamics. To fully appreciate the behavioral effects of this perturbation, we compared eye tracking performance when self-moving a target with a rigid mapping (simple) and a spring mapping as well as when the subject tracked target trajectories that he/she had previously generated when using the rigid or spring mapping. Concerning the rigid mapping, our results confirmed that smooth pursuit was more accurate when the target was self-moved than externally moved. In contrast, with the spring mapping, eye tracking had initially similar low spatial accuracy (though shorter temporal lag) in the self versus externally moved conditions. However, within ∼5 min of practice, smooth pursuit improved in the self-moved spring condition, up to a level similar to the self-moved rigid condition. Subsequently, when the mapping unexpectedly switched from spring to rigid, the eye initially followed the expected target trajectory and not the real one, thereby suggesting that subjects used an internal representation of the new hand-target dynamics. Overall, these results emphasize the stunning adaptability of smooth pursuit when self-maneuvering objects with complex dynamics.


2021 ◽  
pp. 1-16
Author(s):  
Leigha A. MacNeill ◽  
Xiaoxue Fu ◽  
Kristin A. Buss ◽  
Koraly Pérez-Edgar

Abstract Temperamental behavioral inhibition (BI) is a robust endophenotype for anxiety characterized by increased sensitivity to novelty. Controlling parenting can reinforce children's wariness by rewarding signs of distress. Fine-grained, dynamic measures are needed to better understand both how children perceive their parent's behaviors and the mechanisms supporting evident relations between parenting and socioemotional functioning. The current study examined dyadic attractor patterns (average mean durations) with state space grids, using children's attention patterns (captured via mobile eye tracking) and parental behavior (positive reinforcement, teaching, directives, intrusion), as functions of child BI and parent anxiety. Forty 5- to 7-year-old children and their primary caregivers completed a set of challenging puzzles, during which the child wore a head-mounted eye tracker. Child BI was positively correlated with proportion of parent's time spent teaching. Child age was negatively related, and parent anxiety level was positively related, to parent-focused/controlling parenting attractor strength. There was a significant interaction between parent anxiety level and child age predicting parent-focused/controlling parenting attractor strength. This study is a first step to examining the co-occurrence of parenting behavior and child attention in the context of child BI and parental anxiety levels.


Sensors ◽  
2021 ◽  
Vol 21 (6) ◽  
pp. 2234
Author(s):  
Sebastian Kapp ◽  
Michael Barz ◽  
Sergey Mukhametov ◽  
Daniel Sonntag ◽  
Jochen Kuhn

Currently an increasing number of head mounted displays (HMD) for virtual and augmented reality (VR/AR) are equipped with integrated eye trackers. Use cases of these integrated eye trackers include rendering optimization and gaze-based user interaction. In addition, visual attention in VR and AR is interesting for applied research based on eye tracking in cognitive or educational sciences for example. While some research toolkits for VR already exist, only a few target AR scenarios. In this work, we present an open-source eye tracking toolkit for reliable gaze data acquisition in AR based on Unity 3D and the Microsoft HoloLens 2, as well as an R package for seamless data analysis. Furthermore, we evaluate the spatial accuracy and precision of the integrated eye tracker for fixation targets with different distances and angles to the user (n=21). On average, we found that gaze estimates are reported with an angular accuracy of 0.83 degrees and a precision of 0.27 degrees while the user is resting, which is on par with state-of-the-art mobile eye trackers.


Author(s):  
Ana Guerberof Arenas ◽  
Joss Moorkens ◽  
Sharon O’Brien

AbstractThis paper presents results of the effect of different translation modalities on users when working with the Microsoft Word user interface. An experimental study was set up with 84 Japanese, German, Spanish, and English native speakers working with Microsoft Word in three modalities: the published translated version, a machine translated (MT) version (with unedited MT strings incorporated into the MS Word interface) and the published English version. An eye-tracker measured the cognitive load and usability according to the ISO/TR 16982 guidelines: i.e., effectiveness, efficiency, and satisfaction followed by retrospective think-aloud protocol. The results show that the users’ effectiveness (number of tasks completed) does not significantly differ due to the translation modality. However, their efficiency (time for task completion) and self-reported satisfaction are significantly higher when working with the released product as opposed to the unedited MT version, especially when participants are less experienced. The eye-tracking results show that users experience a higher cognitive load when working with MT and with the human-translated versions as opposed to the English original. The results suggest that language and translation modality play a significant role in the usability of software products whether users complete the given tasks or not and even if they are unaware that MT was used to translate the interface.


Healthcare ◽  
2020 ◽  
Vol 9 (1) ◽  
pp. 10
Author(s):  
Chong-Bin Tsai ◽  
Wei-Yu Hung ◽  
Wei-Yen Hsu

Optokinetic nystagmus (OKN) is an involuntary eye movement induced by motion of a large proportion of the visual field. It consists of a “slow phase (SP)” with eye movements in the same direction as the movement of the pattern and a “fast phase (FP)” with saccadic eye movements in the opposite direction. Study of OKN can reveal valuable information in ophthalmology, neurology and psychology. However, the current commercially available high-resolution and research-grade eye tracker is usually expensive. Methods & Results: We developed a novel fast and effective system combined with a low-cost eye tracking device to accurately quantitatively measure OKN eye movement. Conclusions: The experimental results indicate that the proposed method achieves fast and promising results in comparisons with several traditional approaches.


Robotics ◽  
2021 ◽  
Vol 10 (2) ◽  
pp. 54
Author(s):  
Lorenzo Scalera ◽  
Stefano Seriani ◽  
Paolo Gallina ◽  
Mattia Lentini ◽  
Alessandro Gasparetto

In this paper, authors present a novel architecture for controlling an industrial robot via an eye tracking interface for artistic purposes. Humans and robots interact thanks to an acquisition system based on an eye tracker device that allows the user to control the motion of a robotic manipulator with his gaze. The feasibility of the robotic system is evaluated with experimental tests in which the robot is teleoperated to draw artistic images. The tool can be used by artists to investigate novel forms of art and by amputees or people with movement disorders or muscular paralysis, as an assistive technology for artistic drawing and painting, since, in these cases, eye motion is usually preserved.


Sign in / Sign up

Export Citation Format

Share Document