scholarly journals Remote Eye-Tracking for Cognitive Telerehabilitation and Interactive School Tasks in Times of COVID-19

Information ◽  
2020 ◽  
Vol 11 (6) ◽  
pp. 296
Author(s):  
Giancarlo Iannizzotto ◽  
Andrea Nucita ◽  
Rosa Angela Fabio ◽  
Tindara Caprì ◽  
Lucia Lo Bello
Keyword(s):  
Special Education ◽  
Eye Tracking ◽  
Eye Gaze ◽  
Video Stream ◽  
Gaze Tracking ◽  
Genetic Syndrome ◽  
Live Video ◽  
E Learning ◽  
Tracking Devices ◽  
School Tasks

In the attempt to mitigate the effects of COVID-19 lockdown, most countries have recently authorized and promoted the adoption of e-learning and remote teaching technologies, often with the support of teleconferencing platforms. Unfortunately, not all students can benefit from the adoption of such a surrogate of their usual school. We were asked to devise a way to allow a community of children affected by the Rett genetic syndrome, and thus unable to communicate verbally, in writing or by gestures, to actively participate in remote rehabilitation and special education sessions by exploiting eye-gaze tracking. As not all subjects can access commercial eye-tracking devices, we investigated new ways to facilitate the access to eye gaze-based interaction for this specific case. The adopted communication platform is a videoconferencing software, so all we had at our disposal was a live video stream of the child. As a solution to the problem, we developed a software (named SWYG) that only runs at the “operator” side of the communication, at the side of the videoconferencing software, and does not require to install other software in the child’s computer. The preliminary results obtained are very promising and the software is ready to be deployed on a larger base. While this paper is being written, several children are finally able to communicate with their caregivers from home, without relying on expensive and cumbersome devices.

scholarly journals The application of image processing for Human-Computer Interface (HCI) using the Eye

2021 ◽  
Vol 2120 (1) ◽  
pp. 012030
Author(s):  
J K Tan ◽  
W J Chew ◽  
S K Phang
Keyword(s):  
Eye Tracking ◽  
Tracking System ◽  
Eye Gaze ◽  
Gaze Tracking ◽  
Tracking Method ◽  
Infrared Rays ◽  
Mouse Pointer ◽  
Hand Disability ◽  
Enzyme Denaturation ◽  
Human Eyes

Abstract The field of Human-Computer Interaction (HCI) has been developing tremendously since the past decade. The existence of smartphones or modern computers is already a norm in society these days which utilizes touch, voice and typing as a means for input. To further increase the variety of interaction, human eyes are set to be a good candidate for another form of HCI. The amount of information which the human eyes contain are extremely useful, hence, various methods and algorithm for eye gaze tracking are implemented in multiple sectors. However, some eye-tracking method requires infrared rays to be projected into the eye of the user which could potentially cause enzyme denaturation when the eye is subjected to those rays under extreme exposure. Therefore, to avoid potential harm from the eye-tracking method that utilizes infrared rays, this paper proposes an image-based eye tracking system using the Viola-Jones algorithm and Circular Hough Transform (CHT) algorithm. The proposed method uses visible light instead of infrared rays to control the mouse pointer using the eye gaze of the user. This research aims to implement the proposed algorithm for people with hand disability to interact with computers using their eye gaze.

scholarly journals The stability of the MEMS 2D mirror's operating point in terms of eye tracking systems

2020 ◽  
Vol 12 (2) ◽  
pp. 43
Author(s):  
Mateusz Pomianek ◽  
Marek Piszczek ◽  
Marcin Maciejewski ◽  
Piotr Krukowski
Keyword(s):  
Eye Tracking ◽  
Laser Scanning ◽  
Tracking System ◽  
Eye Gaze ◽  
Main Element ◽  
Head Tracking ◽  
Tracking Systems ◽  
Gaze Tracking ◽  
Pupil Detection ◽  
The Stability

This paper describes research on the stability of the MEMS mirror for use in eye tracking systems. MEMS mirrors are the main element in scanning methods (which is one of the methods of eye tracking). Due to changes in the mirror pitch, the system can scan the area of the eye with a laser and collect the signal reflected. However, this method works on the assumption that the inclinations are constant in each period. The instability of this causes errors. The aim of this work is to examine the error level caused by pitch instability at different points of work. Full Text: PDF ReferencesW. Fuhl, M. Tonsen, A. Bulling, and E. Kasneci, "Pupil detection for head-mounted eye tracking in the wild: an evaluation of the state of the art," Mach. Vis. Appl., vol. 27, no. 8, pp. 1275-1288, 2016, CrossRef X. Wang, S. Koch, K. Holmqvist, and M. Alexa, "Tracking the gaze on objects in 3D," ACM Trans. Graph., vol. 37, no. 6, pp. 1-18, Dec. 2018 CrossRef X. Xiong and H. Xie, "MEMS dual-mode electrostatically actuated micromirror," Proc. 2014 Zo. 1 Conf. Am. Soc. Eng. Educ. - "Engineering Educ. Ind. Involv. Interdiscip. Trends", ASEE Zo. 1 2014, no. Dmd, 2014 CrossRef E. Pengwang, K. Rabenorosoa, M. Rakotondrabe, and N. Andreff, "Scanning micromirror platform based on MEMS technology for medical application," Micromachines, vol. 7, no. 2, 2016 CrossRef J. P. Giannini, A. G. York, and H. Shroff, "Anticipating, measuring, and minimizing MEMS mirror scan error to improve laser scanning microscopy's speed and accuracy," PLoS One, vol. 12, no. 10, pp. 1-14, 2017 CrossRef C. Hennessey, B. Noureddin, and P. Lawrence, "A single camera eye-gaze tracking system with free head motion," Eye Track. Res. Appl. Symp., vol. 2005, no. March, pp. 87-94, 2005 CrossRef C. H. Morimoto and M. R. M. Mimica, "Eye gaze tracking techniques for interactive applications," Comput. Vis. Image Underst., vol. 98, no. 1, pp. 4-24, Apr. 2005 CrossRef S. T. S. Holmström, U. Baran, and H. Urey, "MEMS laser scanners: A review," J. Microelectromechanical Syst., vol. 23, no. 2, pp. 259-275, 2014 CrossRef C. W. Cho, "Gaze Detection by Wearable Eye-Tracking and NIR LED-Based Head-Tracking Device Based on SVR," ETRI J., vol. 34, no. 4, pp. 542-552, Aug. 2012 CrossRef T. Santini, W. Fuhl, and E. Kasneci, "PuRe: Robust pupil detection for real-time pervasive eye tracking," Comput. Vis. Image Underst., vol. 170, pp. 40-50, May 2018 CrossRef O. Solgaard, A. A. Godil, R. T. Howe, L. P. Lee, Y. A. Peter, and H. Zappe, "Optical MEMS: From micromirrors to complex systems," J. Microelectromechanical Syst., vol. 23, no. 3, pp. 517-538, 2014 CrossRef J. Wang, G. Zhang, and Z. You, "UKF-based MEMS micromirror angle estimation for LiDAR," J. Micromechanics Microengineering, vol. 29, no. 3, 201 CrossRef

Introduction to Gaze Interaction

2012 ◽  
pp. 1-9 ◽  
Author(s):  
Päivi Majaranta ◽  
Mick Donegan
Keyword(s):  
Eye Tracking ◽  
Assistive Technology ◽  
Control Method ◽  
Eye Gaze ◽  
Gaze Tracking ◽  
Input Channel ◽  
Gaze Interaction ◽  
Additional Input ◽  
Gaze Behaviour

Gaze interaction, as understood in this book, provides a means to exploit information from eye gaze behaviour during human-technology interaction. Gaze can either be used as an explicit control method that enables the user to point at and select items, or information from the user’s natural gaze behaviour can be exploited subtly in the background as an additional input channel without interfering with normal viewing. This chapter provides a brief introduction to the potential for applied gaze tracking, with special emphasis on its application in assistive technology. It introduces common terms and offers a concise summary of previous research and applications of eye tracking.

scholarly journals User Experiences of Eye Gaze Classroom Technology for Children With Complex Communication Needs

2021 ◽  
pp. 016264342110193
Author(s):  
Michelle Lui ◽  
Amrita Maharaj ◽  
Roula Shimaly ◽  
Asiya Atcha ◽  
Hamza Ali ◽  
...  
Keyword(s):  
Eye Tracking ◽  
Augmentative And Alternative Communication ◽  
Eye Gaze ◽  
Classroom Technology ◽  
Integrated Systems ◽  
Alternative Communication ◽  
Before And After ◽  
Communication Needs ◽  
Tracking Devices ◽  
Positive Engagement

This study examines interactions between students with atypical motor and speech abilities, their teachers, and eye tracking devices under varying conditions typical of educational settings (e.g., interactional style, teacher familiarity). Twelve children (aged 4–12 years) participated in teacher-guided sessions with eye tracking software that are designed to develop augmentative and alternative communication (AAC) skills. Assessments of expressive communication skills before and after the testing period demonstrated significant improvements. 164 sessions conducted over a 3-month period were analyzed for positive engagement (e.g., gaze direction, session time) and system effectiveness (e.g., lag time, gaze registration) between integrated and non-integrated systems. Findings showed that integrated systems were associated with significantly longer sessions, more time spent looking at the screen, greater proportion of gaze targets registered by the system, and higher response rate to prompts from teachers. We discuss the implications for the facilitated use of eye tracking devices in special education classrooms.

Iris Movement and Eye Gaze Tracking

2021 ◽  
Vol 12 (4) ◽  
pp. 1224-1233
Author(s):  
Villuri Gnaneswar
Keyword(s):  
Computer Vision ◽  
Human Computer Interaction ◽  
Eye Tracking ◽  
Eye Gaze ◽  
Industrial Area ◽  
Research Field ◽  
Efficient Technique ◽  
Gaze Tracking ◽  
The Past ◽  
Active Research

Iris Movement and gaze tracking has been an active research field in the past years as it adds convenience to a variety of applications. It is considered a significant untraditional method of human-computer interaction. The goal of this paper is to present a study on the existing literature on Iris Movement and Gaze Tracking and Develop an Efficient Technique that can revolutionize the field of Computer Vision. With the uptrend of systems based on eye Tracking in many different areas of life in recent years, this subject has gained much more attention by in the academic and industrial area.

scholarly journals Interlocutors and Interactions: Examining the Interactions Between Students With Complex Communication Needs, Teachers, and Eye-Gaze Technology

2020 ◽  
Vol 1 ◽  
pp. 113-131
Author(s):  
Rhonda McEwen ◽  
Asiya Atcha ◽  
Michelle Lui ◽  
Roula Shimaly ◽  
Amrita Maharaj ◽  
...  
Keyword(s):  
Eye Tracking ◽  
Tracking System ◽  
Eye Gaze ◽  
Recognition Task ◽  
Functional Communication ◽  
Complex Communication Needs ◽  
Vocabulary Building ◽  
Communicative Success ◽  
Communication Needs ◽  
Tracking Devices

This study analyzes the role of the machine as a communicative partner for children with complex communication needs as they use eye-tracking technology to communicate. We ask: to what extent do eye-tracking devices serve as functional communications systems for children with complex communication needs? We followed 12 children with profound physical disabilities in a special education classroom over 3 months. An eye-tracking system was used to collect data from software that assisted the children in facial recognition, task identification, and vocabulary building. Results show that eye gaze served as a functional communication system for the majority of the children. We found voice affect to be a strong determinant of communicative success between students and both of their communicative partners: the teachers (humans) and the technologies (machines).

A Review on Eye Tracking Technology

2020 ◽  
pp. 107-130
Author(s):  
Pavneet Bhatia ◽  
Arun Khosla ◽  
Gajendra Singh
Keyword(s):  
Computer Vision ◽  
Eye Tracking ◽  
Assistive Technology ◽  
Tracking System ◽  
Eye Gaze ◽  
Emerging Technology ◽  
Gaze Tracking ◽  
Safety Research ◽  
Computer Vision Technology ◽  
Tracking Technology

In past few decades, eye tracking has evolved as an emerging technology with wide areas of applications in gaming, human-computer interaction, business research, assistive technology, automatic safety research, and many more. Eye-gaze tracking is a provocative idea in computer-vision technology. This chapter includes the recent researches, expansion, and development in the technology, techniques, and its wide-ranging applications. It gives a detailed background of technology with all the efforts done in the direction to improve the tracking system.

Sign in / Sign up

Export Citation Format

Share Document