Knowledge-based scene analysis with saccadic eye movements

Author(s):  
Kerstin Schill ◽  
Elisabeth Umkehrer ◽  
Stephan Beinlich ◽  
Gerhard Krieger ◽  
Christoph Zetzsche
2017 ◽  
Vol 372 (1714) ◽  
pp. 20160106 ◽  
Author(s):  
Anne P. Hillstrom ◽  
Joice D. Segabinazi ◽  
Hayward J. Godwin ◽  
Simon P. Liversedge ◽  
Valerie Benson

We explored the influence of early scene analysis and visible object characteristics on eye movements when searching for objects in photographs of scenes. On each trial, participants were shown sequentially either a scene preview or a uniform grey screen (250 ms), a visual mask, the name of the target and the scene, now including the target at a likely location. During the participant's first saccade during search, the target location was changed to: (i) a different likely location, (ii) an unlikely but possible location or (iii) a very implausible location. The results showed that the first saccade landed more often on the likely location in which the target re-appeared than on unlikely or implausible locations, and overall the first saccade landed nearer the first target location with a preview than without. Hence, rapid scene analysis influenced initial eye movement planning, but availability of the target rapidly modified that plan. After the target moved, it was found more quickly when it appeared in a likely location than when it appeared in an unlikely or implausible location. The findings show that both scene gist and object properties are extracted rapidly, and are used in conjunction to guide saccadic eye movements during visual search. This article is part of the themed issue ‘Auditory and visual scene analysis’.


2015 ◽  
Vol 27 (6) ◽  
pp. 1137-1145 ◽  
Author(s):  
John M. Henderson ◽  
Wonil Choi

During active scene perception, our eyes move from one location to another via saccadic eye movements, with the eyes fixating objects and scene elements for varying amounts of time. Much of the variability in fixation duration is accounted for by attentional, perceptual, and cognitive processes associated with scene analysis and comprehension. For this reason, current theories of active scene viewing attempt to account for the influence of attention and cognition on fixation duration. Yet almost nothing is known about the neurocognitive systems associated with variation in fixation duration during scene viewing. We addressed this topic using fixation-related fMRI, which involves coregistering high-resolution eye tracking and magnetic resonance scanning to conduct event-related fMRI analysis based on characteristics of eye movements. We observed that activation in visual and prefrontal executive control areas was positively correlated with fixation duration, whereas activation in ventral areas associated with scene encoding and medial superior frontal and paracentral regions associated with changing action plans was negatively correlated with fixation duration. The results suggest that fixation duration in scene viewing is controlled by cognitive processes associated with real-time scene analysis interacting with motor planning, consistent with current computational models of active vision for scene perception.


2000 ◽  
Vol 13 (2-3) ◽  
pp. 201-214 ◽  
Author(s):  
Christoph Zetzsche ◽  
Kerstin Schill ◽  
Gerhard Krieger ◽  
Gert Hauske ◽  
Ingo Rentschler

2013 ◽  
Author(s):  
Sara Spotorno ◽  
Guillaume S. Masson ◽  
Anna Montagnini

2000 ◽  
Vol 132 (1) ◽  
pp. 39-51 ◽  
Author(s):  
Christian Quaia ◽  
Martin Paré ◽  
Robert H. Wurtz ◽  
Lance M. Optican

Healthcare ◽  
2020 ◽  
Vol 9 (1) ◽  
pp. 10
Author(s):  
Chong-Bin Tsai ◽  
Wei-Yu Hung ◽  
Wei-Yen Hsu

Optokinetic nystagmus (OKN) is an involuntary eye movement induced by motion of a large proportion of the visual field. It consists of a “slow phase (SP)” with eye movements in the same direction as the movement of the pattern and a “fast phase (FP)” with saccadic eye movements in the opposite direction. Study of OKN can reveal valuable information in ophthalmology, neurology and psychology. However, the current commercially available high-resolution and research-grade eye tracker is usually expensive. Methods & Results: We developed a novel fast and effective system combined with a low-cost eye tracking device to accurately quantitatively measure OKN eye movement. Conclusions: The experimental results indicate that the proposed method achieves fast and promising results in comparisons with several traditional approaches.


Sign in / Sign up

Export Citation Format

Share Document