1997 ◽  
Vol 7 (1) ◽  
pp. 221-233 ◽  
Author(s):  
R. Talluri ◽  
K. Oehler ◽  
T. Barmon ◽  
J.D. Courtney ◽  
A. Das ◽  
...  

2011 ◽  
Vol 62 (3) ◽  
pp. 659-680 ◽  
Author(s):  
Naresh Sharma ◽  
Junda Zhu ◽  
Yuan F. Zheng ◽  
Eric J. Balster

AI ◽  
2020 ◽  
Vol 1 (4) ◽  
pp. 487-509
Author(s):  
Sudarshan Ramenahalli

The natural environment and our interaction with it are essentially multisensory, where we may deploy visual, tactile and/or auditory senses to perceive, learn and interact with our environment. Our objective in this study is to develop a scene analysis algorithm using multisensory information, specifically vision and audio. We develop a proto-object-based audiovisual saliency map (AVSM) for the analysis of dynamic natural scenes. A specialized audiovisual camera with 360∘ field of view, capable of locating sound direction, is used to collect spatiotemporally aligned audiovisual data. We demonstrate that the performance of a proto-object-based audiovisual saliency map in detecting and localizing salient objects/events is in agreement with human judgment. In addition, the proto-object-based AVSM that we compute as a linear combination of visual and auditory feature conspicuity maps captures a higher number of valid salient events compared to unisensory saliency maps. Such an algorithm can be useful in surveillance, robotic navigation, video compression and related applications.


1997 ◽  
Vol 10 (1-3) ◽  
pp. 159-171
Author(s):  
Chung-Tao Chu ◽  
Dimitris Anastassiou ◽  
Shih-Fu Chang

Sign in / Sign up

Export Citation Format

Share Document