scholarly journals String-based audiovisual fusion of behavioural events for the assessment of dimensional affect

2011 ◽  
Author(s):  
Florian Eyben ◽  
Martin Wollmer ◽  
Michel F. Valstar ◽  
Hatice Gunes ◽  
Bjorn Schuller ◽  
...  
Keyword(s):  
Audiovisual Fusion

Audiovisual fusion and cochlear implant proficiency

2010 ◽  
Vol 28 (2) ◽  
pp. 283-291 ◽  
Author(s):  
Corinne Tremblay ◽  
François Champoux ◽  
Franco Lepore ◽  
Hugo Théoret
Keyword(s):  
Cochlear Implant ◽  
Audiovisual Fusion

Comparing models for audiovisual fusion in a noisy-vowel recognition task

1999 ◽  
Vol 7 (6) ◽  
pp. 629-642 ◽  
Author(s):  
P. Teissier ◽  
J. Robert-Ribes ◽  
J.-L. Schwartz ◽  
A. Guerin-Dugue
Keyword(s):  
Recognition Task ◽  
Vowel Recognition ◽  
Audiovisual Fusion

Audiovisual Fusion: Challenges and New Approaches

2015 ◽  
Vol 103 (9) ◽  
pp. 1635-1653 ◽  
Author(s):  
Aggelos K. Katsaggelos ◽  
Sara Bahaadini ◽  
Rafael Molina
Keyword(s):  
New Approaches ◽  
Audiovisual Fusion

Audiovisual Speech Perception

Perception ◽  
1997 ◽  
Vol 26 (1_suppl) ◽  
pp. 347-347
Author(s):  
M Sams
Keyword(s):  
Speech Perception ◽  
Visual Information ◽  
Word Meaning ◽  
Source Area ◽  
Mcgurk Effect ◽  
Audiovisual Speech ◽  
Audiovisual Speech Perception ◽  
Processing Level ◽  
Early Processing ◽  
Audiovisual Fusion

Persons with hearing loss use visual information from articulation to improve their speech perception. Even persons with normal hearing utilise visual information, especially when the stimulus-to-noise ratio is poor. A dramatic demonstration of the role of vision in speech perception is the audiovisual fusion called the ‘McGurk effect’. When the auditory syllable /pa/ is presented in synchrony with the face articulating the syllable /ka/, the subject usually perceives /ta/ or /ka/. The illusory perception is clearly auditory in nature. We recently studied the audiovisual fusion (acoustical /p/, visual /k/) for Finnish (1) syllables, and (2) words. Only 3% of the subjects perceived the syllables according to the acoustical input, ie in 97% of the subjects the perception was influenced by the visual information. For words the percentage of acoustical identifications was 10%. The results demonstrate a very strong influence of visual information of articulation in face-to-face speech perception. Word meaning and sentence context have a negligible influence on the fusion. We have also recorded neuromagnetic responses of the human cortex when the subjects both heard and saw speech. Some subjects showed a distinct response to a ‘McGurk’ stimulus. The response was rather late, emerging about 200 ms from the onset of the auditory stimulus. We suggest that the perisylvian cortex, close to the source area for the auditory 100 ms response (M100), may be activated by the discordant stimuli. The behavioural and neuromagnetic results suggest a precognitive audiovisual speech integration occurring at a relatively early processing level.

scholarly journals Speaker Association With Signal-Level Audiovisual Fusion

2004 ◽  
Vol 6 (3) ◽  
pp. 406-413 ◽  
Author(s):  
J.W. Fisher ◽  
T. Darrell
Keyword(s):  
Audiovisual Fusion
Sign in / Sign up

Export Citation Format

Share Document