scholarly journals Neural Basis of the Sound-Symbolic Crossmodal Correspondence Between Auditory Pseudowords and Visual Shapes

2018 ◽  
Author(s):  
Kelly McCormick ◽  
Simon Lacey ◽  
Randall Stilla ◽  
Lynne C. Nygaard ◽  
K. Sathian

ABSTRACTSound symbolism refers to the association between the sounds of words and their meanings, often studied using the crossmodal correspondence between auditory pseudowords, e.g. ‘takete’ or ‘maluma’, and pointed or rounded visual shapes, respectively. In a functional magnetic resonance imaging study, participants were presented with pseudoword-shape pairs that were sound-symbolically congruent or incongruent. We found no significant congruency effects in the blood oxygenation level-dependent (BOLD) signal when participants were attending to visual shapes. Rather, during attention to auditory pseudowords, we observed greater BOLD activity for incongruent compared to congruent audiovisual pairs bilaterally in the intraparietal sulcus and supramarginal gyrus, and in the left middle frontal gyrus. We compared this activity to independent functional contrasts designed to test potential underlying mechanisms, but found no evidence for semantic mediation, and only limited evidence for multisensory integration and magnitude estimation. Instead, we suggest that the observed incongruency effects are likely to reflect phonological processing and/or multisensory attention. These findings advance our understanding of sound-to-meaning mapping in the brain.

2021 ◽  
pp. 1-50
Author(s):  
Kelly McCormick ◽  
Simon Lacey ◽  
Randall Stilla ◽  
Lynne C. Nygaard ◽  
K. Sathian

Abstract Sound symbolism refers to the association between the sounds of words and their meanings, often studied using the crossmodal correspondence between auditory pseudowords, e.g., ‘takete’ or ‘maluma’, and pointed or rounded visual shapes, respectively. In a functional magnetic resonance imaging study, participants were presented with pseudoword–shape pairs that were sound-symbolically congruent or incongruent. We found no significant congruency effects in the blood oxygenation level-dependent (BOLD) signal when participants were attending to visual shapes. During attention to auditory pseudowords, however, we observed greater BOLD activity for incongruent compared to congruent audiovisual pairs bilaterally in the intraparietal sulcus and supramarginal gyrus, and in the left middle frontal gyrus. We compared this activity to independent functional contrasts designed to test competing explanations of sound symbolism, but found no evidence for mediation via language, and only limited evidence for accounts based on multisensory integration and a general magnitude system. Instead, we suggest that the observed incongruency effects are likely to reflect phonological processing and/or multisensory attention. These findings advance our understanding of sound-to-meaning mapping in the brain.


2009 ◽  
Vol 30 (2) ◽  
pp. 449-458 ◽  
Author(s):  
Barış Yeşilyurt ◽  
Kevin Whittingstall ◽  
Kâmil Uğurbil ◽  
Nikos K Logothetis ◽  
Kâmil Uludağ

There is currently a great interest to combine electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) to study brain function. Earlier studies have shown different EEG components to correlate well with the fMRI signal arguing for a complex relationship between both measurements. In this study, using separate EEG and fMRI measurements, we show that (1) 0.1 ms visual stimulation evokes detectable hemodynamic and visual-evoked potential (VEP) responses, (2) the negative VEP deflection at ∼80 ms (N2) co-varies with stimulus duration/intensity such as with blood oxygenation level-dependent (BOLD) response; the positive deflection at ∼120 ms (P2) does not, and (3) although the N2 VEP–BOLD relationship is approximately linear, deviation is evident at the limit of zero N2 VEP. The latter finding argues that, although EEG and fMRI measurements can co-vary, they reflect partially independent processes in the brain tissue. Finally, it is shown that the stimulus-induced impulse response function (IRF) at 0.1 ms and the intrinsic IRF during rest have different temporal dynamics, possibly due to predominance of neuromodulation during rest as compared with neurotransmission during stimulation. These results extend earlier findings regarding VEP–BOLD coupling and highlight the component- and context-dependency of the relationship between evoked potentials and hemodynamic responses.


2021 ◽  
Author(s):  
Xingyu Liu ◽  
Yuxuan Dai ◽  
Hailun Xie ◽  
Zonglei Zhen

Naturalistic stimuli, such as movies, are being increasingly used to map brain function because of their high ecological validity. The pioneering studyforrest and other naturalistic neuroimaging projects have provided free access to multiple movie-watching functional magnetic resonance imaging (fMRI) datasets to prompt the community for naturalistic experimental paradigms. However, sluggish blood-oxygenation-level-dependent fMRI signals are incapable of resolving neuronal activity with the temporal resolution at which it unfolds. Instead, magnetoencephalography (MEG) measures changes in the magnetic field produced by neuronal activity and is able to capture rich dynamics of the brain at the millisecond level while watching naturalistic movies. Herein, we present the first public prolonged MEG dataset collected from 11 participants while watching the 2 h long audio-visual movie "Forrest Gump". Minimally preprocessed data was also provided to facilitate the use. As a studyforrest extension, we envision that this dataset, together with fMRI data from the studyforrest project, will serve as a foundation for exploring the neural dynamics of various cognitive functions in real-world contexts.


eLife ◽  
2014 ◽  
Vol 3 ◽  
Author(s):  
Robert L Barry ◽  
Seth A Smith ◽  
Adrienne N Dula ◽  
John C Gore

Functional magnetic resonance imaging using blood oxygenation level dependent (BOLD) contrast is well established as one of the most powerful methods for mapping human brain function. Numerous studies have measured how low-frequency BOLD signal fluctuations from the brain are correlated between voxels in a resting state, and have exploited these signals to infer functional connectivity within specific neural circuits. However, to date there have been no previous substantiated reports of resting state correlations in the spinal cord. In a cohort of healthy volunteers, we observed robust functional connectivity between left and right ventral (motor) horns, and between left and right dorsal (sensory) horns. Our results demonstrate that low-frequency BOLD fluctuations are inherent in the spinal cord as well as the brain, and by analogy to cortical circuits, we hypothesize that these correlations may offer insight into the execution and maintenance of sensory and motor functions both locally and within the cerebrum.


2010 ◽  
Vol 104 (4) ◽  
pp. 1838-1840 ◽  
Author(s):  
Helen. S. Palmer

Blood oxygenation level dependent (BOLD) functional magnetic resonance imaging (fMRI) is widely used as a measure of neuronal activity, despite an incomplete understanding of the hemodynamic and neural bases for BOLD signals. Recent work by Lee and colleagues investigated whether activating genetically specified neurons elicits BOLD responses. Integrating optogenetic control of specific cells and fMRI showed that stimulating excitatory neurons triggers a positive BOLD signal with conventional kinetics locally and delayed weaker BOLD signals distally.


Sign in / Sign up

Export Citation Format

Share Document