Decoding conjunctions of direction-of-motion and binocular disparity from human visual cortex

2012 ◽  
Vol 107 (9) ◽  
pp. 2335-2341 ◽  
Author(s):  
Kiley J. Seymour ◽  
Colin W. G. Clifford
Keyword(s):  
Visual Processing ◽  
Binocular Disparity ◽  
Dorsal Stream ◽  
Visual Stream ◽  
Activation Patterns ◽  
Independent Information ◽  
Uncrossed Disparity ◽  
Multivariate Pattern ◽  
Joint Encoding ◽  
Dorsal Visual Stream

Motion and binocular disparity are two features in our environment that share a common correspondence problem. Decades of psychophysical research dedicated to understanding stereopsis suggest that these features interact early in human visual processing to disambiguate depth. Single-unit recordings in the monkey also provide evidence for the joint encoding of motion and disparity across much of the dorsal visual stream. Here, we used functional MRI and multivariate pattern analysis to examine where in the human brain conjunctions of motion and disparity are encoded. Subjects sequentially viewed two stimuli that could be distinguished only by their conjunctions of motion and disparity. Specifically, each stimulus contained the same feature information (leftward and rightward motion and crossed and uncrossed disparity) but differed exclusively in the way these features were paired. Our results revealed that a linear classifier could accurately decode which stimulus a subject was viewing based on voxel activation patterns throughout the dorsal visual areas and as early as V2. This decoding success was conditional on some voxels being individually sensitive to the unique conjunctions comprising each stimulus, thus a classifier could not rely on independent information about motion and binocular disparity to distinguish these conjunctions. This study expands on evidence that disparity and motion interact at many levels of human visual processing, particularly within the dorsal stream. It also lends support to the idea that stereopsis is subserved by early mechanisms also tuned to direction of motion.

scholarly journals Neural Modulation by Binocular Disparity Greatest in Human Dorsal Visual Stream

2010 ◽  
Vol 104 (1) ◽  
pp. 169-178 ◽  
Author(s):  
Loredana Minini ◽  
Andrew J. Parker ◽  
Holly Bridge
Keyword(s):  
Binocular Disparity ◽  
Large Range ◽  
Dorsal Stream ◽  
Cortical Activation ◽  
Bold Signal ◽  
Visual Stream ◽  
Neural Modulation ◽  
Visual Areas ◽  
Parietal Cortices ◽  
Dorsal Visual Stream

Although cortical activation to binocular disparity can be demonstrated throughout occipital and parietal cortices, the relative contributions to depth perception made by different human cortical areas have not been established. To investigate whether different regions are optimized for specific disparity ranges, we have measured the responses of occipital and parietal areas to different magnitudes of binocular disparity. Using stimuli consisting of sinusoidal depth modulations, we measured cortical activation when the stimuli were located at pedestal disparities of 0, 0.1, 0.35, and 0.7° from fixation. Across all areas, occipital and parietal, there was an increase in BOLD signal with increasing pedestal disparity, compared with a plane at zero disparity. However, the greatest modulation of response by the different pedestals was found in the dorsal visual areas and the parietal areas. These differences contrast with the response to the zero disparity plane, compared with fixation, which is greatest in the early visual areas, smaller in the ventral and dorsal visual areas, and absent in parietal areas. Using the simultaneously acquired psychophysical data we also measured a greater response to correct than to incorrect trials, an effect that increased with rising pedestal disparity and was greatest in dorsal visual and parietal areas. These results illustrate that the dorsal stream, along both its occipital and parietal branches, can reliably discriminate a large range of disparities.

scholarly journals Attentional amplification of neural codes for number independent of other quantities along the dorsal visual stream

2019 ◽  
Author(s):  
Elisa Castaldi ◽  
Manuela Piazza ◽  
Stanislas Dehaene ◽  
Alexandre Vignaud ◽  
Evelyn Eger
Keyword(s):  
Dorsal Stream ◽  
7 Tesla ◽  
Visual Stream ◽  
Activation Patterns ◽  
Extraction Mechanism ◽  
Human Volunteers ◽  
Neuronal Processing ◽  
Item Size ◽  
Orthogonal Dimension ◽  
Dorsal Visual Stream

Humans and other animals base important decisions on estimates of number, and intraparietal cortex is thought to provide a crucial substrate of this ability. However, it remains debated whether an independent neuronal processing mechanism underlies this 'number sense', or whether number is instead judged indirectly on the basis of other quantitative features. We performed high-resolution 7 Tesla fMRI while adult human volunteers attended either to the numerosity or to an orthogonal dimension (average item size) of visual dot arrays. Numerosity explained a significant amount of variance in activation patterns, above and beyond non-numerical dimensions. Its representation was progressively enhanced along the dorsal visual pathway and was selectively amplified by attention when task relevant. These results reveal a dedicated extraction mechanism for numerosity that operates independently of other quantitative dimensions of the stimuli, and suggest that later stages along the dorsal stream are most important for the explicit manipulation of numerical quantity.

scholarly journals Attentional amplification of neural codes for number independent of other quantities along the dorsal visual stream

eLife ◽  
2019 ◽  
Vol 8 ◽  
Author(s):  
Elisa Castaldi ◽  
Manuela Piazza ◽  
Stanislas Dehaene ◽  
Alexandre Vignaud ◽  
Evelyn Eger
Keyword(s):  
Dorsal Stream ◽  
7 Tesla ◽  
Visual Stream ◽  
Activation Patterns ◽  
Extraction Mechanism ◽  
Human Volunteers ◽  
Neuronal Processing ◽  
Item Size ◽  
Orthogonal Dimension ◽  
Dorsal Visual Stream

Humans and other animals base important decisions on estimates of number, and intraparietal cortex is thought to provide a crucial substrate of this ability. However, it remains debated whether an independent neuronal processing mechanism underlies this ‘number sense’, or whether number is instead judged indirectly on the basis of other quantitative features. We performed high-resolution 7 Tesla fMRI while adult human volunteers attended either to the numerosity or an orthogonal dimension (average item size) of visual dot arrays. Along the dorsal visual stream, numerosity explained a significant amount of variance in activation patterns, above and beyond non-numerical dimensions. Its representation was selectively amplified and progressively enhanced across the hierarchy when task relevant. Our results reveal a sensory extraction mechanism yielding information on numerosity separable from other dimensions already at early visual stages and suggest that later regions along the dorsal stream are most important for explicit manipulation of numerical quantity.

scholarly journals Visuopathy of prematurity: is retinopathy just the tip of the iceberg?

2021 ◽  
Author(s):  
Sigrid Hegna Ingvaldsen ◽  
Tora Sund Morken ◽  
Dordi Austeng ◽  
Olaf Dammann
Keyword(s):  
Visual Processing ◽  
Structural Changes ◽  
Developmental Trajectories ◽  
Visual Pathway ◽  
Visual Stream ◽  
Visual Deficits ◽  
Cortical Areas ◽  
Cellular Architecture ◽  
Increased Risk ◽  
Dorsal Visual Stream

AbstractResearch on retinopathy of prematurity (ROP) focuses mainly on the abnormal vascularization patterns that are directly visible for ophthalmologists. However, recent findings indicate that children born prematurely also exhibit changes in the retinal cellular architecture and along the dorsal visual stream, such as structural changes between and within cortical areas. Moreover, perinatal sustained systemic inflammation (SSI) is associated with an increased risk for ROP and the visual deficits that follow. In this paper, we propose that ROP might just be the tip of an iceberg we call visuopathy of prematurity (VOP). The VOP paradigm comprises abnormal vascularization of the retina, alterations in retinal cellular architecture, choroidal degeneration, and abnormalities in the visual pathway, including cortical areas. Furthermore, VOP itself might influence the developmental trajectories of cerebral structures and functions deemed responsible for visual processing, thereby explaining visual deficits among children born preterm.

scholarly journals Effects of visual attention modulation on dynamic effective connectivity and visual fixation during own-face viewing in body dysmorphic disorder

2021 ◽  
Author(s):  
Wan-wa Wong ◽  
D. Rangaprakash ◽  
Joel P. Diaz-Fong ◽  
Natalie M. Rotstein ◽  
Gerhard S. Hellemann ◽  
...  
Keyword(s):  
Visual Attention ◽  
Visual Processing ◽  
Fixation Duration ◽  
Body Dysmorphic Disorder ◽  
Effective Connectivity ◽  
Visual Fixation ◽  
Imaging Data ◽  
Visual Scanning ◽  
Visual Stream ◽  
Dorsal Visual Stream

AbstractBackgroundIn individuals with body dysmorphic disorder (BDD), selective attention biases and aberrant visual scanning patterns may cause imbalances in global vs. detailed visual processing, contributing to perceptual distortions for appearance. The mechanistic effects of modifying visual attention on brain function in BDD, which may be critical to developing perceptual-based treatments, have not been explored. This study tested the effects of visual-attention modulation on dorsal and ventral visual stream activation and connectivity, and eye behaviors.MethodsWe acquired functional magnetic resonance imaging data in 37 unmedicated adults with BDD and 30 controls. Participants viewed their faces under two conditions: a) unconstrained (naturalistically), and b) holding their gaze on the center of the image (visual-attention modulation), monitored with an eye-tracking camera. We analyzed activation and dynamic effective connectivity in dorsal and ventral visual streams and visual fixation duration.ResultsVisual-attention modulation resulted in longer fixation duration and reduced activation in dorsal and ventral visual streams in both groups compared with naturalistic viewing. Longer fixation duration was associated with greater effective connectivity from V1 to early dorsal visual stream during the second naturalistic viewing, across groups. During naturalistic viewing, there was greater V1 to early dorsal visual stream connectivity after, compared with before, visual-attention modulation.ConclusionsWhen viewing one’s face, longer visual fixation may confer greater communication in dorsal visual system, facilitating global/holistic visual processing. The finding that reduction in visual scanning while viewing one’s face results in persistent effects during unconstrained viewing has implications for perceptual retraining treatment design for BDD.

scholarly journals Your head is there to move you around: Goal-driven models of the primate dorsal pathway

2021 ◽  
Author(s):  
Patrick J Mineault ◽  
Shahab Bakhtiari ◽  
Blake A Richards ◽  
Christopher C Pack
Keyword(s):  
Moving Objects ◽  
Explanatory Power ◽  
Dorsal Stream ◽  
Visual Pathway ◽  
Mammalian Brain ◽  
Visual Stream ◽  
Dorsal Pathway ◽  
Simulated Environment ◽  
Self Motion ◽  
Dorsal Visual Stream

Neurons in the dorsal visual pathway of the mammalian brain are selective for motion stimuli, with the complexity of stimulus representations increasing along the hierarchy. This progression is similar to that of the ventral visual pathway, which is well characterized by artificial neural networks (ANNs) optimized for object recognition. In contrast, there are no image-computable models of the dorsal stream with comparable explanatory power. We hypothesized that the properties of dorsal stream neurons could be explained by a simple learning objective: the need for an organism to orient itself during self-motion. To test this hypothesis, we trained a 3D ResNet in a self-supervised manner to predict an agent's self-motion parameters from visual stimuli in a simulated environment. We found that the responses in this network accounted well for the selectivity of neurons in a large database of single-neuron recordings from the dorsal visual stream of non-human primates. In contrast, ANNs trained for action recognition or with a contrastive objective could not explain responses in the dorsal stream, despite also being trained on naturalistic videos with moving objects. These results demonstrate that an ecologically relevant, self-supervised cost function can account for dorsal stream properties in the primate brain.

Horizontal line bisections in upper and lower body space

2000 ◽  
Vol 6 (4) ◽  
pp. 455-459 ◽  
Author(s):  
ANNA M. BARRETT ◽  
J. BRENT CROSSON ◽  
GREGORY P. CRUCIAN ◽  
KENNETH M. HEILMAN
Keyword(s):  
Object Recognition ◽  
Left Hemisphere ◽  
Visual Processing ◽  
Right Hemisphere ◽  
Dorsal Stream ◽  
Spatial Localization ◽  
Upper Body ◽  
Horizontal Line ◽  
Lower Body ◽  
Visual Stream

Whereas the ventral cortical visual stream is important in object recognition, the dorsal stream is specialized for spatial localization. In humans there are also right and left hemisphere asymmetries in visual processing: the left hemisphere being more important in object recognition and the right in specifying spatial locations. Based on these dorsal–ventral and right–left where–what dichotomies, one would expect that the dorsal right hemisphere systems would be most activated during spatial localization tasks, and this activation may induce a leftward spatial bias in lower space. To determine if visual stimuli in upper and lower body space evoke different hemispheric activation, we had 12 normal participants bisect horizontal lines above and below eye level. Participants erred leftward in lower body space relative to upper body space (M = 1.3345 mm and 0.4225 mm, respectively; p = .011). In upper body space, bisection errors did not differ from zero, but in lower body space, errors tended to deviate leftward (M = 1.3345 mm, differs from null hypotheses at p = .0755). Our results are consistent with dorsal stream/right hemisphere activation when performing a spatial localization task in lower versus upper body space. (JINS, 2000, 6, 455–459.)

scholarly journals “Real-time” obstacle avoidance in the absence of primary visual cortex

2009 ◽  
Vol 106 (37) ◽  
pp. 15996-16001 ◽  
Author(s):  
Christopher L. Striemer ◽  
Craig S. Chapman ◽  
Melvyn A. Goodale
Keyword(s):  
Visual Cortex ◽  
Real Time ◽  
Obstacle Avoidance ◽  
Primary Visual Cortex ◽  
Posterior Parietal Cortex ◽  
Dorsal Stream ◽  
Visual Pathways ◽  
Visual Stream ◽  
Reaching Task ◽  
Visual Inputs

When we reach toward objects, we easily avoid potential obstacles located in the workspace. Previous studies suggest that obstacle avoidance relies on mechanisms in the dorsal visual stream in the posterior parietal cortex. One fundamental question that remains unanswered is where the visual inputs to these dorsal-stream mechanisms are coming from. Here, we provide compelling evidence that these mechanisms can operate in “real-time” without direct input from primary visual cortex (V1). In our first experiment, we used a reaching task to demonstrate that an individual with a dense left visual field hemianopia after damage to V1 remained strikingly sensitive to the position of unseen static obstacles placed in his blind field. Importantly, in a second experiment, we showed that his sensitivity to the same obstacles in his blind field was abolished when a short 2-s delay (without vision) was introduced before reach onset. These findings have far-reaching implications, not only for our understanding of the time constraints under which different visual pathways operate, but also in relation to how these seemingly “primitive” subcortical visual pathways can control complex everyday behavior without recourse to conscious vision.

Independence of color and luminance edges in natural scenes

2009 ◽  
Vol 26 (1) ◽  
pp. 35-49 ◽  
Author(s):  
THORSTEN HANSEN ◽  
KARL R. GEGENFURTNER
Keyword(s):  
Visual Processing ◽  
Artificial Vision ◽  
Natural Scenes ◽  
Natural Scene ◽  
Natural Scene Statistics ◽  
Form Vision ◽  
Independent Information ◽  
Edge Contrast ◽  
Source Of Information ◽  
Gain Access

AbstractForm vision is traditionally regarded as processing primarily achromatic information. Previous investigations into the statistics of color and luminance in natural scenes have claimed that luminance and chromatic edges are not independent of each other and that any chromatic edge most likely occurs together with a luminance edge of similar strength. Here we computed the joint statistics of luminance and chromatic edges in over 700 calibrated color images from natural scenes. We found that isoluminant edges exist in natural scenes and were not rarer than pure luminance edges. Most edges combined luminance and chromatic information but to varying degrees such that luminance and chromatic edges were statistically independent of each other. Independence increased along successive stages of visual processing from cones via postreceptoral color-opponent channels to edges. The results show that chromatic edge contrast is an independent source of information that can be linearly combined with other cues for the proper segmentation of objects in natural and artificial vision systems. Color vision may have evolved in response to the natural scene statistics to gain access to this independent information.

Sign in / Sign up

Export Citation Format

Share Document