scholarly journals An intrinsic neural eye tracker in primary visual cortex

2018 ◽  
Author(s):  
Adam P. Morris ◽  
Bart Krekelberg
Keyword(s):  
Visual Cortex ◽  
Eye Movements ◽  
Primary Visual Cortex ◽  
Visual Information ◽  
Moving Objects ◽  
Receptive Fields ◽  
Gaze Direction ◽  
Eye Tracker ◽  
Electrode Arrays ◽  
Full Field

SummaryHumans and other primates rely on eye movements to explore visual scenes and to track moving objects. As a result, the image that is projected onto the retina – and propagated throughout the visual cortical hierarchy – is almost constantly changing and makes little sense without taking into account the momentary direction of gaze. How is this achieved in the visual system? Here we show that in primary visual cortex (V1), the earliest stage of cortical vision, neural representations carry an embedded “eye tracker” that signals the direction of gaze associated with each image. Using chronically implanted multi-electrode arrays, we recorded the activity of neurons in V1 during tasks requiring fast (exploratory) and slow (pursuit) eye movements. Neurons were stimulated with flickering, full-field luminance noise at all times. As in previous studies 1-4, we observed neurons that were sensitive to gaze direction during fixation, despite comparable stimulation of their receptive fields. We trained a decoder to translate neural activity into metric estimates of (stationary) gaze direction. This decoded signal not only tracked the eye accurately during fixation, but also during fast and slow eye movements, even though the decoder had not been exposed to data from these behavioural states. Moreover, this signal lagged the real eye by approximately the time it took for new visual information to travel from the retina to cortex. Using simulations, we show that this V1 eye position signal could be used to take into account the sensory consequences of eye movements and map the fleeting positions of objects on the retina onto their stable position in the world.

A collicular visual cortex: Neocortical space for an ancient midbrain visual structure

Science ◽  
2019 ◽  
Vol 363 (6422) ◽  
pp. 64-69 ◽  
Author(s):  
Riccardo Beltramo ◽  
Massimo Scanziani
Keyword(s):  
Cerebral Cortex ◽  
Visual Cortex ◽  
Primary Visual Cortex ◽  
Visual Information ◽  
Cortical Area ◽  
Moving Objects ◽  
Visual Responses ◽  
Visual Cortical Area ◽  
Postrhinal Cortex ◽  
Visual Cortical

Visual responses in the cerebral cortex are believed to rely on the geniculate input to the primary visual cortex (V1). Indeed, V1 lesions substantially reduce visual responses throughout the cortex. Visual information enters the cortex also through the superior colliculus (SC), but the function of this input on visual responses in the cortex is less clear. SC lesions affect cortical visual responses less than V1 lesions, and no visual cortical area appears to entirely rely on SC inputs. We show that visual responses in a mouse lateral visual cortical area called the postrhinal cortex are independent of V1 and are abolished upon silencing of the SC. This area outperforms V1 in discriminating moving objects. We thus identify a collicular primary visual cortex that is independent of the geniculo-cortical pathway and is capable of motion discrimination.

scholarly journals Visual motion computation in recurrent neural networks

2017 ◽  
Author(s):  
Marius Pachitariu ◽  
Maneesh Sahani
Keyword(s):  
Visual Cortex ◽  
Primary Visual Cortex ◽  
Visual Information ◽  
Visual Motion ◽  
Hebbian Learning ◽  
Temporal Dynamics ◽  
Temporal Structure ◽  
Receptive Fields ◽  
Learning Rule ◽  
Connectivity Matrix

AbstractPopulations of neurons in primary visual cortex (V1) transform direct thalamic inputs into a cortical representation which acquires new spatio-temporal properties. One of these properties, motion selectivity, has not been strongly tied to putative neural mechanisms, and its origins remain poorly understood. Here we propose that motion selectivity is acquired through the recurrent mechanisms of a network of strongly connected neurons. We first show that a bank of V1 spatiotemporal receptive fields can be generated accurately by a network which receives only instantaneous inputs from the retina. The temporal structure of the receptive fields is generated by the long timescale dynamics associated with the high magnitude eigenvalues of the recurrent connectivity matrix. When these eigenvalues have complex parts, they generate receptive fields that are inseparable in time and space, such as those tuned to motion direction. We also show that the recurrent connectivity patterns can be learnt directly from the statistics of natural movies using a temporally-asymmetric Hebbian learning rule. Probed with drifting grating stimuli and moving bars, neurons in the model show patterns of responses analogous to those of direction-selective simple cells in primary visual cortex. These computations are enabled by a specific pattern of recurrent connections, that can be tested by combining connectome reconstructions with functional recordings.*Author summaryDynamic visual scenes provide our eyes with enormous quantities of visual information, particularly when the visual scene changes rapidly. Even at modest moving speeds, individual small objects quickly change their location causing single points in the scene to change their luminance equally fast. Furthermore, our own movements through the world add to the velocities of objects relative to our retinas, further increasing the speed at which visual inputs change. How can a biological system process efficiently such vast amounts of information, while keeping track of objects in the scene? Here we formulate and analyze a solution that is enabled by the temporal dynamics of networks of neurons.

scholarly journals fMRI Evidence for Default Mode Network Deactivation Associated with Rapid Eye Movements in Sleep

2021 ◽  
Vol 11 (11) ◽  
pp. 1528
Author(s):  
Charles Chong-Hwa Hong ◽  
James H. Fallon ◽  
Karl J. Friston
Keyword(s):  
Visual Cortex ◽  
Eye Movements ◽  
Primary Visual Cortex ◽  
Multisensory Integration ◽  
Default Mode Network ◽  
Visual Information ◽  
Cortical Activation ◽  
Default Mode ◽  
Hierarchical Processing ◽  
Rapid Eye Movements

System-specific brain responses—time-locked to rapid eye movements (REMs) in sleep—are characteristically widespread, with robust and clear activation in the primary visual cortex and other structures involved in multisensory integration. This pattern suggests that REMs underwrite hierarchical processing of visual information in a time-locked manner, where REMs index the generation and scanning of virtual-world models, through multisensory integration in dreaming—as in awake states. Default mode network (DMN) activity increases during rest and reduces during various tasks including visual perception. The implicit anticorrelation between the DMN and task-positive network (TPN)—that persists in REM sleep—prompted us to focus on DMN responses to temporally-precise REM events. We timed REMs during sleep from the video recordings and quantified the neural correlates of REMs—using functional MRI (fMRI)—in 24 independent studies of 11 healthy participants. A reanalysis of these data revealed that the cortical areas exempt from widespread REM-locked brain activation were restricted to the DMN. Furthermore, our analysis revealed a modest temporally-precise REM-locked decrease—phasic deactivation—in key DMN nodes, in a subset of independent studies. These results are consistent with hierarchical predictive coding; namely, permissive deactivation of DMN at the top of the hierarchy (leading to the widespread cortical activation at lower levels; especially the primary visual cortex). Additional findings indicate REM-locked cerebral vasodilation and suggest putative mechanisms for dream forgetting.

Adult Cortical Dynamics

1998 ◽  
Vol 78 (2) ◽  
pp. 467-485 ◽  
Author(s):  
CHARLES D. GILBERT
Keyword(s):  
Visual Cortex ◽  
Functional Properties ◽  
Primary Visual Cortex ◽  
Visual Information ◽  
Visual Space ◽  
Visual Pathway ◽  
Local Features ◽  
Spatial Integration ◽  
Cortical Dynamics ◽  
Wide Range

Gilbert, Charles D. Adult Cortical Dynamics. Physiol. Rev. 78: 467–485, 1998. — There are many influences on our perception of local features. What we see is not strictly a reflection of the physical characteristics of a scene but instead is highly dependent on the processes by which our brain attempts to interpret the scene. As a result, our percepts are shaped by the context within which local features are presented, by our previous visual experiences, operating over a wide range of time scales, and by our expectation of what is before us. The substrate for these influences is likely to be found in the lateral interactions operating within individual areas of the cerebral cortex and in the feedback from higher to lower order cortical areas. Even at early stages in the visual pathway, cells are far more flexible in their functional properties than previously thought. It had long been assumed that cells in primary visual cortex had fixed properties, passing along the product of a stereotyped operation to the next stage in the visual pathway. Any plasticity dependent on visual experience was thought to be restricted to a period early in the life of the animal, the critical period. Furthermore, the assembly of contours and surfaces into unified percepts was assumed to take place at high levels in the visual pathway, whereas the receptive fields of cells in primary visual cortex represented very small windows on the visual scene. These concepts of spatial integration and plasticity have been radically modified in the past few years. The emerging view is that even at the earliest stages in the cortical processing of visual information, cells are highly mutable in their functional properties and are capable of integrating information over a much larger part of visual space than originally believed.

scholarly journals Thalamic inputs determine functionally distinct gamma bands in mouse primary visual cortex

2020 ◽  
Author(s):  
Nicolò Meneghetti ◽  
Chiara Cerri ◽  
Elena Tantillo ◽  
Eleonora Vannini ◽  
Matteo Caleo ◽  
...  
Keyword(s):  
Visual Cortex ◽  
Primary Visual Cortex ◽  
Visual Information ◽  
Narrow Band ◽  
Broad Band ◽  
Gamma Band ◽  
Neuron Network ◽  
Sensory Stimuli ◽  
Thalamic Input ◽  
Visual Contrast

AbstractGamma band is known to be involved in the encoding of visual features in the primary visual cortex (V1). Recent results in rodents V1 highlighted the presence, within a broad gamma band (BB) increasing with contrast, of a narrow gamma band (NB) peaking at ∼60 Hz suppressed by contrast and enhanced by luminance. However, the processing of visual information by the two channels still lacks a proper characterization. Here, by combining experimental analysis and modeling, we prove that the two bands are sensitive to specific thalamic inputs associated with complementary contrast ranges. We recorded local field potentials from V1 of awake mice during the presentation of gratings and observed that NB power progressively decreased from low to intermediate levels of contrast. Conversely, BB power was insensitive to low levels of contrast but it progressively increased going from intermediate to high levels of contrast. Moreover, BB response was stronger immediately after contrast reversal, while the opposite held for NB. All the aforementioned dynamics were accurately reproduced by a recurrent excitatory-inhibitory leaky integrate-and-fire network, mimicking layer IV of mouse V1, provided that the sustained and periodic component of the thalamic input were modulated over complementary contrast ranges. These results shed new light on the origin and function of the two V1 gamma bands. In addition, here we propose a simple and effective model of response to visual contrast that might help in reconstructing network dysfunction underlying pathological alterations of visual information processing.Significance StatementGamma band is a ubiquitous hallmark of cortical processing of sensory stimuli. Experimental evidence shows that in the mouse visual cortex two types of gamma activity are differentially modulated by contrast: a narrow band (NB), that seems to be rodent specific, and a standard broad band (BB), observed also in other animal models.We found that narrow band correlates and broad band anticorrelates with visual contrast in two complementary contrast ranges (low and high respectively). Moreover, BB displayed an earlier response than NB. A thalamocortical spiking neuron network model reproduced the aforementioned results, suggesting they might be due to the presence of two complementary but distinct components of the thalamic input into visual cortical circuitry.

scholarly journals Temporo-nasally biased moving grating selectivity in mouse primary visual cortex

2019 ◽  
Author(s):  
Marie Tolkiehn ◽  
Simon R. Schultz
Keyword(s):  
Visual Cortex ◽  
Spatial Frequency ◽  
Primary Visual Cortex ◽  
Moving Objects ◽  
Direction Selectivity ◽  
Orientation Tuning ◽  
High Signal ◽  
Forward Movement ◽  
Upward Moving

AbstractOrientation tuning in mouse primary visual cortex (V1) has long been reported to have a random or “salt-and-pepper” organisation, lacking the structure found in cats and primates. Laminar in-vivo multi-electrode array recordings here reveal previously elusive structure in the representation of visual patterns in the mouse visual cortex, with temporo-nasally drifting gratings eliciting consistently highest neuronal responses across cortical layers and columns, whilst upward moving gratings reliably evoked the lowest activities. We suggest this bias in direction selectivity to be behaviourally relevant as objects moving into the visual field from the side or behind may pose a predatory threat to the mouse whereas upward moving objects do not. We found furthermore that direction preference and selectivity was affected by stimulus spatial frequency, and that spatial and directional tuning curves showed high signal correlations decreasing with distance between recording sites. In addition, we show that despite this bias in direction selectivity, it is possible to decode stimulus identity and that spatiotemporal features achieve higher accuracy in the decoding task whereas spike count or population counts are sufficient to decode spatial frequencies implying different encoding strategies.Significance statementWe show that temporo-nasally drifting gratings (i.e. opposite the normal visual flow during forward movement) reliably elicit the highest neural activity in mouse primary visual cortex, whereas upward moving gratings reliably evoke the lowest responses. This encoding may be highly behaviourally relevant, as objects approaching from the periphery may pose a threat (e.g. predators), whereas upward moving objects do not. This is a result at odds with the belief that mouse primary visual cortex is randomly organised. Further to this biased representation, we show that direction tuning depends on the underlying spatial frequency and that tuning preference is spatially correlated both across layers and columns and decreases with cortical distance, providing evidence for structural organisation in mouse primary visual cortex.

scholarly journals Postnatal Development of Onset Transient Responses in Macaque V1 and V2 Neurons

2008 ◽  
Vol 100 (3) ◽  
pp. 1476-1487 ◽  
Author(s):  
Bin Zhang ◽  
Earl L. Smith ◽  
Yuzo M. Chino
Keyword(s):  
Visual Cortex ◽  
Eye Movements ◽  
Primary Visual Cortex ◽  
Cortical Neurons ◽  
Newborn Infants ◽  
Neuronal Firing ◽  
Transient Responses ◽  
Visual Cortical ◽  
Better Than

Vision of newborn infants is limited by immaturities in their visual brain. In adult primates, the transient onset discharges of visual cortical neurons are thought to be intimately involved with capturing the rapid succession of brief images in visual scenes. Here we sought to determine the responsiveness and quality of transient responses in individual neurons of the primary visual cortex (V1) and visual area 2 (V2) of infant monkeys. We show that the transient component of neuronal firing to 640-ms stationary gratings was as robust and as reliable as in adults only 2 wk after birth, whereas the sustained component was more sluggish in infants than in adults. Thus the cortical circuitry supporting onset transient responses is functionally mature near birth, and our findings predict that neonates, known for their “impoverished vision,” are capable of initiating relatively mature fixating eye movements and of performing in detection of simple objects far better than traditionally thought.

scholarly journals Spatial Distribution of Contextual Interactions in Primary Visual Cortex and in Visual Perception

2000 ◽  
Vol 84 (4) ◽  
pp. 2048-2062 ◽  
Author(s):  
Mitesh K. Kapadia ◽  
Gerald Westheimer ◽  
Charles D. Gilbert
Keyword(s):  
Spatial Distribution ◽  
Visual Cortex ◽  
Primary Visual Cortex ◽  
Cortical Neurons ◽  
Receptive Fields ◽  
Human Perception ◽  
Spatial Arrangement ◽  
Orthogonal Axis ◽  
V1 Neurons ◽  
Contextual Interactions

To examine the role of primary visual cortex in visuospatial integration, we studied the spatial arrangement of contextual interactions in the response properties of neurons in primary visual cortex of alert monkeys and in human perception. We found a spatial segregation of opposing contextual interactions. At the level of cortical neurons, excitatory interactions were located along the ends of receptive fields, while inhibitory interactions were strongest along the orthogonal axis. Parallel psychophysical studies in human observers showed opposing contextual interactions surrounding a target line with a similar spatial distribution. The results suggest that V1 neurons can participate in multiple perceptual processes via spatially segregated and functionally distinct components of their receptive fields.

Sign in / Sign up

Export Citation Format

Share Document