scholarly journals Recurrent Processes Emulate a Cascade of Hierarchical Decisions: Evidence from Spatio-Temporal Decoding of Human Brain Activity

2019 ◽  
Author(s):  
Laura Gwilliams ◽  
Jean-Remi King
Keyword(s):  
Visual Processing ◽  
Human Subjects ◽  
Brain Activity ◽  
Reaction Times ◽  
Analytical Framework ◽  
Brain Network ◽  
Neural Representations ◽  
Brain Responses ◽  
Spatio Temporal ◽  
Subsequent Activity

AbstractMounting evidence suggests that perception depends on a largely-feedforward brain network. However, the discrepancy between (i) the latency of the corresponding feedforward responses (150-200 ms) and (ii) the time it takes human subjects to recognize brief images (often >500 ms) suggests that recurrent neuronal activity is critical to visual processing. Here, we use magneto-encephalography to localize, track and decode the feedforward and recurrent responses elicited by brief presentations of variably-ambiguous letters and digits. We first confirm that these stimuli trigger, within the first 200 ms, a feedforward response in the ventral and dorsal cortical pathways. The subsequent activity is distributed across temporal, parietal and prefrontal cortices and leads to a slow and incremental cascade of representations culminating in action-specific motor signals. We introduce an analytical framework to show that these brain responses are best accounted for by a hierarchy of recurrent neural assemblies. An accumulation of computational delays across specific processing stages explains subjects’ reaction times. Finally, the slow convergence of neural representations towards perceptual categories is quickly followed by all-or-none motor decision signals. Together, these results show how recurrent processes generate, over extended time periods, a cascade of hierarchical decisions that ultimately predicts subjects’ perceptual reports.

scholarly journals Sensory-modality independent activation of the brain network for language

2019 ◽  
Author(s):  
Sophie Arana ◽  
André Marquand ◽  
Annika Hultén ◽  
Peter Hagoort ◽  
Jan-Mathijs Schoffelen
Keyword(s):  
Language Processing ◽  
Sentence Processing ◽  
Human Subjects ◽  
Brain Activity ◽  
Activity Patterns ◽  
Sensory Modality ◽  
Brain Network ◽  
Large Network ◽  
Individual Subject ◽  
The Brain

AbstractThe meaning of a sentence can be understood, whether presented in written or spoken form. Therefore it is highly probable that brain processes supporting language comprehension are at least partly independent of sensory modality. To identify where and when in the brain language processing is independent of sensory modality, we directly compared neuromagnetic brain signals of 200 human subjects (102 males) either reading or listening to sentences. We used multiset canonical correlation analysis to align individual subject data in a way that boosts those aspects of the signal that are common to all, allowing us to capture word-by-word signal variations, consistent across subjects and at a fine temporal scale. Quantifying this consistency in activation across both reading and listening tasks revealed a mostly left hemispheric cortical network. Areas showing consistent activity patterns include not only areas previously implicated in higher-level language processing, such as left prefrontal, superior & middle temporal areas and anterior temporal lobe, but also parts of the control-network as well as subcentral and more posterior temporal-parietal areas. Activity in this supramodal sentence processing network starts in temporal areas and rapidly spreads to the other regions involved. The findings do not only indicate the involvement of a large network of brain areas in supramodal language processing, but also indicate that the linguistic information contained in the unfolding sentences modulates brain activity in a word-specific manner across subjects.

scholarly journals Visual Selective Behavior Can Be Triggered by a Feed-Forward Process

2003 ◽  
Vol 15 (2) ◽  
pp. 209-217 ◽  
Author(s):  
Rufin VanRullen ◽  
Christof Koch
Keyword(s):  
Object Recognition ◽  
Visual System ◽  
Visual Processing ◽  
Time Course ◽  
Reaction Times ◽  
Feed Forward ◽  
Motor Responses ◽  
Neural Representations ◽  
Short Period ◽  
Feedback Connections

The ventral visual pathway implements object recognition and categorization in a hierarchy of processing areas with neuronal selectivities of increasing complexity. The presence of massive feedback connections within this hierarchy raises the possibility that normal visual processing relies on the use of computational loops. It is not known, however, whether object recognition can be performed at all without such loops (i.e., in a purely feed-forward mode). By analyzing the time course of reaction times in a masked natural scene categorization paradigm, we show that the human visual system can generate selective motor responses based on a single feed-forward pass. We confirm these results using a more constrained letter discrimination task, in which the rapid succession of a target and mask is actually perceived as a distractor. We show that a masked stimulus presented for only 26 msec—and often not consciously perceived—can fully determine the earliest selective motor responses: The neural representations of the stimulus and mask are thus kept separated during a short period corresponding to the feed-forward “sweep.” Therefore, feedback loops do not appear to be “mandatory” for visual processing. Rather, we found that such loops allow the masked stimulus to reverberate in the visual system and affect behavior for nearly 150 msec after the feed-forward sweep.

Graded Effects of Spatial and Featural Attention on Human Area MT and Associated Motion Processing Areas

1997 ◽  
Vol 78 (1) ◽  
pp. 516-520 ◽  
Author(s):  
Michael S. Beauchamp ◽  
Robert W. Cox ◽  
Edgar A. Deyoe
Keyword(s):  
Spatial Attention ◽  
Visual Processing ◽  
Human Subjects ◽  
Brain Activity ◽  
Motion Processing ◽  
Related Factors ◽  
Area Mt ◽  
Subtle Change ◽  
Normal Human ◽  
High Degree

Beauchamp, Michael S., Robert W. Cox, and Edgar A. DeYoe. Graded effects of spatial and featural attention on human area MT and associated motion processing areas. J. Neurophysiol. 78: 516–520, 1997. Functional magnetic resonance imaging was used to quantify the effects of changes in spatial and featural attention on brain activity in the middle temporal visual area and associated motion processing regions (hMT+) of normal human subjects. When subjects performed a discrimination task that directed their spatial attention to a peripherally presented annulus and their featural attention to the speed of points in the annulus, activity in hMT+ was maximal. If subjects were instead asked to discriminate the color of points in the annulus, the magnitude and volume of activation in hMT+ fell to 64 and 35%, respectively, of the previously observed maximum response. In another experiment, subjects were asked to direct their spatial attention away from the annulus toward the fixation point to detect a subtle change in luminance. The response magnitude and volume dropped to 40 and 9% of maximum. These experiments demonstrate that both spatial and featural attention modulate hMT+ and that their effects can work in concert to modulate cortical activity. The high degree of modulation by attention suggests that an understanding of the stimulus-driven properties of visual cortex needs to be complemented with an investigation of the effects of task-related factors on visual processing.

scholarly journals Recurrent processes support a cascade of hierarchical decisions

eLife ◽  
2020 ◽  
Vol 9 ◽  
Author(s):  
Laura Gwilliams ◽  
Jean-Remi King
Keyword(s):  
Reaction Times ◽  
Extended Time ◽  
Complex Interplay ◽  
Neural Assemblies ◽  
Brain Responses ◽  
Recurrent Processing ◽  
Time Periods ◽  
Subsequent Activity ◽  
Prefrontal Cortices ◽  
Motor Signals

Perception depends on a complex interplay between feedforward and recurrent processing. Yet, while the former has been extensively characterized, the computational organization of the latter remains largely unknown. Here, we use magneto-encephalography to localize, track and decode the feedforward and recurrent processes of reading, as elicited by letters and digits whose level of ambiguity was parametrically manipulated. We first confirm that a feedforward response propagates through the ventral and dorsal pathways within the first 200 ms. The subsequent activity is distributed across temporal, parietal and prefrontal cortices, which sequentially generate five levels of representations culminating in action-specific motor signals. Our decoding analyses reveal that both the content and the timing of these brain responses are best explained by a hierarchy of recurrent neural assemblies, which both maintain and broadcast increasingly rich representations. Together, these results show how recurrent processes generate, over extended time periods, a cascade of decisions that ultimately accounts for subjects’ perceptual reports and reaction times.

scholarly journals Alpha oscillation, criticality, and responsiveness in complex brain networks

2020 ◽  
Vol 4 (1) ◽  
pp. 155-173 ◽  
Author(s):  
MinKyung Kim ◽  
UnCheol Lee
Keyword(s):  
Brain Activity ◽  
Time Windows ◽  
Brain Network ◽  
Global Synchronization ◽  
Alpha Oscillations ◽  
Order And Disorder ◽  
Brain Responses ◽  
Alpha Oscillation ◽  
Low Amplitude ◽  
External Stimuli

Brains in unconsciousness are characterized by significantly limited responsiveness to stimuli. Even during conscious wakefulness, responsiveness is highly dependent on ongoing brain activity, specifically, of alpha oscillations (∼10 Hz). We hypothesized that the variety of brain responses to external stimuli result from the interaction between state-specific and transient alpha oscillations and stimuli. To justify this hypothesis, we simulated various alpha oscillations in the human brain network, modulating criticality (a balanced state between order and disorder), and investigated specific alpha oscillation properties (instantaneous amplitude, phase, and global synchronization) that induce a large or small response. As a result, we found that the alpha oscillations near a critical state show a more complex and long-lasting response, which is more prominent when stimuli are given to globally desynchronized and low-amplitude oscillations. We also found specific phases of alpha oscillation that barely respond to stimuli, which implies the presence of temporal windows in the alpha cycle for a large or small response. The results explain why brain responses are so variable across conscious and unconscious states and across time windows even during conscious wakefulness, and emphasize the importance of considering ongoing alpha oscillations for effective brain stimulation.

A Measure of Localization of Brain Activity for the Motion Aperture Problem Using Electroencephalograms

2012 ◽  
pp. 208-223 ◽  
Author(s):  
Isao Hayashi ◽  
Hisashi Toyoshima ◽  
Takahiro Yamanoi
Keyword(s):  
Visual Processing ◽  
Brain Activity ◽  
Inferior Frontal Gyrus ◽  
Dipole Source ◽  
Circular Aperture ◽  
Current Dipole ◽  
Aperture Problem ◽  
Dorsal Pathway ◽  
Ventral Pathway ◽  
Spatio Temporal

When viewed through a limited-sized aperture, bars appear to move in a direction normal to their orientation. This motion aperture problem is an important rubric for analyzing the early stages of visual processing particularly with respect to the perceptual completion of motion sampled across two or more apertures. In the present study, a circular aperture was displayed in the center of the visual field. While the baseline bar moved within the aperture, two additional circular apertures appeared; within each aperture, a “flanker bar” appeared to move. For upwards movement of the flanker lines, subjects perceived the flanker bar to be connected to the base bar, and all three parts to move upward. The authors investigated the motion perception of the moving bars by changing the line speeds, radii of the apertures, and distances between the circular apertures and then analyzed spatio-temporal brain activities by electroencephalograms (EEGs). Latencies in the brain were estimated by using equivalent current dipole source (ECD) localization for one subject. Soon after the flankers appear, ECDs, assumed to be generated by the recognition of the aperture’s form, were localized along the ventral pathway. After the bars moved, the ECDs were localized along the dorsal pathway, presumably in response to motion of the bars. In addition, for the perception of grouped motion and not normal motion, ECDs were localized to the middle frontal gyrus and the inferior frontal gyrus.

Skipping Breakfast Affects the Early Steps of Cognitive Processing

2019 ◽  
Vol 33 (2) ◽  
pp. 109-118
Author(s):  
Andrés Antonio González-Garrido ◽  
Jacobo José Brofman-Epelbaum ◽  
Fabiola Reveca Gómez-Velázquez ◽  
Sebastián Agustín Balart-Sánchez ◽  
Julieta Ramos-Loyo
Keyword(s):  
Working Memory ◽  
Cognitive Processing ◽  
Task Difficulty ◽  
Brain Activity ◽  
Reaction Times ◽  
Brain Potentials ◽  
Brain Functioning ◽  
Attentional Processes ◽  
Electrical Brain Activity ◽  
Skipping Breakfast

Abstract. It has been generally accepted that skipping breakfast adversely affects cognition, mainly disturbing the attentional processes. However, the effects of short-term fasting upon brain functioning are still unclear. We aimed to evaluate the effect of skipping breakfast on cognitive processing by studying the electrical brain activity of young healthy individuals while performing several working memory tasks. Accordingly, the behavioral results and event-related brain potentials (ERPs) of 20 healthy university students (10 males) were obtained and compared through analysis of variances (ANOVAs), during the performance of three n-back working memory (WM) tasks in two morning sessions on both normal (after breakfast) and 12-hour fasting conditions. Significantly fewer correct responses were achieved during fasting, mainly affecting the higher WM load task. In addition, there were prolonged reaction times with increased task difficulty, regardless of breakfast intake. ERP showed a significant voltage decrement for N200 and P300 during fasting, while the amplitude of P200 notably increased. The results suggest skipping breakfast disturbs earlier cognitive processing steps, particularly attention allocation, early decoding in working memory, and stimulus evaluation, and this effect increases with task difficulty.

Behavior in the Brain

2010 ◽  
Vol 24 (2) ◽  
pp. 76-82 ◽  
Author(s):  
Martin M. Monti ◽  
Adrian M. Owen
Keyword(s):  
Motor Behavior ◽  
Functional Neuroimaging ◽  
Brain Activity ◽  
Motor Output ◽  
The Unconscious ◽  
Ethical Implications ◽  
Brain Responses ◽  
Minimally Conscious ◽  
Brain Insults ◽  
Brain Behavior

Recent evidence has suggested that functional neuroimaging may play a crucial role in assessing residual cognition and awareness in brain injury survivors. In particular, brain insults that compromise the patient’s ability to produce motor output may render standard clinical testing ineffective. Indeed, if patients were aware but unable to signal so via motor behavior, they would be impossible to distinguish, at the bedside, from vegetative patients. Considering the alarming rate with which minimally conscious patients are misdiagnosed as vegetative, and the severe medical, legal, and ethical implications of such decisions, novel tools are urgently required to complement current clinical-assessment protocols. Functional neuroimaging may be particularly suited to this aim by providing a window on brain function without requiring patients to produce any motor output. Specifically, the possibility of detecting signs of willful behavior by directly observing brain activity (i.e., “brain behavior”), rather than motoric output, allows this approach to reach beyond what is observable at the bedside with standard clinical assessments. In addition, several neuroimaging studies have already highlighted neuroimaging protocols that can distinguish automatic brain responses from willful brain activity, making it possible to employ willful brain activations as an index of awareness. Certainly, neuroimaging in patient populations faces some theoretical and experimental difficulties, but willful, task-dependent, brain activation may be the only way to discriminate the conscious, but immobile, patient from the unconscious one.

scholarly journals Neural alignment predicts learning outcomes in students taking an introduction to computer science course

2021 ◽  
Vol 12 (1) ◽  
Author(s):  
Meir Meshulam ◽  
Liat Hasenfratz ◽  
Hanna Hillman ◽  
Yun-Fei Liu ◽  
Mai Nguyen ◽  
...  
Keyword(s):  
Computer Science ◽  
Learning Outcomes ◽  
Brain Activity ◽  
Activity Patterns ◽  
Real Life ◽  
Final Exam ◽  
Neural Representations ◽  
Real Life Setting ◽  
The Right ◽  
Mri Study

AbstractDespite major advances in measuring human brain activity during and after educational experiences, it is unclear how learners internalize new content, especially in real-life and online settings. In this work, we introduce a neural approach to predicting and assessing learning outcomes in a real-life setting. Our approach hinges on the idea that successful learning involves forming the right set of neural representations, which are captured in canonical activity patterns shared across individuals. Specifically, we hypothesized that learning is mirrored in neural alignment: the degree to which an individual learner’s neural representations match those of experts, as well as those of other learners. We tested this hypothesis in a longitudinal functional MRI study that regularly scanned college students enrolled in an introduction to computer science course. We additionally scanned graduate student experts in computer science. We show that alignment among students successfully predicts overall performance in a final exam. Furthermore, within individual students, we find better learning outcomes for concepts that evoke better alignment with experts and with other students, revealing neural patterns associated with specific learned concepts in individuals.

Sign in / Sign up

Export Citation Format

Share Document