scholarly journals Decoding semantic predictions from EEG prior to word onset

2018 ◽  
Author(s):  
Edvard Heikel ◽  
Jona Sassenhagen ◽  
Christian J. Fiebach

ABSTRACTThe outstanding speed of language comprehension necessitates a highly efficient implementation of cognitive-linguistic processes. The domain-general theory of Predictive Coding suggests that our brain solves this problem by continuously forming linguistic predictions about expected upcoming input. The neurophysiological implementation of these predictive linguistic processes, however, is not yet understood. Here, we use EEG (human participants, both sexes) to investigate the existence and nature of online-generated, category-level semantic representations during sentence processing. We conducted two experiments in which some nouns – embedded in a predictive spoken sentence context – were unexpectedly delayed by 1 second. Target nouns were either abstract/concrete (Experiment 1) or animate/inanimate (Experiment 2). We hypothesized that if neural prediction error signals following (temporary) omissions carry specific information about the stimulus, the semantic category of the upcoming target word is encoded in brain activity prior to its presentation. Using time-generalized multivariate pattern analysis, we demonstrate significant decoding of word category from silent periods directly preceding the target word, in both experiments. This provides direct evidence for predictive coding during sentence processing, i.e., that information about a word can be encoded in brain activity before it is perceived. While the same semantic contrast could also be decoded from EEG activity elicited by isolated words (Experiment 1), the identified neural patterns did not generalize to pre-stimulus delay period activity in sentences. Our results not only indicate that the brain processes language predictively, but also demonstrate the nature and sentence-specificity of category-level semantic predictions preactivated during sentence comprehension.STATEMENT OF SIGNIFICANCEThe speed of language comprehension necessitates a highly efficient implementation of cognitive-linguistic processes. Predictive processing has been suggested as a solution to this problem, but the underlying neural mechanisms and linguistic content of such predictions are only poorly understood. Inspired by Predictive Coding theory, we investigate whether the meaning of expected, but not-yet heard words can be decoded from brain activity. Using EEG, we can predict if a word is, e.g., abstract (as opposed to concrete), or animate (vs. inanimate), from brain signals preceding the word itself. This strengthens predictive coding theory as a likely candidate for the principled neural mechanisms underlying online processing of language and indicates that predictive processing applies to highly abstract categories like semantics.

2021 ◽  
Vol 15 ◽  
Author(s):  
Kentaro Ono ◽  
Junya Hashimoto ◽  
Ryosuke Hiramoto ◽  
Takafumi Sasaoka ◽  
Shigeto Yamawaki

Prediction is essential for the efficiency of many cognitive processes; however, this process is not always perfect. Predictive coding theory suggests that the brain generates and updates a prediction to respond to an upcoming event. Although an electrophysiological index of prediction, the stimulus preceding negativity (SPN), has been reported, it remains unknown whether the SPN reflects the prediction accuracy, or whether it is associated with the prediction error, which corresponds to a mismatch between a prediction and an actual input. Thus, the present study aimed to investigate this question using electroencephalography (EEG). Participants were asked to predict the original pictures from pictures that had undergone different levels of pixelation. The SPN amplitude was affected by the level of pixelation and correlated with the subjective evaluation of the prediction accuracy. Furthermore, late positive components (LPC) were negatively correlated with SPN. These results suggest that the amplitude of SPN reflects the prediction accuracy; more accurate prediction increases the SPN and reduces the prediction error, resulting in reduced LPC amplitudes.


2018 ◽  
Author(s):  
K. Weber ◽  
C. Micheli ◽  
E. Ruigendijk ◽  
J.W. Rieger

AbstractWords are not processed in isolation but in rich contexts that are used to modulate and facilitate language comprehension. Here, we investigate distinct neural networks underlying two types of contexts. Firstly, the current linguistic environment, presented as the relative frequencies of two syntactic structures (prepositional object (PO) and double-object (DO)), which would either follow everyday linguistic experience or not. Secondly, preference towards one or the other structure depending on the verb; learned in everyday language use and stored in memory. German participants were reading PO and DO sentences in German while brain activity was measured with functional magnetic resonance imaging. Firstly, the anterior cingulate cortex (ACC) showed a pattern of activation that integrated the current linguistic environment with everyday linguistic experience. When the input did not match everyday experience, the unexpectedly frequent structure showed higher activation in the ACC than the other conditions and more connectivity from the ACC to posterior parts of the language network. Secondly, verb-based surprisal of seeing a structure given a verb (PO verb preference but DO structure presentation) resulted, within the language network (left inferior frontal and left middle/superior temporal gyrus) and the precuneus, in increased activation compared to a predictable situation. In conclusion, 1) beyond the canonical language network, brain areas engaged in cognitive control, such as the ACC, might use the statistics of syntactic structures to facilitate language comprehension, 2) the language network is directly engaged in processing verb preferences. These two networks show distinct influences on sentence processing.


2020 ◽  
Vol 43 ◽  
Author(s):  
Martina G. Vilas ◽  
Lucia Melloni

Abstract To become a unifying theory of brain function, predictive processing (PP) must accommodate its rich representational diversity. Gilead et al. claim such diversity requires a multi-process theory, and thus is out of reach for PP, which postulates a universal canonical computation. We contend this argument and instead propose that PP fails to account for the experiential level of representations.


2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Betina Korka ◽  
Erich Schröger ◽  
Andreas Widmann

AbstractOur brains continuously build and update predictive models of the world, sources of prediction being drawn for example from sensory regularities and/or our own actions. Yet, recent results in the auditory system indicate that stochastic regularities may not be easily encoded when a rare medium pitch deviant is presented between frequent high and low pitch standard sounds in random order, as reflected in the lack of sensory prediction error event-related potentials [i.e., mismatch negativity (MMN)]. We wanted to test the implication of the predictive coding theory that predictions based on higher-order generative models—here, based on action intention, are fed top-down in the hierarchy to sensory levels. Participants produced random sequences of high and low pitch sounds by button presses in two conditions: In a “specific” condition, one button produced high and the other low pitch sounds; in an “unspecific” condition, both buttons randomly produced high or low-pitch sounds. Rare medium pitch deviants elicited larger MMN and N2 responses in the “specific” compared to the “unspecific” condition, despite equal sound probabilities. These results thus demonstrate that action-effect predictions can boost stochastic regularity-based predictions and engage higher-order deviance detection processes, extending previous notions on the role of action predictions at sensory levels.


Author(s):  
Yiwen Wang ◽  
Yuxiao Lin ◽  
Chao Fu ◽  
Zhihua Huang ◽  
Rongjun Yu ◽  
...  

Abstract The desire for retaliation is a common response across a majority of human societies. However, the neural mechanisms underlying aggression and retaliation remain unclear. Previous studies on social intentions are confounded by low-level response related brain activity. Using an EEG-based brain-computer interface (BCI) combined with the Chicken Game, our study examined the neural dynamics of aggression and retaliation after controlling for nonessential response related neural signals. Our results show that aggression is associated with reduced alpha event-related desynchronization (ERD), indicating reduced mental effort. Moreover, retaliation and tit-for-tat strategy use are also linked with smaller alpha-ERD. Our study provides a novel method to minimize motor confounds and demonstrates that choosing aggression and retaliation is less effortful in social conflicts.


2017 ◽  
Vol 20 (4) ◽  
pp. 712-721 ◽  
Author(s):  
IAN CUNNINGS

The primary aim of my target article was to demonstrate how careful consideration of the working memory operations that underlie successful language comprehension is crucial to our understanding of the similarities and differences between native (L1) and non-native (L2) sentence processing. My central claims were that highly proficient L2 speakers construct similarly specified syntactic parses as L1 speakers, and that differences between L1 and L2 processing can be characterised in terms of L2 speakers being more prone to interference during memory retrieval operations. In explaining L1/L2 differences in this way, I argued a primary source of differences between L1 and L2 processing lies in how different populations of speakers weight cues that guide memory retrieval.


2010 ◽  
Vol 21 (7) ◽  
pp. 931-937 ◽  
Author(s):  
C. Nathan DeWall ◽  
Geoff MacDonald ◽  
Gregory D. Webster ◽  
Carrie L. Masten ◽  
Roy F. Baumeister ◽  
...  

Pain, whether caused by physical injury or social rejection, is an inevitable part of life. These two types of pain—physical and social—may rely on some of the same behavioral and neural mechanisms that register pain-related affect. To the extent that these pain processes overlap, acetaminophen, a physical pain suppressant that acts through central (rather than peripheral) neural mechanisms, may also reduce behavioral and neural responses to social rejection. In two experiments, participants took acetaminophen or placebo daily for 3 weeks. Doses of acetaminophen reduced reports of social pain on a daily basis (Experiment 1). We used functional magnetic resonance imaging to measure participants’ brain activity (Experiment 2), and found that acetaminophen reduced neural responses to social rejection in brain regions previously associated with distress caused by social pain and the affective component of physical pain (dorsal anterior cingulate cortex, anterior insula). Thus, acetaminophen reduces behavioral and neural responses associated with the pain of social rejection, demonstrating substantial overlap between social and physical pain.


2005 ◽  
Vol 17 (10) ◽  
pp. 1667-1678 ◽  
Author(s):  
Regine Oberecker ◽  
Manuela Friedrich ◽  
Angela D. Friederici

Event-related brain potential (ERP) studies of sentence processing in adults have shown that phrase-structure violations are associated with two ERP components: an early left anterior negativity (ELAN) and a late, centro-parietal positivity (P600). Although the ELAN reflects highly automatic first-pass sentence parsing, the P600 has been interpreted to reflect later, more controlled processes. The present ERP study investigates the processing of phrase-structure violations in children below three years of age. Both children (mean age of 2.8 years) and adults passively listened to short active sentences that were either correct or syntactically incorrect. Adults displayed an ELAN that was followed by a P600 to the syntactic violation. Children also demonstrated a biphasic ERP pattern consisting of an early left hemispheric negativity and a late positivity. Both components, however, started later and persisted longer than those observed in adults. The left lateralization of the children's negativity suggests that this component can be interpreted as a child-specific precursor to the ELAN observed in adults. The appearance of the early negativity indicates that the neural mechanisms of syntactic parsing are present, in principle, during early language development.


2022 ◽  
Vol 8 (1) ◽  
pp. 235-256
Author(s):  
Holger Hopp

Second language (L2) sentence processing research studies how adult L2 learners understand sentences in real time. I review how L2 sentence processing differs from monolingual first-language (L1) processing and outline major findings and approaches. Three interacting factors appear to mandate L1–L2 differences: ( a) capacity restrictions in the ability to integrate information in an L2; ( b) L1–L2 differences in the weighting of cues, the timing of their application, and the efficiency of their retrieval; and ( c) variation in the utility functions of predictive processing. Against this backdrop, I outline a novel paradigm of interlanguage processing, which examines bilingual features of L2 processing, such as bilingual language systems, nonselective access to all grammars, and processing to learn an L2. Interlanguage processing goes beyond the traditional framing of L2 sentence processing as an incomplete form of monolingual processing and reconnects the field with current approaches to grammar acquisition and the bilingual mental lexicon.


Sign in / Sign up

Export Citation Format

Share Document