scholarly journals Subgoal- and Goal-Related Prediction Errors in Medial Prefrontal Cortex

2018 ◽  
Author(s):  
José J. F. Ribas Fernandes ◽  
Danesh Shahnazian ◽  
Clay B. Holroyd ◽  
Matthew M. Botvinick

AbstractA longstanding view of the organization of human and animal behavior holds that behavior is hierarchically organized, meaning that it can be understood as directed towards achieving superordinate goals through subordinate goals, or subgoals. For example, the superordinate goal of making coffee can be broken down as accomplishing a series of subgoals, namely boiling water, grinding coffee, pouring cream, etc.Learning and behavioral adaptation depend on prediction-error signals, which have been observed in ventral striatum (VS) and medial prefrontal cortex (mPFC). In past work, we have shown that prediction error signals (PEs) can be linked not only to superordinate goals, but also to subgoals.Here we present two functional magnetic resonance imagining experiments that replicate and extend these findings. In the first experiment, we replicated the finding that mPFC signals subgoal-related PEs, independently of goal PEs. Together with our past work, this experiment reveals that BOLD responses to PEs in mPFC are unsigned. In the second experiment, we showed that when a task involves both goal and subgoal PEs, mPFC shows only goal-related PEs, suggesting that context or attention can strongly impact hierarchical PE coding. Furthermore, we observed a dissociation between the coding of PEs in mPFC and VS. These experiments suggest that the mPFC selectively attends to information at different levels of hierarchy depending on the task context.

2019 ◽  
Vol 31 (1) ◽  
pp. 8-23 ◽  
Author(s):  
José J. F. Ribas-Fernandes ◽  
Danesh Shahnazian ◽  
Clay B. Holroyd ◽  
Matthew M. Botvinick

A longstanding view of the organization of human and animal behavior holds that behavior is hierarchically organized—in other words, directed toward achieving superordinate goals through the achievement of subordinate goals or subgoals. However, most research in neuroscience has focused on tasks without hierarchical structure. In past work, we have shown that negative reward prediction error (RPE) signals in medial prefrontal cortex (mPFC) can be linked not only to superordinate goals but also to subgoals. This suggests that mPFC tracks impediments in the progression toward subgoals. Using fMRI of human participants engaged in a hierarchical navigation task, here we found that mPFC also processes positive prediction errors at the level of subgoals, indicating that this brain region is sensitive to advances in subgoal completion. However, when subgoal RPEs were elicited alongside with goal-related RPEs, mPFC responses reflected only the goal-related RPEs. These findings suggest that information from different levels of hierarchy is processed selectively, depending on the task context.


2017 ◽  
Vol 29 (4) ◽  
pp. 718-727 ◽  
Author(s):  
Sara Garofalo ◽  
Christopher Timmermann ◽  
Simone Battaglia ◽  
Martin E. Maier ◽  
Giuseppe di Pellegrino

The medial prefrontal cortex (mPFC) and ACC have been consistently implicated in learning predictions of future outcomes and signaling prediction errors (i.e., unexpected deviations from such predictions). A computational model of ACC/mPFC posits that these prediction errors should be modulated by outcomes occurring at unexpected times, even if the outcomes themselves are predicted. However, unexpectedness per se is not the only variable that modulates ACC/mPFC activity, as studies reported its sensitivity to the salience of outcomes. In this study, mediofrontal negativity, a component of the event-related brain potential generated in ACC/mPFC and coding for prediction errors, was measured in 48 participants performing a Pavlovian aversive conditioning task, during which aversive (thus salient) and neutral outcomes were unexpectedly shifted (i.e., anticipated or delayed) in time. Mediofrontal ERP signals of prediction error were observed for outcomes occurring at unexpected times but were specific for salient (shock-associated), as compared with neutral, outcomes. These findings have important implications for the theoretical accounts of ACC/mPFC and suggest a critical role of timing and salience information in prediction error signaling.


2018 ◽  
Author(s):  
Mariann Oemisch ◽  
Stephanie Westendorff ◽  
Marzyeh Azimi ◽  
Seyed Ali Hassani ◽  
Salva Ardid ◽  
...  

SummaryPrediction errors signal unexpected outcomes indicating that expectations need to be adjusted. For adjusting expectations efficiently prediction errors need to be associated with the precise features that gave rise to the unexpected outcome. For many visual tasks this credit assignment proceeds in a multidimensional feature space that makes it ambiguous which object defining features are relevant. Here, we report of a potential solution by showing that neurons in all areas of the medial and lateral fronto-striatal networks encode prediction errors that are specific to separate features of attended multidimensional stimuli, with the most ubiquitous prediction error occurring for the reward relevant features. These feature specific prediction error signals (1) are different from a non-specific prediction error signal, (2) arise earliest in the anterior cingulate cortex and later in lateral prefrontal cortex, caudate and ventral striatum, and (3) contribute to feature-based stimulus selection after learning. These findings provide strong evidence for a widely-distributed feature-based eligibility trace that can be used to update synaptic weights for improved feature-based attention.HighlightsNeural reward prediction errors carry information for updating feature-based attention in all areas of the fronto-striatal network.Feature specific neural prediction errors emerge earliest in anterior cingulate cortex and later in lateral prefrontal cortex.Ventral striatum neurons encode feature specific surprise strongest for the goal-relevant feature.Neurons encoding feature-specific prediction errors contribute to attentional selection after learning.


2008 ◽  
Vol 213 (1-2) ◽  
pp. 183-195 ◽  
Author(s):  
Pornnarin Taepavarapruk ◽  
John G. Howland ◽  
Soyon Ahn ◽  
Anthony G. Phillips

1995 ◽  
Vol 72 (1-2) ◽  
pp. 103-114 ◽  
Author(s):  
Peter Hertel ◽  
Jan M. Mathé ◽  
George G. Nomikos ◽  
Marina Iurlo ◽  
Aleksander A. Mathé ◽  
...  

2020 ◽  
Vol 46 (6) ◽  
pp. 1535-1546
Author(s):  
Teresa Katthagen ◽  
Jakob Kaminski ◽  
Andreas Heinz ◽  
Ralph Buchert ◽  
Florian Schlagenhauf

Abstract Increased striatal dopamine synthesis capacity has consistently been reported in patients with schizophrenia. However, the mechanism translating this into behavior and symptoms remains unclear. It has been proposed that heightened striatal dopamine may blunt dopaminergic reward prediction error signaling during reinforcement learning. In this study, we investigated striatal dopamine synthesis capacity, reward prediction errors, and their association in unmedicated schizophrenia patients (n = 19) and healthy controls (n = 23). They took part in FDOPA-PET and underwent functional magnetic resonance imaging (fMRI) scanning, where they performed a reversal-learning paradigm. The groups were compared regarding dopamine synthesis capacity (Kicer), fMRI neural prediction error signals, and the correlation of both. Patients did not differ from controls with respect to striatal Kicer. Taking into account, comorbid alcohol abuse revealed that patients without such abuse showed elevated Kicer in the associative striatum, while those with abuse did not differ from controls. Comparing all patients to controls, patients performed worse during reversal learning and displayed reduced prediction error signaling in the ventral striatum. In controls, Kicer in the limbic striatum correlated with higher reward prediction error signaling, while there was no significant association in patients. Kicer in the associative striatum correlated with higher positive symptoms and blunted reward prediction error signaling was associated with negative symptoms. Our results suggest a dissociation between striatal subregions and symptom domains, with elevated dopamine synthesis capacity in the associative striatum contributing to positive symptoms while blunted prediction error signaling in the ventral striatum related to negative symptoms.


2008 ◽  
Vol 54 (1) ◽  
pp. 108-116 ◽  
Author(s):  
David J. Rademacher ◽  
Sarah E. Meier ◽  
Leyu Shi ◽  
W.-S. Vanessa Ho ◽  
Abbas Jarrahian ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document