Using TD learning to simulate working memory performance in a model of the prefrontal cortex and basal ganglia

2007 ◽  
Vol 8 (4) ◽  
pp. 262-281 ◽  
Author(s):  
Ahmed A. Moustafa ◽  
Anthony S. Maida
2000 ◽  
Vol 48 (2) ◽  
pp. 99-109 ◽  
Author(s):  
Dara S Manoach ◽  
Randy L Gollub ◽  
Etienne S Benson ◽  
Meghan M Searl ◽  
Donald C Goff ◽  
...  

Author(s):  
Veronica Claire Galvin ◽  
ShengTao Yang ◽  
Constantinos D. Paspalas ◽  
Yang Yang ◽  
Lu E. Jin ◽  
...  

Author(s):  
Ryan McKendrick ◽  
Ranjana Mehta ◽  
Hasan Ayaz ◽  
Melissa Scheldrup ◽  
Raja Parasuraman

Objective: The aim of this study was to assess performance and cognitive states during cognitive work in the presence of physical work and in natural settings. Background: Authors of previous studies have examined the interaction between cognitive and physical work, finding performance decrements in working memory. Neuroimaging has revealed increases and decreases in prefrontal oxygenated hemoglobin during the interaction of cognitive and physical work. The effect of environment on cognitive-physical dual tasking has not been previously considered. Method: Thirteen participants were monitored with wireless functional near-infrared spectroscopy (fNIRS) as they performed an auditory 1-back task while sitting, walking indoors, and walking outdoors. Results: Relative to sitting and walking indoors, auditory working memory performance declined when participants were walking outdoors. Sitting during the auditory 1-back task increased oxygenated hemoglobin and decreased deoxygenated hemoglobin in bilateral prefrontal cortex. Walking reduced the total hemoglobin available to bilateral prefrontal cortex. An increase in environmental complexity reduced oxygenated hemoglobin and increased deoxygenated hemoglobin in bilateral prefrontal cortex. Conclusion: Wireless fNIRS is capable of monitoring cognitive states in naturalistic environments. Selective attention and physical work compete with executive processing. During executive processing loading of selective attention and physical work results in deactivation of bilateral prefrontal cortex and degraded working memory performance, indicating that physical work and concomitant selective attention may supersede executive processing in the distribution of mental resources. Application: This research informs decision-making procedures in work where working memory, physical activity, and attention interact. Where working memory is paramount, precautions should be taken to eliminate competition from physical work and selective attention.


Neuron ◽  
2020 ◽  
Vol 106 (4) ◽  
pp. 649-661.e4 ◽  
Author(s):  
Veronica C. Galvin ◽  
Sheng Tao Yang ◽  
Constantinos D. Paspalas ◽  
Yang Yang ◽  
Lu E. Jin ◽  
...  

2006 ◽  
Vol 18 (2) ◽  
pp. 283-328 ◽  
Author(s):  
Randall C. O'Reilly ◽  
Michael J. Frank

The prefrontal cortex has long been thought to subserve both working memory (the holding of information online for processing) and executive functions (deciding how to manipulate working memory and perform processing). Although many computational models of working memory have been developed, the mechanistic basis of executive function remains elusive, often amounting to a homunculus. This article presents an attempt to deconstruct this homunculus through powerful learning mechanisms that allow a computational model of the prefrontal cortex to control both itself and other brain areas in a strategic, task-appropriate manner. These learning mechanisms are based on subcortical structures in the midbrain, basal ganglia, and amygdala, which together form an actor-critic architecture. The critic system learns which prefrontal representations are task relevant and trains the actor, which in turn provides a dynamic gating mechanism for controlling working memory updating. Computationally, the learning mechanism is designed to simultaneously solve the temporal and structural credit assignment problems. The model's performance compares favorably with standard backpropagation-based temporal learning mechanisms on the challenging 1-2-AX working memory task and other benchmark working memory tasks.


Sign in / Sign up

Export Citation Format

Share Document