scholarly journals A Biologically Plausible Action Selection System for Cognitive Architectures: Implications of Basal Ganglia Anatomy for Learning and Decision-Making Models

2017 ◽  
Vol 42 (2) ◽  
pp. 457-490 ◽  
Author(s):  
Andrea Stocco
Keyword(s):  
Decision Making ◽  
Basal Ganglia ◽  
Action Selection ◽  
Selection System ◽  
Cognitive Architectures ◽  
Decision Making Models

Interaction between cognitive and motor cortico-basal ganglia loops during decision making: a computational study

2013 ◽  
Vol 109 (12) ◽  
pp. 3025-3040 ◽  
Author(s):  
M. Guthrie ◽  
A. Leblois ◽  
A. Garenne ◽  
T. Boraud
Keyword(s):  
Decision Making ◽  
Basal Ganglia ◽  
Computational Study ◽  
Selection Process ◽  
Action Selection ◽  
External Input ◽  
Projection Neurons ◽  
Cognitive Level ◽  
Striatal Projection Neurons ◽  
Previous Modeling Study

In a previous modeling study, Leblois et al. (2006) demonstrated an action selection mechanism in cortico-basal ganglia loops based on competition between the positive feedback, direct pathway through the striatum and the negative feedback, hyperdirect pathway through the subthalamic nucleus. The present study investigates how multiple level action selection could be performed by the basal ganglia. To do this, the model is extended in a manner consistent with known anatomy and electrophysiology in three main areas. First, two-level decision making has been incorporated, with a cognitive level selecting based on cue shape and a motor level selecting based on cue position. We show that the decision made at the cognitive level can be used to bias the decision at the motor level. We then demonstrate that, for accurate transmission of information between decision-making levels, low excitability of striatal projection neurons is necessary, a generally observed electrophysiological finding. Second, instead of providing a biasing signal between cue choices as an external input to the network, we show that the action selection process can be driven by reasonable levels of noise. Finally, we incorporate dopamine modulated learning at corticostriatal synapses. As learning progresses, the action selection becomes based on learned visual cue values and is not interfered with by the noise that was necessary before learning.

scholarly journals Tonic dopamine, uncertainty and basal ganglia action selection

2020 ◽  
Author(s):  
Tom Gilbertson ◽  
Douglas Steele
Keyword(s):  
Decision Making ◽  
Basal Ganglia ◽  
Neural Circuit ◽  
Optimal Solution ◽  
Action Selection ◽  
Selection Function ◽  
Cortical Input ◽  
Optimal Decisions ◽  
Multiple Alternative ◽  
The Relationship

AbstractTo make optimal decisions in uncertain circumstances flexible adaption of behaviour is required; exploring alternatives when the best choice is unknown, exploiting what is known when that is best. Using a detailed computational model of the basal ganglia, we propose that switches between exploratory and exploitative decisions can be mediated by the interaction between tonic dopamine and cortical input to the basal ganglia. We show that a biologically detailed action selection circuit model of the basal ganglia, endowed with dopamine dependant striatal plasticity, can optimally solve the explore-exploit problem, estimating the true underlying state of a noisy Gaussian diffusion process. Critical to the model’s performance was a fluctuating level of tonic dopamine which increased under conditions of uncertainty. With an optimal range of tonic dopamine, explore-exploit decision making was mediated by the effects of tonic dopamine on the precision of the model action selection mechanism. Under conditions of uncertain reward pay-out, the model’s reduced selectivity allowed disinhibition of multiple alternative actions to be explored at random. Conversely, when uncertainly about reward pay-out was low, enhanced selectivity of the action selection circuit was enhanced, facilitating exploitation of the high value choice. When integrated with phasic dopamine dependant influences on cortico-striatal plasticity, the model’s performance was at the level of the Kalman filter which provides an optimal solution for the task. Our model provides an integrative account of the relationship between phasic and tonic dopamine and the action selection function of the basal ganglia and supports the idea that this subcortical neural circuit may have evolved to facilitate decision making in non-stationary reward environments, allowing a number of experimental predictions with relevance to abnormal decision making in neuropsychiatric and neurological disease.

scholarly journals Is there a brainstem substrate for action selection?

2007 ◽  
Vol 362 (1485) ◽  
pp. 1627-1639 ◽  
Author(s):  
M.D Humphries ◽  
K Gurney ◽  
T.J Prescott
Keyword(s):  
Basal Ganglia ◽  
Hierarchical Control ◽  
Computational Modelling ◽  
Small World ◽  
Action Selection ◽  
Action Representation ◽  
Selection System ◽  
Neural Substrate ◽  
Main Component ◽  
Behavioural Repertoire

The search for the neural substrate of vertebrate action selection has focused on structures in the forebrain and midbrain, and particularly on the group of sub-cortical nuclei known as the basal ganglia. Yet, the behavioural repertoire of decerebrate and neonatal animals suggests the existence of a relatively self-contained neural substrate for action selection in the brainstem. We propose that the medial reticular formation (mRF) is the substrate's main component and review evidence showing that the mRF's inputs, outputs and intrinsic organization are consistent with the requirements of an action-selection system. The internal architecture of the mRF is composed of interconnected neuron clusters. We present an anatomical model which suggests that the mRF's intrinsic circuitry constitutes a small-world network and extend this result to show that it may have evolved to reduce axonal wiring. Potential configurations of action representation within the internal circuitry of the mRF are then assessed by computational modelling. We present new results demonstrating that each cluster's output is most likely to represent activation of a component action; thus, coactivation of a set of these clusters would lead to the coordinated behavioural response observed in the animal. Finally, we consider the potential integration of the basal ganglia and mRF substrates for selection and suggest that they may collectively form a layered/hierarchical control system.

scholarly journals Unilateral optogenetic inhibition and excitation of basal ganglia output show opposing effects on directional lick choices and movement initiation in mice

2018 ◽  
Author(s):  
Arthur E. Morrissette ◽  
Po-Han Chen ◽  
Conrad Bhamani ◽  
Peter Y. Borden ◽  
Christian Waiblinger ◽  
...  
Keyword(s):  
Decision Making ◽  
Basal Ganglia ◽  
Substantia Nigra ◽  
Feedback Loop ◽  
Premotor Cortex ◽  
Sensory Information ◽  
Action Selection ◽  
Direct Test ◽  
Movement Initiation ◽  
Motor Thalamus

AbstractModels of basal ganglia function predict that tonic inhibitory output to motor thalamus suppresses unwanted movements, and that a decrease in such activity leads to action selection. A direct test of these outcomes of thalamic inhibition has not been performed, however. To conduct such a direct test, we utilized rapid optogenetic activation and inactivation of the GABAergic output of the substantia nigra pars reticulata (SNr) to motor thalamus in mice that were trained in a sensory cued left/right licking task. Directional licking tasks have previously been shown to depend on a thalamocortical feedback loop between ventromedial motor thalamus and antero-lateral premotor cortex (Li et al., 2015; Guo et al., 2017). In confirmation of model predictions, we found that 1s of unilateral optogenetic inhibition of GABAergic output from the SNr biased decision making towards the contralateral lick spout with ipsilaterally cued trials while leaving motor performance intact. In contrast, 1s of optogenetic excitation of SNr terminals in motor thalamus resulted in an opposite bias towards the ipsilateral direction confirming a bidirectional effect of tonic nigral output on directional decision making. In a second variant of the task we disallowed anticipatory licking and found that successful suppression of anticipatory licking was also impacted by our optogenetic manipulations in agreement with the suppressive effect of tonic nigral output. Nevertheless, direct unilateral excitation of SNr cell bodies resulted in bilateral movement suppression, suggesting that descending motor pathways from the SNr to superior colliculus also play an important role in the control of licking behavior.Significance StatementThis study provides the first evidence that basal ganglia output to motor thalamus can control decision making in left/right licking choices and suppress anticipatory movement initiation. Unilateral optogenetic inhibition or excitation of basal ganglia output via the substantia nigra resulted in opposite changes of directional lick choices and could override the sensory information on lick direction provided by a whisker stimulus. These results suggest that basal ganglia output gates activity in a thalamo-cortical feedback loop previously shown to underlie the control of forced choice directional licking behavior. The results substantiate models stating that tonic inhibition of motor thalamus from the basal ganglia directs action selection and suppresses unwanted movements.

Sistem Pendukung Keputusan SNMPTN Jalur Undangan Dengan Metode Electre

2018 ◽  
Vol 3 ◽  
pp. 14
Author(s):  
Lidia K Simanjuntak ◽  
Tessa Y M Sihite ◽  
Mesran Mesran ◽  
Nuning Kurniasih ◽  
Yuhandri Yuhandri
Keyword(s):  
Decision Making ◽  
Decision Support ◽  
Decision Support System ◽  
Support System ◽  
Action Selection ◽  
Multi Criteria Decision Making ◽  
Prospective Students ◽  
College Entrance ◽  
Electre Method ◽  
Selection Of

All colleges each year organize the selection of new admissions. Acceptance of prospective students in universities as education providers is done by selecting prospective students based on achievement in school and college entrance selection. To select the best student candidates based on predetermined criteria, then use Multi-Criteria Decision Making (MCDM) or commonly called decision support system. One method in MCDM is the Elimination Et Choix Traduisant la Reality (ELECTRE). The ELECTRE method is the best method of action selection. The ELECTRE method to obtain the best alternative by eliminating alternative that do not fit the criteria and can be applied to the decision SNMPTN invitation path.

Information support for expert evaluation of the states of the external environment

2020 ◽  
pp. 71-76
Author(s):  
Rasol Murtadha Najah
Keyword(s):  
Decision Making ◽  
Environmental Conditions ◽  
Fuzzy Inference ◽  
Environmental Parameters ◽  
Information Support ◽  
Expert Assessment ◽  
Fuzzy Variables ◽  
Decision Making Models ◽  
The Difference ◽  
State Of The Environment

This article discusses the application of methods to enhance the knowledge of experts to build a decision-making model based on the processing of physical data on the real state of the environment. Environmental parameters determine its ecological state. To carry out research in the field of expert assessment of environmental conditions, the analysis of known works in this field is carried out. The results of the analysis made it possible to justify the relevance of the application of analytical, stochastic models and models based on methods of enhancing the knowledge of experts — experts. It is concluded that the results of using analytical and stochastic objects are inaccurate, due to the complexity and poor mathematical description of the objects. The relevance of developing information support for an expert assessment of environmental conditions is substantiated. The difference of this article is that based on the analysis of the application of expert methods for assessing the state of the environment, a fuzzy logic adoption model and information support for assessing the environmental state of the environment are proposed. The formalization of the parameters of decision-making models using linguistic and fuzzy variables is considered. The formalization of parameters of decision-making models using linguistic and fuzzy variables was considered. The model’s description of fuzzy inference is given. The use of information support for environment state assessment is shown on the example of experts assessing of the land desertification stage.

Information technology support for integrated supply chain modeling

2008 ◽  
Vol 27 (1) ◽  
pp. 3-13
Author(s):  
Charu Chandra ◽  
Jānis Grabis
Keyword(s):  
Decision Making ◽  
Information Technology ◽  
Supply Chain ◽  
Process Modeling ◽  
Service Oriented Architecture ◽  
Model Development ◽  
Integrated Models ◽  
Supply Chain Modeling ◽  
Decision Making Models ◽  
Integrated Supply Chain

Multiple interrelated decision-making models are frequently used in supply chain modeling. Model integration is a precondition for efficient development and utilization of these models. This paper discusses use of modern information technology (IT) techniques and methods for integration of supply chain decision-making models. The overall approach to using IT at various stages of model development is presented. Data and process modeling techniques are used to developed semi-formalized representation of integrated models. These models support integration of decision-making components with other parts of supply chain information system. Process modeling is also used to describe interrelationships among multiple decision-making models. This representation is used as the basis for implementation of integrated models. The service-oriented architecture is proposed as an implementation platform. The presented discussion serves as the basis for further developments in developing integrated supply chain decision-making models.

Sign in / Sign up

Export Citation Format

Share Document