scholarly journals A Rescorla-Wagner Drift-Diffusion Model of Conditioning and Timing

2017 ◽  
Author(s):  
André Luzardo ◽  
Eduardo Alonso ◽  
Esther Mondragón

AbstractComputational models of classical conditioning have made significant contributions to the theoretic understanding of associative learning, yet they still struggle when the temporal aspects of conditioning are taken into account. Interval timing models have contributed a rich variety of time representations and provided accurate predictions for the timing of responses, but they usually have little to say about associative learning. In this article we present a unified model of conditioning and timing that is based on the influential Rescorla-Wagner conditioning model and the more recently developed Timing Drift-Diffusion model. We test the model by simulating 10 experimental phenomena and show that it can provide an adequate account for 8, and a partial account for the other 2. We argue that the model can account for more phenomena in the chosen set than these other similar in scope models: CSC-TD, MS-TD, Learning to Time and Modular Theory. A comparison and analysis of the mechanisms in these models is provided, with a focus on the types of time representation and associative learning rule used.Author SummaryHow does the time of events affect the way we learn about associations between these events? Computational models have made great contributions to our understanding of associative learning, but they usually do not perform very well when time is taken into account. Models of timing have reached high levels of accuracy in describing timed behaviour, but they usually do not have much to say about associations. A unified approach would involve combining associative learning and timing models into a single framework. This article takes just this approach. It combines the influential Rescorla-Wagner associative model with a timing model based on the Drift-Diffusion process, and shows how the resultant model can account for a number of learning and timing phenomena. The article also compares the new model to others that are similar in scope.

2013 ◽  
Vol 1 (2) ◽  
pp. 159-188 ◽  
Author(s):  
Patrick Simen ◽  
Francois Rivest ◽  
Elliot A. Ludvig ◽  
Fuat Balci ◽  
Peter Killeen

Pacemaker-accumulator (PA) systems have been the most popular kind of timing model in the half-century since their introduction by Treisman (1963). Many alternative timing models have been designed predicated on different assumptions, though the dominant PA model during this period — Gibbon and Church’s Scalar Expectancy Theory (SET) — invokes most of them. As in Treisman, SET’s implementation assumes a fixed-rate clock-pulse generator and encodes durations by storing average pulse counts; unlike Treisman’s model, SET’s decision process invokes Weber’s law of magnitude-comparison to account for timescale-invariant temporal precision in animal behavior. This is one way to deal with the ‘Poisson timing’ issue, in which relative temporal precision increases for longer durations, contrafactually, in a simplified version of Treisman’s model. First, we review the fact that this problem does not afflict Treisman’s model itself due to a key assumption not shared by SET. Second, we develop a contrasting PA model, an extension of Killeen and Fetterman’s Behavioral Theory of Timing that accumulates Poisson pulses up to a fixed criterion level, with pulse rates adapting to time different intervals. Like Treisman’s model, this time-adaptive, opponent Poisson, drift–diffusion model accounts for timescale invariance without first assuming Weber’s law. It also makes new predictions about response times and learning speed and connects interval timing to the popular drift–diffusion model of perceptual decision making. With at least three different routes to timescale invariance, the PA model family can provide a more compelling account of timed behavior than may be generally appreciated.


2015 ◽  
Vol 122 (2) ◽  
pp. 312-336 ◽  
Author(s):  
Brandon M. Turner ◽  
Leendert van Maanen ◽  
Birte U. Forstmann

2014 ◽  
Vol 116 (19) ◽  
pp. 194504 ◽  
Author(s):  
Matthew P. Lumb ◽  
Myles A. Steiner ◽  
John F. Geisz ◽  
Robert J. Walters

2022 ◽  
Vol 15 ◽  
Author(s):  
Ankur Gupta ◽  
Rohini Bansal ◽  
Hany Alashwal ◽  
Anil Safak Kacar ◽  
Fuat Balci ◽  
...  

Many studies on the drift-diffusion model (DDM) explain decision-making based on a unified analysis of both accuracy and response times. This review provides an in-depth account of the recent advances in DDM research which ground different DDM parameters on several brain areas, including the cortex and basal ganglia. Furthermore, we discuss the changes in DDM parameters due to structural and functional impairments in several clinical disorders, including Parkinson's disease, Attention Deficit Hyperactivity Disorder (ADHD), Autism Spectrum Disorders, Obsessive-Compulsive Disorder (OCD), and schizophrenia. This review thus uses DDM to provide a theoretical understanding of different brain disorders.


2018 ◽  
Vol 46 (8) ◽  
pp. 3031-3039 ◽  
Author(s):  
Shailendra Singh ◽  
Yuriy V. Serdyuk ◽  
Stanislaw M. Gubanski

Sign in / Sign up

Export Citation Format

Share Document