Lateral Preoptic Area Neurons Signal Cocaine Self-Administration Behaviors

The lateral preoptic area is implicated in numerous aspects of substance use disorder. In particular, the lateral preoptic area is highly sensitive to the pharmacological properties of psychomotor stimulants, and its activity promotes drug-seeking in the face of punishment and reinstatement during abstinence. Despite the lateral preoptic areas complicity in substance use disorder, how precisely lateral preoptic area neurons encode the individual components of drug self-administration has not been ascertained. To bridge this gap, we examined how the firing of single lateral preoptic area neurons correlates with three discrete elements of cocaine self-administration: 1) drug-seeking (pre-response), 2) drug-taking (response), and 3) receipt of the cocaine infusion. A significant subset of lateral preoptic area neurons responded to each component with a mix of increases and decreases in firing-rate. A majority of these neurons encoded the operant response with increases in spiking, though responses during the drug-seeking, taking, and reciept windows were highly correlated.

Associative processes in addiction relapse models: A review of their Pavlovian and instrumental mechanisms, history, and terminology

Animal models of relapse to drug-seeking have borrowed heavily from associative learning approaches. In studies of relapse-like behaviour, animals learn to self-administer drugs then receive a period of extinction during which they learn to inhibit the operant response. Several triggers can produce a recovery of responding which form the basis of a variety of models. These include the passage of time (spontaneous recovery), drug availability (rapid reacquisition), extinction of an alternative response (resurgence), context change (renewal), drug priming, stress, and cues (reinstatement). In most cases, the behavioural processes driving extinction and recovery in operant drug self-administration studies are similar to those in the Pavlovian and behavioural literature, such as context effects. However, reinstatement in addiction studies have several differences with Pavlovian reinstatement, which have emerged over several decades, in experimental procedures, associative mechanisms, and terminology. Interestingly, in cue-induced reinstatement, drug-paired cues that are present during acquisition are omitted during lever extinction. The unextinguished drug-paired cue may limit the model’s translational relevance to cue exposure therapy and renders its underlying associative mechanisms ambiguous. We review major behavioural theories that explain recovery phenomena, with a particular focus on cue-induced reinstatement because it is a widely used model in addiction. We argue that cue-induced reinstatement may be explained by a combination of behavioural processes, including reacquisition of conditioned reinforcement and Pavlovian to Instrumental Transfer. While there are important differences between addiction studies and the behavioural literature in terminology and procedures, it is clear that understanding associative learning processes is essential for studying relapse.

Associative processes in addiction relapse models: A review of their Pavlovian and instrumental mechanisms, history, and terminology

Animal models of relapse to drug-seeking have borrowed heavily from associative learning approaches. In studies of relapse-like behaviour, animals learn to self-administer drugs then receive a period of extinction during which they learn to inhibit the operant response. Several triggers can produce a recovery of responding which form the basis of a variety of models. These include the passage of time (spontaneous recovery), drug availability (rapid reacquisition), extinction of an alternative response (resurgence), context change (renewal), drug priming, stress, and cues (reinstatement). In most cases, the behavioural processes driving extinction and recovery in operant drug self-administration studies are similar to those in the Pavlovian and behavioural literature, such as context effects. However, reinstatement in addiction studies have several differences with Pavlovian reinstatement, which have emerged over several decades, in experimental procedures, associative mechanisms, and terminology. Interestingly, in cue-induced reinstatement, drug-paired cues that are present during acquisition are omitted during lever extinction. The unextinguished drug-paired cue may limit the model’s translational relevance to cue exposure therapy and renders its underlying associative mechanisms ambiguous. We review major behavioural theories that explain recovery phenomena, with a particular focus on cue-induced reinstatement because it is a widely used model in addiction. We argue that cue-induced reinstatement may be explained by a combination of behavioural processes, including reacquisition of conditioned reinforcement and Pavlovian to Instrumental Transfer. While there are important differences between addiction studies and the behavioural literature in terminology and procedures, it is clear that understanding associative learning processes is essential for studying relapse.

Whole brain dynamics during optogenetic self-stimulation of the medial prefrontal cortex in mice

Intracranial self-stimulation, in which an animal performs an operant response to receive regional brain electrical stimulation, is a widely used procedure to study motivated behavior. While local neuronal activity has long been measured immediately before or after the operant, imaging the whole brain in real-time remains a challenge. Herein we report a method that permits functional MRI (fMRI) of brain dynamics while mice are cued to perform an operant task: licking a spout to receive optogenetic stimulation to the medial prefrontal cortex (MPFC) during a cue ON, but not cue OFF. Licking during cue ON results in activation of a widely distributed network consistent with underlying MPFC projections, while licking during cue OFF (without optogenetic stimulation) leads to negative fMRI signal in brain regions involved in acute extinction. Noninvasive whole brain readout combined with circuit-specific neuromodulation opens an avenue for investigating adaptive behavior in both healthy and disease models.

An open source platform for presenting dynamic visual stimuli

Operant behavior procedures often rely on visual stimuli to cue the initiation or secession of a response, and to provide a means for discriminating between two or more simultaneously available responses. While primate and human studies typically use LCD or OLED monitors and touch screens, rodent studies use a variety of methods to present visual cues ranging from traditional incandescent light bulbs, single LEDs, and, more recently, touch screen monitors. Commercially available systems for visual stimulus presentation are costly, challenging to customize, and are typically closed source. We developed an open-source, highly-modifiable visual stimulus presentation platform that can be combined with a 3D-printed operant response device. The device uses an eight by eight matrix of LEDs, and can be expanded to control much larger LED matrices. Implementing the platform is low-cost (<$70 USD per device in the year 2020). Using the platform, we trained rats to make nosepoke responses and discriminate between two distinct visual cues in a location-independent manner. This visual stimulus presentation platform is a cost-effective way to implement complex visually-guided operant behavior, including the use of moving or dynamically changing visual stimuli.Significance StatementThe design of an open source and low cost device for presenting visual stimuli is described. It is capable of presenting complex visual patterns and dynamically changing stimuli. A practical demonstration of the device is also reported, from an experiment in which rats performed a luminance based visual discrimination. The device has utility for studying visual processing, psychophysics, and decision making in a variety of species.

The Near-Miss Effect in Slot Machines: A Review and Experimental Analysis Over Half a Century Later

In games of chance, a near miss is said to occur when feedback for a loss approximates a win. For instance, obtaining “cherry–cherry–lemon” on a slot machine could be considered a near miss. Sixty-six years ago, B.F. Skinner first proposed the idea that near-miss events might reinforce continued play in slot machines, and despite some inconsistencies in the experimental literature, belief in this “near-miss effect” has remained strong. In the present manuscript, we will review this literature and present experimental assessments of the near-miss effect on the frequency of the gambling response. Experiment 1 used a tightly controlled resistance-to-extinction procedure in pigeons to evaluate the putative reinforcing effect of near misses relative to a control “far-miss” reel pattern. Experiment 2 extended Experiment 1’s procedure to human participants. The results of both experiments failed to support the near-miss effect hypothesis. Experiment 3 used a further simplified procedure to assess the validity of the resistance-to-extinction paradigm when a probable conditional reinforcer was present on the reel stimuli. Although a clear conditional response was obtained from the reel, subsequent testing in extinction revealed no conditionally reinforcing function of this stimulus on operant response frequency.

Valence and Intensity of Video Stimuli of Dogs and Conspecifics in Sheep: Approach-Avoidance, Operant Response, and Attention

Stimuli are often presumed to be either negative or positive. However, animals’ judgement of their negativity or positivity cannot generally be assumed. A possibility to assess emotional states in animals elicited by stimuli is to investigate animal preferences and their motivation to gain access to these stimuli. This study’s aim was to assess the valence of social stimuli in sheep. We used silent videos of varying intensity of dogs as negative versus conspecifics as positive stimuli in three approaches: (1) an approach–avoidance paradigm; (2) operant conditioning using the video stimuli as reinforcers; and (3) an attention test. In the latter, we assessed differential attention of sheep to simultaneous projections by automatically tracking sheep head and ear postures and recording brain activity. With these approaches, it was difficult to support that the sheep’s reactions varied according to the stimuli’s presumed valence and intensity. The approach–avoidance paradigm and attention test did not support the assumption that dog videos were more negative than sheep videos, though sheep reacted to the stimuli presented. Results from the operant conditioning indicated that sheep were more prone to avoid videos of moving dogs. Overall, we found that standard video images may not be ideal to represent valence characteristics of stimuli to sheep.