Neurons in dopamine-rich areas of the rat medial midbrain predominantly encode the outcome-related rather than behavioural switching properties of conditioned stimuli

Occasion setters determine responses of putative DA neurons to discriminative stimuli

Midbrain dopamine (DA) neurons are involved in the processing of rewards and reward-predicting stimuli, possibly analogous to reinforcement learning reward prediction errors. Here we studied the activity of putative DA neurons (n = 37) recorded in the ventral tegmental area of rats (n = 6) performing a behavioural task involving occasion setting. In this task an occasion setter (OS) indicated that the relationship between a discriminative stimulus (DS) and reinforcement is in effect, so that reinforcement of bar pressing occurred only after the OS (tone or houselight) was followed by the DS (houselight or tone). We found that responses of putative DA cells to the DS were enhanced when preceded by the OS, as were behavioural responses to obtain rewards. Surprisingly though, we did not find a homogeneous increase in the mean activity of the population of putative DA neurons to the OS, contrary to predictions of standard temporal-difference models of DA neurons. Instead, putative DA neurons exhibited a heterogeneous response on a single unit level, so that some units increased and others decreased their activity as a response to the OS. Similarly, putative non-DA cells did not show a homogeneous response to the DS on a population level, but also had heterogeneous responses on a single unit level. The heterogeneity in the responses of neurons in the ventral tegmental area may reflect how DA neurons encode context and point to local differences in DA signalling.

The role of DAT1 gene on the rapid detection of task novelty

In an environment with a myriad of different stimuli, the fast detection of novel and behaviorally relevant signals becomes crucial for an adaptive behavior. The detection of task-novelty has been related to striatum-prefrontal cortex (PFC) pathways involving dopaminergic (DA) neurotransmission. Here we thus tested the hypothesis that DA regulates the detection of task novelty through the modulation of the auditory N1 potential, an auditory potential peaking at 100 ms and previously shown to be modulated by the detection of sensory novelty. Thirty-five healthy volunteers were divided in two groups according to the presence or absence of the 9-repetition allele (9R) of the SLC6A3/DAT1 gene for the dopamine transporter. Participants performed a cued task-switching paradigm that dissociated the effects of exogenous sensory novelty from those of endogenous task novelty. Individuals with the 9R allele showed an amplitude enhancement of the auditory N1 elicited to sensory changes requiring a task-set reconfiguration as compared to sensory changes with no task novelty. In contrast, individuals without the 9R allele did not have their N1 waveform modulated by task novelty. The present results suggest that individuals homozygous for the 10-repeat allele fail to detect the behavioral relevance of new stimuli at early stages.

The effect of alcohol and nicotine abuse on gene expression in the brain

Alcohol intake at levels posing an acute heath risk is common amongst teenagers. Alcohol abuse is the second most common mental disorder worldwide. The incidence of smoking is decreasing in the Western world but increasing in developing countries and is the leading cause of preventable death worldwide. Considering the longstanding history of alcohol and tobacco consumption in human societies, it might be surprising that the molecular mechanisms underlying alcohol and smoking dependence are still incompletely understood. Effective treatments against the risk of relapse are lacking. Drugs of abuse exert their effect manipulating the dopaminergic mesocorticolimbic system. In this brain region, alcohol has many potential targets including membranes and several ion channels, while other drugs, for example nicotine, act via specific receptors or binding proteins. Repeated consumption of drugs of abuse mediates adaptive changes within this region, resulting in addiction. The high incidence of alcohol and nicotine co-abuse complicates analysis of the molecular basis of the disease. Gene expression profiling is a useful approach to explore novel drug targets in the brain. Several groups have utilised this technology to reveal drug-sensitive pathways in the mesocorticolimbic system of animal models and in human subjects. These studies are the focus of the present review.

How conditioned stimuli acquire the ability to activate VTA dopamine cells: a proposed neurobiological component of reward-related learning

The ability to learn about conditioned stimuli (CS) associated with rewards is a crucial adaptive mechanism. Activity in the mesocorticolimbic dopamine (DA) system, as well as in the ventral tegmental area (VTA), is correlated with responding to and learning about CSs. The mechanism by which VTA neurons become activated by signals associated with conditioned stimuli is not fully understood. Our model suggests that NMDA receptor stimulation in the VTA allows originally weak glutamate signals carrying information about environmental stimuli, coincident with strong excitation correlated with primary rewards, to be strengthened and thereby acquire the ability to activate VTA neurons in themselves, producing approach. Furthermore, once synaptic strengthening occurs, the model suggests that NMDA receptor stimulation in VTA is not necessary for the expression of reward-related learning. In this review we survey evidence that VTA cells respond to cues associated with primary rewards, that this responding is acquired, and that the VTA possesses the attributes to function as a site of integration of signals of primary and conditioned stimuli.

Dissociation of neural networks for anticipation and consumption of monetary and social rewards

Human behaviour is generally guided by the anticipation of potential outcomes that are considered to be rewarding. Reward processing can thus be dissected into a phase of reward anticipation and a phase of reward consumption. A number of brain structures have been suggested to be involved in reward processing. However, it is unclear whether anticipation and consumption are mediated by the same or different neural networks. We examined the neural basis of these processes using functional magnetic resonance imaging (fMRI) in an incentive delay task offering either money or social approval. In both conditions participants (N=28) were given a cue indicating potential reward. In order to receive reward a target button had to be pushed within a certain time window (adapted for individual reaction time). Cues triggering either monetary or social reward anticipation were presented sessionwise. Imaging was performed on a 1.5-Tesla Philips scanner in an event-related design. Anticipation of both reward types activated brain structures constituting the brain reward system including the ventral striatum. In contrast to the task independent activity in the anticipation phase, reward consumption evoked different patterns of activation for money and social approval, respectively. While social stimuli were mainly associated with amygdala activation, the thalamus was more strongly activated by the presentation of monetary rewards. Our results identify dissociable neural networks for the anticipation and consumption of reward. The findings implicate that the neural mechanisms underlying reward consumption are more modality-specific than those for reward anticipation, and that they are mediated by subjective reward value.

Beyond the Reward Pathway: Coding Reward Magnitude and Error in the Rat Subthalamic Nucleus

It was recently shown that subthalamic nucleus (STN) lesions affect motivation for food, cocaine, and alcohol, differentially, according to either the nature of the reward or the preference for it. The STN may thus code a reward according to its value. Here, we investigated how the firing of subthalamic neurons is modulated during expectation of a predicted reward between two possibilities (4 or 32% sucrose solution). The firing pattern of neurons responding to predictive cues and to reward delivery indicates that STN neurons can be divided into subpopulations responding specifically to one reward and less or giving no response to the other. In addition, some neurons (“oops” neurons) specifically encode errors as they respond only during error trials. These results reveal that the STN plays a critical role in ascertaining the value of the reward and seems to encode that value differently depending on the magnitude of the reward. These data highlight the importance of the STN in the reward circuitry of the brain.

Anticipation of monetary and social reward differently activates mesolimbic brain structures in men and women

Motivation for goal-directed behaviour largely depends on the expected value of the anticipated reward. The aim of the present study was to examine how different levels of reward value are coded in the brain for two common forms of human reward: money and social approval. To account for gender differences 16 male and 16 female participants performed an incentive delay task expecting to win either money or positive social feedback. fMRI recording during the anticipation phase revealed proportional activation of neural structures constituting the human reward system for increasing levels of reward, independent of incentive type. However, in men activation in the prospect of monetary rewards encompassed a wide network of mesolimbic brain regions compared to only limited activation for social rewards. In contrast, in women, anticipation of either incentive type activated identical brain regions. Our findings represent an important step towards a better understanding of motivated behaviour by taking into account individual differences in reward valuation.

Electrophysiological properties of dopamine neurons in the ventral tegmental area of Sardinian alcohol-preferring rats

RATIONALE

Sardinian alcohol-preferring (sP) or -nonpreferring (sNP) rats are one of the few pairs of lines of rats selectively bred for their voluntary alcohol preference or aversion, respectively. Ventral tegmental area (VTA) dopamine (DA) neurons have long been implicated in many drug-related behaviors, including alcohol self-administration. However, the electrophysiological properties of these cells in sP and sNP rats remain unknown.

OBJECTIVES

This study was designed to examine the properties of posterior VTA DA neurons and to unveil functional differences between sP and sNP rats.

MATERIALS AND METHODS

The electrophysiological properties of DA cells were examined performing either single-cell extracellular recordings in anesthetized rats or whole-cell patch-clamp recordings in slices.

RESULTS

Extracellular single-unit recordings revealed an increased spontaneous activity in sP rats. However, a corresponding difference was not found in vitro. Moreover, DA cells of sP and sNP rats showed similar intrinsic properties, suggesting changes at synaptic level. Therefore, inhibitory- and excitatory-mediated currents were studied. A decreased probability of GABA release was found in sP rats. Additionally, sP rats showed a reduced depolarization-induced suppression of inhibition, which is an endocannabinoid-mediated form of short-term plasticity. Additionally, the effect of cannabinoid-type 1 (CB1) receptor agonist WIN55,212-2 on GABAA IPSCs was smaller in sP rats, suggesting either a reduced number or functionality of CB1 receptors in the VTA.

CONCLUSIONS

Our findings suggest that both decreased GABA release and endocannabinoid transmission in the VTA play a role in the increased impulse activity of DA cells and, ultimately, in alcohol preference displayed by sP rats.

Performance evaluation of PCA-based spike sorting algorithms

Deciphering the electrical activity of individual neurons from multi-unit noisy recordings is critical for understanding complex neural systems. A widely used spike sorting algorithm is being evaluated for single-electrode nerve trunk recordings. The algorithm is based on principal component analysis (PCA) for spike feature extraction. In the neuroscience literature it is generally assumed that the use of the first two or most commonly three principal components is sufficient. We estimate the optimum PCA-based feature space by evaluating the algorithm's performance on simulated series of action potentials. A number of modifications are made to the open source nev2lkit software to enable systematic investigation of the parameter space. We introduce a new metric to define clustering error considering over-clustering more favorable than under-clustering as proposed by experimentalists for our data. Both the program patch and the metric are available online. Correlated and white Gaussian noise processes are superimposed to account for biological and artificial jitter in the recordings. We report that the employment of more than three principal components is in general beneficial for all noise cases considered. Finally, we apply our results to experimental data and verify that the sorting process with four principal components is in agreement with a panel of electrophysiology experts.

The nucleus accumbens as part of a basal ganglia action selection circuit

BACKGROUND

The nucleus accumbens is the ventral extent of the striatum, the main input nucleus of the basal ganglia. Recent hypotheses propose that the accumbens and its dopamine projection from the midbrain contribute to appetitive behaviors required to obtain reward. However, the specific nature of this contribution is unclear. In contrast, significant advances have been made in understanding the role of the dorsal striatum in action selection and decision making.

OBJECTIVE

In order to develop a hypothesis of the role of nucleus accumbens dopamine in action selection, the physiology and behavioral pharmacology of the nucleus accumbens are compared to those of the dorsal striatum.

HYPOTHESES

Three hypotheses concerning the role of dopamine in these structures are proposed: (1) that dopamine release in the dorsal striatum serves to facilitate the ability to respond appropriately to temporally predictable stimuli (that is, stimuli that are so predictable that animals engage in anticipatory behavior just prior to the stimulus); (2) that dopamine in the nucleus accumbens facilitates the ability to respond to temporally unpredictable stimuli (which require interruption of ongoing behavior); and (3) that accumbens neurons participate in action selection in response to such stimuli by virtue of their direct (monosynaptic inhibitory) and indirect (polysynaptic excitatory) projections to basal ganglia output nuclei.