Isolating event-related neuronal responses by deconvolution

Two Distinct Neuronal Populations in the Rat Parafascicular Nucleus Oppositely Encode the Engagement in Stimulus-driven Reward-seeking

BACKGROUND

The thalamus is a phylogenetically well-preserved structure. Known to densely contact cortical regions, its role in the transmission of sensory information to the striatal complex has been widely reconsidered in recent years.

METHODS

The parafascicular nucleus of the thalamus (Pf) has been implicated in the orientation of attention toward salient sensory stimuli. In a stimulus-driven reward-seeking task, we sought to characterize the electrophysiological activity of Pf neurons in rats.

RESULTS

We observed a predominance of excitatory over inhibitory responses for all events in the task. Neurons responded more strongly to the stimulus compared to lever-pressing and reward collecting, confirming the strong involvement of the Pf in sensory information processing. The use of long sessions allowed us to compare neuronal responses to stimuli between trials when animals were engaged in action and those when they were not. We distinguished two populations of neurons with opposite responses: MOTIV+ neurons responded more intensely to stimuli followed by a behavioral response than those that were not. Conversely, MOTIV- neurons responded more strongly when the animal did not respond to the stimulus. In addition, the latency of excitation of MOTIV- neurons was shorter than that of MOTIV+ neurons.

CONCLUSION

Through this encoding, the Pf could perform an early selection of environmental stimuli transmitted to the striatum according to motivational level.

Prefrontal cortex encodes value pop-out in visual search

Recent evidence demonstrates that long-term object value association can enhance visual search efficiency, a phenomenon known as value pop-out. However, the neural mechanism underlying this effect is not fully understood. Given the known role of the ventrolateral prefrontal cortex (vlPFC) in visual search and value memory, we recorded its single-unit activity (n = 526) in two macaque monkeys while they engaged in the value-driven search. Monkeys had to determine whether a high-value target was present within a variable number of low-value objects. Differential neural firing, as well as gamma-band power, indicated the presence of a target within ∼150ms of display onset. Notably, this differential activity was negatively correlated with search time and had reduced set-size dependence during efficient search. On the other hand, neural firing and its variability were higher in inefficient search. These findings implicate vlPFC in rapid detection of valuable targets which would be a crucial skill in competitive environments.

Recruitment and disruption of ventral pallidal cue encoding during alcohol seeking

A critical area of inquiry in the neurobiology of alcohol abuse is the mechanism by which cues gain the ability to elicit alcohol use. Previously, we found that cue-evoked activity in rat ventral pallidum robustly encodes the value of sucrose cues trained under both Pavlovian and instrumental contingencies, despite a stronger relationship between cue-evoked activity and behavioral latency after instrumental training (Richard et al., 2018, Elife, 7, e33107). Here, we assessed: (a) ventral pallidal representations of Pavlovian versus instrumental cues trained with alcohol reward, and (b) the impact of non-associative alcohol exposure on ventral pallidal representations of sucrose cues. Decoding of cue identity based on ventral pallidum firing was blunted for the Pavlovian alcohol cue in comparison to both the instrumental cue trained with alcohol and either cue type trained with sucrose. Further, non-associative alcohol exposure had opposing effects on ventral pallidal encoding of sucrose cues trained on instrumental versus Pavlovian associations, enhancing decoding accuracy for an instrumental discriminative stimulus and reducing decoding accuracy for a Pavlovian conditioned stimulus. These findings suggest that alcohol exposure can drive biased engagement of specific reward-related signals in the ventral pallidum.

A New Nonlinear Sparse Component Analysis for a Biologically Plausible Model of Neurons

It is known that brain can create a sparse representation of the environment in both sensory and mnemonic forms (Olshausen & Field, 2004). Such sparse representation can be combined in downstream areas to create rich multisensory responses to support various cognitive and motor functions. Determining the components present in neuronal responses in a given region is key to deciphering its functional role and connection with upstream areas. One approach for parsing out various sources of information in a single neuron is by using linear blind source separation (BSS) techniques. However, applying linear techniques to neuronal spiking activity is likely to be suboptimal due to inherent and unknown nonlinearity of neuronal responses to inputs. This letter proposes a nonlinear sparse component analysis (SCA) method to separate jointly sparse inputs to neurons with post summation nonlinearity, or SCA for post-nonlinear neurons (SCAPL). Specifically, a linear clustering approach followed by principal curve regression (PCR) and a nonlinear curve fitting are used to separate sources. Analysis using simulated data shows that SCAPL accuracy outperforms ones obtained by linear SCA, as well as other separating methods, including linear independent and principal component analyses. In SCAPL, the number of derived sparse components is not limited by the number of neurons, unlike most BSS methods. Furthermore, this method allows for a broad range of post-summation nonlinearities that could differ among neurons. The sensitivity of our method to noise, joint sparseness, degree, and shape of nonlinearity and mixing ill conditions is discussed and compared to existing methods. Our results show that the proposed method can successfully separate input components in a population of neurons provided that they are temporally sparse to some degree. Application of SCAPL should facilitate comparison of functional roles across regions by parsing various elements present in a region.

Ventral pallidal encoding of reward-seeking behavior depends on the underlying associative structure

Despite its being historically conceptualized as a motor expression site, emerging evidence suggests the ventral pallidum (VP) plays a more active role in integrating information to generate motivation. Here, we investigated whether rat VP cue responses would encode and contribute similarly to the vigor of reward-seeking behaviors trained under Pavlovian versus instrumental contingencies, when these behavioral responses consist of superficially similar locomotor response patterns but may reflect distinct underlying decision-making processes. We find that cue-elicited activity in many VP neurons predicts the latency of instrumental reward seeking, but not of Pavlovian response latency. Further, disruption of VP signaling increases the latency of instrumental but not Pavlovian reward seeking. This suggests that VP encoding of and contributions to response vigor are specific to the ability of incentive cues to invigorate reward-seeking behaviors upon which reward delivery is contingent.

Sounds or other cues associated with receiving a reward can have a powerful effect on an individual’s behavior or emotions. For example, the sound of an ice cream truck might cause salivation and motivate an individual to stand in a long line. Cues may prompt specific actions necessary to receive a reward, for example, approaching the ice cream truck and paying to get an ice cream. This is called instrumental conditioning. Some cues predict reward delivery, without requiring a specific action. This is called Pavlovian conditioning. Pavlovian cues can still prompt actions, such as approaching the truck, even though the action is not required. But exactly what happens in the brain to generate these actions during the two types of learning, is unclear.

Learning more about these reward-driven brain mechanisms might help scientists to develop better treatments for people with addiction or other conditions that involve compulsive reward-seeking behavior. Currently, scientists do not know enough about how the brain triggers this kind of behavior or how these processes lead to relapse in individuals who have been abstinent. Basic studies on the brain mechanisms that trigger reward-seeking behavior are needed.

Now, Richard et al. show that a greater activity in neurons, or brain cells, in a part of the brain called the ventral pallidum predicts a faster response to a reward cue. In the experiments, some rats were trained to approach a certain location when they heard a particular sound in order to receive sugar water, a form of instrumental conditioning. Another group of rats underwent Pavlovian training and learned to expect sugar water every time they heard sound even if they did nothing. Both groups learned to approach the sugar water location when they heard the cue, despite the different training requirements.

Richard et al. measured the activity of neurons in the ventral pallidum when the rats in the two groups heard the reward-associated sound. The experiments showed that the amount of activity in the brain cells in this area predicted whether a rat would approach the sugar-water delivery area and how quickly they would approach the reward after hearing the cue. The predictions were most reliable for rats that had to do something to get the sugar water. When Richard et al. reduced the activity in these cells they found the rats took longer to approach the reward source, but only when this action was required to receive sugar water. The experiments show that the ventral pallidum may provide the motivation to undertake reward-seeking behavior.

Temporal-prefrontal cortical network for discrimination of valuable objects in long-term memory

Remembering and discriminating objects based on their previously learned values are essential for goal-directed behaviors. While the cerebral cortex is known to contribute to object recognition, surprisingly little is known about its role in retaining long-term object-value associations. To address this question, we trained macaques to arbitrarily associate small or large rewards with many random fractal objects (>100) and then used fMRI to study the long-term retention of value-based response selectivity across the brain. We found a pronounced long-term value memory in core subregions of temporal and prefrontal cortex where, several months after training, fractals previously associated with high reward ("good" stimuli) elicited elevated fMRI responses compared with those associated with low reward ("bad" stimuli). Similar long-term value-based modulation was also observed in subregions of the striatum, amygdala, and claustrum, but not in the hippocampus. The value-modulated temporal-prefrontal subregions showed strong resting-state functional connectivity to each other. Moreover, for areas outside this core, the magnitude of long-term value responses was predicted by the strength of resting-state functional connectivity to the core subregions. In separate testing, free-viewing gaze behavior indicated that the monkeys retained stable long-term memory of object value. These results suggest an implicit and high-capacity memory mechanism in the temporal-prefrontal circuitry and its associated subcortical regions for long-term retention of object-value memories that can guide value-oriented behavior.

Prefrontal cortex mediates extinction of responding by two distinct neural mechanisms in accumbens shell

Suppression of ill-timed or competing actions optimizes goal-directed behaviors. Diminished inhibitory control over such actions is a central feature of such disorders as impulsivity, obesity, and drug addiction. The ventromedial prefrontal cortex (vmPFC) is involved in suppression of unreinforced actions. Using reversible inactivation in rats, we demonstrate that vmPFC activity is also required for inhibition of unreinforced actions extinguished during learning of a cued appetitive task and that behavioral disinhibition following vmPFC inactivation depends on dopamine signaling in nucleus accumbens shell (NAcS). Combining electrophysiological recording in NAcS with vmPFC inactivation in rats reveals two neural mechanisms by which vmPFC inhibits unreinforced actions. The first is by suppressing phasic excitations that promote behavioral cue responding. The second is by increasing the basal firing of NAcS neurons that tonically inhibit reward seeking. These results identify the vmPFC and the NAcS as critical elements of the circuits relevant to suppression of inappropriate actions.

Roles of nucleus accumbens core and shell in incentive-cue responding and behavioral inhibition

The nucleus accumbens (NAc) is involved in many reward-related behaviors. The NAc has two major components, the core and the shell. These two areas have different inputs and outputs, suggesting that they contribute differentially to goal-directed behaviors. Using a discriminative stimulus (DS) task in rats and inactivating the NAc by blocking excitatory inputs with glutamate antagonists, we dissociated core and shell contributions to task performance. NAc core but not shell inactivation decreased responding to a reward-predictive cue. In contrast, inactivation of either subregion induced a general behavioral disinhibition. This reveals that the NAc actively suppresses actions inappropriate to the DS task. Importantly, selective inactivation of the shell but not core significantly increased responding to the nonrewarded cue. To determine whether the different contributions of the NAc core and shell depend on the information encoded in their constituent neurons, we performed electrophysiological recording in rats performing the DS task. Although there was no firing pattern unique to either core or shell, the reward-predictive cue elicited more frequent and larger magnitude responses in the NAc core than in the shell. Conversely, more NAc shell neurons selectively responded to the nonrewarded stimulus. These quantitative differences might account for the different behavioral patterns that require either core or shell. Neurons with similar firing patterns could also have different effects on behavior due to their distinct projection targets.