Dichotomous dopaminergic and noradrenergic neural states mediate distinct aspects of exploitative behavioral states

Shining light on the noradrenergic system

Despite decades of research on the noradrenergic system, our understanding of its impact on brain function and behavior remains incomplete. Traditional recording techniques are challenging to implement for investigating in vivo noradrenergic activity, due to the relatively small size and the position in the brain of the locus coeruleus (LC), the primary location for noradrenergic neurons. However, recent advances in optical and fluorescent methods have enabled researchers to study the LC more effectively. Use of genetically encoded calcium indicators to image the activity of noradrenergic neurons and biosensors that monitor noradrenaline release with fluorescence can be an indispensable tool for studying noradrenergic activity. In this review, we examine how these methods are being applied to record the noradrenergic system in the rodent brain during behavior.

Calcium activity is a degraded estimate of spikes

Recording action potentials extracellularly during behavior has led to fundamental discoveries regarding neural function-hippocampal neurons respond to locations in space,1 motor cortex neurons encode movement direction,2 and dopamine neurons signal reward prediction errors3-observations undergirding current theories of cognition,4 movement,5 and learning.6 Recently it has become possible to measure calcium flux, an internal cellular signal related to spiking. The ability to image calcium flux in anatomically7,8 or genetically9 identified neurons can extend our knowledge of neural circuit function by allowing activity to be monitored in specific cell types or projections, or in the same neurons across many days. However, while initial studies were grounded in prior unit recording work, it has become fashionable to assume that calcium is identical to spiking, even though the spike-to-fluorescence transformation is nonlinear, noisy, and unpredictable under real-world conditions.10 It remains an open question whether calcium provides a high-fidelity representation of single-unit activity in awake, behaving subjects. Here, we have addressed this question by recording both signals in the lateral orbitofrontal cortex (OFC) of rats during olfactory discrimination learning. Activity in the OFC during olfactory learning has been well-studied in humans,11,12,13,14 nonhuman primates,15,16 and rats,17,18,19,20,21 where it has been shown to signal information about both the sensory properties of odor cues and the rewards they predict. Our single-unit results replicated prior findings, whereas the calcium signal provided only a degraded estimate of the information available in the single-unit spiking, reflecting primarily reward value.

The locus coeruleus mediates behavioral flexibility

Behavioral flexibility is the ability to adjust behavioral strategies in response to changing environmental contingencies. A major hypothesis in the field posits that the activity of neurons in the locus coeruleus (LC) plays an important role in mediating behavioral flexibility. To test this hypothesis, we developed a tactile-based rule-shift detection task in which mice responded to left and right whisker deflections in a context-dependent manner and exhibited varying degrees of switching behavior. Recording spiking activity from optogenetically tagged neurons in the LC at millisecond precision during task performance revealed a prominent graded correlation between baseline LC activity and behavioral flexibility, where higher baseline activity following a rule change was associated with faster behavioral switching to the new rule. Increasing baseline LC activity with optogenetic activation accelerated task switching and improved task performance. Overall, our study provides important evidence to reveal the link between LC activity and behavioral flexibility.

Prior actions influence cost-benefit related decision-making during mouse foraging behaviors

Food foraging is essential for the fitness of animals. Previous studies have suggested that optimal foraging strategies involve a cost-benefit analysis comparing reward versus effort to guide action choices. Little is known how prior experience with different actions to obtain rewards may affect subsequent foraging choices. Here, we report a sunflower seed foraging test to investigate how effort and prior actions influence decision-making in laboratory mice. Sunflower seeds are a natural food favorite for mice, and mice spend effort to peel the hard shells to obtain the seeds. In our test, peeled and unpeeled sunflower seeds were placed at different ends of a Y-maze. Mice were free to explore the maze and make foraging decisions. Naïve mice were more likely to choose peeled seeds requiring low effort versus unpeeled seeds requiring high effort. Furthermore, mice with prior seed peeling experience significantly reduced preference for peeled seeds during the subsequent Y-maze foraging test, compared to mice pre-exposed to peeled seeds only. This experience dependent shift in foraging choice was associated with reduced seed peeling time and improved motor skills with practice, and predictable on a trial-by-trial basis by a probabilistic decision-making model with the amount of peeled and unpeeled seeds consumed as inputs. Together, these results suggest that laboratory mice make rational foraging choices based on effort estimation and moreover, prior actions to obtain reward alter effort estimation and decision-making through motor skill learning. This naturalist behavioral task may be applied to dissect neural mechanisms in adaptive decision-making during foraging.