In monkeys making value-based decisions, amygdala neurons are sensitive to cue value as distinct from cue salience

The amygdala and the pursuit of future rewards

The successful pursuit of future rewards requires forming an internal goal, followed by planning, decision-making, and progress-tracking over multiple steps. The initial step-forming goals and the plans for obtaining them-involves the subjective valuation of an anticipated reward, considering both the reward's properties and associated delay and physical-effort costs. Recent findings indicate individuals similarly evaluate cognitive effort over time (Johnson and Most, 2023). Success and failure in these processes have been linked to differential life outcomes and psychiatric conditions. Here we review evidence from single-neuron recordings and neuroimaging studies that implicate the amygdala-a brain structure long associated with cue-reactivity and emotion-in decision-making and the planned pursuit of future rewards (Grabenhorst et al., 2012, 2016, 2019, 2023;Hernadi et al., 2015;Zangemeister et al., 2016). The main findings are that, in behavioral tasks in which future rewards can be pursued through planning and stepwise decision-making, amygdala neurons prospectively encode the value of anticipated rewards and related behavioral plans. Moreover, amygdala neurons predict the stepwise choices to pursue these rewards, signal progress toward goals, and distinguish internally generated (i.e., self-determined) choices from externally imposed actions. Importantly, amygdala neurons integrate the subjective value of a future reward with delay and effort costs inherent in pursuing it. This neural evidence identifies three key computations of the primate amygdala that underlie the pursuit of future rewards: (1) forming a self-determined internal goal based on subjective reward-cost valuations, (2) defining a behavioral plan for obtaining the goal, (3) executing this plan through stepwise decision-making and progress-tracking. Based on this framework, we suggest that amygdala neurons constitute vulnerabilities for dysfunction that contribute to maladaptive reward pursuit in psychiatric and behavioral conditions. Consequently, amygdala neurons may also represent potential targets for behavioral-change interventions that aim to improve individual decision-making.

Neuronal Encoding of Emotional Valence and Intensity in the Monkey Amygdala

Neuropsychological and neuroimaging studies have suggested that the primate amygdala plays an essential role in processing the emotional valence and intensity of visual stimuli, which is necessary for determining whether to approach or avoid a stimulus. However, the neuronal mechanisms underlying the evaluation of emotional value remain unknown. In the present study, we trained male macaque monkeys to perform an operant conditioning task in which fractal visual patterns were associated with three different amounts of air puff delivered to the cheek (negative) or liquid reward (positive). After confirming that the monkeys successfully differentiated the emotional valence and intensity of the visual stimuli, we analyzed neuronal responses to the stimuli in the amygdala. Most amygdala neurons conveyed information concerning the emotional valence and/or intensity of the visual stimuli, and the majority of those conveying information about emotional valence responded optimally to negative stimuli. Further, some amygdala neurons conveyed information related to both emotional valence and intensity, whereas a small portion conveyed information related to emotional intensity alone. These results indicate that the primate amygdala encodes both emotional valence and intensity, highlighting its important role in the avoidance of dangerous stimuli and animal survival.SIGNIFICANCE STATEMENT Evaluating the emotional value of visual stimuli is essential for animal survival, especially in primates. Emotional value is estimated from the emotional valence and intensity of stimuli, and evidence indicates that the amygdala is likely to play a major role in processing these types of information. To our knowledge, the current study is the first to examine the responses of neurons in the monkey amygdala to visual stimuli that differ in emotional valence and intensity simultaneously. Our data suggest that the amygdala plays an important role in the evaluation of emotional stimuli and in the decision to escape negative and harmful stimuli.

Contingent Amygdala Inputs Trigger Heterosynaptic LTP at Hippocampus-To-Accumbens Synapses

The nucleus accumbens shell (NAcSh) is a key brain region where environmental cues acquire incentive salience to reinforce motivated behaviors. Principal medium spiny neurons (MSNs) in the NAcSh receive extensive glutamatergic projections from limbic regions, among which, the ventral hippocampus (vH) transmits information enriched in contextual cues, and the basolateral amygdala (BLA) encodes real-time arousing states. The vH and BLA project convergently to NAcSh MSNs, both activated in a time-locked manner on a cue-conditioned motivational action. In brain slices prepared from male and female mice, we show that co-activation of the two projections induces long-term potentiation (LTP) at vH-to-NAcSh synapses without affecting BLA-to-NAcSh synapses, revealing a heterosynaptic mechanism through which BLA signals persistently increase the temporally contingent vH-to-NAcSh transmission. Furthermore, this LTP is more prominent in dopamine D1 receptor-expressing (D1) MSNs than D2 MSNs and can be prevented by inhibition of either D1 receptors or dopaminergic terminals in NAcSh. This heterosynaptic LTP may provide a dopamine-guided mechanism through which vH-encoded cue inputs that are contingent to BLA activation acquire increased circuit representation to reinforce behavior.SIGNIFICANCE STATEMENT In motivated behaviors, environmental cues associated with arousing stimuli acquire increased incentive salience, processes mediated in part by the nucleus accumbens (NAc). NAc principal neurons receive glutamatergic projections from the ventral hippocampus (vH) and basolateral amygdala (BLA), which transmit information encoding contextual cues and affective states, respectively. Our results show that co-activation of the two projections induces long-term potentiation (LTP) at vH-to-NAc synapses without affecting BLA-to-NAc synapses, revealing a heterosynaptic mechanism through which BLA signals potentiate the temporally contingent vH-to-NAc transmission. Furthermore, this LTP is prevented by inhibition of either D1 receptors or dopaminergic axons. This heterosynaptic LTP may provide a dopamine-guided mechanism through which vH-encoded cue inputs that are contingent to BLA activation acquire increased circuit representation to reinforce behavior.

Delays to Reward Delivery Enhance the Preference for an Initially Less Desirable Option: Role for the Basolateral Amygdala and Retrosplenial Cortex

Temporal costs influence reward-based decisions. This is commonly studied in temporal discounting tasks that involve choosing between cues signaling an imminent reward option or a delayed reward option. However, it is unclear whether the temporal delay before a reward can alter the value of that option. To address this, we identified the relative preference between different flavored rewards during a free-feeding test using male and female rats. Animals underwent training where either the initial preferred or the initial less preferred reward was delivered noncontingently. By manipulating the intertrial interval during training sessions, we could determine whether temporal delays impact reward preference in a subsequent free-feeding test. Rats maintained their initial preference if the same delays were used across all training sessions. When the initial less preferred option was delivered after short delays (high reward rate) and the initial preferred option was delivered after long delays (low reward rate), rats expectedly increased their preference for the initial less desirable option. However, rats also increased their preference for the initial less desirable option under the opposite training contingencies: delivering the initial less preferred reward after long delays and the initial preferred reward after short delays. These data suggest that sunk temporal costs enhance the preference for a less desirable reward option. Pharmacological and lesion experiments were performed to identify the neural systems responsible for this behavioral phenomenon. Our findings demonstrate the basolateral amygdala and retrosplenial cortex are required for temporal delays to enhance the preference for an initially less desirable reward.SIGNIFICANCE STATEMENT The goal of this study was to determine how temporal delays influence reward preference. We demonstrate that delivering an initially less desirable reward after long delays subsequently increases the consumption and preference for that reward. Furthermore, we identified the basolateral amygdala and the retrosplenial cortex as essential nuclei for mediating the change in reward preference elicited by sunk temporal costs.

Toward a holistic view of value and social processing in the amygdala: Insights from primate behavioral neurophysiology

Located medially within the temporal lobes, the amygdala is a formation of heterogenous nuclei that has emerged as a target for investigations into the neural bases of both primitive and complex behaviors. Although modern neuroscience has eschewed the practice of assigning broad functions to distinct brain regions, the amygdala has classically been associated with regulating negative emotional processes (such as fear or aggression), primarily through research performed in rodent models. Contemporary studies, particularly those in non-human primate models, have provided evidence for a role of the amygdala in other aspects of cognition such as valuation of stimuli or shaping social behaviors. Consequently, many modern perspectives now also emphasize the amygdala's role in processing positive affect and social behaviors. Importantly, several recent experiments have examined the intersection of two seemingly autonomous domains; how both valence/value and social stimuli are simultaneously represented in the amygdala. Results from these studies suggest that there is an overlap between valence/value processing and the processing of social behaviors at the level of single neurons. These findings have prompted researchers investigating the neurophysiological mechanisms underlying social interactions to question what contributions reward-related processes in the amygdala make in shaping social behaviors. In this review, we will examine evidence, primarily from primate neurophysiology, suggesting that value-related processes in the amygdala interact with the processing of social stimuli, and explore holistic hypotheses about how these amygdalar interactions might be instantiated.

A Frontal Neuropsychological Profile in Fitness to Drive

Traffic accidents are a global concern due to the elevated mortality rates of both drivers and pedestrians. The World Health Organization declared 2011-2020 as the Decade of Action for Road Safety, endorsing initiatives to reduce traffic-related deaths. Yet, despite these incentives, fatal accidents still occur. Different studies have linked deficits in executive functions to risky driving attitudes and crashes. The present study focuses on demographic, cognitive and personality factors, related to the prefrontal cortex, that are characteristic of drivers prone to risky behavior behind the wheel. The penalty Points System was used to classify drivers as "safe", with no point loss over a two-year period, or "risky", with full point loss during the same interval. A neuropsychological assessment of prefrontal cognitive functions was carried out on each group to identify variables associated with safe and risky behavior. Neuropsychological indexes were obtained from a continuous performance task without cue (Simple Attention), a continuous performance task with cue (Conditioned Attention), the Tower of Hanoi test and the Neurologically-related Changes in Personality Inventory (NECHAPI). A Discriminant Analysis (DA) found that education level, reaction times in Simple and Conditioned Attention, learning errors in the Tower of Hanoi and vulnerability in the personality test, best predicted whether drivers were likely to be in the safe or risky group. Finally, a cross-validation analysis performed on the same sample correctly classified 87.5% of the drivers. These data suggest that prefrontal dysfunction contributes to risky behavior behind the wheel. The inclusion of cognitive programs to identify and train drivers with this propensity could reduce risky driving, and consequently, save lives on the road.

Neuronal Activity in the Primate Amygdala during Economic Choice

Multiple lines of evidence link economic choices to the orbitofrontal cortex (OFC), but other brain regions may contribute to the computation and comparison of economic values. A particularly strong candidate is the basolateral amygdala (BLA). Amygdala lesions impair performance in reinforcer devaluation tasks, suggesting that the BLA contributes to value computation. Furthermore, previous studies of the BLA have found neuronal activity consistent with a value representation. Here, we recorded from the BLA of two male rhesus macaques choosing between different juices. Offered quantities varied from trial to trial, and relative values were inferred from choices. Approximately one-third of BLA cells were task-related. Our analyses revealed the presence of three groups of neurons encoding variables offer value, chosen value, and chosen juice In this respect, the BLA appeared similar to the OFC. The two areas differed for the proportion of neurons in each group, as the fraction of chosen value cells was significantly higher in the BLA. Importantly, the activity of these neurons reflected the subjective nature of value. Firing rates in the BLA were sustained throughout the trial and maximal after juice delivery. In contrast, firing rates in the OFC were phasic and maximal shortly after offer presentation. Our results suggest that the BLA supports economic choice and reward expectation.SIGNIFICANCE STATEMENT Economic choices rely on the orbitofrontal cortex (OFC), but other brain regions may contribute to this behavior. A strong candidate is the basolateral amygdala (BLA). Previous results are consistent with a neuronal representation of value, but the role of the BLA in economic decisions remains unclear. Here, we recorded from monkeys choosing between juices. Neurons in the BLA encoded three decision variables: offer value, chosen value, and chosen juice These variables were also identified in the OFC. The two areas differed in the proportion of cells encoding each variable and in the activation timing. In the OFC, firing rates peaked shortly after offer presentation; in the BLA, firing rates were sustained and peaked after juice delivery. These results suggest that the BLA supports choices and reward expectation.

Cognitive Control of Escape Behaviour

When faced with potential predators, animals instinctively decide whether there is a threat they should escape from, and also when, how, and where to take evasive action. While escape is often viewed in classical ethology as an action that is released upon presentation of specific stimuli, successful and adaptive escape behaviour relies on integrating information from sensory systems, stored knowledge, and internal states. From a neuroscience perspective, escape is an incredibly rich model that provides opportunities for investigating processes such as perceptual and value-based decision-making, or action selection, in an ethological setting. We review recent research from laboratory and field studies that explore, at the behavioural and mechanistic levels, how elements from multiple information streams are integrated to generate flexible escape behaviour.

Gustatory responses in macaque monkeys revealed with fMRI: Comments on taste, taste preference, and internal state

Studies of the neural mechanisms underlying value-based decision making typically employ food or fluid rewards to motivate subjects to perform cognitive tasks. Rewards are often treated as interchangeable, but it is well known that the specific tastes of foods and fluids and the values associated with their taste sensations influence choices and contribute to overall levels of food consumption. Accordingly, we characterized the gustatory system in three macaque monkeys (Macaca mulatta) and examined whether gustatory responses were modulated by preferences and hydration status. To identify taste-responsive cortex, we delivered small quantities (0.1 ml) of sucrose (sweet), citric acid (sour), or distilled water in random order without any predictive cues while scanning monkeys using event-related fMRI. Neural effects were evaluated by using each session in each monkey as a data point in a second-level analysis. By contrasting BOLD responses to sweet and sour tastes with those from distilled water in a group level analysis, we identified taste responses in primary gustatory cortex area G, an adjacent portion of the anterior insular cortex, and prefrontal cortex area 12o. Choice tests administered outside the scanner revealed that all three monkeys strongly preferred sucrose to citric acid or water. BOLD responses in the ventral striatum, ventral pallidum, and amygdala reflected monkeys' preferences, with greater BOLD responses to sucrose than citric acid. Finally, we examined the influence of hydration level by contrasting BOLD responses to receipt of fluids when monkeys were thirsty and after ad libitum water consumption. BOLD responses in area G and area 12o in the left hemisphere were greater following full hydration. By contrast, BOLD responses in portions of medial frontal cortex were reduced after ad libitum water consumption. These findings highlight brain regions involved in representing taste, taste preference and internal state.

Amygdala activity for the modulation of goal-directed behavior in emotional contexts

Choosing valuable objects and rewarding actions is critical for survival. While such choices must be made in a way that suits the animal’s circumstances, the neural mechanisms underlying such context-appropriate behavior are unclear. To address this question, we devised a context-dependent reward-seeking task for macaque monkeys. Each trial started with the appearance of one of many visual scenes containing two or more objects, and the monkey had to choose the good object by saccade to get a reward. These scenes were categorized into two dimensions of emotional context: dangerous versus safe and rich versus poor. We found that many amygdala neurons were more strongly activated by dangerous scenes, by rich scenes, or by both. Furthermore, saccades to target objects occurred more quickly in dangerous than in safe scenes and were also quicker in rich than in poor scenes. Thus, amygdala neuronal activity and saccadic reaction times were negatively correlated in each monkey. These results suggest that amygdala neurons facilitate targeting saccades predictably based on aspects of emotional context, as is necessary for goal-directed and social behavior.

The amygdala is known to control passive fear responses (e.g., freezing), but it is unclear if it also contributes to active behaviors. To reach certain goals, we (humans and animals) often need to go through fearful environments. We hypothesized that the amygdala contributes to such an active behavior and devised a new foraging task for macaque monkeys in which various emotional contexts changed across many environments. This “exciting” task provoked extremely fast learning and high-capacity memory of objects and environments, and thereby caused extremely fast goal-directed behaviors. We found that the goal-directed behavior was affected by the emotional context in two dimensions (dangerous–safe and rich–poor) separately from the object values. Then, many neurons in the amygdala responded to the environments before any object appeared and did so selectively, depending on the emotional context of the environment. The neuronal activity was tightly correlated with the reaction time of goal-directed behavior across the contexts: faster behavior in dangerous or rich context. These results suggest that the amygdala facilitates goal-directed behavior by focusing on emotional contexts. Such a function is also important for emotional–social behavior and its disorder, including averted eye gaze in autism.