Rhinal cortex ablations fail to disrupt reinforcer devaluation effects in rhesus monkeys (Macaca mulatta)

The visual prefrontal cortex of anthropoids: interaction with temporal cortex in decision making and its role in the making of "visual animals"

The ventral prefrontal cortex (PFC) of primates-a region strongly implicated in decision making-receives highly processed visual sensory inputs from the inferior temporal cortex (ITC) and perirhinal cortex (PRC) and can therefore be considered visual PFC. Usually, the functions of temporal cortex and visual PFC have been discussed in separate literatures. By considering them together, we aim to clarify the ways in which fronto-temporal networks guide decision making. After discussing the ways in which visual PFC interacts with temporal cortex to promote decision making, we offer specific predictions about the selective roles of the ITC- and PRC-based fronto-temporal networks. Finally, we suggest that an increased reliance on visual PFC in anthropoid primates led to our emergence as 'visual' animals.

Effects of systemic cholinergic antagonism on reinforcer devaluation in macaques

The capacity to adjust actions based on new information is a vital cognitive function. An animal's ability to adapt behavioral responses according to changes in reward value can be measured using a reinforcer devaluation task, wherein the desirability of a given object is reduced by decreasing the value of the associated food reinforcement. Elements of the neural circuits serving this ability have been studied in both rodents and nonhuman primates. Specifically, the basolateral amygdala, orbitofrontal cortex, nucleus accumbens, and mediodorsal thalamus have each been shown to play a critical role in the process of value updating, required for adaptive goal selection. As these regions receive dense cholinergic input, we investigated whether systemic injections of non-selective nicotinic or muscarinic acetylcholine receptor antagonists, mecamylamine and scopolamine, respectively, would impair performance on a reinforcer devaluation task. Here we demonstrate that in the presence of either a nicotinic or muscarinic antagonist, animals are able to shift their behavioral responses in an appropriate manner, suggesting that disruption of cholinergic neuromodulation is not sufficient to disrupt value updating, and subsequent goal selection, in rhesus macaques.

Neural estimates of imagined outcomes in the orbitofrontal cortex drive behavior and learning

Imagination, defined as the ability to interpret reality in ways that diverge from past experience, is fundamental to adaptive behavior. This can be seen at a simple level in our capacity to predict novel outcomes in new situations. The ability to anticipate outcomes never before received can also influence learning if those imagined outcomes are not received. The orbitofrontal cortex is a key candidate for where the process of imagining likely outcomes occurs; however, its precise role in generating these estimates and applying them to learning remain open questions. Here we address these questions by showing that single-unit activity in the orbitofrontal cortex reflects novel outcome estimates. The strength of these neural correlates predicted both behavior and learning, learning that was abolished by temporally specific inhibition of orbitofrontal neurons. These results are consistent with the proposal that the orbitofrontal cortex is critical for integrating information to imagine future outcomes.

Behavioral outcomes of late-onset or early-onset orbital frontal cortex (areas 11/13) lesions in rhesus monkeys

The orbital frontal cortex (OFC) has been implicated in a number of psychiatric disorders, including depression, anxiety, phobia, and obsessive-compulsive disorder. Thus, a better understanding of its functions will likely provide critical information to understand the specific behavioral and cognitive processes affected in these human disorders. In recent years, a growing number of studies have provided evidence for anatomical and functional differentiation within the OFC. Here we discuss the effects of selective OFC (areas 11/13) lesions on social behavior, emotional regulation, and behavioral adaptation. Damage to these specific OFC subfields in adult monkeys resulted in profound changes in the flexible modulation of responses guided by reward value that could explain the poor fear regulation and disturbed social interactions observed in the same animals. A similar pattern of results was found when the OFC lesions were done in infancy. Thus, in monkeys, self-regulation abilities mediated by OFC areas 11/13 emerge from midinfancy through adolescence.

Transient inactivation of orbitofrontal cortex blocks reinforcer devaluation in macaques

The orbitofrontal cortex (OFC) and its interactions with the basolateral amygdala (BLA) are critical for goal-directed behavior, especially for adapting to changes in reward value. Here we used a reinforcer devaluation paradigm to investigate the contribution of OFC to this behavior in four macaques. Subjects that had formed associations between objects and two different primary reinforcers (foods) were presented with choices of objects overlying the two different foods. When one of the two foods was devalued by selective satiation, the subjects shifted their choices toward the objects that represented the nonsated food reward (devaluation effect). Transient inactivation of OFC by infusions of the GABA(A) receptor agonist muscimol into area 13 blocked the devaluation effect: the monkeys did not reduce their selection of objects associated with the devalued food. This effect was observed when OFC was inactivated during both satiation and the choice test, and during the choice test only. This supports our hypothesis that OFC activity is required during the postsatiety object choice period to guide the selection of objects. This finding sharply contrasts with the role of BLA in the same devaluation process (Wellman et al., 2005). Whereas activity in BLA was required during the selective satiation procedure, it was not necessary for guiding the subsequent object choice. Our results are the first to demonstrate that transient inactivation of OFC is sufficient to disrupt the devaluation effect, and to document a role for OFC distinct from that of BLA for the conditioned reinforcer devaluation process in monkeys.

Localization of dysfunction in major depressive disorder: prefrontal cortex and amygdala

Despite considerable effort, the localization of dysfunction in major depressive disorder (MDD) remains poorly understood. We present a hypothesis about its localization that builds on recent findings from primate neuropsychology. The hypothesis has four key components: a deficit in the valuation of "self" underlies the core disorder in MDD; the medial frontal cortex represents "self"; interactions between the amygdala and cortical representations update their valuation; and inefficiency in using positive feedback by orbital prefrontal cortex contributes to MDD.

A visual, position-independent instrumental reinforcer devaluation task for rats

Flexible goal-directed behavior has been studied across species using reinforcer devaluation tasks, in which subjects form associations between specific stimuli (cues) and specific reinforcer(s). The reinforcer is subsequently devalued by selective satiation or taste aversion. Following devaluation, subjects adjust their responding to the cues reflecting the new value of the reinforcer. Tasks currently used in rats differ in several ways from tasks used in monkeys and this may explain contrasting results between the two species. To address one of the differences, we developed a rat task independent of spatial cues. It employs two visual cues presented simultaneously, changing left and right positions pseudorandomly. Each cue predicts one of two food reinforcers. Rats were trained to lever press in response to the two visual cues. Subsequently, they were satiated on one of the foods followed by an extinction test where in each trial they could choose to respond to one of the two cues, one predicting the devalued reinforcer and the other the non-devalued. This procedure was repeated later with the alternative food devalued. The rats adjusted their responding by choosing the cue predicting the devalued food significantly less (p<0.05) than the alternative cue. These results show that rats can discriminate two visual stimuli presented simultaneously, devalue two different foods by selective satiation, and transfer the new value to the visual cues. Discrimination of the visual cues is not aided by spatial cues, thereby eliminating a major difference between the instrumental tasks used in rats and the task used in monkeys.

Neurotoxic lesions of the medial mediodorsal nucleus of the thalamus disrupt reinforcer devaluation effects in rhesus monkeys

The mediodorsal thalamus is a major input to the prefrontal cortex and is thought to modulate cognitive functions of the prefrontal cortex. Damage to the medial, magnocellular part of the mediodorsal thalamus (MDmc) impairs cognitive functions dependent on prefrontal cortex, including memory. The contribution of MDmc to other aspects of cognition dependent on prefrontal cortex has not been determined. The ability of monkeys to adjust their choice behavior in response to changes in reinforcer value, a capacity impaired by lesions of orbital prefrontal cortex, can be tested in a reinforcer devaluation paradigm. In the present study, rhesus monkeys with bilateral neurotoxic MDmc lesions were tested in the devaluation procedure. Monkeys learned visual discrimination problems in which each rewarded object is reliably paired with one of two different food rewards and then were given choices between pairs of rewarded objects, one associated with each food. Selective satiation of one of the food rewards reduces choices of objects associated with that food in normal monkeys. Monkeys with bilateral neurotoxic lesions of MDmc learned concurrently presented visual discrimination problems as quickly as unoperated control monkeys but showed impaired reinforcer devaluation effects. This finding suggests that the neural circuitry for control of behavioral choice by changes in reinforcer value includes MDmc.

Measuring reward assessment in a semi-naturalistic context: the effects of selective amygdala, orbital frontal or hippocampal lesions

Studying the neural mechanisms underlying complex goal-directed behaviors, such as social behavior, reward seeking or punishment avoidance, has become increasingly tractable in humans, nonhuman primates and rodents. In most experiments, however, goal-directed behaviors are measured in a laboratory setting, which is vastly different from the context in which these behaviors naturally occur. This study adapted a reward assessment paradigm, previously conducted with rhesus monkeys (Macaca mulatta) in the controlled environment of a Wisconsin General Testing Apparatus (WGTA) [Machado CJ, Bachevalier J (2007) The effects of selective amygdala, orbital frontal cortex or hippocampal formation lesions on reward assessment in nonhuman primates. Eur J Neurosci 25:2885-2904], to a more naturalistic context. We used this new paradigm to examine the effects of bilateral amygdaloid, hippocampal or orbital frontal cortex lesions on established food and nonfood preferences. Behavioral modification following reinforcer devaluation was also measured. Consistent with our previous study, none of the lesions produced changes in preference for palatable foods relative to pre-surgery, but animals with amygdala lesions displayed heightened preference for unpalatable foods that control or other operated animals typically avoided. In contrast to several previous WGTA-based experiments, nonfood preference was not affected by any of the lesions. Finally, animals with orbital frontal cortex lesions continued to select preferred foods after satiation, but those with amygdala, hippocampal or sham lesions altered their foraging behavior appropriately and selected less of the sated food. These findings parallel food devaluation results obtained with these same animals when tested in the WGTA. Overall, this study stresses the importance of testing context when measuring decision-making abilities in nonhuman primates with selective brain lesions.

The effects of selective amygdala, orbital frontal cortex or hippocampal formation lesions on reward assessment in nonhuman primates

We examined the effects of bilateral amygdaloid, hippocampal or orbital frontal cortex lesions on reward assessment in rhesus monkeys (Macaca mulatta). In Experiment 1, basic preferences for foods and inedible nonfoods were measured pre- and postsurgery. None of the lesions produced changes in animals' preferences for palatable foods or raw meat relative to presurgery, although amygdaloid or hippocampal lesions yielded increased preference for inedible nonfoods postsurgery. When the reinforcement value of each animal's highest-preferred food was decreased by selective satiation, only animals with neurotoxic orbital frontal cortex lesions continued to select the sated food. Experiment 2 measured the impact of each lesion on learning 60 concurrent discrimination problems and, then, on flexibly avoiding objects associated with sated foods in favour of objects associated with nonsated foods. None of the lesions affected concurrent discrimination learning, but animals with neurotoxic amygdala or aspiration orbital frontal lesions could not refrain from displacing items covering devalued foods. Only animals with orbital lesions also selected the devalued food beneath the object. The results indicate a functional dissociation for the amygdala and orbital frontal cortex in reward assessment, depending on the type of the reinforcer available (objects vs. food). Finally, this is the first study indicating that the hippocampal formation is involved in the assessment of familiar nonfoods, but not in judging the current value of unconditioned and conditioned reinforcers.

The neurocognitive bases of human multimodal food perception: consciousness

This review explores how we become aware of the (integrated) flavor of food. In recent years, progress has been made understanding the neural correlates of consciousness. Experimental and computational data have been largely based on the visual system. Contemporary neurobiological frameworks of consciousness are reviewed, concluding that neural reverberation among forward- and back-projecting neural ensembles across brain areas is a common theme. In an attempt to extrapolate these concepts to the oral-sensory and olfactory systems involved with multimodal flavor perception, the integration of the sensory information of which into a flavor gestalt has been reviewed elsewhere (Verhagen, J.V., Engelen, L., 2006. The neurocognitive bases of human multimodal food perception: Sensory integration. Neurosci. Biobehav. Rev. 30(5): 613_650), I reconceptualize the flavor-sensory system by integrating it into a larger neural system termed the Homeostatic Interoceptive System (HIS). This system consists of an oral (taste, oral touch, etc.) and non-oral part (non oral-thermosensation, pain, etc.) which are anatomically and functionally highly similar. Consistent with this new concept and with a large volume of experimental data, I propose that awareness of intraoral food is related to the concomitant reverberant self-sustained activation of a coalition of neuronal subsets in agranular insula and orbitofrontal cortex (affect, hedonics) and agranular insula and perirhinal cortex (food identity), as well as the amygdala (affect and identity) in humans. I further discuss the functional anatomy in relation essential nodes. These formulations are by necessity to some extent speculative.

What, if anything, is the medial temporal lobe, and how can the amygdala be part of it if there is no such thing?

Should the medial temporal lobe (MTL) of primates--which includes allocortical structures such as the hippocampus, neocortical structures such as the parahippocampal cortex, and nuclear structures such as the basolateral amygdala--be considered a single "thing"? According to the prevailing view, here termed the reification theory, the answer is yes. According to this theory, the MTL functions as an amalgamated entity that provides the neuronal mechanisms for declarative memory; the greater the damage to the MTL or any of its components, the greater the deleterious effects on declarative memory. A countervailing view, here called the balkanization theory, holds that the various components of the MTL process and store different kinds of information. According to this theory, damage to each part of the MTL causes a unique set of behavioral deficits-some involving memory, others involving perception, and yet others involving response selection. The empirical neuropsychological evidence favors the balkanization theory, as do some new concepts in theoretical neuroanatomy.

The Role of Perirhinal Cortex in Visual Discrimination Learning for Visual Secondary Reinforcement in Rats

Perirhinal cortex in monkeys has been thought to be involved in visual associative learning. The authors examined rats' ability to make associations between visual stimuli in a visual secondary reinforcement task. Rats learned 2-choice visual discriminations for secondary visual reinforcement. They showed significant learning of discriminations before any primary reinforcement. Following bilateral perirhinal cortex lesions, rats continued to learn visual discriminations for visual secondary reinforcement at the same rate as before surgery. Thus, this study does not support a critical role of perirhinal cortex in learning for visual secondary reinforcement. Contrasting this result with other positive results, the authors suggest that the role of perirhinal cortex is in "within-object" associations and that it plays a much lesser role in stimulus-stimulus associations between objects.

The amygdala and reward

The amygdala -- an almond-shaped group of nuclei at the heart of the telencephalon -- has been associated with a range of cognitive functions, including emotion, learning, memory, attention and perception. Most current views of amygdala function emphasize its role in negative emotions, such as fear, and in linking negative emotions with other aspects of cognition, such as learning and memory. However, recent evidence supports a role for the amygdala in processing positive emotions as well as negative ones, including learning about the beneficial biological value of stimuli. Indeed, the amygdala's role in stimulus-reward learning might be just as important as its role in processing negative affect and fear conditioning.

Visual agnosia and Klüver-Bucy syndrome in marmosets (Callithrix jacchus) following ablation of inferotemporal cortex, with additional mnemonic effects of immunotoxic lesions of cholinergic projections to medial temporal areas

Inferotemporal ablations in the New World monkey, the common marmoset (Callithrix jacchus), produced a persistent impairment on visual discrimination learning and a florid, but transient, Klüver-Bucy syndrome. Monkeys with these ablations were impaired on acquisition of object discriminations to a high criterion and on concurrent discrimination learning, to a single high criterion across all trials. Neither the control monkeys nor the monkeys with inferotemporal ablations found acquisition more difficult when the component discriminations of a set were presented concurrently compared to consecutively, although the monkeys with inferotemporal ablations found acquisition under both these conditions somewhat more difficult than did control monkeys. This suggests that the severe impairment caused by inferotemporal ablations on concurrent learning measured across all trials is due to the need for sustained performance across a concurrent set rather than to the extra mnemonic demands of concurrent presentation. When immunotoxic lesions of the cholinergic projection to the hippocampal formation were added to the inferotemporal ablations, a further impairment on retention, and a differential impairment on concurrent, compared to consecutive, learning was observed. Previous studies have shown that lesions of the cholinergic projection to the hippocampus alone, or excitotoxic hippocampal lesions, do not affect simple visual discrimination learning. It is suggested that large inferotemporal ablations in monkeys produce a visual agnosia which causes severe 'psychic blindness' in the first instance, and a persistent impairment on visual discrimination learning. The hippocampus makes a contribution, which may be mnemonic, to discrimination performance after inferotemporal ablations.

Role of perirhinal cortex in object perception, memory, and associations

The perirhinal cortex plays a key role in acquiring knowledge about objects. It contributes to at least four cognitive functions, and recent findings provide new insights into how the perirhinal cortex contributes to each: first, it contributes to recognition memory in an automatic fashion; second, it probably contributes to perception as well as memory; third, it helps identify objects by associating together the different sensory features of an object; and fourth, it associates objects with other objects and with abstractions.

Impairments in visual discrimination learning and recognition memory produced by neurotoxic lesions of rhinal cortex in rhesus monkeys

Much work on the cognitive functions of the primate rhinal (i.e. entorhinal plus perirhinal) cortex has been based on aspiration lesions of this structure, which might disrupt fibres passing nearby and through the rhinal cortex in addition to removing the cell bodies of the rhinal cortex itself. To determine whether damage limited to the cell bodies of the rhinal cortex is sufficient to impair visual learning and memory, four rhesus monkeys (Macaca mulatta) were preoperatively trained on a battery of visual learning and memory tasks, including single-pair discrimination learning for primary reinforcement, single-pair discrimination reversals, concurrent discrimination learning and reversal, and delayed matching-to-sample. Following acquisition of these tasks and a preoperative performance test, ibotenic acid was injected bilaterally into the rhinal cortex, and the monkeys were retested. Consistent with the results of studies using aspiration lesions, the monkeys were impaired on single-pair discrimination learning as well as recognition memory performance postoperatively, although reliable reversal learning impairments were not observed. The magnitude of postoperative impairment in discrimination learning was not correlated with the magnitude of postoperative impairment in recognition memory, suggesting a possible dissociation between these functions within the rhinal cortex. The correspondence of behavioural deficits following aspiration and neurotoxic lesions of the rhinal cortex validates the attribution of various cognitive functions to this structure, based on the results of studies with aspiration lesions.

Learning motivational significance of visual cues for reward schedules requires rhinal cortex

The limbic system is necessary to associate stimuli with their motivational and emotional significance. The perirhinal cortex is directly connected to this system, and neurons in this region carry signals related to a monkey's progress through visually cued reward schedules. This task manipulates motivation by displaying different visual cues to indicate the amount of work remaining until reward delivery. We asked whether rhinal (that is, entorhinal and perirhinal) cortex is necessary to associate the visual cues with reward schedules. When faced with new visual cues in reward schedules, intact monkeys adjusted their motivation in the schedules, whereas monkeys with rhinal cortex removals failed to do so. Thus, the rhinal cortex is critical for forming associations between visual stimuli and their motivational significance.

Cognitive functions of the temporal lobe in the dog: a review

1 The current paper reviews the role of temporal lobe structures in learning and different kinds of memory, with an emphasis on behavioral tasks that re auditory stimuli. 2 The effects of lesions to structures in the temporal lobe were examined in separate groups of dogs, which were trained on an auditory spatial delayed response, or in a trial-unique auditory delayed match to sample recognition task. 3 Spatial memory was impaired after bilateral hippocampal lesions. On the other hand, neither an anterior temporal lesion or rhinal cortical injury nor combined lesion to the hippocampus and the anterior temporal lobe, affected postoperative retraining and performance of the spatial task. 4 Auditory recognition memory task was not impaired after a hippocampal and/or rhinal cortex lesion. However, postoperative retraining of the task was impaired after a lesion to auditory association areas. 5 These results confirm the role of the hippocampus in spatial memory in the dog. On the other hand, the organization of auditory recognition functions within the temporal lobe appears to be different from those described for visual recognition functions.

Control of response selection by reinforcer value requires interaction of amygdala and orbital prefrontal cortex

Goal-directed actions are guided by expected outcomes of those actions. Humans with bilateral damage to ventromedial prefrontal cortex, or the amygdala, are deficient in their ability to use information about positive and negative outcomes to guide their choice behavior. Similarly, rats and monkeys with orbital prefrontal or amygdala damage have been found to be impaired in their responses to changing values of outcomes. In the present study, we tested whether direct, functional interaction between the amygdala and the orbital prefrontal cortex is necessary for guiding behavior based on expected outcomes. Unlike control monkeys, rhesus monkeys with surgical disconnection of these two structures, achieved by crossed unilateral lesions of the amygdala in one hemisphere and orbital prefrontal cortex in the other, combined with forebrain commissurotomy, were unable to adjust their choice behavior after a change in the outcome (here, a reduction in the value of a particular reinforcer). The lesions did not affect motivation to work for a food reinforcer, or food preferences, per se. Hence, the amygdala and orbital prefrontal cortex act as part of an integrated neural system guiding decision-making and adaptive response selection.

Response differences in monkey TE and perirhinal cortex: stimulus association related to reward schedules

Anatomic and behavioral evidence shows that TE and perirhinal cortices are two directly connected but distinct inferior temporal areas. Despite this distinctness, physiological properties of neurons in these two areas generally have been similar with neurons in both areas showing selectivity for complex visual patterns and showing response modulations related to behavioral context in the sequential delayed match-to-sample (DMS) trials, attention, and stimulus familiarity. Here we identify physiological differences in the neuronal activity of these two areas. We recorded single neurons from area TE and perirhinal cortex while the monkeys performed a simple behavioral task using randomly interleaved visually cued reward schedules of one, two, or three DMS trials. The monkeys used the cue's relation to the reward schedule (indicated by the brightness) to adjust their behavioral performance. They performed most quickly and most accurately in trials in which reward was immediately forthcoming and progressively less well as more intermediate trials remained. Thus the monkeys appeared more motivated as they progressed through the trial schedule. Neurons in both TE and perirhinal cortex responded to both the visual cues related to the reward schedules and the stimulus patterns used in the DMS trials. As expected, neurons in both areas showed response selectivity to the DMS patterns, and significant, but small, modulations related to the behavioral context in the DMS trial. However, TE and perirhinal neurons showed strikingly different response properties. The latency distribution of perirhinal responses was centered 66 ms later than the distribution of TE responses, a larger difference than the 10-15 ms usually found in sequentially connected visual cortical areas. In TE, cue-related responses were related to the cue's brightness. In perirhinal cortex, cue-related responses were related to the trial schedules independently of the cue's brightness. For example, some perirhinal neurons responded in the first trial of any reward schedule including the one trial schedule, whereas other neurons failed to respond in the first trial but respond in the last trial of any schedule. The majority of perirhinal neurons had more complicated relations to the schedule. The cue-related activity of TE neurons is interpreted most parsimoniously as a response to the stimulus brightness, whereas the cue-related activity of perirhinal neurons is interpreted most parsimoniously as carrying associative information about the animal's progress through the reward schedule. Perirhinal cortex may be part of a system gauging the relation between work schedules and rewards.

Amount of training affects associatively-activated event representation

The effects of variations in the amount of training on behavioral plasticity were examined in three experiments that used appetitive Pavlovian conditioning procedures with rats. In experiments 1 and 2, an auditory conditioned stimulus (CS) substituted for a food unconditioned stimulus (US) in the acquisition of new learning about the food US after small numbers of CS-US pairings, but not after larger numbers of pairings. After limited exposure to the relation between the auditory CS and food, pairings of the CS with the toxin LiCl, in the absence of food, were sufficient to establish an aversion to the food US that was previously paired with that CS. This CS-mediated learning did not occur after more extensive exposure to the CS-food relation. In contrast, in experiment 3. mediated performance of previously-established conditioned responding was unaffected by the number of CS-US pairings used to establish that performance. Conditioned responding to the auditory CS remained sensitive to post-training devaluation of the food US regardless of the amount of initial CS-US training. Implications of these results for the investigations of cortical and other brain mechanisms of behavioral plasticity are discussed.