The role of ventral and orbital prefrontal cortex in conditional visuomotor learning and strategy use in rhesus monkeys (Macaca mulatta)

A cerebro-cerebellar network for learning visuomotor associations

Consensus is rapidly building to support a role for the cerebellum beyond motor function, but its contributions to non-motor learning remain poorly understood. Here, we provide behavioral, anatomical and computational evidence to demonstrate a causal role for the primate posterior lateral cerebellum in learning new visuomotor associations. Reversible inactivation of the posterior lateral cerebellum of male monkeys impeded the learning of new visuomotor associations, but had no effect on movement parameters, or on well-practiced performance of the same task. Using retrograde transneuronal transport of rabies virus, we identified a distinct cerebro-cerebellar network linking Purkinje cells in the posterior lateral cerebellum with a region of the prefrontal cortex that is critical in learning visuomotor associations. Together, these results demonstrate a causal role for the primate posterior lateral cerebellum in non-motor, reinforcement learning.

A tripartite view of the posterior cingulate cortex

The posterior cingulate cortex (PCC) is one of the least understood regions of the cerebral cortex. By contrast, the anterior cingulate cortex has been the subject of intensive investigation in humans and model animal systems, leading to detailed behavioural and computational theoretical accounts of its function. The time is right for similar progress to be made in the PCC given its unique anatomical and physiological properties and demonstrably important contributions to higher cognitive functions and brain diseases. Here, we describe recent progress in understanding the PCC, with a focus on convergent findings across species and techniques that lay a foundation for establishing a formal theoretical account of its functions. Based on this converging evidence, we propose that the broader PCC region contains three major subregions - the dorsal PCC, ventral PCC and retrosplenial cortex - that respectively support the integration of executive, mnemonic and spatial processing systems. This tripartite subregional view reconciles inconsistencies in prior unitary theories of PCC function and offers promising new avenues for progress.

Prefrontal cortex interactions with the amygdala in primates

This review addresses functional interactions between the primate prefrontal cortex (PFC) and the amygdala, with emphasis on their contributions to behavior and cognition. The interplay between these two telencephalic structures contributes to adaptive behavior and to the evolutionary success of all primate species. In our species, dysfunction in this circuitry creates vulnerabilities to psychopathologies. Here, we describe amygdala-PFC contributions to behaviors that have direct relevance to Darwinian fitness: learned approach and avoidance, foraging, predator defense, and social signaling, which have in common the need for flexibility and sensitivity to specific and rapidly changing contexts. Examples include the prediction of positive outcomes, such as food availability, food desirability, and various social rewards, or of negative outcomes, such as threats of harm from predators or conspecifics. To promote fitness optimally, these stimulus-outcome associations need to be rapidly updated when an associative contingency changes or when the value of a predicted outcome changes. We review evidence from nonhuman primates implicating the PFC, the amygdala, and their functional interactions in these processes, with links to experimental work and clinical findings in humans where possible.

Category learning in a recurrent neural network with reinforcement learning

It is known that humans and animals can learn and utilize category information quickly and efficiently to adapt to changing environments, and several brain areas are involved in learning and encoding category information. However, it is unclear that how the brain system learns and forms categorical representations from the view of neural circuits. In order to investigate this issue from the network level, we combine a recurrent neural network with reinforcement learning to construct a deep reinforcement learning model to demonstrate how the category is learned and represented in the network. The model consists of a policy network and a value network. The policy network is responsible for updating the policy to choose actions, while the value network is responsible for evaluating the action to predict rewards. The agent learns dynamically through the information interaction between the policy network and the value network. This model was trained to learn six stimulus-stimulus associative chains in a sequential paired-association task that was learned by the monkey. The simulated results demonstrated that our model was able to learn the stimulus-stimulus associative chains, and successfully reproduced the similar behavior of the monkey performing the same task. Two types of neurons were found in this model: one type primarily encoded identity information about individual stimuli; the other type mainly encoded category information of associated stimuli in one chain. The two types of activity-patterns were also observed in the primate prefrontal cortex after the monkey learned the same task. Furthermore, the ability of these two types of neurons to encode stimulus or category information was enhanced during this model was learning the task. Our results suggest that the neurons in the recurrent neural network have the ability to form categorical representations through deep reinforcement learning during learning stimulus-stimulus associations. It might provide a new approach for understanding neuronal mechanisms underlying how the prefrontal cortex learns and encodes category information.

Evolution of prefrontal cortex

Subdivisions of the prefrontal cortex (PFC) evolved at different times. Agranular parts of the PFC emerged in early mammals, and rodents, primates, and other modern mammals share them by inheritance. These are limbic areas and include the agranular orbital cortex and agranular medial frontal cortex (areas 24, 32, and 25). Rodent research provides valuable insights into the structure, functions, and development of these shared areas, but it contributes less to parts of the PFC that are specific to primates, namely, the granular, isocortical PFC that dominates the frontal lobe in humans. The first granular PFC areas evolved either in early primates or in the last common ancestor of primates and tree shrews. Additional granular PFC areas emerged in the primate stem lineage, as represented by modern strepsirrhines. Other granular PFC areas evolved in simians, the group that includes apes, humans, and monkeys. In general, PFC accreted new areas along a roughly posterior to anterior trajectory during primate evolution. A major expansion of the granular PFC occurred in humans in concert with other association areas, with modifications of corticocortical connectivity and gene expression, although current evidence does not support the addition of a large number of new, human-specific PFC areas.

The visual prefrontal cortex of anthropoids: interaction with temporal cortex in decision making and its role in the making of "visual animals"

The ventral prefrontal cortex (PFC) of primates-a region strongly implicated in decision making-receives highly processed visual sensory inputs from the inferior temporal cortex (ITC) and perirhinal cortex (PRC) and can therefore be considered visual PFC. Usually, the functions of temporal cortex and visual PFC have been discussed in separate literatures. By considering them together, we aim to clarify the ways in which fronto-temporal networks guide decision making. After discussing the ways in which visual PFC interacts with temporal cortex to promote decision making, we offer specific predictions about the selective roles of the ITC- and PRC-based fronto-temporal networks. Finally, we suggest that an increased reliance on visual PFC in anthropoid primates led to our emergence as 'visual' animals.

Reconciling the object and spatial processing views of the perirhinal cortex through task-relevant unitization

The perirhinal cortex is situated on the border between sensory association cortex and the hippocampal formation. It serves an important function as a transition area between the sensory neocortex and the medial temporal lobe. While the perirhinal cortex has traditionally been associated with object coding and the "what" pathway of the temporal lobe, current evidence suggests a broader function of the perirhinal cortex in solving feature ambiguity and processing complex stimuli. Besides fulfilling functions in object coding, recent neurophysiological findings in freely moving rodents indicate that the perirhinal cortex also contributes to spatial and contextual processing beyond individual sensory modalities. Here, we address how these two opposing views on perirhinal cortex-the object-centered and spatial-contextual processing hypotheses-may be reconciled. The perirhinal cortex is consistently recruited when different features can be merged perceptually or conceptually into a single entity. Features that are unitized in these entities include object information from multiple sensory domains, reward associations, semantic features and spatial/contextual associations. We propose that the same perirhinal network circuits can be flexibly deployed for multiple cognitive functions, such that the perirhinal cortex performs similar unitization operations on different types of information, depending on behavioral demands and ranging from the object-related domain to spatial, contextual and semantic information.

Divergent Strategies for Learning in Males and Females

A frequent assumption in value-based decision-making tasks is that agents make decisions based on the feature dimension that reward probabilities vary on. However, in complex, multidimensional environments, stimuli can vary on multiple dimensions at once, meaning that the feature deserving the most credit for outcomes is not always obvious. As a result, individuals may vary in the strategies used to sample stimuli across dimensions, and these strategies may have an unrecognized influence on decision-making. Sex is a proxy for multiple genetic and endocrine influences on behavior, including how environments are sampled. In this study, we examined the strategies adopted by female and male mice as they learned the value of stimuli that varied in both image and location in a visually cued two-armed bandit, allowing two possible dimensions to learn about. Female mice acquired the correct image-value associations more quickly than male mice, preferring a fundamentally different strategy. Female mice were more likely to constrain their decision-space early in learning by preferentially sampling one location over which images varied. Conversely, male mice were more likely to be inconsistent, changing their choice frequently and responding to the immediate experience of stochastic rewards. Individual strategies were related to sex-biased changes in neuronal activation in early learning. Together, we find that in mice, sex is associated with divergent strategies for sampling and learning about the world, revealing substantial unrecognized variability in the approaches implemented during value-based decision making.

COX5A Plays a Vital Role in Memory Impairment Associated With Brain Aging via the BDNF/ERK1/2 Signaling Pathway

Cytochrome c oxidase subunit Va (COX5A) is involved in maintaining normal mitochondrial function. However, little is known on the role of COX5A in the development and progress of Alzheimer’s disease (Martinez-Losa et al., 2018). In this study, we established and characterized the genomic profiles of genes expressed in the hippocampus of Senescence-Accelerated Mouse-prone 8 (SAMP8) mice, and revealed differential expression of COX5A among 12-month-aged SAMP8 mice and 2-month-aged SAMP8 mice. Newly established transgenic mice with systemic COX5A overexpression (51% increase) resulted in the improvement of spatial recognition memory and hippocampal synaptic plasticity, recovery of hippocampal CA1 dendrites, and activation of the BDNF/ERK1/2 signaling pathway in vivo. Moreover, mice with both COX5A overexpression and BDNF knockdown showed a poor recovery in spatial recognition memory as well as a decrease in spine density and branching of dendrites in CA1, when compared to mice that only overexpressed COX5A. In vitro studies supported that COX5A affected neuronal growth via BDNF. In summary, this study was the first to show that COX5A in the hippocampus plays a vital role in aging-related cognitive deterioration via BDNF/ERK1/2 regulation, and suggested that COX5A may be a potential target for anti-senescence drugs.

Specializations for reward-guided decision-making in the primate ventral prefrontal cortex

The estimated values of choices, and therefore decision-making based on those values, are influenced by both the chance that the chosen items or goods can be obtained (availability) and their current worth (desirability) as well as by the ability to link the estimated values to choices (a process sometimes called credit assignment). In primates, the prefrontal cortex (PFC) has been thought to contribute to each of these processes; however, causal relationships between particular subdivisions of the PFC and specific functions have been difficult to establish. Recent lesion-based research studies have defined the roles of two different parts of the primate PFC - the orbitofrontal cortex (OFC) and the ventral lateral frontal cortex (VLFC) - and their subdivisions in evaluating each of these factors and in mediating credit assignment during reward-based decision-making.

Learning the meaning of new stimuli increases the cross-correlated activity of prefrontal neurons

The prefrontal cortex (PF) has a key role in learning rules and generating associations between stimuli and responses also called conditional motor learning. Previous studies in PF have examined conditional motor learning at the single cell level but not the correlation of discharges between neurons at the ensemble level. In the present study, we recorded from two rhesus monkeys in the dorsolateral and the mediolateral parts of the prefrontal cortex to address the role of correlated firing of simultaneously recorded pairs during conditional motor learning. We trained two rhesus monkeys to associate three stimuli with three response targets, such that each stimulus was mapped to only one response. We recorded the neuronal activity of the same neuron pairs during learning of new associations and with already learned associations. In these tasks after a period of fixation, a visual instruction stimulus appeared centrally and three potential response targets appeared in three positions: right, left, and up from center. We found a higher number of neuron pairs significantly correlated and higher cross-correlation coefficients during stimulus presentation in the new than in the familiar mapping task. These results demonstrate that learning affects the PF neural correlation structure.

Contributions of Lateral and Orbital Frontal Regions to Abstract Rule Acquisition and Reversal in Monkeys

The ability to learn and follow abstract rules relies on intact prefrontal regions including the lateral prefrontal cortex (LPFC) and the orbitofrontal cortex (OFC). Here, we investigate the specific roles of these brain regions in learning rules that depend critically on the formation of abstract concepts as opposed to simpler input-output associations. To this aim, we tested monkeys with bilateral removals of either LPFC or OFC on a rapidly learned task requiring the formation of the abstract concept of same vs. different. While monkeys with OFC removals were significantly slower than controls at both acquiring and reversing the concept-based rule, monkeys with LPFC removals were not impaired in acquiring the task, but were significantly slower at rule reversal. Neither group was impaired in the acquisition or reversal of a delayed visual cue-outcome association task without a concept-based rule. These results suggest that OFC is essential for the implementation of a concept-based rule, whereas LPFC seems essential for its modification once established.

Learned Value Shapes Responses to Objects in Frontal and Ventral Stream Networks in Macaque Monkeys

We have an incomplete picture of how the brain links object representations to reward value, and how this information is stored and later retrieved. The orbitofrontal cortex (OFC), medial frontal cortex (MFC), and ventrolateral prefrontal cortex (VLPFC), together with the amygdala, are thought to play key roles in these processes. There is an apparent discrepancy, however, regarding frontal areas thought to encode value in macaque monkeys versus humans. To address this issue, we used fMRI in macaque monkeys to localize brain areas encoding recently learned image values. Each week, monkeys learned to associate images of novel objects with a high or low probability of water reward. Areas responding to the value of recently learned reward-predictive images included MFC area 10 m/32, VLPFC area 12, and inferior temporal visual cortex (IT). The amygdala and OFC, each thought to be involved in value encoding, showed little such effect. Instead, these 2 areas primarily responded to visual stimulation and reward receipt, respectively. Strong image value encoding in monkey MFC compared with OFC is surprising, but agrees with results from human imaging studies. Our findings demonstrate the importance of VLPFC, MFC, and IT in representing the values of recently learned visual images.

Outcome Modulation Across Tasks in the Primate Dorsolateral Prefrontal Cortex

Animals need to learn and to adapt to new and changing environments so that appropriate actions that lead to desirable outcomes are acquired within each context. The prefrontal cortex (PF) is known to underlie such function that directly implies that the outcome of each response must be represented in the brain for behavioral policies update. However, whether such PF signal is context dependent or it is a general representation beyond the specificity of a context is still unclear. Here, we analyzed the activity of neurons in the dorsolateral PF (PFdl) recorded while two monkeys performed two perceptual magnitude discrimination tasks. Both tasks were well known by the monkeys and unexpected changes did not occur but the difficulty of the task varied from trial to trial and thus the monkeys made mistakes in a proportion of trials. We show a context-independent coding of the response outcome with neurons maintaining similar selectivity in both task contexts. Using a classification method of the neural activity, we also show that the trial outcome could be well predicted from the activity of the same neurons in the two contexts. Altogether, our results provide evidence of high degree of outcome generality in PFdl.

Neuromodulation of Prefrontal Cortex in Non-Human Primates by Dopaminergic Receptors during Rule-Guided Flexible Behavior and Cognitive Control

The prefrontal cortex (PFC) is indispensable for several higher-order cognitive and executive capacities of primates, including representation of salient stimuli in working memory (WM), maintenance of cognitive task set, inhibition of inappropriate responses and rule-guided flexible behavior. PFC networks are subject to robust neuromodulation from ascending catecholaminergic systems. Disruption of these systems in PFC has been implicated in cognitive deficits associated with several neuropsychiatric disorders. Over the past four decades, a considerable body of work has examined the influence of dopamine on macaque PFC activity representing spatial WM. There has also been burgeoning interest in neuromodulation of PFC circuits involved in other cognitive functions of PFC, including representation of rules to guide flexible behavior. Here, we review recent neuropharmacological investigations conducted in our laboratory and others of the role of PFC dopamine receptors in regulating rule-guided behavior in non-human primates. Employing iontophoresis, we examined the effects of local manipulation of dopaminergic subtypes on neuronal activity during performance of rule-guided pro- and antisaccades, an experimental paradigm sensitive to PFC integrity, wherein deficits in performance are reliably observed in many neuropsychiatric disorders. We found dissociable effects of dopamine receptors on neuronal activity for rule representation and oculomotor responses and discuss these findings in the context of prior studies that have examined the role of dopamine in spatial delayed response tasks, attention, target selection, abstract rules, visuomotor learning and reward. The findings we describe here highlight the common features, as well as heterogeneity and context dependence of dopaminergic neuromodulation in regulating the efficacy of cognitive functions of PFC in health and disease.

Specialized Representations of Value in the Orbital and Ventrolateral Prefrontal Cortex: Desirability versus Availability of Outcomes

Advantageous foraging choices benefit from an estimation of two aspects of a resource's value: its current desirability and availability. Both orbitofrontal and ventrolateral prefrontal areas contribute to updating these valuations, but their precise roles remain unclear. To explore their specializations, we trained macaque monkeys on two tasks: one required updating representations of a predicted outcome's desirability, as adjusted by selective satiation, and the other required updating representations of an outcome's availability, as indexed by its probability. We evaluated performance on both tasks in three groups of monkeys: unoperated controls and those with selective, fiber-sparing lesions of either the OFC or VLPFC. Representations that depend on the VLPFC but not the OFC play a necessary role in choices based on outcome availability; in contrast, representations that depend on the OFC but not the VLPFC play a necessary role in choices based on outcome desirability.

No effect of hippocampal lesions on stimulus-response bindings

The hippocampus is believed to be important for rapid learning of arbitrary stimulus-response contingencies, or S-R bindings. In support of this, Schnyer et al. (2006) (Experiment 2) measured priming of reaction times (RTs) to categorise visual objects, and found that patients with medial temporal lobe damage, unlike healthy controls, failed to show evidence of reduced priming when response contingencies were reversed between initial and repeated categorisation of objects (a signature of S-R bindings). We ran a similar though extended object classification task on 6 patients who appear to have selective hippocampal lesions, together with 24 age-matched controls. Unlike Schnyer et al. (2006), we found that reversing response contingencies abolished priming in both controls and patients. Bayes Factors provided no reason to believe that response reversal had less effect on patients than controls. We therefore conclude that it is unlikely that the hippocampus is needed for S-R bindings.

•

Hippocampus is thought important for rapid binding of stimuli (S) and responses (R).

•

Six patients with hippocampal damage showed evidence of normal S-R bindings.

•

Both patients and controls showed priming of object size judgments.

•

Patients and controls showed equivalent priming reductions when responses reversed.

•

The hippocampus is not necessary for this type of S-R binding.

Insights into Seeing and Grasping: Distinguishing the Neural Correlates of Perception and Action

Vision contributes to both perception and visuomotor control, and it has been suggested that many higher brain structures specialize in one or the other function. An alternative view, presented here, is that most higher brain areas participate in both visuomotor and perceptual functions. In the anterior frontal cortex, for example, the activity of one population of neurons reflects perceptual reports about a visual stimulus, whereas the activity of an intermingled population reflects movements aimed at the same stimulus. Similarly, posterior parietal and inferior temporal areas appear to function in both visual perception and visuomotor control. Visuomotor signals in higher order cortical areas could contribute to the perception of one’s own action. They also might reflect the existence of two systems for visual information processing: one stressing accuracy for the control of movement and the other generating hypotheses about the world.

Rostrocaudal functional gradient among the pre-dorsal premotor cortex, dorsal premotor cortex and primary motor cortex in goal-directed motor behaviour

The dorsal premotor cortex residing in the dorsolateral aspect of area 6 is a rostrocaudally elongated area that is rostral to the primary motor cortex (M1) and caudal to the prefrontal cortex. This region, which is subdivided into rostral [pre-dorsal premotor cortex (pre-PMd)] and caudal [dorsal premotor cortex proper (PMd)] components, probably plays a central role in planning and executing actions to achieve a behavioural goal. In the present study, we investigated the functional specializations of the pre-PMd, PMd, and M1, because the synthesis of the specific functions performed by each area is considered to be essential. Neurons were recorded while monkeys performed a conditional visuo-goal task designed to include separate processes for determining a behavioural goal (reaching towards a right or left potential target) on the basis of visual object instructions, specifying actions (direction of reaching) to be performed on the basis of the goal, and preparing and executing the action. Neurons in the pre-PMd and PMd retrieved and maintained behavioural goals without encoding the visual features of the visual object instructions, and subsequently specified the actions by multiplexing the goals with the locations of the targets. Furthermore, PMd and M1 neurons played a major role in representing the action during movement preparation and execution, whereas the contribution of the pre-PMd progressively decreased as the time of the actual execution of the movement approached. These findings revealed that the multiple processing stages necessary for the realization of an action to accomplish a goal were implemented in an area-specific manner across a functional gradient from the pre-PMd to M1 that included the PMd as an intermediary.

A novel semi-immersive virtual reality visuo-motor task activates ventrolateral prefrontal cortex: a functional near-infrared spectroscopy study

OBJECTIVE

In the last few years, the interest in applying virtual reality systems for neurorehabilitation is increasing. Their compatibility with neuroimaging techniques, such as functional near-infrared spectroscopy (fNIRS), allows for the investigation of brain reorganization with multimodal stimulation and real-time control of the changes occurring in brain activity. The present study was aimed at testing a novel semi-immersive visuo-motor task (VMT), which has the features of being adopted in the field of neurorehabilitation of the upper limb motor function.

APPROACH

A virtual environment was simulated through a three-dimensional hand-sensing device (the LEAP Motion Controller), and the concomitant VMT-related prefrontal cortex (PFC) response was monitored non-invasively by fNIRS. Upon the VMT, performed at three different levels of difficulty, it was hypothesized that the PFC would be activated with an expected greater level of activation in the ventrolateral PFC (VLPFC), given its involvement in the motor action planning and in the allocation of the attentional resources to generate goals from current contexts. Twenty-one subjects were asked to move their right hand/forearm with the purpose of guiding a virtual sphere over a virtual path. A twenty-channel fNIRS system was employed for measuring changes in PFC oxygenated-deoxygenated hemoglobin (O2Hb/HHb, respectively).

MAIN RESULTS

A VLPFC O2Hb increase and a concomitant HHb decrease were observed during the VMT performance, without any difference in relation to the task difficulty.

SIGNIFICANCE

The present study has revealed a particular involvement of the VLPFC in the execution of the novel proposed semi-immersive VMT adoptable in the neurorehabilitation field.

Cognitive Translation Using the Rodent Touchscreen Testing Approach

The development of novel therapeutic avenues for the treatment of cognitive deficits in psychiatric and neurodegenerative disease is of high importance, yet progress in this field has been slow. One reason for this lack of success may lie in discrepancies between how cognitive functions are assessed in experimental animals and humans. In an attempt to bridge this translational gap, the rodent touchscreen testing platform is suggested as a translational tool. Specific examples of successful cross-species translation are discussed focusing on paired associate learning (PAL), the 5-choice serial reaction time task (5-CSRTT), the rodent continuous performance task (rCPT) and reversal learning. With ongoing research assessing the neurocognitive validity of tasks, the touchscreen approach is likely to become increasingly prevalent in translational cognitive research.

Specialized areas for value updating and goal selection in the primate orbitofrontal cortex

The macaque orbitofrontal cortex (OFC) is essential for selecting goals based on current, updated values of expected reward outcomes. As monkeys consume a given type of reward to satiety, its value diminishes, and OFC damage impairs the ability to shift goal choices away from devalued outcomes. To examine the contributions of OFC’s components to goal selection, we reversibly inactivated either its anterior (area 11) or posterior (area 13) parts. We found that neurons in area 13 must be active during the selective satiation procedure to enable the updating of outcome valuations. After this updating has occurred, however, area 13 is not needed to select goals based on this knowledge. In contrast, neurons in area 11 do not need to be active during the value-updating process. Instead, inactivation of this area during choices causes an impairment. These findings demonstrate selective and complementary specializations within the OFC.

DOI:http://dx.doi.org/10.7554/eLife.11695.001

Everyone knows that somehow, somewhere, the brain translates knowledge into action. In some people, however, knowledge and action become disconnected. These people behave in a way that either ignores or contradicts the knowledge that they have. They know what to do and can explain it to others, but – when the time comes to act – they do something else, something wrong.

Murray et al. have now investigated how a brain region called the orbitofrontal cortex helps to link knowledge and action in macaque monkeys, which, unlike rodents, have all of the main brain areas that make up the orbitofrontal cortex of humans. The monkeys learned to associate images with different types of food, and then performed a task where they chose between two images in order to get the food they wanted. On some days, one of the foods was less ‘valuable’ because the monkeys had already eaten a lot of it. In these circumstances, monkeys chose fewer of the images associated with that food.

By temporarily inactivating either the front or back region of the monkey’s orbitofrontal cortex at different times, Murray et al. showed that these regions make different contributions to decision making. Inactivating the back region of the orbitofrontal cortex disrupted the ability of monkeys to update their knowledge about the value of a particular foodstuff. However, inactivating the front part of the orbitofrontal cortex disrupted their ability to use this knowledge to select the images that led to the most valuable food. This contradicts the widely held belief that the orbitofrontal cortex acts as a single entity to update values and translate this knowledge into action.

Future work will need to investigate how, having translated knowledge into a chosen action, the orbitofrontal cortex stimulates the motor areas of the brain to generate the movements needed to perform that action.

DOI:http://dx.doi.org/10.7554/eLife.11695.002

Cognitive impairment in a young marmoset reveals lateral ventriculomegaly and a mild hippocampal atrophy: a case report

The number of studies that use the common marmoset (Callithrix jacchus) in various fields of neurosciences is increasing dramatically. In general, animals enter the study when their health status is considered satisfactory on the basis of classical clinical investigations. In behavioral studies, variations of score between individuals are frequently observed, some of them being considered as poor performers or outliers. Experimenters rarely consider the fact that it could be related to some brain anomaly. This raises the important issue of the reliability of such classical behavioral approaches without using complementary imaging, especially in animals lacking striking external clinical signs. Here we report the case of a young marmoset which presented a set of cognitive impairments in two different tasks compared to other age-matched animals. Brain imaging revealed a patent right lateral ventricular enlargement with a mild hippocampal atrophy. This abnormality could explain the cognitive impairments of this animal. Such a case points to the importance of complementing behavioral studies by imaging explorations to avoid experimental bias.

Neuronal representation of audio-place associations in the medial prefrontal cortex of rats

Stimulus-place associative task requires humans or animals to associate or map different stimuli with different locations. It is know that the medial prefrontal cortex (mPFC) in rats, also termed prelimbic cortex (PrL), is important for performing stimulus-place associations. However, little is known about how mPFC neurons encode stimulus-palce associations. To address this, the present study trained rats on an audio-place associative task, whereby the animals were required to associate two different tones with entering two different arms in a Y-shaped maze. Reversible inactivation of the mPFC by local infusion of the GABAA receptor agonist muscimol severely impaired the performance of rats on the associative task, again indicating an important role of mPFC in the task performance. Single-unit recording showed that a group of mPFC neurons (40/275, 14.5 %) fired preferentially for the audio-place associations, providing the first electrophysiological evidence for the involvement of mPFC cells in representing audio-place associations.

Movement-related activity during goal-directed hand actions in the monkey ventrolateral prefrontal cortex

Grasping actions require the integration of two neural processes, one enabling the transformation of object properties into corresponding motor acts, and the other involved in planning and controlling action execution on the basis of contextual information. The first process relies on parieto-premotor circuits, whereas the second is considered to be a prefrontal function. Up to now, the prefrontal cortex has been mainly investigated with conditional visuomotor tasks requiring a learned association between cues and behavioural output. To clarify the functional role of the prefrontal cortex in grasping actions, we recorded the activity of ventrolateral prefrontal (VLPF) neurons while monkeys (Macaca mulatta) performed tasks requiring reaching-grasping actions in different contextual conditions (in light and darkness, memory-guided, and in the absence of abstract learned rules). The results showed that the VLPF cortex contains neurons that are active during action execution (movement-related neurons). Some of them showed grip selectivity, and some also responded to object presentation. Most movement-related neurons discharged during action execution both with and without visual feedback, and this discharge typically did not change when the action was performed with object mnemonic information and in the absence of abstract rules. The findings of this study indicate that a population of VLPF neurons play a role in controlling goal-directed grasping actions in several contexts. This control is probably exerted within a wider network, involving parietal and premotor regions, where the role of VLPF movement-related neurons would be that of activating, on the basis of contextual information, the representation of the motor goal of the intended action (taking possession of an object) during action planning and execution.

Regional inactivations of primate ventral prefrontal cortex reveal two distinct mechanisms underlying negative bias in decision making

Dysregulation of the orbitofrontal and ventrolateral prefrontal cortices is implicated in anxiety and mood disorders, but the specific contributions of each region are unknown, including how they gate the impact of threat on decision making. To address this, the effects of GABAergic inactivation of these regions were studied in marmoset monkeys performing an instrumental approach-avoidance decision-making task that is sensitive to changes in anxiety. Inactivation of either region induced a negative bias away from punishment that could be ameliorated with anxiolytic treatment. However, whereas the effects of ventrolateral prefrontal cortex inactivation on punishment avoidance were seen immediately, those of orbitofrontal cortex inactivation were delayed and their expression was dependent upon an amygdala-anterior hippocampal circuit. We propose that these negative biases result from deficits in attentional control and punishment prediction, respectively, and that they provide the basis for understanding how distinct regional prefrontal dysregulation contributes to the heterogeneity of anxiety disorders with implications for cognitive-behavioral treatment strategies.

The effects of short-term and long-term learning on the responses of lateral intraparietal neurons to visually presented objects

The lateral intraparietal area (LIP) is thought to play an important role in the guidance of where to look and pay attention. LIP can also respond selectively to differently shaped objects. We sought to understand to what extent short-term and long-term experience with visual orienting determines the responses of LIP to objects of different shapes. We taught monkeys to arbitrarily associate centrally presented objects of various shapes with orienting either toward or away from a preferred spatial location of a neuron. The training could last for less than a single day or for several months. We found that neural responses to objects are affected by such experience, but that the length of the learning period determines how this neural plasticity manifests. Short-term learning affects neural responses to objects, but these effects are only seen relatively late after visual onset; at this time, the responses to newly learned objects resemble those of familiar objects that share their meaning or arbitrary association. Long-term learning affects the earliest bottom-up responses to visual objects. These responses tend to be greater for objects that have been associated with looking toward, rather than away from, LIP neurons' preferred spatial locations. Responses to objects can nonetheless be distinct, although they have been similarly acted on in the past and will lead to the same orienting behavior in the future. Our results therefore indicate that a complete experience-driven override of LIP object responses may be difficult or impossible. We relate these results to behavioral work on visual attention.

Sodium Channel Voltage-Gated Beta 2 Plays a Vital Role in Brain Aging Associated with Synaptic Plasticity and Expression of COX5A and FGF-2

The role of sodium channel voltage-gated beta 2 (SCN2B) in brain aging is largely unknown. The present study was therefore designed to determine the role of SCN2B in brain aging by using the senescence-accelerated mice prone 8 (SAMP8), a brain senescence-accelerated animal model, together with the SCN2B transgenic mice. The results showed that SAMP8 exhibited impaired learning and memory functions, assessed by the Morris water maze test, as early as 8 months of age. The messenger RNA (mRNA) and protein expressions of SCN2B were also upregulated in the prefrontal cortex at this age. Treatment with traditional Chinese anti-aging medicine Xueshuangtong (Panax notoginseng saponins, PNS) significantly reversed the SCN2B expressions in the prefrontal cortex, resulting in improved learning and memory. Moreover, SCN2B knockdown transgenic mice were generated and bred to determine the roles of SCN2B in brain senescence. A reduction in the SCN2B level by 60.68% resulted in improvement in the hippocampus-dependent spatial recognition memory and long-term potential (LTP) slope of field excitatory postsynaptic potential (fEPSP), followed by an upregulation of COX5A mRNA levels and downregulation of fibroblast growth factor-2 (FGF-2) mRNA expression. Together, the present findings indicated that SCN2B could play an important role in the aging-related cognitive deterioration, which is associated with the regulations of COX5A and FGF-2. These findings could provide the potential strategy of candidate target to develop antisenescence drugs for the treatment of brain aging.

Functional Specialization within Macaque Dorsolateral Prefrontal Cortex for the Maintenance of Task Rules and Cognitive Control

The abilities of switching between and maintaining task rules are fundamental aspects of goal-oriented behavior. The PFC is thought to implement the cognitive processes underling such rule-based behavior, but the specific contributions of the several cytoarchitecturally distinct subfields of PFC remain poorly understood. Here, we used bilateral cryogenic deactivation to investigate the relative contributions of two regions of the dorsolateral PFC (dlPFC)—the inferior dlPFC (idlPFC) area, consisting of the cortex lining the caudal principal sulcus, and the dorsally adjacent superior dlPFC (sdlPFC)—to different aspects of rule-based behavior. Macaque monkeys performed two variants of a task that required them to alternate unpredictably between eye movements toward (prosaccade) or away from (antisaccade) a visual stimulus. In one version of the task, the current rule was overtly cued. In the second, the task rule was uncued, and successful performance required the animals to detect rule changes on the basis of reward outcome and subsequently maintain the current task rule within working memory. Deactivation of the idlPFC impaired the monkeys' ability to perform pro- and antisaccades in the uncued task only. In contrast, deactivation of the sdlPFC had no effect on performance in either task. Combined deactivation of idlPFC and sdlPFC impaired performance on antisaccade, but not prosaccade, trials in both task variants. These results suggest that the idlPFC is required for mnemonic processes involved in maintenance of task rules, whereas both idlPFC and sdlPFC together are necessary for the deployment of the cognitive control required to perform antisaccades. Together, these data support the concept of a functional specialization of subregions within the dlPFC for rule-guided behavior.

Absence of "Warm-Up" during Active Avoidance Learning in a Rat Model of Anxiety Vulnerability: Insights from Computational Modeling

Avoidance behaviors, in which a learned response causes omission of an upcoming punisher, are a core feature of many psychiatric disorders. While reinforcement learning (RL) models have been widely used to study the development of appetitive behaviors, less attention has been paid to avoidance. Here, we present a RL model of lever-press avoidance learning in Sprague-Dawley (SD) rats and in the inbred Wistar Kyoto (WKY) rat, which has been proposed as a model of anxiety vulnerability. We focus on “warm-up,” transiently decreased avoidance responding at the start of a testing session, which is shown by SD but not WKY rats. We first show that a RL model can correctly simulate key aspects of acquisition, extinction, and warm-up in SD rats; we then show that WKY behavior can be simulated by altering three model parameters, which respectively govern the tendency to explore new behaviors vs. exploit previously reinforced ones, the tendency to repeat previous behaviors regardless of reinforcement, and the learning rate for predicting future outcomes. This suggests that several, dissociable mechanisms may contribute independently to strain differences in behavior. The model predicts that, if the “standard” inter-session interval is shortened from 48 to 24 h, SD rats (but not WKY) will continue to show warm-up; we confirm this prediction in an empirical study with SD and WKY rats. The model further predicts that SD rats will continue to show warm-up with inter-session intervals as short as a few minutes, while WKY rats will not show warm-up, even with inter-session intervals as long as a month. Together, the modeling and empirical data indicate that strain differences in warm-up are qualitative rather than just the result of differential sensitivity to task variables. Understanding the mechanisms that govern expression of warm-up behavior in avoidance may lead to better understanding of pathological avoidance, and potential pathways to modify these processes.

Contributions of the hippocampus and entorhinal cortex to rapid visuomotor learning in rhesus monkeys

The hippocampus and adjacent structures in the medial temporal lobe are essential for establishing new associative memories. Despite this knowledge, it is not known whether the hippocampus proper is essential for establishing such memories, nor is it known whether adjacent regions like the entorhinal cortex might contribute. To test the contributions of these regions to the formation of new associative memories, we trained rhesus monkeys to rapidly acquire arbitrary visuomotor associations, i.e., associations between visual stimuli and spatially directed actions. We then assessed the effects of reversible inactivations of either the hippocampus (Experiment 1) or entorhinal cortex (Experiment 2) on the within-session rate of learning. For comparison, we also evaluated the effects of the inactivations on performance of problems of the same type that had been well learned prior to any inactivations. We found that inactivation of the entorhinal cortex but not hippocampus produced impairments in acquiring novel arbitrary associations. The impairment did not extend to the familiar, previously established associations. These data indicate that the entorhinal cortex is causally involved in establishing new associations, as opposed to retrieving previously learned associations. Published 2014. This article is a U.S. Government work and is in the public domain in the USA.

Medial-lateral organization of the orbitofrontal cortex

Emerging evidence suggests that specific cognitive functions localize to different subregions of OFC, but the nature of these functional distinctions remains unclear. One prominent theory, derived from human neuroimaging, proposes that different stimulus valences are processed in separate orbital regions, with medial and lateral OFC processing positive and negative stimuli, respectively. Thus far, neurophysiology data have not supported this theory. We attempted to reconcile these accounts by recording neural activity from the full medial-lateral extent of the orbital surface in monkeys receiving rewards and punishments via gain or loss of secondary reinforcement. We found no convincing evidence for valence selectivity in any orbital region. Instead, we report differences between neurons in central OFC and those on the inferior-lateral orbital convexity, in that they encoded different sources of value information provided by the behavioral task. Neurons in inferior convexity encoded the value of external stimuli, whereas those in OFC encoded value information derived from the structure of the behavioral task. We interpret these results in light of recent theories of OFC function and propose that these distinctions, not valence selectivity, may shed light on a fundamental organizing principle for value processing in orbital cortex.

Electrophysiological responses to feedback during the application of abstract rules

Much research focuses on how people acquire concrete stimulus-response associations from experience; however, few neuroscientific studies have examined how people learn about and select among abstract rules. To address this issue, we recorded ERPs as participants performed an abstract rule-learning task. In each trial, they viewed a sample number and two test numbers. Participants then chose a test number using one of three abstract mathematical rules they freely selected from: greater than the sample number, less than the sample number, or equal to the sample number. No one rule was always rewarded, but some rules were rewarded more frequently than others. To maximize their earnings, participants needed to learn which rules were rewarded most frequently. All participants learned to select the best rules for repeating and novel stimulus sets that obeyed the overall reward probabilities. Participants differed, however, in the extent to which they overgeneralized those rules to repeating stimulus sets that deviated from the overall reward probabilities. The feedback-related negativity (FRN), an ERP component thought to reflect reward prediction error, paralleled behavior. The FRN was sensitive to item-specific reward probabilities in participants who detected the deviant stimulus set, and the FRN was sensitive to overall reward probabilities in participants who did not. These results show that the FRN is sensitive to the utility of abstract rules and that the individual's representation of a task's states and actions shapes behavior as well as the FRN.

Cortico-basal ganglia networks subserving goal-directed behavior mediated by conditional visuo-goal association

Action is often executed according to information provided by a visual signal. As this type of behavior integrates two distinct neural representations, perception and action, it has been thought that identification of the neural mechanisms underlying this process will yield deeper insights into the principles underpinning goal-directed behavior. Based on a framework derived from conditional visuomotor association, prior studies have identified neural mechanisms in the dorsal premotor cortex (PMd), dorsolateral prefrontal cortex (dlPFC), ventrolateral prefrontal cortex (vlPFC), and basal ganglia (BG). However, applications resting solely on this conceptualization encounter problems related to generalization and flexibility, essential processes in executive function, because the association mode involves a direct one-to-one mapping of each visual signal onto a particular action. To overcome this problem, we extend this conceptualization and postulate a more general framework, conditional visuo-goal association. According to this new framework, the visual signal identifies an abstract behavioral goal, and an action is subsequently selected and executed to meet this goal. Neuronal activity recorded from the four key areas of the brains of monkeys performing a task involving conditional visuo-goal association revealed three major mechanisms underlying this process. First, visual-object signals are represented primarily in the vlPFC and BG. Second, all four areas are involved in initially determining the goals based on the visual signals, with the PMd and dlPFC playing major roles in maintaining the salience of the goals. Third, the cortical areas play major roles in specifying action, whereas the role of the BG in this process is restrictive. These new lines of evidence reveal that the four areas involved in conditional visuomotor association contribute to goal-directed behavior mediated by conditional visuo-goal association in an area-dependent manner.

Encoding of rules by neurons in the human dorsolateral prefrontal cortex

We use rules to extend learned behavior beyond specific instances to general scenarios. The prefrontal cortex (PFC) is thought to play an important role in representing rules, as evidenced by subjects who have difficulty in following rules after PFC damage and by animal studies demonstrating rule sensitivity of individual PFC neurons. How rules are instantiated at the single-neuronal level in the human brain, however, remains unclear. Here, we recorded from individual neurons in the human dorsolateral prefrontal cortex (DLPFC) as subjects performed a task in which they evaluated pairs of images using either of 2 abstract rules. We find that DLPFC neurons selectively encoded these rules while carrying little information about the subjects' responses or the sensory cues used to guide their decisions.

NMDA antagonist ketamine reduces task selectivity in macaque dorsolateral prefrontal neurons and impairs performance of randomly interleaved prosaccades and antisaccades

Ketamine, an NMDA receptor antagonist, has been shown to induce behavioral abnormalities in humans that mimic the positive, negative, and most importantly cognitive deficits observed in schizophrenia. Similar cognitive deficits have been observed in nonhuman primates after a subanesthetic dose of ketamine, including an impairment in their ability to perform the antisaccade task, which requires the suppression of a prosaccade toward a flashed stimulus and the generation of a saccade in the opposite direction. The neural basis underlying these cognitive impairments remains unknown. Here, we recorded single-neuron activity in the lateral prefrontal cortex of macaque monkeys before and after the administration of subanesthetic doses of ketamine during the performance of randomly interleaved prosaccade and antisaccade trials. Ketamine impeded the monkeys' ability to maintain and apply the correct task rule and increased reaction times of prosaccades and antisaccades. These behavioral changes were associated with an overall increase in activity of PFC neurons and a reduction in their task selectivity. Our results suggest that the mechanism underlying ketamine-induced cognitive abnormalities may be the nonspecific increase in PFC activity and the associated reduction of task selectivity.

Multisynaptic projections from the ventrolateral prefrontal cortex to the dorsal premotor cortex in macaques - anatomical substrate for conditional visuomotor behavior

Lines of evidence indicate that both the ventrolateral prefrontal cortex (vlPFC) (areas 45/12) and dorsal premotor cortex (PMd) (rostral F2 in area 6) are crucially involved in conditional visuomotor behavior, in which it is required to determine an action based on an associated visual object. However, virtually no direct projections appear to exist between the vlPFC and PMd. In the present study, to elucidate possible multisynaptic networks linking the vlPFC to the PMd, we performed a series of neuroanatomical tract-tracing experiments in macaque monkeys. First, we identified cortical areas that send projection fibers directly to the PMd by injecting Fast Blue into the PMd. Considerable retrograde labeling occurred in the dorsal prefrontal cortex (dPFC) (areas 46d/9/8B/8Ad), dorsomedial motor cortex (dmMC) (F7 and presupplementary motor area), rostral cingulate motor area, and ventral premotor cortex (F5 and area 44), whereas the vlPFC was virtually devoid of neuronal labeling. Second, we injected the rabies virus, a retrograde transneuronal tracer, into the PMd. At 3 days after the rabies injections, second-order neurons were labeled in the vlPFC (mainly area 45), indicating that the vlPFC disynaptically projects to the PMd. Finally, to determine areas that connect the vlPFC to the PMd indirectly, we carried out an anterograde/retrograde dual-labeling experiment in single monkeys. By examining the distribution of axon terminals labeled from the vlPFC and cell bodies labeled from the PMd, we found overlapping labels in the dPFC and dmMC. These results indicate that the vlPFC outflow is directed toward the PMd in a multisynaptic fashion through the dPFC and/or dmMC.

Considering anger from a cognitive neuroscience perspective

The goal of this paper is to consider anger from a cognitive neuroscience perspective. Five main claims are made: first, reactive aggression is the ultimate behavioral expression of anger and thus we can begin to understand anger by understanding reactive aggression. Second, neural systems implicated in reactive aggression (amygdala, hypothalamus, and periaqueductal gray; the basic threat system) are critically implicated in anger. Factors such as exposure to extreme threat that increase the responsiveness of these systems, should be (and are in the context of posttraumatic stress disorder), associated with increased anger. Third, regions of frontal cortex implicated in regulating the basic threat system, when dysfunctional (e.g., in the context of lesions) should be associated with increased anger. Fourth, frustration occurs when an individual continues to do an action in the expectation of a reward but does not actually receive that reward, and is associated with anger. Individuals who show impairment in the ability to alter behavioral responding when actions no longer receive their expected rewards should be (and are in the context of psychopathy) associated with increased anger. Fifth, someone not doing what another person wants them to do (particularly if this thwarts the person's goal) is frustrating and consequently anger inducing. The response to such a frustrating social event relies on the neural architecture implicated in changing behavioral responses in nonsocial frustrating situations. WIREs Cogn Sci 2012, 3:65-74. doi: 10.1002/wcs.154 This article is categorized under: Psychology > Brain Function and Dysfunction.

Compositionality of rule representations in human prefrontal cortex

Rules are widely used in everyday life to organize actions and thoughts in accordance with our internal goals. At the simplest level, single rules can be used to link individual sensory stimuli to their appropriate responses. However, most tasks are more complex and require the concurrent application of multiple rules. Experiments on humans and monkeys have shown the involvement of a frontoparietal network in rule representation. Yet, a fundamental issue still needs to be clarified: Is the neural representation of multiple rules compositional, that is, built on the neural representation of their simple constituent rules? Subjects were asked to remember and apply either simple or compound rules. Multivariate decoding analyses were applied to functional magnetic resonance imaging data. Both ventrolateral frontal and lateral parietal cortex were involved in compound representation. Most importantly, we were able to decode the compound rules by training classifiers only on the simple rules they were composed of. This shows that the code used to store rule information in prefrontal cortex is compositional. Compositional coding in rule representation suggests that it might be possible to decode other complex action plans by learning the neural patterns of the known composing elements.

Mechanisms of rule acquisition and rule following in inductive reasoning

Despite the recent interest in the neuroanatomy of inductive reasoning processes, the regional specificity within prefrontal cortex (PFC) for the different mechanisms involved in induction tasks remains to be determined. In this study, we used fMRI to investigate the contribution of PFC regions to rule acquisition (rule search and rule discovery) and rule following. Twenty-six healthy young adult participants were presented with a series of images of cards, each consisting of a set of circles numbered in sequence with one colored blue. Participants had to predict the position of the blue circle on the next card. The rules that had to be acquired pertained to the relationship among succeeding stimuli. Responses given by subjects were categorized in a series of phases either tapping rule acquisition (responses given up to and including rule discovery) or rule following (correct responses after rule acquisition). Mid-dorsolateral PFC (mid-DLPFC) was active during rule search and remained active until successful rule acquisition. By contrast, rule following was associated with activation in temporal, motor, and medial/anterior prefrontal cortex. Moreover, frontopolar cortex (FPC) was active throughout the rule acquisition and rule following phases before a rule became familiar. We attributed activation in mid-DLPFC to hypothesis generation and in FPC to integration of multiple separate inferences. The present study provides evidence that brain activation during inductive reasoning involves a complex network of frontal processes and that different subregions respond during rule acquisition and rule following phases.

Dissociation of prefrontal cortex and nucleus accumbens dopaminergic systems in conditional learning in rats

There is converging evidence that the prefrontal and mesolimbic dopaminergic (DAergic) systems are involved in the performance of a variety of tasks that require the use of contextual, or task-setting, information to select an appropriate response from a number of candidate responses. Performance on tasks of this nature are impaired in schizophrenia and in rats exposed to psychotomimetics; impairments that are often attenuated by administration of dopamine (DA) antagonists. Rats were trained on either a complex instrumental discrimination task, that required the use of task-setting cues, or a simple discrimination task that did not. Following training, microdialysis probes were implanted unilaterally in either the medial prefrontal cortex (mPFC) or nucleus accumbens (NAc) and samples were collected in freely moving animals during a behavioural test session. In Experiment 1, we found no difference in levels of DA in the mPFC of rats while they were performing the two discrimination tasks. Rats that performed the complex task did, however, show significantly higher mPFC DA levels relative to rats in the simple discrimination condition following the end of the behavioural test session. In Experiment 2, rats performing the conditional discrimination showed lower levels of DA in the NAc compared to the simple discrimination group both during the test session and after it. These results provide direct evidence that conditional discrimination tasks engage frontal and mesolimbic DAergic systems and are consistent with the proposal that regulation of fronto-striatal DA is involved in aspects of cognitive control that are known to be impaired in individuals with schizophrenia.

Rule-guided executive control of response inhibition: functional topography of the inferior frontal cortex

Background

The human inferior frontal cortex (IFC) is a large heterogeneous structure with distinct cytoarchitectonic subdivisions and fiber connections. It has been found involved in a wide range of executive control processes from target detection, rule retrieval to response control. Since these processes are often being studied separately, the functional organization of executive control processes within the IFC remains unclear.

Methodology/Principal Findings

We conducted an fMRI study to examine the activities of the subdivisions of IFC during the presentation of a task cue (rule retrieval) and during the performance of a stop-signal task (requiring response generation and inhibition) in comparison to a not-stop task (requiring response generation but not inhibition). We utilized a mixed event-related and block design to separate brain activity in correspondence to transient control processes from rule-related and sustained control processes. We found differentiation in control processes within the IFC. Our findings reveal that the bilateral ventral-posterior IFC/anterior insula are more active on both successful and unsuccessful stop trials relative to not-stop trials, suggesting their potential role in the early stage of stopping such as triggering the stop process. Direct countermanding seems to be outside of the IFC. In contrast, the dorsal-posterior IFC/inferior frontal junction (IFJ) showed transient activity in correspondence to the infrequent presentation of the stop signal in both tasks and the left anterior IFC showed differential activity in response to the task cues. The IFC subdivisions also exhibited similar but distinct patterns of functional connectivity during response control.

Conclusions/Significance

Our findings suggest that executive control processes are distributed across the IFC and that the different subdivisions of IFC may support different control operations through parallel cortico-cortical and cortico-striatal circuits.

Differential contributions of the primate ventrolateral prefrontal and orbitofrontal cortex to serial reversal learning

The discrimination reversal paradigm is commonly used to measure a subject's ability to adapt their behavior according to changes in stimulus-reward contingencies. Human functional neuroimaging studies have demonstrated activations in the lateral orbitofrontal cortex (OFC) and the inferior frontal gyrus (IFG) in subjects performing this task. Excitotoxic lesions of analogous regions in marmosets have revealed, however, that although the OFC is indeed critical for reversal learning, ventrolateral prefrontal cortex (VLPFC) (analogous to IFG) is not, contributing instead to higher order processing, such as that required in attentional set-shifting and strategy transfer. One major difference between the marmoset and human studies has been the level of training subjects received in reversal learning, being far greater in the latter. Since exposure to repeated contingency changes, as occurs in serial reversal learning, is likely to trigger the development of higher order, rule-based strategies, we hypothesized a critical role of the marmoset VLPFC in performance of a serial reversal learning paradigm. After extensive training in reversal learning, marmosets received an excitotoxic lesion of the VLPFC, OFC, or a sham control procedure. In agreement with our prediction, postsurgery, VLPFC lesioned animals were impaired in performing a series of discrimination reversals, but only when novel visual stimuli were introduced. In contrast, OFC lesioned animals were impaired regardless of whether the visual stimuli were the same or different from those used during presurgery training. Together, these data demonstrate the heterogeneous but interrelated involvement of primate OFC and VLPFC in the performance of serial reversal learning.

Brain substrates of behavioral programs associated with self-regulation

The present paper proposes that four neuromodulator systems underpin highly generalized behavioral sets, but each targets either dorsomedial or ventrolateral cortical systems, where it produces its effects in either a proactive or reactive orientation to the environment. This way systems are discriminated that control reactive approach (dopaminergic), reactive avoidance (cholinergic), proactive behavior (noradrenergic), and withdrawal (serotonergic). This model is compared with models of temperament, affect, personality, and so-called two-system models from psychology. Although the present model converges with previous models that point to a basic scheme underlying temperamental and affective space, at the same time it suggest that specific additional discriminations are necessary to improve descriptive fit to data and solve inconsistencies and confusions. We demonstrate how proactive and reactive actions and controls can be confused, and that this has many potential implications for psychology and neurobiology. We uncover conceptual problems regarding constructs such as effortful control, positive affect, approach-avoidance, extraversion, impulsivity, impulse-control, and goal-directedness of behavior. By delineating those problems, our approach also opens up ways to tackle them.