Reward-related choices determine information timing and flow across macaque lateral prefrontal cortex

Home-Cage Training for Non-Human Primates: An Opportunity to Reduce Stress and Study Natural Behavior in Neurophysiology Experiments

Research involving non-human primates remains a cornerstone in fields such as biomedical research and systems neuroscience. However, the daily routines of laboratory work can induce stress in these animals, potentially compromising their well-being and the reliability of experimental outcomes. To address this, many laboratories have adopted home-cage training protocols to mitigate stress caused by routine procedures such as transport and restraint-a factor that can impact both macaque physiology and experimental validity. This review explores the primary methods and experimental setups employed in home-cage training, highlighting their potential not only to address ethical concerns surrounding animal welfare but also to reduce training time and risks for the researchers. Furthermore, by combining home-cage training with wireless recordings, it becomes possible to expand research opportunities in behavioral neurophysiology with non-human primates. This approach enables the study of various cognitive processes in more naturalistic settings, thereby increasing the ecological validity of scientific findings through innovative experimental designs that thoroughly investigate the complexity of the animals' natural behavior.

A Functional Magnetic Resonance Imaging Investigation of Hot and Cool Executive Functions in Reward and Competition

Social and environmental influences are important for learning. However, the influence of reward and competition during social learning is less understood. The literature suggests that the ventromedial prefrontal cortex is implicated in hot executive functioning (EF), while the dorsolateral prefrontal cortex is related to cool EF. In addition, reward processing deficits are associated with atypical connectivity between the nucleus accumbens and the dorsofrontal regions. Here, we used functional magnetic resonance imaging (fMRI) to determine the role of hot and cool EF in reward processing and their relationship to performance under social competition. We adapted a reward-based n-back task to examine the neural correlates of hot and cool EF and the reward influence on performance during competition. A total of 29 healthy adults showed cortical activation associated with individual differences in EF abilities during fMRI scans. Hot and cool EF activated distinct networks in the right insula, hippocampus, left caudate nucleus, and superior parietal gyrus during the no-competition task, while they differentially activated the right precuneus and caudate nucleus in the competition condition. Further analysis revealed correlations between the Hot-Cool network and reward sensitivity and risk-taking behaviour. The findings provided further insights into the neural basis of hot and cool EF engagement in the socio-emotional regulation for learning.

Prefrontal cortex neuronal ensembles dynamically encode task features during associative memory and virtual navigation

Neuronal populations expand their information-encoding capacity using mixed selective neurons. This is particularly prominent in association areas such as the lateral prefrontal cortex (LPFC), which integrate information from multiple sensory systems. However, during conditions that approximate natural behaviors, it is unclear how LPFC neuronal ensembles process space- and time-varying information about task features. Here, we show that, during a virtual reality task with naturalistic elements that requires associative memory, individual neurons and neuronal ensembles in the primate LPFC dynamically mix unconstrained features of the task, such as eye movements, with task-related visual features. Neurons in dorsal regions show more selectivity for space and eye movements, while ventral regions show more selectivity for visual features, representing them in a separate subspace. In summary, LPFC neurons exhibit dynamic and mixed selectivity for unconstrained and constrained task elements, and neural ensembles can separate task features in different subspaces.

Ventral frontostriatal circuitry mediates the computation of reinforcement from symbolic gains and losses

Reinforcement learning (RL), particularly in primates, is often driven by symbolic outcomes. However, it is usually studied with primary reinforcers. To examine the neural mechanisms underlying learning from symbolic outcomes, we trained monkeys on a task in which they learned to choose options that led to gains of tokens and avoid choosing options that led to losses of tokens. We then recorded simultaneously from the orbitofrontal cortex (OFC), ventral striatum (VS), amygdala (AMY), and mediodorsal thalamus (MDt). We found that the OFC played a dominant role in coding token outcomes and token prediction errors. The other areas contributed complementary functions, with the VS coding appetitive outcomes and the AMY coding the salience of outcomes. The MDt coded actions and relayed information about tokens between the OFC and VS. Thus, the OFC leads the processing of symbolic RL in the ventral frontostriatal circuitry.

Different Subregions of Monkey Lateral Prefrontal Cortex Respond to Abstract Sequences and Their Components

Sequential information permeates daily activities, such as when watching for the correct series of buildings to determine when to get off the bus or train. These sequences include periodicity (the spacing of the buildings), the identity of the stimuli (the kind of house), and higher-order more abstract rules that may not depend on the exact stimulus (e.g., house, house, house, business). Previously, we found that the posterior fundus of area 46 in the monkey lateral prefrontal cortex (LPFC) responds to rule changes in such abstract visual sequences. However, it is unknown if this region responds to other components of the sequence, i.e., image periodicity and identity, in isolation. Further, it is unknown if this region dissociates from other, more ventral LPFC subregions that have been associated with sequences and their components. To address these questions, we used awake functional magnetic resonance imaging in three male macaque monkeys during two no-report visual tasks. One task contained abstract visual sequences, and the other contained no visual sequences but maintained the same image periodicity and identities. We found the fundus of area 46 responded only to abstract sequence rule violations. In contrast, the ventral bank of area 46 responded to changes in image periodicity and identity, but not changes in the abstract sequence. These results suggest a functional specialization within anatomical substructures of LPFC to signal different kinds of stimulus regularities. This specialization may provide key scaffolding to identify abstract patterns and construct complex models of the world for daily living.

Contribution of amygdala to dynamic model arbitration under uncertainty

Intrinsic uncertainty in the reward environment requires the brain to run multiple models simultaneously to predict outcomes based on preceding cues or actions, commonly referred to as stimulus- and action-based learning. Ultimately, the brain also must adopt appropriate choice behavior using reliability of these models. Here, we combined multiple experimental and computational approaches to quantify concurrent learning in monkeys performing tasks with different levels of uncertainty about the model of the environment. By comparing behavior in control monkeys and monkeys with bilateral lesions to the amygdala or ventral striatum, we found evidence for dynamic, competitive interaction between stimulus-based and action-based learning, and for a distinct role of the amygdala. Specifically, we demonstrate that the amygdala adjusts the initial balance between the two learning systems, thereby altering the interaction between arbitration and learning that shapes the time course of both learning and choice behaviors. This novel role of the amygdala can account for existing contradictory observations and provides testable predictions for future studies into circuit-level mechanisms of flexible learning and choice under uncertainty.

Multiscale chemogenetic dissection of fronto-temporal top-down regulation for object memory in primates

Visual object memory is a fundamental element of various cognitive abilities, and the underlying neural mechanisms have been extensively examined especially in the anterior temporal cortex of primates. However, both macroscopic large-scale functional network in which this region is embedded and microscopic neuron-level dynamics of top-down regulation it receives for object memory remains elusive. Here, we identified the orbitofrontal node as a critical partner of the anterior temporal node for object memory by combining whole-brain functional imaging during rest and a short-term object memory task in male macaques. Focal chemogenetic silencing of the identified orbitofrontal node downregulated both the local orbitofrontal and remote anterior temporal nodes during the task, in association with deteriorated mnemonic, but not perceptual, performance. Furthermore, imaging-guided neuronal recordings in the same monkeys during the same task causally revealed that orbitofrontal top-down modulation enhanced stimulus-selective mnemonic signal in individual anterior temporal neurons while leaving bottom-up perceptual signal unchanged. Furthermore, similar activity difference was also observed between correct and mnemonic error trials before silencing, suggesting its behavioral relevance. These multifaceted but convergent results provide a multiscale causal understanding of dynamic top-down regulation of the anterior temporal cortex along the ventral fronto-temporal network underpinning short-term object memory in primates.

Ventral frontostriatal circuitry mediates the computation of reinforcement from symbolic gains and losses

Reinforcement learning (RL), particularly in primates, is often driven by symbolic outcomes. However, it is usually studied with primary reinforcers. To examine the neural mechanisms underlying learning from symbolic outcomes, we trained monkeys on a task in which they learned to choose options that led to gains of tokens and avoid choosing options that led to losses of tokens. We then recorded simultaneously from the orbitofrontal cortex (OFC), ventral striatum (VS), amygdala (AMY), and the mediodorsal thalamus (MDt). We found that the OFC played a dominant role in coding token outcomes and token prediction errors. The other areas contributed complementary functions with the VS coding appetitive outcomes and the AMY coding the salience of outcomes. The MDt coded actions and relayed information about tokens between the OFC and VS. Thus, OFC leads the process of symbolic reinforcement learning in the ventral frontostriatal circuitry.

Ventrolateral prefrontal neurons of the monkey encode instructions in the 'pragmatic' format of the associated behavioral outcomes

The prefrontal cortex plays an important role in coding rules and producing context-appropriate behaviors. These processes necessarily require the generation of goals based on current context. Indeed, instructing stimuli are prospectively encoded in prefrontal cortex in relation to behavioral demands, but the coding format of this neural representation is, to date, largely unknown. In order to study how instructions and behaviors are encoded in prefrontal cortex, we recorded the activity of monkeys (Macaca mulatta) ventrolateral prefrontal neurons in a task requiring to perform (Action condition) or withhold (Inaction condition) grasping actions on real objects. Our data show that there are neurons responding in different task phases, and that the neuronal population discharge is stronger in the Inaction condition when the instructing cue is presented, and in the Action condition in the subsequent phases, from object presentation to action execution. Decoding analyses performed on neuronal populations showed that the neural activity recorded during the initial phases of the task shares the same type of format with that recorded during the final phases. We propose that this format has a pragmatic nature, that is instructions and goals are encoded by prefrontal neurons as predictions of the behavioral outcome.

Characterizing Early-Onset Alzheimer Disease Using Multiprobe PET/MRI: An AT(N) Framework-Based Study

PURPOSE

Early-onset Alzheimer disease (EOAD) is rare, highly heterogeneous, and associated with poor prognosis. This AT(N) Framework-based study aimed to compare multiprobe PET/MRI findings between EOAD and late-onset Alzheimer disease (LOAD) patients and explore potential imaging biomarkers for characterizing EOAD.

METHODS

Patients with AD who underwent PET/MRI in our PET center were retrospectively reviewed and grouped according to the age at disease onset: EOAD, younger than 60 years; and LOAD, 60 years or older. Clinical characteristics were recorded. All study patients had positive β-amyloid PET imaging; some patients also underwent 18 F-FDG and 18 F-florzolotau PET. Imaging of the EOAD and LOAD groups was compared using region-of-interest and voxel-based analysis. Correlation of onset age and regional SUV ratios were also evaluated.

RESULTS

One hundred thirty-three patients were analyzed (75 EOAD and 58 LOAD patients). Sex ( P = 0.515) and education ( P = 0.412) did not significantly differ between groups. Mini-Mental State Examination score was significantly lower in the EOAD group (14.32 ± 6.74 vs 18.67 ± 7.20, P = 0.004). β-Amyloid deposition did not significantly differ between groups. Glucose metabolism in the frontal, parietal, precuneus, temporal, occipital lobe, and supramarginal and angular gyri was significantly lower in the EOAD group (n = 49) than in the LOAD group (n = 44). In voxel-based morphometry analysis, right posterior cingulate/precuneus atrophy was more obvious in the EOAD ( P < 0.001), although no voxel survived family-wise error correction. Tau deposition in the precuneus, parietal lobe, and angular, supramarginal, and right middle frontal gyri was significantly higher in the EOAD group (n = 18) than in the LOAD group (n = 13).

CONCLUSIONS

Multiprobe PET/MRI showed that tau burden and neuronal damage are more severe in EOAD than in LOAD. Multiprobe PET/MRI may be useful to assess the pathologic characteristics of EOAD.

A revised perspective on the evolution of the lateral frontal cortex in primates

Detailed neuroscientific data from macaque monkeys have been essential in advancing understanding of human frontal cortex function, particularly for regions of frontal cortex without homologs in other model species. However, precise transfer of this knowledge for direct use in human applications requires an understanding of monkey to hominid homologies, particularly whether and how sulci and cytoarchitectonic regions in the frontal cortex of macaques relate to those in hominids. We combine sulcal pattern analysis with resting-state functional magnetic resonance imaging and cytoarchitectonic analysis to show that old-world monkey brains have the same principles of organization as hominid brains, with the notable exception of sulci in the frontopolar cortex. This essential comparative framework provides insights into primate brain evolution and a key tool to drive translation from invasive research in monkeys to human applications.

Frontal and temporal coding dynamics in successive steps of complex behavior

Ventrolateral prefrontal cortex (vlPFC), dorsolateral prefrontal cortex (dlPFC), and temporal cortex (TE) all contribute to visual decision-making. Accumulating evidence suggests that vlPFC may play a central role in multiple cognitive operations, perhaps resembling domain-general regions of the human frontal lobe. We trained monkeys in a task calling for learning, retrieval, and spatial selection of rewarded target objects. Recordings of neural activity covered large areas of vlPFC, dlPFC, and TE. Results suggested a central role for vlPFC in each cognitive operation with strong coding of each task feature, while only location was strongly coded in dlPFC and current object identity in TE. During target selection, target location was communicated first from vlPFC to dlPFC, followed by extensive mutual support. In vlPFC, stimulus identities were independently coded in different task operations. The results suggest a central role for the inferior frontal convexity in controlling successive operations of a complex, multi-step task.

Hierarchical Reinforcement Learning, Sequential Behavior, and the Dorsal Frontostriatal System

To effectively behave within ever-changing environments, biological agents must learn and act at varying hierarchical levels such that a complex task may be broken down into more tractable subtasks. Hierarchical reinforcement learning (HRL) is a computational framework that provides an understanding of this process by combining sequential actions into one temporally extended unit called an option. However, there are still open questions within the HRL framework, including how options are formed and how HRL mechanisms might be realized within the brain. In this review, we propose that the existing human motor sequence literature can aid in understanding both of these questions. We give specific emphasis to visuomotor sequence learning tasks such as the discrete sequence production task and the M × N (M steps × N sets) task to understand how hierarchical learning and behavior manifest across sequential action tasks as well as how the dorsal cortical-subcortical circuitry could support this kind of behavior. This review highlights how motor chunks within a motor sequence can function as HRL options. Furthermore, we aim to merge findings from motor sequence literature with reinforcement learning perspectives to inform experimental design in each respective subfield.

Medial and orbital frontal cortex in decision-making and flexible behavior

The medial frontal cortex and adjacent orbitofrontal cortex have been the focus of investigations of decision-making, behavioral flexibility, and social behavior. We review studies conducted in humans, macaques, and rodents and argue that several regions with different functional roles can be identified in the dorsal anterior cingulate cortex, perigenual anterior cingulate cortex, anterior medial frontal cortex, ventromedial prefrontal cortex, and medial and lateral parts of the orbitofrontal cortex. There is increasing evidence that the manner in which these areas represent the value of the environment and specific choices is different from subcortical brain regions and more complex than previously thought. Although activity in some regions reflects distributions of reward and opportunities across the environment, in other cases, activity reflects the structural relationships between features of the environment that animals can use to infer what decision to take even if they have not encountered identical opportunities in the past.

The cortical connectome of primate lateral prefrontal cortex

The lateral prefrontal cortex (LPFC) of primates plays an important role in executive control, but how it interacts with the rest of the cortex remains unclear. To address this, we densely mapped the cortical connectome of LPFC, using electrical microstimulation combined with functional MRI (EM-fMRI). We found isomorphic mappings between LPFC and five major processing domains composing most of the cerebral cortex except early sensory and motor areas. An LPFC grid of ∼200 stimulation sites topographically mapped to separate grids of activation sites in the five domains, coarsely resembling how the visual cortex maps the retina. The temporal and parietal maps largely overlapped in LPFC, suggesting topographically organized convergence of the ventral and dorsal streams, and the other maps overlapped at least partially. Thus, the LPFC contains overlapping, millimeter-scale maps that mirror the organization of major cortical processing domains, supporting LPFC's role in coordinating activity within and across these domains.

Prefrontal cortical plasticity during learning of cognitive tasks

Training in working memory tasks is associated with lasting changes in prefrontal cortical activity. To assess the neural activity changes induced by training, we recorded single units, multi-unit activity (MUA) and local field potentials (LFP) with chronic electrode arrays implanted in the prefrontal cortex of two monkeys, throughout the period they were trained to perform cognitive tasks. Mastering different task phases was associated with distinct changes in neural activity, which included recruitment of larger numbers of neurons, increases or decreases of their firing rate, changes in the correlation structure between neurons, and redistribution of power across LFP frequency bands. In every training phase, changes induced by the actively learned task were also observed in a control task, which remained the same across the training period. Our results reveal how learning to perform cognitive tasks induces plasticity of prefrontal cortical activity, and how activity changes may generalize between tasks.

Differential coding of goals and actions in ventral and dorsal corticostriatal circuits during goal-directed behavior

Goal-directed behavior requires identifying objects in the environment that can satisfy internal needs and executing actions to obtain those objects. The current study examines ventral and dorsal corticostriatal circuits that support complementary aspects of goal-directed behavior. We analyze activity from the amygdala, ventral striatum, orbitofrontal cortex, and lateral prefrontal cortex (LPFC) while monkeys perform a three-armed bandit task. Information about chosen stimuli and their value is primarily encoded in the amygdala, ventral striatum, and orbitofrontal cortex, while the spatial information is primarily encoded in the LPFC. Before the options are presented, information about the to-be-chosen stimulus is represented in the amygdala, ventral striatum, and orbitofrontal cortex; at the time of choice, the information is passed to the LPFC to direct a saccade. Thus, learned value information specifying behavioral goals is maintained throughout the ventral corticostriatal circuit, and it is routed through the dorsal circuit at the time actions are selected.

The diversity and specificity of functional connectivity across spatial and temporal scales

Macroscopic neuroimaging modalities in humans have revealed the organization of brain-wide activity into distributed functional networks that re-organize according to behavioral demands. However, the inherent coarse-graining of macroscopic measurements conceals the diversity and specificity in responses and connectivity of many individual neurons contained in each local region. New invasive approaches in animals enable recording and manipulating neural activity at meso- and microscale resolution, with cell-type specificity and temporal precision down to milliseconds. Determining how brain-wide activity patterns emerge from interactions across spatial and temporal scales will allow us to identify the key circuit mechanisms contributing to global brain states and how the dynamic activity of these states enables adaptive behavior.

Choice-relevant information transformation along a ventrodorsal axis in the medial prefrontal cortex

Choice-relevant brain regions in prefrontal cortex may progressively transform information about options into choices. Here, we examine responses of neurons in four regions of the medial prefrontal cortex as macaques performed two-option risky choices. All four regions encode economic variables in similar proportions and show similar putative signatures of key choice-related computations. We provide evidence to support a gradient of function that proceeds from areas 14 to 25 to 32 to 24. Specifically, we show that decodability of twelve distinct task variables increases along that path, consistent with the idea that regions that are higher in the anatomical hierarchy make choice-relevant variables more separable. We also show progressively longer intrinsic timescales in the same series. Together these results highlight the importance of the medial wall in choice, endorse a specific gradient-based organization, and argue against a modular functional neuroanatomy of choice.