Foraging with the frontal cortex: A cross-species evaluation of reward-guided behavior

Theory Change in Cognitive Neurobiology: The Case of the Orbitofrontal Cortex

How do theories of the functions of parts of the brain change? I argue that computational hypotheses help explain the nature of theorizing in cognitive neurobiology. I will focus on the orbitofrontal cortex (OFC), a frontal region of the brain implicated in an array of cognitive functions. Different theories of OFC state different principles of OFC function and use different concepts to construct those principles. There are also differences in the patterns of use of evidence across different theories. I briefly survey several extant proposals for understanding theory change in science generally and cognitive neuroscience specifically, including paradigm shifts, tool innovation, mechanism discovery, conceptual innovation, exploratory experimentation, and changes in measurement techniques. While these extant approaches fall short at describing the nature of theory change illustrated by the case of OFC, they are compatible with my proposal that these theoretical changes and differences in the use of evidence result from different computational hypotheses about the region.

Risk preferences depend on environmental richness in rats performing a patch-foraging task

Risk, or variance over outcomes, features prominently in many decisions, but the factors that determine when and how risk modulates decision making remain unclear. We tested how risk affected rats' strategies for exploiting a diminishing food source as the overall richness of the environment was manipulated. Long-Evans rats earned food by sequentially visiting two foraging patches with different reward schedules-a low-variance standard option and a high-variance risky option-that provided the same average rate of reward. When rats switched between options, they encountered either a long or short delay during which no food was available to simulate the cost of travelling between patches. When the travel delay was short rats allocated more time to the low-variance standard reward schedule than the high-variance risky option. When the travel time was long rats spent the same amount of time in risky and standard patches. Consistent with previous work, rats "overharvested" patches, remaining for longer than the optimal patch residence duration. Overharvesting was prevalent in both risky and standard patches, and the magnitude of overharvesting increased with successive visits to the same patch, suggesting that overharvesting was not driven by uncertainty about the reward statistics of patches.

Characterization of Gut Microbiota in Rats and Rhesus Monkeys After Methamphetamine Self-administration

Methamphetamine (MA) is one of the most abused drugs globally, but the mechanism of its addiction remains unclear. Several animal studies have shown that the gut microbiota (GM) influences addictive behaviors, but the pattern of GM changes during addiction in animals of different species remains unclear. The aim of this study was to explore the association between dynamic changes in GM and MA self-administration acquisition among two classical mammals, rhesus monkeys (Macaca mulatta) and rats, MA self-administration models. Male Sprague-Dawley rats and male rhesus monkeys were subjected to classical MA self-administration training, and fecal samples were collected before and after MA self-administration training, respectively. 16S rRNA sequencing was used for GM analyses. We found that GM changes were more pronounced in rats than in rhesus monkeys, as evidenced by more GM taxa producing significant differences before and after MA self-administration training in rats than in monkeys. We also found that the expression of the genus Clostridia_vadinBB60_group significantly decreased after MA self-administration training in both rats and rhesus monkeys. Lactobacillus changes were significantly negatively correlated with total MA uptake in rats (Pearson R =  - 0.666, p = 0.035; Spearman R =  - 0.721, p = 0.023), whereas its change was also highly negatively correlated with total MA uptake in rhesus monkeys (Pearson R =  - 0.882, p = 0.118; Spearman R =  - 1.000, p = 0.083), although this was not significant. These findings suggest that MA causes significant alterations in GM in both rhesus monkeys and rats and that the genus Lactobacillus might be a common therapeutic target for MA uptake prevention across the species.

Representation of Anticipated Rewards and Punishments in the Human Brain

Subjective value is a core concept in neuroeconomics, serving as the basis for decision making. Despite the extensive literature on the neural encoding of subjective reward value in humans, the neural representation of punishment value remains relatively understudied. This review synthesizes current knowledge on the neural representation of reward value, including methodologies, involved brain regions, and the concept of a common currency representation of diverse reward types in decision-making and learning processes. We then critically examine existing research on the neural representation of punishment value, highlighting conceptual and methodological challenges in human studies and insights gained from animal research. Finally, we explore how individual differences in reward and punishment processing may be linked to various mental illnesses, with a focus on stress-related psychopathologies. This review advocates for the integration of both rewards and punishments within value-based decision-making and learning frameworks, leveraging insights from cross-species studies and utilizing ecological gamified paradigms to reflect real-life scenarios.

Comparing mouse and human cingulate cortex organization using functional connectivity

The subdivisions of the extended cingulate cortex of the human brain are implicated in a number of high-level behaviors and affected by a range of neuropsychiatric disorders. Its anatomy, function, and response to therapeutics are often studied using non-human animals, including the mouse. However, the similarity of human and mouse frontal cortex, including cingulate areas, is still not fully understood. Some accounts emphasize resemblances between mouse cingulate cortex and human cingulate cortex while others emphasize similarities with human granular prefrontal cortex. We use comparative neuroimaging to study the connectivity of the cingulate cortex in the mouse and human, allowing comparisons between mouse 'gold standard' tracer and imaging data, and, in addition, comparison between the mouse and the human using comparable imaging data. We find overall similarities in organization of the cingulate between species, including anterior and midcingulate areas and a retrosplenial area. However, human cingulate contains subareas with a more fine-grained organization than is apparent in the mouse and it has connections to prefrontal areas not present in the mouse. Results such as these help formally address between-species brain organization and aim to improve the translation from preclinical to human results.

Examining the relationship between psychosocial adversity and inhibitory control: an fMRI study of children growing up in extreme poverty

Exposure to psychosocial adversity (PA) is associated with poor behavioral, physical, and mental health outcomes in adulthood. As these outcomes are related to alterations in developmental processes, growing evidence suggests that deficits in executive functions-inhibitory control in particular-may, in part, explain this relationship. However, literature examining the development of inhibitory control has been based on children in higher resource environments, and little is known how low resource settings might exacerbate the link between inhibitory control and health outcomes. In this context, we collected fMRI data during a Go/No-Go inhibitory control task and PA variables for 68 children 5 to 7 years of age living in Dhaka, Bangladesh, an area with a high prevalence of PA. The children's mothers completed behavioral questionnaires to assess the child's PA and their own PA. Whole-brain activation underlying inhibitory control was examined using the No-Go versus Go contrast, and associations with PA variables were assessed using whole-brain regressions. Childhood neglect was associated with weaker activation in the right posterior cingulate, whereas greater family conflict, economic stress, and maternal PA factors were associated with greater activation in the left medial frontal gyrus, right superior and middle frontal gyri, and left cingulate gyrus. These data suggest that neural networks supporting inhibitory control processes may vary as a function of exposure to different types of PA, particularly between those related to threat and deprivation. Furthermore, increased activation in children with greater PA may serve as a compensatory mechanism, allowing them to maintain similar behavioral task performance.

Comparative basolateral amygdala connectomics reveals dissociable single-neuron projection patterns to frontal cortex in macaques and mice

Basolateral amygdala (BLA) is a key hub for affect in the brain,1,2,3 and dysfunction within this area contributes to a host of psychiatric disorders.4,5 BLA is extensively and reciprocally interconnected with frontal cortex,6,7,8,9 and some aspects of its function are evolutionarily conserved across rodents, anthropoid primates, and humans.10 Neuron density in BLA is substantially lower in primates compared to murine rodents,11 and frontal cortex (FC) is dramatically expanded in primates, particularly the more anterior granular and dysgranular areas.12,13,14 Yet, how these anatomical differences influence the projection patterns of single BLA neurons to frontal cortex across rodents and primates is unknown. Using a barcoded connectomic approach, we assessed the single BLA neuron connections to frontal cortex in mice and macaques. We found that BLA neurons are more likely to project to multiple distinct parts of FC in mice than in macaques. Further, while single BLA neuron projections to nucleus accumbens were similarly organized in mice and macaques, BLA-FC connections differed substantially. Notably, BLA connections to subcallosal anterior cingulate cortex (scACC) in macaques were least likely to branch to other medial frontal cortex areas compared to perigenual ACC (pgACC). This pattern of connections was reversed in the mouse homologues of these areas, infralimbic and prelimbic cortex (IL and PL), mirroring functional differences between rodents and non-human primates. Taken together, these results indicate that BLA connections to FC are not linearly scaled from mice to macaques and instead the organization of single-neuron BLA connections is distinct between these species.

Preferences reveal dissociable encoding across prefrontal-limbic circuits

Individual preferences for the flavor of different foods and fluids exert a strong influence on behavior. Most current theories posit that preferences are integrated with other state variables in the orbitofrontal cortex (OFC), which is thought to derive the relative subjective value of available options to guide choice behavior. Here, we report that instead of a single integrated valuation system in the OFC, another complementary one is centered in the ventrolateral prefrontal cortex (vlPFC) in macaques. Specifically, we found that the OFC and vlPFC preferentially represent outcome flavor and outcome probability, respectively, and that preferences are separately integrated into value representations in these areas. In addition, the vlPFC, but not the OFC, represented the probability of receiving the available outcome flavors separately, with the difference between these representations reflecting the degree of preference for each flavor. Thus, both the vlPFC and OFC exhibit dissociable but complementary representations of subjective value, both of which are necessary for decision-making.

The mouse motor system contains multiple premotor areas and partially follows human organizational principles

While humans are known to have several premotor cortical areas, secondary motor cortex (M2) is often considered to be the only higher-order motor area of the mouse brain and is thought to combine properties of various human premotor cortices. Here, we show that axonal tracer, functional connectivity, myelin mapping, gene expression, and optogenetics data contradict this notion. Our analyses reveal three premotor areas in the mouse, anterior-lateral motor cortex (ALM), anterior-lateral M2 (aM2), and posterior-medial M2 (pM2), with distinct structural, functional, and behavioral properties. By using the same techniques across mice and humans, we show that ALM has strikingly similar functional and microstructural properties to human anterior ventral premotor areas and that aM2 and pM2 amalgamate properties of human pre-SMA and cingulate cortex. These results provide evidence for the existence of multiple premotor areas in the mouse and chart a comparative map between the motor systems of humans and mice.

Conditioned preferences: Gated by experience, context, and endocrine systems

Central to the navigation of an ever-changing environment is the ability to form positive associations with places and conspecifics. The functions of location and social conditioned preferences are often studied independently, limiting our understanding of their interplay. Furthermore, a de-emphasis on natural functions of conditioned preferences has led to neurobiological interpretations separated from ecological context. By adopting a naturalistic and ethological perspective, we uncover complexities underlying the expression of conditioned preferences. Development of conditioned preferences is a combination of motivation, reward, associative learning, and context, including for social and spatial environments. Both social- and location-dependent reward-responsive behaviors and their conditioning rely on internal state-gating mechanisms that include neuroendocrine and hormone systems such as opioids, dopamine, testosterone, estradiol, and oxytocin. Such reinforced behavior emerges from mechanisms integrating past experience and current social and environmental conditions. Moreover, social context, environmental stimuli, and internal state gate and modulate motivation and learning via associative reward, shaping the conditioning process. We highlight research incorporating these concepts, focusing on the integration of social neuroendocrine mechanisms and behavioral conditioning. We explore three paradigms: 1) conditioned place preference, 2) conditioned social preference, and 3) social conditioned place preference. We highlight nonclassical species to emphasize the naturalistic applications of these conditioned preferences. To fully appreciate the complex integration of spatial and social information, future research must identify neural networks where endocrine systems exert influence on such behaviors. Such research promises to provide valuable insights into conditioned preferences within a broader naturalistic context.

Comparative basolateral amygdala connectomics reveals dissociable single-neuron projection patterns to frontal cortex in macaques and mice

The basolateral amygdala (BLA) projects to the frontal cortex (FC) in both rodents and primates, but the comparative organization of single-neuron BLA-FC projections is unknown. Using a barcoded connectomic approach, we found that BLA neurons are more likely to project to multiple distinct parts of FC in mice than in macaques. Further, while single BLA neuron projections to nucleus accumbens are similarly organized in mice and macaques, BLA-FC connections differ.

Protocol guide for food foraging behavior test: Assessment of decision making in rodents

Food foraging behavior requires higher cognitive function like investing efforts in decision making. Hoarding food for the future consumption in adverse climatic conditions or to avoid predatory threats needs precise perception and potential of decision making to overcome challenges in the time of need. The brain areas and neural circuitry responsible for such cognitive skills are poorly understood. Previously available animal models are trained prior to test, which makes it difficult to understand the true nature of animals, and hoard the food from external source into the cage. The new food foraging behavior test, recently developed and evidenced by Li et al., relies on untrained rats and test the competitive ability and hoarding from source within the test box. It can be used to study decision making potentials and underlying neural bases in laboratory settings. Multiple aspects like food quality/flavor preference, competitive nature can be assessed within the test box and the paradigm is conveniently customizable according the hypothesis. However, a detailed protocol guide, to be followed in the laboratory setting, for food foraging behavior test is not available. Therefore, it is urged to produce an elaborated guide for scientists to conduct food foraging behavior test in convenient and precise manner.

Single basolateral amygdala neurons in macaques exhibit distinct connectional motifs with frontal cortex

Basolateral amygdala (BLA) projects widely across the macaque frontal cortex, and amygdalo-frontal projections are critical for appropriate emotional responding and decision making. While it is appreciated that single BLA neurons branch and project to multiple areas in frontal cortex, the organization and frequency of this branching has yet to be fully characterized. Here, we determined the projection patterns of more than 3,000 macaque BLA neurons. We found that one-third of BLA neurons had two or more distinct projection targets in frontal cortex and subcortical structures. The patterns of single BLA neuron projections to multiple areas were organized into repeating motifs that targeted distinct sets of areas in medial and ventral frontal cortex, indicative of separable BLA networks. Our findings begin to reveal the rich structure of single-neuron connections in the non-human primate brain, providing a neuroanatomical basis for the role of BLA in coordinating brain-wide responses to valent stimuli.

Sex differences in patch-leaving foraging decisions in rats

The ubiquity, importance, and sophistication of foraging behavior makes it an ideal platform for studying naturalistic decision making in animals. We developed a spatial patch-foraging task for rats, in which subjects chose how long to remain in one foraging patch as the rate of food earnings steadily decreased. The cost of seeking out a new location was varied across sessions. The behavioral task was designed to mimic the structure of natural foraging problems, where distinct spatial locations are associated with different reward statistics, and decisions require navigation and movement through space. Male and female Long-Evans rats generally followed the predictions of theoretical models of foraging, albeit with a consistent tendency to persist with patches for too long compared to behavioral strategies that maximize food intake rate. The tendency to choose overly-long patch residence times was stronger in male rats. We also observed sex differences in locomotion as rats performed the task, but these differences in movement only partially accounted for the differences in patch residence durations observed between male and female rats. Together, these results suggest a nuanced relationship between movement, sex, and foraging decisions.

Sex differences in patch-leaving foraging decisions in rats

The ubiquity, importance, and sophistication of foraging behavior makes it an ideal platform for studying naturalistic decision making in animals. We developed a spatial patch-foraging task for rats, in which subjects chose how long to remain in one foraging patch as the rate of food earnings steadily decreased. The cost of seeking out a new location was varied across sessions. The behavioral task was designed to mimic the structure of natural foraging problems, where distinct spatial locations are associated with different reward statistics, and decisions require navigation and movement through space. Male and female Long-Evans rats generally followed the predictions of theoretical models of foraging, albeit with a consistent tendency to persist with patches for too long compared to behavioral strategies that maximize food intake rate. The tendency to choose overly-long patch residence times was stronger in male rats. We also observed sex differences in locomotion as rats performed the task, but these differences in movement only partially accounted for the differences in patch residence durations observed between male and female rats. Together, these results suggest a nuanced relationship between movement, sex, and foraging decisions.

Behaviour, Furnishing and Vertical Space Use of Captive Callimico (Callimico goeldii): Implications for Welfare

Provision of optimal captive care should be supported by species-specific evidence. Callimico (Callimico goeldii) is a small South American callitrichid primate. This study sought to address gaps in species-specific knowledge and captive management research by examining differences in callimico behaviour across multiple collections, investigating vertical enclosure use and a possible association between specific behaviours and vertical zones. Observational research was conducted at five European Association of Zoos and Aquaria (EAZA) organisations, in exhibits that were visually divided into four vertical zones. Instantaneous scan sampling was used to record behaviour and location of callimico over a six-day period at each collection, exceeding 160 observational hours. Significant differences were observed in foraging between collections and were much lower than the recommendations in Best Practice Guidelines, although near-wild levels were recorded in one enclosure. At an average height of 2 m, callimico utilized a similar vertical space across very different enclosures, regardless of overall available height, reflective of their natural ecology. The association between whole food items and increased foraging time, horizontal branches and locomotion and deep substrate and diversity of behaviours, offers further species-specific evidence of how the callimico use their captive environment. Our findings complement current EAZA guidelines to support species appropriate care for callimico and makes specific recommendations for further research.

Mechanisms of adjustments to different types of uncertainty in the reward environment across mice and monkeys

Despite being unpredictable and uncertain, reward environments often exhibit certain regularities, and animals navigating these environments try to detect and utilize such regularities to adapt their behavior. However, successful learning requires that animals also adjust to uncertainty associated with those regularities. Here, we analyzed choice data from two comparable dynamic foraging tasks in mice and monkeys to investigate mechanisms underlying adjustments to different types of uncertainty. In these tasks, animals selected between two choice options that delivered reward probabilistically, while baseline reward probabilities changed after a variable number (block) of trials without any cues to the animals. To measure adjustments in behavior, we applied multiple metrics based on information theory that quantify consistency in behavior, and fit choice data using reinforcement learning models. We found that in both species, learning and choice were affected by uncertainty about reward outcomes (in terms of determining the better option) and by expectation about when the environment may change. However, these effects were mediated through different mechanisms. First, more uncertainty about the better option resulted in slower learning and forgetting in mice, whereas it had no significant effect in monkeys. Second, expectation of block switches accompanied slower learning, faster forgetting, and increased stochasticity in choice in mice, whereas it only reduced learning rates in monkeys. Overall, while demonstrating the usefulness of metrics based on information theory in examining adaptive behavior, our study provides evidence for multiple types of adjustments in learning and choice behavior according to uncertainty in the reward environment.

Preferences reveal separable valuation systems in prefrontal-limbic circuits

Individual preferences for the flavor of different foods and fluids exert a strong influence on behavior. Most current theories posit that preferences are integrated with other state variables in orbitofrontal cortex (OFC), which is thought to derive the relative subjective value of available options to drive choice behavior. Here we report that instead of a single integrated valuation system in OFC, another separate one is centered in ventrolateral prefrontal cortex (vlPFC) in macaque monkeys. Specifically, we found that OFC and vlPFC preferentially represent outcome flavor and outcome probability, respectively, and that preferences are separately integrated into these two aspects of subjective valuation. In addition, vlPFC, but not OFC, represented the outcome probability for the two options separately, with the difference between these representations reflecting the degree of preference. Thus, there are at least two separable valuation systems that work in concert to guide choices and that both are biased by preferences.

Subgenual and Hippocampal Pathways in Amygdala Are Set to Balance Affect and Context Processing

The amygdala, hippocampus, and subgenual cortex area 25 (A25) are engaged in complex cognitive-emotional processes. Yet pathway interactions from hippocampus and A25 with postsynaptic sites in amygdala remain largely unknown. In rhesus monkeys of both sexes, we studied with neural tracers how pathways from A25 and hippocampus interface with excitatory and inhibitory microcircuits in amygdala at multiple scales. We found that both hippocampus and A25 innervate distinct as well as overlapping sites of the basolateral (BL) amygdalar nucleus. Unique hippocampal pathways heavily innervated the intrinsic paralaminar basolateral nucleus, which is associated with plasticity. In contrast, orbital A25 preferentially innervated another intrinsic network, the intercalated masses, an inhibitory reticulum that gates amygdalar autonomic output and inhibits fear-related behaviors. Finally, using high-resolution confocal and electron microscopy (EM), we found that among inhibitory postsynaptic targets in BL, both hippocampal and A25 pathways preferentially formed synapses with calretinin (CR) neurons, which are known for disinhibition and may enhance excitatory drive in the amygdala. Among other inhibitory postsynaptic sites, A25 pathways innervated the powerful parvalbumin (PV) neurons which may flexibly regulate the gain of neuronal assemblies in the BL that affect the internal state. In contrast, hippocampal pathways innervated calbindin (CB) inhibitory neurons, which modulate specific excitatory inputs for processing context and learning correct associations. Common and unique patterns of innervation in amygdala by hippocampus and A25 have implications for how complex cognitive and emotional processes may be selectively disrupted in psychiatric disorders.SIGNIFICANCE STATEMENT The hippocampus, subgenual A25, and amygdala are associated with learning, memory, and emotions. We found that A25 is poised to affect diverse amygdalar processes, from emotional expression to fear learning by innervating the basal complex and the intrinsic intercalated masses. Hippocampal pathways uniquely interacted with another intrinsic amygdalar nucleus which is associated with plasticity, suggesting flexible processing of signals in context for learning. In the basolateral (BL) amygdala, which has a role in fear learning, both hippocampal and A25 interacted preferentially with disinhibitory neurons, suggesting a boost in excitation. The two pathways diverged in innervating other classes of inhibitory neurons, suggesting circuit specificities that could become perturbed in psychiatric diseases.

Medial orbitofrontal neurotrophin systems integrate hippocampal input into outcome-specific value representations

In everyday life, we mentally represent possible consequences of our behaviors and integrate specific outcome values into existing knowledge to inform decisions. The medial orbitofrontal cortex (MO) is necessary to adapt behaviors when outcomes are not immediately available-when they and their values need to be envisioned. Nevertheless, neurobiological mechanisms remain unclear. We find that the neuroplasticity-associated neurotrophin receptor tropomyosin receptor kinase B (TrkB) is necessary for mice to integrate outcome-specific value information into choice behavior. This function appears attributable to memory updating (and not retrieval) and the stabilization of dendritic spines on excitatory MO neurons, which led us to investigate inputs to the MO. Ventral hippocampal (vHC)-to-MO projections appear conditionally necessary for value updating, involved in long-term aversion-based value memory updating. Furthermore, vHC-MO-mediated control of choice is TrkB dependent. Altogether, we reveal a vHC-MO connection by which specific value memories are updated, and we position TrkB within this functional circuit.

Amygdala-cortical collaboration in reward learning and decision making

Adaptive reward-related decision making requires accurate prospective consideration of the specific outcome of each option and its current desirability. These mental simulations are informed by stored memories of the associative relationships that exist within an environment. In this review, I discuss recent investigations of the function of circuitry between the basolateral amygdala (BLA) and lateral (lOFC) and medial (mOFC) orbitofrontal cortex in the learning and use of associative reward memories. I draw conclusions from data collected using sophisticated behavioral approaches to diagnose the content of appetitive memory in combination with modern circuit dissection tools. I propose that, via their direct bidirectional connections, the BLA and OFC collaborate to help us encode detailed, outcome-specific, state-dependent reward memories and to use those memories to enable the predictions and inferences that support adaptive decision making. Whereas lOFC→BLA projections mediate the encoding of outcome-specific reward memories, mOFC→BLA projections regulate the ability to use these memories to inform reward pursuit decisions. BLA projections to lOFC and mOFC both contribute to using reward memories to guide decision making. The BLA→lOFC pathway mediates the ability to represent the identity of a specific predicted reward and the BLA→mOFC pathway facilitates understanding of the value of predicted events. Thus, I outline a neuronal circuit architecture for reward learning and decision making and provide new testable hypotheses as well as implications for both adaptive and maladaptive decision making.

Multistability, perceptual value, and internal foraging

Substantial experimental, theoretical, and computational insights into sensory processing have been derived from the phenomena of perceptual multistability-when two or more percepts alternate or switch in response to a single sensory input. Here, we review a range of findings suggesting that alternations can be seen as internal choices by the brain responding to values. We discuss how elements of external, experimenter-controlled values and internal, uncertainty- and aesthetics-dependent values influence multistability. We then consider the implications for the involvement in switching of regions, such as the anterior cingulate cortex, which are more conventionally tied to value-dependent operations such as cognitive control and foraging.

The influence of the subcortex and brain stem on overeating: How advances in functional neuroimaging can be applied to expand neurobiological models to beyond the cortex

Functional neuroimaging has become a widely used tool in obesity and eating disorder research to explore the alterations in neurobiology that underlie overeating and binge eating behaviors. Current and traditional neurobiological models underscore the importance of impairments in brain systems supporting reward, cognitive control, attention, and emotion regulation as primary drivers for overeating. Due to the technical limitations of standard field strength functional magnetic resonance imaging (fMRI) scanners, human neuroimaging research to date has focused largely on cortical and basal ganglia effects on appetitive behaviors. The present review draws on animal and human research to highlight how neural signaling encoding energy regulation, reward-learning, and habit formation converge on hypothalamic, brainstem, thalamic, and striatal regions to contribute to overeating in humans. We also consider the role of regions such as the mediodorsal thalamus, ventral striatum, lateral hypothalamus and locus coeruleus in supporting habit formation, inhibitory control of food craving, and attentional biases. Through these discussions, we present proposals on how the neurobiology underlying these processes could be examined using functional neuroimaging and highlight how ultra-high field 7-Tesla (7 T) fMRI may be leveraged to elucidate the potential functional alterations in subcortical networks. Focus is given to how interactions of these regions with peripheral endocannabinoids and neuropeptides, such as orexin, could be explored. Technical and methodological aspects regarding the use of ultra-high field 7 T fMRI to study eating behaviors are also reviewed.

Choosing memory retrieval strategies: A critical role for inhibition in the dentate gyrus

Remembering the location of food is essential for survival. Rodents and humans employ mainly hippocampus-dependent spatial strategies, but when being stressed they shift to striatum-mediated stimulus-based strategies. To investigate underlying brain circuits, we tested mice with a heightened stress susceptibility due to a lack of the GABA-synthetizing enzyme GAD65 (GAD65−/− mice) in a dual solution task. Here, GAD65−/− mice preferred to locate a food reward in an open field via a proximal cue, while their wildtype littermates preferred a spatial strategy. The analysis of cFos co-activation across brain regions and of stress-induced mRNA expression changes of GAD65 pointed towards the hippocampal dorsal dentate gyrus (dDG) as a central structure for mediating stress effects on strategy choices via GAD65. Reducing the GAD65 expression locally in the dDG by a shRNA mediated knock down was sufficient to replicate the phenotype of the global GAD65 knock out and to increase dDG excitability. Using DREADD vectors to specifically interfere with dDG circuit activity during dual solution retrieval but not learning confirmed that the dDG modulates strategy choices and that a balanced excitability of this structure is necessary to establish spatial strategy preference. These data highlight the dDG as a critical hub for choosing between spatial and non-spatial foraging strategies.

•

Stress reduces spatial memory preferences for locating rewards in an open field.

•

GAD65 deficient mice show reduced preferences for spatial memory strategy.

•

Dorsal dentate gyrus knock down of GAD65 is sufficient to reduce spatial strategies.

•

Excitability in the dorsal dentate gyrus modulates retrieval strategy choices.

Medial and orbital frontal cortex in decision-making and flexible behavior

The medial frontal cortex and adjacent orbitofrontal cortex have been the focus of investigations of decision-making, behavioral flexibility, and social behavior. We review studies conducted in humans, macaques, and rodents and argue that several regions with different functional roles can be identified in the dorsal anterior cingulate cortex, perigenual anterior cingulate cortex, anterior medial frontal cortex, ventromedial prefrontal cortex, and medial and lateral parts of the orbitofrontal cortex. There is increasing evidence that the manner in which these areas represent the value of the environment and specific choices is different from subcortical brain regions and more complex than previously thought. Although activity in some regions reflects distributions of reward and opportunities across the environment, in other cases, activity reflects the structural relationships between features of the environment that animals can use to infer what decision to take even if they have not encountered identical opportunities in the past.

Synthetic Spatial Foraging With Active Inference in a Geocaching Task

Humans are highly proficient in learning about the environments in which they operate. They form flexible spatial representations of their surroundings that can be leveraged with ease during spatial foraging and navigation. To capture these abilities, we present a deep Active Inference model of goal-directed behavior, and the accompanying belief updating. Active Inference rests upon optimizing Bayesian beliefs to maximize model evidence or marginal likelihood. Bayesian beliefs are probability distributions over the causes of observable outcomes. These causes include an agent's actions, which enables one to treat planning as inference. We use simulations of a geocaching task to elucidate the belief updating-that underwrites spatial foraging-and the associated behavioral and neurophysiological responses. In a geocaching task, the aim is to find hidden objects in the environment using spatial coordinates. Here, synthetic agents learn about the environment via inference and learning (e.g., learning about the likelihoods of outcomes given latent states) to reach a target location, and then forage locally to discover the hidden object that offers clues for the next location.

The role of prefrontal cortex in cognitive control and executive function

Concepts of cognitive control (CC) and executive function (EF) are defined in terms of their relationships with goal-directed behavior versus habits and controlled versus automatic processing, and related to the functions of the prefrontal cortex (PFC) and related regions and networks. A psychometric approach shows unity and diversity in CC constructs, with 3 components in the most commonly studied constructs: general or common CC and components specific to mental set shifting and working memory updating. These constructs are considered against the cellular and systems neurobiology of PFC and what is known of its functional neuroanatomical or network organization based on lesioning, neurochemical, and neuroimaging approaches across species. CC is also considered in the context of motivation, as "cool" and "hot" forms. Its Common CC component is shown to be distinct from general intelligence (g) and closely related to response inhibition. Impairments in CC are considered as possible causes of psychiatric symptoms and consequences of disorders. The relationships of CC with the general factor of psychopathology (p) and dimensional constructs such as impulsivity in large scale developmental and adult populations are considered, as well as implications for genetic studies and RDoC approaches to psychiatric classification.