Reversible inactivations of rat medial prefrontal cortex impair the ability to wait for a stimulus

From memory disorders to the development of depression: A system approach

In this review, a hypothesis explaining the origin and genesis of depression development from the perspective of a holistic functional system of behavioral control is proposed. The core of the functional system is the memory apparatus, on which all other key components of the behavioral control system (sensory information, motivation, reinforcement, and motor activity) are interlocked. In the organization of memory traces (engrams) there are two inputs, sensory and motivational, through which the stimulus-stimulus (S-S) and stimulus-motor (S-R) engrams are formed. These engrams are organized and actualized by means of forward and backward conditional connections between cortical representations of sensory information and motivational structures of the brain. Through feedback connections from reinforcing (emotional) input to the memory apparatus, the S-S and S-R engrams are consolidated or weakened depending on the strength of reward or negative events. Depression begins with a breakdown in memory mechanisms. These breakdowns are related to problems with the three mentioned memory inputs: sensory, motivational, and reinforcing (emotional). Disruptions in sensory and motivational input lead to an inability to form new memory engrams, their actualization and retrieval. This creates difficulty in solving current and past unresolved problems, eliciting more accumulation and increasing difficulties in their solving. Unresolved tasks lead to weakening of the reinforcing input, and further impairment of consolidation of the acting engrams. Another reason for the weakening of reinforcing input is excessive action of directly harmful events or constant chronic stress. The review presents the current literature and some data from our laboratory in favor of each memory input's contribution and their impact on the development of depression, when they are problematic.

Neural circuit mapping of waiting impulsivity and proactive inhibition with convergent evidence from fMRI and TMS

BACKGROUND AND OBJECTIVES

Waiting and stopping are essential and distinct elements of motor response inhibition. Waiting impulsivity has been traditionally studied in humans with choice serial reaction time tasks. Proactive stopping is one form of stopping relevant to waiting impulsivity and the neural substrates underlying their interaction are not well defined.

METHODS

We conducted two separate, but hierarchical studies. In the first we used functional magnetic resonance imaging (fMRI), a choice reaction time task and a novel proactive stopping task, in N = 41 healthy volunteers to map the overlapping neural circuit involved in waiting impulsivity and proactive stopping. In the second study, we aimed to provide mechanistic and causal evidence that disruption of this circuit with continuous theta burst stimulation (cTBS; an inhibitory repetitive transcranial magnetic stimulation protocol) affected waiting impulsivity. We recruited N = 51 healthy, right-handed volunteers in a single-blind, randomized, between-subjects design who were randomly allocated to stimulation (N = 26) and sham (N = 25) groups and subsequently performed a choice reaction time task.

RESULTS

In the first study, we showed; 1. a shared neural network comprising the pre- supplementary motor area and bilateral anterior insula underlying both waiting impulsivity and proactive stopping, and 2. activity in dorsomedial prefrontal cortex and left inferior frontal gyrus negatively correlated with waiting impulsivity in trials with additional target onset delay. In the second study, we demonstrated that inactivation of the left inferior frontal gyrus using cTBS significantly increased waiting impulsivity in a choice reaction time task.

CONCLUSIONS

Our findings highlight the relevance of task design in assessing motor response inhibition and the role of the left inferior frontal gyrus integrity and related neural circuitry in waiting impulsivity and proactive stopping. We also leverage the use of convergent evidence from multi-modal investigation tools in addressing the causal neural areas underlying distinct forms of impulsivity.

A role for the midbrain reticular formation in delay-based decision making

In many real-life situations, decisions involve temporal delays between actions and their outcomes. During these intervals, waiting is an active process that requires maintaining motivation and anticipating future rewards. This study aimed to explore the role of the midbrain reticular formation (MRF) in delay-based decision-making. We recorded neural activity in the MRF while rats performed delay discounting and reward discrimination tasks, choosing between a smaller, sooner reward and a larger, later reward. Our findings reveal that MRF neurons are integral to maintaining motivation during waiting periods by encoding both the anticipated size and the discounted value of delayed rewards. Furthermore, the inactivation of the MRF led to a significant reduction in the rats' willingness to wait for delayed rewards. These results demonstrate the MRF's function in balancing the trade-offs between reward magnitude and timing, providing insight into the neural mechanisms that support sustained motivation and decision-making over time.

The Role of the Rat Prefrontal Cortex and Sex Differences in Decision-Making

The prefrontal cortex is critical for decision-making across species, with its activity linked to choosing between options. Drift diffusion models (DDMs) are commonly employed to understand the neural computations underlying this behavior. Studies exploring the specific roles of regions of the rodent prefrontal cortex in controlling the decision process are limited. This study explored the role of the prelimbic cortex (PLC) in decision-making using a two-alternative forced-choice task. Rats first learned to report the location of a lateralized visual stimulus. The brightness of the stimulus indicated its reward value. Then, the rats learned to make choices between pairs of stimuli. Sex differences in learning were observed, with females responding faster and more selectively to high-value stimuli than males. DDM analysis found that males had decreased decision thresholds during initial learning, whereas females maintained a consistently higher drift rate. Pharmacological manipulations revealed that PLC inactivation reduced the decision threshold for all rats, indicating that less information was needed to make a choice in the absence of normal PLC processing. μ-Opioid receptor stimulation of the PLC had the opposite effect, raising the decision threshold and reducing bias in the decision process toward high-value stimuli. These effects were observed without any impact on the rats' choice preferences. Our findings suggest that PLC has an inhibitory role in the decision process and regulates the amount of evidence that is required to make a choice. That is, PLC activity controls "when," but not "how," to act.

Sex- and estrous-related response patterns for alcohol depend critically on the level of compulsion-like challenge

Alcohol use disorder is a substantial social and economic burden. During the last years, the number of women with drinking problems has been increasing, and one main concern is that they are particularly more vulnerable to negative consequences of alcohol. However, little is known about female-specific response patterns for alcohol, and potential underlying differences in brain mechanisms, including for compulsion-like alcohol drinking (when intake persists despite adverse consequences). We used lickometry to assess behavioral microstructure in adult Wistar male and female rats (n = 28-30) during alcohol-only drinking or moderate- or higher-challenge alcohol compulsion (10 or 60 mg/l quinine in alcohol, respectively). Estrous stages were determined and related to drinking levels and patterns of responding to alcohol, as was ovariectomy. Our findings showed that females (where we didn't determine estrus stage) had similar total licks in a session as males, but significantly longer licking bouts under alcohol-only and moderate-challenge, suggesting greater persistence. Further, greater intake under alcohol-only and moderate-challenge was related to faster licking in males, while female consumption was not related to licking speed. Thus, females could have increased persistence without greater vigor, unlike males. However, under higher-challenge, faster licking did predict higher intake in females, similar to males. To better understand female higher-challenge responding, we examined drinking in relation to phases of the estrous cycle. Higher-challenge had longer bouts only in late diestrus. In addition, ovariectomy led to longer bouts only under higher-challenge, suggesting that conditions with reduced hormone levels could increase female persistence for alcohol under higher-challenge. However, ovariectomy also reduced alcohol-only and moderate-challenge drinking but did not reduce bout length. Thus, intake level and response strategy could be regulated somewhat differently by ovarian hormones. Finally, moderate-challenge licking speed was less variable during early diestrus, and we previously showed more stereotyped responding specifically under moderate-challenge in males. By combining behavioral microstructure and sex- and estrus-related changes in drinking patterns, our results suggest that females have greater persistence for alcohol under lower-challenge drinking, while late diestrus and ovariectomy unmasked greater persistence under higher-challenge. Together, our novel insights could help develop more effective and personalized treatments for problematic alcohol use.

Goal-Directed Learning is Multidimensional and Accompanied by Diverse and Widespread Changes in Neocortical Signaling

New tasks are often learned in stages with each stage reflecting a different learning challenge. Accordingly, each learning stage is likely mediated by distinct neuronal processes. And yet, most rodent studies of the neuronal correlates of goal-directed learning focus on individual outcome measures and individual brain regions. Here, we longitudinally studied mice from naïve to expert performance in a head-fixed, operant conditioning whisker discrimination task. In addition to tracking the primary behavioral outcome of stimulus discrimination, we tracked and compared an array of object-based and temporal-based behavioral measures. These behavioral analyses identify multiple, partially overlapping learning stages in this task, consistent with initial response implementation, early stimulus-response generalization, and late response inhibition. To begin to understand the neuronal foundations of these learning processes, we performed widefield Ca2+ imaging of dorsal neocortex throughout learning and correlated behavioral measures with neuronal activity. We found distinct and widespread correlations between neocortical activation patterns and various behavioral measures. For example, improvements in sensory discrimination correlated with target stimulus evoked activations of licking-related cortices along with distractor stimulus evoked global cortical suppression. Our study reveals multidimensional learning for a simple goal-directed learning task and generates hypotheses for the neuronal modulations underlying these various learning processes.

Insular and prelimbic cortices control behavioral accuracy and precision in a temporal decision-making task in rats

The anterior insular cortex (AIC) comprises a region of sensory integration. It appears to detect salient events in order to guide goal-directed behavior, code tracking errors, and estimate the passage of time. Temporal processing in the AIC may be instantiated by the integration of representations of interoception. Projections between the AIC and the medial prefrontal cortex (mPFC) - found both in rats and humans - also suggest a possible role for these structures in the integration of autonomic responses during ongoing behavior. Few studies, however, have investigated the role of AIC and mPFC in decision-making and time estimation tasks. Moreover, their findings are not consistent, so the relationship between temporal decision-making and those areas remains unclear. The present study employed bilateral inactivations to explore the role of AIC and prelimbic cortex (PL) in rats during a temporal decision-making task. In this task, two levers are available simultaneously (but only one is active), one predicting reinforcement after a short, and the other after a long-fixed interval. Optimal performance requires a switch from the short to the long lever after the short-fixed interval elapsed and no reinforcement was delivered. Switch behavior from the short to the long lever was dependent on AIC and PL. During AIC inactivation, switch latencies became more variable, while during PL inactivation switch latencies became both more variable and less accurate. These findings point to a dissociation between AIC and PL in temporal decision-making, suggesting that the AIC is important for temporal precision, and PL is important for both temporal accuracy and precision.

Noradrenergic regulation of cue-guided decision making and impulsivity is doubly dissociable across frontal brain regions

RATIONALE

Win-paired stimuli can promote risk taking in experimental gambling paradigms in both rats and humans. We previously demonstrated that atomoxetine, a noradrenaline reuptake inhibitor, and guanfacine, a selective α2A adrenergic receptor agonist, reduced risk taking on the cued rat gambling task (crGT), a rodent assay of risky choice in which wins are accompanied by salient cues. Both compounds also decreased impulsive premature responding.

OBJECTIVE

The key neural loci mediating these effects were unknown. The lateral orbitofrontal cortex (lOFC) and the medial prefrontal cortex (mPFC), which are highly implicated in risk assessment, action selection, and impulse control, receive dense noradrenergic innervation. We therefore infused atomoxetine and guanfacine directly into either the lOFC or prelimbic (PrL) mPFC prior to task performance.

RESULTS

When infused into the lOFC, atomoxetine improved decision making score and adaptive lose-shift behaviour in males, but not in females, without altering motor impulsivity. Conversely, intra-PrL atomoxetine improved impulse control in risk preferring animals of both sexes, but did not alter decision making. Guanfacine administered into the PrL, but not lOFC, also altered motor impulsivity in all subjects, though in the opposite direction to atomoxetine.

CONCLUSIONS

These data highlight a double dissociation between the behavioural effects of noradrenergic signaling across frontal regions with respect to risky choice and impulsive action. Given that the influence of noradrenergic manipulations on motor impulsivity could depend on baseline risk preference, these data also suggest that the noradrenaline system may function differently in subjects that are susceptible to the risk-promoting lure of win-associated cues.

The role of rat prelimbic cortex in decision making

The frontal cortex plays a critical role in decision-making. One specific frontal area, the anterior cingulate cortex, has been identified as crucial for setting a threshold for how much evidence is needed before a choice is made (Domenech & Dreher, 2010). Threshold is a key concept in drift diffusion models, a popular framework used to understand decision-making processes. Here, we investigated the role of the prelimbic cortex, part of the rodent cingulate cortex, in decision making. Male and female rats learned to choose between stimuli associated with high and low value rewards. Females learned faster, were more selective in their responses, and integrated information about the stimuli more quickly. By contrast, males learned more slowly and showed a decrease in their decision thresholds during choice learning. Inactivating the prelimbic cortex in female and male rats sped up decision making without affecting choice accuracy. Drift diffusion modeling found selective effects of prelimbic cortex inactivation on the decision threshold, which was reduced with increasing doses of the GABA-A agonist muscimol. Stimulating the prelimbic cortex through mu opioid receptors slowed the animals' choice latencies and increased the decision threshold. These findings provide the first causal evidence that the prelimbic cortex directly influences decision processes. Additionally, they suggest possible sex-based differences in early choice learning.

Maturation of cortical input to dorsal raphe nucleus increases behavioral persistence in mice

The ability to persist toward a desired objective is a fundamental aspect of behavioral control whose impairment is implicated in several behavioral disorders. One of the prominent features of behavioral persistence is that its maturation occurs relatively late in development. This is presumed to echo the developmental time course of a corresponding circuit within late-maturing parts of the brain, such as the prefrontal cortex, but the specific identity of the responsible circuits is unknown. Here, we used a genetic approach to describe the maturation of the projection from layer 5 neurons of the neocortex to the dorsal raphe nucleus in mice. Using optogenetic-assisted circuit mapping, we show that this projection undergoes a dramatic increase in synaptic potency between postnatal weeks 3 and 8, corresponding to the transition from juvenile to adult. We then show that this period corresponds to an increase in the behavioral persistence that mice exhibit in a foraging task. Finally, we used a genetic targeting strategy that primarily affected neurons in the medial prefrontal cortex, to selectively ablate this pathway in adulthood and show that mice revert to a behavioral phenotype similar to juveniles. These results suggest that frontal cortical to dorsal raphe input is a critical anatomical and functional substrate of the development and manifestation of behavioral persistence.

Sequential effect and temporal orienting in prestimulus oculomotor inhibition

When faced with unfamiliar circumstances, we often turn to our past experiences with similar situations to shape our expectations. This results in the well-established sequential effect, in which previous trials influence the expectations of the current trial. Studies have revealed that, in addition to the classical behavioral metrics, the inhibition of eye movement could be used as a biomarker to study temporal expectations. This prestimulus oculomotor inhibition is found a few hundred milliseconds prior to predictable events, with a stronger inhibition for predictable than unpredictable events. The phenomenon has been found to occur in various temporal structures, such as rhythms, cue-association, and conditional probability, yet it is still unknown whether it reflects local sequential information of the previous trial. To explore this, we examined the relationship between the sequential effect and the prestimulus oculomotor inhibition. Our results (N = 40) revealed that inhibition was weaker when the previous trial was longer than the current trial, in line with findings of behavioral metrics. These findings indicate that the prestimulus oculomotor inhibition covaries with expectation based on local sequential information, demonstrating the tight connection between this phenomenon and expectation and providing a novel measurement for studying sequential effects in temporal expectation.

Emotion in action: When emotions meet motor circuits

The brain is a remarkably complex organ responsible for a wide range of functions, including the modulation of emotional states and movement. Neuronal circuits are believed to play a crucial role in integrating sensory, cognitive, and emotional information to ultimately guide motor behavior. Over the years, numerous studies employing diverse techniques such as electrophysiology, imaging, and optogenetics have revealed a complex network of neural circuits involved in the regulation of emotional or motor processes. Emotions can exert a substantial influence on motor performance, encompassing both everyday activities and pathological conditions. The aim of this review is to explore how emotional states can shape movements by connecting the neural circuits for emotional processing to motor neural circuits. We first provide a comprehensive overview of the impact of different emotional states on motor control in humans and rodents. In line with behavioral studies, we set out to identify emotion-related structures capable of modulating motor output, behaviorally and anatomically. Neuronal circuits involved in emotional processing are extensively connected to the motor system. These circuits can drive emotional behavior, essential for survival, but can also continuously shape ongoing movement. In summary, the investigation of the intricate relationship between emotion and movement offers valuable insights into human behavior, including opportunities to enhance performance, and holds promise for improving mental and physical health. This review integrates findings from multiple scientific approaches, including anatomical tracing, circuit-based dissection, and behavioral studies, conducted in both animal and human subjects. By incorporating these different methodologies, we aim to present a comprehensive overview of the current understanding of the emotional modulation of movement in both physiological and pathological conditions.

Selective chemogenetic inactivation of corticoaccumbal projections disrupts trait choice impulsivity

Impulsive choice has enduring trait-like characteristics and is defined by preference for small immediate rewards over larger delayed ones. Importantly, it is a determining factor in the development and persistence of substance use disorder (SUD). Emerging evidence from human and animal studies suggests frontal cortical regions exert influence over striatal reward processing areas during decision-making in impulsive choice or delay discounting (DD) tasks. The goal of this study was to examine how these circuits are involved in decision-making in animals with defined trait impulsivity. To this end, we trained adolescent male rats to stable behavior on a DD procedure and then re-trained them in adulthood to assess trait-like, conserved impulsive choice across development. We then used chemogenetic tools to selectively and reversibly target corticostriatal projections during performance of the DD task. The prelimbic region of the medial prefrontal cortex (mPFC) was injected with a viral vector expressing inhibitory designer receptors exclusively activated by designer drugs (Gi-DREADD), and then mPFC projections to the nucleus accumbens core (NAc) were selectively suppressed by intra-NAc administration of the Gi-DREADD actuator clozapine-n-oxide (CNO). Inactivation of the mPFC-NAc projection elicited a robust increase in impulsive choice in rats with lower vs. higher baseline impulsivity. This demonstrates a fundamental role for mPFC afferents to the NAc during choice impulsivity and suggests that maladaptive hypofrontality may underlie decreased executive control in animals with higher levels of choice impulsivity. Results such as these may have important implications for the pathophysiology and treatment of impulse control, SUDs, and related psychiatric disorders.

Impulse control disorder in Parkinson's disease is associated with abnormal frontal value signalling

Dopaminergic medication is well established to boost reward- versus punishment-based learning in Parkinson's disease. However, there is tremendous variability in dopaminergic medication effects across different individuals, with some patients exhibiting much greater cognitive sensitivity to medication than others. We aimed to unravel the mechanisms underlying this individual variability in a large heterogeneous sample of early-stage patients with Parkinson's disease as a function of comorbid neuropsychiatric symptomatology, in particular impulse control disorders and depression. One hundred and ninety-nine patients with Parkinson's disease (138 ON medication and 61 OFF medication) and 59 healthy controls were scanned with functional MRI while they performed an established probabilistic instrumental learning task. Reinforcement learning model-based analyses revealed medication group differences in learning from gains versus losses, but only in patients with impulse control disorders. Furthermore, expected-value related brain signalling in the ventromedial prefrontal cortex was increased in patients with impulse control disorders ON medication compared with those OFF medication, while striatal reward prediction error signalling remained unaltered. These data substantiate the hypothesis that dopamine's effects on reinforcement learning in Parkinson's disease vary with individual differences in comorbid impulse control disorder and suggest they reflect deficient computation of value in medial frontal cortex, rather than deficient reward prediction error signalling in striatum. See Michael Browning (https://doi.org/10.1093/brain/awad248) for a scientific commentary on this article.

Using lickometry to infer differential contributions of salience network regions during compulsion-like alcohol drinking

Alcohol use disorder extracts substantial personal, social and clinical costs, and continued intake despite negative consequences (compulsion-like consumption) can contribute strongly. Here we discuss lickometry, a simple method where lick times are determined across a session, while analysis across many aspects of licking can offer important insights into underlying psychological and action strategies, including their brain mechanisms. We first describe studies implicating anterior insula (AIC) and dorsal medial prefrontal cortex (dMPF) in compulsion-like responding for alcohol, then review work suggesting that AIC/ventral frontal cortex versus dMPF regulate different aspects of behavior (oral control and overall response strategy, versus moment-to-moment action organization). We then detail our lickometer work comparing alcohol-only drinking (AOD) and compulsion-like drinking under moderate- or higher-challenge (ModChD or HiChD, using quinine-alcohol). Many studies have suggested utilization of one of two main strategies, with higher motivation indicated by more bouts, and greater palatability suggested by longer, faster bouts. Instead, ModChD shows decreased variability in many lick measures, which is unexpected but consistent with the suggested importance of automaticity for addiction. Also surprising is that HiChD retains several behavior changes seen with ModChD, reduced tongue variability and earlier bout start, even though intake is otherwise disrupted. Since AIC-related measures are retained under both moderate- and higher-challenge, we propose a novel hypothesis that AIC sustains overall commitment regardless of challenge level, while disordered licking during HiChD mirrors the effects of dMPF inhibition. Thus, while AIC provides overall drive despite challenge, the ability to act is ultimately determined within the dMPF.

Phylogenic evolution of beat perception and synchronization: a comparative neuroscience perspective

The study of music has long been of interest to researchers from various disciplines. Scholars have put forth numerous hypotheses regarding the evolution of music. With the rise of cross-species research on music cognition, researchers hope to gain a deeper understanding of the phylogenic evolution, behavioral manifestation, and physiological limitations of the biological ability behind music, known as musicality. This paper presents the progress of beat perception and synchronization (BPS) research in cross-species settings and offers varying views on the relevant hypothesis of BPS. The BPS ability observed in rats and other mammals as well as recent neurobiological findings presents a significant challenge to the vocal learning and rhythm synchronization hypothesis if taken literally. An integrative neural-circuit model of BPS is proposed to accommodate the findings. In future research, it is recommended that greater consideration be given to the social attributes of musicality and to the behavioral and physiological changes that occur across different species in response to music characteristics.

Influence of Recent Trial History on Interval Timing

Interval timing is involved in a variety of cognitive behaviors such as associative learning and decision-making. While it has been shown that time estimation is adaptive to the temporal context, it remains unclear how interval timing behavior is influenced by recent trial history. Here we found that, in mice trained to perform a licking-based interval timing task, a decrease of inter-reinforcement interval in the previous trial rapidly shifted the time of anticipatory licking earlier. Optogenetic inactivation of the anterior lateral motor cortex (ALM), but not the medial prefrontal cortex, for a short time before reward delivery caused a decrease in the peak time of anticipatory licking in the next trial. Electrophysiological recordings from the ALM showed that the response profiles preceded by short and long inter-reinforcement intervals exhibited task-engagement-dependent temporal scaling. Thus, interval timing is adaptive to recent experience of the temporal interval, and ALM activity during time estimation reflects recent experience of interval.

Time encoding migrates from prefrontal cortex to dorsal striatum during learning of a self-timed response duration task

Although time is a fundamental dimension of life, we do not know how brain areas cooperate to keep track and process time intervals. Notably, analyses of neural activity during learning are rare, mainly because timing tasks usually require training over many days. We investigated how the time encoding evolves when animals learn to time a 1.5 s interval. We designed a novel training protocol where rats go from naive- to proficient-level timing performance within a single session, allowing us to investigate neuronal activity from very early learning stages. We used pharmacological experiments and machine-learning algorithms to evaluate the level of time encoding in the medial prefrontal cortex and the dorsal striatum. Our results show a double dissociation between the medial prefrontal cortex and the dorsal striatum during temporal learning, where the former commits to early learning stages while the latter engages as animals become proficient in the task.

Noradrenaline and Movement Initiation Disorders in Parkinson’s Disease: A Pharmacological Functional MRI Study with Clonidine

Slowness of movement initiation is a cardinal motor feature of Parkinson’s disease (PD) and is not fully reverted by current dopaminergic treatments. This trouble could be due to the dysfunction of executive processes and, in particular, of inhibitory control of response initiation, a function possibly associated with the noradrenergic (NA) system. The implication of NA in the network supporting proactive inhibition remains to be elucidated using pharmacological protocols. For that purpose, we administered 150 μg of clonidine to 15 healthy subjects and 12 parkinsonian patients in a double-blind, randomized, placebo-controlled design. Proactive inhibition was assessed by means of a Go/noGo task, while pre-stimulus brain activity was measured by event-related functional MRI. Acute reduction in noradrenergic transmission induced by clonidine enhanced difficulties initiating movements reflected by an increase in omission errors and modulated the activity of the anterior node of the proactive inhibitory network (dorsomedial prefrontal and anterior cingulate cortices) in PD patients. We conclude that NA contributes to movement initiation by acting on proactive inhibitory control via the α2-adrenoceptor. We suggest that targeting noradrenergic dysfunction may represent a new treatment approach in some of the movement initiation disorders seen in Parkinson’s disease.

Medial prefrontal cortex lesions disrupt prepotent action selection signals in dorsomedial striatum

The ability to inhibit or adapt unwanted actions or movements is a critical feature of almost all forms of behavior. Many have attributed this ability to frontal brain areas such as the anterior cingulate cortex (ACC) and the medial prefrontal cortex (mPFC), but the exact contribution of each brain region is often debated because their functions are not examined in animals performing the same task. Recently, we have shown that ACC signals a need for cognitive control and is crucial for the adaptation of action selection signals in dorsomedial striatum (DMS) in rats performing a stop-change task. Here, we show that unlike ACC, the prelimbic region of mPFC does not disrupt the inhibition or adaption of an action plan at either the level of behavior or downstream firing in DMS. Instead, lesions to mPFC correlate with changes in DMS signals involved in action initiation and disrupt performance on GO trials while improving performance on STOP trials.

Gated feedforward inhibition in the frontal cortex releases goal-directed action

Cortical circuits process both sensory and motor information in animals performing perceptual tasks. However, it is still unclear how sensory inputs are transformed into motor signals in the cortex to initiate goal-directed actions. In this study, we found that a visual-to-motor inhibitory circuit in the anterior cingulate cortex (ACC) triggers precise action in mice performing visual Go/No-go tasks. Three distinct features of ACC neurons-visual amplitudes of sensory neurons, suppression times of motor neurons and network activity from other neurons-predicted response times of the mice. Moreover, optogenetic activation of visual inputs in the ACC, which drives fast-spiking sensory neurons, prompted task-relevant actions in mice by suppressing ACC motor neurons and disinhibiting downstream striatal neurons. Notably, when mice terminated actions in response to stop signals, both motor neuron and network activity increased. Collectively, our data demonstrate that visual inputs to the frontal cortex trigger gated feedforward inhibition to initiate goal-directed actions.

A sex-dependent role for the prelimbic cortex in impulsive action both before and following early cocaine abstinence

Although impulsive action is strongly associated with addiction, the neural underpinnings of this relationship and how they are influenced by sex have not been well characterized. Here, we used a titrating reaction time task to assess differences in impulsive action in male and female Long Evans rats both before and after short (4-6 days) or long (25-27 days) abstinence from 2 weeks of cocaine or water/saline self-administration (6 h daily access). Neural activity in the prelimbic cortex (PrL) and nucleus accumbens (NAc) core was assessed at each time point. We found that a history of cocaine self-administration increased impulsivity in all rats following short, but not long, abstinence. Furthermore, male rats with an increased ratio of excited to inhibited neurons in the PrL at the start of each trial in the task exhibited higher impulsivity in the naïve state (before self-administration). Following short abstinence from cocaine, PrL activity in males became more inhibited, and this change in activity predicted the shift in impulsivity. However, PrL activity did not track impulsivity in female rats. Additionally, although the NAc core tracked several aspects of behavior in the task, it did not track impulsivity in either sex. Together, these findings demonstrate a sex-dependent role for the PrL in impulsivity both before and after a history of cocaine.

Concomitant Processing of Choice and Outcome in Frontal Corticostriatal Ensembles Correlates with Performance of Rats

The frontal cortex-basal ganglia network plays a pivotal role in adaptive goal-directed behaviors. Medial frontal cortex (MFC) encodes information about choices and outcomes into sequential activation of neural population, or neural trajectory. While MFC projects to the dorsal striatum (DS), whether DS also displays temporally coordinated activity remains unknown. We studied this question by simultaneously recording neural ensembles in the MFC and DS of rodents performing an outcome-based alternative choice task. We found that the two regions exhibited highly parallel evolution of neural trajectories, transforming choice information into outcome-related information. When the two trajectories were highly correlated, spike synchrony was task-dependently modulated in some MFC-DS neuron pairs. Our results suggest that neural trajectories concomitantly process decision-relevant information in MFC and DS with increased spike synchrony between these regions.

The warning stimulus as retrieval cue: The role of associative memory in temporal preparation

In a warned reaction time task, the warning stimulus (S1) initiates a process of temporal preparation, which promotes a speeded response to the impending target stimulus (S2). According to the multiple trace theory of temporal preparation (MTP), participants learn the timing of S2 by storing a memory trace on each trial, which contains a temporal profile of the events on that trial. On each new trial, S1 serves as a retrieval cue that implicitly and associatively activates memory traces created on earlier trials, which jointly drive temporal preparation for S2. The idea that S1 assumes this role as a retrieval cue was tested across eight experiments, in which two different S1s were associated with two different distributions of S1-S2 intervals: one with predominantly short and one with predominantly long intervals. Experiments differed regarding the S1 features that made up a pair, ranging from highly distinct (e.g., tone and flash) to more similar (e.g., red and green flash) and verbal (i.e., "short" vs "long"). Exclusively for pairs of highly distinct S1s, the results showed that the S1 cue modified temporal preparation, even in participants who showed no awareness of the contingency. This cueing effect persisted in a subsequent transfer phase, in which the contingency between S1 and the timing of S2 was broken - a fact participants were informed of in advance. Together, these findings support the role of S1 as an implicit retrieval cue, consistent with MTP.

Suppressing Anterior Cingulate Cortex Modulates Default Mode Network and Behavior in Awake Rats

The default mode network (DMN) is a principal brain network in the mammalian brain. Although the DMN in humans has been extensively studied with respect to network structure, function, and clinical implications, our knowledge of DMN in animals remains limited. In particular, the functional role of DMN nodes, and how DMN organization relates to DMN-relevant behavior are still elusive. Here we investigated the causal relationship of inactivating a pivotal node of DMN (i.e., dorsal anterior cingulate cortex [dACC]) on DMN function, network organization, and behavior by combining chemogenetics, resting-state functional magnetic resonance imaging (rsfMRI) and behavioral tests in awake rodents. We found that suppressing dACC activity profoundly changed the activity and connectivity of DMN, and these changes were associated with altered DMN-related behavior in animals. The chemo-rsfMRI-behavior approach opens an avenue to mechanistically dissecting the relationships between a specific node, brain network function, and behavior. Our data suggest that, like in humans, DMN in rodents is a functional network with coordinated activity that mediates behavior.

Mapping Large-Scale Networks Associated with Action, Behavioral Inhibition and Impulsivity

A key aspect of behavioral inhibition is the ability to wait before acting. Failures in this form of inhibition result in impulsivity and are commonly observed in various neuropsychiatric disorders. Prior evidence has implicated medial frontal cortex, motor cortex, orbitofrontal cortex (OFC), and ventral striatum in various aspects of inhibition. Here, using distributed recordings of brain activity [with local-field potentials (LFPs)] in rodents, we identified oscillatory patterns of activity linked with action and inhibition. Low-frequency (δ) activity within motor and premotor circuits was observed in two distinct networks, the first involved in cued, sensory-based responses and the second more generally in both cued and delayed actions. By contrast, θ activity within prefrontal and premotor regions (medial frontal cortex, OFC, ventral striatum, and premotor cortex) was linked with inhibition. Connectivity at θ frequencies was observed within this network of brain regions. Interestingly, greater connectivity between primary motor cortex (M1) and other motor regions was linked with greater impulsivity, whereas greater connectivity between M1 and inhibitory brain regions (OFC, ventral striatum) was linked with improved inhibition and diminished impulsivity. We observed similar patterns of activity on a parallel task in humans: low-frequency activity in sensorimotor cortex linked with action, θ activity in OFC/ventral prefrontal cortex (PFC) linked with inhibition. Thus, we show that δ and θ oscillations form distinct large-scale networks associated with action and inhibition, respectively.

Potential roles of the rodent medial prefrontal cortex in conflict resolution between multiple decision-making systems

Mammalian decision-making is mediated by the interaction of multiple, neurally and computationally separable decision systems. Having multiple systems requires a mechanism to manage conflict and converge onto the selection of singular actions. A long history of evidence has pointed to the prefrontal cortex as a central component in processing the interactions between distinct decision systems and resolving conflicts among them. In this chapter we review four theories of how that interaction might occur and identify how the medial prefrontal cortex in the rodent may be involved in each theory. We then present experimental predictions implied by the neurobiological data in the context of each theory as a starting point for future investigation of medial prefrontal cortex and decision-making.

Prefrontal contributions to action control in rodents

The rodent medial prefrontal cortex (mPFC) is typically considered to be involved in cognitive aspects of action control, e.g., decision making, rule learning and application, working memory and generally guiding adaptive behavior (Euston, Gruber, & McNaughton, 2012). These cognitive aspects often occur on relatively slow time scales, i.e., in the order of several trials within a block structure (Murakami, Shteingart, Loewenstein, & Mainen, 2017). In this way, the mPFC is able to set up a representational memory (Goldman-Rakic, 1987). On the other hand, the mPFC can also impact action control more directly (i.e., more on the motoric and less cognitive side). This impact on motor control manifests on faster time scales, i.e., on a single trial level (Hardung et al., 2017). While the more cognitive aspects have been reviewed previously as well as in other subchapters of this book, we explicitly focus on the latter aspect in this chapter, particularly on movement inhibition. We discuss models of prefrontal motor interactions, the impact of the behavioral paradigm, evidences for mPFC involvement in action control, and the anatomical connections between mPFC and motor cortex.

Reward signaling by the rodent medial frontal cortex

The anatomical relevance and functional significance of medial parts of the rodent frontal cortex have been intensely debated over the modern history of neuroscience. Early studies emphasized common functions among medial frontal regions in rodents and the dorsolateral prefrontal cortex of primates. Behavioral tasks emphasized memory-guided performance and persistent neural activity as a marker of working memory. Over time, it became clear that long-standing concerns about cross-species homology were justified and the view emerged that rodents are useful for understanding medial parts of the frontal cortex in primates, and not the dorsolateral prefrontal cortex. Here, we summarize a series of studies on the rodent medial frontal cortex that began with an interest in studying working memory in the perigenual prelimbic area and ended up studying reward processing in the medial orbital region. Our experiments revealed a role for a 4-8Hz "theta" rhythm in tracking engagement in the consumption of rewarding fluids and denoting the value of a given reward. Evidence for a functional differentiation between the rostral and caudal medial frontal cortex and its relationship to other frontal cortical areas is also discussed with the hope of motivating future work on this part of the cerebral cortex.

Medial prefrontal cortex and the temporal control of action

Across species, the medial prefrontal cortex guides actions in time. This process can be studied using behavioral paradigms such as simple reaction-time and interval-timing tasks. Temporal control of action can be influenced by prefrontal neurotransmitters such as dopamine and acetylcholine and is highly relevant to human diseases such as Parkinson's disease, schizophrenia, and attention-deficit hyperactivity disorder (ADHD). We review evidence that across species, medial prefrontal lesions impair the temporal control of action. We then consider neurophysiological correlates in humans, primates, and rodents that might encode temporal processing and relate to cognitive-control mechanisms. These data have informed brain-stimulation studies in rodents and humans that can compensate for timing deficits. This line of work illuminates basic mechanisms of temporal control of action in the medial prefrontal cortex, which underlies a range of high-level cognitive processing and could contribute to new biomarkers and therapies for human brain diseases.

Behavioral indicators of succeeding and failing under higher-challenge compulsion-like alcohol drinking in rat

Intake despite negative consequences (compulsivity) contributes strongly to the harm of alcohol use disorder, making the underlying psychological and circuit mechanisms of great importance. To gain insight into possible underlying action strategies, we compared rat licking microstructure across compulsion-like and non-compulsive conditions. We previously showed that drinking under a moderate-challenge, quinine-alcohol model (Alc-ModQ) shows less variable responding in many measures, suggesting a more automatic strategy to overcome challenge. Here, we reanalyzed our original data, newly focusing on the behavioral profile of higher-challenge intake (100 mg/L quinine in alcohol, Alc-HighQ). Alc-HighQ greatly dropped consumption, yet retained aspects of greater automaticity and drive seen with Alc-ModQ, including earlier bout initiation and measures suggesting more stereotyped tongue control. In contrast, Alc-HighQ disordered bout generation and timing. Importantly, only fast-starting bouts persisted under Alc-HighQ, and while there were many fewer longer Alc-HighQ bouts, they still contributed >50 % of consumption. Also, longer bouts under Alc-HighQ had an early, several-second period with greater chance of stopping, but afterwards showed similar persistence and recovery from slow licking as other drinking conditions. Together, our findings elucidate novel behavioral indicators of successful and unsuccessful epochs of Alc-HighQ, compulsion-like intake. We also relate findings to congruent human and animal work implicating anterior insula and medial prefrontal cortices as critical for compulsion-like alcohol responding, and where ventral frontal cortex has been more associated with overall action plan and tongue control (retained under Alc-HighQ), with medial cortex more related to proximal action timing (disrupted under Alc-HighQ except after faster bout initiation).

Role of mPFC and nucleus accumbens circuitry in modulation of a nicotine plus alcohol compound drug state

Combined use of nicotine and alcohol constitute a significant public health risk. An important aspect of drug use and dependence are the various cues, both external (contextual) and internal (interoceptive) that influence drug-seeking and drug-taking behavior. The present experiments employed the use of Designer Receptors Exclusively Activated by Designer Drugs (DREADDs) and complementary Pavlovian drug discrimination procedures (feature-positive and feature-negative training conditions) in order to examine whether medial prefrontal cortex (prelimbic; mPFC-PL) projections to the nucleus accumbens core (AcbC) modulate sensitivity to a nicotine + alcohol (N + A) interoceptive cue. First, we show neuronal activation in mPFC-PL and AcbC following treatment with N + A. Next, we demonstrate that chemogenetic silencing of projections from mPFC-PL to nucleus accumbens core decrease sensitivity to the N + A interoceptive cue, while enhancing sensitivity to the individual components, suggesting an important role for this specific projection. Furthermore, we demonstrate that clozapine-N-oxide (CNO), the ligand used to activate the DREADDs, had no effect in parallel mCherry controls. These findings contribute important information regarding our understanding of the cortical-striatal circuitry that regulates sensitivity to the interoceptive effects of a compound N + A cue.

Prefrontal D1 Dopamine-Receptor Neurons and Delta Resonance in Interval Timing

Considerable evidence has shown that prefrontal neurons expressing D1-type dopamine receptors (D1DRs) are critical for working memory, flexibility, and timing. This line of work predicts that frontal neurons expressing D1DRs mediate cognitive processing. During timing tasks, one form this cognitive processing might take is time-dependent ramping activity-monotonic changes in firing rate over time. Thus, we hypothesized the prefrontal D1DR+ neurons would strongly exhibit time-dependent ramping during interval timing. We tested this idea using an interval-timing task in which we used optogenetics to tag D1DR+ neurons in the mouse medial frontal cortex (MFC). While 23% of MFC D1DR+ neurons exhibited ramping, this was significantly less than untagged MFC neurons. By contrast, MFC D1DR+ neurons had strong delta-frequency (1-4 Hz) coherence with other MFC ramping neurons. This coherence was phase-locked to cue onset and was strongest early in the interval. To test the significance of these interactions, we optogenetically stimulated MFC D1DR+ neurons early versus late in the interval. We found that 2-Hz stimulation early in the interval was particularly effective in rescuing timing-related behavioral performance deficits in dopamine-depleted animals. These findings provide insight into MFC networks and have relevance for disorders such as Parkinson's disease and schizophrenia.

ChABC infusions into medial prefrontal cortex, but not posterior parietal cortex, improve the performance of rats tested on a novel, challenging delay in the touchscreen TUNL task

Perineuronal nets (PNNs) are specialized extracellular matrix structures that surround subsets of neurons throughout the central nervous system (CNS). They are made up of chondroitin sulfate proteoglycans (CSPGs), hyaluronan, tenascin-R, and many other link proteins that together make up their rigid and lattice-like structure. Modulation of PNNs can alter synaptic plasticity and thereby affect learning, memory, and cognition. In the present study, we degraded PNNs in the medial prefrontal (mPFC) and posterior parietal (PPC) cortices of Long–Evans rats using the enzyme chondroitinase ABC (ChABC), which cleaves apart CSPGs. We then measured the consequences of PNN degradation on spatial working memory (WM) with a trial-unique, non-matching-to location (TUNL) automated touchscreen task. All rats were trained with a standard 6 sec delay and 20 sec inter-trial interval (ITI) and then tested under four different conditions: a 6 sec delay, a variable 2 or 6 sec delay, a 2 sec delay with a 1 sec ITI (interference condition), and a 20 sec delay. Rats that received mPFC ChABC treatment initially performed TUNL with higher accuracy, more selection trials completed, and fewer correction trials completed compared to controls in the 20 sec delay condition but did not perform differently from controls in any other condition. Rats that received PPC ChABC treatment did not perform significantly differently from controls in any condition. Posthumous immunohistochemistry confirmed an increase in CSPG degradation products (C4S stain) in the mPFC and PPC following ChABC infusions while WFA staining intensity and parvalbumin positive neuron number were decreased following mPFC, but not PPC, ChABC infusions. These findings suggest that PNNs in the mPFC play a subtle role in spatial WM, but PNNs in the PPC do not. Furthermore, it appears that PNNs in the mPFC are involved in adapting to a challenging novel delay, but that they do not play an essential role in spatial WM function.

Single Neurons in Anterior Cingulate Cortex Signal the Need to Change Action During Performance of a Stop-change Task that Induces Response Competition

Several human imaging studies have suggested that anterior cingulate cortex (ACC) is highly active when participants receive competing inputs, and that these signals may be important for influencing the downstream planning of actions. Despite increasing evidence from several neuroimaging studies, no study has examined ACC activity at the level of the single neuron in rodents performing similar tasks. To fill this gap, we recorded from single neurons in ACC while rats performed a stop-change task. We found higher firing on trials with competing inputs (STOP trials), and that firing rates were positively correlated with accuracy and movement speed, suggesting that when ACC was engaged, rats tended to slow down and perform better. Finally, firing was the strongest when STOP trials were preceded by GO trials and was reduced when rats adapted their behavior on trials subsequent to a STOP trial. These data provide the first evidence that activity of single neurons in ACC is elevated when 2 responses are in competition with each other when there is a need to change the course of action to obtain reward.

Inherent Motor Impulsivity Associates with Specific Gene Targets in the Rat Medial Prefrontal Cortex

High impulsivity characterizes a myriad of neuropsychiatric diseases, and identifying targets for neuropharmacological intervention to reduce impulsivity could reveal transdiagnostic treatment strategies. Motor impulsivity (impulsive action) reflects in part the failure of "top-down" executive control by the medial prefrontal cortex (mPFC). The present study profiled the complete set of mRNA molecules expressed from genes (transcriptome) in the mPFC of male, outbred rats stably expressing high (HI) or low (LI) motor impulsivity based upon premature responses in the 1-choice serial reaction time (1-CSRT) task. RNA-sequencing identified expression of 18 genes that was higher in the mPFC of HI vs. LI rats. Functional gene enrichment revealed that biological processes related to calcium homeostasis and G protein-coupled receptor (GPCR) signaling pathways, particularly glutamatergic, were overrepresented in the mPFC of HI vs. LI rats. Transcription factor enrichment identified mothers against decapentaplegic homolog 4 (SMAD4) and RE1 silencing transcription factor (REST) as overrepresented in the mPFC of HI rats relative to LI rats, while in silico analysis predicted a conserved SMAD binding site within the voltage-gated calcium channel subunit alpha1 E (CACNA1E) promoter region. qRT-PCR analyses confirmed that mRNA expression of CACNA1E, as well as expression of leucyl and cystinyl aminopeptidase (LNPEP), were higher in the mPFC of HI vs. LI rats. These outcomes establish a transcriptomic landscape in the mPFC that is related to individual differences in motor impulsivity and propose novel gene targets for future impulsivity research.

Temporal Preparation, Impulsivity and Short-Term Memory in Depression

Patient suffering of major depressive disorder (MDD) often complain that subjective time seems to "drag" with respect to physical time. This may point toward a generalized dysfunction of temporal processing in MDD. In the present study, we investigated temporal preparation in MDD. "Temporal preparation" refers to an increased readiness to act before an expected event; consequently, reaction time should be reduced. MDD patients and age-matched controls were required to make a saccadic eye movement between a central and an eccentric visual target after a variable duration preparatory period. We found that MDD patients produced a larger number of premature saccades, saccades initiated prior to the appearance of the expected stimulus. These saccades were not temporally controlled; instead, they seemed to reflect reduced inhibitory control causing oculomotor impulsivity. In contrast, the latency of visually guided saccades was strongly influenced by temporal preparation in controls; significantly less so, in MDD patients. This observed reduced temporal preparation in MDD was associated with a faster decay of short-term temporal memory. Moreover, in patients producing a lot of premature responses, temporal preparation to early imperative stimuli was increased. In conclusion, reduced temporal preparation and short-term temporal memory in the oculomotor domain supports the hypothesis that temporal processing was altered in MDD patients. Moreover, oculomotor impulsivity interacted with temporal preparation. These observed deficits could reflect other underlying aspects of abnormal time experience in MDD.

Corticostriatal stimulation compensates for medial frontal inactivation during interval timing

Prefrontal dysfunction is a common feature of brain diseases such as schizophrenia and contributes to deficits in executive functions, including working memory, attention, flexibility, inhibitory control, and timing of behaviors. Currently, few interventions improve prefrontal function. Here, we tested whether stimulating the axons of prefrontal neurons in the striatum could compensate for deficits in temporal processing related to prefrontal dysfunction. We used an interval-timing task that requires working memory for temporal rules and attention to the passage of time. Our previous work showed that inactivation of the medial frontal cortex (MFC) impairs interval timing and attenuates ramping activity, a key form of temporal processing in the dorsomedial striatum (DMS). We found that 20-Hz optogenetic stimulation of MFC axon terminals increased curvature of time-response histograms and improved interval-timing behavior. Furthermore, optogenetic stimulation of terminals modulated time-related ramping of medium spiny neurons in the striatum. These data suggest that corticostriatal stimulation can compensate for deficits caused by MFC inactivation and they imply that frontostriatal projections are sufficient for controlling responses in time.

Differential Effects of Dorsal and Ventral Medial Prefrontal Cortex Inactivation during Natural Reward Seeking, Extinction, and Cue-Induced Reinstatement

Rodent dorsal medial prefrontal cortex (mPFC), typically prelimbic cortex, is often described as promoting actions such as reward seeking, whereas ventral mPFC, typically infralimbic cortex, is thought to promote response inhibition. However, both dorsal and ventral mPFC are necessary for both expression and suppression of different behaviors, and each region may contribute to different functions depending on the specifics of the behavior tested. To better understand the roles of dorsal and ventral mPFC in motivated behavior we pharmacologically inactivated each area during operant fixed ratio 1 (FR1) seeking for a natural reward (sucrose), extinction, cue-induced reinstatement, and progressive ratio (PR) sucrose seeking in male Long–Evans rats. Bilateral inactivation of dorsal mPFC, but not ventral mPFC increased reward seeking during FR1. Inactivation of both dorsal and ventral mPFC decreased seeking during extinction. Bilateral inactivation of ventral mPFC, but not dorsal mPFC decreased reward seeking during cue-induced reinstatement. No effect of inactivation was found during PR. Our data contrast sharply with observations seen during drug seeking and fear conditioning, indicating that previously established roles of dorsal mPFC = going versus ventral mPFC = stopping are not applicable to all motivated behaviors and/or outcomes. Our results indicate that dichotomous functions of dorsal versus ventral mPFC, if they exist, may align better with other models, or may require the development of a new framework in which these multifaceted brain areas play different roles in action control depending on the behavioral context in which they are engaged.

Optogenetic and chemogenetic approaches to manipulate attention, impulsivity and behavioural flexibility in rodents

Studies manipulating neural activity acutely with optogenetic or chemogenetic intervention in behaving rodents have increased considerably in recent years. More often, these circuit-level neural manipulations are tested within an existing framework of behavioural testing that strives to model complex executive functions or symptomologies relevant to multidimensional psychiatric disorders in humans, such as attentional control deficits, impulsivity or behavioural (in)flexibility. This methods perspective argues in favour of carefully implementing these acute circuit-based approaches to better understand and model cognitive symptomologies or their similar isomorphic animal behaviours, which often arise and persist in overlapping brain circuitries. First, we offer some practical considerations for combining long-term, behavioural paradigms with optogenetic or chemogenetic interventions. Next, we examine how cell-type or projection-specific manipulations to the ascending neuromodulatory systems, local brain region or descending cortical glutamatergic projections influence aspects of cognitive control. For this, we primarily focus on the influence exerted on attentional and motor impulsivity performance in the (3-choice or) 5-choice serial reaction time task, and impulsive, risky or inflexible choice biases during alternative preference, reward discounting or reversal learning tasks.

Inhibitory Control: Mapping Medial Frontal Cortex

Functional anatomy in frontal cortex has been elusive and controversial. A new study combines neuronal ensemble recordings and optogenetics to map a functional gradient in rodent prefrontal cortex that supports inhibitory control.

Neuronal stability in medial frontal cortex sets individual variability in decision-making

In the brain, decision making is instantiated in dedicated neural circuits. However, there is considerable individual variability in decision-making behavior, particularly under uncertainty. The origins of decision variability within these conserved neural circuits are not known. Here we demonstrate in the rat medial frontal cortex (MFC) that individual variability is a consequence of altered stability in neuronal populations. In a sensory-guided choice task, rats trained on familiar stimuli were exposed to unfamiliar stimuli, resulting in variable choice responses across individuals. We created a recurrent network model to examine the source of variability in MFC neurons, and found that the landscape of neural population trajectories explained choice variability across different unfamiliar stimuli. We experimentally confirmed model predictions showing that trial-by-trial variability in neuronal activity indexes the landscape and predicts individual variation. These results show that neural stability is a critical component of the MFC neural dynamics that underpins individual variation in decision-making.

Neural Representation of Motor Output, Context and Behavioral Adaptation in Rat Medial Prefrontal Cortex During Learned Behavior

Selecting behavioral outputs in a dynamic environment is the outcome of integrating multiple information streams and weighing possible action outcomes with their value. Integration depends on the medial prefrontal cortex (mPFC), but how mPFC neurons encode information necessary for appropriate behavioral adaptation is poorly understood. To identify spiking patterns of mPFC during learned behavior, we extracellularly recorded neuronal action potential firing in the mPFC of rats performing a whisker-based "Go"/"No-go" object localization task. First, we identify three functional groups of neurons, which show different degrees of spiking modulation during task performance. One group increased spiking activity during correct "Go" behavior (positively modulated), the second group decreased spiking (negatively modulated) and one group did not change spiking. Second, the relative change in spiking was context-dependent and largest when motor output had contextual value. Third, the negatively modulated population spiked more when rats updated behavior following an error compared to trials without integration of error information. Finally, insufficient spiking in the positively modulated population predicted erroneous behavior under dynamic "No-go" conditions. Thus, mPFC neuronal populations with opposite spike modulation characteristics differentially encode context and behavioral updating and enable flexible integration of error corrections in future actions.

Neural representations of time-linked memory

Many cognitive processes, such as episodic memory and decision making, rely on the ability to form associations between two events that occur separately in time. The formation of such temporal associations depends on neural representations of three types of information: what has been presented (trace holding), what will follow (temporal expectation), and when the following event will occur (explicit timing). The present review seeks to link these representations with firing patterns of single neurons recorded while rodents and non-human primates associate stimuli, outcomes, and motor responses over time intervals. Across these studies, two distinct firing patterns were observed in the hippocampus, neocortex, and striatum: some neurons change firing rates during or shortly after the stimulus presentation and sustain the firing rate stably or sidlingly during the subsequent intervals (tonic firings). Other neurons transiently change firing rates during a specific moment within the time intervals (phasic firings), and as a group, they form a sequential firing pattern that covers the entire interval. Clever task designs used in some of these studies collectively provide evidence that both tonic and phasic firing responses represent trace holding, temporal expectation, and explicit timing. Subsequently, we applied machine-learning based classification approaches to the two firing patterns within the same dataset collected from rat medial prefrontal cortex during trace eyeblink conditioning. This quantitative analysis revealed that phasic-firing patterns showed greater selectivity for stimulus identity and temporal position than tonic-firing patterns. Our summary illuminates distributed neural representations of temporal association in the forebrain and generates several ideas for future investigations.

The infralimbic and prelimbic cortices contribute to the inhibitory control of cocaine-seeking behavior during a discriminative stimulus task in rats

The infralimbic and prelimbic (IL and PL, respectively) regions of the medial prefrontal cortex regulate the control of drug-seeking behavior. However, their roles in cocaine seeking in a discriminative stimulus (DS)-based self-administration task are unclear. To address this issue, male Sprague Dawley rats were trained on a DS task in which, on a trial-by-trial basis, a DS+ indicated that a lever press would produce a cocaine infusion, whereas a distinct DS- indicated that a lever press would produce nothing. IL and PL inactivation via GABA receptor activation decreased performance accuracy and disinhibited behavioral responding on DS- trials, resulting in greater lever pressing during the DS- presentation. This was accompanied by a decrease in cocaine infusions obtained, a finding confirmed in a subsequent experiment using a standard FR1 cocaine self-administration paradigm. We repeated the DS study using a food reward and found that inactivation of each region decreased performance accuracy but had no effect on the total number of food pellets earned. Additional experiments with the cocaine DS task found that dopamine receptor blockade in the IL, but not PL, reduced performance accuracy and disinhibited behavioral responding on DS- trials, whereas AMPA receptor blockade in the IL and PL had no effect on performance accuracy. These findings strongly suggest that, in a DS-based self-administration task in which rats must actively decide whether to engage in lever pressing (DS+) or withhold lever pressing (DS-) on a trial-by-trial basis, both the IL and PL contribute to the inhibitory control of drug-seeking behavior.

Medial Frontal Theta Is Entrained to Rewarded Actions

Rodents lick to consume fluids. The reward value of ingested fluids is likely to be encoded by neuronal activity entrained to the lick cycle. Here, we investigated relationships between licking and reward signaling by the medial frontal cortex (MFC), a key cortical region for reward-guided learning and decision-making. Multielectrode recordings of spike activity and field potentials were made in male rats as they performed an incentive contrast licking task. Rats received access to higher- and lower-value sucrose rewards over alternating 30 s periods. They learned to lick persistently when higher-value rewards were available and to suppress licking when lower-value rewards were available. Spectral analysis of spikes and fields revealed evidence for reward value being encoded by the strength of phase-locking of a 6-12 Hz theta rhythm to the rats' lick cycle. Recordings during the initial acquisition of the task found that the strength of phase-locking to the lick cycle was strengthened with experience. A modification of the task, with a temporal gap of 2 s added between reward deliveries, found that the rhythmic signals persisted during periods of dry licking, a finding that suggests the MFC encodes either the value of the currently available reward or the vigor with which rats act to consume it. Finally, we found that reversible inactivations of the MFC in the opposite hemisphere eliminated the encoding of reward information. Together, our findings establish that a 6-12 Hz theta rhythm, generated by the rodent MFC, is synchronized to rewarded actions.SIGNIFICANCE STATEMENT The cellular and behavioral mechanisms of reward signaling by the medial frontal cortex (MFC) have not been resolved. We report evidence for a 6-12 Hz theta rhythm that is generated by the MFC and synchronized with ongoing consummatory actions. Previous studies of MFC reward signaling have inferred value coding upon temporally sustained activity during the period of reward consumption. Our findings suggest that MFC activity is temporally sustained due to the consumption of the rewarding fluids, and not necessarily the abstract properties of the rewarding fluid. Two other major findings were that the MFC reward signals persist beyond the period of fluid delivery and are generated by neurons within the MFC.

Rodent Medial Frontal Control of Temporal Processing in the Dorsomedial Striatum

Although frontostriatal circuits are critical for the temporal control of action, how time is encoded in frontostriatal circuits is unknown. We recorded from frontal and striatal neurons while rats engaged in interval timing, an elementary cognitive function that engages both areas. We report four main results. First, "ramping" activity, a monotonic change in neuronal firing rate across time, is observed throughout frontostriatal ensembles. Second, frontostriatal activity scales across multiple intervals. Third, striatal ramping neurons are correlated with activity of the medial frontal cortex. Finally, interval timing and striatal ramping activity are disrupted when the medial frontal cortex is inactivated. Our results support the view that striatal neurons integrate medial frontal activity and are consistent with drift-diffusion models of interval timing. This principle elucidates temporal processing in frontostriatal circuits and provides insight into how the medial frontal cortex exerts top-down control of cognitive processing in the striatum.SIGNIFICANCE STATEMENT The ability to guide actions in time is essential to mammalian behavior from rodents to humans. The prefrontal cortex and striatum are critically involved in temporal processing and share extensive neuronal connections, yet it remains unclear how these structures represent time. We studied these two brain areas in rodents performing interval-timing tasks and found that time-dependent "ramping" activity, a monotonic increase or decrease in neuronal activity, was a key temporal signal. Furthermore, we found that striatal ramping activity was correlated with and dependent upon medial frontal activity. These results provide insight into information-processing principles in frontostriatal circuits.

Oculomotor measures reveal the temporal dynamics of preparing for search

Theories of visual search assume that selection is driven by an active template representation of the target object. Earlier studies suggest that template activation occurs prior to search, but the temporal dynamics of such preactivation remain unclear. Two experiments employed microsaccades to track both general preparation (i.e., anticipation of the search task as such) and template-specific preparation (i.e., anticipation of target selection) of visual search. Participants memorized a target color (i.e., the template) for an upcoming search task. During the delay period, we presented an irrelevant rapid serial visual presentation (RSVP) of lateralized colored disks. Crucially, at different time points into the RSVP, the template color was inserted, allowing us to measure attentional biases toward the template match as a function of time. Results showed a general suppression of saccades: the closer in time to the search display, the less saccades were produced. This suppression was stronger when a template-matching color was present compared to when absent. However, when microsaccades occurred, they were biased toward the template-matching color and more so just prior to the search display. We conclude that observers adapt search template activation to the anticipated moment of search, and that microsaccades reflect general as well as target-specific preparation effects.

Distinct Sources of Deterministic and Stochastic Components of Action Timing Decisions in Rodent Frontal Cortex

The selection and timing of actions are subject to determinate influences such as sensory cues and internal state as well as to effectively stochastic variability. Although stochastic choice mechanisms are assumed by many theoretical models, their origin and mechanisms remain poorly understood. Here we investigated this issue by studying how neural circuits in the frontal cortex determine action timing in rats performing a waiting task. Electrophysiological recordings from two regions necessary for this behavior, medial prefrontal cortex (mPFC) and secondary motor cortex (M2), revealed an unexpected functional dissociation. Both areas encoded deterministic biases in action timing, but only M2 neurons reflected stochastic trial-by-trial fluctuations. This differential coding was reflected in distinct timescales of neural dynamics in the two frontal cortical areas. These results suggest a two-stage model in which stochastic components of action timing decisions are injected by circuits downstream of those carrying deterministic bias signals.

Amygdalar Gating of Early Sensory Processing through Interactions with Locus Coeruleus

Fear- and stress-induced activity in the amygdala has been hypothesized to influence sensory brain regions through the influence of the amygdala on neuromodulatory centers. To directly examine this relationship, we used optical imaging to observe odor-evoked activity in populations of olfactory bulb inhibitory interneurons and of synaptic terminals of olfactory sensory neurons (the primary sensory neurons of the olfactory system, which provide the initial olfactory input to the brain) during pharmacological inactivation of amygdala and locus coeruleus (LC) in mice. Although the amygdala does not directly project to the olfactory bulb, joint pharmacological inactivation of the central, basolateral, and lateral nuclei of the amygdala nonetheless strongly suppressed odor-evoked activity in GABAergic inhibitory interneuron populations in the OB. This suppression was prevented by inactivation of LC or pretreatment of the olfactory bulb with a broad-spectrum noradrenergic receptor antagonist. Visualization of synaptic output from olfactory sensory neuron terminals into the olfactory bulb of the brain revealed that amygdalar inactivation preferentially strengthened the odor-evoked synaptic output of weakly activated populations of sensory afferents from the nose, thus demonstrating a change in sensory gating potentially mediated by local inhibition of olfactory sensory neuron terminals. We conclude that amygdalar activity influences olfactory processing as early as the primary sensory input to the brain by modulating norepinephrine release from the locus coeruleus into the olfactory bulb. These findings show that the amygdala and LC state actively determines which sensory signals are selected for processing in sensory brain regions. Similar local circuitry operates in the olfactory, visual, and auditory systems, suggesting a potentially shared mechanism across modalities.SIGNIFICANCE STATEMENT The affective state is increasingly understood to influence early neural processing of sensory stimuli, not just the behavioral response to those stimuli. The present study elucidates one circuit by which the amygdala, a critical structure for emotional learning, valence coding, and stress, can shape sensory input to the brain and early sensory processing through its connections to the locus coeruleus. One function of this interaction appears to be sensory gating, because inactivating the central, basolateral, and lateral nuclei of the amygdala selectively strengthened the weakest olfactory inputs to the brain. This linkage of amygdalar and LC output to primary sensory signaling may have implications for affective disorders that include sensory dysfunctions like hypervigilance, attentional bias, and impaired sensory gating.