Control of adaptive action selection by secondary motor cortex during flexible visual categorization

Flexibility in choosing decision policies in gathering discrete evidence over time

The brain can remarkably adapt its decision-making process to suit the dynamic environment and diverse aims and demands. The brain's flexibility can be classified into three categories: flexibility in choosing solutions, decision policies, and actions. We employ two experiments to explore flexibility in decision policy: a visual object categorization task and an auditory object categorization task. Both tasks required participants to accumulate discrete evidence over time, with the only difference being the sensory state of the stimuli. We aim to investigate how the brain demonstrates flexibility in selecting decision policies in different sensory contexts when the solution and action remain the same. Our results indicate that the decision policy of the brain in integrating information is independent of inter-pulse interval across these two tasks. However, the decision policy based on how the brain ranks the first and second pulse of evidence changes flexibly. We show that the sequence of pulses does not affect the choice accuracy in the auditory mode. However, in the visual mode, the first pulse had the larger leverage on decisions. Our research underscores the importance of incorporating diverse contexts to improve our understanding of the brain's flexibility in real-world decision-making.

Prediction-error signals in anterior cingulate cortex drive task-switching

Task-switching is a fundamental cognitive ability that allows animals to update their knowledge of current rules or contexts. Detecting discrepancies between predicted and observed events is essential for this process. However, little is known about how the brain computes cognitive prediction-errors and whether neural prediction-error signals are causally related to task-switching behaviours. Here we trained mice to use a prediction-error to switch, in a single trial, between responding to the same stimuli using two distinct rules. Optogenetic silencing and un-silencing, together with widefield and two-photon calcium imaging revealed that the anterior cingulate cortex (ACC) was specifically required for this rapid task-switching, but only when it exhibited neural prediction-error signals. These prediction-error signals were projection-target dependent and were larger preceding successful behavioural transitions. An all-optical approach revealed a disinhibitory interneuron circuit required for successful prediction-error computation. These results reveal a circuit mechanism for computing prediction-errors and transitioning between distinct cognitive states.

Single-Trial Representations of Decision-Related Variables by Decomposed Frontal Corticostriatal Ensemble Activity

The frontal cortex-striatum circuit plays a pivotal role in adaptive goal-directed behaviors. However, it remains unclear how decision-related signals are mediated through cross-regional transmission between the medial frontal cortex and the striatum by neuronal ensembles in making decision based on outcomes of past action. Here, we analyzed neuronal ensemble activity obtained through simultaneous multiunit recordings in the secondary motor cortex (M2) and dorsal striatum (DS) in rats performing an outcome-based left-or-right choice task. By adopting tensor component analysis (TCA), a single-trial-based unsupervised dimensionality reduction approach, for concatenated ensembles of M2 and DS neurons, we identified distinct three spatiotemporal neural dynamics (TCA components) at the single-trial level specific to task-relevant variables. Choice-position-selective neural dynamics reflected the positions chosen and was correlated with the trial-to-trial fluctuation of behavioral variables. Intriguingly, choice-pattern-selective neural dynamics distinguished whether the incoming choice was a repetition or a switch from the previous choice before a response choice. Other neural dynamics was selective to outcome and increased within-trial activity following response. Our results demonstrate how the concatenated ensembles of M2 and DS process distinct features of decision-related signals at various points in time. Thereby, the M2 and DS collaboratively monitor action outcomes and determine the subsequent choice, whether to repeat or switch, for action selection.

Convergence of inputs from the basal ganglia with layer 5 of motor cortex and cerebellum in mouse motor thalamus

A key to motor control is the motor thalamus, where several inputs converge. One excitatory input originates from layer 5 of primary motor cortex (M1L5), while another arises from the deep cerebellar nuclei (Cb). M1L5 terminals distribute throughout the motor thalamus and overlap with GABAergic inputs from the basal ganglia output nuclei, the internal segment of the globus pallidus (GPi), and substantia nigra pars reticulata (SNr). In contrast, it is thought that Cb and basal ganglia inputs are segregated. Therefore, we hypothesized that one potential function of the GABAergic inputs from basal ganglia is to selectively inhibit, or gate, excitatory signals from M1L5 in the motor thalamus. Here, we tested this possibility and determined the circuit organization of mouse (both sexes) motor thalamus using an optogenetic strategy in acute slices. First, we demonstrated the presence of a feedforward transthalamic pathway from M1L5 through motor thalamus. Importantly, we discovered that GABAergic inputs from the GPi and SNr converge onto single motor thalamic cells with excitatory synapses from M1L5. Separately, we also demonstrate that, perhaps unexpectedly, GABAergic GPi and SNr inputs converge with those from the Cb. We interpret these results to indicate that a role of the basal ganglia is to gate the thalamic transmission of M1L5 and Cb information to cortex.

Convergence of inputs from the basal ganglia with layer 5 of motor cortex and cerebellum in mouse motor thalamus

A key to motor control is the motor thalamus, where several inputs converge. One excitatory input originates from layer 5 of primary motor cortex (M1L5), while another arises from the deep cerebellar nuclei (Cb). M1L5 terminals distribute throughout the motor thalamus and overlap with GABAergic inputs from the basal ganglia output nuclei, the internal segment of the globus pallidus (GPi) and substantia nigra pars reticulata (SNr). In contrast, it is thought that Cb and basal ganglia inputs are segregated. Therefore, we hypothesized that one potential function of the GABAergic inputs from basal ganglia is to selectively inhibit, or gate, excitatory signals from M1L5 in the motor thalamus. Here, we tested this possibility and determined the circuit organization of mouse (both sexes) motor thalamus using an optogenetic strategy in acute slices. First, we demonstrated the presence of a feedforward transthalamic pathway from M1L5 through motor thalamus. Importantly, we discovered that GABAergic inputs from the GPi and SNr converge onto single motor thalamic cells with excitatory synapses from M1L5 and, unexpectedly, Cb as well. We interpret these results to indicate that a role of the basal ganglia is to gate the thalamic transmission of M1L5 and Cb information to cortex.

The secondary somatosensory cortex gates mechanical and heat sensitivity

The cerebral cortex is vital for the processing and perception of sensory stimuli. In the somatosensory axis, information is received primarily by two distinct regions, the primary (S1) and secondary (S2) somatosensory cortices. Top-down circuits stemming from S1 can modulate mechanical and cooling but not heat stimuli such that circuit inhibition causes blunted perception. This suggests that responsiveness to particular somatosensory stimuli occurs in a modality specific fashion and we sought to determine additional cortical substrates. In this work, we identify in a mouse model that inhibition of S2 output increases mechanical and heat, but not cooling sensitivity, in contrast to S1. Combining 2-photon anatomical reconstruction with chemogenetic inhibition of specific S2 circuits, we discover that S2 projections to the secondary motor cortex (M2) govern mechanical and heat sensitivity without affecting motor performance or anxiety. Taken together, we show that S2 is an essential cortical structure that governs mechanical and heat sensitivity.

The Secondary Motor Cortex-striatum Circuit Contributes to Suppressing Inappropriate Responses in Perceptual Decision Behavior

The secondary motor cortex (M2) encodes choice-related information and plays an important role in cue-guided actions. M2 neurons innervate the dorsal striatum (DS), which also contributes to decision-making behavior, yet how M2 modulates signals in the DS to influence perceptual decision-making is unclear. Using mice performing a visual Go/No-Go task, we showed that inactivating M2 projections to the DS impaired performance by increasing the false alarm (FA) rate to the reward-irrelevant No-Go stimulus. The choice signal of M2 neurons correlated with behavioral performance, and the inactivation of M2 neurons projecting to the DS reduced the choice signal in the DS. By measuring and manipulating the responses of direct or indirect pathway striatal neurons defined by M2 inputs, we found that the indirect pathway neurons exhibited a shorter response latency to the No-Go stimulus, and inactivating their early responses increased the FA rate. These results demonstrate that the M2-to-DS pathway is crucial for suppressing inappropriate responses in perceptual decision behavior.

Prelimbic neuron assemblies with delayed activation encode the economic decision-making process in a bandit game

The medial prefrontal cortex (mPFC) is critical to an animal's value-based decision-making process. However, due to heterogeneity of local mPFC neurons, which neuron group and how it contributes to the alteration of the animal's decision is yet to be explored. And the effect of empty reward in this process is often neglected. Here, we adopted a two-port bandit game paradigm for mice and applied synchronized calcium imaging to the prelimbic area of the mPFC. The results showed that neurons recruited in the bandit game exhibit three distinct firing patterns. Specially, neurons with delayed activation (deA neurons¹) carried exclusive information on reward type and changes of choice value. We demonstrated that these deA neurons were essential for the construction of choice-outcome correlation and the trial-to-trial modification of decision. Additionally, we found that in a long-term gambling game, members of the deA neuron assembly were dynamically shifting while maintaining the function, and the importance of empty reward feedbacks were gradually elevated to the same level as reward. Together, these results revealed a vital role for prelimbic deA neurons in the gambling tasks and a new perspective on the encoding of economic decision-making.

The Secondary Somatosensory Cortex Gates Mechanical and Thermal Sensitivity

The cerebral cortex is vital for the perception and processing of sensory stimuli. In the somatosensory axis, information is received by two distinct regions, the primary (S1) and secondary (S2) somatosensory cortices. Top-down circuits stemming from S1 can modulate mechanical and cooling but not heat stimuli such that circuit inhibition causes blunted mechanical and cooling perception. Using optogenetics and chemogenetics, we find that in contrast to S1, an inhibition of S2 output increases mechanical and heat, but not cooling sensitivity. Combining 2-photon anatomical reconstruction with chemogenetic inhibition of specific S2 circuits, we discover that S2 projections to the secondary motor cortex (M2) govern mechanical and thermal sensitivity without affecting motor or cognitive function. This suggests that while S2, like S1, encodes specific sensory information, that S2 operates through quite distinct neural substrates to modulate responsiveness to particular somatosensory stimuli and that somatosensory cortical encoding occurs in a largely parallel fashion.

Carboxypeptidase E conditional knockout mice exhibit learning and memory deficits and neurodegeneration

Carboxypeptidase E (CPE) is a multifunctional protein with many nonenzymatic functions in various systems. Previous studies using CPE knock-out mice have shown that CPE has neuroprotective effects against stress and is involved in learning and memory. However, the functions of CPE in neurons are still largely unknown. Here we used a Camk2a-Cre system to conditionally knockout CPE in neurons. The wild-type, CPE^flox/-, and CPE^flox/flox mice were weaned, ear-tagged, and tail clipped for genotyping at 3 weeks old, and they underwent open field, object recognition, Y-maze, and fear conditioning tests at 8 weeks old. The CPE^flox/flox mice had normal body weight and glucose metabolism. The behavioral tests showed that CPE^flox/flox mice had impaired learning and memory compared with wild-type and CPE^flox/- mice. Surprisingly, the subiculum (Sub) region of CPE^flox/flox mice was completely degenerated, unlike the CPE full knockout mice, which exhibit CA3 region neurodegeneration. In addition, doublecortin immunostaining suggested that neurogenesis in the dentate gyrus of the hippocampus was significantly reduced in CPE^flox/flox mice. Interestingly, TrkB phosphorylation in the hippocampus was downregulated in CPE^flox/flox mice, but brain-derived neurotrophic factor levels were not. In both the hippocampus and dorsal medial prefrontal cortex, we observed reduced MAP2 and GFAP expression in CPE^flox/flox mice. Taken together, the results of this study demonstrate that specific neuronal CPE knockout leads to central nervous system dysfunction in mice, including learning and memory deficits, hippocampal Sub degeneration and impaired neurogenesis.

Influence of Recent Trial History on Interval Timing

Interval timing is involved in a variety of cognitive behaviors such as associative learning and decision-making. While it has been shown that time estimation is adaptive to the temporal context, it remains unclear how interval timing behavior is influenced by recent trial history. Here we found that, in mice trained to perform a licking-based interval timing task, a decrease of inter-reinforcement interval in the previous trial rapidly shifted the time of anticipatory licking earlier. Optogenetic inactivation of the anterior lateral motor cortex (ALM), but not the medial prefrontal cortex, for a short time before reward delivery caused a decrease in the peak time of anticipatory licking in the next trial. Electrophysiological recordings from the ALM showed that the response profiles preceded by short and long inter-reinforcement intervals exhibited task-engagement-dependent temporal scaling. Thus, interval timing is adaptive to recent experience of the temporal interval, and ALM activity during time estimation reflects recent experience of interval.

Neural Mechanisms That Make Perceptual Decisions Flexible

Neural mechanisms of perceptual decision making have been extensively studied in experimental settings that mimic stable environments with repeating stimuli, fixed rules, and payoffs. In contrast, we live in an ever-changing environment and have varying goals and behavioral demands. To accommodate variability, our brain flexibly adjusts decision-making processes depending on context. Here, we review a growing body of research that explores the neural mechanisms underlying this flexibility. We highlight diverse forms of context dependency in decision making implemented through a variety of neural computations. Context-dependent neural activity is observed in a distributed network of brain structures, including posterior parietal, sensory, motor, and subcortical regions, as well as the prefrontal areas classically implicated in cognitive control. We propose that investigating the distributed network underlying flexible decisions is key to advancing our understanding and discuss a path forward for experimental and theoretical investigations.

Activity in developing prefrontal cortex is shaped by sleep and sensory experience

In developing rats, behavioral state exerts a profound modulatory influence on neural activity throughout the sensorimotor system, including primary motor cortex (M1). We hypothesized that similar state-dependent modulation occurs in prefrontal cortical areas with which M1 forms functional connections. Here, using 8- and 12-day-old rats cycling freely between sleep and wake, we record neural activity in M1, secondary motor cortex (M2), and medial prefrontal cortex (mPFC). At both ages in all three areas, neural activity increased during active sleep (AS) compared with wake. Also, regardless of behavioral state, neural activity in all three areas increased during periods when limbs were moving. The movement-related activity in M2 and mPFC, like that in M1, is driven by sensory feedback. Our results, which diverge from those of previous studies using anesthetized pups, demonstrate that AS-dependent modulation and sensory responsivity extend to prefrontal cortex. These findings expand the range of possible factors shaping the activity-dependent development of higher-order cortical areas.

Prospective and retrospective values integrated in frontal cortex drive predictive choice

To make a deliberate action in a volatile environment, the brain must frequently reassess the value of each action (action-value). Choice can be initially made from the experience of trial-and-errors, but once the dynamics of the environment is learned, the choice can be made from the knowledge of the environment. The action-values constructed from the experience (retrospective value) and the ones from the knowledge (prospective value) were identified in various regions of the brain. However, how and which neural circuit integrates these values and executes the chosen action remains unknown. Combining reinforcement learning and two-photon calcium imaging, we found that the preparatory activity of neurons in a part of the frontal cortex, the anterior-lateral motor (ALM) area, initially encodes retrospective value, but after extensive training, they jointly encode the retrospective and prospective value. Optogenetic inhibition of ALM preparatory activity specifically abolished the expert mice's predictive choice behavior and returned them to the novice-like state. Thus, the integrated action-value encoded in the preparatory activity of ALM plays an important role to bias the action toward the knowledge-dependent, predictive choice behavior.

Dynamics of history-dependent perceptual judgment

Identical physical inputs do not always evoke identical percepts. To investigate the role of stimulus history in tactile perception, we designed a task in which rats had to judge each vibrissal vibration, in a long series, as strong or weak depending on its mean speed. After a low-speed stimulus (trial n - 1), rats were more likely to report the next stimulus (trial n) as strong, and after a high-speed stimulus, they were more likely to report the next stimulus as weak, a repulsive effect that did not depend on choice or reward on trial n - 1. This effect could be tracked over several preceding trials (i.e., n - 2 and earlier) and was characterized by an exponential decay function, reflecting a trial-by-trial incorporation of sensory history. Surprisingly, the influence of trial n - 1 strengthened as the time interval between n - 1 and n grew. Human subjects receiving fingertip vibrations showed these same key findings. We are able to account for the repulsive stimulus history effect, and its detailed time scale, through a single-parameter model, wherein each new stimulus gradually updates the subject's decision criterion. This model points to mechanisms underlying how the past affects the ongoing subjective experience.

Stress induces microglia-associated synaptic circuit alterations in the dorsomedial prefrontal cortex

The mammalian dorsomedial prefrontal cortex (dmPFC) receives diverse inputs and plays important roles in adaptive behavior and cognitive flexibility. Stress, a major risk factor for many psychiatric disorders, compromises the structure and function of multiple brain regions and circuits. Here we show that 7-day restraint stress impairs reversal learning in the 4-choice odor discrimination test, a decision-making task requiring an intact dmPFC. In vivo two-photon imaging further reveals that stress increases dmPFC dendritic spine elimination, particularly those of the mushroom morphology, without affecting spine formation. In addition, stress alters dmPFC microglial branching complexity and elevates their terminal process dynamics. In stressed mice, dmPFC microglia contact dendrites more frequently, and dendritic spines with microglial contact are prone to elimination. In summary, our work suggests that stress-induced changes in glial-synapse interaction contributes to synaptic loss in dmPFC, resulting in neuronal circuit deficits and impaired cognitive flexibility.

•

Restraint stress impairs cognitive flexibility in adolescent mice.

•

Stress leads to synapse loss on pyramidal neurons in the dorsomedial prefrontal cortex.

•

Stress decreases microglial complexity but increases their terminal dynamics and contacts with dendritic spines.

•

Dendritic spines contacted by microglial processes are more prone to elimination.

A cortical circuit mechanism for structural knowledge-based flexible sensorimotor decision-making

Making flexible decisions based on prior knowledge about causal environmental structures is a hallmark of goal-directed cognition in mammalian brains. Although several association brain regions, including the orbitofrontal cortex (OFC), have been implicated, the precise neuronal circuit mechanisms underlying knowledge-based decision-making remain elusive. Here, we established an inference-based auditory categorization task where mice performed within-session flexible stimulus re-categorization by inferring the changing task rules. We constructed a reinforcement learning model to recapitulate the inference-based flexible behavior and quantify the hidden variables associated with task structural knowledge. Combining two-photon population imaging and projection-specific optogenetics, we found that auditory cortex (ACx) neurons encoded the hidden task rule variable, which requires feedback input from the OFC. Silencing OFC-ACx input specifically disrupted re-categorization behavior. Direct imaging from OFC axons in the ACx revealed task state-related feedback signals, supporting the knowledge-based updating mechanism. Our data reveal a cortical circuit mechanism underlying structural knowledge-based flexible decision-making.

Secondary motor cortex: Broadcasting and biasing animal's decisions through long-range circuits

Medial secondary motor cortex (MOs or M2) constitutes the dorsal aspect of the rodent medial frontal cortex. We previously proposed that the function of MOs is to link antecedent conditions, including sensory stimuli and prior choices, to impending actions. In this review, we focus on the long-range pathways between MOs and other cortical and subcortical regions. We highlight three circuits: (1) connections with visual and auditory cortices that are essential for predictive coding of perceptual inputs; (2) connections with motor cortex and brainstem that are responsible for top-down, context-dependent modulation of movements; (3) connections with retrosplenial cortex, orbitofrontal cortex, and basal ganglia that facilitate reward-based learning. Together, these long-range circuits allow MOs to broadcast choice signals for feedback and to bias decision-making processes.

Control of adaptive action selection by secondary motor cortex during flexible visual categorization

Adaptive action selection during stimulus categorization is an important feature of flexible behavior. To examine neural mechanism underlying this process, we trained mice to categorize the spatial frequencies of visual stimuli according to a boundary that changed between blocks of trials in a session. Using a model with a dynamic decision criterion, we found that sensory history was important for adaptive action selection after the switch of boundary. Bilateral inactivation of the secondary motor cortex (M2) impaired adaptive action selection by reducing the behavioral influence of sensory history. Electrophysiological recordings showed that M2 neurons carried more information about upcoming choice and previous sensory stimuli when sensorimotor association was being remapped than when it was stable. Thus, M2 causally contributes to flexible action selection during stimulus categorization, with the representations of upcoming choice and sensory history regulated by the demand to remap stimulus-action association.