Cell-type specific responses to associative learning in the primary motor cortex

Somatostatin neurons detect stimulus-reward contingencies to reduce neocortical inhibition during learning

Learning involves the association of discrete events in the world to infer causality, likely through a cascade of changes at input- and target-specific synapses. Transient or sustained disinhibition may initiate cortical circuit plasticity important for association learning, but the cellular networks involved have not been well defined. Using recordings in acute brain slices, we show that whisker-dependent sensory association learning drives a durable, target-specific reduction in inhibition from somatostatin (SST)-expressing GABAergic neurons onto pyramidal (Pyr) neurons in superficial but not deep layers of mouse somatosensory cortex. Critically, SST output was not altered when stimuli and rewards were unpaired, indicating that these neurons are sensitive to stimulus-reward contingency. Depression of SST output onto Pyr neurons could be phenocopied by chemogenetic suppression of SST activity outside of the training context. Thus, neocortical SST neuron output can undergo long-lasting modifications to selectively disinhibit superficial layers of sensory neocortex during learning.

Age-related increase in the excitability of mouse layer V pyramidal neurons in the primary motor cortex is accompanied by an increased persistent inward current

Sarcopenia, or pathological age-related loss of muscle strength and mass, contributes to physical function impairment in older adults. While current understanding of sarcopenia is centered mostly on neuromuscular mechanisms, mounting evidence supports that deficits at the level of the primary motor cortex (PMC) play a significant role. Despite the importance of the PMC to initiate movement, understanding of how age affects the excitability of layer V pyramidal neurons (LVPNs) of the PMC is limited. To address this, we used the whole-cell patch clamp technique to measure the excitability of LVPNs of the PMC in young, late adulthood, and old mice. Old LVPNs had increased firing frequency and membrane input resistance, but no differences in action potential kinetics versus young and late adulthood mice. Since changes in the persistent inward current (PIC) are known to contribute to changes in motor neuron excitability, we measured LVPN PICs as a putative contributor to LVPN excitability. The PIC amplitude was increased in old LVPN via increases in Na+ and Ca2+ PICs, in addition to being active across a wider voltage range. Given that LVPN function is integral to initiation of voluntary muscle contraction, altered LVPN excitability likely contributes to age-related impairment of physical function.

Effect of Extrinsic Reward on Motor Plasticity during Skill Learning

Human motor skill acquisition is improved by performance feedback, and coupling such feedback with extrinsic reward (such as money) can enhance skill learning. However, the neurophysiology underlying such behavioral effect is unclear. To bridge this gap, we assessed the effects of reward on multiple forms of motor plasticity during skill learning. Sixty-five healthy participants divided into three groups performed a pinch-grip skill task with sensory feedback only, sensory and reinforcement feedback, or both feedback coupled with an extrinsic monetary reward during skill training. To probe motor plasticity, we applied transcranial magnetic stimulation at rest, on the left primary motor cortex before, at an early-training time point, and after training in the three groups and measured motor-evoked potentials from task-relevant muscle of the right arm. This allowed us to evaluate the amplitude and variability of corticospinal output, GABAergic short-intracortical inhibition, and use-dependent plasticity before training and at two additional time points (early and end training). At the behavioral level, monetary reward accelerated skill learning. In parallel, corticospinal output became less variable early on during training in the presence of extrinsic reward. Interestingly, this effect was particularly pronounced for participants who were more sensitive to reward, as evaluated in an independent questionnaire. Other measures of motor excitability remained comparable across groups. These findings highlight that a mechanism underlying the benefit of reward on motor skill learning is the fine-tuning of early-training resting-state corticospinal variability.

Reward signals in the motor cortex: from biology to neurotechnology

Over the past decade, research has shown that the primary motor cortex (M1), the brain's main output for movement, also responds to rewards. These reward signals may shape motor output in its final stages, influencing movement invigoration and motor learning. In this Perspective, we highlight the functional roles of M1 reward signals and propose how they could guide advances in neurotechnologies for movement restoration, specifically brain-computer interfaces and non-invasive brain stimulation. Understanding M1 reward signals may open new avenues for enhancing motor control and rehabilitation.

Neocortical somatostatin neuron diversity in cognition and learning

Somatostatin-expressing (SST) neurons are a major class of electrophysiologically and morphologically distinct inhibitory cells in the mammalian neocortex. Transcriptomic data suggest that this class can be divided into multiple subtypes that are correlated with morpho-electric properties. At the same time, availability of transgenic tools to identify and record from SST neurons in awake, behaving mice has stimulated insights about their response properties and computational function. Neocortical SST neurons are regulated by sleep and arousal, attention, and novelty detection, and show marked response plasticity during learning. Recent studies suggest that subtype-specific analysis of SST neurons may be critical for understanding their complex roles in cortical function. In this review, we discuss and synthesize recent advances in understanding the diversity, circuit integration, and functional properties of this important group of GABAergic neurons.

The short-term plasticity of VIP interneurons in motor cortex

Short-term plasticity is an important feature in the brain for shaping neural dynamics and for information processing. Short-term plasticity is known to depend on many factors including brain region, cortical layer, and cell type. Here we focus on vasoactive-intestinal peptide (VIP) interneurons (INs). VIP INs play a key disinhibitory role in cortical circuits by inhibiting other IN types, including Martinotti cells (MCs) and basket cells (BCs). Despite this prominent role, short-term plasticity at synapses to and from VIP INs is not well described. In this study, we therefore characterized the short-term plasticity at inputs and outputs of genetically targeted VIP INs in mouse motor cortex. To explore inhibitory to inhibitory (I → I) short-term plasticity at layer 2/3 (L2/3) VIP IN outputs onto L5 MCs and BCs, we relied on a combination of whole-cell recording, 2-photon microscopy, and optogenetics, which revealed that VIP IN→MC/BC synapses were consistently short-term depressing. To explore excitatory (E) → I short-term plasticity at inputs to VIP INs, we used extracellular stimulation. Surprisingly, unlike VIP IN outputs, E → VIP IN synapses exhibited heterogeneous short-term dynamics, which we attributed to the target VIP IN cell rather than the input. Computational modeling furthermore linked the diversity in short-term dynamics at VIP IN inputs to a wide variability in probability of release. Taken together, our findings highlight how short-term plasticity at VIP IN inputs and outputs is specific to synapse type. We propose that the broad diversity in short-term plasticity of VIP IN inputs forms a basis to code for a broad range of contrasting signal dynamics.

Multimodal Nature of the Single-cell Primate Brain Atlas: Morphology, Transcriptome, Electrophysiology, and Connectivity

Primates exhibit complex brain structures that augment cognitive function. The neocortex fulfills high-cognitive functions through billions of connected neurons. These neurons have distinct transcriptomic, morphological, and electrophysiological properties, and their connectivity principles vary. These features endow the primate brain atlas with a multimodal nature. The recent integration of next-generation sequencing with modified patch-clamp techniques is revolutionizing the way to census the primate neocortex, enabling a multimodal neuronal atlas to be established in great detail: (1) single-cell/single-nucleus RNA-seq technology establishes high-throughput transcriptomic references, covering all major transcriptomic cell types; (2) patch-seq links the morphological and electrophysiological features to the transcriptomic reference; (3) multicell patch-clamp delineates the principles of local connectivity. Here, we review the applications of these technologies in the primate neocortex and discuss the current advances and tentative gaps for a comprehensive understanding of the primate neocortex.

Synaptic configuration and reconfiguration in the neocortex are spatiotemporally selective

Brain computation relies on the neural networks. Neurons extend the neurites such as dendrites and axons, and the contacts of these neurites that form chemical synapses are the biological basis of signal transmissions in the central nervous system. Individual neuronal outputs can influence the other neurons within the range of the axonal spread, while the activities of single neurons can be affected by the afferents in their somatodendritic fields. The morphological profile, therefore, binds the functional role each neuron can play. In addition, synaptic connectivity among neurons displays preference based on the characteristics of presynaptic and postsynaptic neurons. Here, the author reviews the "spatial" and "temporal" connection selectivity in the neocortex. The histological description of the neocortical circuitry depends primarily on the classification of cell types, and the development of gene engineering techniques allows the cell type-specific visualization of dendrites and axons as well as somata. Using genetic labeling of particular cell populations combined with immunohistochemistry and imaging at a subcellular spatial resolution, we revealed the "spatial selectivity" of cortical wirings in which synapses are non-uniformly distributed on the subcellular somatodendritic domains in a presynaptic cell type-specific manner. In addition, cortical synaptic dynamics in learning exhibit presynaptic cell type-dependent "temporal selectivity": corticocortical synapses appear only transiently during the learning phase, while learning-induced new thalamocortical synapses persist, indicating that distinct circuits may supervise learning-specific ephemeral synapse and memory-specific immortal synapse formation. The selectivity of spatial configuration and temporal reconfiguration in the neural circuitry may govern diverse functions in the neocortex.

Inhibitory neurons: VIP neurons expect rewards

Inhibitory neurons which express vasoactive intestinal polypeptide, VIPs, are a small subset of the mammalian cortex but in importance live up to their acronym. New research shows that these critical control knobs of cortical activity are specifically activated by actions taken when rewards are anticipated rather than consummated.

VIP interneurons in sensory cortex encode sensory and action signals but not direct reward signals

Vasoactive intestinal peptide (VIP) interneurons in sensory cortex modulate sensory responses based on global exploratory behavior and arousal state, but their function during non-exploratory, goal-directed behavior is not well understood. In particular, whether VIP cells are activated by sensory cues, reward-seeking actions, or directly by reinforcement is unclear. We trained mice on a Go/NoGo whisker touch detection task that included a delay period and other features designed to separate sensory-evoked, action-related, and reward-related neural activity. Mice had to lick in response to a whisker stimulus to receive a variable-sized reward. Using two-photon calcium imaging, we measured ΔF/F responses of L2/3 VIP neurons in whisker somatosensory cortex (S1) during behavior. In both expert and novice mice, VIP cells were strongly activated by whisker stimuli and goal-directed actions (licking), but not by reinforcement. VIP cells showed somatotopic whisker tuning that was spatially organized relative to anatomical columns in S1, unlike lick-related signals which were spatially widespread. In expert mice, lick-related VIP responses were suppressed, not enhanced, when a reward was delivered, and the amount of suppression increased with reward size. This reward-related suppression was not seen in novice mice, where reward delivery was not yoked to licking. These results indicate that besides arousal and global state variables, VIP cells are activated by local sensory features and goal-directed actions, but not directly by reinforcement. Instead, our results are consistent with a role for VIP cells in encoding the expectation of reward associated with motor actions.

Emerging V1 neuronal ensembles with enhanced connectivity after associative learning

Introduction

The visual stimulus-specific responses in the primary visual cortex (V1) undergo plastic changes after associative learning. During the learning process, neuronal ensembles, defined as groups of coactive neurons, are well known to be related to learning and memory. However, it remains unclear what effect learning has on ensembles, and which neuronal subgroups within those ensembles play a key role in associative learning.

Methods

We used two-photon calcium imaging in mice to record the activity of V1 neurons before and after fear conditioning associated with a visual cue (blue light). We first defined neuronal ensembles by thresholding their functional connectivity in response to blue (conditioned) or green (control) light. We defined neurons that existed both before and after conditioning as stable neurons. Neurons which were recruited after conditioning were defined as new neurons. The graph theory-based analysis was performed to quantify the changes in connectivity within ensembles after conditioning.

Results

A significant enhancement in the connectivity strength (the average correlation with other neurons) was observed in the blue ensembles after conditioning. We found that stable neurons within the blue ensembles showed a significantly smaller clustering coefficient (the value represented the degree of interconnectedness among a node's neighbors) after conditioning than they were before conditioning. Additionally, new neurons within the blue ensembles had a larger clustering coefficient, similar relative degree (the value represented the number of functional connections between neurons) and connectivity strength compared to stable neurons in the same ensembles.

Discussion

Overall, our results demonstrated that the plastic changes caused by conditioning occurred in subgroups of neurons in the ensembles. Moreover, new neurons from conditioned ensembles may play a crucial role in memory formation, as they exhibited not only similar connection competence in relative degree and connectivity strength as stable neurons, but also showed a significantly larger clustering coefficient compared to the stable neurons within the same ensembles after conditioning.

Whole-brain mapping of long-range inputs to the VIP-expressing inhibitory neurons in the primary motor cortex

The primary motor cortex (MOp) is an important site for motor skill learning. Interestingly, neurons in MOp possess reward-related activity, presumably to facilitate reward-based motor learning. While pyramidal neurons (PNs) and different subtypes of GABAergic inhibitory interneurons (INs) in MOp all undergo cell-type specific plastic changes during motor learning, the vasoactive intestinal peptide-expressing inhibitory interneurons (VIP-INs) in MOp have been shown to preferentially respond to reward and play a critical role in the early phases of motor learning by triggering local circuit plasticity. To understand how VIP-INs might integrate various streams of information, such as sensory, pre-motor, and reward-related inputs, to regulate local plasticity in MOp, we performed monosynaptic rabies tracing experiments and employed an automated cell counting pipeline to generate a comprehensive map of brain-wide inputs to VIP-INs in MOp. We then compared this input profile to the brain-wide inputs to somatostatin-expressing inhibitory interneurons (SST-INs) and parvalbumin-expressing inhibitory interneurons (PV-INs) in MOp. We found that while all cell types received major inputs from sensory, motor, and prefrontal cortical regions, as well as from various thalamic nuclei, VIP-INs received more inputs from the orbital frontal cortex (ORB) - a region associated with reinforcement learning and value predictions. Our findings provide insight on how the brain leverages microcircuit motifs by both integrating and partitioning different streams of long-range input to modulate local circuit activity and plasticity.