Parallel and hierarchical neural mechanisms for adaptive and predictive behavioral control

Direct and indirect striatal projecting neurons exert strategy-dependent effects on decision-making

The striatum plays a key role in decision-making, with its effects varying with anatomical location and direct and indirect pathway striatal projecting neuron (d- and iSPN) populations. Using a mouse gambling task with a reinforcement-learning model, we described individual decision-making profiles as a combination of three archetypal strategies: Optimizers, Risk-averse, and Explorers. These strategies reflected stable differences in the parameters generating decisions (sensitivity to the reward magnitude, to risk, or to punishment) derived from a reinforcement-learning model of animal choice. Chemogenetic manipulation showed that dorsomedial striatum (DMS) neurons substantially affect decision-making, while the nucleus accumbens (NAc) and dorsolateral striatum neurons (DLS) have lesser or no effects, respectively. Specifically, DMS dSPNs decrease risk aversion by increasing the perceived value of risky choices, while DMS iSPNs emphasize large gains, affecting decisions depending on decision-making profiles. Hence, we propose that striatal populations from different subregions influence distinct decision-making parameters, leading to profile-dependent choices.

The function(s) of consciousness: an evolutionary perspective

The functions of consciousness, viewed from an evolutionary standpoint, can be categorized as being either general or particular. There are two general functions, meaning those that do not depend on the particulars of how consciousness influences behavior or how and why it first evolved: of (1) expanding the behavioral repertoire of the individual through the gradual accumulation of neurocircuitry innovations incorporating consciousness that would not exist without it, and (2) reducing the time scale over which preprogrammed behaviors can be altered, from evolutionary time, across generations, to real-time. But neither answers Velmans' question, of why consciousness is adaptive in a proximate sense, and hence why it would have evolved, which depends on identifying the particular function it first performed. Memory arguably plays a role here, as a strong case can be made that consciousness first evolved to make motivational control more responsive, though memory, to the past life experiences of the individual. A control mechanism of this kind could, for example, have evolved to consciously inhibit appetitive behaviors, whether consciously instigated or not, that would otherwise expose the individual to harm. There is then the question of whether, for amniote vertebrates, a role in memory formation and access would have led directly to a wider role for consciousness in the way the brain operates, or if some other explanation is required. Velmans' question might then have two answers, the second having more to do with the advantages of global oversight for the control of behavior, as in a global workspace, or for conferring meaning on sensory experience in a way that non-conscious neural processes cannot. Meaning in this context refers specifically to the way valence is embodied in the genomic instructions for assembling the neurocircuitry responsible for phenomenal contents, so it constitutes an embodied form of species memory, and a way of thinking about the adaptive utility of consciousness that is less concerned with real-time mechanistic events than with information storage on an evolutionary time scale.

Frontostriatal circuit dysfunction leads to cognitive inflexibility in neuroligin-3 R451C knockin mice

Cognitive and behavioral rigidity are observed in various psychiatric diseases, including in autism spectrum disorder (ASD). However, the underlying mechanism remains to be elucidated. In this study, we found that neuroligin-3 (NL3) R451C knockin mouse model of autism (KI mice) exhibited deficits in behavioral flexibility in choice selection tasks. Single-unit recording of medium spiny neuron (MSN) activity in the nucleus accumbens (NAc) revealed altered encoding of decision-related cue and impaired updating of choice anticipation in KI mice. Additionally, fiber photometry demonstrated significant disruption in dynamic mesolimbic dopamine (DA) signaling for reward prediction errors (RPEs), along with reduced activity in medial prefrontal cortex (mPFC) neurons projecting to the NAc in KI mice. Interestingly, NL3 re-expression in the mPFC, but not in the NAc, rescued the deficit of flexible behaviors and simultaneously restored NAc-MSN encoding, DA dynamics, and mPFC-NAc output in KI mice. Taken together, this study reveals the frontostriatal circuit dysfunction underlying cognitive inflexibility and establishes a critical role of the mPFC NL3 deficiency in this deficit in KI mice. Therefore, these findings provide new insights into the mechanisms of cognitive and behavioral inflexibility and potential intervention strategies.

Temporal dynamics of white and gray matter plasticity during motor skill acquisition: a comparative diffusion tensor imaging and multiparametric mapping analysis

Learning new motor skills relies on neural plasticity within motor and limbic systems. This study uniquely combined diffusion tensor imaging and multiparametric mapping MRI to detail these neuroplasticity processes. We recruited 18 healthy male participants who underwent 960 min of training on a computer-based motion game, while 14 were scanned without training. Diffusion tensor imaging, which quantifies tissue microstructure by measuring the capacity for, and directionality of, water diffusion, revealed mostly linear changes in white matter across the corticospinal-cerebellar-thalamo-hippocampal circuit. These changes related to performance and reflected different responses to upper- and lower-limb training in brain areas with known somatotopic representations. Conversely, quantitative MRI metrics, sensitive to myelination and iron content, demonstrated mostly quadratic changes in gray matter related to performance and reflecting somatotopic representations within the same brain areas. Furthermore, while myelin and iron-sensitive multiparametric mapping MRI was able to describe time lags between different cortical brain systems, diffusion tensor imaging detected time lags within the white matter of the motor systems. These findings suggest that motor skill learning involves distinct phases of white and gray matter plasticity across the sensorimotor network, with the unique combination of diffusion tensor imaging and multiparametric mapping MRI providing complementary insights into the underlying neuroplastic responses.

Dissecting muscle synergies in the task space

The muscle synergy is a guiding concept in motor control research that relies on the general notion of muscles 'working together' towards task performance. However, although the synergy concept has provided valuable insights into motor coordination, muscle interactions have not been fully characterised with respect to task performance. Here, we address this research gap by proposing a novel perspective to the muscle synergy that assigns specific functional roles to muscle couplings by characterising their task-relevance. Our novel perspective provides nuance to the muscle synergy concept, demonstrating how muscular interactions can 'work together' in different ways: (1) irrespective of the task at hand but also (2) redundantly or (3) complementarily towards common task-goals. To establish this perspective, we leverage information- and network-theory and dimensionality reduction methods to include discrete and continuous task parameters directly during muscle synergy extraction. Specifically, we introduce co-information as a measure of the task-relevance of muscle interactions and use it to categorise such interactions as task-irrelevant (present across tasks), redundant (shared task information), or synergistic (different task information). To demonstrate these types of interactions in real data, we firstly apply the framework in a simple way, revealing its added functional and physiological relevance with respect to current approaches. We then apply the framework to large-scale datasets and extract generalizable and scale-invariant representations consisting of subnetworks of synchronised muscle couplings and distinct temporal patterns. The representations effectively capture the functional interplay between task end-goals and biomechanical affordances and the concurrent processing of functionally similar and complementary task information. The proposed framework unifies the capabilities of current approaches in capturing distinct motor features while providing novel insights and research opportunities through a nuanced perspective to the muscle synergy.

α4-Containing GABAA Receptors on DRD2 Neurons of the Nucleus Accumbens Mediate Instrumental Responding for Conditioned Reinforcers and Its Potentiation by Cocaine

Extrasynaptic GABAA receptors (GABAARs) composed of α4, β, and δ subunits mediate GABAergic tonic inhibition and are potential molecular targets in the modulation of behavioral responses to natural and drug rewards. These GABAARs are highly expressed within the nucleus accumbens (NAc), where they influence the excitability of the medium spiny neurons. Here, we explore their role in modulating behavioral responses to food-conditioned cues and the behavior-potentiating effects of cocaine. α4-Subunit constitutive knock-out mice (α4-/-) showed higher rates of instrumental responding for reward-paired stimuli in a test of conditioned reinforcement (CRf). A similar effect was seen following viral knockdown of GABAAR α4 subunits within the NAc. Local infusion of the α4βδ-GABAAR-preferring agonist THIP (4,5,6,7-tetrahydroisoxazolo[5,4-c]pyridin-3-ol; Gaboxadol) into the NAc had no effect on responding when given alone but reduced cocaine potentiation of responding for conditioned reinforcers in wild-type, but not α4-/- mice. Finally, specific deletion of α4-subunits from dopamine D2, but not D1, receptor-expressing neurons (DRD2 and DRD1 neurons), mimicked the phenotype of the constitutive knockout, potentiating CRf responding, and blocking intra-accumbal THIP attenuation of cocaine-potentiated CRf responding. These data demonstrate that α4-GABAAR-mediated inhibition of DRD2 neurons reduces instrumental responding for a conditioned reinforcer and its potentiation by cocaine and emphasize the importance of GABAergic signaling within the NAc in mediating the effects of cocaine.

Error-related signaling in nucleus accumbens D2 receptor-expressing neurons guides inhibition-based choice behavior in mice

Learned associations between environmental cues and the outcomes they predict (cue-outcome associations) play a major role in behavioral control, guiding not only which responses we should perform, but also which we should inhibit, in order to achieve a specific goal. The encoding of such cue-outcome associations, as well as the performance of cue-guided choice behavior, is thought to involve dopamine D1 and D2 receptor-expressing medium spiny neurons (D1-/D2-MSNs) of the nucleus accumbens (NAc). Here, using a visual discrimination task in male mice, we assessed the role of NAc D1-/D2-MSNs in cue-guided inhibition of inappropriate responding. Cell-type specific neuronal silencing and in-vivo imaging revealed NAc D2-MSNs to contribute to inhibiting behavioral responses, with activation of NAc D2-MSNs following response errors playing an important role in optimizing future choice behavior. Our findings indicate that error-signaling by NAc D2-MSNs contributes to the ability to use environmental cues to inhibit inappropriate behavior.

Importin α3 (KPNA3) Deficiency Augments Effortful Reward-Seeking Behavior in Mice

Importin α3 (Gene: Kpna3, the ortholog of human Importin α4) is a member of the importin α family and participates in nucleocytoplasmic transport by forming trimeric complexes between cargo proteins and importin β1. Evidence from human studies has indicated that single nucleotide polymorphisms (SNP) in the KPNA3 gene are associated with the occurrence of several psychiatric disorders accompanied by abnormal reward-related behavior, including schizophrenia, major depression, and substance addiction. However, the precise roles of importin α3 in controlling reward processing and motivation are still unclear. In this study, we evaluated the behavioral effects of Kpna3 knockout (KO) in mice on performance in touchscreen operant chamber-based tasks evaluating simple (fixed-ratio) and effortful (progressive-ratio) reward-seeking behaviors. While Kpna3 KO mice showed no significant differences in operant reward learning on a fixed-ratio schedule, they demonstrated significantly increased motivation (increased break point) to instrumentally respond for sucrose on a progressive-ratio schedule. We additionally measured the number of c-Fos-positive cells, a marker of neural activity, in 20 regions of the brain and identified a network of brain regions based on their interregional correlation coefficients. Network and graph-theoretic analyses suggested that Kpna3 deficiency enhanced overall interregional functional connectivity. These findings suggest the importance of Kpna3 in motivational control and indicate that Kpna3 KO mice may be an attractive line for modeling motivational abnormalities associated with several psychiatric disorders.

Nucleus Accumbens Core Dopamine D2 Receptor-Expressing Neurons Control Reversal Learning but Not Set-Shifting in Behavioral Flexibility in Male Mice

The ability to use environmental cues to flexibly guide responses is crucial for adaptive behavior and is thought to be controlled within a series of cortico-basal ganglia-thalamo-cortical loops. Previous evidence has indicated that different prefrontal cortical regions control dissociable aspects of behavioral flexibility, with the medial prefrontal cortex (mPFC) necessary for the ability to shift attention to a novel strategy (set-shifting) and the orbitofrontal cortex (OFC) necessary for shifting attention between learned stimulus-outcome associations (reversal learning). The nucleus accumbens (NAc) is a major downstream target of both the mPFC and the OFC; however, its role in controlling reversal learning and set-shifting abilities is still unclear. Here we investigated the contribution of the two major NAc neuronal populations, medium spiny neurons expressing either dopamine D1 or D2 receptors (D1-/D2-MSNs), in guiding reversal learning and set-shifting in an attentional set-shifting task (ASST). Persistent inhibition of neurotransmitter release from NAc D2-MSNs, but not D1-MSNs, resulted in an impaired ability for reversal learning, but not set-shifting in male mice. These findings suggest that NAc D2-MSNs play a critical role in suppressing responding toward specific learned cues that are now associated with unfavorable outcomes (i.e., in reversal stages), but not in the suppression of more general learned strategies (i.e., in set-shifting). This study provides further evidence for the anatomical separation of reversal learning and set-shifting abilities within cortico-basal ganglia-thalamo-cortical loops.