Medial prefrontal activity during delay period contributes to learning of a working memory task

Awake and behaving mouse fMRI during Go/No-Go task

Functional magnetic imaging (fMRI) has been widely used to examine the functional neural networks in both the evoked and resting states. However, most fMRI studies in rodents are performed under anesthesia, which greatly limits the scope of their application, and behavioral relevance. Efforts have been made to image rodents in the awake condition, either in the resting state or in response to sensory or optogenetic stimulation. However, fMRI in awake behaving rodents has not yet been achieved. In the current study, a novel fMRI paradigm for awake and behaving mice was developed, allowing functional imaging of the mouse brain in an olfaction-based go/no-go task. High resolution functional imaging with limited motion and image distortion were achieved at 9.4T with a cryogenic coil in awake and behaving mice. Distributed whole-brain spatiotemporal patterns were revealed, with drastically different activity profiles for go versus no-go trials. Therefore, we have demonstrated the feasibility of functional imaging of an olfactory behavior in awake mice. This fMRI paradigm in awake behaving mice could lead to novel insights into neural mechanisms underlying behaviors at a whole-brain level.

Neural Representation of Motor Output, Context and Behavioral Adaptation in Rat Medial Prefrontal Cortex During Learned Behavior

Selecting behavioral outputs in a dynamic environment is the outcome of integrating multiple information streams and weighing possible action outcomes with their value. Integration depends on the medial prefrontal cortex (mPFC), but how mPFC neurons encode information necessary for appropriate behavioral adaptation is poorly understood. To identify spiking patterns of mPFC during learned behavior, we extracellularly recorded neuronal action potential firing in the mPFC of rats performing a whisker-based "Go"/"No-go" object localization task. First, we identify three functional groups of neurons, which show different degrees of spiking modulation during task performance. One group increased spiking activity during correct "Go" behavior (positively modulated), the second group decreased spiking (negatively modulated) and one group did not change spiking. Second, the relative change in spiking was context-dependent and largest when motor output had contextual value. Third, the negatively modulated population spiked more when rats updated behavior following an error compared to trials without integration of error information. Finally, insufficient spiking in the positively modulated population predicted erroneous behavior under dynamic "No-go" conditions. Thus, mPFC neuronal populations with opposite spike modulation characteristics differentially encode context and behavioral updating and enable flexible integration of error corrections in future actions.

Dynamics and Functional Role of Dopaminergic Neurons in the Ventral Tegmental Area during Itch Processing

Itchiness triggers a strong urge to engage in scratching behavior, which could lead to severe skin or tissue damage in patients with chronic itch. This process is dynamically modulated. However, the neural mechanisms underlying itch modulation remain largely unknown. Here, we report that dopaminergic (DA) neurons in the ventral tegmental area (VTA) play a critical role in modulating itch-induced scratching behavior. We found that the activity of VTA DA neurons was increased during pruritogen-induced scratching behavior in freely moving male mice. Consistently, individual VTA DA neurons mainly exhibited elevated neural activity during itch-induced scratching behavior as demonstrated by in vivo extracellular recording. In behavioral experiments, the transient suppression of VTA DA neurons with the optogenetic approach shortened the pruritogen-induced scratching train. Furthermore, the DA projection from the VTA to the lateral shell of the nucleus accumbens exhibited strong activation as measured with fiber photometry during itch-elicited scratching behavior. These results revealed the dynamic activity of VTA DA neurons during itch processing and demonstrated the modulatory role of the DA system in itch-induced scratching behavior.SIGNIFICANCE STATEMENT Itchiness is an unpleasant sensation that evokes a scratching response for relief. However, the neural mechanism underlying the modulation of itch-evoked scratching in the brain remains elusive. Here, by combining fiber photometry, extracellular recording, and optogenetic manipulation, we show that the dopaminergic neurons in the ventral tegmental area play a modulatory role in itch-evoked scratching behavior. These results reveal a potential target for suppressing excessive scratching responses in patients with chronic itch.

Neural Circuits for Goal-Directed Sensorimotor Transformations

Precisely wired neuronal circuits process sensory information in a learning- and context-dependent manner in order to govern behavior. Simple sensory decision-making tasks in rodents are now beginning to reveal the contributions of distinct cell types and brain regions participating in the conversion of sensory information into learned goal-directed motor output. Task learning is accompanied by target-specific routing of sensory information to specific downstream cortical regions, with higher-order cortical regions such as the posterior parietal cortex, medial prefrontal cortex, and hippocampus appearing to play important roles in learning- and context-dependent processing of sensory input. An important challenge for future research is to connect cell-type-specific activity in these brain regions with motor neurons responsible for action initiation.

Behavioral Strategy Determines Frontal or Posterior Location of Short-Term Memory in Neocortex

The location of short-term memory in mammalian neocortex remains elusive. Here we show that distinct neocortical areas maintain short-term memory depending on behavioral strategy. Using wide-field and single-cell calcium imaging, we measured layer 2/3 neuronal activity in mice performing a whisker-based texture discrimination task with delayed response. Mice either deployed an active strategy-engaging their body toward the approaching texture-or passively awaited the touch. Independent of strategy, whisker-related posterior areas encoded choice early after touch. During the delay, in contrast, persistent cortical activity was located medio-frontally in active trials but in a lateral posterior area in passive trials. Perturbing these areas impaired performance for the associated strategy and also provoked strategy switches. Frontally maintained information related to future action, whereas activity in the posterior cortex reflected past stimulus identity. Thus, depending on behavioral strategy, cortical activity is routed differentially to hold information either frontally or posteriorly before converging to similar action.

Attractor Dynamics in Networks with Learning Rules Inferred from In Vivo Data

The attractor neural network scenario is a popular scenario for memory storage in the association cortex, but there is still a large gap between models based on this scenario and experimental data. We study a recurrent network model in which both learning rules and distribution of stored patterns are inferred from distributions of visual responses for novel and familiar images in the inferior temporal cortex (ITC). Unlike classical attractor neural network models, our model exhibits graded activity in retrieval states, with distributions of firing rates that are close to lognormal. Inferred learning rules are close to maximizing the number of stored patterns within a family of unsupervised Hebbian learning rules, suggesting that learning rules in ITC are optimized to store a large number of attractor states. Finally, we show that there exist two types of retrieval states: one in which firing rates are constant in time and another in which firing rates fluctuate chaotically.

The Lateral Habenula as a Relay of Cortical Information to Process Working Memory

Working memory is a cognitive ability allowing the temporary storage of information to solve problems or adjust behavior. While working memory is known to mainly depend on the medial prefrontal cortex (mPFC), very few is known about how cortical information are relayed subcortically. By its connectivity, the lateral habenula (lHb) might act as a subcortical relay for cortical information. Indeed, the lHb receives inputs from several mPFC subregions, and recent findings suggest a role for the lHb in online processing of spatial information, a fundamental aspect of working memory. In rats, in a delayed non-matching to position paradigm, using focal microinjections of the GABAA agonist muscimol we showed that inactivation of the lHb (16 ng in 0.2 µL per side), as well as disconnection between the prelimbic region of the mPFC (mPFC/PrL, 32 ng in 0.4 µL in one hemisphere) and the lHb (16 ng in 0.2 µL in the lHb in the contralateral hemisphere) impaired working memory. The deficits were unlikely to result from motivational or motor deficits as muscimol did not affect reward collection or cue responding latencies, and did not increase the number of omissions. These results show for the first time the implication of the lHb in mPFC-dependent memory processes, likely as a relay of mPFC/PrL information. They also open new perspectives in the understanding of the top-down processing of high-level cognitive functions.

MicroRNA Expression Profiling in the Prefrontal Cortex: Putative Mechanisms for the Cognitive Effects of Adolescent High Fat Feeding

The medial prefrontal cortex (mPFC), master regulator of higher-order cognitive functions, is the only brain region that matures until late adolescence. During this period, the mPFC is sensitive to stressful events or suboptimal nutrition. For instance, high-fat diet (HFD) feeding during adolescence markedly impairs prefrontal-dependent cognition. It also provokes multiple changes at the cellular and synaptic scales within the mPFC, suggesting that major transcriptional events are elicited by HFD during this maturational period. The nature of this transcriptional reprogramming remains unknown, but may include epigenetic processes, in particular microRNAs, known to directly regulate synaptic functions. We used high–throughput screening in the adolescent mouse mPFC and identified 38 microRNAs differentially regulated by HFD, in particular mir-30e-5p. We used a luciferase assay to confirm the functional effect of mir-30e-5p on a chosen target: Ephrin-A3. Using global pathway analyses of predicted microRNA targets, we identified biological pathways putatively affected by HFD. Axon guidance was the top-1 pathway, validated by identifying gene expression changes of axon guidance molecules following HFD. Our findings delineate major microRNA transcriptional reprogramming within the mPFC induced by adolescent HFD. These results will help understanding the contribution of microRNAs in the emergence of cognitive deficits following early-life environmental events.

PV Interneurons: Critical Regulators of E/I Balance for Prefrontal Cortex-Dependent Behavior and Psychiatric Disorders

Elucidating the prefrontal cortical microcircuit has been challenging, given its role in multiple complex behaviors, including working memory, cognitive flexibility, attention, social interaction and emotional regulation. Additionally, previous methodological limitations made it difficult to parse out the contribution of certain neuronal subpopulations in refining cortical representations. However, growing evidence supports a fundamental role of fast-spiking parvalbumin (PV) GABAergic interneurons in regulating pyramidal neuron activity to drive appropriate behavioral responses. Further, their function is heavily diminished in the prefrontal cortex (PFC) in numerous psychiatric diseases, including schizophrenia and autism. Previous research has demonstrated the importance of the optimal balance of excitation and inhibition (E/I) in cortical circuits in maintaining the efficiency of cortical information processing. Although we are still unraveling the mechanisms of information representation in the PFC, the E/I balance seems to be crucial, as pharmacological, chemogenetic and optogenetic approaches for disrupting E/I balance induce impairments in a range of PFC-dependent behaviors. In this review, we will explore two key hypotheses. First, PV interneurons are powerful regulators of E/I balance in the PFC, and help optimize the representation and processing of supramodal information in PFC. Second, diminishing the function of PV interneurons is sufficient to generate an elaborate symptom sequelae corresponding to those observed in a range of psychiatric diseases. Then, using this framework, we will speculate on whether this circuitry could represent a platform for the development of therapeutic interventions in disorders of PFC function.

Low-Dimensional and Monotonic Preparatory Activity in Mouse Anterior Lateral Motor Cortex

Neurons in multiple brain regions fire trains of action potentials anticipating specific movements, but this "preparatory activity" has not been systematically compared across behavioral tasks. We compared preparatory activity in auditory and tactile delayed-response tasks in male mice. Skilled, directional licking was the motor output. The anterior lateral motor cortex (ALM) is necessary for motor planning in both tasks. Multiple features of ALM preparatory activity during the delay epoch were similar across tasks. First, most neurons showed direction-selective activity and spatially intermingled neurons were selective for either movement direction. Second, many cells showed mixed coding of sensory stimulus and licking direction, with a bias toward licking direction. Third, delay activity was monotonic and low-dimensional. Fourth, pairs of neurons with similar direction selectivity showed high spike-count correlations. Our study forms the foundation to analyze the neural circuit mechanisms underlying preparatory activity in a genetically tractable model organism.SIGNIFICANCE STATEMENT Short-term memories link events separated in time. Neurons in the frontal cortex fire trains of action potentials anticipating specific movements, often seconds before the movement. This "preparatory activity" has been observed in multiple brain regions, but has rarely been compared systematically across behavioral tasks in the same brain region. To identify common features of preparatory activity, we developed and compared preparatory activity in auditory and tactile delayed-response tasks in mice. The same cortical area is necessary for both tasks. Multiple features of preparatory activity, measured with high-density silicon probes, were similar across tasks. We find that preparatory activity is low-dimensional and monotonic. Our study forms a foundation for analyzing the circuit mechanisms underlying preparatory activity in a genetically tractable model organism.

The Corticostriatal Adenosine A2A Receptor Controls Maintenance and Retrieval of Spatial Working Memory

BACKGROUND

Working memory (WM) taps into multiple executive processes including encoding, maintenance, and retrieval of information, but the molecular and circuit modulation of these WM processes remains undefined due to the lack of methods to control G protein-coupled receptor signaling with temporal resolution of seconds.

METHODS

By coupling optogenetic control of the adenosine A_2A receptor (A_2AR) signaling, the Cre-loxP-mediated focal A_2AR knockdown with a delayed non-match-to-place (DNMTP) task, we investigated the effect of optogenetic activation and focal knockdown of A_2ARs in the dorsomedial striatum (n = 8 to 14 per group) and medial prefrontal cortex (n = 16 to 22 per group) on distinct executive processes of spatial WM. We also evaluated the therapeutic effect of the A_2AR antagonist KW6002 on delayed match-to-sample/place tasks in 6 normal and 6 MPTP-treated cynomolgus monkeys.

RESULTS

Optogenetic activation of striatopallidal A_2ARs in the dorsomedial striatum selectively at the delay and choice (not sample) phases impaired DNMTP performance. Optogenetic activation of A_2ARs in the medial prefrontal cortex selectively at the delay (not sample or choice) phase improved DNMTP performance. The corticostriatal A_2AR control of spatial WM was specific for a novel but not well-trained DNMTP task. Focal dorsomedial striatum A_2AR knockdown or KW6002 improved DNMTP performance in mice. Last, KW6002 improved spatial WM in delayed match-to-sample and delayed match-to-place tasks of normal and dopamine-depleted cynomolgus monkeys.

CONCLUSIONS

The A_2ARs in striatopallidal and medial prefrontal cortex neurons exert distinctive control of WM maintenance and retrieval to achieve cognitive stability and flexibility. The procognitive effect of KW6002 in nonhuman primates provides the preclinical data to translate A_2AR antagonists for improving cognitive impairments in Parkinson's disease.

Individual variation in working memory is associated with fear extinction performance

PTSD has been associated consistently with abnormalities in fear acquisition and extinction learning and retention. Fear acquisition refers to learning to discriminate between threat and safety cues. Extinction learning reflects the formation of a new inhibitory-memory that competes with a previously learned threat-related memory. Adjudicating the competition between threat memory and the new inhibitory memory during extinction may rely, in part, on cognitive processes such as working memory (WM). Despite significant shared neural circuits and signaling pathways the relationship between WM, fear acquisition, and extinction is poorly understood. Here, we analyzed data from a large sample of healthy Marines who underwent an assessment battery including tests of fear acquisition, extinction learning, and WM (N-back). Fear potentiated startle (FPS), fear expectancy ratings, and self-reported anxiety served as the primary dependent variables. High WM ability (N = 192) was associated with greater CS + fear inhibition during the late block of extinction and greater US expectancy change during extinction learning compared to individuals with low WM ability (N = 204). WM ability was not associated with magnitude of fear conditioning/expression. Attention ability was unrelated to fear acquisition or extinction supporting specificity of WM associations with extinction. These results support the conclusion that individual differences in WM may contribute to regulating fear responses.

Prefrontal cortical-specific differences in behavior and synaptic plasticity between adolescent and adult mice

Adolescence is a highly vulnerable period for the emergence of major neuropsychological disorders and is characterized by decreased cognitive control and increased risk-taking behavior and novelty-seeking. The prefrontal cortex (PFC) is involved in the cognitive control of impulsive and risky behavior. Although the PFC is known to reach maturation later than other cortical areas, little information is available regarding the functional changes from adolescence to adulthood in PFC, particularly compared with other primary cortical areas. This study aims to understand the development of PFC-mediated, compared with non-PFC-mediated, cognitive functions. Toward this aim, we performed cognitive behavioral tasks in adolescent and adult mice and subsequently investigated synaptic plasticity in two different cortical areas. Our results showed that adolescent mice exhibit impaired performance in PFC-dependent cognitive tasks compared with adult mice, whereas their performance in non-PFC-dependent tasks is similar to that of adults. Furthermore, adolescent mice exhibited decreased long-term potentiation (LTP) within upper-layer synapses of the PFC but not the barrel cortex. Blocking GABAA receptor function significantly augments LTP in both the adolescent and adult PFC. No change in intrinsic excitability of PFC pyramidal neurons was observed between adolescent and adult mice. Finally, increased expression of the NR2A subunit of the N-methyl-d-aspartate receptors is found only in the adult PFC, a change that could underlie the emergence of LTP. In conclusion, our results demonstrate physiological and behavioral changes during adolescence that are specific to the PFC and could underlie the reduced cognitive control in adolescents.

NEW & NOTEWORTHY This study reports that adolescent mice exhibit impaired performance in cognitive functions dependent on the prefrontal cortex but not in cognitive functions dependent on other cortical regions. The current results propose reduced synaptic plasticity in the upper layers of the prefrontal cortex as a cellular correlate of this weakened cognitive function. This decreased synaptic plasticity is due to reduced N-methyl-d-aspartate receptor expression but not due to dampened intrinsic excitability or enhanced GABAergic signaling during adolescence.

High-Throughput Automatic Training System for Odor-Based Learned Behaviors in Head-Fixed Mice

Understanding neuronal mechanisms of learned behaviors requires efficient behavioral assays. We designed a high-throughput automatic training system (HATS) for olfactory behaviors in head-fixed mice. The hardware and software were constructed to enable automatic training with minimal human intervention. The integrated system was composed of customized 3D-printing supporting components, an odor-delivery unit with fast response, Arduino based hardware-controlling and data-acquisition unit. Furthermore, the customized software was designed to enable automatic training in all training phases, including lick-teaching, shaping and learning. Using HATS, we trained mice to perform delayed non-match to sample (DNMS), delayed paired association (DPA), Go/No-go (GNG), and GNG reversal tasks. These tasks probed cognitive functions including sensory discrimination, working memory, decision making and cognitive flexibility. Mice reached stable levels of performance within several days in the tasks. HATS enabled an experimenter to train eight mice simultaneously, therefore greatly enhanced the experimental efficiency. Combined with causal perturbation and activity recording techniques, HATS can greatly facilitate our understanding of the neural-circuitry mechanisms underlying learned behaviors.

Efficient enhancement of information in the prefrontal cortex during the presence of reward predicting stimuli

The prefrontal cortex (PFC) is a key brain structure for decision making, behavioural flexibility and working memory. Neurons in PFC encode relevant stimuli through changes in their firing rate, although the metabolic cost of spiking activity puts strong constrains to neural codes based on firing rate modulation. Thus, how PFC neural populations code relevant information in an efficient way is not clearly understood. To address this issue we made single unit recordings in the PFC of rats performing a GO/NOGO discrimination task and analysed how entropy between pairs of neurons changes during cue presentation. We found that entropy rises only during reward-predicting cues. Moreover, this change in entropy occurred along an increase in the efficiency of the whole process. We studied possible mechanisms behind the efficient gain in entropy by means of a two neuron leaky integrate-and-fire model, and found that a precise relationship between synaptic efficacy and firing rate is required to explain the experimentally observed results.

ArControl: An Arduino-Based Comprehensive Behavioral Platform with Real-Time Performance

Studying animal behavior in the lab requires reliable delivering stimulations and monitoring responses. We constructed a comprehensive behavioral platform (ArControl: Arduino Control Platform) that was an affordable, easy-to-use, high-performance solution combined software and hardware components. The hardware component was consisted of an Arduino UNO board and a simple drive circuit. As for software, the ArControl provided a stand-alone and intuitive GUI (graphical user interface) application that did not require users to master scripts. The experiment data were automatically recorded with the built in DAQ (data acquisition) function. The ArControl also allowed the behavioral schedule to be entirely stored in and operated on the Arduino chip. This made the ArControl a genuine, real-time system with high temporal resolution (<1 ms). We tested the ArControl, based on strict performance measurements and two mice behavioral experiments. The results showed that the ArControl was an adaptive and reliable system suitable for behavioral research.

Modulation of Ether-à-Go-Go Related Gene (ERG) Current Governs Intrinsic Persistent Activity in Rodent Neocortical Pyramidal Cells

While cholinergic receptor activation has long been known to dramatically enhance the excitability of cortical neurons, the cellular mechanisms responsible for this effect are not well understood. We used intracellular recordings in rat (both sexes) neocortical brain slices to assess the ionic mechanisms supporting persistent firing modes triggered by depolarizing stimuli following cholinergic receptor activation. We found multiple lines of evidence suggesting that a component of the underlying hyperexcitability associated with persistent firing reflects a reduction in the standing (leak) K⁺ current mediated by Ether-a-go-go-Related Gene (ERG) channels. Three chemically diverse ERG channel blockers (terfenadine, ErgToxin-1, and E-4031) abolished persistent firing and the underlying increase in input resistance in deep pyramidal cells in temporal and prefrontal association neocortex. Calcium accumulation during triggering stimuli appears to attenuate ERG currents, leading to membrane potential depolarization and increased input resistance, two critical elements generating persistent firing. Our results also suggest that ERG current normally governs cortical neuron responses to depolarizing stimuli by opposing prolonged discharges and by enhancing the poststimulus repolarization. The broad expression of ERG channels and the ability of ERG blocks to abolish persistent firing evoked by both synaptic and intracellular step stimuli suggest that modulation of ERG channels may underlie many forms of persistent activity observed in vivoSIGNIFICANCE STATEMENT Persistent activity, where spiking continues beyond the triggering stimulus, is a common phenomenon observed in many types of neurons. Identifying the mechanism underlying this elementary process of memory is a step forward in understanding higher cognitive function including short-term memory. Our results suggest that a reduction in the currents normally mediated by Ether-a-go-go-Related Gene (ERG) K⁺ channels contributes to persistent firing in neocortical pyramidal cells. ERG currents have been previously studied primarily in the heart; relatively little is known about ERG function in the brain, although mutations in ERG channels have recently been linked to schizophrenia. The present study is among the first to describe its role in neocortex in relation to biophysical correlates of memory function.

Exploring the limits of learning: Segregation of information integration and response selection is required for learning a serial reversal task

Animals are proposed to learn the latent rules governing their environment in order to maximize their chances of survival. However, rules may change without notice, forcing animals to keep a memory of which one is currently at work. Rule switching can lead to situations in which the same stimulus/response pairing is positively and negatively rewarded in the long run, depending on variables that are not accessible to the animal. This fact raises questions on how neural systems are capable of reinforcement learning in environments where the reinforcement is inconsistent. Here we address this issue by asking about which aspects of connectivity, neural excitability and synaptic plasticity are key for a very general, stochastic spiking neural network model to solve a task in which rules change without being cued, taking the serial reversal task (SRT) as paradigm. Contrary to what could be expected, we found strong limitations for biologically plausible networks to solve the SRT. Especially, we proved that no network of neurons can learn a SRT if it is a single neural population that integrates stimuli information and at the same time is responsible of choosing the behavioural response. This limitation is independent of the number of neurons, neuronal dynamics or plasticity rules, and arises from the fact that plasticity is locally computed at each synapse, and that synaptic changes and neuronal activity are mutually dependent processes. We propose and characterize a spiking neural network model that solves the SRT, which relies on separating the functions of stimuli integration and response selection. The model suggests that experimental efforts to understand neural function should focus on the characterization of neural circuits according to their connectivity, neural dynamics, and the degree of modulation of synaptic plasticity with reward.

High-Yield Methods for Accurate Two-Alternative Visual Psychophysics in Head-Fixed Mice

Research in neuroscience increasingly relies on the mouse, a mammalian species that affords unparalleled genetic tractability and brain atlases. Here, we introduce high-yield methods for probing mouse visual decisions. Mice are head-fixed, facilitating repeatable visual stimulation, eye tracking, and brain access. They turn a steering wheel to make two alternative choices, forced or unforced. Learning is rapid thanks to intuitive coupling of stimuli to wheel position. The mouse decisions deliver high-quality psychometric curves for detection and discrimination and conform to the predictions of a simple probabilistic observer model. The task is readily paired with two-photon imaging of cortical activity. Optogenetic inactivation reveals that the task requires mice to use their visual cortex. Mice are motivated to perform the task by fluid reward or optogenetic stimulation of dopamine neurons. This stimulation elicits a larger number of trials and faster learning. These methods provide a platform to accurately probe mouse vision and its neural basis.

Selective Modulation of Orbitofrontal Network Activity during Negative Occasion Setting

Discrete cues can gain powerful control over behavior to help an animal anticipate and cope with upcoming events. This is important in conditions where understanding the relationship between complex stimuli provides a means to resolving situational ambiguity. However, it is unclear how cortical circuits generate and maintain these signals that conditionally regulate behavior. To address this, we established a Pavlovian serial feature-negative conditioning paradigm, where male mice are trained on a trial in which a conditioned stimulus (CS) is presented alone and followed by reward, or a feature-negative trial in which the CS is preceded by a feature cue indicating there is no reward. Mice learn to respond with anticipatory licking to a solitary CS, but significantly suppress their responding to the same cue during feature-negative trials. We show that the feature cue forms a selective association with its paired CS, because the ability of the feature to transfer its suppressive properties to a separately rewarded cue is limited. Next, to examine the underlying neural dynamics, we conduct recordings in the orbitofrontal cortex (OFC). We find that the feature cue significantly and selectively inhibits CS-evoked activity. Finally, we find that the feature triggers a distinct OFC network state during the delay period between the feature and CS, establishing a potential link between the feature and future events. Together, our findings suggest that OFC dynamics are modulated by the feature cue and its associated conditioned stimulus in a manner consistent with an occasion setting model.SIGNIFICANCE STATEMENT The ability of patterned cues to form an inhibitory relationship with ambiguously rewarded outcomes has been appreciated since early studies on learning and memory. However, it was often assumed that these cues, despite their hierarchical nature, still made direct associative links with neural rewarding events. This model was significantly challenged, largely by the work of Holland and colleagues, who demonstrated that under certain conditions cues can inherit occasion setting properties whereby they modulate the ability of a paired cue to elicit its conditioned response. Here we provide some of the first evidence that the activity of a cortical circuit is selectively modulated by such cues, thereby providing insight into the mechanisms of higher order learning.

Mechanisms of Persistent Activity in Cortical Circuits: Possible Neural Substrates for Working Memory

A commonly observed neural correlate of working memory is firing that persists after the triggering stimulus disappears. Substantial effort has been devoted to understanding the many potential mechanisms that may underlie memory-associated persistent activity. These rely either on the intrinsic properties of individual neurons or on the connectivity within neural circuits to maintain the persistent activity. Nevertheless, it remains unclear which mechanisms are at play in the many brain areas involved in working memory. Herein, we first summarize the palette of different mechanisms that can generate persistent activity. We then discuss recent work that asks which mechanisms underlie persistent activity in different brain areas. Finally, we discuss future studies that might tackle this question further. Our goal is to bridge between the communities of researchers who study either single-neuron biophysical, or neural circuit, mechanisms that can generate the persistent activity that underlies working memory.

Periaqueductal Gray Neuronal Activities Underlie Different Aspects of Defensive Behaviors

Defense is a basic survival mechanism when animals face danger. Previous studies have suggested that the midbrain periaqueductal gray (PAG) is essential for the generation of defensive reactions. Here we showed that optogenetic activation of neurons in the PAG in mice was sufficient to induce a series of defensive responses (including running, freezing, and avoidance). However, the endogenous neural dynamics of the PAG underlying defensive behaviors still remain elusive. Using chronic extracellular recording, we recorded the spiking activities of PAG neurons in freely behaving mice exposed to natural threats (rats). We observed that there exist distinct neuronal subsets within the PAG participating in respective detection (risk assessment) and response (flight) aspects of defensive behaviors. Our results demonstrate the important role of PAG neuronal activities in the control of different aspects of defensive behaviors, and provide novel insights for investigating defense from an electrophysiological perspective.

SIGNIFICANCE STATEMENT

Defense is crucial for animals' survival in nature. Here, using optogenetic stimulation and in vivo recording in behaving mice reacting to threats, we explored the role of the midbrain periaqueductal gray (PAG) in defense. We show that optogenetic activation of PAG neurons is sufficient to elicit different aspects of defensive responses. Consistently, the present study provides in vivo evidence demonstrating that activity of the population of dorsal PAG neurons is activated during defense. Also, different subpopulations of units recorded in the dorsal PAG participate in distinct aspects of defensive behaviors. These findings help us understand the role of the PAG in animal behavior at the single neuron level.

Opportunities and challenges in modeling human brain disorders in transgenic primates

Molecular genetic tools have had a profound impact on neuroscience, but until recently their application has largely been confined to a few model species, most notably mouse, zebrafish, Drosophila melanogaster and Caenorhabditis elegans. With the development of new genome engineering technologies such as CRISPR, it is becoming increasingly feasible to apply these molecular tools in a wider range of species, including nonhuman primates. This will lead to many opportunities for brain research, but it will also pose challenges. Here we identify some of these opportunities and challenges in light of recent and foreseeable technological advances and offer some suggestions. Our main focus is on the creation of new primate disease models for understanding the pathological mechanisms of brain disorders and for developing new approaches to effective treatment. However, we also emphasize that primate genetic models have great potential to address many fundamental questions about brain function, providing an essential foundation for future progress in disease research.

Empathy for Distress in Humans and Rodents

Empathy is traditionally thought to be a unique ability of humans to feel, understand, and share the emotional state of others. However, the notion has been greatly challenged by the emerging discoveries of empathy for pain or distress in rodents. Because empathy is believed to be fundamental to the formation of prosocial, altruistic, and even moral behaviors in social animals and humans, studies associated with decoding the neural circuits and unraveling the underlying molecular and neural mechanisms of empathy for pain or distress in rodents would be very important and encouraging. In this review, the author set out to outline and update the concept of empathy from the evolutionary point of view, and introduce up-to-date advances in the study of empathy and its neural correlates in both humans and rodents. Finally, the author highlights the perspectives and challenges for the further use of rodent models in the study of empathy for pain or distress.

Maintenance of persistent activity in a frontal thalamocortical loop

Persistent neural activity maintains information bridging past and future events. Models of persistent activity often invoke reverberations within local cortical circuits, but long-range circuits could also contribute. Neurons in mouse anterior lateral motor cortex (ALM) show selective persistent activity that instructs future actions. ALM is connected bi-directionally with parts of the thalamus, including the ventral medial and ventral anterior-lateral nuclei. We recorded spikes from ALM and thalamus during tactile discrimination with a delayed directional response. Similar to ALM neurons, thalamic neurons exhibited selective persistent delay activity that predicted movement direction. Unilateral photoinhibition of delay activity in ALM or thalamus produced contralesional neglect. Photoinhibition of thalamus caused a short-latency and near total collapse of ALM activity. Similarly, photoinhibition of ALM diminished thalamic activity. Our results reveal thalamus as a circuit hub in motor preparation and suggest that persistent activity requires reciprocal excitation across multiple brain areas.

Dysregulation of Specialized Delay/Interference-Dependent Working Memory Following Loss of Dysbindin-1A in Schizophrenia-Related Phenotypes

Dysbindin-1, a protein that regulates aspects of early and late brain development, has been implicated in the pathobiology of schizophrenia. As the functional roles of the three major isoforms of dysbindin-1, (A, B, and C) remain unknown, we generated a novel mutant mouse, dys-1A-/-, with selective loss of dysbindin-1A and investigated schizophrenia-related phenotypes in both males and females. Loss of dysbindin-1A resulted in heightened initial exploration and disruption in subsequent habituation to a novel environment, together with heightened anxiety-related behavior in a stressful environment. Loss of dysbindin-1A was not associated with disruption of either long-term (olfactory) memory or spontaneous alternation behavior. However, dys-1A-/- showed enhancement in delay-dependent working memory under high levels of interference relative to controls, ie, impairment in sensitivity to the disruptive effect of such interference. These findings in dys-1A-/- provide the first evidence for differential functional roles for dysbindin-1A vs dysbindin-1C isoforms among phenotypes relevant to the pathobiology of schizophrenia. Future studies should investigate putative sex differences in these phenotypic effects.

Delay activity of specific prefrontal interneuron subtypes modulates memory-guided behavior

Memory-guided behavior requires maintenance of task-relevant information without sensory input, but the underlying circuit mechanism remains unclear. Calcium imaging in mice performing a delayed Go/No-Go task revealed robust delay activity in dorsomedial prefrontal cortex (dmPFC), with different pyramidal neurons signaling Go and No-Go action plans. Inhibiting pyramidal neurons by optogenetically activating somatostatin (SST)- or parvalbumin (PV)-positive interneurons, even transiently during an early delay period, impaired task performance primarily by increasing inappropriate Go responses. In contrast, activating vasoactive intestinal peptide (VIP)-positive interneurons enhanced the behavioral performance and neuronal representation of action plans. Furthermore, while the natural activity of SST and PV neurons was strongly biased toward Go trials, VIP neurons were similarly active in Go and No-Go trials. SST/VIP neuron activation also impaired/enhanced performance of a delayed two-alternative forced choice task. Thus, dmPFC is a crucial component of the short-term memory network, and activation of its VIP neurons improves memory retention.

A distinct entorhinal cortex to hippocampal CA1 direct circuit for olfactory associative learning

Lateral and medial parts of entorhinal cortex (EC) convey nonspatial 'what' and spatial 'where' information, respectively, into hippocampal CA1, via both the indirect EC layer 2→ hippocampal dentate gyrus→CA3→CA1 and the direct EC layer 3→CA1 paths. However, it remains elusive how the direct path transfers distinct information and contributes to hippocampal learning functions. Here we report that lateral EC projection neurons selectively form direct excitatory synapses onto a subpopulation of morphologically complex, calbindin-expressing pyramidal cells (PCs) in the dorsal CA1 (dCA1), while medial EC neurons uniformly innervate all dCA1 PCs. Optogenetically inactivating the distinct lateral EC-dCA1 connections or the postsynaptic dCA1 calbindin-expressing PC activity slows olfactory associative learning. Moreover, optetrode recordings reveal that dCA1 calbindin-expressing PCs develop more selective spiking responses to odor cues during learning. Thus, our results identify a direct lateral EC→dCA1 circuit that is required for olfactory associative learning.

Persistent Neuronal Activity in Anterior Cingulate Cortex Correlates with Sustained Attention in Rats Regardless of Sensory Modality

The anterior cingulate cortex (ACC) has long been thought to regulate conflict between an object of attention and distractors during goal-directed sustained attention. However, it is unclear whether ACC serves to sustained attention itself. Here, we developed a task in which the time course of sustained attention could be controlled in rats. Then, using pharmacological lesion experiments, we employed it to assess function of ACC in sustained attention. We then recorded neuronal activity in ACC using multichannel extracellular recording techniques and identified specific ACC neurons persistently activated during the period of attention. Further experiments showed that target modality had minimal influence on the neuronal activity, and distracting external sensory input during the attention period did not perturb persistent neuronal activity. Additionally, minimal trial-to-trial variability in neuronal activity observed during sustained attention supports a role for ACC neurons in that behavior. Therefore, we conclude that the ACC neuronal activity correlates with sustained attention.

Distinct Roles of Parvalbumin- and Somatostatin-Expressing Interneurons in Working Memory

Inhibitory interneurons are thought to play crucial roles in diverse brain functions. However, roles of different inhibitory interneuron subtypes in working memory remain unclear. We found distinct activity patterns and stimulation effects of two major interneuron subtypes, parvalbumin (PV)- and somatostatin (SOM)-expressing interneurons, in the medial prefrontal cortex of mice performing a spatial working memory task. PV interneurons showed weak target-dependent delay-period activity and were strongly inhibited by reward. By contrast, SOM interneurons showed strong target-dependent delay-period activity, and only a subtype of them was inhibited by reward. Furthermore, optogenetic stimulation of PV and SOM interneurons preferentially suppressed discharges of putative pyramidal cells and interneurons, respectively. These results indicate different contributions of PV and SOM interneurons to prefrontal cortical circuit dynamics underlying working memory.

Distinct roles of visual, parietal, and frontal motor cortices in memory-guided sensorimotor decisions

Mapping specific sensory features to future motor actions is a crucial capability of mammalian nervous systems. We investigated the role of visual (V1), posterior parietal (PPC), and frontal motor (fMC) cortices for sensorimotor mapping in mice during performance of a memory-guided visual discrimination task. Large-scale calcium imaging revealed that V1, PPC, and fMC neurons exhibited heterogeneous responses spanning all task epochs (stimulus, delay, response). Population analyses demonstrated unique encoding of stimulus identity and behavioral choice information across regions, with V1 encoding stimulus, fMC encoding choice even early in the trial, and PPC multiplexing the two variables. Optogenetic inhibition during behavior revealed that all regions were necessary during the stimulus epoch, but only fMC was required during the delay and response epochs. Stimulus identity can thus be rapidly transformed into behavioral choice, requiring V1, PPC, and fMC during the transformation period, but only fMC for maintaining the choice in memory prior to execution.

DOI:http://dx.doi.org/10.7554/eLife.13764.001

Neural activity of orbitofrontal cortex contributes to control of waiting

The willingness to wait for delayed reward and information is of fundamental importance for deliberative behaviors. The orbitofrontal cortex (OFC) is thought to be a core component of the neural circuitry underlying the capacity to control waiting. However, the neural correlates of active waiting and the causal role of the OFC in the control of waiting still remain largely unknown. Here, we trained rats to perform a waiting task (waiting for a pseudorandom time to obtain the water reward), and recorded neuronal ensembles in the OFC throughout the task. We observed that subset OFC neurons exhibited ramping activities throughout the waiting process. Receiver operating characteristic analysis showed that neural activities during the waiting period even predicted the trial outcomes (patient vs. impatient) on a trial-by-trial basis. Furthermore, optogenetic activation of the OFC during the waiting period improved the waiting performance, but did not influence rats' movement to obtain the reward. Taken together, these findings reveal that the neural activity in the OFC contributes to the control of waiting.

Enhancing Prefrontal Neuron Activity Enables Associative Learning of Temporally Disparate Events

The ability to link events that are separated in time is important for extracting meaning from experiences and guiding behavior in the future. This ability likely requires the brain to continue representing events even after they have passed, a process that may involve the prefrontal cortex and takes the form of sustained, event-specific neuron activity. Here, we show that experimentally increasing the activity of excitatory neurons in the medial prefrontal cortex (mPFC) enables rats to associate two stimuli separated by a 750-ms long temporal gap. Learning is accompanied by ramping increases in prefrontal theta and beta rhythms during the interval between stimuli. This ramping activity predicts memory-related behavioral responses on a trial-by-trial basis but is not correlated with the same muscular activity during non-memory conditions. Thus, the enhancement of prefrontal neuron excitability extends the time course of evoked prefrontal network activation and facilitates the formation of associations of temporally disparate, but correlated, events.

Robust neuronal dynamics in premotor cortex during motor planning

Neural activity maintains representations that bridge past and future events, often over many seconds. Network models can produce persistent and ramping activity, but the positive feedback that is critical for these slow dynamics can cause sensitivity to perturbations. Here we use electrophysiology and optogenetic perturbations in the mouse premotor cortex to probe the robustness of persistent neural representations during motor planning. We show that preparatory activity is remarkably robust to large-scale unilateral silencing: detailed neural dynamics that drive specific future movements were quickly and selectively restored by the network. Selectivity did not recover after bilateral silencing of the premotor cortex. Perturbations to one hemisphere are thus corrected by information from the other hemisphere. Corpus callosum bisections demonstrated that premotor cortex hemispheres can maintain preparatory activity independently. Redundancy across selectively coupled modules, as we observed in the premotor cortex, is a hallmark of robust control systems. Network models incorporating these principles show robustness that is consistent with data.

Prefrontal Neurons Encode Actions and Outcomes in Conjunction with Spatial Location in Rats Performing a Dynamic Delayed Non-Match to Position Task

To respond adaptively to change organisms must utilize information about recent events and environmental context to select actions that are likely to produce favorable outcomes. We developed a dynamic delayed nonmatching to position task to study the influence of spatial context on event-related activity of medial prefrontal cortex neurons during reinforcement-guided decision-making. We found neurons with responses related to preparation, movement, lever press responses, reinforcement, and memory delays. Combined event-related and video tracking analyses revealed variability in spatial tuning of neurons with similar event-related activity. While all correlated neurons exhibited spatial tuning broadly consistent with relevant task events, for instance reinforcement-related activity concentrated in locations where reinforcement was delivered, some had elevated activity in more specific locations, for instance reinforcement-related activity in one of several locations where reinforcement was delivered. Timing analyses revealed a limited set of distinct response types with activity time-locked to critical behavioral events that represent the temporal organization of dDNMTP trials. Our results suggest that reinforcement-guided decision-making emerges from discrete populations of medial prefrontal neurons that encode information related to planned or ongoing movements and actions and anticipated or actual action-outcomes in conjunction with information about spatial context.

Inhibitory luminopsins: genetically-encoded bioluminescent opsins for versatile, scalable, and hardware-independent optogenetic inhibition

Optogenetic techniques provide an unprecedented ability to precisely manipulate neural activity in the context of complex neural circuitry. Although the toolbox of optogenetic probes continues to expand at a rapid pace with more efficient and responsive reagents, hardware-based light delivery is still a major hurdle that limits its practical use in vivo. We have bypassed the challenges of external light delivery by directly coupling a bioluminescent light source (a genetically encoded luciferase) to an inhibitory opsin, which we term an inhibitory luminopsin (iLMO). iLMO was shown to suppress action potential firing and synchronous bursting activity in vitro in response to both external light and luciferase substrate. iLMO was further shown to suppress single-unit firing rate and local field potentials in the hippocampus of anesthetized rats. Finally, expression of iLMO was scaled up to multiple structures of the basal ganglia to modulate rotational behavior of freely moving animals in a hardware-independent fashion. This novel class of optogenetic probes demonstrates how non-invasive inhibition of neural activity can be achieved, which adds to the versatility, scalability, and practicality of optogenetic applications in freely behaving animals.

The challenge of understanding the brain: where we stand in 2015

Starting with the work of Cajal more than 100 years ago, neuroscience has sought to understand how the cells of the brain give rise to cognitive functions. How far has neuroscience progressed in this endeavor? This Perspective assesses progress in elucidating five basic brain processes: visual recognition, long-term memory, short-term memory, action selection, and motor control. Each of these processes entails several levels of analysis: the behavioral properties, the underlying computational algorithm, and the cellular/network mechanisms that implement that algorithm. At this juncture, while many questions remain unanswered, achievements in several areas of research have made it possible to relate specific properties of brain networks to cognitive functions. What has been learned reveals, at least in rough outline, how cognitive processes can be an emergent property of neurons and their connections.

Functional connectivity changes during a working memory task in rat via NMF analysis

Working memory (WM) is necessary in higher cognition. The brain as a complex network is formed by interconnections among neurons. Connectivity results in neural dynamics to support cognition. The first aim is to investigate connectivity dynamics in medial prefrontal cortex (mPFC) networks during WM. As brain neural activity is sparse, the second aim is to find the intrinsic connectivity property in a feature space. Using multi-channel electrode recording techniques, spikes were simultaneously obtained from mPFC of rats that performed a Y-maze WM task. Continuous time series converted from spikes were embedded in a low-dimensional space by non-negative matrix factorization (NMF). mPFC network in original space was constructed by measuring connections among neurons. And the same network in NMF space was constructed by computing connectivity values between the extracted NMF components. Causal density (Cd) and global efficiency (E) were estimated to present the network property. The results showed that Cd and E significantly peaked in the interval right before the maze choice point in correct trials. However, the increase did not emerge in error trials. Additionally, Cd and E in two spaces displayed similar trends in correct trials. The difference was that the measures in NMF space were significantly greater than those in original space. Our findings indicated that the anticipatory changes in mPFC networks may have an effect on future WM behavioral choices. Moreover, the NMF analysis achieves a better characterization for a brain network.