The medial prefrontal cortex during flexible decisions: Evidence for its role in distinct working memory processes

During decisions that involve working memory, task-related information must be encoded, maintained across delays, and retrieved. Few studies have attempted to causally disambiguate how different brain structures contribute to each of these components of working memory. In the present study, we used transient optogenetic disruptions of rat medial prefrontal cortex (mPFC) during a serial spatial reversal learning (SSRL) task to test its role in these specific working memory processes. By analyzing numerous performance metrics, we found: (1) mPFC disruption impaired performance during only the choice epoch of initial discrimination learning of the SSRL task; (2) mPFC disruption impaired performance in dissociable ways across all task epochs (delay, choice, return) during flexible decision-making; (3) mPFC disruption resulted in a reduction of the typical vicarious-trial-and-error rate modulation that was related to changes in task demands. Taken together, these findings suggest that the mPFC plays an outsized role in working memory retrieval, becomes involved in encoding and maintenance when recent memories conflict with task demands, and enables animals to flexibly utilize working memory to update behavior as environments change.

Hippocampal beta rhythms as a bridge between sensory learning and memory-guided decision-making

A pillar of systems neuroscience has been the study of neural oscillations. Research into these oscillations spans brain areas, species, and disciplines, giving us common ground for discussing typically disparate fields of neuroscience. In this review, we aim to strengthen the dialog between sensory systems research and learning and memory systems research by examining a 15-40 Hz oscillation known as the beta rhythm. Starting with foundational observations based largely in olfactory systems neuroscience, we review evidence suggesting beta-based activity may extend across sensory systems generally, as well as into the hippocampus and areas well known for coordinating decisions and memory-guided behaviors. After evaluating this work, we propose a framework wherein the hippocampal beta oscillation and its diverse coupling with other brain areas can support both sensory learning and memory-guided decision-making. Using this framework, we also propose circuitries that may support these processes, and experiments to test our hypothesis.

Response Flexibility: The Role of the Lateral Habenula

The ability to make appropriate decisions that result in an optimal outcome is critical for survival. This process involves assessing the environment as well as integrating prior knowledge about the environment with information about one’s current internal state. There are many neural structures that play critical roles in mediating these processes, but it is not yet known how such information coalesces to influence behavioral output. The lateral habenula (LHb) has often been cited as a structure critical for adaptive and flexible responding when environmental contexts and internal state changes. A challenge, however, has been understanding how LHb promotes response flexibility. In this review, we hypothesize that the LHb enables flexible responding following the integration of context memory and internal state information by signaling downstream brainstem structures known to drive hippocampal theta. In this way, animals respond more flexibly in a task situation not because the LHb selects a particular action, but rather because LHb enhances a hippocampal neural state that is often associated with greater attention, arousal, and exploration. In freely navigating animals, these are essential conditions that are needed to discover and implement appropriate alternative choices and behaviors. As a corollary to our hypothesis, we describe short- and intermediate-term functions of the LHb. Finally, we discuss the effects on the behavior of LHb dysfunction in short- and intermediate-timescales, and then suggest that new therapies may act on the LHb to alleviate the behavioral impairments following long-term LHb disruption.

Lateral Habenula Beyond Avoidance: Roles in Stress, Memory, and Decision-Making With Implications for Psychiatric Disorders

In this Perspective review, we highlight some of the less explored aspects of lateral habenula (LHb) function in contextual memory, sleep, and behavioral flexibility. We provide evidence that LHb is well-situated to integrate different internal state and multimodal sensory information from memory-, stress-, motivational-, and reward-related circuits essential for both survival and decision making. We further discuss the impact of early life stress (ELS) on LHb function as an example of stress-induced hyperactivity and dysregulation of neuromodulatory systems within the LHb that promote anhedonia and motivational deficits following ELS. We acknowledge that recent technological advancements in manipulation and recording of neural circuits in simplified and well-controlled behavioral paradigms have been invaluable in our understanding of the critical role of LHb in motivation and emotional regulation as well as the involvement of LHb dysfunction in stress-induced psychopathology. However, we also argue that the use of ethologically-relevant behaviors with consideration of complex aspects of decision-making is warranted for future studies of LHb contributions in a wide range of psychiatric illnesses. We conclude this Perspective with some of the outstanding issues for the field to consider where a multi-systems approach is needed to investigate the complex nature of LHb circuitry interactions with environmental stimuli that predisposes psychiatric disorders.

A Machine Learning Approach for Detecting Vicarious Trial and Error Behaviors

Vicarious trial and error behaviors (VTEs) indicate periods of indecision during decision-making, and have been proposed as a behavioral marker of deliberation. In order to understand the neural underpinnings of these putative bridges between behavior and neural dynamics, researchers need the ability to readily distinguish VTEs from non-VTEs. Here we utilize a small set of trajectory-based features and standard machine learning classifiers to identify VTEs from non-VTEs for rats performing a spatial delayed alternation task (SDA) on an elevated plus maze. We also show that previously reported features of the hippocampal field potential oscillation can be used in the same types of classifiers to separate VTEs from non-VTEs with above chance performance. However, we caution that the modest classifier success using hippocampal population dynamics does not identify many trials where VTEs occur, and show that combining oscillation-based features with trajectory-based features does not improve classifier performance compared to trajectory-based features alone. Overall, we propose a standard set of features useful for trajectory-based VTE classification in binary decision tasks, and support previous suggestions that VTEs are supported by a network including, but likely extending beyond, the hippocampus.

Loss of Sensitivity to Rewards by Dopamine Neurons May Underlie Age-Related Increased Probability Discounting

Normative aging is known to affect how decisions are made in risky situations. Although important individual variability exists, on average, aging is accompanied by greater risk aversion. Here the behavioral and neural mechanisms of greater risk aversion were examined in young and old rats trained on an instrumental probability discounting task. Consistent with the literature, old rats showed greater discounting of reward value when the probability of obtaining rewards dropped below 100%. Behaviorally, reward magnitude discrimination was the same between young and old rats, and yet these same rats exhibited reduced sensitivity to positive, but not negative, choice outcomes. The latter behavioral result was congruent with additional findings that the aged ventral tegmental neurons (including dopamine cells) were less responsive to rewards when compared to the same cell types recorded from young animals. In sum, it appears that reduced responses of dopamine neurons to rewards contribute to aging-related changes in risky decisions.

Selective Functional Interaction Between the Lateral Habenula and Hippocampus During Different Tests of Response Flexibility

The lateral habenula (LHb) has been shown to play critical roles in a variety of appetitive tasks (e.g., spatial memory and object recognition) that require animals to flexibly respond to changing task conditions. These types of tasks are known to be dependent on hippocampus (HPC) and/or medial prefrontal cortex (mPFC), suggesting that the LHb contributes to the limbic memory circuit. Here we provide new evidence that the LHb and HPC play distinct but complimentary roles in tasks that require flexible responding to changing task conditions. Experiment 1 tested whether the LHb is needed for the performance of a HPC-dependent maze-based spatial delayed alternation task. The importance of interactions between the LHb and HPC to accomplish the same spatial delayed alternation task was tested in Experiment 2 where the LHb and HPC were disconnected both ipsilaterally and contralaterally. Experiment 3 tested LHb's involvement in a standard behavioral economic task that requires flexible responding (maze-based delayed discounting), a task previously shown to rely on HPC. Results of Experiment 1, revealed that LHb inactivation impairs spatial delayed alternation during asymptotic performance but not during initial learning. Importantly, working memory did not appear to be affected as performance remained above chance levels both during initial learning and asymptotic testing. Experiment 2 showed that ipsilateral and contralateral disconnection of the LHb and HPC led to impaired performance on the spatial delayed alternation task. Impairments were not observed after unilateral inactivation of only one structure. Results of Experiment 3 were similar to our previous report of the effects of HPC inactivation: LHb inactivation impaired delayed discounting. All effects could not be accounted for by changes in reward magnitude discrimination, reward location per se, or sex of the animal. These findings, combined with other recent publications confirms and extends our working hypothesis that the LHb enables adaptive and flexible responding, particularly when established rules must be flexibly applied on a trial by trial basis. Since there are no known direct anatomical connections between LHb and HPC, future research is needed to understand how these structures communicate to enable flexible and rapid responding.

A Novel Role for the Periaqueductal Gray in Consummatory Behavior

The periaqueductal gray (PAG) has a well-established role in pain processing, autonomic function and behavioral responses to fear. Anatomical work suggests the PAG may mediate food intake and reward processing as it has extensive reciprocal connections within brain circuits that mediate appetitive processes and consummatory behaviors such as prefrontal cortex, hypothalamus, amygdala, parabrachial nucleus (PBN) and ventral tegmental area (Kelley et al., 2005). Therefore, we investigated if the PAG of hungry rats has a functional role in appetitive and consummatory behaviors. To address this, PAG was pharmacologically inactivated during a spatial working memory task with muscimol (0.1-0.3 μg), a GABAA agonist via intracranial infusion. Inactivation of PAG led to reduced intake of food rewards and increased errors on this task. To focus on the specific effects PAG inactivation had on food consumption, PAG was inactivated during two separate food intake tasks in a separate group of rats. Again, PAG inactivation resulted in a significant decrease in food consumption, as well as an increased latency to consume food. We next investigated PAG neural responses to reward encounters. A different group of rats performed the same task used in Experiment 1 while the in vivo activity of PAG neurons was recorded. In a subset of PAG neurons, reward encounters elicited phasic excitation. A separate subset of PAG neurons were inhibited during reward encounters. These responses scaled with the size of the reward, with sustained excitation or inhibition in response to large rewards compared to small. Our data also show that separate groups of PAG neurons in awake behaving animals display either increased and decreased neural responses to reward encounters. Additionally, a proportion of neurons were modulated by the animals' velocity. This study is the first to show that PAG neurons process reward-related information, perhaps to mediate consummatory behaviors related to food consumption.

Dynamic coding of predatory information between the prelimbic cortex and lateral amygdala in foraging rats

Predation is considered a major selective pressure in the evolution of fear, but the neurophysiology of predator-induced fear is unknown. We simultaneously recorded lateral amygdala (LA) and prelimbic (PL) area neuronal activities as rats exited a safe nest to search for food in an open space before, during, and after encountering a "predator" robot programmed to surge from afar. Distinct populations of LA neurons transiently increased spiking as rats either advanced or fled the robot, whereas PL neurons showed longer-lasting spike trains that preceded and persisted beyond LA activity. Moreover, discrete LA-PL cell pairs displayed correlated firings only when the animals either approached or fled the robot. These results suggest a general fear function of the LA-PL circuit where the PL participates in the initial detection of potential threats, the LA signals the occurrence of real threats, and the dynamic LA-PL interaction optimizes defensive readiness for action.

Control of behavioral flexibility by the lateral habenula

The ability to rapidly switch behaviors in dynamic environments is fundamental to survival across species. Recognizing when an ongoing behavioral strategy should be replaced by an alternative one requires the integration of a diverse number of cues both internal and external to the organism including hunger, stress, or the presence of reward predictive cues. Increasingly sophisticated behavioral paradigms coupled with state of the art electrophysiological and pharmacological approaches have delineated a brain circuit involved in behavioral flexibility. However, how diverse contextual cues are integrated to influence strategy selection on a trial by trial basis remains largely unknown. One promising candidate for integration of internal and external cues to determine whether an ongoing behavioral strategy is appropriate is the lateral habenula (LHb). The LHb receives input from many brain areas that signal both internal and external environmental contexts and in turn projects to areas involved in behavioral monitoring and plasticity. This review examines how these connections, combined with recent pharmacological and electrophysiological results reveal a critical role for the LHb in behavioral flexibility in dynamic environments. This proposed role extends the known contributions of the LHb to motivated behaviors and suggests that the fundamental role of the LHb in these behaviors goes beyond signaling rewards and punishments to dopaminergic systems.

Hippocampal neural activity reflects the economy of choices during goal-directed navigation

Distinguishing spatial contexts is likely essential for the well-known role of the hippocampus in episodic memory. We studied whether types of hippocampal neural organization thought to underlie context discrimination are impacted by learned economic considerations of choice behavior. Hippocampal place cells and theta activity were recorded as rats performed a maze-based probability discounting task that involved choosing between a small certain reward or a large probabilistic reward. Different spatial distributions of place fields were observed in response to changes in probability, the outcome of the rats' choice, and whether or not rats were free to make that choice. The degree to which the reward location was represented by place cells scaled with the expected probability of rewards. Theta power increased around the goal location also in proportion to the expected probability of signaled rewards. Furthermore, theta power dynamically varied as specific econometric information was obtained "on the fly" during task performance. Such an economic perspective of memory processing by hippocampal place cells expands our view of the nature of context memories retrieved by hippocampus during adaptive navigation.

A framework for understanding and advancing intertemporal choice research using rodent models

Intertemporal choices are common and consequential to private and public life. Thus, there is considerable interest in understanding the neural basis of intertemporal decision making. In this minireview, we briefly describe conceptual and psychological perspectives on intertemporal choice and then provide a comprehensive evaluation of the neural structures and signals that comprise the underlying cortico-limbic-striatal circuit. Even though great advances have been made, our understanding of the neurobiology of intertemporal choice is still in its infancy because of the complex and dynamic nature of this form of decision making. We close by briefly discussing recommendations for the future study of intertemporal choice research.

Analysis of morphine-induced changes in the activity of periaqueductal gray neurons in the intact rat

Microinjection of morphine into the periaqueductal gray (PAG) produces antinociception. In vitro slice recordings indicate that all PAG neurons are sensitive to morphine either by direct inhibition or indirect disinhibition. We tested the hypothesis that all PAG neurons respond to opioids in vivo by examining the extracellular activity of PAG neurons recorded in lightly anesthetized and awake rats. Spontaneous activity was less than 1Hz in most neurons. Noxious stimuli (heat, pinch) caused an increase in activity in 57% and 75% of the neurons recorded in anesthetized and awake rats, respectively. The same noxious stimuli caused a decrease in activity in only 17% and 6% of neurons recorded in anesthetized and awake rats. Systemic administration of morphine caused approximately equal numbers of neurons to increase, decrease, or show no change in activity in lightly anesthetized rats. In contrast, administration of morphine caused an increase in the activity of 22 of the 27 neurons recorded in awake rats. No change in activity was evident in the remaining five neurons. Changes in activity caused by morphine were surprisingly modest (a median increase from 0.7 to 1.3Hz). The small inconsistent effects of morphine are in stark contrast to the large changes produced by morphine on the activity of rostral ventromedial medulla (RVM) neurons or the widespread inhibition and excitation of PAG neurons treated with opioids in in vitro slice experiments. The relatively modest effects of morphine in the present study suggest that morphine produces antinociception by causing small changes in the activity of many PAG neurons.

Lateral habenula integration of proactive and retroactive information mediates behavioral flexibility

The lateral habenula (LHb) is known to play an important role in signaling aversive or adverse events that have happened or are predicted by cues under Pavlovian conditions. In rodents, it is also required for behavioral flexibility when changes in reward outcomes signal that strategies should be changed. It is not known whether the LHb also controls appetitive behaviors when an animal is able to utilize external cues proactively to guide upcoming decisions. In order to test this, male Long-Evans rats were trained to switch between two arms of a figure eight maze based on the tone presented prior to the choice. Importantly, the tones were switched every three to six trials so rats were able establish a response pattern before being required to switch. This caused rats to rely on both proactive (tones) and retroactive information (reward feedback) to guide behavior. Inactivation of the LHb with the GABA agonists baclofen and muscimol impaired overall performance by increasing both errors when the tones are switched (switch errors) as well as on subsequent trials (perseverative errors) indicating that both proactive and retroactive information are utilized by the LHb to guide behavioral flexibility. Once a correct choice was made in a given block, LHb inactivated rats did not make more errors than controls. A control study revealed that the LHb is not required for tone or reward magnitude discrimination per se. These results demonstrate for the first time that the LHb contributes to behavioral flexibility through utilizing both proactive and retroactive information when performing appetitive tasks.

Learning to Thrive: Building Diverse Scientists' Access to Community and Resources through the BRAINS Program

Broadening the Representation of Academic Investigators in NeuroScience is a National Institutes of Health-funded, national program that addresses challenges to the persistence of diverse early-career neuroscientists. In doing so, BRAINS aims to advance diversity in neuroscience by increasing career advancement and retention of post-PhD, early-career neuroscientists from underrepresented groups (URGs). The comprehensive professional development program is structured to catalyze conversations specific to URGs in neuroscience and explicitly addresses factors known to impact persistence such as a weak sense of belonging to the scientific community, isolation and solo status, inequitable access to resources that impact career success, and marginalization from informal networks and mentoring relationships. While we do not yet have data on the long-term impact of the BRAINS program on participants' career trajectory and persistence, we introduce the BRAINS program theory and report early quantitative and qualitative data on shorter-term individual impacts within the realms of career-advancing behaviors and career experiences. These early results suggest promising, positive career productivity, increased self-efficacy, stronger sense of belonging, and new perspectives on navigating careers for BRAINS participants. We finish by discussing recommendations for future professional development programs and research designed to broaden participation in the biomedical and life sciences.

Ongoing behavioral state information signaled in the lateral habenula guides choice flexibility in freely moving rats

The lateral habenula (LHb) plays a role in a wide variety of behaviors ranging from maternal care, to sleep, to various forms of cognition. One prominent theory with ample supporting evidence is that the LHb serves to relay basal ganglia and limbic signals about negative outcomes to midbrain monoaminergic systems. This makes it likely that the LHb is critically involved in behavioral flexibility as all of these systems have been shown to contribute when flexible behavior is required. Behavioral flexibility is commonly examined across species and is impaired in various neuropsychiatric conditions including autism, depression, addiction, and schizophrenia; conditions in which the LHb is thought to play a role. Therefore, a thorough examination of the role of the LHb in behavioral flexibility serves multiple functions including understanding possible connections with neuropsychiatric illnesses and additional insight into its role in cognition in general. Here, we assess the LHb’s role in behavioral flexibility through comparisons of the roles its afferent and efferent pathways are known to play. Additionally, we provide new evidence supporting the LHb contributions to behavioral flexibility through organization of specific goal directed actions under cognitively demanding conditions. Specifically, in the first experiment, a majority of neurons recorded from the LHb were found to correlate with velocity on a spatial navigation task and did not change significantly when reward outcomes were manipulated. Additionally, measurements of local field potential (LFP) in the theta band revealed significant changes in power relative to velocity and reward location. In a second set of experiments, inactivation of the LHb with the gamma-aminobutyric acid (GABA) agonists baclofen and muscimol led to an impairment in a spatial/response based repeated probabilistic reversal learning task. Control experiments revealed that this impairment was likely due to the demands of repeated switching behaviors as rats were unimpaired on initial discrimination acquisition or retention of probabilistic learning. Taken together, these novel findings compliment other work discussed supporting a role for the LHb in action selection when cognitive or emotional demands are increased. Finally, we discuss future mechanisms by which a superior understanding of the LHb can be obtained through additional examination of behavioral flexibility tasks.

Prefrontal Regulation of Neuronal Activity in the Ventral Tegmental Area

Growing evidence indicates that midbrain dopamine (DA) cells integrate reward expectancy-related information from the prefrontal cortex to properly compute errors in reward prediction. Here we investigated how 2 major prefrontal subregions, the orbitofrontal cortex (OFC) and the medial prefrontal cortex (mPFC), contributed to DAergic prediction errors while rats performed a delay discounting task on a T-maze. Most putative DA cells in the task showed phasic responses to salient cues that predicted delayed rewards, but not to the actual rewards. After temporary inactivation of the OFC, putative DA cells exhibited strikingly reduced phasic responses to reward-predicting cues but increased responses to rewards. In contrast, mPFC inactivation significantly elevated DA responses to both predictive cues and rewards. In addition, OFC, but not mPFC, inactivation disrupted the activity of putative non-DA cells that encoded expected reward values during waiting periods. These results suggest that the 2 prefrontal subregions differentially regulate DAergic prediction errors and the OFC conveys value signals to midbrain dopamine systems.

Integrative hippocampal and decision-making neurocircuitry during goal-relevant predictions and encoding

It has become clear that the hippocampus plays a critical role in the identification of new contexts and for the detection of changes in familiar contexts. The hippocampus accomplishes these goals through a continual process of comparing predicted features of a context or situation to those actually experienced. A mismatch between expected and experienced context expectations is thought to lead to the generation of a context prediction error (Mizumori, 2013) that functionally alerts connected brain areas to alter subsequent decision making and response selection. Little is understood about how hippocampal context analyses impact downstream decision processes. This issue is evaluated here first by comparing the nature of the information represented in hippocampus and decision-related midbrain-striatal structures, while rats perform a hippocampal-dependent spatial memory task in which rewards of different value are found at different locations. In contrast to place-specific and egocentric neural representations, neural representations of goal information are broadly distributed in hippocampal and decision neural circuitry, but they appear in different forms for different brain structures. It is suggested that further researching on how goal information processing occurs in hippocampus and decision neural circuitry may reveal insights into the nature of the interaction between memory and decision systems. The second part of this review describes neural pathways by which hippocampal context information might arrive within the decision circuit. The third section presents a hypothesis that the nature of the interactions between hippocampal and midbrain-striatal circuitry is regulated by the prefrontal cortex.

Homeostatic regulation of memory systems and adaptive decisions

While it is clear that many brain areas process mnemonic information, understanding how their interactions result in continuously adaptive behaviors has been a challenge. A homeostatic-regulated prediction model of memory is presented that considers the existence of a single memory system that is based on a multilevel coordinated and integrated network (from cells to neural systems) that determines the extent to which events and outcomes occur as predicted. The “multiple memory systems of the brain” have in common output that signals errors in the prediction of events and/or their outcomes, although these signals differ in terms of what the error signal represents (e.g., hippocampus: context prediction errors vs. midbrain/striatum: reward prediction errors). The prefrontal cortex likely plays a pivotal role in the coordination of prediction analysis within and across prediction brain areas. By virtue of its widespread control and influence, and intrinsic working memory mechanisms. Thus, the prefrontal cortex supports the flexible processing needed to generate adaptive behaviors and predict future outcomes. It is proposed that prefrontal cortex continually and automatically produces adaptive responses according to homeostatic regulatory principles: prefrontal cortex may serve as a controller that is intrinsically driven to maintain in prediction areas an experience-dependent firing rate set point that ensures adaptive temporally and spatially resolved neural responses to future prediction errors. This same drive by prefrontal cortex may also restore set point firing rates after deviations (i.e. prediction errors) are detected. In this way, prefrontal cortex contributes to reducing uncertainty in prediction systems. An emergent outcome of this homeostatic view may be the flexible and adaptive control that prefrontal cortex is known to implement (i.e. working memory) in the most challenging of situations. Compromise to any of the prediction circuits should result in rigid and suboptimal decision making and memory as seen in addiction and neurological disease. © 2013 The Authors. Hippocampus Published by Wiley Periodicals, Inc.

A role for the lateral dorsal tegmentum in memory and decision neural circuitry

A role for the hippocampus in memory is clear, although the mechanism for its contribution remains a matter of debate. Converging evidence suggests that hippocampus evaluates the extent to which context-defining features of events occur as expected. The consequence of mismatches, or prediction error, signals from hippocampus is discussed in terms of its impact on neural circuitry that evaluates the significance of prediction errors: Ventral tegmental area (VTA) dopamine cells burst fire to rewards or cues that predict rewards (Schultz, Dayan, & Montague, 1997). Although the lateral dorsal tegmentum (LDTg) importantly controls dopamine cell burst firing (Lodge & Grace, 2006) the behavioral significance of the LDTg control is not known. Therefore, we evaluated LDTg functional activity as rats performed a spatial memory task that generates task-dependent reward codes in VTA (Jo, Lee, & Mizumori, 2013; Puryear, Kim, & Mizumori, 2010) and another VTA afferent, the pedunculopontine nucleus (PPTg, Norton, Jo, Clark, Taylor, & Mizumori, 2011). Reversible inactivation of the LDTg significantly impaired choice accuracy. LDTg neurons coded primarily egocentric information in the form of movement velocity, turning behaviors, and behaviors leading up to expected reward locations. A subset of the velocity-tuned LDTg cells also showed high frequency bursts shortly before or after reward encounters, after which they showed tonic elevated firing during consumption of small, but not large, rewards. Cells that fired before reward encounters showed stronger correlations with velocity as rats moved toward, rather than away from, rewarded sites. LDTg neural activity was more strongly regulated by egocentric behaviors than that observed for PPTg or VTA cells that were recorded by Puryear et al. and Norton et al. While PPTg activity was uniquely sensitive to ongoing sensory input, all three regions encoded reward magnitude (although in different ways), reward expectation, and reward encounters. Only VTA encoded reward prediction errors. LDTg may inform VTA about learned goal-directed movement that reflects the current motivational state, and this in turn may guide VTA determination of expected subjective goal values. When combined it is clear the LDTg and PPTg provide only a portion of the information that dopamine cells need to assess the value of prediction errors, a process that is essential to future adaptive decisions and switches of cognitive (i.e. memorial) strategies and behavioral responses.

Context prediction analysis and episodic memory

Events that happen at a particular place and time come to define our episodic memories. Extensive experimental and clinical research illustrate that the hippocampus is central to the processing of episodic memories, and this is in large part due to its analysis of context information according to spatial and temporal references. In this way, hippocampus defines ones expectations for a given context as well as detects errors in predicted contextual features. The detection of context prediction errors is hypothesized to distinguished events into meaningful epochs that come to be recalled as separate episodic memories. The nature of the spatial and temporal context information processed by hippocampus is described, as is a hypothesis that the apparently self-regulatory nature of hippocampal context processing may ultimately be mediated by natural homeostatic operations and plasticity. Context prediction errors by hippocampus are suggested to be valued by the midbrain dopamine system, the output of which is ultimately fed back to hippocampus to update memory-driven context expectations for future events. Thus, multiple network functions (both within and outside hippocampus) combine to result in adaptive episodic memories.

Age-associated changes in the hippocampal-ventral striatum-ventral tegmental loop that impact learning, prediction, and context discrimination

Studies of the neural mechanisms of navigation and context discrimination have generated a powerful heuristic for understanding how neural codes, circuits, and computations contribute to accurate behavior as animals traverse and learn about spatially extended environments. It is assumed that memories are updated as a result of spatial experience. The mechanism, however, for such a process is not clear. Here we suggest that one revealing approach to study this issue is to integrate our knowledge about limbic system mediated navigation and context discrimination with knowledge about how midbrain neural circuitry mediates decision-making. This perspective should lead to new and specific neural theories about how choices that we make during navigation determine what information is ultimately learned and remembered. This same circuitry may be involved when past experiences come to bias future spatial perceptions and response selection. With old age come not only important changes in limbic system operations, but also significant decline in the function of midbrain regions that underlie accurate and efficient decisions. Thus, suboptimal accuracy of spatial context-based decision-making may be, at least in part, responsible for the common observation of spatial memory decline in old age.

Neural systems analysis of decision making during goal-directed navigation

The ability to make adaptive decisions during goal-directed navigation is a fundamental and highly evolved behavior that requires continual coordination of perceptions, learning and memory processes, and the planning of behaviors. Here, a neurobiological account for such coordination is provided by integrating current literatures on spatial context analysis and decision-making. This integration includes discussions of our current understanding of the role of the hippocampal system in experience-dependent navigation, how hippocampal information comes to impact midbrain and striatal decision making systems, and finally the role of the striatum in the implementation of behaviors based on recent decisions. These discussions extend across cellular to neural systems levels of analysis. Not only are key findings described, but also fundamental organizing principles within and across neural systems, as well as between neural systems functions and behavior, are emphasized. It is suggested that studying decision making during goal-directed navigation is a powerful model for studying interactive brain systems and their mediation of complex behaviors.

Complimentary roles of the hippocampus and retrosplenial cortex in behavioral context discrimination

Complex cognitive functions, such as learning and memory, arise from the interaction of multiple brain regions that comprise functional circuits and different components of these circuits make unique contributions to learning. The hippocampus and the retrosplenial cortex (RSC) are anatomically interconnected and both regions are involved in learning and memory. Previous studies indicate that the hippocampus exhibits unique firing patterns for different contexts and that RSC neurons selectively respond to cues that predict reinforcement or the need for a behavioral response, suggesting a hippocampal role in encoding contexts and an RSC role in encoding behaviorally significant cues. To test this, we simultaneously recorded hippocampal and RSC neuronal activity as rats learned to discriminate two behavioral contexts. The rats learned to approach the east arm of a plus maze for reward during the first half of each session and to approach the west arm during the second half. The "go east" and "go west" conditions constitute distinct behavioral contexts, which were cued by the reward location. Neurons in both regions developed highly context-specific responses as subjects learned to discriminate the contexts, but the response patterns differed in the two brain regions. Consistent with a context processing role, hippocampal neurons developed context-specific responses to a variety of task stimuli and events. In contrast, RSC neurons only developed context-specific responses to the reward location, which served as the context identifying cue. These results suggest that the hippocampus and RSC play distinct, but complimentary roles in mediating context appropriate memories and behaviors.

Activation of dopamine neurons is critical for aversive conditioning and prevention of generalized anxiety

Generalized anxiety is thought to result, in part, from impairments in contingency awareness during conditioning to cues that predict aversive or fearful outcomes. Dopamine neurons of the ventral midbrain exhibit heterogeneous responses to aversive stimuli that are thought to provide a critical modulatory signal to facilitate orienting to environmental changes and assignment of motivational value to unexpected events. Here, we describe a mouse model in which activation of dopamine neurons in response to an aversive stimulus is attenuated by conditional genetic inactivation of functional N–methyl–D–aspartate–type glutamate receptors (NMDARs) on dopamine neurons. We discovered that altering the magnitude of excitatory responses by dopamine neurons in response to an aversive stimulus is associated with impaired conditioning to a cue that predicts an aversive outcome. Impaired conditioning by these mice is associated with development of a persistent, generalized anxiety–like phenotype. These data are consistent with a role for dopamine in facilitating contingency awareness that is critical for the prevention of generalized anxiety.

Independent neural coding of reward and movement by pedunculopontine tegmental nucleus neurons in freely navigating rats

Phasic firing of dopamine (DA) neurons in the ventral tegmental area (VTA) and substantia nigra (SN) is likely to be crucial for reward processing that guides learning. One of the key structures implicated in the regulation of this DA burst firing is the pedunculopontine tegmental nucleus (PPTg), which projects to both the VTA and SN. Different literatures suggest that the PPTg serves as a sensory-gating area for DA cells or it regulates voluntary movement. This study recorded PPTg single-unit activity as rats perform a spatial navigation task to examine the potential for both reward and movement contributions. PPTg cells showed significant changes in firing relative to reward acquisition, the velocity of movement across the maze and turning behaviors of the rats. Reward, but not movement, correlates were impacted by changes in context, and neither correlate type was affected by reward manipulations (e.g. changing the expected location of a reward). This suggests that the PPTg conjunctively codes both reward and behavioral information, and that the reward information is processed in a context-dependent manner. The distinct anatomical distribution of reward and movement cells emphasizes different models of synaptic control by PPTg of DA burst firing in the VTA and SN. Relevant to both VTA and SN learning systems, however, PPTg appears to serve as a sensory gating mechanism to facilitate reinforcement learning, while at the same time provides reinforcement-based guidance of ongoing goal-directed behaviors.

Ventral tegmental area disruption selectively affects CA1/CA2 but not CA3 place fields during a differential reward working memory task

Hippocampus (HPC) receives dopaminergic (DA) projections from the ventral tegmental area (VTA) and substantia nigra. These inputs appear to provide a modulatory signal that influences HPC dependent behaviors and place fields. We examined how efferent projections from VTA to HPC influence spatial working memory and place fields when the reward context changes. CA1 and CA3 process environmental context changes differently and VTA preferentially innervates CA1. Given these anatomical data and electrophysiological evidence that implicate DA in reward processing, we predicted that CA1 place fields would respond more strongly to both VTA disruption and changes in the reward context than CA3 place fields. Rats (N = 9) were implanted with infusion cannula targeting VTA and recording tetrodes aimed at HPC. Then they were tested on a differential reward, win-shift working memory task. One recording session consisted of 5 baseline and 5 manipulation trials during which place cells in CA1/CA2 (N = 167) and CA3 (N = 94) were recorded. Prior to manipulation trials rats were infused with either baclofen or saline and then subjected to control or reward conditions during which the learned locations of large and small reward quantities were reversed. VTA disruption resulted in an increase in errors, and in CA1/CA2 place field reorganization. There were no changes in any measures of CA3 place field stability during VTA disruption. Reward manipulations did not affect performance or place field stability in CA1/CA2 or CA3; however, changes in the reward locations "rescued" performance and place field stability in CA1/CA2 when VTA activity was compromised, perhaps by trigging compensatory mechanisms. These data support the hypothesis that VTA contributes to spatial working memory performance perhaps by maintaining place field stability selectively in CA1/CA2.

Hippocampal episode fields develop with learning

Several recent studies have shown that hippocampal neurons fire during the delay period in between trials and that these firing patterns differ when different behaviors are required, suggesting that the neuronal responses may be involved in maintaining the memories needed for the upcoming trial. In particular, one study found that hippocampal neurons reliably fired at particular times, referred to as "episode fields" (EFs), during the delay period of a spatial alternation task (Pastalkova et al. (2008) Science 321:1322-1327). The firing of these neurons resulted in distinct sequential firing patterns on left and right turn trials, and these firing patterns could be used to predict the upcoming behavioral response. In this study, we examined neuronal firing during the delay period of a hippocampus-dependent plus maze task, which involved learning to approach two different reward locations (east and west), and we examined the development of these firing patterns with learning. As in the previous study, hippocampal neurons exhibited discrete periods of elevated firing during the delay (EFs) and the firing patterns were distinct on the east and west trials. Moreover, these firing patterns emerged and began to differentiate the east and west conditions during the first training session and continued to develop as the rats learned the task. The finding of similar firing patterns in different tasks suggests that the EFs are a robust phenomenon, which may occur whenever subjects must maintain distinct memory representations during a delay period. Additionally, in the previous study (Pastalkova et al. (2008) Science 321:1322-1327), the distinct firing patterns could have been due to the differing goal locations, behavioral responses (left or right turns), or trajectories. In this study, neuronal firing varied with the goal location regardless of the trajectories or responses, suggesting that the firing patterns encode the behavioral context rather than specific behaviors.

Conjunctive encoding of movement and reward by ventral tegmental area neurons in the freely navigating rodent

As one of the two main sources of brain dopamine, the ventral tegmental area (VTA) is important for several complex functions, including motivation, reward prediction, and contextual learning. Although many studies have identified the potential neural substrate of VTA dopaminergic activity in reward prediction functions during Pavlovian and operant conditioning tasks, less is understood about the role of VTA neuronal activity in motivated behaviors and more naturalistic forms of context-dependent learning. Therefore, VTA neural activity was recorded as rats performed a spatial memory task under varying contextual conditions. In addition to reward- and reward predicting cue-related firing commonly observed during conditioning tasks, the activity of a large proportion of VTA neurons was also related to the velocity and/or acceleration of the animal's movement. It is important to note that movement-related activity was strongest when rats displayed more motivation to obtain reward. Furthermore, many cells displayed a dual code of movement- and reward-related activity. These two modes of firing, however, were differentially regulated by context information, suggesting that movement- and reward-related firing are two independently regulated modes of VTA neuronal activity and may serve separate functions.

Neuronal representation of conditioned taste in the basolateral amygdala of rats

Animals develop robust learning and long lasting taste aversion memory once they experience a new taste that is followed by visceral discomfort. A large body of literature has supported the hypothesis that basolateral amygdala (BLA) plays a critical role in the acquisition and extinction of such conditioned taste aversions (CTA). Despite the evidence that BLA is crucially engaged during CTA training, it is unclear how BLA neural activity represents the conditioned tastes. Here, we incorporated a modified behavioral paradigm suitable for single unit study, one which utilizes a sequence of pulsed saccharin and water infusion via intraoral cannulae. After conditioning, we investigated BLA unit activity while animals experience the conditioned taste (saccharin). Behavioral tests of taste reactivity confirmed that the utilized training procedure produced reliable acquisition and expression of the aversion throughout test sessions. When neural activity was compared between saccharin and water trials, half of the recorded BLA units (77/149) showed differential activity according to the types of solution. 76% of those cells (29/38) in the conditioned group showed suppressed activity, while only 44% of taste reactive cells (17/39) in controls showed suppressed activity during saccharin trials (relative to water trials). In addition, the overall excitability of BLA units was increased as shown by altered characteristics of burst activity after conditioning. The changes in BLA activity as a consequence of CTA were maintained throughout test sessions, consistent with the behavioral study. The current study suggests that the neuronal activity evoked by a sweet taste is altered as a consequence of CTA learning, and that the overall change might be related to the learning induced negative affect.

Context dependent effects of ventral tegmental area inactivation on spatial working memory

Rats were tested on a hippocampus dependent win-shift working memory task in familiar or novel environments after receiving bilateral ventral tegmental area infusions of baclofen. Baclofen infusion disrupted working memory performance in both familiar and novel environments. In addition, baclofen infusion selectively disrupted short-term working memory in the novel environment. This experiment confirms selective ventral tegmental area support of accurate performance during a context dependent spatial navigation task.

Reward prediction error signals by reticular formation neurons

As a key part of the brain's reward system, midbrain dopamine neurons are thought to generate signals that reflect errors in the prediction of reward. However, recent evidence suggests that "upstream" brain areas may make important contributions to the generation of prediction error signals. To address this issue, we recorded neural activity in midbrain reticular formation (MRNm) while rats performed a spatial working memory task. A large proportion of these neurons displayed positive and negative reward prediction error-related activity that was strikingly similar to that observed in dopamine neurons. Therefore, MRNm may be a source of reward prediction error signals.

Basal ganglia contributions to adaptive navigation

The striatum has long been considered to be selectively important for nondeclarative, procedural types of memory. This stands in contrast with spatial context processing that is typically attributed to hippocampus. Neurophysiological evidence from studies of the neural mechanisms of adaptive navigation reveals that distinct neural systems such as the striatum and hippocampus continuously process task relevant information regardless of the current cognitive strategy. For example, both striatal and hippocampal neural representations reflect spatial location, directional heading, reward, and egocentric movement features of a test situation in an experience-dependent way, and independent of task demands. Thus, continual parallel processing across memory systems may be the norm rather than the exception. It is suggested that neuromodulators, such as dopamine, may serve to differentially regulate learning-induced neural plasticity mechanisms within these memory systems such that the most successful form of neural processing exerts the strongest control over response selection functions. In this way, dopamine may serve to optimize behavioral choices in the face of changing environmental demands during navigation.

Hippocampal and neocortical interactions during context discrimination: electrophysiological evidence from the rat

There is substantial evidence that hippocampus plays an important role in the processing of contextual information. Its specific role, however, remains unclear. One possibility is that single hippocampal neurons represent context information so that local circuits can construct representations of the current context, and the context that is expected based on past experience. Population codes derived from input by multiple local circuits may then engage match-mismatch algorithms that compare current and expected context information to determine the extent to which an expected context has changed. The results of such match-mismatch comparisons can be used to discriminate contexts. When context changes are detected, efferent messages may be passed on to connected neocortical areas so that informed "decisions" regarding future behavioral and cognitive strategies can be made. Here, a brief review describes evidence that a primary consequence of hippocampal processing is the discrimination of meaningful contexts. Then, the functional significance of neocortical circuits that likely receive hippocampal output messages are described in terms of their contribution to the control of ongoing behavioral and cognitive strategy, especially during active navigation. It is clear from this systems view that studies of spatial navigation continue to provide researchers with an excellent model of hippocampal-neocortical interactions during learning.

Immediate early gene activation in hippocampus and dorsal striatum: Effects of explicit place and response training

Evidence from lesion, electrophysiological, and neuroimaging studies support the hypothesis that the hippocampus and dorsal striatum process afferent inputs in such a way that each structure regulates expression of different behaviors in learning and memory. The present study sought to determine whether rats explicitly trained to perform one of two different learning strategies, spatial or response, would display disparate immediate early gene activation in hippocampus and striatum. c-Fos and Zif268 immunoreactivity (IR) was measured in both hippocampus and striatum 30 or 90 min following criterial performance on a standard plus-maze task (place learners) or a modified T-maze task (response learners). Place and response learning differentially affected c-Fos-IR in striatum but not hippocampus. Specifically, explicit response learning induced greater c-Fos-IR activation in two subregions of the dorsal striatum. This increased c-Fos-IR was dependent upon the number of trials performed prior to reaching behavioral criterion and accuracy of performance during post-testing probe trials. Quantification of Zif268-IR in both hippocampus and striatum failed to distinguish between place and response learners. The changes in c-Fos-IR occurred 30 min, but not 90 min, post-testing. The synthesis of c-Fos early in testing could reflect the recruitment of key structures in learning. Consequently, animals that were able to learn the response task efficiently displayed greater amounts of c-Fos-IR in dorsal striatum.

Memory influences on hippocampal and striatal neural codes: effects of a shift between task rules

Interactions with neocortical memory systems may facilitate flexible information processing by hippocampus. We sought direct evidence for such memory influences by recording hippocampal neural responses to a change in cognitive strategy. Well-trained rats switched (within a single recording session) between the use of place and response strategies to solve a plus maze task. Maze and extramaze environments were constant throughout testing. Place fields demonstrated (in-field) firing rate and location-based reorganization [Leutgeb, S., Leutgeb, J. K., Barnes, C. A., Moser, E. I., McNaughton, B. L., & Moser, M. B. (2005). Independent codes for spatial and episodic memory in hippocampal neuronal ensembles. Science, 309, 619-623] after a task switch, suggesting that hippocampus encoded each phase of testing as a different context, or episode. The task switch also resulted in qualitative and quantitative changes to discharge that were correlated with an animal's velocity or acceleration of movement. Thus, the effects of a strategy switch extended beyond the spatial domain, and the movement correlates were not passive reflections of the current behavioral state. To determine whether hippocampal neural responses were unique, striatal place and movement-correlated neurons were simultaneously recorded with hippocampal neurons. Striatal place and movement cells exhibited a response profile that was similar, but not identical, to that observed for hippocampus after a strategy switch. Thus, retrieval of a different memory led both neural systems to represent a different context. However, hippocampus may play a special (though not exclusive) role in flexible spatial processing since correlated firing amongst cell pairs was highest when rats successfully switched between two spatial tasks. Correlated firing by striatal cell pairs increased following any strategy switch, supporting the view that striatum codes change in reinforcement contingencies.

Learning-related development of context-specific neuronal responses to places and events: the hippocampal role in context processing

Contextual information plays a key role in learning and memory. Learned information becomes associated with the context such that the context can cue the relevant memories and behaviors. An extensive literature involving experimental brain lesions has implicated the hippocampus in context processing. However, the neurophysiological mechanisms of context coding are not known. Although "context" has typically been defined in terms of the background cues, recent studies indicate that hippocampal neurons are sensitive to subtle changes in task demands, even in an unchanging environment. Thus, the context may also include non-environmental features of a learning situation. In the present study, hippocampal neuronal activity was recorded while rats learned to approach different reward locations in two contexts. Because all of the training took place in the same environment, the contexts were defined by the task demands rather than by environmental stimuli. Learning to differentiate two such contexts was associated with the development of highly context-specific neuronal firing patterns. These included different place fields in pyramidal neurons and different event (e.g., reward) responses in pyramidal and interneurons. The differential firing patterns did not develop in a control condition that did not involve a context manipulation. The context-specific firing patterns could modulate activity in extrahippocampal structures to prime context-appropriate behavioral responses and memories. These results provide direct support for a context processing role of the hippocampus and suggest that the hippocampus contributes contextual representations to episodic memories.

Specific changes in hippocampal spatial codes predict spatial working memory performance

This study examined the relationship between hippocampal place fields and spatial working memory. Place cells were recorded while rats solved a spatial working memory task in light and dark testing conditions. Rats made significantly more errors when tested in darkness, and although place fields changed in multiple ways in darkness, only changes in place field specificity predicted the degree of impaired spatial memory. This finding suggests that more spatially distinct place fields may contribute to hippocampal-dependent mnemonic functions.

Hippocampal place cells, context, and episodic memory

Although most observers agree that the hippocampus has a critical role in learning and memory, there remains considerable debate about the precise functional contribution of the hippocampus to these processes. Two of the most influential accounts hold that the primary function of the hippocampus is to generate cognitive maps and to mediate episodic memory processes. The well-documented spatial firing patterns (place fields) of hippocampal neurons in rodents, along with the spatial learning impairments observed with hippocampal damage support the cognitive mapping hypothesis. The amnesia for personally experienced events seen in humans with hippocampal damage and the data of animal models, which show severe memory deficits associated with hippocampal lesions, support the episodic memory account. Although an extensive literature supports each of these hypotheses, a specific contribution of place cells to episodic memory has not been clearly demonstrated. Recent data from our laboratory, together with previous findings, indicate that hippocampal place fields and neuronal responses to task-relevant stimuli are highly sensitive to the context, even when the contexts are defined by abstract task demands rather than the spatial geometry of the environment. On the basis of these findings, it is proposed that place fields reflect a more general context processing function of the hippocampus. Hippocampal context representations could serve to differentiate contexts and prime the relevant memories and behaviors. Since episodic memories, by definition, include information about the time and place where the episode occurred, contextual information is a necessary prerequisite for any episodic memory. Thus, place fields contribute importantly to episodic memory as part of the needed context representations. Additionally, recent findings indicate that hippocampal neurons differentiate contexts at progressively finer levels of detail, suggesting a hierarchical coding scheme which, if combined with temporal information, could provide a means of differentiating memory episodes.

Context-dependent modulation by D₁ receptors: Differential effects in hippocampus and striatum

Place-specific firing by hippocampal and striatal neurons was recorded simultaneously following injection of a D(1) receptor antagonist (SCH23390) and during spatial working memory task performance. SCH23390-induced changes in unit responses were observed during light and dark test conditions. Although hippocampal place field locations were altered by the contextual change, the reliability and specificity of place fields was disrupted only by combining D(1) antagonism and a change in context. Striatal place field locations were reorganized after either contextual change or D(1) antagonism, without altering place field reliability and specificity. Disrupted velocity encoding by place cells in both regions was induced by darkness, whereas greater stability in acceleration encoding followed removal of D(1) receptor activity. Dopamine may differentially regulate hippocampal context learning and striatum-based predictive codes.

Differential effects of estrogen on hippocampal- and striatal-dependent learning

Estrogen's role in learning and memory may be to predispose animals to use specific cognitive strategies (Korol & Kolo, 2002). Specifically, estrogen may facilitate hippocampal-dependent learning, while at the same time attenuate striatal-dependent learning. As a stringent test of this hypothesis, place or response learning on an eight-arm radial maze was compared between ovariectomized (OVX) female Long-Evans rats and rats with chronic estrogen replacement (OVX+E; 5mg 17-beta estradiol 60-day release tablet). Reference and working memory errors were monitored separately for both place and response learning tasks. OVX+E rats learned the place task significantly faster than the response task, and faster than OVX rats. OVX rats required fewer days to reach criterion on the response task than OVX+E rats. Estrogen selectively enhanced reference memory performance, but only during place learning. The specific pattern of estrogen effects on learning suggests that future studies include verification of cognitive strategies used by animals.

Parallel processing across neural systems: Implications for a multiple memory system hypothesis

A common conceptualization of the organization of memory systems in brain is that different types of memory are mediated by distinct neural systems. Strong support for this view comes from studies that show double (or triple) dissociations between spatial, response, and emotional memories following selective lesions of hippocampus, striatum, and the amygdala. Here, we examine the extent to which hippocampal and striatal neural activity patterns support the multiple memory systems view. A comparison is made between hippocampal and striatal neural correlates with behavior during asymptotic performance of spatial and response maze tasks. Location- (or place), movement, and reward-specific firing patterns were found in both structures regardless of the task demands. Many, but not all, place fields of hippocampal and striatal neurons were similarly affected by changes in the visual and reward context regardless of the cognitive demands. Also, many, but not all, hippocampal and striatal movement-sensitive neurons showed significant changes in their behavioral correlates after a change in visual context, irrespective of cognitive strategy. Similar partial reorganization was observed following manipulations of the reward condition for cells recorded from both structures, again regardless of task. Assuming that representations that persist across context changes reflect learned information, we make the following conclusions. First, the consistent pattern of partial reorganization supports a view that the analysis of spatial, response, and reinforcement information is accomplished via an error-driven, or match-mismatch, algorithm across neural systems. Second, task-relevant processing occurs continuously within hippocampus and striatum regardless of the cognitive demands of the task. Third, given the high degree of parallel processing across allegedly different memory systems, we propose that different neural systems may effectively compete for control of a behavioral expression system. The strength of the influence of any one neural system on behavioral output is likely modulated by factors such as motivation, experience, or hormone status.

Firing properties of dopamine neurons in freely moving dopamine-deficient mice: effects of dopamine receptor activation and anesthesia

To examine the regulation of midbrain dopamine neurons, recordings were obtained from single neurons of freely moving, genetically engineered dopamine-deficient (DD) mice. DD mice were tested without dopamine signaling (basal state) and with endogenous dopamine signaling (after L-dopa administration). In the basal state, when dopamine concentration in DD mice is <1% of that in control animals, the firing properties of midbrain dopamine neurons were remarkably similar among genotypes. However, L-dopa treatment, which restores dopamine and feeding and locomotor behavior in DD mice, profoundly inhibited the firing rate and bursting of dopamine neurons in DD mice. In addition, dopamine neurons in DD mice were hypersensitive to the dopamine receptor agonists quinpirole and SKF 81297. Anesthesia markedly reduced the firing rate of dopamine neurons in DD mice but did not significantly decrease the firing rate in control dopamine neurons. These data suggest that restoration of endogenous dopamine signaling activates hypersensitive long-loop feedback pathways that serve to limit dopamine release and underscore the importance of recording from awake animals.

Methods for chronic neural recording in the telencephalon of freely behaving fish

We have adapted for use in fish several of the procedures employed for recording single neuron activity in freely behaving rodents. Developing a method for single unit chronic recording in freely behaving fish was motivated by a need for a comparison across taxa of telencephalic neural activity evoked during spatial navigation by animals of their environments. However, the procedures outlined here can be modified easily for underwater recording from most aquatic species and from other brain areas. Under anesthesia, bundles of stereotrodes or tetrodes were implanted into the dorsolateral region of the goldfish or cichlid telencephalon. An infrared light emitting diode (LED) was also fixed to the fish's head at the time of surgery. After recovery from anesthesia, fish were allowed to swim freely within a large aquarium. Single unit activity was analyzed and correlated with stimulus conditions, behavior, and the location and movement of the LED recorded by a camera tracking system. The value of this technique is demonstrated by providing the first evidence in fish for navigation-related neural firing, including "place cells" that display location-specific discharge.