Cognitive representations of intracranial self-stimulation of midbrain dopamine neurons depend on stimulation frequency

Dopamine neurons in the ventral tegmental area support intracranial self-stimulation (ICSS), yet the cognitive representations underlying this phenomenon remain unclear. Here, 20-Hz stimulation of dopamine neurons, which approximates a physiologically relevant prediction error, was not sufficient to support ICSS beyond a continuously reinforced schedule and did not endow cues with a general or specific value. However, 50-Hz stimulation of dopamine neurons was sufficient to drive robust ICSS and was represented as a specific reward to motivate behavior. The frequency dependence of this effect is due to the rate (not the number) of action potentials produced by dopamine neurons, which differently modulates dopamine release downstream.

Dopamine projections to the basolateral amygdala drive the encoding of identity-specific reward memories

To make adaptive decisions, we build an internal model of the associative relationships in an environment and use it to make predictions and inferences about specific available outcomes. Detailed, identity-specific cue-reward memories are a core feature of such cognitive maps. Here we used fiber photometry, cell-type and pathway-specific optogenetic manipulation, Pavlovian cue-reward conditioning and decision-making tests in male and female rats, to reveal that ventral tegmental area dopamine (VTADA) projections to the basolateral amygdala (BLA) drive the encoding of identity-specific cue-reward memories. Dopamine is released in the BLA during cue-reward pairing; VTADA→BLA activity is necessary and sufficient to link the identifying features of a reward to a predictive cue but does not assign general incentive properties to the cue or mediate reinforcement. These data reveal a dopaminergic pathway for the learning that supports adaptive decision-making and help explain how VTADA neurons achieve their emerging multifaceted role in learning.

The cognitive (lateral) hypothalamus

Despite the physiological complexity of the hypothalamus, its role is typically restricted to initiation or cessation of innate behaviors. For example, theories of lateral hypothalamus argue that it is a switch to turn feeding 'on' and 'off' as dictated by higher-order structures that render when feeding is appropriate. However, recent data demonstrate that the lateral hypothalamus is critical for learning about food-related cues. Furthermore, the lateral hypothalamus opposes learning about information that is neutral or distal to food. This reveals the lateral hypothalamus as a unique arbitrator of learning capable of shifting behavior toward or away from important events. This has relevance for disorders characterized by changes in this balance, including addiction and schizophrenia. Generally, this suggests that hypothalamic function is more complex than increasing or decreasing innate behaviors.

A process-based approach to health-related quality of life as a "way of living"

INTRODUCTION

There is an historical initiative to establish common theoretical ground to support a framework for assessing health-related quality of life (HRQL). Our aim was to add to this effort with an analysis of theoretical/philosophical themes embedded in HRQL questionnaires and patient reports.

METHODS AND RESULTS

We reviewed recent developments in HRQL assessment. This included analyzing a representative sample of psychometric measures of HRQL to schematically summarize core theoretical/philosophical themes that are embedded in questionnaire items. This analysis indicated a state-based framework for HRQL that was characterized by themes of hedonic and eudaimonic well-being, and desire-satisfaction. In contrast, a review of patient reports of HRQL indicated a process-based framework where goal-directed activities aimed to secure aspirational life goals while striving to accept the reality of declining health. Given this difference in HRQL themes we used a meta-philosophical approach, based on Hadot's idea of philosophy as a way of living, to identify a process-based theoretical framework for HRQL assessment that addressed patient-reported themes. The Stoic modification of eudaimonic well-being was examined where HRQL and well-being are viewed as a process (vs. state) aimed at transforming the experience of loss or grief in response to adversity through goal-directed activities/exercises (euroia biou, good flow in life). We then introduced a complementary research agenda for HRQL assessment that incorporates self-reported, goal-directed activities that are initiated or maintained to promote HRQL.

CONCLUSION

A process-based approach to HRQL assessment may increase the spectrum of clinically relevant features that currently comprise operational measures of this patient-reported appraisal.

Dopamine signaling in the nucleus accumbens core mediates latent inhibition

Studies investigating the neural mechanisms by which associations between cues and predicted outcomes control behavior often use associative learning frameworks to understand the neural control of behavior. These frameworks do not always account for the full range of effects that novelty can have on behavior and future associative learning. Here, in mice, we show that dopamine in the nucleus accumbens core is evoked by novel, neutral stimuli, and the trajectory of this response over time tracked habituation to these stimuli. Habituation to novel cues before associative learning reduced future associative learning, a phenomenon known as latent inhibition. Crucially, trial-by-trial dopamine response patterns tracked this phenomenon. Optogenetic manipulation of dopamine responses to the cue during the habituation period bidirectionally influenced future associative learning. Thus, dopamine signaling in the nucleus accumbens core has a causal role in novelty-based learning in a way that cannot be predicted based on purely associative factors.

Dopamine errors drive excitatory and inhibitory components of backward conditioning in an outcome-specific manner

For over two decades, phasic activity in midbrain dopamine neurons was considered synonymous with the prediction error in temporal-difference reinforcement learning.^1-4 Central to this proposal is the notion that reward-predictive stimuli become endowed with the scalar value of predicted rewards. When these cues are subsequently encountered, their predictive value is compared to the value of the actual reward received, allowing for the calculation of prediction errors.^5,6 Phasic firing of dopamine neurons was proposed to reflect this computation,^1,2 facilitating the backpropagation of value from the predicted reward to the reward-predictive stimulus, thus reducing future prediction errors. There are two critical assumptions of this proposal: (1) that dopamine errors can only facilitate learning about scalar value and not more complex features of predicted rewards, and (2) that the dopamine signal can only be involved in anticipatory cue-reward learning in which cues or actions precede rewards. Recent work^7-15 has challenged the first assumption, demonstrating that phasic dopamine signals across species are involved in learning about more complex features of the predicted outcomes, in a manner that transcends this value computation. Here, we tested the validity of the second assumption. Specifically, we examined whether phasic midbrain dopamine activity would be necessary for backward conditioning-when a neutral cue reliably follows a rewarding outcome.^16-20 Using a specific Pavlovian-to-instrumental transfer (PIT) procedure,^21-23 we show rats learn both excitatory and inhibitory components of a backward association, and that this association entails knowledge of the specific identity of the reward and cue. We demonstrate that brief optogenetic inhibition of VTA_DA neurons timed to the transition between the reward and cue reduces both of these components of backward conditioning. These findings suggest VTA_DA neurons are capable of facilitating associations between contiguously occurring events, regardless of the content of those events. We conclude that these data may be in line with suggestions that the VTA_DA error acts as a universal teaching signal. This may provide insight into why dopamine function has been implicated in myriad psychological disorders that are characterized by very distinct reinforcement-learning deficits.

The prediction-error hypothesis of schizophrenia: new data point to circuit-specific changes in dopamine activity

Schizophrenia is a severe psychiatric disorder affecting 21 million people worldwide. People with schizophrenia suffer from symptoms including psychosis and delusions, apathy, anhedonia, and cognitive deficits. Strikingly, schizophrenia is characterised by a learning paradox involving difficulties learning from rewarding events, whilst simultaneously 'overlearning' about irrelevant or neutral information. While dysfunction in dopaminergic signalling has long been linked to the pathophysiology of schizophrenia, a cohesive framework that accounts for this learning paradox remains elusive. Recently, there has been an explosion of new research investigating how dopamine contributes to reinforcement learning, which illustrates that midbrain dopamine contributes in complex ways to reinforcement learning, not previously envisioned. This new data brings new possibilities for how dopamine signalling contributes to the symptomatology of schizophrenia. Building on recent work, we present a new neural framework for how we might envision specific dopamine circuits contributing to this learning paradox in schizophrenia in the context of models of reinforcement learning. Further, we discuss avenues of preclinical research with the use of cutting-edge neuroscience techniques where aspects of this model may be tested. Ultimately, it is hoped that this review will spur to action more research utilising specific reinforcement learning paradigms in preclinical models of schizophrenia, to reconcile seemingly disparate symptomatology and develop more efficient therapeutics.

The effect of stress and reward on encoding future fear memories

Prior experience changes the way we learn about our environment. Stress predisposes individuals to developing psychological disorders, just as positive experiences protect from this eventuality (Kirkpatrick & Heller, 2014; Koenigs & Grafman, 2009; Pechtel & Pizzagalli, 2011). Yet current models of how the brain processes information often do not consider a role for prior experience. The considerable literature that examines how stress impacts the brain is an exception to this. This research demonstrates that stress can bias the interpretation of ambiguous events towards being aversive in nature, owed to changes in amygdala physiology (Holmes et al., 2013; Perusini et al., 2016; Rau et al., 2005; Shors et al., 1992). This is thought to be an important model for how people develop anxiety disorders, like post-traumatic stress disorder (PTSD; Rau et al., 2005). However, more recent evidence suggests that experience with reward learning can also change the neural circuits that are involved in learning about fear (Sharpe et al., 2021). Specifically, the lateral hypothalamus, a region typically restricted to modulating feeding and reward behavior, can be recruited to encode fear memories after experience with reward learning. This review discusses the literature on how stress and reward change the way we acquire and encode memories for aversive events, offering a testable model of how these regions may interact to promote either adaptive or maladaptive fear memories.

BehaviorDEPOT is a simple, flexible tool for automated behavioral detection based on markerless pose tracking

Quantitative descriptions of animal behavior are essential to study the neural substrates of cognitive and emotional processes. Analyses of naturalistic behaviors are often performed by hand or with expensive, inflexible commercial software. Recently, machine learning methods for markerless pose estimation enabled automated tracking of freely moving animals, including in labs with limited coding expertise. However, classifying specific behaviors based on pose data requires additional computational analyses and remains a significant challenge for many groups. We developed BehaviorDEPOT (DEcoding behavior based on POsitional Tracking), a simple, flexible software program that can detect behavior from video timeseries and can analyze the results of experimental assays. BehaviorDEPOT calculates kinematic and postural statistics from keypoint tracking data and creates heuristics that reliably detect behaviors. It requires no programming experience and is applicable to a wide range of behaviors and experimental designs. We provide several hard-coded heuristics. Our freezing detection heuristic achieves above 90% accuracy in videos of mice and rats, including those wearing tethered head-mounts. BehaviorDEPOT also helps researchers develop their own heuristics and incorporate them into the software's graphical interface. Behavioral data is stored framewise for easy alignment with neural data. We demonstrate the immediate utility and flexibility of BehaviorDEPOT using popular assays including fear conditioning, decision-making in a T-maze, open field, elevated plus maze, and novel object exploration.

Higher-Order Conditioning and Dopamine: Charting a Path Forward

Higher-order conditioning involves learning causal links between multiple events, which then allows one to make novel inferences. For example, observing a correlation between two events (e.g., a neighbor wearing a particular sports jersey), later helps one make new predictions based on this knowledge (e.g., the neighbor's wife's favorite sports team). This type of learning is important because it allows one to benefit maximally from previous experiences and perform adaptively in complex environments where many things are ambiguous or uncertain. Two procedures in the lab are often used to probe this kind of learning, second-order conditioning (SOC) and sensory preconditioning (SPC). In second-order conditioning (SOC), we first teach subjects that there is a relationship between a stimulus and an outcome (e.g., a tone that predicts food). Then, an additional stimulus is taught to precede the predictive stimulus (e.g., a light leads to the food-predictive tone). In sensory preconditioning (SPC), this order of training is reversed. Specifically, the two neutral stimuli (i.e., light and tone) are first paired together and then the tone is paired separately with food. Interestingly, in both SPC and SOC, humans, rodents, and even insects, and other invertebrates will later predict that both the light and tone are likely to lead to food, even though they only experienced the tone directly paired with food. While these processes are procedurally similar, a wealth of research suggests they are associatively and neurobiologically distinct. However, midbrain dopamine, a neurotransmitter long thought to facilitate basic Pavlovian conditioning in a relatively simplistic manner, appears critical for both SOC and SPC. These findings suggest dopamine may contribute to learning in ways that transcend differences in associative and neurological structure. We discuss how research demonstrating that dopamine is critical to both SOC and SPC places it at the center of more complex forms of cognition (e.g., spatial navigation and causal reasoning). Further, we suggest that these more sophisticated learning procedures, coupled with recent advances in recording and manipulating dopamine neurons, represent a new path forward in understanding dopamine's contribution to learning and cognition.

Past experience shapes the neural circuits recruited for future learning

Experimental research controls for past experience, yet prior experience influences how we learn. Here, we tested whether we could recruit a neural population that usually encodes rewards to encode aversive events. Specifically, we found that GABAergic neurons in the lateral hypothalamus (LH) were not involved in learning about fear in naïve rats. However, if these rats had prior experience with rewards, LH GABAergic neurons became important for learning about fear. Interestingly, inhibition of these neurons paradoxically enhanced learning about neutral sensory information, regardless of prior experience, suggesting that LH GABAergic neurons normally oppose learning about irrelevant information. These experiments suggest that prior experience shapes the neural circuits recruited for future learning in a highly specific manner, reopening the neural boundaries we have drawn for learning of particular types of information from work in naïve subjects.

Responding to preconditioned cues is devaluation sensitive and requires orbitofrontal cortex during cue-cue learning

The orbitofrontal cortex (OFC) is necessary for inferring value in tests of model-based reasoning, including in sensory preconditioning. This involvement could be accounted for by representation of value or by representation of broader associative structure. We recently reported neural correlates of such broader associative structure in OFC during the initial phase of sensory preconditioning (Sadacca et al., 2018). Here, we used optogenetic inhibition of OFC to test whether these correlates might be necessary for value inference during later probe testing. We found that inhibition of OFC during cue-cue learning abolished value inference during the probe test, inference subsequently shown in control rats to be sensitive to devaluation of the expected reward. These results demonstrate that OFC must be online during cue-cue learning, consistent with the argument that the correlates previously observed are not simply downstream readouts of sensory processing and instead contribute to building the associative model supporting later behavior.

Causal evidence supporting the proposal that dopamine transients function as temporal difference prediction errors

Reward-evoked dopamine transients are well established as prediction errors. However, the central tenet of temporal difference accounts-that similar transients evoked by reward-predictive cues also function as errors-remains untested. In the present communication we addressed this by showing that optogenetically shunting dopamine activity at the start of a reward-predicting cue prevents second-order conditioning without affecting blocking. These results indicate that cue-evoked transients function as temporal-difference prediction errors rather than reward predictions.

Dopamine transients do not act as model-free prediction errors during associative learning

Dopamine neurons are proposed to signal the reward prediction error in model-free reinforcement learning algorithms. This term represents the unpredicted or 'excess' value of the rewarding event, value that is then added to the intrinsic value of any antecedent cues, contexts or events. To support this proposal, proponents cite evidence that artificially-induced dopamine transients cause lasting changes in behavior. Yet these studies do not generally assess learning under conditions where an endogenous prediction error would occur. Here, to address this, we conducted three experiments where we optogenetically activated dopamine neurons while rats were learning associative relationships, both with and without reward. In each experiment, the antecedent cues failed to acquire value and instead entered into associations with the later events, whether valueless cues or valued rewards. These results show that in learning situations appropriate for the appearance of a prediction error, dopamine transients support associative, rather than model-free, learning.

An Integrated Model of Action Selection: Distinct Modes of Cortical Control of Striatal Decision Making

Making decisions in environments with few choice options is easy. We select the action that results in the most valued outcome. Making decisions in more complex environments, where the same action can produce different outcomes in different conditions, is much harder. In such circumstances, we propose that accurate action selection relies on top-down control from the prelimbic and orbitofrontal cortices over striatal activity through distinct thalamostriatal circuits. We suggest that the prelimbic cortex exerts direct influence over medium spiny neurons in the dorsomedial striatum to represent the state space relevant to the current environment. Conversely, the orbitofrontal cortex is argued to track a subject's position within that state space, likely through modulation of cholinergic interneurons.

Evaluation of the hypothesis that phasic dopamine constitutes a cached-value signal

The phasic dopamine error signal is currently argued to be synonymous with the prediction error in Sutton and Barto (1987, 1998) model-free reinforcement learning algorithm (Schultz et al., 1997). This theory argues that phasic dopamine reflects a cached-value signal that endows reward-predictive cues with the scalar value inherent in reward. Such an interpretation does not envision a role for dopamine in more complex cognitive representations between events which underlie many forms of associative learning, restricting the role dopamine can play in learning. The cached-value hypothesis of dopamine makes three concrete predictions about when a phasic dopamine response should be seen and what types of learning this signal should be able to promote. We discuss these predictions in light of recent evidence which we believe provide particularly strong tests of their validity. In doing so, we find that while the phasic dopamine signal conforms to a cached-value account in some circumstances, other evidence demonstrate that this signal is not restricted to a model-free cached-value reinforcement learning signal. In light of this evidence, we argue that the phasic dopamine signal functions more generally to signal violations of expectancies to drive real-world associations between events.

Author Correction: Dopamine transients are sufficient and necessary for acquisition of model-based associations

In the version of this article initially published, the laser activation at the start of cue X in experiment 1 was described in the first paragraph of the Results and in the third paragraph of the Experiment 1 section of the Methods as lasting 2 s; in fact, it lasted only 1 s. The error has been corrected in the HTML and PDF versions of the article.

What a relief! A role for dopamine in positive (but not negative) valence

We have long known that dopamine encodes the predictive relationship between cues and rewards. But what about relief learning? In this issue of Neuropsychopharmacology, Mayer et al. show that the same circuits encoding rewarding events also encode relief from aversive events. And this appears to be in a manner distinct from encoding of the aversive event itself. So does dopamine only contribute to learning about positive events? And are these events encoded in the same way regardless of how that positive experience came about? Not quite. Turns out, the devil is in the details.

Model-based predictions for dopamine

Phasic dopamine responses are thought to encode a prediction-error signal consistent with model-free reinforcement learning theories. However, a number of recent findings highlight the influence of model-based computations on dopamine responses, and suggest that dopamine prediction errors reflect more dimensions of an expected outcome than scalar reward value. Here, we review a selection of these recent results and discuss the implications and complications of model-based predictions for computational theories of dopamine and learning.

Preconditioned cues have no value

Sensory preconditioning has been used to implicate midbrain dopamine in model-based learning, contradicting the view that dopamine transients reflect model-free value. However, it has been suggested that model-free value might accrue directly to the preconditioned cue through mediated learning. Here, building on previous work (Sadacca et al., 2016), we address this question by testing whether a preconditioned cue will support conditioned reinforcement in rats. We found that while both directly conditioned and second-order conditioned cues supported robust conditioned reinforcement, a preconditioned cue did not. These data show that the preconditioned cue in our procedure does not directly accrue model-free value and further suggest that the cue may not necessarily access value even indirectly in a model-based manner. If so, then phasic response of dopamine neurons to cues in this setting cannot be described as signaling errors in predicting value.

Lateral Hypothalamic GABAergic Neurons Encode Reward Predictions that Are Relayed to the Ventral Tegmental Area to Regulate Learning

Eating is a learned process. Our desires for specific foods arise through experience. Both electrical stimulation and optogenetic studies have shown that increased activity in the lateral hypothalamus (LH) promotes feeding. Current dogma is that these effects reflect a role for LH neurons in the control of the core motivation to feed, and their activity comes under control of forebrain regions to elicit learned food-motivated behaviors. However, these effects could also reflect the storage of associative information about the cues leading to food in LH itself. Here, we present data from several studies that are consistent with a role for LH in learning. In the first experiment, we use a novel GAD-Cre rat to show that optogenetic inhibition of LH γ-aminobutyric acid (GABA) neurons restricted to cue presentation disrupts the rats' ability to learn that a cue predicts food without affecting subsequent food consumption. In the second experiment, we show that this manipulation also disrupts the ability of a cue to promote food seeking after learning. Finally, we show that inhibition of the terminals of the LH GABA neurons in ventral-tegmental area (VTA) facilitates learning about reward-paired cues. These results suggest that the LH GABA neurons are critical for storing and later disseminating information about reward-predictive cues.

Dopamine transients are sufficient and necessary for acquisition of model-based associations

Associative learning is driven by prediction errors. Dopamine transients correlate with these errors, which current interpretations limit to endowing cues with a scalar quantity reflecting the value of future rewards. We tested whether dopamine might act more broadly to support learning of an associative model of the environment. Using sensory preconditioning, we show that prediction errors underlying stimulus-stimulus learning can be blocked behaviorally and reinstated by optogenetically activating dopamine neurons. We further show that suppressing the firing of these neurons across the transition prevents normal stimulus-stimulus learning. These results establish that the acquisition of model-based information about transitions between nonrewarding events is also driven by prediction errors and that, contrary to existing canon, dopamine transients are both sufficient and necessary to support this type of learning. Our findings open new possibilities for how these biological signals might support associative learning in the mammalian brain in these and other contexts.

The Dopamine Prediction Error: Contributions to Associative Models of Reward Learning

Phasic activity of midbrain dopamine neurons is currently thought to encapsulate the prediction-error signal described in Sutton and Barto’s (1981) model-free reinforcement learning algorithm. This phasic signal is thought to contain information about the quantitative value of reward, which transfers to the reward-predictive cue after learning. This is argued to endow the reward-predictive cue with the value inherent in the reward, motivating behavior toward cues signaling the presence of reward. Yet theoretical and empirical research has implicated prediction-error signaling in learning that extends far beyond a transfer of quantitative value to a reward-predictive cue. Here, we review the research which demonstrates the complexity of how dopaminergic prediction errors facilitate learning. After briefly discussing the literature demonstrating that phasic dopaminergic signals can act in the manner described by Sutton and Barto (1981), we consider how these signals may also influence attentional processing across multiple attentional systems in distinct brain circuits. Then, we discuss how prediction errors encode and promote the development of context-specific associations between cues and rewards. Finally, we consider recent evidence that shows dopaminergic activity contains information about causal relationships between cues and rewards that reflect information garnered from rich associative models of the world that can be adapted in the absence of direct experience. In discussing this research we hope to support the expansion of how dopaminergic prediction errors are thought to contribute to the learning process beyond the traditional concept of transferring quantitative value.

The State of the Orbitofrontal Cortex

State representation is fundamental to behavior. However, identifying the true state of the world is challenging when explicit cues are ambiguous. Here, Bradfield and colleagues show that the medial OFC is critical for using associative information to discriminate ambiguous states.

Back to basics: Making predictions in the orbitofrontal-amygdala circuit

Underlying many complex behaviors are simple learned associations that allow humans and animals to anticipate the consequences of their actions. The orbitofrontal cortex and basolateral amygdala are two regions which are crucial to this process. In this review, we go back to basics and discuss the literature implicating both these regions in simple paradigms requiring the development of associations between stimuli and the motivationally-significant outcomes they predict. Much of the functional research surrounding this ability has suggested that the orbitofrontal cortex and basolateral amygdala play very similar roles in making these predictions. However, electrophysiological data demonstrates critical differences in the way neurons in these regions respond to predictive cues, revealing a difference in their functional role. On the basis of these data and theories that have come before, we propose that the basolateral amygdala is integral to updating information about cue-outcome contingencies whereas the orbitofrontal cortex is critical to forming a wider network of past and present associations that are called upon by the basolateral amygdala to benefit future learning episodes. The tendency for orbitofrontal neurons to encode past and present contingencies in distinct neuronal populations may facilitate its role in the formation of complex, high-dimensional state-specific associations.

Daily Exposure to Sucrose Impairs Subsequent Learning About Food Cues: A Role for Alterations in Ghrelin Signaling and Dopamine D2 Receptors

The prevalence of hedonic foods and associated advertising slogans has contributed to the rise of the obesity epidemic in the modern world. Research has shown that intake of these foods disrupt dopaminergic systems. It may be that a disruption of these circuits produces aberrant learning about food-cue relationships. We found that rodents given 28 days of intermittent access to sucrose exhibited a deficit in the ability to block learning about a stimulus when it is paired in compound with food and another stimulus that has already been established as predictive of the food outcome. This deficit was characterized by an approach to a cue signaling food delivery that is usually blocked by prior learning, an effect dependent on dopaminergic prediction-error signaling in the midbrain. Administering the D2 agonist quinpirole during learning restored blocking in animals with a prior history of sucrose exposure. Further, repeated central infusions of ghrelin produced a deficit in blocking in the same manner as sucrose exposure. We argue that changes in dopaminergic systems resulting from sucrose exposure are mediated by a disruption of ghrelin signaling as rodents come to anticipate delivery of the highly palatable sucrose outside of normal feeding schedules. This suggestion is supported by our finding that both sucrose and ghrelin treatments resulted in increases in amphetamine-induced locomotor responding. Thus, for the first time, we have provided evidence of a potential link between alterations in D2 receptors caused by the intake of hedonic foods and aberrant learning about cue-food relationships capable of promoting inappropriate feeding habits. In addition, we have found preliminary evidence to suggest that this is mediated by changes in ghrelin signaling, a finding that should stimulate further research into modulation of ghrelin activity to treat obesity.

The prelimbic cortex directs attention toward predictive cues during fear learning

The prelimbic cortex is argued to promote conditioned fear expression, at odds with appetitive research implicating this region in attentional processing. Consistent with an attentional account, we report that the effect of prelimbic lesions on fear expression depends on the degree of competition between contextual and discrete cues. Further, when competition from contextual cues is low, we found that PL inactivation resulted in animals expressing fear toward irrelevant discrete cues; an effect selective to inactivation during the learning phase and not during retrieval. These data demonstrate that the prelimbic cortex modulates attention toward cues to preferentially direct fear responding on the basis of their predictive value.

The prelimbic cortex uses higher-order cues to modulate both the acquisition and expression of conditioned fear

The prelimbic (PL) cortex allows rodents to adapt their responding under changing experimental circumstances. In line with this, the PL cortex has been implicated in strategy set shifting, attentional set shifting, the resolution of response conflict, and the modulation of attention towards predictive stimuli. One interpretation of this research is that the PL cortex is involved in using information garnered from higher-order cues in the environment to modulate how an animal responds to environmental stimuli. However, data supporting this view of PL function in the aversive domain are lacking. In the following experiments, we attempted to answer two questions. Firstly, we wanted to investigate whether the role of the PL cortex in using higher-order cues to influence responding generalizes across appetitive and aversive domains. Secondly, as much of the research has focused on a role for the PL cortex in performance, we wanted to assess whether this region is also involved in the acquisition of hierarchal associations which facilitate an ability to use higher-order cues to modulate responding. In order to answer these questions, we assessed the impact of PL inactivation during both the acquisition and expression of a contextual bi-conditional discrimination. A contextual bi-conditional discrimination involves presenting two stimuli. In one context, one stimulus is paired with shock while the other is presented without shock. In another context, these contingencies are reversed. Thus, animals have to use the present contextual cues to disambiguate the significance of the stimulus and respond appropriately. We found that PL inactivation disrupted both the encoding and expression of these context-dependent associations. This supports a role for the PL cortex in allowing higher-order cues to modulate both learning about, and responding towards, different cues. We discuss these findings in the broader context of functioning in the medial prefrontal cortex (PFC).

The prelimbic cortex contributes to the down-regulation of attention toward redundant cues

Previous research suggests disruption of activity in the prelimbic (PL) cortex produces deficits in tasks requiring preferential attention toward cues that are good predictors of an event. By manipulating cue predictive power, we clarify this role using Pavlovian conditioning. Experiment 1a showed pretraining excitotoxic lesions of the PL cortex disrupted the ability of animals to distribute attention across stimuli conditioned in compound. Experiment 1b demonstrated that these lesions did not affect the ability to block learning about a stimulus when it was presented simultaneously with another stimulus that was previously paired with the outcome. However, in a subsequent test, PL-lesioned animals learnt about this blocked cue faster than sham-lesioned animals when this stimulus alone was paired with reinforcement, suggesting these animals did not down-regulate attention toward the redundant cue during blocking. Experiment 2 tested this hypothesis using an unblocking procedure designed to explicitly reveal a down-regulation of attention during blocking. In this, sham-lesioned animals were shown to down-regulate attention during blocking. PL-lesioned animals did not exhibit this effect. We propose that observed deficits are the result of a specific deficit in down-regulating attention toward redundant cues, indicating the disruption of an attentional process described in Mackintosh's (Mackintosh NJ. 1975. Psychol Review. 82:276) attentional theory.

A role for HGF/SF in neural induction and its expression in Hensen's node during gastrulation

It was previously shown (Roberts, C., Platt, N., Streit, A., Schachner, M. and Stern, C. D. (1991) Development 112, 959–970) that grafts of Hensen's node into chick embryos enhanced and maintain expression of the L5 carbohydrate in neighbouring epiblast cells, and that antibodies against L5 inhibit neural induction by such a graft. We now show that L5 is initially widely expressed in the epiblast, but as neural induction proceeds it gradually becomes confined to and up-regulated in the early neural plate. L5 can therefore be considered as a marker for cells that are competent to respond to neural induction. We also show that Hepatocyte Growth Factor/Scatter Factor (HGF/SF) promotes the expression of L5 by extraembryonic epiblast in collagen gels after overnight culture. Explants cultured for several days in the presence of HGF/SF, as well as explants of prospective neural plate, can differentiate into cells with neuronal morphology expressing neuronal markers. To investigate whether HGF/SF is expressed in the chick embryo at appropriate stages of development, we produced specific cDNA probes and used them for in situ hybridization. We find that at the primitive streak stage, HGF/SF is expressed specifically in Hensen's node. We therefore propose that HGF/SF plays a role during the early steps of neural induction, perhaps by inducing or maintaining the competence of the epiblast to respond to neural inducing signals.

Expression of HGF/SF, HGF1/MSP, and c-met suggests new functions during early chick development

We report the cloning of fulllength cDNAs for a plasminogen-related growth factor, hepatocyte growth factor/scatter factor (HGF/SF), its tyrosine kinase receptor, c-met, and a close member of the same family, hepatocyte growth factor-like/macrophage stimulating protein (HGF1/MSP), from the chick. We have used these cDNAs to provide the first report of the expression of this family of growth factors and the c-met receptor at early stages of vertebrate development. RNAase protection and wholemount in situ hybridization were used on chick embryos between formation of the primitive streak and early organogenesis. We find patterns of expression for HGF/SF and its receptor c-met consistent with their known roles in epithelial-mesenchymal transformation and angiogenesis. In addition, these genes and HGF1/MSP are expressed in discrete locations within developing somites, suggesting a role in paraxial mesodermal development. Very strong and early expression of HGF/SF in the elevating limb buds suggests its involvement in limb outgrowth. HGF1/MSP is expressed in the notochord and then in the prospective floor plate region and could play a role in development of the neural tube. Interestingly, c-met is often more closely associated with HGF1/MSP than with its known ligand, HGF/SF, raising the possibility that c-met expression may be induced by HGF1/MSP.

Somatic hypermutation of immunoglobulin kappa may depend on sequences 3′ of C kappa and occurs on passenger transgenes

We have compared the pattern of somatic mutation in different immunoglobulin kappa transgenes and suggest that an element(s) located between 1 kb and 9 kb 3' of C kappa is necessary for somatic hypermutation of the antibody V gene. The sequences of transgenic and endogenous Ig V regions were determined in antigen-specific B cell hybridomas specific for 2-phenyloxazolone from independent lines of hyperimmunized transgenic mice. We analysed somatic mutation of the transgene both in hybridomas in which the transgenic kappa chain contributes to the antigen combining site as well as in hybridomas in which the transgene is a passenger with the expressed antibody being composed of endogenously-encoded heavy and light chains. In both cases, nucleotide changes in the transgene are correctly targeted to the V region and are absent from the C region. They accumulate at a similar rate to that in the endogenous Ig genes within the same cell and we find that, irrespective of whether or not the transgene kappa is directly selected by antigen, somatic mutation occurs at a similar rate and involves only single base substitutions. Furthermore, the pattern of mutations in passenger transgenes gives information about the intrinsic sequence specificities of the somatic hypermutation mechanism.

The importance of the 3'-enhancer region in immunoglobulin kappa gene expression

The first enhancers to be identified in the immunoglobulin gene loci are located in the J-C intron. However, deletion of the immunoglobulin kappa intron-enhancer has little effect on the transcription of kappa transgenes. Here we ask whether the second kappa enhancer which we recently identified at the 3'-end of the locus plays a role in kappa gene expression. We show that its omission leads to 20-40 fold lower expression of kappa transgenes and to poor allelic exclusion. Transfection experiments show that activity of the 3'-enhancer, like that of the kappa-intron enhancer, can be induced in a pre-B cell line by incubation with bacterial lipopolysaccharide. Whereas induction of the kappa-intron enhancer is due to induction of NF-kappa B activity, deletion mapping of the 3'-enhancer localises its activity to a 50 nucleotide region that lacks an NF-kappa B site; indeed the 3'-enhancer allows kappa expression in a cell line which lacks NF-kappa B. Thus, both the 3'- and intron-enhancers can be induced at the same stage of differentiation but by distinct pathways. Furthermore, unlike the intron-enhancer, the 3'-enhancer plays a critical role in the transcription of rearranged immunoglobulin kappa genes.

Lack of somatic mutation in a kappa light chain transgene

Analysis of mice transgenic for immunoglobulin genes should allow definition of the cis-acting DNA sequences required to target somatic mutation to antibody V genes. We have looked for mutations in a chimeric kappa transgene encoding a V region specific for the hapten 2-phenyloxazolone (phOx) linked to a rat C kappa gene. Two independent lines of transgenic mice were hyperimmunized with phOx and splenic hybridomas established. In B cells that had been selected by antigen and which used mouse anti-phOx genes, the endogenous sequences were found to be mutated whereas the transgene remained unchanged. These results suggest either that (a) if the transgene is a "passenger" gene expressed at a low level, transgene mutation is a rare event, or that (b) sequences far from the kappa coding region are necessary to direct somatic mutation.

Cellular selection leads to age-dependent and reversible down-regulation of transgenic immunoglobulin light chain genes

Analysis of immunoglobulin expression in mice transgenic for either a kappa light chain (driven by the kappa enhancer) or lambda light chain (driven by the IgH enhancer) revealed that the transgenic light chains are expressed by the majority of B lymphocytes in the neonatal mice. However, the proportion of B cells that express the transgenes at a detectable level decreases rapidly with age, with a concomitant increase in cells expressing rearrangements of one of the endogenous light chain loci. This appears to be the result of cellular selection. The down-regulation of transgene expression is not due to an irreversible mechanism as incubation of adult splenic lymphocytes with bacterial lipopolysaccharide leads to a rapid increase in the expression of the transgenic light chain on the B cell surface. In mice carrying the lambda transgene (but not in mice carrying the kappa transgene) the change with age in the pattern of transgene expression is accompanied by a shift towards B cells that do not express surface IgD. This shift towards IgM+/IgDlow B cells is also observed in mice transgenic for a chloramphenicol acetyltransferase gene linked to the IgH enhancer. This suggests that the down-regulation of IgD may either be due to the expression of a transgene that impairs B cell development or, alternatively, could be associated with the molecular events responsible for the down-regulation of IgH enhancer activity. The results also draw attention to the contribution of cellular selection in determining the pattern of expression of immunoglobulin transgenes and emphasize the importance of in vivo analysis of neonatal as well as adult transgenic mice.

Double-blind evaluation of nebulized cromolyn, terbutaline, and the combination for childhood asthma

To evaluate whether the potency of a long-acting selective beta 2-agonist negates the need for cromolyn, 27 children, aged 6 to 12 years, with mild to moderate asthma requiring long-term medication, were assessed for the therapeutic effects of cromolyn and/or terbutaline by jet nebulizer. Patients received either cromolyn, 20 mg, terbutaline, 0.1 mg/kg up to 4 mg, or the combination, three times daily. The study design was double-blind, crossover with each patient receiving the three treatment regimens in randomized order for a period of 8 weeks each. Daily diary mean scores generally demonstrated best symptom control with cromolyn or the combination than with terbutaline alone. Cough was significantly less with cromolyn than with terbutaline (p less than 0.05). Morning peak flow measures were higher with combination therapy than with terbutaline (p less than 0.05). Evening peak flow measures were higher with the combination and cromolyn alone than with terbutaline alone (p less than 0.01). Methacholine challenge demonstrated less bronchial hyperreactivity with the combination or cromolyn alone than with terbutaline alone (p less than 0.02). The effectiveness of the nebulizer regimen for children with chronic asthma is better when cromolyn is used alone or in combination with terbutaline than when the beta-agonist is used alone.

Changes in the level of acetylcholinesterase of nematospiroides dubius and Trichostrongylus colubriformis following paralysis by levamisole in vivo

Acetylcholinesterase (acetylcholine acetylhydrolase; EC 3.1.1.7) levels of Nematospiroides dubius from laboratory mice and Trichostrongylus colubriformis from lambs have been measured. The anthelmintic levamisole (leavo isomer of 2,3,5,6-tetrahydro-6-phenylimidazo-(2,1b)-thiazole (Tetramizole)) did not affect the level of acetylcholinesterase in N. dubius in vivo but caused a reduction in the level of the enzyme in T. colubriformis following paralysis in vivo. The effect of levamisole on acetylcholinesterase in the nematodes is explained in terms of the differing roles of the enzyme in these two species.

Changes in the adenylate energy charge of Nematospiroides dubius and Trichostrongylus colubriformis paralysed by levamisole in vivo

The adenine nucleotide content and adenylate energy charge of Nematospiroides dubius from laboratory mice and of Trichostrongylus colubriformis from lambs has been measured. Administration of the anthelmintic, levamisole, to infected hosts resulted in only a slight fall in the adenylate energy charge of N. dubius over a 3-h period but there was a greater fall in the adenylate energy charge of T. colubriformis during this period. In neither case did the energy charge fall quickly, nor did it fall to the low levels which would be expected if the levamisole were inhibiting synthesis of ATP. The changes in energy charge of the nematodes which occurred following administration of levamisole to their hosts was of the order which can be satisfactorily explained by changes in the environment of the nematodes, such as reduced oxygen tension. It is concluded that the maintenance of levamisole-induced paralysis of these two species of trichostrongyle in vivo does not rely on the inhibition of fumarate reductase.

Changes in the adenylate energy charge of Nippostrongylus brasiliensis and Nematodirus battus during the development of immunity to these nematodes in their host

Infection of rats with 2000 infective juveniles of Nippostrongylus brasiliensis and of lambs with 60 000 infective juveniles of Nematodirus battus results in a well-marked immunity to these nematodes in their respective host. There is a fall in the adenylate energy charge value of these nematodes during the course of these infections, reaching values of 0.37 in males and 0.27 in females of N. brasiliensis, and 0.31 in males and 0.23 in females of N. battus towards the end of the infections. In hosts given relatively small numbers of infective juveniles, the values for the nematodes removed from the hosts late in the infection remain at a relatively high level. These results indicate that the immune response of the host may affect the energy status of these nematodes, and this could help to explain their subsequent expulsion from the immune host.