Response to novelty and its rapid habituation in locus coeruleus neurons of the freely exploring rat

Differential effects of cholinergic and noradrenergic neuromodulation on spontaneous cortical network dynamics

Cholinergic and noradrenergic neuromodulation play a key role in determining overall behavioral state by shaping the underlying cortical network dynamics. The effects of these systems on synaptic and intrinsic cellular targets are quite diverse and a comprehensive understanding of how these neuromodulators regulate (spontaneous) cortical network activity has remained elusive. Here, we used multielectrode electrophysiology in vitro to investigate the effect of these neuromodulators on spontaneous network dynamics in acute slices of mouse visual cortex. We found that application of Carbachol (CCh) and Norepinephrine (NE) both enhanced the spontaneous network dynamics by increasing (1) the activity levels, (2) the temporal complexity of the network activity, and (3) the spatial complexity by decorrelating the network activity over a wide range of neuromodulator concentrations (1 μM, 10 μM, 50 μM, and 100 μM). Interestingly, we found that cholinergic neuromodulation was limited to the presence of CCh in the bath whereas the effects of NE, in particular for higher concentrations, induced plasticity that caused outlasting effects most prominently in the deep cortical layers. Together, these results provide a comprehensive network-level understanding of the similarities and differences of cholinergic and noradrenergic modulation of spontaneous network dynamics.

A neurorobotic platform to test the influence of neuromodulatory signaling on anxious and curious behavior

The vertebrate neuromodulatory systems are critical for appropriate value-laden responses to environmental challenges. Whereas changes in the overall level of dopamine (DA) have an effect on the organism's reward or curiosity-seeking behavior, changes in the level of serotonin (5-HT) can affect its level of anxiety or harm aversion. Moreover, top-down signals from frontal cortex can exert cognitive control on these neuromodulatory systems. The cholinergic (ACh) and noradrenergic (NE) systems affect the ability to filter out noise and irrelevant events. We introduce a neural network for action selection that is based on these principles of neuromodulatory systems. The algorithm tested the hypothesis that high levels of serotonin lead to withdrawn behavior by suppressing DA action and that high levels of DA or low levels of 5-HT lead to curious, exploratory behavior. Furthermore, the algorithm tested the idea that top-down signals from the frontal cortex to neuromodulatory areas are critical for an organism to cope with both stressful and novel events. The neural network was implemented on an autonomous robot and tested in an open-field paradigm. The open-field test is often used to test for models anxiety or exploratory behavior in the rodent and allows for qualitative comparisons with the neurorobot's behavior. The present neurorobotic experiments can lead to a better understanding of how neuromodulatory signaling affects the balance between anxious and curious behavior. Therefore, this experimental paradigm may also be informative in exploring a wide range of neurological diseases such as anxiety, autism, attention deficit disorders, and obsessive-compulsive disorders.

Synaptic depression in the CA1 region of freely behaving mice is highly dependent on afferent stimulation parameters

Persistent synaptic plasticity has been subjected to intense study in the decades since it was first described. Occurring in the form of long-term potentiation (LTP) and long-term depression (LTD), it shares many cellular and molecular properties with hippocampus-dependent forms of persistent memory. Recent reports of both LTP and LTD occurring endogenously under specific learning conditions provide further support that these forms of synaptic plasticity may comprise the cellular correlates of memory. Most studies of synaptic plasticity are performed using in vitro or in vivo preparations where patterned electrical stimulation of afferent fibers is implemented to induce changes in synaptic strength. This strategy has proven very effective in inducing LTP, even under in vivo conditions. LTD in vivo has proven more elusive: although LTD occurs endogenously under specific learning conditions in both rats and mice, its induction has not been successfully demonstrated with afferent electrical stimulation alone. In this study we screened a large spectrum of protocols that are known to induce LTD either in hippocampal slices or in the intact rat hippocampus, to clarify if LTD can be induced by sole afferent stimulation in the mouse CA1 region in vivo. Low frequency stimulation at 1, 2, 3, 5, 7, or 10 Hz given in the range of 100 through 1800 pulses produced, at best, short-term depression (STD) that lasted for up to 60 min. Varying the administration pattern of the stimuli (e.g., 900 pulses given twice at 5 min intervals), or changing the stimulation intensity did not improve the persistency of synaptic depression. LTD that lasts for at least 24 h occurs under learning conditions in mice. We conclude that a coincidence of factors, such as afferent activity together with neuromodulatory inputs, play a decisive role in the enablement of LTD under more naturalistic (e.g., learning) conditions.

Orienting and reorienting: the locus coeruleus mediates cognition through arousal

Mood, motivation, attention, and arousal are behavioral states having a profound impact on cognition. Behavioral states are mediated though the peripheral nervous system and neuromodulatory systems in the brainstem. The noradrenergic nucleus locus coeruleus is activated in parallel with the autonomic system in response to biological imperatives. These responses can be spontaneous, to unexpected salient or threatening stimuli, or they can be conditioned responses to awaited behaviorally relevant stimuli. Noradrenaline, released in forebrain structures, will facilitate sensory processing, enhance cognitive flexibility and executive function in the frontal cortex, and promote offline memory consolidation in limbic structures. Central activation of neuromodulatory neurons and peripheral arousal, together, prepare the organism for a reorientation or reset of cortical networks and an adaptive behavioral response.

Norepinephrine: a neuromodulator that boosts the function of multiple cell types to optimize CNS performance

Norepinephrine (NE) is a neuromodulator that in multiple ways regulates the activity of neuronal and non-neuronal cells. NE participates in the rapid modulation of cortical circuits and cellular energy metabolism, and on a slower time scale in neuroplasticity and inflammation. Of the multiple sources of NE in the brain, the locus coeruleus (LC) plays a major role in noradrenergic signaling. Processes from the LC primarily release NE over widespread brain regions via non-junctional varicosities. We here review the actions of NE in astrocytes, microglial cells, and neurons based on the idea that the overarching effect of signaling from the LC is to maximize brain power, which is accomplished via an orchestrated cellular response involving most, if not all cell types in CNS.

Learning-facilitated long-term depression and long-term potentiation at mossy fiber-CA3 synapses requires activation of β-adrenergic receptors

Learning-facilitated plasticity refers to hippocampal synaptic plasticity that is facilitated by novel spatial learning events. Both long-term potentiation (LTP) and long-term depression (LTD) are facilitated by novel hippocampus-dependent learning. This has important ramifications for our understanding of how the hippocampus encodes memory. One structure that is rarely studied in vivo, but is believed to be crucially important for working and long-term memory processing is the hippocampal CA3 region. Whereas learning-facilitated plasticity has been described in this structure, the mechanisms underlying this phenomenon have not been explored. The noradrenergic system plays an important role in arousal and qualification of new information as salient. It regulates synaptic plasticity in the dentate gyrus and CA1, but nothing is known about the regulation by the noradrenergic system of synaptic plasticity in the CA3 region. We explored whether β-adrenergic receptors contribute to learning-facilitated plasticity at mossy fiber (mf)-CA3 synapses of behaving rats. We found that receptor antagonism had no effect on basal synaptic transmission, short-term potentiation (STP), short-term depression, LTP, or LTD, that were electrically induced by patterned afferent stimulation. We found, however, that both learning-facilitated LTP and LTD were prevented by antagonism of β-adrenergic receptors, whereas the agonist isoproterenol facilitated STP into LTP. Thus, learning-facilitated and electrically-induced plasticity may not share the same prerequisites. These results support that the mf synapse engages in a distinct aspect of encoding of spatial information that involves both LTP and LTD. Furthermore, changes in arousal that are coupled to new learning are associated with activation of hippocampal β-adrenergic receptors that in turn comprise a key element in this type of information acquisition and processing by the CA3 region.

Simulation of cholinergic and noradrenergic modulation of behavior in uncertain environments

Attention is a complex neurobiological process that involves rapidly and flexibly balancing sensory input and goal-directed predictions in response to environmental changes. The cholinergic and noradrenergic systems, which have been proposed to respond to expected and unexpected environmental uncertainty, respectively, play an important role in attention by differentially modulating activity in a multitude of cortical targets. Here we develop a model of an attention task that involves expected and unexpected uncertainty. The cholinergic and noradrenergic systems track this uncertainty and, in turn, influence cortical processing in five different, experimentally verified ways: (1) nicotinic enhancement of thalamocortical input, (2) muscarinic regulation of corticocortical feedback, (3) noradrenergic mediation of a network reset, (4) locus coeruleus (LC) activation of the basal forebrain (BF), and (5) cholinergic and noradrenergic balance between sensory input and frontal cortex predictions. Our results shed light on how the noradrenergic and cholinergic systems interact with each other and a distributed set of neural areas, and how this could lead to behavioral adaptation in the face of uncertainty.

Dopamine D1/D5 receptors contribute to de novo hippocampal LTD mediated by novel spatial exploration or locus coeruleus activity

The neurons of the locus coeruleus (LC) fire in response to novelty, and LC activation coupled with hippocampal afferent stimulation leads to long-term depression (LTD). The encoding of novel spatial information also involves activation of dopamine D1/D5 receptors. It is unclear if, or how, the noradrenergic and dopaminergic systems interact mechanistically in processing novelty. Novel spatial exploration when coupled with Schaffer collateral (SC) test-pulse stimulation results in short-term depression at SC-CA1 synapses, which is not observed in the absence of afferent stimulation. However, activation of D1/D5 receptors under these conditions without concomitant afferent stimulation enables slow-onset depression. LTD (>24 h) is facilitated when novel exploration occurs concurrently with low-frequency stimulation of CA1. Effects are not improved by a D1/D5 agonist. Facilitation of LTD (>4 h) by coupling LC stimulation with CA1 test-pulse stimulation was blocked by a D1/D5 antagonist, however, as was habituation to the holeboard environment. Novel spatial learning during LC stimulation did not enhance LTD further, whereas D1/D5 agonist treatment enabled LTD to persist for over 24 h. These data suggest that the regulation of hippocampal LTD by the LC is supported by D1/D5 receptors and that their contribution to information storage becomes important when the thresholds for persistent LTD have not been reached.

Developmental changes in pacemaker currents in mouse locus coeruleus neurons

The present study compares the electrophysiological properties and the primary pacemaker currents that flow during the interspike interval in locus coeruleus (LC) neurons from infant (P7-12 days) and young adult (8-12 weeks) mice. The magnitude of the primary pacemaker currents, which consist of an excitatory TTX-sensitive Na(+) current and an inhibitory voltage-dependent K(+) current, increased in parallel during development. We found no evidence for the involvement of hyperpolarization-activated (I(H)) or Ca(2+) currents in pacemaking in infant or adult LC neurons. The incidence of TTX-resistant spikes, observed during current clamp recordings, was greater in adult neurons. Neurons from adult animals also showed an increase in voltage fluctuations, during the interspike interval, as revealed in the presence of the K(+) channel blocker, 4-AP (1mM). In summary, our results suggest that mouse LC neurons undergo changes in basic electrophysiological properties during development that influence pacemaking and hence spontaneous firing in LC neurons.

Neuroplasticity regulation by noradrenaline in mammalian brain

The neuromodulator noradrenaline (NA) is released in almost all brain areas in a highly diffused manner. Its action is slow, as it acts through G protein-coupled receptors, but its wide release in the brain makes NA a crucial regulator for various fundamental brain functions such as arousal, attention and memory processes [102]. To understand how NA acts in the brain to promote such diverse actions, it is necessary to dissect the cellular actions of NA at the level of single neurons as well as at the level of neuronal networks. In the present article, we will provide a compact review of the main literatures concerning the NA actions on neuroplasticity processes. Depending on which subtype of adrenoceptor is activated, NA differently affects intrinsic membrane properties of postsynaptic neurons and synaptic plasticity. For example, beta-adrenoceptor activation is mainly related to the potentiation of synaptic responses and learning and memory processes. alpha2-adrenoceptor activation may contribute to a high-order information processing such as executive function, but currently the direction of synaptic plasticity modification by alpha2-adrenoceptors has not been clearly determined. The activation of alpha1-adrenoceptors appears to mainly induce synaptic depression in the brain. But its physiological roles are still unclear: while its activation has been described as beneficial for cognitive functions, it may also exert detrimental effects in some brain structures such as the prefrontal cortex.

Electromagnetic field effect or simply stress? Effects of UMTS exposure on hippocampal longterm plasticity in the context of procedure related hormone release

Harmful effects of electromagnetic fields (EMF) on cognitive and behavioural features of humans and rodents have been controversially discussed and raised persistent concern about adverse effects of EMF on general brain functions. In the present study we applied radio-frequency (RF) signals of the Universal Mobile Telecommunications System (UMTS) to full brain exposed male Wistar rats in order to elaborate putative influences on stress hormone release (corticosteron; CORT and adrenocorticotropic hormone; ACTH) and on hippocampal derived synaptic long-term plasticity (LTP) and depression (LTD) as electrophysiological hallmarks for memory storage and memory consolidation. Exposure was computer controlled providing blind conditions. Nominal brain-averaged specific absorption rates (SAR) as a measure of applied mass-related dissipated RF power were 0, 2, and 10 W/kg over a period of 120 min. Comparison of cage exposed animals revealed, regardless of EMF exposure, significantly increased CORT and ACTH levels which corresponded with generally decreased field potential slopes and amplitudes in hippocampal LTP and LTD. Animals following SAR exposure of 2 W/kg (averaged over the whole brain of 2.3 g tissue mass) did not differ from the sham-exposed group in LTP and LTD experiments. In contrast, a significant reduction in LTP and LTD was observed at the high power rate of SAR (10 W/kg). The results demonstrate that a rate of 2 W/kg displays no adverse impact on LTP and LTD, while 10 W/kg leads to significant effects on the electrophysiological parameters, which can be clearly distinguished from the stress derived background. Our findings suggest that UMTS exposure with SAR in the range of 2 W/kg is not harmful to critical markers for memory storage and memory consolidation, however, an influence of UMTS at high energy absorption rates (10 W/kg) cannot be excluded.

Nonlinear effects of noradrenergic modulation of olfactory bulb function in adult rodents

The mammalian main olfactory bulb receives a significant noradrenergic input from the locus coeruleus. Norepinephrine (NE) is involved in acquisition of conditioned odor preferences in neonatal animals, in some species-specific odor-dependent behaviors, and in adult odor perception. We provide a detailed review of the functional role of NE in adult rodent main olfactory bulb function. We include cellular, synaptic, network, and behavioral data and use computational simulations to tie these different types of data together.

Functional division of hippocampal area CA1 via modulatory gating of entorhinal cortical inputs

The hippocampus receives two streams of information, spatial and nonspatial, via major afferent inputs from the medial (MEC) and lateral entorhinal cortexes (LEC). The MEC and LEC projections in the temporoammonic pathway are topographically organized along the transverse-axis of area CA1. The potential for functional segregation of area CA1, however, remains relatively unexplored. Here, we demonstrated differential novelty-induced c-Fos expression along the transverse-axis of area CA1 corresponding to topographic projections of MEC and LEC inputs. We found that, while novel place exposure induced a uniform c-Fos expression along the transverse-axis of area CA1, novel object exposure primarily activated the distal half of CA1 neurons. In hippocampal slices, we observed distinct presynaptic properties between LEC and MEC terminals, and application of either DA or NE produced a largely selective influence on one set of inputs (LEC). Finally, we demonstrated that differential c-Fos expression along the transverse axis of area CA1 was largely abolished by an antagonist of neuromodulatory receptors, clozapine. Our results suggest that neuromodulators can control topographic TA projections allowing the hippocampus to differentially encode new information along the transverse axis of area CA1.

Locus ceruleus and anterior cingulate cortex sustain wakefulness in a novel environment

Locus ceruleus (LC) neuronal activity is correlated with the waking state, yet LC lesions produce only minor alterations in daily wakefulness. Here, we report that sustained elevations in neurobehavioral and EEG arousal in response to exposure to an environment with novel stimuli, including social interaction, are prevented by selective chemical lesions of the LC in rats. Similar results are seen when the anterior cingulate cortex (ACC), which receives especially dense LC innervation, is selectively denervated of LC input or is ablated by the cell-specific neurotoxin ibotenic acid. Anterograde tracing combined with tyrosine hydroxylase immunohistochemistry demonstrates ACC terminals in apposition with the distal dendrites of LC neurons. Our data implicate the ACC as both a source of input to the LC as well as one of its targets and suggests that the two structures engage in a dialog that may provide a critical neurobiological substrate for sustained attention.

The neurobiology of infant maternal odor learning

Infant rats must learn to identify their mother's diet-dependent odor. Once learned, maternal odor controls pups' approach to the mother, their social behavior and nipple attachment. Here we present a review of the research from four different laboratories, which suggests that neural and behavioral responses to the natural maternal odor and neonatal learned odors are similar. Together, these data indicate that pups have a unique learning circuit relying on the olfactory bulb for neural plasticity and on the hyperfunctioning noradrenergic locus coeruleus flooding the olfactory bulb with norepinephrine to support the neural changes. Another important factor making this system unique is the inability of the amygdala to become incorporated into the infant learning circuit. Thus, infant rats appear to be primed in early life to learn odors that will evoke approach responses supporting attachment to the caregiver.

Noradrenaline release in the locus coeruleus modulates memory formation and consolidation; roles for α- and β-adrenergic receptors

Noradrenaline, essential for the modulation of memory, is released in various parts of the brain from nerve terminals controlled by the locus coeruleus (LoC). Noradrenaline release consequent upon input from higher brain areas also occurs within the LoC itself. We examined the effect of noradrenaline on adrenergic receptors in the LoC on memory processing, using colored bead discrimination learning in the young domestic chick. We have shown previously that the release of noradrenaline in the hippocampus and cortex (mesopallium) is essential for acquisition and consolidation of short-term to intermediate and to long-term memory. Noradrenaline release within the LoC is triggered by the glutamatergic input from the forebrain. Inhibition by LoC injection of NMDA or AMPA receptor antagonists is rescued by injection of β2-and β3-adrenoceptor (AR) agonists in the hippocampus. We show that inhibition of α2A-ARs by BRL44408 in the LoC up to 30 min post-training consolidates weakly-reinforced learning. Conversely activation of α2A-ARs in the LoC at the times of consolidation between short-term and intermediate and long-term memory caused memory loss, which is likely to be due to a decreased release of noradrenaline within these two time windows. The α2A-AR antagonist will block presynaptic inhibitory receptors leading to an increase in extracellular noradrenaline. This interpretation is supported by the actions of noradrenaline uptake blockers that produce the same memory outcome. BRL44408 in the mesopallium also caused memory enhancement. β2-ARs are important in the first time window, whereas α1-, α2C-and β3-ARs are important in the second time window. The results reveal that for successful memory formation noradrenaline release is necessary within the LoC as well as in other brain regions, at the time of consolidation of memory from short-term to intermediate and from intermediate to long-term memory.

A cortical sparse distributed coding model linking mini- and macrocolumn-scale functionality

No generic function for the minicolumn – i.e., one that would apply equally well to all cortical areas and species – has yet been proposed. I propose that the minicolumn does have a generic functionality, which only becomes clear when seen in the context of the function of the higher-level, subsuming unit, the macrocolumn. I propose that: (a) a macrocolumn's function is to store sparse distributed representations of its inputs and to be a recognizer of those inputs; and (b) the generic function of the minicolumn is to enforce macrocolumnar code sparseness. The minicolumn, defined here as a physically localized pool of ∼20 L2/3 pyramidals, does this by acting as a winner-take-all (WTA) competitive module, implying that macrocolumnar codes consist of ∼70 active L2/3 cells, assuming ∼70 minicolumns per macrocolumn. I describe an algorithm for activating these codes during both learning and retrievals, which causes more similar inputs to map to more highly intersecting codes, a property which yields ultra-fast (immediate, first-shot) storage and retrieval. The algorithm achieves this by adding an amount of randomness (noise) into the code selection process, which is inversely proportional to an input's familiarity. I propose a possible mapping of the algorithm onto cortical circuitry, and adduce evidence for a neuromodulatory implementation of this familiarity-contingent noise mechanism. The model is distinguished from other recent columnar cortical circuit models in proposing a generic minicolumnar function in which a group of cells within the minicolumn, the L2/3 pyramidals, compete (WTA) to be part of the sparse distributed macrocolumnar code.

The Attentional Boost Effect: Transient increases in attention to one task enhance performance in a second task

Recent work on event perception suggests that perceptual processing increases when events change. An important question is how such changes influence the way other information is processed, particularly during dual-task performance. In this study, participants monitored a long series of distractor items for an occasional target as they simultaneously encoded unrelated background scenes. The appearance of an occasional target could have two opposite effects on the secondary task: It could draw attention away from the second task, or, as a change in the ongoing event, it could improve secondary task performance. Results were consistent with the second possibility. Memory for scenes presented simultaneously with the targets was better than memory for scenes that preceded or followed the targets. This effect was observed when the primary detection task involved visual feature oddball detection, auditory oddball detection, and visual color-shape conjunction detection. It was eliminated when the detection task was omitted, and when it required an arbitrary response mapping. The appearance of occasional, task-relevant events appears to trigger a temporal orienting response that facilitates processing of concurrently attended information (Attentional Boost Effect).

Dynamics of attentional selection under conflict: toward a rational Bayesian account

The brain exhibits remarkable facility in exerting attentional control in most circumstances, but it also suffers apparent limitations in others. The authors' goal is to construct a rational account for why attentional control appears suboptimal under conditions of conflict and what this implies about the underlying computational principles. The formal framework used is based on Bayesian probability theory, which provides a convenient language for delineating the rationale and dynamics of attentional selection. The authors illustrate these issues with the Eriksen flanker task, a classical paradigm that explores the effects of competing sensory inputs on response tendencies. The authors show how 2 distinctly formulated models, based on compatibility bias and spatial uncertainty principles, can account for the behavioral data. They also suggest novel experiments that may differentiate these models. In addition, they elaborate a simplified model that approximates optimal computation and may map more directly onto the underlying neural machinery. This approximate model uses conflict monitoring, putatively mediated by the anterior cingulate cortex, as a proxy for compatibility representation. The authors also consider how this conflict information might be disseminated and used to control processing.

Locus coeruleus activation facilitates memory encoding and induces hippocampal LTD that depends on beta-adrenergic receptor activation

Spatial memory formation is enabled through synaptic information processing, in the form of persistent strengthening and weakening of synapses, within the hippocampus. It is, however, unclear how relevant spatial information is selected for encoding, in preference to less pertinent information. As the noradrenergic locus coeruleus (LC) becomes active in response to novel experiences, we hypothesized that the LC may provide the saliency signal required to promote hippocampal encoding of relevant information through changes in synaptic strength. Test pulse stimulation evoked stable basal synaptic transmission at Schaffer collateral (SC)-CA1 stratum radiatum synapses in freely behaving adult rats. Coupling of these test pulses with electrical stimulation of the LC induced long-term depression (LTD) at SC-CA1 synapses and induced a transient suppression of theta-frequency oscillations. Effects were N-methyl-D-aspartate and beta-adrenergic receptor dependent. Activation of the LC also increased CA1 noradrenalin levels and facilitated the encoding of spatial memory for a single episode via a beta-adrenoceptor-dependent mechanism. Our results demonstrate that the LC plays a key role in the induction of hippocampal LTD and in promoting the encoding of spatial information. This LC-hippocampal interaction may reflect a means by which salient information is distinguished for subsequent synaptic processing.

Origins of altered reinforcement effects in ADHD

Attention-deficit/hyperactivity disorder (ADHD), characterized by hyperactivity, impulsiveness and deficient sustained attention, is one of the most common and persistent behavioral disorders of childhood. ADHD is associated with catecholamine dysfunction. The catecholamines are important for response selection and memory formation, and dopamine in particular is important for reinforcement of successful behavior. The convergence of dopaminergic mesolimbic and glutamatergic corticostriatal synapses upon individual neostriatal neurons provides a favorable substrate for a three-factor synaptic modification rule underlying acquisition of associations between stimuli in a particular context, responses, and reinforcers. The change in associative strength as a function of delay between key stimuli or responses, and reinforcement, is known as the delay of reinforcement gradient. The gradient is altered by vicissitudes of attention, intrusions of irrelevant events, lapses of memory, and fluctuations in dopamine function. Theoretical and experimental analyses of these moderating factors will help to determine just how reinforcement processes are altered in ADHD. Such analyses can only help to improve treatment strategies for ADHD.

Novelty determines the effects of olfactory enrichment on memory and neurogenesis through noradrenergic mechanisms

Commonly used experimental paradigms of environmental enrichment combine increased social interactions and sensory inputs and renewal of the objects present in the environment. However, the specific contribution of novelty to the effects of enrichment is unclear. Here, we show that repeated daily exposure to single novel odorants and not to an enriched but stable olfactory environment improves short-term olfactory memory and neurogenesis in the mouse olfactory bulb. In addition, these positive effects are mediated by noradrenalin as they are blocked by a noradrenergic receptor antagonist. These data suggest that novelty recognition and noradrenergic mechanisms are crucial in mediating neural plasticity induced by olfactory enrichment.

Relation of locus coeruleus neurons in monkeys to Pavlovian and operant behaviors

Noradrenaline is released throughout the forebrain from locus coeruleus (LC) projections in close temporal proximity to emotional and goal-directed events. To examine interactive influences of these processes on LC neuronal activity, we used a task where Pavlovian and operant processes vary and can be easily identified. We recorded 69 single LC neurons from two monkeys performing a task where cues indicate the progression through schedules of one, two, or three operant trials. Pavlovian responses and phasic LC activations occur following the appearance of conditioned visual cues (54/69 neurons), especially those at the beginning of new schedules, whether the current trial will be rewarded (single trial schedule) or not (2 or 3 trial schedules), and after visual imperative signals eliciting the operant response (64/69 neurons), whether the current trial will be rewarded or not. The modulation of LC responses seems to be relatively independent of attention or motivation, because the responses do not covary with operant performance in the task. The magnitude of LC responses across the schedules varied in close relation to the intensity of Pavlovian behavior but these responses were also modulated by operant processes. Our conclusion is that LC activation occurs when task-relevant stimuli evoke a conditioned instinctive (Pavlovian) response, with the strength of the activation also being modulated by goal-directed processes. Thus locus coeruleus neurons broadcast information about stimulus-elicited primitive and goal-directed behaviors to forebrain structures important for executive functions and emotions.

Olfaction as a model system for the neurobiology of mammalian short-term habituation

Olfaction represents an ideal model system for the study of mammalian habituation given that it is an anatomically relatively simple system with strong reciprocal connections to the limbic system, driving both reflexive and non-reflexive (motivated) behaviors that are easily quantifiable. Data are reviewed here demonstrating short-term habituation of the odor-evoked heart-rate orienting reflex described according to the criteria for habituation outlined by Thompson and Spencer [Thompson, R. F., & Spencer, W. A. (1966). Habituation: A model phenomenon for the study of neuronal substrates of behavior. Psychological Reviews, 73(1), 16-43]. A necessary and sufficient mechanism of short-term habituation is then described, which involves a metabotropic glutamate receptor mediated depression of afferent input to the piriform (primary olfactory) cortex. Finally, evidence for, and a mechanisms of, dishabituation of the orienting reflex and cortical adaptation are described.

Arousal facilitates collision avoidance mediated by a looming sensitive visual neuron in a flying locust

Locusts have two large collision-detecting neurons, the descending contralateral movement detectors (DCMDs) that signal object approach and trigger evasive glides during flight. We sought to investigate whether vision for action, when the locust is in an aroused state rather than a passive viewer, significantly alters visual processing in this collision-detecting pathway. To do this we used two different approaches to determine how the arousal state of a locust affects the prolonged periods of high-frequency spikes typical of the DCMD response to approaching objects that trigger evasive glides. First, we manipulated arousal state in the locust by applying a brief mechanical stimulation to the hind leg; this type of change of state occurs when gregarious locusts accumulate in high-density swarms. Second, we examined DCMD responses during flight because flight produces a heightened physiological state of arousal in locusts. When arousal was induced by either method we found that the DCMD response recovered from a previously habituated state; that it followed object motion throughout approach; and--most important--that it was significantly more likely to generate the maintained spike frequencies capable of evoking gliding dives even with extremely short intervals (1.8 s) between approaches. Overall, tethered flying locusts responded to 41% of simulated approaching objects (sets of 6 with 1.8 s ISI). When we injected epinastine, the neuronal octopamine receptor antagonist, into the hemolymph responsiveness declined to 12%, suggesting that octopamine plays a significant role in maintaining responsiveness of the DCMD and the locust to visual stimuli during flight.

Novelty-induced behavioral traits correlate with numbers of brainstem noradrenergic neurons and septal cholinergic neurons in C57BL/6J mice

It is generally accepted that different brain regions regulate specific behavioral responses and that structural alterations in these regions may affect behavior. We investigated whether inter-individual variability in novelty-induced behaviors in C57BL/6J mice correlates with numbers of noradrenergic neurons in the locus coeruleus and cholinergic neurons in the septum. We found that exploration of new stimuli correlated negatively with numbers of noradrenergic neurons, whereas anxiety correlated positively with numbers of cholinergic neurons. The observed correlations suggest physiologically plausible links between structure and function and indicate that precise morphological estimates can be predictive for behavioral responses.

-Adrenoreceptors Comprise a Critical Element in Learning-Facilitated Long-Term Plasticity

A novel spatial environment consists of several different types of information that may be encoded by cellular information storage mechanisms such as long-term potentiation (LTP) and long-term depression (LTD). Arousal, mediated, for example, by activation of the noradrenergic system, is a critical factor in information acquisition and may enhance the encoding of novel spatial information. Using electrophysiological recordings of hippocampal responses in freely moving rats during spatial learning, we investigated the role of the beta-adrenoreceptor in Schaeffer collateral-CA1 synaptic plasticity. We found that novel exploration of spatial context facilitates induction of LTD that is inhibited by intracerebroventricular application of the beta-adrenoreceptor antagonist, propranolol. Long-lasting homosynaptic LTD, that was electrically induced by low-frequency stimulation, was unaffected by the antagonist. Although application of a beta-adrenoreceptor agonist (isoproterenol) did not affect electrically induced LTD, agonist application facilitated short-term depression (STD) into LTD and mimicked the augmentation, through spatial exploration, of STD into LTD. Exploration of a novel empty environment facilitated LTP that was prevented by application of propranolol. These results suggest that beta-adrenoreceptors may facilitate encoding of spatial information through synaptic plasticity in the hippocampus and that noradrenaline is a key factor in effective information acquisition.

Repetition and Event-related Potentials: Distinguishing Early and Late Processes in Affective Picture Perception

A repetition paradigm was used to assess the nature of affective modulation of early and late components of the event-related potential (ERP) during picture viewing. High-density ERPs were measured while participants passively viewed affective or neutral pictures that were repeated up to 90 times each. Both ERP components were modulated by emotional arousal, with ERPs elicited when viewing pleasant and unpleasant pictures different than when viewing neutral pictures. On the other hand, repetition had different effects on these two components. The early occipitotemporal component (150–300 msec) primarily showed a decrease in amplitude within a block of repetitions that did not differ as a function of picture content. The late centroparietal component (300–600 msec) showed a decrease both between and within blocks of repetitions, with neutral pictures eliciting no late positive potential in the final block of the study. The data suggest that the early ERP primarily reflects obligatory perceptual processing that is facilitated by active short-term memory representations, whereas the late ERP reflects increased resource allocation due to the motivational relevance of affective cues.

Temporal ontogeny of circuit activation prior to the onset of seizure susceptibility in EL/Suz mice

The EL/Suz (EL) mouse is a model of multifactorial temporal lobe epilepsy in which seizures begin around 90 days of age, but can be hastened through increased exposure to human handling. In order to better understand seizure etiology in this mouse strain relative to seizure-resistant control mice, the present study examined region-specific neuronal activation in response to non-seizure-inducing handling implemented before the onset of seizure susceptibility. Immediate-early gene (cFos) expression emerged in EL mice by postnatal day (PND) 21 in the primary motor cortex, progressed to the locus ceruleus and prefrontal cortex by PND 35, and appeared in the hippocampus and amygdala by PND 70, as mice neared the age of onset for seizure susceptibility. Thus, mirroring the pattern observed during the course of a seizure, specific brain regions were differentially recruited to a neural network for seizure predisposition before the onset of seizure susceptibility. This developmental pattern of early and transient neural activation represents an important window for the study of causal mechanisms of seizure susceptibility following exposure to environmental triggers.

Adrenergic drugs modify the level of noradrenaline in the insular cortex and alter extinction of conditioned taste aversion in rats

We compared the effect of conditioned taste aversion in rats by measuring the amount of sucrose that they drunk after conditioning, which differed according to whether rats had drunk the sucrose freely (SD: self drinking) during the conditioning session, or had been forced to drink it (IO: intra-oral administration through a chronically implanted cannula). The SD procedure delayed the extinction of conditioned taste aversion. Enhanced arousal, alertness, awareness or attention in the SD condition may have strengthened the memory of the taste. Brain noradrenergic networks are involved in such processes. We administered two noradrenergic drugs that produce opposite effects on noradrenaline release in the brain, methoxy-idazoxan, RX821002 (1mg/kg, i.p.), and guanfacine (0.12mg/kg, i.p.). We evaluated their effect (i) on the level of noradrenaline in the gustatory cortex using microdialysis, (ii) on glycaemia that is an essential factor of taste learning and (iii) on the comparative SD versus IO conditioned taste aversion protocol mentioned above. Injecting RX821001 increased the level of noradrenaline in the gustatory cortex up to two-fold of the baseline. This effect lasted 1h. The same dose of RX821002 did not elicit any alteration of glycaemia. It enhanced extinction of conditioned taste aversion in the SD group of rats. Injecting 0.12mg/kg of guanfacine produced the opposite effect. The noradrenaline level of the gustatory cortex decreased, but only down to 20% of the baseline. This decrease lasted 2h. Guanfacine increased glycaemia. Extinction of conditioned taste aversion was only marginally decreased by guanfacine in the SD group of rats. These results fit with Aston-Jones' point of view that the role of the noradrenergic coeruleo-cortical system may be to enhance arousal, alertness, awareness or attention to an event by a transient increase of cortical noradrenaline.

Effects of novelty on activity of lateral and medial prefrontal neurons

Detection of novel events is crucial for adapting to changing environments. The prefrontal cortex has been thought to be one of the areas involved in orienting attention to novel events. Here, we examined the effects of two components of novelty: context novelty, which purely happens when a familiar event occurs in an unpredicted situation or time and feature novelty, which happens by itself when an unfamiliar stimulus appears against the expectation of familiar ones. We trained monkeys on a task that included both novelty components and recorded the activity of neurons in the lateral and medial divisions of the prefrontal cortex. The responses of a substantial number of cells in both the lateral and medial divisions were enhanced when a familiar visual stimulus was presented in an unpredicted context. By contrast, enhancement of responses by the unfamiliarity of visual stimuli was observed mainly in cells in the lateral prefrontal cortex. These results suggest that the lateral and medial divisions of the prefrontal cortex are differentially involved in the control of attention triggered by novel sensory events.

Norepinephrine and the dentate gyrus

Norepinephrine's role in the dentate gyrus is assessed based on a review of what is known about its innervation and receptor patterns and its functional effects at both cellular and behavioral levels. The data support seven hypotheses: (1) Norepinephrine's functional actions are primarily mediated by beta adrenoceptors and include electrophysiological enhancement of responses to excitatory input and glycogenolytic metabolic support of excitatory synaptic activity. (2) At the cellular level, locus coeruleus burst release of norepinephrine transiently inhibits feedforward interneurons and either excites or inhibits subpopulations of feedback interneurons. Consistent with reduced feedforward inhibition, granule cell firing is transiently increased. Concomitant EEG effects include transient increases in theta power and decreases in beta and gamma power. (3) Norepinephrine selectively promotes the processing of medial perforant path spatial input. This effect is mediated both through short- and long-term potentiation of cell excitability and through delayed potentiation of synaptic input. A critical level of norepinephrine release is required for long-term effects to norepinephrine alone. Norepinephrine release switches early phase frequency-induced long-term potentiation of perforant path input to an enduring late phase form and can reinstate decayed long-term potentiation. Norepinephrine also promotes frequency-induced potentiation of granule cell output at the mossy fiber to CA3 connection. (4) Local increases in norepinephrine accompany glutamate release and release of other neurotransmitters providing a mechanism for norepinephrine enhancement effects independent of locus coeruleus firing. (5) Stimuli, such as novelty and reward and punishment, which activate locus coeruleus neurons, enhance responses to medial perforant path input and engage late phase frequency-induced long-term potentiation through beta adrenoceptor activation. (6) Behavioral studies are consistent with the mechanistic evidence for a norepinephrine role in promoting learning and memory and assisting retrieval. (7) The overall profile suggests lower levels of norepinephrine may facilitate pattern completion or memory retrieval while higher levels would recruit global remapping and promote long-term episodic memory.

Phasic norepinephrine: a neural interrupt signal for unexpected events

Extensive animal studies indicate that the neuromodulator norepinephrine plays an important role in specific aspects of vigilance, attention and learning, putatively serving as a neural interrupt or reset function. The activity of norepinephrine-releasing neurons in the locus coeruleus during attentional tasks is modulated not only by the animal's level of engagement and the sensory inputs, but also by temporally rich aspects of internal decision-making processes. Here, we propose that it is unexpected changes in the world within the context of a task that activate the noradrenergic interrupt signal. We quantify this idea in a Bayesian model of a well-studied visual discrimination task, demonstrating that the model captures a rich repertoire of noradrenergic responses at the sub-second temporal resolution.

Idazoxan increases perforant path-evoked EPSP slope paired pulse inhibition and reduces perforant path-evoked population spike paired pulse facilitation in rat dentate gyrus

Norepinephrine, acting via beta-adrenoceptors, enhances the perforant path-evoked potential in dentate gyrus. Using systemic idazoxan to increase norepinephrine, and paired perforant path pulses to probe early inhibition, previous investigators reported that idazoxan increased initial spike amplitude and increased somatic feedback inhibition. Here, feedback inhibition was re-examined in idazoxan-treated (5 mg/kg) rats under urethane anesthesia. To control for initial increased spike amplitude after idazoxan, evoked potentials were matched, pre- and post-idazoxan, on initial population spike. Input-output current profiles were also compared pre- and post-idazoxan. Saline- and timolol-filled micropipettes permitted evaluation of a contribution of local beta-adrenoceptors. As previously observed, initial spike amplitude was potentiated by idazoxan. Comparable spike potentiation was not seen on the timolol micropipette. Paired pulse inhibition of spike amplitude apparently increased, but input-output curve comparisons revealed a loss of feedback facilitation rather than an increase in feedback inhibition. Initial EPSP slopes were depressed after idazoxan in input-output curve data. EPSP slope feedback ratios were significantly reduced following idazoxan. These data suggest idazoxan has multiple effects on perforant path input to the dentate gyrus. Spike potentiation following idazoxan has previously been shown to depend on intact norepinephrine input. Here, the reduction in spike potentiation on the timolol pipette is consistent with other evidence that norepinephrine-mediated potentiation of the perforant path-evoked potential is dependent on local beta-adrenoceptor activation. The input-output data suggest a decrease in feedback facilitation after idazoxan is likely to account for the apparent increase in feedback inhibition previously reported. Decreased EPSP slope ratios with similar paired pulse intervals have been reported in novel environments. Since exposure to novel environments activates locus coeruleus neurons, norepinephrine may mediate the change in EPSP slope inhibition reported in awake rats. In summary, these results are consistent with the hypothesis that idazoxan potentiates granule cell responses to perforant path input in the dentate gyrus via increases in norepinephrine that lead to beta-adrenoceptor activation, and, further, that idazoxan reduces paired pulse feedback spike facilitation and enhances EPSP slope, but not spike, feedback inhibition.

Network reset: a simplified overarching theory of locus coeruleus noradrenaline function

Unraveling the functional role of neuromodulatory systems has been a major challenge for cognitive neuroscience, giving rise to theories ranging from a simple role in vigilance to complex models concerning decision making, prediction errors or unexpected uncertainty. A new, simplified and overarching theory of noradrenaline function is inspired by an invertebrate model: neuromodulators in crustacea abruptly interrupt activity in neural networks and reorganize the elements into new functional networks determining the behavioral output. Analogously in mammals, phasic activation of noradrenergic neurons of the locus coeruleus in time with cognitive shifts could provoke or facilitate dynamic reorganization of target neural networks, permitting rapid behavioral adaptation to changing environmental imperatives. Detailed analysis and discussion of extensive electrophysiological data from the locus coeruleus of rats and monkeys in controlled behavioral situations is provided here to support this view. This simplified 'new look' at locus coeruleus noradrenaline function redirects the challenge of understanding neuromodulatory systems towards their target networks, particularly to the dynamics of their interactions and how they organize adaptive behavior.

Locus ceruleus activation suppresses feedforward interneurons and reduces beta-gamma electroencephalogram frequencies while it enhances theta frequencies in rat dentate gyrus

The locus ceruleus is activated by novel stimuli, and its activation promotes learning and memory. Phasic activation of locus ceruleus neurons by glutamate enhances the dentate gyrus population spike amplitude and results in long-term potentiation of synaptic responses recorded after 24 h. Cholinergic activation of locus ceruleus neurons increases hippocampal . At the level of the cellular network, it is not clear how the potentiating effects of norepinephrine are mediated. Previous studies show that exogenous norepinephrine enhances inhibitory interneuron firing in the dentate gyrus. This finding appears at odds with evidence for potentiation. In this study, natural release of norepinephrine was induced by glutamate activation of locus ceruleus while we recorded EEGs and physiologically identified interneurons in the dentate gyrus of urethane-anesthetized rats. Feedforward neurons were inhibited (approximately 1-2 min) by locus ceruleus activation. Feedback interneurons showed both increased and decreased activity, whereas granule cells increased firing as predicted by evoked potential studies. EEG results replicated an increase in power (4-8 Hz) with locus ceruleus activation, but the effect with glutamatergic locus ceruleus activation was transient (approximately 1-2 min). Beta-gamma Frequencies were also transiently suppressed. Together, the data suggest that locus ceruleus activation enhances the throughput of concomitant sensory input by reducing feedforward inhibitory interneuron activity, which may reduce "binding" in existing cell assemblies, and enhances the conditions for synaptic plasticity through disinhibition, promotion of 4-8 Hz , and noradrenergic potentiation to facilitate the building of new representations.

Decision making, the P3, and the locus coeruleus-norepinephrine system

Psychologists and neuroscientists have had a long-standing interest in the P3, a prominent component of the event-related brain potential. This review aims to integrate knowledge regarding the neural basis of the P3 and to elucidate its functional role in information processing. The authors review evidence suggesting that the P3 reflects phasic activity of the neuromodulatory locus coeruleus-norepinephrine (LC-NE) system. They discuss the P3 literature in the light of empirical findings and a recent theory regarding the information-processing function of the LC-NE phasic response. The theoretical framework emerging from this research synthesis suggests that the P3 reflects the response of the LC-NE system to the outcome of internal decision-making processes and the consequent effects of noradrenergic potentiation of information processing.

Imprinted Nesp55 influences behavioral reactivity to novel environments

Genomic imprinting results in parent-of-origin-dependent monoallelic expression of selected genes. Although their importance in development and physiology is recognized, few imprinted genes have been investigated for their effects on brain function. Gnas is a complex imprinted locus whose gene products are involved in early postnatal adaptations and neuroendocrine functions. Gnas encodes the stimulatory G-protein subunit Gsalpha and two other imprinted protein-coding transcripts. Of these, the Nesp transcript, expressed exclusively from the maternal allele, codes for neuroendocrine secretory protein 55 (Nesp55), a chromogranin-like polypeptide associated with the constitutive secretory pathway but with an unknown function. Nesp is expressed in restricted brain nuclei, suggesting an involvement in specific behaviors. We have generated a knockout of Nesp55 in mice. Nesp55-deficient mice develop normally, excluding a role of this protein in the severe postnatal effects associated with imprinting of the Gnas cluster. Behavioral analysis of adult Nesp55 mutants revealed, in three separate tasks, abnormal reactivity to novel environments independent of general locomotor activity and anxiety. This phenotype may be related to prominent Nesp55 expression in the noradrenergic locus coeruleus. These results indicate a role of maternally expressed Nesp55 in controlling exploratory behavior and are the first demonstration that imprinted genes affect such a fundamental behavior.

Chronic exposure to low doses bisphenol A interferes with pair-bonding and exploration in female Mongolian gerbils

Estrogenic endocrine disruptors, synthetic or naturally occurring substances found in the environment, can interfere with the vertebrate endocrine system and, mimicking estrogens, interact with the neuroendocrine substrates of behavior. Since species vary in their sensitivity to steroids, it is of great interest to widen the range of species included in the researches on neurobehavioral effects of estrogenic endocrine disruptors. We examined socio-sexual and exploratory behavior of Mongolian gerbil females (Meriones unguiculatus), a monogamous rodent, in response to chronic exposure to the estrogenic endocrine disruptor bisphenol A. Paired females were daily administered with one of the following treatments: bisphenol A (2 or 20 microg/kg body weight/day); 17alpha-ethynil estradiol (0.04 microg/kg body weight/day 17alphaE); oil (vehicle). Females were treated for 3 weeks after pairing. Starting on day of pairing, social interactions within pairs were daily recorded. Three weeks after pairing, females were individually tested in a free exploratory paradigm. Bisphenol A and 17alphaE affected male-female social interactions by increasing social investigation. Bisphenol A reduced several exploratory parameters, indicating a decreased exploratory propensity of females. These results highlight the sensitivity of adult female gerbils to bisphenol A during the hormonally sensitive period of pair formation, also considering that the bisphenol A doses tested are well below the suggested human tolerable daily intake.

Novel environments enhance the induction and maintenance of long-term potentiation in the dentate gyrus

The induction of long-term potentiation (LTP) in the hippocampal formation can be modulated by different behavioral states. However, few studies have addressed modulation of LTP during behavioral states in which the animal is likely acquiring new information. Here, we demonstrate that both the induction and the longevity of LTP in the dentate gyrus are enhanced when LTP is induced during the initial exploration of a novel environment. These effects are independent from locomotor activity, changes in brain temperature, and theta rhythm. Previous exposure to the novel environment attenuated this enhancement, suggesting that the effects of novelty habituate with familiarity. LTP longevity also was enhanced when induced in familiar environments containing novel objects. Together, these data indicate that both LTP induction and maintenance are enhanced when LTP is induced while rats investigate novel stimuli. We suggest that novelty initiates a transition of the hippocampal formation to a mode that is particularly conducive to synaptic plasticity, a process that could allow for new learning while preserving the stability of previously stored information. In addition, LTP induced in novel environments elicited a sustained late LTP. This suggests that a single synaptic population can display distinct profiles of LTP maintenance and that this depends on the animal's behavioral state during its induction. Furthermore, the duration of LTP enhanced by novelty parallels the time period during which the hippocampal formation is thought necessary for memory, consistent with the view that dentate LTP is of a duration sufficient to sustain memory in the hippocampal formation.

Neural Signature of Taste Familiarity in the Gustatory Cortex of the Freely Behaving Rat

Ample data indicate that the gustatory cortex (GC) subserves the processing, encoding, and storage of taste information. To further elucidate the neural processes involved, we recorded multi-unit activity in the GC of the freely behaving rat as it became familiar with a novel tastant. Exposure to the tastant was performed over three 40- to 50-min sessions, 24 h apart. In each session, the tastant was presented repeatedly, 1 s at a time, with 10- to 12-s inter-trial intervals. The neural response to the tastant typically lasted 7 s. Our results show that the average neuronal response to the tastant increased as this tastant became familiar, but this increase was detected only during the last 5 s of the response. The increased response was not generalized to another tastant. Furthermore, our analysis suggests that specific neuronal populations subserve the processing of familiarity of specific tastants. The signature of familiarity was not detected in the course of the familiarization session, but only on the subsequent day, suggesting that its development involves slow post-acquisition processes. Our data are in line with the notion that GC neurons process multiple taste attributes, familiarity included, during different temporal phases of their response. The data also suggest that by default the brain considers a taste stimulus as novel, unless proven otherwise.

A parameter control method in reinforcement learning to rapidly follow unexpected environmental changes

In order to rapidly follow unexpected environmental changes, we propose a parameter control method in reinforcement learning that changes each of learning parameters in appropriate directions. We determine each appropriate direction on the basis of relationships between behaviors and neuromodulators by considering an emergency as a key word. Computer experiments show that the agents using our proposed method could rapidly respond to unexpected environmental changes, not depending on either two reinforcement learning algorithms (Q-learning and actor-critic (AC) architecture) or two learning problems (discontinuous and continuous state-action problems).