Prior experience conditionally inhibits the expression of new learning in Drosophila

Dopamine neurons that inform Drosophila olfactory memory have distinct, acute functions driving attraction and aversion

The brain must guide immediate responses to beneficial and harmful stimuli while simultaneously writing memories for future reference. While both immediate actions and reinforcement learning are instructed by dopamine, how dopaminergic systems maintain coherence between these 2 reward functions is unknown. Through optogenetic activation experiments, we showed that the dopamine neurons that inform olfactory memory in Drosophila have a distinct, parallel function driving attraction and aversion (valence). Sensory neurons required for olfactory memory were dispensable to dopaminergic valence. A broadly projecting set of dopaminergic cells had valence that was dependent on dopamine, glutamate, and octopamine. Similarly, a more restricted dopaminergic cluster with attractive valence was reliant on dopamine and glutamate; flies avoided opto-inhibition of this narrow subset, indicating the role of this cluster in controlling ongoing behavior. Dopamine valence was distinct from output-neuron opto-valence in locomotor pattern, strength, and polarity. Overall, our data suggest that dopamine's acute effect on valence provides a mechanism by which a dopaminergic system can coherently write memories to influence future responses while guiding immediate attraction and aversion.

Common principles for odour coding across vertebrates and invertebrates

The olfactory system is an ideal and tractable system for exploring how the brain transforms sensory inputs into behaviour. The basic tasks of any olfactory system include odour detection, discrimination and categorization. The challenge for the olfactory system is to transform the high-dimensional space of olfactory stimuli into the much smaller space of perceived objects and valence that endows odours with meaning. Our current understanding of how neural circuits address this challenge has come primarily from observations of the mechanisms of the brain for processing other sensory modalities, such as vision and hearing, in which optimized deep hierarchical circuits are used to extract sensory features that vary along continuous physical dimensions. The olfactory system, by contrast, contends with an ill-defined, high-dimensional stimulus space and discrete stimuli using a circuit architecture that is shallow and parallelized. Here, we present recent observations in vertebrate and invertebrate systems that relate the statistical structure and state-dependent modulation of olfactory codes to mechanisms of perception and odour-guided behaviour.

Diverse memory paradigms in Drosophila reveal diverse neural mechanisms

In this review, we aggregated the different types of learning and memory paradigms developed in adult Drosophila and attempted to assess the similarities and differences in the neural mechanisms supporting diverse types of memory. The simplest association memory assays are conditioning paradigms (olfactory, visual, and gustatory). A great deal of work has been done on these memories, revealing hundreds of genes and neural circuits supporting this memory. Variations of conditioning assays (reversal learning, trace conditioning, latent inhibition, and extinction) also reveal interesting memory mechanisms, whereas mechanisms supporting spatial memory (thermal maze, orientation memory, and heat box) and the conditioned suppression of innate behaviors (phototaxis, negative geotaxis, anemotaxis, and locomotion) remain largely unexplored. In recent years, there has been an increased interest in multisensory and multicomponent memories (context-dependent and cross-modal memory) and higher-order memory (sensory preconditioning and second-order conditioning). Some of this work has revealed how the intricate mushroom body (MB) neural circuitry can support more complex memories. Finally, the most complex memories are arguably those involving social memory: courtship conditioning and social learning (mate-copying and egg-laying behaviors). Currently, very little is known about the mechanisms supporting social memories. Overall, the MBs are important for association memories of multiple sensory modalities and multisensory integration, whereas the central complex is important for place, orientation, and navigation memories. Interestingly, several different types of memory appear to use similar or variants of the olfactory conditioning neural circuitry, which are repurposed in different ways.

Prediction error drives associative learning and conditioned behavior in a spiking model of Drosophila larva

Predicting reinforcement from sensory cues is beneficial for goal-directed behavior. In insect brains, underlying associations between cues and reinforcement, encoded by dopaminergic neurons, are formed in the mushroom body. We propose a spiking model of the Drosophila larva mushroom body. It includes a feedback motif conveying learned reinforcement expectation to dopaminergic neurons, which can compute prediction error as the difference between expected and present reinforcement. We demonstrate that this can serve as a driving force in learning. When combined with synaptic homeostasis, our model accounts for theoretically derived features of acquisition and loss of associations that depend on the intensity of the reinforcement and its temporal proximity to the cue. From modeling olfactory learning over the time course of behavioral experiments and simulating the locomotion of individual larvae toward or away from odor sources in a virtual environment, we conclude that learning driven by prediction errors can explain larval behavior.

Dopaminergic neurons dynamically update sensory values during olfactory maneuver

Dopaminergic neurons (DANs) drive associative learning to update the value of sensory cues, but their contribution to the assessment of sensory values outside the context of association remains largely unexplored. Here, we show in Drosophila that DANs in the mushroom body encode the innate value of odors and constantly update the current value by inducing plasticity during olfactory maneuver. Our connectome-based network model linking all the way from the olfactory neurons to DANs reproduces the characteristics of DAN responses, proposing a concrete circuit mechanism for computation. Downstream of DANs, odors alone induce value- and dopamine-dependent changes in the activity of mushroom body output neurons, which store the current value of odors. Consistent with this neural plasticity, specific sets of DANs bidirectionally modulate flies' steering in a virtual olfactory environment. Thus, the DAN circuit known for discrete, associative learning also continuously updates odor values in a nonassociative manner.

ABA, AAB and ABC renewal with Pavlovian Conditioning of Tentacle Lowering procedure in the snail Cornu aspersum

This study assesses the recovery of the conditioned response (CR) due to a contextual change (renewal effect) in the Cornu aspersum, using the appetitive Pavlovian Conditioning of Tentacle Lowering procedure. Snails experienced an odorous conditioned stimulus (CS) paired with food (conditioning), followed by the exposition to the CS without any consequence (extinction). Then, they were exposed to the CS in a different context from the extinction one (renewal test). The contexts were three types of illumination. In Experiment 1a, the conditioning was performed in context A, the extinction was conducted in context B and the renewal test was performed in context A. For Experiment 1b, the conditioning and extinction were conducted in context A and renewal was performed in context B. In Experiment 1c, three dissimilar contexts were used for each experimental phase: context A for the conditioning, context B for the extinction and context C for the renewal. In Experiment 2, the renewal magnitude was compared among the three paradigms (ABA, AAB and ABC). Experiments 1a, 1b and 1c showed a recovery of the CR when subjects experienced a contextual change and Experiment 2 showed equivalent levels of renewal in the three paradigms. Learning processes and theories involved are discussed.

Multisensory learning binds neurons into a cross-modal memory engram

Associating multiple sensory cues with objects and experience is a fundamental brain process that improves object recognition and memory performance. However, neural mechanisms that bind sensory features during learning and augment memory expression are unknown. Here we demonstrate multisensory appetitive and aversive memory in Drosophila. Combining colours and odours improved memory performance, even when each sensory modality was tested alone. Temporal control of neuronal function revealed visually selective mushroom body Kenyon cells (KCs) to be required for enhancement of both visual and olfactory memory after multisensory training. Voltage imaging in head-fixed flies showed that multisensory learning binds activity between streams of modality-specific KCs so that unimodal sensory input generates a multimodal neuronal response. Binding occurs between regions of the olfactory and visual KC axons, which receive valence-relevant dopaminergic reinforcement, and is propagated downstream. Dopamine locally releases GABAergic inhibition to permit specific microcircuits within KC-spanning serotonergic neurons to function as an excitatory bridge between the previously 'modality-selective' KC streams. Cross-modal binding thereby expands the KCs representing the memory engram for each modality into those representing the other. This broadening of the engram improves memory performance after multisensory learning and permits a single sensory feature to retrieve the memory of the multimodal experience.

Locomotor and olfactory responses in dopamine neurons of the Drosophila superior-lateral brain

The Drosophila brain contains about 50 distinct morphological types of dopamine neurons.^1,2,3,4 Physiological studies of Drosophila dopamine neurons have been largely limited to one brain region, the mushroom body,^{5,6,7,8,9,10,11,12,13} where they are implicated in learning.^{14,15,16,17,18} By comparison, we know little about the physiology of other Drosophila dopamine neurons. Interestingly, a recent whole-brain imaging study found that dopamine neuron activity in several fly brain regions is correlated with locomotion.¹⁹ This is notable because many dopamine neurons in the rodent brain are also correlated with locomotion or other movements^{20,21,22,23,24,25,26,27,28,29,30}; however, most rodent studies have focused on learned and rewarded behaviors, and few have investigated dopamine neuron activity during spontaneous (self-timed) movements. In this study, we monitored dopamine neurons in the Drosophila brain during self-timed locomotor movements, focusing on several previously uncharacterized cell types that arborize in the superior-lateral brain, specifically the lateral horn and superior-lateral protocerebrum. We found that activity of all of these dopamine neurons correlated with spontaneous fluctuations in walking speed, with different cell types showing different speed correlations. Some dopamine neurons also responded to odors, but these responses were suppressed by repeated odor encounters. Finally, we found that the same identifiable dopamine neuron can encode different combinations of locomotion and odor in different individuals. If these dopamine neurons promote synaptic plasticity-like the dopamine neurons of the mushroom body-then, their tuning profiles would imply that plasticity depends on a flexible integration of sensory signals, motor signals, and recent experience.

Transient active zone remodeling in the Drosophila mushroom body supports memory

Elucidating how the distinct components of synaptic plasticity dynamically orchestrate the distinct stages of memory acquisition and maintenance within neuronal networks remains a major challenge. Specifically, plasticity processes tuning the functional and also structural state of presynaptic active zone (AZ) release sites are widely observed in vertebrates and invertebrates, but their behavioral relevance remains mostly unclear. We here provide evidence that a transient upregulation of presynaptic AZ release site proteins supports aversive olfactory mid-term memory in the Drosophila mushroom body (MB). Upon paired aversive olfactory conditioning, AZ protein levels (ELKS-family BRP/(m)unc13-family release factor Unc13A) increased for a few hours with MB-lobe-specific dynamics. Kenyon cell (KC, intrinsic MB neurons)-specific knockdown (KD) of BRP did not affect aversive olfactory short-term memory (STM) but strongly suppressed aversive mid-term memory (MTM). Different proteins crucial for the transport of AZ biosynthetic precursors (transport adaptor Aplip1/Jip-1; kinesin motor IMAC/Unc104; small GTPase Arl8) were also specifically required for the formation of aversive olfactory MTM. Consistent with the merely transitory increase of AZ proteins, BRP KD did not interfere with the formation of aversive olfactory long-term memory (LTM; i.e., 1 day). Our data suggest that the remodeling of presynaptic AZ refines the MB circuitry after paired aversive conditioning, over a time window of a few hours, to display aversive olfactory memories.

Novel approaches to the study of viscosity discrimination in rodents

Texture has enormous effects on food preferences. The materials used to study texture discrimination also have tastes that experimental animal can detect; therefore, such studies must be designed to exclude taste differences. In this study, to minimize the effects of material tastes, we utilized high- and low-viscosity forms of carboxymethyl cellulose (CMC-H and CMC-L, respectively) at the same concentrations (0.1-3%) for viscosity discrimination tests in rats. In two-bottle preference tests of water and CMC, rats avoided CMC-H solutions above 1% (63 mPa·s) but did not avoid less viscous CMC-L solutions with equivalent taste magnitudes, suggesting that rats spontaneously avoided high viscosity. To evaluate low-viscosity discrimination, we performed conditioned aversion tests to 0.1% CMC, which initially showed a comparable preference ratio to water in the two-bottle preference tests. Conditioning with 0.1% CMC-L (1.5 mPa·s) did not induce aversion to 0.1% CMC-L or CMC-H. However, rats acquired a conditioned aversion to 0.1% CMC-H (3.6 mPa·s) even after latent inhibition to CMC taste by pre-exposure to 0.1% CMC-L. These results suggest that rats can discriminate considerably low viscosity independent of CMC taste. This novel approach for viscosity discrimination can be used to investigate the mechanisms of texture perception in mammals.

Dopamine signaling in the nucleus accumbens core mediates latent inhibition

Studies investigating the neural mechanisms by which associations between cues and predicted outcomes control behavior often use associative learning frameworks to understand the neural control of behavior. These frameworks do not always account for the full range of effects that novelty can have on behavior and future associative learning. Here, in mice, we show that dopamine in the nucleus accumbens core is evoked by novel, neutral stimuli, and the trajectory of this response over time tracked habituation to these stimuli. Habituation to novel cues before associative learning reduced future associative learning, a phenomenon known as latent inhibition. Crucially, trial-by-trial dopamine response patterns tracked this phenomenon. Optogenetic manipulation of dopamine responses to the cue during the habituation period bidirectionally influenced future associative learning. Thus, dopamine signaling in the nucleus accumbens core has a causal role in novelty-based learning in a way that cannot be predicted based on purely associative factors.

Context specificity of latent inhibition in the snail Cornu aspersum

The present study was conducted to assess the context specificity of latent inhibition (LI) in the snail Cornu aspersum, using the appetitive Pavlovian Conditioning procedure of tentacle lowering. Snails experienced an odorous conditioned stimulus (CS) without any consequence before being conditioned with food. The conditioned stimulus preexposure occurred in the same context than the conditioning and the test context or in the different context. The study was performed in two replicas in which the photoperiod was defined by level of illumination and time of day (circadian replica) or was defined only by light (light replica). Both replicas showed that the CS preexposure in the same context as conditioning produced a delay in the acquisition of the conditioned response (CR). However, when the CS preexposure took place in a different context than the conditioning context, an equivalent level of CR as that observed in controls without preexposition to CS was shown. These results are congruent with context specificity of LI and they provide the first evidence of this phenomenon in terrestrial mollusks. Learning processes and theories involved in this phenomenon are also debated in the paper.

Honey bees can store and retrieve independent memory traces after complex experiences that combine appetitive and aversive associations

Real-world experiences do often mix appetitive and aversive events. Understanding the ability of animals to extract, store and use this information is an important issue in neurobiology. We used honey bees as model organism to study learning and memory after a differential conditioning that combines appetitive and aversive training trials. First of all, we describe an aversive conditioning paradigm that constitutes a clear opposite of the well known appetitive olfactory conditioning of the proboscis extension response. A neutral odour is presented paired with the bitter substance quinine. Aversive memory is evidenced later as an odour-specific impairment in appetitive conditioning. Then we tested the effect of mixing appetitive and aversive conditioning trials distributed along the same training session. Differential conditioning protocols like this were used before to study the ability to discriminate odours, however they were not focused on whether appetitive and aversive memories are formed. We found that after a differential conditioning, honey bees establish independent appetitive and aversive memories that do not interfere with each other during acquisition or storage. Finally, we moved the question forward to retrieval and memory expression to evaluate what happens when appetitive and the aversive learned odours are mixed during test. Interestingly, opposite memories compete in a way that they do not cancel each other out. Honey bees showed the ability to switch from expressing appetitive to aversive memory depending on their satiation level.

Optogenetic and thermogenetic manipulation of defined neural circuits and behaviors in Drosophila

Neural network dynamics underlying flexible animal behaviors remain elusive. The fruit fly Drosophila melanogaster is considered an excellent model in behavioral neuroscience because of its simple neuroanatomical architecture and the availability of various genetic methods. Moreover, Drosophila larvae's transparent body allows investigators to use optical methods on freely moving animals, broadening research directions. Activating or inhibiting well-defined events in excitable cells with a fine temporal resolution using optogenetics and thermogenetics led to the association of functions of defined neural populations with specific behavioral outputs such as the induction of associative memory. Furthermore, combining optogenetics and thermogenetics with state-of-the-art approaches, including connectome mapping and machine learning-based behavioral quantification, might provide a complete view of the experience- and time-dependent variations of behavioral responses. These methodologies allow further understanding of the functional connections between neural circuits and behaviors such as chemosensory, motivational, courtship, and feeding behaviors and sleep, learning, and memory.

Temporally and Spatially Localized PKA Activity within Learning and Memory Circuitry Regulated by Network Feedback

Dynamic functional connectivity within brain circuits requires coordination of intercellular signaling and intracellular signal transduction. Critical roles for cAMP-dependent protein kinase A (PKA) signaling are well established in the Drosophila mushroom body (MB) learning and memory circuitry, but local PKA activity within this well-mapped neuronal network is uncharacterized. Here, we use an in vivo PKA activity sensor (PKA-SPARK) to test spatiotemporal regulatory requirements in the MB axon lobes. We find immature animals have little detectable PKA activity, whereas postcritical period adults show high field-selective activation primarily in just 3/16 defined output regions. In addition to the age-dependent PKA activity in distinct α'/β' lobe nodes, females show sex-dependent elevation compared with males in these same restricted regions. Loss of neural cell body Fragile X mental retardation protein (FMRP) and Rugose [human Neurobeachin (NBEA)] suppresses localized PKA activity, whereas overexpression (OE) of MB lobe PKA-synergist Meng-Po (human SBK1) promotes PKA activity. Elevated Meng-Po subverts the PKA age-dependence, with elevated activity in immature animals, and spatial-restriction, with striking γ lobe activity. Testing circuit signaling requirements with temperature-sensitive shibire (human Dynamin) blockade, we find broadly expanded PKA activity within the MB lobes. Using transgenic tetanus toxin to block MB synaptic output, we find greatly heightened PKA activity in virtually all MB lobe fields, although the age-dependence is maintained. We conclude spatiotemporally restricted PKA activity signaling within this well-mapped learning/memory circuit is age-dependent and sex-dependent, driven by FMRP-Rugose pathway activation, temporally promoted by Meng-Po kinase function, and restricted by output neurotransmission providing network feedback.

Neural Circuits Underlying Behavioral Flexibility: Insights From Drosophila

Behavioral flexibility is critical to survival. Animals must adapt their behavioral responses based on changes in the environmental context, internal state, or experience. Studies in Drosophila melanogaster have provided insight into the neural circuit mechanisms underlying behavioral flexibility. Here we discuss how Drosophila behavior is modulated by internal and behavioral state, environmental context, and learning. We describe general principles of neural circuit organization and modulation that underlie behavioral flexibility, principles that are likely to extend to other species.

Learning and memory: Clashing engrams in the fly brain

Prior experience is known to deeply influence new learning. A recent study describes a neural mechanism where initial sensory experience promotes the establishment of a competing and/or cooperative memory trace that shapes behavioral expression of subsequent learning.