Suppression of a single pair of mushroom body output neurons in Drosophila triggers aversive associations

Functional dissection of a neuronal brain circuit mediating higher-order associative learning

A central feature characterizing the neural architecture of many species' brains is their capacity to form associative chains through learning. In elementary forms of associative learning, stimuli coinciding with reward or punishment become attractive or repulsive. Notably, stimuli previously learned as attractive or repulsive can themselves serve as reinforcers, establishing a cascading effect whereby they become associated with additional stimuli. When this iterative process is perpetuated, it results in higher-order associations. Here, we use odor conditioning in Drosophila and computational modeling to dissect the architecture of neuronal networks underlying higher-order associative learning. We show that the responsible circuit, situated in the mushroom bodies of the brain, is characterized by parallel processing of odor information and by recurrent excitatory and inhibitory feedback loops that empower odors to gain control over the dopaminergic valence-signaling system. Our findings establish a paradigmatic framework of a neuronal circuit diagram enabling the acquisition of associative chains.

Roles of feedback and feed-forward networks of dopamine subsystems: insights from Drosophila studies

Across animal species, dopamine-operated memory systems comprise anatomically segregated, functionally diverse subsystems. Although individual subsystems could operate independently to support distinct types of memory, the logical interplay between subsystems is expected to enable more complex memory processing by allowing existing memory to influence future learning. Recent comprehensive ultrastructural analysis of the Drosophila mushroom body revealed intricate networks interconnecting the dopamine subsystems-the mushroom body compartments. Here, we review the functions of some of these connections that are beginning to be understood. Memory consolidation is mediated by two different forms of network: A recurrent feedback loop within a compartment maintains sustained dopamine activity required for consolidation, whereas feed-forward connections across compartments allow short-term memory formation in one compartment to open the gate for long-term memory formation in another compartment. Extinction and reversal of aversive memory rely on a similar feed-forward circuit motif that signals omission of punishment as a reward, which triggers plasticity that counteracts the original aversive memory trace. Finally, indirect feed-forward connections from a long-term memory compartment to short-term memory compartments mediate higher-order conditioning. Collectively, these emerging studies indicate that feedback control and hierarchical connectivity allow the dopamine subsystems to work cooperatively to support diverse and complex forms of learning.

Hierarchical architecture of dopaminergic circuits enables second-order conditioning in Drosophila

Dopaminergic neurons with distinct projection patterns and physiological properties compose memory subsystems in a brain. However, it is poorly understood whether or how they interact during complex learning. Here, we identify a feedforward circuit formed between dopamine subsystems and show that it is essential for second-order conditioning, an ethologically important form of higher-order associative learning. The Drosophila mushroom body comprises a series of dopaminergic compartments, each of which exhibits distinct memory dynamics. We find that a slow and stable memory compartment can serve as an effective 'teacher' by instructing other faster and transient memory compartments via a single key interneuron, which we identify by connectome analysis and neurotransmitter prediction. This excitatory interneuron acquires enhanced response to reward-predicting odor after first-order conditioning and, upon activation, evokes dopamine release in the 'student' compartments. These hierarchical connections between dopamine subsystems explain distinct properties of first- and second-order memory long known by behavioral psychologists.

A pair of dopamine neurons mediate chronic stress signals to induce learning deficit in Drosophila melanogaster

Chronic stress could induce severe cognitive impairments. Despite extensive investigations in mammalian models, the underlying mechanisms remain obscure. Here, we show that chronic stress could induce dramatic learning and memory deficits in Drosophila melanogaster The chronic stress-induced learning deficit (CSLD) is long lasting and associated with other depression-like behaviors. We demonstrated that excessive dopaminergic activity provokes susceptibility to CSLD. Remarkably, a pair of PPL1-γ1pedc dopaminergic neurons that project to the mushroom body (MB) γ1pedc compartment play a key role in regulating susceptibility to CSLD so that stress-induced PPL1-γ1pedc hyperactivity facilitates the development of CSLD. Consistently, the mushroom body output neurons (MBON) of the γ1pedc compartment, MBON-γ1pedc>α/β neurons, are important for modulating susceptibility to CSLD. Imaging studies showed that dopaminergic activity is necessary to provoke the development of chronic stress-induced maladaptations in the MB network. Together, our data support that PPL1-γ1pedc mediates chronic stress signals to drive allostatic maladaptations in the MB network that lead to CSLD.

The Role of Dopamine in Associative Learning in Drosophila: An Updated Unified Model

Learning to associate a positive or negative experience with an unrelated cue after the presentation of a reward or a punishment defines associative learning. The ability to form associative memories has been reported in animal species as complex as humans and as simple as insects and sea slugs. Associative memory has even been reported in tardigrades [1], species that diverged from other animal phyla 500 million years ago. Understanding the mechanisms of memory formation is a fundamental goal of neuroscience research. In this article, we work on resolving the current contradictions between different Drosophila associative memory circuit models and propose an updated version of the circuit model that predicts known memory behaviors that current models do not. Finally, we propose a model for how dopamine may function as a reward prediction error signal in Drosophila, a dopamine function that is well-established in mammals but not in insects [2, 3].

A Mechanistic Model for Reward Prediction and Extinction Learning in the Fruit Fly

Extinction learning, the ability to update previously learned information by integrating novel contradictory information, is of high clinical relevance for therapeutic approaches to the modulation of maladaptive memories. Insect models have been instrumental in uncovering fundamental processes of memory formation and memory update. Recent experimental results in Drosophila melanogaster suggest that, after the behavioral extinction of a memory, two parallel but opposing memory traces coexist, residing at different sites within the mushroom body (MB). Here, we propose a minimalistic circuit model of the Drosophila MB that supports classical appetitive and aversive conditioning and memory extinction. The model is tailored to the existing anatomic data and involves two circuit motives of central functional importance. It employs plastic synaptic connections between Kenyon cells (KCs) and MB output neurons (MBONs) in separate and mutually inhibiting appetitive and aversive learning pathways. Recurrent modulation of plasticity through projections from MBONs to reinforcement-mediating dopaminergic neurons (DAN) implements a simple reward prediction mechanism. A distinct set of four MBONs encodes odor valence and predicts behavioral model output. Subjecting our model to learning and extinction protocols reproduced experimental results from recent behavioral and imaging studies. Simulating the experimental blocking of synaptic output of individual neurons or neuron groups in the model circuit confirmed experimental results and allowed formulation of testable predictions. In the temporal domain, our model achieves rapid learning with a step-like increase in the encoded odor value after a single pairing of the conditioned stimulus (CS) with a reward or punishment, facilitating single-trial learning.

Dopaminergic mechanism underlying reward-encoding of punishment omission during reversal learning in Drosophila

Animals form and update learned associations between otherwise neutral sensory cues and aversive outcomes (i.e., punishment) to predict and avoid danger in changing environments. When a cue later occurs without punishment, this unexpected omission of aversive outcome is encoded as reward via activation of reward-encoding dopaminergic neurons. How such activation occurs remains unknown. Using real-time in vivo functional imaging, optogenetics, behavioral analysis and synaptic reconstruction from electron microscopy data, we identify the neural circuit mechanism through which Drosophila reward-encoding dopaminergic neurons are activated when an olfactory cue is unexpectedly no longer paired with electric shock punishment. Reduced activation of punishment-encoding dopaminergic neurons relieves depression of olfactory synaptic inputs to cholinergic neurons. Synaptic excitation by these cholinergic neurons of reward-encoding dopaminergic neurons increases their odor response, thus decreasing aversiveness of the odor. These studies reveal how an excitatory cholinergic relay from punishment- to reward-encoding dopaminergic neurons encodes the absence of punishment as reward, revealing a general circuit motif for updating aversive memories that could be present in mammals.

Mushroom body output differentiates memory processes and distinct memory-guided behaviors

The mushroom body (MB) of Drosophila melanogaster has multiple functions in controlling memory and behavior.^1-9 However, circuit mechanisms that generate this functional diversity are largely unclear. Here, we systematically probed the behavioral contribution of each type of MB output neuron (MBON) by blocking during acquisition, retention, or retrieval of reward or punishment memories. We evaluated the contribution using two conditioned responses: memory-guided odor choice and odor source attraction. Quantitative analysis revealed that these conditioned odor responses are controlled by different sets of MBONs. We found that the valence of memory, rather than the transition of memory steps, has a larger impact on the patterns of required MBONs. Moreover, we found that the glutamatergic MBONs forming recurrent circuits commonly contribute to appetitive memory acquisition, suggesting a pivotal role of this circuit motif for reward processing. Our results provide principles how the MB output circuit processes associative memories of different valence and controls distinct memory-guided behaviors.

Changing memories on the fly: the neural circuits of memory re-evaluation in Drosophila melanogaster

Associative learning leads to modifications in neural networks to assign valence to sensory cues. These changes not only allow the expression of learned behavior but also modulate subsequent learning events. In the brain of the adult fruit fly, Drosophila melanogaster, olfactory memories are established as dopamine-driven plasticity in the output of a highly recurrent network, the mushroom body. Recent findings have highlighted how these changes in the network can steer the strengthening, weakening and formation of parallel memories when flies are exposed to subsequent training trials, conflicting situations or the reversal of contingencies. Together, these processes provide an initial understanding of how learned information can be used to guide the re-evaluation of memories.

The connectome of the adult Drosophila mushroom body provides insights into function

Making inferences about the computations performed by neuronal circuits from synapse-level connectivity maps is an emerging opportunity in neuroscience. The mushroom body (MB) is well positioned for developing and testing such an approach due to its conserved neuronal architecture, recently completed dense connectome, and extensive prior experimental studies of its roles in learning, memory, and activity regulation. Here, we identify new components of the MB circuit in Drosophila, including extensive visual input and MB output neurons (MBONs) with direct connections to descending neurons. We find unexpected structure in sensory inputs, in the transfer of information about different sensory modalities to MBONs, and in the modulation of that transfer by dopaminergic neurons (DANs). We provide insights into the circuitry used to integrate MB outputs, connectivity between the MB and the central complex and inputs to DANs, including feedback from MBONs. Our results provide a foundation for further theoretical and experimental work.

Recurrent architecture for adaptive regulation of learning in the insect brain

Dopaminergic neurons (DANs) drive learning across the animal kingdom, but the upstream circuits that regulate their activity and thereby learning remain poorly understood. We provide a synaptic-resolution connectome of the circuitry upstream of all DANs in a learning center, the mushroom body of Drosophila larva. We discover afferent sensory pathways and a large population of neurons that provide feedback from mushroom body output neurons and link distinct memory systems (aversive and appetitive). We combine this with functional studies of DANs and their presynaptic partners and with comprehensive circuit modeling. We find that DANs compare convergent feedback from aversive and appetitive systems, which enables the computation of integrated predictions that may improve future learning. Computational modeling reveals that the discovered feedback motifs increase model flexibility and performance on learning tasks. Our study provides the most detailed view to date of biological circuit motifs that support associative learning.

The neural circuit linking mushroom body parallel circuits induces memory consolidation in Drosophila

Memory consolidation is augmented by repeated learning following rest intervals, which is known as the spacing effect. Although the spacing effect has been associated with cumulative cellular responses in the neurons engaged in memory, here, we report the neural circuit-based mechanism for generating the spacing effect in the memory-related mushroom body (MB) parallel circuits in Drosophila To investigate the neurons activated during the training, we monitored expression of phosphorylation of mitogen-activated protein kinase (MAPK), ERK [phosphorylation of extracellular signal-related kinase (pERK)]. In an olfactory spaced training paradigm, pERK expression in one of the parallel circuits, consisting of γm neurons, was progressively inhibited via dopamine. This inhibition resulted in reduced pERK expression in a postsynaptic GABAergic neuron that, in turn, led to an increase in pERK expression in a dopaminergic neuron specifically in the later session during spaced training, suggesting that disinhibition of the dopaminergic neuron occurs during spaced training. The dopaminergic neuron was significant for gene expression in the different MB parallel circuits consisting of α/βs neurons for memory consolidation. Our results suggest that the spacing effect-generating neurons and the neurons engaged in memory reside in the distinct MB parallel circuits and that the spacing effect can be a consequence of evolved neural circuit architecture.

An optogenetic analogue of second-order reinforcement in Drosophila

In insects, odours are coded by the combinatorial activation of ascending pathways, including their third-order representation in mushroom body Kenyon cells. Kenyon cells also receive intersecting input from ascending and mostly dopaminergic reinforcement pathways. Indeed, in Drosophila, presenting an odour together with activation of the dopaminergic mushroom body input neuron PPL1-01 leads to a weakening of the synapse between Kenyon cells and the approach-promoting mushroom body output neuron MBON-11. As a result of such weakened approach tendencies, flies avoid the shock-predicting odour in a subsequent choice test. Thus, increased activity in PPL1-01 stands for punishment, whereas reduced activity in MBON-11 stands for predicted punishment. Given that punishment-predictors can themselves serve as punishments of second order, we tested whether presenting an odour together with the optogenetic silencing of MBON-11 would lead to learned odour avoidance, and found this to be the case. In turn, the optogenetic activation of MBON-11 together with odour presentation led to learned odour approach. Thus, manipulating activity in MBON-11 can be an analogue of predicted, second-order reinforcement.

A GABAergic Feedback Shapes Dopaminergic Input on the Drosophila Mushroom Body to Promote Appetitive Long-Term Memory

Memory consolidation is a crucial step for long-term memory (LTM) storage. However, we still lack a clear picture of how memory consolidation is regulated at the neuronal circuit level. Here, we took advantage of the well-described anatomy of the Drosophila olfactory memory center, the mushroom body (MB), to address this question in the context of appetitive LTM. The MB lobes, which are made by the fascicled axons of the MB intrinsic neurons, are organized into discrete anatomical modules, each covered by the terminals of a defined type of dopaminergic neuron (DAN) and the dendrites of a corresponding type of MB output neuron (MBON). We previously revealed the essential role of one DAN, the MP1 neuron, in the formation of appetitive LTM. The MP1 neuron is anatomically matched to the GABAergic MBON MVP2, which has been attributed feedforward inhibitory functions recently. Here, we used behavior experiments and in vivo imaging to challenge the existence of MP1-MVP2 synapses and investigate their role in appetitive LTM consolidation. We show that MP1 and MVP2 neurons form an anatomically and functionally recurrent circuit, which features a feedback inhibition that regulates consolidation of appetitive memory. This circuit involves two opposite type 1 and type 2 dopamine receptors in MVP2 neurons and the metabotropic GABAB-R1 receptor in MP1 neurons. We propose that this dual-receptor feedback supports a bidirectional self-regulation of MP1 input to the MB. This mechanism displays striking similarities with the mammalian reward system, in which modulation of the dopaminergic signal is primarily assigned to inhibitory neurons.

Drosophila mushroom bodies integrate hunger and satiety signals to control innate food-seeking behavior

The fruit fly can evaluate its energy state and decide whether to pursue food-related cues. Here, we reveal that the mushroom body (MB) integrates hunger and satiety signals to control food-seeking behavior. We have discovered five pathways in the MB essential for hungry flies to locate and approach food. Blocking the MB-intrinsic Kenyon cells (KCs) and the MB output neurons (MBONs) in these pathways impairs food-seeking behavior. Starvation bi-directionally modulates MBON responses to a food odor, suggesting that hunger and satiety controls occur at the KC-to-MBON synapses. These controls are mediated by six types of dopaminergic neurons (DANs). By manipulating these DANs, we could inhibit food-seeking behavior in hungry flies or promote food seeking in fed flies. Finally, we show that the DANs potentially receive multiple inputs of hunger and satiety signals. This work demonstrates an information-rich central circuit in the fly brain that controls hunger-driven food-seeking behavior.

Random neuronal ensembles can inherently do context dependent coarse conjunctive encoding of input stimulus without any specific training

Conjunctive encoding of inputs has been hypothesized to be a key feature in the computational capabilities of the brain. This has been inferred based on behavioral studies and electrophysiological recording from animals. In this report, we show that random neuronal ensembles grown on multi-electrode array perform a coarse-conjunctive encoding for a sequence of inputs with the first input setting the context. Such an encoding scheme creates similar yet unique population codes at the output of the ensemble, for related input sequences, which can then be decoded via a simple perceptron and hence a single STDP neuron layer. The random neuronal ensembles allow for pattern generalization and novel sequence classification without needing any specific learning or training of the ensemble. Such a representation of the inputs as population codes of neuronal ensemble outputs, has inherent redundancy and is suitable for further decoding via even probabilistic/random connections to subsequent neuronal layers. We reproduce this behavior in a mathematical model to show that a random neuronal network with a mix of excitatory and inhibitory neurons and sufficient connectivity creates similar coarse-conjunctive encoding of input sequences.

Long-term memory requires sequential protein synthesis in three subsets of mushroom body output neurons in Drosophila

Creating long-term memory (LTM) requires new protein synthesis to stabilize learning-induced synaptic changes in the brain. In the fruit fly, Drosophila melanogaster, aversive olfactory learning forms several phases of labile memory to associate an odor with coincident punishment in the mushroom body (MB). It remains unclear how the brain consolidates early labile memory into LTM. Here, we survey 183 Gal4 lines containing almost all 21 distinct types of MB output neurons (MBONs) and show that sequential synthesis of learning-induced proteins occurs at three types of MBONs. Downregulation of oo18 RNA-binding proteins (ORBs) in any of these MBONs impaired LTM. And, neurotransmission outputs from these MBONs are all required during LTM retrieval. Together, these results suggest an LTM consolidation model in which transient neural activities of early labile memory in the MB are consolidated into stable LTM at a few postsynaptic MBONs through sequential ORB-regulated local protein synthesis.