Cellular-resolution population imaging reveals robust sparse coding in the Drosophila mushroom body

Functional dissection of a neuronal brain circuit mediating higher-order associative learning

A central feature characterizing the neural architecture of many species' brains is their capacity to form associative chains through learning. In elementary forms of associative learning, stimuli coinciding with reward or punishment become attractive or repulsive. Notably, stimuli previously learned as attractive or repulsive can themselves serve as reinforcers, establishing a cascading effect whereby they become associated with additional stimuli. When this iterative process is perpetuated, it results in higher-order associations. Here, we use odor conditioning in Drosophila and computational modeling to dissect the architecture of neuronal networks underlying higher-order associative learning. We show that the responsible circuit, situated in the mushroom bodies of the brain, is characterized by parallel processing of odor information and by recurrent excitatory and inhibitory feedback loops that empower odors to gain control over the dopaminergic valence-signaling system. Our findings establish a paradigmatic framework of a neuronal circuit diagram enabling the acquisition of associative chains.

Synaptic enrichment and dynamic regulation of the two opposing dopamine receptors within the same neurons

Dopamine can play opposing physiological roles depending on the receptor subtype. In the fruit fly Drosophila melanogaster, Dop1R1 and Dop2R encode the D1- and D2-like receptors, respectively, and are reported to oppositely regulate intracellular cAMP levels. Here, we profiled the expression and subcellular localization of endogenous Dop1R1 and Dop2R in specific cell types in the mushroom body circuit. For cell-type-specific visualization of endogenous proteins, we employed reconstitution of split-GFP tagged to the receptor proteins. We detected dopamine receptors at both presynaptic and postsynaptic sites in multiple cell types. Quantitative analysis revealed enrichment of both receptors at the presynaptic sites, with Dop2R showing a greater degree of localization than Dop1R1. The presynaptic localization of Dop1R1 and Dop2R in dopamine neurons suggests dual feedback regulation as autoreceptors. Furthermore, we discovered a starvation-dependent, bidirectional modulation of the presynaptic receptor expression in the protocerebral anterior medial (PAM) and posterior lateral 1 (PPL1) clusters, two distinct subsets of dopamine neurons, suggesting their roles in regulating appetitive behaviors. Our results highlight the significance of the co-expression of the two opposing dopamine receptors in the spatial and conditional regulation of dopamine responses in neurons.

Driver lines for studying associative learning in Drosophila

The mushroom body (MB) is the center for associative learning in insects. In Drosophila, intersectional split-GAL4 drivers and electron microscopy (EM) connectomes have laid the foundation for precise interrogation of the MB neural circuits. However, investigation of many cell types upstream and downstream of the MB has been hindered due to lack of specific driver lines. Here we describe a new collection of over 800 split-GAL4 and split-LexA drivers that cover approximately 300 cell types, including sugar sensory neurons, putative nociceptive ascending neurons, olfactory and thermo-/hygro-sensory projection neurons, interneurons connected with the MB-extrinsic neurons, and various other cell types. We characterized activation phenotypes for a subset of these lines and identified a sugar sensory neuron line most suitable for reward substitution. Leveraging the thousands of confocal microscopy images associated with the collection, we analyzed neuronal morphological stereotypy and discovered that one set of mushroom body output neurons, MBON08/MBON09, exhibits striking individuality and asymmetry across animals. In conjunction with the EM connectome maps, the driver lines reported here offer a powerful resource for functional dissection of neural circuits for associative learning in adult Drosophila.

A modular chemigenetic calcium indicator for multiplexed in vivo functional imaging

Genetically encoded fluorescent calcium indicators allow cellular-resolution recording of physiology. However, bright, genetically targetable indicators that can be multiplexed with existing tools in vivo are needed for simultaneous imaging of multiple signals. Here we describe WHaloCaMP, a modular chemigenetic calcium indicator built from bright dye-ligands and protein sensor domains. Fluorescence change in WHaloCaMP results from reversible quenching of the bound dye via a strategically placed tryptophan. WHaloCaMP is compatible with rhodamine dye-ligands that fluoresce from green to near-infrared, including several that efficiently label the brain in animals. When bound to a near-infrared dye-ligand, WHaloCaMP shows a 7× increase in fluorescence intensity and a 2.1-ns increase in fluorescence lifetime upon calcium binding. We use WHaloCaMP1a to image Ca2+ responses in vivo in flies and mice, to perform three-color multiplexed functional imaging of hundreds of neurons and astrocytes in zebrafish larvae and to quantify Ca2+ concentration using fluorescence lifetime imaging microscopy (FLIM).

Analysis of fast calcium dynamics of honey bee olfactory coding

Odour processing exhibits multiple parallels between vertebrate and invertebrate olfactory systems. Insects, in particular, have emerged as relevant models for olfactory studies because of the tractability of their olfactory circuits. Here, we used fast calcium imaging to track the activity of projection neurons in the honey bee antennal lobe (AL) during olfactory stimulation at high temporal resolution. We observed a heterogeneity of response profiles and an abundance of inhibitory activities, resulting in various response latencies and stimulus-specific post-odour neural signatures. Recorded calcium signals were fed to a mushroom body (MB) model constructed implementing the fundamental features of connectivity between olfactory projection neurons, Kenyon cells (KC), and MB output neurons (MBON). The model accounts for the increase of odorant discrimination in the MB compared to the AL and reveals the recruitment of two distinct KC populations that represent odorants and their aftersmell as two separate but temporally coherent neural objects. Finally, we showed that the learning-induced modulation of KC-to-MBON synapses can explain both the variations in associative learning scores across different conditioning protocols used in bees and the bees' response latency. Thus, it provides a simple explanation of how the time contingency between the stimulus and the reward can be encoded without the need for time tracking. This study broadens our understanding of olfactory coding and learning in honey bees. It demonstrates that a model based on simple MB connectivity rules and fed with real physiological data can explain fundamental aspects of odour processing and associative learning.

Spaced training activates Miro/Milton-dependent mitochondrial dynamics in neuronal axons to sustain long-term memory

Neurons have differential and fluctuating energy needs across distinct cellular compartments, shaped by brain electrochemical activity associated with cognition. In vitro studies show that mitochondria transport from soma to axons is key to maintaining neuronal energy homeostasis. Nevertheless, whether the spatial distribution of neuronal mitochondria is dynamically adjusted in vivo in an experience-dependent manner remains unknown. In Drosophila, associative long-term memory (LTM) formation is initiated by an early and persistent upregulation of mitochondrial pyruvate flux in the axonal compartment of neurons in the mushroom body (MB). Through behavior experiments, super-resolution analysis of mitochondria morphology in the neuronal soma and in vivo mitochondrial fluorescence recovery after photobleaching (FRAP) measurements in the axons, we show that LTM induction, contrary to shorter-lived memories, is sustained by the departure of some mitochondria from MB neuronal soma and increased mitochondrial dynamics in the axonal compartment. Accordingly, impairing mitochondrial dynamics abolished the increased pyruvate consumption, specifically after spaced training and in the MB axonal compartment, thereby preventing LTM formation. Our results thus promote reorganization of the mitochondrial network in neurons as an integral step in elaborating high-order cognitive processes.

Skewing information flow through pre- and postsynaptic plasticity in the mushroom bodies of Drosophila

Animal brains need to store information to construct a representation of their environment. Knowledge of what happened in the past allows both vertebrates and invertebrates to predict future outcomes by recalling previous experience. Although invertebrate and vertebrate brains share common principles at the molecular, cellular, and circuit-architectural levels, there are also obvious differences as exemplified by the use of acetylcholine versus glutamate as the considered main excitatory neurotransmitters in the respective central nervous systems. Nonetheless, across central nervous systems, synaptic plasticity is thought to be a main substrate for memory storage. Therefore, how brain circuits and synaptic contacts change following learning is of fundamental interest for understanding brain computations tied to behavior in any animal. Recent progress has been made in understanding such plastic changes following olfactory associative learning in the mushroom bodies (MBs) of Drosophila A current framework of memory-guided behavioral selection is based on the MB skew model, in which antagonistic synaptic pathways are selectively changed in strength. Here, we review insights into plasticity at dedicated Drosophila MB output pathways and update what is known about the plasticity of both pre- and postsynaptic compartments of Drosophila MB neurons.

The caloric value of food intake structurally adjusts a neuronal mushroom body circuit mediating olfactory learning in Drosophila

Associative learning enables the adaptive adjustment of behavioral decisions based on acquired, predicted outcomes. The valence of what is learned is influenced not only by the learned stimuli and their temporal relations, but also by prior experiences and internal states. In this study, we used the fruit fly Drosophila melanogaster to demonstrate that neuronal circuits involved in associative olfactory learning undergo restructuring during extended periods of low-caloric food intake. Specifically, we observed a decrease in the connections between specific dopaminergic neurons (DANs) and Kenyon cells at distinct compartments of the mushroom body. This structural synaptic plasticity was contingent upon the presence of allatostatin A receptors in specific DANs and could be mimicked optogenetically by expressing a light-activated adenylate cyclase in exactly these DANs. Importantly, we found that this rearrangement in synaptic connections influenced aversive, punishment-induced olfactory learning but did not impact appetitive, reward-based learning. Whether induced by prolonged low-caloric conditions or optogenetic manipulation of cAMP levels, this synaptic rearrangement resulted in a reduction of aversive associative learning. Consequently, the balance between positive and negative reinforcing signals shifted, diminishing the ability to learn to avoid odor cues signaling negative outcomes. These results exemplify how a neuronal circuit required for learning and memory undergoes structural plasticity dependent on prior experiences of the nutritional value of food.

Learning with sparse reward in a gap junction network inspired by the insect mushroom body

Animals can learn in real-life scenarios where rewards are often only available when a goal is achieved. This 'distal' or 'sparse' reward problem remains a challenge for conventional reinforcement learning algorithms. Here we investigate an algorithm for learning in such scenarios, inspired by the possibility that axo-axonal gap junction connections, observed in neural circuits with parallel fibres such as the insect mushroom body, could form a resistive network. In such a network, an active node represents the task state, connections between nodes represent state transitions and their connection to actions, and current flow to a target state can guide decision making. Building on evidence that gap junction weights are adaptive, we propose that experience of a task can modulate the connections to form a graph encoding the task structure. We demonstrate that the approach can be used for efficient reinforcement learning under sparse rewards, and discuss whether it is plausible as an account of the insect mushroom body.

Sensory encoding and memory in the mushroom body: signals, noise, and variability

To survive in changing environments, animals need to learn to associate specific sensory stimuli with positive or negative valence. How do they form stimulus-specific memories to distinguish between positively/negatively associated stimuli and other irrelevant stimuli? Solving this task is one of the functions of the mushroom body, the associative memory center in insect brains. Here we summarize recent work on sensory encoding and memory in the Drosophila mushroom body, highlighting general principles such as pattern separation, sparse coding, noise and variability, coincidence detection, and spatially localized neuromodulation, and placing the mushroom body in comparative perspective with mammalian memory systems.

What do the mushroom bodies do for the insect brain? Twenty-five years of progress

In 1998, a special edition of Learning & Memory was published with a discrete focus of synthesizing the state of the field to provide an overview of the function of the insect mushroom body. While molecular neuroscience and optical imaging of larger brain areas were advancing, understanding the basic functioning of neuronal circuits, particularly in the context of the mushroom body, was rudimentary. In the past 25 years, technological innovations have allowed researchers to map and understand the in vivo function of the neuronal circuits of the mushroom body system, making it an ideal model for investigating the circuit basis of sensory encoding, memory formation, and behavioral decisions. Collaborative efforts within the community have played a crucial role, leading to an interactive connectome of the mushroom body and accessible genetic tools for studying mushroom body circuit function. Looking ahead, continued technological innovation and collaborative efforts are likely to further advance our understanding of the mushroom body and its role in behavior and cognition, providing insights that generalize to other brain structures and species.

Future avenues in Drosophila mushroom body research

How does the brain translate sensory information into complex behaviors? With relatively small neuronal numbers, readable behavioral outputs, and an unparalleled genetic toolkit, the Drosophila mushroom body (MB) offers an excellent model to address this question in the context of associative learning and memory. Recent technological breakthroughs, such as the freshly completed full-brain connectome, multiomics approaches, CRISPR-mediated gene editing, and machine learning techniques, led to major advancements in our understanding of the MB circuit at the molecular, structural, physiological, and functional levels. Despite significant progress in individual MB areas, the field still faces the fundamental challenge of resolving how these different levels combine and interact to ultimately control the behavior of an individual fly. In this review, we discuss various aspects of MB research, with a focus on the current knowledge gaps, and an outlook on the future methodological developments required to reach an overall view of the neurobiological basis of learning and memory.

Cyclic nucleotide-induced bidirectional long-term synaptic plasticity in Drosophila mushroom body

Activation of the cAMP pathway is one of the common mechanisms underlying long-term potentiation (LTP). In the Drosophila mushroom body, simultaneous activation of odour-coding Kenyon cells (KCs) and reinforcement-coding dopaminergic neurons activates adenylyl cyclase in KC presynaptic terminals, which is believed to trigger synaptic plasticity underlying olfactory associative learning. However, learning induces long-term depression (LTD) at these synapses, contradicting the universal role of cAMP as a facilitator of transmission. Here, we developed a system to electrophysiologically monitor both short-term and long-term synaptic plasticity at KC output synapses and demonstrated that they are indeed an exception in which activation of the cAMP-protein kinase A pathway induces LTD. Contrary to the prevailing model, our cAMP imaging found no evidence for synergistic action of dopamine and KC activity on cAMP synthesis. Furthermore, we found that forskolin-induced cAMP increase alone was insufficient for plasticity induction; it additionally required simultaneous KC activation to replicate the presynaptic LTD induced by pairing with dopamine. On the other hand, activation of the cGMP pathway paired with KC activation induced slowly developing LTP, proving antagonistic actions of the two second-messenger pathways predicted by behavioural study. Finally, KC subtype-specific interrogation of synapses revealed that different KC subtypes exhibit distinct plasticity duration even among synapses on the same postsynaptic neuron. Thus, our work not only revises the role of cAMP in synaptic plasticity by uncovering the unexpected convergence point of the cAMP pathway and neuronal activity, but also establishes the methods to address physiological mechanisms of synaptic plasticity in this important model. KEY POINTS: Although presynaptic cAMP increase generally facilitates synapses, olfactory associative learning in Drosophila, which depends on dopamine and cAMP signalling genes, induces long-term depression (LTD) at the mushroom body output synapses. By combining electrophysiology, pharmacology and optogenetics, we directly demonstrate that these synapses are an exception where activation of the cAMP-protein kinase A pathway leads to presynaptic LTD. Dopamine- or forskolin-induced cAMP increase alone is not sufficient for LTD induction; neuronal activity, which has been believed to trigger cAMP synthesis in synergy with dopamine input, is required in the downstream pathway of cAMP. In contrast to cAMP, activation of the cGMP pathway paired with neuronal activity induces presynaptic long-term potentiation, which explains behaviourally observed opposing actions of transmitters co-released by dopaminergic neurons. Our work not only revises the role of cAMP in synaptic plasticity, but also provides essential methods to address physiological mechanisms of synaptic plasticity in this important model system.

Roles of feedback and feed-forward networks of dopamine subsystems: insights from Drosophila studies

Across animal species, dopamine-operated memory systems comprise anatomically segregated, functionally diverse subsystems. Although individual subsystems could operate independently to support distinct types of memory, the logical interplay between subsystems is expected to enable more complex memory processing by allowing existing memory to influence future learning. Recent comprehensive ultrastructural analysis of the Drosophila mushroom body revealed intricate networks interconnecting the dopamine subsystems-the mushroom body compartments. Here, we review the functions of some of these connections that are beginning to be understood. Memory consolidation is mediated by two different forms of network: A recurrent feedback loop within a compartment maintains sustained dopamine activity required for consolidation, whereas feed-forward connections across compartments allow short-term memory formation in one compartment to open the gate for long-term memory formation in another compartment. Extinction and reversal of aversive memory rely on a similar feed-forward circuit motif that signals omission of punishment as a reward, which triggers plasticity that counteracts the original aversive memory trace. Finally, indirect feed-forward connections from a long-term memory compartment to short-term memory compartments mediate higher-order conditioning. Collectively, these emerging studies indicate that feedback control and hierarchical connectivity allow the dopamine subsystems to work cooperatively to support diverse and complex forms of learning.

Evolution of neural circuitry and cognition

Neural circuits govern the interface between the external environment, internal cues and outwardly directed behaviours. To process multiple environmental stimuli and integrate these with internal state requires considerable neural computation. Expansion in neural network size, most readily represented by whole brain size, has historically been linked to behavioural complexity, or the predominance of cognitive behaviours. Yet, it is largely unclear which aspects of circuit variation impact variation in performance. A key question in the field of evolutionary neurobiology is therefore how neural circuits evolve to allow improved behavioural performance or innovation. We discuss this question by first exploring how volumetric changes in brain areas reflect actual neural circuit change. We explore three major axes of neural circuit evolution-replication, restructuring and reconditioning of cells and circuits-and discuss how these could relate to broader phenotypes and behavioural variation. This discussion touches on the relevant uses and limitations of volumetrics, while advocating a more circuit-based view of cognition. We then use this framework to showcase an example from the insect brain, the multi-sensory integration and internal processing that is shared between the mushroom bodies and central complex. We end by identifying future trends in this research area, which promise to advance the field of evolutionary neurobiology.

Minimal circuit motifs for second-order conditioning in the insect mushroom body

In well-established first-order conditioning experiments, the concurrence of a sensory cue with reinforcement forms an association, allowing the cue to predict future reinforcement. In the insect mushroom body, a brain region central to learning and memory, such associations are encoded in the synapses between its intrinsic and output neurons. This process is mediated by the activity of dopaminergic neurons that encode reinforcement signals. In second-order conditioning, a new sensory cue is paired with an already established one that presumably activates dopaminergic neurons due to its predictive power of the reinforcement. We explored minimal circuit motifs in the mushroom body for their ability to support second-order conditioning using mechanistic models. We found that dopaminergic neurons can either be activated directly by the mushroom body's intrinsic neurons or via feedback from the output neurons via several pathways. We demonstrated that the circuit motifs differ in their computational efficiency and robustness. Beyond previous research, we suggest an additional motif that relies on feedforward input of the mushroom body intrinsic neurons to dopaminergic neurons as a promising candidate for experimental evaluation. It differentiates well between trained and novel stimuli, demonstrating robust performance across a range of model parameters.

Cyclic nucleotide-induced bidirectional long-term synaptic plasticity in Drosophila mushroom body

Activation of the cAMP pathway is one of the common mechanisms underlying long-term potentiation (LTP). In the Drosophila mushroom body, simultaneous activation of odor-coding Kenyon cells (KCs) and reinforcement-coding dopaminergic neurons activates adenylyl cyclase in KC presynaptic terminals, which is believed to trigger synaptic plasticity underlying olfactory associative learning. However, learning induces long-term depression (LTD) at these synapses, contradicting the universal role of cAMP as a facilitator of transmission. Here, we develop a system to electrophysiologically monitor both short-term and long-term synaptic plasticity at KC output synapses and demonstrate that they are indeed an exception where activation of the cAMP/protein kinase A pathway induces LTD. Contrary to the prevailing model, our cAMP imaging finds no evidence for synergistic action of dopamine and KC activity on cAMP synthesis. Furthermore, we find that forskolin-induced cAMP increase alone is insufficient for plasticity induction; it additionally requires simultaneous KC activation to replicate the presynaptic LTD induced by pairing with dopamine. On the other hand, activation of the cGMP pathway paired with KC activation induces slowly developing LTP, proving antagonistic actions of the two second-messenger pathways predicted by behavioral study. Finally, KC subtype-specific interrogation of synapses reveals that different KC subtypes exhibit distinct plasticity duration even among synapses on the same postsynaptic neuron. Thus, our work not only revises the role of cAMP in synaptic plasticity by uncovering the unexpected convergence point of the cAMP pathway and neuronal activity, but also establishes the methods to address physiological mechanisms of synaptic plasticity in this important model.

Combinatory Actions of Co-transmitters in Dopaminergic Systems Modulate Drosophila Olfactory Memories

Dopamine neurons (DANs) are extensively studied in the context of associative learning, in both vertebrates and invertebrates. In the acquisition of male and female Drosophila olfactory memory, the PAM cluster of DANs provides the reward signal, and the PPL1 cluster of DANs sends the punishment signal to the Kenyon cells (KCs) of mushroom bodies, the center for memory formation. However, thermo-genetical activation of the PPL1 DANs after memory acquisition impaired aversive memory, and that of the PAM DANs impaired appetitive memory. We demonstrate that the knockdown of glutamate decarboxylase, which catalyzes glutamate conversion to GABA in PAM DANs, potentiated the appetitive memory. In addition, the knockdown of glutamate transporter in PPL1 DANs potentiated aversive memory, suggesting that GABA and glutamate co-transmitters act in an inhibitory manner in olfactory memory formation. We also found that, in γKCs, the Rdl receptor for GABA and the mGluR DmGluRA mediate the inhibition. Although multiple-spaced training is required to form long-term aversive memory, a single cycle of training was sufficient to develop long-term memory when the glutamate transporter was knocked down, in even a single subset of PPL1 DANs. Our results suggest that the mGluR signaling pathway may set a threshold for memory acquisition to allow the organisms' behaviors to adapt to changing physiological conditions and environments.SIGNIFICANCE STATEMENT In the acquisition of olfactory memory in Drosophila, the PAM cluster of dopamine neurons (DANs) mediates the reward signal, while the PPL1 cluster of DANs conveys the punishment signal to the Kenyon cells of the mushroom bodies, which serve as the center for memory formation. We found that GABA co-transmitters in the PAM DANs and glutamate co-transmitters in the PPL1 DANs inhibit olfactory memory formation. Our findings demonstrate that long-term memory acquisition, which typically necessitates multiple-spaced training sessions to establish aversive memory, can be triggered with a single training cycle in cases where the glutamate co-transmission is inhibited, even within a single subset of PPL1 DANs, suggesting that the glutamate co-transmission may modulate the threshold for memory acquisition.

Experience-dependent tuning of the olfactory system

Insects rely on their sense of smell to navigate complex environments and make decisions regarding food and reproduction. However, in natural settings, the odors that convey this information may come mixed with environmental odors that can obscure their perception. Therefore, recognizing the presence of informative odors involves generalization and discrimination processes, which can be facilitated when there is a high contrast between stimuli, or the internal representation of the odors of interest outcompetes that of concurrent ones. The first two layers of the olfactory system, which involve the detection of odorants by olfactory receptor neurons and their encoding by the first postsynaptic partners in the antennal lobe, are critical for achieving such optimal representation. In this review, we summarize evidence indicating that experience-dependent changes adjust these two levels of the olfactory system. These changes are discussed in the context of the advantages they provide for detection of informative odors.

Rewarding Capacity of Optogenetically Activating a Giant GABAergic Central-Brain Interneuron in Larval Drosophila

Larvae of the fruit fly Drosophila melanogaster are a powerful study case for understanding the neural circuits underlying behavior. Indeed, the numerical simplicity of the larval brain has permitted the reconstruction of its synaptic connectome, and genetic tools for manipulating single, identified neurons allow neural circuit function to be investigated with relative ease and precision. We focus on one of the most complex neurons in the brain of the larva (of either sex), the GABAergic anterior paired lateral neuron (APL). Using behavioral and connectomic analyses, optogenetics, Ca2+ imaging, and pharmacology, we study how APL affects associative olfactory memory. We first provide a detailed account of the structure, regional polarity, connectivity, and metamorphic development of APL, and further confirm that optogenetic activation of APL has an inhibiting effect on its main targets, the mushroom body Kenyon cells. All these findings are consistent with the previously identified function of APL in the sparsening of sensory representations. To our surprise, however, we found that optogenetically activating APL can also have a strong rewarding effect. Specifically, APL activation together with odor presentation establishes an odor-specific, appetitive, associative short-term memory, whereas naive olfactory behavior remains unaffected. An acute, systemic inhibition of dopamine synthesis as well as an ablation of the dopaminergic pPAM neurons impair reward learning through APL activation. Our findings provide a study case of complex circuit function in a numerically simple brain, and suggest a previously unrecognized capacity of central-brain GABAergic neurons to engage in dopaminergic reinforcement.SIGNIFICANCE STATEMENT The single, identified giant anterior paired lateral (APL) neuron is one of the most complex neurons in the insect brain. It is GABAergic and contributes to the sparsening of neuronal activity in the mushroom body, the memory center of insects. We provide the most detailed account yet of the structure of APL in larval Drosophila as a neurogenetically accessible study case. We further reveal that, contrary to expectations, the experimental activation of APL can exert a rewarding effect, likely via dopaminergic reward pathways. The present study both provides an example of unexpected circuit complexity in a numerically simple brain, and reports an unexpected effect of activity in central-brain GABAergic circuits.

The mushroom body output encodes behavioral decision during sensory-motor transformation

Animals form a behavioral decision by evaluating sensory evidence on the background of past experiences and the momentary motivational state. In insects, we still lack understanding of how and at which stage of the recurrent sensory-motor pathway behavioral decisions are formed. The mushroom body (MB), a central brain structure in insects1 and crustaceans,2,3 integrates sensory input of different modalities4,5,6 with the internal state, the behavioral state, and external sensory context7,8,9,10 through a large number of recurrent, mostly neuromodulatory inputs,11,12 implicating a functional role for MBs in state-dependent sensory-motor transformation.13,14 A number of classical conditioning studies in honeybees15,16 and fruit flies17,18,19 have provided accumulated evidence that at its output, the MB encodes the valence of a sensory stimulus with respect to its behavioral relevance. Recent work has extended this notion of valence encoding to the context of innate behaviors.8,20,21,22 Here, we co-analyzed a defined feeding behavior and simultaneous extracellular single-unit recordings from MB output neurons (MBONs) in the cockroach in response to timed sensory stimulation with odors. We show that clear neuronal responses occurred almost exclusively during behaviorally responded trials. Early MBON responses to the sensory stimulus preceded the feeding behavior and predicted its occurrence or non-occurrence from the single-trial population activity. Our results therefore suggest that at its output, the MB does not merely encode sensory stimulus valence. We hypothesize instead that the MB output represents an integrated signal of internal state, momentary environmental conditions, and experience-dependent memory to encode a behavioral decision.

Mixing things up! - how odor blends are processed in Drosophila

Insects have to navigate a complex and rich olfactory environment consisting of mixtures of odors at varying ratios. However, we understand little of how the olfactory system represents these complex blends. This review aims to highlight some of the recent results of studying this mixture code, in the Drosophila melanogaster olfactory system, as well as gives a short background to one of the most challenging questions in olfaction - how are mixtures encoded in the brain?

Effects of stochastic coding on olfactory discrimination in flies and mice

Sparse coding can improve discrimination of sensory stimuli by reducing overlap between their representations. Two factors, however, can offset sparse coding's benefits: similar sensory stimuli have significant overlap and responses vary across trials. To elucidate the effects of these 2 factors, we analyzed odor responses in the fly and mouse olfactory regions implicated in learning and discrimination-the mushroom body (MB) and the piriform cortex (PCx). We found that neuronal responses fall along a continuum from extremely reliable across trials to extremely variable or stochastic. Computationally, we show that the observed variability arises from noise within central circuits rather than sensory noise. We propose this coding scheme to be advantageous for coarse- and fine-odor discrimination. More reliable cells enable quick discrimination between dissimilar odors. For similar odors, however, these cells overlap and do not provide distinguishing information. By contrast, more unreliable cells are decorrelated for similar odors, providing distinguishing information, though these benefits only accrue with extended training with more trials. Overall, we have uncovered a conserved, stochastic coding scheme in vertebrates and invertebrates, and we identify a candidate mechanism, based on variability in a winner-take-all (WTA) inhibitory circuit, that improves discrimination with training.

Dopamine-Dependent Plasticity Is Heterogeneously Expressed by Presynaptic Calcium Activity across Individual Boutons of the Drosophila Mushroom Body

The Drosophila mushroom body (MB) is an important model system for studying the synaptic mechanisms of associative learning. In this system, coincidence of odor-evoked calcium influx and dopaminergic input in the presynaptic terminals of Kenyon cells (KCs), the principal neurons of the MB, triggers long-term depression (LTD), which plays a critical role in olfactory learning. However, it is controversial whether such synaptic plasticity is accompanied by a corresponding decrease in odor-evoked calcium activity in the KC presynaptic terminals. Here, we address this question by inducing LTD by pairing odor presentation with optogenetic activation of dopaminergic neurons (DANs). This allows us to rigorously compare the changes at the presynaptic and postsynaptic sites in the same conditions. By imaging presynaptic acetylcholine release in the condition where LTD is reliably observed in the postsynaptic calcium signals, we show that neurotransmitter release from KCs is depressed selectively in the MB compartments innervated by activated DANs, demonstrating the presynaptic nature of LTD. However, total odor-evoked calcium activity of the KC axon bundles does not show concurrent depression. We further conduct calcium imaging in individual presynaptic boutons and uncover the highly heterogeneous nature of calcium plasticity. Namely, only a subset of boutons, which are strongly activated by associated odors, undergo calcium activity depression, while weakly responding boutons show potentiation. Thus, our results suggest an unexpected nonlinear relationship between presynaptic calcium influx and the results of plasticity, challenging the simple view of cooperative actions of presynaptic calcium and dopaminergic input.

Task-dependent optimal representations for cerebellar learning

The cerebellar granule cell layer has inspired numerous theoretical models of neural representations that support learned behaviors, beginning with the work of Marr and Albus. In these models, granule cells form a sparse, combinatorial encoding of diverse sensorimotor inputs. Such sparse representations are optimal for learning to discriminate random stimuli. However, recent observations of dense, low-dimensional activity across granule cells have called into question the role of sparse coding in these neurons. Here, we generalize theories of cerebellar learning to determine the optimal granule cell representation for tasks beyond random stimulus discrimination, including continuous input-output transformations as required for smooth motor control. We show that for such tasks, the optimal granule cell representation is substantially denser than predicted by classical theories. Our results provide a general theory of learning in cerebellum-like systems and suggest that optimal cerebellar representations are task-dependent.

Learning and memory using Drosophila melanogaster: a focus on advances made in the fifth decade of research

In the last decade, researchers using Drosophila melanogaster have made extraordinary progress in uncovering the mysteries underlying learning and memory. This progress has been propelled by the amazing toolkit available that affords combined behavioral, molecular, electrophysiological, and systems neuroscience approaches. The arduous reconstruction of electron microscopic images resulted in a first-generation connectome of the adult and larval brain, revealing complex structural interconnections between memory-related neurons. This serves as substrate for future investigations on these connections and for building complete circuits from sensory cue detection to changes in motor behavior. Mushroom body output neurons (MBOn) were discovered, which individually forward information from discrete and non-overlapping compartments of the axons of mushroom body neurons (MBn). These neurons mirror the previously discovered tiling of mushroom body axons by inputs from dopamine neurons and have led to a model that ascribes the valence of the learning event, either appetitive or aversive, to the activity of different populations of dopamine neurons and the balance of MBOn activity in promoting avoidance or approach behavior. Studies of the calyx, which houses the MBn dendrites, have revealed a beautiful microglomeruluar organization and structural changes of synapses that occur with long-term memory (LTM) formation. Larval learning has advanced, positioning it to possibly lead in producing new conceptual insights due to its markedly simpler structure over the adult brain. Advances were made in how cAMP response element-binding protein interacts with protein kinases and other transcription factors to promote the formation of LTM. New insights were made on Orb2, a prion-like protein that forms oligomers to enhance synaptic protein synthesis required for LTM formation. Finally, Drosophila research has pioneered our understanding of the mechanisms that mediate permanent and transient active forgetting, an important function of the brain along with acquisition, consolidation, and retrieval. This was catalyzed partly by the identification of memory suppressor genes-genes whose normal function is to limit memory formation.

A modular chemigenetic calcium indicator enables in vivo functional imaging with near-infrared light

Genetically encoded fluorescent calcium indicators have revolutionized neuroscience and other biological fields by allowing cellular-resolution recording of physiology during behavior. However, we currently lack bright, genetically targetable indicators in the near infrared that can be used in animals. Here, we describe WHaloCaMP, a modular chemigenetic calcium indicator built from bright dye-ligands and protein sensor domains that can be genetically targeted to specific cell populations. Fluorescence change in WHaloCaMP results from reversible quenching of the bound dye via a strategically placed tryptophan. WHaloCaMP is compatible with rhodamine dye-ligands that fluoresce from green to near-infrared, including several dye-ligands that efficiently label the central nervous system in animals. When bound to a near-infrared dye-ligand, WHaloCaMP1a is more than twice as bright as jGCaMP8s, and shows a 7× increase in fluorescence intensity and a 2.1 ns increase in fluorescence lifetime upon calcium binding. We use WHaloCaMP1a with near-infrared fluorescence emission to image Ca2+ responses in flies and mice, to perform three-color multiplexed functional imaging of hundreds of neurons and astrocytes in zebrafish larvae, and to quantitate calcium concentration using fluorescence lifetime imaging microscopy (FLIM).

Input density tunes Kenyon cell sensory responses in the Drosophila mushroom body

The ability to discriminate sensory stimuli with overlapping features is thought to arise in brain structures called expansion layers, where neurons carrying information about sensory features make combinatorial connections onto a much larger set of cells. For 50 years, expansion coding has been a prime topic of theoretical neuroscience, which seeks to explain how quantitative parameters of the expansion circuit influence sensory sensitivity, discrimination, and generalization. Here, we investigate the developmental events that produce the quantitative parameters of the arthropod expansion layer, called the mushroom body. Using Drosophila melanogaster as a model, we employ genetic and chemical tools to engineer changes to circuit development. These allow us to produce living animals with hypothesis-driven variations on natural expansion layer wiring parameters. We then test the functional and behavioral consequences. By altering the number of expansion layer neurons (Kenyon cells) and their dendritic complexity, we find that input density, but not cell number, tunes neuronal odor selectivity. Simple odor discrimination behavior is maintained when the Kenyon cell number is reduced and augmented by Kenyon cell number expansion. Animals with increased input density to each Kenyon cell show increased overlap in Kenyon cell odor responses and become worse at odor discrimination tasks.

Olfactory navigation in arthropods

Using odors to find food and mates is one of the most ancient and highly conserved behaviors. Arthropods from flies to moths to crabs use broadly similar strategies to navigate toward odor sources-such as integrating flow information with odor information, comparing odor concentration across sensors, and integrating odor information over time. Because arthropods share many homologous brain structures-antennal lobes for processing olfactory information, mechanosensors for processing flow, mushroom bodies (or hemi-ellipsoid bodies) for associative learning, and central complexes for navigation, it is likely that these closely related behaviors are mediated by conserved neural circuits. However, differences in the types of odors they seek, the physics of odor dispersal, and the physics of locomotion in water, air, and on substrates mean that these circuits must have adapted to generate a wide diversity of odor-seeking behaviors. In this review, we discuss common strategies and specializations observed in olfactory navigation behavior across arthropods, and review our current knowledge about the neural circuits subserving this behavior. We propose that a comparative study of arthropod nervous systems may provide insight into how a set of basic circuit structures has diversified to generate behavior adapted to different environments.

Gain modulation and odor concentration invariance in early olfactory networks

The broad receptive field of the olfactory receptors constitutes the basis of a combinatorial code that allows animals to detect and discriminate many more odorants than the actual number of receptor types that they express. One drawback is that high odor concentrations recruit lower affinity receptors which can lead to the perception of qualitatively different odors. Here we addressed the contribution that signal-processing in the antennal lobe makes to reduce concentration dependence in odor representation. By means of calcium imaging and pharmacological approach we describe the contribution that GABA receptors play in terms of the amplitude and temporal profiles of the signals that convey odor information from the antennal lobes to higher brain centers. We found that GABA reduces the amplitude of odor elicited signals and the number of glomeruli that are recruited in an odor-concentration-dependent manner. Blocking GABA receptors decreases the correlation among glomerular activity patterns elicited by different concentrations of the same odor. In addition, we built a realistic mathematical model of the antennal lobe that was used to test the viability of the proposed mechanisms and to evaluate the processing properties of the AL network under conditions that cannot be achieved in physiology experiments. Interestingly, even though based on a rather simple topology and cell interactions solely mediated by GABAergic lateral inhibitions, the AL model reproduced key features of the AL response upon different odor concentrations and provides plausible solutions for concentration invariant recognition of odors by artificial sensors.

Characterizing neural coding performance for populations of sensory neurons: comparing a weighted spike distance metrics to other analytical methods

The identity of sensory stimuli is encoded in the spatio-temporal patterns of responses of the encoding neural population. For stimuli to be discriminated reliably, differences in population responses must be accurately decoded by downstream networks. Several methods to compare patterns of responses have been used by neurophysiologists to characterize the accuracy of the sensory responses studied. Among the most widely used analyses, we note methods based on Euclidean distances or on spike metric distances. Methods based on artificial neural networks and machine learning that recognize and/or classify specific input patterns have also gained popularity. Here, we first compare these three strategies using datasets from three different model systems: the moth olfactory system, the electrosensory system of gymnotids, and leaky-integrate-and-fire (LIF) model responses. We show that the input-weighting procedure inherent to artificial neural networks allows the efficient extraction of information relevant to stimulus discrimination. To combine the convenience of methods such as spike metric distances but leverage the advantages of weighting the inputs, we propose a measure based on geometric distances where each dimension is weighted proportionally to how informative it is. We show that the result of this Weighted Euclidian Distance (WED) analysis performs as well or better than the artificial neural network we tested and outperforms the more traditional spike distance metrics. We applied information theoretic analysis to LIF responses and compared their encoding accuracy with the discrimination accuracy quantified through this WED analysis. We show a high degree of correlation between discrimination accuracy and information content, and that our weighting procedure allowed the efficient use of information present to perform the discrimination task. We argue that our proposed measure provides the flexibility and ease of use sought by neurophysiologists while providing a more powerful way to extract relevant information than more traditional methods.

The cellular architecture of memory modules in Drosophila supports stochastic input integration

The ability to associate neutral stimuli with valence information and to store these associations as memories forms the basis for decision making. To determine the underlying computational principles, we build a realistic computational model of a central decision module within the Drosophila mushroom body (MB), the fly's center for learning and memory. Our model combines the electron microscopy-based architecture of one MB output neuron (MBON-α3), the synaptic connectivity of its 948 presynaptic Kenyon cells (KCs), and its membrane properties obtained from patch-clamp recordings. We show that this neuron is electrotonically compact and that synaptic input corresponding to simulated odor input robustly drives its spiking behavior. Therefore, sparse innervation by KCs can efficiently control and modulate MBON activity in response to learning with minimal requirements on the specificity of synaptic localization. This architecture allows efficient storage of large numbers of memories using the flexible stochastic connectivity of the circuit.

Restructuring of olfactory representations in the fly brain around odor relationships in natural sources

A core challenge of olfactory neuroscience is to understand how neural representations of odor are generated and progressively transformed across different layers of the olfactory circuit into formats that support perception and behavior. The encoding of odor by odorant receptors in the input layer of the olfactory system reflects, at least in part, the chemical relationships between odor compounds. Neural representations of odor in higher order associative olfactory areas, generated by random feedforward networks, are expected to largely preserve these input odor relationships1-3. We evaluated these ideas by examining how odors are represented at different stages of processing in the olfactory circuit of the vinegar fly D. melanogaster. We found that representations of odor in the mushroom body (MB), a third-order associative olfactory area in the fly brain, are indeed structured and invariant across flies. However, the structure of MB representational space diverged significantly from what is expected in a randomly connected network. In addition, odor relationships encoded in the MB were better correlated with a metric of the similarity of their distribution across natural sources compared to their similarity with respect to chemical features, and the converse was true for odor relationships encoded in primary olfactory receptor neurons (ORNs). Comparison of odor coding at primary, secondary, and tertiary layers of the circuit revealed that odors were significantly regrouped with respect to their representational similarity across successive stages of olfactory processing, with the largest changes occurring in the MB. The non-linear reorganization of odor relationships in the MB indicates that unappreciated structure exists in the fly olfactory circuit, and this structure may facilitate the generalization of odors with respect to their co-occurence in natural sources.

A linear discriminant analysis model of imbalanced associative learning in the mushroom body compartment

To adapt to their environments, animals learn associations between sensory stimuli and unconditioned stimuli. In invertebrates, olfactory associative learning primarily occurs in the mushroom body, which is segregated into separate compartments. Within each compartment, Kenyon cells (KCs) encoding sparse odor representations project onto mushroom body output neurons (MBONs) whose outputs guide behavior. Associated with each compartment is a dopamine neuron (DAN) that modulates plasticity of the KC-MBON synapses within the compartment. Interestingly, DAN-induced plasticity of the KC-MBON synapse is imbalanced in the sense that it only weakens the synapse and is temporally sparse. We propose a normative mechanistic model of the MBON as a linear discriminant analysis (LDA) classifier that predicts the presence of an unconditioned stimulus (class identity) given a KC odor representation (feature vector). Starting from a principled LDA objective function and under the assumption of temporally sparse DAN activity, we derive an online algorithm which maps onto the mushroom body compartment. Our model accounts for the imbalanced learning at the KC-MBON synapse and makes testable predictions that provide clear contrasts with existing models.

SpaRCe: Improved Learning of Reservoir Computing Systems Through Sparse Representations

"Sparse" neural networks, in which relatively few neurons or connections are active, are common in both machine learning and neuroscience. While, in machine learning, "sparsity" is related to a penalty term that leads to some connecting weights becoming small or zero, in biological brains, sparsity is often created when high spiking thresholds prevent neuronal activity. Here, we introduce sparsity into a reservoir computing network via neuron-specific learnable thresholds of activity, allowing neurons with low thresholds to contribute to decision-making but suppressing information from neurons with high thresholds. This approach, which we term "SpaRCe," optimizes the sparsity level of the reservoir without affecting the reservoir dynamics. The read-out weights and the thresholds are learned by an online gradient rule that minimizes an error function on the outputs of the network. Threshold learning occurs by the balance of two opposing forces: reducing interneuronal correlations in the reservoir by deactivating redundant neurons, while increasing the activity of neurons participating in correct decisions. We test SpaRCe on classification problems and find that threshold learning improves performance compared to standard reservoir computing. SpaRCe alleviates the problem of catastrophic forgetting, a problem most evident in standard echo state networks (ESNs) and recurrent neural networks in general, due to increasing the number of task-specialized neurons that are included in the network decisions.

Hacking brain development to test models of sensory coding

Animals can discriminate myriad sensory stimuli but can also generalize from learned experience. You can probably distinguish the favorite teas of your colleagues while still recognizing that all tea pales in comparison to coffee. Tradeoffs between detection, discrimination, and generalization are inherent at every layer of sensory processing. During development, specific quantitative parameters are wired into perceptual circuits and set the playing field on which plasticity mechanisms play out. A primary goal of systems neuroscience is to understand how material properties of a circuit define the logical operations-computations--that it makes, and what good these computations are for survival. A cardinal method in biology-and the mechanism of evolution--is to change a unit or variable within a system and ask how this affects organismal function. Here, we make use of our knowledge of developmental wiring mechanisms to modify hard-wired circuit parameters in the Drosophila melanogaster mushroom body and assess the functional and behavioral consequences. By altering the number of expansion layer neurons (Kenyon cells) and their dendritic complexity, we find that input number, but not cell number, tunes odor selectivity. Simple odor discrimination performance is maintained when Kenyon cell number is reduced and augmented by Kenyon cell expansion.

Drosophila olfaction: past, present and future

Among the many wonders of nature, the sense of smell of the fly Drosophila melanogaster might seem, at first glance, of esoteric interest. Nevertheless, for over a century, the 'nose' of this insect has been an extraordinary system to explore questions in animal behaviour, ecology and evolution, neuroscience, physiology and molecular genetics. The insights gained are relevant for our understanding of the sensory biology of vertebrates, including humans, and other insect species, encompassing those detrimental to human health. Here, I present an overview of our current knowledge of D. melanogaster olfaction, from molecules to behaviours, with an emphasis on the historical motivations of studies and illustration of how technical innovations have enabled advances. I also highlight some of the pressing and long-term questions.

Input-timing-dependent plasticity at incoming synapses of the mushroom body facilitates olfactory learning in Drosophila

Aversive olfactory conditioning in Drosophila is a valuable model for elucidating the mechanism of associative learning. Much effort has centered around the role of neuroplasticity at the mushroom body (MB)-mushroom body output neuron (MBON) synapses in mapping odors to specific behaviors. By electrophysiological recordings from MB neurons, we discovered a form of input-timing-dependent plasticity at the incoming synapses from projection neurons that controls the efficacy of aversive olfactory memory formation. Importantly, this plasticity is facilitated by the neural activity of PPL1, the neuronal cluster that also modulates MB-MBON connections at the output stage of MB. Unlike the MB-MBON synapses that probably utilize dopamine D1-like receptors, this neuroplasticity is dependent on D2-like receptors that are expressed mainly by γ Kenyon cells noticeably in their somato-dendritic region. The D2-like receptors recruit voltage-gated calcium channels, leading to calcium influx in the soma and dendrites of γ neurons. Together, our results reveal a previously unrecognized synaptic component of the MB circuit architecture that not only could increase the salience of a conditioning odor but also couples the process of memory encoding and valency mapping to drive-associative learning.

Lateral axonal modulation is required for stimulus-specific olfactory conditioning in Drosophila

Effective and stimulus-specific learning is essential for animals' survival. Two major mechanisms are known to aid stimulus specificity of associative learning. One is accurate stimulus-specific representations in neurons. The second is a limited effective temporal window for the reinforcing signals to induce neuromodulation after sensory stimuli. However, these mechanisms are often imperfect in preventing unspecific associations; different sensory stimuli can be represented by overlapping populations of neurons, and more importantly, the reinforcing signals alone can induce neuromodulation even without coincident sensory-evoked neuronal activity. Here, we report a crucial neuromodulatory mechanism that counteracts both limitations and is thereby essential for stimulus specificity of learning. In Drosophila, olfactory signals are sparsely represented by cholinergic Kenyon cells (KCs), which receive dopaminergic reinforcing input. We find that KCs have numerous axo-axonic connections mediated by the muscarinic type-B receptor (mAChR-B). By using functional imaging and optogenetic approaches, we show that these axo-axonic connections suppress both odor-evoked calcium responses and dopamine-evoked cAMP signals in neighboring KCs. Strikingly, behavior experiments demonstrate that mAChR-B knockdown in KCs impairs olfactory learning by inducing undesired changes to the valence of an odor that was not associated with the reinforcer. Thus, this local neuromodulation acts in concert with sparse sensory representations and global dopaminergic modulation to achieve effective and accurate memory formation.

Pruning deep neural networks generates a sparse, bio-inspired nonlinear controller for insect flight

Insect flight is a strongly nonlinear and actuated dynamical system. As such, strategies for understanding its control have typically relied on either model-based methods or linearizations thereof. Here we develop a framework that combines model predictive control on an established flight dynamics model and deep neural networks (DNN) to create an efficient method for solving the inverse problem of flight control. We turn to natural systems for inspiration since they inherently demonstrate network pruning with the consequence of yielding more efficient networks for a specific set of tasks. This bio-inspired approach allows us to leverage network pruning to optimally sparsify a DNN architecture in order to perform flight tasks with as few neural connections as possible, however, there are limits to sparsification. Specifically, as the number of connections falls below a critical threshold, flight performance drops considerably. We develop sparsification paradigms and explore their limits for control tasks. Monte Carlo simulations also quantify the statistical distribution of network weights during pruning given initial random weights of the DNNs. We demonstrate that on average, the network can be pruned to retain a small amount of original network weights and still perform comparably to its fully-connected counterpart. The relative number of remaining weights, however, is highly dependent on the initial architecture and size of the network. Overall, this work shows that sparsely connected DNNs are capable of predicting the forces required to follow flight trajectories. Additionally, sparsification has sharp performance limits.

Structured sampling of olfactory input by the fly mushroom body

Associative memory formation and recall in the fruit fly Drosophila melanogaster is subserved by the mushroom body (MB). Upon arrival in the MB, sensory information undergoes a profound transformation from broadly tuned and stereotyped odorant responses in the olfactory projection neuron (PN) layer to narrowly tuned and nonstereotyped responses in the Kenyon cells (KCs). Theory and experiment suggest that this transformation is implemented by random connectivity between KCs and PNs. However, this hypothesis has been challenging to test, given the difficulty of mapping synaptic connections between large numbers of brain-spanning neurons. Here, we used a recent whole-brain electron microscopy volume of the adult fruit fly to map PN-to-KC connectivity at synaptic resolution. The PN-KC connectome revealed unexpected structure, with preponderantly food-responsive PN types converging at above-chance levels on downstream KCs. Axons of the overconvergent PN types tended to arborize near one another in the MB main calyx, making local KC dendrites more likely to receive input from those types. Overconvergent PN types preferentially co-arborize and connect with dendrites of αβ and α'β' KC subtypes. Computational simulation of the observed network showed degraded discrimination performance compared with a random network, except when all signal flowed through the overconvergent, primarily food-responsive PN types. Additional theory and experiment will be needed to fully characterize the impact of the observed non-random network structure on associative memory formation and recall.

Visualization of learning-induced synaptic plasticity in output neurons of the Drosophila mushroom body γ-lobe

By learning, through experience, which stimuli coincide with dangers, it is possible to predict outcomes and act pre-emptively to ensure survival. In insects, this process is localized to the mushroom body (MB), the circuitry of which facilitates the coincident detection of sensory stimuli and punishing or rewarding cues and, downstream, the execution of appropriate learned behaviors. Here, we focused our attention on the mushroom body output neurons (MBONs) of the γ-lobes that act as downstream synaptic partners of the MB γ-Kenyon cells (KCs) to ask how the output of the MB γ-lobe is shaped by olfactory associative conditioning, distinguishing this from non-associative stimulus exposure effects, and without the influence of downstream modulation. This was achieved by employing a subcellularly localized calcium sensor to specifically monitor activity at MBON postsynaptic sites. Therein, we identified a robust associative modulation within only one MBON postsynaptic compartment (MBON-γ1pedc > α/β), which displayed a suppressed postsynaptic response to an aversively paired odor. While this MBON did not undergo non-associative modulation, the reverse was true across the remainder of the γ-lobe, where general odor-evoked adaptation was observed, but no conditioned odor-specific modulation. In conclusion, associative synaptic plasticity underlying aversive olfactory learning is localized to one distinct synaptic γKC-to-γMBON connection.

Pairing-Dependent Plasticity in a Dissected Fly Brain Is Input-Specific and Requires Synaptic CaMKII Enrichment and Nighttime Sleep

In Drosophila, in vivo functional imaging studies revealed that associative memory formation is coupled to a cascade of neural plasticity events in distinct compartments of the mushroom body (MB). In-depth investigation of the circuit dynamics, however, will require an ex vivo model that faithfully mirrors these events to allow direct manipulations of circuit elements that are inaccessible in the intact fly. The current ex vivo models have been able to reproduce the fundamental plasticity of aversive short-term memory, a potentiation of the MB intrinsic neuron (Kenyon cells [KCs]) responses after artificial learning ex vivo However, this potentiation showed different localization and encoding properties from those reported in vivo and failed to generate the previously reported suppression plasticity in the MB output neurons (MBONs). Here, we develop an ex vivo model using the female Drosophila brain that recapitulates behaviorally evoked plasticity in the KCs and MBONs. We demonstrate that this plasticity accurately localizes to the MB α'3 compartment and is encoded by a coincidence between KC activation and dopaminergic input. The formed plasticity is input-specific, requiring pairing of the conditioned stimulus and unconditioned stimulus pathways; hence, we name it pairing-dependent plasticity. Pairing-dependent plasticity formation requires an intact CaMKII gene and is blocked by previous-night sleep deprivation but is rescued by rebound sleep. In conclusion, we show that our ex vivo preparation recapitulates behavioral and imaging results from intact animals and can provide new insights into mechanisms of memory formation at the level of molecules, circuits, and brain state.SIGNIFICANCE STATEMENT The mammalian ex vivo LTP model enabled in-depth investigation of the hippocampal memory circuit. We develop a parallel model to study the Drosophila mushroom body (MB) memory circuit. Pairing activation of the conditioned stimulus and unconditioned stimulus pathways in dissected brains induces a potentiation pairing-dependent plasticity (PDP) in the axons of α'β' Kenyon cells and a suppression PDP in the dendrites of their postsynaptic MB output neurons, localized in the MB α'3 compartment. This PDP is input-specific and requires the 3' untranslated region of CaMKII Interestingly, ex vivo PDP carries information about the animal's experience before dissection; brains from sleep-deprived animals fail to form PDP, whereas those from animals who recovered 2 h of their lost sleep form PDP.

Postsynaptic plasticity of cholinergic synapses underlies the induction and expression of appetitive and familiarity memories in Drosophila

In vertebrates, several forms of memory-relevant synaptic plasticity involve postsynaptic rearrangements of glutamate receptors. In contrast, previous work indicates that Drosophila and other invertebrates store memories using presynaptic plasticity of cholinergic synapses. Here, we provide evidence for postsynaptic plasticity at cholinergic output synapses from the Drosophila mushroom bodies (MBs). We find that the nicotinic acetylcholine receptor (nAChR) subunit α5 is required within specific MB output neurons for appetitive memory induction but is dispensable for aversive memories. In addition, nAChR α2 subunits mediate memory expression and likely function downstream of α5 and the postsynaptic scaffold protein discs large (Dlg). We show that postsynaptic plasticity traces can be induced independently of the presynapse, and that in vivo dynamics of α2 nAChR subunits are changed both in the context of associative and non-associative (familiarity) memory formation, underlying different plasticity rules. Therefore, regardless of neurotransmitter identity, key principles of postsynaptic plasticity support memory storage across phyla.

High-throughput automated methods for classical and operant conditioning of Drosophila larvae

Learning which stimuli (classical conditioning) or which actions (operant conditioning) predict rewards or punishments can improve chances of survival. However, the circuit mechanisms that underlie distinct types of associative learning are still not fully understood. Automated, high-throughput paradigms for studying different types of associative learning, combined with manipulation of specific neurons in freely behaving animals, can help advance this field. The Drosophila melanogaster larva is a tractable model system for studying the circuit basis of behaviour, but many forms of associative learning have not yet been demonstrated in this animal. Here, we developed a high-throughput (i.e. multi-larva) training system that combines real-time behaviour detection of freely moving larvae with targeted opto- and thermogenetic stimulation of tracked animals. Both stimuli are controlled in either open- or closed-loop, and delivered with high temporal and spatial precision. Using this tracker, we show for the first time that Drosophila larvae can perform classical conditioning with no overlap between sensory stimuli (i.e. trace conditioning). We also demonstrate that larvae are capable of operant conditioning by inducing a bend direction preference through optogenetic activation of reward-encoding serotonergic neurons. Our results extend the known associative learning capacities of Drosophila larvae. Our automated training rig will facilitate the study of many different forms of associative learning and the identification of the neural circuits that underpin them.

A non-canonical on-demand dopaminergic transmission underlying olfactory aversive learning

Dopamine (DA) is involved in various brain functions including associative learning. However, it is unclear how a small number of DA neurons appropriately regulates various brain functions. DA neurons have a large number of release sites and release DA non-specifically to a large number of target neurons in the projection area in response to the activity of DA neurons. In contrast to this "broad transmission", recent studies in Drosophila ex vivo functional imaging studies have identified "on-demand transmission" that occurs independent on activity of DA neurons and releases DA specifically onto the target neurons that have produced carbon monoxide (CO) as a retrograde signal for DA release. Whereas broad transmission modulates the global function of the target area, on-demand transmission is suitable for modulating the function of specific circuits, neurons, or synapses. In Drosophila olfactory aversive conditioning, odor and shock information are associated in the brain region called mushroom body (MB) to form olfactory aversive memory. It has been suggested that DA neurons projecting to the MB mediate the transmission of shock information and reinforcement simultaneously. However, the circuit model based on on-demand transmission proposes that transmission of shock information and reinforcement are mediated by distinct neural mechanisms; while shock transmission is glutamatergic, DA neurons mediates reinforcement. On-demand transmission provides mechanical insights into how DA neurons regulate various brain functions.

The anterior paired lateral neuron normalizes odour-evoked activity in the Drosophila mushroom body calyx

To identify and memorize discrete but similar environmental inputs, the brain needs to distinguish between subtle differences of activity patterns in defined neuronal populations. The Kenyon cells (KCs) of the Drosophila adult mushroom body (MB) respond sparsely to complex olfactory input, a property that is thought to support stimuli discrimination in the MB. To understand how this property emerges, we investigated the role of the inhibitory anterior paired lateral (APL) neuron in the input circuit of the MB, the calyx. Within the calyx, presynaptic boutons of projection neurons (PNs) form large synaptic microglomeruli (MGs) with dendrites of postsynaptic KCs. Combining electron microscopy (EM) data analysis and in vivo calcium imaging, we show that APL, via inhibitory and reciprocal synapses targeting both PN boutons and KC dendrites, normalizes odour-evoked representations in MGs of the calyx. APL response scales with the PN input strength and is regionalized around PN input distribution. Our data indicate that the formation of a sparse code by the KCs requires APL-driven normalization of their MG postsynaptic responses. This work provides experimental insights on how inhibition shapes sensory information representation in a higher brain centre, thereby supporting stimuli discrimination and allowing for efficient associative memory formation.

Compensatory variability in network parameters enhances memory performance in the Drosophila mushroom body

Neural circuits use homeostatic compensation to achieve consistent behavior despite variability in underlying intrinsic and network parameters. However, it remains unclear how compensation regulates variability across a population of the same type of neurons within an individual and what computational benefits might result from such compensation. We address these questions in the Drosophila mushroom body, the fly's olfactory memory center. In a computational model, we show that under sparse coding conditions, memory performance is degraded when the mushroom body's principal neurons, Kenyon cells (KCs), vary realistically in key parameters governing their excitability. However, memory performance is rescued while maintaining realistic variability if parameters compensate for each other to equalize KC average activity. Such compensation can be achieved through both activity-dependent and activity-independent mechanisms. Finally, we show that correlations predicted by our model's compensatory mechanisms appear in the Drosophila hemibrain connectome. These findings reveal compensatory variability in the mushroom body and describe its computational benefits for associative memory.