D1 dopamine receptor dDA1 is required in the mushroom body neurons for aversive and appetitive learning in Drosophila

Reinforcement signaling of punishment versus relief in fruit flies

Painful events establish opponent memories: cues that precede pain are remembered negatively, whereas cues that follow pain, thus coinciding with relief are recalled positively. How do individual reinforcement-signaling neurons contribute to this “timing-dependent valence-reversal?” We addressed this question using an optogenetic approach in the fruit fly. Two types of fly dopaminergic neuron, each comprising just one paired cell, indeed established learned avoidance of odors that preceded their photostimulation during training, and learned approach to odors that followed the photostimulation. This is in striking parallel to punishment versus relief memories reinforced by a real noxious event. For only one of these neuron types, both effects were strong enough for further analyses. Notably, interfering with dopamine biosynthesis in these neurons partially impaired the punishing effect, but not the relieving after-effect of their photostimulation. We discuss how this finding constraints existing computational models of punishment versus relief memories and introduce a new model, which also incorporates findings from mammals. Furthermore, whether using dopaminergic neuron photostimulation or a real noxious event, more prolonged punishment led to stronger relief. This parametric feature of relief may also apply to other animals and may explain particular aspects of related behavioral dysfunction in humans.

A Fly's Eye View of Natural and Drug Reward

Animals encounter multiple stimuli each day. Some of these stimuli are innately appetitive or aversive, while others are assigned valence based on experience. Drugs like ethanol can elicit aversion in the short term and attraction in the long term. The reward system encodes the predictive value for different stimuli, mediating anticipation for attractive or punishing stimuli and driving animal behavior to approach or avoid conditioned stimuli. The neurochemistry and neurocircuitry of the reward system is partly evolutionarily conserved. In both vertebrates and invertebrates, including Drosophila melanogaster, dopamine is at the center of a network of neurotransmitters and neuromodulators acting in concert to encode rewards. Behavioral assays in D. melanogaster have become increasingly sophisticated, allowing more direct comparison with mammalian research. Moreover, recent evidence has established the functional modularity of the reward neural circuits in Drosophila. This functional modularity resembles the organization of reward circuits in mammals. The powerful genetic and molecular tools for D. melanogaster allow characterization and manipulation at the single-cell level. These tools are being used to construct a detailed map of the neural circuits mediating specific rewarding stimuli and have allowed for the identification of multiple genes and molecular pathways that mediate the effects of reinforcing stimuli, including their rewarding effects. This report provides an overview of the research on natural and drug reward in D. melanogaster, including natural rewards such as sugar and other food nutrients, and drug rewards including ethanol, cocaine, amphetamine, methamphetamine, and nicotine. We focused mainly on the known genetic and neural mechanisms underlying appetitive reward for sugar and reward for ethanol. We also include genes, molecular pathways, and neural circuits that have been identified using assays that test the palatability of the rewarding stimulus, the preference for the rewarding stimulus, or other effects of the stimulus that indicate how it can modify behavior. Commonalities between mechanisms of natural and drug reward are highlighted and future directions are presented, putting forward questions best suited for research using D. melanogaster as a model organism.

Satiation state-dependent dopaminergic control of foraging in Drosophila

Hunger evokes stereotypic behaviors that favor the discovery of nutrients. The neural pathways that coordinate internal and external cues to motivate foraging behaviors are only partly known. Drosophila that are food deprived increase locomotor activity, are more efficient in locating a discrete source of nutrition, and are willing to overcome adversity to obtain food. We developed a simple open field assay that allows flies to freely perform multiple steps of the foraging sequence, and we show that two distinct dopaminergic neural circuits regulate measures of foraging behaviors. One group, the PAM neurons, functions in food deprived flies while the other functions in well fed flies, and both promote foraging. These satiation state-dependent circuits converge on dopamine D1 receptor-expressing Kenyon cells of the mushroom body, where neural activity promotes foraging independent of satiation state. These findings provide evidence for active foraging in well-fed flies that is separable from hunger-driven foraging.

The neurobiological basis of sleep: Insights from Drosophila

Sleep is a biological enigma that has raised numerous questions about the inner workings of the brain. The fundamental question of why our nervous systems have evolved to require sleep remains a topic of ongoing scientific deliberation. This question is largely being addressed by research using animal models of sleep. Drosophila melanogaster, also known as the common fruit fly, exhibits a sleep state that shares common features with many other species. Drosophila sleep studies have unearthed an immense wealth of knowledge about the neuroscience of sleep. Given the breadth of findings published on Drosophila sleep, it is important to consider how all of this information might come together to generate a more holistic understanding of sleep. This review provides a comprehensive summary of the neurobiology of Drosophila sleep and explores the broader insights and implications of how sleep is regulated across species and why it is necessary for the brain.

Neural Control of Startle-Induced Locomotion by the Mushroom Bodies and Associated Neurons in Drosophila

Startle-induced locomotion is commonly used in Drosophila research to monitor locomotor reactivity and its progressive decline with age or under various neuropathological conditions. A widely used paradigm is startle-induced negative geotaxis (SING), in which flies entrapped in a narrow column react to a gentle mechanical shock by climbing rapidly upwards. Here we combined in vivo manipulation of neuronal activity and splitGFP reconstitution across cells to search for brain neurons and putative circuits that regulate this behavior. We show that the activity of specific clusters of dopaminergic neurons (DANs) afferent to the mushroom bodies (MBs) modulates SING, and that DAN-mediated SING regulation requires expression of the DA receptor Dop1R1/Dumb, but not Dop1R2/Damb, in intrinsic MB Kenyon cells (KCs). We confirmed our previous observation that activating the MB α'β', but not αβ, KCs decreased the SING response, and we identified further MB neurons implicated in SING control, including KCs of the γ lobe and two subtypes of MB output neurons (MBONs). We also observed that co-activating the αβ KCs antagonizes α'β' and γ KC-mediated SING modulation, suggesting the existence of subtle regulation mechanisms between the different MB lobes in locomotion control. Overall, this study contributes to an emerging picture of the brain circuits modulating locomotor reactivity in Drosophila that appear both to overlap and differ from those underlying associative learning and memory, sleep/wake state and stress-induced hyperactivity.

Dop1 enhances conspecific olfactory attraction by inhibiting miR-9a maturation in locusts

Dopamine receptor 1 (Dop1) mediates locust attraction behaviors, however, the mechanism by which Dop1 modulates this process remains unknown to date. Here, we identify differentially expressed small RNAs associated with locust olfactory attraction after activating and inhibiting Dop1. Small RNA transcriptome analysis and qPCR validation reveal that Dop1 activation and inhibition downregulates and upregulates microRNA-9a (miR-9a) expression, respectively. miR-9a knockdown in solitarious locusts increases their attraction to gregarious volatiles, whereas miR-9a overexpression in gregarious locusts reduces olfactory attraction. Moreover, miR-9a directly targets adenylyl cyclase 2 (ac2), causing its downregulation at the mRNA and protein levels. ac2 responds to Dop1 and mediates locust olfactory attraction. Mechanistically, Dop1 inhibits miR-9a expression through inducing the dissociation of La protein from pre-miR-9a and resulting in miR-9a maturation inhibition. Our results reveal a Dop1–miR-9a–AC2 circuit that modulates locust olfactory attraction underlying aggregation. This study suggests that miRNAs act as key messengers in the GPCR signaling.

Migratory locusts shift between aggregating together during gregarious phases and living individually during solitary phases. Here, the authors find that the D1-like dopamine receptor regulates the olfactory attraction underlying this behavioral switch via microRNA-9a and adenylyl cyclase.

Functional architecture of reward learning in mushroom body extrinsic neurons of larval Drosophila

The brain adaptively integrates present sensory input, past experience, and options for future action. The insect mushroom body exemplifies how a central brain structure brings about such integration. Here we use a combination of systematic single-cell labeling, connectomics, transgenic silencing, and activation experiments to study the mushroom body at single-cell resolution, focusing on the behavioral architecture of its input and output neurons (MBINs and MBONs), and of the mushroom body intrinsic APL neuron. Our results reveal the identity and morphology of almost all of these 44 neurons in stage 3 Drosophila larvae. Upon an initial screen, functional analyses focusing on the mushroom body medial lobe uncover sparse and specific functions of its dopaminergic MBINs, its MBONs, and of the GABAergic APL neuron across three behavioral tasks, namely odor preference, taste preference, and associative learning between odor and taste. Our results thus provide a cellular-resolution study case of how brains organize behavior.

Drosophila mushroom bodies integrate hunger and satiety signals to control innate food-seeking behavior

The fruit fly can evaluate its energy state and decide whether to pursue food-related cues. Here, we reveal that the mushroom body (MB) integrates hunger and satiety signals to control food-seeking behavior. We have discovered five pathways in the MB essential for hungry flies to locate and approach food. Blocking the MB-intrinsic Kenyon cells (KCs) and the MB output neurons (MBONs) in these pathways impairs food-seeking behavior. Starvation bi-directionally modulates MBON responses to a food odor, suggesting that hunger and satiety controls occur at the KC-to-MBON synapses. These controls are mediated by six types of dopaminergic neurons (DANs). By manipulating these DANs, we could inhibit food-seeking behavior in hungry flies or promote food seeking in fed flies. Finally, we show that the DANs potentially receive multiple inputs of hunger and satiety signals. This work demonstrates an information-rich central circuit in the fly brain that controls hunger-driven food-seeking behavior.

Neural, Cellular and Molecular Mechanisms of Active Forgetting

The neurobiology of memory formation attracts much attention in the last five decades. Conversely, the rules that govern and the mechanisms underlying forgetting are less understood. In addition to retroactive interference, retrieval-induced forgetting and passive decay of time, it has been recently demonstrated that the nervous system has a diversity of active and inherent processes involved in forgetting. In Drosophila, some operate mainly at an early stage of memory formation and involves dopamine (DA) neurons, specific postsynaptic DA receptor subtypes, Rac1 activation and induces rapid active forgetting. In mammals, others regulate forgetting and persistence of seemingly consolidated memories and implicate the activity of DA receptor subtypes and AMPA receptors in the hippocampus (HP) and related structures to activate parallel signaling pathways controlling active time-dependent forgetting. Most of them may involve plastic changes in synaptic and extrasynaptic receptors including specific removal of GluA2 AMPA receptors. Forgetting at longer timescales might also include changes in adult neurogenesis in the dentate gyrus (DG) of the HP. Therefore, based on relevance or value considerations neuronal circuits may regulate in a time-dependent manner what is formed, stored, and maintained and what is forgotten.

The Post-mating Switch in the Pheromone Response of Nasonia Females Is Mediated by Dopamine and Can Be Reversed by Appetitive Learning

The olfactory sense is of crucial importance for animals, but their response to chemical stimuli is plastic and depends on their physiological state and prior experience. In many insect species, mating status influences the response to sex pheromones, but the underlying neuromodulatory mechanisms are poorly understood. After mating, females of the parasitic wasp Nasonia vitripennis are no longer attracted to the male sex pheromone. Here we show that this post-mating behavioral switch is mediated by dopamine (DA). Females fed a DA-receptor antagonist prior to mating maintained their attraction to the male pheromone after mating while virgin females injected with DA became unresponsive. However, the switch is reversible as mated females regained their pheromone preference after appetitive learning. Feeding mated N. vitripennis females with antagonists of either octopamine- (OA) or DA-receptors prevented relearning of the pheromone preference suggesting that both receptors are involved in appetitive learning. Moreover, DA injection into mated females was sufficient to mimic the oviposition reward during odor conditioning with the male pheromone. Our data indicate that DA plays a key role in the plastic pheromone response of N. vitripennis females and reveal some striking parallels between insects and mammals in the neuromodulatory mechanisms underlying olfactory plasticity.

Persistent activity in a recurrent circuit underlies courtship memory in Drosophila

Recurrent connections are thought to be a common feature of the neural circuits that encode memories, but how memories are laid down in such circuits is not fully understood. Here we present evidence that courtship memory in Drosophila relies on the recurrent circuit between mushroom body gamma (MBγ), M6 output, and aSP13 dopaminergic neurons. We demonstrate persistent neuronal activity of aSP13 neurons and show that it transiently potentiates synaptic transmission from MBγ>M6 neurons. M6 neurons in turn provide input to aSP13 neurons, prolonging potentiation of MBγ>M6 synapses over time periods that match short-term memory. These data support a model in which persistent aSP13 activity within a recurrent circuit lays the foundation for a short-term memory.

Memories help to shape behavior, and can last from a few seconds to an entire lifetime. Working memory, in which information is temporarily held available for use in an ongoing task, is the most fleeting form of memory. It relies on persistent activation of a network of nerve cells or neurons that represent the information in question. Strengthening the connections between those neurons may result in a longer-lasting memory. But the mechanisms that support the formation of memories of different durations are not fully understood.

Zhao et al. have now explored these mechanisms in the fruit fly by studying memory for courtship behavior. Inexperienced male fruit flies will attempt to court both virgin females and females who have recently mated. But the latter reject courtship attempts, and male fruit flies therefore learn to avoid them. This is known as courtship memory, and it relies on a network of neurons within a region of the fruit fly brain called the mushroom body.

Within the mushroom body, dopamine neuron sends signals to a neuron called the Kenyon cell, which in turn sends signals to a mushroom body output neuron. The latter activates circuits responsible for decision-making and movement. But it also activates the dopamine neuron, thereby forming a recurrent circuit or loop. When the courtship is rejected, the dopamine neuron becomes persistently active, which generates a working memory of the experience. If the circuit is activated again during this period of persistent firing, the working memory may be converted into a longer-lasting memory.

The results of Zhao et al. provide insights into the mechanisms by which memories form and undergo strengthening. They suggest that distinct processes within a single neural circuit give rise to memories of different durations. Recurrent loops are also present within the brains of mammals. Similar processes may thus support the formation and persistence of our own memories.

Visual discrimination transfer and modulation by biogenic amines in honeybees

For more than a century, visual learning and memory has been studied in the honeybee Apis mellifera using operant appetitive conditioning. Although honeybees show impressive visual learning capacities in this well-established protocol, operant training of free-flying animals can hardly be combined with invasive protocols for studying the neurobiological basis of visual learning. In view of that, different efforts have been made to develop new classical conditioning protocols for studying visual learning in harnessed honeybees, though learning performances remain considerably poorer than those obtained in free-flying animals. Here we investigated the ability of honeybees to use visual information acquired during classical conditioning in a new operant context. We performed differential visual conditioning of the proboscis extension reflex (PER) followed by visual orientation tests in Y-maze. Classical conditioning and Y-maze retention tests were performed using a same pair of perceptually isoluminant monochromatic stimuli, to avoid the influence of phototaxis during free-flying orientation. Visual discrimination transfer was clearly observed, with pre-trained honeybees significantly orienting their flights towards the former positive conditioned stimulus (CS+). We thus show that visual memories acquired by honeybees are resistant to context changes between conditioning and retention test. We combined this visual discrimination approach with selective pharmacological injections to evaluate the effect of dopamine and octopamine in appetitive visual learning. Both octopaminergic and dopaminergic antagonists impaired visual discrimination performances, suggesting that both these biogenic amines modulate appetitive visual learning in honeybees. Our study brings new insights into cognitive and neurobiological mechanisms underlying visual learning in honeybees.

Cyclic AMP-dependent plasticity underlies rapid changes in odor coding associated with reward learning

Learning and memory rely on dopamine and downstream cAMP-dependent plasticity across diverse organisms. Despite the central role of cAMP signaling, it is not known how cAMP-dependent plasticity drives coherent changes in neuronal physiology that encode the memory trace, or engram. In Drosophila, the mushroom body (MB) is critically involved in olfactory classical conditioning, and cAMP signaling molecules are necessary and sufficient for normal memory in intrinsic MB neurons. To evaluate the role of cAMP-dependent plasticity in learning, we examined how cAMP manipulations and olfactory classical conditioning modulate olfactory responses in the MB with in vivo imaging. Elevating cAMP pharmacologically or optogenetically produced plasticity in MB neurons, altering their responses to odorants. Odor-evoked Ca²⁺ responses showed net facilitation across anatomical regions. At the single-cell level, neurons exhibited heterogeneous responses to cAMP elevation, suggesting that cAMP drives plasticity to discrete subsets of MB neurons. Olfactory appetitive conditioning enhanced MB odor responses, mimicking the cAMP-dependent plasticity in directionality and magnitude. Elevating cAMP to equivalent levels as appetitive conditioning also produced plasticity, suggesting that the cAMP generated during conditioning affects odor-evoked responses in the MB. Finally, we found that this plasticity was dependent on the Rutabaga type I adenylyl cyclase, linking cAMP-dependent plasticity to behavioral modification. Overall, these data demonstrate that learning produces robust cAMP-dependent plasticity in intrinsic MB neurons, which is biased toward naturalistic reward learning. This suggests that cAMP signaling may serve to modulate intrinsic MB responses toward salient stimuli.

Reward from bugs to bipeds: a comparative approach to understanding how reward circuits function

In a complex environment, animals learn from their responses to stimuli and events. Appropriate response to reward and punishment can promote survival, reproduction and increase evolutionary fitness. Interestingly, the neural processes underlying these responses are remarkably similar across phyla. In all species, dopamine is central to encoding reward and directing motivated behaviors, however, a comprehensive understanding of how circuits encode reward and direct motivated behaviors is still lacking. In part, this is a result of the sheer diversity of neurons, the heterogeneity of their responses and the complexity of neural circuits within which they are found. We argue that general features of reward circuitry are common across model organisms, and thus principles learned from invertebrate model organisms can inform research across species. In particular, we discuss circuit motifs that appear to be functionally equivalent from flies to primates. We argue that a comparative approach to studying and understanding reward circuit function provides a more comprehensive understanding of reward circuitry, and informs disorders that affect the brain’s reward circuitry.

Roles of Octopamine and Dopamine Neurons for Mediating Appetitive and Aversive Signals in Pavlovian Conditioning in Crickets

Revealing neural systems that mediate appetite and aversive signals in associative learning is critical for understanding the brain mechanisms controlling adaptive behavior in animals. In mammals, it has been shown that some classes of dopamine neurons in the midbrain mediate prediction error signals that govern the learning process, whereas other classes of dopamine neurons control execution of learned actions. In this review, based on the results of our studies on Pavlovian conditioning in the cricket Gryllus bimaculatus and by referring to the findings in honey bees and fruit-flies, we argue that comparable aminergic systems exist in the insect brain. We found that administrations of octopamine (the invertebrate counterpart of noradrenaline) and dopamine receptor antagonists impair conditioning to associate an olfactory or visual conditioned stimulus (CS) with water or sodium chloride solution (appetitive or aversive unconditioned stimulus, US), respectively, suggesting that specific octopamine and dopamine neurons mediate appetitive and aversive signals, respectively, in conditioning in crickets. These findings differ from findings in fruit-flies. In fruit-flies, appetitive and aversive signals are mediated by different dopamine neuron subsets, suggesting diversity in neurotransmitters mediating appetitive signals in insects. We also found evidences of “blocking” and “auto-blocking” phenomena, which suggested that the prediction error, the discrepancy between actual US and predicted US, governs the conditioning in crickets and that octopamine neurons mediate prediction error signals for appetitive US. Our studies also showed that activations of octopamine and dopamine neurons are needed for the execution of an appetitive conditioned response (CR) and an aversive CR, respectively, and we, thus, proposed that these neurons mediate US prediction signals that drive appetitive and aversive CRs. Our findings suggest that the basic principles of functioning of aminergic systems in associative learning, i.e., to transmit prediction error signals for conditioning and to convey US prediction signals for execution of CR, are conserved among insects and mammals, on account of the fact that the organization of the insect brain is much simpler than that of the mammalian brain. Further investigation of aminergic systems that govern associative learning in insects should lead to a better understanding of commonalities and diversities of computational rules underlying associative learning in animals.

A simple high throughput assay to evaluate water consumption in the fruit fly

Water intake is essential for survival and thus under strong regulation. Here, we describe a simple high throughput system to monitor water intake over time in Drosophila. The design of the assay involves dehydrating fly food and then adding water back separately so flies either eat or drink. Water consumption is then evaluated by weighing the water vessel and comparing this back to an evaporation control. Our system is high throughput, does not require animals to be artificially dehydrated, and is simple both in design and implementation. Initial characterisation of homeostatic water consumption shows high reproducibility between biological replicates in a variety of experimental conditions. Water consumption was dependent on ambient temperature and humidity and was equal between sexes when corrected for mass. By combining this system with the Drosophila genetics tools, we could confirm a role for ppk28 and DopR1 in promoting water consumption, and through functional investigation of RNAseq data from dehydrated animals, we found DopR1 expression in the mushroom body was sufficient to drive consumption and enhance water taste sensitivity. Together, we provide a simple high throughput water consumption assay that can be used to dissect the cellular and molecular machinery regulating water homeostasis in Drosophila.

Roles of dopamine neurons in mediating the prediction error in aversive learning in insects

In associative learning in mammals, it is widely accepted that the discrepancy, or error, between actual and predicted reward determines whether learning occurs. The prediction error theory has been proposed to account for the finding of a blocking phenomenon, in which pairing of a stimulus X with an unconditioned stimulus (US) could block subsequent association of a second stimulus Y to the US when the two stimuli were paired in compound with the same US. Evidence for this theory, however, has been imperfect since blocking can also be accounted for by competitive theories. We recently reported blocking in classical conditioning of an odor with water reward in crickets. We also reported an "auto-blocking" phenomenon in appetitive learning, which supported the prediction error theory and rejected alternative theories. The presence of auto-blocking also suggested that octopamine neurons mediate reward prediction error signals. Here we show that blocking and auto-blocking occur in aversive learning to associate an odor with salt water (US) in crickets, and our results suggest that dopamine neurons mediate aversive prediction error signals. We conclude that the prediction error theory is applicable to both appetitive learning and aversive learning in insects.

The mushroom body D1 dopamine receptor controls innate courtship drive

Mating is critical for species survival and is profoundly regulated by neuromodulators and neurohormones to accommodate internal states and external factors. To identify the underlying neuromodulatory mechanisms, we investigated the roles of dopamine receptors in various aspects of courtship behavior in Drosophila. Here, we report that the D1 dopamine receptor dDA1 regulates courtship drive in naïve males. The wild‐type naïve males actively courted females regardless their appearance or mating status. On the contrary, the dDA1 mutant (dumb) males exhibited substantially reduced courtship toward less appealing females including decapitated, leg‐less and mated females. The dumb male's reduced courtship activity was due to delay in courtship initiation and prolonged intervals between courtship bouts. The dampened courtship drive of dumb males was rescued by reinstated dDA1 expression in the mushroom body α/β and γ neurons but not α/β or γ neurons alone, which is distinct from the previously characterized dDA1 functions in experience‐dependent courtship or other learning and memory processes. We also found that the dopamine receptors dDA1, DAMB and dD2R are dispensable for associative memory formation and short‐term memory of conditioned courtship, thus courtship motivation and associative courtship learning and memory are regulated by distinct neuromodulatory mechanisms. Taken together, our study narrows the gap in the knowledge of the mechanism that dopamine regulates male courtship behavior.

The Biology of Forgetting-A Perspective

Pioneering research studies, beginning with those using Drosophila, have identified several molecular and cellular mechanisms for active forgetting. The currently known mechanisms for active forgetting include neurogenesis-based forgetting, interference-based forgetting, and intrinsic forgetting, the latter term describing the brain's chronic signaling systems that function to slowly degrade molecular and cellular memory traces. The best-characterized pathway for intrinsic forgetting includes "forgetting cells" that release dopamine onto engram cells, mobilizing a signaling pathway that terminates in the activation of Rac1/Cofilin to effect changes in the actin cytoskeleton and neuron/synapse structure. Intrinsic forgetting may be the default state of the brain, constantly promoting memory erasure and competing with processes that promote memory stability like consolidation. A better understanding of active forgetting will provide insights into the brain's memory management system and human brain disorders that alter active forgetting mechanisms.

Behavioral Sensitization to the Disinhibition Effect of Ethanol Requires the Dopamine/Ecdysone Receptor in Drosophila

Male flies under the influence of ethanol display disinhibited courtship, which is augmented with repeated ethanol exposures. We have previously shown that dopamine is important for this type of ethanol-induced behavioral sensitization but the underlying mechanism is unknown. Here we report that DopEcR, an insect G-protein coupled receptor that binds to dopamine and steroid hormone ecdysone, is a major receptor mediating courtship sensitization. Upon daily ethanol administration, dumb and damb mutant males defective in D1 (dDA1/DopR1) and D5 (DAMB/DopR2) dopamine receptors, respectively, showed normal courtship sensitization; however, the DopEcR-deficient der males exhibited greatly diminished sensitization. der mutant males nevertheless developed normal tolerance to the sedative effect of ethanol, indicating a selective function of DopEcR in chronic ethanol-associated behavioral plasticity. DopEcR plays a physiological role in behavioral sensitization since courtship sensitization in der males was reinstated when DopEcR expression was induced during adulthood but not during development. When examined for the DopEcR’s functional site, the der mutant’s sensitization phenotype was fully rescued by restored DopEcR expression in the mushroom body (MB) αβ and γ neurons. Consistently, we observed DopEcR immunoreactivity in the MB calyx and lobes in the wild-type Canton-S brain, which was barely detectable in the der brain. Behavioral sensitization to the locomotor-stimulant effect has been serving as a model for ethanol abuse and addiction. This is the first report elucidating the mechanism underlying behavioral sensitization to another stimulant effect of ethanol.

A connectome of a learning and memory center in the adult Drosophila brain

Understanding memory formation, storage and retrieval requires knowledge of the underlying neuronal circuits. In Drosophila, the mushroom body (MB) is the major site of associative learning. We reconstructed the morphologies and synaptic connections of all 983 neurons within the three functional units, or compartments, that compose the adult MB’s α lobe, using a dataset of isotropic 8 nm voxels collected by focused ion-beam milling scanning electron microscopy. We found that Kenyon cells (KCs), whose sparse activity encodes sensory information, each make multiple en passant synapses to MB output neurons (MBONs) in each compartment. Some MBONs have inputs from all KCs, while others differentially sample sensory modalities. Only 6% of KC>MBON synapses receive a direct synapse from a dopaminergic neuron (DAN). We identified two unanticipated classes of synapses, KC>DAN and DAN>MBON. DAN activation produces a slow depolarization of the MBON in these DAN>MBON synapses and can weaken memory recall.

DOI:http://dx.doi.org/10.7554/eLife.26975.001

Circuit Analysis of a Drosophila Dopamine Type 2 Receptor That Supports Anesthesia-Resistant Memory

Dopamine is central to reinforcement processing and exerts this function in species ranging from humans to fruit flies. It can do so via two different types of receptors (i.e., D1 or D2) that mediate either augmentation or abatement of cellular cAMP levels. Whereas D1 receptors are known to contribute to Drosophila aversive odor learning per se, we here show that D2 receptors are specific for support of a consolidated form of odor memory known as anesthesia-resistant memory. By means of genetic mosaicism, we localize this function to Kenyon cells, the mushroom body intrinsic neurons, as well as GABAergic APL neurons and local interneurons of the antennal lobes, suggesting that consolidated anesthesia-resistant memory requires widespread dopaminergic modulation within the olfactory circuit. Additionally, dopaminergic neurons themselves require D2R, suggesting a critical role in dopamine release via its recognized autoreceptor function. Considering the dual role of dopamine in balancing memory acquisition (proactive function of dopamine) and its "forgetting" (retroactive function of dopamine), our analysis suggests D2R as central player of either process.

SIGNIFICANCE STATEMENT

Dopamine provides different information; while it mediates reinforcement during the learning act (proactive function), it balances memory performance between two antithetic processes thereafter (retroactive function) (i.e., forgetting and augmentation). Such bidirectional design can also be found at level of dopamine receptors, where augmenting D1 and abating D2 receptors are engaged to balance cellular cAMP levels. Here, we report that consolidated anesthesia-resistant memory (ARM), but not other concomitant memory phases, are sensitive to bidirectional dopaminergic signals. By means of genetic mosaicism, we identified widespread dopaminergic modulation within the olfactory circuit that suggests nonredundant and reiterating functions of D2R in support of ARM. Our results oppose ARM to its concomitant memory phases that localize to mushroom bodies and propose a decentralized organization of consolidated ARM.

Trace Conditioning in Drosophila Induces Associative Plasticity in Mushroom Body Kenyon Cells and Dopaminergic Neurons

Dopaminergic neurons (DANs) signal punishment and reward during associative learning. In mammals, DANs show associative plasticity that correlates with the discrepancy between predicted and actual reinforcement (prediction error) during classical conditioning. Also in insects, such as Drosophila, DANs show associative plasticity that is, however, less understood. Here, we study associative plasticity in DANs and their synaptic partners, the Kenyon cells (KCs) in the mushroom bodies (MBs), while training Drosophila to associate an odorant with a temporally separated electric shock (trace conditioning). In most MB compartments DANs strengthened their responses to the conditioned odorant relative to untrained animals. This response plasticity preserved the initial degree of similarity between the odorant- and the shock-induced spatial response patterns, which decreased in untrained animals. Contrary to DANs, KCs (α'/β'-type) decreased their responses to the conditioned odorant relative to untrained animals. We found no evidence for prediction error coding by DANs during conditioning. Rather, our data supports the hypothesis that DAN plasticity encodes conditioning-induced changes in the odorant's predictive power.

Upregulated energy metabolism in the Drosophila mushroom body is the trigger for long-term memory

Efficient energy use has constrained the evolution of nervous systems. However, it is unresolved whether energy metabolism may resultantly regulate major brain functions. Our observation that Drosophila flies double their sucrose intake at an early stage of long-term memory formation initiated the investigation of how energy metabolism intervenes in this process. Cellular-resolution imaging of energy metabolism reveals a concurrent elevation of energy consumption in neurons of the mushroom body, the fly's major memory centre. Strikingly, upregulation of mushroom body energy flux is both necessary and sufficient to drive long-term memory formation. This effect is triggered by a specific pair of dopaminergic neurons afferent to the mushroom bodies, via the D5-like DAMB dopamine receptor. Hence, dopamine signalling mediates an energy switch in the mushroom body that controls long-term memory encoding. Our data thus point to an instructional role for energy flux in the execution of demanding higher brain functions.

Energy consumption in the brain is thought to respond to changes in neuronal activity, without informational role. Here the authors show that increased energy flux in the mushroom body, driven by a pair of input dopaminergic neurons, is a command for the formation of long-term memory in Drosophila.

Modulation of neuronal activity in the Drosophila mushroom body by DopEcR, a unique dual receptor for ecdysone and dopamine

G-protein-coupled receptors (GPCRs) for steroid hormones mediate unconventional steroid signaling and play a significant role in the rapid actions of steroids in a variety of biological processes, including those in the nervous system. However, the effects of these GPCRs on overall neuronal activity remain largely elusive. Drosophila DopEcR is a GPCR that responds to both ecdysone (the major steroid hormone in insects) and dopamine, regulating multiple second messenger systems. Recent studies have revealed that DopEcR is preferentially expressed in the nervous system and involved in behavioral regulation. Here we utilized the bioluminescent Ca²⁺-indicator GFP-aequorin to monitor the nicotine-induced Ca²⁺-response within the mushroom bodies (MB), a higher-order brain center in flies, and examined how DopEcR modulates these Ca²⁺-dynamics. Our results show that in DopEcR knockdown flies, the nicotine-induced Ca²⁺-response in the MB was significantly enhanced selectively in the medial lobes. We then reveal that application of DopEcR's ligands, ecdysone and dopamine, had different effects on nicotine-induced Ca²⁺-responses in the MB: ecdysone enhanced activity in the calyx and cell body region in a DopEcR-dependent manner, whereas dopamine reduced activity in the medial lobes independently of DopEcR. Finally, we show that flies with reduced DopEcR function in the MB display decreased locomotor activity. This behavioral phenotype of DopEcR-deficient flies may be partly due to their enhanced MB activity, since the MB have been implicated in the suppression of locomotor activity. Overall, these data suggest that DopEcR is involved in region-specific modulation of Ca²⁺ dynamics within the MB, which may play a role in behavioral modulation.

Reciprocal synapses between mushroom body and dopamine neurons form a positive feedback loop required for learning

Current thought envisions dopamine neurons conveying the reinforcing effect of the unconditioned stimulus during associative learning to the axons of Drosophila mushroom body Kenyon cells for normal olfactory learning. Here, we show using functional GFP reconstitution experiments that Kenyon cells and dopamine neurons from axoaxonic reciprocal synapses. The dopamine neurons receive cholinergic input via nicotinic acetylcholine receptors from the Kenyon cells; knocking down these receptors impairs olfactory learning revealing the importance of these receptors at the synapse. Blocking the synaptic output of Kenyon cells during olfactory conditioning reduces presynaptic calcium transients in dopamine neurons, a finding consistent with reciprocal communication. Moreover, silencing Kenyon cells decreases the normal chronic activity of the dopamine neurons. Our results reveal a new and critical role for positive feedback onto dopamine neurons through reciprocal connections with Kenyon cells for normal olfactory learning.

DOI:http://dx.doi.org/10.7554/eLife.23789.001

What can tiny mushrooms in fruit flies tell us about learning and memory?

Nervous systems have evolved to translate external stimuli into appropriate behavioral responses. In an ever-changing environment, flexible adjustment of behavioral choice by experience-dependent learning is essential for the animal's survival. Associative learning is a simple form of learning that is widely observed from worms to humans. To understand the whole process of learning, we need to know how sensory information is represented and transformed in the brain, how it is changed by experience, and how the changes are reflected on motor output. To tackle these questions, studying numerically simple invertebrate nervous systems has a great advantage. In this review, I will feature the Pavlovian olfactory learning in the fruit fly, Drosophila melanogaster. The mushroom body is a key brain area for the olfactory learning in this organism. Recently, comprehensive anatomical information and the genetic tool sets were made available for the mushroom body circuit. This greatly accelerated the physiological understanding of the learning process. One of the key findings was dopamine-induced long-term synaptic plasticity that can alter the representations of stimulus valence. I will mostly focus on the new studies within these few years and discuss what we can possibly learn about the vertebrate systems from this model organism.

Coincident postsynaptic activity gates presynaptic dopamine release to induce plasticity in Drosophila mushroom bodies

Simultaneous stimulation of the antennal lobes (ALs) and the ascending fibers of the ventral nerve cord (AFV), two sensory inputs to the mushroom bodies (MBs), induces long-term enhancement (LTE) of subsequent AL-evoked MB responses. LTE induction requires activation of at least three signaling pathways to the MBs, mediated by nicotinic acetylcholine receptors (nAChRs), NMDA receptors (NRs), and D1 dopamine receptors (D1Rs). Here, we demonstrate that inputs from the AL are transmitted to the MBs through nAChRs, and inputs from the AFV are transmitted by NRs. Dopamine signaling occurs downstream of both nAChR and NR activation, and requires simultaneous stimulation of both pathways. Dopamine release requires the activity of the rutabaga adenylyl cyclase in postsynaptic MB neurons, and release is restricted to MB neurons that receive coincident stimulation. Our results indicate that postsynaptic activity can gate presynaptic dopamine release to regulate plasticity.

Fly Stampede 2.0: A Next Generation Optomotor Assay for Walking Behavior in Drosophila Melanogaster

Optomotor behavior represents a stereotyped locomotor response to visual motion that is found in both vertebrate and invertebrate models. The Fly Stampede assay was developed to study an optomotor response in freely walking populations of Drosophila. Here we share optimized assay designs and software for production of a modified stampede assay that can be used for genetic screens, and improved tracking outputs for understanding behavioral parameters of visual-motion responses and arousal state of individual animals. Arousal state influences behavioral performance in the stampede assay. As proof of principle experiments we show parametric modulation of visual stimuli and startle stimuli in both wildtype and mutant flies for the type I family dopamine receptor Dop1R1 (DopR). DopR mutants are hyperactive and perform poorly in the stampede assay, suggesting a potential role in visual perception and/or arousal. The stampede assay creates an efficient platform for rapid screening of mutant animals or circuit manipulations for investigating attentional processes in Drosophila.

A Genetic Screen To Assess Dopamine Receptor (DopR1) Dependent Sleep Regulation in Drosophila

Sleep is an essential behavioral state of rest that is regulated by homeostatic drives to ensure a balance of sleep and activity, as well as independent arousal mechanisms in the central brain. Dopamine has been identified as a critical regulator of both sleep behavior and arousal. Here, we present results of a genetic screen that selectively restored the Dopamine Receptor (DopR/DopR1/dumb) to specific neuroanatomical regions of the adult Drosophila brain to assess requirements for DopR in sleep behavior. We have identified subsets of the mushroom body that utilizes DopR in daytime sleep regulation. These data are supported by multiple examples of spatially restricted genetic rescue data in discrete circuits of the mushroom body, as well as immunohistochemistry that corroborates the localization of DopR protein within mushroom body circuits. Independent loss of function data using an inducible RNAi construct in the same specific circuits also supports a requirement for DopR in daytime sleep. Additional circuit activation of discrete DopR⁺ mushroom body neurons also suggests roles for these subpopulations in sleep behavior. These conclusions support a new separable function for DopR in daytime sleep regulation within the mushroom body. This daytime regulation is independent of the known role of DopR in nighttime sleep, which is regulated within the Fan-Shaped Body (FSB). This study provides new neuroanatomical loci for exploration of dopaminergic sleep functions in Drosophila, and expands our understanding of sleep regulation during the day vs. night.

MicroRNA function in Drosophila memory formation

MicroRNAs (miRs) are small non-coding RNAs that regulate protein expression through post-transcriptional mechanisms. They participate in broad aspects of biology from the control of developmental processes to tumorigenesis. Recent studies in Drosophila show that they also regulate activity-dependent and sensory-specific protein expression and support olfactory memory formation. Among the hundreds of miRs described, several have been demonstrated to be required for normal learning, memory, or for the development of neuronal circuits that support memory formation. Fly models of human diseases offer promise of identifying miRs whose expression becomes dysregulated and part of the pathological state, providing models for understanding brain disorders and drug discovery.

Genetic Dissection of Aversive Associative Olfactory Learning and Memory in Drosophila Larvae

Memory formation is a highly complex and dynamic process. It consists of different phases, which depend on various neuronal and molecular mechanisms. In adult Drosophila it was shown that memory formation after aversive Pavlovian conditioning includes—besides other forms—a labile short-term component that consolidates within hours to a longer-lasting memory. Accordingly, memory formation requires the timely controlled action of different neuronal circuits, neurotransmitters, neuromodulators and molecules that were initially identified by classical forward genetic approaches. Compared to adult Drosophila, memory formation was only sporadically analyzed at its larval stage. Here we deconstruct the larval mnemonic organization after aversive olfactory conditioning. We show that after odor-high salt conditioning larvae form two parallel memory phases; a short lasting component that depends on cyclic adenosine 3’5’-monophosphate (cAMP) signaling and synapsin gene function. In addition, we show for the first time for Drosophila larvae an anesthesia resistant component, which relies on radish and bruchpilot gene function, protein kinase C activity, requires presynaptic output of mushroom body Kenyon cells and dopamine function. Given the numerical simplicity of the larval nervous system this work offers a unique prospect for studying memory formation of defined specifications, at full-brain scope with single-cell, and single-synapse resolution.

Learning and memory helps organisms to predict and adapt to events in their environment. Gained experience leaves traces of memory in the nervous system. Yet, memory formation in vertebrates and invertebrates is a highly complex and dynamic process that consists of different phases, which depend on various neuronal and molecular mechanisms. To understand which changes occur in a brain when it learns, we applied a reductionist approach. Instead of studying complex cases, we analyzed learning and memory in Drosophila larvae that have a simple brain that is genetically and behaviorally accessible and consists of only about 10,000 neurons. Drosophila larvae are able to learn to associate an odor with punishing high salt concentrations. It is therefore possible to correlate changes in larval behavior with molecular events in identifiable neurons after classical olfactory conditioning. We show that under these circumstances larvae form two parallel memory phases; a short lasting component (lSTM) that is molecularly conserved throughout the animal kingdom as it depends on the classical cAMP pathway. In parallel they establish a larval anesthesia resistant memory (lARM) that relies on a different molecular signal. lARM has not been described in larvae before.

Visual Attention in Flies-Dopamine in the Mushroom Bodies Mediates the After-Effect of Cueing

Visual environments may simultaneously comprise stimuli of different significance. Often such stimuli require incompatible responses. Selective visual attention allows an animal to respond exclusively to the stimuli at a certain location in the visual field. In the process of establishing its focus of attention the animal can be influenced by external cues. Here we characterize the behavioral properties and neural mechanism of cueing in the fly Drosophila melanogaster. A cue can be attractive, repulsive or ineffective depending upon (e.g.) its visual properties and location in the visual field. Dopamine signaling in the brain is required to maintain the effect of cueing once the cue has disappeared. Raising or lowering dopamine at the synapse abolishes this after-effect. Specifically, dopamine is necessary and sufficient in the αβ-lobes of the mushroom bodies. Evidence is provided for an involvement of the αβ_posterior Kenyon cells.

Artificial Induction of Associative Olfactory Memory by Optogenetic and Thermogenetic Activation of Olfactory Sensory Neurons and Octopaminergic Neurons in Drosophila Larvae

The larval brain of Drosophila melanogaster provides an excellent system for the study of the neurocircuitry mechanism of memory. Recent development of neurogenetic techniques in fruit flies enables manipulations of neuronal activities in freely behaving animals. This protocol describes detailed steps for artificial induction of olfactory associative memory in Drosophila larvae. In this protocol, the natural reward signal is substituted by thermogenetic activation of octopaminergic neurons in the brain. In parallel, the odor signal is substituted by optogenetic activation of a specific class of olfactory receptor neurons. Association of reward and odor stimuli is achieved with the concomitant application of blue light and heat that leads to activation of both sets of neurons in living transgenic larvae. Given its operational simplicity and robustness, this method could be utilized to further our knowledge on the neurocircuitry mechanism of memory in the fly brain.

Dopaminergic neurons write and update memories with cell-type-specific rules

Associative learning is thought to involve parallel and distributed mechanisms of memory formation and storage. In Drosophila, the mushroom body (MB) is the major site of associative odor memory formation. Previously we described the anatomy of the adult MB and defined 20 types of dopaminergic neurons (DANs) that each innervate distinct MB compartments (Aso et al., 2014a, 2014b). Here we compare the properties of memories formed by optogenetic activation of individual DAN cell types. We found extensive differences in training requirements for memory formation, decay dynamics, storage capacity and flexibility to learn new associations. Even a single DAN cell type can either write or reduce an aversive memory, or write an appetitive memory, depending on when it is activated relative to odor delivery. Our results show that different learning rules are executed in seemingly parallel memory systems, providing multiple distinct circuit-based strategies to predict future events from past experiences.

Learning and Memory in Disease Vector Insects

Learning and memory plays an important role in host preference and parasite transmission by disease vector insects. Historically there has been a dearth of standardized protocols that permit testing their learning abilities, thus limiting discussion on the potential epidemiological consequences of learning and memory to a largely speculative extent. However, with increasing evidence that individual experience and associative learning can affect processes such as oviposition site selection and host preference, it is timely to review the recently acquired knowledge, identify research gaps and discuss the implication of learning in disease vector insects in perspective with control strategies.

Roles of OA1 octopamine receptor and Dop1 dopamine receptor in mediating appetitive and aversive reinforcement revealed by RNAi studies

Revealing reinforcing mechanisms in associative learning is important for elucidation of brain mechanisms of behavior. In mammals, dopamine neurons are thought to mediate both appetitive and aversive reinforcement signals. Studies using transgenic fruit-flies suggested that dopamine neurons mediate both appetitive and aversive reinforcements, through the Dop1 dopamine receptor, but our studies using octopamine and dopamine receptor antagonists and using Dop1 knockout crickets suggested that octopamine neurons mediate appetitive reinforcement and dopamine neurons mediate aversive reinforcement in associative learning in crickets. To fully resolve this issue, we examined the effects of silencing of expression of genes that code the OA1 octopamine receptor and Dop1 and Dop2 dopamine receptors by RNAi in crickets. OA1-silenced crickets exhibited impairment in appetitive learning with water but not in aversive learning with sodium chloride solution, while Dop1-silenced crickets exhibited impairment in aversive learning but not in appetitive learning. Dop2-silenced crickets showed normal scores in both appetitive learning and aversive learning. The results indicate that octopamine neurons mediate appetitive reinforcement via OA1 and that dopamine neurons mediate aversive reinforcement via Dop1 in crickets, providing decisive evidence that neurotransmitters and receptors that mediate appetitive reinforcement indeed differ among different species of insects.

A critical role for the Drosophila dopamine D1-like receptor Dop1R2 at the onset of metamorphosis

BACKGROUND

Insect metamorphosis relies on temporal and spatial cues that are precisely controlled. Previous studies in Drosophila have shown that untimely activation of genes that are essential to metamorphosis results in growth defects, developmental delay and death. Multiple factors exist that safeguard these genes against dysregulated expression. The list of identified negative regulators that play such a role in Drosophila development continues to expand.

RESULTS

By using RNAi transgene-induced gene silencing coupled to spatio/temporal assessment, we have unraveled an important role for the Drosophila dopamine 1-like receptor, Dop1R2, in development. We show that Dop1R2 knockdown leads to pre-adult lethality. In adults that escape death, abnormal wing expansion and/or melanization defects occur. Furthermore we show that salivary gland expression of this GPCR during the late larval/prepupal stage is essential for the flies to survive through adulthood. In addition to RNAi-induced effects, treatment of larvae with the high affinity D1-like receptor antagonist flupenthixol, also results in developmental arrest, and in morphological defects comparable to those seen in Dop1R2 RNAi flies. To examine the basis for pupal lethality in Dop1R2 RNAi flies, we carried out transcriptome analysis. These studies revealed up-regulation of genes that respond to ecdysone, regulate morphogenesis and/or modulate defense/immunity.

CONCLUSION

Taken together our findings suggest a role for Dop1R2 in the repression of genes that coordinate metamorphosis. Premature release of this inhibition is not tolerated by the developing fly.

Coordinated and Compartmentalized Neuromodulation Shapes Sensory Processing in Drosophila

Learned and adaptive behaviors rely on neural circuits that flexibly couple the same sensory input to alternative output pathways. Here, we show that the Drosophila mushroom body functions like a switchboard in which neuromodulation reroutes the same odor signal to different behavioral circuits, depending on the state and experience of the fly. Using functional synaptic imaging and electrophysiology, we reveal that dopaminergic inputs to the mushroom body modulate synaptic transmission with exquisite spatial specificity, allowing individual neurons to differentially convey olfactory signals to each of their postsynaptic targets. Moreover, we show that the dopaminergic neurons function as an interconnected network, encoding information about both an animal's external context and internal state to coordinate synaptic plasticity throughout the mushroom body. Our data suggest a general circuit mechanism for behavioral flexibility in which neuromodulatory networks act with synaptic precision to transform a single sensory input into different patterns of output activity. PAPERCLIP.

Heterosynaptic Plasticity Underlies Aversive Olfactory Learning in Drosophila

Although associative learning has been localized to specific brain areas in many animals, identifying the underlying synaptic processes in vivo has been difficult. Here, we provide the first demonstration of long-term synaptic plasticity at the output site of the Drosophila mushroom body. Pairing an odor with activation of specific dopamine neurons induces both learning and odor-specific synaptic depression. The plasticity induction strictly depends on the temporal order of the two stimuli, replicating the logical requirement for associative learning. Furthermore, we reveal that dopamine action is confined to and distinct across different anatomical compartments of the mushroom body lobes. Finally, we find that overlap between sparse representations of different odors defines both stimulus specificity of the plasticity and generalizability of associative memories across odors. Thus, the plasticity we find here not only manifests important features of associative learning but also provides general insights into how a sparse sensory code is read out.

Memory-Relevant Mushroom Body Output Synapses Are Cholinergic

Memories are stored in the fan-out fan-in neural architectures of the mammalian cerebellum and hippocampus and the insect mushroom bodies. However, whereas key plasticity occurs at glutamatergic synapses in mammals, the neurochemistry of the memory-storing mushroom body Kenyon cell output synapses is unknown. Here we demonstrate a role for acetylcholine (ACh) in Drosophila. Kenyon cells express the ACh-processing proteins ChAT and VAChT, and reducing their expression impairs learned olfactory-driven behavior. Local ACh application, or direct Kenyon cell activation, evokes activity in mushroom body output neurons (MBONs). MBON activation depends on VAChT expression in Kenyon cells and is blocked by ACh receptor antagonism. Furthermore, reducing nicotinic ACh receptor subunit expression in MBONs compromises odor-evoked activation and redirects odor-driven behavior. Lastly, peptidergic corelease enhances ACh-evoked responses in MBONs, suggesting an interaction between the fast- and slow-acting transmitters. Therefore, olfactory memories in Drosophila are likely stored as plasticity of cholinergic synapses.

•

Mushroom body Kenyon cell function requires ChAT and VAChT expression

•

Kenyon cell-released acetylcholine drives mushroom body output neurons

•

Blocking nicotinic receptors impairs mushroom body output neuron activation

•

Acetylcholine interacts with coreleased neuropeptide

The D1 family dopamine receptor, DopR, potentiates hind leg grooming behavior in Drosophila

Drosophila groom away debris and pathogens from the body using their legs in a stereotyped sequence of innate motor behaviors. Here, we investigated one aspect of the grooming repertoire by characterizing the D1 family dopamine receptor, DopR. Removal of DopR results in decreased hind leg grooming, as substantiated by quantitation of dye remaining on mutant and RNAi animals vs. controls and direct scoring of behavioral events. These data are also supported by pharmacological results that D1 receptor agonists fail to potentiate grooming behaviors in headless DopR flies. DopR protein is broadly expressed in the neuropil of the thoracic ganglion and overlaps with TH‐positive dopaminergic neurons. Broad neuronal expression of dopamine receptor in mutant animals restored normal grooming behaviors. These data provide evidence for the role of DopR in potentiating hind leg grooming behaviors in the thoracic ganglion of adult Drosophila. This is a remarkable juxtaposition to the considerable role of D1 family dopamine receptors in rodent grooming, and future investigations of evolutionary relationships of circuitry may be warranted.

Reward signal in a recurrent circuit drives appetitive long-term memory formation

Dopamine signals reward in animal brains. A single presentation of a sugar reward to Drosophila activates distinct subsets of dopamine neurons that independently induce short- and long-term olfactory memories (STM and LTM, respectively). In this study, we show that a recurrent reward circuit underlies the formation and consolidation of LTM. This feedback circuit is composed of a single class of reward-signaling dopamine neurons (PAM-α1) projecting to a restricted region of the mushroom body (MB), and a specific MB output cell type, MBON-α1, whose dendrites arborize that same MB compartment. Both MBON-α1 and PAM-α1 neurons are required during the acquisition and consolidation of appetitive LTM. MBON-α1 additionally mediates the retrieval of LTM, which is dependent on the dopamine receptor signaling in the MB α/β neurons. Our results suggest that a reward signal transforms a nascent memory trace into a stable LTM using a feedback circuit at the cost of memory specificity.

DOI:http://dx.doi.org/10.7554/eLife.10719.001

An animal that finds particularly nutritious and palatable food will often develop a long-lasting memory—even if they experience that event only once.

One example of this is the ability of the fruit fly Drosophila to form a long-term association between a sugar reward and a specific odor that was present when they received the reward. The consumption of sugar triggers the release of a chemical called dopamine on specific compartments of a brain structure called the mushroom body. Dopamine then acts to modify the connection between cells called “Kenyon cells”, which encode specific odors, and the neurons that send signals out from the mushroom body (called MBONs). The result is the formation of a memory that links the odor with the reward.

However, little is known about how this process differs for long-term vs. short-term memories, and how it can occur when the fly has experienced the odor and reward together on only a single occasion. To find out, Ichinose et al. combined behavioral testing of fruit flies with genetics. The results confirmed that the dopamine neurons and the MBONs that project to a single compartment of the mushroom body, called α1, are both required for the formation of long-term odor-reward memories, but not their short-term equivalents. These neurons are called PAM-α1 and MBON-α1, respectively.

Unexpectedly, anatomical data revealed that PAM-α1 dopamine neurons receive input from MBON-α1; that is, long-term memory formation involves a feedback circuit: from PAM-α1 to Kenyon cells, then to MBON-α1 and back to PAM-α1. Blocking feedback from the MBON-α1 onto the PAM-α1 neurons shortly after odor-reward training disrupted long-term memory formation. Conversely, blocking feedback at a later stage did not. This suggests that prolonged activation of PAM-α1 by MBON-α1 helps to strengthen newly established memories, converting them into memories that will last for a long time.

The discovery of a specific circuit that supports long-term, but not short-term, memory formation in fruit flies is consistent with evidence of distinct mechanisms underlying these processes in mammals. Further work is now required to determine whether feedback circuits similar to those in fruit flies also contribute to reward-based learning in other animals.

DOI:http://dx.doi.org/10.7554/eLife.10719.002

Olfactory learning skews mushroom body output pathways to steer behavioral choice in Drosophila

Learning permits animals to attach meaning and context to sensory stimuli. How this information is coded in neural networks in the brain, and appropriately retrieved and utilized to guide behavior, is poorly understood. In the fruit fly olfactory memories of particular value are represented within sparse populations of odor-activated Kenyon cells (KCs) in the mushroom body ensemble. During learning reinforcing dopaminergic neurons skew the mushroom body network by driving zonally restricted plasticity at synaptic junctions between the KCs and subsets of the overall small collection of mushroom body output neurons. Reactivation of this skewed KC-output neuron network retrieves memory of odor valence and guides appropriate approach or avoidance behavior.

Knockout crickets for the study of learning and memory: Dopamine receptor Dop1 mediates aversive but not appetitive reinforcement in crickets

Elucidation of reinforcement mechanisms in associative learning is an important subject in neuroscience. In mammals, dopamine neurons are thought to play critical roles in mediating both appetitive and aversive reinforcement. Our pharmacological studies suggested that octopamine and dopamine neurons mediate reward and punishment, respectively, in crickets, but recent studies in fruit-flies concluded that dopamine neurons mediates both reward and punishment, via the type 1 dopamine receptor Dop1. To resolve the discrepancy between studies in different insect species, we produced Dop1 knockout crickets using the CRISPR/Cas9 system and found that they are defective in aversive learning with sodium chloride punishment but not appetitive learning with water or sucrose reward. The results suggest that dopamine and octopamine neurons mediate aversive and appetitive reinforcement, respectively, in crickets. We suggest unexpected diversity in neurotransmitters mediating appetitive reinforcement between crickets and fruit-flies, although the neurotransmitter mediating aversive reinforcement is conserved. This study demonstrates usefulness of the CRISPR/Cas9 system for producing knockout animals for the study of learning and memory.

Association of Amine-Receptor DNA Sequence Variants with Associative Learning in the Honeybee

Octopamine- and dopamine-based neuromodulatory systems play a critical role in learning and learning-related behaviour in insects. To further our understanding of these systems and resulting phenotypes, we quantified DNA sequence variations at six loci coding octopamine-and dopamine-receptors and their association with aversive and appetitive learning traits in a population of honeybees. We identified 79 polymorphic sequence markers (mostly SNPs and a few insertions/deletions) located within or close to six candidate genes. Intriguingly, we found that levels of sequence variation in the protein-coding regions studied were low, indicating that sequence variation in the coding regions of receptor genes critical to learning and memory is strongly selected against. Non-coding and upstream regions of the same genes, however, were less conserved and sequence variations in these regions were weakly associated with between-individual differences in learning-related traits. While these associations do not directly imply a specific molecular mechanism, they suggest that the cross-talk between dopamine and octopamine signalling pathways may influence olfactory learning and memory in the honeybee.

Differentially expressed genes linked to natural variation in long-term memory formation in Cotesia parasitic wasps

Even though learning and memory are universal traits in the Animal Kingdom, closely related species reveal substantial variation in learning rate and memory dynamics. To determine the genetic background of this natural variation, we studied two congeneric parasitic wasp species, Cotesia glomerata and C. rubecula, which lay their eggs in caterpillars of the large and small cabbage white butterfly. A successful egg laying event serves as an unconditioned stimulus (US) in a classical conditioning paradigm, where plant odors become associated with the encounter of a suitable host caterpillar. Depending on the host species, the number of conditioning trials and the parasitic wasp species, three different types of transcription-dependent long-term memory (LTM) and one type of transcription-independent, anesthesia-resistant memory (ARM) can be distinguished. To identify transcripts underlying these differences in memory formation, we isolated mRNA from parasitic wasp heads at three different time points between induction and consolidation of each of the four memory types, and for each sample three biological replicates, where after strand-specific paired-end 100 bp deep sequencing. Transcriptomes were assembled de novo and differential expression was determined for each memory type and time point after conditioning, compared to unconditioned wasps. Most differentially expressed (DE) genes and antisense transcripts were only DE in one of the LTM types. Among the DE genes that were DE in two or more LTM types, were many protein kinases and phosphatases, small GTPases, receptors and ion channels. Some genes were DE in opposing directions between any of the LTM memory types and ARM, suggesting that ARM in Cotesia requires the transcription of genes inhibiting LTM or vice versa. We discuss our findings in the context of neuronal functioning, including RNA splicing and transport, epigenetic regulation, neurotransmitter/peptide synthesis and antisense transcription. In conclusion, these brain transcriptomes provide candidate genes that may be involved in the observed natural variation in LTM in closely related Cotesia parasitic wasp species.

Roles of octopamine and dopamine in appetitive and aversive memory acquisition studied in olfactory conditioning of maxillary palpi extension response in crickets

Elucidation of reinforcing mechanisms for associative learning is an important subject in neuroscience. Based on results of our previous pharmacological studies in crickets, we suggested that octopamine and dopamine mediate reward and punishment signals, respectively, in associative learning. In fruit-flies, however, it was concluded that dopamine mediates both appetitive and aversive reinforcement, which differs from our suggestion in crickets. In our previous studies, the effect of conditioning was tested at 30 min after training or later, due to limitations of our experimental procedures, and thus the possibility that octopamine and dopamine were not needed for initial acquisition of learning was not ruled out. In this study we first established a conditioning procedure to enable us to evaluate acquisition performance in crickets. Crickets extended their maxillary palpi and vigorously swung them when they perceived some odors, and we found that crickets that received pairing of an odor with water reward or sodium chloride punishment exhibited an increase or decrease in percentages of maxillary palpi extension responses to the odor. Using this procedure, we found that octopamine and dopamine receptor antagonists impair acquisition of appetitive and aversive learning, respectively. This finding suggests that neurotransmitters mediating appetitive reinforcement differ in crickets and fruit-flies.