Learning the specific quality of taste reinforcement in larval Drosophila

From sensory organs to internal pathways: A comprehensive review of amino acid sensing in Drosophila

Organisms require various nutrients to provide energy, support growth, and maintain metabolic balance. Amino acid is among the most basic nutrients, serving as fundamental building blocks for protein synthesis while playing vital roles in growth, development, and reproduction. Understanding the mechanisms by which organisms perceive amino acids is key to unraveling how they select appropriate food sources and adapt to environmental challenges. The fruit fly, Drosophila melanogaster, serves as a powerful model for understanding fundamental genetic and physiological processes. This review focuses on recent advances in amino acid sensing mechanisms in Drosophila melanogaster and their relevance to feeding behavior, nutrient homeostasis, and adaptive responses, and integrates insights into peripheral sensory systems, such as the legs and proboscis, as well as internal regulatory mechanisms within the gut, fat body, and brain. It highlights key molecular players, including ionotropic receptors, gut-derived hormones, neuropeptides, and the microbiome-gut-brain axis. Additionally, the manuscript identifies knowledge gaps and proposes directions for future research, providing a comprehensive overview of this dynamic field.

The elusive nature of forward blocking effect on running-based taste aversion learning in laboratory rats

It is well documented that rats learn to avoid a taste solution consumed immediately before voluntary running in activity wheels, which represents a form of Pavlovian aversive conditioning based on the taste-running association. Although various behavioral phenomena observed in typical Pavlovian preparations, such as fear conditioning, have also been demonstrated in this setup, evidence of the associative blocking effect is limited. The present study aimed to demonstrate this effect, and the first experiment provided some positive evidence. Conditioning rats with serial presentations of two taste solutions followed by an opportunity to run (A → B → running) resulted in reduced aversion to taste A if the rats had prior experience of running after consuming B (B → running), suggesting that the previously established B-running association blocked the A-running association. However, subsequent experiments failed to yield statistically reliable results, raising questions about the robustness of the blocking effect on running-based taste aversion learning.

Cognitive limits of larval Drosophila: testing for conditioned inhibition, sensory preconditioning, and second-order conditioning

Drosophila larvae are an established model system for studying the mechanisms of innate and simple forms of learned behavior. They have about 10 times fewer neurons than adult flies, and it was the low total number of their neurons that allowed for an electron microscopic reconstruction of their brain at synaptic resolution. Regarding the mushroom body, a central brain structure for many forms of associative learning in insects, it turned out that more than half of the classes of synaptic connection had previously escaped attention. Understanding the function of these circuit motifs, subsequently confirmed in adult flies, is an important current research topic. In this context, we test larval Drosophila for their cognitive abilities in three tasks that are characteristically more complex than those previously studied. Our data provide evidence for (i) conditioned inhibition, as has previously been reported for adult flies and honeybees. Unlike what is described for adult flies and honeybees, however, our data do not provide evidence for (ii) sensory preconditioning or (iii) second-order conditioning in Drosophila larvae. We discuss the methodological features of our experiments as well as four specific aspects of the organization of the larval brain that may explain why these two forms of learning are observed in adult flies and honeybees, but not in larval Drosophila.

IR76b-expressing neurons in Drosophila melanogaster are necessary for associative reward learning of an amino acid mixture

Learning where to find nutrients while at the same time avoiding toxic food is essential for survival of any animal. Using Drosophila melanogaster larvae as a study case, we investigate the role of gustatory sensory neurons expressing IR76b for associative learning of amino acids, the building blocks of proteins. We found surprising complexity in the neuronal underpinnings of sensing amino acids, and a functional division of sensory neurons. We found that the IR76b receptor is dispensable for amino acid learning, whereas the neurons expressing IR76b are specifically required for the rewarding but not the punishing effect of amino acids. This unexpected dissociation in neuronal processing of amino acids for different behavioural functions provides a study case for functional divisions of labour in gustatory systems.

Prediction error drives associative learning and conditioned behavior in a spiking model of Drosophila larva

Predicting reinforcement from sensory cues is beneficial for goal-directed behavior. In insect brains, underlying associations between cues and reinforcement, encoded by dopaminergic neurons, are formed in the mushroom body. We propose a spiking model of the Drosophila larva mushroom body. It includes a feedback motif conveying learned reinforcement expectation to dopaminergic neurons, which can compute prediction error as the difference between expected and present reinforcement. We demonstrate that this can serve as a driving force in learning. When combined with synaptic homeostasis, our model accounts for theoretically derived features of acquisition and loss of associations that depend on the intensity of the reinforcement and its temporal proximity to the cue. From modeling olfactory learning over the time course of behavioral experiments and simulating the locomotion of individual larvae toward or away from odor sources in a virtual environment, we conclude that learning driven by prediction errors can explain larval behavior.

Rewarding Capacity of Optogenetically Activating a Giant GABAergic Central-Brain Interneuron in Larval Drosophila

Larvae of the fruit fly Drosophila melanogaster are a powerful study case for understanding the neural circuits underlying behavior. Indeed, the numerical simplicity of the larval brain has permitted the reconstruction of its synaptic connectome, and genetic tools for manipulating single, identified neurons allow neural circuit function to be investigated with relative ease and precision. We focus on one of the most complex neurons in the brain of the larva (of either sex), the GABAergic anterior paired lateral neuron (APL). Using behavioral and connectomic analyses, optogenetics, Ca2+ imaging, and pharmacology, we study how APL affects associative olfactory memory. We first provide a detailed account of the structure, regional polarity, connectivity, and metamorphic development of APL, and further confirm that optogenetic activation of APL has an inhibiting effect on its main targets, the mushroom body Kenyon cells. All these findings are consistent with the previously identified function of APL in the sparsening of sensory representations. To our surprise, however, we found that optogenetically activating APL can also have a strong rewarding effect. Specifically, APL activation together with odor presentation establishes an odor-specific, appetitive, associative short-term memory, whereas naive olfactory behavior remains unaffected. An acute, systemic inhibition of dopamine synthesis as well as an ablation of the dopaminergic pPAM neurons impair reward learning through APL activation. Our findings provide a study case of complex circuit function in a numerically simple brain, and suggest a previously unrecognized capacity of central-brain GABAergic neurons to engage in dopaminergic reinforcement.SIGNIFICANCE STATEMENT The single, identified giant anterior paired lateral (APL) neuron is one of the most complex neurons in the insect brain. It is GABAergic and contributes to the sparsening of neuronal activity in the mushroom body, the memory center of insects. We provide the most detailed account yet of the structure of APL in larval Drosophila as a neurogenetically accessible study case. We further reveal that, contrary to expectations, the experimental activation of APL can exert a rewarding effect, likely via dopaminergic reward pathways. The present study both provides an example of unexpected circuit complexity in a numerically simple brain, and reports an unexpected effect of activity in central-brain GABAergic circuits.

Ethanol-guided behavior in Drosophila larvae

Chemosensory signals allow vertebrates and invertebrates not only to orient in its environment toward energy-rich food sources to maintain nutrition but also to avoid unpleasant or even poisonous substrates. Ethanol is a substance found in the natural environment of Drosophila melanogaster. Accordingly, D. melanogaster has evolved specific sensory systems, physiological adaptations, and associated behaviors at its larval and adult stage to perceive and process ethanol. To systematically analyze how D. melanogaster larvae respond to naturally occurring ethanol, we examined ethanol-induced behavior in great detail by reevaluating existing approaches and comparing them with new experiments. Using behavioral assays, we confirm that larvae are attracted to different concentrations of ethanol in their environment. This behavior is controlled by olfactory and other environmental cues. It is independent of previous exposure to ethanol in their food. Moreover, moderate, naturally occurring ethanol concentration of 4% results in increased larval fitness. On the contrary, higher concentrations of 10% and 20% ethanol, which rarely or never appear in nature, increase larval mortality. Finally, ethanol also serves as a positive teaching signal in learning and memory and updates valence associated with simultaneously processed odor information. Since information on how larvae perceive and process ethanol at the genetic and neuronal level is limited, the establishment of standardized assays described here is an important step towards their discovery.

To be specific: The role of orbitofrontal cortex in signaling reward identity

The orbitofrontal cortex (OFC) plays a prominent role in signaling reward expectations. Two important features of rewards are their value (how good they are) and their specific identity (what they are). Whereas research on OFC has traditionally focused on reward value, recent findings point toward a pivotal role of reward identity in understanding OFC signaling and its contribution to behavior. Here, we review work in rodents, nonhuman primates, and humans on how the OFC represents expectations about the identity of rewards, and how these signals contribute to outcome-guided behavior. Moreover, we summarize recent findings suggesting that specific reward expectations in OFC are learned and updated by means of identity errors in the dopaminergic midbrain. We conclude by discussing how OFC encoding of specific rewards complements recent proposals that this region represents a cognitive map of relevant task states, which forms the basis for model-based behavior. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Rewarding compounds identified from the medicinal plant Rhodiola rosea

Preparations of Rhodiola rosea root are widely used in traditional medicine. They can increase life span in worms and flies, and have various effects related to nervous system function in different animal species and humans. However, which of the compounds in R. rosea is mediating any one of these effects has remained unknown in most cases. Here, an analysis of the volatile and non-volatile low-molecular-weight constituents of R. rosea root samples was accompanied by an investigation of their behavioral impact on Drosophila melanogaster larvae. Rhodiola rosea root samples have an attractive smell and taste to the larvae, and exert a rewarding effect. This rewarding effect was also observed for R. rosea root extracts, and did not require activity of dopamine neurons that mediate known rewards such as sugar. Based on the chemical profiles of R. rosea root extracts and resultant fractions, a bioactivity-correlation analysis (AcorA) was performed to identify candidate rewarding compounds. This suggested positive correlations for - among related compounds - ferulic acid eicosyl ester (FAE-20) and β-sitosterol glucoside. A validation using these as pure compounds confirmed that the correlations were causal. Their rewarding effects can be observed even at low micromolar concentrations and thus at remarkably lower doses than for any known taste reward in the larva. We discuss whether similar rewarding effects, should they be observed in humans, would indicate a habit-forming or addictive potential.

Identification of Dopaminergic Neurons That Can Both Establish Associative Memory and Acutely Terminate Its Behavioral Expression

An adaptive transition from exploring the environment in search of vital resources to exploiting these resources once the search was successful is important to all animals. Here we study the neuronal circuitry that allows larval Drosophila melanogaster of either sex to negotiate this exploration-exploitation transition. We do so by combining Pavlovian conditioning with high-resolution behavioral tracking, optogenetic manipulation of individually identified neurons, and EM data-based analyses of synaptic organization. We find that optogenetic activation of the dopaminergic neuron DAN-i1 can both establish memory during training and acutely terminate learned search behavior in a subsequent recall test. Its activation leaves innate behavior unaffected, however. Specifically, DAN-i1 activation can establish associative memories of opposite valence after paired and unpaired training with odor, and its activation during the recall test can terminate the search behavior resulting from either of these memories. Our results further suggest that in its behavioral significance DAN-i1 activation resembles, but does not equal, sugar reward. Dendrogram analyses of all the synaptic connections between DAN-i1 and its two main targets, the Kenyon cells and the mushroom body output neuron MBON-i1, further suggest that the DAN-i1 signals during training and during the recall test could be delivered to the Kenyon cells and to MBON-i1, respectively, within previously unrecognized, locally confined branching structures. This would provide an elegant circuit motif to terminate search on its successful completion.SIGNIFICANCE STATEMENT In the struggle for survival, animals have to explore their environment in search of food. Once food is found, however, it is adaptive to prioritize exploiting it over continuing a search that would now be as pointless as searching for the glasses you are wearing. This exploration-exploitation trade-off is important for animals and humans, as well as for technical search devices. We investigate which of the only 10,000 neurons of a fruit fly larva can tip the balance in this trade-off, and identify a single dopamine neuron called DAN-i1 that can do so. Given the similarities in dopamine neuron function across the animal kingdom, this may reflect a general principle of how search is terminated once it is successful.

Neuronal processing of amino acids in Drosophila: from taste sensing to behavioural regulation

Finding and feeding on appropriate food are crucial for all animals. Carbohydrates and amino acids are both essential nutrients, albeit with distinct roles: the former are the main energy source whereas the latter are the building blocks of proteins and are used as neurotransmitters. Despite their crucial role, neither the sensing nor the neuronal processing of amino acids is well understood. Studies in Drosophila melanogaster have only recently gained momentum in shedding new light on the molecular and neuronal mechanisms of peripheral and internal amino acid sensing, as well as the organization of amino acid feeding behaviour. Furthermore, amino acids have been shown to act as rewards in associative learning. Focusing on recent studies in Drosophila, we summarize what is known so far about the perception of, and the behavioural responses to, amino acids in insects, and try to identify key questions for future research.

An amino-acid mixture can be both rewarding and punishing to larval Drosophila melanogaster

Amino acids are important nutrients for animals because they are necessary for protein synthesis in particular during growth, as well as for neurotransmission. However, little is known about how animals use past experience to guide their search for amino-acid-rich food. We reasoned that the larvae of Drosophila melanogaster are suitable for investigating this topic because they are the feeding and growth stages in the life cycle of these holometabolous insects. Specifically, we investigated whether experiencing an odour with a 20 amino-acid mixture as a semi-natural tastant during training establishes odour-tastant associative memories. Across a broad concentration range (0.01-20 mmol l^-1), such an amino-acid mixture was found to have a rewarding effect, establishing appetitive memory for the odour. To our surprise, however, manipulation of the test conditions revealed that relatively high concentrations of the amino-acid mixture (3.3 mmol l^-1 and higher) in addition establish aversive memory for the odour. We then characterized both of these oppositely valenced memories in terms of their dependency on the number of training trials, their temporal stability, their modulation through starvation and the specific changes in locomotion underlying them. Collectively, and in the light of what is known about the neuronal organization of odour-food memory in larval D . melanogaster, our data suggest that these memories are established in parallel. We discuss the similarity of our results to what has been reported for sodium chloride, and the possible neurogenetic bases for concentration-dependent changes in valence when these tastants are used as reinforcers.

Reversal learning in Drosophila larvae

Adjusting behavior to changed environmental contingencies is critical for survival, and reversal learning provides an experimental handle on such cognitive flexibility. Here, we investigate reversal learning in larval Drosophila Using odor-taste associations, we establish olfactory reversal learning in the appetitive and the aversive domain, using either fructose as a reward or high-concentration sodium chloride as a punishment, respectively. Reversal learning is demonstrated both in differential and in absolute conditioning, in either valence domain. In differential conditioning, the animals are first trained such that an odor A is paired, for example, with the reward whereas odor B is not (A+/B); this is followed by a second training phase with reversed contingencies (A/B+). In absolute conditioning, odor B is omitted, such that the animals are first trained with paired presentations of A and reward, followed by unpaired training in the second training phase. Our results reveal "true" reversal learning in that the opposite associative effects of both the first and the second training phase are detectable after reversed-contingency training. In what is a surprisingly quick, one-trial contingency adjustment in the Drosophila larva, the present study establishes a simple and genetically easy accessible study case of cognitive flexibility.

Modulations of microbehaviour by associative memory strength in Drosophila larvae

Finding food is a vital skill and a constant task for any animal, and associative learning of food-predicting cues gives an advantage in this daily struggle. The strength of the associations between cues and food depends on a number of parameters, such as the salience of the cue, the strength of the food reward and the number of joint cue-food experiences. We investigate what impact the strength of an associative odour-sugar memory has on the microbehaviour of Drosophila melanogaster larvae. We find that larvae form stronger memories with increasing concentrations of sugar or odour, and that these stronger memories manifest themselves in stronger modulations of two aspects of larval microbehaviour, the rate and the direction of lateral reorientation manoeuvres (so-called head casts). These two modulations of larval behaviour are found to be correlated to each other in every experiment performed, which is in line with a model that assumes that both modulations are controlled by a common motor output. Given that the Drosophila larva is a genetically tractable model organism that is well suited to the study of simple circuits at the single-cell level, these analyses can guide future research into the neuronal circuits underlying the translation of associative memories of different strength into behaviour, and may help to understand how these processes are organised in more complex systems.

Reward signaling in a recurrent circuit of dopaminergic neurons and peptidergic Kenyon cells

Dopaminergic neurons in the brain of the Drosophila larva play a key role in mediating reward information to the mushroom bodies during appetitive olfactory learning and memory. Using optogenetic activation of Kenyon cells we provide evidence that recurrent signaling exists between Kenyon cells and dopaminergic neurons of the primary protocerebral anterior (pPAM) cluster. Optogenetic activation of Kenyon cells paired with odor stimulation is sufficient to induce appetitive memory. Simultaneous impairment of the dopaminergic pPAM neurons abolishes appetitive memory expression. Thus, we argue that dopaminergic pPAM neurons mediate reward information to the Kenyon cells, and in turn receive feedback from Kenyon cells. We further show that this feedback signaling is dependent on short neuropeptide F, but not on acetylcholine known to be important for odor-shock memories in adult flies. Our data suggest that recurrent signaling routes within the larval mushroom body circuitry may represent a mechanism subserving memory stabilization.

Softness sensing and learning in Drosophila larvae

Mechanosensation provides animals with important sensory information in addition to olfaction and gustation during feeding behavior. Here, we used Drosophila melanogaster larvae to investigate the role of softness sensing in behavior and learning. In the natural environment, larvae need to dig into soft foods for feeding. Finding foods that are soft enough to dig into is likely to be essential for their survival. We report that larvae can discriminate between different agar concentrations and prefer softer agar. Interestingly, we show that larvae on a harder surface search for a softer surface using memory associated with an odor, and that they evaluate foods by balancing softness and sweetness. These findings suggest that larvae integrate mechanosensory information with chemosensory input while foraging. Moreover, we found that the larval preference for softness is affected by genetic background.

One-trial learning in larval Drosophila

Animals of many species are capable of “small data” learning, that is, of learning without repetition. Here we introduce larval Drosophila melanogaster as a relatively simple study case for such one-trial learning. Using odor-food associative conditioning, we first show that a sugar that is both sweet and nutritious (fructose) and sugars that are only sweet (arabinose) or only nutritious (sorbitol) all support appetitive one-trial learning. The same is the case for the optogenetic activation of a subset of dopaminergic neurons innervating the mushroom body, the memory center of the insects. In contrast, no one-trial learning is observed for an amino acid reward (aspartic acid). As regards the aversive domain, one-trial learning is demonstrated for high-concentration sodium chloride, but is not observed for a bitter tastant (quinine). Second, we provide follow-up, parametric analyses of odor-fructose learning. Specifically, we ascertain its dependency on the number and duration of training trials, the requirements for the behavioral expression of one-trial odor-fructose memory, its temporal stability, and the feasibility of one-trial differential conditioning. Our results set the stage for a neurogenetic analysis of one-trial learning and define the requirements for modeling mnemonic processes in the larva.

How foresight might support the behavioral flexibility of arthropods

The small brains of insects and other invertebrates are often thought to constrain these animals to live entirely 'in the moment'. In this view, each one of their many seemingly hard-wired behavioral routines is triggered by a precisely defined environmental stimulus configuration, but there is no mental appreciation of the possible outcomes of one's actions, and therefore little flexibility. However, many studies show problem-solving behavior in various arthropod species that falls outside the range of fixed behavior routines. We propose that a basic form of foresight, the ability to predict the outcomes of one's own actions, is at the heart of such behavioral flexibility, and that the evolutionary roots of such outcome expectation are found in the need to disentangle sensory input that is predictable from self-generated motion versus input generated by changes in the outside world. Based on this, locusts, grasshoppers, dragonflies and flies seem to use internal models of the surrounding world to tailor their actions adaptively to predict the imminent future. Honeybees and orb-weaving spiders appear to act towards a desired outcome of their respective constructions, and the genetically pre-programmed routines that govern these constructions are subordinate to achieving the desired goal. Jumping spiders seem to preplan their route to prey suggesting they recognize the spatial challenge and actions necessary to obtain prey. Bumblebees and ants utilize objects not encountered in the wild as types of tools to solve problems in a manner that suggests an awareness of the desired outcome. Here we speculate that it may be simpler, in terms of the required evolutionary changes, computation and neural architecture, for arthropods to recognize their goal and predict the outcomes of their actions towards that goal, rather than having a large number of pre-programmed behaviors necessary to account for their observed behavioral flexibility.

Connectomics and function of a memory network: the mushroom body of larval Drosophila

The Drosophila larva is a relatively simple, 10 000-neuron study case for learning and memory with enticing analytical power, combining genetic tractability, the availability of robust behavioral assays, the opportunity for single-cell transgenic manipulation, and an emerging synaptic connectome of its complete central nervous system. Indeed, although the insect mushroom body is a much-studied memory network, the connectome revealed that more than half of the classes of connection within the mushroom body had escaped attention. The connectome also revealed circuitry that integrates, both within and across brain hemispheres, higher-order sensory input, intersecting valence signals, and output neurons that instruct behavior. Further, it was found that activating individual dopaminergic mushroom body input neurons can have a rewarding or a punishing effect on olfactory stimuli associated with it, depending on the relative timing of this activation, and that larvae form molecularly dissociable short-term, long-term, and amnesia-resistant memories. Together, the larval mushroom body is a suitable study case to achieve a nuanced account of molecular function in a behaviorally meaningful memory network.

Associative Learning of Stimuli Paired and Unpaired With Reinforcement: Evaluating Evidence From Maggots, Flies, Bees, and Rats

Finding rewards and avoiding punishments are powerful goals of behavior. To maximize reward and minimize punishment, it is beneficial to learn about the stimuli that predict their occurrence, and decades of research have provided insight into the brain processes underlying such associative reinforcement learning. In addition, it is well known in experimental psychology, yet often unacknowledged in neighboring scientific disciplines, that subjects also learn about the stimuli that predict the absence of reinforcement. Here we evaluate evidence for both these learning processes. We focus on two study cases that both provide a baseline level of behavior against which the effects of associative learning can be assessed. Firstly, we report pertinent evidence from Drosophila larvae. A re-analysis of the literature reveals that through paired presentations of an odor A and a sugar reward (A+) the animals learn that the reward can be found where the odor is, and therefore show an above-baseline preference for the odor. In contrast, through unpaired training (A/+) the animals learn that the reward can be found precisely where the odor is not, and accordingly these larvae show a below-baseline preference for it (the same is the case, with inverted signs, for learning through taste punishment). In addition, we present previously unpublished data demonstrating that also during a two-odor, differential conditioning protocol (A+/B) both these learning processes take place in larvae, i.e., learning about both the rewarded stimulus A and the non-rewarded stimulus B (again, this is likewise the case for differential conditioning with taste punishment). Secondly, after briefly discussing published evidence from adult Drosophila, honeybees, and rats, we report an unpublished data set showing that relative to baseline behavior after truly random presentations of a visual stimulus A and punishment, rats exhibit memories of opposite valence upon paired and unpaired training. Collectively, the evidence conforms to classical findings in experimental psychology and suggests that across species animals associatively learn both through paired and through unpaired presentations of stimuli with reinforcement – with opposite valence. While the brain mechanisms of unpaired learning for the most part still need to be uncovered, the immediate implication is that using unpaired procedures as a mnemonically neutral control for associative reinforcement learning may be leading analyses astray.

Odor-taste learning in Drosophila larvae

The Drosophila larva is an attractive model system to study fundamental questions in the field of neuroscience. Like the adult fly, the larva offers a seemingly unlimited genetic toolbox, which allows one to visualize, silence or activate neurons down to the single cell level. This, combined with its simplicity in terms of cell numbers, offers a useful system to study the neuronal correlates of complex processes including associative odor-taste learning and memory formation. Here, we summarize the current knowledge about odor-taste learning and memory at the behavioral level and integrate the recent progress on the larval connectome to shed light on the sub-circuits that allow Drosophila larvae to integrate present sensory input in the context of past experience and to elicit an appropriate behavioral response.

Functional architecture of reward learning in mushroom body extrinsic neurons of larval Drosophila

The brain adaptively integrates present sensory input, past experience, and options for future action. The insect mushroom body exemplifies how a central brain structure brings about such integration. Here we use a combination of systematic single-cell labeling, connectomics, transgenic silencing, and activation experiments to study the mushroom body at single-cell resolution, focusing on the behavioral architecture of its input and output neurons (MBINs and MBONs), and of the mushroom body intrinsic APL neuron. Our results reveal the identity and morphology of almost all of these 44 neurons in stage 3 Drosophila larvae. Upon an initial screen, functional analyses focusing on the mushroom body medial lobe uncover sparse and specific functions of its dopaminergic MBINs, its MBONs, and of the GABAergic APL neuron across three behavioral tasks, namely odor preference, taste preference, and associative learning between odor and taste. Our results thus provide a cellular-resolution study case of how brains organize behavior.

A connectome of a learning and memory center in the adult Drosophila brain

Understanding memory formation, storage and retrieval requires knowledge of the underlying neuronal circuits. In Drosophila, the mushroom body (MB) is the major site of associative learning. We reconstructed the morphologies and synaptic connections of all 983 neurons within the three functional units, or compartments, that compose the adult MB’s α lobe, using a dataset of isotropic 8 nm voxels collected by focused ion-beam milling scanning electron microscopy. We found that Kenyon cells (KCs), whose sparse activity encodes sensory information, each make multiple en passant synapses to MB output neurons (MBONs) in each compartment. Some MBONs have inputs from all KCs, while others differentially sample sensory modalities. Only 6% of KC>MBON synapses receive a direct synapse from a dopaminergic neuron (DAN). We identified two unanticipated classes of synapses, KC>DAN and DAN>MBON. DAN activation produces a slow depolarization of the MBON in these DAN>MBON synapses and can weaken memory recall.

DOI:http://dx.doi.org/10.7554/eLife.26975.001

The Ol1mpiad: concordance of behavioural faculties of stage 1 and stage 3 Drosophila larvae

Mapping brain function to brain structure is a fundamental task for neuroscience. For such an endeavour, the Drosophila larva is simple enough to be tractable, yet complex enough to be interesting. It features about 10,000 neurons and is capable of various taxes, kineses and Pavlovian conditioning. All its neurons are currently being mapped into a light-microscopical atlas, and Gal4 strains are being generated to experimentally access neurons one at a time. In addition, an electron microscopic reconstruction of its nervous system seems within reach. Notably, this electron microscope-based connectome is being drafted for a stage 1 larva – because stage 1 larvae are much smaller than stage 3 larvae. However, most behaviour analyses have been performed for stage 3 larvae because their larger size makes them easier to handle and observe. It is therefore warranted to either redo the electron microscopic reconstruction for a stage 3 larva or to survey the behavioural faculties of stage 1 larvae. We provide the latter. In a community-based approach we called the Ol1mpiad, we probed stage 1 Drosophila larvae for free locomotion, feeding, responsiveness to substrate vibration, gentle and nociceptive touch, burrowing, olfactory preference and thermotaxis, light avoidance, gustatory choice of various tastants plus odour–taste associative learning, as well as light/dark–electric shock associative learning. Quantitatively, stage 1 larvae show lower scores in most tasks, arguably because of their smaller size and lower speed. Qualitatively, however, stage 1 larvae perform strikingly similar to stage 3 larvae in almost all cases. These results bolster confidence in mapping brain structure and behaviour across developmental stages.

Trace Conditioning in Drosophila Induces Associative Plasticity in Mushroom Body Kenyon Cells and Dopaminergic Neurons

Dopaminergic neurons (DANs) signal punishment and reward during associative learning. In mammals, DANs show associative plasticity that correlates with the discrepancy between predicted and actual reinforcement (prediction error) during classical conditioning. Also in insects, such as Drosophila, DANs show associative plasticity that is, however, less understood. Here, we study associative plasticity in DANs and their synaptic partners, the Kenyon cells (KCs) in the mushroom bodies (MBs), while training Drosophila to associate an odorant with a temporally separated electric shock (trace conditioning). In most MB compartments DANs strengthened their responses to the conditioned odorant relative to untrained animals. This response plasticity preserved the initial degree of similarity between the odorant- and the shock-induced spatial response patterns, which decreased in untrained animals. Contrary to DANs, KCs (α'/β'-type) decreased their responses to the conditioned odorant relative to untrained animals. We found no evidence for prediction error coding by DANs during conditioning. Rather, our data supports the hypothesis that DAN plasticity encodes conditioning-induced changes in the odorant's predictive power.

Pavlovian Conditioning of Larval Drosophila: An Illustrated, Multilingual, Hands-On Manual for Odor-Taste Associative Learning in Maggots

Larval Drosophila offer a study case for behavioral neurogenetics that is simple enough to be experimentally tractable, yet complex enough to be worth the effort. We provide a detailed, hands-on manual for Pavlovian odor-reward learning in these animals. Given the versatility of Drosophila for genetic analyses, combined with the evolutionarily shared genetic heritage with humans, the paradigm has utility not only in behavioral neurogenetics and experimental psychology, but for translational biomedicine as well. Together with the upcoming total synaptic connectome of the Drosophila nervous system and the possibilities of single-cell-specific transgene expression, it offers enticing opportunities for research. Indeed, the paradigm has already been adopted by a number of labs and is robust enough to be used for teaching in classroom settings. This has given rise to a demand for a detailed, hands-on manual directed at newcomers and/or at laboratory novices, and this is what we here provide.

The paradigm and the present manual have a unique set of features:

The present manual can thus foster science education at an earlier age and enable research by a broader community than has been the case to date.

Common microbehavioral "footprint" of two distinct classes of conditioned aversion

Avoiding unfavorable situations is a vital skill and a constant task for any animal. Situations can be unfavorable because they feature something that the animal wants to escape from, or because they do not feature something that it seeks to obtain. We investigate whether the microbehavioral mechanisms by which these two classes of aversion come about are shared or distinct. We find that larval Drosophila avoid odors either previously associated with a punishment, or previously associated with the lack of a reward. These two classes of conditioned aversion are found to be strikingly alike at the microbehavioral level. In both cases larvae show more head casts when oriented toward the odor source than when oriented away, and direct fewer of their head casts toward the odor than away when oriented obliquely to it. Thus, conditioned aversion serving two qualitatively different functions—escape from a punishment or search for a reward—is implemented by the modulation of the same microbehavioral features. These features also underlie conditioned approach, albeit with opposite sign. That is, the larvae show conditioned approach toward odors previously associated with a reward, or with the lack of a punishment. In order to accomplish both these classes of conditioned approach the larvae show fewer head casts when oriented toward an odor, and direct more of their head casts toward it when they are headed obliquely. Given that the Drosophila larva is a genetically tractable model organism that is well suited to study simple circuits at the single-cell level, these analyses can guide future research into the neuronal circuits underlying conditioned approach and aversion, and the computational principles of conditioned search and escape.

Preference for and learning of amino acids in larval Drosophila

Relative to other nutrients, less is known about how animals sense amino acids and how behaviour is organized accordingly. This is a significant gap in our knowledge because amino acids are required for protein synthesis - and hence for life as we know it. Choosing Drosophila larvae as a case study, we provide the first systematic analysis of both the preference behaviour for, and the learning of, all 20 canonical amino acids in Drosophila We report that preference for individual amino acids differs according to the kind of amino acid, both in first-instar and in third-instar larvae. Our data suggest that this preference profile changes across larval instars, and that starvation during the third instar also alters this profile. Only aspartic acid turns out to be robustly attractive across all our experiments. The essentiality of amino acids does not appear to be a determinant of preference. Interestingly, although amino acids thus differ in their innate attractiveness, we find that all amino acids are equally rewarding. Similar discrepancies between innate attractiveness and reinforcing effect have previously been reported for other tastants, including sugars, bitter substances and salt. The present analyses will facilitate the ongoing search for the receptors, sensory neurons, and internal, homeostatic amino acid sensors in Drosophila.

Drosophila FIT is a protein-specific satiety hormone essential for feeding control

Protein homeostasis is critical for health and lifespan of animals. However, the mechanisms for controlling protein feeding remain poorly understood. Here we report that in Drosophila, protein intake-induced feeding inhibition (PIFI) is specific to protein-containing food, and this effect is mediated by a fat body (FB) peptide named female-specific independent of transformer (FIT). Upon consumption of protein food, FIT expression is greatly elevated. Secreted FIT peptide in the fly haemolymph conveys this metabolic message to the brain, thereby promoting the release of Drosophila insulin-like peptide 2 (DILP2) and suppressing further protein intake. Interestingly, Fit is a sexually dimorphic gene, and consequently protein consumption-induced insulin release, as well as protein feeding behaviour, are also dimorphic between sexes. Thus, our findings reveal a protein-specific satiety hormone, providing important insights into the complex regulation of feeding decision, as well as the sexual dimorphism in feeding behaviour.

Continuous lateral oscillations as a core mechanism for taxis in Drosophila larvae

Taxis behaviour in Drosophila larva is thought to consist of distinct control mechanisms triggering specific actions. Here, we support a simpler hypothesis: that taxis results from direct sensory modulation of continuous lateral oscillations of the anterior body, sparing the need for ‘action selection’. Our analysis of larvae motion reveals a rhythmic, continuous lateral oscillation of the anterior body, encompassing all head-sweeps, small or large, without breaking the oscillatory rhythm. Further, we show that an agent-model that embeds this hypothesis reproduces a surprising number of taxis signatures observed in larvae. Also, by coupling the sensory input to a neural oscillator in continuous time, we show that the mechanism is robust and biologically plausible. The mechanism provides a simple architecture for combining information across modalities, and explaining how learnt associations modulate taxis. We discuss the results in the light of larval neural circuitry and make testable predictions.

DOI:http://dx.doi.org/10.7554/eLife.15504.001

Remembering Components of Food in Drosophila

Remembering features of past feeding experience can refine foraging and food choice. Insects can learn to associate sensory cues with components of food, such as sugars, amino acids, water, salt, alcohol, toxins and pathogens. In the fruit fly Drosophila some food components activate unique subsets of dopaminergic neurons (DANs) that innervate distinct functional zones on the mushroom bodies (MBs). This architecture suggests that the overall dopaminergic neuron population could provide a potential cellular substrate through which the fly might learn to value a variety of food components. In addition, such an arrangement predicts that individual component memories reside in unique locations. DANs are also critical for food memory consolidation and deprivation-state dependent motivational control of the expression of food-relevant memories. Here, we review our current knowledge of how nutrient-specific memories are formed, consolidated and specifically retrieved in insects, with a particular emphasis on Drosophila.

Four Individually Identified Paired Dopamine Neurons Signal Reward in Larval Drosophila

Dopaminergic neurons serve multiple functions, including reinforcement processing during associative learning [1-12]. It is thus warranted to understand which dopaminergic neurons mediate which function. We study larval Drosophila, in which only approximately 120 of a total of 10,000 neurons are dopaminergic, as judged by the expression of tyrosine hydroxylase (TH), the rate-limiting enzyme of dopamine biosynthesis [5, 13]. Dopaminergic neurons mediating reinforcement in insect olfactory learning target the mushroom bodies, a higher-order "cortical" brain region [1-5, 11, 12, 14, 15]. We discover four previously undescribed paired neurons, the primary protocerebral anterior medial (pPAM) neurons. These neurons are TH positive and subdivide the medial lobe of the mushroom body into four distinct subunits. These pPAM neurons are acutely necessary for odor-sugar reward learning and require intact TH function in this process. However, they are dispensable for aversive learning and innate behavior toward the odors and sugars employed. Optogenetical activation of pPAM neurons is sufficient as a reward. Thus, the pPAM neurons convey a likely dopaminergic reward signal. In contrast, DL1 cluster neurons convey a corresponding punishment signal [5], suggesting a cellular division of labor to convey dopaminergic reward and punishment signals. On the level of individually identified neurons, this uncovers an organizational principle shared with adult Drosophila and mammals [1-4, 7, 9, 10] (but see [6]). The numerical simplicity and connectomic tractability of the larval nervous system [16-19] now offers a prospect for studying circuit principles of dopamine function at unprecedented resolution.

Drosophila females trade off good nutrition with high quality oviposition sites when choosing foods

Animals, from insects to human, select foods to regulate their acquisition of key nutrients in amounts and balances maximising fitness. In species where the nutrition of juveniles depends on parents, adults must make challenging foraging decisions that simultaneously address their own nutrient needs as well as those of the progeny. Here we examined how fruit flies Drosophila melanogaster, a species where individuals eat and lay eggs in decaying fruits, integrate feeding decisions (individual nutrition) and oviposition decisions (offspring nutrition) when foraging. Using cafeteria assays with artificial diets varying in concentrations and ratios of protein to carbohydrates, we show that Drosophila females exhibit complex foraging patterns, alternating between laying eggs on high carbohydrate foods and feeding on foods with different nutrient contents depending on their own nutritional state. Although larvae showed faster development on high protein foods, both survival and learning performances were higher on balanced foods. We suggest that the apparent mismatch between the oviposition preference of females for high carbohydrate foods and the high performances of larvae on balanced foods reflects a natural situation where high carbohydrate ripened fruits gradually enrich in proteinaceous yeast as they start rotting, thereby yielding optimal nutrition for the developing larvae. Our findings that animals with rudimentary parental care uncouple feeding and egg-laying decisions in order to balance their own diet and provide a nutritionally optimal environment to their progeny reveals unsuspected levels of complexity in the nutritional ecology of parent-offspring interactions.

Taste processing in Drosophila larvae

The sense of taste allows animals to detect chemical substances in their environment to initiate appropriate behaviors: to find food or a mate, to avoid hostile environments and predators. Drosophila larvae are a promising model organism to study gustation. Their simple nervous system triggers stereotypic behavioral responses, and the coding of taste can be studied by genetic tools at the single cell level. This review briefly summarizes recent progress on how taste information is sensed and processed by larval cephalic and pharyngeal sense organs. The focus lies on several studies, which revealed cellular and molecular mechanisms required to process sugar, salt, and bitter substances.

The impact of odor-reward memory on chemotaxis in larval Drosophila

How do animals adaptively integrate innate with learned behavioral tendencies? We tackle this question using chemotaxis as a paradigm. Chemotaxis in the Drosophila larva largely results from a sequence of runs and oriented turns. Thus, the larvae minimally need to determine (i) how fast to run, (ii) when to initiate a turn, and (iii) where to direct a turn. We first report how odor-source intensities modulate these decisions to bring about higher levels of chemotactic performance for higher odor-source intensities during innate chemotaxis. We then examine whether the same modulations are responsible for alterations of chemotactic performance by learned odor “valence” (understood throughout as level of attractiveness). We find that run speed (i) is neither modulated by the innate nor by the learned valence of an odor. Turn rate (ii), however, is modulated by both: the higher the innate or learned valence of the odor, the less often larvae turn whenever heading toward the odor source, and the more often they turn when heading away. Likewise, turning direction (iii) is modulated concordantly by innate and learned valence: turning is biased more strongly toward the odor source when either innate or learned valence is high. Using numerical simulations, we show that a modulation of both turn rate and of turning direction is sufficient to account for the empirically found differences in preference scores across experimental conditions. Our results suggest that innate and learned valence organize adaptive olfactory search behavior by their summed effects on turn rate and turning direction, but not on run speed. This work should aid studies into the neural mechanisms by which memory impacts specific aspects of behavior.

Identity-specific coding of future rewards in the human orbitofrontal cortex

Nervous systems must encode information about the identity of expected outcomes to make adaptive decisions. However, the neural mechanisms underlying identity-specific value signaling remain poorly understood. By manipulating the value and identity of appetizing food odors in a pattern-based imaging paradigm of human classical conditioning, we were able to identify dissociable predictive representations of identity-specific reward in orbitofrontal cortex (OFC) and identity-general reward in ventromedial prefrontal cortex (vmPFC). Reward-related functional coupling between OFC and olfactory (piriform) cortex and between vmPFC and amygdala revealed parallel pathways that support identity-specific and -general predictive signaling. The demonstration of identity-specific value representations in OFC highlights a role for this region in model-based behavior and reveals mechanisms by which appetitive behavior can go awry.