Computations underlying Drosophila photo-taxis, odor-taxis, and multi-sensory integration

Navigation strategies in Caenorhabditis elegans are differentially altered by learning

Learned olfactory-guided navigation is a powerful platform for studying how a brain generates goal-directed behaviors. However, the quantitative changes that occur in sensorimotor transformations and the underlying neural circuit substrates to generate such learning-dependent navigation is still unclear. Here we investigate learned sensorimotor processing for navigation in the nematode Caenorhabditis elegans by measuring and modeling experience-dependent odor and salt chemotaxis. We then explore the neural basis of learned odor navigation through perturbation experiments. We develop a novel statistical model to characterize how the worm employs two behavioral strategies: a biased random walk and weathervaning. We infer weights on these strategies and characterize sensorimotor kernels that govern them by fitting our model to the worm's time-varying navigation trajectories and precise sensory experiences. After olfactory learning, the fitted odor kernels reflect how appetitive and aversive trained worms up- and down-regulate both strategies, respectively. The model predicts an animal's past olfactory learning experience with  > 90% accuracy given finite observations, outperforming a classical chemotaxis metric. The model trained on natural odors further predicts the animals' learning-dependent response to optogenetically induced odor perception. Our measurements and model show that behavioral variability is altered by learning-trained worms exhibit less variable navigation than naive ones. Genetically disrupting individual interneuron classes downstream of an odor-sensing neuron reveals that learned navigation strategies are distributed in the network. Together, we present a flexible navigation algorithm that is supported by distributed neural computation in a compact brain.

Q-learning with temporal memory to navigate turbulence

We consider the problem of olfactory searches in a turbulent environment. We focus on agents that respond solely to odor stimuli, with no access to spatial perception nor prior information about the odor. We ask whether navigation to a target can be learned robustly within a sequential decision making framework. We develop a reinforcement learning algorithm using a small set of interpretable olfactory states and train it with realistic turbulent odor cues. By introducing a temporal memory, we demonstrate that two salient features of odor traces, discretized in few olfactory states, are sufficient to learn navigation in a realistic odor plume. Performance is dictated by the sparse nature of turbulent odors. An optimal memory exists which ignores blanks within the plume and activates a recovery strategy outside the plume. We obtain the best performance by letting agents learn their recovery strategy and show that it is mostly casting cross wind, similar to behavior observed in flying insects. The optimal strategy is robust to substantial changes in the odor plumes, suggesting minor parameter tuning may be sufficient to adapt to different environments.

The neurobiology of parenting and infant-evoked aggression

Parenting behavior comprises a variety of adult-infant and adult-adult interactions across multiple timescales. The state transition from nonparent to parent requires an extensive reorganization of individual priorities and physiology and is facilitated by combinatorial hormone action on specific cell types that are integrated throughout interconnected and brainwide neuronal circuits. In this review, we take a comprehensive approach to integrate historical and current literature on each of these topics across multiple species, with a focus on rodents. New and emerging molecular, circuit-based, and computational technologies have recently been used to address outstanding gaps in our current framework of knowledge on infant-directed behavior. This work is raising fundamental questions about the interplay between instinctive and learned components of parenting and the mutual regulation of affiliative versus agonistic infant-directed behaviors in health and disease. Whenever possible, we point to how these technologies have helped gain novel insights and opened new avenues of research into the neurobiology of parenting. We hope this review will serve as an introduction for those new to the field, a comprehensive resource for those already studying parenting, and a guidepost for designing future studies.

CRASH2p: Closed-loop Two Photon Imaging in a Freely Moving Animal

Direct measurement of neural activity in freely moving animals is essential for understanding how the brain controls and represents behaviors. Genetically encoded calcium indicators report neural activity as changes in fluorescence intensity, but brain motion confounds quantitative measurement of fluorescence. Translation, rotation, and deformation of the brain and the movements of intervening scattering or auto-fluorescent tissue all alter the amount of fluorescent light captured by a microscope. Compared to single-photon approaches, two photon microscopy is less sensitive to scattering and off-target fluorescence, but more sensitive to motion, and two photon imaging has always required anchoring the microscope to the brain. We developed a closed-loop resonant axial-scanning high-speed two photon (CRASH2p) microscope for real-time 3D motion correction in unrestrained animals, without implantation of reference markers. We complemented CRASH2p with a novel scanning strategy and a multi-stage registration pipeline. We performed volumetric ratiometrically corrected functional imaging in the CNS of freely moving Drosophila larvae and discovered previously unknown neural correlates of behavior.

Attractiveness versus stickiness: Behavioural preferences of Drosophila melanogaster with competing visual stimuli

In nature, animals often encounter various competing stimuli and must make choices among them. Although the behaviour under two identical stimuli has been extensively studied for fruit flies, Drosophila melanogaster, how the appeal of one stimulus for the animals is influenced by the appeal of the other is not fully understood. In the present study, we systematically investigated this equation using a modified Buridan's paradigm. We focused on the behaviour of fruit flies under asymmetric visual stimuli, i.e., two black stripes of different widths. We characterized two behaviour modes: (1) Attractiveness: moving toward a stripe in the inner area of the platform, and (2) Stickiness: staying around the edge near a stripe. Our results reveal that while Attractiveness of a stripe is primarily influenced by its own width and remains relatively independent of the opposite stripe, Stickiness is significantly affected by the width of the competing stripe. These findings suggest that the behavioural response of fruit flies to visual stimuli involves complex decision-making processes influenced by both intrinsic and extrinsic factors. This study provides new insights into the cognitive and sensory mechanisms underlying visual preference behaviour in Drosophila and highlights the importance of considering multiple stimuli in behavioural assays.

Tracking the Navigation Behavior of Drosophila Larvae in Real and Virtual Odor Gradients by Using the Raspberry Pi Virtual Reality (PiVR) System

In a closed-loop experimental paradigm, an animal experiences a modulation of its sensory input as a function of its own behavior. Tools enabling closed-loop experiments are crucial for delineating causal relationships between the activity of genetically labeled neurons and specific behavioral responses. We have recently developed an experimental platform known as "Raspberry Pi Virtual Reality" (PiVR) that is used to perform closed-loop optogenetic stimulation of neurons in unrestrained animals. PiVR is a system that operates at high temporal resolution (>30-Hz) and with low latencies. Larvae of the fruit fly Drosophila melanogaster are ideal to study the role of individual neurons in modulating behavior to aid the understanding of the neural pathways underlying various guided behaviors. Here, we introduce larval chemotaxis as an example of a navigational behavior in which an animal seeks to locate a target-in this case, the attractive source of an odor-by tracking a concentration gradient. The methodologies that we describe here combine the use of PiVR with the study of larval chemotaxis in real and virtual odor gradients, but these can also be readily adapted to other sensory modalities.

Sensorimotor transformation underlying odor-modulated locomotion in walking Drosophila

Most real-world behaviors - such as odor-guided locomotion - are performed with incomplete information. Activity in olfactory receptor neuron (ORN) classes provides information about odor identity but not the location of its source. In this study, we investigate the sensorimotor transformation that relates ORN activation to locomotion changes in Drosophila by optogenetically activating different combinations of ORN classes and measuring the resulting changes in locomotion. Three features describe this sensorimotor transformation: First, locomotion depends on both the instantaneous firing frequency (f) and its change (df); the two together serve as a short-term memory that allows the fly to adapt its motor program to sensory context automatically. Second, the mapping between (f, df) and locomotor parameters such as speed or curvature is distinct for each pattern of activated ORNs. Finally, the sensorimotor mapping changes with time after odor exposure, allowing information integration over a longer timescale.

Linking neural circuits to the mechanics of animal behavior in Drosophila larval locomotion

The motions that make up animal behavior arise from the interplay between neural circuits and the mechanical parts of the body. Therefore, in order to comprehend the operational mechanisms governing behavior, it is essential to examine not only the underlying neural network but also the mechanical characteristics of the animal's body. The locomotor system of fly larvae serves as an ideal model for pursuing this integrative approach. By virtue of diverse investigation methods encompassing connectomics analysis and quantification of locomotion kinematics, research on larval locomotion has shed light on the underlying mechanisms of animal behavior. These studies have elucidated the roles of interneurons in coordinating muscle activities within and between segments, as well as the neural circuits responsible for exploration. This review aims to provide an overview of recent research on the neuromechanics of animal locomotion in fly larvae. We also briefly review interspecific diversity in fly larval locomotion and explore the latest advancements in soft robots inspired by larval locomotion. The integrative analysis of animal behavior using fly larvae could establish a practical framework for scrutinizing the behavior of other animal species.

Continuous, long-term crawling behavior characterized by a robotic transport system

Detailed descriptions of behavior provide critical insight into the structure and function of nervous systems. In Drosophila larvae and many other systems, short behavioral experiments have been successful in characterizing rapid responses to a range of stimuli at the population level. However, the lack of long-term continuous observation makes it difficult to dissect comprehensive behavioral dynamics of individual animals and how behavior (and therefore the nervous system) develops over time. To allow for long-term continuous observations in individual fly larvae, we have engineered a robotic instrument that automatically tracks and transports larvae throughout an arena. The flexibility and reliability of its design enables controlled stimulus delivery and continuous measurement over developmental time scales, yielding an unprecedented level of detailed locomotion data. We utilize the new system's capabilities to perform continuous observation of exploratory search behavior over a duration of 6 hr with and without a thermal gradient present, and in a single larva for over 30 hr. Long-term free-roaming behavior and analogous short-term experiments show similar dynamics that take place at the beginning of each experiment. Finally, characterization of larval thermotaxis in individuals reveals a bimodal distribution in navigation efficiency, identifying distinct phenotypes that are obfuscated when only analyzing population averages.

Continuous odor profile monitoring to study olfactory navigation in small animals

Olfactory navigation is observed across species and plays a crucial role in locating resources for survival. In the laboratory, understanding the behavioral strategies and neural circuits underlying odor-taxis requires a detailed understanding of the animal's sensory environment. For small model organisms like Caenorhabditis elegans and larval Drosophila melanogaster, controlling and measuring the odor environment experienced by the animal can be challenging, especially for airborne odors, which are subject to subtle effects from airflow, temperature variation, and from the odor's adhesion, adsorption, or reemission. Here, we present a method to control and measure airborne odor concentration in an arena compatible with an agar substrate. Our method allows continuous controlling and monitoring of the odor profile while imaging animal behavior. We construct stationary chemical landscapes in an odor flow chamber through spatially patterned odorized air. The odor concentration is measured with a spatially distributed array of digital gas sensors. Careful placement of the sensors allows the odor concentration across the arena to be continuously inferred in space and monitored through time. We use this approach to measure the odor concentration that each animal experiences as it undergoes chemotaxis behavior and report chemotaxis strategies for C. elegans and D. melanogaster larvae populations as they navigate spatial odor landscapes.

Olfactory navigation in arthropods

Using odors to find food and mates is one of the most ancient and highly conserved behaviors. Arthropods from flies to moths to crabs use broadly similar strategies to navigate toward odor sources-such as integrating flow information with odor information, comparing odor concentration across sensors, and integrating odor information over time. Because arthropods share many homologous brain structures-antennal lobes for processing olfactory information, mechanosensors for processing flow, mushroom bodies (or hemi-ellipsoid bodies) for associative learning, and central complexes for navigation, it is likely that these closely related behaviors are mediated by conserved neural circuits. However, differences in the types of odors they seek, the physics of odor dispersal, and the physics of locomotion in water, air, and on substrates mean that these circuits must have adapted to generate a wide diversity of odor-seeking behaviors. In this review, we discuss common strategies and specializations observed in olfactory navigation behavior across arthropods, and review our current knowledge about the neural circuits subserving this behavior. We propose that a comparative study of arthropod nervous systems may provide insight into how a set of basic circuit structures has diversified to generate behavior adapted to different environments.

Multi-neuronal recording in unrestrained animals with all acousto-optic random-access line-scanning two-photon microscopy

To understand how neural activity encodes and coordinates behavior, it is desirable to record multi-neuronal activity in freely behaving animals. Imaging in unrestrained animals is challenging, especially for those, like larval Drosophila melanogaster, whose brains are deformed by body motion. A previously demonstrated two-photon tracking microscope recorded from individual neurons in freely crawling Drosophila larvae but faced limits in multi-neuronal recording. Here we demonstrate a new tracking microscope using acousto-optic deflectors (AODs) and an acoustic GRIN lens (TAG lens) to achieve axially resonant 2D random access scanning, sampling along arbitrarily located axial lines at a line rate of 70 kHz. With a tracking latency of 0.1 ms, this microscope recorded activities of various neurons in moving larval Drosophila CNS and VNC including premotor neurons, bilateral visual interneurons, and descending command neurons. This technique can be applied to the existing two-photon microscope to allow for fast 3D tracking and scanning.

Temporal novelty detection and multiple timescale integration drive Drosophila orientation dynamics in temporally diverse olfactory environments

To survive, insects must effectively navigate odor plumes to their source. In natural plumes, turbulent winds break up smooth odor regions into disconnected patches, so navigators encounter brief bursts of odor interrupted by bouts of clean air. The timing of these encounters plays a critical role in navigation, determining the direction, rate, and magnitude of insects' orientation and speed dynamics. Disambiguating the specific role of odor timing from other cues, such as spatial structure, is challenging due to natural correlations between plumes' temporal and spatial features. Here, we use optogenetics to isolate temporal features of odor signals, examining how the frequency and duration of odor encounters shape the navigational decisions of freely-walking Drosophila. We find that fly angular velocity depends on signal frequency and intermittency-the fraction of time signal can be detected-but not directly on durations. Rather than switching strategies when signal statistics change, flies smoothly transition between signal regimes, by combining an odor offset response with a frequency-dependent novelty-like response. In the latter, flies are more likely to turn in response to each odor hit only when the hits are sparse. Finally, the upwind bias of individual turns relies on a filtering scheme with two distinct timescales, allowing rapid and sustained responses in a variety of signal statistics. A quantitative model incorporating these ingredients recapitulates fly orientation dynamics across a wide range of environments and shows that temporal novelty detection, when combined with odor motion detection, enhances odor plume navigation.

Continuous, long-term crawling behavior characterized by a robotic transport system

Detailed descriptions of behavior provide critical insight into the structure and function of nervous systems. In Drosophila larvae and many other systems, short behavioral experiments have been successful in characterizing rapid responses to a range of stimuli at the population level. However, the lack of long-term continuous observation makes it difficult to dissect comprehensive behavioral dynamics of individual animals and how behavior (and therefore the nervous system) develops over time. To allow for long-term continuous observations in individual fly larvae, we have engineered a robotic instrument that automatically tracks and transports larvae throughout an arena. The flexibility and reliability of its design enables controlled stimulus delivery and continuous measurement over developmental time scales, yielding an unprecedented level of detailed locomotion data. We utilize the new system’s capabilities to perform continuous observation of exploratory behavior over a duration of six hours with and without a thermal gradient present, and in a single larva for over 30 hours. Long-term free-roaming behavior and analogous short-term experiments show similar dynamics that take place at the beginning of each experiment. Finally, characterization of larval thermotaxis in individuals reveals a bimodal distribution in navigation efficiency, identifying distinct phenotypes that are obfuscated when only analyzing population averages.

Collective Behaviors of Active Matter Learning from Natural Taxes Across Scales

Taxis orientation is common in microorganisms, and it provides feasible strategies to operate active colloids as small-scale robots. Collective taxes involve numerous units that collectively perform taxis motion, whereby the collective cooperation between individuals enables the group to perform efficiently, adaptively, and robustly. Hence, analyzing and designing collectives is crucial for developing and advancing microswarm toward practical or clinical applications. In this review, natural taxis behaviors are categorized and synthetic microrobotic collectives are discussed as bio-inspired realizations, aiming at closing the gap between taxis strategies of living creatures and those of functional active microswarms. As collective behaviors emerge within a group, the global taxis to external stimuli guides the group to conduct overall tasks, whereas the local taxis between individuals induces synchronization and global patterns. By encoding the local orientations and programming the global stimuli, various paradigms can be introduced for coordinating and controlling such collective microrobots, from the viewpoints of fundamental science and practical applications. Therefore, by discussing the key points and difficulties associated with collective taxes of different paradigms, this review potentially offers insights into mimicking natural collective behaviors and constructing intelligent microrobotic systems for on-demand control and preassigned tasks.

An internal expectation guides Drosophila egg-laying decisions

To better understand how animals make ethologically relevant decisions, we studied egg-laying substrate choice in Drosophila. We found that flies dynamically increase or decrease their egg-laying rates while exploring substrates so as to target eggs to the best, recently visited option. Visiting the best option typically yielded inhibition of egg laying on other substrates for many minutes. Our data support a model in which flies compare the current substrate's value with an internally constructed expectation on the value of available options to regulate the likelihood of laying an egg. We show that dopamine neuron activity is critical for learning and/or expressing this expectation, similar to its role in certain tasks in vertebrates. Integrating sensory experiences over minutes to generate an estimate of the quality of available options allows flies to use a dynamic reference point for judging the current substrate and might be a general way in which decisions are made.

Multisensory Concept Learning Framework Based on Spiking Neural Networks

Concept learning highly depends on multisensory integration. In this study, we propose a multisensory concept learning framework based on brain-inspired spiking neural networks to create integrated vectors relying on the concept's perceptual strength of auditory, gustatory, haptic, olfactory, and visual. With different assumptions, two paradigms: Independent Merge (IM) and Associate Merge (AM) are designed in the framework. For testing, we employed eight distinct neural models and three multisensory representation datasets. The experiments show that integrated vectors are closer to human beings than the non-integrated ones. Furthermore, we systematically analyze the similarities and differences between IM and AM paradigms and validate the generality of our framework.

Optogenetic and thermogenetic manipulation of defined neural circuits and behaviors in Drosophila

Neural network dynamics underlying flexible animal behaviors remain elusive. The fruit fly Drosophila melanogaster is considered an excellent model in behavioral neuroscience because of its simple neuroanatomical architecture and the availability of various genetic methods. Moreover, Drosophila larvae's transparent body allows investigators to use optical methods on freely moving animals, broadening research directions. Activating or inhibiting well-defined events in excitable cells with a fine temporal resolution using optogenetics and thermogenetics led to the association of functions of defined neural populations with specific behavioral outputs such as the induction of associative memory. Furthermore, combining optogenetics and thermogenetics with state-of-the-art approaches, including connectome mapping and machine learning-based behavioral quantification, might provide a complete view of the experience- and time-dependent variations of behavioral responses. These methodologies allow further understanding of the functional connections between neural circuits and behaviors such as chemosensory, motivational, courtship, and feeding behaviors and sleep, learning, and memory.

Multimodal Information Processing and Associative Learning in the Insect Brain

Simple Summary

Insect behaviors are a great indicator of evolution and provide useful information about the complexity of organisms. The realistic sensory scene of an environment is complex and replete with multisensory inputs, making the study of sensory integration that leads to behavior highly relevant. We summarize the recent findings on multimodal sensory integration and the behaviors that originate from them in our review.

Abstract

The study of sensory systems in insects has a long-spanning history of almost an entire century. Olfaction, vision, and gustation are thoroughly researched in several robust insect models and new discoveries are made every day on the more elusive thermo- and mechano-sensory systems. Few specialized senses such as hygro- and magneto-reception are also identified in some insects. In light of recent advancements in the scientific investigation of insect behavior, it is not only important to study sensory modalities individually, but also as a combination of multimodal inputs. This is of particular significance, as a combinatorial approach to study sensory behaviors mimics the real-time environment of an insect with a wide spectrum of information available to it. As a fascinating field that is recently gaining new insight, multimodal integration in insects serves as a fundamental basis to understand complex insect behaviors including, but not limited to navigation, foraging, learning, and memory. In this review, we have summarized various studies that investigated sensory integration across modalities, with emphasis on three insect models (honeybees, ants and flies), their behaviors, and the corresponding neuronal underpinnings.

The role of food odor in invertebrate foraging

Foraging for food is an integral part of animal survival. In small insects and invertebrates, multisensory information and optimized locomotion strategies are used to effectively forage in patchy and complex environments. Here, the importance of olfactory cues for effective invertebrate foraging is discussed in detail. We review how odors are used by foragers to move toward a likely food source and the recent models that describe this sensory-driven behavior. We argue that smell serves a second function by priming an organism for the efficient exploitation of food. By appraising food odors, invertebrates can establish preferences and better adapt to their ecological niches, thereby promoting survival. The smell of food pre-prepares the gastrointestinal system and primes feeding motor programs for more effective ingestion as well. Optimizing resource utilization affects longevity and reproduction as a result, leading to drastic changes in survival. We propose that models of foraging behavior should include odor priming, and illustrate this with a simple toy model based on the marginal value theorem. Lastly, we discuss the novel techniques and assays in invertebrate research that could investigate the interactions between odor sensing and food intake. Overall, the sense of smell is indispensable for efficient foraging and influences not only locomotion, but also organismal physiology, which should be reflected in behavioral modeling.

A high-throughput method to deliver targeted optogenetic stimulation to moving C. elegans populations

We present a high-throughput optogenetic illumination system capable of simultaneous closed-loop light delivery to specified targets in populations of moving Caenorhabditis elegans. The instrument addresses three technical challenges: It delivers targeted illumination to specified regions of the animal's body such as its head or tail; it automatically delivers stimuli triggered upon the animal's behavior; and it achieves high throughput by targeting many animals simultaneously. The instrument was used to optogenetically probe the animal's behavioral response to competing mechanosensory stimuli in the the anterior and posterior gentle touch receptor neurons. Responses to more than 43,418 stimulus events from a range of anterior-posterior intensity combinations were measured. The animal's probability of sprinting forward in response to a mechanosensory stimulus depended on both the anterior and posterior stimulation intensity, while the probability of reversing depended primarily on the anterior stimulation intensity. We also probed the animal's response to mechanosensory stimulation during the onset of turning, a relatively rare behavioral event, by delivering stimuli automatically when the animal began to turn. Using this closed-loop approach, over 9,700 stimulus events were delivered during turning onset at a rate of 9.2 events per worm hour, a greater than 25-fold increase in throughput compared to previous investigations. These measurements validate with greater statistical power previous findings that turning acts to gate mechanosensory evoked reversals. Compared to previous approaches, the current system offers targeted optogenetic stimulation to specific body regions or behaviors with many fold increases in throughput to better constrain quantitative models of sensorimotor processing.

High-throughput automated methods for classical and operant conditioning of Drosophila larvae

Learning which stimuli (classical conditioning) or which actions (operant conditioning) predict rewards or punishments can improve chances of survival. However, the circuit mechanisms that underlie distinct types of associative learning are still not fully understood. Automated, high-throughput paradigms for studying different types of associative learning, combined with manipulation of specific neurons in freely behaving animals, can help advance this field. The Drosophila melanogaster larva is a tractable model system for studying the circuit basis of behaviour, but many forms of associative learning have not yet been demonstrated in this animal. Here, we developed a high-throughput (i.e. multi-larva) training system that combines real-time behaviour detection of freely moving larvae with targeted opto- and thermogenetic stimulation of tracked animals. Both stimuli are controlled in either open- or closed-loop, and delivered with high temporal and spatial precision. Using this tracker, we show for the first time that Drosophila larvae can perform classical conditioning with no overlap between sensory stimuli (i.e. trace conditioning). We also demonstrate that larvae are capable of operant conditioning by inducing a bend direction preference through optogenetic activation of reward-encoding serotonergic neurons. Our results extend the known associative learning capacities of Drosophila larvae. Our automated training rig will facilitate the study of many different forms of associative learning and the identification of the neural circuits that underpin them.

Circuits for integrating learned and innate valences in the insect brain

Animal behavior is shaped both by evolution and by individual experience. Parallel brain pathways encode innate and learned valences of cues, but the way in which they are integrated during action-selection is not well understood. We used electron microscopy to comprehensively map with synaptic resolution all neurons downstream of all mushroom body (MB) output neurons (encoding learned valences) and characterized their patterns of interaction with lateral horn (LH) neurons (encoding innate valences) in Drosophila larva. The connectome revealed multiple convergence neuron types that receive convergent MB and LH inputs. A subset of these receives excitatory input from positive-valence MB and LH pathways and inhibitory input from negative-valence MB pathways. We confirmed functional connectivity from LH and MB pathways and behavioral roles of two of these neurons. These neurons encode integrated odor value and bidirectionally regulate turning. Based on this, we speculate that learning could potentially skew the balance of excitation and inhibition onto these neurons and thereby modulate turning. Together, our study provides insights into the circuits that integrate learned and innate valences to modify behavior.

Switch-like and persistent memory formation in individual Drosophila larvae

Associative learning allows animals to use past experience to predict future events. The circuits underlying memory formation support immediate and sustained changes in function, often in response to a single example. Larval Drosophila is a genetic model for memory formation that can be accessed at molecular, synaptic, cellular, and circuit levels, often simultaneously, but existing behavioral assays for larval learning and memory do not address individual animals, and it has been difficult to form long-lasting memories, especially those requiring synaptic reorganization. We demonstrate a new assay for learning and memory capable of tracking the changing preferences of individual larvae. We use this assay to explore how activation of a pair of reward neurons changes the response to the innately aversive gas carbon dioxide (CO2). We confirm that when coupled to CO2 presentation in appropriate temporal sequence, optogenetic reward reduces avoidance of CO2. We find that learning is switch-like: all-or-none and quantized in two states. Memories can be extinguished by repeated unrewarded exposure to CO2 but are stabilized against extinction by repeated training or overnight consolidation. Finally, we demonstrate long-lasting protein synthesis dependent and independent memory formation.

Interspecies variation of larval locomotion kinematics in the genus Drosophila and its relation to habitat temperature

BACKGROUND

Speed and trajectory of locomotion are the characteristic traits of individual species. Locomotion kinematics may have been shaped during evolution towards increased survival in the habitats of each species. Although kinematics of locomotion is thought to be influenced by habitats, the quantitative relation between the kinematics and environmental factors has not been fully revealed. Here, we performed comparative analyses of larval locomotion in 11 Drosophila species.

RESULTS

We found that larval locomotion kinematics are divergent among the species. The diversity is not correlated to the body length but is correlated instead to the habitat temperature of the species. Phylogenetic analyses using Bayesian inference suggest that the evolutionary rate of the kinematics is diverse among phylogenetic tree branches.

CONCLUSIONS

The results of this study imply that the kinematics of larval locomotion has diverged in the evolutionary history of the genus Drosophila and evolved under the effects of the ambient temperature of habitats.

Navigational strategies underlying temporal phototaxis in Drosophila larvae

Navigating across light gradients is essential for survival for many animals. However, we still have a poor understanding of the algorithms that underlie such behaviors. Here, we developed a novel closed-loop phototaxis assay for Drosophila larvae in which light intensity is always spatially uniform but updates depending on the location of the animal in the arena. Even though larvae can only rely on temporal cues during runs, we find that they are capable of finding preferred areas of low light intensity. Further detailed analysis of their behavior reveals that larvae turn more frequently and that heading angle changes increase when they experience brightness increments over extended periods of time. We suggest that temporal integration of brightness change during runs is an important - and so far largely unexplored - element of phototaxis.

Optogenetics in Drosophila

The fruit fly Drosophila melanogaster, an insect 4 mm long, has served as the experimental subject in a wide range of biological research, including neuroscience. In this chapter, we briefly introduce optogenetic applications in Drosophila neuroscience research. First, we describe the development of Drosophila from egg to adult. In fly neuroscience, temperature-controlled perturbation of neural activity, sometimes called "thermogenetics," has been an invaluable tool that predates the advent of optogenetics. After briefly introducing this perturbation technique, we describe the process of generating transgenic flies that express optogenetic probes in a specific group of cells. Transgenic techniques are crucial in the application of optogenetics in Drosophila neuroscience; here we introduce the transposon P-elements, ϕC31 integrase, and CRISPR-Cas9 methods. As for cell-specific gene expression techniques, the binary expression systems utilizing Gal4-UAS, LexA-lexAop, and Q-system are described. We also present a short and basic optogenetic experiment with Drosophila larvae as a practical example. Finally, we review a few recent studies in Drosophila neuroscience that made use of optogenetics. In this overview of fly development, transgenic methods, and applications of optogenetics, we present an introductory background to optogenetics in Drosophila.

Useful road maps: studying Drosophila larva's central nervous system with the help of connectomics

The larva of Drosophila melanogaster is emerging as a powerful model system for comprehensive brain-wide understanding of the circuit implementation of neural computations. With an unprecedented amount of tools in hand, including synaptic-resolution connectomics, whole-brain imaging, and genetic tools for selective targeting of single neuron types, it is possible to dissect which circuits and computations are at work behind behaviors that have an interesting level of complexity. Here we present some of the recent advances regarding multisensory integration, learning, and action selection in Drosophila larva.

Quantifying behavior to understand the brain

Over the past years, numerous methods have emerged to automate the quantification of animal behavior at a resolution not previously imaginable. This has opened up a new field of computational ethology and will, in the near future, make it possible to quantify in near completeness what an animal is doing as it navigates its environment. The importance of improving the techniques with which we characterize behavior is reflected in the emerging recognition that understanding behavior is an essential (or even prerequisite) step to pursuing neuroscience questions. The use of these methods, however, is not limited to studying behavior in the wild or in strictly ethological settings. Modern tools for behavioral quantification can be applied to the full gamut of approaches that have historically been used to link brain to behavior, from psychophysics to cognitive tasks, augmenting those measurements with rich descriptions of how animals navigate those tasks. Here we review recent technical advances in quantifying behavior, particularly in methods for tracking animal motion and characterizing the structure of those dynamics. We discuss open challenges that remain for behavioral quantification and highlight promising future directions, with a strong emphasis on emerging approaches in deep learning, the core technology that has enabled the markedly rapid pace of progress of this field. We then discuss how quantitative descriptions of behavior can be leveraged to connect brain activity with animal movements, with the ultimate goal of resolving the relationship between neural circuits, cognitive processes and behavior.

Walking Drosophila navigate complex plumes using stochastic decisions biased by the timing of odor encounters

How insects navigate complex odor plumes, where the location and timing of odor packets are uncertain, remains unclear. Here we imaged complex odor plumes simultaneously with freely-walking flies, quantifying how behavior is shaped by encounters with individual odor packets. We found that navigation was stochastic and did not rely on the continuous modulation of speed or orientation. Instead, flies turned stochastically with stereotyped saccades, whose direction was biased upwind by the timing of prior odor encounters, while the magnitude and rate of saccades remained constant. Further, flies used the timing of odor encounters to modulate the transition rates between walks and stops. In more regular environments, flies continuously modulate speed and orientation, even though encounters can still occur randomly due to animal motion. We find that in less predictable environments, where encounters are random in both space and time, walking flies navigate with random walks biased by encounter timing.

Mini-brain computations converting dynamic olfactory inputs into orientation behavior

The neural logic underlying the conversion of non-stationary (dynamic) olfactory inputs into odor-search behaviors has been difficult to crack due to the distributed nature of the olfactory code - food odors typically co-activate multiple olfactory sensory neurons. In the Drosophila larva, the activity of a single olfactory sensory neuron is sufficient to direct accurate reorientation maneuvers in odor gradients (chemotaxis). In this reduced sensory system, a descending pathway essential for larval chemotaxis has been delineated from the peripheral olfactory system down to the premotor system. Here, I review how anatomical and functional inspections of this pathway have advanced our understanding of the neural mechanisms that convert behaviorally relevant sensory signals into orientation responses.

Complexity and plasticity in honey bee phototactic behaviour

The ability to move towards or away from a light source, namely phototaxis, is essential for a number of species to find the right environmental niche and may have driven the appearance of simple visual systems. In this study we ask if the later evolution of more complex visual systems was accompanied by a sophistication of phototactic behaviour. The honey bee is an ideal model organism to tackle this question, as it has an elaborate visual system, demonstrates exquisite abilities for visual learning and performs phototaxis. Our data suggest that in this insect, phototaxis has wavelength specific properties and is a highly dynamical response including multiple decision steps. In addition, we show that previous experience with a light (through exposure or classical aversive conditioning) modulates the phototactic response. This plasticity is dependent on the wavelength used, with blue being more labile than green or ultraviolet. Wavelength, intensity and past experience are integrated into an overall valence for each light that determines phototactic behaviour in honey bees. Thus, our results support the idea that complex visual systems allow sophisticated phototaxis. Future studies could take advantage of these findings to better understand the neuronal circuits underlying this processing of the visual information.

Spatiotemporally precise optogenetic activation of sensory neurons in freely walking Drosophila

Previous work has characterized how walking Drosophila coordinate the movements of individual limbs (DeAngelis et al., 2019). To understand the circuit basis of this coordination, one must characterize how sensory feedback from each limb affects walking behavior. However, it has remained difficult to manipulate neural activity in individual limbs of freely moving animals. Here, we demonstrate a simple method for optogenetic stimulation with body side-, body segment-, and limb-specificity that does not require real-time tracking. Instead, we activate at random, precise locations in time and space and use post hoc analysis to determine behavioral responses to specific activations. Using this method, we have characterized limb coordination and walking behavior in response to transient activation of mechanosensitive bristle neurons and sweet-sensing chemoreceptor neurons. Our findings reveal that activating these neurons has opposite effects on turning, and that activations in different limbs and body regions produce distinct behaviors.

Spatial Comparisons of Mechanosensory Information Govern the Grooming Sequence in Drosophila

Animals integrate information from different sensory modalities, body parts, and time points to inform behavioral choice, but the relevant sensory comparisons and the underlying neural circuits are still largely unknown. We use the grooming behavior of Drosophila melanogaster as a model to investigate the sensory comparisons that govern a motor sequence. Flies perform grooming movements spontaneously, but when covered with dust, they clean their bodies following an anterior-to-posterior sequence. After investigating different sensory modalities that could detect dust, we focus on mechanosensory bristle neurons, whose optogenetic activation induces a similar sequence. Computational modeling predicts that higher sensory input strength to the head will cause anterior grooming to occur first. We test this prediction using an optogenetic competition assay whereby two targeted light beams independently activate mechanosensory bristle neurons on different body parts. We find that the initial choice of grooming movement is determined by the ratio of sensory inputs to different body parts. In dust-covered flies, sensory inputs change as a result of successful cleaning movements. Simulations from our model suggest that this change results in sequence progression. One possibility is that flies perform frequent comparisons between anterior and posterior sensory inputs, and the changing ratios drive different behavior choices. Alternatively, flies may track the temporal change in sensory input to a given body part to measure cleaning effectiveness. The first hypothesis is supported by our optogenetic competition experiments: iterative spatial comparisons of sensory inputs between body parts is essential for organizing grooming movements in sequence.

Zhang et al. find that Drosophila covered with dust compare sensory inputs from mechanosensory bristles on different body parts during grooming. The ratio of anterior:posterior sensory input and its dynamics, rather than the rate of dust removal from the anterior, drives the anterior-to-posterior grooming sequence.

Studying neural circuits of decision-making in Drosophila larva

To study neural circuits underlying decisions, the model organism used for that purpose has to be simple enough to be able to dissect the circuitry neuron by neuron across the nervous system and in the same time complex enough to be able to perform different types of decisions. Here, I lay out the case: (1) that Drosophila larva is an advantageous model system that balances well these two requirements and (2) the insights gained from this model, assuming that circuit principles may be shared across species, can be used to advance our knowledge of neural circuit implementation of decision-making in general, including in more complex brains.

Multisensory control of navigation in the fruit fly

Spatial navigation is influenced by cues from nearly every sensory modality and thus provides an excellent model for understanding how different sensory streams are integrated to drive behavior. Here we review recent work on multisensory control of navigation in the model organism Drosophila melanogaster, which allows for detailed circuit dissection. We identify four modes of integration that have been described in the literature-suppression, gating, summation, and association-and describe regions of the larval and adult brain that have been implicated in sensory integration. Finally we discuss what circuit architectures might support these different forms of integration. We argue that Drosophila is an excellent model to discover these circuit and biophysical motifs.

Controlling and measuring dynamic odorant stimuli in the laboratory

Animals experience complex odorant stimuli that vary widely in composition, intensity and temporal properties. However, stimuli used to study olfaction in the laboratory are much simpler. This mismatch arises from the challenges in measuring and controlling them precisely and accurately. Even simple pulses can have diverse kinetics that depend on their molecular identity. Here, we introduce a model that describes how stimulus kinetics depend on the molecular identity of the odorant and the geometry of the delivery system. We describe methods to deliver dynamic odorant stimuli of several types, including broadly distributed stimuli that reproduce some of the statistics of naturalistic plumes, in a reproducible and precise manner. Finally, we introduce a method to calibrate a photo-ionization detector to any odorant it can detect, using no additional components. Our approaches are affordable and flexible and can be used to advance our understanding of how olfactory neurons encode real-world odor signals.

An Adaptive-Threshold Mechanism for Odor Sensation and Animal Navigation

Identifying the environmental information and computations that drive sensory detection is key for understanding animal behavior. Using experimental and theoretical analysis of AWC^ON, a well-described olfactory neuron in C. elegans, here we derive a general and broadly useful model that matches stimulus history to odor sensation and behavioral responses. We show that AWC^ON sensory activity is regulated by an absolute signal threshold that continuously adapts to odor history, allowing animals to compare present and past odor concentrations. The model predicts sensory activity and probabilistic behavior during animal navigation in different odor gradients and across a broad stimulus regime. Genetic studies demonstrate that the cGMP-dependent protein kinase EGL-4 determines the timescale of threshold adaptation, defining a molecular basis for a critical model feature. The adaptive threshold model efficiently filters stimulus noise, allowing reliable sensation in fluctuating environments, and represents a feedforward sensory mechanism with implications for other sensory systems.

Computational Neuroethology: A Call to Action

The brain is worthy of study because it is in charge of behavior. A flurry of recent technical advances in measuring and quantifying naturalistic behaviors provide an important opportunity for advancing brain science. However, the problem of understanding unrestrained behavior in the context of neural recordings and manipulations remains unsolved, and developing approaches to addressing this challenge is critical. Here we discuss considerations in computational neuroethology-the science of quantifying naturalistic behaviors for understanding the brain-and propose strategies to evaluate progress. We point to open questions that require resolution and call upon the broader systems neuroscience community to further develop and leverage measures of naturalistic, unrestrained behavior, which will enable us to more effectively probe the richness and complexity of the brain.

Modelling the mechanics of exploration in larval Drosophila

The Drosophila larva executes a stereotypical exploratory routine that appears to consist of stochastic alternation between straight peristaltic crawling and reorientation events through lateral bending. We present a model of larval mechanics for axial and transverse motion over a planar substrate, and use it to develop a simple, reflexive neuromuscular model from physical principles. The mechanical model represents the midline of the larva as a set of point masses which interact with each other via damped translational and torsional springs, and with the environment via sliding friction forces. The neuromuscular model consists of: 1. segmentally localised reflexes that amplify axial compression in order to counteract frictive energy losses, and 2. long-range mutual inhibition between reflexes in distant segments, enabling overall motion of the model larva relative to its substrate. In the absence of damping and driving, the mechanical model produces axial travelling waves, lateral oscillations, and unpredictable, chaotic deformations. The neuromuscular model counteracts friction to recover these motion patterns, giving rise to forward and backward peristalsis in addition to turning. Our model produces spontaneous exploration, even though the nervous system has no intrinsic pattern generating or decision making ability, and neither senses nor drives bending motions. Ultimately, our model suggests a novel view of larval exploration as a deterministic superdiffusion process which is mechanistically grounded in the chaotic mechanics of the body. We discuss how this may provide new interpretations for existing observations at the level of tissue-scale activity patterns and neural circuitry, and provide some experimental predictions that would test the extent to which the mechanisms we present translate to the real larva.

We investigate the relationship between brain, body and environment in the exploratory behaviour of fruitfly larva. A larva crawls forward by propagating a wave of compression through its segmented body, and changes its crawling direction by bending to one side or the other. We show first that a purely mechanical model of the larva’s body can produce travelling compression waves, sideways bending, and unpredictable, chaotic motions. For this body to locomote through its environment, it is necessary to add a neuromuscular system to counteract the loss of energy due to friction, and to limit the simultaneous compression of segments. These simple additions allow our model larva to generate life-like forward and backward crawling as well as spontaneous turns, which occur without any direct sensing or control of reorientation. The unpredictability inherent in the larva’s physics causes the model to explore its environment, despite the lack of any neural mechanism for rhythm generation or for deciding when to switch from crawling to turning. Our model thus demonstrates how understanding body mechanics can generate and simplify neurobiological hypotheses as to how behaviour arises.

A Neuromechanical Model of Larval Chemotaxis

Larval Drosophila move up attractive chemical gradients, and down aversive ones. Although their movement is often characterized as a series of runs and directed turns, it can also be modeled as a continuous modulation of turning extent by the detected change in stimulus intensity as the animal moves through the gradient. We show that a neuromechanical model of peristaltic crawling and spontaneous bending in the larva can be adapted to produce taxis behavior by the simple addition of a local segmental reflex to modulate transverse viscosity (or "bendiness") proportionally to the intensity change detected in the head. Altering the gain produces weaker or stronger, negative or positive taxis, with behavioral statistics that qualitatively match the larva.

Reverse-Correlation Analysis of the Mechanosensation Circuit and Behavior in C. elegans Reveals Temporal and Spatial Encoding

Animals must integrate the activity of multiple mechanoreceptors to navigate complex environments. In Caenorhabditis elegans, the general roles of the mechanosensory neurons have been defined, but most studies involve end-point or single-time-point measurements, and thus lack dynamic information. Here, we formulate a set of unbiased quantitative characterizations of the mechanosensory system by using reverse correlation analysis on behavior. We use a custom tracking, selective illumination, and optogenetics platform to compare two mechanosensory systems: the gentle-touch (TRNs) and harsh-touch (PVD) circuits. This method yields characteristic linear filters that allow for the prediction of behavioral responses. The resulting filters are consistent with previous findings and further provide new insights on the dynamics and spatial encoding of the systems. Our results suggest that the tiled network of the gentle-touch neurons has better resolution for spatial encoding than the harsh-touch neurons. Additionally, linear-nonlinear models can predict behavioral responses based only on sensory neuron activity. Our results capture the overall dynamics of behavior induced by the activation of sensory neurons, providing simple transformations that quantitatively characterize these systems. Furthermore, this platform can be extended to capture the behavioral dynamics induced by any neuron or other excitable cells in the animal.

Neural Substrates of Drosophila Larval Anemotaxis

Animals use sensory information to move toward more favorable conditions. Drosophila larvae can move up or down gradients of odors (chemotax), light (phototax), and temperature (thermotax) by modulating the probability, direction, and size of turns based on sensory input. Whether larvae can anemotax in gradients of mechanosensory cues is unknown. Further, although many of the sensory neurons that mediate taxis have been described, the central circuits are not well understood. Here, we used high-throughput, quantitative behavioral assays to demonstrate Drosophila larvae anemotax in gradients of wind speeds and to characterize the behavioral strategies involved. We found that larvae modulate the probability, direction, and size of turns to move away from higher wind speeds. This suggests that similar central decision-making mechanisms underlie taxis in somatosensory and other sensory modalities. By silencing the activity of single or very few neuron types in a behavioral screen, we found two sensory (chordotonal and multidendritic class III) and six nerve cord neuron types involved in anemotaxis. We reconstructed the identified neurons in an electron microscopy volume that spans the entire larval nervous system and found they received direct input from the mechanosensory neurons or from each other. In this way, we identified local interneurons and first- and second-order subesophageal zone (SEZ) and brain projection neurons. Finally, silencing a dopaminergic brain neuron type impairs anemotaxis. These findings suggest that anemotaxis involves both nerve cord and brain circuits. The candidate neurons and circuitry identified in our study provide a basis for future detailed mechanistic understanding of the circuit principles of anemotaxis.

Stochastic thermodynamic limit on E. coli adaptation by information geometric approach

Biological systems process information under noisy environment. Sensory adaptation model of E. coli is suitable for investigation because of its simplicity. To understand the adaptation processing quantitatively, stochastic thermodynamic approach has been attempted. Information processing can be assumed as state transition of a system that consists of signal transduction molecules using thermodynamic approach, and efficiency can be measured as thermodynamic cost. Recently, using information geometry and stochastic thermodynamics, a relationship between speed of the transition and the thermodynamic cost has been investigated for a chemical reaction model. Here, we introduce this approach to sensory adaptation model of E. coli, and examined a relationship between adaptation speed and the thermodynamic cost, and efficiency of the adaptation speed. For increasing external noise level in stimulation, the efficiency decreased, but the efficiency was highly robust to external stimulation strength. Moreover, we demonstrated that there is the best noise to achieve the adaptation in the aspect of thermodynamic efficiency. Our quantification method provides a framework to understand the adaptation speed and the thermodynamic cost for various biological systems.

Variance adaptation in navigational decision making

Sensory systems relay information about the world to the brain, which enacts behaviors through motor outputs. To maximize information transmission, sensory systems discard redundant information through adaptation to the mean and variance of the environment. The behavioral consequences of sensory adaptation to environmental variance have been largely unexplored. Here, we study how larval fruit flies adapt sensory-motor computations underlying navigation to changes in the variance of visual and olfactory inputs. We show that variance adaptation can be characterized by rescaling of the sensory input and that for both visual and olfactory inputs, the temporal dynamics of adaptation are consistent with optimal variance estimation. In multisensory contexts, larvae adapt independently to variance in each sense, and portions of the navigational pathway encoding mixed odor and light signals are also capable of variance adaptation. Our results suggest multiplication as a mechanism for odor-light integration.

Sensorimotor pathway controlling stopping behavior during chemotaxis in the Drosophila melanogaster larva

Sensory navigation results from coordinated transitions between distinct behavioral programs. During chemotaxis in the Drosophila melanogaster larva, the detection of positive odor gradients extends runs while negative gradients promote stops and turns. This algorithm represents a foundation for the control of sensory navigation across phyla. In the present work, we identified an olfactory descending neuron, PDM-DN, which plays a pivotal role in the organization of stops and turns in response to the detection of graded changes in odor concentrations. Artificial activation of this descending neuron induces deterministic stops followed by the initiation of turning maneuvers through head casts. Using electron microscopy, we reconstructed the main pathway that connects the PDM-DN neuron to the peripheral olfactory system and to the pre-motor circuit responsible for the actuation of forward peristalsis. Our results set the stage for a detailed mechanistic analysis of the sensorimotor conversion of graded olfactory inputs into action selection to perform goal-oriented navigation.

Multisensory Control of Orientation in Tethered Flying Drosophila

A longstanding goal of systems neuroscience is to quantitatively describe how the brain integrates sensory cues over time. Here, we develop a closed-loop orienting paradigm in Drosophila to study the algorithms by which cues from two modalities are integrated during ongoing behavior. We find that flies exhibit two behaviors when presented simultaneously with an attractive visual stripe and aversive wind cue. First, flies perform a turn sequence where they initially turn away from the wind but later turn back toward the stripe, suggesting dynamic sensory processing. Second, turns toward the stripe are slowed by the presence of competing wind, suggesting summation of turning drives. We develop a model in which signals from each modality are filtered in space and time to generate turn commands and then summed to produce ongoing orienting behavior. This computational framework correctly predicts behavioral dynamics for a range of stimulus intensities and spatial arrangements.

Algorithms for Olfactory Search across Species

Localizing the sources of stimuli is essential. Most organisms cannot eat, mate, or escape without knowing where the relevant stimuli originate. For many, if not most, animals, olfaction plays an essential role in search. While microorganismal chemotaxis is relatively well understood, in larger animals the algorithms and mechanisms of olfactory search remain mysterious. In this symposium, we will present recent advances in our understanding of olfactory search in flies and rodents. Despite their different sizes and behaviors, both species must solve similar problems, including meeting the challenges of turbulent airflow, sampling the environment to optimize olfactory information, and incorporating odor information into broader navigational systems.

Recording Neural Activity in Unrestrained Animals with Three-Dimensional Tracking Two-Photon Microscopy

Optical recordings of neural activity in behaving animals can reveal the neural correlates of decision making, but brain motion, which often accompanies behavior, compromises these measurements. Two-photon point-scanning microscopy is especially sensitive to motion artifacts, and two-photon recording of activity has required rigid coupling between the brain and microscope. We developed a two-photon tracking microscope with extremely low-latency (360 μs) feedback implemented in hardware. This microscope can maintain continuous focus on neurons moving with velocities of 3 mm/s and accelerations of 1 m/s2 both in-plane and axially. We recorded calcium dynamics of motor neurons and inter-neurons in unrestrained freely behaving fruit fly larvae, correlating neural activity with stimulus presentations and behavioral outputs, and we measured light-induced depolarization of a visual interneuron in a moving animal using a genetically encoded voltage indicator. Our technique can be extended to stabilize recordings in a variety of moving substrates.