Walking Drosophila navigate complex plumes using stochastic decisions biased by the timing of odor encounters

Inhibitory control explains locomotor statistics in walking Drosophila

In order to forage for food, many animals regulate not only specific limb movements but the statistics of locomotor behavior, switching between long-range dispersal and local search depending on resource availability. How premotor circuits regulate locomotor statistics is not clear. Here, we analyze and model locomotor statistics and their modulation by attractive food odor in walking Drosophila. Food odor evokes three motor regimes in flies: baseline walking, upwind running during odor, and search behavior following odor loss. During search, we find that flies adopt higher angular velocities and slower ground speeds and turn for longer periods in the same direction. We further find that flies adopt periods of different mean ground speed and that these state changes influence the length of odor-evoked runs. We next developed a simple model of neural locomotor control that suggests that contralateral inhibition plays a key role in regulating the statistical features of locomotion. As the fly connectome predicts decussating inhibitory neurons in the premotor lateral accessory lobe (LAL), we gained genetic access to a subset of these neurons and tested their effects on behavior. We identified one population whose activation induces all three signature of local search and that regulates angular velocity at odor offset. We identified a second population, including a single LAL neuron pair, that bidirectionally regulates ground speed. Together, our work develops a biologically plausible computational architecture that captures the statistical features of fly locomotion across behavioral states and identifies neural substrates of these computations.

Fly navigational responses to odor motion and gradient cues are tuned to plume statistics

Odor cues guide animals to food and mates. Different environmental conditions can create differently patterned odor plumes, making navigation more challenging. Prior work has shown that animals turn upwind when they detect odor and cast crosswind when they lose it. Animals with bilateral olfactory sensors can also detect directional odor cues, such as odor gradient and odor motion. It remains unknown how animals use these two directional odor cues to guide crosswind navigation in odor plumes with distinct statistics. Here, we investigate this problem theoretically and experimentally. We show that these directional odor cues provide complementary information for navigation in different plume environments. We numerically analyzed real plumes to show that odor gradient cues are more informative about crosswind directions in relatively smooth odor plumes, while odor motion cues are more informative in turbulent or complex plumes. Neural networks trained to optimize crosswind turning converge to distinctive network structures that are tuned to odor gradient cues in smooth plumes and to odor motion cues in complex plumes. These trained networks improve the performance of artificial agents navigating plume environments that match the training environment. By recording Drosophila fruit flies as they navigated different odor plume environments, we verified that flies show the same correspondence between informative cues and plume types. Fly turning in the crosswind direction is correlated with odor gradients in smooth plumes and with odor motion in complex plumes. Overall, these results demonstrate that these directional odor cues are complementary across environments, and that animals exploit this relationship.

Significance

Many animals use smell to find food and mates, often navigating complex odor plumes shaped by environmental conditions. While upwind movement upon odor detection is well established, less is known about how animals steer crosswind to stay in the plume. We show that directional odor cues-gradients and motion-guide crosswind navigation differently depending on plume structure. Gradients carry more information in smooth plumes, while motion dominates in turbulent ones. Neural network trained to optimize crosswind navigation reflect this distinction, developing gradient sensitivity in smooth environments and motion sensitivity in complex ones. Experimentally, fruit flies adjust their turning behavior to prioritize the most informative cue in each context. These findings likely generalize to other animals navigating similarly structured odor plumes.

Q-learning with temporal memory to navigate turbulence

We consider the problem of olfactory searches in a turbulent environment. We focus on agents that respond solely to odor stimuli, with no access to spatial perception nor prior information about the odor. We ask whether navigation to a target can be learned robustly within a sequential decision making framework. We develop a reinforcement learning algorithm using a small set of interpretable olfactory states and train it with realistic turbulent odor cues. By introducing a temporal memory, we demonstrate that two salient features of odor traces, discretized in few olfactory states, are sufficient to learn navigation in a realistic odor plume. Performance is dictated by the sparse nature of turbulent odors. An optimal memory exists which ignores blanks within the plume and activates a recovery strategy outside the plume. We obtain the best performance by letting agents learn their recovery strategy and show that it is mostly casting cross wind, similar to behavior observed in flying insects. The optimal strategy is robust to substantial changes in the odor plumes, suggesting minor parameter tuning may be sufficient to adapt to different environments.

Simple olfactory navigation in air and water

Two simple algorithms based on combining odor concentration differences across time and space along with information on the flow direction are tested for their ability to locate an odor source in four different odor landscapes. Image data taken from air plumes in three different regimes and a water plume are used as test environments for a bilateral ("stereo sampling") algorithm using concentration differences across two sensors and a "casting" algorithm that uses successive samples to decide orientation. Agents are started at random locations and orientations in the landscape and allowed to move until they reach the source of the odor (success) or leave the imaged area (failure). Parameters for the algorithm are chosen to optimize success and to minimize path length to the source. Success rates over 90% are consistently obtained with path lengths that can be as low as twice the starting distance from the source in air and four times the distance in the highly turbulent water plumes. We find that parameters that optimize success often lead to more exploratory pathways to the source. Information about the direction from which the odor is coming is necessary for successful navigation in the water plume and reduces the path length in the three tested air plumes.

Inhibitory control of locomotor statistics in walking Drosophila

In order to forage for food, many animals regulate not only specific limb movements but the statistics of locomotor behavior over time, switching between long-range dispersal and localized search depending on resource availability. How pre-motor circuits regulate such locomotor statistics is not clear. Here we analyze and model locomotor statistics in walking Drosophila, and their modulation by attractive food odor. Odor evokes three motor regimes in flies: baseline walking, upwind running during odor, and search behavior following odor loss. During search behavior, we find that flies adopt higher angular velocities and slower ground speeds, and tend to turn for longer periods of time in one direction. We further find that flies spontaneously adopt periods of different mean ground speed, and that these changes in state influence the length of odor-evoked runs. We next developed a simple model of neural locomotor control that suggests that contralateral inhibition plays a key role in regulating the statistical features of locomotion. As the fly connectome predicts decussating inhibitory neurons in the lateral accessory lobe (LAL), a pre-motor structure, we gained genetic access to a subset of these neurons and tested their effects on behavior. We identified one population of neurons whose activation induces all three signature of search and that bi-directionally regulates angular velocity at odor offset. We identified a second group of neurons, including a single LAL neuron pair, that bi-directionally regulate ground speed. Together, our work develops a biologically plausible computational architecture that captures the statistical features of fly locomotion across behavioral states and identifies potential neural substrates of these computations.

NeuroMechFly v2: simulating embodied sensorimotor control in adult Drosophila

Discovering principles underlying the control of animal behavior requires a tight dialogue between experiments and neuromechanical models. Such models have primarily been used to investigate motor control with less emphasis on how the brain and motor systems work together during hierarchical sensorimotor control. NeuroMechFly v2 expands Drosophila neuromechanical modeling by enabling vision, olfaction, ascending motor feedback and complex terrains that can be navigated using leg adhesion. We illustrate its capabilities by constructing biologically inspired controllers that use ascending feedback to perform path integration and head stabilization. After adding vision and olfaction, we train a controller using reinforcement learning to perform a multimodal navigation task. Finally, we illustrate more bio-realistic modeling involving complex odor plume navigation, and fly-fly following using a connectome-constrained visual network. NeuroMechFly can be used to accelerate the discovery of explanatory models of the nervous system and to develop machine learning-based controllers for autonomous artificial agents and robots.

High-speed odor sensing using miniaturized electronic nose

Animals have evolved to rapidly detect and recognize brief and intermittent encounters with odor packages, exhibiting recognition capabilities within milliseconds. Artificial olfaction has faced challenges in achieving comparable results-existing solutions are either slow; or bulky, expensive, and power-intensive-limiting applicability in real-world scenarios for mobile robotics. Here, we introduce a miniaturized high-speed electronic nose, characterized by high-bandwidth sensor readouts, tightly controlled sensing parameters, and powerful algorithms. The system is evaluated on a high-fidelity odor delivery benchmark. We showcase successful classification of tens-of-millisecond odor pulses and demonstrate temporal pattern encoding of stimuli switching with up to 60 hertz. Those timescales are unprecedented in miniaturized low-power settings and demonstrably exceed the performance observed in mice. It is now possible to match the temporal resolution of animal olfaction in robotic systems. This will allow for addressing challenges in environmental and industrial monitoring, security, neuroscience, and beyond.

How do mammals convert dynamic odor information into neural maps for landscape navigation?

Odors are transported by seemingly chaotic plumes, whose spatiotemporal structure contains rich information about space, with olfaction serving as a gateway for obtaining and processing this spatial information. Beyond tracking odors, olfaction provides localization and chemical communication cues for detecting conspecifics and predators, and linking external environments to internal cognitive maps. In this Essay, we discuss recent physiological, behavioral, and methodological advancements in mammalian olfactory research to present our current understanding of how olfaction can be used to navigate the environment. We also examine potential neural mechanisms that might convert dynamic olfactory inputs into environmental maps along this axis. Finally, we consider technological applications of odor dynamics for developing bio-inspired sensor technologies, robotics, and computational models. By shedding light on the principles underlying the processing of odor dynamics, olfactory research will pave the way for innovative solutions that bridge the gap between biology and technology, enriching our understanding of the natural world.

Wind gates olfaction-driven search states in free flight

For organisms tracking a chemical cue to its source, the motion of their surrounding fluid provides crucial information for success. Swimming and flying animals engaged in olfaction-driven search often start by turning into the direction of an oncoming wind or water current. However, it is unclear how organisms adjust their strategies when directional cues are absent or unreliable, as is often the case in nature. Here, we use the genetic toolkit of Drosophila melanogaster to develop an optogenetic paradigm to deliver temporally precise "virtual" olfactory experiences for free-flying animals in either laminar wind or still air. We first confirm that in laminar wind flies turn upwind. Furthermore, we show that they achieve this using a rapid (∼100 ms) turn, implying that flies estimate the ambient wind direction prior to "surging" upwind. In still air, flies adopt a remarkably stereotyped "sink and circle" search state characterized by ∼60° turns at 3-4 Hz, biased in a consistent direction. Together, our results show that Drosophila melanogaster assesses the presence and direction of ambient wind prior to deploying a distinct search strategy. In both laminar wind and still air, immediately after odor onset, flies decelerate and often perform a rapid turn. Both maneuvers are consistent with predictions from recent control theoretic analyses for how insects may estimate properties of wind while in flight. We suggest that flies may use their deceleration and "anemometric" turn as active sensing maneuvers to rapidly gauge properties of their wind environment before initiating a proximal or upwind search routine.

Bifurcation enhances temporal information encoding in the olfactory periphery

Living systems continually respond to signals from the surrounding environment. Survival requires that their responses adapt quickly and robustly to the changes in the environment. One particularly challenging example is olfactory navigation in turbulent plumes, where animals experience highly intermittent odor signals while odor concentration varies over many length- and timescales. Here, we show theoretically that Drosophila olfactory receptor neurons (ORNs) can exploit proximity to a bifurcation point of their firing dynamics to reliably extract information about the timing and intensity of fluctuations in the odor signal, which have been shown to be critical for odor-guided navigation. Close to the bifurcation, the system is intrinsically invariant to signal variance, and information about the timing, duration, and intensity of odor fluctuations is transferred efficiently. Importantly, we find that proximity to the bifurcation is maintained by mean adaptation alone and therefore does not require any additional feedback mechanism or fine-tuning. Using a biophysical model with calcium-based feedback, we demonstrate that this mechanism can explain the measured adaptation characteristics of Drosophila ORNs.

Bifurcation enhances temporal information encoding in the olfactory periphery

Living systems continually respond to signals from the surrounding environment. Survival requires that their responses adapt quickly and robustly to the changes in the environment. One particularly challenging example is olfactory navigation in turbulent plumes, where animals experience highly intermittent odor signals while odor concentration varies over many length- and timescales. Here, we show theoretically that Drosophila olfactory receptor neurons (ORNs) can exploit proximity to a bifurcation point of their firing dynamics to reliably extract information about the timing and intensity of fluctuations in the odor signal, which have been shown to be critical for odor-guided navigation. Close to the bifurcation, the system is intrinsically invariant to signal variance, and information about the timing, duration, and intensity of odor fluctuations is transferred efficiently. Importantly, we find that proximity to the bifurcation is maintained by mean adaptation alone and therefore does not require any additional feedback mechanism or fine-tuning. Using a biophysical model with calcium-based feedback, we demonstrate that this mechanism can explain the measured adaptation characteristics of Drosophila ORNs.

Dynamics of odor-source localization: Insights from real-time odor plume recordings and head-motion tracking in freely moving mice

Animals navigating turbulent odor plumes exhibit a rich variety of behaviors, and employ efficient strategies to locate odor sources. A growing body of literature has started to probe this complex task of localizing airborne odor sources in walking mammals to further our understanding of neural encoding and decoding of naturalistic sensory stimuli. However, correlating the intermittent olfactory information with behavior has remained a long-standing challenge due to the stochastic nature of the odor stimulus. We recently reported a method to record real-time olfactory information available to freely moving mice during odor-guided navigation, hence overcoming that challenge. Here we combine our odor-recording method with head-motion tracking to establish correlations between plume encounters and head movements. We show that mice exhibit robust head-pitch motions in the 5-14Hz range during an odor-guided navigation task, and that these head motions are modulated by plume encounters. Furthermore, mice reduce their angles with respect to the source upon plume contact. Head motions may thus be an important part of the sensorimotor behavioral repertoire during naturalistic odor-source localization.

A neural circuit architecture for rapid learning in goal-directed navigation

Anchoring goals to spatial representations enables flexible navigation but is challenging in novel environments when both representations must be acquired simultaneously. We propose a framework for how Drosophila uses internal representations of head direction (HD) to build goal representations upon selective thermal reinforcement. We show that flies use stochastically generated fixations and directed saccades to express heading preferences in an operant visual learning paradigm and that HD neurons are required to modify these preferences based on reinforcement. We used a symmetric visual setting to expose how flies' HD and goal representations co-evolve and how the reliability of these interacting representations impacts behavior. Finally, we describe how rapid learning of new goal headings may rest on a behavioral policy whose parameters are flexible but whose form is genetically encoded in circuit architecture. Such evolutionarily structured architectures, which enable rapidly adaptive behavior driven by internal representations, may be relevant across species.

Wind Gates Olfaction Driven Search States in Free Flight

For organisms tracking a chemical cue to its source, the motion of their surrounding fluid provides crucial information for success. Swimming and flying animals engaged in olfaction driven search often start by turning into the direction of an oncoming wind or water current. However, it is unclear how organisms adjust their strategies when directional cues are absent or unreliable, as is often the case in nature. Here, we use the genetic toolkit of Drosophila melanogaster to develop an optogenetic paradigm to deliver temporally precise "virtual" olfactory experiences for free-flying animals in either laminar wind or still air. We first confirm that in laminar wind flies turn upwind. Furthermore, we show that they achieve this using a rapid (∼100 ms) turn, implying that flies estimate the ambient wind direction prior to "surging" upwind. In still air, flies adopt remarkably stereotyped "sink and circle" search state characterized by ∼60°turns at 3-4 Hz, biased in a consistent direction. Together, our results show that Drosophila melanogaster assess the presence and direction of ambient wind prior to deploying a distinct search strategy. In both laminar wind and still air, immediately after odor onset, flies decelerate and often perform a rapid turn. Both maneuvers are consistent with predictions from recent control theoretic analyses for how insects may estimate properties of wind while in flight. We suggest that flies may use their deceleration and "anemometric" turn as active sensing maneuvers to rapidly gauge properties of their wind environment before initiating a proximal or upwind search routine.

Dynamics of odor-source localization: Insights from real-time odor plume recordings and head-motion tracking in freely moving mice

Animals navigating turbulent odor plumes exhibit a rich variety of behaviors, and employ efficient strategies to locate odor sources. A growing body of literature has started to probe this complex task of localizing airborne odor sources in walking mammals to further our understanding of neural encoding and decoding of naturalistic sensory stimuli. However, correlating the intermittent olfactory information with behavior has remained a long-standing challenge due to the stochastic nature of the odor stimulus. We recently reported a method to record real-time olfactory information available to freely moving mice during odor-guided navigation, hence overcoming that challenge. Here we combine our odor-recording method with head-motion tracking to establish correlations between plume encounters and head movements. We show that mice exhibit robust head-pitch motions in the 5-14Hz range during an odor-guided navigation task, and that these head motions are modulated by plume encounters. Furthermore, mice reduce their angles with respect to the source upon plume contact. Head motions may thus be an important part of the sensorimotor behavioral repertoire during naturalistic odor-source localization.

Odour source distance is predictable from a time history of odour statistics for large scale outdoor plumes

Odour plumes in turbulent environments are intermittent and sparse. Laboratory-scaled experiments suggest that information about the source distance may be encoded in odour signal statistics, yet it is unclear whether useful and continuous distance estimates can be made under real-world flow conditions. Here, we analyse odour signals from outdoor experiments with a sensor moving across large spatial scales in desert and forest environments to show that odour signal statistics can yield useful estimates of distance. We show that achieving accurate estimates of distance requires integrating statistics from 5 to 10 s, with a high temporal encoding of the olfactory signal of at least 20 Hz. By combining distance estimates from a linear model with wind-relative motion dynamics, we achieved source distance estimates in a 60 × 60 m2 search area with median errors of 3-8 m, a distance at which point odour sources are often within visual range for animals such as mosquitoes.

Exploration-exploitation model of moth-inspired olfactory navigation

Navigation of male moths towards females during the mating search offers a unique perspective on the exploration-exploitation (EE) model in decision-making. This study uses the EE model to explain male moth pheromone-driven flight paths. Wind tunnel measurements and three-dimensional tracking using infrared cameras have been leveraged to gain insights into male moth behaviour. During the experiments in the wind tunnel, disturbance to the airflow has been added and the effect of increased fluctuations on moth flights has been analysed, in the context of the proposed EE model. The exploration and exploitation phases are separated using a genetic algorithm to the experimentally obtained dataset of moth three-dimensional trajectories. First, the exploration-to-exploitation rate (EER) increases with distance from the source of the female pheromone is demonstrated, which can be explained in the context of the EE model. Furthermore, our findings reveal a compelling relationship between EER and increased flow fluctuations near the pheromone source. Using an olfactory navigation simulation and our moth-inspired navigation model, the phenomenon where male moths exhibit an enhanced EER as turbulence levels increase is explained. This research extends our understanding of optimal navigation strategies based on general biological EE models and supports the development of bioinspired navigation algorithms.

STEERING FROM THE REAR: COORDINATION OF CENTRAL PATTERN GENERATORS UNDERLYING NAVIGATION BY ASCENDING INTERNEURONS

Understanding how animals coordinate movements to achieve goals is a fundamental pursuit in neuroscience. Here we explore how neurons that reside in posterior lower-order regions of a locomotor system project to anterior higher-order regions to influence steering and navigation. We characterized the anatomy and functional role of a population of ascending interneurons in the ventral nerve cord of Drosophila larvae. Through electron microscopy reconstructions and light microscopy, we determined that the cholinergic 19f cells receive input primarily from premotor interneurons and synapse upon a diverse array of postsynaptic targets within the anterior segments including other 19f cells. Calcium imaging of 19f activity in isolated central nervous system (CNS) preparations in relation to motor neurons revealed that 19f neurons are recruited into most larval motor programmes. 19f activity lags behind motor neuron activity and as a population, the cells encode spatio-temporal patterns of locomotor activity in the larval CNS. Optogenetic manipulations of 19f cell activity in isolated CNS preparations revealed that they coordinate the activity of central pattern generators underlying exploratory headsweeps and forward locomotion in a context and location specific manner. In behaving animals, activating 19f cells suppressed exploratory headsweeps and slowed forward locomotion, while inhibition of 19f activity potentiated headsweeps, slowing forward movement. Inhibiting activity in 19f cells ultimately affected the ability of larvae to remain in the vicinity of an odor source during an olfactory navigation task. Overall, our findings provide insights into how ascending interneurons monitor motor activity and shape interactions amongst rhythm generators underlying complex navigational tasks.

Olfactory cues and memories in animal navigation

Thierry Emonet and Massimo Vergassola discuss what research shows about how animals perform the feat of navigating by smell.

Behavioral discrimination and olfactory bulb encoding of odor plume intermittency

In order to survive, animals often need to navigate a complex odor landscape where odors can exist in airborne plumes. Several odor plume properties change with distance from the odor source, providing potential navigational cues to searching animals. Here, we focus on odor intermittency, a temporal odor plume property that measures the fraction of time odor is above a threshold at a given point within the plume and decreases with increasing distance from the odor source. We sought to determine if mice can use changes in intermittency to locate an odor source. To do so, we trained mice on an intermittency discrimination task. We establish that mice can discriminate odor plume samples of low and high intermittency and that the neural responses in the olfactory bulb can account for task performance and support intermittency encoding. Modulation of sniffing, a behavioral parameter that is highly dynamic during odor-guided navigation, affects both behavioral outcome on the intermittency discrimination task and neural representation of intermittency. Together, this work demonstrates that intermittency is an odor plume property that can inform olfactory search and more broadly supports the notion that mammalian odor-based navigation can be guided by temporal odor plume properties.

The conserved RNA-binding protein Imp is required for the specification and function of olfactory navigation circuitry in Drosophila

Complex behaviors depend on the precise developmental specification of neuronal circuits, but the relationship between genetic programs for neural development, circuit structure, and behavioral output is often unclear. The central complex (CX) is a conserved sensory-motor integration center in insects, which governs many higher-order behaviors and largely derives from a small number of type II neural stem cells (NSCs). Here, we show that Imp, a conserved IGF-II mRNA-binding protein expressed in type II NSCs, plays a role in specifying essential components of CX olfactory navigation circuitry. We show the following: (1) that multiple components of olfactory navigation circuitry arise from type II NSCs. (2) Manipulating Imp expression in type II NSCs alters the number and morphology of many of these circuit elements, with the most potent effects on neurons targeting the ventral layers of the fan-shaped body (FB). (3) Imp regulates the specification of Tachykinin-expressing ventral FB input neurons. (4) Imp is required in type II NSCs for establishing proper morphology of the CX neuropil structures. (5) Loss of Imp in type II NSCs abolishes upwind orientation to attractive odor while leaving locomotion and odor-evoked regulation of movement intact. Taken together, our findings establish that a temporally expressed gene can regulate the expression of a complex behavior by developmentally regulating the specification of multiple circuit components and provides a first step toward a developmental dissection of the CX and its roles in behavior.

Inferring neural dynamics of memory during naturalistic social communication

Memory processes in complex behaviors like social communication require forming representations of the past that grow with time. The neural mechanisms that support such continually growing memory remain unknown. We address this gap in the context of fly courtship, a natural social behavior involving the production and perception of long, complex song sequences. To study female memory for male song history in unrestrained courtship, we present 'Natural Continuation' (NC)-a general, simulation-based model comparison procedure to evaluate candidate neural codes for complex stimuli using naturalistic behavioral data. Applying NC to fly courtship revealed strong evidence for an adaptive population mechanism for how female auditory neural dynamics could convert long song histories into a rich mnemonic format. Song temporal patterning is continually transformed by heterogeneous nonlinear adaptation dynamics, then integrated into persistent activity, enabling common neural mechanisms to retain continuously unfolding information over long periods and yielding state-of-the-art predictions of female courtship behavior. At a population level this coding model produces multi-dimensional advection-diffusion-like responses that separate songs over a continuum of timescales and can be linearly transformed into flexible output signals, illustrating its potential to create a generic, scalable mnemonic format for extended input signals poised to drive complex behavioral responses. This work thus shows how naturalistic behavior can directly inform neural population coding models, revealing here a novel process for memory formation.

Olfactory receptor neurons are sensitive to stimulus onset asynchrony: implications for odor source discrimination

In insects, olfactory receptor neurons (ORNs) are localized in sensilla. Within a sensillum, different ORN types are typically co-localized and exhibit nonsynaptic reciprocal inhibition through ephaptic coupling. This inhibition is hypothesized to aid odor source discrimination in environments where odor molecules (odorants) are dispersed by wind, resulting in turbulent plumes. Under these conditions, odorants from a single source arrive at the ORNs synchronously, while those from separate sources arrive asynchronously. Ephaptic inhibition is expected to be weaker for asynchronous arriving odorants from separate sources, thereby enhancing their discrimination. Previous studies have focused on ephaptic inhibition of sustained ORN responses to constant odor stimuli. This begs the question of whether ephaptic inhibition also affects transient ORN responses and if this inhibition is modulated by the temporal arrival patterns of different odorants. To address this, we recorded co-localized ORNs in the fruit fly Drosophila melanogaster and exposed them to dynamic odorant mixtures. We found reciprocal inhibition, strongly suggesting the presence of ephaptic coupling. This reciprocal inhibition does indeed modulate transient ORN responses and is sensitive to the relative timing of odor stimuli. Notably, the strength of inhibition decreases as the synchrony and correlation between arriving odorants decrease. These results support the hypothesis that ephaptic inhibition aids odor source discrimination.

Sensorimotor transformation underlying odor-modulated locomotion in walking Drosophila

Most real-world behaviors - such as odor-guided locomotion - are performed with incomplete information. Activity in olfactory receptor neuron (ORN) classes provides information about odor identity but not the location of its source. In this study, we investigate the sensorimotor transformation that relates ORN activation to locomotion changes in Drosophila by optogenetically activating different combinations of ORN classes and measuring the resulting changes in locomotion. Three features describe this sensorimotor transformation: First, locomotion depends on both the instantaneous firing frequency (f) and its change (df); the two together serve as a short-term memory that allows the fly to adapt its motor program to sensory context automatically. Second, the mapping between (f, df) and locomotor parameters such as speed or curvature is distinct for each pattern of activated ORNs. Finally, the sensorimotor mapping changes with time after odor exposure, allowing information integration over a longer timescale.

Mixing things up! - how odor blends are processed in Drosophila

Insects have to navigate a complex and rich olfactory environment consisting of mixtures of odors at varying ratios. However, we understand little of how the olfactory system represents these complex blends. This review aims to highlight some of the recent results of studying this mixture code, in the Drosophila melanogaster olfactory system, as well as gives a short background to one of the most challenging questions in olfaction - how are mixtures encoded in the brain?

Extracting spatial information from temporal odor patterns: insights from insects

Extracting spatial information from temporal stimulus patterns is essential for sensory perception (e.g. visual motion direction detection or concurrent sound segregation), but this process remains understudied in olfaction. Animals rely on olfaction to locate resources and dangers. In open environments, where odors are dispersed by turbulent wind, detection of wind direction seems crucial for odor source localization. However, recent studies showed that insects can extract spatial information from the odor stimulus itself, independently from sensing wind direction. This remarkable ability is achieved by detecting the fine-scale temporal pattern of odor encounters, which contains information about the location and size of an odor source, and the distance between different odor sources.

Analysis of Odor-Tracking Performance of Silk Moth Using a Sensory-Motor Intervention System

Animals can adaptively behave in different environmental conditions by converting environmental information obtained from their sensory organs into actions. This sensory-motor integration enables the accomplishment of various tasks and is essential for animal survival. This sensory-motor integration also plays an important role in localization to females, relying on sex pheromones floating in space. In this study, we focused on the localization behavior of the adult male silk moth, Bombyx mori. We investigated sensory-motor integration against time delay using odor plume tracking performance as an index when we set a certain time delay for the sensory and motor responses. Given that it is difficult to directly intervene in the sensory and motor functions of the silk moth, we constructed an intervention system based on a mobile behavior measurement system controlled by them. Using this intervention system, not only can timing the detection of the odor in the environment and timing the presentation of the odor to the silk moth be manipulated, but timing the reflection of the movement of the silk moth can also be manipulated. We analyzed the extent to which the localization strategy of the silk moth could tolerate sensory delays by setting a delay to the odor presentation. We also evaluated behavioral compensation by odor sensory feedback by setting a delay to the motor. The results of the localization experiment have shown that the localization success rate did not decrease when there was a motor delay. However, when there was a sensory delay, the success rate decreased depending on the time delay. Analysis of the change in behavior after detection of the odor stimulus has shown that the movement was more linear when we set a motor delay. However, the movement was accompanied by a large rotational movement when there was a delay in the sensory input. This result has suggested that behavior is compensated for the delay in motor function by feedback control of odor sensation, but not when accompanied by sensory delay. To compensate for this, the silk moth may acquire appropriate information from the environment by making large body movements.

Olfactory search with finite-state controllers

Long-range olfactory search is an extremely difficult task in view of the sparsity of odor signals that are available to the searcher and the complex encoding of the information about the source location. Current algorithmic approaches typically require a continuous memory space, sometimes of large dimensionality, which may hamper their optimization and often obscure their interpretation. Here, we show how finite-state controllers with a small set of discrete memory states are expressive enough to display rich, time-extended behavioral modules that resemble the ones observed in living organisms. Finite-state controllers optimized for olfactory search have an immediate interpretation in terms of approximate clocks and coarse-grained spatial maps, suggesting connections with neural models of search behavior.

Aerosol Alteration of Behavioral Response to Pheromone in Bombyx mori

Because of the complexity to study them, aerosols have been neglected in nearly all studies on olfaction, especially studies dealing with odor capture. However, aerosols are present in large quantities in the atmosphere and have the physico-chemical ability to interact with odor molecules, in particular the many pheromones with low volatility. We submitted male moths of Bombyx mori to bombykol puffs, the main fatty alcohol component of its sex pheromone, depending on whether the air is free of aerosols, charged with ambient concentration aerosols or supplemented with aqueous aerosols and recorded their arousal behavior. Aerosols and pheromone do interact consistently over all experiments and moths react better in low aerosol-concentration conditions. We propose four hypotheses for explaining this impediment, the two most likely resorting to competition between odor molecules and aerosols for the olfactory pores and postulate a reversal to a positive impact of aerosols on communication, depending on the particular physico-chemical properties of the multiphasic interaction. Studying the partitioning between gas and particulate phases in the transport and reception of odors is key for advancing the chemico-physical understanding of olfaction.

Continuous odor profile monitoring to study olfactory navigation in small animals

Olfactory navigation is observed across species and plays a crucial role in locating resources for survival. In the laboratory, understanding the behavioral strategies and neural circuits underlying odor-taxis requires a detailed understanding of the animal's sensory environment. For small model organisms like Caenorhabditis elegans and larval Drosophila melanogaster, controlling and measuring the odor environment experienced by the animal can be challenging, especially for airborne odors, which are subject to subtle effects from airflow, temperature variation, and from the odor's adhesion, adsorption, or reemission. Here, we present a method to control and measure airborne odor concentration in an arena compatible with an agar substrate. Our method allows continuous controlling and monitoring of the odor profile while imaging animal behavior. We construct stationary chemical landscapes in an odor flow chamber through spatially patterned odorized air. The odor concentration is measured with a spatially distributed array of digital gas sensors. Careful placement of the sensors allows the odor concentration across the arena to be continuously inferred in space and monitored through time. We use this approach to measure the odor concentration that each animal experiences as it undergoes chemotaxis behavior and report chemotaxis strategies for C. elegans and D. melanogaster larvae populations as they navigate spatial odor landscapes.

Olfactory navigation in arthropods

Using odors to find food and mates is one of the most ancient and highly conserved behaviors. Arthropods from flies to moths to crabs use broadly similar strategies to navigate toward odor sources-such as integrating flow information with odor information, comparing odor concentration across sensors, and integrating odor information over time. Because arthropods share many homologous brain structures-antennal lobes for processing olfactory information, mechanosensors for processing flow, mushroom bodies (or hemi-ellipsoid bodies) for associative learning, and central complexes for navigation, it is likely that these closely related behaviors are mediated by conserved neural circuits. However, differences in the types of odors they seek, the physics of odor dispersal, and the physics of locomotion in water, air, and on substrates mean that these circuits must have adapted to generate a wide diversity of odor-seeking behaviors. In this review, we discuss common strategies and specializations observed in olfactory navigation behavior across arthropods, and review our current knowledge about the neural circuits subserving this behavior. We propose that a comparative study of arthropod nervous systems may provide insight into how a set of basic circuit structures has diversified to generate behavior adapted to different environments.

The RNA-binding protein, Imp specifies olfactory navigation circuitry and behavior in Drosophila

Complex behaviors depend on the precise developmental specification of neuronal circuits, but the relationship between genetic prograssms for neural development, circuit structure, and behavioral output is often unclear. The central complex (CX) is a conserved sensory-motor integration center in insects that governs many higher order behaviors and largely derives from a small number of Type II neural stem cells. Here, we show that Imp, a conserved IGF-II mRNA-binding protein expressed in Type II neural stem cells, specifies components of CX olfactory navigation circuitry. We show: (1) that multiple components of olfactory navigation circuitry arise from Type II neural stem cells and manipulating Imp expression in Type II neural stem cells alters the number and morphology of many of these circuit elements, with the most potent effects on neurons targeting the ventral layers of the fan-shaped body. (2) Imp regulates the specification of Tachykinin expressing ventral fan-shaped body input neurons. (3) Imp in Type II neural stem cells alters the morphology of the CX neuropil structures. (4) Loss of Imp in Type II neural stem cells abolishes upwind orientation to attractive odor while leaving locomotion and odor-evoked regulation of movement intact. Taken together, our work establishes that a single temporally expressed gene can regulate the expression of a complex behavior through the developmental specification of multiple circuit components and provides a first step towards a developmental dissection of the CX and its roles in behavior.

Temporal novelty detection and multiple timescale integration drive Drosophila orientation dynamics in temporally diverse olfactory environments

To survive, insects must effectively navigate odor plumes to their source. In natural plumes, turbulent winds break up smooth odor regions into disconnected patches, so navigators encounter brief bursts of odor interrupted by bouts of clean air. The timing of these encounters plays a critical role in navigation, determining the direction, rate, and magnitude of insects' orientation and speed dynamics. Disambiguating the specific role of odor timing from other cues, such as spatial structure, is challenging due to natural correlations between plumes' temporal and spatial features. Here, we use optogenetics to isolate temporal features of odor signals, examining how the frequency and duration of odor encounters shape the navigational decisions of freely-walking Drosophila. We find that fly angular velocity depends on signal frequency and intermittency-the fraction of time signal can be detected-but not directly on durations. Rather than switching strategies when signal statistics change, flies smoothly transition between signal regimes, by combining an odor offset response with a frequency-dependent novelty-like response. In the latter, flies are more likely to turn in response to each odor hit only when the hits are sparse. Finally, the upwind bias of individual turns relies on a filtering scheme with two distinct timescales, allowing rapid and sustained responses in a variety of signal statistics. A quantitative model incorporating these ingredients recapitulates fly orientation dynamics across a wide range of environments and shows that temporal novelty detection, when combined with odor motion detection, enhances odor plume navigation.

Olfactory receptor neurons generate multiple response motifs, increasing coding space dimensionality

Odorants binding to olfactory receptor neurons (ORNs) trigger bursts of action potentials, providing the brain with its only experience of the olfactory environment. Our recordings made in vivo from locust ORNs showed that odor-elicited firing patterns comprise four distinct response motifs, each defined by a reliable temporal profile. Different odorants could elicit different response motifs from a given ORN, a property we term motif switching. Further, each motif undergoes its own form of sensory adaptation when activated by repeated plume-like odor pulses. A computational model constrained by our recordings revealed that organizing responses into multiple motifs provides substantial benefits for classifying odors and processing complex odor plumes: each motif contributes uniquely to encode the plume's composition and structure. Multiple motifs and motif switching further improve odor classification by expanding coding dimensionality. Our model demonstrated that these response features could provide benefits for olfactory navigation, including determining the distance to an odor source.

Robust Moth-Inspired Algorithm for Odor Source Localization Using Multimodal Information

Odor-source localization, by which one finds the source of an odor by detecting the odor itself, is an important ability to possess in order to search for leaking gases, explosives, and disaster survivors. Although many animals possess this ability, research on implementing olfaction in robotics is still developing. We developed a novel algorithm that enables a robot to localize an odor source indoors and outdoors by taking inspiration from the adult male silk moth, which we used as the target organism. We measured the female-localization behavior of the silk moth by using a virtual reality (VR) system to obtain the relationship between multiple sensory stimuli and behavior during the localization behavior. The results showed that there were two types of search active and inactive depending on the direction of odor and wind detection. In an active search, the silk moth moved faster as the odor-detection frequency increased, whereas in the inactive search, they always moved slower under all odor-detection frequencies. This phenomenon was constructed as a robust moth-inspired (RMI) algorithm and implemented on a ground-running robot. Experiments on odor-source localization in three environments with different degrees of environmental complexity showed that the RMI algorithm has the best localization performance among conventional moth-inspired algorithms. Analysis of the trajectories showed that the robot could move smoothly through the odor plume even when the environment became more complex. This indicates that switching and modulating behavior based on the direction of odor and wind detection contributes to the adaptability and robustness of odor-source localization.

Emergent behaviour and neural dynamics in artificial agents tracking odour plumes

Tracking an odour plume to locate its source under variable wind and plume statistics is a complex task. Flying insects routinely accomplish such tracking, often over long distances, in pursuit of food or mates. Several aspects of this remarkable behaviour and its underlying neural circuitry have been studied experimentally. Here we take a complementary in silico approach to develop an integrated understanding of their behaviour and neural computations. Specifically, we train artificial recurrent neural network agents using deep reinforcement learning to locate the source of simulated odour plumes that mimic features of plumes in a turbulent flow. Interestingly, the agents' emergent behaviours resemble those of flying insects, and the recurrent neural networks learn to compute task-relevant variables with distinct dynamic structures in population activity. Our analyses put forward a testable behavioural hypothesis for tracking plumes in changing wind direction, and we provide key intuitions for memory requirements and neural dynamics in odour plume tracking.

Behavioral algorithms and neural mechanisms underlying odor-modulated locomotion in insects

Odors released from mates and resources such as a host and food are often the first sensory signals that an animal can detect. Changes in locomotion in response to odors are an important mechanism by which animals access resources important to their survival. Odor-modulated changes in locomotion in insects constitute a whole suite of flexible behaviors that allow insects to close in on these resources from long distances and perform local searches to locate and subsequently assess them. Here, we review changes in odor-mediated locomotion across many insect species. We emphasize that changes in locomotion induced by odors are diverse. In particular, the olfactory stimulus is sporadic at long distances and becomes more continuous at short distances. This distance-dependent change in temporal profile produces a corresponding change in an insect's locomotory strategy. We also discuss the neural circuits underlying odor modulation of locomotion.

Drosophila olfaction: past, present and future

Among the many wonders of nature, the sense of smell of the fly Drosophila melanogaster might seem, at first glance, of esoteric interest. Nevertheless, for over a century, the 'nose' of this insect has been an extraordinary system to explore questions in animal behaviour, ecology and evolution, neuroscience, physiology and molecular genetics. The insights gained are relevant for our understanding of the sensory biology of vertebrates, including humans, and other insect species, encompassing those detrimental to human health. Here, I present an overview of our current knowledge of D. melanogaster olfaction, from molecules to behaviours, with an emphasis on the historical motivations of studies and illustration of how technical innovations have enabled advances. I also highlight some of the pressing and long-term questions.

Odour motion sensing enhances navigation of complex plumes

Odour plumes in the wild are spatially complex and rapidly fluctuating structures carried by turbulent airflows^1-4. To successfully navigate plumes in search of food and mates, insects must extract and integrate multiple features of the odour signal, including odour identity⁵, intensity⁶ and timing^6-12. Effective navigation requires balancing these multiple streams of olfactory information and integrating them with other sensory inputs, including mechanosensory and visual cues^9,12,13. Studies dating back a century have indicated that, of these many sensory inputs, the wind provides the main directional cue in turbulent plumes, leading to the longstanding model of insect odour navigation as odour-elicited upwind motion^6,8-12,14,15. Here we show that Drosophila melanogaster shape their navigational decisions using an additional directional cue-the direction of motion of odours-which they detect using temporal correlations in the odour signal between their two antennae. Using a high-resolution virtual-reality paradigm to deliver spatiotemporally complex fictive odours to freely walking flies, we demonstrate that such odour-direction sensing involves algorithms analogous to those in visual-direction sensing¹⁶. Combining simulations, theory and experiments, we show that odour motion contains valuable directional information that is absent from the airflow alone, and that both Drosophila and virtual agents are aided by that information in navigating naturalistic plumes. The generality of our findings suggests that odour-direction sensing may exist throughout the animal kingdom and could improve olfactory robot navigation in uncertain environments.

Where is that smell coming from?

Computational model reveals why pausing to sniff the air helps animals track a scent when they are far away from the source.

Learning to predict target location with turbulent odor plumes

Animal behavior and neural recordings show that the brain is able to measure both the intensity and the timing of odor encounters. However, whether intensity or timing of odor detections is more informative for olfactory-driven behavior is not understood. To tackle this question, we consider the problem of locating a target using the odor it releases. We ask whether the position of a target is best predicted by measures of timing vs intensity of its odor, sampled for a short period of time. To answer this question, we feed data from accurate numerical simulations of odor transport to machine learning algorithms that learn how to connect odor to target location. We find that both intensity and timing can separately predict target location even from a distance of several meters; however, their efficacy varies with the dilution of the odor in space. Thus, organisms that use olfaction from different ranges may have to switch among different modalities. This has implications on how the brain should represent odors as the target is approached. We demonstrate simple strategies to improve accuracy and robustness of the prediction by modifying odor sampling and appropriately combining distinct measures together. To test the predictions, animal behavior and odor representation should be monitored as the animal moves relative to the target, or in virtual conditions that mimic concentrated vs dilute environments.

Active anemosensing hypothesis: how flying insects could estimate ambient wind direction through sensory integration and active movement

Estimating the direction of ambient fluid flow is a crucial step during chemical plume tracking for flying and swimming animals. How animals accomplish this remains an open area of investigation. Recent calcium imaging with tethered flying Drosophila has shown that flies encode the angular direction of multiple sensory modalities in their central complex: orientation, apparent wind (or airspeed) direction and direction of motion. Here, we describe a general framework for how these three sensory modalities can be integrated over time to provide a continuous estimate of ambient wind direction. After validating our framework using a flying drone, we use simulations to show that ambient wind direction can be most accurately estimated with trajectories characterized by frequent, large magnitude turns. Furthermore, sensory measurements and estimates of their derivatives must be integrated over a period of time that incorporates at least one of these turns. Finally, we discuss approaches that insects might use to simplify the required computations, and present a list of testable predictions. Together, our results suggest that ambient flow estimation may be an important driver underlying the zigzagging manoeuvres characteristic of plume tracking animals' trajectories.

A persistent behavioral state enables sustained predation of humans by mosquitoes

Predatory animals pursue prey in a noisy sensory landscape, deciding when to continue or abandon their chase. The mosquito Aedes aegypti is a micropredator that first detects humans at a distance through sensory cues such as carbon dioxide. As a mosquito nears its target, it senses more proximal cues such as body heat that guide it to a meal of blood. How long the search for blood continues after initial detection of a human is not known. Here, we show that a 5 s optogenetic pulse of fictive carbon dioxide induced a persistent behavioral state in female mosquitoes that lasted for more than 10 min. This state is highly specific to females searching for a blood meal and was not induced in recently blood-fed females or in males, who do not feed on blood. In males that lack the gene fruitless, which controls persistent social behaviors in other insects, fictive carbon dioxide induced a long-lasting behavior response resembling the predatory state of females. Finally, we show that the persistent state triggered by detection of fictive carbon dioxide enabled females to engorge on a blood meal mimic offered up to 14 min after the initial 5 s stimulus. Our results demonstrate that a persistent internal state allows female mosquitoes to integrate multiple human sensory cues over long timescales, an ability that is key to their success as an apex micropredator of humans.

Mechanisms of Variability Underlying Odor-Guided Locomotion

Changes in locomotion mediated by odors (odor-guided locomotion) are an important mechanism by which animals discover resources important to their survival. Odor-guided locomotion, like most other behaviors, is highly variable. Variability in behavior can arise at many nodes along the circuit that performs sensorimotor transformation. We review these sources of variability in the context of the Drosophila olfactory system. While these sources of variability are important, using a model for locomotion, we show that another important contributor to behavioral variability is the stochastic nature of decision-making during locomotion as well as the persistence of these decisions: Flies choose the speed and curvature stochastically from a distribution and locomote with the same speed and curvature for extended periods. This stochasticity in locomotion will result in variability in behavior even if there is no noise in sensorimotor transformation. Overall, the noise in sensorimotor transformation is amplified by mechanisms of locomotion making odor-guided locomotion in flies highly variable.

The role of food odor in invertebrate foraging

Foraging for food is an integral part of animal survival. In small insects and invertebrates, multisensory information and optimized locomotion strategies are used to effectively forage in patchy and complex environments. Here, the importance of olfactory cues for effective invertebrate foraging is discussed in detail. We review how odors are used by foragers to move toward a likely food source and the recent models that describe this sensory-driven behavior. We argue that smell serves a second function by priming an organism for the efficient exploitation of food. By appraising food odors, invertebrates can establish preferences and better adapt to their ecological niches, thereby promoting survival. The smell of food pre-prepares the gastrointestinal system and primes feeding motor programs for more effective ingestion as well. Optimizing resource utilization affects longevity and reproduction as a result, leading to drastic changes in survival. We propose that models of foraging behavior should include odor priming, and illustrate this with a simple toy model based on the marginal value theorem. Lastly, we discuss the novel techniques and assays in invertebrate research that could investigate the interactions between odor sensing and food intake. Overall, the sense of smell is indispensable for efficient foraging and influences not only locomotion, but also organismal physiology, which should be reflected in behavioral modeling.

Sensing complementary temporal features of odor signals enhances navigation of diverse turbulent plumes

We and others have shown that during odor plume navigation, walking Drosophila melanogaster bias their motion upwind in response to both the frequency of their encounters with the odor (Demir et al., 2020) and the intermittency of the odor signal, which we define to be the fraction of time the signal is above a detection threshold (Alvarez-Salvado et al., 2018). Here, we combine and simplify previous mathematical models that recapitulated these data to investigate the benefits of sensing both of these temporal features and how these benefits depend on the spatiotemporal statistics of the odor plume. Through agent-based simulations, we find that navigators that only use frequency or intermittency perform well in some environments - achieving maximal performance when gains are near those inferred from experiment - but fail in others. Robust performance across diverse environments requires both temporal modalities. However, we also find a steep trade-off when using both sensors simultaneously, suggesting a strong benefit to modulating how much each sensor is weighted, rather than using both in a fixed combination across plumes. Finally, we show that the circuitry of the Drosophila olfactory periphery naturally enables simultaneous intermittency and frequency sensing, enhancing robust navigation through a diversity of odor environments. Together, our results suggest that the first stage of olfactory processing selects and encodes temporal features of odor signals critical to real-world navigation tasks.

How the insect central complex could coordinate multimodal navigation

The central complex of the insect midbrain is thought to coordinate insect guidance strategies. Computational models can account for specific behaviours, but their applicability across sensory and task domains remains untested. Here, we assess the capacity of our previous model (Sun et al. 2020) of visual navigation to generalise to olfactory navigation and its coordination with other guidance in flies and ants. We show that fundamental to this capacity is the use of a biologically plausible neural copy-and-shift mechanism that ensures sensory information is presented in a format compatible with the insect steering circuit regardless of its source. Moreover, the same mechanism is shown to allow the transfer cues from unstable/egocentric to stable/geocentric frames of reference, providing a first account of the mechanism by which foraging insects robustly recover from environmental disturbances. We propose that these circuits can be flexibly repurposed by different insect navigators to address their unique ecological needs.

Multisensory-motor integration in olfactory navigation of silkmoth, Bombyx mori, using virtual reality system

Most animals survive and thrive due to navigational behavior to reach their destinations. In order to navigate, it is important for animals to integrate information obtained from multisensory inputs and use that information to modulate their behavior. In this study, by using a virtual reality (VR) system for an insect, we investigated how the adult silkmoth integrates visual and wind direction information during female search behavior (olfactory behavior). According to the behavioral experiments using a VR system, the silkmoth had the highest navigational success rate when odor, vision, and wind information were correctly provided. However, the success rate of the search was reduced if the wind direction information provided was different from the direction actually detected. This indicates that it is important to acquire not only odor information but also wind direction information correctly. When the wind is received from the same direction as the odor, the silkmoth takes positive behavior; if the odor is detected but the wind direction is not in the same direction as the odor, the silkmoth behaves more carefully. This corresponds to a modulation of behavior according to the degree of complexity (turbulence) of the environment. We mathematically modeled the modulation of behavior using multisensory information and evaluated it using simulations. The mathematical model not only succeeded in reproducing the actual silkmoth search behavior but also improved the search success relative to the conventional odor-source search algorithm.