Alternation emerges as a multi-modal strategy for turbulent odor navigation

Q-Learning to navigate turbulence without a map

We consider the problem of olfactory searches in a turbulent environment. We focus on agents that respond solely to odor stimuli, with no access to spatial perception nor prior information about the odor location. We ask whether navigation strategies to a target can be learned robustly within a sequential decision making framework. We develop a reinforcement learning algorithm using a small set of interpretable olfactory states and train it with realistic turbulent odor cues. By introducing a temporal memory, we demonstrate that two salient features of odor traces, discretized in few olfactory states, are sufficient to learn navigation in a realistic odor plume. Performance is dictated by the sparse nature of turbulent plumes. An optimal memory exists which ignores blanks within the plume and activates a recovery strategy outside the plume. We obtain the best performance by letting agents learn their recovery strategy and show that it is mostly casting cross wind, similar to behavior observed in flying insects. The optimal strategy is robust to substantial changes in the odor plumes, suggesting minor parameter tuning may be sufficient to adapt to different environments.

The spiking output of the mouse olfactory bulb encodes large-scale temporal features of natural odor environments

Spatiotemporal dynamics of natural odor environment have informative features for animals navigating to an odor source. Population activity in the olfactory bulb (OB) has been shown to follow plume dynamics to a moderate degree (Lewis et al., 2021), but it is unknown whether the ability to follow plume dynamics is driven by individual cells or whether it emerges at the population level. Previous research has explored the responses of individual OB cells to isolated features of plumes, but it is difficult to adequately sample these features as it is still undetermined which features navigating mice employ during olfactory guided search. Here we released odor from an upwind odor source and simultaneously recorded both odor concentration dynamics and cellular response dynamics in awake, head-fixed mice. We found that longer timescale features of odor concentration dynamics were encoded at both the cellular and population level. At the cellular level, plume onset was encoded across all trials and plume offset was encoded for high concentration odors, but not low concentration odors. Although cellular level tracking of plume dynamics was observed to be weak, we found that at the population level, OB activity distinguished whiffs and blanks (accurately detected odor presence versus absence) throughout the duration of a plume. Even ~20 OB cells were enough to accurately encode these features. Our findings indicate that the full range of odor concentration dynamics and high frequency fluctuations are not encoded by OB spiking activity. Instead, relatively lower-frequency dynamics of plumes, such as plume onset, plume offset, whiffs, and blanks, are represented in the OB.

Wind Gates Search States in Free Flight

For any organism tracking a chemical cue to its source, the motion of its surrounding fluid provides crucial information for success. For both swimming and flying animals engaged in olfaction driven search, turning into the direction of oncoming wind or water current is often a critical first step 1, 2 . However, in nature, wind and water currents may not always provide a reliable directional cue 3, 4, 5 . It is unclear how organisms adjust their search strategies accordingly due to the challenges of separately controlling flow and chemical encounters. Here, we use the genetic toolkit of Drosophila melanogaster , a model organism for olfaction 6 , to develop an optogenetic paradigm to deliver temporally precise "virtual" olfactory experiences in free-flying animals while independently manipulating the wind conditions. We show that in free flight, Drosophila melanogaster adopt distinct search routines that are gated by whether they are flying in laminar wind or in still air. We first confirm that in laminar wind flies turn upwind, and further, we show that they achieve this using a rapid turn. In still air, flies adopt remarkably stereotyped "sink and circle" search state characterized by ∼60°turns at 3-4 Hz, biased in a consistent direction. In both laminar wind and still air, immediately after odor onset, flies decelerate and often perform a rapid turn. Both maneuvers are consistent with predictions from recent control theoretic analyses for how insects may estimate properties of wind while in flight 7, 8 . We suggest that flies may use their deceleration and "anemometric" turn as active sensing maneuvers to rapidly gauge properties of their wind environment before initiating a proximal or upwind search routine.

Dynamics of odor-source localization: Insights from real-time odor plume recordings and head-motion tracking in freely moving mice

Animals navigating turbulent odor plumes exhibit a rich variety of behaviors, and employ efficient strategies to locate odor sources. A growing body of literature has started to probe this complex task of localizing airborne odor sources in walking mammals to further our understanding of neural encoding and decoding of naturalistic sensory stimuli. However, correlating the intermittent olfactory information with behavior has remained a long-standing challenge due to the stochastic nature of the odor stimulus. We recently reported a method to record real-time olfactory information available to freely moving mice during odor-guided navigation, hence overcoming that challenge. Here we combine our odor-recording method with head-motion tracking to establish correlations between plume encounters and head movements. We show that mice exhibit robust head-pitch motions in the 5-14Hz range during an odor-guided navigation task, and that these head motions are modulated by plume encounters. Furthermore, mice orient towards the odor source upon plume contact. Head motions may thus be an important part of the sensorimotor behavioral repertoire during naturalistic odor-source localization.

Extracting spatial information from temporal odor patterns: insights from insects

Extracting spatial information from temporal stimulus patterns is essential for sensory perception (e.g. visual motion direction detection or concurrent sound segregation), but this process remains understudied in olfaction. Animals rely on olfaction to locate resources and dangers. In open environments, where odors are dispersed by turbulent wind, detection of wind direction seems crucial for odor source localization. However, recent studies showed that insects can extract spatial information from the odor stimulus itself, independently from sensing wind direction. This remarkable ability is achieved by detecting the fine-scale temporal pattern of odor encounters, which contains information about the location and size of an odor source, and the distance between different odor sources.

Olfactory search with finite-state controllers

Long-range olfactory search is an extremely difficult task in view of the sparsity of odor signals that are available to the searcher and the complex encoding of the information about the source location. Current algorithmic approaches typically require a continuous memory space, sometimes of large dimensionality, which may hamper their optimization and often obscure their interpretation. Here, we show how finite-state controllers with a small set of discrete memory states are expressive enough to display rich, time-extended behavioral modules that resemble the ones observed in living organisms. Finite-state controllers optimized for olfactory search have an immediate interpretation in terms of approximate clocks and coarse-grained spatial maps, suggesting connections with neural models of search behavior.

Where is that smell coming from?

Computational model reveals why pausing to sniff the air helps animals track a scent when they are far away from the source.