MAPLE (modular automated platform for large-scale experiments), a robot for integrated organism-handling and phenotyping

Spatiotemporal dynamics of locomotor decisions in Drosophila melanogaster

Decision-making in animals often involves choosing actions while navigating the environment, a process markedly different from static decision paradigms commonly studied in laboratory settings. Even in decision-making assays in which animals can freely locomote, decision outcomes are often interpreted as happening at single points in space and single moments in time, a simplification that potentially glosses over important spatiotemporal dynamics. We investigated locomotor decision-making in Drosophila melanogaster in Y-shaped mazes, measuring the extent to which their future choices could be predicted through space and time. We demonstrate that turn-decisions can be reliably predicted from flies' locomotor dynamics, with distinct predictability phases emerging as flies progress through maze regions. We show that these predictability dynamics are not merely the result of maze geometry or wall-following tendencies, but instead reflect the capacity of flies to move in ways that depend on sustained locomotor signatures, suggesting an active, working memory-like process. Additionally, we demonstrate that fly mutants known to have sensory and information-processing deficits exhibit altered spatial predictability patterns, highlighting the role of visual, mechanosensory, and dopaminergic signaling in locomotor decision-making. Finally, highlighting the broad applicability of our analyses, we generalize our findings to other species and tasks. We show that human participants in a virtual Y-maze exhibited similar decision predictability dynamics as flies. This study advances our understanding of decision-making processes, emphasizing the importance of spatial and temporal dynamics of locomotor behavior in the lead-up to discrete choice outcomes.

A reductionist paradigm for high-throughput behavioural fingerprinting in Drosophila melanogaster

Understanding how the brain encodes behaviour is the ultimate goal of neuroscience and the ability to objectively and reproducibly describe and quantify behaviour is a necessary milestone on this path. Recent technological progresses in machine learning and computational power have boosted the development and adoption of systems leveraging on high-resolution video recording to track an animal pose and describe behaviour in all four dimensions. However, the high temporal and spatial resolution that these systems offer must come as a compromise with their throughput and accessibility. Here, we describe coccinella, an open-source reductionist framework combining high-throughput analysis of behaviour using real-time tracking on a distributed mesh of microcomputers (ethoscopes) with resource-lean statistical learning (HCTSA/Catch22). Coccinella is a reductionist system, yet outperforms state-of-the-art alternatives when exploring the pharmacobehaviour in Drosophila melanogaster.

Continuous, long-term crawling behavior characterized by a robotic transport system

Detailed descriptions of behavior provide critical insight into the structure and function of nervous systems. In Drosophila larvae and many other systems, short behavioral experiments have been successful in characterizing rapid responses to a range of stimuli at the population level. However, the lack of long-term continuous observation makes it difficult to dissect comprehensive behavioral dynamics of individual animals and how behavior (and therefore the nervous system) develops over time. To allow for long-term continuous observations in individual fly larvae, we have engineered a robotic instrument that automatically tracks and transports larvae throughout an arena. The flexibility and reliability of its design enables controlled stimulus delivery and continuous measurement over developmental time scales, yielding an unprecedented level of detailed locomotion data. We utilize the new system's capabilities to perform continuous observation of exploratory search behavior over a duration of 6 hr with and without a thermal gradient present, and in a single larva for over 30 hr. Long-term free-roaming behavior and analogous short-term experiments show similar dynamics that take place at the beginning of each experiment. Finally, characterization of larval thermotaxis in individuals reveals a bimodal distribution in navigation efficiency, identifying distinct phenotypes that are obfuscated when only analyzing population averages.

Colony size buffers interactions between neonicotinoid exposure and cold stress in bumblebees

Social bees are critical for supporting biodiversity, ecosystem function and crop yields globally. Colony size is a key ecological trait predicted to drive sensitivity to environmental stressors and may be especially important for species with annual cycles of sociality, such as bumblebees. However, there is limited empirical evidence assessing the effect of colony size on sensitivity to environmental stressors or the mechanisms underlying these effects. Here, we examine the relationship between colony size and sensitivity to environmental stressors in bumblebees. We exposed colonies at different developmental stages briefly (2 days) to a common neonicotinoid (imidacloprid) and cold stress, while quantifying behaviour of individuals. Combined imidacloprid and cold exposure had stronger effects on both thermoregulatory behaviour and long-term colony growth in small colonies. We find that imidacloprid's effects on behaviour are mediated by body temperature and spatial location within the nest, suggesting that social thermoregulation provides a buffering effect in large colonies. Finally, we demonstrate qualitatively similar effects in size-manipulated microcolonies, suggesting that group size per se, rather than colony age, drives these patterns. Our results provide evidence that colony size is critical in driving sensitivity to stressors and may help elucidate mechanisms underlying the complex and context-specific impacts of pesticide exposure.

A robotic system for automated genetic manipulation and analysis of Caenorhabditis elegans

The nematode Caenorhabditis elegans is one of the most widely studied organisms in biology due to its small size, rapid life cycle, and manipulable genetics. Research with C. elegans depends on labor-intensive and time-consuming manual procedures, imposing a major bottleneck for many studies, especially for those involving large numbers of animals. Here, we describe a general-purpose tool, WormPicker, a robotic system capable of performing complex genetic manipulations and other tasks by imaging, phenotyping, and transferring C. elegans on standard agar media. Our system uses a motorized stage to move an imaging system and a robotic arm over an array of agar plates. Machine vision tools identify animals and assay developmental stage, morphology, sex, expression of fluorescent reporters, and other phenotypes. Based on the results of these assays, the robotic arm selectively transfers individual animals using an electrically self-sterilized wire loop, with the aid of machine vision and electrical capacitance sensing. Automated C. elegans manipulation shows reliability and throughput comparable with standard manual methods. We developed software to enable the system to autonomously carry out complex protocols. To validate the effectiveness and versatility of our methods, we used the system to perform a collection of common C. elegans procedures, including genetic crossing, genetic mapping, and genomic integration of a transgene. Our robotic system will accelerate C. elegans research and open possibilities for performing genetic and pharmacological screens that would be impractical using manual methods.

A network-based analysis detects cocaine-induced changes in social interactions in Drosophila melanogaster

Addiction is a multifactorial biological and behavioral disorder that is studied using animal models, based on simple behavioral responses in isolated individuals. A couple of decades ago it was shown that Drosophila melanogaster can serve as a model organism for behaviors related to alcohol, nicotine and cocaine (COC) addiction. Scoring of COC-induced behaviors in a large group of flies has been technologically challenging, so we have applied a local, middle and global level of network-based analyses to study social interaction networks (SINs) among a group of 30 untreated males compared to those that have been orally administered with 0.50 mg/mL of COC for 24 hours. In this study, we have confirmed the previously described increase in locomotion upon COC feeding. We have isolated new network-based measures associated with COC, and influenced by group on the individual behavior. COC fed flies showed a longer duration of interactions on the local level, and formed larger, more densely populated and compact, communities at the middle level. Untreated flies have a higher number of interactions with other flies in a group at the local level, and at the middle level, these interactions led to the formation of separated communities. Although the network density at the global level is higher in COC fed flies, at the middle level the modularity is higher in untreated flies. One COC specific behavior that we have isolated was an increase in the proportion of individuals that do not interact with the rest of the group, considered as the individual difference in COC induced behavior and/or consequence of group influence on individual behavior. Our approach can be expanded on different classes of drugs with the same acute response as COC to determine drug specific network-based measures and could serve as a tool to determinate genetic and environmental factors that influence both drug addiction and social interaction.

Towards the fully automated monitoring of ecological communities

High-resolution monitoring is fundamental to understand ecosystems dynamics in an era of global change and biodiversity declines. While real-time and automated monitoring of abiotic components has been possible for some time, monitoring biotic components-for example, individual behaviours and traits, and species abundance and distribution-is far more challenging. Recent technological advancements offer potential solutions to achieve this through: (i) increasingly affordable high-throughput recording hardware, which can collect rich multidimensional data, and (ii) increasingly accessible artificial intelligence approaches, which can extract ecological knowledge from large datasets. However, automating the monitoring of facets of ecological communities via such technologies has primarily been achieved at low spatiotemporal resolutions within limited steps of the monitoring workflow. Here, we review existing technologies for data recording and processing that enable automated monitoring of ecological communities. We then present novel frameworks that combine such technologies, forming fully automated pipelines to detect, track, classify and count multiple species, and record behavioural and morphological traits, at resolutions which have previously been impossible to achieve. Based on these rapidly developing technologies, we illustrate a solution to one of the greatest challenges in ecology: the ability to rapidly generate high-resolution, multidimensional and standardised data across complex ecologies.

Precise Quantification of Behavioral Individuality From 80 Million Decisions Across 183,000 Flies

Individual animals behave differently from each other. This variability is a component of personality and arises even when genetics and environment are held constant. Discovering the biological mechanisms underlying behavioral variability depends on efficiently measuring individual behavioral bias, a requirement that is facilitated by automated, high-throughput experiments. We compiled a large data set of individual locomotor behavior measures, acquired from over 183,000 fruit flies walking in Y-shaped mazes. With this data set we first conducted a "computational ethology natural history" study to quantify the distribution of individual behavioral biases with unprecedented precision and examine correlations between behavioral measures with high power. We discovered a slight, but highly significant, left-bias in spontaneous locomotor decision-making. We then used the data to evaluate standing hypotheses about biological mechanisms affecting behavioral variability, specifically: the neuromodulator serotonin and its precursor transporter, heterogametic sex, and temperature. We found a variety of significant effects associated with each of these mechanisms that were behavior-dependent. This indicates that the relationship between biological mechanisms and behavioral variability may be highly context dependent. Going forward, automation of behavioral experiments will likely be essential in teasing out the complex causality of individuality.

Long-term tracking and quantification of individual behavior in bumble bee colonies

Social insects are ecologically dominant and provide vital ecosystem services. It is critical to understand collective responses of social insects such as bees to ecological perturbations. However, studying behavior of individual insects across entire colonies and across timescales relevant for colony performance (i.e., days or weeks) remains a central challenge. Here, we describe an approach for long-term monitoring of individuals within multiple bumble bee (Bombus spp.) colonies that combines the complementary strengths of multiple existing methods. Specifically, we combine (a) automated monitoring, (b) fiducial tag tracking, and (c) pose estimation to quantify behavior across multiple colonies over a 48 h period. Finally, we demonstrate the benefits of this approach by quantifying an important but subtle behavior (antennal activity) in bumble bee colonies, and how this behavior is impacted by a common environmental stressor (a neonicotinoid pesticide).

Megapixel camera arrays enable high-resolution animal tracking in multiwell plates

Tracking small laboratory animals such as flies, fish, and worms is used for phenotyping in neuroscience, genetics, disease modelling, and drug discovery. An imaging system with sufficient throughput and spatiotemporal resolution would be capable of imaging a large number of animals, estimating their pose, and quantifying detailed behavioural differences at a scale where hundreds of treatments could be tested simultaneously. Here we report an array of six 12-megapixel cameras that record all the wells of a 96-well plate with sufficient resolution to estimate the pose of C. elegans worms and to extract high-dimensional phenotypic fingerprints. We use the system to study behavioural variability across wild isolates, the sensitisation of worms to repeated blue light stimulation, the phenotypes of worm disease models, and worms' behavioural responses to drug treatment. Because the system is compatible with standard multiwell plates, it makes computational ethological approaches accessible in existing high-throughput pipelines.

Idiosyncratic learning performance in flies

Individuals vary in their innate behaviours, even when they have the same genome and have been reared in the same environment. The extent of individuality in plastic behaviours, like learning, is less well characterized. Also unknown is the extent to which intragenotypic differences in learning generalize: if an individual performs well in one assay, will it perform well in other assays? We investigated this using the fruit fly Drosophila melanogaster, an organism long-used to study the mechanistic basis of learning and memory. We found that isogenic flies, reared in identical laboratory conditions, and subject to classical conditioning that associated odorants with electric shock, exhibit clear individuality in their learning responses. Flies that performed well when an odour was paired with shock tended to perform well when the odour was paired with bitter taste or when other odours were paired with shock. Thus, individuality in learning performance appears to be prominent in isogenic animals reared identically, and individual differences in learning performance generalize across some aversive sensory modalities. Establishing these results in flies opens up the possibility of studying the genetic and neural circuit basis of individual differences in learning in a highly suitable model organism.

Paired fruit flies synchronize behavior: Uncovering social interactions in Drosophila melanogaster

Social behaviors are ubiquitous and crucial to an animal's survival and success. The behaviors an animal performs in a social setting are affected by internal factors, inputs from the environment, and interactions with others. To quantify social behaviors, we need to measure both the stochastic nature of the behavior of isolated individuals and how this behavioral repertoire changes as a function of the environment and interactions between individuals. We probed the behavior of male and female fruit flies in a circular arena as individuals and within all possible pairings. By combining measurements of the animals' position in the arena with an unsupervised analysis of their behaviors, we define the effects of position in the environment and the presence of a partner on locomotion, grooming, singing, and other behaviors that make up an animal's repertoire. We find that geometric context tunes behavioral preference, pairs of animals synchronize their behavioral preferences across shared trials, and paired individuals display signatures of behavioral mimicry.

Individual, but not population asymmetries, are modulated by social environment and genotype in Drosophila melanogaster

Theory predicts that social interactions can induce an alignment of behavioral asymmetries between individuals (i.e., population-level lateralization), but evidence for this effect is mixed. To understand how interaction with other individuals affects behavioral asymmetries, we systematically manipulated the social environment of Drosophila melanogaster, testing individual flies and dyads (female-male, female-female and male-male pairs). In these social contexts we measured individual and population asymmetries in individual behaviors (circling asymmetry, wing use) and dyadic behaviors (relative position and orientation between two flies) in five different genotypes. We reasoned that if coordination between individuals drives alignment of behavioral asymmetries, greater alignment at the population-level should be observed in social contexts compared to solitary individuals. We observed that the presence of other individuals influenced the behavior and position of flies but had unexpected effects on individual and population asymmetries: individual-level asymmetries were strong and modulated by the social context but population-level asymmetries were mild or absent. Moreover, the strength of individual-level asymmetries differed between strains, but this was not the case for population-level asymmetries. These findings suggest that the degree of social interaction found in Drosophila is insufficient to drive population-level behavioral asymmetries.

Tools for Rapid High-Resolution Behavioral Phenotyping of Automatically Isolated Drosophila

Sparse manipulation of neuron excitability during free behavior is critical for identifying neural substrates of behavior. Genetic tools for precise neuronal manipulation exist in the fruit fly, Drosophila melanogaster, but behavioral tools are still lacking to identify potentially subtle phenotypes only detectible using high-throughput and high spatiotemporal resolution. We developed three assay components that can be used modularly to study natural and optogenetically induced behaviors. FlyGate automatically releases flies one at a time into an assay. FlyDetect tracks flies in real time, is robust to severe occlusions, and can be used to track appendages, such as the head. GlobeDisplay is a spherical projection system covering the fly's visual receptive field with a single projector. We demonstrate the utility of these components in an integrated system, FlyPEZ, by comprehensively modeling the input-output function for directional looming-evoked escape takeoffs and describing a millisecond-timescale phenotype from genetic silencing of a single visual projection neuron type.

DeepPoseKit, a software toolkit for fast and robust animal pose estimation using deep learning

Quantitative behavioral measurements are important for answering questions across scientific disciplines-from neuroscience to ecology. State-of-the-art deep-learning methods offer major advances in data quality and detail by allowing researchers to automatically estimate locations of an animal's body parts directly from images or videos. However, currently available animal pose estimation methods have limitations in speed and robustness. Here, we introduce a new easy-to-use software toolkit, DeepPoseKit, that addresses these problems using an efficient multi-scale deep-learning model, called Stacked DenseNet, and a fast GPU-based peak-detection algorithm for estimating keypoint locations with subpixel precision. These advances improve processing speed >2x with no loss in accuracy compared to currently available methods. We demonstrate the versatility of our methods with multiple challenging animal pose estimation tasks in laboratory and field settings-including groups of interacting individuals. Our work reduces barriers to using advanced tools for measuring behavior and has broad applicability across the behavioral sciences.

DeepPoseKit, a software toolkit for fast and robust animal pose estimation using deep learning

Quantitative behavioral measurements are important for answering questions across scientific disciplines-from neuroscience to ecology. State-of-the-art deep-learning methods offer major advances in data quality and detail by allowing researchers to automatically estimate locations of an animal's body parts directly from images or videos. However, currently available animal pose estimation methods have limitations in speed and robustness. Here, we introduce a new easy-to-use software toolkit, DeepPoseKit, that addresses these problems using an efficient multi-scale deep-learning model, called Stacked DenseNet, and a fast GPU-based peak-detection algorithm for estimating keypoint locations with subpixel precision. These advances improve processing speed >2x with no loss in accuracy compared to currently available methods. We demonstrate the versatility of our methods with multiple challenging animal pose estimation tasks in laboratory and field settings-including groups of interacting individuals. Our work reduces barriers to using advanced tools for measuring behavior and has broad applicability across the behavioral sciences.

DeepPoseKit, a software toolkit for fast and robust animal pose estimation using deep learning

Quantitative behavioral measurements are important for answering questions across scientific disciplines-from neuroscience to ecology. State-of-the-art deep-learning methods offer major advances in data quality and detail by allowing researchers to automatically estimate locations of an animal's body parts directly from images or videos. However, currently available animal pose estimation methods have limitations in speed and robustness. Here, we introduce a new easy-to-use software toolkit, DeepPoseKit, that addresses these problems using an efficient multi-scale deep-learning model, called Stacked DenseNet, and a fast GPU-based peak-detection algorithm for estimating keypoint locations with subpixel precision. These advances improve processing speed >2x with no loss in accuracy compared to currently available methods. We demonstrate the versatility of our methods with multiple challenging animal pose estimation tasks in laboratory and field settings-including groups of interacting individuals. Our work reduces barriers to using advanced tools for measuring behavior and has broad applicability across the behavioral sciences.

Digging deeper: methodologies for high-content phenotyping in Caenorhabditis elegans

Deep phenotyping is an emerging conceptual paradigm and experimental approach aimed at measuring and linking many aspects of a phenotype to understand its underlying biology. To date, deep phenotyping has been applied mostly in cultured cells and used less in multicellular organisms. However, in the past decade, it has increasingly been recognized that deep phenotyping could lead to a better understanding of how genetics, environment and stochasticity affect the development, physiology and behavior of an organism. The nematode Caenorhabditis elegans is an invaluable model system for studying how genes affect a phenotypic trait, and new technologies have taken advantage of the worm's physical attributes to increase the throughput and informational content of experiments. Coupling of these technical advancements with computational and analytical tools has enabled a boom in deep-phenotyping studies of C. elegans. In this Review, we highlight how these new technologies and tools are digging into the biological origins of complex, multidimensional phenotypes.

Aversive Training of Honey Bees in an Automated Y-Maze

Honeybees have remarkable learning abilities given their small brains, and have thus been established as a powerful model organism for the study of learning and memory. Most of our current knowledge is based on appetitive paradigms, in which a previously neutral stimulus (e.g., a visual, olfactory, or tactile stimulus) is paired with a reward. Here, we present a novel apparatus, the yAPIS, for aversive training of walking honey bees. This system consists in three arms of equal length and at 120° from each other. Within each arm, colored lights (λ = 375, 465 or 520 nm) or odors (here limonene or linalool) can be delivered to provide conditioned stimuli (CS). A metal grid placed on the floor and roof delivers the punishment in the form of mild electric shocks (unconditioned stimulus, US). Our training protocol followed a fully classical procedure, in which the bee was exposed sequentially to a CS paired with shocks (CS+) and to another CS not punished (CS-). Learning performance was measured during a second phase, which took advantage of the Y-shape of the apparatus and of real-time tracking to present the bee with a choice situation, e.g., between the CS+ and the CS-. Bees reliably chose the CS- over the CS+ after only a few training trials with either colors or odors, and retained this memory for at least a day, except for the shorter wavelength (λ = 375 nm) that produced mixed results. This behavior was largely the result of the bees avoiding the CS+, as no evidence was found for attraction to the CS-. Interestingly, trained bees initially placed in the CS+ spontaneously escaped to a CS- arm if given the opportunity, even though they could never do so during the training. Finally, honey bees trained with compound stimuli (color + odor) later avoided either components of the CS+. Thus, the yAPIS is a fast, versatile and high-throughput way to train honey bees in aversive paradigms. It also opens the door for controlled laboratory experiments investigating bimodal integration and learning, a field that remains in its infancy.

Tools to reverse-engineer multicellular systems: case studies using the fruit fly

Reverse-engineering how complex multicellular systems develop and function is a grand challenge for systems bioengineers. This challenge has motivated the creation of a suite of bioengineering tools to develop increasingly quantitative descriptions of multicellular systems. Here, we survey a selection of these tools including microfluidic devices, imaging and computer vision techniques. We provide a selected overview of the emerging cross-talk between engineering methods and quantitative investigations within developmental biology. In particular, the review highlights selected recent examples from the Drosophila system, an excellent platform for understanding the interplay between genetics and biophysics. In sum, the integrative approaches that combine multiple advances in these fields are increasingly necessary to enable a deeper understanding of how to analyze both natural and synthetic multicellular systems.

Neonicotinoid exposure disrupts bumblebee nest behavior, social networks, and thermoregulation

Neonicotinoid pesticides can negatively affect bee colonies, but the behavioral mechanisms by which these compounds impair colony growth remain unclear. Here, we investigate imidacloprid’s effects on bumblebee worker behavior within the nest, using an automated, robotic platform for continuous, multicolony monitoring of uniquely identified workers. We find that exposure to field-realistic levels of imidacloprid impairs nursing and alters social and spatial dynamics within nests, but that these effects vary substantially with time of day. In the field, imidacloprid impairs colony thermoregulation, including the construction of an insulating wax canopy. Our results show that neonicotinoids induce widespread disruption of within-nest worker behavior that may contribute to impaired growth, highlighting the potential of automated techniques for characterizing the multifaceted, dynamic impacts of stressors on behavior in bee colonies.