Parallel Computations in Insect and Mammalian Visual Motion Processing

Overcoming the limitations of motion sensor models by considering dendritic computations

The estimation of motion is an essential process for any sighted animal. Computational models of motion sensors have a long and successful history but they still suffer from basic shortcomings, as they disagree with physiological evidence and each model is dedicated to a specific type of motion, which is controversial from a biological standpoint. In this work, we propose a new approach to modeling motion sensors that considers dendritic computations, a key aspect for predicting single-neuron responses that had previously been absent from motion models. We show how, by taking into account the dynamic and input-dependent nature of dendritic nonlinearities, our motion sensor model is able to overcome the fundamental limitations of standard approaches.

Broken time-reversal symmetry in visual motion detection

Our intuition suggests that when a movie is played in reverse, our perception of motion at each location in the reversed movie will be perfectly inverted compared to the original. This intuition is also reflected in classical theoretical and practical models of motion estimation, in which velocity flow fields invert when inputs are reversed in time. However, here we report that this symmetry of motion perception upon time reversal is broken in real visual systems. We designed a set of visual stimuli to investigate time reversal symmetry breaking in the fruit fly Drosophila's well-studied optomotor rotation behavior. We identified a suite of stimuli with a wide variety of properties that can uncover broken time reversal symmetry in fly behavioral responses. We then trained neural network models to predict the velocity of scenes with both natural and artificial contrast distributions. Training with naturalistic contrast distributions yielded models that broke time reversal symmetry, even when the training data themselves were time reversal symmetric. We show analytically and numerically that the breaking of time reversal symmetry in the model responses can arise from contrast asymmetry in the training data, but can also arise from other features of the contrast distribution. Furthermore, shallower neural network models can exhibit stronger symmetry breaking than deeper ones, suggesting that less flexible neural networks may be more prone to time reversal symmetry breaking. Overall, these results reveal a surprising feature of biological motion detectors and suggest that it could arise from constrained optimization in natural environments.

Changes in Vertical Stratification of Neotropical Nymphalid Butterflies at Forest Edges Are Not Directly Caused by Light and Temperature Conditions

Habitat fragmentation and land use changes threaten neotropical habitats and alter patterns of diversity at forest edges. Like other arthropod assemblages, neotropical fruit-feeding butterfly communities show strong vertical stratification within forests, with some recent work showing its potential role in speciation. At forest edges, species considered to be forest canopy specialists have been observed descending to the forest understory, with the similarity in light conditions between the canopy and understory strata at edges hypothesized to be responsible for this phenomenon. We conducted a study using standardized sampling to document and quantify this edge effect, characterize edge and forest strata, and estimate the relative contributions of temperature and light conditions to changes in nymphalid butterfly stratification at forest edges. We found strong evidence of an edge effect in these butterflies and confirmed strong differences in light and temperature, showing that the edge understory differs little from forest canopy conditions. Of 41 species common to both forests and edges, 28 shifted to have a lower canopy probability at the edge, and our model detected a decrease in canopy probability of 0.165. Furthermore, our analysis indicated the relative abundance of canopy taxa increased at the edge, and the tribes Haeterini and Morphini were especially sensitive to edge effects. However, the analyses here did not clearly implicate temperature or light magnitude in causing changes in neotropical nymphalid vertical stratification at forest edges. Instead, our results point to other mediator variables as being important for changes at tropical forest edges. From our data, edge-responsive species can be separated into two different categories, which likely relates to their resilience to anthropogenic disturbance. We also note that structural causal models have a potential place in future work on tropical conservation, given they can provide causal estimates with observational data.

Universality of representation in biological and artificial neural networks

Many artificial neural networks (ANNs) trained with ecologically plausible objectives on naturalistic data align with behavior and neural representations in biological systems. Here, we show that this alignment is a consequence of convergence onto the same representations by high-performing ANNs and by brains. We developed a method to identify stimuli that systematically vary the degree of inter-model representation agreement. Across language and vision, we then showed that stimuli from high- and low-agreement sets predictably modulated model-to-brain alignment. We also examined which stimulus features distinguish high- from low-agreement sentences and images. Our results establish representation universality as a core component in the model-to-brain alignment and provide a new approach for using ANNs to uncover the structure of biological representations and computations.

Humans can use positive and negative spectrotemporal correlations to detect rising and falling pitch

To discern speech or appreciate music, the human auditory system detects how pitch increases or decreases over time. However, the algorithms used to detect changes in pitch, or pitch motion, are incompletely understood. Here, using psychophysics, computational modeling, functional neuroimaging, and analysis of recorded speech, we ask if humans can detect pitch motion using computations analogous to those used by the visual system. We adapted stimuli from studies of vision to create novel auditory correlated noise stimuli that elicited robust pitch motion percepts. Crucially, these stimuli are inharmonic and possess no persistent features across frequency or time, but do possess positive or negative local spectrotemporal correlations in intensity. In psychophysical experiments, we found clear evidence that humans can judge pitch direction based only on positive or negative spectrotemporal intensity correlations. The key behavioral result-robust sensitivity to the negative spectrotemporal correlations-is a direct analogue of illusory "reverse-phi" motion in vision, and thus constitutes a new auditory illusion. Our behavioral results and computational modeling led us to hypothesize that human auditory processing may employ pitch direction opponency. fMRI measurements in auditory cortex supported this hypothesis. To link our psychophysical findings to real-world pitch perception, we analyzed recordings of English and Mandarin speech and found that pitch direction was robustly signaled by both positive and negative spectrotemporal correlations, suggesting that sensitivity to both types of correlations confers ecological benefits. Overall, this work reveals how motion detection algorithms sensitive to local correlations are deployed by the central nervous system across disparate modalities (vision and audition) and dimensions (space and frequency).

Inspiration from Visual Ecology for Advancing Multifunctional Robotic Vision Systems: Bio-inspired Electronic Eyes and Neuromorphic Image Sensors

In robotics, particularly for autonomous navigation and human-robot collaboration, the significance of unconventional imaging techniques and efficient data processing capabilities is paramount. The unstructured environments encountered by robots, coupled with complex missions assigned to them, present numerous challenges necessitating diverse visual functionalities, and consequently, the development of multifunctional robotic vision systems has become indispensable. Meanwhile, rich diversity inherent in animal vision systems, honed over evolutionary epochs to meet their survival demands across varied habitats, serves as a profound source of inspirations. Here, recent advancements in multifunctional robotic vision systems drawing inspiration from natural ocular structures and their visual perception mechanisms are delineated. First, unique imaging functionalities of natural eyes across terrestrial, aerial, and aquatic habitats and visual signal processing mechanism of humans are explored. Then, designs and functionalities of bio-inspired electronic eyes are explored, engineered to mimic key components and underlying optical principles of natural eyes. Furthermore, neuromorphic image sensors are discussed, emulating functional properties of synapses, neurons, and retinas and thereby enhancing accuracy and efficiency of robotic vision tasks. Next, integration examples of electronic eyes with mobile robotic/biological systems are introduced. Finally, a forward-looking outlook on the development of bio-inspired electronic eyes and neuromorphic image sensors is provided.

Optimization in Visual Motion Estimation

Sighted animals use visual signals to discern directional motion in their environment. Motion is not directly detected by visual neurons, and it must instead be computed from light signals that vary over space and time. This makes visual motion estimation a near universal neural computation, and decades of research have revealed much about the algorithms and mechanisms that generate directional signals. The idea that sensory systems are optimized for performance in natural environments has deeply impacted this research. In this article, we review the many ways that optimization has been used to quantitatively model visual motion estimation and reveal its underlying principles. We emphasize that no single optimization theory has dominated the literature. Instead, researchers have adeptly incorporated different computational demands and biological constraints that are pertinent to the specific brain system and animal model under study. The successes and failures of the resulting optimization models have thereby provided insights into how computational demands and biological constraints together shape neural computation.

Broken time reversal symmetry in visual motion detection

Our intuition suggests that when a movie is played in reverse, our perception of motion in the reversed movie will be perfectly inverted compared to the original. This intuition is also reflected in many classical theoretical and practical models of motion detection. However, here we demonstrate that this symmetry of motion perception upon time reversal is often broken in real visual systems. In this work, we designed a set of visual stimuli to investigate how stimulus symmetries affect time reversal symmetry breaking in the fruit fly Drosophila's well-studied optomotor rotation behavior. We discovered a suite of new stimuli with a wide variety of different properties that can lead to broken time reversal symmetries in fly behavioral responses. We then trained neural network models to predict the velocity of scenes with both natural and artificial contrast distributions. Training with naturalistic contrast distributions yielded models that break time reversal symmetry, even when the training data was time reversal symmetric. We show analytically and numerically that the breaking of time reversal symmetry in the model responses can arise from contrast asymmetry in the training data, but can also arise from other features of the contrast distribution. Furthermore, shallower neural network models can exhibit stronger symmetry breaking than deeper ones, suggesting that less flexible neural networks promote some forms of time reversal symmetry breaking. Overall, these results reveal a surprising feature of biological motion detectors and suggest that it could arise from constrained optimization in natural environments.

Hue selectivity from recurrent circuitry in Drosophila

In the perception of color, wavelengths of light reflected off objects are transformed into the derived quantities of brightness, saturation and hue. Neurons responding selectively to hue have been reported in primate cortex, but it is unknown how their narrow tuning in color space is produced by upstream circuit mechanisms. We report the discovery of neurons in the Drosophila optic lobe with hue-selective properties, which enables circuit-level analysis of color processing. From our analysis of an electron microscopy volume of a whole Drosophila brain, we construct a connectomics-constrained circuit model that accounts for this hue selectivity. Our model predicts that recurrent connections in the circuit are critical for generating hue selectivity. Experiments using genetic manipulations to perturb recurrence in adult flies confirm this prediction. Our findings reveal a circuit basis for hue selectivity in color vision.

Circular and unified analysis in network neuroscience

Genuinely new discovery transcends existing knowledge. Despite this, many analyses in systems neuroscience neglect to test new speculative hypotheses against benchmark empirical facts. Some of these analyses inadvertently use circular reasoning to present existing knowledge as new discovery. Here, I discuss that this problem can confound key results and estimate that it has affected more than three thousand studies in network neuroscience over the last decade. I suggest that future studies can reduce this problem by limiting the use of speculative evidence, integrating existing knowledge into benchmark models, and rigorously testing proposed discoveries against these models. I conclude with a summary of practical challenges and recommendations.

Neural mechanisms to incorporate visual counterevidence in self-movement estimation

In selecting appropriate behaviors, animals should weigh sensory evidence both for and against specific beliefs about the world. For instance, animals measure optic flow to estimate and control their own rotation. However, existing models of flow detection can be spuriously triggered by visual motion created by objects moving in the world. Here, we show that stationary patterns on the retina, which constitute evidence against observer rotation, suppress inappropriate stabilizing rotational behavior in the fruit fly Drosophila. In silico experiments show that artificial neural networks (ANNs) that are optimized to distinguish observer movement from external object motion similarly detect stationarity and incorporate negative evidence. Employing neural measurements and genetic manipulations, we identified components of the circuitry for stationary pattern detection, which runs parallel to the fly's local motion and optic-flow detectors. Our results show how the fly brain incorporates negative evidence to improve heading stability, exemplifying how a compact brain exploits geometrical constraints of the visual world.

Direct comparison reveals algorithmic similarities in fly and mouse visual motion detection

Evolution has equipped vertebrates and invertebrates with neural circuits that selectively encode visual motion. While similarities in the computations performed by these circuits in mouse and fruit fly have been noted, direct experimental comparisons have been lacking. Because molecular mechanisms and neuronal morphology in the two species are distinct, we directly compared motion encoding in these two species at the algorithmic level, using matched stimuli and focusing on a pair of analogous neurons, the mouse ON starburst amacrine cell (ON SAC) and Drosophila T4 neurons. We find that the cells share similar spatiotemporal receptive field structures, sensitivity to spatiotemporal correlations, and tuning to sinusoidal drifting gratings, but differ in their responses to apparent motion stimuli. Both neuron types showed a response to summed sinusoids that deviates from models for motion processing in these cells, underscoring the similarities in their processing and identifying response features that remain to be explained.

Hue selectivity from recurrent circuitry in Drosophila

A universal principle of sensory perception is the progressive transformation of sensory information from broad non-specific signals to stimulus-selective signals that form the basis of perception. To perceive color, our brains must transform the wavelengths of light reflected off objects into the derived quantities of brightness, saturation and hue. Neurons responding selectively to hue have been reported in primate cortex, but it is unknown how their narrow tuning in color space is produced by upstream circuit mechanisms. To enable circuit level analysis of color perception, we here report the discovery of neurons in the Drosophila optic lobe with hue selective properties. Using the connectivity graph of the fly brain, we construct a connectomics-constrained circuit model that accounts for this hue selectivity. Unexpectedly, our model predicts that recurrent connections in the circuit are critical for hue selectivity. Experiments using genetic manipulations to perturb recurrence in adult flies confirms this prediction. Our findings reveal the circuit basis for hue selectivity in color vision.

Visual processing in the fly, from photoreceptors to behavior

Originally a genetic model organism, the experimental use of Drosophila melanogaster has grown to include quantitative behavioral analyses, sophisticated perturbations of neuronal function, and detailed sensory physiology. A highlight of these developments can be seen in the context of vision, where pioneering studies have uncovered fundamental and generalizable principles of sensory processing. Here we begin with an overview of vision-guided behaviors and common methods for probing visual circuits. We then outline the anatomy and physiology of brain regions involved in visual processing, beginning at the sensory periphery and ending with descending motor control. Areas of focus include contrast and motion detection in the optic lobe, circuits for visual feature selectivity, computations in support of spatial navigation, and contextual associative learning. Finally, we look to the future of fly visual neuroscience and discuss promising topics for further study.

The influence of stimulus history on directional coding in the monarch butterfly brain

The central complex is a brain region in the insect brain that houses a neural network specialized to encode directional information. Directional coding has traditionally been investigated with compass cues that revolve in full rotations and at constant angular velocities around the insect's head. However, these stimulus conditions do not fully simulate an insect's sensory perception of compass cues during navigation. In nature, an insect flight is characterized by abrupt changes in moving direction as well as constant changes in velocity. The influence of such varying cue dynamics on compass coding remains unclear. We performed long-term tetrode recordings from the brain of monarch butterflies to study how central complex neurons respond to different stimulus velocities and directions. As these butterflies derive directional information from the sun during migration, we measured the neural response to a virtual sun. The virtual sun was either presented as a spot that appeared at random angular positions or was rotated around the butterfly at different angular velocities and directions. By specifically manipulating the stimulus velocity and trajectory, we dissociated the influence of angular velocity and direction on compass coding. While the angular velocity substantially affected the tuning directedness, the stimulus trajectory influenced the shape of the angular tuning curve. Taken together, our results suggest that the central complex flexibly adjusts its directional coding to the current stimulus dynamics ensuring a precise compass even under highly demanding conditions such as during rapid flight maneuvers.

Contrast polarity-specific mapping improves efficiency of neuronal computation for collision detection

Neurons receive information through their synaptic inputs, but the functional significance of how those inputs are mapped on to a cell's dendrites remains unclear. We studied this question in a grasshopper visual neuron that tracks approaching objects and triggers escape behavior before an impending collision. In response to black approaching objects, the neuron receives OFF excitatory inputs that form a retinotopic map of the visual field onto compartmentalized, distal dendrites. Subsequent processing of these OFF inputs by active membrane conductances allows the neuron to discriminate the spatial coherence of such stimuli. In contrast, we show that ON excitatory synaptic inputs activated by white approaching objects map in a random manner onto a more proximal dendritic field of the same neuron. The lack of retinotopic synaptic arrangement results in the neuron's inability to discriminate the coherence of white approaching stimuli. Yet, the neuron retains the ability to discriminate stimulus coherence for checkered stimuli of mixed ON/OFF polarity. The coarser mapping and processing of ON stimuli thus has a minimal impact, while reducing the total energetic cost of the circuit. Further, we show that these differences in ON/OFF neuronal processing are behaviorally relevant, being tightly correlated with the animal's escape behavior to light and dark stimuli of variable coherence. Our results show that the synaptic mapping of excitatory inputs affects the fine stimulus discrimination ability of single neurons and document the resulting functional impact on behavior.

Classical center-surround receptive fields facilitate novel object detection in retinal bipolar cells

Antagonistic interactions between center and surround receptive field (RF) components lie at the heart of the computations performed in the visual system. Circularly symmetric center-surround RFs are thought to enhance responses to spatial contrasts (i.e., edges), but how visual edges affect motion processing is unclear. Here, we addressed this question in retinal bipolar cells, the first visual neuron with classic center-surround interactions. We found that bipolar glutamate release emphasizes objects that emerge in the RF; their responses to continuous motion are smaller, slower, and cannot be predicted by signals elicited by stationary stimuli. In our hands, the alteration in signal dynamics induced by novel objects was more pronounced than edge enhancement and could be explained by priming of RF surround during continuous motion. These findings echo the salience of human visual perception and demonstrate an unappreciated capacity of the center-surround architecture to facilitate novel object detection and dynamic signal representation.

Mathematical study of neural feedback roles in small target motion detection

Building an efficient and reliable small target motion detection visual system is challenging for artificial intelligence robotics because a small target only occupies few pixels and hardly displays visual features in images. Biological visual systems that have evolved over millions of years could be ideal templates for designing artificial visual systems. Insects benefit from a class of specialized neurons, called small target motion detectors (STMDs), which endow them with an excellent ability to detect small moving targets against a cluttered dynamic environment. Some bio-inspired models featured in feed-forward information processing architectures have been proposed to imitate the functions of the STMD neurons. However, feedback, a crucial mechanism for visual system regulation, has not been investigated deeply in the STMD-based neural circuits and its roles in small target motion detection remain unclear. In this paper, we propose a time-delay feedback STMD model for small target motion detection in complex backgrounds. The main contributions of this study are as follows. First, a feedback pathway is designed by transmitting information from output-layer neurons to lower-layer interneurons in the STMD pathway and the role of the feedback is analyzed from the view of mathematical analysis. Second, to estimate the feedback constant, the existence and uniqueness of solutions for nonlinear dynamical systems formed by feedback loop are analyzed via Schauder's fixed point theorem and contraction mapping theorem. Finally, an iterative algorithm is designed to solve the nonlinear problem and the performance of the proposed model is tested by experiments. Experimental results demonstrate that the feedback is able to weaken background false positives while maintaining a minor effect on small targets. It outperforms existing STMD-based models regarding the accuracy of fast-moving small target detection in visual clutter. The proposed feedback approach could inspire the relevant modeling of robust motion perception robotics visual systems.

The vertical light-gradient and its potential impact on animal distribution and behavior

The visual environment provides vital cues allowing animals to assess habitat quality, weather conditions or measure time of day. Together with other sensory cues and physiological conditions, the visual environment sets behavioral states that make the animal more prone to engage in some behaviors, and less in others. This master-control of behavior serves a fundamental and essential role in determining the distribution and behavior of all animals. Although it is obvious that visual information contains vital input for setting behavioral states, the precise nature of these visual cues remains unknown. Here we use a recently described method to quantify the distribution of light reaching animals’ eyes in different environments. The method records the vertical gradient (as a function of elevation angle) of intensity, spatial structure and spectral balance. Comparison of measurements from different types of environments, weather conditions, times of day, and seasons reveal that these aspects can be readily discriminated from one another. The vertical gradients of radiance, spatial structure (contrast) and color are thus reliable indicators that are likely to have a strong impact on animal behavior and spatial distribution.

Neural mechanisms to exploit positional geometry for collision avoidance

Visual motion provides rich geometrical cues about the three-dimensional configuration of the world. However, how brains decode the spatial information carried by motion signals remains poorly understood. Here, we study a collision-avoidance behavior in Drosophila as a simple model of motion-based spatial vision. With simulations and psychophysics, we demonstrate that walking Drosophila exhibit a pattern of slowing to avoid collisions by exploiting the geometry of positional changes of objects on near-collision courses. This behavior requires the visual neuron LPLC1, whose tuning mirrors the behavior and whose activity drives slowing. LPLC1 pools inputs from object and motion detectors, and spatially biased inhibition tunes it to the geometry of collisions. Connectomic analyses identified circuitry downstream of LPLC1 that faithfully inherits its response properties. Overall, our results reveal how a small neural circuit solves a specific spatial vision task by combining distinct visual features to exploit universal geometrical constraints of the visual world.

Conserved circuits for direction selectivity in the primate retina

The detection of motion direction is a fundamental visual function and a classic model for neural computation. In the non-primate retina, direction selectivity arises in starburst amacrine cell (SAC) dendrites, which provide selective inhibition to direction-selective retinal ganglion cells (dsRGCs). Although SACs are present in primates, their connectivity and the existence of dsRGCs remain open questions. Here, we present a connectomic reconstruction of the primate ON SAC circuit from a serial electron microscopy volume of the macaque central retina. We show that the structural basis for the SACs' ability to confer directional selectivity on postsynaptic neurons is conserved. SACs selectively target a candidate homolog to the mammalian ON-sustained dsRGCs that project to the accessory optic system (AOS) and contribute to gaze-stabilizing reflexes. These results indicate that the capacity to compute motion direction is present in the retina, which is earlier in the primate visual system than classically thought.

Drosophila: A Model to Study the Pathogenesis of Parkinson's Disease

Human Central Nervous System (CNS) is the complex part of the human body, which regulates multiple cellular and molecular events taking place simultaneously. Parkinsons Disease (PD) is the second most common neurodegenerative disease after Alzheimer's disease (AD). The pathological hallmarks of PD are loss of dopaminergic neurons in the substantianigra (SN) pars compacta (SNpc) and accumulation of misfolded α-synuclein, in intra-cytoplasmic inclusions called Lewy bodies (LBs). So far, there is no cure for PD, due to the complexities of molecular mechanisms and events taking place during the pathogenesis of PD. Drosophila melanogaster is an appropriate model organism to unravel the pathogenicity not only behind PD but also other NDs. In this context as numerous biological functions are preserved between Drosophila and humans. Apart from sharing 75% of human disease-causing genes homolog in Drosophila, behavioral responses like memory-based tests, negative geotaxis, courtship and mating are also well studied. The genetic, as well as environmental factors, can be studied in Drosophila to understand the geneenvironment interactions behind the disease condition. Through genetic manipulation, mutant flies can be generated harboring human orthologs, which can prove to be an excellent model to understand the effect of the mutant protein on the pathogenicity of NDs.

First-order visual interneurons distribute distinct contrast and luminance information across ON and OFF pathways to achieve stable behavior

The accurate processing of contrast is the basis for all visually guided behaviors. Visual scenes with rapidly changing illumination challenge contrast computation because photoreceptor adaptation is not fast enough to compensate for such changes. Yet, human perception of contrast is stable even when the visual environment is quickly changing, suggesting rapid post receptor luminance gain control. Similarly, in the fruit fly Drosophila, such gain control leads to luminance invariant behavior for moving OFF stimuli. Here, we show that behavioral responses to moving ON stimuli also utilize a luminance gain, and that ON-motion guided behavior depends on inputs from three first-order interneurons L1, L2, and L3. Each of these neurons encodes contrast and luminance differently and distributes information asymmetrically across both ON and OFF contrast-selective pathways. Behavioral responses to both ON and OFF stimuli rely on a luminance-based correction provided by L1 and L3, wherein L1 supports contrast computation linearly, and L3 non-linearly amplifies dim stimuli. Therefore, L1, L2, and L3 are not specific inputs to ON and OFF pathways but the lamina serves as a separate processing layer that distributes distinct luminance and contrast information across ON and OFF pathways to support behavior in varying conditions.

Non-preferred contrast responses in the Drosophila motion pathways reveal a receptive field structure that explains a common visual illusion

Diverse sensory systems, from audition to thermosensation, feature a separation of inputs into ON (increments) and OFF (decrements) signals. In the Drosophila visual system, separate ON and OFF pathways compute the direction of motion, yet anatomical and functional studies have identified some crosstalk between these channels. We used this well-studied circuit to ask whether the motion computation depends on ON-OFF pathway crosstalk. Using whole-cell electrophysiology, we recorded visual responses of T4 (ON) and T5 (OFF) cells, mapped their composite ON-OFF receptive fields, and found that they share a similar spatiotemporal structure. We fit a biophysical model to these receptive fields that accurately predicts directionally selective T4 and T5 responses to both ON and OFF moving stimuli. This model also provides a detailed mechanistic explanation for the directional preference inversion in response to the prominent reverse-phi illusion. Finally, we used the steering responses of tethered flying flies to validate the model's predicted effects of varying stimulus parameters on the behavioral turning inversion.

Small brains for big science

As the study of the human brain is complicated by its sheer scale, complexity, and impracticality of invasive experiments, neuroscience research has long relied on model organisms. The brains of macaque, mouse, zebrafish, fruit fly, nematode, and others have yielded many secrets that advanced our understanding of the human brain. Here, we propose that adding miniature insects to this collection would reduce the costs and accelerate brain research. The smallest insects occupy a special place among miniature animals: despite their body sizes, comparable to unicellular organisms, they retain complex brains that include thousands of neurons. Their brains possess the advantages of those in insects, such as neuronal identifiability and the connectome stereotypy, yet are smaller and hence easier to map and understand. Finally, the brains of miniature insects offer insights into the evolution of brain design.

Predicting individual neuron responses with anatomically constrained task optimization

Artificial neural networks trained to solve sensory tasks can develop statistical representations that match those in biological circuits. However, it remains unclear whether they can reproduce properties of individual neurons. Here, we investigated how artificial networks predict individual neuron properties in the visual motion circuits of the fruit fly Drosophila. We trained anatomically constrained networks to predict movement in natural scenes, solving the same inference problem as fly motion detectors. Units in the artificial networks adopted many properties of analogous individual neurons, even though they were not explicitly trained to match these properties. Among these properties was the split into ON and OFF motion detectors, which is not predicted by classical motion detection models. The match between model and neurons was closest when models were trained to be robust to noise. These results demonstrate how anatomical, task, and noise constraints can explain properties of individual neurons in a small neural network.

Neuroscience: Convergence of biological and artificial networks

A new study shows that an artificial neural network trained to predict visual motion reproduces key properties of motion detecting circuits in the fruit fly.

The cell adhesion molecule Sdk1 shapes assembly of a retinal circuit that detects localized edges

Nearly 50 different mouse retinal ganglion cell (RGC) types sample the visual scene for distinct features. RGC feature selectivity arises from their synapses with a specific subset of amacrine (AC) and bipolar cell (BC) types, but how RGC dendrites arborize and collect input from these specific subsets remains poorly understood. Here we examine the hypothesis that RGCs employ molecular recognition systems to meet this challenge. By combining calcium imaging and type-specific histological stains, we define a family of circuits that express the recognition molecule Sidekick-1 (Sdk1), which include a novel RGC type (S1-RGC) that responds to local edges. Genetic and physiological studies revealed that Sdk1 loss selectively disrupts S1-RGC visual responses, which result from a loss of excitatory and inhibitory inputs and selective dendritic deficits on this neuron. We conclude that Sdk1 shapes dendrite growth and wiring to help S1-RGCs become feature selective.

The physiological basis for contrast opponency in motion computation in Drosophila

In Drosophila, direction-selective neurons implement a mechanism of motion computation similar to cortical neurons, using contrast-opponent receptive fields with ON and OFF subfields. It is not clear how the presynaptic circuitry of direction-selective neurons in the OFF pathway supports this computation if all major inputs are OFF-rectified neurons. Here, we reveal the biological substrate for motion computation in the OFF pathway. Three interneurons, Tm2, Tm9 and CT1, provide information about ON stimuli to the OFF direction-selective neuron T5 across its receptive field, supporting a contrast-opponent receptive field organization. Consistent with its prominent role in motion detection, variability in Tm9 receptive field properties transfers to T5, and calcium decrements in Tm9 in response to ON stimuli persist across behavioral states, while spatial tuning is sharpened by active behavior. Together, our work shows how a key neuronal computation is implemented by its constituent neuronal circuit elements to ensure direction selectivity.

Drosophila Fezf functions as a transcriptional repressor to direct layer-specific synaptic connectivity in the fly visual system

Functionally relevant neuronal connections are often organized within discrete layers of neuropil to ensure proper connectivity and information processing. While layer-specific assembly of neuronal connectivity is a dynamic process involving stepwise interactions between different neuron types, the mechanisms underlying this critical developmental process are not well understood. Here, we investigate the role of the transcription factor dFezf in layer selection within the Drosophila visual system, which is important for synaptic specificity. Our findings show that dFezf functions as a transcriptional repressor governing the precise temporal expression pattern of downstream genes, including other transcription factors required for proper connectivity. Layer-specific assembly of neuronal connectivity in the fly visual system is thus orchestrated by precise, temporally controlled transcriptional cascades.

The layered compartmentalization of synaptic connections, a common feature of nervous systems, underlies proper connectivity between neurons and enables parallel processing of neural information. However, the stepwise development of layered neuronal connections is not well understood. The medulla neuropil of the Drosophila visual system, which comprises 10 discrete layers (M1 to M10), where neural computations underlying distinct visual features are processed, serves as a model system for understanding layered synaptic connectivity. The first step in establishing layer-specific connectivity in the outer medulla (M1 to M6) is the innervation by lamina (L) neurons of one of two broad, primordial domains that will subsequently expand and transform into discrete layers. We previously found that the transcription factor dFezf cell-autonomously directs L3 lamina neurons to their proper primordial broad domain before they form synapses within the developing M3 layer. Here, we show that dFezf controls L3 broad domain selection through temporally precise transcriptional repression of the transcription factor slp1 (sloppy paired 1). In wild-type L3 neurons, slp1 is transiently expressed at a low level during broad domain selection. When dFezf is deleted, slp1 expression is up-regulated, and ablation of slp1 fully rescues the defect of broad domain selection in dFezf-null L3 neurons. Although the early, transient expression of slp1 is expendable for broad domain selection, it is surprisingly necessary for the subsequent L3 innervation of the M3 layer. DFezf thus functions as a transcriptional repressor to coordinate the temporal dynamics of a transcriptional cascade that orchestrates sequential steps of layer-specific synapse formation.

Adaptive temporal processing of odor stimuli

The olfactory system translates chemical signals into neuronal signals that inform behavioral decisions of the animal. Odors are cues for source identity, but if monitored long enough, they can also be used to localize the source. Odor representations should therefore be robust to changing conditions and flexible in order to drive an appropriate behavior. In this review, we aim at discussing the main computations that allow robust and flexible encoding of odor information in the olfactory neural pathway.

Multi-regional circuits underlying visually guided decision-making in Drosophila

Visually guided decision-making requires integration of information from distributed brain areas, necessitating a brain-wide approach to examine its neural mechanisms. New tools in Drosophila melanogaster enable circuits spanning the brain to be charted with single cell-type resolution. Here, we highlight recent advances uncovering the computations and circuits that transform and integrate visual information across the brain to make behavioral choices. Visual information flows from the optic lobes to three primary central brain regions: a sensorimotor mapping area and two 'higher' centers for memory or spatial orientation. Rapid decision-making during predator evasion emerges from the spike timing dynamics in parallel sensorimotor cascades. Goal-directed decisions may occur through memory, navigation and valence processing in the central complex and mushroom bodies.

Structure and Functions of Sidekicks

Many of the immunoglobulin superfamily (IgSF) molecules play pivotal roles in cell communication. The Sidekick (Sdk) gene, first described in Drosophila, encodes the single-pass transmembrane protein, Sdk, which is one of the largest among IgSF membrane proteins. Sdk first appeared in multicellular animals during the Precambrian age and later evolved to Sdk1 and Sdk2 in vertebrates by gene duplication. In flies, a single Sdk is involved in positioning photoreceptor neurons and their axons in the visual system and is responsible for dynamically rearranging cell shapes by strictly populating tricellular adherens junctions in epithelia. In vertebrates, Sdk1 and Sdk2 are expressed by unique sets of cell types and distinctively participate in the formation and/or maintenance of neural circuits in the retina, indicating that they are determinants of synaptic specificity. These functions are mediated by specific homophilic binding of their ectodomains and by intracellular association with PDZ scaffold proteins. Recent human genetic studies as well as animal experiments implicate that Sdk genes may influence various neurodevelopmental and psychiatric disorders, such as autism spectrum disorders, attention-deficit hyperactivity disorder, addiction, and depression. The gigantic Sdk1 gene is susceptible to erratic gene rearrangements or mutations in both somatic and germ-line cells, potentially contributing to neurological disorders and some types of cancers. This review summarizes what is known about the structure and roles of Sdks.

Mechanism for analogous illusory motion perception in flies and humans

Visual motion detection is one of the most important computations performed by visual circuits. Yet, we perceive vivid illusory motion in stationary, periodic luminance gradients that contain no true motion. This illusion is shared by diverse vertebrate species, but theories proposed to explain this illusion have remained difficult to test. Here, we demonstrate that in the fruit fly Drosophila, the illusory motion percept is generated by unbalanced contributions of direction-selective neurons' responses to stationary edges. First, we found that flies, like humans, perceive sustained motion in the stationary gradients. The percept was abolished when the elementary motion detector neurons T4 and T5 were silenced. In vivo calcium imaging revealed that T4 and T5 neurons encode the location and polarity of stationary edges. Furthermore, our proposed mechanistic model allowed us to predictably manipulate both the magnitude and direction of the fly's illusory percept by selectively silencing either T4 or T5 neurons. Interestingly, human brains possess the same mechanistic ingredients that drive our model in flies. When we adapted human observers to moving light edges or dark edges, we could manipulate the magnitude and direction of their percepts as well, suggesting that mechanisms similar to the fly's may also underlie this illusion in humans. By taking a comparative approach that exploits Drosophila neurogenetics, our results provide a causal, mechanistic account for a long-known visual illusion. These results argue that this illusion arises from architectures for motion detection that are shared across phyla.

A minimal synaptic model for direction selective neurons in Drosophila

Visual motion estimation is a canonical neural computation. In Drosophila, recent advances have identified anatomic and functional circuitry underlying direction-selective computations. Models with varying levels of abstraction have been proposed to explain specific experimental results but have rarely been compared across experiments. Here we use the wealth of available anatomical and physiological data to construct a minimal, biophysically inspired synaptic model for Drosophila’s first-order direction-selective T4 cells. We show how this model relates mathematically to classical models of motion detection, including the Hassenstein-Reichardt correlator model. We used numerical simulation to test how well this synaptic model could reproduce measurements of T4 cells across many datasets and stimulus modalities. These comparisons include responses to sinusoid gratings, to apparent motion stimuli, to stochastic stimuli, and to natural scenes. Without fine-tuning this model, it sufficed to reproduce many, but not all, response properties of T4 cells. Since this model is flexible and based on straightforward biophysical properties, it provides an extensible framework for developing a mechanistic understanding of T4 neural response properties. Moreover, it can be used to assess the sufficiency of simple biophysical mechanisms to describe features of the direction-selective computation and identify where our understanding must be improved.

A Neural Representation of Naturalistic Motion-Guided Behavior in the Zebrafish Brain

All animals must transform ambiguous sensory data into successful behavior. This requires sensory representations that accurately reflect the statistics of natural stimuli and behavior. Multiple studies show that visual motion processing is tuned for accuracy under naturalistic conditions, but the sensorimotor circuits extracting these cues and implementing motion-guided behavior remain unclear. Here we show that the larval zebrafish retina extracts a diversity of naturalistic motion cues, and the retinorecipient pretectum organizes these cues around the elements of behavior. We find that higher-order motion stimuli, gliders, induce optomotor behavior matching expectations from natural scene analyses. We then image activity of retinal ganglion cell terminals and pretectal neurons. The retina exhibits direction-selective responses across glider stimuli, and anatomically clustered pretectal neurons respond with magnitudes matching behavior. Peripheral computations thus reflect natural input statistics, whereas central brain activity precisely codes information needed for behavior. This general principle could organize sensorimotor transformations across animal species.

Luminance Information Is Required for the Accurate Estimation of Contrast in Rapidly Changing Visual Contexts

Visual perception scales with changes in the visual stimulus, or contrast, irrespective of background illumination. However, visual perception is challenged when adaptation is not fast enough to deal with sudden declines in overall illumination, for example, when gaze follows a moving object from bright sunlight into a shaded area. Here, we show that the visual system of the fly employs a solution by propagating a corrective luminance-sensitive signal. We use in vivo 2-photon imaging and behavioral analyses to demonstrate that distinct OFF-pathway inputs encode contrast and luminance. Predictions of contrast-sensitive neuronal responses show that contrast information alone cannot explain behavioral responses in sudden dim light. The luminance-sensitive pathway via the L3 neuron is required for visual processing in such rapidly changing light conditions, ensuring contrast constancy when pure contrast sensitivity underestimates a stimulus. Thus, retaining a peripheral feature, luminance, in visual processing is required for robust behavioral responses.

Heterogeneous Temporal Contrast Adaptation in Drosophila Direction-Selective Circuits

In visual systems, neurons adapt both to the mean light level and to the range of light levels, or the contrast. Contrast adaptation has been studied extensively, but it remains unclear how it is distributed among neurons in connected circuits, and how early adaptation affects subsequent computations. Here, we investigated temporal contrast adaptation in neurons across Drosophila's visual motion circuitry. Several ON-pathway neurons showed strong adaptation to changes in contrast over time. One of these neurons, Mi1, showed almost complete adaptation on fast timescales, and experiments ruled out several potential mechanisms for its adaptive properties. When contrast adaptation reduced the gain in ON-pathway cells, it was accompanied by decreased motion responses in downstream direction-selective cells. Simulations show that contrast adaptation can substantially improve motion estimates in natural scenes. The benefits are larger for ON-pathway adaptation, which helps explain the heterogeneous distribution of contrast adaptation in these circuits.

Asymmetric ON-OFF processing of visual motion cancels variability induced by the structure of natural scenes

Animals detect motion using a variety of visual cues that reflect regularities in the natural world. Experiments in animals across phyla have shown that motion percepts incorporate both pairwise and triplet spatiotemporal correlations that could theoretically benefit motion computation. However, it remains unclear how visual systems assemble these cues to build accurate motion estimates. Here, we used systematic behavioral measurements of fruit fly motion perception to show how flies combine local pairwise and triplet correlations to reduce variability in motion estimates across natural scenes. By generating synthetic images with statistics controlled by maximum entropy distributions, we show that the triplet correlations are useful only when images have light-dark asymmetries that mimic natural ones. This suggests that asymmetric ON-OFF processing is tuned to the particular statistics of natural scenes. Since all animals encounter the world's light-dark asymmetries, many visual systems are likely to use asymmetric ON-OFF processing to improve motion estimation.

Dynamic nonlinearities enable direction opponency in Drosophila elementary motion detectors

Direction-selective neurons respond to visual motion in a preferred direction. They are direction-opponent if they are also inhibited by motion in the opposite direction. In flies and vertebrates, direction opponency has been observed in second-order direction-selective neurons, which achieve this opponency by subtracting signals from first-order direction-selective cells with opposite directional tunings. Here, we report direction opponency in Drosophila that emerges in first-order direction-selective neurons, the elementary motion detectors T4 and T5. This opponency persists when synaptic output from these cells is blocked, suggesting that it arises from feedforward, not feedback, computations. These observations exclude a broad class of linear-nonlinear models that have been proposed to describe direction-selective computations. However, they are consistent with models that include dynamic nonlinearities. Simulations of opponent models suggest that direction opponency in first-order motion detectors improves motion discriminability by suppressing noise generated by the local structure of natural scenes.

Visual Control of Walking Speed in Drosophila

An animal's self-motion generates optic flow across its retina, and it can use this visual signal to regulate its orientation and speed through the world. While orientation control has been studied extensively in Drosophila and other insects, much less is known about the visual cues and circuits that regulate translational speed. Here, we show that flies regulate walking speed with an algorithm that is tuned to the speed of visual motion, causing them to slow when visual objects are nearby. This regulation does not depend strongly on the spatial structure or the direction of visual stimuli, making it algorithmically distinct from the classic computation that controls orientation. Despite the different algorithms, the visual circuits that regulate walking speed overlap with those that regulate orientation. Taken together, our findings suggest that walking speed is controlled by a hierarchical computation that combines multiple motion detectors with distinct tunings. VIDEO ABSTRACT.

Spiking Neurons Integrating Visual Stimuli Orientation and Direction Selectivity in a Robotic Context

Visual motion detection is essential for the survival of many species. The phenomenon includes several spatial properties, not fully understood at the level of a neural circuit. This paper proposes a computational model of a visual motion detector that integrates direction and orientation selectivity features. A recent experiment in the Drosophila model highlights that stimulus orientation influences the neural response of direction cells. However, this interaction and the significance at the behavioral level are currently unknown. As such, another objective of this article is to study the effect of merging these two visual processes when contextualized in a neuro-robotic model and an operant conditioning procedure. In this work, the learning task was solved using an artificial spiking neural network, acting as the brain controller for virtual and physical robots, showing a behavior modulation from the integration of both visual processes.

The Neuronal Basis of an Illusory Motion Percept Is Explained by Decorrelation of Parallel Motion Pathways

Both vertebrates and invertebrates perceive illusory motion, known as "reverse-phi," in visual stimuli that contain sequential luminance increments and decrements. However, increment (ON) and decrement (OFF) signals are initially processed by separate visual neurons, and parallel elementary motion detectors downstream respond selectively to the motion of light or dark edges, often termed ON- and OFF-edges. It remains unknown how and where ON and OFF signals combine to generate reverse-phi motion signals. Here, we show that each of Drosophila's elementary motion detectors encodes motion by combining both ON and OFF signals. Their pattern of responses reflects combinations of increments and decrements that co-occur in natural motion, serving to decorrelate their outputs. These results suggest that the general principle of signal decorrelation drives the functional specialization of parallel motion detection channels, including their selectivity for moving light or dark edges.

Neural Mechanisms of Motion Processing in the Mammalian Retina

Visual motion on the retina activates a cohort of retinal ganglion cells (RGCs). This population activity encodes multiple streams of information extracted by parallel retinal circuits. Motion processing in the retina is best studied in the direction-selective circuit. The main focus of this review is the neural basis of direction selectivity, which has been investigated in unprecedented detail using state-of-the-art functional, connectomic, and modeling methods. Mechanisms underlying the encoding of other motion features by broader RGC populations are also discussed. Recent discoveries at both single-cell and population levels highlight the dynamic and stimulus-dependent engagement of multiple mechanisms that collectively implement robust motion detection under diverse visual conditions.

Spatio-temporal relays control layer identity of direction-selective neuron subtypes in Drosophila

Visual motion detection in sighted animals is essential to guide behavioral actions ensuring their survival. In Drosophila, motion direction is first detected by T4/T5 neurons. Their axons innervate one of the four lobula plate layers. How T4/T5 neurons with layer-specific representation of motion-direction preferences are specified during development is unknown. We show that diffusible Wingless (Wg) between adjacent neuroepithelia induces its own expression to form secondary signaling centers. These activate Decapentaplegic (Dpp) signaling in adjacent lateral tertiary neuroepithelial domains dedicated to producing layer 3/4-specific T4/T5 neurons. T4/T5 neurons derived from the core domain devoid of Dpp signaling adopt the default layer 1/2 fate. Dpp signaling induces the expression of the T-box transcription factor Optomotor-blind (Omb), serving as a relay to postmitotic neurons. Omb-mediated repression of Dachshund transforms layer 1/2- into layer 3/4-specific neurons. Hence, spatio-temporal relay mechanisms, bridging the distances between neuroepithelial domains and their postmitotic progeny, implement T4/T5 neuron-subtype identity.

Restoring Vision to the Blind with Chemical Photoswitches

Degenerative retinal diseases such as retinitis pigmentosa (RP) and age-related macular degeneration (AMD) affect millions of people around the world and lead to irreversible vision loss if left untreated. A number of therapeutic strategies have been developed over the years to treat these diseases or restore vision to already blind patients. In this Review, we describe the development and translational application of light-sensitive chemical photoswitches to restore visual function to the blind retina and compare the translational potential of photoswitches with other vision-restoring therapies. This therapeutic strategy is enabled by an efficient fusion of chemical synthesis, chemical biology, and molecular biology and is broadly applicable to other biological systems. We hope this Review will be of interest to chemists as well as neuroscientists and clinicians.

Neural Mechanisms Mediating Motion Sensitivity in Parasol Ganglion Cells of the Primate Retina

Considerable theoretical and experimental effort has been dedicated to understanding how neural circuits detect visual motion. In primates, much is known about the cortical circuits that contribute to motion processing, but the role of the retina in this fundamental neural computation is poorly understood. Here, we used a combination of extracellular and whole-cell recording to test for motion sensitivity in the two main classes of output neurons in the primate retina-midget (parvocellular-projecting) and parasol (magnocellular-projecting) ganglion cells. We report that parasol, but not midget, ganglion cells are motion sensitive. This motion sensitivity is present in synaptic excitation and disinhibition from presynaptic bipolar cells and amacrine cells, respectively. Moreover, electrical coupling between neighboring bipolar cells and the nonlinear nature of synaptic release contribute to the observed motion sensitivity. Our findings indicate that motion computations arise far earlier in the primate visual stream than previously thought.

Topological and modality-specific representation of somatosensory information in the fly brain

Insects and mammals share similarities of neural organization underlying the perception of odors, taste, vision, sound, and gravity. We observed that insect somatosensation also corresponds to that of mammals. In Drosophila, the projections of all the somatosensory neuron types to the insect's equivalent of the spinal cord segregated into modality-specific layers comparable to those in mammals. Some sensory neurons innervate the ventral brain directly to form modality-specific and topological somatosensory maps. Ascending interneurons with dendrites in matching layers of the nerve cord send axons that converge to respective brain regions. Pathways arising from leg somatosensory neurons encode distinct qualities of leg movement information and play different roles in ground detection. Establishment of the ground pattern and genetic tools for neuronal manipulation should provide the basis for elucidating the mechanisms underlying somatosensation.

Drosophila Sidekick is required in developing photoreceptors to enable visual motion detection

The assembly of functional neuronal circuits requires growth cones to extend in defined directions and recognize the correct synaptic partners. Homophilic adhesion between vertebrate Sidekick proteins promotes synapse formation between retinal neurons involved in visual motion detection. We show here that Drosophila Sidekick accumulates in specific synaptic layers of the developing motion detection circuit and is necessary for normal optomotor behavior. Sidekick is required in photoreceptors, but not in their target lamina neurons, to promote the alignment of lamina neurons into columns and subsequent sorting of photoreceptor axons into synaptic modules based on their precise spatial orientation. Sidekick is also localized to the dendrites of the direction-selective T4 and T5 cells, and is expressed in some of their presynaptic partners. In contrast to its vertebrate homologs, Sidekick is not essential for T4 and T5 to direct their dendrites to the appropriate layers or to receive synaptic contacts. These results illustrate a conserved requirement for Sidekick proteins in establishing visual motion detection circuits that is achieved through distinct cellular mechanisms in Drosophila and vertebrates.