Connectome of the lamina reveals the circuit for early color processing in the visual pathway of a butterfly

Neuromorphic Visual Computing with ZnMgO QDs-Based UV-Responsive Optoelectronic Synaptic Devices for Image Encryption and Recognition

Retina-inspired optoelectronic neuromorphic devices integrating optical sensing and computation are the key components in realizing neuromorphic visual computing. In particular, UV-responsive optoelectronic synaptic devices hold significant value for advanced neuromorphic vision systems, as they can expand human visual perception. Herein, we demonstrate a UV-responsive optoelectronic synaptic device based on ZnMgO quantum dots (QDs) designed for in-sensor computing in neuromorphic vision applications. The device demonstrates voltage-driven short-term and long-term synaptic plasticity, as well as multiple photoinduced synaptic functions. Based on this device, an in-sensor image-blending encryption method has been designed, which can effectively reduce the risk of data leakage during transmission. Furthermore, an in-sensor reservoir computing (RC) system with image processing functions is constructed, which integrates a photonic reservoir layer (PRL) for image preprocessing and a multilayer perceptron (MLP) capable of image recognition. The system achieves 98.6% accuracy in recognizing Fashion-MNIST images and maintains 83% accuracy under 60% random noise, showcasing its robustness. This work introduces a novel approach for developing UV-responsive optoelectronic synaptic devices equipped with dual-mode modulation of both electrical and optical signals, offering new perspectives and solutions for integrated applications in neuromorphic vision systems.

Effects of Climate Change on the Distribution of Papilio xuthus

The Papilio xuthus is a widely distributed species in the genus Papilio of the family Papilionidae, possessing ecological, ornamental, and socio-economic service values. To determine the ecological role of P. xuthus and assess its population distribution under future climate change scenarios, this study utilized the MaxEnt model to predict the geographic distribution of P. xuthus in the future and evaluate its population dynamics. The results indicated that P. xuthus is currently widely distributed in East Asia, with a high suitability area of 1827.83 × 103 km2, primarily in China, Japan, North Korea, and South Korea. Climate change has a significant impact on the geographic distribution of P. xuthus, with its high suitability areas decreasing in the future, particularly within China, where the change is projected to be as high as 46.46% under the SSP126 scenario by the 2050s. The centroid of its high-suitability area is expected to shift northeastward. Key environmental variable analysis revealed that Temperature Seasonality, Mean Temperature of the Wettest Quarter, Precipitation of the Wettest Month, and Precipitation of the Warmest Quarter are critical factors influencing the selection of suitable habitats by P. xuthus. This study assessed the distribution of P. xuthus and provided conservation recommendations, offering a reference for future population control and conservation efforts.

Integrating ultraviolet sensing and memory functions in gallium nitride-based optoelectronic devices

Optoelectronic devices present a promising avenue for emulating the human visual system. However, existing devices struggle to maintain optical image information after removing external stimuli, preventing the integration of image perception and memory. The development of optoelectronic memory devices offers a feasible solution to bridge this gap. Simultaneously, the artificial vision for perceiving and storing ultraviolet (UV) images is particularly important because UV light carries information imperceptible to the naked eye. This study introduces a multi-level UV optoelectronic memory based on gallium nitride (GaN), seamlessly integrating UV sensing and memory functions within a single device. The embedded SiO2 side-gates around source and drain regions effectively extend the lifetime of photo-generated carriers, enabling dual-mode storage of UV signals in terms of threshold voltage and ON-state current. The optoelectronic memory demonstrates excellent robustness with the retention time exceeding 4 × 104 s and programming/erasing cycles surpassing 1 × 105. Adjusting the gate voltage achieves five distinct storage states, each characterized by excellent retention, and efficiently modulates erasure times for rapid erasure. Furthermore, the integration of the GaN optoelectronic memory array successfully captures and stably stores specific UV images for over 7 days. The study marks a significant stride in optoelectronic memories, showcasing their potential in applications requiring prolonged retention.

Looking across the gap: Understanding the evolution of eyes and vision among insects

The compound eyes of insects exhibit stunning variation in size, structure, and function, which has allowed these animals to use their vision to adapt to a huge range of different environments and lifestyles, and evolve complex behaviors. Much of our knowledge of eye development has been learned from Drosophila, while visual adaptations and behaviors are often more striking and better understood from studies of other insects. However, recent studies in Drosophila and other insects, including bees, beetles, and butterflies, have begun to address this gap by revealing the genetic and developmental bases of differences in eye morphology and key new aspects of compound eye structure and function. Furthermore, technical advances have facilitated the generation of high-resolution connectomic data from different insect species that enhances our understanding of visual information processing, and the impact of changes in these processes on the evolution of vision and behavior. Here, we review these recent breakthroughs and propose that future integrated research from the development to function of visual systems within and among insect species represents a great opportunity to understand the remarkable diversification of insect eyes and vision.

Morphology and spectral sensitivity of long visual fibers and lamina monopolar cells in the butterfly Papilio xuthus

Extensive analysis of the flower-visiting behavior of a butterfly, Papilio xuthus, has indicated complex interaction between chromatic, achromatic, and motion cues. Their eyes are spectrally rich with six classes of photoreceptors, respectively sensitive in the ultraviolet, violet, blue, green, red, and broad-band wavelength regions. Here, we studied the anatomy and physiology of photoreceptors and second-order neurons of P. xuthus, focusing on their spectral sensitivities and projection terminals to address where the early visual integration takes place. We thus found the ultraviolet, violet, and blue photoreceptors and all second-order neurons terminate in the distal region of the second optic ganglion, the medulla. We identified five types of second-order neurons based on the arborization in the first optic ganglion, the lamina, and the shape of the medulla terminals. Their spectral sensitivity is independent of the morphological types but reflects the combination of pre-synaptic photoreceptors. The results indicate that the distal medulla is the most plausible region for early visual integration.

Multiple axes of visual system diversity in Ithomiini, an ecologically diverse tribe of mimetic butterflies

The striking structural variation seen in arthropod visual systems can be explained by the overall quantity and spatio-temporal structure of light within habitats coupled with developmental and physiological constraints. However, little is currently known about how fine-scale variation in visual structures arises across shorter evolutionary and ecological scales. In this study, we characterise patterns of interspecific (between species), intraspecific (between sexes) and intraindividual (between eye regions) variation in the visual system of four ithomiine butterfly species. These species are part of a diverse 26-million-year-old Neotropical radiation where changes in mimetic colouration are associated with fine-scale shifts in ecology, such as microhabitat preference. Using a combination of selection analyses on visual opsin sequences, in vivo ophthalmoscopy, micro-computed tomography (micro-CT), immunohistochemistry, confocal microscopy and neural tracing, we quantify and describe physiological, anatomical and molecular traits involved in visual processing. Using these data, we provide evidence of substantial variation within the visual systems of Ithomiini, including: (i) relaxed selection on visual opsins, perhaps mediated by habitat preference, (ii) interspecific shifts in visual system physiology and anatomy, and (iii) extensive sexual dimorphism, including the complete absence of a butterfly-specific optic neuropil in the males of some species. We conclude that considerable visual system variation can exist within diverse insect radiations, hinting at the evolutionary lability of these systems to rapidly develop specialisations to distinct visual ecologies, with selection acting at the perceptual, processing and molecular level.

Different spectral sensitivities of ON- and OFF-motion pathways enhance the detection of approaching color objects in Drosophila

Color and motion are used by many species to identify salient objects. They are processed largely independently, but color contributes to motion processing in humans, for example, enabling moving colored objects to be detected when their luminance matches the background. Here, we demonstrate an unexpected, additional contribution of color to motion vision in Drosophila. We show that behavioral ON-motion responses are more sensitive to UV than for OFF-motion, and we identify cellular pathways connecting UV-sensitive R7 photoreceptors to ON and OFF-motion-sensitive T4 and T5 cells, using neurogenetics and calcium imaging. Remarkably, this contribution of color circuitry to motion vision enhances the detection of approaching UV discs, but not green discs with the same chromatic contrast, and we show how this could generalize for systems with ON- and OFF-motion pathways. Our results provide a computational and circuit basis for how color enhances motion vision to favor the detection of saliently colored objects.

A complete reconstruction of the early visual system of an adult insect

For most model organisms in neuroscience, research into visual processing in the brain is difficult because of a lack of high-resolution maps that capture complex neuronal circuitry. The microinsect Megaphragma viggianii, because of its small size and non-trivial behavior, provides a unique opportunity for tractable whole-organism connectomics. We image its whole head using serial electron microscopy. We reconstruct its compound eye and analyze the optical properties of the ommatidia as well as the connectome of the first visual neuropil-the lamina. Compared with the fruit fly and the honeybee, Megaphragma visual system is highly simplified: it has 29 ommatidia per eye and 6 lamina neuron types. We report features that are both stereotypical among most ommatidia and specialized to some. By identifying the "barebones" circuits critical for flying insects, our results will facilitate constructing computational models of visual processing in insects.

Tetrachromatic vision-inspired neuromorphic sensors with ultraweak ultraviolet detection

Sensing and recognizing invisible ultraviolet (UV) light is vital for exploiting advanced artificial visual perception system. However, due to the uncertainty of the natural environment, the UV signal is very hard to be detected and perceived. Here, inspired by the tetrachromatic visual system, we report a controllable UV-ultrasensitive neuromorphic vision sensor (NeuVS) that uses organic phototransistors (OPTs) as the working unit to integrate sensing, memory and processing functions. Benefiting from asymmetric molecular structure and unique UV absorption of the active layer, the as fabricated UV-ultrasensitive NeuVS can detect 370 nm UV-light with the illumination intensity as low as 31 nW cm^-2, exhibiting one of the best optical figures of merit in UV-sensitive neuromorphic vision sensors. Furthermore, the NeuVS array exbibits good image sensing and memorization capability due to its ultrasensitive optical detection and large density of charge trapping states. In addition, the wavelength-selective response and multi-level optical memory properties are utilized to construct an artificial neural network for extract and identify the invisible UV information. The NeuVS array can perform static and dynamic image recognition from the original color image by filtering red, green and blue noise, and significantly improve the recognition accuracy from 46 to 90%.

'Color' processing in the butterfly visual system

The swallowtail butterfly, Papilio xuthus, has excellent color discrimination abilities, and its visible light spectrum is notably wide. We discuss the neural basis of color vision in P. xuthus, highlighting some of the evolutionary adaptations in this species in relation to other insects. These adaptations include inter-photoreceptor (PR) interactions that produce spectral-opponent PRs, and complex higher order color-coding neurons.

Circadian rhythm entrainment of the jewel wasp, Nasonia vitripennis, by antagonistic interactions of multiple spectral inputs

Circadian light entrainment in some insects is regulated by blue-light-sensitive cryptochrome (CRY) protein that is expressed in the clock neurons, but this is not the case in hymenopterans. The hymenopteran clock does contain CRY, but it appears to be light-insensitive. Therefore, we investigated the role of retinal photoreceptors in the photic entrainment of the jewel wasp Nasonia vitripennis. Application of monochromatic light stimuli at different light intensities caused phase shifts in the wasp's circadian activity from which an action spectrum with three distinct peaks was derived. Electrophysiological recordings from the compound eyes and ocelli revealed the presence of three photoreceptor classes, with peak sensitivities at 340 nm (ultraviolet), 450 nm (blue) and 530 nm (green). An additional photoreceptor class in the ocelli with sensitivity maximum at 560-580 nm (red) was found. Whereas a simple sum of photoreceptor spectral sensitivities could not explain the action spectrum of the circadian phase shifts, modelling of the action spectrum indicates antagonistic interactions between pairs of spectral photoreceptors, residing in the compound eyes and the ocelli. Our findings imply that the photic entrainment mechanism in N. vitripennis encompasses the neural pathways for measuring the absolute luminance as well as the circuits mediating colour opponency.

Connectomics and the neural basis of behaviour

Methods to acquire and process synaptic-resolution electron-microscopy datasets have progressed very rapidly, allowing production and annotation of larger, more complete connectomes. More accurate neuronal matching techniques are enriching cell type data with gene expression, neuron activity, behaviour and developmental information, providing ways to test hypotheses of circuit function. In a variety of behaviours such as learned and innate olfaction, navigation and sexual behaviour, connectomics has already revealed interconnected modules with a hierarchical structure, recurrence and integration of sensory streams. Comparing individual connectomes to determine which circuit features are robust and which are variable is one key research area; new work in comparative connectomics across development, experience, sex and species will establish strong links between neuronal connectivity and brain function.

High diversity of arthropod colour vision: from genes to ecology

Colour vision allows animals to use the information contained in the spectrum of light to control important behavioural decisions such as selection of habitats, food or mates. Among arthropods, the largest animal phylum, we find completely colour-blind species as well as species with up to 40 different opsin genes or more than 10 spectral types of photoreceptors, we find a large diversity of optical methods shaping spectral sensitivity, we find eyes with different colour vision systems looking into the dorsal and ventral hemisphere, and species in which males and females see the world in different colours. The behavioural use of colour vision shows an equally astonishing diversity. Only the neural mechanisms underlying this sensory ability seems surprisingly conserved-not only within the phylum, but even between arthropods and the other well-studied phylum, chordates. The papers in this special issue allow a glimpse into the colourful world of arthropod colour vision, and besides giving an overview this introduction highlights how much more research is needed to fill in the many missing pieces of this large puzzle. This article is part of the theme issue 'Understanding colour vision: molecular, physiological, neuronal and behavioural studies in arthropods'.

Colour vision in ants (Formicidae, Hymenoptera)

Ants are ecologically one of the most important groups of insects and exhibit impressive capabilities for visual learning and orientation. Studies on numerous ant species demonstrate that ants can learn to discriminate between different colours irrespective of light intensity and modify their behaviour accordingly. However, the findings across species are variable and inconsistent, suggesting that our understanding of colour vision in ants and what roles ecological and phylogenetic factors play is at an early stage. This review provides a brief synopsis of the critical findings of the past century of research by compiling studies that address molecular, physiological and behavioural aspects of ant colour vision. With this, we aim to improve our understanding of colour vision and to gain deeper insights into the mysterious and colourful world of ants.

This article is part of the theme issue ‘Understanding colour vision: molecular, physiological, neuronal and behavioural studies in arthropods’.

Night skies through animals' eyes-Quantifying night-time visual scenes and light pollution as viewed by animals

A large proportion of animal species enjoy the benefits of being active at night, and have evolved the corresponding optical and neural adaptations to cope with the challenges of low light intensities. However, over the past century electric lighting has introduced direct and indirect light pollution into the full range of terrestrial habitats, changing nocturnal animals' visual worlds dramatically. To understand how these changes affect nocturnal behavior, we here propose an animal-centered analysis method based on environmental imaging. This approach incorporates the sensitivity and acuity limits of individual species, arriving at predictions of photon catch relative to noise thresholds, contrast distributions, and the orientation cues nocturnal species can extract from visual scenes. This analysis relies on just a limited number of visual system parameters known for each species. By accounting for light-adaptation in our analysis, we are able to make more realistic predictions of the information animals can extract from nocturnal visual scenes under different levels of light pollution. With this analysis method, we aim to provide context for the interpretation of behavioral findings, and to allow researchers to generate specific hypotheses for the behavior of nocturnal animals in observed light-polluted scenes.

Connectomics: From form to function in butterfly colour vision

A recent study has revealed how the connectivity of neurons in the lamina of the Asian swallowtail butterfly forms the basis of this insect's exceptional colour vision through two circuit motifs: colour opponency of photoreceptors and broadband colour integration by lamina neurons.