Bio-inspired modeling and implementation of the ocelli visual system of flying insects

Bioinspired Perception and Navigation of Service Robots in Indoor Environments: A Review

Biological principles draw attention to service robotics because of similar concepts when robots operate various tasks. Bioinspired perception is significant for robotic perception, which is inspired by animals' awareness of the environment. This paper reviews the bioinspired perception and navigation of service robots in indoor environments, which are popular applications of civilian robotics. The navigation approaches are classified by perception type, including vision-based, remote sensing, tactile sensor, olfactory, sound-based, inertial, and multimodal navigation. The trend of state-of-art techniques is moving towards multimodal navigation to combine several approaches. The challenges in indoor navigation focus on precise localization and dynamic and complex environments with moving objects and people.

Accommodating unobservability to control flight attitude with optic flow

Attitude control is an essential flight capability. Whereas flying robots commonly rely on accelerometers¹ for estimating attitude, flying insects lack an unambiguous sense of gravity^2,3. Despite the established role of several sense organs in attitude stabilization^3-5, the dependence of flying insects on an internal gravity direction estimate remains unclear. Here we show how attitude can be extracted from optic flow when combined with a motion model that relates attitude to acceleration direction. Although there are conditions such as hover in which the attitude is unobservable, we prove that the ensuing control system is still stable, continuously moving into and out of these conditions. Flying robot experiments confirm that accommodating unobservability in this manner leads to stable, but slightly oscillatory, attitude control. Moreover, experiments with a bio-inspired flapping-wing robot show that residual, high-frequency attitude oscillations from flapping motion improve observability. The presented approach holds a promise for robotics, with accelerometer-less autopilots paving the road for insect-scale autonomous flying robots⁶. Finally, it forms a hypothesis on insect attitude estimation and control, with the potential to provide further insight into known biological phenomena^5,7,8 and to generate new predictions such as reduced head and body attitude variance at higher flight speeds⁹.

Insect-inspired vision for autonomous vehicles

Flying insects are being studied these days as if they were agile micro air vehicles fitted with smart sensors, requiring very few brain resources. The findings obtained on these natural fliers have proved to be extremely valuable when it comes to designing compact low-weight artificial optical sensors capable of performing visual processing tasks robustly under various environmental conditions (light, clouds, contrast). Here, we review some outstanding bio-inspired visual sensors, which can be used for either detecting motion in the visible spectrum or controlling celestial navigation in the ultraviolet spectrum and for attitude stabilisation purposes. Biologically inspired visual sensors do not have to comprise a very large number of pixels: they are able to perform both short and long range navigation tasks surprisingly well with just a few pixels and a weak resolution.

It's Not a Bug, It's a Feature: Functional Materials in Insects

Over the course of their wildly successful proliferation across the earth, the insects as a taxon have evolved enviable adaptations to their diverse habitats, which include adhesives, locomotor systems, hydrophobic surfaces, and sensors and actuators that transduce mechanical, acoustic, optical, thermal, and chemical signals. Insect-inspired designs currently appear in a range of contexts, including antireflective coatings, optical displays, and computing algorithms. However, as over one million distinct and highly specialized species of insects have colonized nearly all habitable regions on the planet, they still provide a largely untapped pool of unique problem-solving strategies. With the intent of providing materials scientists and engineers with a muse for the next generation of bioinspired materials, here, a selection of some of the most spectacular adaptations that insects have evolved is assembled and organized by function. The insects presented display dazzling optical properties as a result of natural photonic crystals, precise hierarchical patterns that span length scales from nanometers to millimeters, and formidable defense mechanisms that deploy an arsenal of chemical weaponry. Successful mimicry of these adaptations may facilitate technological solutions to as wide a range of problems as they solve in the insects that originated them.

Diversity and common themes in the organization of ocelli in Hymenoptera, Odonata and Diptera

We show in a comparative analysis that distinct retinal specializations in insect ocelli are much more common than previously realized and that the rhabdom organization of ocellar photoreceptors is extremely diverse. Hymenoptera, Odonata and Diptera show prominent equatorial fovea-like indentations of the ocellar retinae, where distal receptor endings are furthest removed from the lens surface and receptor densities are highest. In contrast, rhabdomere arrangements are very diverse across insect groups: in Hymenoptera, with some exceptions, pairs of ocellar retinular cells form sheet-like rhabdoms that form elongated rectangular shapes in cross-section, with highly aligned microvilli directions perpendicular to the long axis of cross-sections. This arrangement makes most ocellar retinular cells in Hymenoptera sensitive to the direction of polarized light. In dragonflies, triplets of retinular cells form a y-shaped fused rhabdom with microvilli directions oriented at 60° to each other. In Dipteran ocellar retinular cells microvilli directions are randomised, which destroys polarization sensitivity. We suggest that the differences in ocellar organization between insect groups may reflect the different head attitude control systems that have evolved in these insect groups, but possibly also differences in the mode of locomotion and in the need for celestial compass information.

An artificial elementary eye with optic flow detection and compositional properties

We describe a 2 mg artificial elementary eye whose structure and functionality is inspired by compound eye ommatidia. Its optical sensitivity and electronic architecture are sufficient to generate the required signals for the measurement of local optic flow vectors in multiple directions. Multiple elementary eyes can be assembled to create a compound vision system of desired shape and curvature spanning large fields of view. The system configurability is validated with the fabrication of a flexible linear array of artificial elementary eyes capable of extracting optic flow over multiple visual directions.

Aerodynamics, sensing and control of insect-scale flapping-wing flight

There are nearly a million known species of flying insects and 13 000 species of flying warm-blooded vertebrates, including mammals, birds and bats. While in flight, their wings not only move forward relative to the air, they also flap up and down, plunge and sweep, so that both lift and thrust can be generated and balanced, accommodate uncertain surrounding environment, with superior flight stability and dynamics with highly varied speeds and missions. As the size of a flyer is reduced, the wing-to-body mass ratio tends to decrease as well. Furthermore, these flyers use integrated system consisting of wings to generate aerodynamic forces, muscles to move the wings, and sensing and control systems to guide and manoeuvre. In this article, recent advances in insect-scale flapping-wing aerodynamics, flexible wing structures, unsteady flight environment, sensing, stability and control are reviewed with perspective offered. In particular, the special features of the low Reynolds number flyers associated with small sizes, thin and light structures, slow flight with comparable wind gust speeds, bioinspired fabrication of wing structures, neuron-based sensing and adaptive control are highlighted.

The ocelli of Archaeognatha (Hexapoda): Functional morphology, pigment migration and chemical nature of the reflective tapetum

The ocelli of Archaeognatha, or jumping bristletails, differ from typical insect ocelli in shape and field of view. While the shape of the lateral ocelli is highly variable among species, most Machiloidea have sole shaped lateral ocelli beneath the compound eyes and a median ocellus that is oriented downward. This study investigated morphological and physiological aspects of the ocelli of Machilis hrabei and Lepismachilis spp.

The light reflecting ocellar tapetum in Machilis hrabei is made up by xanthine nanocrystals, as demonstrated by confocal Raman spectroscopy. Pigment granules in the photoreceptor cells move behind the tapetum in the dark adapted state. Such a vertical pigment migration in combination with a tapetum has not been described for any insect ocellus so far. The pigment migration has a dynamic range of around 4 log units and is maximally sensitive to green light. Adaptation from darkness to bright light lasts over an hour, which is slow compared to the radial pupil mechanism in some dragonflies and locusts.