1
|
Hazelaar ST, Wang C, de Wagter C, Muijres FT, de Croon GCHE, Yedutenko M. Bioinspired adaptive visual servoing control for quadrotors. BIOINSPIRATION & BIOMIMETICS 2025; 20:036014. [PMID: 40239692 DOI: 10.1088/1748-3190/adcdde] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/31/2024] [Accepted: 04/16/2025] [Indexed: 04/18/2025]
Abstract
Since every flight ends in a landing and every landing is a potential crash, deceleration during landing is one of the most critical flying maneuvers. Here we implement a recently-discovered insect visual-guided landing strategy in which the divergence of optical flow is regulated in a step-wise fashion onboard a quadrotor for the task of visual servoing. This approach was shown to be a powerful tool for understanding challenges encountered by visually-guided flying systems. We found that landing on a relatively small target requires mitigation of the noise with adaptive low-pass filtering, while compensation for the delays introduced by this filter requires open-loop forward accelerations to switch from divergence setpoint. Both implemented solutions are consistent with insect physiological properties. Our study evaluates the challenges of visual-based navigation for flying insects. It highlights the benefits and feasibility of the switching divergence strategy that allows for faster and safer landings in the context of robotics.
Collapse
Affiliation(s)
- Sander T Hazelaar
- Micro Air Laboratory, Faculty of Aerospace Engineering, Delft University of Technology, Delft, The Netherlands
| | - Chenyao Wang
- Experimental Zoology Group, Wageningen University, Wageningen, The Netherlands
| | - Christophe de Wagter
- Micro Air Laboratory, Faculty of Aerospace Engineering, Delft University of Technology, Delft, The Netherlands
| | - Florian T Muijres
- Experimental Zoology Group, Wageningen University, Wageningen, The Netherlands
| | - Guido C H E de Croon
- Micro Air Laboratory, Faculty of Aerospace Engineering, Delft University of Technology, Delft, The Netherlands
| | - Matthew Yedutenko
- Micro Air Laboratory, Faculty of Aerospace Engineering, Delft University of Technology, Delft, The Netherlands
| |
Collapse
|
2
|
Hyun NSP, Chan CM, Hernandez AM, Wood RJ. Sticking the landing: Insect-inspired strategies for safely landing flapping-wing aerial microrobots. Sci Robot 2025; 10:eadq3059. [PMID: 40238921 DOI: 10.1126/scirobotics.adq3059] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2024] [Accepted: 03/18/2025] [Indexed: 04/18/2025]
Abstract
For flying insects, the transition from flight to surface locomotion requires effective touchdown maneuvers that allow stable landings on a variety of surfaces. Landing behaviors of insects are diverse, with some using more controlled flight approaches to landing, whereas others dampen collision impacts with parts of their bodies. The landing approaches of real insects inspired our current work, where we present a combined mechanical and control approach to achieving safe and accurate landings for flapping-wing microaerial vehicles. For the mechanical approach to landing, we took inspiration from the legs of the crane fly, designing lossy compliant legs that maximize energy dissipation during surface collisions. We explored three features in the compliant leg design: leg stance, number of joints, and joint placement. For the control approach to landing, the challenge lies in overcoming the aerodynamic ground effect near the surface. Leveraging the compliant leg design during impact, we designed the preimpact behavior, drawing inspiration from insect landing trajectories, to increase landing success. The proposed controlled landing sequence includes an initial acceleration from hovering, followed by deceleration toward the target, ending with a nonzero impact velocity, similar to what is observed in insects. Last, using an insect-scale flapping-wing aerial microrobot platform (Harvard RoboBee), we verified the controlled, safe, and accurate landing on natural terrain.
Collapse
Affiliation(s)
- Nak-Seung P Hyun
- John A. Paulson School of Engineering and Applied Sciences, Harvard University, Massachusetts Hall, Cambridge, MA 02138, USA
- Elmore Family School of Electrical and Computer Engineering, Purdue University, 610 Purdue Mall, West Lafayette, IN 47907, USA
| | - Christian M Chan
- John A. Paulson School of Engineering and Applied Sciences, Harvard University, Massachusetts Hall, Cambridge, MA 02138, USA
| | - Alyssa M Hernandez
- John A. Paulson School of Engineering and Applied Sciences, Harvard University, Massachusetts Hall, Cambridge, MA 02138, USA
| | - Robert J Wood
- John A. Paulson School of Engineering and Applied Sciences, Harvard University, Massachusetts Hall, Cambridge, MA 02138, USA
| |
Collapse
|
3
|
de Vries LJ, van Langevelde F, van Leeuwen JL, Naguib M, Pieters RPM, Muijres FT. Follow the flower: approach-flight behaviour of bumblebees landing on a moving target. J Exp Biol 2025; 228:jeb249380. [PMID: 40019036 DOI: 10.1242/jeb.249380] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2024] [Accepted: 01/23/2025] [Indexed: 03/01/2025]
Abstract
While landing on flowers, pollinating insects often have to deal with flower movement caused by wind. Here, we determined the landing performance of bumblebees on a moving artificial flower and how bees use their visual-motor system to control their landings. To do this, we built an experimental setup containing a physical model of a flower, moving sideways using sinusoidal kinematics at various oscillation frequencies (up to 0.65 Hz, at constant amplitude of 5 cm). We filmed the landings of Bombus terrestris bumblebees on this moving flower model and extracted the flight kinematics and trajectories using deep neural network-based videography tracking. The bumblebees were capable of compensating for the detrimental effects of flower movement on landing performance for flower movement frequencies up to 0.53 Hz. Only at our maximum frequency of 0.65 Hz did the percentage of successful landings decrease but landing accuracy and duration were not affected. To successfully land on the moving flower, the bumblebees gradually slowed down, aimed towards the middle of the flower and aligned with its movement. Our results indicated that bumblebees use modular visual-motor control feedback to do this: (1) they slow down by maintaining an approximately constant average optic expansion of the approaching flower image; (2) they aim towards the flower by keeping the flower in the middle of their view; (3) they align to the flower movement by minimizing the sideways optic flow of the moving flower image. Our findings increase our understanding of how flying insects land on flowers moved by wind.
Collapse
Affiliation(s)
- Lana J de Vries
- Experimental Zoology Group, Wageningen University & Research, De Elst 1, 6708WD Wageningen, The Netherlands
- Wildlife Ecology and Conservation Group, Wageningen University & Research, Droevendaalsesteeg 3a, 6708PB Wageningen, The Netherlands
- Behavioural Ecology Group, Wageningen University & Research, De Elst 1, 6708WD Wageningen, The Netherlands
| | - Frank van Langevelde
- Wildlife Ecology and Conservation Group, Wageningen University & Research, Droevendaalsesteeg 3a, 6708PB Wageningen, The Netherlands
| | - Johan L van Leeuwen
- Experimental Zoology Group, Wageningen University & Research, De Elst 1, 6708WD Wageningen, The Netherlands
| | - Marc Naguib
- Behavioural Ecology Group, Wageningen University & Research, De Elst 1, 6708WD Wageningen, The Netherlands
| | - Remco P M Pieters
- Experimental Zoology Group, Wageningen University & Research, De Elst 1, 6708WD Wageningen, The Netherlands
| | - Florian T Muijres
- Experimental Zoology Group, Wageningen University & Research, De Elst 1, 6708WD Wageningen, The Netherlands
| |
Collapse
|
4
|
Zeng Y, Naing G, Lu V, Chen Y, Dudley R. Biomechanics and ontogeny of gliding in wingless stick insect nymphs (Extatosoma tiaratum). J Exp Biol 2024; 227:jeb247805. [PMID: 39670518 PMCID: PMC11698037 DOI: 10.1242/jeb.247805] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2024] [Accepted: 10/30/2024] [Indexed: 12/14/2024]
Abstract
Many wingless arboreal arthropods can glide back to tree trunks following free falls. However, little is known about the behaviors and aerodynamics underlying such aerial performance, and how this may be influenced by body size. Here, we studied gliding performance by nymphs of the stick insect Extatosoma tiaratum, focusing on the dynamics of J-shaped trajectories and how gliding capability changes during ontogeny. After being dropped 40 cm horizontally from a visual target, the first-instar nymphs landed on the target within 1.1 s. After reaching terminal speed (at ∼0.25 s), they initiated gliding with significant horizontal force, during which the overall lift-to-drag ratio increased from 0.16 to 0.48. This transition from parachuting to gliding is characterized by a damped oscillation in body pitch, initiated with a rapid nose-down pitching, and led to a higher-lift configuration with reduced body angle of attack. Among instars, increasing wing loading during ontogeny led to greater terminal speed, reduced agility during glide initiation and increased glide angle. Our study demonstrates that a sequence of controlled behaviors, from pre-glide descent to glide initiation and forward gliding, underlies their gliding aerodynamics, which in aggregate form the basis for J-shaped aerial trajectories. Selection for improved gliding performance in wingless arthropods may foster the evolution of more rapid maneuvers and of dedicated morphological traits (such as winglets) that contribute to an overall reduction in wing loading, either across ontogeny or during the evolution of larger body size.
Collapse
Affiliation(s)
- Yu Zeng
- Department of Integrative Biology, University of California, Berkeley, Berkeley, CA 94720, USA
- Department of Integrative Biology, University of South Florida, Tampa, FL 33620, USA
| | - Grisanu Naing
- Department of Earth and Planetary Science, University of California, Berkeley, Berkeley, CA 94720, USA
| | - Vivian Lu
- Department of Integrative Biology, University of California, Berkeley, Berkeley, CA 94720, USA
| | - Yuexiang Chen
- Department of Integrative Biology, University of California, Berkeley, Berkeley, CA 94720, USA
| | - Robert Dudley
- Department of Integrative Biology, University of California, Berkeley, Berkeley, CA 94720, USA
- Smithsonian Tropical Research Institute, Balboa, Republic of Panama
| |
Collapse
|
5
|
Xie Y, Li Z, Song L, Zhao J. A bio-inspired looming detection for stable landing in unmanned aerial vehicles . BIOINSPIRATION & BIOMIMETICS 2024; 20:016007. [PMID: 39481235 DOI: 10.1088/1748-3190/ad8d99] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/18/2024] [Accepted: 10/25/2024] [Indexed: 11/02/2024]
Abstract
Flying insects, such as flies and bees, have evolved the capability to rely solely on visual cues for smooth and secure landings on various surfaces. In the process of carrying out tasks, micro unmanned aerial vehicles (UAVs) may encounter various emergencies, and it is necessary to land safely in complex and unpredictable ground environments, especially when altitude information is not accurately obtained, which undoubtedly poses a significant challenge. Our study draws on the remarkable response mechanism of the Lobula Giant Movement Detector to looming scenarios to develop a novel UAV landing strategy. The proposed strategy does not require distance estimation, making it particularly suitable for payload-constrained micro aerial vehicles. Through a series of experiments, this strategy has proven to effectively achieve stable and high-performance landings in unknown and complex environments using only a monocular camera. Furthermore, a novel mechanism to trigger the final landing phase has been introduced, further ensuring the safe and stable touchdown of the drone.
Collapse
Affiliation(s)
- Yupeng Xie
- Guangxi Key Laboratory of Intelligent Control and Maintenance of Power Equipment, School of Electrical Engineering, Guangxi University, Nanning 530004, People's Republic of China
| | - Zhiteng Li
- Guangxi Key Laboratory of Intelligent Control and Maintenance of Power Equipment, School of Electrical Engineering, Guangxi University, Nanning 530004, People's Republic of China
| | - Linkun Song
- Guangxi Key Laboratory of Intelligent Control and Maintenance of Power Equipment, School of Electrical Engineering, Guangxi University, Nanning 530004, People's Republic of China
| | - Jiannan Zhao
- Guangxi Key Laboratory of Intelligent Control and Maintenance of Power Equipment, School of Electrical Engineering, Guangxi University, Nanning 530004, People's Republic of China
| |
Collapse
|
6
|
Goyal P, van Leeuwen JL, Muijres FT. Bumblebees compensate for the adverse effects of sidewind during visually guided landings. J Exp Biol 2024; 227:jeb245432. [PMID: 38506223 PMCID: PMC11112349 DOI: 10.1242/jeb.245432] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2022] [Accepted: 02/26/2024] [Indexed: 03/21/2024]
Abstract
Flying animals often encounter winds during visually guided landings. However, how winds affect their flight control strategy during landing is unknown. Here, we investigated how sidewind affects the landing performance and sensorimotor control of foraging bumblebees (Bombus terrestris). We trained bumblebees to forage in a wind tunnel, and used high-speed stereoscopic videography to record 19,421 landing maneuvers in six sidewind speeds (0 to 3.4 m s-1), which correspond to winds encountered in nature. Bumblebees landed less often in higher windspeeds, but the landing durations from free flight were not increased by wind. By testing how bumblebees adjusted their landing control to compensate for adverse effects of sidewind on landing, we showed that the landing strategy in sidewind resembled that in still air, but with important adaptations. Bumblebees landing in a sidewind tended to drift downwind, which they controlled for by performing more hover maneuvers. Surprisingly, the increased hover prevalence did not increase the duration of free-flight landing maneuvers, as these bumblebees flew faster towards the landing platform outside the hover phases. Hence, by alternating these two flight modes along their flight path, free-flying bumblebees negated the adverse effects of high windspeeds on landing duration. Using control theory, we hypothesize that bumblebees achieve this by integrating a combination of direct aerodynamic feedback and a wind-mediated mechanosensory feedback control, with their vision-based sensorimotor control loop. The revealed landing strategy may be commonly used by insects landing in windy conditions, and may inspire the development of landing control strategies onboard autonomously flying robots.
Collapse
Affiliation(s)
- Pulkit Goyal
- Experimental Zoology Group, Wageningen University and Research, 6708 WD Wageningen, The Netherlands
| | - Johan L. van Leeuwen
- Experimental Zoology Group, Wageningen University and Research, 6708 WD Wageningen, The Netherlands
| | - Florian T. Muijres
- Experimental Zoology Group, Wageningen University and Research, 6708 WD Wageningen, The Netherlands
| |
Collapse
|