1
|
Ulrich J, Stefanec M, Rekabi-Bana F, Fedotoff LA, Rouček T, Gündeğer BY, Saadat M, Blaha J, Janota J, Hofstadler DN, Žampachů K, Keyvan EE, Erdem B, Şahin E, Alemdar H, Turgut AE, Arvin F, Schmickl T, Krajník T. Autonomous tracking of honey bee behaviors over long-term periods with cooperating robots. Sci Robot 2024; 9:eadn6848. [PMID: 39413166 DOI: 10.1126/scirobotics.adn6848] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2023] [Accepted: 09/23/2024] [Indexed: 10/18/2024]
Abstract
Digital and mechatronic methods, paired with artificial intelligence and machine learning, are transformative technologies in behavioral science and biology. The central element of the most important pollinator species-honey bees-is the colony's queen. Because honey bee self-regulation is complex and studying queens in their natural colony context is difficult, the behavioral strategies of these organisms have not been widely studied. We created an autonomous robotic observation and behavioral analysis system aimed at continuous observation of the queen and her interactions with worker bees and comb cells, generating behavioral datasets of exceptional length and quality. Key behavioral metrics of the queen and her social embedding within the colony were gathered using our robotic system. Data were collected continuously for 24 hours a day over a period of 30 days, demonstrating our system's capability to extract key behavioral metrics at microscopic, mesoscopic, and macroscopic system levels. Additionally, interactions among the queen, worker bees, and brood were observed and quantified. Long-term continuous observations performed by the robot yielded large amounts of high-definition video data that are beyond the observation capabilities of humans or stationary cameras. Our robotic system can enable a deeper understanding of the innermost mechanisms of honey bees' swarm-intelligent self-regulation. Moreover, it offers the possibility to study other social insect colonies, biocoenoses, and ecosystems in an automated manner. Social insects are keystone species in all terrestrial ecosystems; thus, developing a better understanding of their behaviors will be invaluable for the protection and even the restoration of our fragile ecosystems globally.
Collapse
Affiliation(s)
- Jiří Ulrich
- Artificial Intelligence Centre, Faculty of Electrical Engineering, Czech Technical University, Prague, Czechia
| | - Martin Stefanec
- Artificial Life Lab, Department of Zoology, Institute of Biology, University of Graz, Graz, Austria
| | - Fatemeh Rekabi-Bana
- Swarm & Computation Intelligence Lab (SwaCIL), Department of Computer Science, Durham University, Durham, UK
| | | | - Tomáš Rouček
- Artificial Intelligence Centre, Faculty of Electrical Engineering, Czech Technical University, Prague, Czechia
| | - Bilal Yağız Gündeğer
- Computer Engineering Department, Middle East Technical University, Ankara, Türkiye
| | - Mahmood Saadat
- Swarm & Computation Intelligence Lab (SwaCIL), Department of Computer Science, Durham University, Durham, UK
| | - Jan Blaha
- Artificial Intelligence Centre, Faculty of Electrical Engineering, Czech Technical University, Prague, Czechia
| | - Jiří Janota
- Artificial Intelligence Centre, Faculty of Electrical Engineering, Czech Technical University, Prague, Czechia
| | | | - Kristina Žampachů
- Artificial Intelligence Centre, Faculty of Electrical Engineering, Czech Technical University, Prague, Czechia
| | - Erhan Ege Keyvan
- Center for Robotics and Artificial Intelligence (ROMER), Middle East Technical University, Ankara, Türkiye
| | - Babür Erdem
- Center for Robotics and Artificial Intelligence (ROMER), Middle East Technical University, Ankara, Türkiye
| | - Erol Şahin
- Computer Engineering Department, Middle East Technical University, Ankara, Türkiye
| | - Hande Alemdar
- Computer Engineering Department, Middle East Technical University, Ankara, Türkiye
| | - Ali Emre Turgut
- Mechanical Engineering Department, Middle East Technical University, Ankara, Türkiye
| | - Farshad Arvin
- Swarm & Computation Intelligence Lab (SwaCIL), Department of Computer Science, Durham University, Durham, UK
| | - Thomas Schmickl
- Artificial Life Lab, Department of Zoology, Institute of Biology, University of Graz, Graz, Austria
| | - Tomáš Krajník
- Artificial Intelligence Centre, Faculty of Electrical Engineering, Czech Technical University, Prague, Czechia
| |
Collapse
|
2
|
Romano D, Benelli G, Stefanini C. How aggressive interactions with biomimetic agents optimize reproductive performances in mass-reared males of the Mediterranean fruit fly. BIOLOGICAL CYBERNETICS 2023:10.1007/s00422-023-00965-w. [PMID: 37256317 DOI: 10.1007/s00422-023-00965-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Subscribe] [Scholar Register] [Received: 09/23/2022] [Accepted: 05/01/2023] [Indexed: 06/01/2023]
Abstract
Mass-rearing procedures of insect species, often used in biological control and Sterile Insect Technique, can reduce the insects competitiveness in foraging, dispersal, and mating. The evocation of certain behaviours responsible to induce specific neuroendocrine products may restore or improve the competitiveness of mass-reared individuals. Herein, we used a mass-reared strain of Ceratitis capitata as model organism. C. capitata is a polyphagous pest exhibiting territorial displays that are closely related to its reproductive performance. We tested if the behaviour of C. capitata males could be altered by hybrid aggressive interactions with a conspecific-mimicking robotic fly, leading to more competitive individuals in subsequent mating events. Aggressive interactions with the robotic fly had a notable effect on subsequent courtship and mating sequences of males that performed longer courtship displays compared to naïve individuals. Furthermore, previous interactions with the robotic fly produced a higher mating success of males. Reproductive performances of C. capitata males may be improved by specific octopaminergic neurones activated during previous aggressive interactions with the robotic fly. This study adds fundamental knowledge on the potential role of specific neuro-behavioural processes in the ecology of tephritid species and paves the way to innovative biotechnological control methods based on robotics and bionics.
Collapse
Affiliation(s)
- Donato Romano
- The BioRobotics Institute, Sant'Anna School of Advanced Studies, Viale Rinaldo Piaggio 34, 56025, Pontedera, Pisa, Italy.
- Department of Excellence in Robotics and AI, Sant'Anna School of Advanced Studies, 56127, Pisa, Italy.
| | - Giovanni Benelli
- Department of Agriculture, Food and Environment, University of Pisa, Via del Borghetto 80, 56124, Pisa, Italy
| | - Cesare Stefanini
- The BioRobotics Institute, Sant'Anna School of Advanced Studies, Viale Rinaldo Piaggio 34, 56025, Pontedera, Pisa, Italy
- Department of Excellence in Robotics and AI, Sant'Anna School of Advanced Studies, 56127, Pisa, Italy
| |
Collapse
|
3
|
Design and control of soft biomimetic pangasius fish robot using fin ray effect and reinforcement learning. Sci Rep 2022; 12:21861. [PMID: 36529776 PMCID: PMC9760642 DOI: 10.1038/s41598-022-26179-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2022] [Accepted: 12/12/2022] [Indexed: 12/23/2022] Open
Abstract
Soft robots provide a pathway to accurately mimic biological creatures and be integrated into their environment with minimal invasion or disruption to their ecosystem. These robots made from soft deforming materials possess structural properties and behaviors similar to the bodies and organs of living creatures. However, they are difficult to develop in terms of integrated actuation and sensing, accurate modeling, and precise control. This article presents a soft-rigid hybrid robotic fish inspired by the Pangasius fish. The robot employs a flexible fin ray tail structure driven by a servo motor, to act as the soft body of the robot and provide the undulatory motion to the caudal fin of the fish. To address the modeling and control challenges, reinforcement learning (RL) is proposed as a model-free control strategy for the robot fish to swim and reach a specified target goal. By training and investigating the RL through experiments on real hardware, we illustrate the capability of the fish to learn and achieve the required task.
Collapse
|
4
|
Zhou Z, Mei H, Li R, Wang C, Fang K, Wang W, Tang Y, Dai Z. Progresses of animal robots: A historical review and perspectiveness. Heliyon 2022; 8:e11499. [PMID: 36411898 PMCID: PMC9674511 DOI: 10.1016/j.heliyon.2022.e11499] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2022] [Revised: 08/12/2022] [Accepted: 11/01/2022] [Indexed: 11/13/2022] Open
Abstract
Animal robots have remarkable advantages over traditional mechatronic ones in terms of energy supply, self-orientation, and natural concealment and can provide remarkable theoretical and practical values for scientific investigation, community service, military detection and other fields. Given these features, animal robots have become high-profile research objects and have recently attracted extensive attention. Herein, we have defined animal robots, reviewed the main types of animal robots, and discussed the potential developing directions. We have also detailed the mechanisms underlying the regulation of animal robots and introduced key methods for manipulating them. We have further proposed several application prospects for different types of animal robots. Finally, we have presented research directions for their further improvement.
Collapse
Affiliation(s)
- Zhengyue Zhou
- Institute of Bio-inspired Structure and Surface Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, Jiangsu, China
| | - Hao Mei
- Institute of Bio-inspired Structure and Surface Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, Jiangsu, China
| | - Rongxun Li
- Institute of Bio-inspired Structure and Surface Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, Jiangsu, China
| | - Chenyuan Wang
- Institute of Bio-inspired Structure and Surface Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, Jiangsu, China
| | - Ke Fang
- Institute of Bio-inspired Structure and Surface Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, Jiangsu, China
| | - Wenbo Wang
- Institute of Bio-inspired Structure and Surface Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, Jiangsu, China
| | - Yezhong Tang
- Institute of Bio-inspired Structure and Surface Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, Jiangsu, China
- Chengdu Institute of Biology, Chinese Academy of Sciences. No.9 Section 4, Renmin Nan Road, 610041, Chengdu, Sichuan, China
| | - Zhendong Dai
- Institute of Bio-inspired Structure and Surface Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, Jiangsu, China
| |
Collapse
|
5
|
Rajewicz W, Romano D, Varughese JC, Vuuren GJV, Campo A, Thenius R, Schmickl T. Freshwater organisms potentially useful as biosensors and power-generation mediators in biohybrid robotics. BIOLOGICAL CYBERNETICS 2021; 115:615-628. [PMID: 34812929 PMCID: PMC8642376 DOI: 10.1007/s00422-021-00902-9] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/31/2021] [Accepted: 09/29/2021] [Indexed: 06/13/2023]
Abstract
Facing the threat of rapidly worsening water quality, there is an urgent need to develop novel approaches of monitoring its global supplies and early detection of environmental fluctuations. Global warming, urban growth and other factors have threatened not only the freshwater supply but also the well-being of many species inhabiting it. Traditionally, laboratory-based studies can be both time and money consuming and so, the development of a real-time, continuous monitoring method has proven necessary. The use of autonomous, self-actualizing entities became an efficient way of monitoring the environment. The Microbial Fuel Cells (MFC) will be investigated as an alternative energy source to allow for these entities to self-actualize. This concept has been improved with the use of various lifeforms in the role of biosensors in a structure called "biohybrid" which we aim to develop further within the framework of project Robocoenosis relying on animal-robot interaction. We introduce a novel concept of a fully autonomous biohybrid agent with various lifeforms in the role of biosensors. Herein, we identify most promising organisms in the context of underwater robotics, among others Dreissena polymorpha, Anodonta cygnaea, Daphnia sp. and various algae. Special focus is placed on the "ecosystem hacking" based on their interaction with the electronic parts. This project uses Austrian lakes of various trophic levels (Millstättersee, Hallstättersee and Neusiedlersee) as case studies and as a "proof of concept".
Collapse
Affiliation(s)
- Wiktoria Rajewicz
- 649 Institute of Biology, Graz, 8010, Austria.
- University of Graz, Graz, Austria.
| | - Donato Romano
- The BioRobotics Institute, Sant'Anna School of Advanced Studies, Viale Rinaldo Piaggio 34, Pontedera, Pisa, 56025, Italy
- Department of Excellence in Robotics and AI, Sant'Anna School of Advanced Studies, Pisa, 56127, Italy
| | | | | | - Alexandre Campo
- Unit of Social Ecology, Universit é Libre de Bruxelles, Campus Plaine, Boulevard duTriomphe, CP 231, 1050, Bruxelles, Belgium
| | | | | |
Collapse
|