1
|
Connor J, Joordens M, Champion B. Fish-inspired robotic algorithm: mimicking behaviour and communication of schooling fish. BIOINSPIRATION & BIOMIMETICS 2023; 18:066007. [PMID: 37714177 DOI: 10.1088/1748-3190/acfa52] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/02/2023] [Accepted: 09/15/2023] [Indexed: 09/17/2023]
Abstract
This study aims to present a novel flocking algorithm for robotic fish that will aid the study of fish in their natural environment. The algorithm, fish-inspired robotic algorithm (FIRA), amalgamates the standard flocking behaviors of attraction, alignment, and repulsion, together with predator avoidance, foraging, general obstacle avoidance, and wandering. The novelty of the FIRA algorithm is the combination of predictive elements to counteract processing delays from sensors and the addition of memory. Furthermore, FIRA is specifically designed to work with an indirect communication method that leads to superior performance in collision avoidance, exploration, foraging, and the emergence of realistic behaviors. By leveraging a high-latency, non-guaranteed communication methodology inspired by stigmergy methods inherent in nature, FIRA successfully addresses some of the obstacles associated with underwater communication. This breakthrough enables the realization of inexpensive, multi-agent swarms while concurrently harnessing the advantages of tetherless communication. FIRA provides a computational light control algorithm for further research with low-cost, low-computing agents. Eventually, FIRA will be used to assimilate robots into a school of biological fish, to study or influence the school. This study endeavors to demonstrate the effectiveness of FIRA by simulating it using a digital twin of a bio-inspired robotic fish. The simulation incorporates the robot's motion and sensors in a realistic, real-time environment with the algorithm used to direct the movements of individual agents. The performance of FIRA was tested against other collective flocking algorithms to determine its effectiveness. From the experiments, it was determined that FIRA outperformed the other algorithms in both collision avoidance and exploration. These experiments establish FIRA as a viable flocking algorithm to mimic fish behavior in robotics.
Collapse
Affiliation(s)
- Jack Connor
- School of Engineering, Deakin University, Geelong, Victoria 3216, Australia
| | - Matthew Joordens
- School of Engineering, Deakin University, Geelong, Victoria 3216, Australia
| | - Benjamin Champion
- School of Engineering, Deakin University, Geelong, Victoria 3216, Australia
| |
Collapse
|
2
|
Brown AA, Brown MF, Folk SR, Utter BA. Archerfish respond to a hunting robotic conspecific. BIOLOGICAL CYBERNETICS 2021; 115:585-598. [PMID: 34272968 DOI: 10.1007/s00422-021-00885-7] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/02/2021] [Accepted: 07/06/2021] [Indexed: 06/13/2023]
Abstract
While the unique hunting behavior of archerfish has received considerable scientific attention, the specific social cues that govern behaviors like intraspecific kleptoparasitism in the species are less understood. This paper asks whether the use of a robotic facsimile representing an archerfish can elicit a social response if it approximates an archerfish's appearance, along with key features of its hunting behavior. We found that the fish respond to the robot when it hunted, as indicated by decreasing distances between the robot and fish (and among the fish) during the robot's hunting behavior sequence, as well as higher net transfer entropy when the robot was hunting. These effects were present even when the robot's "hunt" was unproductive and did not result in food. The temporal pattern of fish approach to the robot and each other indicated that the segment of robot hunting behavior proximal to the robotic facsimile shot elicited fish behavior initially. However, earlier cues in the robot's hunting sequence became important following more experience with a food contingency. This indicates that further studies could use a robotic facsimile to conduct a detailed stimulus analysis, changing aspects of the robot's appearance and behavior to uncover the basic mechanisms of information transfer among individuals in a social hunting scenario.
Collapse
Affiliation(s)
- Alexander A Brown
- Department of Mechanical Engineering, Lafayette College, Easton, PA, USA.
| | - Michael F Brown
- Department of Psychological and Brain Sciences, Villanova University, Villanova, PA, USA
| | - Spencer R Folk
- Department of Mechanical Engineering, Lafayette College, Easton, PA, USA
| | - Brent A Utter
- Department of Mechanical Engineering, Lafayette College, Easton, PA, USA
| |
Collapse
|
3
|
DeLellis P, Cadolini E, Croce A, Yang Y, di Bernardo M, Porfiri M. Model-based feedback control of live zebrafish behavior via interaction with a robotic replica. IEEE T ROBOT 2021; 36:28-41. [PMID: 33746643 DOI: 10.1109/tro.2019.2943066] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
The possibility of regulating the behavior of live animals using biologically-inspired robots has attracted the interest of biologists and engineers for over twenty-five years. From early work on insects to recent endeavors on mammals, we have witnessed fascinating applications that have pushed forward our understanding of animal behavior along new directions. Despite significant progress, most of the research has focused on open-loop control systems, in which robots execute predetermined actions, independent of the animal behavior. We integrate mathematical modeling of social behavior toward the design of realistic feedback laws for robots to interact with a live animal. In particular, we leverage recent advancements in data-driven modeling of zebrafish behavior. Ultimately, we establish a novel robotic platform that allows real-time actuation of a biologically-inspired 3D-printed zebrafish replica to implement model-based control of animal behavior. We demonstrate our approach through a series of experiments, designed to elucidate the appraisal of the replica by live subjects with respect to conspecifics and to quantify the biological value of closed-loop control.
Collapse
Affiliation(s)
- Pietro DeLellis
- Department of Electrical Electrical Engineering and Information Technology, University of Naples Federico II. Department of Mechanical and Aerospace Engineering, New York University Tandon School of Engineering
| | - Edoardo Cadolini
- Department of Electrical Electrical Engineering and Information Technology, University of Naples Federico II. Department of Mechanical and Aerospace Engineering, New York University Tandon School of Engineering
| | - Arrigo Croce
- Department of Electrical Electrical Engineering and Information Technology, University of Naples Federico II. Department of Mechanical and Aerospace Engineering, New York University Tandon School of Engineering
| | - Yanpeng Yang
- Department of Mechanical and Aerospace Engineering, New York University Tandon School of Engineering. Key Laboratory of Mechanism Theory and Equipment Design of Ministry of Education, School of Mechanical Engineering, Tianjin University, Tianjin, China
| | - Mario di Bernardo
- Department of Electrical Electrical Engineering and Information Technology, University of Naples Federico II. Department of Engineering Mathematics of the University of Bristol, U.K
| | - Maurizio Porfiri
- Department of Mechanical and Aerospace Engineering, New York University Tandon School of Engineering. Department of Biomedical Engineering, New York University Tandon School of Engineering
| |
Collapse
|
4
|
Chemtob Y, Cazenille L, Bonnet F, Gribovskiy A, Mondada F, Halloy J. Strategies to modulate zebrafish collective dynamics with a closed-loop biomimetic robotic system. BIOINSPIRATION & BIOMIMETICS 2020; 15:046004. [PMID: 32252047 DOI: 10.1088/1748-3190/ab8706] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
The objective of this study is to integrate biomimetic robots into small groups of zebrafish and to modulate their collective behaviours. A possible approach is to have the robots behave like sheepdogs. In this case, the robots would behave like a different species than the fish and would present different relevant behaviours. In this study, we explore different strategies that use biomimetic zebrafish behaviours. In past work, we have shown that robots biomimicking zebrafish can be socially integrated into zebrafish groups. We have also shown that a fish-like robot can modulate the rotation choice of zebrafish groups in a circular set-up. Here, we further study the modulation capabilities of such robots in a more complex set-up. To do this, we exploit zebrafish social behaviours we identified in previous studies. We first modulate collective departure by replicating the leadership mechanisms with the robot in a set-up composed of two rooms connected by a corridor. Then, we test different behavioural strategies to drive the fish groups towards a predefined target room. To drive the biohybrid groups towards a predefined choice, they have to adopt some specific fish-like behaviours. The first strategy is based on a single robot using the initiation behaviour. In this case, the robot keeps trying to initiate a group transition towards the target room. The second strategy is based on two robots, one initiating and one staying in the target room as a social attractant. The third strategy is based on a single robot behaving like a zebrafish but staying in the target room as a social attractant. The fourth strategy uses two robots behaving like zebrafish but staying in the target room. We conclude that robots can modulate zebrafish group behaviour by adopting strategies based on existing fish behaviours. Under these conditions, robots enable the testing of hypotheses about the behaviours of fish.
Collapse
Affiliation(s)
- Yohann Chemtob
- Univ Paris Diderot, Sorbonne Paris Cité, LIED, UMR 8236, 75013, Paris, France
| | | | | | | | | | | |
Collapse
|
5
|
Bierbach D, Mönck HJ, Lukas J, Habedank M, Romanczuk P, Landgraf T, Krause J. Guppies Prefer to Follow Large (Robot) Leaders Irrespective of Own Size. Front Bioeng Biotechnol 2020; 8:441. [PMID: 32500065 PMCID: PMC7243707 DOI: 10.3389/fbioe.2020.00441] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2020] [Accepted: 04/16/2020] [Indexed: 11/13/2022] Open
Abstract
Body size is often assumed to determine how successfully an individual can lead others with larger individuals being better leaders than smaller ones. But even if larger individuals are more readily followed, body size often correlates with specific behavioral patterns and it is thus unclear whether larger individuals are more often followed than smaller ones because of their size or because they behave in a certain way. To control for behavioral differences among differentially-sized leaders, we used biomimetic robotic fish (Robofish) of different sizes. Live guppies (Poecilia reticulata) are known to interact with Robofish in a similar way as with live conspecifics. Consequently, Robofish may serve as a conspecific-like leader that provides standardized behaviors irrespective of its size. We asked whether larger Robofish leaders are preferentially followed and whether the preferences of followers depend on own body size or risk-taking behavior ("boldness"). We found that live female guppies followed larger Robofish leaders in closer proximity than smaller ones and this pattern was independent of the followers' own body size as well as risk-taking behavior. Our study shows a "bigger is better" pattern in leadership that is independent of behavioral differences among differentially-sized leaders, followers' own size and risk-taking behavior.
Collapse
Affiliation(s)
- David Bierbach
- Faculty of Life Sciences, Thaer Institute, Humboldt-Universität zu Berlin, Berlin, Germany
- Excellence Cluster ‘Science of Intelligence’, Technische Universität Berlin, Berlin, Germany
- Department of Biology and Ecology of Fishes, Leibniz-Institute of Freshwater Ecology and Inland Fisheries, Berlin, Germany
| | - Hauke J. Mönck
- Department of Mathematics and Computer Science, Institute for Computer Science, Freie Universität Berlin, Berlin, Germany
| | - Juliane Lukas
- Faculty of Life Sciences, Thaer Institute, Humboldt-Universität zu Berlin, Berlin, Germany
- Department of Biology and Ecology of Fishes, Leibniz-Institute of Freshwater Ecology and Inland Fisheries, Berlin, Germany
| | - Marie Habedank
- Faculty of Life Sciences, Thaer Institute, Humboldt-Universität zu Berlin, Berlin, Germany
- Department of Biology and Ecology of Fishes, Leibniz-Institute of Freshwater Ecology and Inland Fisheries, Berlin, Germany
| | - Pawel Romanczuk
- Excellence Cluster ‘Science of Intelligence’, Technische Universität Berlin, Berlin, Germany
- Department of Biology, Institute for Theoretical Biology, Humboldt-Universität zu Berlin, Berlin, Germany
- Bernstein Center for Computational Neuroscience, Humboldt-Universität zu Berlin, Berlin, Germany
| | - Tim Landgraf
- Excellence Cluster ‘Science of Intelligence’, Technische Universität Berlin, Berlin, Germany
- Department of Mathematics and Computer Science, Institute for Computer Science, Freie Universität Berlin, Berlin, Germany
| | - Jens Krause
- Faculty of Life Sciences, Thaer Institute, Humboldt-Universität zu Berlin, Berlin, Germany
- Excellence Cluster ‘Science of Intelligence’, Technische Universität Berlin, Berlin, Germany
- Department of Biology and Ecology of Fishes, Leibniz-Institute of Freshwater Ecology and Inland Fisheries, Berlin, Germany
| |
Collapse
|
6
|
Heinrich MK, von Mammen S, Hofstadler DN, Wahby M, Zahadat P, Skrzypczak T, Soorati MD, Krela R, Kwiatkowski W, Schmickl T, Ayres P, Stoy K, Hamann H. Constructing living buildings: a review of relevant technologies for a novel application of biohybrid robotics. J R Soc Interface 2019; 16:20190238. [PMID: 31362616 PMCID: PMC6685033 DOI: 10.1098/rsif.2019.0238] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2019] [Accepted: 07/02/2019] [Indexed: 12/22/2022] Open
Abstract
Biohybrid robotics takes an engineering approach to the expansion and exploitation of biological behaviours for application to automated tasks. Here, we identify the construction of living buildings and infrastructure as a high-potential application domain for biohybrid robotics, and review technological advances relevant to its future development. Construction, civil infrastructure maintenance and building occupancy in the last decades have comprised a major portion of economic production, energy consumption and carbon emissions. Integrating biological organisms into automated construction tasks and permanent building components therefore has high potential for impact. Live materials can provide several advantages over standard synthetic construction materials, including self-repair of damage, increase rather than degradation of structural performance over time, resilience to corrosive environments, support of biodiversity, and mitigation of urban heat islands. Here, we review relevant technologies, which are currently disparate. They span robotics, self-organizing systems, artificial life, construction automation, structural engineering, architecture, bioengineering, biomaterials, and molecular and cellular biology. In these disciplines, developments relevant to biohybrid construction and living buildings are in the early stages, and typically are not exchanged between disciplines. We, therefore, consider this review useful to the future development of biohybrid engineering for this highly interdisciplinary application.
Collapse
Affiliation(s)
- Mary Katherine Heinrich
- Institute of Computer Engineering, University of Lübeck, Lübeck, Germany
- School of Architecture, Centre for IT and Architecture, Royal Danish Academy, Copenhagen, Denmark
| | - Sebastian von Mammen
- Human–Computer Interaction, Julius Maximilian University of Würzburg, Würzburg, Germany
| | | | - Mostafa Wahby
- Institute of Computer Engineering, University of Lübeck, Lübeck, Germany
| | - Payam Zahadat
- Institute of Biology, Artificial Life Lab, University of Graz, Graz, Austria
- Department of Computer Science, IT University of Copenhagen, Kobenhavn, Denmark
| | - Tomasz Skrzypczak
- Department of Molecular and Cellular Biology, Adam Mickiewicz University, Poznan, Poland
| | | | - Rafał Krela
- Department of Molecular and Cellular Biology, Adam Mickiewicz University, Poznan, Poland
| | - Wojciech Kwiatkowski
- Department of Molecular and Cellular Biology, Adam Mickiewicz University, Poznan, Poland
| | - Thomas Schmickl
- Institute of Biology, Artificial Life Lab, University of Graz, Graz, Austria
| | - Phil Ayres
- School of Architecture, Centre for IT and Architecture, Royal Danish Academy, Copenhagen, Denmark
| | - Kasper Stoy
- Department of Computer Science, IT University of Copenhagen, Kobenhavn, Denmark
| | - Heiko Hamann
- Institute of Computer Engineering, University of Lübeck, Lübeck, Germany
| |
Collapse
|
7
|
Romano D, Donati E, Benelli G, Stefanini C. A review on animal-robot interaction: from bio-hybrid organisms to mixed societies. BIOLOGICAL CYBERNETICS 2019; 113:201-225. [PMID: 30430234 DOI: 10.1007/s00422-018-0787-5] [Citation(s) in RCA: 75] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/25/2017] [Accepted: 10/19/2018] [Indexed: 05/28/2023]
Abstract
Living organisms are far superior to state-of-the-art robots as they have evolved a wide number of capabilities that far encompass our most advanced technologies. The merging of biological and artificial world, both physically and cognitively, represents a new trend in robotics that provides promising prospects to revolutionize the paradigms of conventional bio-inspired design as well as biological research. In this review, a comprehensive definition of animal-robot interactive technologies is given. They can be at animal level, by augmenting physical or mental capabilities through an integrated technology, or at group level, in which real animals interact with robotic conspecifics. Furthermore, an overview of the current state of the art and the recent trends in this novel context is provided. Bio-hybrid organisms represent a promising research area allowing us to understand how a biological apparatus (e.g. muscular and/or neural) works, thanks to the interaction with the integrated technologies. Furthermore, by using artificial agents, it is possible to shed light on social behaviours characterizing mixed societies. The robots can be used to manipulate groups of living organisms to understand self-organization and the evolution of cooperative behaviour and communication.
Collapse
Affiliation(s)
- Donato Romano
- The BioRobotics Institute, Sant'Anna School of Advanced Studies, Viale Rinaldo Piaggio 34, 56025, Pontedera, PI, Italy.
| | - Elisa Donati
- The Institute of Neuroinformatics, University of Zurich/ETH, Winterthurerstrasse 190, 8057, Zurich, Switzerland
| | - Giovanni Benelli
- The BioRobotics Institute, Sant'Anna School of Advanced Studies, Viale Rinaldo Piaggio 34, 56025, Pontedera, PI, Italy
- Department of Agriculture, Food and Environment, University of Pisa, Via del Borghetto 80, 56124, Pisa, Italy
| | - Cesare Stefanini
- The BioRobotics Institute, Sant'Anna School of Advanced Studies, Viale Rinaldo Piaggio 34, 56025, Pontedera, PI, Italy
- HEIC Center, BME Department, Khalifa University, PO Box 127788, Abu Dhabi, UAE
| |
Collapse
|
8
|
Bierbach D, Landgraf T, Romanczuk P, Lukas J, Nguyen H, Wolf M, Krause J. Using a robotic fish to investigate individual differences in social responsiveness in the guppy. ROYAL SOCIETY OPEN SCIENCE 2018; 5:181026. [PMID: 30225087 PMCID: PMC6124066 DOI: 10.1098/rsos.181026] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/27/2018] [Accepted: 07/06/2018] [Indexed: 05/19/2023]
Abstract
Responding towards the actions of others is one of the most important behavioural traits whenever animals of the same species interact. Mutual influences among interacting individuals may modulate the social responsiveness seen and thus make it often difficult to study the level and individual variation in responsiveness. Here, open-loop biomimetic robots that provide standardized, non-interactive social cues can be a useful tool. These robots are not affected by the live animal's actions but are assumed to still represent valuable and biologically relevant social cues. As this assumption is crucial for the use of biomimetic robots in behavioural studies, we hypothesized (i) that meaningful social interactions can be assumed if live animals maintain individual differences in responsiveness when interacting with both a biomimetic robot and a live partner. Furthermore, to study the level of individual variation in social responsiveness, we hypothesized (ii) that individual differences should be maintained over the course of multiple tests with the robot. We investigated the response of live guppies (Poecilia reticulata) when allowed to interact either with a biomimetic open-loop-controlled fish robot-'Robofish'-or with a live companion. Furthermore, we investigated the responses of live guppies when tested three times with Robofish. We found that responses of live guppies towards Robofish were weaker compared with those of a live companion, most likely as a result of the non-interactive open-loop behaviour of Robofish. Guppies, however, were consistent in their individual responses between a live companion and Robofish, and similar individual differences in response towards Robofish were maintained over repeated testing even though habituation to the test environment was detectable. Biomimetic robots like Robofish are therefore a useful tool for the study of social responsiveness in guppies and possibly other small fish species.
Collapse
Affiliation(s)
- David Bierbach
- Leibniz-Institute of Freshwater Ecology and Inland Fisheries, Müggelseedamm 310, 12587 Berlin, Germany
| | - Tim Landgraf
- Department of Mathematics and Computer Science, Freie Universität Berlin, Institute for Computer Science, Arnimallee 7, 14195 Berlin, Germany
| | - Pawel Romanczuk
- Faculty of Life Sciences, Humboldt University of Berlin, Thaer Institute, Hinter d. Reinhardtstr. 8-18, Berlin, Germany
- Department of Biology, Institute for Theoretical Biology, Humboldt Universität zu Berlin, Philippstr. 13, 10115 Berlin, Germany
- Bernstein Center for Computational Neuroscience, Humboldt Universität zu Berlin, Philippstr. 13, 10115 Berlin, Germany
| | - Juliane Lukas
- Leibniz-Institute of Freshwater Ecology and Inland Fisheries, Müggelseedamm 310, 12587 Berlin, Germany
- Faculty of Life Sciences, Humboldt University of Berlin, Thaer Institute, Hinter d. Reinhardtstr. 8-18, Berlin, Germany
| | - Hai Nguyen
- Leibniz-Institute of Freshwater Ecology and Inland Fisheries, Müggelseedamm 310, 12587 Berlin, Germany
| | - Max Wolf
- Leibniz-Institute of Freshwater Ecology and Inland Fisheries, Müggelseedamm 310, 12587 Berlin, Germany
| | - Jens Krause
- Leibniz-Institute of Freshwater Ecology and Inland Fisheries, Müggelseedamm 310, 12587 Berlin, Germany
- Faculty of Life Sciences, Humboldt University of Berlin, Thaer Institute, Hinter d. Reinhardtstr. 8-18, Berlin, Germany
| |
Collapse
|
9
|
Worm M, Landgraf T, Prume J, Nguyen H, Kirschbaum F, von der Emde G. Evidence for mutual allocation of social attention through interactive signaling in a mormyrid weakly electric fish. Proc Natl Acad Sci U S A 2018; 115:6852-6857. [PMID: 29891707 PMCID: PMC6042124 DOI: 10.1073/pnas.1801283115] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
Mormyrid weakly electric fish produce electric organ discharges (EODs) for active electrolocation and electrocommunication. These pulses are emitted with variable interdischarge intervals (IDIs) resulting in temporal discharge patterns and interactive signaling episodes with nearby conspecifics. However, unequivocal assignment of interactive signaling to a specific behavioral context has proven to be challenging. Using an ethorobotical approach, we confronted single individuals of weakly electric Mormyrus rume proboscirostris with a mobile fish robot capable of interacting both physically, on arbitrary trajectories, as well as electrically, by generating echo responses through playback of species-specific EODs, thus synchronizing signals with the fish. Interactive signaling by the fish was more pronounced in response to a dynamic echo playback generated by the robot than in response to playback of static random IDI sequences. Such synchronizations were particularly strong at a distance corresponding to the outer limit of active electrolocation, and when fish oriented toward the fish replica. We therefore argue that interactive signaling through echoing of a conspecific's EODs provides a simple mechanism by which weakly electric fish can specifically address nearby individuals during electrocommunication. Echoing may thus enable mormyrids to mutually allocate social attention and constitute a foundation for complex social behavior and relatively advanced cognitive abilities in a basal vertebrate lineage.
Collapse
Affiliation(s)
- Martin Worm
- Institut für Zoologie, Neuroethologie/Sensorische Ökologie, Universität Bonn, 53115 Bonn, Germany;
| | - Tim Landgraf
- Institut für Informatik, Fachbereich Informatik und Mathematik, Freie Universität Berlin, 14195 Berlin, Germany
| | - Julia Prume
- Institut für Zoologie, Neuroethologie/Sensorische Ökologie, Universität Bonn, 53115 Bonn, Germany
| | - Hai Nguyen
- Institut für Informatik, Fachbereich Informatik und Mathematik, Freie Universität Berlin, 14195 Berlin, Germany
| | - Frank Kirschbaum
- Biologie und Ökologie der Fische, Lebenswissenschaftliche Fakultät, Humboldt-Universität-zu Berlin, 10115 Berlin, Germany
| | - Gerhard von der Emde
- Institut für Zoologie, Neuroethologie/Sensorische Ökologie, Universität Bonn, 53115 Bonn, Germany
| |
Collapse
|
10
|
Kim C, Ruberto T, Phamduy P, Porfiri M. Closed-loop control of zebrafish behaviour in three dimensions using a robotic stimulus. Sci Rep 2018; 8:657. [PMID: 29330523 PMCID: PMC5766612 DOI: 10.1038/s41598-017-19083-2] [Citation(s) in RCA: 47] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2017] [Accepted: 12/21/2017] [Indexed: 11/15/2022] Open
Abstract
Robotics is continuously being integrated in animal behaviour studies to create customizable, controllable, and repeatable stimuli. However, few systems have capitalized on recent breakthroughs in computer vision and real-time control to enable a two-way interaction between the animal and the robot. Here, we present a "closed-loop control" system to investigate the behaviour of zebrafish, a popular animal model in preclinical studies. The system allows for actuating a biologically-inspired 3D-printed replica in a 3D workspace, in response to the behaviour of a zebrafish. We demonstrate the role of closed-loop control in modulating the response of zebrafish, across a range of behavioural and information-theoretic measures. Our results suggest that closed-loop control could enhance the degree of biomimicry of the replica, by increasing the attraction of live subjects and their interaction with the stimulus. Interactive experiments hold promise to advance our understanding of zebrafish, offering new means for high throughput behavioural phenotyping.
Collapse
Affiliation(s)
- Changsu Kim
- Department of Mechanical and Aerospace Engineering, New York University Tandon School of Engineering, Brooklyn, New York, 11201, USA
| | - Tommaso Ruberto
- Department of Mechanical and Aerospace Engineering, New York University Tandon School of Engineering, Brooklyn, New York, 11201, USA
| | - Paul Phamduy
- Department of Mechanical and Aerospace Engineering, New York University Tandon School of Engineering, Brooklyn, New York, 11201, USA
| | - Maurizio Porfiri
- Department of Mechanical and Aerospace Engineering, New York University Tandon School of Engineering, Brooklyn, New York, 11201, USA.
| |
Collapse
|
11
|
Cazenille L, Collignon B, Chemtob Y, Bonnet F, Gribovskiy A, Mondada F, Bredeche N, Halloy J. How mimetic should a robotic fish be to socially integrate into zebrafish groups? BIOINSPIRATION & BIOMIMETICS 2018; 13:025001. [PMID: 28952466 DOI: 10.1088/1748-3190/aa8f6a] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
Biomimetic robots are promising tools in animal behavioural studies. If they are socially integrated in a group of animals, they can produce calibrated social stimuli to test the animal responses. However, the design of such social robots is challenging as it involves both a luring capability including appropriate robot behaviours, and the acceptation of the robots by the animals as social companions. Here, we investigate the integration of a biomimetic robot driven by biomimetic behavioural models into a group of zebrafish (Danio rerio). The robot behaviours are based on a stochastic model linking zebrafish visual perception to individual behaviour and calibrated experimentally to correspond to the behaviour of zebrafish. We show that our robot can be integrated into a group of zebrafish, mimic their behaviour and exhibit similar collective dynamics compared to fish-only groups. This study shows that an autonomous biomimetic robot was enhanced by a biomimetic behavioural model so that it can socially integrate into groups of fish.
Collapse
Affiliation(s)
- Leo Cazenille
- Univ Paris Diderot, Sorbonne Paris Cité, LIED, UMR 8236, 75013, Paris, France. Sorbonne Universités, UPMC Univ Paris 06, CNRS, ISIR, F-75005 Paris, France
| | | | | | | | | | | | | | | |
Collapse
|
12
|
Cazenille L, Chemtob Y, Bonnet F, Gribovskiy A, Mondada F, Bredeche N, Halloy J. How to Blend a Robot Within a Group of Zebrafish: Achieving Social Acceptance Through Real-Time Calibration of a Multi-level Behavioural Model. BIOMIMETIC AND BIOHYBRID SYSTEMS 2018. [DOI: 10.1007/978-3-319-95972-6_9] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/07/2023]
|
13
|
Romano D, Benelli G, Donati E, Remorini D, Canale A, Stefanini C. Multiple cues produced by a robotic fish modulate aggressive behaviour in Siamese fighting fishes. Sci Rep 2017; 7:4667. [PMID: 28680126 PMCID: PMC5498610 DOI: 10.1038/s41598-017-04840-0] [Citation(s) in RCA: 41] [Impact Index Per Article: 5.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2017] [Accepted: 05/22/2017] [Indexed: 11/25/2022] Open
Abstract
The use of robotics to establish social interactions between animals and robots, represents an elegant and innovative method to investigate animal behaviour. However, robots are still underused to investigate high complex and flexible behaviours, such as aggression. Here, Betta splendens was tested as model system to shed light on the effect of a robotic fish eliciting aggression. We evaluated how multiple signal systems, including a light stimulus, affect aggressive responses in B. splendens. Furthermore, we conducted experiments to estimate if aggressive responses were triggered by the biomimetic shape of fish replica, or whether any intruder object was effective as well. Male fishes showed longer and higher aggressive displays as puzzled stimuli from the fish replica increased. When the fish replica emitted its full sequence of cues, the intensity of aggression exceeded even that produced by real fish opponents. Fish replica shape was necessary for conspecific opponent perception, evoking significant aggressive responses. Overall, this study highlights that the efficacy of an artificial opponent eliciting aggressive behaviour in fish can be boosted by exposure to multiple signals. Optimizing the cue combination delivered by the robotic fish replica may be helpful to predict escalating levels of aggression.
Collapse
Affiliation(s)
- Donato Romano
- The BioRobotics Institute, Scuola Superiore Sant'Anna, Viale Rinaldo Piaggio 34, 56025 Pontedera, Pisa, Italy.
| | - Giovanni Benelli
- The BioRobotics Institute, Scuola Superiore Sant'Anna, Viale Rinaldo Piaggio 34, 56025 Pontedera, Pisa, Italy.
- Department of Agriculture, Food and Environment, University of Pisa, via del Borghetto 80, 56124, Pisa, Italy.
| | - Elisa Donati
- The BioRobotics Institute, Scuola Superiore Sant'Anna, Viale Rinaldo Piaggio 34, 56025 Pontedera, Pisa, Italy
| | - Damiano Remorini
- Department of Agriculture, Food and Environment, University of Pisa, via del Borghetto 80, 56124, Pisa, Italy
| | - Angelo Canale
- Department of Agriculture, Food and Environment, University of Pisa, via del Borghetto 80, 56124, Pisa, Italy
| | - Cesare Stefanini
- The BioRobotics Institute, Scuola Superiore Sant'Anna, Viale Rinaldo Piaggio 34, 56025 Pontedera, Pisa, Italy
- Department of Biomedical Engineering and Robotics Institute, Khalifa University, PO Box, 127788, Abu Dhabi, UAE
| |
Collapse
|
14
|
Neri D, Ruberto T, Cord-Cruz G, Porfiri M. Information theory and robotics meet to study predator-prey interactions. CHAOS (WOODBURY, N.Y.) 2017; 27:073111. [PMID: 28764408 DOI: 10.1063/1.4990051] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
Transfer entropy holds promise to advance our understanding of animal behavior, by affording the identification of causal relationships that underlie animal interactions. A critical step toward the reliable implementation of this powerful information-theoretic concept entails the design of experiments in which causal relationships could be systematically controlled. Here, we put forward a robotics-based experimental approach to test the validity of transfer entropy in the study of predator-prey interactions. We investigate the behavioral response of zebrafish to a fear-evoking robotic stimulus, designed after the morpho-physiology of the red tiger oscar and actuated along preprogrammed trajectories. From the time series of the positions of the zebrafish and the robotic stimulus, we demonstrate that transfer entropy correctly identifies the influence of the stimulus on the focal subject. Building on this evidence, we apply transfer entropy to study the interactions between zebrafish and a live red tiger oscar. The analysis of transfer entropy reveals a change in the direction of the information flow, suggesting a mutual influence between the predator and the prey, where the predator adapts its strategy as a function of the movement of the prey, which, in turn, adjusts its escape as a function of the predator motion. Through the integration of information theory and robotics, this study posits a new approach to study predator-prey interactions in freshwater fish.
Collapse
Affiliation(s)
- Daniele Neri
- Department of Mechanical and Aerospace Engineering, New York University, Tandon School of Engineering, 6 MetroTech Center, Brooklyn, New York 11201, USA
| | - Tommaso Ruberto
- Department of Mechanical and Aerospace Engineering, New York University, Tandon School of Engineering, 6 MetroTech Center, Brooklyn, New York 11201, USA
| | - Gabrielle Cord-Cruz
- Department of Mechanical and Aerospace Engineering, New York University, Tandon School of Engineering, 6 MetroTech Center, Brooklyn, New York 11201, USA
| | - Maurizio Porfiri
- Department of Mechanical and Aerospace Engineering, New York University, Tandon School of Engineering, 6 MetroTech Center, Brooklyn, New York 11201, USA
| |
Collapse
|
15
|
Affiliation(s)
- Klaudia Witte
- Research Group of Ecology and Behavioral Biology, Department of Chemistry
and Biology, Institute of Biology, University of Siegen, Adolf-Reichwein-Str. 2, Siegen
57068, Germany
| | - Stefanie Gierszewski
- Research Group of Ecology and Behavioral Biology, Department of Chemistry
and Biology, Institute of Biology, University of Siegen, Adolf-Reichwein-Str. 2, Siegen
57068, Germany
| | - Laura Chouinard-Thuly
- Department of Biology, McGill University, 1205 Docteur Penfield, Montréal,
Quebec, Canada H3A 1B1
| | | |
Collapse
|
16
|
Chouinard-Thuly L, Gierszewski S, Rosenthal GG, Reader SM, Rieucau G, Woo KL, Gerlai R, Tedore C, Ingley SJ, Stowers JR, Frommen JG, Dolins FL, Witte K. Technical and conceptual considerations for using animated stimuli in studies of animal behavior. Curr Zool 2017; 63:5-19. [PMID: 29491958 PMCID: PMC5804155 DOI: 10.1093/cz/zow104] [Citation(s) in RCA: 57] [Impact Index Per Article: 8.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2016] [Accepted: 10/12/2016] [Indexed: 11/14/2022] Open
Abstract
Rapid technical advances in the field of computer animation (CA) and virtual reality (VR) have opened new avenues in animal behavior research. Animated stimuli are powerful tools as they offer standardization, repeatability, and complete control over the stimulus presented, thereby "reducing" and "replacing" the animals used, and "refining" the experimental design in line with the 3Rs. However, appropriate use of these technologies raises conceptual and technical questions. In this review, we offer guidelines for common technical and conceptual considerations related to the use of animated stimuli in animal behavior research. Following the steps required to create an animated stimulus, we discuss (I) the creation, (II) the presentation, and (III) the validation of CAs and VRs. Although our review is geared toward computer-graphically designed stimuli, considerations on presentation and validation also apply to video playbacks. CA and VR allow both new behavioral questions to be addressed and existing questions to be addressed in new ways, thus we expect a rich future for these methods in both ultimate and proximate studies of animal behavior.
Collapse
Affiliation(s)
- Laura Chouinard-Thuly
- Department of Biology, McGill University, 1205 Docteur Penfield, Montréal, Quebec, Canada H3A 1B1
| | - Stefanie Gierszewski
- Research Group of Ecology and Behavioral Biology, Institute of Biology, University of Siegen, Adolf-Reichwein Str. 2, Siegen 57068, Germany
| | - Gil G. Rosenthal
- Ecology & Evolutionary Biology, Texas A&M University, 3258 TAMU College Station, TX 77843, USA
- Centro de Investigaciones Científicas de las Huastecas “Aguazarca”, Calnali, Hidalgo, México
| | - Simon M. Reader
- Department of Biology, McGill University, 1205 Docteur Penfield, Montréal, Quebec, Canada H3A 1B1
| | - Guillaume Rieucau
- Department of Biological Sciences, Florida International University, 3000 Northeast 151 Street, North Miami, FL 33181, USA
| | - Kevin L. Woo
- SUNY Empire State College, Metropolitan Center, 325 Hudson Street, New York, NY 10013-1005, USA
| | - Robert Gerlai
- Department of Psychology, University of Toronto Mississauga, 3359 Mississauga Road, Mississauga, Ontario, Canada L5L 1C6
| | - Cynthia Tedore
- Lund Vision Group, Department of Biology, Lund University, Sölvegatan 35, Lund 22362, Sweden
| | - Spencer J. Ingley
- Department of Biology, University of North Carolina at Chapel Hill, CB#3280, Coker Hall, Chapel Hill, NC 27599, USA
| | - John R. Stowers
- Research Institute of Molecular Pathology IMP, Vienna Biocenter VBC, Dr. Bohr-Gasse 7, Vienna 1030, Austria
- loopbio gmbh, Hauptstrasse 93, Kritzendorf 3420, Austria
| | - Joachim G. Frommen
- Department of Behavioural Ecology, Institute of Ecology and Evolution, University of Bern, Wohlenstrasse 50a, Hinterkappelen 3032, Switzerland
| | - Francine L. Dolins
- Department of Behavioral Sciences, University of Michigan-Dearborn, 4901 Evergreen Road, Dearborn, MI 48128, USA
| | - Klaudia Witte
- Research Group of Ecology and Behavioral Biology, Institute of Biology, University of Siegen, Adolf-Reichwein Str. 2, Siegen 57068, Germany
| |
Collapse
|
17
|
Müller K, Smielik I, Hütwohl JM, Gierszewski S, Witte K, Kuhnert KD. The virtual lover: variable and easily guided 3D fish animations as an innovative tool in mate-choice experiments with sailfin mollies-I. Design and implementation. Curr Zool 2017; 63:55-64. [PMID: 29491963 PMCID: PMC5804152 DOI: 10.1093/cz/zow106] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2016] [Accepted: 10/19/2016] [Indexed: 11/15/2022] Open
Abstract
Animal behavior researchers often face problems regarding standardization and reproducibility of their experiments. This has led to the partial substitution of live animals with artificial virtual stimuli. In addition to standardization and reproducibility, virtual stimuli open new options for researchers since they are easily changeable in morphology and appearance, and their behavior can be defined. In this article, a novel toolchain to conduct behavior experiments with fish is presented by a case study in sailfin mollies Poecilia latipinna. As the toolchain holds many different and novel features, it offers new possibilities for studies in behavioral animal research and promotes the standardization of experiments. The presented method includes options to design, animate, and present virtual stimuli to live fish. The designing tool offers an easy and user-friendly way to define size, coloration, and morphology of stimuli and moreover it is able to configure virtual stimuli randomly without any user influence. Furthermore, the toolchain brings a novel method to animate stimuli in a semiautomatic way with the help of a game controller. These created swimming paths can be applied to different stimuli in real time. A presentation tool combines models and swimming paths regarding formerly defined playlists, and presents the stimuli onto 2 screens. Experiments with live sailfin mollies validated the usage of the created virtual 3D fish models in mate-choice experiments.
Collapse
Affiliation(s)
- Klaus Müller
- Department of Electrical Engineering & Computer Science, Institute of Real-Time Learning Systems, University of Siegen, Hölderlinstraße 3, Siegen, 57076, GermanyResearch Group of Ecology and Behavioral Biology, Institute of Biology, University of Siegen, Adolf-Reichwein-Straße 2, Siegen, 57068, Germany
| | - Ievgen Smielik
- Department of Electrical Engineering & Computer Science, Institute of Real-Time Learning Systems, University of Siegen, Hölderlinstraße 3, Siegen, 57076, GermanyResearch Group of Ecology and Behavioral Biology, Institute of Biology, University of Siegen, Adolf-Reichwein-Straße 2, Siegen, 57068, Germany
| | - Jan-Marco Hütwohl
- Department of Electrical Engineering & Computer Science, Institute of Real-Time Learning Systems, University of Siegen, Hölderlinstraße 3, Siegen, 57076, GermanyResearch Group of Ecology and Behavioral Biology, Institute of Biology, University of Siegen, Adolf-Reichwein-Straße 2, Siegen, 57068, Germany
| | - Stefanie Gierszewski
- Department of Electrical Engineering & Computer Science, Institute of Real-Time Learning Systems, University of Siegen, Hölderlinstraße 3, Siegen, 57076, GermanyResearch Group of Ecology and Behavioral Biology, Institute of Biology, University of Siegen, Adolf-Reichwein-Straße 2, Siegen, 57068, Germany
| | - Klaudia Witte
- Department of Electrical Engineering & Computer Science, Institute of Real-Time Learning Systems, University of Siegen, Hölderlinstraße 3, Siegen, 57076, GermanyResearch Group of Ecology and Behavioral Biology, Institute of Biology, University of Siegen, Adolf-Reichwein-Straße 2, Siegen, 57068, Germany
| | - Klaus-Dieter Kuhnert
- Department of Electrical Engineering & Computer Science, Institute of Real-Time Learning Systems, University of Siegen, Hölderlinstraße 3, Siegen, 57076, GermanyResearch Group of Ecology and Behavioral Biology, Institute of Biology, University of Siegen, Adolf-Reichwein-Straße 2, Siegen, 57068, Germany
| |
Collapse
|
18
|
Ruberto T, Mwaffo V, Singh S, Neri D, Porfiri M. Zebrafish response to a robotic replica in three dimensions. ROYAL SOCIETY OPEN SCIENCE 2016; 3:160505. [PMID: 27853566 PMCID: PMC5098991 DOI: 10.1098/rsos.160505] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/11/2016] [Accepted: 09/12/2016] [Indexed: 05/26/2023]
Abstract
As zebrafish emerge as a species of choice for the investigation of biological processes, a number of experimental protocols are being developed to study their social behaviour. While live stimuli may elicit varying response in focal subjects owing to idiosyncrasies, tiredness and circadian rhythms, video stimuli suffer from the absence of physical input and rely only on two-dimensional projections. Robotics has been recently proposed as an alternative approach to generate physical, customizable, effective and consistent stimuli for behavioural phenotyping. Here, we contribute to this field of investigation through a novel four-degree-of-freedom robotics-based platform to manoeuvre a biologically inspired three-dimensionally printed replica. The platform enables three-dimensional motions as well as body oscillations to mimic zebrafish locomotion. In a series of experiments, we demonstrate the differential role of the visual stimuli associated with the biologically inspired replica and its three-dimensional motion. Three-dimensional tracking and information-theoretic tools are complemented to quantify the interaction between zebrafish and the robotic stimulus. Live subjects displayed a robust attraction towards the moving replica, and such attraction was lost when controlling for its visual appearance or motion. This effort is expected to aid zebrafish behavioural phenotyping, by offering a novel approach to generate physical stimuli moving in three dimensions.
Collapse
|
19
|
Bartolini T, Mwaffo V, Showler A, Macrì S, Butail S, Porfiri M. Zebrafish response to 3D printed shoals of conspecifics: the effect of body size. BIOINSPIRATION & BIOMIMETICS 2016; 11:026003. [PMID: 26891476 DOI: 10.1088/1748-3190/11/2/026003] [Citation(s) in RCA: 24] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/05/2023]
Abstract
Recent progress in three-dimensional (3D) printing technology has enabled rapid prototyping of complex models at a limited cost. Virtually every research laboratory has access to a 3D printer, which can assist in the design and implementation of hypothesis-driven studies on animal behavior. In this study, we explore the possibility of using 3D printing technology to understand the role of body size in the social behavior of the zebrafish model organism. In a dichotomous preference test, we study the behavioral response of zebrafish to shoals of 3D printed replicas of varying size. We systematically vary the size of each replica without altering the coloration, aspect ratio, and stripe patterns, which are all selected to closely mimic zebrafish morphophysiology. The replicas are actuated through a robotic manipulator, mimicking the natural motion of live subjects. Zebrafish preference is assessed by scoring the time spent in the vicinity of the shoal of replicas, and the information theoretic construct of transfer entropy is used to further elucidate the influence of the replicas on zebrafish motion. Our results demonstrate that zebrafish adjust their behavior in response to variations in the size of the replicas. Subjects exhibit an avoidance reaction for larger replicas, and they are attracted toward and influenced by smaller replicas. The approach presented in this study, integrating 3D printing technology, robotics, and information theory, is expected to significantly aid preclinical research on zebrafish behavior.
Collapse
Affiliation(s)
- Tiziana Bartolini
- Department of Mechanical and Aerospace Engineering, New York University Tandon School of Engineering, Brooklyn, New York, NY 11201, USA
| | | | | | | | | | | |
Collapse
|
20
|
Landgraf T, Bierbach D, Nguyen H, Muggelberg N, Romanczuk P, Krause J. RoboFish: increased acceptance of interactive robotic fish with realistic eyes and natural motion patterns by live Trinidadian guppies. BIOINSPIRATION & BIOMIMETICS 2016; 11:015001. [PMID: 26757096 DOI: 10.1088/1748-3190/11/1/015001] [Citation(s) in RCA: 35] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/05/2023]
Abstract
In recent years, simple biomimetic robots have been increasingly used in biological studies to investigate social behavior, for example collective movement. Nevertheless, a big challenge in developing biomimetic robots is the acceptance of the robotic agents by live animals. In this contribution, we describe our recent advances with regard to the acceptance of our biomimetic RoboFish by live Trinidadian guppies (Poecilia reticulata). We provide a detailed technical description of the RoboFish system and show the effect of different appearance, motion patterns and interaction modes on the acceptance of the artificial fish replica. Our results indicate that realistic eye dummies along with natural motion patterns significantly improve the acceptance level of the RoboFish. Through the interactive behaviors, our system can be adjusted to imitate different individual characteristics of live animals, which further increases the bandwidth of possible applications of our RoboFish for the study of animal behavior.
Collapse
Affiliation(s)
- Tim Landgraf
- Freie Universität Berlin, FB Mathematik u. Informatik Arnimallee 7, 14195 Berlin, Germany
| | | | | | | | | | | |
Collapse
|
21
|
|