The Autonomous Pipeline Navigation of a Cockroach Bio-Robot with Enhanced Walking Stimuli

Tens of crawling bio-robots with cockroaches as the mobile platform have been developed with various functions. Compared with artificial crawling robots of the same size, they revealed better flexibility, larger payload, and stronger endurance. These features made bio-robots ideal for pipeline inspection scenarios because the advancements in locomotion mechanisms and efficient power systems are still hurdles for current artificial systems. In this study, we controlled the bio-robot to crawl in the confined dark pipeline and achieved autonomous motion control with the help of an onboard sensing system. Specifically, a micro-camera was mounted on the electronic backpack of the cockroach for image collection, and an IMU sensor was used to compute its body orientation. The electronic backpack transmitted images to the host computer for junction recognition and distance estimation. Meanwhile, the insect's habituation to electrical stimulation has long been an uncertain factor in the control of bio-robots. Here, a synergistic stimulation strategy was proposed to markedly reduce the habituation and increase the number of effective turning controls to over 100 times. It is also found that both the increase of payload and the application of stimulations could promote the metabolic rate by monitoring carbon dioxide release. With the integration of synergistic stimulation and autonomous control, we demonstrated the fully autonomous pipeline navigation with our cockroach bio-robot, which realized the cycle number of approximately 10 in a roll. This research provides a novel technology that has the potential for practical applications in the future.

CameraRoach: A WiFi- and Camera-Enabled Cyborg Cockroach for Search and Rescue

We describe here our design and implementation of a cyborg insect, called CameraRoach, with onboard camera feedback that can be navigated via remote control providing a first-person view. The camera pack is mounted on the Madagascar hissing cockroach, which is small enough to fit into crevices but also can carry a printed circuit boards with power, communication, and sensor components (visual camera). For navigating the cockroach, we implemented a unique electronic backpack neural stimulator, which allows the cockroach to be maneuvered on a desired path with a joystick. A high-resolution wireless camera, also included in the backpack, sends live images via a WiFi (Wireless Fidelity) network. We present the results of an evaluation experiment with the CameraRoach and compare it with the other state of the art systems like the Beetle-Cam.

Behavioral control and changes in brain activity of honeybee during flapping

INTRODUCTION

Insect cyborg is a kind of novel robot based on insect-machine interface and principles of neurobiology. The key idea is to stimulate live insects by specific stimuli; thus, the flight trajectory of insects could be controlled as anticipated. However, the neuroregulatory mechanism of insect flight has not been elucidated completely at present.

METHODS

To explore the neuro-mechanism of insect flight behaviors, a series of electrical stimulation was applied on the optic lobes of semi-constrained honeybees. Times of flight initiation, flapping frequency, and duration were recorded by a high-speed camera. In addition, flapping and steering initiation experiments of the cyborg honeybee were verified. Moreover, series of local field potential signals of optic lobes during flapping were collected, pre-processed to remove baseline wander and DC components, then analyzed by power spectrum estimation.

RESULTS

A quantitative optimization method and optimal stimulation parameters of flight initiation were presented. Stimulation results showed that the flapping duration differed greatly while the flapping frequency varied with little difference among different individuals. Moreover, there was always a fluctuation peak around 20-30 Hz in power spectral density (PSD) curves during flapping, distinguishing from calm state, which indicated some brain activity changes during flapping.

CONCLUSIONS

Our study presented a range of relatively optimal electrical parameters to initiate honeybee flight behavior. Meanwhile, the regularity of flapping duration and flapping frequency under electrical stimulations with different parameters were given. The feasibility of controlling a honeybee's flight behavior by brain electrical stimulation was verified through the flapping and steering initiation experiment of honeybees under semi-constrained state. PSD fluctuations reflected changes in brain activity during flapping and that those fluctuation characteristics at the specific frequency band could be sensitive determinants to distinguish whether the honeybee was flying or not, which benefits our understanding of honeybee's flapping behavior and furthers the study of honeybee cyborgs.

Brain-Machine Interface-Based Rat-Robot Behavior Control

Brain-machine interface (BMI) provides a bidirectional pathway between the brain and external facilities. The machine-to-brain pathway makes it possible to send artificial information back into the biological brain, interfering neural activities and generating sensations. The idea of the BMI-assisted bio-robotic animal system is accomplished by stimulations on specific sites of the nervous system. With the technology of BMI, animals' locomotion behavior can be precisely controlled as robots, which made the animal turning into bio-robot. In this chapter, we reviewed our lab works focused on rat-robot navigation. The principles of rat-robot system have been briefly described first, including the target brain sites chosen for locomotion control and the design of remote control system. Some methodological advances made by optogenetic technologies for better modulation control have then been introduced. Besides, we also introduced our implementation of "mind-controlled" rat navigation system. Moreover, we have presented our efforts made on combining biological intelligence with artificial intelligence, with developments of automatic control and training system assisted with images or voices inputs. We concluded this chapter by discussing further developments to acquire environmental information as well as promising applications with write-in BMIs.

A review on animal-robot interaction: from bio-hybrid organisms to mixed societies

Living organisms are far superior to state-of-the-art robots as they have evolved a wide number of capabilities that far encompass our most advanced technologies. The merging of biological and artificial world, both physically and cognitively, represents a new trend in robotics that provides promising prospects to revolutionize the paradigms of conventional bio-inspired design as well as biological research. In this review, a comprehensive definition of animal-robot interactive technologies is given. They can be at animal level, by augmenting physical or mental capabilities through an integrated technology, or at group level, in which real animals interact with robotic conspecifics. Furthermore, an overview of the current state of the art and the recent trends in this novel context is provided. Bio-hybrid organisms represent a promising research area allowing us to understand how a biological apparatus (e.g. muscular and/or neural) works, thanks to the interaction with the integrated technologies. Furthermore, by using artificial agents, it is possible to shed light on social behaviours characterizing mixed societies. The robots can be used to manipulate groups of living organisms to understand self-organization and the evolution of cooperative behaviour and communication.

Intercollicular nucleus electric stimulation encoded “walk forward” commands in pigeons

The bio-robot research field is growing. Robo-pigeons have been successfully programmed to turn left or right; however, a satisfactory method of commanding a robo-pigeon to walk forward is still lacking. This problem has become a roadblock to progress in bio-robot research and applications. In mammals, the midbrain periaqueductal gray region (PAG) plays a key role in mediating defensive reactions in response to fear and anxiety. The avian intercollicular nucleus (ICo) is thought to correspond to the PAG. In this study, we found that microstimulating the ICo could successfully induce a robo-pigeon to walk forward. Compared with stimulation of the previously used archistriatum, the response time was considerably shorter and the behavior accuracy significantly higher. This paper describes in detail the process of controlling a robo-pigeon such that it walks forward and backward along a prescribed straight line. From the results, we draw the conclusion that the ICo is suitable for prompting the “walk forward” order in robo-pigeons.

Insect-computer hybrid legged robot with user-adjustable speed, step length and walking gait

We have constructed an insect-computer hybrid legged robot using a living beetle (Mecynorrhina torquata; Coleoptera). The protraction/retraction and levation/depression motions in both forelegs of the beetle were elicited by electrically stimulating eight corresponding leg muscles via eight pairs of implanted electrodes. To perform a defined walking gait (e.g., gallop), different muscles were individually stimulated in a predefined sequence using a microcontroller. Different walking gaits were performed by reordering the applied stimulation signals (i.e., applying different sequences). By varying the duration of the stimulation sequences, we successfully controlled the step frequency and hence the beetle's walking speed. To the best of our knowledge, this paper presents the first demonstration of living insect locomotion control with a user-adjustable walking gait, step length and walking speed.

Effective Stimulus Parameters for Directed Locomotion in Madagascar Hissing Cockroach Biobot

Swarms of insects instrumented with wireless electronic backpacks have previously been proposed for potential use in search and rescue operations. Before deploying such biobot swarms, an effective long-term neural-electric stimulus interface must be established, and the locomotion response to various stimuli quantified. To this end, we studied a variety of pulse types (mono- vs. bipolar; voltage- vs. current-controlled) and shapes (amplitude, frequency, duration) to parameters that are most effective for evoking locomotion along a desired path in the Madagascar hissing cockroach (G. portentosa) in response to antennal and cercal stimulation. We identified bipolar, 2 V, 50 Hz, 0.5 s voltage controlled pulses as being optimal for evoking forward motion and turns in the expected contraversive direction without habituation in ≈50% of test subjects, a substantial increase over ≈10% success rates previously reported. Larger amplitudes for voltage (1–4 V) and current (50–150 μA) pulses generally evoked larger forward walking (15.6–25.6 cm; 3.9–5.6 cm/s) but smaller concomitant turning responses (149 to 80.0 deg; 62.8 to 41.2 deg/s). Thus, the radius of curvature of the initial turn-then-run locomotor response (≈10–25 cm) could be controlled in a graded manner by varying the stimulus amplitude. These findings could be used to help optimize stimulus protocols for swarms of cockroach biobots navigating unknown terrain.

Kinect-based system for automated control of terrestrial insect biobots

Centimeter scale mobile biobots offer unique advantages in uncertain environments. Our previous experimentation has demonstrated neural stimulation techniques in order to control the motion of Madagascar hissing cockroaches. These trials relied on stimulation by a human operator using a remote control. We have developed a Kinect-based system for computer operated automatic control of cockroaches. Using image processing techniques and a radio transmitter, this platform both detects the position of the roach biobot and sends stimulation commands to an implanted microcontroller-based receiver. The work presented here enables repeatable experimentation and allows precise quantification of the line following capabilities of the roach biobot. This system will help refine our model for the stimulation response of the insect and improve our ability to direct them in increasingly dynamic situations.

Towards fenceless boundaries for solar powered insect biobots

Demonstration of remote navigation with instrumented insects, such as the Madagascar Hissing Cockroach, Gromphadorhina portentosa, has enabled the concept of biobotic agents for search and rescue missions and environmental monitoring applications. The biobots can form the nodes of a mobile sensor network to be established, for example, in unknown and dynamic environments after natural disasters to pinpoint surviving victims. We demonstrate here, for the first time, the concept of an invisible fence for insect biobots with an ultimate goal of keeping insect biobots within a certain distance of each other or a base station to ensure a reliable wireless network. For extended mission durations, this fenceless boundary would also be used to guide insects towards light sources for autonomous solar charging of their on-board batteries.

Insect biofuel cells using trehalose included in insect hemolymph leading to an insect-mountable biofuel cell

In this paper, an insect biofuel cell (BFC) using trehalose included in insect hemolymph was developed. The insect BFC is based on trehalase and glucose oxidase (GOD) reaction systems which oxidize β-glucose obtained by hydrolyzing trehalose. First, we confirmed by LC-MS that a sufficient amount of trehalose was present in the cockroach hemolymph (CHL). The maximum power density obtained using the insect BFC was 6.07 μW/cm(2). The power output was kept more than 10 % for 2.5 h by protecting the electrodes with a dialysis membrane. Furthermore, the maximum power density was increased to 10.5 μW/cm(2) by using an air diffusion cathode. Finally, we succeeded in driving a melody integrated circuit (IC) and a piezo speaker by connecting five insect BFCs in series. The results indicate that the insect BFC is a promising insect-mountable battery to power environmental monitoring micro-tools.

Line following terrestrial insect biobots

The present day technology falls short in offering centimeter scale mobile robots that can function effectively under unknown and dynamic environmental conditions. Insects, on the other hand, exhibit an unmatched ability to navigate through a wide variety of environments and overcome perturbations by successfully maintaining control and stability. In this study, we use neural stimulation systems to wirelessly navigate cockroaches to follow lines to enable terrestrial insect biobots. We also propose a system-on-chip based ZigBee enabled wireless neurostimulation backpack system with on-board tissue-electrode bioelectrical coupling verification. Such a capability ensures an electrochemically safe stimulation and avoids irreversible damage to the interface which is often misinterpreted as habituation of the insect to the applied stimulation.

Review of Research Progress in Biorobot

Biorobot which is also called robot animal, has become a hotspot nowadays. This paper reviews its current research and predict its application prospects.

Electromagnetic levitation platform for wireless study of insect flight neurophysiology

An electromagnetic levitation platform for use in a light emitting diode (LED) arena based virtual reality environment was developed for wireless recording of neural and neuromuscular signals from the flight related muscle groups in Manduca sexta. The platform incorporates the use of Early Metamorphosis Insertion Technology to implant recording electrodes into the flight muscles of late stage pupal moths. Analysis of the insects' response to changes in the LED arena rotation direction indicate that this setup could be used to perform a variety of flight behavior studies during yaw maneuvers.

Flexible split-ring electrode for insect flight biasing using multisite neural stimulation

We describe a flexible multisite microelectrode for insect flight biasing using neural stimulation. The electrode is made of two layers of polyimide (PI) with gold sandwiched in between in a split-ring geometry. The split-ring design in conjunction with the flexibility of the PI allows for a simple insertion process and provides good attachment between the electrode and ventral nerve cord of the insect. Stimulation sites are located at the ends of protruding tips that are circularly distributed inside the split-ring structure. These protruding tips penetrate into the connective tissue surrounding the nerve cord. We have been able to insert the electrode into pupae of the giant sphinx moth Manduca sexta as early as seven days before the adult moth emerges, and we are able to use the multisite electrode to deliver electrical stimuli that evoke multidirectional, graded abdominal motions in both pupae and adult moths. Finally, in loosely tethered flight, we have used stimulation through the flexible microelectrodes to alter the abdominal angle, thus causing the flying moth to deviate to the left or right of its intended path.