Automatic tracking of free-flying insects using a cable-driven robot

A hybrid tendon-driven continuum robot that avoids torsion under external load

Tendon-driven continuum robots usually consists of several actuators and cables pulling a flexible backbone. The tendon path alongside the backbone allows to perform complex movements with high dexterity. Yet, the integration of multiple tendons adds complexity and the lack of rigidity makes continuum robots susceptible to torsion whenever an external force or load is applied. This paper proposes a reduced complexity, hybrid tendon-driven continuum robot (HTDCR) that avoids undesired torsion under external load. Bending of the HTDCR is achieved from a single tendon with lateral joints alongside the backbone acting as mechanical constraint on the bending plane. A rotary base then provides an additional degree of freedom by allowing full rotation of the arm. We developed a robot prototype with control law based on a constant curvature model and validated it experimentally with various loads on the tip. Body deviation outside the bending plane is negligible (mm range), thereby demonstrating no torsional deformation. Tip deflection within the bending plane is smaller than the one obtained with a 4-tendon driven continuum robot. Moreover, tip deflection can be accurately estimated from the load and motor input which paves the way to possible compensation. All together, the experiments demonstrate the efficiency of the HTDCR with 450 g payload which makes it suitable in agricultural tasks such as fruit and vegetable harvesting.

High-resolution outdoor videography of insects using Fast Lock-On tracking

Insects have important roles globally in ecology, economy, and health, yet our understanding of their behavior remains limited. Bees, for example, use vision and a tiny brain to find flowers and return home, but understanding how they perform these impressive tasks has been hampered by limitations in recording technology. Here, we present Fast Lock-On (FLO) tracking. This method moves an image sensor to remain focused on a retroreflective marker affixed to an insect. Using paraxial infrared illumination, simple image processing can localize the sensor location of the insect in a few milliseconds. When coupled with a feedback system to steer a high-magnification optical system to remain focused on the insect, a high-spatiotemporal resolution trajectory can be gathered over a large region. As the basis for several robotic systems, we show that FLO is a versatile idea that can be used in combination with other components. We demonstrate that the optical path can be split and used for recording high-speed video. Furthermore, by flying an FLO system on a quadcopter drone, we track a flying honey bee and anticipate tracking insects in the wild over kilometer scales. Such systems have the capability to provide higher-resolution information about insects behaving in natural environments and as such will be helpful in revealing the biomechanical and neuroethological mechanisms used by insects in natural settings.

Kinematic Uncertainty Analysis of a Cable-Driven Parallel Robot Based on an Error Transfer Model

Cable-driven parallel robots (CDPRs) are a kind of mechanism with large workspace, fast response, and low inertia. However, due to the existence of various sources of error, it is unavoidable to bring uncertain cable lengths and lead to pose errors of the end-effector. The inverse kinematic model of a CDPR for picking up medicines is established by considering radii of fixed pulleys. The influence of radii of fixed pulleys on errors of cable lengths is explored. Error transfer model of the CDPR is constructed, and uncertain sources of cable lengths are analyzed. Based on evidence theory and error transfer model, an evidence theory-based uncertainty analysis method (ETUAM) is presented. The structural performance function for kinematic response is derived based on the error transfer model. Belief and plausibility measures of joint focal elements under the given threshold are obtained. Kinematic error simulations show that errors of cable lengths become larger with the increase of radii of fixed pulleys. Compared with the vertex method and Monte Carlo method, numerical examples demonstrate the accuracy and efficiency of the ETUAM when it comes to the kinematic uncertainty analysis of the CDPR.

High speed visual insect swarm tracker (Hi-VISTA) used to identify the effects of confinement on individual insect flight

Individual insects flying in crowded assemblies perform complex aerial maneuvers by sensing and feeding back neighbor measurements to small changes in their wing motions. To understand the individual feedback rules that permit these fast, adaptive behaviors in group flight, both experimental preparations inducing crowded flight and high-speed tracking systems capable of tracking both body motions and more subtle wing motion changes for multiple insects in simultaneous flight are needed. This measurement capability extends tracking beyond the previous focus on individual insects to multiple insects. This paper describes an experimental preparation that induces crowded insect flight in more naturalistic conditions (a laboratory-outdoor transition tunnel) and directly compares the resulting flight performance to traditional flight enclosures. Measurements are made possible via the introduction of a multi-agent high speed insect tracker called Hi-VISTA, which provides a capability to track wing and body motions of multiple insects using high speed cameras (9000-12 500 fps). Processing steps consist of automatic background identification, data association, hull reconstruction, segmentation, and feature measurement. To improve the biological relevance of laboratory experiments and develop a platform for interaction studies, this paper applies the Hi-VISTA measurement system toApis melliferaforagers habituated to transit flights through the transparent transition environment. Binary statistical analysis (Welch's t-test, Cohen's d effect size) of 95 flight trajectories is presented, quantifying the differences between flights in an unobstructed environment and in a confined tunnel volume. The results indicate that body pitch angle, heading rate, flapping frequency, and vertical speed (heave) are each affected by confinement, and other flight variables show minor or statistically insignificant changes. These results form a baseline as swarm tracking and analysis begins to isolate the effects of neighbors from environmental enclosures, and improve the connection of high speed insect laboratory experiments to outdoor field experiments.

The function of pitching in Beetle's flight revealed by insect-wearable backpack

The study of insect flight orientation is important for investigating flapping-wing aerodynamics and designing bioinspired micro air vehicles (MAVs). Pitch orientation plays a vital role in flight control, which has been explored less than directional control. In this study, the role of pitching maneuvers in flight was revealed by mounting an insect-wearable backpack on a beetle, which transformed the live insect into a bioelectronic device. The flight status of the cyborg beetle in a large chamber was recorded wirelessly. Accordingly, the pitch angle and forward acceleration showed a strong linear relationship. The coupling of pitch angle and forward acceleration was due to a tilted net aerodynamic force and the induced air drag. Moreover, the left and right subalar muscles of the beetle, a pair of major flight muscles, were electrically stimulated in free flight on demand to pitch up the beetle's body. We demonstrated that the induced nose-up movements were effective for decelerating the beetle in air. The flight orientation findings from the flying cyborgs would inspire a new approach to the study of flapping-wing flight and control of flapping-wing MAVs.

Review of methods for animal videography using camera systems that automatically move to follow the animal

Digital photography and videography provide rich data for the study of animal behavior and are consequently widely used techniques. For fixed, unmoving cameras, the image sensor and optics govern the field of view and spatial detail. For a given sensor resolution, the optics determine a tradeoff between high magnification in which high spatial detail from a restricted field of view is obtained versus low magnification in which lower spatial detail is obtained from a larger region. In addition to this geometric resolution versus field of view tradeoff, limited light availability establishes a physical limit when imaging movement. If the animal is moving, motion blur smears the subject on the sensor during exposure. Practically, motion blur is further compounded by sensor inefficiency and noise. While these fundamental tradeoffs with stationary cameras can be sidestepped by employing multiple cameras and providing additional illumination, this may not always be desirable. An alternative that overcomes these issues of stationary cameras is to direct a high magnification camera at an animal continually as it moves. Here we review systems in which automatic tracking is used to maintain an animal in the working volume of a moving optical path. Such methods provide an opportunity to escape the tradeoff between resolution and field of view and also to reduce motion blur while still enabling automated image acquisition. We argue that further development will be useful and outline potential innovations that may improve the technology and lead to more widespread use.

Wearable Vibration Sensor for Measuring the Wing Flapping of Insects

In this study, we fabricated a novel wearable vibration sensor for insects and measured their wing flapping. An analysis of insect wing deformation in relation to changes in the environment plays an important role in understanding the underlying mechanism enabling insects to dynamically interact with their surrounding environment. It is common to use a high-speed camera to measure the wing flapping; however, it is difficult to analyze the feedback mechanism caused by the environmental changes caused by the flapping because this method applies an indirect measurement. Therefore, we propose the fabrication of a novel film sensor that is capable of measuring the changes in the wingbeat frequency of an insect. This novel sensor is composed of flat silver particles admixed with a silicone polymer, which changes the value of the resistor when a bending deformation occurs. As a result of attaching this sensor to the wings of a moth and a dragonfly and measuring the flapping of the wings, we were able to measure the frequency of the flapping with high accuracy. In addition, as a result of simultaneously measuring the relationship between the behavior of a moth during its search for an odor source and its wing flapping, it became clear that the frequency of the flapping changed depending on the frequency of the odor reception. From this result, a wearable film sensor for an insect that can measure the displacement of the body during a particular behavior was fabricated.

Enhancing insect flight research with a lab-on-cables

A cable-driven robot that tracks flying insects at close range offers a useful method to study insects in free flight.