Robotic-Assisted Colonoscopy Platform with a Magnetically-Actuated Soft-Tethered Capsule

Bioinspired Stimuli-Responsive Materials for Soft Actuators

Biological species can walk, swim, fly, jump, and climb with fast response speeds and motion complexity. These remarkable functions are accomplished by means of soft actuation organisms, which are commonly composed of muscle tissue systems. To achieve the creation of their biomimetic artificial counterparts, various biomimetic stimuli-responsive materials have been synthesized and developed in recent decades. They can respond to various external stimuli in the form of structural or morphological transformations by actively or passively converting input energy into mechanical energy. They are the core element of soft actuators for typical smart devices like soft robots, artificial muscles, intelligent sensors and nanogenerators. Significant progress has been made in the development of bioinspired stimuli-responsive materials. However, these materials have not been comprehensively summarized with specific actuation mechanisms in the literature. In this review, we will discuss recent advances in biomimetic stimuli-responsive materials that are instrumental for soft actuators. Firstly, different stimuli-responsive principles for soft actuators are discussed, including fluidic, electrical, thermal, magnetic, light, and chemical stimuli. We further summarize the state-of-the-art stimuli-responsive materials for soft actuators and explore the advantages and disadvantages of using electroactive polymers, magnetic soft composites, photo-thermal responsive polymers, shape memory alloys and other responsive soft materials. Finally, we provide a critical outlook on the field of stimuli-responsive soft actuators and emphasize the challenges in the process of their implementation to various industries.

A Framework for the Evaluation of Human Machine Interfaces of Robot-Assisted Colonoscopy

The Human Machine Interface (HMI) of intraluminal robots has a crucial impact on the clinician's performance. It increases or decreases the difficulty of the tasks, and is connected to the users' physical and mental stress.

OBJECTIVE

This article presents a framework to compare and evaluate different HMIs for robotic colonoscopy, with the objective of identifying the optimal HMI that minimises the clinician's effort and maximises the clinical outcomes.

METHODS

The framework comprises a 1) a virtual simulator (clinically validated), 2) wearable sensors measuring the cognitive load, 3) a data collection unit of metrics correlated to the clinical performance, and 4) questionnaires exploring the users' impressions and perceived stress. The framework was tested with 42 clinicians investigating the optimal device for tele-operated control of robotic colonoscopes. Two control devices were selected and compared: a haptic serial-kinematic device and a standard videogame joypad.

RESULTS

The haptic device was preferred by the endoscopists, but the joypad enabled better clinical performance and reduced cognitive and physical load.

CONCLUSION

The framework can be used to evaluate different aspects of a HMI, both hardware and software, and determine the optimal HMI that can reduce the burden on clinicians while improving the clinical outcome.

SIGNIFICANCE

The findings of this study, and of future studies performed with this framework, can inform the design and development of HMIs for intraluminal robots, leading to improved clinical performance, reduced physical and mental stress for clinicians, and ultimately better patient outcomes.

Endoluminal Procedures and Devices for Esophageal Tract Investigation: A Critical Review

Diseases of the esophageal tract represent a heterogeneous class of pathological conditions for which diagnostic paradigms continue to emerge. In the last few decades, innovative diagnostic devices have been developed, and several attempts have been made to advance and standardize diagnostic algorithms to be compliant with medical procedures. To the best of our knowledge, a comprehensive review of the procedures and available technologies to investigate the esophageal tract was missing in the literature. Therefore, the proposed review aims to provide a comprehensive analysis of available endoluminal technologies and procedures to investigate esophagus health conditions. The proposed systematic review was performed using PubMed, Scopus, and Web of Science databases. Studies have been divided into categories based on the type of evaluation and measurement that the investigated technology provides. In detail, three main categories have been identified, i.e., endoluminal technologies for the (i) morphological, (ii) bio-mechanical, and (iii) electro-chemical evaluation of the esophagus.

Robotic Colonoscopy and Beyond: Insights into Modern Lower Gastrointestinal Endoscopy

Lower gastrointestinal endoscopy is considered the gold standard for the diagnosis and removal of colonic polyps. Delays in colonoscopy following a positive fecal immunochemical test increase the likelihood of advanced adenomas and colorectal cancer (CRC) occurrence. However, patients may refuse to undergo conventional colonoscopy (CC) due to fear of possible risks and pain or discomfort. In this regard, patients undergoing CC frequently require sedation to better tolerate the procedure, increasing the risk of deep sedation or other complications related to sedation. Accordingly, the use of CC as a first-line screening strategy for CRC is hampered by patients' reluctance due to its invasiveness and anxiety about possible discomfort. To overcome the limitations of CC and improve patients' compliance, several studies have investigated the use of robotic colonoscopy (RC) both in experimental models and in vivo. Self-propelling robotic colonoscopes have proven to be promising thanks to their peculiar dexterity and adaptability to the shape of the lower gastrointestinal tract, allowing a virtually painless examination of the colon. In some instances, when alternatives to CC and RC are required, barium enema (BE), computed tomographic colonography (CTC), and colon capsule endoscopy (CCE) may be options. However, BE and CTC are limited by the need for subsequent investigations whenever suspicious lesions are found. In this narrative review, we discussed the current clinical applications of RC, CTC, and CCE, as well as the advantages and disadvantages of different endoscopic procedures, with a particular focus on RC.

Robotic, self-propelled, self-steerable, and disposable colonoscopes: Reality or pipe dream? A state of the art review

Robotic colonoscopes could potentially provide a comfortable, less painful and safer alternative to standard colonoscopy. Recent exciting developments in this field are pushing the boundaries to what is possible in the future. This article provides a comprehensive review of the current work in robotic colonoscopes including self-propelled, steerable and disposable endoscopes that could be alternatives to standard colonoscopy. We discuss the advantages and disadvantages of these systems currently in development and highlight the technical readiness of each system to help the reader understand where and when such systems may be available for routine clinical use and get an idea of where and in which situation they can best be deployed.

Robotic Autonomy for Magnetic Endoscope Biopsy

Magnetically actuated endoscopes are currently transitioning in to clinical use for procedures such as colonoscopy, presenting numerous benefits over their conventional counterparts. Intelligent and easy-to-use control strategies are an essential part of their clinical effectiveness due to the un-intuitive nature of magnetic field interaction. However, work on developing intelligent control for these devices has mainly been focused on general purpose endoscope navigation. In this work, we investigate the use of autonomous robotic control for magnetic colonoscope intervention via biopsy, another major component of clinical viability. We have developed control strategies with varying levels of robotic autonomy, including semi-autonomous routines for identifying and performing targeted biopsy, as well as random quadrant biopsy. We present and compare the performance of these approaches to magnetic endoscope biopsy against the use of a standard flexible endoscope on bench-top using a colonoscopy training simulator and silicone colon model. The semi-autonomous routines for targeted and random quadrant biopsy were shown to reduce user workload with comparable times to using a standard flexible endoscope.

Transanal Local Excision or Endoscopic Dissection for Benign and Large Lesions of the Rectum

Since the introduction of transanal endoscopic microsurgery, local excision of "early" rectal lesions has offered the possibility to reduce the invasiveness of treatment for the limited disease. Flexible endoscopy techniques allow today different alternatives consisting of endoscopic mucosal resection or endoscopic submucosal dissection. The first is a straightforward and relatively easy technique, but it prevents a correct pathological staging of the lesion due to fragmentation and the verification of disease-free margins. The second relies on operators' audacity depending on their increasing experience due to the limited progress in technology. What is the preferable technique today is questionable. All the methods have pros and cons. The future certainly will see the use of ideal systems, allowing the possibility of precision surgery for partial- or full-thickness excision, depending on intraoperative findings, and the extension above the rectosigmoid junction. Miniaturized flexible robotic devices may represent the solution for both issues.

Application of robotic technologies in lower gastrointestinal tract endoscopy: A systematic review

BACKGROUND

Conventional optical colonoscopy is considered the gold standard investigation for colorectal tract pathology including colorectal malignancy, polyps and inflammatory bowel disease. Inherent limitations exist with current generation endoscopic technologies, including, but not limited to, patient discomfort, endoscopist fatigue, narrow field of view and missed pathology behind colonic folds. Rapid developments in medical robotics have led to the emergence of a variety of next-generation robotically-augmented technologies that could overcome these limitations.

AIM

To provide a comprehensive summary of recent developments in the application of robotics in lower gastrointestinal tract endoscopy.

METHODS

A systematic review of the literature was performed from January 1, 2000 to the January 7, 2021 using EMBASE, MEDLINE and Cochrane databases. Studies reporting data on the use of robotic technology in ex vivo or in vivo animal and human experiments were included. In vitro studies (studies using synthetic colon models), studies evaluating non-robotic technology, robotic technology aimed at the upper gastrointestinal tract or paediatric endoscopy were excluded. System ergonomics, safety, visualisation, and diagnostic/therapeutic capabilities were assessed.

RESULTS

Initial literature searching identified 814 potentially eligible studies, from which 37 were deemed suitable for inclusion. Included studies were classified according to the actuation modality of the robotic device(s) as electromechanical (EM) (n = 13), pneumatic (n = 11), hydraulic (n = 1), magnetic (n = 10) and hybrid (n = 2) mechanisms. Five devices have been approved by the Food and Drug Administration, however most of the technologies reviewed remain in the early phases of testing and development. Level 1 evidence is lacking at present, but early reports suggest that these technologies may be associated with improved pain and safety. The reviewed devices appear to be ergonomically capable and efficient though to date no reports have convincingly shown diagnostic or therapeutic superiority over conventional colonoscopy.

CONCLUSION

Significant progress in robotic colonoscopy has been made over the last couple of decades. Improvements in design together with the integration of semi-autonomous and autonomous systems over the next decade will potentially result in robotic colonoscopy becoming more commonplace.

Small bowel to closest human body surface distance calculation through a custom-made software using CT-based datasets

Screening of the gastrointestinal tract is imperative for the detection and treatment of physiological and pathological disorders in humans. Ingestible devices (e.g., magnetic capsule endoscopes) represent an alternative to conventional flexible endoscopy for reducing the invasiveness of the procedure and the related patient's discomforts. However, to properly design localization and navigation strategies for capsule endoscopes, the knowledge of anatomical features is paramount. Therefore, authors developed a semi-automatic software for measuring the distance between the small bowel and the closest human external body surface, using CT colonography images. In this study, volumetric datasets of 30 patients were processed by gastrointestinal endoscopists with the dedicated custom-made software and results showed an average distance of 79.29 ± 23.85 mm.

Descending-sigmoid colon flexure - An important but surprisingly ignored landmark

BACKGROUND

In invasive examinations of the colon, e.g. colonoscopy, the tortuosity of the colon is a crucial factor for successful completion of the procedure. If adjacent segments of the colon bend at acute angles (under 90°), endoscopy may become difficult and troublesome.

METHODS

We retrospectively enroled 227 individuals (96 female, 131 male) who underwent abdominopelvic computed tomography examination. For inclusion, subjects were required to have a negative history for colonic disease and abdominopelvic surgery. We measured the angle between the descending colon and the proximal part of the sigmoid (in degrees). In addition, the position of the descending-sigmoid flexure was assessed in relation to the left anterior superior iliac spine, the median plane, and anterior aspect of the 5th lumbar vertebra (in mm). The study protocol was reviewed and approved by the local ethics committee.

RESULTS

We visualised the descending-sigmoid flexure in all 227 subjects. In one third of cases, the flexure formed an angle smaller than/or 90°. In females, this landmark (mean ± standard deviation) was located 30.2 ± 8.4 mm from the left anterior superior iliac spine, 88.6 ± 14.2 mm from the median plane, and 115.4 ± 21.4 mm from the anterior aspect of the 5th lumbar vertebra. In males, the dimensions were: 32.1 ± 12.8 mm, 97.6 ± 15.8 mm, and 123.9 ± 22.9 mm, respectively. This landmark distance remained constant from the left anterior superior iliac spine regardless of subject age, height and weight. The other measured distances were related to age, height, weight or BMI.

CONCLUSIONS

The descending-sigmoid flexure is an important landmark in large intestine morphology situated approximately width of two fingers (3 cm) from the left anterior superior iliac spine and one hand width (9-10 cm) from the median plane. In approximately one third of the subjects, the flexure formed an angle of less than/or 90°, which can cause a problem during colonoscopy.

Endorobots for Colonoscopy: Design Challenges and Available Technologies

Colorectal cancer (CRC) is the second most common cause of cancer death worldwide, after lung cancer (Sung et al., 2021). Early stage detection is key to increase the survival rate. Colonoscopy remains to be the gold standard procedure due to its dual capability to optically inspect the entire colonic mucosa and to perform interventional procedures at the same time. However, this causes pain and discomfort, whereby it requires sedation or anaesthesia of the patient. It is a difficult procedure to perform that can cause damage to the colonic wall in some cases. Development of new technologies aims to overcome the current limitations on colonoscopy by using advancements in endorobotics research. The design of these advanced medical devices is challenging because of the limited space of the lumen, the contorted shape, and the long tract of the large bowel. The force applied to the colonic wall needs to be controlled to avoid collateral effects such as injuries to the colonic mucosa and pain during the procedure. This article discusses the current challenges in the colonoscopy procedure, the available locomotion technologies for endorobots used in colonoscopy at a prototype level and the commercial products available.

Endoluminal Motion Recognition of a Magnetically-Guided Capsule Endoscope Based on Capsule-Tissue Interaction Force

A magnetically-guided capsule endoscope, embedding flexible force sensors, is designed to measure the capsule-tissue interaction force. The flexible force sensor is composed of eight force-sensitive elements surrounding the internal permanent magnet (IPM). The control of interaction force acting on the intestinal wall can reduce patient's discomfort and maintain the magnetic coupling between the external permanent magnet (EPM) and the IPM during capsule navigation. A flexible force sensor can achieve this control. In particular, by analyzing the signals of the force sensitive elements, we propose a method to recognize the status of the motion of the magnetic capsule, and provide corresponding formulas to evaluate whether the magnetic capsule follows the motion of the external driving magnet. Accuracy of the motion recognition in Ex Vivo tests reached 94% when the EPM was translated along the longitudinal axis. In addition, a method is proposed to realign the EPM and the IPM before the loss of their magnetic coupling. Its translational error, rotational error, and runtime are 7.04 ± 0.71 mm, 3.13 ± 0.47∘, and 11.4 ± 0.39 s, respectively. Finally, a control strategy is proposed to prevent the magnetic capsule endoscope from losing control during the magnetically-guided capsule colonoscopy.

Training Simulators for Gastrointestinal Endoscopy: Current and Future Perspectives

Simple Summary

Over the last decades, visual endoscopy has become a gold standard for the detection and treatment of gastrointestinal cancers. However, mastering endoscopic procedures is complex and requires long hours of practice. In this context, simulation-based training represents a valuable opportunity for acquiring technical and cognitive skills, suiting the different trainees’ learning pace and limiting the risks for the patients. In this regard, the present contribution aims to present a critical and comprehensive review of the current technology for gastrointestinal (GI) endoscopy training, including both commercial products and platforms at a research stage. Not limited to it, the recent revolution played by the technological advancements in the fields of robotics, artificial intelligence, virtual/augmented reality, and computational tools on simulation-based learning is documented and discussed. Finally, considerations on the future trend of this application field are drawn, highlighting the impact of the most recent pandemic and the current demographic trends.

Abstract

Gastrointestinal (GI) endoscopy is the gold standard in the detection and treatment of early and advanced GI cancers. However, conventional endoscopic techniques are technically demanding and require visual-spatial skills and significant hands-on experience. GI endoscopy simulators represent a valid solution to allow doctors to practice in a pre-clinical scenario. From the first endoscopy mannequin, developed in 1969, several simulation platforms have been developed, ranging from purely mechanical systems to more complex mechatronic devices and animal-based models. Considering the recent advancement of technologies (e.g., artificial intelligence, augmented reality, robotics), simulation platforms can now reach high levels of realism, representing a valid and smart alternative to standard trainee/mentor learning programs. This is particularly true nowadays, when the current demographic trend and the most recent pandemic demand, more than ever, the ability to cope with many patients. This review offers a broad view of the technology available for GI endoscopy training, including platforms currently in the market and the relevant advancements in this research and application field. Additionally, new training needs and new emerging technologies are discussed to understand where medical education is heading.

Automatic lumen detection and magnetic alignment control for magnetic-assisted capsule colonoscope system optimization

We developed a magnetic-assisted capsule colonoscope system with integration of computer vision-based object detection and an alignment control scheme. Two convolutional neural network models A and B for lumen identification were trained on an endoscopic dataset of 9080 images. In the lumen alignment experiment, models C and D used a simulated dataset of 8414 images. The models were evaluated using validation indexes for recall (R), precision (P), mean average precision (mAP), and F1 score. Predictive performance was evaluated with the area under the P-R curve. Adjustments of pitch and yaw angles and alignment control time were analyzed in the alignment experiment. Model D had the best predictive performance. Its R, P, mAP, and F1 score were 0.964, 0.961, 0.961, and 0.963, respectively, when the area of overlap/area of union was at 0.3. In the lumen alignment experiment, the mean degrees of adjustment for yaw and pitch in 160 trials were 21.70° and 13.78°, respectively. Mean alignment control time was 0.902 s. Finally, we compared the cecal intubation time between semi-automated and manual navigation in 20 trials. The average cecal intubation time of manual navigation and semi-automated navigation were 9 min 28.41 s and 7 min 23.61 s, respectively. The automatic lumen detection model, which was trained using a deep learning algorithm, demonstrated high performance in each validation index.