Flexible Gastro-intestinal Endoscopy - Clinical Challenges and Technical Achievements

Robotics in interventional endoscopy-evolution and the way forward

The integration of robotics into gastrointestinal (GI) endoscopy represents a transformative advancement and bears the potential to bridge the gap between traditional limitations by offering unprecedented precision and control in diagnostic and therapeutic procedures. This review explores the historical progression, current applications and future potential of robotic platforms in GI endoscopy. Originally designed for surgical applications, robotic systems have expanded their reach into endoscopy, potentially enhancing procedural accuracy and reducing ergonomic strain on practitioners. Natural Orifice Transluminal Endoscopic Surgery (NOTES) emerged as a promising technique, leveraging natural orifices to perform minimally invasive surgeries. Despite its initial potential, several factors, including limitations of the available instrumentations and lack of reliable closure techniques, hindered its widespread adoption and progress. Conventional endoscopic tools often fall short in terms of triangulation, traction and degrees of freedom, necessitating the adoption of robotic interventions. Over recent decades, robotic endoscopy has significantly evolved, focusing on both diagnostic and complex therapeutic procedures such as endoscopic sub-mucosal dissection (ESD) and endoscopic full-thickness resection (EFTR). Various robotic platforms demonstrate enhanced safety and efficiency in GI procedures. As the field progresses, the emphasis on clinical validation, advanced training and the exploration of new applications remains crucial. Continuous innovation in robotic technology and endoscopic techniques promises to overcome existing limitations, further revolutionizing the management of GI diseases and improving patient outcomes.

SimCol3D - 3D reconstruction during colonoscopy challenge

Colorectal cancer is one of the most common cancers in the world. While colonoscopy is an effective screening technique, navigating an endoscope through the colon to detect polyps is challenging. A 3D map of the observed surfaces could enhance the identification of unscreened colon tissue and serve as a training platform. However, reconstructing the colon from video footage remains difficult. Learning-based approaches hold promise as robust alternatives, but necessitate extensive datasets. Establishing a benchmark dataset, the 2022 EndoVis sub-challenge SimCol3D aimed to facilitate data-driven depth and pose prediction during colonoscopy. The challenge was hosted as part of MICCAI 2022 in Singapore. Six teams from around the world and representatives from academia and industry participated in the three sub-challenges: synthetic depth prediction, synthetic pose prediction, and real pose prediction. This paper describes the challenge, the submitted methods, and their results. We show that depth prediction from synthetic colonoscopy images is robustly solvable, while pose estimation remains an open research question.

A novel endoscopy image fusion system: combine white light imaging and compound band imaging

PURPOSE

White light imaging (WLI) is a commonly seen examination mode in endoscopy. The particular light in compound band imaging (CBI) can highlight delicate structures, such as capillaries and tiny structures on the mucosal surface. These two modes complement each other, and doctors switch between them manually to complete the examination. This paper proposes an endoscopy image fusion system to combine WLI and CBI.

METHODS

We add a real-time rotatable color wheel in the light source device of the AQ-200 endoscopy system to achieve rapid imaging of two modes at the same position of living tissue. The two images corresponding to the pixel level can avoid registration and lay the foundation for image fusion. We propose a multi-scale image fusion framework, which involves Laplacian pyramid (LP) and convolutional sparse representation (CSR) and strengthens the details in the fusion rule.

RESULTS

Volunteer experiments and ex vivo pig stomach trials are conducted to verify the feasibility of our proposed system. We also conduct comparative experiments with other image fusion methods, evaluate the quality of the fused images, and verify the effectiveness of our fusion framework. The results show that our fused image has rich details, high color contrast, apparent structures, and clear lesion boundaries.

CONCLUSION

An endoscopy image fusion system is proposed, which does not change the doctor's operation and makes the fusion of WLI and CBI optical staining technology a reality. We change the light source device of the endoscope, propose an image fusion framework, and verify the feasibility and effectiveness of our scheme. Our method fully integrates the advantages of WLI and CBI, which can help doctors make more accurate judgments than before. The endoscopy image fusion system is of great significance for improving the detection rate of early lesions and has broad application prospects.

Artificial Intelligence in endoscopy: A future poll

Artificial Intelligence [AI] has been a trendy topic in recent years, with many developed medical applications. In gastrointestinal endoscopy, AI systems include computer-assisted detection [CADe] for lesion detection as bleedings and polyps and computer-assisted diagnosis [CADx] for optical biopsy and lesion characterization. The technology behind these systems is based on a computer algorithm that is trained for a specific function. This function could be to recognize or characterize target lesions such as colonic polyps. Moreover, AI systems can offer technical assistance to improve endoscopic performance as scope insertion guidance. Currently, we believe that such technologies still lack legal and regulatory validations as a large sector of doctors and patients have concerns. However, there is no doubt that these technologies will bring significant improvement in the endoscopic management of patients as well as save money and time.

Clinical applications of robotic surgery platforms: a comprehensive review

Robotic surgery has expanded globally across various medical specialties since its inception more than 20 years ago. Accompanying this expansion were significant technological improvements, providing tremendous benefits to patients and allowing the surgeon to perform with more precision and accuracy. This review lists some of the different types of platforms available for use in various clinical applications. We performed a literature review of PubMed and Web of Science databases in May 2023, searching for all available articles describing surgical robotic platforms from January 2000 (the year of the first approved surgical robot, da Vinci® System, by Intuitive Surgical) until May 1st, 2023. All retrieved robotic platforms were then divided according to their clinical application into four distinct groups: soft tissue robotic platforms, orthopedic robotic platforms, neurosurgery and spine platforms, and endoluminal robotic platforms. Robotic surgical technology has undergone a rapid expansion over the last few years. Currently, multiple robotic platforms with specialty-specific applications are entering the market. Many of the fields of surgery are now embracing robotic surgical technology. We review some of the most important systems in clinical practice at this time.

A novel miniature flexible robotic system for endoscopic mucosal dissection: an animal experimental study

Endoscopic submucosal dissection (ESD) is a standard treatment for early gastrointestinal cancer due to its higher rate of en-bloc resection and lower recurrence rate. However, the technical challenges lead to long learning curve and high risks of adverse events. A gastrointestinal flexible robotic-tool system (GIFTS) was proposed to reduce the difficulty and shorten the learning curve of novices. This is an animal study to evaluate the feasibility of GIFTS in ESD. The GIFTS provides a total of 13 degrees of freedom within 10 mm in diameter and variable stiffness function to achieve endoscopic intervention and submucosal dissection with the cooperation of two flexible robotic instruments. One esophageal and four colorectal ESDs in five porcine models were performed. In all five ESD procedures, the GIFTS was successfully intubated and submucosal dissection was completed without perforation or significant bleeding, and there was no system fault. The mean operative time was 99 min, and the mean size of the specimen was 151 mm2. The fifth experiment showed significantly better results than the first one. In vivo animal experiments confirmed the feasibility of GIFTS in performing ESD. The control of GIFTS is friendly to inexperienced beginners, which will help reduce the technical challenges of ESD and shorten the learning curve of endoscopists.

Untethered shape-changing devices in the gastrointestinal tract

INTRODUCTION

Advances in microfabrication, automation, and computer engineering seek to revolutionize small-scale devices and machines. Emerging trends in medicine point to smart devices that emulate the motility, biosensing abilities, and intelligence of cells and pathogens that inhabit the human body. Two important characteristics of smart medical devices are the capability to be deployed in small conduits, which necessitates being untethered, and the capacity to perform mechanized functions, which requires autonomous shape-changing.

AREAS COVERED

We motivate the need for untethered shape-changing devices in the gastrointestinal tract for drug delivery, diagnosis, and targeted treatment. We survey existing structures and devices designed and utilized across length scales from the macro to the sub-millimeter. These devices range from triggerable pre-stressed thin film microgrippers and spring-loaded devices to shape-memory and differentially swelling structures.

EXPERT OPINION

Recent studies demonstrate that when fully enabled, tether-free and shape-changing devices, especially at sub-mm scales, could significantly advance the diagnosis and treatment of GI diseases ranging from cancer and inflammatory bowel disease (IBD) to irritable bowel syndrome (IBS) by improving treatment efficacy, reducing costs, and increasing medication compliance. We discuss the challenges and possibilities associated with ensuring safe, reliable, and autonomous operation of these smart devices.

PolyEffNetV1: A CNN based colorectal polyp detection in colonoscopy images

Presence of polyps is the root cause of colorectal cancer, hence identification of such polyps at an early stage can help in advance treatments to avoid complications to the patient. Since there are variations in the size and shape of polyps, the task of detecting them in colonoscopy images becomes challenging. Hence our work is to leverage an algorithm for segmentation and classification of the polyp of colonoscopy images using Deep learning algorithms. In this work, we propose PolypEffNetV1, a U-Net to segment the different pathologies present in the colonoscopy frame and EfficientNetB5 to classify the detected pathologies. The colonoscopy images for the segmentation process are taken from the open-source dataset KVASIR, it consists of 1000 images with "ground truth" labeling. For classification, combination of KVASIR and CVC datasets are incorporated, which consists of 1612 images with 1696 polyp regions and 760 non-polyp inflamed regions. The proposed PolypEffNetV1 produced testing accuracy of 97.1%, Jaccard index of 0.84, dice coefficient of 0.91, and F1-score of 0.89. Subsequently, for classification to evidence whether the segmented region is polyp or non-polyp inflammation, the developed classifier produced validation accuracy of 99%, specificity of 98%, and sensitivity of 99%. Hence the proposed system could be used by gastroenterologists to identify the presence of polyp in the colonoscopy images/videos which will in turn increase healthcare quality. These developed models can be either deployed on the edge of the device to enable real-time aidance or can be integrated with existing software-application for offline review and treatment planning.

A Novel Asymmetric Pneumatic Soft-Surgical Endoscope Design with Laminar Jamming

Soft pneumatic endoscopes developed for Minimally Invasive Surgeries (MIS) are designed upright which means that the starting positions straight. As the internal chambers are pressurized the endoscopic module starts bending. The relation between the pneumatic pressure and bending is nonlinear as the air needs first to fill the chamber before bending, and additionally frictional interaction to the sheath adds more to this start-up transient behaviour. This highly nonlinear behaviour severely limits the actuator sensitivity, accuracy, and repeatability near the endoscope's center of operating range. This paper introduces a novel pre-bent MR-compatible soft-surgical pneumatic endoscope design aimed to improve the bending performance of soft endoscopes by shifting the start-up transient out of the operating range. The pre-bent design of 12 mm diameter consists of an actuation and stiffening chamber, inextensible shell reinforcement with a backbone and rings, and external sheathing. The design parameters that include cross-sectional area, number of rings and backbone width are determined using Finite Element (FE) analysis. The motion profile of the fabricated endoscope, determined via experimentation, shows a successful shift of the start-up transient while the jamming structure increases the stiffness of the endoscope but limits the bending range. Further design developments of the endoscope are required for clinical application.

Endorobots for Colonoscopy: Design Challenges and Available Technologies

Colorectal cancer (CRC) is the second most common cause of cancer death worldwide, after lung cancer (Sung et al., 2021). Early stage detection is key to increase the survival rate. Colonoscopy remains to be the gold standard procedure due to its dual capability to optically inspect the entire colonic mucosa and to perform interventional procedures at the same time. However, this causes pain and discomfort, whereby it requires sedation or anaesthesia of the patient. It is a difficult procedure to perform that can cause damage to the colonic wall in some cases. Development of new technologies aims to overcome the current limitations on colonoscopy by using advancements in endorobotics research. The design of these advanced medical devices is challenging because of the limited space of the lumen, the contorted shape, and the long tract of the large bowel. The force applied to the colonic wall needs to be controlled to avoid collateral effects such as injuries to the colonic mucosa and pain during the procedure. This article discusses the current challenges in the colonoscopy procedure, the available locomotion technologies for endorobots used in colonoscopy at a prototype level and the commercial products available.

Evaluation of long-term stability of monolithic 3D-printed robotic manipulator structures for minimally invasive surgery

Purpose

In the era of patient-centered medicine, clinical procedures, tools and instruments should be individually adapted to the patient. In this context, the presented 3D-printed Single-Port Overtube Manipulator System follows the aims to provide patient- and task-specific disposable manipulators for minimally invasive surgery. In a first experiment, the robustness of the monolithic flexure hinge structures in use as robotic manipulators will be investigated.

Methods

Customizable monolithic manipulator structures designed by means of an automated design process and manufactured with selective laser sintering were investigated with regard to long-term stability in an endurance test. Therefore, a bare manipulator arm, an arm equipped with a standard instrument and finally loaded with an additional load of 0.5 N were evaluated by continuously following a trajectory within the workspace of the manipulator arms over a period of 90 min.

Results

The unloaded manipulator as well as the manipulator arm equipped with a standard instrument showed a sufficient reproducibility (deviation of 1.5 mm and 2.5 mm, respectively, on average) with regard to an application as telemanipulated master–slave surgical robotic system. The 3D-printed manipulators showed no damage and maintained integrity after the experiment.

Conclusion

It has been shown that 3D-printed manipulators in principle are suitable for use as disposable surgical manipulator systems and offer a long-term stability over at least 90 min. The developed manipulator design shows great potential for the production of patient-, task- and user-specific robot systems. However, the manipulator geometries as well as the control strategies still show room for improvements.

Frontiers of Robotic Colonoscopy: A Comprehensive Review of Robotic Colonoscopes and Technologies

Flexible colonoscopy remains the prime mean of screening for colorectal cancer (CRC) and the gold standard of all population-based screening pathways around the world. Almost 60% of CRC deaths could be prevented with screening. However, colonoscopy attendance rates are affected by discomfort, fear of pain and embarrassment or loss of control during the procedure. Moreover, the emergence and global thread of new communicable diseases might seriously affect the functioning of contemporary centres performing gastrointestinal endoscopy. Innovative solutions are needed: artificial intelligence (AI) and physical robotics will drastically contribute for the future of the healthcare services. The translation of robotic technologies from traditional surgery to minimally invasive endoscopic interventions is an emerging field, mainly challenged by the tough requirements for miniaturization. Pioneering approaches for robotic colonoscopy have been reported in the nineties, with the appearance of inchworm-like devices. Since then, robotic colonoscopes with assistive functionalities have become commercially available. Research prototypes promise enhanced accessibility and flexibility for future therapeutic interventions, even via autonomous or robotic-assisted agents, such as robotic capsules. Furthermore, the pairing of such endoscopic systems with AI-enabled image analysis and recognition methods promises enhanced diagnostic yield. By assembling a multidisciplinary team of engineers and endoscopists, the paper aims to provide a contemporary and highly-pictorial critical review for robotic colonoscopes, hence providing clinicians and researchers with a glimpse of the major changes and challenges that lie ahead.

Impact of new techniques on adenoma detection rate based on meta-analysis data

The high incidence of colorectal cancer and the occurrence of interval cancers after screening colonoscopy support the need to develop methods to increase adenoma detection rate (ADR). This review focuses on the importance of ADR and the impact of new techniques on ADR based on meta-analysis data. The low-cost interventions (such as water-aided colonoscopy, second observation, and dynamic position change) were effective in increasing ADR. So were enhanced imaging techniques and add-on devices. Increase with higher cost interventions such as newer scopes is uncertain. Water exchange (WE) has the highest ADR compared with water immersion, air insufflation, and carbon dioxide insufflation. Second observation with forward or retroflexed views improved the right colon ADR. Add-on devices result in only modest improvement in ADR, of particular help in low performing endoscopists. The second-generation narrow-band imaging (NBI) provided a two-fold brighter image than the previous system. The improvement in ADR with NBI required the "best" quality bowel preparation. New endoscopic techniques incur various additional costs, nil for WE, small for tip attachments but large for the newer scopes. In conclusion, one or more of the above methods to improve ADR may be applicable in Taiwan. A comparison of these approaches to determine which is the most cost-effective is warranted.

A review on recent advances in soft surgical robots for endoscopic applications

BACKGROUND

Soft materials, with their compliant properties, enable conformity and safe interaction with human body. With the advance in actuation and sensing of soft materials, new paradigm in robotics called "soft robotics" emerges. Soft robotics has become a new approach in designing medical devices such as wearable robotic gloves and exoskeleton. However, application of soft robotics in surgical instrument inside human body is still in its infancy.

AIMS

In this paper, current application and design of soft robots specifically applied for endoscopy are reviewed.

MATERIALS & METHODS

Different aspects in the implementation of soft robotics in endoscope design were reviewed. The key studies about MIS and NOTES were reviewed to establish the clinical background and extract the limitations of current endoscopic device in the last decade.

RESULTS AND DISCUSSION

In this review study, the implementation of soft robotics concepts in endoscopic application, with highlights on different features of several soft endoscopes, were evaluated. The progress in different aspects of soft robotics endoscope, current state, and future perspectives were also discussed.

CONCLUSION

Based on the survey on the structural specification, actuation, sensing, and stiffening the future soft surgical endoscopes are recommended to fulfil the following specifications: safe especially from pressure leakage, fully biocompatible materials, MR-compatible, capable for large bending in at least two antagonistic directions, modularity, adjustable stiffness.

Emerging next-generation robotic colonoscopy systems towards painless colonoscopy

Advances in the field of robotics have allowed modern technology to be integrated into medicine and that can minimize patients suffering from the side effects that are inherent to procedures for improving their quality of life. Conventional devices that are used for colonoscopies are rigid and require a high level of expertise from endoscopists to perform the procedure. Advances in robot-assisted colonoscopic systems now produce softer, more slender, automated designs that no longer require the operator to use forceful pushing to advance the colonoscope inside the colon, reducing risks to the patient of perforation and pain. It is challenging to reprocess these scopes for reuse as the materials used can be damaged during decontamination, leading to the possible risks of cross-infection by pathogenic microorganisms when reused by patients. An ideal solution is to eliminate these contamination risks to patients by adopting sterile, single-use scopes straight from the manufacturer's package to the patient. With this idea in mind, emerging developments that push the boundaries in this area will benefit patients and encourage the public to participate in and adhere better to colonoscopy screening to reduce the development of colorectal cancer. Thus, in light of these concerns and challenges, to encourage patients undergoing colorectal screening to comply with colonoscopy procedures that they are less invasive, changes in the design and materials are necessary. One of the more promising technological advances in this area is the advent of robotic colonoscopy.

Review of emerging surgical robotic technology

BACKGROUND

The use of laparoscopic and robotic procedures has increased in general surgery. Minimally invasive robotic surgery has made tremendous progress in a relatively short period of time, realizing improvements for both the patient and surgeon. This has led to an increase in the use and development of robotic devices and platforms for general surgery. The purpose of this review is to explore current and emerging surgical robotic technologies in a growing and dynamic environment of research and development.

METHODS

This review explores medical and surgical robotic endoscopic surgery and peripheral technologies currently available or in development. The devices discussed here are specific to general surgery, including laparoscopy, colonoscopy, esophagogastroduodenoscopy, and thoracoscopy. Benefits and limitations of each technology were identified and applicable future directions were described.

RESULTS

A number of FDA-approved devices and platforms for robotic surgery were reviewed, including the da Vinci Surgical System, Sensei X Robotic Catheter System, FreeHand 1.2, invendoscopy E200 system, Flex® Robotic System, Senhance, ARES, the Single-Port Instrument Delivery Extended Research (SPIDER), and the NeoGuide Colonoscope. Additionally, platforms were reviewed which have not yet obtained FDA approval including MiroSurge, ViaCath System, SPORT™ Surgical System, SurgiBot, Versius Robotic System, Master and Slave Transluminal Endoscopic Robot, Verb Surgical, Miniature In Vivo Robot, and the Einstein Surgical Robot.

CONCLUSIONS

The use and demand for robotic medical and surgical platforms is increasing and new technologies are continually being developed. New technologies are increasingly implemented to improve on the capabilities of previously established systems. Future studies are needed to further evaluate the strengths and weaknesses of each robotic surgical device and platform in the operating suite.

Optical coherence tomography in gastroenterology: a review and future outlook

Optical coherence tomography (OCT) is an imaging technique optically analogous to ultrasound that can generate depth-resolved images with micrometer-scale resolution. Advances in fiber optics and miniaturized actuation technologies allow OCT imaging of the human body and further expand OCT utilization in applications including but not limited to cardiology and gastroenterology. This review article provides an overview of current OCT development and its clinical utility in the gastrointestinal tract, including disease detection/differentiation and endoscopic therapy guidance, as well as a discussion of its future applications.