Design and evaluation of new user control devices for improved ergonomics in flexible robotic endoscopy

Background

The ergonomics of flexible endoscopes require improvement as the current design carries a high risk of musculoskeletal injury for endoscopists. Robotic systems offer a solution by separating the endoscope from the control handle, allowing a focus on ergonomics and usability. Despite the increasing interest in this field, little attention has been paid towards developing ergonomic human input devices. This study addresses two key questions: How can handheld control devices for flexible robotic endoscopy be designed to prioritize ergonomics and usability? And, how effective are these new devices in a simulated clinical environment?

Methods

Addressing this gap, the study proposes two handheld input device models for controlling a flexible endoscope in four degrees of freedom (DOFs) and an endoscopic instrument in three DOFs. A two-stage evaluation was conducted with six endoscopists evaluating the physical ergonomics and a final clinical user evaluation with seven endoscopists using a virtual colonoscopy simulator with proportional velocity and position mapping.

Results and discussion

Both models demonstrated clinical suitability, with the first model scoring 4.8 and the second model scoring 5.2 out of 6 in the final evaluation. In sum, the study presents two designs of ergonomic control devices for robotic colonoscopy, which have the potential to reduce endoscopy-related injuries. Furthermore, the proposed colonoscopy simulator is useful to evaluate the benefits of different mapping modes. This could help to optimize the design and control mechanism of future control devices.

Evaluation of current and emerging endoluminal robotic platforms using the IDEAL framework

BACKGROUND

Robotic-assisted endoluminal systems are rapidly evolving within the field of minimally invasive surgery. The IDEAL framework (Idea, Development, Exploration, Assessment, and Surveillance) can be used to evaluate novel technologies. This review provides a summary of current and emerging endoluminal systems using the IDEAL framework.

METHODS

A scoping review was conducted to include all existing and developing robotic-assisted endoluminal systems. Data was collected via virtual interviews, questionnaires, biomedical databases, company websites, and peer-reviewed articles. Key metrics were reported, enabling the assignment of each system to an IDEAL stage.

RESULTS

The review identified 17 distinct systems from 16 companies. Nine systems received regulatory approval in their respective countries. Our evaluation showed that two systems were at the pre-IDEAL Stage 0. Seven systems were in the Idea stage (Stage 1), six systems were in the Development stage (Stage 2) and two systems completed Stage 3. No system underwent long-term study evaluation (Stage 4).

CONCLUSIONS

There is a gap in long-term clinical data of robotic-assisted endoluminal systems, indicated by the absence of systems at Stage 4. Collaborative efforts amongst the medical community, regulatory bodies, and industry specialists are vital to ensure the delivery of evidence-based medicine in the discipline of robotics.

SAM: Semi-Active Mechanism for Extensible Continuum Manipulator and Real-Time Hysteresis Compensation Control Algorithm

BACKGROUND

Cable-driven continuum manipulators (CDCMs) enable scar-free procedures but face limitations in workspace and control accuracy due to hysteresis.

METHODS

We introduce an extensible CDCM with a semi-active mechanism (SAM) and develop a real-time hysteresis compensation control algorithm using a temporal convolution network (TCN) based on data collected from fiducial markers and RGBD sensing.

RESULTS

Performance validation shows the proposed controller significantly reduces hysteresis by up to 69.5% in random trajectory tracking test and approximately 26% in the box pointing task.

CONCLUSION

The SAM mechanism enables access to various lesions without damaging surrounding tissues. The proposed controller with TCN-based compensation effectively predicts hysteresis behaviour and minimises position and joint angle errors in real-time, which has the potential to enhance surgical task performance.

Endoluminal robotics

The search for less-invasive approaches led to the birth of endoluminal surgery 40 years ago. The limited dexterity of flexible endoscopic systems generated an interest in the development of robotic platforms to encourage the adoption of surgical-like, bimanual techniques involving manipulation of tissues, thus favoring organ preservation. Nevertheless, the road ahead for endoluminal surgery is still at the beginning.

Real-Time Shape Estimation of Hyper-Redundant Flexible Manipulator Using Coiled Fiber Sensors

The shape of flexible endoscopic surgical robot should be obtained to increase control accuracy and prevent unwanted tissue damage. To estimate the shape of flexible manipulator, space efficiency, cost-effectiveness, system complexity, and ease of calibration should be considered to integrate sensors into the manipulator. In this article, we propose a real-time method to estimate the shape of a hyper-redundant manipulator having embedded coiled fiber sensors. The main advantage of this method is guaranteeing shape recognition even when the manipulator is subjected to an external load. The fiber sensors are highly flexible, compact, and inexpensive, as well as they can functionally measure both compressive and tensile strain of hyper-redundant manipulator. The sensor design was optimized to achieve durability and sensitivity. The numbers of sensor and the placements were determined by the analysis of the kinematics and moment distribution of the manipulator. The accuracy of shape estimation was validated experimentally under both free-loading and loading conditions. The proposed method achieved real-time estimating capability with a mean maximum error of each joint position smaller than 3.54% in free-loading condition and 5.47% in loading condition.

Design and Modelling of Continuum Robot for Endoscopic Submucosal Dissection Surgery With Lifting Force Estimation

BACKGROUND

Endoscopic submucosal dissection (ESD) is an effective treatment for early-stage gastrointestinal cancers. However, traditional surgical instruments lack accuracy and force-sensing.

METHODS

A new type of continuum robot for ESD is designed. An accurate static model of the proposed continuum robot is established, considering cases where the robot bends into C-shapes and S-shapes. A force estimation method based on an accurate static model is proposed. Then, the accuracy of the static model and force estimation is verified through experiments. Finally, an ex-organ experiment is carried out.

RESULTS

The average position error of the proposed static model is 0.72 mm, accounting for 2.57% of the total robot length. The average error of force estimation is 19.53 mN. By gripping and cutting ex-porcine gastric mucosa, the robot's functionality is validated.

CONCLUSION

This paper contributes to precise control and safe interaction of continuum robots.

Efficacy of robot arm-assisted endoscopic submucosal dissection in live porcine stomach (with video)

Endoscopic submucosal dissection (ESD) is technically challenging and requires a high level of skill. However, there is no effective method of exposing the submucosal plane during dissection. In this study, the efficacy of robot arm-assisted tissue traction for gastric ESD was evaluated using an in vivo porcine model. The stomach of each pig was divided into eight locations. In the conventional ESD (C-ESD) group, one ESD was performed at each location (N = 8). In the robot arm-assisted ESD (R-ESD) group, two ESDs were performed at each location (N = 16). The primary endpoint was the submucosal dissection speed (mm2/s). The robot arm could apply tissue traction in the desired direction and successfully expose the submucosal plane during submucosal dissection in all lesion locations. The submucosal dissection speed was significantly faster in the R-ESD group than in the C-ESD group (p = 0.005). The blind dissection rate was significantly lower in the R-ESD group (P = 0.000). The robotic arm-assisted traction in ESD enabled a significant improvement in submucosal dissection speed, blind dissection rate which suggests the potential for making ESD easier and enhancing procedural efficiency and safety.

Stereo Visual Servoing Control of a Soft Endoscope for Upper Gastrointestinal Endoscopic Submucosal Dissection

Quickly and accurately completing endoscopic submucosal dissection (ESD) operations within narrow lumens is currently challenging because of the environment's high flexibility, invisible collision, and natural tissue motion. This paper proposes a novel stereo visual servoing control for a dual-segment robotic endoscope (DSRE) for ESD surgery. Departing from conventional monocular-based methods, our DSRE leverages stereoscopic imaging to rapidly extract precise depth data, enabling quicker controller convergence and enhanced surgical accuracy. The system's dual-segment configuration enables agile maneuverability around lesions, while its compliant structure ensures adaptability within the surgical environment. The implemented stereo visual servo controller uses image features for real-time feedback and dynamically updates gain coefficients, facilitating rapid convergence to the target. In visual servoing experiments, the controller demonstrated strong performance across various tasks. Even when subjected to unknown external forces, the controller maintained robust performance in target tracking. The feasibility and effectiveness of the DSRE were further verified through ex vivo experiments. We posit that this novel system holds significant potential for clinical application in ESD surgeries.

Novel miniature transendoscopic telerobotic system for endoscopic submucosal dissection (with videos)

BACKGROUND AND AIMS

The lack of tissue traction and instrument dexterity to allow for adequate visualization and effective dissection were the main issues in performing endoscopic submucosal dissection (ESD). Robot-assisted systems may provide advantages. In this study we developed a novel transendoscopic telerobotic system and evaluated its performance in ESD.

METHODS

A miniature dual-arm robotic endoscopic assistant for minimally invasive surgery (DREAMS) was developed. The DREAMS system contained the current smallest robotic ESD instruments and was compatible with the commercially available dual-channel endoscope. After the system was established, a prospective randomized controlled study was conducted to validate the performance of the DREAMS-assisted ESD in terms of efficacy, safety, and workload by comparing it with the conventional technique.

RESULTS

Two robotic instruments can achieve safe collaboration and provide sufficient visualization and efficient dissection during ESD. Forty ESDs in the stomach and esophagus of 8 pigs were completed by DREAMS-assisted ESD or conventional ESD. Submucosal dissection time was comparable between the 2 techniques, but DREAMS-assisted ESD demonstrated a significantly lower muscular injury rate (15% vs 50%, P = .018) and workload scores (22.30 vs 32.45, P < .001). In the subgroup analysis of esophageal ESD, DREAMS-assisted ESD showed significantly improved submucosal dissection time (6.45 vs 16.37 minutes, P = .002), muscular injury rate (25% vs 87.5%, P = .041), and workload (21.13 vs 40.63, P = .001).

CONCLUSIONS

We developed a novel transendoscopic telerobotic system, named DREAMS. The safety profile and technical feasibility of ESD were significantly improved with the assistance of the DREAMS system, especially in the narrower esophageal lumen.

A novel miniature flexible robotic system for endoscopic mucosal dissection: an animal experimental study

Endoscopic submucosal dissection (ESD) is a standard treatment for early gastrointestinal cancer due to its higher rate of en-bloc resection and lower recurrence rate. However, the technical challenges lead to long learning curve and high risks of adverse events. A gastrointestinal flexible robotic-tool system (GIFTS) was proposed to reduce the difficulty and shorten the learning curve of novices. This is an animal study to evaluate the feasibility of GIFTS in ESD. The GIFTS provides a total of 13 degrees of freedom within 10 mm in diameter and variable stiffness function to achieve endoscopic intervention and submucosal dissection with the cooperation of two flexible robotic instruments. One esophageal and four colorectal ESDs in five porcine models were performed. In all five ESD procedures, the GIFTS was successfully intubated and submucosal dissection was completed without perforation or significant bleeding, and there was no system fault. The mean operative time was 99 min, and the mean size of the specimen was 151 mm2. The fifth experiment showed significantly better results than the first one. In vivo animal experiments confirmed the feasibility of GIFTS in performing ESD. The control of GIFTS is friendly to inexperienced beginners, which will help reduce the technical challenges of ESD and shorten the learning curve of endoscopists.

Advanced Endoscopy for Thoracic Surgeons

The thoracic surgeon, well versed in advanced endoscopy, has an array of therapeutic options for foregut pathologic conditions. Peroral endoscopic myotomy (POEM) offers a less-invasive means to treat achalasia, and the authors' preferred approach is described in this article. They also describe variations of POEM, such as G-POEM, Z-POEM, and D-POEM. In addition, endoscopic stenting, endoluminal vacuum therapy, endoscopic internal drainage, and endoscopic suturing/clipping are discussed and can be valuable tools for esophageal leaks and perforations. Endoscopic procedures are advancing rapidly, and thoracic surgeons must maintain at the forefront of these technologies.

A Robotized Soft Endoscope with Stereo Vision for Upper Gastrointestinal Endoscopic Submucosal Dissection (ESD)

This work presents a novel dual-segment flexible robotic endoscope designed to enhance reachability and dexterity during ESD surgery. The proposed system is capable of executing multi-angle cutting operations at a small angle relative to the lesion surface, allowing for efficient en-bloc resection. Additionally, the system incorporates two calibrated RGB cameras and a depth estimation algorithm to provide detailed 3D information of the tumour, which is used to guide the control framework. A stereo visual servoing controller is also implemented to improve path-following performance during surgery. Experiments results indicate that the proposed system improves motion stability and precision. The root means square error (RMSE) of circle path following is 1.1991mm with a maximum of 1.4751mm. Ex-vivo testing demonstrates its significant potential for use in endoscopic surgery.

Robotic endoscope with double-balloon and double-bend tube for colonoscopy

The insertion of conventional colonoscopes can sometimes cause patients to experience pain during the procedure owing to the stretching of the mesentery. In this study, a prototype of a robotic colonoscope with a double-balloon and double-bend tube based on the conventional double-balloon endoscope was developed to simplify insertion and prevent the overstretching of the colon. Both the outer and inner tubes were confirmed to be free from interference from wires and sheaths. Additionally, all functions such as tip bending, inflation and deflation of the balloons, and actuator-driven pulling and pushing of the inner tube were operated properly. During the insertion test, the device could be reached the cecum of a colon model in approximately 442 s when operated by a non-medical operator. In addition, the device did not overstretch the colon model, thereby suggesting that the insertion mechanism can follow the shape of the colon model. As a result, the developed mechanism has the potential to navigate through a highly-bent colon without overstretching.

User interfaces for actuated scope maneuvering in surgical systems: a scoping review

BACKGROUND

A variety of human computer interfaces are used by robotic surgical systems to control and actuate camera scopes during minimally invasive surgery. The purpose of this review is to examine the different user interfaces used in both commercial systems and research prototypes.

METHODS

A comprehensive scoping review of scientific literature was conducted using PubMed and IEEE Xplore databases to identify user interfaces used in commercial products and research prototypes of robotic surgical systems and robotic scope holders. Papers related to actuated scopes with human-computer interfaces were included. Several aspects of user interfaces for scope manipulation in commercial and research systems were reviewed.

RESULTS

Scope assistance was classified into robotic surgical systems (for multiple port, single port, and natural orifice) and robotic scope holders (for rigid, articulated, and flexible endoscopes). Benefits and drawbacks of control by different user interfaces such as foot, hand, voice, head, eye, and tool tracking were outlined. In the review, it was observed that hand control, with its familiarity and intuitiveness, is the most used interface in commercially available systems. Control by foot, head tracking, and tool tracking are increasingly used to address limitations, such as interruptions to surgical workflow, caused by using a hand interface.

CONCLUSION

Integrating a combination of different user interfaces for scope manipulation may provide maximum benefit for the surgeons. However, smooth transition between interfaces might pose a challenge while combining controls.

Time-Optimal Trajectory Planning of Flexible Manipulator Moving along Multi-Constraint Continuous Path and Avoiding Obstacles

To solve the trajectory planning problem of the flexible manipulator under various constraints such as end-camera attitude, drive space, and obstacles during video inspection along a continuous path in narrow three-dimensional space, this paper proposes a time-optimal trajectory planning method from the initial configuration to the final configuration. The trajectory planning problem is transformed into a multi-constraint optimization problem. First, to realize continuous video inspection in an unstructured complex environment, by analyzing the geometric model of the two-segment flexible manipulator with a camera at the end, the pose constraints between the camera and the shooting surface are formulated by the space vector method, the driving constraints are formulated based on kinematics, and the obstacle constraints are formulated by space mapping. Then, a multi-constraint optimization model is constructed to generate the smooth trajectory of the drive cable of the flexible manipulator by minimizing the total time of continuous path motion. Compared with the conventional point-to-point collision avoidance planning solution method, this paper starts from the global perspective and investigates the less considered continuous path trajectory planning problem; also, the swarm intelligence algorithm artificial jellyfish search algorithm (JS) is employed to optimize the solution and find the minimum time trajectory conforming to a variety of complex constraints. Finally, a simulation is conducted with CoppeliaSim, and the continuous path video inspection experiment is carried out in the 500KV GIS (Gas Insulated Switchgear) equipment, the simulation and experimental results indicate that the planned drive cable trajectory is smooth and effective. In addition, each path point is tracked and obstacles are avoided safely. When the flexible manipulator moves along the whole path, the pose of the camera satisfies the relaxed attitude constrain The proposed method can guide the two-segment flexible manipulator to complete the continuous video inspection task of the GIS cavity wall and conductive column surface.

2.5-mm articulated endoluminal forceps using a compliant mechanism

PURPOSE

Gastrointestinal cancer can be treated using a flexible endoscope through a natural orifice. However, treatment instruments with limited degrees of freedom (DOFs) require a highly skilled operator. Articulated devices useful for endoluminal procedures, such as endoscopic submucosal dissection and biopsy, have been developed. These devices enable dexterous operation in a narrow lumen; however, they suffer from limitations such as large size and high cost. To overcome these limitations, we developed a 2.5-mm articulated forceps that can be inserted into a standard endoscope channel based on a compliant mechanism.

METHODS

The compliant mechanism allows the device to be compact and affordable, which is possible due to its monolithic structure. The proposed mechanism consists of two segments, 1-DOF grasping and 2-DOF bending, that are actuated by tendon-sheath mechanisms. A prototype was designed based on finite element analysis results.

RESULTS

To confirm the effectiveness of the proposed mechanism, we fabricated the prototype using a 3D printer. A series of mechanical performance tests on the prototype revealed that it achieved the following specifications: (1) DOF: 1-DOF grasping + 2-DOF bending, (2) outer diameter: 2.5 mm, (3) length of the bending segment: 30 mm, and (4) range of motion: [Formula: see text] to [Formula: see text] (grasping) and [Formula: see text] to [Formula: see text] (bending). Finally, we performed a tissue manipulation test on an excised porcine colon and found that a piece of mucous membrane tissue was successfully resected using an electric knife while being lifted with the developed forceps.

CONCLUSION

The results of the evaluation experiment demonstrated a positive feasibility of the proposed mechanism, which has a simpler structure compared to those of other conventional mechanisms; furthermore, it is potentially more cost-effective and is disposable. The mechanical design, prototype implementation, and evaluations are reported in this paper.

Endoscopic surgery robot that facilitates insertion of the curved colon and ensures positional stability against external forces: K-COLON

BACKGROUND

Although various endoscopic surgery robots developed in previous studies are versatile and have high lesion accessibility, they have limitations in terms of reaching the target lesion through the curved path in the large intestine and providing a stable tasking environment for the operator.

METHODS

An endoscopic surgery robot was developed for performing surgery in the large intestine. The robot was easily inserted into the target lesion in the curved colon through the mounted soft actuator and demonstrated high structural stiffness through the insertion of the sigmoidal auxiliary tendons.

RESULTS

The robot was able to access the target lesion in the curved colon through teleoperation alone. Further, it was confirmed that the high structural stiffness overtube improved the overall task performance in the user test.

CONCLUSIONS

The proposed robotic system demonstrated the possibility and potential of performing advanced endoscopic surgery in the large intestine.

Miniature Manipulator Design and Cartesian Control for Minimally Invasive Transluminal Endoscopic Surgery

This paper presents a miniature manipulator under Cartesian control for minimally invasive transluminal endoscopic surgery. The manipulator had four degrees of freedom (DoFs) and a diameter of only 3.5 mm. The compact size of the manipulator allowed it to pass through the instrument channel of the endoscope, and its high dexterity allowed it to perform most of the operations in endoscopic surgery such as marking, grasping, hanging, etc. The implicit function relationship in the kinematics of the continuum manipulator was analyzed. By introducing the regression analysis method, the analytical form of the inverse kinematics was obtained. The distribution of singularities in the manipulator workspace was analyzed with emphasis. The presence of singularities made Cartesian mapping control between the primary side and secondary side impossible. By introducing the smoothing method of the joint trajectory, the discontinuity of the joint velocity at the singularity was avoided and the primary-secondary mapping under Cartesian control was realized. The trajectory-tracking experiment proved that the smoothness of the joint trajectory could make the manipulator smoothly pass through the singularity. The fixed-point marking experiment proved that the Cartesian control could improve the intuition of operation and the efficiency of task completion. Comprehensive performance experiments showed that the manipulator had enough dexterity to execute complex operations.

Progress in Control-Actuation Robotic System for Gastrointestinal NOTES Development

Purpose

Natural orifice transluminal endoscopic surgery (NOTES) is a minimally invasive surgical procedure that reduces patient trauma, infection probability, and rehabilitation time. This paper reviews the progress made in the control-actuation robotic systems for gastrointestinal NOTES development. Material and Methods. A survey on both existing and state-of-the-art control-actuation robotic systems for gastrointestinal NOTES was conducted in December 2021.

Results

Nine control-actuation robotic systems for gastrointestinal NOTES were identified. The structures and specifications of these robotic systems were reported. The technical parameters were also discussed. Special attention was directed to systems using a control-actuation structure and tendon-driven mechanism. The control-actuation robotic systems typically deploy a control-actuation structure and tendon-driven mechanism. Control-actuation robotic systems for gastrointestinal NOTES show great ability to improve operational accuracy and flexibility and flatten the learning curve of procedures. These characteristics suggest that the use of control-actuation robotic systems is worth exploring in future development.

Robotic, self-propelled, self-steerable, and disposable colonoscopes: Reality or pipe dream? A state of the art review

Robotic colonoscopes could potentially provide a comfortable, less painful and safer alternative to standard colonoscopy. Recent exciting developments in this field are pushing the boundaries to what is possible in the future. This article provides a comprehensive review of the current work in robotic colonoscopes including self-propelled, steerable and disposable endoscopes that could be alternatives to standard colonoscopy. We discuss the advantages and disadvantages of these systems currently in development and highlight the technical readiness of each system to help the reader understand where and when such systems may be available for routine clinical use and get an idea of where and in which situation they can best be deployed.

Sigmoidal Auxiliary Tendon-Driven Mechanism Reinforcing Structural Stiffness of Hyper-Redundant Manipulator for Endoscopic Surgery

The overtube of an endoscopic surgery robot is fixed when performing tasks, unlike those of commercial endoscopes, and this overtube should have high structural stiffness after reaching the target lesion so that sufficient tension can be applied to the lesion tissue with the surgical tool and there are fewer changes in the field of view of the endoscopic camera from this reaction force. Various methods have been proposed to reinforce the structural stiffnesses of hyper-redundant manipulators. However, the safety, rapid response, space efficiency, and cost-effectiveness of these methods should be considered for use in actual clinical environments, such as the gastrointestinal tract. This study proposed a method to minimize the positional changes of the overtube end tip due to external forces using only auxiliary tendons in the optimized path without additional mechanical structures. Overall, the proposed method involved moving the overtube to the target lesion through the main driving tendon and applying tension to the auxiliary tendons to reinforce the structural stiffness. The complete system was analyzed in terms of energy, and the sigmoidal auxiliary tendons were verified to effectively reinforce the structural stiffness of the overtube consisting of rolling joints. In addition, the design guidelines of the overtube for actual endoscopic surgery were proposed considering hollowness, retroflexion, and high structural stiffness. The positional changes due to external forces were confirmed to be reduced by 60% over the entire workspace.

Coupling Effect Suppressed Compact Surgical Robot with 7-Axis Multi-Joint Using Wire-Driven Method

Currently, the most prevalent surgical treatment method is laparoscopic surgery. Robotic surgery has many advantages over laparoscopic surgery. Therefore, robotic surgery technology is currently constantly evolving. The advantages of robotic surgery are that it can minimize incision, bleeding, and sequelae. Other advantages of robotic surgery are that it can reduce hospitalization, recovery period, and side effects. The appeal of robotic surgery is that it requires fewer surgical personnel compared to laparoscopic surgery. This paper proposes an ultra-compact 7-axis vertical multi-joint robot that employs the wire-driven method for minimally invasive surgery. The proposed robot analyzes the degree of freedom and motion coupling for control. The robot joint is composed of a total of seven joints, and among them, the 7-axis joint operates the forceps. At this time, the forceps joint (#7 axis) can only operate open and close functions, while the link is bent and rotatable, regardless of position change. This phenomenon can be analyzed by Forward Kinematics. Also, when the DOF rotates, the passing wires become twisted, and the wire is generated through length change and coupling phenomenon. The maximum rotation angle of DOF is 90° and the rotating passing wire is wound by the rotation of the wire pulley. If the DOF is rotated to the full range of 120°, the second DOF will be rotated to 90°, and at this time, the coupling phenomenon caused by the first DOF rotation can be eliminated. The length change and the robot joint angle change related to the motor drive, based on the surgical robot control using the wire-driven method, are correlated, and the values for the position and direction of the end effector of the robot can be obtained through a forward kinematic analysis. The coupling problem occurring in the wire connecting the robot driving part can be solved through a kinematic analysis. Therefore, it was possible to test the position of the slave robot and the performance of the surgical forceps movement using the master system.

A Dexterous Robotic System for Autonomous Debridement of Osteolytic Bone Lesions in Confined Spaces: Human Cadaver Studies

This article presents a dexterous robotic system for autonomous debridement of osteolytic bone lesions in confined spaces. The proposed system is distinguished from the state-of-the-art orthopedics systems because it combines a rigid-link robot with a continuum manipulator (CM) that enhances reach in difficult-to-access spaces often encountered in surgery. The CM is equipped with flexible debriding instruments and fiber Bragg grating sensors. The surgeon plans on the patient's preoperative computed tomography and the robotic system performs the task autonomously under the surgeon's supervision. An optimization-based controller generates control commands on the fly to execute the task while satisfying physical and safety constraints. The system design and controller are discussed and extensive simulation, phantom and human cadaver experiments are carried out to evaluate the performance, workspace, and dexterity in confined spaces. Mean and standard deviation of target placement are 0.5 and 0.18 mm, and the robotic system covers 91% of the workspace behind an acetabular implant in treatment of hip osteolysis, compared to the 54% that is achieved by conventional rigid tools.

Stress Dispersion Design in Continuum Compliant Structure toward Multi-DOF Endoluminal Forceps

Gastrointestinal cancer, when detected early, is treated by accessing the lesion through the natural orifice using flexible endoscopes. However, the limited degree-of-freedom (DOF) of conventional treatment devices and the narrow surgical view through the endoscope demand advanced techniques. In contrast, multi-DOF forceps systems are an excellent alternative; however, these systems often involve high fabrication costs because they require a large number of micro-parts. To solve this problem, we designed compact multi-DOF endoluminal forceps with a monolithic structure comprising compliant hinges. To allow an efficient stress dispersion at the base end when the hinge bends, we proposed a novel design method to obtain the hinge parameters using the beam of uniform strength theory. This method does not involve a high computational cost. The results show that the improved design with a variable hinge thickness can reduce the maximum bending stress, dispersing the stress in a larger area than that of the previous design considering a constant thickness of the hinge. Moreover, the experiments conducted in a prototype confirm that the radius of the curvature was significantly improved. The proposed method could aid in designing other continuum robots relying on compliant hinges.

A Three-Limb Teleoperated Robotic System with Foot Control for Flexible Endoscopic Surgery

Flexible endoscopy requires a lot of skill to manipulate both the endoscope and the associated instruments. In most robotic flexible endoscopic systems, the endoscope and instruments are controlled separately by two operators, which may result in communication errors and inefficient operation. Our solution is to enable the surgeon to control both the endoscope and the instruments. Here, we present a novel tele-operation robotic endoscopic system commanded by one operator using the continuous and simultaneous movements of their two hands and one foot. This 13-degree-of-freedom (DoF) system integrates a foot-controlled robotic flexible endoscope and two hand-controlled robotic endoscopic instruments, a robotic grasper and a robotic cauterizing hook. A dedicated foot-interface transfers the natural foot movements to the 4-DoF movements of the endoscope while two other commercial hand interfaces map the movements of the two hands to the two instruments individually. An ex-vivo experiment was carried out by six subjects without surgical experience, where the simultaneous control with foot and hands was compared with a sequential clutch-based hand control. The participants could successfully teleoperate the endoscope and the two instruments to cut the tissues at scattered target areas in a porcine stomach. Foot control yielded 43.7% faster task completion and required less mental effort as compared to the clutch-based hand control scheme, which proves the concept of three-limb tele-operation surgery and the developed flexible endoscopic system.

Development of a novel deployable arm for natural orifice transluminal endoscopic surgery

BACKGROUND

Natural orifice transluminal endoscopic surgery (NOTES) is aided by the instrument channel of an endoscope. Limited by the diameter of the endoscope, the construction of the operation triangle is affected. This paper presents a deployable arm that can increase the distance between the arms.

METHODS

The manipulation arm is composed of a continuum arm and a deployable arm. The deployable arm can be locked by a stay cable and a mechanical structure. The angle between the end-effectors and the common workspace of the two manipulation arms are comprehensively analysed. Through experiments, the design parameters are validated and justified.

RESULTS

The experiment shows that the deployment arm can maintain the deformation within 3.5 mm under a 300 g load, and the angle between the two end-effectors can be maintained within the range of [88°, 110°].

CONCLUSIONS

The novel deployment arms enlarge the angle between the end effectors, which significantly improves the flexibility of the arms.

Surgical Robot for Intraluminal Access: An Ex Vivo Feasibility Study

Early-stage gastrointestinal cancer is often treated by endoscopic submucosal dissection (ESD) using a flexible endoscope. Compared with conventional percutaneous surgery, ESD is much less invasive and provides a high quality of life for the patient because it does not require a skin incision, and the organ is preserved. However, the operator must be highly skilled because ESD requires using a flexible endoscope with energy devices, which have limited degrees of freedom. To facilitate easier manipulation of these flexible devices, we developed a surgical robot comprising a flexible endoscope and two articulating instruments. The robotic system is based on a conventional flexible endoscope, and an extrapolated motor unit moves the endoscope in all its degrees of freedom. The instruments are thin enough to allow insertion of two instruments into the endoscope channel, and each instrument has a bending section that allows for up–down, right–left, and forward–backward motion. In this study, we performed an ex vivo feasibility evaluation using the proposed robotic system for ESD in a porcine stomach. The procedure was successfully performed by five novice operators without complications. Our findings demonstrated the feasibility of the proposed robotic system and, furthermore, suggest that even operators with limited experience can use this system to perform ESD.

easyEndo robotic endoscopy system: Development and usability test in a randomized controlled trial with novices and physicians

BACKGROUND

Some difficulties are common when using endoscopes. Steering is not intuitive, the endoscope weight is a physical burden to physicians and communication problems often occur between operators.

METHOD

To overcome these, we developed a robotic endoscopy system and conducted a usability test to compare conventional and robotic manipulation. Nine novices and eighteen physicians participated with the physicians being divided into intermediate and expert groups. The participants performed endoscope insertion into a simulator (physicians) or lesion marking on a testbed (novices) and simulate biopsies.

RESULT

Novices completed the tasks faster and with a lower workload when using robotic manipulation, whereas the experts showed the opposite trend. Still, the intermediates showed no significant difference as trials proceeded. Nevertheless, the learning curve analysis showed that the learning rate in all groups is greater for robotic manipulation (21.02% on average) than for conventional manipulation (13.75%) and predicted that physicians can reach manual performance.

CONCLUSION

The proposed robotic endoscopy system may allow solo-manipulation using one controller and may be more intuitive and convenient to use than conventional manipulation.