Autonomous Laparoscopic Robotic Suturing with a Novel Actuated Suturing Tool and 3D Endoscope

Artificial Intelligence in Urologic Robotic Oncologic Surgery: A Narrative Review

With the rapid increase in computer processing capacity over the past two decades, machine learning techniques have been applied in many sectors of daily life. Machine learning in therapeutic settings is also gaining popularity. We analysed current studies on machine learning in robotic urologic surgery. We searched PubMed/Medline and Google Scholar up to December 2023. Search terms included "urologic surgery", "artificial intelligence", "machine learning", "neural network", "automation", and "robotic surgery". Automatic preoperative imaging, intraoperative anatomy matching, and bleeding prediction has been a major focus. Early artificial intelligence (AI) therapeutic outcomes are promising. Robot-assisted surgery provides precise telemetry data and a cutting-edge viewing console to analyse and improve AI integration in surgery. Machine learning enhances surgical skill feedback, procedure effectiveness, surgical guidance, and postoperative prediction. Tension-sensors on robotic arms and augmented reality can improve surgery. This provides real-time organ motion monitoring, improving precision and accuracy. As datasets develop and electronic health records are used more and more, these technologies will become more effective and useful. AI in robotic surgery is intended to improve surgical training and experience. Both seek precision to improve surgical care. AI in ''master-slave'' robotic surgery offers the detailed, step-by-step examination of autonomous robotic treatments.

The current state of autonomous suturing: a systematic review

BACKGROUND

Robotic technology is an important tool in surgical innovation, with robots increasingly being used in the clinical setting. Robots can be used to enhance accuracy, perform remote actions, or to automate tasks. One such surgical task is suturing, a repetitive, fundamental component of surgery that can be tedious and time consuming. Suturing is a promising automation target because of its ubiquity, repetitive nature, and defined constraints. This systematic review examines research to date on autonomous suturing.

METHODS

A systematic review of the literature focused on autonomous suturing was conducted in accordance with PRISMA guidelines.

RESULTS

6850 articles were identified by searching PubMed, Embase, Compendex, and Inspec. Duplicates and non-English articles were removed. 4389 articles were screened and 4305 were excluded. Of the 84 remaining, 43 articles did not meet criteria, leaving 41 articles for final review. Among these, 34 (81%) were published after 2014. 31 (76%) were published in an engineering journal9 in a robotics journal, and 1 in a medical journal. The great majority of articles (33, 80%) did not have a specific clinical specialty focus, whereas 6 (15%) were focused on applications in MIS/laparoscopic surgery and 2 (5%) on applications in ophthalmology. Several suturing subtasks were identified, including knot tying, suture passing/needle insertion, needle passing, needle and suture grasping, needle tracking/kinesthesia, suture thread detection, suture needle shape production, instrument assignment, and suture accuracy. 14 articles were considered multi-component because they referred to several previously mentioned subtasks.

CONCLUSION

In this systematic review exploring research to date on autonomous suturing, 41 articles demonstrated significant progress in robotic suturing. This summary revealed significant heterogeneity of work, with authors focused on different aspects of suturing and a multitude of engineering problems. The review demonstrates increasing academic and commercial interest in surgical automation, with significant technological advances toward feasibility.

Scoping review: autonomous endoscopic navigation

This is a scoping review of artificial intelligence (AI) in flexible endoscopy (FE), encompassing both computer vision (CV) and autonomous actions (AA). While significant progress has been made in AI and FE, particularly in polyp detection and malignancy prediction, resulting in several available market products, these achievements only scratch the surface potential of AI in flexible endoscopy. Many doctors still do not fully grasp that contemporary robotic FE systems, which operate the endoscope through telemanipulation, represent the most basic autonomy level, specifically categorized as level 1. Although these console systems allow remote control, they lack the more sophisticated forms of autonomy. This manuscript aims to review the current examples of AI applications in FE and hopefully act as a stimulus for more advanced AA in FE.

Use of Artificial Intelligence in the Advancement of Breast Surgery and Implications for Breast Reconstruction: A Narrative Review

BACKGROUND

Breast reconstruction is a pivotal part of the recuperation process following a mastectomy and aims to restore both the physical aesthetic and emotional well-being of breast cancer survivors. In recent years, artificial intelligence (AI) has emerged as a revolutionary technology across numerous medical disciplines. This narrative review of the current literature and evidence analysis explores the role of AI in the domain of breast reconstruction, outlining its potential to refine surgical procedures, enhance outcomes, and streamline decision making.

METHODS

A systematic search on Medline (via PubMed), Cochrane Library, Web of Science, Google Scholar, Clinical Trials, and Embase databases from January 1901 to June 2023 was conducted.

RESULTS

By meticulously evaluating a selection of recent studies and engaging with inherent challenges and prospective trajectories, this review spotlights the promising role AI plays in advancing the techniques of breast reconstruction. However, issues concerning data quality, privacy, and ethical considerations pose hurdles to the seamless integration of AI in the medical field.

CONCLUSION

The future research agenda comprises dataset standardization, AI algorithm refinement, and the implementation of prospective clinical trials and fosters cross-disciplinary partnerships. The fusion of AI with other emergent technologies like augmented reality and 3D printing could further propel progress in breast surgery.

Evolution of a surgical system using deep learning in minimally invasive surgery (Review)

Recently, artificial intelligence (AI) has been applied in various fields due to the development of new learning methods, such as deep learning, and the marked progress in computational processing speed. AI is also being applied in the medical field for medical image recognition and omics analysis of genomes and other data. Recently, AI applications for videos of minimally invasive surgeries have also advanced, and studies on such applications are increasing. In the present review, studies that focused on the following topics were selected: i) Organ and anatomy identification, ii) instrument identification, iii) procedure and surgical phase recognition, iv) surgery-time prediction, v) identification of an appropriate incision line, and vi) surgical education. The development of autonomous surgical robots is also progressing, with the Smart Tissue Autonomous Robot (STAR) and RAVEN systems being the most reported developments. STAR, in particular, is currently being used in laparoscopic imaging to recognize the surgical site from laparoscopic images and is in the process of establishing an automated suturing system, albeit in animal experiments. The present review examined the possibility of fully autonomous surgical robots in the future.

Laparoscopic and Robot-Assisted Hepatic Surgery: An Historical Review

Hepatic surgery is a rapidly expanding component of abdominal surgery and is performed for a wide range of indications. The introduction of laparoscopic cholecystectomy in 1987 was a major change in abdominal surgery. Laparoscopic surgery was widely and rapidly adopted throughout the world for cholecystectomy initially and then applied to a variety of other procedures. Laparoscopic surgery became regularly applied to hepatic surgery, including segmental and major resections as well as organ donation. Many operations progressed from open surgery to laparoscopy to robot-assisted surgery, including colon resection, pancreatectomy, splenectomy thyroidectomy, adrenalectomy, prostatectomy, gastrectomy, and others. It is difficult to prove a data-based benefit using robot-assisted surgery, although laparoscopic and robot-assisted surgery of the liver are not inferior regarding major outcomes. When laparoscopic surgery initially became popular, many had concerns about its use to treat malignancies. Robot-assisted surgery is being used to treat a variety of benign and malignant conditions, and studies have shown no deterioration in outcomes. Robot-assisted surgery for the treatment of malignancies has become accepted and is now being used at more centers. The outcomes after robot-assisted surgery depend on its use at specialized centers, the surgeon's personal experience backed up by extensive training and maintenance of international registries. Robot-assisted hepatic surgery has been shown to be associated with slightly less intraoperative blood loss and shorter hospital lengths of stay compared to open surgery. Oncologic outcomes have been maintained, and some studies show higher rates of R0 resections. Patients who need surgery for liver lesions should identify a surgeon they trust and should not be concerned with the specific operative approach used. The growth of robot-assisted surgery of the liver has occurred in a stepwise approach which is very different from the frenzy that was seen with the introduction of laparoscopic cholecystectomy. This approach allowed the identification of areas for improvement, many of which are at the nexus of engineering and medicine. Further improvements in robot-assisted surgery depend on the combined efforts of engineers and surgeons.

A systematic review of robotic surgery: From supervised paradigms to fully autonomous robotic approaches

BACKGROUND

From traditional open surgery to laparoscopic surgery and robot-assisted surgery, advances in robotics, machine learning, and imaging are pushing the surgical approach to-wards better clinical outcomes. Pre-clinical and clinical evidence suggests that automation may standardise techniques, increase efficiency, and reduce clinical complications.

METHODS

A PRISMA-guided search was conducted across PubMed and OVID.

RESULTS

Of the 89 screened articles, 51 met the inclusion criteria, with 10 included in the final review. Automatic data segmentation, trajectory planning, intra-operative registration, trajectory drilling, and soft tissue robotic surgery were discussed.

CONCLUSION

Although automated surgical systems remain conceptual, several research groups have developed supervised autonomous robotic surgical systems with increasing consideration for ethico-legal issues for automation. Automation paves the way for precision surgery and improved safety and opens new possibilities for deploying more robust artificial intelligence models, better imaging modalities and robotics to improve clinical outcomes.

Autonomous robotic laparoscopic surgery for intestinal anastomosis

Autonomous robotic surgery has the potential to provide efficacy, safety, and consistency independent of individual surgeon's skill and experience. Autonomous anastomosis is a challenging soft-tissue surgery task because it requires intricate imaging, tissue tracking, and surgical planning techniques, as well as a precise execution via highly adaptable control strategies often in unstructured and deformable environments. In the laparoscopic setting, such surgeries are even more challenging because of the need for high maneuverability and repeatability under motion and vision constraints. Here we describe an enhanced autonomous strategy for laparoscopic soft tissue surgery and demonstrate robotic laparoscopic small bowel anastomosis in phantom and in vivo intestinal tissues. This enhanced autonomous strategy allows the operator to select among autonomously generated surgical plans and the robot executes a wide range of tasks independently. We then use our enhanced autonomous strategy to perform in vivo autonomous robotic laparoscopic surgery for intestinal anastomosis on porcine models over a 1-week survival period. We compared the anastomosis quality criteria-including needle placement corrections, suture spacing, suture bite size, completion time, lumen patency, and leak pressure-of the developed autonomous system, manual laparoscopic surgery, and robot-assisted surgery (RAS). Data from a phantom model indicate that our system outperforms expert surgeons' manual technique and RAS technique in terms of consistency and accuracy. This was also replicated in the in vivo model. These results demonstrate that surgical robots exhibiting high levels of autonomy have the potential to improve consistency, patient outcomes, and access to a standard surgical technique.

Vaginal Cuff Closure With Dual-Arm Robot and Near-Infrared Fluorescent Sutures

This paper presents a dual-arm suturing robot. We extend the Smart Tissue Autonomous Robot (STAR) with a second robot manipulator, whose purpose is to manage loose suture thread, a task that was previously executed by a human assistant. We also introduce novel near-infrared fluorescent (NIRF) sutures that are automatically segmented and delimit the boundaries of the suturing task. During ex-vivo experiments of porcine models, our results demonstrate that this new system is capable of outperforming human surgeons in all but one metric for the task of vaginal cuff closure (porcine model) and is more consistent in every aspect of the task. We also present results to demonstrate that the system can perform a vaginal cuff closure during an in-vivo experiment (porcine model).

A Confidence-Based Supervised-Autonomous Control Strategy for Robotic Vaginal Cuff Closure

Autonomous robotic suturing has the potential to improve surgery outcomes by leveraging accuracy, repeatability, and consistency compared to manual operations. However, achieving full autonomy in complex surgical environments is not practical and human supervision is required to guarantee safety. In this paper, we develop a confidence-based supervised autonomous suturing method to perform robotic suturing tasks via both Smart Tissue Autonomous Robot (STAR) and surgeon collaboratively with the highest possible degree of autonomy. Via the proposed method, STAR performs autonomous suturing when highly confident and otherwise asks the operator for possible assistance in suture positioning adjustments. We evaluate the accuracy of our proposed control method via robotic suturing tests on synthetic vaginal cuff tissues and compare them to the results of vaginal cuff closures performed by an experienced surgeon. Our test results indicate that by using the proposed confidence-based method, STAR can predict the success of pure autonomous suture placement with an accuracy of 94.74%. Moreover, via an additional 25% human intervention, STAR can achieve a 98.1% suture placement accuracy compared to an 85.4% accuracy of completely autonomous robotic suturing. Finally, our experiment results indicate that STAR using the proposed method achieves 1.6 times better consistency in suture spacing and 1.8 times better consistency in suture bite sizes than the manual results.

An Optimization-Based Algorithm for Trajectory Planning of an Under-Actuated Robotic Arm to Perform Autonomous Suturing

In single-port access surgeries, robot size is crucial due to the limited workspace. Thus, a robot may be designed under-actuated. Suturing, in contrast, is a complicated task and requires full actuation. This study aims to overcome this shortcoming by implementing an optimization-based algorithm for autonomous suturing for an under-actuated robot. The proposed algorithm approximates the ideal suturing trajectory by slightly reorienting the needle while deviating as little as possible from the ideal, full degree-of-freedom suturing case. The deviation of the path taken by a custom robot with respect to the ideal trajectory varies depending on the suturing starting location within the workspace as well as the needle size. A quantitative analysis reveals that in 13% of the investigated workspace, the accumulative deviation was less than 10 mm. In the remaining workspace, the accumulative deviation was less than 30 mm. Likewise, the accumulative deviation of a needle with a radius of 10 mm was 2.2 mm as opposed to 8 mm when the radius was 20 mm. The optimization-based algorithm maximized the accuracy of a four-DOF robot to perform a path-constrained trajectory and illustrates the accuracy-workspace correlation.

Supervised Autonomous Electrosurgery via Biocompatible Near-Infrared Tissue Tracking Techniques

Autonomous robotic surgery systems aim to improve patient outcomes by leveraging the repeatability and consistency of automation and also reducing human induced errors. However, intraoperative autonomous soft tissue tracking and robot control still remains a challenge due to the lack of structure, and high deformability of such tissues. In this paper, we take advantage of biocompatible Near-Infrared (NIR) marking methods and develop a supervised autonomous 3D path planning, filtering, and control strategy for our Smart Tissue Autonomous Robot (STAR) to enable precise and consistent incisions on complex 3D soft tissues. Our experimental results on cadaver porcine tongue samples indicate that the proposed strategy reduces surface incision error and depth incision error by 40.03% and 51.5%, respectively, compared to a teleoperation strategy via da Vinci. Furthermore, compared to an autonomous path planning method with linear interpolation between the NIR markers, the proposed strategy reduces the incision depth error by 48.58% by taking advantage of 3D tissue surface information.

Semi-autonomous Robotic Anastomoses of Vaginal Cuffs Using Marker Enhanced 3D Imaging and Path Planning

Autonomous robotic anastomosis has the potential to improve surgical outcomes by performing more consistent suture spacing and bite size compared to manual anastomosis. However, due to soft tissue's irregular shape and unpredictable deformation, performing autonomous robotic anastomosis without continuous tissue detection and three-dimensional path planning strategies remains a challenging task. In this paper, we present a novel three-dimensional path planning algorithm for Smart Tissue Autonomous Robot (STAR) to enable semi-autonomous robotic anastomosis on deformable tissue. The algorithm incorporates (i) continuous detection of 3D near infrared (NIR) markers manually placed on deformable tissue before the procedure, (ii) generating a uniform and consistent suture placement plan using 3D path planning methods based on the locations of the NIR markers, and (iii) updating the remaining suture plan after each completed stitch using a non-rigid registration technique to account for tissue deformation during anastomosis. We evaluate the path planning algorithm for accuracy and consistency by comparing the anastomosis of synthetic vaginal cuff tissue completed by STAR and a surgeon. Our test results indicate that STAR using the proposed method achieves 2.6 times better consistency in suture spacing and 2.4 times better consistency in suture bite sizes than the manual anastomosis.