Augmented reality-guided artery-first pancreatico-duodenectomy

Virtual 3D models, augmented reality systems and virtual laparoscopic simulations in complicated pancreatic surgeries: state of art, future perspectives, and challenges

Pancreatic surgery is considered one of the most challenging interventions by many surgeons, mainly due to retroperitoneal location and proximity to key and delicate vascular structures. These factors make pancreatic resection a demanding procedure, with successful rates far from optimal and frequent postoperative complications. Surgical planning is essential to improve patient outcomes, and in this regard, many technological advances made in the last few years have proven to be extremely useful in medical fields. This review aims to outline the potential and limitations of 3D digital and 3D printed models in pancreatic surgical planning, as well as the impact and challenges of novel technologies such as augmented/virtual reality systems or artificial intelligence to improve medical training and surgical outcomes.

Beyond the visible: preliminary evaluation of the first wearable augmented reality assistance system for pancreatic surgery

PURPOSE

The retroperitoneal nature of the pancreas, marked by minimal intraoperative organ shifts and deformations, makes augmented reality (AR)-based systems highly promising for pancreatic surgery. This study presents preliminary data from a prospective study aiming to develop the first wearable AR assistance system, ARAS, for pancreatic surgery and evaluating its usability, accuracy, and effectiveness in enhancing the perioperative outcomes of patients.

METHODS

We developed ARAS as a two-phase system for a wearable AR device to aid surgeons in planning and operation. This system was used to visualize and register patient-specific 3D anatomical models during the surgery. The location and precision of the registered 3D anatomy were evaluated by assessing the arterial pulse and employing Doppler and duplex ultrasonography. The usability, accuracy, and effectiveness of ARAS were assessed using a five-point Likert scale questionnaire.

RESULTS

Perioperative outcomes of five patients underwent various pancreatic resections with ARAS are presented. Surgeons rated ARAS as excellent for preoperative planning. All structures were accurately identified without any noteworthy errors. Only tumor identification decreased after the preparation phase, especially in patients who underwent pancreaticoduodenectomy because of the extensive mobilization of peripancreatic structures. No perioperative complications related to ARAS were observed.

CONCLUSIONS

ARAS shows promise in enhancing surgical precision during pancreatic procedures. Its efficacy in preoperative planning and intraoperative vascular identification positions it as a valuable tool for pancreatic surgery and a potential educational resource for future surgical residents.

Augmented Reality Implementation in Minimally Invasive Surgery for Future Application in Pulmonary Surgery: A Systematic Review

OBJECTIVE

This systematic review investigates of Augmented Reality (AR) systems used in minimally invasive surgery of deformable organs, focusing on initial registration, dynamic tracking, and visualization. The objective is to acquire a comprehensive understanding of the current knowledge, applications, and challenges associated with current AR-techniques, aiming to leverage these insights for developing a dedicated AR pulmonary Video or Robotic Assisted Thoracic Surgery (VATS/RATS) workflow.

METHODS

A systematic search was conducted within Embase, Medline (Ovid) and Web of Science on April 16, 2024, following the Preferred Reporting items for Systematic Reviews and Meta-Analyses (PRISMA). The search focused on intraoperative AR applications and intraoperative navigational purposes for deformable organs. Quality assessment was performed and studies were categorized according to initial registration and dynamic tracking methods.

RESULTS

33 articles were included, of which one involved pulmonary surgery. Studies used both manual and (semi-) automatic registration methods, established through anatomical landmark-based, fiducial-based, or surface-based techniques. Diverse outcome measures were considered, including surgical outcomes and registration accuracy. The majority of studies that reached an registration accuracy below 5 mm applied surface-based registration.

CONCLUSIONS

AR can potentially aid surgeons with real-time navigation and decision making during anatomically complex minimally invasive procedures. Future research for pulmonary applications should focus on exploring surface-based registration methods, considering their non-invasive, marker-less nature, and promising accuracy. Additionally, vascular-labeling-based methods are worth exploring, given the importance and relative stability of broncho-vascular anatomy in pulmonary VATS/RATS. Assessing clinical feasibility of these approaches is crucial, particularly concerning registration accuracy and potential impact on surgical outcomes.

Enhancing Perioperative Outcomes of Pancreatic Surgery with Wearable Augmented Reality Assistance System: A Matched-Pair Analysis

Objective

The present study aimed to evaluate the safety of the first wearable augmented reality assistance system (ARAS) specifically designed for pancreatic surgery and its impact on perioperative outcomes.

Background

Pancreatic surgery remains highly complex and is associated with a high rate of perioperative complications. ARAS, as an intraoperative assistance system, has the potential to reduce these complications.

Methods

This prospective, single-center study included 20 patients who underwent pancreatic surgery using ARAS. These patients were matched in a 1:3 ratio with 60 patients from our retrospective data who underwent standard pancreatic resection. Matching variables were selected based on factors associated with poor intraoperative outcomes.

Results

A higher proportion of patients in the ARAS group were diagnosed with borderline resectable pancreatic cancer and received neoadjuvant chemotherapy (20.0% vs 6.7%, P = 0.085). Additionally, more patients in the ARAS group required arterial resection compared with the control group (15.0% vs 0.0%, P = 0.002). Nevertheless, the ARAS group had a significantly shorter operative time (246 vs 299 minutes, P = 0.004) and required significantly fewer intraoperative blood transfusions (0.0 ± 0.0 vs 0.5 ± 1.4 units, P = 0.014). None of the patients in the ARAS group had positive resection margins (0.0% vs 20.0%, P = 0.045). Furthermore, patients in the ARAS group experienced a significantly shorter hospital stay (13.8 ± 6.6 vs 17.9 ± 8.2 days, P = 0.046).

Conclusions

ARAS is a safe and effective assistance system for pancreatic surgery, offering superior perioperative outcomes compared with standard procedures.

Novel multimodal sensing and machine learning strategies to classify cognitive workload in laparoscopic surgery

BACKGROUND

Surgeons can experience elevated cognitive workload (CWL) during surgery due to various factors including operative technicalities and the environmental demands of the operating theatre. This can result in poorer outcomes and have a detrimental effect on surgeon well-being. The objective measurement of CWL provides a potential solution to facilitate classification of workload levels, however results are variable when physiological measures are used in isolation. The aim of this study is to develop and propose a multimodal machine learning (ML) approach to classify CWL levels using a bespoke sensor platform and to develop a ML approach to impute missing pupil diameter measures due to the effect of blinking or noise.

MATERIALS AND METHODS

Ten surgical trainees performed a simulated laparoscopic cholecystectomy under cognitive conditions of increasing difficulty, namely a modified auditory N-back task with increasing difficulty and a verbal clinical scenario. Physiological measures were recorded using a novel platform (MAESTRO). Electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) were used as direct measures of CWL. Indirect measures included electromyography (EMG), electrocardiography (ECG) and pupil diameter (PD). A reference point for validation was provided by subjective assessment of perceived CWL using the SURG-TLX. A multimodal machine learning approach that systematically implements a CNN-BiLSTM, a binary version of the metaheuristic Manta Ray Foraging Optimisation (BMRFO) and a version of Fuzzy C-Means (FCM) called Optimal Completion Strategy (OCS) was used to classify the associated perceived CWL state.

RESULTS

Compared to other state of the art classification techniques, cross-validation results for the classification of CWL levels suggest that the CNN-BLSTM and BMRFO approach provides an average accuracy of 97 % based on the confusion matrix. Additionally, OCS demonstrated a superior average performance of 9.15 % in terms of Root-Mean-Square-Error (RMSE) when compared to other PD imputation methods.

CONCLUSION

Perceived CWL levels were correctly classified using a multimodal ML approach. This approach provides a potential route to accurately classify CWL levels, which may have application in future surgical training and assessment programs as well as the development of cognitive support systems in the operating room.

More than meets the eye: Augmented reality in surgical oncology

BACKGROUND AND OBJECTIVES

In the field of surgical oncology, there has been a desire for innovative techniques to improve tumor visualization, resection, and patient outcomes. Augmented reality (AR) technology superimposes digital content onto the real-world environment, enhancing the user's experience by blending digital and physical elements. A thorough examination of AR technology in surgical oncology has yet to be performed.

METHODS

A scoping review of intraoperative AR in surgical oncology was conducted according to the guidelines and recommendations of The Preferred Reporting Items for Systematic Review and Meta-analyzes Extension for Scoping Reviews (PRISMA-ScR) framework. All original articles examining the use of intraoperative AR during surgical management of cancer were included. Exclusion criteria included virtual reality applications only, preoperative use only, fluorescence, AR not specific to surgical oncology, and study design (reviews, commentaries, abstracts).

RESULTS

A total of 2735 articles were identified of which 83 were included. Most studies (52) were performed on animals or phantom models, while the remaining included patients. A total of 1112 intraoperative AR surgical cases were performed across the studies. The most common anatomic site was brain (20 articles), followed by liver (16), renal (9), and head and neck (8). AR was most often used for intraoperative navigation or anatomic visualization of tumors or critical structures but was also used to identify osteotomy or craniotomy planes.

CONCLUSIONS

AR technology has been applied across the field of surgical oncology to aid in localization and resection of tumors.

A Review of Cognitive Support Systems in the Operating Room

BACKGROUND

In recent years, numerous innovative yet challenging surgeries, such as minimally invasive procedures, have introduced an overwhelming amount of new technologies, increasing the cognitive load for surgeons and potentially diluting their attention. Cognitive support technologies (CSTs) have been in development to reduce surgeons' cognitive load and minimize errors. Despite its huge demands, it still lacks a systematic review.

METHODS

Literature was searched up until May 21st, 2021. Pubmed, Web of Science, and IEEExplore. Studies that aimed at reducing the cognitive load of surgeons were included. Additionally, studies that contained an experimental trial with real patients and real surgeons were prioritized, although phantom and animal studies were also included. Major outcomes that were assessed included surgical error, anatomical localization accuracy, total procedural time, and patient outcome.

RESULTS

A total of 37 studies were included. Overall, the implementation of CSTs had better surgical performance than the traditional methods. Most studies reported decreased error rate and increased efficiency. In terms of accuracy, most CSTs had over 90% accuracy in identifying anatomical markers with an error margin below 5 mm. Most studies reported a decrease in surgical time, although some were statistically insignificant.

DISCUSSION

CSTs have been shown to reduce the mental workload of surgeons. However, the limited ergonomic design of current CSTs has hindered their widespread use in the clinical setting. Overall, more clinical data on actual patients is needed to provide concrete evidence before the ubiquitous implementation of CSTs.

Augmented reality-assisted navigation system contributes to better intraoperative and short-time outcomes of laparoscopic pancreaticoduodenectomy: a retrospective cohort study

BACKGROUND

Augmented reality (AR)-assisted navigation system are currently good techniques for hepatectomy; however, its application and efficacy for laparoscopic pancreatoduodenectomy have not been reported. This study sought to focus on and evaluate the advantages of laparoscopic pancreatoduodenectomy guided by the AR-assisted navigation system in intraoperative and short-time outcomes.

METHODS

Eighty-two patients who underwent laparoscopic pancreatoduodenectomy from January 2018 to May 2022 were enrolled and divided into the AR and non-AR groups. Clinical baseline features, operation time, intraoperative blood loss, blood transfusion rate, perioperative complications, and mortality were analyzed.

RESULTS

AR-guided laparoscopic pancreaticoduodenectomy was performed in the AR group ( n =41), whereas laparoscopic pancreatoduodenectomy was carried out routinely in the non-AR group ( n =41). There was no significant difference in baseline data between the two groups ( P >0.05); Although the operation time of the AR group was longer than that of the non-AR group (420.15±94.38 vs. 348.98±76.15, P <0.001), the AR group had a less intraoperative blood loss (219.51±167.03 vs. 312.20±195.51, P =0.023), lower blood transfusion rate (24.4 vs. 65.9%, P <0.001), lower occurrence rates of postoperative pancreatic fistula (12.2 vs. 46.3%, P =0.002) and bile leakage (0 vs. 14.6%, P =0.026), and shorter postoperative hospital stay (11.29±2.78 vs. 20.04±11.22, P <0.001) compared with the non-AR group.

CONCLUSION

AR-guided laparoscopic pancreatoduodenectomy has significant advantages in identifying important vascular structures, minimizing intraoperative damage, and reducing postoperative complications, suggesting that it is a safe, feasible method with a bright future in the clinical setting.

Preclinical Application of Augmented Reality in Pediatric Craniofacial Surgery: An Accuracy Study

Background: Augmented reality (AR) allows the overlapping and integration of virtual information with the real environment. The camera of the AR device reads the object and integrates the virtual data. It has been widely applied to medical and surgical sciences in recent years and has the potential to enhance intraoperative navigation. Materials and methods: In this study, the authors aim to assess the accuracy of AR guidance when using the commercial HoloLens 2 head-mounted display (HMD) in pediatric craniofacial surgery. The Authors selected fronto-orbital remodeling (FOR) as the procedure to test (specifically, frontal osteotomy and nasal osteotomy were considered). Six people (three surgeons and three engineers) were recruited to perform the osteotomies on a 3D printed stereolithographic model under the guidance of AR. By means of calibrated CAD/CAM cutting guides with different grooves, the authors measured the accuracy of the osteotomies that were performed. We tested accuracy levels of ±1.5 mm, ±1 mm, and ±0.5 mm. Results: With the HoloLens 2, the majority of the individuals involved were able to successfully trace the trajectories of the frontal and nasal osteotomies with an accuracy level of ±1.5 mm. Additionally, 80% were able to achieve an accuracy level of ±1 mm when performing a nasal osteotomy, and 52% were able to achieve an accuracy level of ±1 mm when performing a frontal osteotomy, while 61% were able to achieve an accuracy level of ±0.5 mm when performing a nasal osteotomy, and 33% were able to achieve an accuracy level of ±0.5 mm when performing a frontal osteotomy. Conclusions: despite this being an in vitro study, the authors reported encouraging results for the prospective use of AR on actual patients.

Advances in perforator imaging through holographic CTA and augmented reality: a systematic review

Introduction: Free tissue transfer has become a mainstay in reconstructive plastic surgery, and techniques to plan such surgery continue to evolve. Novel technologies and increases in computational power have enabled computed tomographic angiography (CTA)data augmentation onto patients to assist in pedicle identification and dissection. Given the rapidly evolving field and research in this domain, a systematic re-view was undertaken to establish the evidence for its usefulness in pedicle identification and dissection. Methods: An extensive search using keywords in EMBASE and PubMed with bibliographic linkage following PRISMA guidelines was performed. 107 articles were identified. Duplicate articles were removed prior to review. Two reviewers independently screened the titles for appropriate topic relevance. Full articles were then screened for review. Results: Eleven articles were appropriate for review. Two articles analysed the time taken to identify perfo-rators using augmented reality (AR) compared to Doppler ultrasound. The remainder of the articles ana-lysed time to perforator identification, differences between projected location and dissected perforator location, qualitative feedback from surgeons on the use of AR systems for perforator identification and proof of concept and the usefulness of AR in perforator flap surgery. Conclusion: This review demonstrates that while established methods of data rendering and projection can achieve holographic projection and AR, there is a lack of objective outcome data to demonstrate its usefulness. This, combined with a cost analysis, are the main obstructions to this technology being more widely adopted.

What does preoperative three-dimensional image contribute to complex pancreatic surgery?

The possibility of modelling diagnostic images in three dimensions (3D) in pancreatic surgery is a novelty that provides us multiple advantages. A better visualization of the structures allows us a more accurate planning of the surgical technique and makes it easier the surgery in complex cases. We present the case study of a borderline pancreatic head adenocarcinoma patient to illustrate the advantages of 3D modelling in complex pancreatic surgery. The help of 3D technology allowed us to optimally plan the intervention and facilitate surgical resection. The use of this tool could translate into: shorter operative time, fewer intraoperative complications or an increase in R0 resections. The usability of the program used in our case, agile and intuitive, was an added advantage.

What does preoperative three-dimensional image contribute to complex pancreatic surgery?

The possibility of modelling diagnostic images in three dimensions (3D) in pancreatic surgery is a novelty that provides us multiple advantages. A better visualization of the structures allows us a more accurate planning of the surgical technique and makes it easier the surgery in complex cases. We present the case study of a borderline pancreatic head adenocarcinoma patient to illustrate the advantages of 3D modelling in complex pancreatic surgery. The help of 3D technology allowed us to optimally plan the intervention and facilitate surgical resection. The use of this tool could translate into: shorter operative time, fewer intraoperative complications or an increase in R0 resections. The usability of the program used in our case, agile and intuitive, was an added advantage.

3D-exoscopic visualization using the VITOM-3D in cranial and spinal neurosurgery. What are the limitations?

OBJECTIVE

3D exoscopic visualization in neurosurgical procedures is of interest for several reasons. The VITOM-3D exoscopic system is cheaper compared to the operating microscope (OM) and offers each person involved in the procedure the same image of the operative field. Little is known of limitations of this visualization technique.

PATIENTS AND METHODS

Prospectively, a consecutive series 34 procedures were assessed with focus on the following aspects: intraoperative limitation and the cause for a switch to the OM or endoscopy. A standardized questionnaire was answered by each individual involved in the procedure to assess the image quality, illumination, and magnification of the operative field. Intraoperative video recording and pre- and postoperative MRI and CT-scan were analyzed to assess the dimensions of the surgical approach.

RESULTS

Sixteen cranial and 18 spinal procedures (10 intra-axial, 6 extra-axial, 6 cervical, and 12 lumbar) were performed by seven neurosurgical attendings, twelve residents and twelve scrub nurses who all completed a standardized questionnaire after each procedure. Handling and identification of anatomical structures was rated equal or superior to the OM in 62 % and over 80 % of cases, respectively. The illumination and magnification of the operative field on the surface was rate in equal od superior in all cases and on the depth it was rated inferior to the OM over 60 % of cases. In one spinal and five cranial procedures a switch to the OM or endoscope were performed for the following reasons: poor illumination (4 cases), tissue identification (1 case), need for fluorescence imaging (1 case).

CONCLUSION

3D exoscopic visualization using the VITOM-3D is best suited for spinal procedures and for extra-axial cranial procedures. In case of small approach dimensions, the illumination and magnification of the depth of the operative field is rated inferior to the OM which resulted in difficulty of tissue identification and a switch to the OM.

Robotic radical antegrade modular pancreatosplenectomy (RAMPS) versus standard retrograde pancreatosplenectomy (SRPS): study protocol for a randomized controlled trial

Background

Data from meta-analysis suggest that robotic radical antegrade modular pancreatosplenectomy (RAMPS) is a safe and effective procedure for treating adenocarcinoma in the body or tail of the pancreas, and is oncologically superior to standard retrograde pancreatosplenectomy (SRPS). RAMPS is an operation that actively expands the scope of resection, and achieves a higher R0 resection rate and lymph nodes acquisition through expanded resection. However, previous studies on RAMPS were conducted under open and laparoscopic surgery. Robotic surgery, on the other hand, plays a role in ergonomics and offers several advantages, including less fatigue, tremor filtering, 7° of wrist-like motion, motion scaling, and three-dimensional vision. At present, there is still a world-wide lack of clinical studies to observe the safety and clinical efficacy of robotic RAMPS. Hence, prospective randomized controlled trials (RCTs) comparing robotic RAMPS and SRPS are required. We begin an RCT to compare short-term surgical and oncological outcomes of robotic RAMPS and SRPS in patients undergoing distal pancreatectomy.

Methods

This is a randomized, single-center clinical trial. All participants are adult patients with primary pancreatic cancer, who are undergoing RAMPS or SRPS. The primary endpoints are R0 rate (resection margins are classified by a margin to tumor distance ≥ 1 mm). The secondary endpoints are the number of harvested lymph nodes, perioperative complications and perioperative indicators (duration of surgery, blood loss, blood transfusion volume, costs).

Discussion

We are undertaking a prospective RCT to evaluate the surgical and oncological outcomes of robotic RAMPS. This procedure may become a standard approach to robotic pancreatosplenectomy.

Trial registration

Chinese Clinical Trial Registry: ChiCTR1900020833, Registered on 20 January 2019.

Video Technologies for Recording Open Surgery: A Systematic Review

Video recording of surgical procedures is an important tool for surgical education, performance enhancement, and error analysis. Technology for video recording open surgery, however, is limited. The objective of this article is to provide an overview of the available literature regarding the various technologies used for intraoperative video recording of open surgery. A systematic review was conducted in accordance with the Preferred Reporting Items for Systematic Review and Meta-Analyses (PRISMA) guidelines using the MEDLINE, Cochrane Central, and EMBASE databases. Two authors independently screened the titles and abstracts of the retrieved articles, and those that satisfied the defined inclusion criteria were selected for a full-text review. A total of 2275 publications were initially identified, and 110 were included in the final review. The included articles were categorized based on type of article, surgical subspecialty, type and positioning of camera, and limitations identified with their use. The most common article type was primary-technical (29%), and the dominant specialties were general surgery (22%) and plastic surgery (18%). The most commonly cited camera used was the GoPro (30%) positioned in a head-mount configuration (60%). Commonly cited limitations included poor video quality, inadequate battery life, light overexposure, obstruction by surgical team members, and excessive motion. Open surgery remains the mainstay of many surgical specialties today, and technological innovation is absolutely critical to fulfill the unmet need for better video capture of open surgery. The findings of this article will be valuable for guiding future development of novel technology for this purpose.

Disappearing liver metastases: A systematic review of the current evidence

Advances in systemic chemotherapy have resulted in a significant increase in the reported response rates of colorectal liver metastases (CRLM) over time. Although radiologic response is usually prognostic of favorable outcomes, complete shrinkage of CRLM after chemotherapy, namely "disappearing liver metastases" (DLMs) poses significant therapeutic dilemmas. A systematic review of the literature was conducted to evaluate the existing evidence on the imaging and management of patients with DLMs using the PubMed (Medline), Embase and Cochrane library through December 21st, 2018. The following algorithm was used: "(disappearing OR vanishing OR missing OR (residual tiny)) AND ((liver OR hepatic) AND (metastasis OR metastases OR metastatic OR secondary))." From the 225 records retrieved, 15 studies were finally deemed eligible. A total of 479 patients with DLMs with a median age of 59.5 years (range, 30-83) were identified. Median number of DLM per patient ranged from 1 to 8.8. Median size of LMs prior to chemotherapy was 1.07 cm (range 0.3-3.5). The systemic treatment used to achieve DLMs included systemic chemotherapy alone (only 2 studies) or in combination with targeted agents (11 studies). The median number of chemotherapy cycles in the included studies was 7.8 (range 6-12). Identified factors predisposing to the development of DLM were small size (<2 cm), increased number of treatment cycles, oxaliplatin-based therapy, increased number of CRLM (≥3) and synchronous CRLM. Baseline and preoperative MRI with iv contrast showed the highest sensitivity for DLM detection. Fiducial placement facilitated pre- and intra-operative identification of DLM. Although resection of DLM decreased the local recurrence risk, there was no clearly demonstrated survival benefit after resecting all sites of disappearing lesions. Future randomized clinical trials are highly encouraged to provide strict, evidence-based recommendations for the treatment of patients with DLM.

A markerless automatic deformable registration framework for augmented reality navigation of laparoscopy partial nephrectomy

Purpose Video see-through augmented reality (VST-AR) navigation for laparoscopic partial nephrectomy (LPN) can enhance intraoperative perception of surgeons by visualizing surgical targets and critical structures of the kidney tissue. Image registration is the main challenge in the procedure. Existing registration methods in laparoscopic navigation systems suffer from limitations such as manual alignment, invasive external marker fixation, relying on external tracking devices with bulky tracking sensors and lack of deformation compensation. To address these issues, we present a markerless automatic deformable registration framework for LPN VST-AR navigation.

METHOD

Dense stereo matching and 3D reconstruction, automatic segmentation and surface stitching are combined to obtain a larger dense intraoperative point cloud of the renal surface. A coarse-to-fine deformable registration is performed to achieve a precise automatic registration between the intraoperative point cloud and the preoperative model using the iterative closest point algorithm followed by the coherent point drift algorithm. Kidney phantom experiments and in vivo experiments were performed to evaluate the accuracy and effectiveness of our approach.

RESULTS

The average segmentation accuracy rate of the automatic segmentation was 94.9%. The mean target registration error of the phantom experiments was found to be 1.28 ± 0.68 mm (root mean square error). In vivo experiments showed that tumor location was identified successfully by superimposing the tumor model on the laparoscopic view.

CONCLUSION

Experimental results have demonstrated that the proposed framework could accurately overlay comprehensive preoperative models on deformable soft organs automatically in a manner of VST-AR without using extra intraoperative imaging modalities and external tracking devices, as well as its potential clinical use.

Precision of a Novel Craniofacial Surgical Navigation System Based on Augmented Reality Using an Occlusal Splint as a Registration Strategy

The authors have developed a novel augmented reality (AR)-based navigation system (NS) for craniofacial surgery. In this study, the authors aimed to measure the precision of the system and further analyze the primary influencing factors of the precision. The drilling of holes into the mandibles of ten beagle dogs was performed under the AR-based NS, and the precision was analyzed by comparing the deviation between the preoperational plan and the surgical outcome. The AR-based NS was successfully applied to quickly and precisely drill holes in the mandibles. The mean positional deviation between the preoperative design and intraoperative navigation was 1.29 ± 0.70 mm for the entry points and 2.47 ± 0.66 mm for the end points, and the angular deviation was 1.32° ± 1.17°. The precision linearly decreased with the distance from the marker. In conclusion, the precision of this system could satisfy clinical requirements, and this system may serve as a helpful tool for improving the precision in craniofacial surgery.

Virtual and Augmented Reality in Oncologic Liver Surgery

Virtual reality (VR) and augmented reality (AR) in complex surgery are evolving technologies enabling improved preoperative planning and intraoperative navigation. The basis of these technologies is a computer-based generation of a patient-specific 3-dimensional model from Digital Imaging and Communications in Medicine (DICOM) data. This article provides a state-of-the- art overview on the clinical use of this technology with a specific focus on hepatic surgery. Although VR and AR are still in an evolving stage with only some clinical application today, these technologies have the potential to become a key factor in improving preoperative and intraoperative decision making.

Which method of distal pancreatectomy is cost-effective among open, laparoscopic, or robotic surgery?

Background

The aim of this study was to analyze the clinical and economic impact of robotic distal pancreatectomy, laparoscopic distal pancreatectomy, and open distal pancreatectomy.

Methods

All consecutive patients who underwent distal pancreatic resection for benign and malignant diseases between January 2012 and December 2015 were prospectively included. Cost analysis was performed; all charges from patient admission to discharge were considered.

Results

There were 21 robotic (RDP), 25 laparoscopic (LDP), and 43 open (ODP) procedures. Operative time was longer in the RDP group (RDP =345 minutes, LDP =306 min, ODP =251 min, P=0.01). Blood loss was higher in the ODP group (RDP =192 mL, LDP =356 mL, ODP =573 mL, P=0.0002). Spleen preservation was more frequent in the RDP group (RDP =66.6%, LDP =61.9%, ODP =9.3%, P=0.001). The rate of patients with Clavien-Dindo > grade III was higher in the ODP group (RDP =0%, LDP =12%, ODP =23%, P=0.01), especially for non-surgical complications, which were more frequent in the ODP group (RDP =9.5%, LDP =24%, ODP =41.8%, P=0.02). Length of hospital stay was increased in the ODP group (ODP =19 days, LDP =13 days, RDP =11 days, P=0.007). The total cost of the procedure, including the surgical procedure and postoperative course was higher in the ODP group (ODP =30,929 Euros, LDP =22,150 Euros, RDP =21,219 Euros, P=0.02).

Conclusions

Cost-effective results of RDP seem to be similar to LDP with some better short-term outcomes.

New intraoperative imaging technologies: Innovating the surgeon's eye toward surgical precision

Imaging is one of the pillars for the ongoing evolution of surgical oncology toward a precision paradigm. In the present overview, some established or emerging intraoperative imaging technologies are described in light of the vision and experience of our group in image-guided surgery, focusing on digestive surgical oncology.

Augmented reality in open surgery

Augmented reality (AR) has been successfully providing surgeons an extensive visual information of surgical anatomy to assist them throughout the procedure. AR allows surgeons to view surgical field through the superimposed 3D virtual model of anatomical details. However, open surgery presents new challenges. This study provides a comprehensive overview of the available literature regarding the use of AR in open surgery, both in clinical and simulated settings. In this way, we aim to analyze the current trends and solutions to help developers and end/users discuss and understand benefits and shortcomings of these systems in open surgery. We performed a PubMed search of the available literature updated to January 2018 using the terms (1) "augmented reality" AND "open surgery", (2) "augmented reality" AND "surgery" NOT "laparoscopic" NOT "laparoscope" NOT "robotic", (3) "mixed reality" AND "open surgery", (4) "mixed reality" AND "surgery" NOT "laparoscopic" NOT "laparoscope" NOT "robotic". The aspects evaluated were the following: real data source, virtual data source, visualization processing modality, tracking modality, registration technique, and AR display type. The initial search yielded 502 studies. After removing the duplicates and by reading abstracts, a total of 13 relevant studies were chosen. In 1 out of 13 studies, in vitro experiments were performed, while the rest of the studies were carried out in a clinical setting including pancreatic, hepatobiliary, and urogenital surgeries. AR system in open surgery appears as a versatile and reliable tool in the operating room. However, some technological limitations need to be addressed before implementing it into the routine practice.

Virtual Reality Exploration and Planning for Precision Colorectal Surgery

BACKGROUND

Medical software can build a digital clone of the patient with 3-dimensional reconstruction of Digital Imaging and Communication in Medicine images. The virtual clone can be manipulated (rotations, zooms, etc), and the various organs can be selectively displayed or hidden to facilitate a virtual reality preoperative surgical exploration and planning.

OBJECTIVE

We present preliminary cases showing the potential interest of virtual reality in colorectal surgery for both cases of diverticular disease and colonic neoplasms.

DESIGN

This was a single-center feasibility study.

SETTINGS

The study was conducted at a tertiary care institution.

PATIENTS

Two patients underwent a laparoscopic left hemicolectomy for diverticular disease, and 1 patient underwent a laparoscopic right hemicolectomy for cancer. The 3-dimensional virtual models were obtained from preoperative CT scans. The virtual model was used to perform preoperative exploration and planning. Intraoperatively, one of the surgeons was manipulating the virtual reality model, using the touch screen of a tablet, which was interactively displayed to the surgical team.

MAIN OUTCOME MEASURES

The main outcome was evaluation of the precision of virtual reality in colorectal surgery planning and exploration.

RESULTS

In 1 patient undergoing laparoscopic left hemicolectomy, an abnormal origin of the left colic artery beginning as an extremely short common trunk from the inferior mesenteric artery was clearly seen in the virtual reality model. This finding was missed by the radiologist on CT scan. The precise identification of this vascular variant granted a safe and adequate surgery. In the remaining cases, the virtual reality model helped to precisely estimate the vascular anatomy, providing key landmarks for a safer dissection.

LIMITATIONS

A larger sample size would be necessary to definitively assess the efficacy of virtual reality in colorectal surgery.

CONCLUSIONS

Virtual reality can provide an enhanced understanding of crucial anatomical details, both preoperatively and intraoperatively, which could contribute to improve safety in colorectal surgery.

A Novel Augmented Reality-Based Navigation System in Perforator Flap Transplantation - A Feasibility Study

BACKGROUND

In perforator flap transplantation, dissection of the perforator is an important but difficult procedure because of the high variability in vascular anatomy. Preoperative imaging techniques could provide substantial information about vascular anatomy; however, it cannot provide direct guidance for surgeons during the operation. In this study, a navigation system (NS) was established to overlie a vascular map on surgical sites to further provide a direct guide for perforator flap transplantation.

METHODS

The NS was established based on computed tomographic angiography and augmented reality techniques. A virtual vascular map was reconstructed according to computed tomographic angiography data and projected onto real patient images using ARToolKit software. Additionally, a screw-fixation marker holder was created to facilitate registration. With the use of a tracking and display system, we conducted the NS on an animal model and measured the system error on a rapid prototyping model.

RESULTS

The NS assistance allowed for correct identification, as well as a safe and precise dissection of the perforator. The mean value of the system error was determined to be 3.474 ± 1.546 mm.

CONCLUSIONS

Augmented reality-based NS can provide precise navigation information by directly displaying a 3-dimensional individual anatomical virtual model onto the operative field in real time. It will allow rapid identification and safe dissection of a perforator in free flap transplantation surgery.

New laparoscopic procedure for left-sided pancreatic cancer-artery-first approach laparoscopic RAMPS using 3D technique

Background

For left-sided pancreatic ductal adenocarcinoma (PDAC), radical antegrade modular pancreatosplenectomy (RAMPS) is a reasonable surgical approach for tumor-free margin resection and systemic lymph node clearance. In pancreaticoduodenectomy for PDAC, the superior mesenteric artery (SMA)-first approach (or the “artery-first approach”) has become the standard procedure. With improvements in laparoscopic instruments and techniques, some surgeons attempted to apply laparoscopic RAMPS (L-RAMPS) for carefully selected patients with left-sided PDAC. However, owing to several technical difficulties in this procedure, its application remains uncommon. Moreover, the artery-first approach in L-RAMPS has not been reported. Here, we developed the artery-first approach L-RAMPS for left-sided PDAC and have presented the same in this report.

Case presentation

Between June 2014 and July 2015, 16 patients with left-sided PDAC were referred to our division for pancreatic resection. The following technique was used for performing L-RAMPS on 3 of the 16 patients (19%). Six trocars were placed. After opening the omental bursa, only the middle segment of the pancreas was initially separated from both the left renal vein and the SMA. We termed this procedure as the “artery-first approach using a dome-shaped dorsomedial dissection (3D) technique.” This 3D technique enabled the interruption of the entire arterial supply to the specimen while preserving the venous drainage through the splenic vein for preventing venous congestion. The technique also contributed to the early detection of no tumor infiltration into the SMA and the early determination of posterior dissection plane. After pancreatic neck transection, the splenic artery and vein were divided. Finally, the pancreatic tail and spleen were dissected in a right-to-left direction. All operations were completed without any intraoperative complications. The median blood loss and retrieved lymph node count were 75 mL and 37, respectively, which were superior to those reported by other previous studies on L-RAMPS. All resection margins were free of carcinoma. No severe postoperative complications were observed.

Conclusions

The artery-first approach L-RAMPS using 3D technique is safe and feasible to perform. The significance of our proposed procedure is minimal blood loss and precise lymphadenectomy. Therefore, this novel technique may become the preferred treatment for left-sided PDAC in selected cases.

Robust augmented reality registration method for localization of solid organs' tumors using CT-derived virtual biomechanical model and fluorescent fiducials

BACKGROUND

Augmented reality (AR) is the fusion of computer-generated and real-time images. AR can be used in surgery as a navigation tool, by creating a patient-specific virtual model through 3D software manipulation of DICOM imaging (e.g., CT scan). The virtual model can be superimposed to real-time images enabling transparency visualization of internal anatomy and accurate localization of tumors. However, the 3D model is rigid and does not take into account inner structures' deformations. We present a concept of automated AR registration, while the organs undergo deformation during surgical manipulation, based on finite element modeling (FEM) coupled with optical imaging of fluorescent surface fiducials.

METHODS

Two 10 × 1 mm wires (pseudo-tumors) and six 10 × 0.9 mm fluorescent fiducials were placed in ex vivo porcine kidneys (n = 10). Biomechanical FEM-based models were generated from CT scan. Kidneys were deformed and the shape changes were identified by tracking the fiducials, using a near-infrared optical system. The changes were registered automatically with the virtual model, which was deformed accordingly. Accuracy of prediction of pseudo-tumors' location was evaluated with a CT scan in the deformed status (ground truth). In vivo: fluorescent fiducials were inserted under ultrasound guidance in the kidney of one pig, followed by a CT scan. The FEM-based virtual model was superimposed on laparoscopic images by automatic registration of the fiducials.

RESULTS

Biomechanical models were successfully generated and accurately superimposed on optical images. The mean measured distance between the estimated tumor by biomechanical propagation and the scanned tumor (ground truth) was 0.84 ± 0.42 mm. All fiducials were successfully placed in in vivo kidney and well visualized in near-infrared mode enabling accurate automatic registration of the virtual model on the laparoscopic images.

CONCLUSIONS

Our preliminary experiments showed the potential of a biomechanical model with fluorescent fiducials to propagate the deformation of solid organs' surface to their inner structures including tumors with good accuracy and automatized robust tracking.

Vitom-3D for Exoscopic Neurosurgery: Initial Experience in Cranial and Spinal Procedures

BACKGROUND

The authors describe the application of a new exoscope that offers 3-dimensional (3D) visualization in cranial and spinal neurosurgery in detail.

METHODS

Five cranial and 11 spinal procedures were performed with a 3D exoscope. Instrument handling, repositioning of the exoscope, handling of the image control unit, the adjustment of magnification and focal length, the depth perception, the image quality, the illumination, and the comfort level of the posture during the procedure were assessed via a questionnaire.

RESULTS

The following procedures were performed: Microvascular decompression (n = 1), craniotomy and tumor resection (n = 4), anterior cervical discectomy and fusion with cervical plating (n = 2), cervical laminectomy and lateral mass fixation (n = 1), shear cervical lateral mass osteosynthesis (n = 1), lumbar canal decompression (n = 1), transforaminal lumbar interbody fusion (n = 2), thoracic intraspinal extradural tumor resection (n = 1), and lumbar discectomy (n = 3). Instrument handling, the intraoperative repositioning and handling of the VITOM-3D, and the comfort level of the intraoperative posture was rated excellent in 100% of procedures. The image quality was rated equal to the operating microscope in 68.75% of procedures. None of the procedures had to be stopped because of technical problems. No surgical complications were noted that could be related to the use of the exoscope.

CONCLUSIONS

The 3D-exoscopic system is safe and effective tool to perform spinal procedures and less demanding cranial procedures. The image quality and 3D visualization were comparable with the operating microscope. The technique harbors the unique advantage of excellent comfort for the involved surgical team during the procedure.

Superselective intra-arterial hepatic injection of indocyanine green (ICG) for fluorescence image-guided segmental positive staining: experimental proof of the concept

BACKGROUND

Intraoperative liver segmentation can be obtained by means of percutaneous intra-portal injection of a fluorophore and illumination with a near-infrared light source. However, the percutaneous approach is challenging in the minimally invasive setting. We aimed to evaluate the feasibility of fluorescence liver segmentation by superselective intra-hepatic arterial injection of indocyanine green (ICG).

MATERIALS AND METHODS

Eight pigs (mean weight: 26.01 ± 5.21 kg) were involved. Procedures were performed in a hybrid experimental operative suite equipped with the Artis Zeego®, multiaxis robotic angiography system. A pneumoperitoneum was established and four laparoscopic ports were introduced. The celiac trunk was catheterized, and a microcatheter was advanced into different segmental hepatic artery branches. A near-infrared laparoscope (D-Light P, Karl Storz) was used to detect the fluorescent signal. To assess the correspondence between arterial-based fluorescence demarcation and liver volume, metallic markers were placed along the fluorescent border, followed by a 3D CT-scanning, after injecting intra-arterial radiological contrast (n = 3). To assess the correspondence between arterial and portal supplies, percutaneous intra-portal angiography and intra-arterial angiography were performed simultaneously (n = 1).

RESULTS

Bright fluorescence signal enhancing the demarcation of target segments was obtained from 0.1 mg/mL, in matter of seconds. Correspondence between the volume of hepatic segments and arterial territories was confirmed by CT angiography. Higher background fluorescence noise was found after positive staining by intra-portal ICG injection, due to parenchymal accumulation and porto-systemic shunting.

CONCLUSIONS

Intra-hepatic arterial ICG injection, rapidly highlights hepatic target segment borders, with a better signal-to-background ratio as compared to portal vein injection, in the experimental setting.

[Intraoperative multidimensional visualization]

Modern intraoperative techniques of visualization are increasingly being applied in general and visceral surgery. The combination of diverse techniques provides the possibility of multidimensional intraoperative visualization of specific anatomical structures. Thus, it is possible to differentiate between normal tissue and tumor tissue and therefore exactly define tumor margins. The aim of intraoperative visualization of tissue that is to be resected and tissue that should be spared is to lead to a rational balance between oncological and functional results. Moreover, these techniques help to analyze the physiology and integrity of tissues. Using these methods surgeons are able to analyze tissue perfusion and oxygenation. However, to date it is not clear to what extent these imaging techniques are relevant in the clinical routine. The present manuscript reviews the relevant modern visualization techniques focusing on intraoperative computed tomography and magnetic resonance imaging as well as augmented reality, fluorescence imaging and optoacoustic imaging.

Application of a Compact High-Definition Exoscope for Illumination and Magnification in High-Precision Surgical Procedures

BACKGROUND

The basic necessities for surgical procedures are illumination, exposure, and magnification. These have undergone transformation in par with technology. One of the recent developments is the compact magnifying exoscope system. In this report, we describe the application of this system for surgical operations and discuss its advantages and pitfalls.

METHODS

We used the ViTOM exoscope mounted on the mechanical holding arm. The following surgical procedures were conducted: lumbar and cervical spinal canal decompression (n = 5); laminotomy and removal of lumbar migrated disk herniations (n = 4); anterior cervical diskectomy and fusion (n = 1); removal of intraneural schwannomas (n = 2); removal of an acute cerebellar hemorrhage (n = 1); removal of a parafalcine atypical cerebral hematoma caused by a dural arteriovenous fistula (n = 1); and microsutures and anastomoses of a nerve (n = 1), an artery (n = 1), and veins (n = 2).

RESULTS

The exoscope offered excellent, magnified, and brilliantly illuminated high-definition images of the surgical field. All surgical operations were successfully completed. The main disadvantage was the adjustment and refocusing using the mechanical holding arm. The time required for the surgical operation under the exoscope was slightly longer than the times required for a similar procedure performed using an operating microscope.

CONCLUSIONS

The magnifying exoscope is an effective and nonbulky tool for surgical procedures. In visualization around the corners, the exoscope has better potential than a microscope. With technical and technologic modifications, the exoscope might become the next generation in illumination, visualization, exposure, and magnification for high-precision surgical procedures.

High intensity focused ultrasound (HIFU) applied to hepato-bilio-pancreatic and the digestive system-current state of the art and future perspectives

BACKGROUND

High intensity focused ultrasound (HIFU) is emerging as a valid minimally-invasive image-guided treatment of malignancies. We aimed to review to current state of the art of HIFU therapy applied to the digestive system and discuss some promising avenues of the technology.

METHODS

Pertinent studies were identified through PubMed and Embase search engines using the following keywords, combined in different ways: HIFU, esophagus, stomach, liver, pancreas, gallbladder, colon, rectum, and cancer. Experimental proof of the concept of endoluminal HIFU mucosa/submucosa ablation using a custom-made transducer has been obtained in vivo in the porcine model.

RESULTS

Forty-four studies reported on the clinical use of HIFU to treat liver lesions, while 19 series were found on HIFU treatment of pancreatic cancers and four studies included patients suffering from both liver and pancreatic cancers, reporting on a total of 1,682 and 823 cases for liver and pancreas, respectively. Only very limited comparative prospective studies have been reported.

CONCLUSIONS

Digestive system clinical applications of HIFU are limited to pancreatic and liver cancer. It is safe and well tolerated. The exact place in the hepatocellular carcinoma (HCC) management algorithm remains to be defined. HIFU seems to add clear survival advantages over trans arterial chemo embolization (TACE) alone and similar results when compared to radio frequency (RF). For pancreatic cancer, HIFU achieves consistent cancer-related pain relief. Further research is warranted to improve targeting accuracy and efficacy monitoring. Furthermore, additional work is required to transfer this technology on appealing treatments such as endoscopic HIFU-based therapies.

Innovative surgical approaches for hepatocellular carcinoma

Hepatocellular carcinoma (HCC) is the sixth most common cancer worldwide, with an increasing diffusion in Europe and the United States. The management of such a cancer is continuously progressing and the objective of this paper is to evaluate innovation in the surgical treatment of HCC. In this review, we will analyze the modern concept of preoperative management, the role of laparoscopic and robotic surgery, the intrao-perative use of three dimensional models and augme-nted reality, as well as the potential application of fluore-scence.

Augmented Reality Guidance for the Resection of Missing Colorectal Liver Metastases: An Initial Experience

BACKGROUND

Modern chemotherapy achieves the shrinking of colorectal cancer liver metastases (CRLM) to such extent that they may disappear from radiological imaging. Disappearing CRLM rarely represents a complete pathological remission and have an important risk of recurrence. Augmented reality (AR) consists in the fusion of real-time patient images with a computer-generated 3D virtual patient model created from pre-operative medical imaging. The aim of this prospective pilot study is to investigate the potential of AR navigation as a tool to help locate and surgically resect missing CRLM.

METHODS

A 3D virtual anatomical model was created from thoracoabdominal CT-scans using customary software (VR RENDER(®), IRCAD). The virtual model was superimposed to the operative field using an Exoscope (VITOM(®), Karl Storz, Tüttlingen, Germany). Virtual and real images were manually registered in real-time using a video mixer, based on external anatomical landmarks with an estimated accuracy of 5 mm. This modality was tested in three patients, with four missing CRLM that had sizes from 12 to 24 mm, undergoing laparotomy after receiving pre-operative oxaliplatin-based chemotherapy.

RESULTS

AR display and fine registration was performed within 6 min. AR helped detect all four missing CRLM, and guided their resection. In all cases the planned security margin of 1 cm was clear and resections were confirmed to be R0 by pathology. There was no postoperative major morbidity or mortality. No local recurrence occurred in the follow-up period of 6-22 months.

CONCLUSIONS

This initial experience suggests that AR may be a helpful navigation tool for the resection of missing CRLM.

Augmented Reality Guidance for the Resection of Missing Colorectal Liver Metastases: An Initial Experience

BACKGROUND

Modern chemotherapy achieves the shrinking of colorectal cancer liver metastases (CRLM) to such extent that they may disappear from radiological imaging. Disappearing CRLM rarely represents a complete pathological remission and have an important risk of recurrence. Augmented reality (AR) consists in the fusion of real-time patient images with a computer-generated 3D virtual patient model created from pre-operative medical imaging. The aim of this prospective pilot study is to investigate the potential of AR navigation as a tool to help locate and surgically resect missing CRLM.

METHODS

A 3D virtual anatomical model was created from thoracoabdominal CT-scans using customary software (VR RENDER(®), IRCAD). The virtual model was superimposed to the operative field using an Exoscope (VITOM(®), Karl Storz, Tüttlingen, Germany). Virtual and real images were manually registered in real-time using a video mixer, based on external anatomical landmarks with an estimated accuracy of 5 mm. This modality was tested in three patients, with four missing CRLM that had sizes from 12 to 24 mm, undergoing laparotomy after receiving pre-operative oxaliplatin-based chemotherapy.

RESULTS

AR display and fine registration was performed within 6 min. AR helped detect all four missing CRLM, and guided their resection. In all cases the planned security margin of 1 cm was clear and resections were confirmed to be R0 by pathology. There was no postoperative major morbidity or mortality. No local recurrence occurred in the follow-up period of 6-22 months.

CONCLUSIONS

This initial experience suggests that AR may be a helpful navigation tool for the resection of missing CRLM.

The quest for precision in transanal total mesorectal excision

Transanal total mesorectal excision (TME) is an emerging minimally invasive approach to rectal cancer, with encouraging preliminary results. However, the new surgical anatomy of the bottom-up approach complicates surgical understanding and increases the risks of inadvertent injuries to crucial anatomical structures, including nerves. Key elements to improve the safety and stimulate interest in such a complex technique might be robotics and image guidance, to enhance the level of precision. In this editorial, some of the technologies that could be used for precision TME are outlined, in light of the experience of our Institute for Image-Guided Surgery.

Computer vision and augmented reality in gastrointestinal endoscopy

Augmented reality (AR) is an environment-enhancing technology, widely applied in the computer sciences, which has only recently begun to permeate the medical field. Gastrointestinal endoscopy—which relies on the integration of high-definition video data with pathologic correlates—requires endoscopists to assimilate and process a tremendous amount of data in real time. We believe that AR is well positioned to provide computer-guided assistance with a wide variety of endoscopic applications, beginning with polyp detection. In this article, we review the principles of AR, describe its potential integration into an endoscopy set-up, and envisage a series of novel uses. With close collaboration between physicians and computer scientists, AR promises to contribute significant improvements to the field of endoscopy.

Navigation surgery using an augmented reality for pancreatectomy

AIM

The aim of this study was to evaluate the utility of navigation surgery using augmented reality technology (AR-based NS) for pancreatectomy.

METHODS

The 3D reconstructed images from CT were created by segmentation. The initial registration was performed by using the optical location sensor. The reconstructed images were superimposed onto the real organs in the monitor display. Of the 19 patients who had undergone hepatobiliary and pancreatic surgery using AR-based NS, the accuracy, visualization ability, and utility of our system were assessed in five cases with pancreatectomy.

RESULTS

The position of each organ in the surface-rendering image corresponded almost to that of the actual organ. Reference to the display image allowed for safe dissection while preserving the adjacent vessels or organs. The locations of the lesions and resection line on the targeted organ were overlaid on the operating field. The initial mean registration error was improved to approximately 5 mm by our refinements. However, several problems such as registration accuracy, portability and cost still remain.

CONCLUSION

AR-based NS contributed to accurate and effective surgical resection in pancreatectomy. The pancreas appears to be a suitable organ for further investigations. This technology is promising to improve surgical quality, training, and education.

Inventing the future of surgery

Surgical innovation relies on patient safety and quality of life, which require a drastic iatrogenic impact reduction. A parallel development toward less invasive approaches has occurred in the field of surgery, interventional radiology, and endoscopy. Minimally invasive techniques provide unquestionable benefits to patients in terms of postoperative outcome. However, those techniques are not intuitive, and extensive training is required to overcome the inherent challenges and to be proficient and consequently to achieve a steep learning curve. Technologies have been developed by computer science and robotics departments, which might improve minimally invasive techniques. A new concept of cyber therapies is emerging through the development of computer and robotic sciences aiming at human-machine integration. Additionally, the convergence of surgery, endoscopy, and interventional radiology toward a hybrid therapeutic modality, namely image-guided minimally invasive procedures, holds promises insofar as they could well maximize benefits in terms of efficacy and iatrogenic impact. In the present manuscript, the mainstays of these new paradigm developments are briefly outlined in light of our experience and vision of the future.

Next step in minimally invasive surgery: hybrid image-guided surgery

Surgery, interventional radiology, and advanced endoscopy have all developed minimally invasive techniques to effectively treat a variety of diseases with positive impact on patients' postoperative outcomes. However, those techniques are challenging and require extensive training. Robotics and computer sciences can help facilitate minimally invasive approaches. Furthermore, surgery, advanced endoscopy, and interventional radiology could converge towards a new hybrid specialty, hybrid image-guided minimally invasive therapies, in which the three fundamental disciplines could complement one another to maximize the positive effects and reduce the iatrogenic footprint on patients. The present manuscript describes the fundamental steps of this new paradigm shift in surgical therapies that, in our opinion, will be the next revolutionary step in minimally invasive approaches.

Emerging technology in surgical education: combining real-time augmented reality and wearable computing devices

The authors describe the first surgical case adopting the combination of real-time augmented reality and wearable computing devices such as Google Glass (Google Inc, Mountain View, California). A 66-year-old man presented to their institution for a total shoulder replacement after 5 years of progressive right shoulder pain and decreased range of motion. Throughout the surgical procedure, Google Glass was integrated with the Virtual Interactive Presence and Augmented Reality system (University of Alabama at Birmingham, Birmingham, Alabama), enabling the local surgeon to interact with the remote surgeon within the local surgical field. Surgery was well tolerated by the patient and early surgical results were encouraging, with an improvement of shoulder pain and greater range of motion. The combination of real-time augmented reality and wearable computing devices such as Google Glass holds much promise in the field of surgery.