Telestration with augmented reality for visual presentation of intraoperative target structures in minimally invasive surgery: a randomized controlled study

Cognitive learning versus practical "hands-on" training for acquisition of laparoscopic surgical skills: an optimal combination study

BACKGROUND

Most minimally invasive surgery (MIS) training curricula involve practical training (PT) and cognitive learning (CL) to different extents. It has been proven that acquiring and training specific skills through CL can improve MIS skills. This study aimed to discover the most efficient combination of these two approaches and examine their effects on acquiring MIS skills in novices.

METHODS

Sixty medical students without MIS experience participated in this randomized controlled study and were divided into three groups. The first group received the same amount of PT (50%) as CL (50%). The second group focused on PT (75%) compared to the CL (25%). The third group focused more on CL (75%), with less PT implemented (25%). Before and after training, participants performed an ex vivo laparoscopic cholecystectomy (LCHE). Objective Structured Assessment of Technical Skills (OSATS) and Global Operative Assessment of Laparoscopic Skills (GOALS) scores were used for MIS skill evaluation.

RESULTS

Group 1 improved all four performance assessments (global GOALS 14.3 vs. 18.0, p < 0.001, LCHE-specific GOALS 5.9 vs. 6.9, p = 0.016, global OSATS 19.4 vs. 26.4, p < 0.001, LCHE-specific OSATS 37.9 vs. 46.5, p = 0.004). Group 2 and Group 3 improved three of four performance scores (Group 2: global GOALS 15.0 vs. 18.4, p < 0.001, LCHE-specific GOALS 7.0 vs. 7.7, p = 0.115, global OSATS 19.6 vs. 25.8, p < 0.001, LCHE-specific OSATS 41.3 vs. 50.7, p = 0.001; Group 3: global GOALS 13.8 vs. 17.9, p < 0.001, LCHE-specific GOALS 5.8 vs. 6.6, p = 0.148, global OSATS 18.9 vs. 25.5, p < 0.001, LCHE-specific OSATS 36.8 vs. 43.5, p = 0.034).

CONCLUSIONS

A balanced combination of PT and CL seems to offer the most effective training compared to predominantly PT or CL training. All three training modes improved MIS skills in novices.

Dynamic Augmented Reality Cues for Telementoring in Minimally Invasive Surgeries: Scoping Review

BACKGROUND

Remote surgeons use telementoring technologies to provide real-time guidance during minimally invasive surgeries (MIS). Such technologies are continuously improving with the integration of dynamic augmented reality (AR) cues. This includes virtual overlays of hand gestures, pointers, and surgical tools onto the operating surgeon's view. The operating surgeon comprehends this augmented information to operate on the patient. Thus, understanding these dynamic AR cues (either during surgical training or live surgery) is crucial.

OBJECTIVE

In this paper, we aimed to review the existing telementoring technologies that use dynamic AR cues during MIS. This review describes the MIS (including surgery type, specialty, procedure, and clinical trial), the telementoring system, the dynamic AR cues generated by these systems, and evaluation of the technology in terms of technical aspects, user perceptions, skills gained, and patient outcomes.

METHODS

A scoping review was conducted using PubMed, Web of Science, Scopus, IEEE Xplore, and ACM Digital Library databases. The search terms included "telementoring," "minimally invasive surgery," and "augmented reality" without restrictions imposed on the publication year. Articles covering telementoring using dynamic AR cues during MIS, including laparoscopic and robot-assisted, were identified.

RESULTS

A total of 21 articles were included and categorized based on type of surgery, the telementoring technology used, and evaluation of the technology. Most of the articles reported on laparoscopic suturing performed using synthetic phantoms. Hand gestures and surgical tools were the most frequently used dynamic AR cues (10 articles on each cue), while the mentors and mentees primarily consisted of experienced surgeons and medical students. The studies assessing the telementoring technologies were either descriptive (7 articles) or analytical (14 articles) where it was compared against no cue, prerecorded visual cue, in-person guidance, audio cue, or static AR cue. Outcomes were measured mostly using skills gained (13 articles) and user perception about the telementoring system.

CONCLUSIONS

In general, telementoring using dynamic AR cues resulted in positive outcomes during MIS. In some cases, they were considered on par with conventional methods such as audio cues and in-person guidance. Further randomized controlled trials are required to objectively assess its clinical benefits.

Assessing the Use of Virtual Pointers in Laparoscopic Surgery Training Activities

BACKGROUND

Laparoscopic surgery has advanced significantly; however, effective communication within the surgical team remains challenging, particularly in training scenarios where misinterpretation of instructions can lead to errors. Virtual pointers, indicating the instructor's gaze through eye-tracking devices and overlaying it onto the screen using augmented reality (AR), can enhance understanding and reduce errors.

METHODS

In a study involving 10 participants divided into experts and novices in laparoscopic surgery, various pointers (differing in shape, size and colour) were analysed in an AR environment using the HoloLens2 device. The aim was to assess the acceptance of these pointers by both groups, understand how their characteristics affect perception, and evaluate the AR device's usefulness.

RESULTS

Initial results showed an 80% acceptance rate. After analysing the pointers, this decreased to 60%, as some experts changed their opinion from positive to neutral. The study revealed that the characteristics of the pointers significantly affect their perception, with large, thick-rimmed pointers being preferred. Orange was the best-performing colour. The device used also influenced perception, as experts who changed their perception criticised certain aspects of the head-mounted display.

CONCLUSIONS

The study highlights the potential of virtual pointers to improve communication in laparoscopic training, particularly when their size, shape, and colour are optimised. Further research with a larger sample size is needed to confirm these results and explore the HoloLens2's influence on users' perceptions. These insights could guide the development of more effective training tools for minimally invasive surgery.

Use of Augmented Reality for Training Assistance in Laparoscopic Surgery: Scoping Literature Review

BACKGROUND

Laparoscopic surgery training is a demanding process requiring technical and nontechnical skills. Surgical training has evolved from traditional approaches to the use of immersive digital technologies such as virtual, augmented, and mixed reality. These technologies are now integral to laparoscopic surgery training.

OBJECTIVE

This scoping literature review aimed to analyze the current augmented reality (AR) solutions used in laparoscopic surgery training.

METHODS

Following the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines, we conducted a scoping review using 4 databases: Scopus, IEEE Xplore, PubMed, and ACM. Inclusion and exclusion criteria were applied to select relevant articles. Exclusion criteria were studies not using AR, not focused on laparoscopic surgery, not focused on training, written in a language other than English, or not providing relevant information on the topics studied. After selecting the articles, research questions (RQs) were formulated to guide the review. In total, 2 independent reviewers then extracted relevant data, and a descriptive analysis of the results was conducted.

RESULTS

Of 246 initial records, 172 (69.9%) remained after removing duplicates. After applying the exclusion criteria, 76 articles were selected, with 25 (33%) later excluded for not meeting quality standards, leaving 51 (67%) in the final review. Among the devices analyzed (RQ 1), AR video-based devices were the most prevalent (43/51, 84%). The most common information provided by AR devices (RQ 1) focused on task execution and patient-related data, both appearing in 20% (10/51) of studies. Regarding sensorization (RQ 2), most studies (46/51, 90%) incorporated some form of sensorized environment, with computer vision being the most used technology (21/46, 46%) and the trainee the most frequently sensorized element (41/51, 80%). Regarding training setups (RQ 3), 39% (20/51) of the studies used commercial simulators, and 51% (26/51) made use of artificial models. Concerning the evaluation methods (RQ 4), objective evaluation was the most used, featured in 71% (36/51) of the studies. Regarding tasks (RQ 5), 43% (22/51) of studies focused on full surgical procedures, whereas 57% (29/51) focused on simple training tasks, with suturing being the most common among the latter (11/29, 38%).

CONCLUSIONS

This scoping review highlights the evolving role of AR technologies in laparoscopic surgery training, although the impact of optical see-through devices remains unclear due to their limited use. It underscores the potential of emerging technologies such as haptic feedback, computer vision, and eye tracking to further enhance laparoscopic skill acquisition. While most relevant articles from other databases were included, some studies may have been missed due to the specific databases and search strategies used. Moreover, the need for standardized evaluation metrics is emphasized, paving the way for future research into AR's full potential in laparoscopic skill acquisition.

Augmented reality for basic skills training in laparoscopic surgery: a systematic review and meta-analysis

BACKGROUND

Augmented reality (AR) has emerged as a transformative technology in medical education, particularly in training basic laparoscopic skills. Despite its growing applications, the effectiveness of AR in this specific domain remains underexplored, with a lack of standardized assessment frameworks and inconsistent methodologies across studies. This systematic review and meta-analysis aimed to evaluate the effectiveness of AR in laparoscopic basic skills training for medical students and junior physicians.

METHODS

We conducted a systematic review and meta-analysis following PRISMA guidelines. Databases searched included PubMed, Embase, Cochrane Library, Web of Science, and ClinicalTrials.gov. Studies were selected based on their focus on AR applications in laparoscopic training, involving both randomized controlled trials and non-randomized studies. Inclusion criteria focused on medical students and novice surgeons, assessing educational outcomes such as Global Operative Assessment of Laparoscopic Skills (GOALS) Global, Objective Structured Assessment of Technical Skills (OSATS) Global, OSATS Specific, Training Time, and Subjective Workload.

RESULTS

A total of 12 studies involving 434 participants met the inclusion criteria. The analysis revealed that AR technology significantly improved educational outcomes, with participants achieving higher GOALS and OSATS scores. Specifically, the mean difference for GOALS scores was 2.40 points (95% CI [1.30, 3.50], p < 0.001) and for OSATS scores, 7.71 points (95% CI [3.39, 12.03], p < 0.001). Additionally, AR-assisted training showed a reduction in subjective workload, with a mean decrease of 2.95 points (95% CI [- 4.95, - 0.95], p = 0.003).

CONCLUSIONS

The findings indicate that AR significantly enhances laparoscopic training outcomes, facilitating improved technical skills, efficiency, and learner independence. However, variability in study designs and outcomes limits generalizability. Future research should focus on standardize AR training protocols and evaluate long-term effectiveness to fully leverage AR's potential in surgical education.

[Status Quo of Surgical Navigation]

Surgical navigation, also referred to as computer-assisted or image-guided surgery, is a technique that employs a variety of methods - such as 3D imaging, tracking systems, specialised software, and robotics to support surgeons during surgical interventions. These emerging technologies aim not only to enhance the accuracy and precision of surgical procedures, but also to enable less invasive approaches, with the objective of reducing complications and improving operative outcomes for patients. By harnessing the integration of emerging digital technologies, surgical navigation holds the promise of assisting complex procedures across various medical disciplines. In recent years, the field of surgical navigation has witnessed significant advances. Abdominal surgical navigation, particularly endoscopy, laparoscopic, and robot-assisted surgery, is currently undergoing a phase of rapid evolution. Emphases include image-guided navigation, instrument tracking, and the potential integration of augmented and mixed reality (AR, MR). This article will comprehensively delve into the latest developments in surgical navigation, spanning state-of-the-art intraoperative technologies like hyperspectral and fluorescent imaging, to the integration of preoperative radiological imaging within the intraoperative setting.

Assessing the Impact of Augmented Reality on Surgical Skills Training for Medical Students: A Systematic Review

Augmented reality (AR) is increasingly being explored as a tool to enhance surgical skills training in medical education. This systematic review evaluates the effectiveness of AR in improving surgical skills among medical students. A comprehensive literature search identified studies on AR in surgical training, and data were extracted on sample size, type and dose of intervention, AR technology, application context, parameters, diagnoses, outcomes, and main results. Five studies were included, demonstrating that AR significantly improved technical performance (mean improvement of 35%, 95% CI (28%-42%)), accuracy (mean improvement of 29%, 95% CI (23%-35%)), and procedural knowledge (mean improvement of 32%, 95% CI (25%-39%)) compared to traditional methods. AR also resulted in higher student engagement (mean score 4.5/5, SD = 0.6), satisfaction (mean score 4.7/5, SD = 0.5), and confidence (mean improvement of 30%, 95% CI (24%-36%)). However, variability in AR technologies, intervention types, and outcome measures was observed. Small sample sizes (median = 34) and short follow-up periods (median = two weeks) limited generalizability. Despite these limitations, AR shows potential for enhancing surgical skills training, and optimizing its use could improve medical education and patient care. Further research is required to establish standardized protocols and validate the long-term efficacy of AR in surgical education.

Intraoperative Telestration System in Endoscopic Transsphenoidal Surgery Contributes to Improved Surgical Safety and Efficient Surgical Education

OBJECTIVE

To evaluate the effectiveness of a "telestration" system in which the mentor annotates the view of the surgical field, for endoscopic transsphenoidal surgery (ETS).

METHODS

The use of telestration was evaluated for sellar floor-opening during ETS and for a task performed using ETS simulation training. During ETS, the mentor outlined the opening area of the sella turcica on the monitor and then the trainee surgeon opened the sella, either with the telestration displayed (telestration (+) group, n = 8) or without (telestration (-) group, n = 7). In the task using an ETS training model, 18 subjects were asked to touch the indicated targets with the forceps, once with the instructions given via telestration and once with verbal instructions only.

RESULTS

During ETS, the telestration (+) group had a significantly higher concordance rate between the planned bone window and actual bone window than the telestration (-) group (92.97 ± 4.16% vs. 77.57 ± 10.51%, P = 0.014). In the ETS model, the time required to finish the task was significantly less with telestration than with verbal instructions alone (P = 0.002). None of the subjects had errors when telestration was used, while subjects made an average of 0.33 ± 0.59 errors and had to re-listen to the instructions 0.27 ± 0.46 times when only verbal instructions were given.

CONCLUSIONS

The use of the telestration system during ETS facilitated the communication of the mentor's intentions to the trainee surgeon and contributed to safer, more accurate surgery. The system was also thought to be useful in reducing operative time.

Usability, Ergonomics, and Educational Value of a Novel Telestration Tool for Surgical Coaching: Usability Study

BACKGROUND

Telementoring studies found technical challenges in achieving accurate and stable annotations during live surgery using commercially available telestration software intraoperatively. To address the gap, a wireless handheld telestration device was developed to facilitate dynamic user interaction with live video streams.

OBJECTIVE

This study aims to find the perceived usability, ergonomics, and educational value of a first-generation handheld wireless telestration platform.

METHODS

A prototype was developed with four core hand-held functions: (1) free-hand annotation, (2) cursor navigation, (3) overlay and manipulation (rotation) of ghost (avatar) instrumentation, and (4) hand-held video feed navigation on a remote monitor. This device uses a proprietary augmented reality platform. Surgeons and trainees were invited to test the core functions of the platform by performing standardized tasks. Usability and ergonomics were evaluated with a validated system usability scale and a 5-point Likert scale survey, which also evaluated the perceived educational value of the device.

RESULTS

In total, 10 people (9 surgeons and 1 senior resident; 5 male and 5 female) participated. Participants strongly agreed or agreed (SA/A) that it was easy to perform annotations (SA/A 9, 90% and neutral 0, 0%), video feed navigation (SA/A 8, 80% and neutral 1, 10%), and manipulation of ghost (avatar) instruments on the monitor (SA/A 6, 60% and neutral 3, 30%). Regarding ergonomics, 40% (4) of participants agreed or strongly agreed (neutral 4, 40%) that the device was physically comfortable to use and hold. These results are consistent with open-ended comments on the device's size and weight. The average system usability scale was 70 (SD 12.5; median 75, IQR 63-84) indicating an above average usability score. Participants responded favorably to the device's perceived educational value, particularly for postoperative coaching (agree 6, 60%, strongly agree 4, 40%).

CONCLUSIONS

This study presents the preliminary usability results of a novel first-generation telestration tool customized for use in surgical coaching. Favorable usability and perceived educational value were reported. Future iterations of the device should focus on incorporating user feedback and additional studies should be conducted to evaluate its effectiveness for improving surgical education. Ultimately, such tools can be incorporated into pedagogical models of surgical coaching to optimize feedback and training.

Outcomes of robotic versus laparoscopic-assisted surgery in patients with rectal cancer: a systematic review and meta-analysis

PURPOSE

Robotic-assisted rectal surgery (RARS) and Laparoscopic-assisted rectal surgery are the two techniques that are increasingly used for rectal cancer, and both have their advantages and disadvantages. This meta-analysis will analyze the outcomes of both techniques to determine their relative performance and suitability.

METHODS

An extensive search was carried out on PubMed, Cochrane, Scopus, Embase, and Google Scholar, followed by a meta-analysis of all randomized controlled trials (RCTs) to assess both approaches for rectal cancer.

RESULTS

This meta-analysis is comprised of fifteen RCTs. The conversion to open surgery (RR = 0.53, 95% CI: 0.38-0.74, P = 0.0002) was significantly lower in the RARS group. The outcomes like anastomotic leak, postoperative ileus, postoperative urinary retention (POUR), surgical site infection (SSI), and intra-abdominal abscess showed no significant difference between the two groups. The reoperation rate (RR = 0.56, 95% CI: 0.34-0.95, P = 0.03) was lower in the robotic group. High heterogeneity was obtained when pooling data on operative time, length of hospital stay, and blood loss. Oncological outcomes, including local recurrence, the number of harvested lymph nodes (LN) and distal resection margin showed no significant distinction among both groups, while the positive circumferential resection margin (CRM) (RR = 0.67, 95% CI: 0.49-0.91, P = 0.01) was lower in the RARS group. RARS demonstrated a significantly higher rate of total mesorectal excision (TME) (RR = 1.07, 95% CI: 1.01-1.14, P = 0.03).

CONCLUSION

RARS is safe and feasible for rectal cancer patients and may be superior or equivalent to Laparoscopic-assisted rectal surgery, but high-standard, large-scale trials are required to determine the best approach.

Educational value of a novel telestration device for surgical coaching-a randomized controlled trial

INTRODUCTION

Communication is fundamental to effective surgical coaching. This can be challenging for training during image-guided procedures where coaches and trainees need to articulate technical details on a monitor. Telestration devices that annotate on monitors remotely could potentially overcome these limitations and enhance the coaching experience. This study aims to evaluate the value of a novel telestration device in surgical coaching.

METHODS

A randomized-controlled trial was designed. All participants watched a video demonstrating the task followed by a baseline performance assessment and randomization into either control group (conventional verbal coaching without telestration) or telestration group (verbal coaching with telestration). Coaching for a simulated laparoscopic small bowel anastomosis on a dry lab model was done by a faculty surgeon. Following the coaching session, participants underwent a post-coaching performance assessment of the same task. Assessments were recorded and rated by blinded reviewers using a modified Global Rating Scale of the Objective Structured Assessment of Technical Skills (OSATS). Coaching sessions were also recorded and compared in terms of mentoring moments; guidance misinterpretations, questions/clarifications by trainees, and task completion time. A 5-point Likert scale was administered to obtain feedback.

RESULTS

Twenty-four residents participated (control group 13, telestration group 11). Improvements in some elements of the OSATS scale were noted in the Telestration arm but there was no statistical significance in the overall score between the two groups. Mentoring moments were more in the telestration Group. Amongst the telestration Group, 55% felt comfortable that they could perform this task independently, compared to only 8% amongst the control group and 82% would recommend the use of telestration tools here.

CONCLUSION

There is demonstrated educational value of this novel telestration device mainly in the non-technical aspects of the interaction by enhancing the coaching experience with improvement in communication and greater mentoring moments between coach and trainee.

Structured feedback and operative video debriefing with critical view of safety annotation in training of laparoscopic cholecystectomy: a randomized controlled study

BACKGROUND

The learning curve in minimally invasive surgery (MIS) is lengthened compared to open surgery. It has been reported that structured feedback and training in teams of two trainees improves MIS training and MIS performance. Annotation of surgical images and videos may prove beneficial for surgical training. This study investigated whether structured feedback and video debriefing, including annotation of critical view of safety (CVS), have beneficial learning effects in a predefined, multi-modal MIS training curriculum in teams of two trainees.

METHODS

This randomized-controlled single-center study included medical students without MIS experience (n = 80). The participants first completed a standardized and structured multi-modal MIS training curriculum. They were then randomly divided into two groups (n = 40 each), and four laparoscopic cholecystectomies (LCs) were performed on ex-vivo porcine livers each. Students in the intervention group received structured feedback after each LC, consisting of LC performance evaluations through tutor-trainee joint video debriefing and CVS video annotation. Performance was evaluated using global and LC-specific Objective Structured Assessments of Technical Skills (OSATS) and Global Operative Assessment of Laparoscopic Skills (GOALS) scores.

RESULTS

The participants in the intervention group had higher global and LC-specific OSATS as well as global and LC-specific GOALS scores than the participants in the control group (25.5 ± 7.3 vs. 23.4 ± 5.1, p = 0.003; 47.6 ± 12.9 vs. 36 ± 12.8, p < 0.001; 17.5 ± 4.4 vs. 16 ± 3.8, p < 0.001; 6.6 ± 2.3 vs. 5.9 ± 2.1, p = 0.005). The intervention group achieved CVS more often than the control group (1. LC: 20 vs. 10 participants, p = 0.037, 2. LC: 24 vs. 8, p = 0.001, 3. LC: 31 vs. 8, p < 0.001, 4. LC: 31 vs. 10, p < 0.001).

CONCLUSIONS

Structured feedback and video debriefing with CVS annotation improves CVS achievement and ex-vivo porcine LC training performance based on OSATS and GOALS scores.

Applying augmented reality in teaching of surgical residents-telementoring, a "stress-free" way to surgical autonomy?

BACKGROUND

Achieving surgical autonomy can be considered the ultimate goal of surgical training. Innovative head-mounted augmented reality (AR) devices enable visualization of the operating field and teaching from remote. Therefore, utilization of AR glasses may be a novel approach to achieve autonomy. The aim of this pilot study is to analyze the feasibility of AR application in surgical training and to assess its impact on intraoperative stress.

METHODS

A head-mounted RealWear Navigator® 500 glasses and the TeamViewer software were used. Initial "dry lab" testing of AR glasses was performed in combination with the Symbionix LAP Mentor™. Subsequently, residents performed various stage-adapted surgical procedures semi-autonomously (SA) (on-demand consultation of senior surgeon, who is in theatre but not scrubbed) versus permanent remote supervision (senior surgeon not present) via augmented reality (AR) glasses, worn by the resident in theatre. Stress was measured by intraoperative heart rate (Polar® pulse belt) and State-Trait Anxiety Inventory (STAI) questionnaire.

RESULTS

After "dry lab" testing, N = 5 senior residents performed equally N = 25 procedures SA and with AR glasses. For both, open and laparoscopic procedure AR remote assistance showed satisfactory applicability. Utilization of AR significantly reduced intraoperative peak pulse rate from 131 to 119 bpm (p = 0.004), as compared with the semi-autonomous group. Likewise, subjectively perceived stress according to STAI was significantly lower in the AR group (p = 0.011).

CONCLUSION

AR can be applied in surgical training and may help to reduce stress in theatre. In the future, AR has a huge potential to become a stepping stone to surgical autonomy.

Telestration with augmented reality improves the performance of the first ten ex vivo porcine laparoscopic cholecystectomies: a randomized controlled study

INTRODUCTION

The learning curve in minimally invasive surgery (MIS) is steep compared to open surgery. One of the reasons is that training in the operating room in MIS is mainly limited to verbal instructions. The iSurgeon telestration device with augmented reality (AR) enables visual instructions, guidance, and feedback during MIS. This study aims to compare the effects of the iSurgeon on the training of novices performing repeated laparoscopic cholecystectomy (LC) on a porcine liver compared to traditional verbal instruction methods.

METHODS

Forty medical students were randomized into the iSurgeon and the control group. The iSurgeon group performed 10 LCs receiving interactive visual guidance. The control group performed 10 LCs receiving conventional verbal guidance. The performance assessment using Objective Structured Assessments of Technical Skills (OSATS) and Global Operative Assessment of Laparoscopic Skills (GOALS) scores, the total operating time, and complications were compared between the two groups.

RESULTS

The iSurgeon group performed LCs significantly better (global GOALS 17.3 ± 2.6 vs. 16 ± 2.6, p ≤ 0.001, LC specific GOALS 7 ± 2 vs. 5.9 ± 2.1, p ≤ 0.001, global OSATS 25.3 ± 4.3 vs. 23.5 ± 3.9, p ≤ 0.001, LC specific OSATS scores 50.8 ± 11.1 vs. 41.2 ± 9.4, p ≤ 0.001) compared to the control group. The iSurgeon group had significantly fewer intraoperative complications in total (2.7 ± 2.0 vs. 3.6 ± 2.0, p ≤ 0.001) than the control group. There was no difference in operating time (79.6 ± 25.7 vs. 84.5 ± 33.2 min, p = 0.087).

CONCLUSION

Visual guidance using the telestration device with AR, iSurgeon, improves performance and lowers the complication rates in LCs in novices compared to conventional verbal expert guidance.

Telestration with augmented reality improves surgical performance through gaze guidance

BACKGROUND

In minimally invasive surgery (MIS), trainees need to learn how to interpret the operative field displayed on the laparoscopic screen. Experts currently guide trainees mainly verbally during laparoscopic procedures. A newly developed telestration system with augmented reality (iSurgeon) allows the instructor to display hand gestures in real-time on the laparoscopic screen in augmented reality to provide visual expert guidance (telestration). This study analysed the effect of telestration guided instructions on gaze behaviour during MIS training.

METHODS

In a randomized-controlled crossover study, 40 MIS naive medical students performed 8 laparoscopic tasks with telestration or with verbal instructions only. Pupil Core eye-tracking glasses were used to capture the instructor's and trainees' gazes. Gaze behaviour measures for tasks 1-7 were gaze latency, gaze convergence and collaborative gaze convergence. Performance measures included the number of errors in tasks 1-7 and trainee's ratings in structured and standardized performance scores in task 8 (ex vivo porcine laparoscopic cholecystectomy).

RESULTS

There was a significant improvement 1-7 on gaze latency [F(1,39) = 762.5, p < 0.01, ηp2 = 0.95], gaze convergence [F(1,39) = 482.8, p < 0.01, ηp2 = 0.93] and collaborative gaze convergence [F(1,39) = 408.4, p < 0.01, ηp2 = 0.91] upon instruction with iSurgeon. The number of errors was significantly lower in tasks 1-7 (0.18 ± 0.56 vs. 1.94 ± 1.80, p < 0.01) and the score ratings for laparoscopic cholecystectomy were significantly higher with telestration (global OSATS: 29 ± 2.5 vs. 25 ± 5.5, p < 0.01; task-specific OSATS: 60 ± 3 vs. 50 ± 6, p < 0.01).

CONCLUSIONS

Telestration with augmented reality successfully improved surgical performance. The trainee's gaze behaviour was improved by reducing the time from instruction to fixation on targets and leading to a higher convergence of the instructor's and the trainee's gazes. Also, the convergence of trainee's gaze and target areas increased with telestration. This confirms augmented reality-based telestration works by means of gaze guidance in MIS and could be used to improve training outcomes.

The Role of Augmented Reality in the Advancement of Minimally Invasive Surgery Procedures: A Scoping Review

The purpose of this review was to analyze the evidence on the role of augmented reality (AR) in the improvement of minimally invasive surgical (MIS) procedures. A scoping literature search of the PubMed and ScienceDirect databases was performed to identify articles published in the last five years that addressed the direct impact of AR technology on MIS procedures or that addressed an area of education or clinical care that could potentially be used for MIS development. A total of 359 studies were screened and 31 articles were reviewed in depth and categorized into three main groups: Navigation, education and training, and user-environment interfaces. A comparison of studies within the different application groups showed that AR technology can be useful in various disciplines to advance the development of MIS. Although AR-guided navigation systems do not yet offer a precision advantage, benefits include improved ergonomics and visualization, as well as reduced surgical time and blood loss. Benefits can also be seen in improved education and training conditions and improved user-environment interfaces that can indirectly influence MIS procedures. However, there are still technical challenges that need to be addressed to demonstrate added value to patient care and should be evaluated in clinical trials with sufficient patient numbers or even in systematic reviews or meta-analyses.

Establishment of a new practical telesurgical platform using the hinotori™ Surgical Robot System: a preclinical study

AIM

The recent development of new surgical robots and network telecommunication technology has opened new avenues for robotic telesurgery. Although a few gastroenterological surgeries have been performed in the telesurgery setting, more technically demanding procedures including gastrectomy with D2 lymphadenectomy and intracorporeal anastomosis have never been reported. We examined the feasibility of telesurgical robotic gastrectomy using the hinotori™ Surgical Robot System in a preclinical setting.

METHODS

First, the suturing time in the dry model was measured in the virtual telesurgery setting to determine the latency time threshold. Second, a surgeon cockpit and a patient unit were installed at Okazaki Medical Center and Fujita Health University, respectively (approximately 30 km apart), and connected using a 10-Gbps leased optic-fiber network. After evaluating the feasibility in the dry gastrectomy model, robotic distal gastrectomies with D2 lymphadenectomy and intracorporeal B-I anastomosis were performed in two porcine models.

RESULTS

The virtual telesurgery study identified a latency time threshold of 125 ms. In the actual telesurgery setting, the latency time was 27 ms, including a 2-ms telecommunication network delay and a 25-ms local information process delay. After verifying the feasibility of the operative procedures using a gastrectomy model, two telesurgical gastrectomies were successfully completed without any unexpected events. No fluctuation was observed across the actual telesurgeries.

CONCLUSION

Short-distance telesurgical robotic surgery for technically more demanding procedure may be safely conducted using the hinotori Surgical Robot System connected by high-speed optic-fiber communication.