HoloMentor: A Novel Mixed Reality Surgical Anatomy Curriculum for Robot-Assisted Radical Prostatectomy

OBJECTIVES

The disruption to surgical training and medical education caused by the global COVID-19 pandemic highlighted the need for realistic, reliable, and engaging educational opportunities available outside of the operating theatre and accessible for trainees of all levels. This article presents the design and development of a virtual reality curriculum which simulates the surgical mentorship experience outside of the operating theatre, with a focus on surgical anatomy and surgical decision-making.

METHOD

This was a multi-institutional study between London's King's College and Imperial College. The index procedure selected for the module was robotic radical prostatectomy. For each stage of the surgical procedure, subject-matter experts (N = 3) at King's College London, identified (1) the critical surgical-decision making points, (2) critical anatomical landmarks, and (3) tips and techniques for overcoming intraoperative challenges. Content validity was determined by an independent panel of subject-matter experts (N = 8) at Imperial College, London, using Fleiss' kappa statistic. The experts' teaching points were combined with operative footage and illustrative animations, and projected onto a virtual reality headset. The module was piloted to surgical science students (N = 15). Quantitative analysis compared participants' confidence regarding their anatomical knowledge before and after taking the module. Qualitative data were gathered from students regarding their views on using the virtual reality model.

RESULTS

Multi-rater agreement between experts was above the 70.0% threshold for all steps of the procedure. Seventy-three percentage of pilot study participants "agreed" or "strongly agreed" that they achieved a better understanding of surgical anatomy and the rationale behind each procedural step. This was reflected in an increase in the median knowledge score after trialing the curriculum (p < 0.001). 100% of subject-matter experts and 93.3% of participants "agreed" or "strongly agreed" that virtual mentorship would be useful for future surgical training.

CONCLUSIONS

This study demonstrated that virtual surgical mentorship could be a feasible and cost-effective alternative to traditional training methods with the potential to improve technical skills, such as operative proficiency and nontechnical skills such as decision-making and situational judgement.

To Beep or Not to Beep? Evaluating Modalities for Multimodal ICU Alarms

Technology plays a prominent role in intensive care units (ICU), with a variety of sensors monitoring both patients and devices. A serious problem exists, however, that can reduce the sensors’ effectiveness. When important values exceed or fall below a certain threshold or sensors lose their signal, up to 350 alarms per patient a day are issued. These frequent alarms are audible in several locations on the ICU, resulting in a massive cognitive load for ICU nurses, as they must evaluate and acknowledge each alarm. “Alarm fatigue” sets in, a desensitization and delayed response time for alarms that can have severe consequences for patients and nurses. To counteract the acoustic load on ICUs, we designed and evaluated personal multimodal alarms for a wearable alarm system (WAS). The result was a lower response time and higher ratings on suitability and feasibility, as well as a lower annoyance level, compared to acoustic alarms. We find that multimodal alarms are a promising new approach to alert ICU nurses, reduce cognitive load, and avoid alarm fatigue.

Smart-Glasses: Exposing and Elucidating the Ethical Issues

The objective of this study is to provide an overview over the ethical issues relevant to the assessment, implementation, and use of smart-glasses. The purpose of the overview is to facilitate deliberation, decision making, and the formation of knowledge and norms for this emerging technology. An axiological question-based method for human cognitive enhancement including an extensive literature search on smart-glasses is used to identify relevant ethical issues. The search is supplemented with relevant ethical issues identified in the literature on human cognitive enhancement (in general) and in the study of the technical aspects of smart-glasses. Identified papers were subject to traditional content analysis: 739 references were identified of which 247 were regarded as relevant for full text examinations, and 155 were included in the study. A wide variety of ethical issues with smart-glasses have been identified, such as issues related to privacy, safety, justice, change in human agency, accountability, responsibility, social interaction, power and ideology. Smart-glasses are envisioned to change individual human identity and behavior as well as social interaction. Taking these issues into account appears to be relevant when developing, deliberating, deciding on, implementing, and using smart-glasses.

Comparison of optical see-through head-mounted displays for surgical interventions with object-anchored 2D-display

PURPOSE

Optical see-through head-mounted displays (OST-HMD) feature an unhindered and instantaneous view of the surgery site and can enable a mixed reality experience for surgeons during procedures. In this paper, we present a systematic approach to identify the criteria for evaluation of OST-HMD technologies for specific clinical scenarios, which benefit from using an object-anchored 2D-display visualizing medical information.

METHODS

Criteria for evaluating the performance of OST-HMDs for visualization of medical information and its usage are identified and proposed. These include text readability, contrast perception, task load, frame rate, and system lag. We choose to compare three commercially available OST-HMDs, which are representatives of currently available head-mounted display technologies. A multi-user study and an offline experiment are conducted to evaluate their performance.

RESULTS

Statistical analysis demonstrates that Microsoft HoloLens performs best among the three tested OST-HMDs, in terms of contrast perception, task load, and frame rate, while ODG R-7 offers similar text readability. The integration of indoor localization and fiducial tracking on the HoloLens provides significantly less system lag in a relatively motionless scenario.

CONCLUSIONS

With ever more OST-HMDs appearing on the market, the proposed criteria could be used in the evaluation of their suitability for mixed reality surgical intervention. Currently, Microsoft HoloLens may be more suitable than ODG R-7 and Epson Moverio BT-200 for clinical usability in terms of the evaluated criteria. To the best of our knowledge, this is the first paper that presents a methodology and conducts experiments to evaluate and compare OST-HMDs for their use as object-anchored 2D-display during interventions.