Application of a virtual and mixed reality-navigation system using commercially available devices to the lateral temporal bone resection

Integration of Augmented Reality in Temporal Bone and Skull Base Surgeries

Augmented reality technologies provide transformative solutions in various surgical fields. Our research focuses on the use of an advanced augmented reality system that projects 3D holographic images directly into surgical footage, potentially improving the surgeon's orientation to the surgical field and lowering the cognitive load. We created a novel system that combines exoscopic surgical footage from the "ORBEYE" and displays both the surgical field and 3D holograms on a single screen. This setup enables surgeons to use the system without using head-mounted displays, instead viewing the integrated images on a 3D monitor. Thirteen surgeons and surgical assistants completed tasks with 2D and 3D graphical surgical guides. The NASA Task Load Index was used to assess mental, physical, and temporal demands. The use of 3D graphical surgical guides significantly improved performance metrics in cochlear implant surgeries by lowering mental, physical, temporal, and frustration levels. However, for Bonebridge implantation, the 2D graphical surgical guide performed better overall (p = 0.045). Participants found the augmented reality system's video latency to be imperceptible, measuring 0.13 ± 0.01 s. This advanced augmented reality system significantly improves the efficiency and precision of cochlear implant surgeries by lowering cognitive load and improving spatial orientation.

Application of 3D-Slicer Software in the Treatment of Gliomas

PURPOSE

To explore the application of 3D-Slicer multimodal image fusion technology in the surgical treatment of gliomas.

METHOD

A retrospective analysis of clinical data from 48 cases of intracranial gliomas treated with 3D-Slicer multimodal image fusion technology from September 2021 to February 2023. Preoperative cranial CT, MRI, TOF-MRA, DTI, and MRV sequence examinations were completed. DICOM format medical imaging data were processed using the 3D-Slicer software. Multimodal fusion and 3-dimensional reconstruction of the tumor and surrounding structures were conducted to clarify the relationship between the tumor and surrounding structures. The surgery path was simulated through 3D virtual visualization images, enabling precise preoperative planning and assisting in surgical treatment.

RESULTS

Out of 48 patients, complete tumor resection was achieved in 45 cases. One case encountered severe postoperative cerebral edema, no infections were reported, 1 patient had slightly reduced muscle strength after surgery compared with before, and no cases of severe neurological function damage or surgical death were recorded.

CONCLUSION

3D-Slicer multimodal image fusion technology can assist in detailed preoperative planning for the surgical treatment of intracranial glioma, reducing surgical complications, improving the rate of total tumor resection, and reducing postoperative complications.

Evaluating the Impact of Different Education Methods on Cleft Lip and Palate Anatomy Training

OBJECTIVE

To compare the effects of different educational methods on short and long-term learning outcomes and to investigate the satisfaction and perception of cleft lip and palate (CLP) education among dental students.

DESIGN

The theoretical exam on CLP to determine their baseline level of knowledge was taken by the participants(T0). After the exam, the students were randomly divided into three groups and all students attended a lecture-based traditional education on CLP. Students in the first group (n = 40) received no additional teaching (Group A). Students in the second group (n = 38) received model teaching with 3D-printed models (Group B). The third group (n = 39) was trained in e-learning-supported education (Group C). The theoretical exam was repeated immediately after the education (T1/short-term learning), one week later (T2/early long-term learning), and one month later (T3/late long-term learning), and the effect of the education methods on information level was assessed. In addition, a post-training satisfaction questionnaire was administered to participants of Group B and Group C.

RESULTS

Both 3D model-based and e-learning-supported approaches significantly improved immediate knowledge of CLP. However, no significant differences were found in knowledge retention over time between the all methods. A majority of students favored the incorporation of both methods in orthodontic education.

CONCLUSIONS

While both 3D models and e-learning effectively enhance short-term CLP knowledge among dental students, their long-term educational impacts are comparable. However, student preferences indicated that the use of 3D-printed models and e-learning strategies may be useful augmentations to traditional lecture education.

More than meets the eye: Augmented reality in surgical oncology

BACKGROUND AND OBJECTIVES

In the field of surgical oncology, there has been a desire for innovative techniques to improve tumor visualization, resection, and patient outcomes. Augmented reality (AR) technology superimposes digital content onto the real-world environment, enhancing the user's experience by blending digital and physical elements. A thorough examination of AR technology in surgical oncology has yet to be performed.

METHODS

A scoping review of intraoperative AR in surgical oncology was conducted according to the guidelines and recommendations of The Preferred Reporting Items for Systematic Review and Meta-analyzes Extension for Scoping Reviews (PRISMA-ScR) framework. All original articles examining the use of intraoperative AR during surgical management of cancer were included. Exclusion criteria included virtual reality applications only, preoperative use only, fluorescence, AR not specific to surgical oncology, and study design (reviews, commentaries, abstracts).

RESULTS

A total of 2735 articles were identified of which 83 were included. Most studies (52) were performed on animals or phantom models, while the remaining included patients. A total of 1112 intraoperative AR surgical cases were performed across the studies. The most common anatomic site was brain (20 articles), followed by liver (16), renal (9), and head and neck (8). AR was most often used for intraoperative navigation or anatomic visualization of tumors or critical structures but was also used to identify osteotomy or craniotomy planes.

CONCLUSIONS

AR technology has been applied across the field of surgical oncology to aid in localization and resection of tumors.

Mixed reality-supported near-infrared photoimmunotherapy for oropharyngeal cancer: a case report

Introduction and importance

Near-infrared photoimmunotherapy (NIR-PIT, Alluminox) uses an antibody-photoabsorber conjugate and light excitation, requiring precise illumination. Mixed reality (MR) technology can enhance medical procedures through advanced visualization and planning.

Case presentation

An 86-year-old man with recurrent oropharyngeal cancer and right cervical metastasis received NIR-PIT. Three-dimensional models from computed tomography (CT) and FDG-PET/CT images were used as holograms on a head-mounted display (HMD) for precise light targeting.

Clinical discussion

HMD-MR technology was utilized for preoperative simulation and guided ideal light direction during surgery. This improved the effectiveness of NIR-PIT.

Conclusion

Three months post-treatment, no residual lesion was observed, demonstrating the utility of HMD-MR technology in optimizing NIR-PIT outcomes.

Application of image recognition-based tracker-less augmented reality navigation system in a series of sawbone trials

BACKGROUND

This study introduced an Augmented Reality (AR) navigation system to address limitations in conventional high tibial osteotomy (HTO). The objective was to enhance precision and efficiency in HTO procedures, overcoming challenges such as inconsistent postoperative alignment and potential neurovascular damage.

METHODS

The AR-MR (Mixed Reality) navigation system, comprising HoloLens, Unity Engine, and Vuforia software, was employed for pre-clinical trials using tibial sawbone models. CT images generated 3D anatomical models, projected via HoloLens, allowing surgeons to interact through intuitive hand gestures. The critical procedure of target tracking, essential for aligning virtual and real objects, was facilitated by Vuforia's feature detection algorithm.

RESULTS

In trials, the AR-MR system demonstrated significant reductions in both preoperative planning and intraoperative times compared to conventional navigation and metal 3D-printed surgical guides. The AR system, while exhibiting lower accuracy, exhibited efficiency, making it a promising option for HTO procedures. The preoperative planning time for the AR system was notably shorter (4 min) compared to conventional navigation (30.5 min) and metal guides (75.5 min). Intraoperative time for AR lasted 8.5 min, considerably faster than that of conventional navigation (31.5 min) and metal guides (10.5 min).

CONCLUSIONS

The AR navigation system presents a transformative approach to HTO, offering a trade-off between accuracy and efficiency. Ongoing improvements, such as the incorporation of two-stage registration and pointing devices, could further enhance precision. While the system may be less accurate, its efficiency renders it a potential breakthrough in orthopedic surgery, particularly for reducing unnecessary harm and streamlining surgical procedures.

Advances and Innovations in Ablative Head and Neck Oncologic Surgery Using Mixed Reality Technologies in Personalized Medicine

The benefit of computer-assisted planning in head and neck ablative and reconstructive surgery has been extensively documented over the last decade. This approach has been proven to offer a more secure surgical procedure. In the treatment of cancer of the head and neck, computer-assisted surgery can be used to visualize and estimate the location and extent of the tumor mass. Nowadays, some software tools even allow the visualization of the structures of interest in a mixed reality environment. However, the precise integration of mixed reality systems into a daily clinical routine is still a challenge. To date, this technology is not yet fully integrated into clinical settings such as the tumor board, surgical planning for head and neck tumors, or medical and surgical education. As a consequence, the handling of these systems is still of an experimental nature, and decision-making based on the presented data is not yet widely used. The aim of this paper is to present a novel, user-friendly 3D planning and mixed reality software and its potential application for ablative and reconstructive head and neck surgery.