Virtual reality improves the accuracy of simulated preoperative planning in temporal bones: a feasibility and validation study

Evaluating the safe zone for lumbar pedicle screws: are midline crossing screws indicative of pedicle breach?

BACKGROUND CONTEXT

Pedicle screw breach (PSB) is not uncommon following lumbar instrumentation, and in some instances, it may lead to vascular and/or neurologic complications. Previous literature suggested that screws crossing the vertebral midline on an anterior-posterior (AP) radiograph (or midsagittal on CT) are concerning for medial pedicle breach.

OBJECTIVE

Our primary aim was to map out the safe zones (SZ) of bilateral pedicle instrumentation and their relationship at each lumbar vertebral level. Our secondary aim was to evaluate the presence of SZs' intersection at each lumbar level, denoting safe midline pedicle screw crossing not otherwise associated with medial pedicle breach.

STUDY DESIGN/SETTING

Retrospective Anatomical Study.

PATIENT SAMPLE

Adult patients in the from "The Cancer Imaging Archive" (TCIA) database who have not had thoraco-lumbo-sacral fusion.

OUTCOME MEASURES

Physiologic measures obtained through 3D analysis of CT images and virtual pedicle screws.

METHOD

CT scans of 51 patients were randomly selected from "The Cancer Imaging Archive" (TCIA) online database for analysis. The Sectra 3D Spine software was used to create 3D renderings, place virtual screws, and make measurements. At each lumbar vertebra, the right and left pedicle corridors were mapped. At each pedicle, two screw positions were templated, the "medial limit screw" (MLS) and the "lateral limit screw" (LLS). Each limit screw was the most extreme position that the screw could exist in without causing a medial or lateral breach. The safe zone was defined as the zone between MLS and LLS. Measurements were taken for each level (between L1 and L5) and side (Left, Right).

RESULTS

A total of 253 lumbar vertebrae from 51 patients (mean age 53.1, 56.9% male) were included. Two vertebrae from two patients were removed for poor image quality. Out of the 506 screw positions analyzed in our study, 97.4% had overlapping SZ and crossed the midplane without medial pedicle breach. The significant factors (p<.01) for safe midplane-crossing screws included: the screw length (L1-L5); the laterality of the screw entry point (L1-L4); and the pedicle diameter (L2 and L5).

CONCLUSIONS

A midline crossing pedicle screw on a lumbar AP radiograph is not necessarily indicative of a medial pedicle screw breach. Anatomical (ie, larger pedicle diameter) and technical (ie, longer screws, and lateral entry points) factors allow for safety zone intersections and indicate safe midline crossing by pedicle screws.

Further Validity Evidence for Patient-Specific Virtual Reality Temporal Bone Surgical Simulation

OBJECTIVE

Patient-specific virtual reality (VR) simulation of cochlear implant (CI) surgery potentially enables preoperative rehearsal and planning. We aim to gather supporting validity evidence for patient-specific simulation through the analysis of virtual performance and comparison with postoperative imaging.

METHODS

Prospective, multi-institutional study. Pre- and postoperative cone-beam CT scans of CI surgical patients were obtained and processed for patient-specific VR simulation. The virtual performances of five trainees and four attendings were recorded and (1) compared with volumes removed during actual surgery as determined in postoperative imaging, and (2) assessed using the Copenhagen Cochlear Implant Surgery Assessment Tool (CISAT) by two blinded raters. The volumes compared were cortical mastoidectomy, facial recess, and round window (RW) cochleostomy as well as violation of the facial nerve and chorda.

RESULTS

Trainees drilled more volume in the cortical mastoidectomy and facial recess, whereas attendings drilled more volume for the RW cochleostomy and made more violations. Except for the cochleostomy, attendings removed volumes closer to that determined in postoperative imaging. Trainees achieved a higher CISAT performance score compared with attendings (22.0 vs. 18.4 points) most likely due to lack of certain visual cues.

CONCLUSION

We found that there were differences in performance of trainees and attendings in patient-specific VR simulation of CI surgery as assessed by raters and in comparison with actual drilled volumes. The presented approach of volume comparison is novel and might be used for further validation of patient-specific VR simulation before clinical implementation for preoperative rehearsal in temporal bone surgery.

LEVEL OF EVIDENCE

n/a Laryngoscope, 134:1403-1409, 2024.

Impact of virtual reality training on mastoidectomy performance: a prospective randomised study

PURPOSE

The opportunities for surgical training and practice in the operating room are in decline due to limited resources, increased efficiency demands, growing complexity of the cases, and concerns for patient safety. Virtual reality (VR) offers a novel opportunity to enhance surgical training and provide complementary three-dimensional experience that has been usually available in the operating room. Since VR allows viewing and manipulation of realistic 3D models, the VR environment could enhance anatomical and topographical knowledge, in particular. In this study, we explored whether incorporating VR anatomy training improves novices' performance during mastoidectomy over traditional methods.

METHODS

Thirty medical students were randomized into two groups and taught mastoidectomy in a structured manner. One group utilized a VR temporal bone model during the training while the other group used more traditional materials such as anatomy books. After the training, all participants completed a mastoidectomy on a 3D-printed temporal bone model under expert supervision. Performance during the mastoidectomy was evaluated with multiple metrics and feedback regarding the two training methods was gathered from the participants.

RESULTS

The VR training method was rated better by the participants, and they also needed less guidance during the mastoidectomy. There were no significant differences in operational time, the occurrence of injuries, self-assessment scores, and the surgical outcome between the two groups.

CONCLUSION

Our results support the utilization of VR training in complete novices as it has higher trainee satisfaction and leads to at least as good results as the more traditional methods.

A Self-Configuring Deep Learning Network for Segmentation of Temporal Bone Anatomy in Cone-Beam CT Imaging

OBJECTIVE

Preoperative planning for otologic or neurotologic procedures often requires manual segmentation of relevant structures, which can be tedious and time-consuming. Automated methods for segmenting multiple geometrically complex structures can not only streamline preoperative planning but also augment minimally invasive and/or robot-assisted procedures in this space. This study evaluates a state-of-the-art deep learning pipeline for semantic segmentation of temporal bone anatomy.

STUDY DESIGN

A descriptive study of a segmentation network.

SETTING

Academic institution.

METHODS

A total of 15 high-resolution cone-beam temporal bone computed tomography (CT) data sets were included in this study. All images were co-registered, with relevant anatomical structures (eg, ossicles, inner ear, facial nerve, chorda tympani, bony labyrinth) manually segmented. Predicted segmentations from no new U-Net (nnU-Net), an open-source 3-dimensional semantic segmentation neural network, were compared against ground-truth segmentations using modified Hausdorff distances (mHD) and Dice scores.

RESULTS

Fivefold cross-validation with nnU-Net between predicted and ground-truth labels were as follows: malleus (mHD: 0.044 ± 0.024 mm, dice: 0.914 ± 0.035), incus (mHD: 0.051 ± 0.027 mm, dice: 0.916 ± 0.034), stapes (mHD: 0.147 ± 0.113 mm, dice: 0.560 ± 0.106), bony labyrinth (mHD: 0.038 ± 0.031 mm, dice: 0.952 ± 0.017), and facial nerve (mHD: 0.139 ± 0.072 mm, dice: 0.862 ± 0.039). Comparison against atlas-based segmentation propagation showed significantly higher Dice scores for all structures (p < .05).

CONCLUSION

Using an open-source deep learning pipeline, we demonstrate consistently submillimeter accuracy for semantic CT segmentation of temporal bone anatomy compared to hand-segmented labels. This pipeline has the potential to greatly improve preoperative planning workflows for a variety of otologic and neurotologic procedures and augment existing image guidance and robot-assisted systems for the temporal bone.

Immersive Virtual Reality for Patient-Specific Preoperative Planning: A Systematic Review

Background. Immersive virtual reality (iVR) facilitates surgical decision-making by enabling surgeons to interact with complex anatomic structures in realistic 3-dimensional environments. With emerging interest in its applications, its effects on patients and providers should be clarified. This systematic review examines the current literature on iVR for patient-specific preoperative planning. Materials and Methods. A literature search was performed on five databases for publications from January 1, 2000 through March 21, 2021. Primary studies on the use of iVR simulators by surgeons at any level of training for patient-specific preoperative planning were eligible. Two reviewers independently screened titles, abstracts, and full texts, extracted data, and assessed quality using the Quality Assessment Tool for Studies with Diverse Designs (QATSDD). Results were qualitatively synthesized, and descriptive statistics were calculated. Results. The systematic search yielded 2,555 studies in total, with 24 full-texts subsequently included for qualitative synthesis, representing 264 medical personnel and 460 patients. Neurosurgery was the most frequently represented discipline (10/24; 42%). Preoperative iVR did not significantly improve patient-specific outcomes of operative time, blood loss, complications, and length of stay, but may decrease fluoroscopy time. In contrast, iVR improved surgeon-specific outcomes of surgical strategy, anatomy visualization, and confidence. Validity, reliability, and feasibility of patient-specific iVR models were assessed. The mean QATSDD score of included studies was 32.9%. Conclusions. Immersive VR improves surgeon experiences of preoperative planning, with minimal evidence for impact on short-term patient outcomes. Future work should focus on high-quality studies investigating long-term patient outcomes, and utility of preoperative iVR for trainees.

The effect of virtual reality on temporal bone anatomy evaluation and performance

PURPOSE

There is only limited data on the application of virtual reality (VR) for the evaluation of temporal bone anatomy. The aim of the present study was to compare the VR environment to traditional cross-sectional viewing of computed tomography images in a simulated preoperative planning setting in novice and expert surgeons.

METHODS

A novice (n = 5) and an expert group (n = 5), based on their otosurgery experience, were created. The participants were asked to identify 24 anatomical landmarks, perform 11 distance measurements between surgically relevant anatomical structures and 10 fiducial markers on five cadaver temporal bones in both VR environment and cross-sectional viewings in PACS interface. The data on performance time and user-experience (i.e., subjective validation) were collected.

RESULTS

The novice group made significantly more errors (p < 0.001) and with significantly longer performance time (p = 0.001) in cross-sectional viewing than the expert group. In the VR environment, there was no significant differences (errors and time) between the groups. The performance of novices improved faster in the VR. The novices showed significantly faster task performance (p = 0.003) and a trend towards fewer errors (p = 0.054) in VR compared to cross-sectional viewing. No such difference between the methods were observed in the expert group. The mean overall scores of user-experience were significantly higher for VR than cross-sectional viewing in both groups (p < 0.001).

CONCLUSION

In the VR environment, novices performed the anatomical evaluation of temporal bone faster and with fewer errors than in the traditional cross-sectional viewing, which supports its efficiency for the evaluation of complex anatomy.

"Snap on" or Not? A Validation on the Measurement Tool in a Virtual Reality Application

This multi-rater comparison study aims to validate the measurement tool with a "snap" feature option (SNAP ON vs. SNAP OFF), in a virtual reality (VR) application, ImmersiveView v. 2.1, against a conventional software Mimics Innovation Suite v.22 (MIS). It is hypothesized that these measurement tools are equivalent between SNAP ON, and SNAP OFF, and when compared to MIS, in terms of basic linear and angular measurements. Six (6) raters conducted a set of 40 linear and 15 angular measurements using CT scan data of three objects (L-block, hand model, and dry skull) with fiducial markers. Inter-rater repeatability and intra-rater reproducibility were assessed via inter-class coefficient (ICC). Equivalency between each pair of modules (SNAP ON, SNAP OFF, and MIS) was analyzed via Bland-Altman plots and two one-sided t-tests (TOST) procedure. The ICC for intra-rater repeatability yielded 0.999 to 1.000, and inter-rater reproducibility yielded 0.998 to 1.000, which suggests high degree of intra- and inter-rater reliability. The Bland-Altman plots demonstrated that measurements acquired from SNAP ON, SNAP OFF, and MIS were equivalent. The TOST procedure yielded that the measurements through all three modules are equivalent within ± 0.2 mm interval for distance, and ± 0.3° interval for angular measurements. The measurement tool with the "snap" feature in a newly developed VR application (ImmersiveView v.2.1) has been validated through a multi-rater comparison study. In terms of linear and angular measurements, this VR application, whether the "snap" feature was on or off, was equivalent to each other and to the control software (MIS) under the condition of this study. A strong reliability, both intra-rater repeatability and inter-rater reproducibility, has been found.

Bioinformatics and the Metaverse: Are We Ready?

COVID-19 forced humanity to think about new ways of working globally without physically being present with other people, and eXtended Reality (XR) systems (defined as Virtual Reality, Augmented Reality and Mixed Reality) offer a potentially elegant solution. Previously seen as mainly for gaming, commercial and research institutions are investigating XR solutions to solve real world problems from training, simulation, mental health, data analysis, and studying disease progression. More recently large corporations such as Microsoft and Meta have announced they are developing the Metaverse as a new paradigm to interact with the digital world. This article will look at how visualization can leverage the Metaverse in bioinformatics research, the pros and cons of this technology, and what the future may hold.

Developing Virtual Reality Head Mounted Display (HMD) Set-Up for Thoracoscopic Surgery of Complex Congenital Lung MalFormations in Children

Video assisted thoracoscopic surgery (VATS) has been adopted in pediatric age for the treatment of congenital lung malformations (CLM). The success of VATS in pediatrics largely depends on the surgeon's skill ability to understand the airways, vascular system and lung parenchyma anatomy in CLM. In the last years, virtual reality (VR) and 3-dimensional (3D) printing of organ models and VR head mounted display (HMD) technologies have been introduced for completion of preoperative planning in adult patients. To date no reports about the use of VR HMD technologies in a pediatric setting are available. The aim of this report is to introduce a VR HMD model in VATS procedure to improve the quality of care in children with CLM. VR HMD set-up for planning thoracoscopic surgery was performed in a series of pediatric patients with diagnosis of CLM. The preoperative VR HMD evaluation allowed a navigation into the malformation with the aim to explore, interact, and make the surgeon more confident and skilled to answer to the traps. A development of surgical simulations models and teaching program dedicated to education and training in pediatric VATS is suitable among the pediatric surgery community. Further studies should demonstrate all the benefits of such technology in pediatric patients submitted to VATS procedure.

Virtual Reality (VR) Simulation and Augmented Reality (AR) Navigation in Orthognathic Surgery: A Case Report

VR and AR technology have gradually developed to the extent that they could help operators in the surgical field. In this study, we present a case of VR simulation for preoperative planning and AR navigation applied to orthognathic surgery. The average difference between the preplanned data and the post-operative results was 3.00 mm, on average, and the standard deviation was 1.44 mm. VR simulation could provide great advantages for 3D medical simulations, with accurate manipulation and immersiveness. AR navigation has great potential in medical application; its advantages include displaying real time augmented 3D models of patients. Moreover, it is easily applied in the surgical field, without complicated 3D simulations or 3D-printed surgical guides.