Virtual, Augmented, and Mixed Reality Applications for Surgical Rehearsal, Operative Execution, and Patient Education in Spine Surgery: A Scoping Review

Background and Objectives: Advances in virtual reality (VR), augmented reality (AR), and mixed reality (MR) technologies have resulted in their increased application across many medical specialties. VR's main application has been for teaching and preparatory roles, while AR has been mostly used as a surgical adjunct. The objective of this study is to discuss the various applications and prospects for VR, AR, and MR specifically as they relate to spine surgery. Materials and Methods: A systematic review was conducted to examine the current applications of VR, AR, and MR with a focus on spine surgery. A literature search of two electronic databases (PubMed and Scopus) was conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA). The study quality was assessed using the MERSQI score for educational research studies, QUACS for cadaveric studies, and the JBI critical appraisal tools for clinical studies. Results: A total of 228 articles were identified in the primary literature review. Following title/abstract screening and full-text review, 46 articles were included in the review. These articles comprised nine studies performed in artificial models, nine cadaveric studies, four clinical case studies, nineteen clinical case series, one clinical case-control study, and four clinical parallel control studies. Teaching applications utilizing holographic overlays are the most intensively studied aspect of AR/VR; the most simulated surgical procedure is pedicle screw placement. Conclusions: VR provides a reproducible and robust medium for surgical training through surgical simulations and for patient education through various platforms. Existing AR/MR platforms enhance the accuracy and precision of spine surgeries and show promise as a surgical adjunct.

Workflow and performance of intraoperative CT, cone-beam CT, and robotic cone-beam CT for spinal navigation in 503 consecutive patients

OBJECTIVE

A direct comparison of intraoperative CT (iCT), cone-beam CT (CBCT), and robotic cone-beam CT (rCBCT) has been necessary to identify the ideal imaging solution for each individual user's need. Herein, the authors sought to analyze workflow, handling, and performance of iCT, CBCT, and rCBCT imaging for navigated pedicle screw instrumentation across the entire spine performed within the same surgical environment by the same group of surgeons.

METHODS

Between 2014 and 2018, 503 consecutive patients received 2673 navigated pedicle screws using iCT (n = 1219), CBCT (n = 646), or rCBCT (n = 808) imaging during the first 24 months after the acquisition of each modality. Clinical and demographic data, workflow, handling, and screw assessment and accuracy were analyzed.

RESULTS

Intraoperative CT showed image quality and workflow advantages for cervicothoracic cases, obese patients, and long-segment instrumentation, whereas CBCT and rCBCT offered independent handling, around-the-clock availability, and the option of performing 2D fluoroscopy. All modalities permitted reliable intraoperative screw assessment. Navigated screw revision was possible with each modality and yielded final accuracy rates > 92% in all groups (iCT 96.2% vs CBCT 92.3%, p < 0.001) without a difference in the accuracy of cervical pedicle screw placement or the rate of secondary screw revision surgeries.

CONCLUSIONS

Continuous training and an individual setup of iCT, CBCT, and rCBCT has been shown to permit safe and precise navigated posterior instrumentation across the entire spine with reliable screw assessment and the option of immediate revision. The perceived higher image quality and larger scan area of iCT should be weighed against the around-the-clock availability of CBCT and rCBCT technology with the option of single-handed robotic image acquisition.

Clinical accuracy and initial experience with augmented reality-assisted pedicle screw placement: the first 205 screws

OBJECTIVE

Augmented reality (AR) is a novel technology which, when applied to spine surgery, offers the potential for efficient, safe, and accurate placement of spinal instrumentation. The authors report the accuracy of the first 205 pedicle screws consecutively placed at their institution by using AR assistance with a unique head-mounted display (HMD) navigation system.

METHODS

A retrospective review was performed of the first 28 consecutive patients who underwent AR-assisted pedicle screw placement in the thoracic, lumbar, and/or sacral spine at the authors' institution. Clinical accuracy for each pedicle screw was graded using the Gertzbein-Robbins scale by an independent neuroradiologist working in a blinded fashion.

RESULTS

Twenty-eight consecutive patients underwent thoracic, lumbar, or sacral pedicle screw placement with AR assistance. The median age at the time of surgery was 62.5 (IQR 13.8) years and the median body mass index was 31 (IQR 8.6) kg/m2. Indications for surgery included degenerative disease (n = 12, 43%); deformity correction (n = 12, 43%); tumor (n = 3, 11%); and trauma (n = 1, 4%). The majority of patients (n = 26, 93%) presented with low-back pain, 19 (68%) patients presented with radicular leg pain, and 10 (36%) patients had documented lower extremity weakness. A total of 205 screws were consecutively placed, with 112 (55%) placed in the lumbar spine, 67 (33%) in the thoracic spine, and 26 (13%) at S1. Screw placement accuracy was 98.5% for thoracic screws, 97.8% for lumbar/S1 screws, and 98.0% overall.

CONCLUSIONS

AR depicted through a unique HMD is a novel and clinically accurate technology for the navigated insertion of pedicle screws. The authors describe the first 205 AR-assisted thoracic, lumbar, and sacral pedicle screws consecutively placed at their institution with an accuracy of 98.0% as determined by a Gertzbein-Robbins grade of A or B.

Augmented Reality in Spine Surgery: A Narrative Review

Augmented reality (AR) navigation refers to novel technologies that superimpose images, such as radiographs and navigation pathways, onto a view of the operative field. The development of AR navigation has focused on improving the safety and efficacy of neurosurgical and orthopedic procedures. In this review, the authors focus on 3 types of AR technology used in spine surgery: AR surgical navigation, microscope-mediated heads-up display, and AR head-mounted displays. Microscope AR and head-mounted displays offer the advantage of reducing attention shift and line-of-sight interruptions inherent in traditional navigation systems. With the U.S. Food and Drug Administration's recent clearance of the XVision AR system (Augmedics, Arlington Heights, IL), the adoption and refinement of AR technology by spine surgeons will only accelerate.

First in-human report of the clinical accuracy of thoracolumbar percutaneous pedicle screw placement using augmented reality guidance

OBJECTIVE

Augmented reality (AR) is an emerging technology that has great potential for guiding the safe and accurate placement of spinal hardware, including percutaneous pedicle screws. The goal of this study was to assess the accuracy of 63 percutaneous pedicle screws placed at a single institution using an AR head-mounted display (ARHMD) system.

METHODS

Retrospective analyses were performed for 9 patients who underwent thoracic and/or lumbar percutaneous pedicle screw placement guided by ARHMD technology. Clinical accuracy was assessed via the Gertzbein-Robbins scale by the authors and by an independent musculoskeletal radiologist. Thoracic pedicle subanalysis was also performed to assess screw accuracy based on pedicle morphology.

RESULTS

Nine patients received thoracic or lumbar AR-guided percutaneous pedicle screws. The mean age at the time of surgery was 71.9 ± 11.5 years and the mean number of screws per patient was 7. Indications for surgery were spinal tumors (n = 4, 44.4%), degenerative disease (n = 3, 33.3%), spinal deformity (n = 1, 11.1%), and a combination of deformity and infection (n = 1, 11.1%). Presenting symptoms were most commonly low-back pain (n = 7, 77.8%) and lower-extremity weakness (n = 5, 55.6%), followed by radicular lower-extremity pain, loss of lower-extremity sensation, or incontinence/urinary retention (n = 3 each, 33.3%). In all, 63 screws were placed (32 thoracic, 31 lumbar). The accuracy for these screws was 100% overall; all screws were Gertzbein-Robbins grade A or B (96.8% grade A, 3.2% grade B). This accuracy was achieved in the thoracic spine regardless of pedicle cancellous bone morphology.

CONCLUSIONS

AR-guided surgery demonstrated a 100% accuracy rate for the insertion of 63 percutaneous pedicle screws in 9 patients (100% rate of Gertzbein-Robbins grade A or B screw placement). Using an ARHMS system for the placement of percutaneous pedicle screws showed promise, but further validation using a larger cohort of patients across multiple surgeons and institutions will help to determine the true accuracy enabled by this technology.

Augmented reality-mediated stereotactic navigation for execution of en bloc lumbar spondylectomy osteotomies

En bloc spinal tumor resections are technically demanding procedures with high morbidity because of the conventionally large exposure area and aggressive resection goals. Stereotactic surgical navigation presents an opportunity to perform the smallest possible resection plan while still achieving an en bloc resection. Augmented reality (AR)-mediated spine surgery (ARMSS) via a mounted display with an integrated tracking camera is a novel FDA-approved technology for intraoperative "heads up" neuronavigation, with the proposed advantages of increased precision, workflow efficiency, and cost-effectiveness. As surgical experience and capability with this technology grow, the potential for more technically demanding surgical applications arises. Here, the authors describe the use of ARMSS for guidance in a unique osteotomy execution to achieve an en bloc wide marginal resection of an L1 chordoma through a posterior-only approach while avoiding a tumor capsule breach. A technique is described to simultaneously visualize the navigational guidance provided by the contralateral surgeon's tracked pointer and the progress of the BoneScalpel aligned in parallel with the tracked instrument, providing maximum precision and safety. The procedure was completed by reconstruction performed with a quad-rod and cabled fibular strut allograft construct, and the patient did well postoperatively. Finally, the authors review the technical aspects of the approach, as well as the applications and limitations of this new technology.