Augmented reality navigation with intraoperative 3D imaging vs fluoroscopy-assisted free-hand surgery for spine fixation surgery: a matched-control study comparing accuracy

A decade of progress: bringing mixed reality image-guided surgery systems in the operating room

Advancements in mixed reality (MR) have led to innovative approaches in image-guided surgery (IGS). In this paper, we provide a comprehensive analysis of the current state of MR in image-guided procedures across various surgical domains. Using the Data Visualization View (DVV) Taxonomy, we analyze the progress made since a 2013 literature review paper on MR IGS systems. In addition to examining the current surgical domains using MR systems, we explore trends in types of MR hardware used, type of data visualized, visualizations of virtual elements, and interaction methods in use. Our analysis also covers the metrics used to evaluate these systems in the operating room (OR), both qualitative and quantitative assessments, and clinical studies that have demonstrated the potential of MR technologies to enhance surgical workflows and outcomes. We also address current challenges and future directions that would further establish the use of MR in IGS.

Feasibility and Usability of Augmented Reality Technology in the Orthopaedic Operating Room

PURPOSE OF REVIEW

Augmented reality (AR) has gained popularity in various sectors, including gaming, entertainment, and healthcare. The desire for improved surgical navigation within orthopaedic surgery has led to the evaluation of the feasibility and usability of AR in the operating room (OR). However, the safe and effective use of AR technology in the OR necessitates a proper understanding of its capabilities and limitations. This review aims to describe the fundamental elements of AR, highlight limitations for use within the field of orthopaedic surgery, and discuss potential areas for development.

RECENT FINDINGS

To date, studies have demonstrated evidence that AR technology can be used to enhance navigation and performance in orthopaedic procedures. General hardware and software limitations of the technology include the registration process, ergonomics, and battery life. Other limitations are related to the human response factors such as inattentional blindness, which may lead to the inability to see complications within the surgical field. Furthermore, the prolonged use of AR can cause eye strain and headache due to phenomena such as the vergence-convergence conflict. AR technology may prove to be a better alternative to current orthopaedic surgery navigation systems. However, the current limitations should be mitigated to further improve the feasibility and usability of AR in the OR setting. It is important for both non-clinicians and clinicians to work in conjunction to guide the development of future iterations of AR technology and its implementation into the OR workflow.

Healthcare in the Dynamism of Metaverse After COVID-19: A Systematic Review of Literature

The idea of the "metaverse" is a relatively recent technological development. The industries that are most supportive of these developments include finance, entertainment, and communication. In addition to these, the healthcare domain has been added to the list of domains that benefit from the metaverse recently. Within the metaverse, research is being conducted on a wide range of medical topics, including conferences and seminars, surgical simulators, awareness campaigns, research projects, and much more. The metaverse is a flexible and highly customizable virtual digital platform that can be configured to suit specific needs, making it an adaptable instrument for medical advancement. These domains, together with their benefits and drawbacks, are thoroughly covered in this review article, which raises the discussion of the need for medical productivity. These studies have undergone a minimum amount of research and experimentation, and the findings are fair from an investigative standpoint. This review article's major goal is to make a provocative remark about metaverse domains and how they have already been used and might be used as an essential operational tool in the field of medicine in the future. Consequently, the objective of the present study is to review the current literature on post-COVID-19 pandemic development that connected the metaverse with the prevention and treatment of diseases, medical education and training, and expansion of available functionalities in research settings.

Accuracy of augmented reality-assisted pedicle screw placement: a systematic review

OBJECTIVE

Conventional freehand methods of pedicle screw placement are associated with significant complications due to close proximity to neural and vascular structures. Recent advances in augmented reality surgical navigation (ARSN) have led to its adoption into spine surgery. However, little is known regarding its overall accuracy. The purpose of this study is to delineate the overall accuracy of ARSN pedicle screw placement across various models.

METHODS

A systematic review was conducted of Medline/PubMed, Cochrane and Embase Library databases according to the PRISMA guidelines. Relevant data extracted included reports of pedicle screw placement accuracy and breaches, as defined by the Gertzbein-Robbins classification, in addition to deviation from pre-planned trajectory and entry point. Accuracy was defined as the summation of grade 0 and grade 1 events per the Gertzbein-Robbins classification.

RESULTS

Twenty studies reported clinically accurate placed screws. The range of clinically accurate placed screws was 26.3-100%, with 2095 screws (93.1%) being deemed clinically accurate. Furthermore, 5.4% (112/2088) of screws were reported as grade two breaches, 1.6% (33/2088) grade 3 breaches, 3.1% (29/926) medial breaches and 2.3% (21/926) lateral breaches. Mean linear deviation ranged from 1.3 to 5.99 mm, while mean angular/trajectory deviation ranged 1.6°-5.88°.

CONCLUSION

The results of this study highlight the overall accuracy of ARSN pedicle screw placement. However, further robust prospective studies are needed to accurately compare to conventional methods of pedicle screw placement.

Spatial Fidelity of Microvascular Perforating Vessels as Perceived by Augmented Reality Virtual Projections

BACKGROUND

Autologous breast reconstruction yields improved long-term aesthetic results but requires increased resources of practitioners and hospital systems. Innovations in radiographic imaging have been increasingly used to improve the efficiency and success of free flap harvest. Augmented reality affords the opportunity to superimpose relevant imaging on a surgeon's native field of view, potentially facilitating dissection of anatomically variable structures. To validate the spatial fidelity of augmented reality projections of deep inferior epigastric perforator flap-relevant anatomy, comparisons of three-dimensional (3D) models and their virtual renderings were performed by four independent observers. Measured discrepancies between the real and holographic models were evaluated.

METHODS

The 3D-printed models of deep inferior epigastric perforator flap-relevant anatomy were fabricated from computed tomographic angiography data from 19 de-identified patients. The corresponding computed tomographic angiography data were similarly formatted for the Microsoft HoloLens to generate corresponding projections. Anatomic points were initially measured on 3D models, after which the corresponding points were measured on the HoloLens projections from two separate vantage points (V1 and V2). Statistical analyses, including generalized linear modeling, were performed to characterize spatial fidelity regarding translation, rotation, and scale of holographic projections.

RESULTS

Among all participants, the median translational displacement at corresponding points was 9.0 mm between the real-3D model and V1, 12.1 mm between the 3D model and V2, and 13.5 mm between V1 and V2.

CONCLUSION

Corresponding points, including topography of perforating vessels, for the purposes of breast reconstruction can be identified within millimeters, but there remain multiple independent contributors of error, most notably the participant and location at which the projection is perceived.

A Fast and Interactive Augmented Reality System for PET/CT-guided Intervention of Neuroblastoma

Neuroblastoma is the most common type of extracranial solid tumor in children and can often result in death if not treated. High-intensity focused ultrasound (HIFU) is a non-invasive technique for treating tissue that is deep within the body. It avoids the use of ionizing radiation, avoiding long-term side-effects of these treatments. The goal of this project was to develop the rendering component of an augmented reality (AR) system with potential applications for image-guided HIFU treatment of neuroblastoma. Our project focuses on taking 3D models of neuroblastoma lesions obtained from PET/CT and displaying them in our AR system in near real-time for use by physicians. We used volume ray casting with raster graphics as our preferred rendering method, as it allows for the real-time editing of our 3D radiologic data. Some unique features of our AR system include intuitive hand gestures and virtual user interfaces that allow the user to interact with the rendered data and process PET/CT images for optimal visualization. We implemented the feature to set a custom transfer function, set custom intensity cutoff points, and region-of-interest extraction via cutting planes. In the future, we hope to incorporate this work as part of a complete system for focused ultrasound treatment by adding ultrasound simulation, visualization, and deformable registration.

Assessing the benefits of digital twins in neurosurgery: a systematic review

Digital twins are virtual replicas of their physical counterparts, and can assist in delivering personalized surgical care. This PRISMA guideline-based systematic review evaluates current literature addressing the effectiveness and role of digital twins in many stages of neurosurgical management. The aim of this review is to provide a high-quality analysis of relevant, randomized controlled trials and observational studies addressing the neurosurgical applicability of a variety of digital twin technologies. Using pre-specified criteria, we evaluated 25 randomized controlled trials and observational studies on the applications of digital twins, including navigation, robotics, and image-guided neurosurgeries. All 25 studies compared these technologies against usual surgical approaches. Risk of bias analyses using the Cochrane risk of bias tool for randomized trials (Rob 2) found "low" risk of bias in the majority of studies (23/25). Overall, this systematic review shows that digital twin applications have the potential to be more effective than conventional neurosurgical approaches when applied to brain and spinal surgery. Moreover, the application of these novel technologies may also lead to fewer post-operative complications.

Augmented reality in spine surgery - past, present, and future

BACKGROUND CONTEXT

Augmented reality (AR) is increasingly recognized as a valuable tool in spine surgery. Here we provides an overview of the key developments and technological milestones that have laid the foundation for AR applications in this field. We also assess the quality of existing studies on AR systems in spine surgery and explore potential future applications.

PURPOSE

The purpose of this narrative review is to examine the role of AR in spine surgery. It aims to highlight the evolution of AR technology in this context, evaluate the existing body of research, and outline potential future directions for integrating AR into spine surgery.

STUDY DESIGN

Narrative review.

METHODS

We conducted a thorough literature search to identify studies and developments related to AR in spine surgery. Relevant articles, reports, and technological advancements were analyzed to establish the historical context and current state of AR in this field.

RESULTS

The review identifies significant milestones in the development of AR technology for spine surgery. It discusses the growing body of research and highlights the strengths and weaknesses of existing investigations. Additionally, it presents insights into the potential for AR to enhance spine surgical education and speculates on future applications.

CONCLUSIONS

Augmented reality has emerged as a promising adjunct in spine surgery, with notable advancements and research efforts. The integration of AR into the spine surgery operating room holds promise, as does its potential to revolutionize surgical education. Future applications of AR in spine surgery may include real-time navigation, enhanced visualization, and improved patient outcomes. Continued development and evaluation of AR technology are essential for its successful implementation in this specialized surgical field.

Point-of-Care Orthopedic Oncology Device Development

BACKGROUND

The triad of 3D design, 3D printing, and xReality technologies is explored and exploited to collaboratively realize patient-specific products in a timely manner with an emphasis on designs with meta-(bio)materials.

METHODS

A case study on pelvic reconstruction after oncological resection (osteosarcoma) was selected and conducted to evaluate the applicability and performance of an inter-epistemic workflow and the feasibility and potential of 3D technologies for modeling, optimizing, and materializing individualized orthopedic devices at the point of care (PoC).

RESULTS

Image-based diagnosis and treatment at the PoC can be readily deployed to develop orthopedic devices for pre-operative planning, training, intra-operative navigation, and bone substitution.

CONCLUSIONS

Inter-epistemic symbiosis between orthopedic surgeons and (bio)mechanical engineers at the PoC, fostered by appropriate quality management systems and end-to-end workflows under suitable scientifically amalgamated synergies, could maximize the potential benefits. However, increased awareness is recommended to explore and exploit the full potential of 3D technologies at the PoC to deliver medical devices with greater customization, innovation in design, cost-effectiveness, and high quality.

Metaverse Wearables for Immersive Digital Healthcare: A Review

The recent exponential growth of metaverse technology has been instrumental in reshaping a myriad of sectors, not least digital healthcare. This comprehensive review critically examines the landscape and future applications of metaverse wearables toward immersive digital healthcare. The key technologies and advancements that have spearheaded the metamorphosis of metaverse wearables are categorized, encapsulating all-encompassed extended reality, such as virtual reality, augmented reality, mixed reality, and other haptic feedback systems. Moreover, the fundamentals of their deployment in assistive healthcare (especially for rehabilitation), medical and nursing education, and remote patient management and treatment are investigated. The potential benefits of integrating metaverse wearables into healthcare paradigms are multifold, encompassing improved patient prognosis, enhanced accessibility to high-quality care, and high standards of practitioner instruction. Nevertheless, these technologies are not without their inherent challenges and untapped opportunities, which span privacy protection, data safeguarding, and innovation in artificial intelligence. In summary, future research trajectories and potential advancements to circumvent these hurdles are also discussed, further augmenting the incorporation of metaverse wearables within healthcare infrastructures in the post-pandemic era.

The use of hybrid operating rooms in neurosurgery, advantages, disadvantages, and future perspectives: a systematic review

BACKGROUND

Hybrid operating rooms (hybrid-ORs) combine the functionalities of a conventional surgical theater with the advanced imaging technologies of a radiological suite. Hybrid-ORs are usually equipped with CBCT devices providing both 2D and 3D imaging capability that can be used for both interventional radiology and image guided surgical applications. Across all fields of surgery, the use of hybrid-ORs is gaining in traction, and neurosurgery is no exception. We hence aimed to comprehensively review the use of hybrid-ORs, the associated advantages, and disadvantages specific to the field of neurosurgery.

MATERIALS AND METHODS

Electronic databases were searched for all studies on hybrid-ORs from inception to May 2022. Findings of matching studies were pooled to strengthen the current body of evidence.

RESULTS

Seventy-four studies were included in this review. Hybrid-ORs were mainly used in endovascular surgery (n = 41) and spine surgery (n = 33). Navigation systems were the most common additional technology employed along with the CBCT systems in the hybrid-ORs. Reported advantages of hybrid-ORs included immediate assessment of outcomes, reduced surgical revision rate, and the ability to perform combined open and endovascular procedures, among others. Concerns about increased radiation exposure and procedural time were some of the limitations mentioned.

CONCLUSION

In the field of neurosurgery, the use of hybrid-ORs for different applications is increasing. Hybrid-ORs provide preprocedure, intraprocedure, and end-of-procedure imaging capabilities, thereby increasing surgical precision, and reducing the need for postoperative imaging and correction surgeries. Despite these advantages, radiation exposure to patient and staff is an important concern.

Augmented Reality-Assisted Spine Surgery: An Early Experience Demonstrating Safety and Accuracy with 218 Screws

STUDY DESIGN

Prospective cohort study.

OBJECTIVES

In spine surgery, accurate screw guidance is critical to achieving satisfactory fixation. Augmented reality (AR) is a novel technology to assist in screw placement and has shown promising results in early studies. This study aims to provide our early experience evaluating safety and efficacy with an Food and Drug Administration-approved head-mounted (head-mounted device augmented reality (HMD-AR)) device.

METHODS

Consecutive adult patients undergoing AR-assisted thoracolumbar fusion between October 2020 and August 2021 with 2 -week follow-up were included. Preoperative, intraoperative, and postoperative data were collected to include demographics, complications, revision surgeries, and AR performance. Intraoperative 3D imaging was used to assess screw accuracy using the Gertzbein-Robbins (G-R) grading scale.

RESULTS

Thirty-two patients (40.6% male) were included with a total of 222 screws executed using HMD-AR. Intraoperatively, 4 (1.8%) were deemed misplaced and revised using AR or freehand. The remaining 218 (98.2%) screws were placed accurately. There were no intraoperative adverse events or complications, and AR was not abandoned in any case. Of the 208 AR-placed screws with 3D imaging confirmation, 97.1% were considered clinically accurate (91.8% Grade A, 5.3% Grade B). There were no early postoperative surgical complications or revision surgeries during the 2 -week follow-up.

CONCLUSIONS

This early experience study reports an overall G-R accuracy of 97.1% across 218 AR-guided screws with no intra or early postoperative complications. This shows that HMD-AR-assisted spine surgery is a safe and accurate tool for pedicle, cortical, and pelvic fixation. Larger studies are needed to continue to support this compelling evolution in spine surgery.

Augmented Reality in Minimally Invasive Spinal Surgery: A Narrative Review of Available Technology

INTRODUCTION

Spine surgery has undergone significant changes in approach and technique. With the adoption of intraoperative navigation, minimally invasive spinal surgery (MISS) has arguably become the gold standard. Augmented reality (AR) has now emerged as a front-runner in anatomical visualization and narrower operative corridors. In effect, AR is poised to revolutionize surgical training and operative outcomes. Our study examines the current literature on AR-assisted MISS, synthesizes findings, and creates a narrative highlighting the history and future of AR in spine surgery.

MATERIAL AND METHODS

Relevant literature was gathered using the PubMed (Medline) database from 1975 to 2023. Pedicle screw placement models were the primary intervention in AR. These were compared to the outcomes of traditional MISS RESULTS: We found that AR devices on the market show promising clinical outcomes in preoperative training and intraoperative use. Three prominent systems were as follows: XVision, HoloLens, and ImmersiveTouch. In the studies, surgeons, residents, and medical students had opportunities to operate AR systems, showcasing their educational potential across each phase of learning. Specifically, one facet described training with cadaver models to gauge accuracy in pedicle screw placement. AR-MISS exceeded free-hand methods without unique complications or contraindications.

CONCLUSIONS

While still in its infancy, AR has already proven beneficial for educational training and intraoperative MISS applications. We believe that with continued research and advancement of this technology, AR is poised to become a dominant player within the fundamentals of surgical education and MISS operative technique.

Extended reality for biomedicine

Extended reality (XR) refers to an umbrella of methods that allows users to be immersed in a three-dimensional (3D) or a 4D (spatial + temporal) virtual environment to different extents, including virtual reality (VR), augmented reality (AR), and mixed reality (MR). While VR allows a user to be fully immersed in a virtual environment, AR and MR overlay virtual objects over the real physical world. The immersion and interaction of XR provide unparalleled opportunities to extend our world beyond conventional lifestyles. While XR has extensive applications in fields such as entertainment and education, its numerous applications in biomedicine create transformative opportunities in both fundamental research and healthcare. This Primer outlines XR technology from instrumentation to software computation methods, delineating the biomedical applications that have been advanced by state-of-the-art techniques. We further describe the technical advances overcoming current limitations in XR and its applications, providing an entry point for professionals and trainees to thrive in this emerging field.

Metaverse applied to musculoskeletal pathology: Orthoverse and Rehabverse

The Metaverse is 'an integrated network of 3D virtual worlds.' It incorporates digitally created realities into the real world, involves virtual copies of existing places and changes the physical reality by superimposing digital aspects, allowing its users to interact with these elements in an immersive, real-time experience. The applications of the Metaverse are numerous, with an increasing number of experiences in the field of musculoskeletal disease management. In the field of medical training, the Metaverse can help facilitate the learning experience and help develop complex clinical skills. In clinical care, the Metaverse can help clinicians perform orthopedic surgery more accurately and safely and can improve pain management, the performance of rehabilitation techniques and the promotion of healthy lifestyles. Virtualization can also optimize aspects of healthcare information and management, increasing the effectiveness of procedures and the functioning of organizations. This optimization can be especially relevant in departments that are under significant care provider pressure. However, we must not lose sight of the fundamental challenges that still need to be solved, such as ensuring patient privacy and fairness. Several studies are underway to assess the feasibility and safety of the Metaverse.

Artificial intelligence and treatment algorithms in spine surgery

Artificial intelligence (AI) is a set of theories and techniques in which machines are used to simulate human intelligence with complex computer programs. The various machine learning (ML) methods are a subtype of AI. They originate from computer science and use algorithms established from analyzing a database to accomplish certain tasks. Among these methods are decision trees or random forests, support vector machines along with artificial neural networks. Convolutive neural networks were inspired from the visual cortex; they process combinations of information used in image or voice recognition. Deep learning (DL) groups together a set of ML methods and is useful for modeling complex relationships with a high degree of abstraction by using multiple layers of artificial neurons. ML techniques have a growing role in spine surgery. The main applications are the segmentation of intraoperative images for surgical navigation or robotics used for pedicle screw placement, the interpretation of images of intervertebral discs or full spine radiographs, which can be automated using ML algorithms. ML techniques can also be used as aids for surgical decision-making in complex fields, such as preoperative evaluation of adult spinal deformity. ML algorithms "learn" from large clinical databases. They make it possible to establish the intraoperative risk level and make a prognosis on how the postoperative functional scores will change over time as a function of the patient profile. These applications open a new path relative to standard statistical analyses. They make it possible to explore more complex relationships with multiple indirect interactions. In the future, AI algorithms could have a greater role in clinical research, evaluating clinical and surgical practices, and conducting health economics analyses.

Clinical applications of augmented reality in orthopaedic surgery: a comprehensive narrative review

PURPOSE

The development of augmented reality (AR) technology allows orthopaedic surgeons to incorporate and visualize surgical data, assisting the execution of both routine and complex surgical operations. Uniquely, AR technology allows a surgeon to view the surgical field and superimpose peri-operative imaging, anatomical landmarks, navigation guidance, and more, all in one view without the need for conjugate gaze between multiple screens. The aim of this literature review was to introduce the fundamental requirements for an augmented reality system and to assess the current applications, outcomes, and potential limitations to this technology.

METHODS

A literature search was performed using MEDLINE and Embase databases, by two independent reviewers, who then collaboratively synthesized and collated the results of the literature search into a narrative review focused on the applications of augmented reality in major orthopaedic sub-specialties.

RESULTS

Current technology requires that pre-operative patient data be acquired, and AR-compatible models constructed. Intra-operatively, to produce manipulatable virtual images into the user's view in real time, four major components are required including a camera, computer image processing technology, tracking tools, and an output screen. The user is provided with a heads-up display, which is a transparent display, enabling the user to look at both their natural view and the computer-generated images. Currently, high-quality evidence for clinical implementation of AR technology in the orthopaedic surgery operating room is lacking; however, growing in vitro literature highlights a multitude of potential applications, including increasing operative accuracy, improved biomechanical angular and alignment parameters, and potentially reduced operative time.

CONCLUSION

While the application of AR systems in surgery is currently in its infancy, we anticipate rapid and widespread implementation of this technology in various orthopaedic sub-specialties.

Augmented Reality-Assisted Navigation System for Transforaminal Epidural Injection

Purpose

Multiple studies have attempted to demonstrate the benefits of augmented reality (AR)-assisted navigation systems in surgery. Lumbosacral transforaminal epidural injection is an effective treatment commonly used in patients with radiculopathy due to spinal degenerative pathologies. However, few studies have applied AR-assisted navigation systems to this procedure. The study aimed to investigate the safety and effectiveness of an AR-assisted navigation system for transforaminal epidural injection.

Patients and Methods

Through a real-time tracking system and a wireless network to the head-mounted display, computed tomography images of the spine and the path of a spinal needle to the target were visualized on a torso phantom with respiration movements installed. From L1/L2 to L5/S1, needle insertions were performed using an AR-assisted system on the left side of the phantom, and the conventional method was performed on the right side.

Results

The procedure duration was approximately three times shorter, and the number of radiographs required was reduced in the experimental group compared to the control group. The distance from the needle tips to the target areas in the plan showed no significant difference between the two groups. (AR group 1.7 ± 2.3mm, control group 3.2 ± 2.8mm, P value 0.067).

Conclusion

An AR-assisted navigation system may be used to reduce the time required for spinal interventions and ensure the safety of patients and physicians in view of radiation exposure. Further studies are essential to apply AR-assisted navigation systems to spine interventions.

Current and Emerging Approaches for Spine Tumor Treatment

Spine tumors represent a significant social and medical problem, affecting the quality of life of thousands of patients and imposing a burden on healthcare systems worldwide. Encompassing a wide range of diseases, spine tumors require prompt multidisciplinary treatment strategies, being mainly approached through chemotherapy, radiotherapy, and surgical interventions, either alone or in various combinations. However, these conventional tactics exhibit a series of drawbacks (e.g., multidrug resistance, tumor recurrence, systemic adverse effects, invasiveness, formation of large bone defects) which limit their application and efficacy. Therefore, recent research focused on finding better treatment alternatives by utilizing modern technologies to overcome the challenges associated with conventional treatments. In this context, the present paper aims to describe the types of spine tumors and the most common current treatment alternatives, further detailing the recent developments in anticancer nanoformulations, personalized implants, and enhanced surgical techniques.

Augmented Reality Neuronavigation for En Bloc Resection of Spinal Column Lesions

BACKGROUND

Primary tumors involving the spine are relatively rare but represent surgically challenging procedures with high patient morbidity. En bloc resection of these tumors necessitates large exposures, wide tumor margins, and poses risks to functionally relevant anatomical structures. Augmented reality neuronavigation (ARNV) represents a paradigm shift in neuronavigation, allowing on-demand visualization of 3D navigation data in real-time directly in line with the operative field.

METHODS

Here, we describe the first application of ARNV to perform distal sacrococcygectomies for the en bloc removal of sacral and retrorectal lesions involving the coccyx in 2 patients, as well as a thoracic 9-11 laminectomy with costotransversectomy for en bloc removal of a schwannoma in a third patient.

RESULTS

In our experience, ARNV allowed our teams to minimize the length of the incision, reduce the extent of bony resection, and enhanced visualization of critical adjacent anatomy. All tumors were resected en bloc, and the patients recovered well postoperatively, with no known complications. Pathologic analysis confirmed the en bloc removal of these lesions with negative margins.

CONCLUSIONS

We conclude that ARNV is an effective strategy for the precise, en bloc removal of spinal lesions including both sacrococcygeal tumors involving the retrorectal space and thoracic schwannomas.

Practical Use of Augmented Reality Modeling to Guide Revision Spine Surgery: An Illustrative Case of Hardware Failure and Overriding Spondyloptosis

BACKGROUND AND IMPORTANCE

Augmented reality (AR) is a novel technology with broadening applications to neurosurgery. In deformity spine surgery, it has been primarily directed to the more precise placement of pedicle screws. However, AR may also be used to generate high fidelity three-dimensional (3D) spine models for cases of advanced deformity with existing instrumentation. We present a case in which an AR-generated 3D model was used to facilitate and expedite the removal of embedded instrumentation and guide the reduction of an overriding spondyloptotic deformity.

CLINICAL PRESENTATION

A young adult with a remote history of a motor vehicle accident treated with long-segment posterior spinal stabilization presented with increasing back pain and difficulty sitting upright in a wheelchair. Imaging revealed pseudoarthrosis with multiple rod fractures resulting in an overriding spondyloptosis of T6 on T9. An AR-generated 3D model was useful in the intraoperative localization of rod breaks and other extensively embedded instrumentation. Real-time model thresholding expedited the safe explanation of the defunct system and correction of the spondyloptosis deformity.

CONCLUSION

An AR-generated 3D model proved instrumental in a revision case of hardware failure and high-grade spinal deformity.

Evaluation of optical tracking and augmented reality for needle navigation in sacral nerve stimulation

BACKGROUND AND OBJECTIVE

Sacral nerve stimulation (SNS) is a minimally invasive procedure where an electrode lead is implanted through the sacral foramina to stimulate the nerve modulating colonic and urinary functions. One of the most crucial steps in SNS procedures is the placement of the tined lead close to the sacral nerve. However, needle insertion is very challenging for surgeons. Several x-ray projections are required to interpret the needle position correctly. In many cases, multiple punctures are needed, causing an increase in surgical time and patient's discomfort and pain. In this work we propose and evaluate two different navigation systems to guide electrode placement in SNS surgeries designed to reduce surgical time, minimize patient discomfort and improve surgical outcomes.

METHODS

We developed, for the first alternative, an open-source navigation software to guide electrode placement by real-time needle tracking with an optical tracking system (OTS). In the second method, we present a smartphone-based AR application that displays virtual guidance elements directly on the affected area, using a 3D printed reference marker placed on the patient. This guidance facilitates needle insertion with a predefined trajectory. Both techniques were evaluated to determine which one obtained better results than the current surgical procedure. To compare the proposals with the clinical method, we developed an x-ray software tool that calculates a digitally reconstructed radiograph, simulating the fluoroscopy acquisitions during the procedure. Twelve physicians (inexperienced and experienced users) performed needle insertions through several specific targets to evaluate the alternative SNS guidance methods on a realistic patient-based phantom.

RESULTS

With each navigation solution, we observed that users took less average time to complete each insertion (36.83 s and 44.43 s for the OTS and AR methods, respectively) and needed fewer average punctures to reach the target (1.23 and 1.96 for the OTS and AR methods respectively) than following the standard clinical method (189.28 s and 3.65 punctures).

CONCLUSIONS

To conclude, we have shown two navigation alternatives that could improve surgical outcome by significantly reducing needle insertions, surgical time and patient's pain in SNS procedures. We believe that these solutions are feasible to train surgeons and even replace current SNS clinical procedures.

Minimally Invasive Spinal Treatment (MIST)—A New Concept in the Treatment of Spinal Diseases: A Narrative Review

In the past two decades, minimally invasive spine surgery (MISS) techniques have been developed for spinal surgery. Historically, minimizing invasiveness in decompression surgery was initially reported as a MISS technique. In recent years, MISS techniques have also been applied for spinal stabilization techniques, which were defined as minimally invasive spine stabilization (MISt), including percutaneous pedicle screws (PPS) fixation, lateral lumbar interbody fusion, balloon kyphoplasty, percutaneous vertebroplasty, cortical bone trajectory, and cervical total disc replacement. These MISS techniques typically provide many advantages such as preservation of paraspinal musculature, less blood loss, a shorter operative time, less postoperative pain, and a lower infection rate as well as being more cost-effective compared to traditional open techniques. However, even MISS techniques are associated with several limitations including technical difficulty, training opportunities, surgical cost, equipment cost, and radiation exposure. These downsides of surgical treatments make conservative treatments more feasible option. In the future, medicine must become “minimally invasive” in the broadest sense—for all patients, conventional surgeries, medical personnel, hospital management, nursing care, and the medical economy. As a new framework for the treatment of spinal diseases, the concept of minimally invasive spinal treatment (MIST) has been proposed.

Extended Reality in Neurosurgical Education: A Systematic Review

Surgical simulation practices have witnessed a rapid expansion as an invaluable approach to resident training in recent years. One emerging way of implementing simulation is the adoption of extended reality (XR) technologies, which enable trainees to hone their skills by allowing interaction with virtual 3D objects placed in either real-world imagery or virtual environments. The goal of the present systematic review is to survey and broach the topic of XR in neurosurgery, with a focus on education. Five databases were investigated, leading to the inclusion of 31 studies after a thorough reviewing process. Focusing on user performance (UP) and user experience (UX), the body of evidence provided by these 31 studies showed that this technology has, in fact, the potential of enhancing neurosurgical education through the use of a wide array of both objective and subjective metrics. Recent research on the topic has so far produced solid results, particularly showing improvements in young residents, compared to other groups and over time. In conclusion, this review not only aids to a better understanding of the use of XR in neurosurgical education, but also highlights the areas where further research is entailed while also providing valuable insight into future applications.

Robot-assisted and augmented reality-assisted spinal instrumentation: a systematic review and meta-analysis of screw accuracy and outcomes over the last decade

OBJECTIVE

The use of technology-enhanced methods in spine surgery has increased immensely over the past decade. Here, the authors present the largest systematic review and meta-analysis to date that specifically addresses patient-centered outcomes, including the risk of inaccurate screw placement and perioperative outcomes in spinal surgeries using robotic instrumentation and/or augmented reality surgical navigation (ARSN).

METHODS

A systematic review of the literature in the PubMed, EMBASE, Web of Science, and Cochrane Library databases spanning the last decade (January 2011-November 2021) was performed to present all clinical studies comparing robot-assisted instrumentation and ARSN with conventional instrumentation techniques in lumbar spine surgery. The authors compared these two technologies as they relate to screw accuracy, estimated blood loss (EBL), intraoperative time, length of stay (LOS), perioperative complications, radiation dose and time, and the rate of reoperation.

RESULTS

A total of 64 studies were analyzed that included 11,113 patients receiving 20,547 screws. Robot-assisted instrumentation was associated with less risk of inaccurate screw placement (p < 0.0001) regardless of control arm approach (freehand, fluoroscopy guided, or navigation guided), fewer reoperations (p < 0.0001), fewer perioperative complications (p < 0.0001), lower EBL (p = 0.0005), decreased LOS (p < 0.0001), and increased intraoperative time (p = 0.0003). ARSN was associated with decreased radiation exposure compared with robotic instrumentation (p = 0.0091) and fluoroscopy-guided (p < 0.0001) techniques.

CONCLUSIONS

Altogether, the pooled data suggest that technology-enhanced thoracolumbar instrumentation is advantageous for both patients and surgeons. As the technology progresses and indications expand, it remains essential to continue investigations of both robotic instrumentation and ARSN to validate meaningful benefit over conventional instrumentation techniques in spine surgery.

Brain Tumor and Augmented Reality: New Technologies for the Future

In recent years, huge progress has been made in the management of brain tumors, due to the availability of imaging devices, which provide fundamental anatomical and pathological information not only for diagnostic purposes [...].

Augmented Reality: Mapping Methods and Tools for Enhancing the Human Role in Healthcare HMI

Background: Augmented Reality (AR) represents an innovative technology to improve data visualization and strengthen the human perception. Among Human–Machine Interaction (HMI), medicine can benefit most from the adoption of these digital technologies. In this perspective, the literature on orthopedic surgery techniques based on AR was evaluated, focusing on identifying the limitations and challenges of AR-based healthcare applications, to support the research and the development of further studies. Methods: Studies published from January 2018 to December 2021 were analyzed after a comprehensive search on PubMed, Google Scholar, Scopus, IEEE Xplore, Science Direct, and Wiley Online Library databases. In order to improve the review reporting, the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guidelines were used. Results: Authors selected sixty-two articles meeting the inclusion criteria, which were categorized according to the purpose of the study (intraoperative, training, rehabilitation) and according to the surgical procedure used. Conclusions: AR has the potential to improve orthopedic training and practice by providing an increasingly human-centered clinical approach. Further research can be addressed by this review to cover problems related to hardware limitations, lack of accurate registration and tracking systems, and absence of security protocols.

Spine Surgery Assisted by Augmented Reality: Where Have We Been?

This present systematic review examines spine surgery literature supporting augmented reality (AR) technology and summarizes its current status in spinal surgery technology. Database search strategies were retrieved from PubMed, Web of Science, Cochrane Library, Embase, from the earliest records to April 1, 2021. Our review briefly examines the history of AR, and enumerates different device application workflows in a variety of spinal surgeries. We also sort out the pros and cons of current mainstream AR devices and the latest updates. A total of 45 articles are included in our review. The most prevalent surgical applications included are the augmented reality surgical navigation system and head-mounted display. The most popular application of AR is pedicle screw instrumentation in spine surgery, and the primary responsible surgical levels are thoracic and lumbar. AR guidance systems show high potential value in practical clinical applications for the spine. The overall number of cases in AR-related studies is still rare compared to traditional surgical-assisted techniques. These lack long-term clinical efficacy and robust surgical-related statistical data. Changing healthcare laws as well as the increasing prevalence of spinal surgery are generating critical data that determines the value of AR technology.

Intra-operative wearable visualization in spine surgery: past, present, and future

The history of modern surgery has run parallel to the invention and development of intra-operative visualization techniques. The first operating room, built in 1804 at Pennsylvania Hospital, demonstrates this principle: illumination of the surgical field by the Sun through an overhead skylight allowed surgeries to proceed even prior to the invention of anesthesia or sterile technique. Surgeries were restricted to begin around when the Sun was at its zenith; without adequate light from the Sun and skylight, surgeons were unable to achieve adequate visualization. In the years since, new visualization instruments have expanded the scope and success of surgical intervention. Spine surgery in particular has benefited greatly from improved visualization technologies, due to the complex and intricate nervous, vascular and musculoskeletal structures that are closely intertwined which surgeons must manipulate. Over time, new technologies have also advanced to take up smaller footprints, leading to the rise of wearable tools that surgeons don intra-operatively to better visualize the surgical field. As surgical techniques shift to more minimally invasive methods, reliable, fidelitous, and ergonomic wearables are of growing importance. Here, we discuss the past and present of wearable visualization tools, from the first surgical loupes to cutting-edge augmented reality (AR) goggles, and comment on how emerging innovations will continue to revolutionize spine surgery.

Feasibility and Accuracy of Thoracolumbar Pedicle Screw Placement Using an Augmented Reality Head Mounted Device

Background: To investigate the accuracy of augmented reality (AR) navigation using the Magic Leap head mounted device (HMD), pedicle screws were minimally invasively placed in four spine phantoms. Methods: AR navigation provided by a combination of a conventional navigation system integrated with the Magic Leap head mounted device (AR-HMD) was used. Forty-eight screws were planned and inserted into Th11-L4 of the phantoms using the AR-HMD and navigated instruments. Postprocedural CT scans were used to grade the technical (deviation from the plan) and clinical (Gertzbein grade) accuracy of the screws. The time for each screw placement was recorded. Results: The mean deviation between navigation plan and screw position was 1.9 ± 0.7 mm (1.9 [0.3–4.1] mm) at the entry point and 1.4 ± 0.8 mm (1.2 [0.1–3.9] mm) at the screw tip. The angular deviation was 3.0 ± 1.4° (2.7 [0.4–6.2]°) and the mean time for screw placement was 130 ± 55 s (108 [58–437] s). The clinical accuracy was 94% according to the Gertzbein grading scale. Conclusion: The combination of an AR-HMD with a conventional navigation system for accurate minimally invasive screw placement is feasible and can exploit the benefits of AR in the perspective of the surgeon with the reliability of a conventional navigation system.

Augmented Reality in Spinal Surgery: Highlights From Augmented Reality Lectures at the Emerging Technologies Annual Meetings

Introduction

Augmented reality (AR) is an advanced technology and emerging field that has been adopted into spine surgery to enhance care and outcomes. AR superimposes a three-dimensional computer-generated image over the normal anatomy of interest in order to facilitate visualization of deep structures without the ability to directly see them.

Objective

To summarize the latest literature and highlight AR from the annual “Spinal Navigation, Emerging Technologies and Systems Integration” meeting lectures presented by the Seattle Science Foundation (SSF) on the development and use of augmented reality in spinal surgery. 

Methods

 We performed a comprehensive literature review from 2016 to 2020 on PubMed to correlate with lectures given at the annual “Emerging Technologies” conferences. After the exclusion of papers that concerned non-spine surgery specialties, a total of 54 papers concerning AR in spinal applications were found. The articles were then categorized by content and focus.

Results

The 54 papers were divided into six major focused topics: training, proof of concept, feasibility and usability, clinical evaluation, state of technology, and nonsurgical applications. The greatest number of papers were published during 2020. Each paper discussed varied topics such as patient rehabilitation, proof of concept, workflow, applications in neurological and orthopedic spine surgery, and outcomes data.

Conclusions

The recent literature and SSF lectures on AR provide a solid base and demonstrate the emergence of an advanced technology that offers a platform for an advantageous technique that is superior, in that it allows the operating surgeon to focus directly on the patient rather than a guidance screen.

Augmented Reality (AR) in Orthopedics: Current Applications and Future Directions

PURPOSE OF REVIEW

Imaging technologies (X-ray, CT, MRI, and ultrasound) have revolutionized orthopedic surgery, allowing for the more efficient diagnosis, monitoring, and treatment of musculoskeletal aliments. The current review investigates recent literature surrounding the impact of augmented reality (AR) imaging technologies on orthopedic surgery. In particular, it investigates the impact that AR technologies may have on provider cognitive burden, operative times, occupational radiation exposure, and surgical precision and outcomes.

RECENT FINDINGS

Many AR technologies have been shown to lower provider cognitive burden and reduce operative time and radiation exposure while improving surgical precision in pre-clinical cadaveric and sawbones models. So far, only a few platforms focusing on pedicle screw placement have been approved by the FDA. These technologies have been implemented clinically with mixed results when compared to traditional free-hand approaches. It remains to be seen if current AR technologies can deliver upon their multitude of promises, and the ability to do so seems contingent upon continued technological progress. Additionally, the impact of these platforms will likely be highly conditional on clinical indication and provider type. It remains unclear if AR will be broadly accepted and utilized or if it will be reserved for niche indications where it adds significant value. One thing is clear, orthopedics' high utilization of pre- and intra-operative imaging, combined with the relative ease of tracking rigid structures like bone as compared to soft tissues, has made it the clear beachhead market for AR technologies in medicine.

Augmented Reality-Assisted Craniotomy for Parasagittal and Convexity En Plaque Meningiomas and Custom-Made Cranio-Plasty: A Preliminary Laboratory Report

BACKGROUND

This report discusses the utility of a wearable augmented reality platform in neurosurgery for parasagittal and convexity en plaque meningiomas with bone flap removal and custom-made cranioplasty.

METHODS

A real patient with en plaque cranial vault meningioma with diffuse and extensive dural involvement, extracranial extension into the calvarium, and homogeneous contrast enhancement on gadolinium-enhanced T1-weighted MRI, was selected for this case study. A patient-specific manikin was designed starting with the segmentation of the patient's preoperative MRI images to simulate a craniotomy procedure. Surgical planning was performed according to the segmented anatomy, and customized bone flaps were designed accordingly. During the surgical simulation stage, the VOSTARS head-mounted display was used to accurately display the planned craniotomy trajectory over the manikin skull. The precision of the craniotomy was assessed based on the evaluation of previously prepared custom-made bone flaps.

RESULTS

A bone flap with a radius 0.5 mm smaller than the radius of an ideal craniotomy fitted perfectly over the performed craniotomy, demonstrating an error of less than ±1 mm in the task execution. The results of this laboratory-based experiment suggest that the proposed augmented reality platform helps in simulating convexity en plaque meningioma resection and custom-made cranioplasty, as carefully planned in the preoperative phase.

CONCLUSIONS

Augmented reality head-mounted displays have the potential to be a useful adjunct in tumor surgical resection, cranial vault lesion craniotomy and also skull base surgery, but more study with large series is needed.

Utility of Augmented Reality and Virtual Reality in Spine Surgery: A Systematic Review of the Literature

BACKGROUND

Augmented reality, virtual reality, and mixed reality (AR, VR, MR) are emerging technologies that are starting to be translated into clinical practice. There is limited data available about these tools being used in live surgery of the spine. The objective of this paper was to systematically collect, analyze, and interpret the existing data regarding AR, VR, and MR use in spine surgery on live people.

METHODS

A systematic review was conducted using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines (PRISMA). PubMed, PubMed Central, Cochrane Reviews, and Embase databases were searched. Combinations and variations of "augmented reality", "virtual reality", and "spine surgery" in both AND and OR configurations were used to gather relevant articles. References of included articles from the systematic review were also screened for possible inclusion as a part of manual review. Included studies were full text publications written in English that had any spine surgery on live persons with the use of virtual or augmented reality.

RESULTS

A total of 1566 unique articles were found, and fifteen full-text publications met criteria for this study. The total number of patients from all studies was 241 with a weighted average age of 50.37. Surgical procedures utilizing AR, VR, and/or MR were diverse and spanned from simple discectomies to intradural spinal tumor resection. All patients experienced improvement in their symptoms from clinical presentation. The highest complication rate mentioned in the articles was 6.1% and was for suboptimal pedicle screw placement. There were no complications that led to clinical sequelae.

CONCLUSIONS

The systematically collected, analyzed, and interpreted data of existing peer-reviewed full text articles showed favorable metrics regarding surgical efficacy, pedicle screw target accuracy, radiation exposure, clinical outcome, and disability and pain in patients with spinal pathology treated with the help of AR, VR, and/or MR.

Real-time navigation guidance with intraoperative CT imaging for pedicle screw placement using an augmented reality head-mounted display: a proof-of-concept study

OBJECTIVE

Augmented reality (AR) has the potential to improve the accuracy and efficiency of instrumentation placement in spinal fusion surgery, increasing patient safety and outcomes, optimizing ergonomics in the surgical suite, and ultimately lowering procedural costs. The authors sought to describe the use of a commercial prototype Spine AR platform (SpineAR) that provides a commercial AR head-mounted display (ARHMD) user interface for navigation-guided spine surgery incorporating real-time navigation images from intraoperative imaging with a 3D-reconstructed model in the surgeon's field of view, and to assess screw placement accuracy via this method.

METHODS

Pedicle screw placement accuracy was assessed and compared with literature-reported data of the freehand (FH) technique. Accuracy with SpineAR was also compared between participants of varying spine surgical experience. Eleven operators without prior experience with AR-assisted pedicle screw placement took part in the study: 5 attending neurosurgeons and 6 trainees (1 neurosurgical fellow, 1 senior orthopedic resident, 3 neurosurgical residents, and 1 medical student). Commercially available 3D-printed lumbar spine models were utilized as surrogates of human anatomy. Among the operators, a total of 192 screws were instrumented bilaterally from L2-5 using SpineAR in 24 lumbar spine models. All but one trainee also inserted 8 screws using the FH method. In addition to accuracy scoring using the Gertzbein-Robbins grading scale, axial trajectory was assessed, and user feedback on experience with SpineAR was collected.

RESULTS

Based on the Gertzbein-Robbins grading scale, the overall screw placement accuracy using SpineAR among all users was 98.4% (192 screws). Accuracy for attendings and trainees was 99.1% (112 screws) and 97.5% (80 screws), respectively. Accuracy rates were higher compared with literature-reported lumbar screw placement accuracy using FH for attendings (99.1% vs 94.32%; p = 0.0212) and all users (98.4% vs 94.32%; p = 0.0099). The percentage of total inserted screws with a minimum of 5° medial angulation was 100%. No differences were observed between attendings and trainees or between the two methods. User feedback on SpineAR was generally positive.

CONCLUSIONS

Screw placement was feasible and accurate using SpineAR, an ARHMD platform with real-time navigation guidance that provided a favorable surgeon-user experience.

Minimally Invasive Transforaminal Lumbar Interbody Fusion Using Augmented Reality Surgical Navigation for Percutaneous Pedicle Screw Placement

STUDY DESIGN

This was a retrospective observational study.

OBJECTIVE

The aim of this study was to evaluate the accuracy of percutaneous pedicle screw placement using augmented reality surgical navigation during minimally invasive transforaminal lumbar interbody fusion (TLIF).

SUMMARY OF BACKGROUND DATA

Augmented reality-based navigation is a new type of computer-assisted navigation where video cameras are used instead of infrared cameras to track the operated patients and surgical instruments. This technology has not so far been clinically evaluated for percutaneous pedicle screw placement.

MATERIALS AND METHODS

The study assessed percutaneous pedicle screw placement in 20 consecutive patients who underwent single-level minimally invasive TLIF using augmented reality surgical navigation. Facet joint violation and depression by the inserted pedicle screws were evaluated. Secondary outcome such as radiation dose exposure, fluoroscopy time, and operative time were collected for 3 phases of surgery: preparation phase, pedicle screw placement, and decompression with cage placement.

RESULTS

A clinical accuracy for screw placement within the pedicle (Gertzbein 0 or 1) of 94% was achieved. One screw violated the facet joint with a transarticular pathway. The screw head did not depress the facet in 54%. The use of fluoroscopy during navigation correlated with patient body-mass index (r=0.68, P<0.0001). The pedicle screw placement time corresponded to 36±5% of the total operative time of 117±11 minutes. A statistically significant decrease of 10 minutes in operative time was observed between the first and last 10 procedures which corresponded to the pedicle screw placement time decrease (48±9 vs. 38±7 min, P=0.0142). The learning curve model suggests an ultimate operative time decrease to 97 minutes.

CONCLUSION

Augmented reality surgical navigation can be clinically used to place percutaneous screws during minimally invasive TLIF. However, the lack of tracking of the location of the device requires intraoperative fluoroscopy to monitor screw insertion depth especially in obese patients.

LEVEL OF EVIDENCE

Level III.

Augmented reality navigation for cranial biopsy and external ventricular drain insertion

OBJECTIVE

The aim of this study was to evaluate the accuracy (deviation from the target or intended path) and efficacy (insertion time) of an augmented reality surgical navigation (ARSN) system for insertion of biopsy needles and external ventricular drains (EVDs), two common neurosurgical procedures that require high precision.

METHODS

The hybrid operating room-based ARSN system, comprising a robotic C-arm with intraoperative cone-beam CT (CBCT) and integrated video tracking of the patient and instruments using nonobtrusive adhesive optical markers, was used. A 3D-printed skull phantom with a realistic gelatinous brain model containing air-filled ventricles and 2-mm spherical biopsy targets was obtained. After initial CBCT acquisition for target registration and planning, ARSN was used for 30 cranial biopsies and 10 EVD insertions. Needle positions were verified by CBCT.

RESULTS

The mean accuracy of the biopsy needle insertions (n = 30) was 0.8 mm ± 0.43 mm. The median path length was 39 mm (range 16-104 mm) and did not correlate to accuracy (p = 0.15). The median device insertion time was 149 seconds (range 87-233 seconds). The mean accuracy for the EVD insertions (n = 10) was 2.9 mm ± 0.8 mm at the tip with a 0.7° ± 0.5° angular deviation compared with the planned path, and the median insertion time was 188 seconds (range 135-400 seconds).

CONCLUSIONS

This study demonstrated that ARSN can be used for navigation of percutaneous cranial biopsies and EVDs with high accuracy and efficacy.

Virtual and augmented reality for biomedical applications

3D visualization technologies such as virtual reality (VR), augmented reality (AR), and mixed reality (MR) have gained popularity in the recent decade. Digital extended reality (XR) technologies have been adopted in various domains ranging from entertainment to education because of their accessibility and affordability. XR modalities create an immersive experience, enabling 3D visualization of the content without a conventional 2D display constraint. Here, we provide a perspective on XR in current biomedical applications and demonstrate case studies using cell biology concepts, multiplexed proteomics images, surgical data for heart operations, and cardiac 3D models. Emerging challenges associated with XR technologies in the context of adverse health effects and a cost comparison of distinct platforms are discussed. The presented XR platforms will be useful for biomedical education, medical training, surgical guidance, and molecular data visualization to enhance trainees' and students' learning, medical operation accuracy, and the comprehensibility of complex biological systems.

"Disruptive Technology" in Spine Surgery and Education: Virtual and Augmented Reality

BACKGROUND

Technological advancements are the drivers of modern-day spine care. With the growing pressure to deliver faster and better care, surgical-assist technology is needed to harness computing power and enable the surgeon to improve outcomes. Virtual reality (VR) and augmented reality (AR) represent the pinnacle of emerging technology, not only to deliver higher quality education through simulated care, but also to provide valuable intraoperative information to assist in more efficient and more precise surgeries.

OBJECTIVE

To describe how the disruptive technologies of VR and AR interface in spine surgery and education.

METHODS

We review the relevance of VR and AR technologies in spine care, and describe the feasibility and limitations of the technologies.

RESULTS

We discuss potential future applications, and provide a case study demonstrating the feasibility of a VR program for neurosurgical spine education.

CONCLUSION

Initial experiences with VR and AR technologies demonstrate their applicability and ease of implementation. However, further prospective studies through multi-institutional and industry-academic partnerships are necessary to solidify the future of VR and AR in spine surgery education and clinical practice.

Applications of augmented reality in the neurosurgical operating room: A systematic review of the literature

Advancements in imaging techniques are key forces of progress in neurosurgery. The importance of accurate visualization of intraoperative anatomy cannot be overemphasized and is commonly delivered through traditional neuronavigation. Augmented Reality (AR) technology has been tested and applied widely in various neurosurgical subspecialties in intraoperative, clinical use and shows promise for the future. This systematic review of the literature explores the ways in which AR technology has been successfully brought into the operating room (OR) and incorporated into clinical practice. A comprehensive literature search was performed in the following databases from inception-April 2020: Ovid MEDLINE, Ovid EMBASE, and The Cochrane Library. Studies retrieved were then screened for eligibility against predefined inclusion/exclusion criteria. A total of 54 articles were included in this systematic review. The studies were sub- grouped into brain and spine subspecialties and analyzed for their incorporation of AR in the neurosurgical clinical setting. AR technology has the potential to greatly enhance intraoperative visualization and guidance in neurosurgery beyond the traditional neuronavigation systems. However, there are several key challenges to scaling the use of this technology and bringing it into standard operative practice including accurate and efficient brain segmentation of magnetic resonance imaging (MRI) scans, accounting for brain shift, reducing coregistration errors, and improving the AR device hardware. There is also an exciting potential for future work combining AR with multimodal imaging techniques and artificial intelligence to further enhance its impact in neurosurgery.

First in man in-situ augmented reality pedicle screw navigation

Background

Augmented reality (AR) is a rising technology gaining increasing utility in medicine. By superimposing the surgical site and the operator's visual field with computer-generated information, it has the potential to enhance the cognitive skills of surgeons. This is the report of the first in man case with "direct holographic navigation" as part of a randomized controlled trial.

Case description

A pointing instrument was equipped with a sterile fiducial marker, which was used to obtain a digital representation of the intraoperative bony anatomy of the lumbar spine. Subsequently, a previously validated registration method was applied to superimpose the surgery plan with the intraoperative anatomy. The registration result is shown in situ as a 3D AR hologram of the preoperative 3D vertebra model with the planned screw trajectory and entry point for validation and approval by the surgeon. After achieving alignment with the surgery plan, a borehole is drilled and the pedicle screw placed. Postoperativ computer tomography was used to measure accuracy of this novel method for surgical navigation.

Outcome

Correct screw positions entirely within bone were documented with a postoperative CT, with an accuracy similar to current standard of care methods for surgical navigation. The patient was mobilized uneventfully on the first postoperative day with little pain medication and dismissed on the fourth postoperative day.

Conclusion

This first in man report of direct AR navigation demonstrates feasibility in vivo. The continuation of this randomized controlled study will evaluate the value of this novel technology.

Augmented, virtual and mixed reality in spinal surgery: A real-world experience

This review aims to identify the role of augmented, virtual or mixed reality (AR, VR or MR) technologies in setting of spinal surgery. The authors address the challenges surrounding the implementation of this technology in the operating room. A technical standpoint addresses the efficacy of these imaging modalities based on the current literature in the field. Ultimately, these technologies must be cost-effective to ensure widespread adoption. This may be achieved through reduced surgical times and decreased incidence of post-operative complications and revisions while maintaining equivalent safety profile to alternative surgical approaches. While current studies focus mainly on the successful placement of pedicle screws via AR-guided instrumentation, a wider scope of procedures may be assisted using AR, VR or MR technology once efficacy and safety have been validated. These emerging technologies offer a significant advantage in the guidance of complex procedures that require high precision and accuracy using minimally invasive interventions.

Navigation assisted total knee arthroplasty in 54,114 patients: No increased risk in acute complications and hospital utilisation

BACKGROUND

The advent of navigation in total knee arthroplasty (TKA) has generated interest in attempt to improve component positioning as desired and clinical outcomes. The aim of this study was to evaluate 90-day complication and cost of navigation-assisted TKAs (NTKA) compared to conventional TKAs (CTKA) using a national database.

METHODS

A retrospective review of national database was conducted on all patients who underwent TKA from 2010 and 2017. The cohort was stratified into NTKA and CTKA subcohorts, excluding cases utilizing robotics.

RESULTS

NTKA was associated with a significant decrease in 90-day postoperative major and minor complications. NTKA was also associated with a decrease in 90-day hospital utilization with lower rates of emergency department visits and readmissions. The cost of hospitalization and total 90-day costs were lower in NTKA, with an average savings of $800.

CONCLUSION

The adoption of navigation in TKA is safe and efficaceous compared to CTKA.

LEVEL OF EVIDENCE

III. Retrospective cohort study.

Augmented Reality, Virtual Reality and Artificial Intelligence in Orthopedic Surgery: A Systematic Review

Background: The application of virtual and augmented reality technologies to orthopaedic surgery training and practice aims to increase the safety and accuracy of procedures and reducing complications and costs. The purpose of this systematic review is to summarise the present literature on this topic while providing a detailed analysis of current flaws and benefits. Methods: A comprehensive search on the PubMed, Cochrane, CINAHL, and Embase database was conducted from inception to February 2021. The Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guidelines were used to improve the reporting of the review. The Cochrane Risk of Bias Tool and the Methodological Index for Non-Randomized Studies (MINORS) was used to assess the quality and potential bias of the included randomized and non-randomized control trials, respectively. Results: Virtual reality has been proven revolutionary for both resident training and preoperative planning. Thanks to augmented reality, orthopaedic surgeons could carry out procedures faster and more accurately, improving overall safety. Artificial intelligence (AI) is a promising technology with limitless potential, but, nowadays, its use in orthopaedic surgery is limited to preoperative diagnosis. Conclusions: Extended reality technologies have the potential to reform orthopaedic training and practice, providing an opportunity for unidirectional growth towards a patient-centred approach.

Augmented Reality in Orthopedic Surgery Is Emerging from Proof of Concept Towards Clinical Studies: a Literature Review Explaining the Technology and Current State of the Art

PURPOSE OF REVIEW

Augmented reality (AR) is becoming increasingly popular in modern-day medicine. Computer-driven tools are progressively integrated into clinical and surgical procedures. The purpose of this review was to provide a comprehensive overview of the current technology and its challenges based on recent literature mainly focusing on clinical, cadaver, and innovative sawbone studies in the field of orthopedic surgery. The most relevant literature was selected according to clinical and innovational relevance and is summarized.

RECENT FINDINGS

Augmented reality applications in orthopedic surgery are increasingly reported. In this review, we summarize basic principles of AR including data preparation, visualization, and registration/tracking and present recently published clinical applications in the area of spine, osteotomies, arthroplasty, trauma, and orthopedic oncology. Higher accuracy in surgical execution, reduction of radiation exposure, and decreased surgery time are major findings presented in the literature. In light of the tremendous progress of technological developments in modern-day medicine and emerging numbers of research groups working on the implementation of AR in routine clinical procedures, we expect the AR technology soon to be implemented as standard devices in orthopedic surgery.

Treating Lumbar Fracture Using the Mixed Reality Technique

The mixed reality (MR) technique has recently been widely used in the orthopedic surgery with satisfactory results reported. However, few studies have focused on the application of MR in the Lumbar fracture (LF). In this retrospective study, our aim is to analyze some findings by investigating the feasibility of MR applied to lumbar fracture treatment. Posterior vertebrectomy has been operated on 7 patients. The MR–based intraoperative three-dimensional image-guided navigation system (MITINS) was used to assist implantation of pedicle screws. The feasibility and safety of pedicle screw implantation were assessed by postsurgery radiography. The visual analog scale (VAS) and Oswestry Disability Index (ODI) were used to assess the pain level and recovery situation before and after surgery. 57 pedicle screws were safely and precisely placed into three-dimensional lumbar models by using MITINS. No screw was found outside the pedicle of the models, and it was not necessary for the X-ray to provide extra locative information during the operation with the use of MITINS. In summary, the application of MITINS is feasible, safe, and accurate while the lumbar fracture surgery is processing, providing satisfactory assistance for spine surgeons.

Application of Real-Time Augmented Reality Laparoscopic Navigation in Splenectomy for Massive Splenomegaly

OBJECTIVES

To evaluate the clinical impact and technical feasibility of augmented reality laparoscopic navigation (ARLN) system in laparoscopic splenectomy for massive splenomegaly.

METHODS

The clinical data of 17 consecutive patients who underwent laparoscopic splenectomy using ARLN (ARLN group) and 26 patients without ARLN guidance (Non-ARLN group) between January 2018 and April 2020 were enrolled. Propensity score matching (PSM) analysis was performed between the patients with and without ARLN guidance at a ratio of 1:1.

RESULTS

Mean intraoperative blood loss was significantly lower in the ARLN-group than in the Non-ARLN group (306.6 ml vs. 462.6 ml, p = 0.047). All the patients in the ARLN-group achieved successful splenic artery dissection, while surgical success was achieved in 12 patients in the Non-ARLN group (p = 0.044). Postoperative hospital stay was significantly longer in the Non-ARLN group (3.8 days vs. 4.5 days, p = 0.040).

CONCLUSIONS

ARLN can provide feasible and accurate intraoperative image guidance, and it could be helpful in the performance of laparoscopic splenectomy for massive splenomegaly.