Augmented reality in spine surgery - past, present, and future

Augmented reality navigation technology in atlantoaxial pedicle screw fixation for atlantoaxial dislocation treatment

Objective

This study aims to evaluate the clinical safety and feasibility of augmented reality (AR) navigation technology in atlantoaxial pedicle screw placement.

Methods

From May 2024 to December 2024, 20 patients with atlantoaxial dislocation undergoing internal fixation were enrolled. During surgery, a real-time CT scan was obtained using an O-arm imaging system, which was processed by the navigation workstation to generate AR images. These AR images can be overlaid directly onto the surgeon's field of view, guiding him to complete pedicle screw placement. The clinical feasibility and safety were evaluated based on operative time, user experience, and the Gertzbein-Robbins scale.

Results

All 20 patients successfully underwent surgery, with a total of 80 pedicle screws placement All screws met clinical safety standards, and no severe complications were observed. The operative time ranged from 16 to 21 min, with an average implantation time of 104 s per screw. The average user experience score was 90.5 points.

Conclusion

This study preliminarily validates the clinical value of AR navigation technology in atlantoaxial pedicle screw fixation, supporting further investigation.

From experimental to essential: The evolving role of augmented reality in neurosurgery (2012-2024)

Recent years have seen augmented reality (AR) transition from experimental to clinical practice. Advancements in hardware, software, and its integration with complementary technologies such as machine learning and robotics have improved its workflow and integration into the neurosurgical environment. This systematic review evaluates shifts in trends in AR adoption in neurosurgery from 2022 to 2024. A systematic review of PubMed was conducted following PRISMA guidelines. Studies published between January 2022 and December 2024 that had direct clinical or educational applications were included. Extracted data included the clinical context and geographical context from each study, and was analyzed with data from a previous systematic review from 2012 to 2021 to assess research evolution. A total of 275 new studies were identified, revealing a substantial increase in AR-related publications. Research trends have shifted towards more clinical embedded topics, particularly centered around neuronavigation (101), education (87), and spinal surgery (70), with the subspecialties exhibiting the most growth being spinal surgery, vascular surgery and neuro-oncology. Research output remained concentrated in high-income countries, led by the United states (53%), Switzerland (18.55%) and the UK (9.45%), reinforcing an expanding global disparity. Topic clustering analysis identified education as a central point of focus across subspecialties. As AR continues to become increasingly integrated within the neurosurgical workflow, future research should emphasize standardizing its clinical implementation and addressing global disparities in access and adoption.

Beyond Pedicle Screw Placement: Future Minimally Invasive Applications of Robotics in Spine Surgery

Advancements in spine surgery have dramatically enhanced minimally invasive techniques, prominently through integrating robotic systems. Although pedicle screw placement remains the most widespread application of this technology, new developments are emerging to create innovative future avenues for these tools. This review explores the promising applications of robotic technology in minimally invasive spinal procedures, ranging from assistance with laminectomies and vertebroplasty to pain management and treatment of spinal tumors. We also discuss the potential for integrating artificial intelligence and augmented reality with robotic systems. If the current trajectory of research and innovation continues, there is promise in creating fully autonomous robotic systems that can revolutionize spine surgery by processing, planning, and performing procedures without heavy reliance on the surgeon.

Augmented Reality in Minimally Invasive Spinal Interventions: Current Use and Future Directions

Minimally invasive spinal interventions have a steep learning curve from a technical perspective, as they are associated with performing precise maneuvers where the surgeon may or may not have direct or full visualization of the patient's anatomy. Augmented reality (AR), where models of the patient's anatomy can be overlaid within the surgical field, has offered promise to improve the operative experience. We present a qualitative review of recent advances in applications of AR technology in minimally invasive spinal procedures in both clinical and educational settings. We explore current evidence of experiences with this technology and highlight key areas for future development. Through this review, we aim to provide a deeper understanding of the current state of AR in transforming both the clinical and educational realms of minimally invasive spinal surgery.

Design and Evaluation of Augmented Reality-Enhanced Robotic System for Epidural Interventions

The epidural injection is a medical intervention to inject therapeutics directly into the vicinity of the spinal cord for pain management. Because of its proximity to the spinal cord, imprecise insertion of the needle may result in irreversible damage to the nerves or spinal cord. This study explores enhancing procedural accuracy by integrating a telerobotic system and augmented reality (AR) assistance. Tele-kinesthesia is achieved using a leader-follower integrated system, and stable force feedback is provided using a novel impedance-matching force rendering approach. In this domain, augmented reality employs a magnetic-tracker-based approach for real-time 3D model projection onto the patient's body, aiming to augment the physician's visual field and improve needle insertion accuracy. Preliminary results indicate that our AR-enhanced robotic system may reduce the cognitive load and improve the accuracy of ENI, highlighting the promise of AR technologies in complex medical procedures. However, further studies with larger sample sizes and more diverse clinical settings must comprehensively validate these findings. This work lays the groundwork for future research into integrating AR into medical robotics, potentially transforming clinical practices by enhancing procedural safety and efficiency.

Enabling Technologies in the Management of Cervical Spine Trauma

STUDY DESIGN

Narrative review.

OBJECTIVE

The objective of this study is to explore and evaluate the role of novel technologies in enhancing the diagnosis, surgical precision, and rehabilitation of cervical spine trauma, and to discuss their potential impact on clinical outcomes.

SUMMARY OF BACKGROUND DATA

Traumatic cervical spine injuries are challenging to manage due to their complex anatomy, the potential for long-term disability, and severe neurological deficits. Traditional management approaches are being supplemented by emerging technologies that promise to improve patient care and outcomes.

METHODS

A literature review was conducted to identify and analyze advancements in imaging, navigation, robotics, and wearable technologies in the context of cervical spine trauma. The review focuses on the potential of these technologies to improve early detection, surgical accuracy, and postoperative recovery.

RESULTS

Technological innovations, including advanced imaging techniques, machine learning for diagnostics, augmented reality, and robotic-assisted surgery, are transforming the management of cervical spine trauma. These tools contribute to more efficient, accurate, and personalized treatment approaches, potentially improving clinical outcomes and reducing patient care burdens.

CONCLUSIONS

Although these technologies hold great promise, challenges such as implementation costs and the need for specialized training must be addressed. With continued research and interdisciplinary collaboration, these advancements can significantly enhance the management of cervical spine trauma, improving patient recovery and quality of life.

LEVEL OF EVIDENCE

Level V.

Pioneering Augmented and Mixed Reality in Cranial Surgery: The First Latin American Experience

INTRODUCTION

Augmented reality (AR) and mixed reality (MR) technologies have revolutionized cranial neurosurgery by overlaying digital information onto the surgical field, enhancing visualization, precision, and training. These technologies enable the real-time integration of preoperative imaging data, aiding in better decision-making and reducing operative risks. Despite challenges such as cost and specialized training needs, AR and MR offer significant benefits, including improved surgical outcomes and personalized surgical plans based on individual patient anatomy.

MATERIALS AND METHODS

This study describes three intracranial surgeries using AR and MR technologies at Hospital Ángeles Universidad, Mexico City, in 2023. Surgeries were performed with VisAR software 3 version and Microsoft HoloLens 2, transforming DICOM images into 3D models. Preoperative MRI and CT scans facilitated planning, and radiopaque tags ensured accurate image registration during surgery. Postoperative outcomes were assessed through clinical and imaging follow-up.

RESULTS

Three intracranial surgeries were performed with AR and MR assistance, resulting in successful outcomes with minimal postoperative complications. Case 1 achieved 80% tumor resection, Case 2 achieved near-total tumor resection, and Case 3 achieved complete lesion resection. All patients experienced significant symptom relief and favorable recoveries, demonstrating the precision and effectiveness of AR and MR in cranial surgery.

CONCLUSIONS

This study demonstrates the successful use of AR and MR in cranial surgery, enhancing precision and clinical outcomes. Despite challenges like training and costs, these technologies offer significant benefits. Future research should focus on long-term outcomes and broader applications to validate their efficacy and cost-effectiveness in neurosurgery.

3D-SARC: A Pilot Study Testing the Use of a 3D Augmented-Reality Model with Conventional Imaging as a Preoperative Assessment Tool for Surgical Resection of Retroperitoneal Sarcoma

BACKGROUND

Retroperitoneal sarcomas (RPSs) present a surgical challenge, with complex anatomic relationships to organs and vascular structures. This pilot study investigated the role of three-dimensional (3D) augmented reality (3DAR) compared with standard imaging in preoperative planning and resection strategies.

METHODS

For the study, 13 patients who underwent surgical resection of their RPS were selected based on the location of their tumor (right, left, pelvis). From the patients' preoperative computed tomography (CT) scans, 3DAR models were created using a D2P program and projected by an augmented-reality (AR) glass (Hololens). The 3DAR models were evaluated by three experienced sarcoma surgeons and compared with the baseline two-dimensional (2D) contrast-enhanced CT scans.

RESULTS

Three members of the surgical team evaluated 13 models of retroperitoneal sarcomas, resulting in a total of 26 responses. When the surgical team was asked to evaluate whether the 3DAR better prepared the surgeon for planned surgical resection, 10 responses favored the 3DAR, 5 favored the 2D CT scans and 11 showed no difference (p = 0.074). According to 15 (57.6 %) of the 26 responses, the 3DAR offered additional value over standard imaging in the preoperative planning (median score of 4; range, 1-5). The median stated likelihood that the surgeons would consult the 3DAR was 5 (range, 2-5) for the preoperative setting and 3 (range, 1-5) for the intraoperative setting.

CONCLUSIONS

This pilot study suggests that the use of 3DAR may provide additional value over current standard imaging in the preoperative planning for surgical resection of RPS, and the technology merits further study.

Integrating Augmented Reality in Spine Surgery: Redefining Precision with New Technologies

INTRODUCTION

The integration of augmented reality (AR) in spine surgery marks a significant advancement, enhancing surgical precision and patient outcomes. AR provides immersive, three-dimensional visualizations of anatomical structures, facilitating meticulous planning and execution of spine surgeries. This technology not only improves spatial understanding and real-time navigation during procedures but also aims to reduce surgical invasiveness and operative times. Despite its potential, challenges such as model accuracy, user interface design, and the learning curve for new technology must be addressed. AR's application extends beyond the operating room, offering valuable tools for medical education and improving patient communication and satisfaction.

MATERIAL AND METHODS

A literature review was conducted by searching PubMed and Scopus databases using keywords related to augmented reality in spine surgery, covering publications from January 2020 to January 2024.

RESULTS

In total, 319 articles were identified through the initial search of the databases. After screening titles and abstracts, 11 articles in total were included in the qualitative synthesis.

CONCLUSION

Augmented reality (AR) is becoming a transformative force in spine surgery, enhancing precision, education, and outcomes despite hurdles like technical limitations and integration challenges. AR's immersive visualizations and educational innovations, coupled with its potential synergy with AI and machine learning, indicate a bright future for surgical care. Despite the existing obstacles, AR's impact on improving surgical accuracy and safety marks a significant leap forward in patient treatment and care.

Precise execution of personalized surgical planning using three-dimensional printed guide template in severe and complex adult spinal deformity patients requiring three-column osteotomy: a retrospective, comparative matched-cohort study

BACKGROUND

The surgical treatment of severe and complex adult spinal deformity (ASD) commonly required three-column osteotomy (3-CO), which was technically demanding with high risk of neurological deficit. Personalized three dimensional (3D)-printed guide template based on preoperative planning has been gradually applied in 3-CO procedure. The purpose of this study was to compare the efficacy, safety, and precision of 3D-printed osteotomy guide template and free-hand technique in the treatment of severe and complex ASD patients requiring 3-CO.

METHODS

This was a single-centre retrospective comparative cohort study of patients with severe and complex ASD (Cobb angle of scoliosis > 80° with flexibility < 25% or focal kyphosis > 90°) who underwent posterior spinal fusion and 3-CO between January 2020 to January 2023, with a minimum 12 months follow-up. Personalized computer-assisted three-dimensional osteotomy simulation was performed for all recruited patients, who were further divided into template and non-template groups based on the application of 3D-printed osteotomy guide template according to the surgical planning. Patients in the two groups were age- and gender- propensity-matched. The radiographic parameters, postoperative neurological deficit, and precision of osteotomy execution were compared between groups.

RESULTS

A total of 40 patients (age 36.53 ± 11.98 years) were retrospectively recruited, with 20 patients in each group. The preoperative focal kyphosis (FK) was 92.72° ± 36.77° in the template group and 93.47° ± 33.91° in the non-template group, with a main curve Cobb angle of 63.35° (15.00°, 92.25°) and 64.00° (20.25°, 99.20°), respectively. Following the correction surgery, there were no significant differences in postoperative FK, postoperative main curve Cobb angle, correction rate of FK (54.20% vs. 51.94%, P = 0.738), and correction rate of main curve Cobb angle (72.41% vs. 61.33%, P = 0.101) between the groups. However, the match ratio of execution to simulation osteotomy angle was significantly greater in the template group than the non-template group (coronal: 89.90% vs. 74.50%, P < 0.001; sagittal: 90.45% vs. 80.35%, P < 0.001). The operating time (ORT) was significantly shorter (359.25 ± 57.79 min vs. 398.90 ± 59.48 min, P = 0.039) and the incidence of postoperative neurological deficit (5.0% vs. 35.0%, P = 0.018) was significantly lower in the template group than the non-template group.

CONCLUSION

Performing 3-CO with the assistance of personalized 3D-printed guide template could increase the precision of execution, decrease the risk of postoperative neurological deficit, and shorten the ORT in the correction surgery for severe and complex ASD. The personalized osteotomy guide had the advantages of 3D insight of the case-specific anatomy, identification of osteotomy location, and translation of the surgical planning or simulation to the real surgical site.

Exergaming in augmented reality is tailor-made for aerobic training and enjoyment among healthy young adults

In recent years, the use of exergaming for physical activity practice has gain in popularity but few is known about the use of augmented reality for physical activity, particularly at moderate to vigorous intensities. The present study examined the use of an exergame in augmented reality for aerobic training in healthy young adults. In a within-subject design, 18 participants (19.8 ± 1.4 years of age) have performed two physical activity sessions playing dodgeball. Indeed, they realized a classical dodgeball session and an exergaming session with an augmented reality version of dodgeball game. Physical loads and intensities were measured with accelerometers, RPE and heart sensors. Enjoyment experienced during the sessions was measured with the short version of the physical activity enjoyment scale questionnaire. Results revealed that both physical load and intensity were appropriate for aerobic training in the two conditions (i.e., classical and exergame in augmented reality) although values were significantly higher in the classical condition. Enjoyment was high in the two conditions with a higher significant value in the classical condition compared to the exergame in augmented reality condition. Put together, these results indicate that an aerobic state can be attained through both physical gameplay and its augmented reality equivalent and was associated to a high level of enjoyment among healthy young adults.

Pelvic Fixation Technique Using the Ilio-Sacral Screw for 173 Neuromuscular Scoliosis Patients

Pelvic fixation remains one of the main challenging issues in non-ambulatory neuromuscular scoliosis (NMS) patients, between clinical effectiveness and a high complication rate. The objective of this multicenter and retrospective study was to evaluate the outcomes of a technique that was applied to treat 173 NMS patients. The technique is not well-known but promising; it uses the ilio-sacral screw, combined with either the posterior spinal fusion or fusionless bipolar technique, with a minimum follow-up of two years. The mean operative age of the patients was 13 ± 7 years. The mean preoperative main coronal curve was 64° and improved by a mean of -39° postoperatively. The mean preoperative pelvic obliquity was 23°, which improved by a mean of -14° postoperatively. No decrease in the frontal or sagittal correction was observed during the last follow-up. The sitting posture improved in all cases. Twenty-nine patients (17%) had a postoperative infection: twenty-six were treated with local debridement and antibiotics, and three required hardware removal. Fourteen mechanical complications (8%) occurred: screw malposition (n = 6), skin prominence (n = 1), and connector failure (n = 1). This type of surgery is associated with a high risk for infection. Comorbidities, rather than the surgery itself, were the main risk factors that led to complications. The ilio-sacral screw was reliable and effective in correcting pelvic obliquity in NMS patients. The introduction of intraoperative navigation should minimize the risk of screw misplacement and facilitate revision or primary fixation.

Computational Modeling, Augmented Reality, and Artificial Intelligence in Spine Surgery

Over the past decade, advancements in computational modeling, augmented reality, and artificial intelligence (AI) have been driving innovations in spine surgery. Much of the research conducted in these fields is from the past 5 years. In 2021, the market value for augmented reality and virtual reality reached around $22.6 billion, highlighting the rise in demand for these technologies in the medical industry and beyond. Currently, these modalities have a wide variety of potential uses, from preoperative planning of pedicle screw placement and assessment of surgical instrumentation to predictions for postoperative outcomes and development of educational tools. In this chapter, we provide an overview of the applications of these technologies in spine surgery. Furthermore, we discuss several avenues for further development, including integrations between these modalities and areas of improvement for more immersive, informative surgical experiences.