Augmented, virtual and mixed reality in spinal surgery: A real-world experience

ARPA: Augmented Reality Prism Adaptation induces sensorimotor and visuospatial effects

Prism adaptation (PA) is a well-established method for sensorimotor recalibration and influencing visuospatial processing. It is also one of the rehabilitation approaches for neglect patients. Recent studies have shown effective adaptation in virtual reality (VR) settings simulating the classic PA procedure. However, no research has explored prism adaptation in augmented reality (AR), which combines the advantages of VR with greater ecological validity, allowing individuals to perform a virtual PA procedure in a real environment with natural visual feedback from their own hand. The present study introduces Augmented Reality Prism Adaptation (ARPA), a novel procedure that incorporates the benefits of AR with the classic PA technique. Forty-eight healthy participants underwent either leftward or rightward ARPA, and their sensorimotor and visuospatial aftereffects were evaluated immediately post-ARPA and over a 40-minute period. Results revealed significant and long-lasting sensorimotor aftereffects following both leftward and rightward ARPA, while only leftward ARPA induced an immediate rightward visuospatial aftereffect. Importantly, we investigated the generalization of these changes to the real environment, finding that ARPA-induced sensorimotor aftereffects extended beyond the virtual setting. While these findings show that ARPA produces both sensorimotor and visuospatial aftereffects, further research is essential to evaluate its applicability and effectiveness in neglect rehabilitation.

Augmented Reality in Minimally Invasive Spinal Interventions: Current Use and Future Directions

Minimally invasive spinal interventions have a steep learning curve from a technical perspective, as they are associated with performing precise maneuvers where the surgeon may or may not have direct or full visualization of the patient's anatomy. Augmented reality (AR), where models of the patient's anatomy can be overlaid within the surgical field, has offered promise to improve the operative experience. We present a qualitative review of recent advances in applications of AR technology in minimally invasive spinal procedures in both clinical and educational settings. We explore current evidence of experiences with this technology and highlight key areas for future development. Through this review, we aim to provide a deeper understanding of the current state of AR in transforming both the clinical and educational realms of minimally invasive spinal surgery.

Dental implant placement with immersive technologies: A preliminary clinical report of augmented and mixed reality applications

A preliminary clinical report of implant placements with 2 immersive reality technologies is described: augmented reality with head mounted display and mixed reality with a tablet PC. Both immersive realities are promising and could facilitate innovative dental applications. However, mixed reality requires further development for clinical optimization.

Immersive learning in medical education: analyzing behavioral insights to shape the future of VR-based courses

BACKGROUND

The emergence of virtual reality (VR) for medical education enables a range of new teaching opportunities. Skills and competences can be trained that cannot be demonstrated in any other way due to physical or ethical limitations. Immersion and presence may play an important role for learning in this context. This study investigates whether this VR-based, immersive software is an effective tool for assessing medical learning objectives by comparing behavioral outcomes in VR and actor-based simulations, and examines how these behaviors relate to immersion levels and their impact on learning success.

METHODS

To evaluate the effectiveness of the new teaching method, objective behavioral outcomes were identified as part of a dermatological learning unit and VR as a method was compared with actor-based simulation training. In addition, subjective questionnaires were collected to compare the levels of immersion in both concepts.

RESULTS

It was shown that primary learning objectives can be addressed well in VR. However, secondary learning objectives that fall into the field of basic skills seem to be delivered better in the actor-based training than in VR. This appears to be an effect of weaker immersion measured in VR training.

CONCLUSIONS

It can be said that the implementation of basic skills training depends largely on the level of immersion in the teaching method used. While primary learning subjectives can be trained and assessed well, at present, it does not appear to be fully possible to train secondary skills with the technical status quo in VR. However, the observation of secondary learning objectives can serve as an indicator for the assessment of immersion in the future.

Evaluating the Status and Promising Potential of Robotic Spinal Surgery Systems

The increasing frequency of cervical and lumbar spine disorders, driven by aging and evolving lifestyles, has led to a rise in spinal surgeries using pedicle screws. Robotic spinal surgery systems have emerged as a promising innovation, offering enhanced accuracy in screw placement and improved surgical outcomes. We focused on literature of this field from the past 5 years, and a comprehensive literature search was performed using PubMed and Google Scholar. Robotic spinal surgery systems have significantly impacted spinal procedures by improving pedicle screw placement accuracy and supporting various techniques. These systems facilitate personalized, minimally invasive, and low-radiation interventions, leading to greater precision, reduced patient risk, and decreased radiation exposure. Despite advantages, challenges such as high costs and a steep learning curve remain. Ongoing advancements are expected to further enhance these systems' role in spinal surgery.

Integrating Augmented Reality in Spine Surgery: Redefining Precision with New Technologies

INTRODUCTION

The integration of augmented reality (AR) in spine surgery marks a significant advancement, enhancing surgical precision and patient outcomes. AR provides immersive, three-dimensional visualizations of anatomical structures, facilitating meticulous planning and execution of spine surgeries. This technology not only improves spatial understanding and real-time navigation during procedures but also aims to reduce surgical invasiveness and operative times. Despite its potential, challenges such as model accuracy, user interface design, and the learning curve for new technology must be addressed. AR's application extends beyond the operating room, offering valuable tools for medical education and improving patient communication and satisfaction.

MATERIAL AND METHODS

A literature review was conducted by searching PubMed and Scopus databases using keywords related to augmented reality in spine surgery, covering publications from January 2020 to January 2024.

RESULTS

In total, 319 articles were identified through the initial search of the databases. After screening titles and abstracts, 11 articles in total were included in the qualitative synthesis.

CONCLUSION

Augmented reality (AR) is becoming a transformative force in spine surgery, enhancing precision, education, and outcomes despite hurdles like technical limitations and integration challenges. AR's immersive visualizations and educational innovations, coupled with its potential synergy with AI and machine learning, indicate a bright future for surgical care. Despite the existing obstacles, AR's impact on improving surgical accuracy and safety marks a significant leap forward in patient treatment and care.

Digital technologies to unlock safe and sustainable opportunities for medical device and healthcare sectors with a focus on the combined use of digital twin and extended reality applications: A review

Medical devices have increased in complexity where there is a pressing need to consider design thinking and specialist training for manufacturers, healthcare and sterilization providers, and regulators. Appropriately addressing this consideration will positively inform end-to-end supply chain and logistics, production, processing, sterilization, safety, regulation, education, sustainability and circularity. There are significant opportunities to innovate and to develop appropriate digital tools to help unlock efficiencies in these important areas. This constitutes the first paper to create an awareness of and to define different digital technologies for informing and enabling medical device production from a holistic end-to-end life cycle perspective. It describes the added-value of using digital innovations to meet emerging opportunities for many disposable and reusable medical devices. It addresses the value of accessing and using integrated multi-actor HUBs that combine academia, industry, healthcare, regulators and society to help meet these opportunities. Such as cost-effective access to specialist pilot facilities and expertise that converges digital innovation, material science, biocompatibility, sterility assurance, business model and sustainability. It highlights the marked gap in academic R&D activities (PRISMA review of best publications conducted between January 2010 and January 2024) and the actual list of U.S. FDA's approved and marketed artificial intelligence/machine learning (AI/ML), and augmented reality/virtual reality (AR/VR) enabled-medical devices for different healthcare applications. Bespoke examples of benefits underlying future use of digital tools includes potential implementation of machine learning for supporting and enabling parametric release of sterilized products through efficient monitoring of critical process data (complying with ISO 11135:2014) that would benefit stakeholders. This paper also focuses on the transformative potential of combining digital twin with extended reality innovations to inform efficiencies in medical device design thinking, supply chain and training to inform patient safety, circularity and sustainability.

Computational Modeling, Augmented Reality, and Artificial Intelligence in Spine Surgery

Over the past decade, advancements in computational modeling, augmented reality, and artificial intelligence (AI) have been driving innovations in spine surgery. Much of the research conducted in these fields is from the past 5 years. In 2021, the market value for augmented reality and virtual reality reached around $22.6 billion, highlighting the rise in demand for these technologies in the medical industry and beyond. Currently, these modalities have a wide variety of potential uses, from preoperative planning of pedicle screw placement and assessment of surgical instrumentation to predictions for postoperative outcomes and development of educational tools. In this chapter, we provide an overview of the applications of these technologies in spine surgery. Furthermore, we discuss several avenues for further development, including integrations between these modalities and areas of improvement for more immersive, informative surgical experiences.

Augmented reality in spine surgery - past, present, and future

BACKGROUND CONTEXT

Augmented reality (AR) is increasingly recognized as a valuable tool in spine surgery. Here we provides an overview of the key developments and technological milestones that have laid the foundation for AR applications in this field. We also assess the quality of existing studies on AR systems in spine surgery and explore potential future applications.

PURPOSE

The purpose of this narrative review is to examine the role of AR in spine surgery. It aims to highlight the evolution of AR technology in this context, evaluate the existing body of research, and outline potential future directions for integrating AR into spine surgery.

STUDY DESIGN

Narrative review.

METHODS

We conducted a thorough literature search to identify studies and developments related to AR in spine surgery. Relevant articles, reports, and technological advancements were analyzed to establish the historical context and current state of AR in this field.

RESULTS

The review identifies significant milestones in the development of AR technology for spine surgery. It discusses the growing body of research and highlights the strengths and weaknesses of existing investigations. Additionally, it presents insights into the potential for AR to enhance spine surgical education and speculates on future applications.

CONCLUSIONS

Augmented reality has emerged as a promising adjunct in spine surgery, with notable advancements and research efforts. The integration of AR into the spine surgery operating room holds promise, as does its potential to revolutionize surgical education. Future applications of AR in spine surgery may include real-time navigation, enhanced visualization, and improved patient outcomes. Continued development and evaluation of AR technology are essential for its successful implementation in this specialized surgical field.

Does Extended Reality Simulation Improve Surgical/Procedural Learning and Patient Outcomes When Compared With Standard Training Methods?: A Systematic Review

INTRODUCTION

The use of extended reality (XR) technologies, including virtual, augmented, and mixed reality, has increased within surgical and procedural training programs. Few studies have assessed experiential learning- and patient-based outcomes using XR compared with standard training methods.

METHODS

As a working group for the Society for Simulation in Healthcare, we used Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines and a PICO strategy to perform a systematic review of 4238 articles to assess the effectiveness of XR technologies compared with standard training methods. Outcomes were grouped into knowledge, time-to-completion, technical proficiency, reactions, and patient outcomes. Because of study heterogeneity, a meta-analysis was not feasible.

RESULTS

Thirty-two studies met eligibility criteria: 18 randomized controlled trials, 7 comparative studies, and 7 systematic reviews. Outcomes of most studies included Kirkpatrick levels of evidence I-III (reactions, knowledge, and behavior), while few reported level IV outcomes (patient). The overall risk of bias was low. With few exceptions, included studies showed XR technology to be more effective than standard training methods in improving objective skills and performance, shortening procedure time, and receiving more positive learner ratings. However, XR use did not show significant differences in gained knowledge.

CONCLUSIONS

Surgical or procedural XR training may improve technical skill development among trainees and is generally favored over standard training methods. However, there should be an additional focus on how skill development translates to clinically relevant outcomes. We recommend longitudinal studies to examine retention and transfer of training to clinical settings, methods to improve timely, adaptive feedback for deliberate practice, and cost analyses.

Application of Extended Reality (Virtual Reality and Mixed Reality) Technology in Laparoscopic Liver Resections

Background and purpose Laparoscopic liver resection (LLR) has recently gained popularity owing to advances in surgical techniques. Difficulties in LLR may be influenced by anatomical factors. This study presents a comprehensive overview of LLR performed using extended reality (XR) technology. Methods Six patients underwent LLR performed wearing HoloLens2® XR (Microsoft Corporation, Redmond, Washington, United States) technology. We performed dynamic contrast-enhanced CT scans before surgery and used the data to construct three-dimensional images. Results Of the six patients, two were diagnosed with colorectal liver metastases, two with hepatocellular carcinoma, and one with intrahepatic cholangiocarcinoma. The median maximum tumor diameter was 31 mm (range, 23-80 mm). One patient had liver cirrhosis, with Child-Pugh classification grade B. Anatomical resection was performed in three patients (60%), with a median difficulty score of 7 (intermediate). No conversions to open surgery were necessary. The median operative time and estimated blood loss were 444 minutes (range, 337-597 minutes) and 200 mL (range, 100-1000 mL), respectively. Postoperative complications (Clavien-Dindo classification grade II) were observed in one patient. All six cases achieved negative surgical margins. Conclusions LLR using XR technology enhances surgical visualization and anatomical recognition. The incorporation of XR technology into LLR offers advantages over traditional two-dimensional imaging.

Augmented reality for minimally invasive spinal surgery

Background

Augmented reality (AR) is an emerging technology that can overlay computer graphics onto the real world and enhance visual feedback from information systems. Within the past several decades, innovations related to AR have been integrated into our daily lives; however, its application in medicine, specifically in minimally invasive spine surgery (MISS), may be most important to understand. AR navigation provides auditory and haptic feedback, which can further enhance surgeons' capabilities and improve safety.

Purpose

The purpose of this article is to address previous and current applications of AR, AR in MISS, limitations of today's technology, and future areas of innovation.

Methods

A literature review related to applications of AR technology in previous and current generations was conducted.

Results

AR systems have been implemented for treatments related to spinal surgeries in recent years, and AR may be an alternative to current approaches such as traditional navigation, robotically assisted navigation, fluoroscopic guidance, and free hand. As AR is capable of projecting patient anatomy directly on the surgical field, it can eliminate concern for surgeon attention shift from the surgical field to navigated remote screens, line-of-sight interruption, and cumulative radiation exposure as the demand for MISS increases.

Conclusion

AR is a novel technology that can improve spinal surgery, and limitations will likely have a great impact on future technology.

Fast-track protocols for patients undergoing spine surgery: a systematic review

BACKGROUND CONTEXT

Fast-track is an evidence-based multidisciplinary strategy for pre-, intra-, and postoperative management of patients during major surgery. To date, fast-track has not been recognized or accepted in all surgical areas, particularly in orthopedic spine surgery where it still represents a relatively new paradigm.

PURPOSE

The aim of this review was provided an evidenced-based assessment of specific interventions, measurement, and associated outcomes linked to enhanced recovery pathways in spine surgery field.

METHODS

We conducted a systematic review in three databases from February 2012 to August 2022 to assess the pre-, intra-, and postoperative key elements and the clinical evidence of fast-track protocols as well as specific interventions and associated outcomes, in patients undergoing to spine surgery.

RESULTS

We included 57 full-text articles of which most were retrospective. Most common fast-track elements included patient's education, multimodal analgesia, thrombo- and antibiotic prophylaxis, tranexamic acid use, urinary catheter and drainage removal within 24 hours after surgery, and early mobilization and nutrition. All studies demonstrated that these interventions were able to reduce patients' length of stay (LOS) and opioid use. Comparative studies between fast-track and non-fast-track protocols also showed improved pain scores without increasing complication or readmission rates, thus improving patient's satisfaction and functional recovery.

CONCLUSIONS

According to the review results, fast-track seems to be a successful tool to reduce LOS, accelerate return of function, minimize postoperative pain, and save costs in spine surgery. However, current studies are mainly on degenerative spine diseases and largely restricted to retrospective studies with non-randomized data, thus multicenter randomized trials comparing fast-track outcomes and implementation are mandatory to confirm its benefit in spine surgery.

Mixed reality navigation training system for liver surgery based on a high-definition human cross-sectional anatomy data set

OBJECTIVES

This study aims to use the three-dimensional (3D) mixed-reality model of liver, entailing complex intrahepatic systems and to deeply study the anatomical structures and to promote the training, diagnosis and treatment of liver diseases.

METHODS

Vascular perfusion human specimens were used for thin-layer frozen milling to obtain liver cross-sections. The 104-megapixel-high-definition cross sectional data set was established and registered to achieve structure identification and manual segmentation. The digital model was reconstructed and data was used to print a 3D hepatic model. The model was combined with HoloLens mixed reality technology to reflect the complex relationships of intrahepatic systems. We simulated 3D patient specific anatomy for identification and preoperative planning, conducted a questionnaire survey, and evaluated the results.

RESULTS

The 3D digital model and 1:1 transparent and colored model of liver established truly reflected intrahepatic vessels and their complex relationships. The reconstructed model imported into HoloLens could be accurately matched with the 3D model. Only 7.7% participants could identify accessory hepatic veins. The depth and spatial-relationship of intrahepatic structures were better understandable for 92%. The 100%, 84.6%, 69% and 84% believed the 3D models were useful in planning, safer surgical paths, reducing intraoperative complications and training of young surgeons respectively.

CONCLUSIONS

A detailed 3D model can be reconstructed using the higher quality cross-sectional anatomical data set. When combined with 3D printing and HoloLens technology, a novel hybrid-reality navigation-training system for liver surgery is created. Mixed Reality training is a worthy alternative to provide 3D information to clinicians and its possible application in surgery. This conclusion was obtained based on a questionnaire and evaluation. Surgeons with extensive experience in surgical operations perceived in the questionnaire that this technology might be useful in liver surgery, would help in precise preoperative planning, accurate intraoperative identification, and reduction of hepatic injury.

Surgical Navigation System for Hypertensive Intracerebral Hemorrhage Based on Mixed Reality

Hypertensive intracerebral hemorrhage (HICH) is an intracerebral bleeding disease that affects 2.5 per 10,000 people worldwide each year. An effective way to cure this disease is puncture through the dura with a brain puncture drill and tube; the accuracy of the insertion determines the quality of the surgery. In recent decades, surgical navigation systems have been widely used to improve the accuracy of surgery and minimize risks. Augmented reality- and mixed reality-based surgical navigation is a promising new technology for surgical navigation in the clinic, aiming to improve the safety and accuracy of the operation. In this study, we present a novel multimodel mixed reality navigation system for HICH surgery in which medical images and virtual anatomical structures can be aligned intraoperatively with the actual structures of the patient in a head-mounted device and adjusted when the patient moves in real time while under local anesthesia; this approach can help the surgeon intuitively perform intraoperative navigation. A novel registration method is used to register the holographic space and serves as an intraoperative optical tracker, and a method for calibrating the HICH surgical tools is used to track the tools in real time. The results of phantom experiments revealed a mean registration error of 1.03 mm and an average time consumption of 12.9 min. In clinical usage, the registration error was 1.94 mm, and the time consumption was 14.2 min, showing that this system is sufficiently accurate and effective for clinical application.

Advances and Innovations in Ablative Head and Neck Oncologic Surgery Using Mixed Reality Technologies in Personalized Medicine

The benefit of computer-assisted planning in head and neck ablative and reconstructive surgery has been extensively documented over the last decade. This approach has been proven to offer a more secure surgical procedure. In the treatment of cancer of the head and neck, computer-assisted surgery can be used to visualize and estimate the location and extent of the tumor mass. Nowadays, some software tools even allow the visualization of the structures of interest in a mixed reality environment. However, the precise integration of mixed reality systems into a daily clinical routine is still a challenge. To date, this technology is not yet fully integrated into clinical settings such as the tumor board, surgical planning for head and neck tumors, or medical and surgical education. As a consequence, the handling of these systems is still of an experimental nature, and decision-making based on the presented data is not yet widely used. The aim of this paper is to present a novel, user-friendly 3D planning and mixed reality software and its potential application for ablative and reconstructive head and neck surgery.

The use of mixed reality in dentistry

Augmented reality (AR) was first described in the literature in the 1990s. It has been shown as a futuristic concept in television, film and media, and now in the twenty-first century has become a reality. AR is defined as an interactive experience of a real-world environment where the object that resides in the real world is enhanced by computer-generated perceptual information.Microsoft HoloLens is a mixed reality device which has the capability to provide a real-time, three-dimensional platform using multiple sensors and holographic processing to display information and even simulate a virtual world. With rapidly evolving technology and virtual learning on the increase, the HoloLens technology can be used as a vital tool for dental education and surgical planning. However, within dentistry at present, there is limited research regarding its benefits and potential.The authors would like to demonstrate the use of HoloLens in three common oral surgery procedures and how it can be used to distinguish anatomy and benefit surgical planning, aid in patient communication and play a role in dental education.

Augmented Reality in Surgery: A Scoping Review

Augmented reality (AR) is an innovative system that enhances the real world by superimposing virtual objects on reality. The aim of this study was to analyze the application of AR in medicine and which of its technical solutions are the most used. We carried out a scoping review of the articles published between 2019 and February 2022. The initial search yielded a total of 2649 articles. After applying filters, removing duplicates and screening, we included 34 articles in our analysis. The analysis of the articles highlighted that AR has been traditionally and mainly used in orthopedics in addition to maxillofacial surgery and oncology. Regarding the display application in AR, the Microsoft HoloLens Optical Viewer is the most used method. Moreover, for the tracking and registration phases, the marker-based method with a rigid registration remains the most used system. Overall, the results of this study suggested that AR is an innovative technology with numerous advantages, finding applications in several new surgery domains. Considering the available data, it is not possible to clearly identify all the fields of application and the best technologies regarding AR.

Effect of Remote Control Augmented Reality Multimedia Technology for Postoperative Rehabilitation of Knee Joint Injury

This study was aimed at exploring the application value of augmented reality (AR) in postoperative rehabilitation training for patients with knee joint injury. 40 patients who underwent knee joint injury surgery were selected as the research objects, and the patients were randomly divided into two groups: an experimental group (20 cases) and a control group (20 cases). Patients in the experimental group were treated with AR-based rehabilitation methods, while those in the control group were treated with traditional rehabilitation methods. Afterwards, the two groups of patients were compared with various indicators such as pain value, swelling, structural and functional recovery, time to complete weight bearing, time to return to work, and X-ray examination results. The main evaluation tools used were Hospital for Special Surgery (HSS) score and Visual Analogue Scale (VAS) score. The results showed that after six weeks, the HSS score of the control group was 82.88 ± 3.07, and the HSS score of the experimental group was 85.46 ± 3.21. The difference between the two groups was statistically significant (P < 0.05). After three months, the HSS score of the control group was 89.96 ± 3.76, and that of the experimental group was 93.21 ± 4.33. The difference between the two groups was statistically significant (P < 0.05). There was a significant difference in pain scores between the two groups at 7 days (3.81 ± 0.48 vs. 5.06 ± 0.66) and 14 days (2.03 ± 0.45 vs. 3.61 ± 0.63) after surgery, with statistical significances (P < 0.05). There were statistically significant differences between the two groups in terms of time to complete weight bearing (7 ± 0.87 weeks vs. 8.82 ± 0.88 weeks) and time to return to work (8.69 ± 0.94 vs. 9.93 ± 0.88 weeks) (P < 0.05). One month after surgery, the X-ray examination results of both groups showed recovery. The AR-based rehabilitation training system showed a good application effect and prospect in the postoperative structural and functional recovery of patients with knee joint injury.

Augmented Reality: Mapping Methods and Tools for Enhancing the Human Role in Healthcare HMI

Background: Augmented Reality (AR) represents an innovative technology to improve data visualization and strengthen the human perception. Among Human–Machine Interaction (HMI), medicine can benefit most from the adoption of these digital technologies. In this perspective, the literature on orthopedic surgery techniques based on AR was evaluated, focusing on identifying the limitations and challenges of AR-based healthcare applications, to support the research and the development of further studies. Methods: Studies published from January 2018 to December 2021 were analyzed after a comprehensive search on PubMed, Google Scholar, Scopus, IEEE Xplore, Science Direct, and Wiley Online Library databases. In order to improve the review reporting, the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guidelines were used. Results: Authors selected sixty-two articles meeting the inclusion criteria, which were categorized according to the purpose of the study (intraoperative, training, rehabilitation) and according to the surgical procedure used. Conclusions: AR has the potential to improve orthopedic training and practice by providing an increasingly human-centered clinical approach. Further research can be addressed by this review to cover problems related to hardware limitations, lack of accurate registration and tracking systems, and absence of security protocols.

Digital Transformation Will Change Medical Education and Rehabilitation in Spine Surgery

The concept of minimally invasive spine therapy (MIST) has been proposed as a treatment strategy to reduce the need for overall patient care, including not only minimally invasive spine surgery (MISS) but also conservative treatment and rehabilitation. To maximize the effectiveness of patient care in spine surgery, the educational needs of medical students, residents, and patient rehabilitation can be enhanced by digital transformation (DX), including virtual reality (VR), augmented reality (AR), mixed reality (MR), and extended reality (XR), three-dimensional (3D) medical images and holograms; wearable sensors, high-performance video cameras, fifth-generation wireless system (5G) and wireless fidelity (Wi-Fi), artificial intelligence, and head-mounted displays (HMDs). Furthermore, to comply with the guidelines for social distancing due to the unexpected COVID-19 pandemic, the use of DX to maintain healthcare and education is becoming more innovative than ever before. In medical education, with the evolution of science and technology, it has become mandatory to provide a highly interactive educational environment and experience using DX technology for residents and medical students, known as digital natives. This study describes an approach to pre- and intraoperative medical education and postoperative rehabilitation using DX in the field of spine surgery that was implemented during the COVID-19 pandemic and will be utilized thereafter.

Trends in the Use of Augmented Reality, Virtual Reality, and Mixed Reality in Surgical Research: a Global Bibliometric and Visualized Analysis

There have been many major developments in the use of augmented reality (AR), virtual reality (VR), and mixed reality (MR) technologies in the context of global surgical research, yet few reports on the trends in this field have been published to date. This study was therefore designed to explore these worldwide trends in this clinically important field. Relevant studies published from 1 January 2009 through 13 October 2020 were retrieved from the Science Citation Index-Expanded (SCI-E) tool of the Web of Science database. Bibliometric techniques were then used to analyze the resultant data, with visual bibliographic coupling, co-authorship, co-citation, co-occurrence, and publication trend analyses subsequently being conducted with GraphPad Prism 8 and with the visualization of similarities (VOS) software tool. There is no patient and public involved. In total, 6221 relevant studies were incorporated into this analysis. At a high level, clear global annual increases in the number of publications in this field were observed. The USA made the greatest contributions to this field over the studied period, with the highest H-index value, the most citations, and the greatest total link strength for analyzed publications. The country with the highest number of average citations per publication was Scotland. The Surgical Endoscopy And Other Interventional Techniques journal contributed the greatest number of publications in this field. The University of London was the institution that produced the greatest volume of research in this field. Overall, studies could be broadly classified into five clusters: Neurological Research, Surgical Techniques, Technological Products, Rehabilitative Medicine, and Clinical Therapy. The trends detected in the present analysis suggest that the number of global publications pertaining to the use of AR, VR, and MR techniques in surgical research is likely to increase in the coming years. Particular attention should be paid to emerging trends in related fields including MR, extended reality, head-mounted displays, navigation, and holographic images.

XR (Extended Reality: Virtual Reality, Augmented Reality, Mixed Reality) Technology in Spine Medicine: Status Quo and Quo Vadis

In recent years, with the rapid advancement and consumerization of virtual reality, augmented reality, mixed reality, and extended reality (XR) technology, the use of XR technology in spine medicine has also become increasingly popular. The rising use of XR technology in spine medicine has also been accelerated by the recent wave of digital transformation (i.e., case-specific three-dimensional medical images and holograms, wearable sensors, video cameras, fifth generation, artificial intelligence, and head-mounted displays), and further accelerated by the COVID-19 pandemic and the increase in minimally invasive spine surgery. The COVID-19 pandemic has a negative impact on society, but positive impacts can also be expected, including the continued spread and adoption of telemedicine services (i.e., tele-education, tele-surgery, tele-rehabilitation) that promote digital transformation. The purpose of this narrative review is to describe the accelerators of XR (VR, AR, MR) technology in spine medicine and then to provide a comprehensive review of the use of XR technology in spine medicine, including surgery, consultation, education, and rehabilitation, as well as to identify its limitations and future perspectives (status quo and quo vadis).

Application of a virtual and mixed reality-navigation system using commercially available devices to the lateral temporal bone resection

Background

Lateral temporal bone resection (LTBR) is performed for stage T1-2 external ear malignant tumors and requires spatial anatomical knowledge of the rare surgical field.

Objective

This paper presents a novel virtual reality (VR) based surgical simulation and navigation system using only commercially available display device and an online software, to assist in the understanding of the anatomy pre and intraoperatively.

Result and conclusion

VR model created by 3D Slicer modules and visualized on head mounted display enabled users to simulate and learn surgical techniques of a rare surgical case. 3D hologram through HoloLens assisted the surgeon in comprehending the spatial relationship between crucial vital structures and the pathological lesion during the operation. This platform does not require the users to possess specific programming skill or knowledge, and is therefore applicable in daily clinical usage.

●

Lateral temporal bone resection (LTBR) is standard operative procedure for early-staged malignant tumors of external ear canals.

●

However, many surgeons lack the opportunity to learn the surgical techniques because of its rarity.

●

We report a usage of novel virtual reality based surgical simulation and navigation system for studying the anatomy and the operative steps in LTBR.

●

3D holograms with head-mounted display will provide revolutionary tool in assisting surgical planning, intraoperative referencing and navigation of otologic and skull base surgery.

Real-time navigation guidance with intraoperative CT imaging for pedicle screw placement using an augmented reality head-mounted display: a proof-of-concept study

OBJECTIVE

Augmented reality (AR) has the potential to improve the accuracy and efficiency of instrumentation placement in spinal fusion surgery, increasing patient safety and outcomes, optimizing ergonomics in the surgical suite, and ultimately lowering procedural costs. The authors sought to describe the use of a commercial prototype Spine AR platform (SpineAR) that provides a commercial AR head-mounted display (ARHMD) user interface for navigation-guided spine surgery incorporating real-time navigation images from intraoperative imaging with a 3D-reconstructed model in the surgeon's field of view, and to assess screw placement accuracy via this method.

METHODS

Pedicle screw placement accuracy was assessed and compared with literature-reported data of the freehand (FH) technique. Accuracy with SpineAR was also compared between participants of varying spine surgical experience. Eleven operators without prior experience with AR-assisted pedicle screw placement took part in the study: 5 attending neurosurgeons and 6 trainees (1 neurosurgical fellow, 1 senior orthopedic resident, 3 neurosurgical residents, and 1 medical student). Commercially available 3D-printed lumbar spine models were utilized as surrogates of human anatomy. Among the operators, a total of 192 screws were instrumented bilaterally from L2-5 using SpineAR in 24 lumbar spine models. All but one trainee also inserted 8 screws using the FH method. In addition to accuracy scoring using the Gertzbein-Robbins grading scale, axial trajectory was assessed, and user feedback on experience with SpineAR was collected.

RESULTS

Based on the Gertzbein-Robbins grading scale, the overall screw placement accuracy using SpineAR among all users was 98.4% (192 screws). Accuracy for attendings and trainees was 99.1% (112 screws) and 97.5% (80 screws), respectively. Accuracy rates were higher compared with literature-reported lumbar screw placement accuracy using FH for attendings (99.1% vs 94.32%; p = 0.0212) and all users (98.4% vs 94.32%; p = 0.0099). The percentage of total inserted screws with a minimum of 5° medial angulation was 100%. No differences were observed between attendings and trainees or between the two methods. User feedback on SpineAR was generally positive.

CONCLUSIONS

Screw placement was feasible and accurate using SpineAR, an ARHMD platform with real-time navigation guidance that provided a favorable surgeon-user experience.

Augmented Reality, Virtual Reality and Artificial Intelligence in Orthopedic Surgery: A Systematic Review

Background: The application of virtual and augmented reality technologies to orthopaedic surgery training and practice aims to increase the safety and accuracy of procedures and reducing complications and costs. The purpose of this systematic review is to summarise the present literature on this topic while providing a detailed analysis of current flaws and benefits. Methods: A comprehensive search on the PubMed, Cochrane, CINAHL, and Embase database was conducted from inception to February 2021. The Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guidelines were used to improve the reporting of the review. The Cochrane Risk of Bias Tool and the Methodological Index for Non-Randomized Studies (MINORS) was used to assess the quality and potential bias of the included randomized and non-randomized control trials, respectively. Results: Virtual reality has been proven revolutionary for both resident training and preoperative planning. Thanks to augmented reality, orthopaedic surgeons could carry out procedures faster and more accurately, improving overall safety. Artificial intelligence (AI) is a promising technology with limitless potential, but, nowadays, its use in orthopaedic surgery is limited to preoperative diagnosis. Conclusions: Extended reality technologies have the potential to reform orthopaedic training and practice, providing an opportunity for unidirectional growth towards a patient-centred approach.