XR (Extended Reality: Virtual Reality, Augmented Reality, Mixed Reality) Technology in Spine Medicine: Status Quo and Quo Vadis

Mixed Reality Biopsy Navigation System Utilizing Markerless Needle Tracking and Imaging Data Superimposition

Exact biopsy planning and careful execution of needle injection is crucial to ensure successful procedure completion as initially intended while minimizing the risk of complications. This study introduces a solution aimed at helping the operator navigate to precisely position the needle in a previously planned trajectory utilizing a mixed reality headset. A markerless needle tracking method was developed by integrating deep learning and deterministic computer vision techniques. The system is based on superimposing imaging data onto the patient's body in order to directly perceive the anatomy and determine a path from the selected injection site to the target location. Four types of tests were conducted to assess the system's performance: measuring the accuracy of needle pose estimation, determining the distance between injection sites and designated targets, evaluating the efficiency of material collection, and comparing procedure time and number of punctures required with and without the system. These tests, involving both phantoms and physician participation in the latter two, demonstrated the accuracy and usability of the proposed solution. The results showcased a significant improvement, with a reduction in number of punctures needed to reach the target location. The test was successfully completed on the first attempt in 70% of cases, as opposed to only 20% without the system. Additionally, there was a 53% reduction in procedure time, validating the effectiveness of the system.

The Application of Extended Reality in Treating Children with Autism Spectrum Disorder

Autism Spectrum Disorder (ASD) is a common neurodevelopmental disorder in children, characterized by social interaction, communication difficulties, and repetitive and stereotyped behaviors. Existing intervention methods have limitations, such as requiring long treatment periods and needing to be more convenient to implement. Extended Reality (XR) technology offers a virtual environment to enhance children's social, communication, and self-regulation skills. This paper compares XR theoretical models, application examples, and intervention effects. The study reveals that XR intervention therapy is mainly based on cognitive rehabilitation, teaching, and social-emotional learning theories. It utilizes algorithms, models, artificial intelligence (AI), eye-tracking, and other technologies for interaction, achieving diverse intervention outcomes. Participants showed effective improvement in competency barriers using XR-based multimodal interactive platforms. However, Mixed Reality (MR) technology still requires further development. Future research should explore multimsodal interaction technologies combining XR and AI, optimize models, prioritize the development of MR intervention scenarios, and sustain an optimal intervention level.

Is Augmented Reality Technology Effective in Locating the Apex of Teeth Undergoing Apicoectomy Procedures?

This study seeks to assess the accuracy of apical location using an augmented reality (AR) device with a free-hand method. Sixty (60) osteotomy site preparations were randomly assigned to one of two study groups: A. AR device (AR) (n = 30), and B. conventional free-hand method (FHM) (n = 30). Preoperative CBCT scans and intraoral scans were taken and uploaded to specialized implant-planning software to virtually plan preparations for the apical location osteotomy sites. The planning software was then used to automatically segment the teeth in each experimental model for their complete visualization using the AR device. A CBCT scan was carried out postoperatively after conducting the apical location procedures. The subsequent datasets were imported into therapeutic software to analyze the coronal, apical, and angular deviations. The Mann-Whitney non-parametric test was used. There were no statistically significant differences identified at the coronal (p = 0.1335), apical (p = 0.2401), and angular deviations (p = 0.4849) between the AR and FHM study groups. The augmented reality technique did not show a statistically significant accuracy of osteotomies for apical location when compared with the conventional free-hand method.

A New Normal: A Case Study on Changing Strategies in Technology Engagement at an Academic Health Sciences Library

As academic libraries shift services to meet the changing needs of patrons after the COVID-19 pandemic, educational technologies and services to support them require updating. Patrons using technology that was once associated with hands-on learning and in-person interactions are preferring flexible and hybrid iterations. In this case study, the authors describe and analyze the pivot of three technology services at the Spencer S. Eccles Health Sciences Library in the post-COVID-19 environment. Technologies discussed include a multimedia studio, virtual reality (VR), and a three-dimensional (3D) printing service. This case study utilizes available usage stats and survey data to demonstrate and provide rationale for the changing strategy in services for each technology "hub." The multimedia studio has been dismantled in favor of the equipment being available for checkout, VR is now available in a staff-supported classroom, and a 3D printing service has been fully automated through an online submission platform. These examples, and the rationale behind changing them, can help offer ideas for other libraries to help find solutions that meet the demands of a changing learning environment.

Development of a Multimodal, Personalized Intervention of Virtual Reality Integrated Within Physiotherapy for Patients With Complex Chronic Low-Back Pain

Background

Chronic low-back pain (CLBP) is the leading cause of years lived with disability. Physiotherapy is the most common treatment option for CLBP, but effects are often unsatisfactory. Virtual reality (VR) offers possibilities to enhance the effectiveness of physiotherapy treatment. Primary aim was to develop and test a personalized VR intervention integrated within a physiotherapy treatment for patients with CLBP.

Methods

This study describes an intervention development process using mixed methods design that followed the Medical Research Council (MRC) framework. This involved a cocreation process with patients, physiotherapists, and researchers. A draft intervention was constructed based on a literature review and focus groups, and subsequently tested in a feasibility study and evaluated in focus groups. Focus group data were analyzed using thematic analysis. This intervention development process resulted in a final intervention.

Results

Focus group data showed that VR and physiotherapy can strengthen each other when they are well integrated, and that VR needs to be administered under the right conditions including flawless technology, physiotherapists with sufficient affinity and training, and the right expectations from patients. The draft intervention was considered feasible after evaluation by four patients and three physiotherapists and was further complemented by expanding the training for physiotherapists and improving the protocols for physiotherapists and patients. The final intervention consisted of a 12-week physiotherapy treatment with three integrated VR modules: pain education, physical exercise, and relaxation.

Conclusion

Using the MRC framework in cocreation with the end users, a personalized VR intervention integrated within a physiotherapy treatment for patients with CLBP was developed. This intervention was found to be feasible and will subsequently be evaluated for (cost-)effectiveness in a cluster randomized controlled trial.

Does Extended Reality Simulation Improve Surgical/Procedural Learning and Patient Outcomes When Compared With Standard Training Methods?: A Systematic Review

INTRODUCTION

The use of extended reality (XR) technologies, including virtual, augmented, and mixed reality, has increased within surgical and procedural training programs. Few studies have assessed experiential learning- and patient-based outcomes using XR compared with standard training methods.

METHODS

As a working group for the Society for Simulation in Healthcare, we used Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines and a PICO strategy to perform a systematic review of 4238 articles to assess the effectiveness of XR technologies compared with standard training methods. Outcomes were grouped into knowledge, time-to-completion, technical proficiency, reactions, and patient outcomes. Because of study heterogeneity, a meta-analysis was not feasible.

RESULTS

Thirty-two studies met eligibility criteria: 18 randomized controlled trials, 7 comparative studies, and 7 systematic reviews. Outcomes of most studies included Kirkpatrick levels of evidence I-III (reactions, knowledge, and behavior), while few reported level IV outcomes (patient). The overall risk of bias was low. With few exceptions, included studies showed XR technology to be more effective than standard training methods in improving objective skills and performance, shortening procedure time, and receiving more positive learner ratings. However, XR use did not show significant differences in gained knowledge.

CONCLUSIONS

Surgical or procedural XR training may improve technical skill development among trainees and is generally favored over standard training methods. However, there should be an additional focus on how skill development translates to clinically relevant outcomes. We recommend longitudinal studies to examine retention and transfer of training to clinical settings, methods to improve timely, adaptive feedback for deliberate practice, and cost analyses.

Questionnaire survey of virtual reality experiences of digestive surgery at a rural academic institute: A pilot study for pre-surgical education

We developed a prototype VR platform, VECTORS L&M (VLM), aiming to enhance the understanding of digestive surgery for students, interns, and young surgeons by limiting costs. Its efficacy was assessed via questionnaires before implementation in surgical education. The VLM provides nine-minute VR views of surgeries, from both 180- and 360-degree angles. It was created with L.A.B. Co., Ltd. and incorporates surgery videos from biliary malignancy patients. Following VLM development, a survey was conducted among surgeons who had experienced it. Twenty-eight participants (32% of observers) responded to the survey. A majority (81%) reported positive experiences with the VR content and showed interest in VR video production, though some reported sickness. Most respondents were experienced surgeons, and nearly all believed VR was important for medical education with a mean score of 4.14 on a scale of up to 5. VR was preferred over 3D printed models due to its application versatility. Participants expressed the desire for future VR improvements, such as increased mobility, cloud connectivity, cost reduction, and better resolution. The VLM platform, coupled with this innovative teaching approach, offers experiential learning in intraabdominal surgery, effectively enriching the knowledge of students and surgeons ahead of surgical education and training.

[Innovative 3D imaging]

Intraoperative 2D fluoroscopy is often performed for repositioning and implant control. However, this does not always provide the details needed to reliably detect joint steps or incorrect repositioning. Over the last few years, intraoperative 3D imaging has been established and further developed. Multiple studies demonstrate an advantage and better intraoperative control through 3D imaging. Examples are the upper ankle, the proximal tibia and the distal radius; the rates of intraoperative revisions with digital volume tomography (DVT) are between 20-30%. Technical advancements, such as metal artifact reductions, automated plane setting, automated screw detection, and robotic DVT devices, facilitate intraoperative operation, shorten surgical time, and provide improved image quality. By processing the data sets in the form of an immersive, computer-simulated image in terms of "augmented reality" (AR), increased precision can be achieved intraoperatively while reducing radiation exposure. The implementation of these systems is associated with costs, which are offset by cost savings from avoided revisions. Adequate counter-financing is still lacking at the present time. Intraoperative 3D imaging represents an important tool for intraoperative control. The current data situation makes it necessary to address the routine use of 3D procedures, especially in the joint area. The indications are becoming increasingly broader. Technical innovations such as robotics and AR have significantly improved 3D devices in recent years and offer high potential for integration into the OR.

More Arrows in the Quiver: Investigating the Use of Auxiliary Models to Localize In-View Components with Augmented Reality

The creation and management of content are among the main open issues for the spread of Augmented Reality. In Augmented Reality interfaces for procedural tasks, a key authoring strategy is chunking instructions and using optimized visual cues, i.e., tailored to the specific information to convey. Nevertheless, research works rarely present rationales behind their choice. This work aims to provide design guidelines for the localization of in-view and not occluded components, which is recurrent information in technical documentation. Previous studies revealed that the most suited visual cues to convey this information are auxiliary models, i.e., abstract shapes that highlight the space region where the component is located. Among them, 3D arrows are widely used, but they may produce ambiguity of information. Furthermore, from the literature, it is unclear how to design auxiliary model shapes and if they are affected by the component shapes. To fill this gap, we conducted two user studies. In the first study, we collected the preference of 45 users regarding the shape, color, and animation of auxiliary models for the localization of various component shapes. According to the results of this study, we defined guidelines for designing optimized auxiliary models based on the component shapes. In the second user study, we validated these guidelines by evaluating the performance (localization time and recognition accuracy) and user experience of 24 users. The results of this study allowed us to confirm that designing auxiliary models following our guidelines leads to a higher recognition accuracy and user experience than using 3D arrows.

Exposure to Extended Reality and Artificial Intelligence-Based Manifestations: A Primer on the Future of Hip and Knee Arthroplasty

BACKGROUND

Software-infused services, from robot-assisted and wearable technologies to artificial intelligence (AI)-laden analytics, continue to augment clinical orthopaedics - namely hip and knee arthroplasty. Extended reality (XR) tools, which encompass augmented reality, virtual reality, and mixed reality technology, represent a new frontier for expanding surgical horizons to maximize technical education, expertise, and execution. The purpose of this review is to critically detail and evaluate the recent developments surrounding XR in the field of hip and knee arthroplasty and to address potential future applications as they relate to AI.

METHODS

In this narrative review surrounding XR, we discuss (1) definitions, (2) techniques, (3) studies, (4) current applications, and (5) future directions. We highlight XR subsets (augmented reality, virtual reality, and mixed reality) as they relate to AI in the increasingly digitized ecosystem within hip and knee arthroplasty.

RESULTS

A narrative review of the XR orthopaedic ecosystem with respect to XR developments is summarized with specific emphasis on hip and knee arthroplasty. The XR as a tool for education, preoperative planning, and surgical execution is discussed with future applications dependent upon AI to potentially obviate the need for robotic assistance and preoperative advanced imaging without sacrificing accuracy.

CONCLUSION

In a field where exposure is critical to clinical success, XR represents a novel stand-alone software-infused service that optimizes technical education, execution, and expertise but necessitates integration with AI and previously validated software solutions to offer opportunities that improve surgical precision with or without the use of robotics and computed tomography-based imaging.

Implications of immersive technologies in healthcare sector and its built environment

Objectives

This research focuses on how built environment experts can contribute to the MXR-enabled digital innovation as part of the multidisciplinary team effort to ensure post-pandemic resilience in healthcare built environment. The goal of this research is to help healthcare providers, built environment experts, and policy makers respectively: (1) Advocate the benefits of MXR for innovating health and social care; (2) Spark debate across networks of expertise to create health-promoting environment; and (3) Understand the overriding priorities in making effective pathways to the implementation of MXR.

Methods

To highlight the novelty of this research, the study relies on two qualitative methodologies: exploratory literature review and semi-structured interviews. Based on the evaluation of prior works and cross-national case studies, hypotheses are formulated from three arenas: (1) Cross-sectional Initiatives for Post-pandemic Resilience; (2) Interoperability and Usability of Next-gen Medicines; and (3) Metaverse and New Forms of Value in Future Healthcare Ecosystems. To verify those hypotheses, empirical findings are derived from in-depth interviews with nine key informants.

Results

The main findings are summarized under the following three themes: (1) Synergism between Architecture and Technology; (2) Patient Empowerment and Staff Support; and (3) Scalable Health and Wellbeing in Non-hospital and Therapeutic Settings. Firstly, both built environment and healthcare sectors can benefit from the various capabilities of MXR through cross-sectional initiatives, evidence-based practices, and participatory approaches. Secondly, a confluence of knowledge and methods of HCI and HBI can increase the interoperability and usability of MXR for the patient-centered and value-based healthcare models. Thirdly, the MXR-enabled technological regime will largely affect the new forms of value in healthcare premises by fostering more decentralized, preventive, and therapeutic characteristics in the future healthcare ecosystems.

Conclusion

Whether it's virtual or physical, our healthcare systems have placed great emphasis on the rigor of evidence-based approach linking health outcome to a clinical environment. Henceforth, built environment experts should seek closer ties with the MXR ecosystems for the co-production of scalable health and wellbeing in non-hospital and therapeutic settings. Ultimately, this is to improve resource efficiency in the healthcare sector while considering the transition of health resources towards in silico status by increasing the implementation of MXR.

The Impact of Virtual Interactive Three-Dimensional Model in the Conceptualization of the Anatomy of the Sacrum: A Randomized Controlled Trial

Introduction Virtual interactive three-dimensional model (VI3DM) is an emerging technology with promising futures in medical education. It allows learners to view and interact with the three-dimensional (3D) object in an isolated virtual environment, as well as on screen-based platforms. This technology seems more helpful in understanding the learning objectives that demand high cognitive and visuospatial skills. The sacrum, part of the posterior wall of the bony pelvis, is a structure of interest to medical professionals and forensic experts. Understanding the anatomy and relations of the sacrum demands good spatial understanding. Hypothetically, virtual 3D models should help in learning the anatomy of the sacrum along with its relations and attachments. This study was conducted to find out the effect of low-cost digital 3D models on the anatomical knowledge of the study. Aims and objectives The goal of the work was to identify the role of virtual 3D models in the conceptualization of the anatomy of the sacrum. The study's objectives were to identify the impact of virtual 3D models on students' knowledge of the external features, relations, attachments, and joints formed by the sacrum. Material and methods Two hundred first-year medical students (168 males and 32 females) who participated in the study after providing informed consent were divided into two equal groups, a control group (n=100) and an experimental group (n=100), after matching the age, gender, and anatomical knowledge of the sacrum. We used two-dimensional (2D) images and virtual interactive 3D models of the sacrum as control and intervention, respectively, in this randomized controlled study. We conducted a post-test quiz after the 30-minute session of self-directed learning. Results The mean difference between the post-test score and the pre-test score of the experimental group (4.1±1.6 ) was significantly higher than the difference between the post-test and pre-test scores of the control group (2.5±1.2). The virtual interactive 3D model of the sacrum was significantly effective in the conceptualization of the sacrum anatomy. Conclusion A virtual interactive 3D model is an effective tool to conceptualize the anatomy of the sacrum and can be explored for its use in further complex anatomical structures. Digital 3D models can become a platform for the application of various virtual realities (VR) and artificial intelligences in medical education.

Augmented or Mixed Reality Enhanced Head-Mounted Display Navigation for In Vivo Spine Surgery: A Systematic Review of Clinical Outcomes

BACKGROUND

This research paper provides a systematic literature review (SLR) on the current status of augmented-reality head-mounted devices (AR-HMDs) that guide and navigate spine surgeries and pedicle screw placement.

METHODS

Embase, Scopus, PubMed, Cochrane Library and IEEE Xplore databases were screened for the systematic literature search to collect and statistically analyze live patient clinical, procedural and user experience data. Multi-level Poisson and binominal models were used for analysis.

RESULTS

In vivo patient data, only the clinically widely used Gertzbein-Robbins Scale, were published as an outcome in the recent heterogeneous literature. The statistical analysis supports the hypothesis that using AR-HMDs has the same clinical outcomes as using more expensive robot-assisted surgical (RAS) systems.

CONCLUSIONS

AR-HMD-guided pedicle screw insertion is reaching its technology readiness, providing similar benefits to RAS. Further meta-analysis is expected in the future from higher case-numbered and standardized randomized clinical trials.

A mixed reality-based navigation method for dental implant navigation method: A pilot study

This in vitro study aimed to put forward the development and investigation of a novel Mixed Reality (MR)-based dental implant navigation method and evaluate implant accuracy. Data were collected using 3D-cone beam computed tomography. The MR-based navigation system included a Hololens headset, an NDI (Northern Digital Inc.) Polaris optical tracking system, and a computer. A software system was developed. Resin models of dentition defects were created for a randomized comparison study with the MR-based navigation implantation system (MR group, n = 25) and the conventional free-hand approach (FH group, n = 25). Implant surgery on the models was completed by an oral surgeon. The precision and feasibility of the MR-based navigation method in dental implant surgery were assessed and evaluated by calculating the entry deviation, middle deviation, apex deviation, and angular deviation values of the implant. The system, including both the hardware and software, for the MR-based dental implant navigation method were successfully developed and a workflow of the method was established. Three-Dimensional (3D) reconstruction and visualization of the surgical instruments, dentition, and jawbone were achieved. Real-time tracking of implant tools and jaw model, holographic display via the MR headset, surgical guidance, and visualization of the intraoperative implant trajectory deviation from the planned trajectory were captured by our system. The MR-based navigation system was with better precise than the free-hand approach for entry deviation (MR: 0.6914 ± 0.2507 mm, FH: 1.571 ± 0.5004 mm, P = 0.000), middle deviation (MR: 0.7156 ± 0.2127 mm, FH: 1.170 ± 0.3448 mm, P = 0.000), apex deviation (MR: 0.7869 ± 0.2298 mm, FH: 0.9190 ± 0.3319 mm, P = 0.1082), and angular deviation (MR: 1.849 ± 0.6120°, FH: 4.933 ± 1.650°, P = 0.000).

A new preoperative localization of pulmonary nodules guided by mixed reality: a pilot study of an animal model

Background

With the popularity of high-resolution computed tomography (HRCT), more and more pulmonary nodules are being discovered. Video-assisted thoracoscopic surgery (VATS) has become the first choice for surgical treatment of pulmonary nodules. The use of accurate preoperative localization is crucial for successful resection in VATS. At present, there are many kinds of preoperative localization methods, but there are certain disadvantages. This study aimed to evaluate the feasibility and safety of mixed reality (MR)-guided pulmonary nodules localization, which is a new method that can benefit patients to a greater extent.

Methods

By constructing an animal model of pulmonary nodules localization, 28 cases of pulmonary nodules were located by MR-guided localization. We recorded the localization accuracy, localization time, insertion attempts, and incidence of complications related to localization under MR-guidance.

Results

All 28 nodules were successfully located: the deviation of MR-guided localization was 5.71±2.59 mm, localization time was 8.07±1.44 min, and insertion attempts was 1. A pneumothorax and localizer dislodgement occurred in 1 case, respectively.

Conclusions

Since preoperative localization is critical for VATS resection of pulmonary nodules, we investigated a new localization method. As indicated by our study, MR-guided localization of pulmonary nodules is feasible and safe, which is worthy of further research and promotion. We have also registered corresponding clinical trials to further investigate and help to improve our understanding of this technique.

Real-time mixed reality display of dual particle radiation detector data

Radiation source localization and characterization are challenging tasks that currently require complex analyses for interpretation. Mixed reality (MR) technologies are at the verge of wide scale adoption and can assist in the visualization of complex data. Herein, we demonstrate real-time visualization of gamma ray and neutron radiation detector data in MR using the Microsoft HoloLens 2 smart glasses, significantly reducing user interpretation burden. Radiation imaging systems typically use double-scatter events of gamma rays or fast neutrons to reconstruct the incidence directional information, thus enabling source localization. The calculated images and estimated 'hot spots' are then often displayed in 2D angular space projections on screens. By combining a state-of-the-art dual particle imaging system with HoloLens 2, we propose to display the data directly to the user via the head-mounted MR smart glasses, presenting the directional information as an overlay to the user's 3D visual experience. We describe an open source implementation using efficient data transfer, image calculation, and 3D engine. We thereby demonstrate for the first time a real-time user experience to display fast neutron or gamma ray images from various radioactive sources set around the detector. We also introduce an alternative source search mode for situations of low event rates using a neural network and simulation based training data to provide a fast estimation of the source's angular direction. Using MR for radiation detection provides a more intuitive perception of radioactivity and can be applied in routine radiation monitoring, education & training, emergency scenarios, or inspections.

The role of artificial intelligence in surgical simulation

Artificial Intelligence (AI) plays an integral role in enhancing the quality of surgical simulation, which is increasingly becoming a popular tool for enriching the training experience of a surgeon. This spans the spectrum from facilitating preoperative planning, to intraoperative visualisation and guidance, ultimately with the aim of improving patient safety. Although arguably still in its early stages of widespread clinical application, AI technology enables personal evaluation and provides personalised feedback in surgical training simulations. Several forms of surgical visualisation technologies currently in use for anatomical education and presurgical assessment rely on different AI algorithms. However, while it is promising to see clinical examples and technological reports attesting to the efficacy of AI-supported surgical simulators, barriers to wide-spread commercialisation of such devices and software remain complex and multifactorial. High implementation and production costs, scarcity of reports evidencing the superiority of such technology, and intrinsic technological limitations remain at the forefront. As AI technology is key to driving the future of surgical simulation, this paper will review the literature delineating its current state, challenges, and prospects. In addition, a consolidated list of FDA/CE approved AI-powered medical devices for surgical simulation is presented, in order to shed light on the existing gap between academic achievements and the universal commercialisation of AI-enabled simulators. We call for further clinical assessment of AI-supported surgical simulators to support novel regulatory body approved devices and usher surgery into a new era of surgical education.

Virtual Reality in Health Science Education: Professors’ Perceptions

Virtual reality (VR) is a simulated experience in a three-dimensional (3D) computer-simulated world. Recent advances in technology position VR as a multipurpose technology in the healthcare sector and as a critical component in achieving Health 4.0. In this article, descriptive and correlationally quantitative research is carried out on the assessments made by Latin American health sciences university professors on the didactic use of virtual reality technologies. The main objective was to analyze the differences in the perceptions expressed by the public or private tenure of the universities where the professors teach. In addition, gender and age gaps were identified in the assessments obtained from each of the types of universities. The results reveal that Latin American health science professors at private universities have a higher selfconcept of their digital skills for the use of virtual reality in the lectures. This greater selfconcept also leads to a reduction in the gender and age gaps in the participating private universities with respect to the public counterparts. It is advisable to increase both faculty training in the didactic use of virtual reality and funding for its use, mainly in public universities.

Current and Emerging Approaches for Spine Tumor Treatment

Spine tumors represent a significant social and medical problem, affecting the quality of life of thousands of patients and imposing a burden on healthcare systems worldwide. Encompassing a wide range of diseases, spine tumors require prompt multidisciplinary treatment strategies, being mainly approached through chemotherapy, radiotherapy, and surgical interventions, either alone or in various combinations. However, these conventional tactics exhibit a series of drawbacks (e.g., multidrug resistance, tumor recurrence, systemic adverse effects, invasiveness, formation of large bone defects) which limit their application and efficacy. Therefore, recent research focused on finding better treatment alternatives by utilizing modern technologies to overcome the challenges associated with conventional treatments. In this context, the present paper aims to describe the types of spine tumors and the most common current treatment alternatives, further detailing the recent developments in anticancer nanoformulations, personalized implants, and enhanced surgical techniques.

Minimally Invasive Procedures, Perioperative Telemedicine, and Decreased Hospital Stays Following Covid-19 Surgical Restrictions: Spinal Surgery

The 2019 severe acute respiratory syndrome coronavirus 2 pandemic had devastating impacts on healthcare system operations. Disruption of this delicate system led to international healthcare challenges with new policy changes that affected all specialties, including the global spine surgery community. The pandemic disrupted normal spine surgery proceedings, restricting, and postponing elective procedures, which comprise a large proportion of spine surgeries. This disruption may have contributed to significant economic losses for providers and resulted in the prolonged impairment of patients who were forced to postpone their procedures. However, response to the pandemic precipitated new procedural guidelines and practices that prioritize health outcomes and satisfaction. These new changes and innovations are positioned to provide lasting economic and procedural impacts in favor of both providers and patients. Thus, the objective of our review is to explore how spinal surgical practices and post-op recovery changed following COVID-19 and highlight some lasting impacts the pandemic created for future patients.

A Systematic Study to Compare the Precise Implantation of Hololens 2 Assisted with Acetabular Prosthesis for Total Hip Replacement

This study aims to evaluate the accuracy of the precise implantation of Hololens 2 assisted with acetabular prosthesis for total hip replacement. A total of 80 orthopaedic doctors from our hospital are enrolled in this systematic study and these doctors are divided into following four groups based on the experience of doctors treatment for orthopaedic patients and the Hololens 2 assisted:Rich experienced group with Hololens 2, rich experienced group without Hololens 2, inexperienced group with Hololens 2, inexperienced group without Hololens 2. The abduction angle, the anteversion angle, the offset degree in the abduction angle, the offset degree in the anteversion angle in four groups are presented and these result are used to evaluate the accuracy of precise implantation of Hololens 2 assisted with acetabular prosthesis for total hip replacement. Finally, all date in this study is collected and analyzed. The total of 80 physicians are included in this study. The results show that the outcomes between rich experienced group with Hololens 2 and rich experienced group without Hololens 2 are significant difference, and the outcomes between inexperienced group with Hololens 2 and inexperienced group without Hololens 2 are significant difference. The result between any other two groups is no significant difference. Hololens 2 assisted with acetabular prosthesis for total hip replacement can improve the accuracy.

Microsoft HoloLens 2 in Medical and Healthcare Context: State of the Art and Future Prospects

In the world reference context, although virtual reality, augmented reality and mixed reality have been emerging methodologies for several years, only today technological and scientific advances have made them suitable to revolutionize clinical care and medical contexts through the provision of enhanced functionalities and improved health services. This systematic review provides the state-of-the-art applications of the Microsoft^® HoloLens 2 in a medical and healthcare context. Focusing on the potential that this technology has in providing digitally supported clinical care, also but not only in relation to the COVID-19 pandemic, studies that proved the applicability and feasibility of HoloLens 2 in a medical and healthcare scenario were considered. The review presents a thorough examination of the different studies conducted since 2019, focusing on HoloLens 2 medical sub-field applications, device functionalities provided to users, software/platform/framework used, as well as the study validation. The results provided in this paper could highlight the potential and limitations of the HoloLens 2-based innovative solutions and bring focus to emerging research topics, such as telemedicine, remote control and motor rehabilitation.

Application Effect of Motion Capture Technology in Basketball Resistance Training and Shooting Hit Rate in Immersive Virtual Reality Environment

With the progress of society, sports have become the mainstream of social development. Strengthening the athletic ability of basketball players can effectively improve their shooting percentage. Firstly, virtual reality (VR) technology and motion capture technology are summarized. Secondly, the resistance training and shooting training of basketball players are analyzed and explained. Finally, the algorithm of motion capture technology is designed to capture and optimize the movements of athletes. In addition, a comprehensive evaluation of the shooting percentage of basketball players is carried out. The results show that the motion capture technology proposed here effectively captures the shooting action of basketball players, and the shooting percentage of players is promoted through resistance training. Among all athletes, the highest shooting percentage improvement is around 14% and the lowest is around 4%. In all groups, athletes of different heights have the largest difference in the improvement of shooting percentage. Therefore, this work plays an important role in improving the shooting rate of basketball players through VR technology. It provides technical support for improving the shooting percentage of basketball players and contributes to the progress of athletes' comprehensive athletic ability.

Review and Future/Potential Application of Mixed Reality Technology in Orthopaedic Oncology

In orthopaedic oncology, surgical planning and intraoperative execution errors may result in positive tumor resection margins that increase the risk of local recurrence and adversely affect patients’ survival. Computer navigation and 3D-printed resection guides have been reported to address surgical inaccuracy by replicating the surgical plans in complex cases. However, limitations include surgeons’ attention shift from the operative field to view the navigation monitor and expensive navigation facilities in computer navigation surgery. Practical concerns are lacking real-time visual feedback of preoperative images and the lead-time in manufacturing 3D-printed objects. Mixed Reality (MR) is a technology of merging real and virtual worlds to produce new environments with enhanced visualizations, where physical and digital objects coexist and allow users to interact with both in real-time. The unique MR features of enhanced medical images visualization and interaction with holograms allow surgeons real-time and on-demand medical information and remote assistance in their immediate working environment. Early application of MR technology has been reported in surgical procedures. Its role is unclear in orthopaedic oncology. This review aims to provide orthopaedic tumor surgeons with up-to-date knowledge of the emerging MR technology. The paper presents its essential features and clinical workflow, reviews the current literature and potential clinical applications, and discusses the limitations and future development in orthopaedic oncology. The emerging MR technology adds a new dimension to digital assistive tools with a more accessible and less costly alternative in orthopaedic oncology. The MR head-mounted display and hand-free control may achieve clinical point-of-care inside or outside the operating room and improve service efficiency and patient safety. However, lacking an accurate hologram-to-patient matching, an MR platform dedicated to orthopaedic oncology, and clinical results may hinder its wide adoption. Industry-academic partnerships are essential to advance the technology with its clinical role determined through future clinical studies.

Point your SmartPhone at the code above. If you have a QR code reader the video abstract will appear. Or use:

https://youtu.be/t4hl_Anh_kM

Augmented reality-assisted craniofacial reconstruction in skull base lesions - an innovative technique for single-step resection and cranioplasty in neurosurgery

Defects of the cranial vault often require cosmetic reconstruction with patient-specific implants, particularly in cases of craniofacial involvement. However, fabrication takes time and is expensive; therefore, efforts must be made to develop more rapidly available and more cost-effective alternatives. The current study investigated the feasibility of an augmented reality (AR)-assisted single-step procedure for repairing bony defects involving the facial skeleton and the skull base. In an experimental setting, nine neurosurgeons fabricated AR-assisted and conventionally shaped ("freehand") implants from polymethylmethacrylate (PMMA) on a skull model with a craniofacial bony defect. Deviations of the surface profile in comparison with the original model were quantified by means of volumetry, and the cosmetic results were evaluated using a multicomponent scoring system, each by two blinded neurosurgeons. Handling the AR equipment proved to be quite comfortable. The median volume deviating from the surface profile of the original model was low in the AR-assisted implants (6.40 cm³) and significantly reduced in comparison with the conventionally shaped implants (13.48 cm³). The cosmetic appearance of the AR-assisted implants was rated as very good (median 25.00 out of 30 points) and significantly improved in comparison with the conventionally shaped implants (median 14.75 out of 30 points). Our experiments showed outstanding results regarding the possibilities of AR-assisted procedures for single-step reconstruction of craniofacial defects. Although patient-specific implants still represent the gold standard in esthetic aspects, AR-assisted procedures hold high potential for an immediately and widely available, cost-effective alternative providing excellent cosmetic outcomes.

Digital Transformation Will Change Medical Education and Rehabilitation in Spine Surgery

The concept of minimally invasive spine therapy (MIST) has been proposed as a treatment strategy to reduce the need for overall patient care, including not only minimally invasive spine surgery (MISS) but also conservative treatment and rehabilitation. To maximize the effectiveness of patient care in spine surgery, the educational needs of medical students, residents, and patient rehabilitation can be enhanced by digital transformation (DX), including virtual reality (VR), augmented reality (AR), mixed reality (MR), and extended reality (XR), three-dimensional (3D) medical images and holograms; wearable sensors, high-performance video cameras, fifth-generation wireless system (5G) and wireless fidelity (Wi-Fi), artificial intelligence, and head-mounted displays (HMDs). Furthermore, to comply with the guidelines for social distancing due to the unexpected COVID-19 pandemic, the use of DX to maintain healthcare and education is becoming more innovative than ever before. In medical education, with the evolution of science and technology, it has become mandatory to provide a highly interactive educational environment and experience using DX technology for residents and medical students, known as digital natives. This study describes an approach to pre- and intraoperative medical education and postoperative rehabilitation using DX in the field of spine surgery that was implemented during the COVID-19 pandemic and will be utilized thereafter.

Looking through the Lens: The Reality of Telesurgical Support with Interactive Technology Using Microsoft’s HoloLens 2

Reality technologies in the orthopaedic arena have been increasing in use over the last decade, including virtual reality (VR), augmented reality (AR), and mixed reality (MR). MR is one of the most recent innovations and perhaps the most promising for improving the overall surgical experience. The purpose of this case report was to demonstrate a complex total knee arthroplasty case where unplanned remote assistance was used for telesurgical support using the HoloLens 2.