Augmented reality through head-mounted display for navigation of baseplate component placement in reverse total shoulder arthroplasty: a cadaveric study

Metaverse, virtual reality and augmented reality in total shoulder arthroplasty: a systematic review

PURPOSE

This systematic review aims to provide an overview of the current knowledge on the role of the metaverse, augmented reality, and virtual reality in reverse shoulder arthroplasty.

METHODS

A systematic review was performed using the PRISMA guidelines. A comprehensive review of the applications of the metaverse, augmented reality, and virtual reality in in-vivo intraoperative navigation, in the training of orthopedic residents, and in the latest innovations proposed in ex-vivo studies was conducted.

RESULTS

A total of 22 articles were included in the review. Data on navigated shoulder arthroplasty was extracted from 14 articles: seven hundred ninety-three patients treated with intraoperative navigated rTSA or aTSA were included. Also, three randomized control trials (RCTs) reported outcomes on a total of fifty-three orthopedics surgical residents and doctors receiving VR-based training for rTSA, which were also included in the review. Three studies reporting the latest VR and AR-based rTSA applications and two proof of concept studies were also included in the review.

CONCLUSIONS

The metaverse, augmented reality, and virtual reality present immense potential for the future of orthopedic surgery. As these technologies advance, it is crucial to conduct additional research, foster development, and seamlessly integrate them into surgical education to fully harness their capabilities and transform the field. This evolution promises enhanced accuracy, expanded training opportunities, and improved surgical planning capabilities.

Feasibility and Usability of Augmented Reality Technology in the Orthopaedic Operating Room

PURPOSE OF REVIEW

Augmented reality (AR) has gained popularity in various sectors, including gaming, entertainment, and healthcare. The desire for improved surgical navigation within orthopaedic surgery has led to the evaluation of the feasibility and usability of AR in the operating room (OR). However, the safe and effective use of AR technology in the OR necessitates a proper understanding of its capabilities and limitations. This review aims to describe the fundamental elements of AR, highlight limitations for use within the field of orthopaedic surgery, and discuss potential areas for development.

RECENT FINDINGS

To date, studies have demonstrated evidence that AR technology can be used to enhance navigation and performance in orthopaedic procedures. General hardware and software limitations of the technology include the registration process, ergonomics, and battery life. Other limitations are related to the human response factors such as inattentional blindness, which may lead to the inability to see complications within the surgical field. Furthermore, the prolonged use of AR can cause eye strain and headache due to phenomena such as the vergence-convergence conflict. AR technology may prove to be a better alternative to current orthopaedic surgery navigation systems. However, the current limitations should be mitigated to further improve the feasibility and usability of AR in the OR setting. It is important for both non-clinicians and clinicians to work in conjunction to guide the development of future iterations of AR technology and its implementation into the OR workflow.

Validation of mixed-reality surgical navigation for glenoid axis pin placement in shoulder arthroplasty using a cadaveric model

BACKGROUND

Mixed reality may offer an alternative for computer-assisted navigation in shoulder arthroplasty. The purpose of this study was to determine the accuracy and precision of mixed-reality guidance for the placement of the glenoid axis pin in cadaver specimens. This step is essential for accurate glenoid placement in total shoulder arthroplasty.

METHODS

Fourteen cadaveric shoulders underwent simulated shoulder replacement surgery by 7 experienced shoulder surgeons. The surgeons exposed the cadavers through a deltopectoral approach and then used mixed-reality surgical navigation to insert a guide pin in a preplanned position and trajectory in the glenoid. The mixed-reality system used the Microsoft Hololens 2 headset, navigation software, dedicated instruments with fiducial marker cubes, and a securing pin. Computed tomography scans obtained before and after the procedure were used to plan the surgeries and determine the difference between the planned and executed values for the entry point, version, and inclination. One specimen had to be discarded from the analysis because the guide pin was removed accidentally before obtaining the postprocedure computed tomography scan.

RESULTS

Regarding the navigated entry point on the glenoid, the mean difference between planned and executed values was 1.7 ± 0.8 mm; this difference was 1.2 ± 0.6 mm in the superior-inferior direction and 0.9 ± 0.8 mm in the anterior-posterior direction. The maximum deviation from the entry point for all 13 specimens analyzed was 3.1 mm. Regarding version, the mean difference between planned and executed version values was 1.6° ± 1.2°, with a maximum deviation in version for all 13 specimens of 4.1°. Regarding inclination, the mean angular difference was 1.7° ± 1.5°, with a maximum deviation in inclination of 5°.

CONCLUSIONS

The mixed-reality navigation system used in this study allowed surgeons to insert the glenoid guide pin on average within 2 mm from the planned entry point and within 2° of version and inclination. The navigated values did not exceed 3 mm or 5°, respectively, for any of the specimens analyzed. This approach may help surgeons more accurately place the definitive glenoid component.

The development of a novel navigation system for reverse shoulder arthroplasty and its accuracy: a phantom and cadaveric study

PURPOSE

Reverse shoulder arthroplasty has demonstrated excellent clinical efficacy for patients with shoulder joint diseases and is increasingly in demand. Traditional surgery faces challenges such as limited exposed surfaces and a narrow field of vision, leading to a shorter prosthesis lifespan and a higher risk of complications. In this study, an optical navigation system was proposed to assist surgeons in real-time tracking of the surgical scene.

METHODS

Our optical navigation system was developed using the NDI Polaris Spectra device and several open-source platforms. The first step involved using the preoperative medical image to plan screw implantation paths. Real-time tracking of the patient phantom or cadaver and the surgical instrument was achieved through registration and calibration algorithms. Surgeons were guided on drilling through visualization methods. Postoperative results were compared with the planned implantation paths, and an algorithm was introduced to correct errors caused by the incorrect beginning points.

RESULTS

Experiments involved three scapula cadavers and their corresponding phantoms with identical anatomy. For each experiment, three holes were completed with drills with diameters of 3.2 mm and 8.0 mm, respectively. Comparisons between the postoperative actual screw implantation paths and the preoperative planned implantation paths revealed an entry error of 1.05 ± 0.15 mm and an angle error of 2.47 ± 0.55° for phantom experiments. For cadaver experiments, the entry error was 1.53 ± 0.22 mm, and the angle error was 4.91 ± 0.78°.

CONCLUSION

Our proposed optical navigation system successfully achieved real-time tracking of the surgical site, encompassing the patient phantom or cadaver and surgical instrument, thereby aiding surgeons in achieving precise surgical outcomes. Future study will explore the integration of robots to further enhance surgical efficiency and effectiveness.

The Value of Computed Tomography-Based Planning in Shoulder Arthroplasty Compared to Intra-/Interobserver Reliability of X-ray Planning

Background: Reversed total shoulder arthroplasty (RTSA) is an established surgery for many pathologies of the shoulder and the demand continues to rise with an aging population. Preoperative planning is mandatory to support the surgeon's understanding of the patient's individual anatomy and, therefore, is crucial for the patient's outcome. Methods: In this observational study, we identified 30 patients who underwent RTSA with two- and three-dimensional preoperative planning. Each patient underwent new two-dimensional planning from a medical student and an orthopedic resident as well as through a mid-volume and high-volume shoulder surgeon, which was repeated after a minimum of 4 weeks. The intra- and interobserver reliability was then analyzed and compared to the 3D planning and the implanted prosthesis. The evaluated parameters were the size of the pegged glenoid baseplate, glenosphere, and humeral short stem. Results: The inter-rater reliability showed higher deviations in all four raters compared to the 3D planning of the base plate, glenosphere, and shaft. The intra-rater reliability showed a better correlation in more experienced raters, especially in the planning of the shaft. Conclusions: Our study shows that 3D planning is more accurate than traditional planning on plain X-rays, despite experienced shoulder surgeons showing better results in 2D planning than inexperienced ones.

Conventional vs Augmented Reality-Guided Lateral Calcaneal Lengthening Simulated in a Foot Bone Model

BACKGROUND

Acquired adult flatfoot deformity (AAFD) results in a loss of the medial longitudinal arch of the foot and dysfunction of the posteromedial soft tissues. Hintermann osteotomy (H-O) is often used to treat stage II AAFD. The procedure is challenging because of variations in the subtalar facets and limited intraoperative visibility. We aimed to assess the impact of augmented reality (AR) guidance on surgical accuracy and the facet violation rate.

METHODS

Sixty AR-guided and 60 conventional osteotomies were performed on foot bone models. For AR osteotomies, the ideal osteotomy plane was uploaded to a Microsoft HoloLens 1 headset and carried out in strict accordance with the superimposed holographic plane. The conventional osteotomies were performed relying solely on the anatomy of the calcaneal lateral column. The rate and severity of facet joint violation was measured, as well as accuracy of entry and exit points. The results were compared across AR-guided and conventional osteotomies, and between experienced and inexperienced surgeons.

RESULTS

Experienced surgeons showed significantly greater accuracy for the osteotomy entry point using AR, with the mean deviation of 1.6 ± 0.9 mm (95% CI 1.26, 1.93) compared to 2.3 ± 1.3 mm (95% CI 1.87, 2.79) in the conventional method (P = .035). The inexperienced had improved accuracy, although not statistically significant (P = .064), with the mean deviation of 2.0 ± 1.5 mm (95% CI 1.47, 2.55) using AR compared with 2.7 ± 1.6 mm (95% CI 2.18, 3.32) in the conventional method. AR helped the experienced surgeons avoid full violation of the posterior facet (P = .011). Inexperienced surgeons had a higher rate of middle and posterior facet injury with both methods (P = .005 and .021).

CONCLUSION

Application of AR guidance during H-O was associated with improved accuracy for experienced surgeons, demonstrated by a better accuracy of the osteotomy entry point. More crucially, AR guidance prevented full violation of the posterior facet in the experienced group. Further research is needed to address limitations and test this technology on cadaver feet. Ultimately, the use of AR in surgery has the potential to improve patient and surgeon safety while minimizing radiation exposure.

CLINICAL RELEVANCE

Subtalar facet injury during lateral column lengthening osteotomy represents a real problem in clinical orthopaedic practice. Because of limited intraoperative visibility and variable anatomy, it is hard to resolve this issue with conventional means. This study suggests the potential of augmented reality to improve the osteotomy accuracy.

Mixed-reality improves execution of templated glenoid component positioning in shoulder arthroplasty: a CT imaging analysis

INTRODUCTION

Glenoid placement is critical for successful outcomes in total shoulder arthroplasty (TSA). Preoperative templating with three-dimensional imaging has improved implant positioning, but deviations from the planned inclination and version still occur. Mixed-Reality (MR) is a novel technology that allows surgeons intra-operative access to three-dimensional imaging and templates, capable of overlaying the surgical field to help guide component positioning. The purpose of this study was to compare the execution of preoperative templates using MR vs.standard instruments (SIs).

METHODS

Retrospective review of 97 total shoulder arthroplasties (18 anatomic, 79 reverse) from a single high-volume shoulder surgeon between January 2021 and February 2023, including only primary diagnoses of osteoarthritis, rotator cuff arthropathy, or a massive irreparable rotator cuff tear. To be included, patients needed a templated preoperative plan and then a postoperative computed tomography scan. Allocation to MR vs. SI was based on availability of the MR headset, industry technical personnel, and the templated preoperative plan loaded into the software, but preoperative or intraoperative patient factors did not contribute to the allocation decision. Postoperative inclination and version were measured by two independent, blinded physicians and compared to the preoperative template. From these measurements, we calculated the mean difference, standard deviation (SD), and variance to compare MR and SI.

RESULTS

Comparing 25 MR to 72 SI cases, MR significantly improved both inclination (P < .001) and version (P < .001). Specifically, MR improved the mean difference from preoperative templates (by 1.9° inclination, 2.4° version), narrowed the SD (by 1.7° inclination, 1.8° version), and decreased the variance (11.7-3.0 inclination, 14.9-4.3 version). A scatterplot of the data demonstrates a concentration of MR cases within 5° of plan relative to SI cases typically within 10° of plan. There was no difference in operative time.

CONCLUSION

MR improved the accuracy and precision of glenoid positioning. Although it is unlikely that 2° makes a detectable clinical difference, our results demonstrate the potential ability for technology like MR to narrow the bell curve and decrease the outliers in glenoid placement. This will be particularly relevant as MR and other similar technologies continue to evolve into more effective methods in guiding surgical execution.

Glenoid component placement in reverse shoulder arthroplasty assisted with augmented reality through a head-mounted display leads to low deviation between planned and postoperative parameters

BACKGROUND

Navigated augmented reality (AR) through a head-mounted display (HMD) may lead to accurate glenoid component placement in reverse shoulder arthroplasty (RSA). The purpose of this study is to evaluate the deviation between planned, intra- and postoperative inclination, retroversion, entry point, depth, and rotation of the glenoid component placement assisted by a navigated AR through HMD during RSA.

METHODS

Both shoulders of 6 fresh frozen human cadavers, free from fractures or other bony pathologies, were used. Preoperative computed tomography (CT) scans were used for the 3-dimensional (3D) planning. The glenoid component placement was assisted using a navigated AR system through an HMD in all specimens. Intraoperative inclination, retroversion, depth, and rotation were measured by the system. A postoperative CT scan was performed. The pre- and postoperative 3D CT scan reconstructions were superimposed to calculate the deviation between planned and postoperative inclination, retroversion, entry point, depth, and rotation of the glenoid component placement. Additionally, a comparison between intra- and postoperative values was calculated. Outliers were defined as >10° inclination, >10° retroversion, >3 mm entry point.

RESULTS

The registration algorithm of the scapulae prior to the procedure was correctly completed for all cases. The deviations between planned and postoperative values were 1.0° ± 0.7° for inclination, 1.8° ± 1.3° for retroversion, 1.1 ± 0.4 mm for entry point, 0.7 ± 0.6 mm for depth, and 1.7° ± 1.6° for rotation. The deviation between intra- and postoperative values were 0.9° ± 0.8° for inclination, 1.2° ± 1.1° for retroversion, 0.6 ± 0.5 mm for depth, and 0.3° ± 0.2° for rotation. There were no outliers between planned and postoperative parameters.

CONCLUSION

In this study, the use of a navigated AR system through an HMD for RSA led to low deviation between planned and postoperative values and between intra- and postoperative parameters.

Preoperative planning in reverse shoulder arthroplasty: plain radiographs vs. computed tomography scan vs. navigation vs. augmented reality

Reverse shoulder arthroplasty (RSA) has become a highly successful treatment option for various shoulder conditions, leading to a significant increase in its utilization since its approval in 2003. However, postoperative complications, including scapular notching, prosthetic instability, and component loosening, remain a concern. These complications can often be attributed to technical errors during component implantation, emphasizing the importance of proper preoperative planning and accurate positioning of prosthetic components. Improper baseplate and glenosphere positioning in RSA have been linked to impingement, reduced range of motion, and increased scapular notching. Additionally, the relationship between component positioning and intrinsic stability of RSA has been established, with glenoid component retroversion exceeding 10° posing a risk to implant stability. Adequate initial glenoid baseplate fixation, achieved through optimal seating and the use of appropriate screws, is crucial for long-term success and prevention of early failure. Factors such as lateralization and distalization also influence outcomes and complications in RSA, yet standardized guidelines for preoperative planning in these parameters are still lacking. Despite the impact of component position on outcomes, glenoid component implantation remains challenging, with position errors being common even among experienced surgeons. Challenges arise due to factors such as deformity, bone defects, limited exposure, and the absence of reliable bony landmarks intraoperatively. With the evolving understanding of RSA biomechanics and the significance of implant configuration and positioning, advancements in preoperative planning and surgical aids have emerged. This review article explores the current evidence on preoperative planning techniques in RSA, including plain radiographs, three-dimensional imaging, computer planning software, intraoperative navigation, and augmented reality (AR), highlighting their potential benefits and advancements in improving implant position accuracy.

Augmented reality and shoulder replacement: a state-of-the-art review article

Since its implementation, the rates of failure of total shoulder arthroplasty which may be due to malpositioning pushed to improve this surgery by creating new techniques and tools to help perioperatively. Augmented reality, a newly used tool in orthopedic surgery can help bypass this problem and reduce the rates of failure faced in shoulder replacement surgeries. Although this technology has revolutionized orthopedic surgery and helped improve the accuracy in shoulder prosthesis components positioning, it still has some limitations such as inaccurate over-imposition that should be addressed before it becomes of standard usage.

The Evolution of Reverse Total Shoulder Arthroplasty-Where Do We Stand and What Comes Next?

Over 35 years ago, the pioneer Paul Grammont from Lyon published his ideas of a reversed semi-constraint prosthesis improving the moment arm of the deltoid by medializing the center of rotation and lengthening of the arm and thus increasing deltoid muscle tension [...].

[Bony glenoid reconstruction in revision arthroplasty]

Glenoid pathologies are one of the main indications for shoulder arthroplasty revisions. In most cases, the glenoid bone defect is associated with insufficiency of the rotator cuff, so that only reverse total shoulder arthroplasty can be considered as a revision implant. For stable permanent fixation of the reverse glenoid component, to avoid inferior glenoid notching, and to achieve optimal function, physiological restoration of three-dimensional glenoid anatomy is necessary. In order to approach the individual glenoid pathologies in a differentiated and optimal manner, it is important to classify the defects. A basic distinction must be made between centric contained and eccentric uncontained defects. Combinations often occur. It is also important to consider the severity, depth, and three-dimensional orientation of the defect. Therefore, a CT analysis of the glenoid is essential preoperatively. The data obtained should serve as the basis for computer-assisted planning to determine the optimal position of the glenoid baseplate and the type and shape of the bone graft for the reconstruction. For patients with good bone quality, we recommend defect reconstruction with autologous iliac crest. The type of graft configuration and fixation and the decision between a one- and two-stage procedure depend on the type and severity of the defect. With technically correct reconstruction and proper prosthesis implantation, sufficient integration of the bone graft and durable fixation of the glenoid component can be expected with satisfactory clinical results. After bony reconstruction of the defects, repeated treatment with a reverse arthroplasty is possible in the long term in the event of renewed glenoid problems.

The Reverse Shoulder Arthroplasty Angle in MRI: Impact of the Articular Cartilage in the Estimated Inclination of the Inferior Glenoid

Purpose

To describe the reverse shoulder arthroplasty angle (RSA angle) in magnetic resonance imaging (MRI) and compare the angle formed using bony landmarks (Bony RSA angle or B-RSA angle) with another angle formed using the cartilage margin as reference (Cartilage RSA angle or C-RSA angle).

Methods

Adult patients with a shoulder MRI obtained in our hospital between July 2020 and July 2021 were included. The C-RSA angle and B-RSA angle were measured. All images were independently assessed by 4 evaluators. Intraclass correlation coefficient (ICC) was determined for the B-RSA and C-RSA to evaluate interobserver agreement.

Results

A total of 61 patients were included with a median age of 59 years (17-77). C-RSA angle was significantly higher than B-RSA (25.4° ± 0.7 vs 19.5° ± 0.7, respectively) with a P-value <.001. The overall agreement was considered “good” for C-RSA (ICC = 0.74 [95% CI 0.61-0.83]) and “excellent” for B-RSA angle (ICC = 0.76 [95% CI 0.65-0.85]).

Conclusions

C-RSA angle is significantly higher than B-RSA angle. In cases without significant glenoid wear neglecting to account for the remaining articular cartilage at the inferior glenoid margin may result in superior inclination of standard surgical guides.

Augmenting Performance: A Systematic Review of Optical See-Through Head-Mounted Displays in Surgery

We conducted a systematic review of recent literature to understand the current challenges in the use of optical see-through head-mounted displays (OST-HMDs) for augmented reality (AR) assisted surgery. Using Google Scholar, 57 relevant articles from 1 January 2021 through 18 March 2022 were identified. Selected articles were then categorized based on a taxonomy that described the required components of an effective AR-based navigation system: data, processing, overlay, view, and validation. Our findings indicated a focus on orthopedic (n=20) and maxillofacial surgeries (n=8). For preoperative input data, computed tomography (CT) (n=34), and surface rendered models (n=39) were most commonly used to represent image information. Virtual content was commonly directly superimposed with the target site (n=47); this was achieved by surface tracking of fiducials (n=30), external tracking (n=16), or manual placement (n=11). Microsoft HoloLens devices (n=24 in 2021, n=7 in 2022) were the most frequently used OST-HMDs; gestures and/or voice (n=32) served as the preferred interaction paradigm. Though promising system accuracy in the order of 2–5 mm has been demonstrated in phantom models, several human factors and technical challenges—perception, ease of use, context, interaction, and occlusion—remain to be addressed prior to widespread adoption of OST-HMD led surgical navigation.

Augmented Reality in Orthopedic Surgery and Its Application in Total Joint Arthroplasty: A Systematic Review

The development of augmented reality (AR) and its application in total joint arthroplasty aims at improving the accuracy and precision in implant components’ positioning, hopefully leading to increased outcomes and survivorship. However, this field is far from being thoroughly explored. We therefore performed a systematic review of the literature in order to examine the application, the results, and the different AR systems available in TJA. A systematic review of the literature according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines was performed. A comprehensive search of PubMed, MEDLINE, EMBASE, and the Cochrane Database of Systematic Reviews was conducted for English articles on the application of augmented reality in total joint arthroplasty using various combinations of keywords since the inception of the database to 31 March 2022. Accuracy was intended as the mean error from the targeted positioning angle and compared as mean values and standard deviations. In all, 14 articles met the inclusion criteria. Among them, four studies reported on the application of AR in total knee arthroplasty, six studies on total hip arthroplasty, three studies reported on reverse shoulder arthroplasty, and one study on total elbow arthroplasty. Nine of the included studies were preclinical (sawbones or cadaveric), while five of them reported results of AR’s clinical application. The main common feature was the high accuracy and precision when implant positioning was compared with preoperative targeted angles with errors ≤2 mm and/or ≤2°. Despite the promising results in terms of increased accuracy and precision, this technology is far from being widely adopted in daily clinical practice. However, the recent exponential growth in machine learning techniques and technologies may eventually lead to the resolution of the ongoing limitations including depth perception and their high complexity, favorably encouraging the widespread usage of AR systems.

Augmented Reality-Based Surgery on the Human Cadaver Using a New Generation of Optical Head-Mounted Displays: Development and Feasibility Study

Background

Although nearly one-third of the world’s disease burden requires surgical care, only a small proportion of digital health applications are directly used in the surgical field. In the coming decades, the application of augmented reality (AR) with a new generation of optical-see-through head-mounted displays (OST-HMDs) like the HoloLens (Microsoft Corp) has the potential to bring digital health into the surgical field. However, for the application to be performed on a living person, proof of performance must first be provided due to regulatory requirements. In this regard, cadaver studies could provide initial evidence.

Objective

The goal of the research was to develop an open-source system for AR-based surgery on human cadavers using freely available technologies.

Methods

We tested our system using an easy-to-understand scenario in which fractured zygomatic arches of the face had to be repositioned with visual and auditory feedback to the investigators using a HoloLens. Results were verified with postoperative imaging and assessed in a blinded fashion by 2 investigators. The developed system and scenario were qualitatively evaluated by consensus interview and individual questionnaires.

Results

The development and implementation of our system was feasible and could be realized in the course of a cadaver study. The AR system was found helpful by the investigators for spatial perception in addition to the combination of visual as well as auditory feedback. The surgical end point could be determined metrically as well as by assessment.

Conclusions

The development and application of an AR-based surgical system using freely available technologies to perform OST-HMD–guided surgical procedures in cadavers is feasible. Cadaver studies are suitable for OST-HMD–guided interventions to measure a surgical end point and provide an initial data foundation for future clinical trials. The availability of free systems for researchers could be helpful for a possible translation process from digital health to AR-based surgery using OST-HMDs in the operating theater via cadaver studies.

Glenoid Component Placement Assisted by Augmented Reality Through a Head-Mounted Display During Reverse Shoulder Arthroplasty

Component positioning is a key factor for avoiding complications and improving functional outcomes in reverse shoulder arthroplasty. Preoperative planning can improve component positioning. However, translating the preoperative plan into the surgical procedure can be challenging. This is particularly the case for the glenoid component positioning in severe deformity or limited visualization of the scapula. Different computational-assisted techniques have been developed to aid implementation of the preoperative plan into the surgical procedure. Navigated augmented reality (AR) refers to the real world augmented with virtual real-time information about the position and orientation of instruments and components. This information can be presented through a head-mounted display (HMD), which enables the user to visualize the virtual information directly overlaid onto the real world. Navigated AR systems through HMD have been validated for shoulder arthroplasty using phantoms and cadavers. This article details a step-by-step guide use of a navigated AR system through HMD, in the placement of the glenoid bony-augmented component.