Augmented and Virtual Reality Instrument Tracking for Minimally Invasive Spine Surgery: A Feasibility and Accuracy Study

Diffuse reflectance spectroscopy for breach detection during pedicle screw placement: a first in vivo investigation in a porcine model

Background

The safe and accurate placement of pedicle screws remains a critical step in open and minimally invasive spine surgery, emphasizing the need for intraoperative guidance techniques. Diffuse reflectance spectroscopy (DRS) is an optical sensing technology that may provide intraoperative guidance in pedicle screw placement.

Purpose

The study presents the first in vivo minimally invasive procedure using DRS sensing at the tip of a Jamshidi needle with an integrated optical K-wire. We investigate the effect of tissue perfusion and probe-handling conditions on the reliability of fat fraction measurements for breach detection in vivo.

Methods

A Jamshidi needle with an integrated fiber-optic K-wire was gradually inserted into the vertebrae under intraoperative image guidance. The fiber-optic K-wire consisted of two optical fibers with a fiber-to-fiber distance of 1.024 mm. DRS spectra in the wavelength range of 450 to 1600 nm were acquired at several positions along the path inside the vertebrae. Probe-handling conditions were varied by changing the amount of pressure exerted on the probe within the vertebrae. Continuous spectra were recorded as the probe was placed in the center of the vertebral body while the porcine specimen was sacrificed via a lethal injection.

Results

A typical insertion of the fiber-optic K-wire showed a drop in fat fraction during an anterior breach as the probe transitioned from cancellous to cortical bone. Fat fraction measurements were found to be similar irrespective of the amount of pressure exerted on the probe (p = 0.65). The 95% confidence interval of fat fraction determination was found in the narrow range of 1.5–3.6% under various probe-handling conditions. The fat fraction measurements remained stable during 70 min of decreased blood flow after the animal was sacrificed.

Discussions

These findings indicate that changes in tissue perfusion and probe-handling conditions have a relatively low measureable effect on the DRS signal quality and thereby on the determination of fat fraction as a breach detection signal.

Conclusions

Fat fraction quantification for intraoperative pedicle screw breach detection is reliable, irrespective of changes in tissue perfusion and probe-handling conditions.

Imaging Technologies in Spine Surgery

This article presents a comprehensive review of the evolution of both invasive and noninvasive imaging technologies that are part of the arsenal of spinal diagnostics and surgical therapy. The text provides not only a historical lens to the evolution of the imaging technologies that are part of routine contemporary practice but also provides a detailed sketch of emerging imaging technologies, such as endoscopic and exoscopic systems. Augmented reality, virtual reality, and mixed reality are new technologies that have enhanced the preparation of surgery and provide excellent case-specific training modules to break down each step of an operation in isolation.

Design and control of an image-guided robot for spine surgery in a hybrid OR

BACKGROUND

Minimally invasive spine (MIS) fusion surgery requires image guidance and expert manual dexterity for a successful, efficient, and accurate pedicle screw placement. Operating room (OR)-integrated robotic solution can provide precise assistance to potentially minimize complication rates and facilitate difficult MIS procedures.

METHODS

A 5-degrees of freedom robot was designed specifically for a hybrid OR with integrated surgical navigation for guiding pedicle screw pilot holes. The system automatically aligns an instrument following the surgical plan using only instrument tracking feedback. Contrary to commercially available robotic systems, no tracking markers on the robotic arm are required. The system was evaluated in a cadaver study.

RESULTS

The mean targeting error (N = 34) was 1.27±0.57 mm and 1.62±0.85°, with 100% of insertions graded as clinically acceptable.

CONCLUSIONS

A fully integrated robotic guidance system, including intra-op imaging, planning, and physical guidance with optimized robot design and control, can improve workflow and provide pedicle screw guidance with less than 2 mm targeting error.

Feasibility and accuracy of a robotic guidance system for navigated spine surgery in a hybrid operating room: a cadaver study

The combination of navigation and robotics in spine surgery has the potential to accurately identify and maintain bone entry position and planned trajectory. The goal of this study was to examine the feasibility, accuracy and efficacy of a new robot-guided system for semi-automated, minimally invasive, pedicle screw placement. A custom robotic arm was integrated into a hybrid operating room (OR) equipped with an augmented reality surgical navigation system (ARSN). The robot was mounted on the OR-table and used to assist in placing Jamshidi needles in 113 pedicles in four cadavers. The ARSN system was used for planning screw paths and directing the robot. The robot arm autonomously aligned with the planned screw trajectory, and the surgeon inserted the Jamshidi needle into the pedicle. Accuracy measurements were performed on verification cone beam computed tomographies with the planned paths superimposed. To provide a clinical grading according to the Gertzbein scale, pedicle screw diameters were simulated on the placed Jamshidi needles. A technical accuracy at bone entry point of 0.48 ± 0.44 mm and 0.68 ± 0.58 mm was achieved in the axial and sagittal views, respectively. The corresponding angular errors were 0.94 ± 0.83° and 0.87 ± 0.82°. The accuracy was statistically superior (p < 0.001) to ARSN without robotic assistance. Simulated pedicle screw grading resulted in a clinical accuracy of 100%. This study demonstrates that the use of a semi-automated surgical robot for pedicle screw placement provides an accuracy well above what is clinically acceptable.

Accuracy of augmented reality surgical navigation for minimally invasive pedicle screw insertion in the thoracic and lumbar spine with a new tracking device

BACKGROUND CONTEXT

Minimally invasive approaches are increasingly used in spine surgery. The purpose of navigation systems is to guide the surgeon and to reduce intraoperative x-ray exposure.

PURPOSE

This study aimed to determine the feasibility and clinical accuracy of a navigation technology based on augmented reality surgical navigation (ARSN) for minimally invasive thoracic and lumbar pedicle screw instrumentation compared with standard fluoroscopy-guided minimally invasive technique.

STUDY DESIGN/SETTING

Cadaveric laboratory study.

METHODS

ARSN was installed in a hybrid operating room, consisting of a flat panel detector c-arm with two dimensional/three dimensional imaging capabilities and four integrated cameras in its frame. The surface-referenced navigation device does not require a bony reference but uses video cameras and optical markers applied to the patient's skin for tracking. In four cadavers, a total of 136 pedicle screws were inserted in thoracic and lumbar vertebrae. The accuracy was assessed by three independent raters in postoperative conventional computed tomography.

RESULTS

The overall accuracy of ARSN was 94% compared with an accuracy of 88% for fluoroscopy. The difference was not statistically significant. In the thoracic region, accuracy with ARSN was 92% compared with 83% with fluoroscopy. With fluoroscopy, unsafe screws were observed in three normal cadavers and one with scoliosis. Using ARSN, unsafe screws were only observed in the scoliotic spine. No significant difference in the median of time for K-wire placement was recorded. As no intraoperative fluoroscopy was necessary in ARSN, the performing surgeon was not exposed to radiation.

CONCLUSIONS

In this limited cadaveric study minimally invasive screw placement using ARSN was demonstrated to be feasible and as accurate as fluoroscopy. It did not require any additional navigation time or use of any intraoperative x-ray imaging, thereby potentially permitting surgery in a protective lead garment-free environment. A well-powered clinical study is needed to demonstrate a significant difference in the accuracy between the two methods.

CLINICAL SIGNIFICANCE

ARSN offers real-time imaging of planned insertion paths, instrument tracking, and overlay of three dimensional bony anatomy and surface topography. The referencing procedure, by optical recognition of several skin markers is easy and does not require a solid bony reference as necessary for conventional navigation which saves time. Additionally, ARSN may foster the reduction of intraoperative x-ray exposure to spinal surgeons.

Evolving Navigation, Robotics, and Augmented Reality in Minimally Invasive Spine Surgery

Innovative technology and techniques have revolutionized minimally invasive spine surgery (MIS) within the past decade. The introduction of navigation and image-guided surgery has greatly affected spinal surgery and will continue to make surgery safer and more efficient. Eventually, it is conceivable that fluoroscopy will be completely replaced with image guidance. These advancements, among others such as robotics and virtual and augmented reality technology, will continue to drive the value of 3-dimensional navigation in MIS. In this review, we cover pertinent features of navigation in MIS and explore their evolution over time. Moreover, we aim to discuss the key features germane to surgical advancement, including technique and technology development, accuracy, overall health care costs, operating room time efficiency, and radiation exposure.

Robotic Spine Surgery and Augmented Reality Systems: A State of the Art

Instrumented spine procedures have been performed for decades to treat a wide variety of spinal disorders. New technologies have been employed to obtain a high degree of precision, to minimize risks of damage to neurovascular structures and to diminish harmful exposure of patients and the operative team to ionizing radiations. Robotic spine surgery comprehends 3 major categories: telesurgical robotic systems, robotic-assisted navigation (RAN) and virtual augmented reality (AR) systems, including AR and virtual reality. Telesurgical systems encompass devices that can be operated from a remote command station, allowing to perform surgery via instruments being manipulated by the robot. On the other hand, RAN technologies are characterized by the robotic guidance of surgeon-operated instruments based on real-time imaging. Virtual AR systems are able to show images directly on special visors and screens allowing the surgeon to visualize information about the patient and the procedure (i.e., anatomical landmarks, screw direction and inclination, distance from neurological and vascular structures etc.). The aim of this review is to focus on the current state of the art of robotics and AR in spine surgery and perspectives of these emerging technologies that hold promises for future applications.

Role of 3D intraoperative imaging in orthopedic and trauma surgery

Intraoperative three-dimensional (3D) imaging is now feasible because of recent technological advances such as 3D cone-beam CT (CBCT) and flat-panel X-ray detectors (FPDs). These technologies reduce the radiation dose to the patient and surgical team. The aim of this study is to review the advantages of 3D intraoperative imaging in orthopedic and trauma surgery by answering the following 5 questions: What are its technical principles? CBCT with a FPD produces non-distorted digital images and frees up the surgical field. The high quality of these 3D intraoperative images allows them to be integrated into surgical navigation systems. Human-robot comanipulation will likely follow soon after. Conventional multislice CT technology has also improved to the point where it can be used in the operating room. What can we expect from 3D intraoperative imaging and which applications have been validated clinically? We reviewed the literature on this topic for the past 10 years. The expected benefits were determined during the implantation of pedicular screws: more accurate implantation, fewer surgical revisions and time savings. There are few studies in trauma or arthroplasty cases, as robotic comanipulation is a more recent development. What is the tolerance for irradiation to the patient and surgical team? The health drawbacks are the harmful radiation-induced effects. The deterministic effects that we will develop are correlated to the absorbed dose in Gray units (Gy). The stochastic and carcinogenic effects are related to the effective dose in milliSievert (mSv) of linear evolution without threshold. The International Commission on Radiological Protection (ICRP) states that irradiation for medical purposes with risk of detriment is acceptable if it is justified by an optimization attempt. The radioprotection limits must be known but do not constitute opposable restrictions. The superiority of intraoperative 3D imaging over fluoroscopy has been demonstrated for spine surgery and sacroiliac screw fixation. How does the environment need to be adapted? The volume, access, wall protection and floor strength of the operating room must take into account the features of each machine. The instrumentation implants and need for specialized staff result in additional costs. Not every system can track movements during the CBCT acquisition thus transient suspension of assisted ventilation may be required. Is it financially viable? This needs to be calculated based on the expected clinical benefits, which mainly correspond to the elimination of expenses tied to surgical revisions. Our society's search for safety has driven the investments in this technology. LEVEL OF EVIDENCE: V, Expert opinion.

Fusion of augmented reality imaging with the endoscopic view for endonasal skull base surgery; a novel application for surgical navigation based on intraoperative cone beam computed tomography and optical tracking

Objective

Surgical navigation is a well-established tool in endoscopic skull base surgery. However, navigational and endoscopic views are usually displayed on separate monitors, forcing the surgeon to focus on one or the other. Aiming to provide real-time integration of endoscopic and diagnostic imaging information, we present a new navigation technique based on augmented reality with fusion of intraoperative cone beam computed tomography (CBCT) on the endoscopic view. The aim of this study was to evaluate the accuracy of the method.

Material and methods

An augmented reality surgical navigation system (ARSN) with 3D CBCT capability was used. The navigation system incorporates an optical tracking system (OTS) with four video cameras embedded in the flat detector of the motorized C-arm. Intra-operative CBCT images were fused with the view of the surgical field obtained by the endoscope’s camera. Accuracy of CBCT image co-registration was tested using a custom-made grid with incorporated 3D spheres.

Results

Co-registration of the CBCT image on the endoscopic view was performed. Accuracy of the overlay, measured as mean target registration error (TRE), was 0.55 mm with a standard deviation of 0.24 mm and with a median value of 0.51mm and interquartile range of 0.39˗˗0.68 mm.

Conclusion

We present a novel augmented reality surgical navigation system, with fusion of intraoperative CBCT on the endoscopic view. The system shows sub-millimeter accuracy.

Virtual reality in spinal endoscopy: a paradigm shift in education to support spine surgeons

BACKGROUND

Minimally invasive spine surgery (MISS) and endoscopic spine surgery have continually evolving indications in the cervical, thoracic, and lumbar spine. Endoscopic spine surgery entails treatment of disc disease, stenosis, spondylolisthesis, radiculopathy, and deformity. MISS involves complex motor skills in regions of variable anatomy. Simulator use has been proposed to aid in training and skill retention, preoperative planning, and intraoperative use.

METHODS

A systematic review of five databases was performed for publications pertaining to the use of virtual (VR), augmented (AR), and mixed (MR) reality in MISS and spinal endoscopic surgery. Qualitative data analysis was undertaken with focus of study design, quality, and reported outcomes. Study quality was assessed using the Medical Education Research Quality Instrument (MERSQI) score and level of evidence (LoE) by a modified Oxford Centre for Evidence-Based Medicine (OCEBM) level for simulation in medicine.

RESULTS

Thirty-eight studies were retained for data collection. Studies were of intervention-control, clinical application, and pilot or cross-sectional design. Identified articles illustrated use of VR, AR, and MR in all study designs. Procedures included pedicle cannulation and screw insertion, vertebroplasty, kyphoplasty, percutaneous transforaminal endoscopic discectomy (PTED), lumbar puncture and facet injection, transvertebral anterior cervical foraminotomy (TVACF) and posterior cervical laminoforaminotomy. Overall MERSQI score was low-to-medium [M =9.71 (SD =2.60); range, 4.5-13.5], and LoE was predominantly low given the number of purely descriptive articles, or low-quality randomized studies.

CONCLUSIONS

The current scope of VR, AR, and MR surgical simulators in MISS and spinal endoscopic surgery was described. Studies demonstrate improvement in technical skill and patient outcomes in short term follow-up. Despite this, overall study quality and levels of evidence remain low. Cohesive study design and reporting with focus on transfer validity in training scenarios, and patient derived outcome measures in clinical studies are required to further advance the field.

Augmented reality in intradural spinal tumor surgery

BACKGROUND

Microscope-based augmented reality (AR) is commonly used in cranial surgery; however, until recently, this technique was not implemented for spinal surgery. We prospectively investigated, how AR can be applied for intradural spinal tumor surgery.

METHODS

For ten patients with intradural spinal tumors (ependymoma, glioma, hemangioblastoma, meningioma, and metastasis), AR was provided by head-up displays (HUDs) of operating microscopes. User-independent automatic AR registration was established by low-dose intraoperative computed tomography. The objects visualized by AR were segmented in preoperative imaging data; non-linear image registration was applied to consider spine flexibility.

RESULTS

In all cases, AR supported surgery by visualizing the tumor outline and other relevant surrounding structures. The overall AR registration error was 0.72 ± 0.24 mm (mean ± standard deviation), a close matching of visible tumor outline and AR visualization was observed for all cases. Registration scanning resulted in a low effective dose of 0.22 ± 0.16 mSv for cervical and 1.68 ± 0.61 mSv for thoracic lesions. The mean HUD AR usage in relation to microscope time was 51.6 ± 36.7%. The HUD was switched off and turned on again in a range of 2 to 17 times (5.7 ± 4.4 times). Independent of the status of the HUD, the AR visualization was displayed on monitors throughout surgery.

CONCLUSIONS

Microscope-based AR can be reliably applied to intradural spinal tumor surgery. Automatic AR registration ensures high precision and provides an intuitive visualization of the extent of the tumor and surrounding structures. Given this setting, all advanced multi-modality options of cranial AR can also be applied to spinal surgery.