Frequency and Causes of Line of Sight Issues During Neurosurgical Procedures Using Optical Image-Guided Systems

Domain adaptation strategies for 3D reconstruction of the lumbar spine using real fluoroscopy data

In this study, we address critical barriers hindering the widespread adoption of surgical navigation in orthopedic surgeries due to limitations such as time constraints, cost implications, radiation concerns, and integration within the surgical workflow. Recently, our work X23D showed an approach for generating 3D anatomical models of the spine from only a few intraoperative fluoroscopic images. This approach negates the need for conventional registration-based surgical navigation by creating a direct intraoperative 3D reconstruction of the anatomy. Despite these strides, the practical application of X23D has been limited by a significant domain gap between synthetic training data and real intraoperative images. In response, we devised a novel data collection protocol to assemble a paired dataset consisting of synthetic and real fluoroscopic images captured from identical perspectives. Leveraging this unique dataset, we refined our deep learning model through transfer learning, effectively bridging the domain gap between synthetic and real X-ray data. We introduce an innovative approach combining style transfer with the curated paired dataset. This method transforms real X-ray images into the synthetic domain, enabling the in-silico-trained X23D model to achieve high accuracy in real-world settings. Our results demonstrated that the refined model can rapidly generate accurate 3D reconstructions of the entire lumbar spine from as few as three intraoperative fluoroscopic shots. The enhanced model reached a sufficient accuracy, achieving an 84% F1 score, equating to the benchmark set solely by synthetic data in previous research. Moreover, with an impressive computational time of just 81.1 ms, our approach offers real-time capabilities, vital for successful integration into active surgical procedures. By investigating optimal imaging setups and view angle dependencies, we have further validated the practicality and reliability of our system in a clinical environment. Our research represents a promising advancement in intraoperative 3D reconstruction. This innovation has the potential to enhance intraoperative surgical planning, navigation, and surgical robotics.

NextLens-The Next Generation of Surgical Navigation: Proof of Concept of an Augmented Reality System for Surgical Navigation

Objective  The aim of this work was the development of an augmented reality system including the functionality of conventional surgical navigation systems. Methods  An application software for the Augmented Reality System HoloLens 2 from Microsoft was developed. It detects the position of the patient as well as position of surgical instruments in real time and displays it within the two-dimensional (2D) magnetic resonance imaging or computed tomography (CT) images. The surgical pointer instrument, including a pattern that is recognized by the HoloLens 2 sensors, was created with three-dimensional (3D) printing. The technical concept was demonstrated at a cadaver skull to identify anatomical landmarks. Results  With the help of the HoloLens 2 and its sensors, the real-time position of the surgical pointer instrument could be shown. The position of the 3D-printed pointer with colored pattern could be recognized within 2D-CT images when stationary and in motion at a cadaver skull. Feasibility could be demonstrated for the clinical application of transsphenoidal pituitary surgery. Conclusion  The HoloLens 2 has a high potential for use as a surgical navigation system. With subsequent studies, a further accuracy evaluation will be performed receiving valid data for comparison with conventional surgical navigation systems. In addition to transsphenoidal pituitary surgery, it could be also applied for other surgical disciplines.

Augmented Reality in Spine Surgery: A Case Study of Atlantoaxial Instrumentation in Os Odontoideum

Despite advancement in surgical innovation, C1-C2 fixation remains challenging due to risks of screw malposition and vertebral artery (VA) injuries. Traditional image-based navigation, while useful, often demands that surgeons frequently shift their attention to external monitors, potentially causing distractions. In this article, we introduce a microscope-based augmented reality (AR) navigation system that projects both anatomical information and real-time navigation images directly onto the surgical field. In the present case report, we discuss a 37-year-old female who suffered from os odontoideum with C1-C2 subluxation. Employing AR-assisted navigation, the patient underwent the successful posterior instrumentation of C1-C2. The integrated AR system offers direct visualization, potentially minimizing surgical distractions. In our opinion, as AR technology advances, its adoption in surgical practices and education is anticipated to expand.

Clinical Application of an Augmented Reality Navigation System for Transforaminal Epidural Injection: A Randomized Controlled Trial

Objectives: Augmented reality (AR) navigation systems are emerging to simplify and enhance the precision of medical procedures. Lumbosacral transforaminal epidural injection is a commonly performed procedure for the treatment and diagnosis of radiculopathy. Accurate needle placement while avoiding critical structures remains a challenge. For this purpose, we conducted a randomized controlled trial for our augmented reality navigation system. Methods: This randomized controlled study involved 28 patients, split between a traditional C-arm guided group (control) and an AR navigation guided group (AR-NAVI), to compare procedure efficiency and radiation exposure. The AR-NAVI group used a real-time tracking system displaying spinal structure and needle position on an AR head-mounted display. The procedural time and C-arm usage (radiation exposure) were measured. Results: All patients underwent successful procedures without complications. The AR-NAVI group demonstrated significantly reduced times and C-arm usage for needle entry to the target point (58.57 ± 33.31 vs. 124.91 ± 41.14, p < 0.001 and 3.79 ± 1.97 vs. 8.86 ± 3.94, p < 0.001). Conclusions: The use of the AR navigation system significantly improved procedure efficiency and safety by reducing time and radiation exposure, suggesting a promising direction for future enhancements and validation.

Beyond Placement of Pedicle Screws - New Applications for Robotics in Spine Surgery: A Multi-Surgeon, Single-Institution Experience

Interest in robotic-assisted spine surgery has grown as surgeon comfort and technology has evolved to maximize benefits of time saving and precision. However, the Food and Drug Administration (FDA) has currently only approved robotics to assist in determining the ideal trajectory for pedicle screw placement after extensive research supporting its efficacy and efficiency. To be considered a durable and effective option, robotics need to expand beyond the indication of just placing pedicle screws. This article aims to illustrate a multi-surgeon, single-institution experience with unique applications of robotic technologies in spine surgery. We will explore accessing Kambin's Triangle in percutaneous transforaminal interbody fusion (percLIF), iliac fixation in metastatic cancer, and sacroiliac (SI) fusions. Each of these topics will be covered in depth with associated background information and subsequent discussion. We show that with proper understanding of its limitations, robots can help surgeons perform difficult surgeries in a safe manner.

First in man in-situ augmented reality pedicle screw navigation

Background

Augmented reality (AR) is a rising technology gaining increasing utility in medicine. By superimposing the surgical site and the operator's visual field with computer-generated information, it has the potential to enhance the cognitive skills of surgeons. This is the report of the first in man case with "direct holographic navigation" as part of a randomized controlled trial.

Case description

A pointing instrument was equipped with a sterile fiducial marker, which was used to obtain a digital representation of the intraoperative bony anatomy of the lumbar spine. Subsequently, a previously validated registration method was applied to superimpose the surgery plan with the intraoperative anatomy. The registration result is shown in situ as a 3D AR hologram of the preoperative 3D vertebra model with the planned screw trajectory and entry point for validation and approval by the surgeon. After achieving alignment with the surgery plan, a borehole is drilled and the pedicle screw placed. Postoperativ computer tomography was used to measure accuracy of this novel method for surgical navigation.

Outcome

Correct screw positions entirely within bone were documented with a postoperative CT, with an accuracy similar to current standard of care methods for surgical navigation. The patient was mobilized uneventfully on the first postoperative day with little pain medication and dismissed on the fourth postoperative day.

Conclusion

This first in man report of direct AR navigation demonstrates feasibility in vivo. The continuation of this randomized controlled study will evaluate the value of this novel technology.

The endonasal patient reference tracker: a novel solution for accurate noninvasive electromagnetic neuronavigation

OBJECTIVE

Electromagnetic (EM) navigation provides the advantages of continuous guidance and tip-tracking of instruments. The current solutions for patient reference trackers are suboptimal, as they are either invasively screwed to the bone or less accurate if attached to the skin. The authors present a novel EM reference method with the tracker rigidly but not invasively positioned inside the nasal cavity.

METHODS

The nasal tracker (NT) consists of the EM coil array of the AxiEM tracker plugged into a nasal tamponade, which is then inserted into the inferior nasal meatus. Initially, a proof-of-concept study was performed on two cadaveric skull bases. The stability of the NT was assessed in simulated surgical situations, for example, prone, supine, and lateral patient positioning and skin traction. A deviation ≤ 2 mm was judged sufficiently accurate for clinical trial. Thus, a feasibility study was performed in the clinical setting. Positional changes of the NT and a standard skin-adhesive tracker (ST) relative to a ground-truth reference tracker were recorded throughout routine surgical procedures. The accuracy of the NT and ST was compared at different stages of surgery.

RESULTS

Ex vivo, the NT proved to be highly stable in all simulated surgical situations (median deviation 0.4 mm, range 0.0-2.0 mm). In 13 routine clinical cases, the NT was significantly more stable than the ST (median deviation at procedure end 1.3 mm, range 0.5-3.0 mm vs 4.0 mm, range 1.2-11.2 mm, p = 0.002). The loss of accuracy of the ST was highest during draping and flap fixation.

CONCLUSIONS

Application of the EM endonasal patient tracker was found to be feasible with high procedural stability ex vivo as well as in the clinical setting. This innovation combines the advantages of high precision and noninvasiveness and may, in the future, enhance EM navigation for neurosurgery.

A new multimodal, image-guided, robot-assisted, interstitial brachytherapy for the treatment of head and neck tumors-A preliminary study

BACKGROUND

Interstitial brachytherapy (BT) is becoming an accepted treatment option for head and neck cancer patients for whom surgery poses high risks. Multimodal, image-guided, robotic surgery has the potential to allow precise seed implantation into tumors. Our aim was to introduce a new multimodal, image-guided surgical robot during the performance of interstitial BT for the treatment of tumors in the head and neck regions.

METHODS

Clinical data for three patients were analyzed, retrospectively; patients had received ¹²⁵ I seed implantations from July 2019 to October 2019. Multimodal, image-guided, robotic surgery was performed in all patients. Postoperative computed tomography data were imported to software to evaluate the accuracy of the seed position and the operation times.

RESULTS

The mean placement error of the ¹²⁵ I seed was 1.9 ± 0.74 mm. The mean operation time is 47 minutes.

CONCLUSION

The experimental results showed that the Remebot has promise for use during BT for the head and neck.