Visualization, registration and tracking techniques for augmented reality guided surgery: a review

Intraoperative Angle Measurement of Anatomical Structures: A Systematic Review

Ensuring precise angle measurement during surgical correction of orientation-related deformities is crucial for optimal postoperative outcomes, yet there is a lack of an ideal commercial solution. Current measurement sensors and instrumentation have limitations that make their use context-specific, demanding a methodical evaluation of the field. A systematic review was carried out in March 2023. Studies reporting technologies and validation methods for intraoperative angular measurement of anatomical structures were analyzed. A total of 32 studies were included, 17 focused on image-based technologies (6 fluoroscopy, 4 camera-based tracking, and 7 CT-based), while 15 explored non-image-based technologies (6 manual instruments and 9 inertial sensor-based instruments). Image-based technologies offer better accuracy and 3D capabilities but pose challenges like additional equipment, increased radiation exposure, time, and cost. Non-image-based technologies are cost-effective but may be influenced by the surgeon's perception and require careful calibration. Nevertheless, the choice of the proper technology should take into consideration the influence of the expected error in the surgery, surgery type, and radiation dose limit. This comprehensive review serves as a valuable guide for surgeons seeking precise angle measurements intraoperatively. It not only explores the performance and application of existing technologies but also aids in the future development of innovative solutions.

Augmented Reality Navigation System for Biliary Interventional Procedures With Dynamic Respiratory Motion Correction

OBJECTIVE

Biliary interventional procedures require physicians to track the interventional instrument tip (Tip) precisely with X-ray image. However, Tip positioning relies heavily on the physicians' experience due to the limitations of X-ray imaging and the respiratory interference, which leads to biliary damage, prolonged operation time, and increased X-ray radiation.

METHODS

We construct an augmented reality (AR) navigation system for biliary interventional procedures. It includes system calibration, respiratory motion correction and fusion navigation. Firstly, the magnetic and 3D computed tomography (CT) coordinates are aligned through system calibration. Secondly, a respiratory motion correction method based on manifold regularization is proposed to correct the misalignment of the two coordinates caused by respiratory motion. Thirdly, the virtual biliary, liver and Tip from CT are overlapped to the corresponding position of the patient for dynamic virtual-real fusion.

RESULTS

Our system is respectively evaluated and achieved an average alignment error of 0.75 ± 0.17 mm and 2.79 ± 0.46 mm on phantoms and patients. The navigation experiments conducted on phantoms achieve an average Tip positioning error of 0.98 ± 0.15 mm and an average fusion error of 1.67 ± 0.34 mm after correction.

CONCLUSION

Our system can automatically register the Tip to the corresponding location in CT, and dynamically overlap the 3D virtual model onto patients to provide accurate and intuitive AR navigation.

SIGNIFICANCE

This study demonstrates the clinical potential of our system by assisting physicians during biliary interventional procedures. Our system enables dynamic visualization of virtual model on patients, reducing the reliance on contrast agents and X-ray usage.