Immersive Three-dimensional Computed Tomography to Plan Chest Wall Resection for Lung Cancer

Enhancing three-dimensional anatomical understanding in complex thoracic surgery: a comparative study of OpVerse and Synapse 3D

OBJECTIVES

Virtual reality (VR) technology is increasingly employed in medical settings to provide innovative solutions for complex surgeries. In this study, we introduced and compared OpVerse, a multifunctional new VR platform developed for surgical simulations, with established software Synapse 3D to assess its efficacy in facilitating complex thoracic surgeries.

METHODS

Patient-specific VR digital twin thoracic models were created based on computed tomography scans of 9 patients with large thoracic neoplasms and 4 requiring tracheobronchial reconstruction. Twelve doctors as system testers were enlisted to evaluate the usability and user acceptance of OpVerse and Synapse 3D using the System Usability Scale (SUS) and the Technology Acceptance Model; they provided qualitative feedback through interviews.

RESULTS

OpVerse achieved higher scores than Synapse 3D in SUS (73.3 ± 14.6 vs 53.8 ± 11.6, P = 0.0006), as well as perceived usefulness (4.5 ± 0.4 vs 4.1 ± 0.5, P = 0.0134), perceived ease of use (4.2 ± 0.4 vs 3.8 ± 0.6, P = 0.0364) and attitude towards using and behavioural intention to use (4.6 ± 0.4 vs 3.6 ± 0.7, P = 0.0002) in Technology Acceptance Model, compared to Synapse 3D, indicating enhanced efficiency and user engagement with the new system. Participants favoured OpVerse for its immersive qualities, intuitive interface (particularly rotation and enhanced visual transparency effects) and ability to enhance comprehension of complex 3D anatomical structures.

CONCLUSIONS

OpVerse, our streaming VR simulation platform, enables the manipulation and visualization of patient-specific digital twin thoracic models through features such as rotation, enhanced visual transparency effects and measurement. Preliminary results suggest that OpVerse may offer advantages in terms of immersion, ease of use and understanding of 3D anatomical structures compared to Synapse 3D.

A System for Mixed-Reality Holographic Overlays of Real-Time Rendered 3D-Reconstructed Imaging Using a Video Pass-through Head-Mounted Display-A Pathway to Future Navigation in Chest Wall Surgery

Background: Three-dimensional reconstructions of state-of-the-art high-resolution imaging are progressively being used more for preprocedural assessment in thoracic surgery. It is a promising tool that aims to improve patient-specific treatment planning, for example, for minimally invasive or robotic-assisted lung resections. Increasingly available mixed-reality hardware based on video pass-through technology enables the projection of image data as a hologram onto the patient. We describe the novel method of real-time 3D surgical planning in a mixed-reality setting by presenting three representative cases utilizing volume rendering. Materials: A mixed-reality system was set up using a high-performance workstation running a video pass-through-based head-mounted display. Image data from computer tomography were imported and volume-rendered in real-time to be customized through live editing. The image-based hologram was projected onto the patient, highlighting the regions of interest. Results: Three oncological cases were selected to explore the potentials of the mixed-reality system. Two of them presented large tumor masses in the thoracic cavity, while a third case presented an unclear lesion of the chest wall. We aligned real-time rendered 3D holographic image data onto the patient allowing us to investigate the relationship between anatomical structures and their respective body position. Conclusions: The exploration of holographic overlay has proven to be promising in improving preprocedural surgical planning, particularly for complex oncological tasks in the thoracic surgical field. Further studies on outcome-related surgical planning and navigation should therefore be conducted. Ongoing technological progress of extended reality hardware and intelligent software features will most likely enhance applicability and the range of use in surgical fields within the near future.

Collaborative Virtual Reality Real-Time 3D Image Editing for Chest Wall Resections and Reconstruction Planning

The integration of extended reality (XR) technologies into health care procedures presents transformative opportunities, particularly in surgical processes. This study delves into the utilization of virtual reality (VR) for preoperative planning related to chest wall resections in thoracic surgery. Leveraging the capabilities of 3-dimensional (3D) imaging, real-time visualization, and collaborative VR environments, surgeons gain enhanced anatomical insights and can develop predictive surgical strategies. Two clinical cases highlighted the effectiveness of this approach, showcasing the potential for personalized and intricate surgical planning. The setup provides an immersive, dynamic representation of real patient data, enabling collaboration among teams from separate locations. While VR offers enhanced interactive and visualization capabilities, preliminary evidence suggests it may support more refined preoperative strategies, potentially influence postoperative outcomes, and optimize resource management. However, its comparative advantage over traditional methods needs further empirical validation. Emphasizing the potential of XR, this exploration suggests its broad implications in thoracic surgery, especially when dealing with complex cases requiring multidisciplinary collaboration in the immersive virtual space, often referred to as the metaverse. This innovative approach necessitates further examination, marking a shift toward future surgical preparations. In this article, we sought to demonstrate the technique of an immersive real-time volume-rendered collaborative VR-planning tool using exemplary case studies in chest wall surgery.