Current and Future Applications of Virtual, Augmented, and Mixed Reality in Cardiothoracic Surgery

Enhancing three-dimensional anatomical understanding in complex thoracic surgery: a comparative study of OpVerse and Synapse 3D

OBJECTIVES

Virtual reality (VR) technology is increasingly employed in medical settings to provide innovative solutions for complex surgeries. In this study, we introduced and compared OpVerse, a multifunctional new VR platform developed for surgical simulations, with established software Synapse 3D to assess its efficacy in facilitating complex thoracic surgeries.

METHODS

Patient-specific VR digital twin thoracic models were created based on computed tomography scans of 9 patients with large thoracic neoplasms and 4 requiring tracheobronchial reconstruction. Twelve doctors as system testers were enlisted to evaluate the usability and user acceptance of OpVerse and Synapse 3D using the System Usability Scale (SUS) and the Technology Acceptance Model; they provided qualitative feedback through interviews.

RESULTS

OpVerse achieved higher scores than Synapse 3D in SUS (73.3 ± 14.6 vs 53.8 ± 11.6, P = 0.0006), as well as perceived usefulness (4.5 ± 0.4 vs 4.1 ± 0.5, P = 0.0134), perceived ease of use (4.2 ± 0.4 vs 3.8 ± 0.6, P = 0.0364) and attitude towards using and behavioural intention to use (4.6 ± 0.4 vs 3.6 ± 0.7, P = 0.0002) in Technology Acceptance Model, compared to Synapse 3D, indicating enhanced efficiency and user engagement with the new system. Participants favoured OpVerse for its immersive qualities, intuitive interface (particularly rotation and enhanced visual transparency effects) and ability to enhance comprehension of complex 3D anatomical structures.

CONCLUSIONS

OpVerse, our streaming VR simulation platform, enables the manipulation and visualization of patient-specific digital twin thoracic models through features such as rotation, enhanced visual transparency effects and measurement. Preliminary results suggest that OpVerse may offer advantages in terms of immersion, ease of use and understanding of 3D anatomical structures compared to Synapse 3D.

3D Visualization Technology for Cardiac Transplant Planning in a Patient With Failing Fontan Circulation

Patients with complex single ventricle anatomy and failing Fontan physiology present unique anatomic challenges to heart transplantation. Cardiac computed tomography scans can be analyzed in a virtual reality environment to aid in understanding of the complex anatomy, perform virtual heart transplant, and help create virtual reality-assisted baffles. This paper presents a case that demonstrates the evolving role of advanced imaging and 3-dimensional virtual modeling in planning complex surgeries.

Effectiveness of Mobile-Based Learning for Nasogastric Tube Intubation Among Medical Students: A Randomized Controlled Trial

Background: Nasogastric tube (NGT) intubation is a critical skill, but it comes with the blind nature of the procedure and its high failure rates. Resources restrict access to traditional training methods, such as simulations based on manikins. We developed a mobile-based application, the Mobile-based Hands-on Learning System for Nasogastric Tube Intubation (MoHoNGT), to enhance undergraduate medical students' training in this essential procedure. Methods: This open-label, randomized controlled trial was conducted in a medical center between August and October 2020, with medical students expected to enter their clerkships. The MoHoNGT and control group were exposed to the traditional training course and a self-learning period. The MoHoNGT group received additional access to MoHoNGT. Training effectiveness was evaluated by measuring knowledge, self-confidence, and performance on an objective structured clinical examination (OSCE). Statistical analyses included descriptive statistics, chi-square tests, and t-tests. Results: Seventy-three medical students were recruited. Thirty-two were allocated to the MoHoNGT group. No between-group differences were observed regarding demographic data. Post-intervention results indicated that the MoHoNGT group revealed more pronounced improvements in both NGT intubation knowledge (38.75 vs. 21.46, p < 0.001) and the confidence scale (8.50 vs. 5.17, p = 0.04). Post-study scores for NGT intubation knowledge were also higher in the MoHoNGT group (69.06 vs. 49.02, p < 0.001). Additionally, participants in the MoHoNGT group demonstrated superior performance on the OSCE (98.81 vs. 91.18, p = 0.003). Conclusions: Employing MoHoNGT with traditional training methods significantly enhanced the knowledge, self-confidence, and skills in NGT intubation among undergraduate medical students. This approach addresses various limitations of conventional techniques, suggesting that mobile-based learning could be a potential strategy for medical education.

Developing a Systematic Approach for the Implementation of Medical Extended Reality Learning Modules in Cardiothoracic Health Care: Recommendations From an International Expert Group

Extended reality (XR) modalities in health care are quickly evolving. There is a lack of systematically described developmental process and the "how to" execute a business-case guidance. This article formulates a systematic approach on the technical developmental steps and generation of business-case to guide the iterative development of an XR tool. An international expert group was established and several available frameworks related to entrepreneurship and business-case development were used to generate recommendations. Our ongoing experience with the development life cycle of an XR tool for cardiopulmonary resuscitation training is provided as a real-life case illustration. Market demand, value proposition, stakeholder analyses, and profitability scenarios are captured with a business model canvas. Developmental process is divided into 4 aspects: Desirability, Feasibility, Viability, and Scalability. Technical- and Investment Readiness Level models are used in defining the technical feasibility and the business viability and scalability, respectively. Best practice recommendations including examples are provided. Health care professionals, health care financers, and health care policymakers are urged to consider the provided systematic approach and recommendations prior to starting a venture with XR.

A Case of Application of Computer-Aided Design and Manufacturing Technology and Extended Reality Surgical Assistance to Marginal Mandibulectomy

Background/Objectives: Mandibular gingival squamous cell carcinoma (SCC) is the second most common oral cancer after tongue cancer. As these carcinomas often invade the mandible early, accurately defining the resection extent is important. This report highlights the use of preoperative virtual surgery data, computer-aided design and manufacturing (CAD/CAM) technology, surgical guidance, and extended reality (XR) support in achieving highly accurate marginal mandibulectomy without recurrence or metastasis. Methods: CT imaging data obtained a month before surgery were imported into Materialize Mimics and Materialize Magics (Materialize, Leuven, Belgium, Ver22.0) CAD/CAM software and used to design an osteotomy guide. An STL file was generated, and the guide was fabricated using a 3D printer (Objet 260 Connex; Stratasys Ltd., Eden Prairie, MN, USA) prior to the operation. An XR application, installed on a HoloLens (Microsoft, WA, USA) head-mounted display, projected a hologram onto the surgical field. Results: The rapid intraoperative diagnostic tests were negative, and histopathology confirmed SCC without vascular or perineural invasion. No complications, including occlusal or feeding problems and sensory abnormalities, were observed. Postoperative imaging 3 years later showed no recurrence. Conclusions: Combining CAD/CAM and XR techniques for mandibulectomy may improve surgical accuracy and safety in oral and maxillofacial surgeries, whereas in-house 3D printing aids in managing tumor progression.

Unifocalization of Major Aortopulmonary Collateral Arteries (MAPCAs) and Native Pulmonary Arteries in Infancy-Application of 3D Printing and Virtual Reality

BACKGROUND

Major aortopulmonary collateral arteries (MAPCAs) are rare remnants of pulmonary circulation embryological development usually associated with complex congenital anomalies of the right ventricular outflow tract and pulmonary arteries. Effective management requires surgical unifocalization of MAPCAs and native pulmonary arteries (NPAs). Traditional imaging may lack the spatial clarity needed for precise surgical planning.

AIM

This study evaluated the feasibility of integrating three-dimensional (3D) printing and virtual reality (VR) into preoperative planning to improve surgical precision, team communication, and parental understanding. In a prospective cohort study, nine infants undergoing MAPCA unifocalization were included. Four patients underwent conventional imaging-based planning (control), while five were additionally assessed using VR and 3D-printed models (intervention). The outcomes measured included operative times, team confidence, collaboration, and parental satisfaction. Statistical analysis was performed using standard tests.

RESULTS

The intervention group had shorter operative and cardiopulmonary bypass times compared to the control group. Intraoperative complications were absent in the VR/3D group but occurred in the control group. Medical staff in the VR/3D group reported significantly improved understanding of anatomy, surgical preparedness, and team collaboration (p < 0.05). Parents also expressed higher satisfaction, with better comprehension of their child's anatomy and surgical plan.

CONCLUSIONS

VR and 3D printing enhanced preoperative planning, surgical precision, and communication, proving valuable for complex congenital heart surgery. These technologies offer promising potential to improve clinical outcomes and patient-family experiences, meriting further investigation in larger studies.

Augmented Reality Implementation in Minimally Invasive Surgery for Future Application in Pulmonary Surgery: A Systematic Review

OBJECTIVE

This systematic review investigates of Augmented Reality (AR) systems used in minimally invasive surgery of deformable organs, focusing on initial registration, dynamic tracking, and visualization. The objective is to acquire a comprehensive understanding of the current knowledge, applications, and challenges associated with current AR-techniques, aiming to leverage these insights for developing a dedicated AR pulmonary Video or Robotic Assisted Thoracic Surgery (VATS/RATS) workflow.

METHODS

A systematic search was conducted within Embase, Medline (Ovid) and Web of Science on April 16, 2024, following the Preferred Reporting items for Systematic Reviews and Meta-Analyses (PRISMA). The search focused on intraoperative AR applications and intraoperative navigational purposes for deformable organs. Quality assessment was performed and studies were categorized according to initial registration and dynamic tracking methods.

RESULTS

33 articles were included, of which one involved pulmonary surgery. Studies used both manual and (semi-) automatic registration methods, established through anatomical landmark-based, fiducial-based, or surface-based techniques. Diverse outcome measures were considered, including surgical outcomes and registration accuracy. The majority of studies that reached an registration accuracy below 5 mm applied surface-based registration.

CONCLUSIONS

AR can potentially aid surgeons with real-time navigation and decision making during anatomically complex minimally invasive procedures. Future research for pulmonary applications should focus on exploring surface-based registration methods, considering their non-invasive, marker-less nature, and promising accuracy. Additionally, vascular-labeling-based methods are worth exploring, given the importance and relative stability of broncho-vascular anatomy in pulmonary VATS/RATS. Assessing clinical feasibility of these approaches is crucial, particularly concerning registration accuracy and potential impact on surgical outcomes.

Mixed reality-assisted versus landmark-guided spinal puncture in elderly patients: protocol for a stratified randomized controlled trial

BACKGROUND

Performing spinal anesthesia in elderly patients with spine degeneration is challenging for novice practitioners. This stratified randomized controlled trial aims to compare the effectiveness of mixed reality-assisted spinal puncture (MRasp) with that of landmark-guided spinal puncture (LGsp) performed by novice practitioners in elderly patients.

METHODS

This prospective, single-center, stratified, blocked, parallel randomized controlled trial will include 168 patients (aged ≥ 65 years) scheduled for elective surgery involving spinal anesthesia. All spinal punctures will be performed by anesthesiology interns and residents trained at Huadong Hospital. Patients will be randomly assigned to the MRasp group (n = 84) or the LGsp group (n = 84). Based on each intern/resident's experience in spinal puncture, participants will be stratified into three clusters: the primary group, intermediate group, and advanced group. The primary outcome will be the comparison of the rate of successful first-attempt needle insertion between the MRasp group and the LGsp group. Secondary outcomes will include the number of needle insertion attempts, the number of redirection attempts, the number of passes, the rate of successful first needle pass, the spinal puncture time, the total procedure time, and the incidence of perioperative complications. A stratified subgroup analysis will also be conducted for interns/residents at different experience levels.

DISCUSSION

The findings from this trial establish the effectiveness of MRasp by novice practitioners in elderly patients. This trial may provide experimental evidence for exploring an effective visualization technology to assist in spinal puncture.

TRIAL REGISTRATION

Chinese Clinical Trials Registry ChiCTR2300075291. Registered on August 31, 2023. https://www.chictr.org.cn/bin/project/edit?pid=189622 .

Augmented and Virtual Reality Applications in Rhinology: A Scoping Review

OBJECTIVES

Virtual reality (VR) and augmented reality (AR) are innovative technologies that have a wide range of potential applications in the health care industry. The aim of this study was to investigate the body of research on AR and VR applications in rhinology by performing a scoping review.

DATA SOURCES

PubMed, Scopus, and Embase.

REVIEW METHODS

According to PRISM-ScR guidelines, a scoping review of literature on the application of AR and/or VR in the context of Rhinology was conducted using PubMed, Scopus, and Embase.

RESULTS

Forty-nine articles from 1996 to 2023 met the criteria for review. Five broad types of AR and/or VR applications were found: preoperative, intraoperative, training/education, feasibility, and technical. The subsequent clinical domains were recognized: craniovertebral surgery, nasal endoscopy, transsphenoidal surgery, skull base surgery, endoscopic sinus surgery, and sinonasal malignancies.

CONCLUSION

AR and VR have comprehensive applications in Rhinology. AR for surgical navigation may have the most emerging potential in skull base surgery and endoscopic sinus surgery. VR can be utilized as an engaging training tool for surgeons and residents and as a distraction analgesia for patients undergoing office-based procedures. Additional research is essential to further understand the tangible effects of these technologies on measurable clinical results. Laryngoscope, 134:4433-4440, 2024.

Applications and advances of immersive technology in cardiology

Different forms of immersive technology, such as Virtual Reality (VR) and Augmented Reality (AR), are getting increasingly invested in medicine. Advances in head-mounted display technology, processing, and rendering power have demonstrated the increasing utility of immersive technology in medicine and the healthcare environment. There are a growing number of publications on using immersive technology in cardiology. We reviewed the articles published within the last decade that reported case studies or research that uses or investigates the application of immersive technology in the broad field of cardiology - from education to preoperative planning and intraoperative guidance. We summarized the advantages and disadvantages of using AR and VR for various application categories. Our review highlights the need for a robust assessment of the effectiveness of the methods and discusses the technical limitations that hinder the complete integration of AR and VR in cardiology, including cost-effectiveness and regulatory compliance. Despite the limitations and gaps that have inhibited us from benefiting from immersive technologies' full potential in cardiology settings to date, its promising, impactful future for standard cardiovascular care is undoubted.

Simulation-based training in robotic surgery education: bibliometric analysis and visualization

Simulation-based robotic surgery training may help surgeons gain operative skills and experience in the simulation environment. This bibliometric analysis examined the development of simulation-based training for robotic surgical education. Articles pertaining to robotic surgical simulation training that were included in the Web of Science Core Collection up to April 25, 2024, were included. The temporal patterns in published paper numbers were evaluated using Microsoft Excel software, and the data regarding co-authorship and keyword co-occurrence were analyzed and visualized using the VOSviewer and SCImago Graphica tools. A total of 594 papers on simulation-based training for robotic surgical education were evaluated in this study. The United States and United Kingdom were the leading contributors in this field. The most published authors were Professor Ahmed Kamran (23 publications) and Prokar Dasgupta (22 publications). The highest number of papers was published in the journal titled "Surgical Endoscopy and Other Interventional Techniques." The most common keywords were "virtual reality," "curriculum," "robotic surgery simulator," "assessment," and "learning curve." Our study offers a detailed overview of international research on simulation-based training for robotic surgical education, including the publishing countries, institutions, authors, journals, and research hotspots. It also methodically summarizes the state of knowledge in the area, and provides definite directions and concepts for further in-depth analysis.

The evolution of simulation-based medical education research: From traditional to virtual simulations

Background

Simulation-based medical education (SBME) is a widely used method in medical education. This study aims to analyze publications on SBME in terms of countries, institutions, journals, authors, and keyword co-occurrence, as well as to identify trends in SBME research.

Methods

We retrieved the Publications on SBME from the Web of Science Core Collection (WoSCC) database from its inception to January 27, 2024. Microsoft Excel 2019, CiteSpace, and VOSviewer were used to identify the distribution of countries, journals, and authors, as well as to determine the research hotspots.

Results

We retrieved a total of 11272 publications from WoSCC. The number of documents published in 2022 was the highest in the last few decades. The USA, the UK, and Canada were three key contributors to this field. The University of Toronto, Stanford University, and Harvard Medical School were the top major institutions with a larger number of publications. Konge, Lars was the most productive author, while McGaghie, William C was the highest cited author. BMC Medical Education has the highest number of publications among journals. The foundational themes of SBME are "Patient simulation," "extending reality," and "surgical skills."

Conclusions

SBME has attracted considerable attention in medical education. The research hotspot is gradually shifting from traditional simulations with real people or mannequins to virtual, digitally-based simulations and online education. Further studies will be conducted to elucidate the mechanisms of SBME. The utilization of SBME will be more rationalized.

CT-guided percutaneous marking of small pulmonary nodules with [99mTc]Tc-Macrosalb is very accurate and allows minimally invasive lung-sparing resection: a single-centre quality control

PURPOSE

The detection of small lung nodules in thoracoscopic procedure is difficult when the lesions are not located within the outer border of the lung. In the case of ground-glass opacities, it is often impossible to palpate the lesion. Marking lung nodules using a radiotracer is a known technique. We analysed the accuracy and safety of the technique and the potential benefits of operating in a hybrid operating room.

METHODS

57 patients, including 33 (58%) females with a median age of 67 years (range 21-82) were included. In 27 patients, we marked and resected the lesion in a hybrid room. In 30 patients, the lesion was marked at the department of radiology the day before resection. [99mTc]Tc-Macrosalb (Pulmocis®) was used at an activity of 1 MBq in the hybrid room and at an activity of 3 MBq the day before to get technical feasible results. Radioactivity was detected using the Neoprobe® detection system.

RESULTS

Precise detection and resection of the nodules was possible in 95% of the lesions and in 93% of the patients. Complete thoracoscopic resection was possible in 90% of the patients. Total conversion rate was 10%, but conversion due to failure of the marking of the nodule was observed in only 5% of the patients. Histology revealed 28 (37%) primary lung cancers, 24 (32%) metastases and 21 (28%) benign lesions. In 13 (23%) patients, minor complications were observed. None of them required additional interventions.

CONCLUSION

The radio-guided detection of small pulmonary nodules is very accurate and safe after CT-guided injection of [99mTc]Tc-Macrosalb. Performing the operation in a hybrid room has several logistic advantages and allows using lower technetium-99m activities. The technique allows minimally invasive lung sparing resection and prevents overtreatment of benign and metastatic lesions.

First use of a new extended reality tool for preoperative planning in coronary artery bypass surgery: a case-report

A 73-year-old male presented with angina symptoms and was diagnosed with three-vessel coronary artery disease by use of computed tomography angiography and coronary angiography. This diagnosis necessitated coronary artery bypass grafting (CABG) surgery. A custom made AI-driven algorithm was used to generate a patient-specific three-dimensional coronary artery model from computed tomography angiography imaging data. This framework enabled precise segmentation and reconstruction of the coronary vasculature, yielding an accurate anatomical and pathological representation. Subsequently, this generated model was integrated into a novel extended reality tool for preoperative planning and intraoperative guidance in CABG surgery. Both preoperatively and intraoperatively, the tool augmented spatial orientation and facilitated precise stenosis localization, thereby enhancing the surgeon's operative proficiency. This case report underscores the utility of advanced extended reality tools in cardiovascular surgery, emphasizing their pivotal role in refining surgical planning and execution.

The next generation of healthcare ecosystem in the metaverse

The Metaverse has gained wide attention for being the application interface for the next generation of Internet. The potential of the Metaverse is growing, as Web 3·0 development and adoption continues to advance medicine and healthcare. We define the next generation of interoperable healthcare ecosystem in the Metaverse. We examine the existing literature regarding the Metaverse, explain the technology framework to deliver an immersive experience, along with a technical comparison of legacy and novel Metaverse platforms that are publicly released and in active use. The potential applications of different features of the Metaverse, including avatar-based meetings, immersive simulations, and social interactions are examined with different roles from patients to healthcare providers and healthcare organizations. Present challenges in the development of the Metaverse healthcare ecosystem are discussed, along with potential solutions including capabilities requiring technological innovation, use cases requiring regulatory supervision, and sound governance. This proposed concept and framework of the Metaverse could potentially redefine the traditional healthcare system and enhance digital transformation in healthcare. Similar to AI technology at the beginning of this decade, real-world development and implementation of these capabilities are relatively nascent. Further pragmatic research is needed for the development of an interoperable healthcare ecosystem in the Metaverse.

How Will Artificial Intelligence Shape the Future of Decision-Making in Congenital Heart Disease?

Improvements in medical technology have significantly changed the management of congenital heart disease (CHD), offering novel tools to predict outcomes and personalize follow-up care. By using sophisticated imaging modalities, computational models and machine learning algorithms, clinicians can experiment with unprecedented insights into the complex anatomy and physiology of CHD. These tools enable early identification of high-risk patients, thus allowing timely, tailored interventions and improved outcomes. Additionally, the integration of genetic testing offers valuable prognostic information, helping in risk stratification and treatment optimisation. The birth of telemedicine platforms and remote monitoring devices facilitates customised follow-up care, enhancing patient engagement and reducing healthcare disparities. Taking into consideration challenges and ethical issues, clinicians can make the most of the full potential of artificial intelligence (AI) to further refine prognostic models, personalize care and improve long-term outcomes for patients with CHD. This narrative review aims to provide a comprehensive illustration of how AI has been implemented as a new technological method for enhancing the management of CHD.

The bibliometric analysis of extended reality in surgical training: Global and Chinese perspective

Objectives

The prospect of extended reality (XR) being integrated with surgical training curriculum has attracted scholars. However, there is a lack of bibliometric analysis to help them better understand this field. Our aim is to analyze relevant literature focusing on development trajectory and research directions since the 21st century to provide valuable insights.

Methods

Papers were retrieved from the Web of Science Core Collection. Microsoft Excel, VOSviewer, and CiteSpace were used for bibliometric analysis.

Results

Of the 3337 papers published worldwide, China contributed 204, ranking fifth. The world's enthusiasm for this field has been growing since 2000, whereas China has been gradually entering since 2001. Although China had a late start, its growth has accelerated since around 2016 due to the reform of the medical postgraduate education system and the rapid development of Chinese information technology, despite no research explosive period has been yet noted. International institutions, notably the University of Toronto, worked closely with others, while Chinese institutions lacked of international and domestic cooperation. Sixteen stable cooperation clusters of international scholars were formed, while the collaboration between Chinese scholars was not yet stable. XR has been primarily applied in orthopedic surgery, cataract surgery, laparoscopic training and intraoperative use in neurosurgery worldwide.

Conclusions

There is strong enthusiasm and cooperation in the international research on the XR-based surgical training. Chinese scholars are making steady progress and have great potential in this area. There has not been noted an explosive research phase yet in the Chinese pace. The research on several surgical specialties has been summarized at the very first time. AR will gradually to be more involved and take important role of the research.

Mitral valve surgery assisted by virtual and augmented reality: Cardiac surgery at the front of innovation

BACKGROUND

Given the variety in mitral valve (MV) pathology and associated surgical techniques, extended reality (XR) holds great potential to assist MV surgeons. This review aims to systematically evaluate the currently available evidence investigating the use of XR and associated technologies in MV surgery.

METHODS

A systematic database search was conducted of original articles and case reports that explored the use of XR and MV surgery in EMBASE, MEDLINE, Cochrane database and Google Scholar, from inception to February 2022.

RESULTS

Our search yielded 171 articles, of which 15 studies were included in this review, featuring 328 patients. Two main areas of application were identified: (i) pre-operative planning and (ii) predicting post-operative outcomes. The articles reporting outcomes relating to pre-operative planning were further categorised as exploring themes relevant to (i) mitral annular assessment; (ii) training; (iii) evaluation of surgical technique; (iv) surgical approach or plan and (v) selecting ring size or type. Preoperatively, XR has been shown to evaluate mitral annular pathology more accurately than echocardiography, informing the surgeon about the optimal surgical technique, approach and plan for a particular patient's MV pathology. Furthermore, XR could simulate and aid ring size/type selection for MV annuloplasty, creating a personalized surgical plan. Additionally, XR could estimate the postoperative MV biomechanical and physiological characteristics, predicting and pre-empting post-operative complications.

CONCLUSION

XR demonstrated promising applications for assisting MV surgery, enhancing outcomes and patient-centred care, nevertheless, there remain the need for randomized studies to ascertain its feasibility, safety, and validity in clinical practice.

Virtual Reality for Pain and Anxiety Management in Cardiac Surgery and Interventional Cardiology

Pain and anxiety are common in patients undergoing cardiac surgery and percutaneous cardiac interventions. Virtual reality (VR) is an emerging non-pharmacological tool for pain and anxiety management. However, its application around cardiac procedures remains relatively unexplored. In this review, we perform a targeted non-systematic literature review to assess the current state-of-the-art of VR for pain and anxiety management in patients undergoing cardiac procedures. Contexts of interest were preprocedural, periprocedural, and postprocedural applications. Existing trials show inconsistent results. The majority of studies in the preprocedural (7 studies, n = 302), periprocedural (1 study, n = 99), and postprocedural stage (4 studies, n = 214) demonstrate significant reduction of pain and anxiety through VR distraction therapy or VR patient education. However, larger-scale trials (2 preprocedural studies [n = 233], 1 periprocedural study [n = 32], 2 postprocedural studies [n = 300]) report no effect. Current literature on effectiveness of VR for pain and anxiety management in cardiac surgery and interventional cardiology remains inconclusive.

A scenario-based web app to facilitate patient education in lung tumor patients undergoing video-assisted thoracoscopic surgery: Development and usability testing

Background

Patient education (PE) is essential for improving patients' knowledge, anxiety, and satisfaction, and supporting their postoperative recovery. However, the advantages of video-assisted thoracoscopic surgery (VATS)-smaller incisions and faster recovery-can result in shorter hospital stays, making PE more challenging to implement effectively. Multimedia PE can potentially enhance PE, but its effectiveness for patients undergoing VATS is unclear.

Objective

This study developed a scenario-based PE web app for lung tumor patients undergoing VATS (SPE-VATS) to facilitate the PE process and evaluated its usability through a clinical trial.

Methods

The SPE-VATS provided the experimental group (EG: 32 participants) with interactive scenario, query guidance, diagnostic analysis, experience sharing, and active reminder, while the control group (CG: 32 participants) used pamphlets and videos. The usability of SPE-VATS in terms of postoperative anxiety reduction and patient satisfaction with the app was evaluated using self-reported questionnaires based on the state-trait anxiety inventory, technology acceptance model, system usability scale, and task load index.

Results

There was no statistically significant difference in postoperative anxiety reduction between the EG and CG, possibly because 90% of the participants underwent a low-risk surgical type, and VATS is known to be advantageous in alleviating surgical anxiety. However, females and higher educated EG participants showed a non-significant but favorable reduction than their CG counterparts. Moreover, the EG was highly satisfied with the app (rated 4.2 to 4.4 out of 5.0), with no significant gender and education level difference. They particularly valued the interactive scenario, experience sharing, and diagnostic analysis features of SPE-VATS.

Conclusions

The SPE-VATS demonstrated its usability and high patient satisfaction, particularly for female and higher educated patients. Low-risk patient predominance and VATS's advantages may explain non-significant postoperative anxiety reduction, warranting further studies on high-risk patients to evaluate the impact of SPE-VATS on clinical practice.

Revaiah P, Stanuch M, Skalski A, Onuma Y, Serruys PW. Feasibility and accuracy of real-time 3D-holographic graft length measurements

Aims

Mixed reality (MR) holograms can display high-definition images while preserving the user's situational awareness. New MR software can measure 3D objects with gestures and voice commands; however, these measurements have not been validated. We aimed to assess the feasibility and accuracy of using 3D holograms for measuring the length of coronary artery bypass grafts.

Methods and results

An independent core lab analyzed follow-up computer tomography coronary angiograms performed 30 days after coronary artery bypass grafting in 30 consecutive cases enrolled in the FASTTRACK CABG trial. Two analysts, blinded to clinical information, performed holographic reconstruction and measurements using the CarnaLife Holo software (Medapp, Krakow, Poland). Inter-observer agreement was assessed in the first 20 cases. Another analyst performed the validation measurements using the CardIQ W8 CT system (GE Healthcare, Milwaukee, Wisconsin). Seventy grafts (30 left internal mammary artery grafts, 31 saphenous vein grafts, and 9 right internal mammary artery grafts) were measured. Holographic measurements were feasible in 97.1% of grafts and took 3 minutes 36 s ± 50.74 s per case. There was an excellent inter-observer agreement [interclass correlation coefficient (ICC) 0.99 (0.97-0.99)]. There was no significant difference between the total graft length on hologram and CT [187.5 mm (157.7-211.4) vs. 183.1 mm (156.8-206.1), P = 0.50], respectively. Hologram and CT measurements are highly correlated (r = 0.97, P < 0.001) with an excellent agreement [ICC 0.98 (0.97-0.99)].

Conclusion

Real-time holographic measurements are feasible, quick, and accurate even for tortuous bypass grafts. This new methodology can empower clinicians to visualize and measure 3D images by themselves and may provide insights for procedural strategy.

Mixed reality in primary retroperitoneal tumour surgery: Evaluation of preoperative and intraoperative application value

OBJECTIVE

To evaluate the feasibility and application value of mixed reality technology (MR) in Primary retroperitoneal tumour (PRT) surgery.

METHODS

From 276 patients who underwent PRT resection at the First Affiliated Hospital of Xi'an Jiaotong University, we screened 46 patients who underwent MR-assisted retroperitoneal tumour resection and 46 patients who underwent tumour resection without MR assistance. The intraoperative and postoperative recovery of the patients in both groups were compared, and the reliability and validity of the application of MR were further examined using the Likert scale.

RESULTS

There was a significant difference in the mean intraoperative bleeding volume between the two groups, but it was reduced in the MR group. The results of the Likert scale showed higher scores in the MR group than non-MR group.

CONCLUSIONS

MR can be used to assist PRT resection and has great potential to improve the rate of complete retroperitoneal tumour resection.

Merging virtual and physical experiences: extended realities in cardiovascular medicine

Technological advancement and the COVID-19 pandemic have brought virtual learning and working into our daily lives. Extended realities (XR), an umbrella term for all the immersive technologies that merge virtual and physical experiences, will undoubtedly be an indispensable part of future clinical practice. The intuitive and three-dimensional nature of XR has great potential to benefit healthcare providers and empower patients and physicians. In the past decade, the implementation of XR into cardiovascular medicine has flourished such that it is now integrated into medical training, patient education, pre-procedural planning, intra-procedural visualization, and post-procedural care. This review article discussed how XR could provide innovative care and complement traditional practice, as well as addressing its limitations and considering its future perspectives.

Three Dimensional Printing as a Tool For Anatomical Training in Lung Surgery

Objective

Pulmonary anatomy is challenging, due to the high variability and its three-dimensional (3D) shape. While demands in thoracic oncologic surgery are increasing, the transition from open to thoracoscopic surgery is hampering anatomical understanding. This study analyzed the value of a 3D printed lung model in understanding and teaching anatomy.

Methods

A 3D pulmonary model was created and tested among different levels of proficiency: 10 experienced surgeons, 10 fellow surgeons and 10 junior residents. They were tested in interpretation of anatomy based on thoracic CT-scans, either using the 3D model or a 2D anatomical atlas. Accuracy of the given answers, time to complete the task and the self-reported level of certainty were scored in each group.

Results

In the experienced surgeons group there was no difference in between the 2D-model or 3D-model with a high rate of correct answers in both groups, and no differences in time or certainty. Fellow surgeons highly benefitted from the 3D-model with an improved accuracy from 26.6% to 70.0% (p = 0.001). Time to complete the task was shorter (207 versus 122 s, p < 0.0001) and participants were more secure (median of 4 versus 3, p = 0.007). For junior residents time to complete the task was shorter, the level of certainty was higher, but there was no improvement in accuracy.

Conclusions

3D printing may benefit in understanding anatomical relations in the complex anatomy of the bronchiopulmonary tree, especially for surgeons in training and could benefit in teaching anatomy.

Supplementary Information

The online version contains supplementary material available at 10.1007/s40670-023-01807-x.

Mixed Reality Platforms in Telehealth Delivery: Scoping Review

BACKGROUND

The distinctive features of the digital reality platforms, namely augmented reality (AR), virtual reality (VR), and mixed reality (MR) have extended to medical education, training, simulation, and patient care. Furthermore, this digital reality technology seamlessly merges with information and communication technology creating an enriched telehealth ecosystem. This review provides a composite overview of the prospects of telehealth delivered using the MR platform in clinical settings.

OBJECTIVE

This review identifies various clinical applications of high-fidelity digital display technology, namely AR, VR, and MR, delivered using telehealth capabilities. Next, the review focuses on the technical characteristics, hardware, and software technologies used in the composition of AR, VR, and MR in telehealth.

METHODS

We conducted a scoping review using the methodological framework and reporting design using the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) guidelines. Full-length articles in English were obtained from the Embase, PubMed, and Web of Science databases. The search protocol was based on the following keywords and Medical Subject Headings to obtain relevant results: "augmented reality," "virtual reality," "mixed-reality," "telemedicine," "telehealth," and "digital health." A predefined inclusion-exclusion criterion was developed in filtering the obtained results and the final selection of the articles, followed by data extraction and construction of the review.

RESULTS

We identified 4407 articles, of which 320 were eligible for full-text screening. A total of 134 full-text articles were included in the review. Telerehabilitation, telementoring, teleconsultation, telemonitoring, telepsychiatry, telesurgery, and telediagnosis were the segments of the telehealth division that explored the use of AR, VR, and MR platforms. Telerehabilitation using VR was the most commonly recurring segment in the included studies. AR and MR has been mainly used for telementoring and teleconsultation. The most important technical features of digital reality technology to emerge with telehealth were virtual environment, exergaming, 3D avatars, telepresence, anchoring annotations, and first-person viewpoint. Different arrangements of technology-3D modeling and viewing tools, communication and streaming platforms, file transfer and sharing platforms, sensors, high-fidelity displays, and controllers-formed the basis of most systems.

CONCLUSIONS

This review constitutes a recent overview of the evolving digital AR and VR in various clinical applications using the telehealth setup. This combination of telehealth with AR, VR, and MR allows for remote facilitation of clinical expertise and further development of home-based treatment. This review explores the rapidly growing suite of technologies available to users within the digital health sector and examines the opportunities and challenges they present.

Immersive Virtual Reality for Patient-Specific Preoperative Planning: A Systematic Review

Background. Immersive virtual reality (iVR) facilitates surgical decision-making by enabling surgeons to interact with complex anatomic structures in realistic 3-dimensional environments. With emerging interest in its applications, its effects on patients and providers should be clarified. This systematic review examines the current literature on iVR for patient-specific preoperative planning. Materials and Methods. A literature search was performed on five databases for publications from January 1, 2000 through March 21, 2021. Primary studies on the use of iVR simulators by surgeons at any level of training for patient-specific preoperative planning were eligible. Two reviewers independently screened titles, abstracts, and full texts, extracted data, and assessed quality using the Quality Assessment Tool for Studies with Diverse Designs (QATSDD). Results were qualitatively synthesized, and descriptive statistics were calculated. Results. The systematic search yielded 2,555 studies in total, with 24 full-texts subsequently included for qualitative synthesis, representing 264 medical personnel and 460 patients. Neurosurgery was the most frequently represented discipline (10/24; 42%). Preoperative iVR did not significantly improve patient-specific outcomes of operative time, blood loss, complications, and length of stay, but may decrease fluoroscopy time. In contrast, iVR improved surgeon-specific outcomes of surgical strategy, anatomy visualization, and confidence. Validity, reliability, and feasibility of patient-specific iVR models were assessed. The mean QATSDD score of included studies was 32.9%. Conclusions. Immersive VR improves surgeon experiences of preoperative planning, with minimal evidence for impact on short-term patient outcomes. Future work should focus on high-quality studies investigating long-term patient outcomes, and utility of preoperative iVR for trainees.

Preoperative visualization of congenital lung abnormalities: hybridizing artificial intelligence and virtual reality

OBJECTIVES

When surgical resection is indicated for a congenital lung abnormality (CLA), lobectomy is often preferred over segmentectomy, mostly because the latter is associated with more residual disease. Presumably, this occurs in children because sublobar surgery often does not adhere to anatomical borders (wedge resection instead of segmentectomy), thus increasing the risk of residual disease. This study investigated the feasibility of identifying eligible cases for anatomical segmentectomy by combining virtual reality (VR) and artificial intelligence (AI).

METHODS

Semi-automated segmentation of bronchovascular structures and lesions were visualized with VR and AI technology. Two specialists independently evaluated via a questionnaire the informative value of regular computed tomography versus three-dimensional (3D) VR images.

RESULTS

Five asymptomatic, non-operated cases were selected. Bronchovascular segmentation, volume calculation and image visualization in the VR environment were successful in all cases. Based on the computed tomography images, assignment of the CLA lesion to specific lung segments matched between the consulted specialists in only 1 out of the cases. Based on the three 3D VR images, however, the localization matched in 3 of the 5 cases. If the patients would have been operated, adding the 3D VR tool to the preoperative workup would have resulted in changing the surgical strategy (i.e. lobectomy versus segmentectomy) in 4 cases.

CONCLUSIONS

This study demonstrated the technical feasibility of a hybridized AI-VR visualization of segment-level lung anatomy in patients with CLA. Further exploration of the value of 3D VR in identifying eligible cases for anatomical segmentectomy is therefore warranted.

Congenital Heart Surgery Skill Training Using Simulation Models: Not an Option but a Necessity

Congenital heart surgery (CHS) is technically demanding, and its training is extremely complex and challenging. Training of the surgeon's technical skills has relied on a preceptorship format in which the trainees are gradually exposed to patients in the operating room under the close tutelage of senior staff surgeons. Training in the operating room is an inefficient process and the concept of a learning curve is no longer acceptable in terms of patient outcomes. The benefits of surgical simulation in training of congenital heart surgeons are well known and appreciated. However, adequate surgical simulation models and equipment for training have been scarce until the recent development of three-dimensionally (3D) printed models. Using comprehensive 3D printing and silicone-molding techniques, realistic simulation training models for most congenital heart surgical procedures have been produced. Newly developed silicone-molded models allow efficient CHS training in a stress-free environment with instantaneous feedback from the proctors and avoids risk to patients. The time has arrived when all congenital heart surgeons should consider surgical simulation training before progressing to real-life operating in a similar fashion to the aviation industry where all pilots are required to complete simulation training before flying a real aircraft. It is argued here that simulation training is not an option anymore but should be a mandatory component of CHS training.

Mixed reality surgical mentoring of combat casualty care related procedures in a perfused cadaver model: Initial results of a randomized feasibility study

BACKGROUND

Most telemedicine modalities have limited ability to enhance procedural and operative care. We developed a novel system to provide synchronous bidirectional expert mixed reality-enabled virtual procedural mentoring. In this feasibility study, we evaluated mixed reality mentoring of combat casualty care related procedures in a re-perfused cadaver model.

METHODS

Novices received real-time holographic mentoring from experts using augmented reality via Hololens (Microsoft Inc, Redmond, WA). The experts maintained real-time awareness of the novice's operative environment using virtual reality via HTC-Vive (HTC Corp, Xindian District, Taiwan). Additional cameras (both environments) and novel software created the immersive, shared, 3-dimensional mixed reality environment in which the novice and expert collaborated. The novices were prospectively randomized to either mixed reality or audio-only mentoring. Blinded experts independently evaluated novice procedural videos using a 5-point Likert scale-based questionnaire. Nonparametric variables were evaluated using the Wilcoxon rank-sum test and comparisons using the χ² analysis; significance was defined at P < .05.

RESULTS

Surgeon and nonsurgeon novices (14) performed 69 combat casualty care-related procedures (38 mixed reality, 31 audio), including various vascular exposures, 4-compartment lower leg fasciotomy, and emergency neurosurgical procedures; 85% were performed correctly with no difference in either group. Upon video review, mixed reality-mentored novices showed no difference in procedural flow and forward planning (3.67 vs 3.28, P = .21) or the likelihood of performing individual procedural steps correctly (4.12 vs 3.59, P = .06).

CONCLUSION

In this initial feasibility study, our novel mixed reality-based mentoring system successfully facilitated the performance of a wide variety of combat casualty care relevant procedures using a high fidelity re-perfused cadaver model. The small sample size and limited variety of novice types likely impacted the ability of holographically mentored novices to demonstrate improvement over the audio-only control group. Despite this, using virtual, augmented, and mixed reality technologies for procedural mentoring demonstrated promise, and further study is needed.

Immersive 3D Virtual Reality-Based Clip Sizing for Thoracoscopic Left Atrial Appendage Closure

Objective: Surgical left atrial appendage (LAA) closure using epicardial clips has become popular in stroke prevention in patients with atrial fibrillation. Optimal placement of the clip is essential to achieve complete LAA occlusion and to prevent complications due to compression of the circumflex artery. We determine the added value of immersive virtual reality (VR) in accurately assessing LAA base size and selection of an appropriately sized clip. Methods: We studied the feasibility of measuring the LAA base using VR and conventional computed tomography (CT). A retrospective analysis was performed of LAA base measurements in 15 patients who had undergone thoracoscopic LAA clipping. Subsequently, we compared the placed clip size with imaging-acquired LAA base size to retrospectively evaluate intraprocedural sizing. Results: We successfully applied a VR platform to measure LAA base size. The median LAA base size measured in CT (23.8 mm, interquartile range [IQR] 22.3 to 26.4 mm) and intracardial virtual reality (23.4 mm, IQR 21.6 to 25.5 mm) did not differ significantly (P = 0.416). VR measurements of the LAA base in surgeon's view (25.7 mm, IQR 24.2 to 29.2) were significantly higher than those of 2-dimensional CT (P = 0.037) and intracardial 3-dimensional (3D) VR (P < 0.05) measurements. All measurements differed significantly with placed clip sizes (P < 0.05). There were no clip malpositioning-related events. Conclusions: Immersive VR is a feasible method for obtaining anatomical information on LAA base size. In this retrospective analysis, CT and VR-based measurements of LAA base size differed significantly from intraoperatively placed LAA clips, indicating potential oversizing when measured intraoperatively. Using intuitive 3D VR-based imaging might be a useful method to assist in accurate preprocedural sizing of LAA base and can potentially prevent oversizing.

Practical Application of Augmented/Mixed Reality Technologies in Surgery of Abdominal Cancer Patients

The technology of augmented and mixed reality (AR/MR) is useful in various areas of modern surgery. We considered the use of augmented and mixed reality technologies as a method of preoperative planning and intraoperative navigation in abdominal cancer patients. Practical use of AM/MR raises a range questions, which demand suitable solutions. The difficulties and obstacles we encountered in the practical use of AR/MR are presented, along with the ways we chose to overcome them. The most demonstrative case is covered in detail. The three-dimensional anatomical model obtained from the CT scan needed to be rigidly attached to the patient’s body, and therefore an invasive approach was developed, using an orthopedic pin fixed to the pelvic bones. The pin is used both similarly to an X-ray contrast marker and as a marker for augmented reality. This solution made it possible, not only to visualize the anatomical structures of the patient and the border zone of the tumor, but also to change the position of the patient during the operation. In addition, a noninvasive (skin-based) marking method was developed that allows the application of mixed and augmented reality during operation. Both techniques were used (8 clinical cases) for preoperative planning and intraoperative navigation, which allowed surgeons to verify the radicality of the operation, to have visual control of all anatomical structures near the zone of interest, and to reduce the time of surgical intervention, thereby reducing the complication rate and improving the rehabilitation period.

"Snap on" or Not? A Validation on the Measurement Tool in a Virtual Reality Application

This multi-rater comparison study aims to validate the measurement tool with a "snap" feature option (SNAP ON vs. SNAP OFF), in a virtual reality (VR) application, ImmersiveView v. 2.1, against a conventional software Mimics Innovation Suite v.22 (MIS). It is hypothesized that these measurement tools are equivalent between SNAP ON, and SNAP OFF, and when compared to MIS, in terms of basic linear and angular measurements. Six (6) raters conducted a set of 40 linear and 15 angular measurements using CT scan data of three objects (L-block, hand model, and dry skull) with fiducial markers. Inter-rater repeatability and intra-rater reproducibility were assessed via inter-class coefficient (ICC). Equivalency between each pair of modules (SNAP ON, SNAP OFF, and MIS) was analyzed via Bland-Altman plots and two one-sided t-tests (TOST) procedure. The ICC for intra-rater repeatability yielded 0.999 to 1.000, and inter-rater reproducibility yielded 0.998 to 1.000, which suggests high degree of intra- and inter-rater reliability. The Bland-Altman plots demonstrated that measurements acquired from SNAP ON, SNAP OFF, and MIS were equivalent. The TOST procedure yielded that the measurements through all three modules are equivalent within ± 0.2 mm interval for distance, and ± 0.3° interval for angular measurements. The measurement tool with the "snap" feature in a newly developed VR application (ImmersiveView v.2.1) has been validated through a multi-rater comparison study. In terms of linear and angular measurements, this VR application, whether the "snap" feature was on or off, was equivalent to each other and to the control software (MIS) under the condition of this study. A strong reliability, both intra-rater repeatability and inter-rater reproducibility, has been found.

Technology Behavior Model—Impact of Extended Reality on Patient Surgery

Smart surgery is a new way to utilize smart devices to change existing surgeries. Smart glasses can enhance the surgical procedure so that the patient can understand the procedure more intuitively. Surgery is for patients, and patient acceptance of extended reality surgery is the purpose of this study. This study uses the technology behavior model, which is more in line with the user’s assessment of the acceptance behavior of the new technology. A triangulated research approach was used, which applies to this study for a specific patient population. Primary data were collected from hospitals through questionnaires and were statistically analyzed by CB&PLS-SEM multimodel using SmartPLS software. It was concluded that patients were influenced by operational emotional factors in undergoing extended reality surgery. The study provides a basis for future research related to the practical application of smart surgery from the patient’s perspective in viewing and accepting surgery.

"Augmented reality" applications in urology: a systematic review

INTRODUCTION

Augmented reality (AR) applied to surgical procedures refers to the superimposition of preoperative or intra-operative images onto the operative field. Augmented reality has been increasingly used in myriad surgical specialties including Urology. The following study reviews advances in the use of AR for improvements in urologic outcomes.

EVIDENCE ACQUISITION

We identified all descriptive, validity, prospective randomized/nonrandomized trials and retrospective comparative/noncomparative studies about the use of AR in Urology up until March 2021. The MEDLINE, Scopus, and Web of Science databases were used for literature search. We conducted the study selection according to the PRISMA (Preferred Reporting Items for Systematic Reviews and meta-analysis statement) guidelines. We limited included studies to only those using AR, excluding all that used virtual reality technology.

EVIDENCE SYNTHESIS

A total of 60 studies were identified and included in the present analysis. Overall, 19 studies were descriptive/validity/phantom studies for specific AR methodologies, 4 studies were case reports, and 37 studies included clinical prospective/retrospective comparative studies.

CONCLUSIONS

Advances in AR have led to increasing registration accuracy as well as increased ability to identify anatomic landmarks and improve outcomes during Urologic procedures such as RARP and robot-assisted partial nephrectomy.

Quo Vadis Anesthesiologist? The Value Proposition of Future Anesthesiologists Lies in Preserving or Restoring Presurgical Health after Surgical Insult

This Special Issue of the Journal of Clinical Medicine is devoted to anesthesia and perioperative care [...].

Virtual Reality in the Preoperative Planning of Adult Aortic Surgery: A Feasibility Study

Background: Complex aortic anatomy needs careful preoperative planning in which a patient-tailored approach with novel immersive techniques could serve as a valuable addition to current preoperative imaging. This pilot study aimed to investigate the technical feasibility of virtual reality (VR) as an additional imaging tool for preoperative planning in ascending aortic surgery. Methods: Ten cardiothoracic surgeons were presented with six patients who had each undergone a recent repair of the ascending aorta. Two-dimensional computed tomography images of each patient were assessed prior to the VR session. After three-dimensional (3D) VR rendering and 3D segmentation of the ascending aorta and aortic arch, the reconstructions were analyzed by each surgeon in VR via a head-mounted display. Each cardiothoracic surgeon completed a questionnaire after each planning procedure. The results of their assessments were compared to the performed operations. The primary endpoint of the present study was a change of surgical approach from open to clamped distal anastomosis, and vice versa. Results: Compared with conventional imaging, 80% of surgeons found that VR prepared them better for surgery. In 33% of cases (two out of six), the preoperative decision was adjusted due to the 3D VR-based evaluation of the anatomy. Surgeons rated CardioVR usefulness, user-friendliness, and satisfaction with median scores of 3.8 (IQR: 3.5-4.1), 4.2 (IQR: 3.8-4.6,) and 4.1 (IQR: 3.8-4.7) on a five-point Likert scale, respectively. Conclusions: Three-dimensional VR imaging was associated with improved anatomical understanding among surgeons and could be helpful in the future preoperative planning of ascending aortic surgery.

Augmented reality-assisted localization of solitary pulmonary nodules for precise sublobar lung resection: a preliminary study using an animal model

Background

Accurate localization of early lung cancer, manifested as solitary pulmonary nodules (SPNs) on computed tomography (CT), is critical in sublobar lung resection. The AR-assisted localization of SPNs was evaluated using a pig animal model.

Methods

A Microsoft HoloLens AR system was used. First, a plastic thoracic model was used for the pilot study. Three female 12 months 45 kg Danish Landrace Pigs were then used for the animal study. Thirty natural pulmonary structures, such as lymphonodus and bifurcated bronchioles or bronchial vessels, were chosen as simulated SPNs. The average angle between the actual puncturing needle and the expected path, the average distance between the puncture point and the plan point, and the difference between the actual puncturing depth and expected depth were recorded, and the accuracy rate was calculated.

Results

The point selected in the plastic thoracic model could be hit accurately with the assistance from the AR system in the pilot study. Moreover, the average angle between the actual puncturing needle and the expected path was 14.52°±6.04°. Meanwhile, the average distance between the puncture point and the expected point was 8.74±5.07 mm, and the difference between the actual and expected depths was 9.42±7.95 mm. Puncturing within a 1 cm³ area around the SPN using a hook-wire was considered a successful hit. The puncture accuracy was calculated. The average hit rate within a spherical area with a diameter of 1 cm range was 76.67%, and within a diameter of 2 cm range was 100%.

Conclusions

The HoloLens AR-assisted localization of SPNs may become a promising technique to improve the surgical treatment of early-stage lung cancer. Here, we evaluated its feasibility in an animal model. Nevertheless, its safety and effectiveness require further investigation in clinical trials.

[Perioperative augmented reality technology in surgical treatment of locally advanced recurrent rectal cancer]

Rectal cancer occupies the leading position among cancers, and incidence of locally advanced recurrences is still high despite comprehensive treatment. Combined resections are usually associated with high perioperative risks. These procedures are technically complex interventions requiring further improvement. Virtual reality technology in surgical treatment of locally advanced rectal cancer recurrence has not been widely discussed. The authors present multidisciplinary construction of the matched topographic-anatomical virtual model and virtual planning of the combined surgical intervention. Intraoperative use of augmented reality allowed specifying topographic and anatomical features of surgical area, level of vascular ligation, localization of tumor fixation points and resection borders. These data ensured safety and quality of resection. Further research of augmented reality technology and improvement of its technical aspects will improve the results of surgical treatment of patients with locally advanced pelvic tumors and recurrences.

Effects of Prehabilitation on Functional Capacity in Aged Patients Undergoing Cardiothoracic Surgeries: A Systematic Review

Background: an increasing number of advanced age patients are considered for cardiothoracic surgeries. Prehabilitation optimizes the patients’ functional capacity and physiological reserve. However, the effectiveness of prehabilitation on physical functioning and postoperative recovery in the scope of cardiothoracic surgery is still uncertain. Objective: to assess the effectiveness of prehabilitation on pre- and/or postoperative functional capacity and physiological reserve in aged patients that are considered for cardiothoracic surgeries. Methods: this systematic review was registered in PROSPERO (CRD42021247117). The searches were conducted in PubMed, Web of Science, Scopus, and Cochrane CENTRAL until 18 April 2021. Randomized clinical trials that compared different prehabilitation strategies with usual care on the pre- and-postoperative results in aged patients undergoing cardiothoracic surgeries were included. Methodological quality was assessed by means of the Jadad scale, and the effectiveness of the interventions according to the Consensus on Therapeutic Exercise Training. Results: nine studies with 876 participants aged from 64 to 71.5 years old were included. Risk of bias was moderate due to the absence of double-blinding. The content of the interventions (multimodal prehabilitation n = 3; based on physical exercises n = 6) and the result measures presented wide variation, which hindered comparison across the studies. In general, the trials with better therapeutic quality (n = 6) reported more significant improvements in physical functioning, cardiorespiratory capacity, and in the postoperative results in the participants under-going prehabilitation. Conclusions: prehabilitation seems to improve functional capacity and postoperative recovery in aged patients undergoing cardiothoracic surgeries. However, due to the significant heterogeneity and questionable quality of the trials, both the effectiveness of prehabilitation and the optimum content are still to be determined.

3D Virtual Reality Imaging of Major Aortopulmonary Collateral Arteries: A Novel Diagnostic Modality

BACKGROUND

Major aortopulmonary collateral arteries (MAPCAs), as seen in patients with pulmonary atresia, are arteries that supply blood from the aorta to the lungs and often require surgical intervention. To achieve complete repair in the least number of interventions, optimal imaging of the pulmonary arterial anatomy and MAPCAs is critical. 3D virtual reality (3D-VR) is a promising and upcoming new technology that could potentially ameliorate current imaging shortcomings.

METHODS

A retrospective, proof-of-concept study was performed of all operated patients with pulmonary atresia and MAPCAs at our center between 2010 and 2020 with a preoperative computed tomography (CT) scan. CT images were reviewed by two congenital cardiac surgeons in 3D-VR to determine additional value of VR for MAPCA imaging compared to conventional CT and for preoperative planning of MAPCA repair.

RESULTS

3D-VR visualizations were reconstructed from CT scans of seven newborns where the enhanced topographic anatomy resulted in improved visualization of MAPCA. In addition, surgical planning was improved since new observations or different preoperative plans were apparent in 4 out of 7 cases. After the initial setup, VR software and hardware was reported to be easy and intuitive to use.

CONCLUSIONS

This study showed technical feasibility of 3D-VR reconstruction of children with immersive visualization of topographic anatomy in an easy-to-use format leading to an improved surgical planning of MAPCA surgery. Future prospective studies are required to investigate the clinical benefits in larger populations.

Extended, virtual and augmented reality in thoracic surgery: a systematic review

OBJECTIVES

Extended reality (XR), encompassing both virtual reality (VR) and augmented reality, allows the user to interact with a computer-generated environment based on reality. In essence, the immersive nature of VR and augmented reality technology has been warmly welcomed in all aspects of medicine, gradually becoming increasingly feasible to incorporate into everyday practice. In recent years, XR has become increasingly adopted in thoracic surgery, although the extent of its applications is unclear. Here, we aim to review the current applications of XR in thoracic surgery.

METHODS

A systematic database search was conducted of original articles that explored the use of VR and/or augmented reality in thoracic surgery in EMBASE, MEDLINE, Cochrane database and Google Scholar, from inception to December 2020.

RESULTS

Our search yielded 1494 citations, of which 21 studies published from 2007 to 2019 were included in this review. Three main areas were identified: (i) the application of XR in thoracic surgery training; (ii) preoperative planning of thoracic procedures; and (iii) intraoperative assistance. Overall, XR could produce progression along the learning curve, enabling trainees to reach acceptable standards before performing in the operating theatre. Preoperatively, through the generation of 3D-renderings of the thoracic cavity and lung anatomy, VR increases procedural accuracy and surgical confidence through familiarization of the patient's anatomy. XR-assisted surgery may have therapeutic use particularly for complex cases, where conventional methods would yield inadequate outcomes due to inferior accuracy.

CONCLUSION

XR represents a salient step towards improving thoracic surgical training, as well as enhancing preoperative planning and intraoperative guidance.

The Impact of Biomedical Engineering on the Development of Minimally Invasive Cardio-Thoracic Surgery

(1) We describe the boundary conditions for minimally invasive cardiac surgery (MICS) with the aim to reduce procedure-related patient injury and discomfort. (2) The analysis of the MICS work process and its demand for improved tools and devices is followed by a description of the relevant sub-specialties of bio-medical engineering: electronics, biomechanics, and materials sciences. (3) Innovations can represent a desired adaptation of an existing work process or a radical redesign of procedure and devices such as in transcutaneous procedures. Focused interaction between engineers, industry, and surgeons is always mandatory (i.e., a therapeutic alliance for addressing 'unmet patient or professional needs'. (4) Novel techniques in MICS lean heavily on usability and safe and effective use in dedicated hands. Therefore, the use of training and simulation models should enable skills selection, a safe learning curve, and maintenance of proficiency. (5) The critical technical steps and cost-benefit trade-offs during the journey from invention to application will be explained. Business considerations such as time-to-market and returns on investment do shape the cost-benefit room for commercial use of technology. Proof of clinical safety and effectiveness by physicians remains important, but establishing the technical reliability of MICS tools and warranting appropriate surgical skills come first.

Virtual reality and artificial intelligence for 3-dimensional planning of lung segmentectomies

BACKGROUND

There has been an increasing trend toward pulmonary segmentectomies to treat early-stage lung cancer, small intrapulmonary metastases, and localized benign pathology. A complete preoperative understanding of pulmonary anatomy is essential for accurate surgical planning and case selection. Identifying intersegmental divisions is extremely difficult when performed on computed tomography. For the preoperative planning of segmentectomies, virtual reality (VR) and artificial intelligence could allow 3-dimensional visualization of the complex anatomy of pulmonary segmental divisions, vascular arborization, and bronchial anatomy. This technology can be applied by surgeons preoperatively to gain better insight into a patient's anatomy for planning segmentectomy.

METHODS

In this prospective observational pilot study, we aim to assess and demonstrate the technical feasibility and clinical applicability of the first dedicated artificial intelligence-based and immersive 3-dimensional-VR platform (PulmoVR; jointly developed and manufactured by Department of Cardiothoracic Surgery [Erasmus Medical Center, Rotterdam, The Netherlands], MedicalVR [Amsterdam, The Netherlands], EVOCS Medical Image Communication [Fysicon BV, Oss, The Netherlands], and Thirona [Nijmegen, The Netherlands]) for preoperative planning of video-assisted thoracoscopic segmentectomies.

RESULTS

A total of 10 eligible patients for segmentectomy were included in this study after referral through the institutional thoracic oncology multidisciplinary team. PulmoVR was successfully applied as a supplementary imaging tool to perform video-assisted thoracoscopic segmentectomies. In 40% of the cases, the surgical strategy was adjusted due to the 3-dimensional-VR-based evaluation of anatomy. This underlines the potential benefit of additional VR-guided planning of segmentectomy for both surgeon and patient.

CONCLUSIONS

Our study demonstrates the successful development and clinical application of the first dedicated artificial intelligence and VR platform for the planning of pulmonary segmentectomy. This is the first study that shows an immersive virtual reality-based application for preoperative planning of segmentectomy to the best of our knowledge.