Microsoft HoloLens 2 in Medical and Healthcare Context: State of the Art and Future Prospects

Augmented Reality Head-Mounted Device and Dynamic Navigation System for Postremoval in Maxillary Molars

INTRODUCTION

This study evaluates the feasibility of an augmented reality (AR) head-mounted device (HMD) displaying a dynamic navigation system (DNS) in the surgical site for fiber postremoval in maxillary molars and compares it to the DNS technique.

METHODS

Fifty maxillary first molars were divided into 2 groups: AR HMD + DNS (n = 25) and DNS (n = 25). The palatal canal was restored with RelyX fiber post (3M ESPE) luted with RelyX Unicem (3M ESPE). A core buildup was performed using Paracore (Coltene/Whaledent). Cone beam computed tomography (CBCT) scans were taken before and after postremoval. The drilling trajectory and depth were planned under X-guide software (X-Nav Technologies, Lansdale, PA). For the AR HMD + DNS group, the AR HMD (Microsoft HoloLens 2) displayed the DNS in the surgical site. The three dimensional (3D) deviations (Global coronal deviation [GCD] and global apical deviation [GAD]) and angular deflection (AD) were calculated. The number of mishaps and operating time were recorded.

RESULTS

Fiber post was removed from all samples (50/50). The AR HMD + DNS was more accurate than DNS, showing significantly lower GCD and GAD deviations and AD (P < .05). No mishap was detected. The AR HMD + DNS was as efficient in time as DNS (P > .05).

CONCLUSIONS

Within the limitations of this in vitro study, the AR HMD can safely display DNS in the surgical site for fiber post-removal in maxillary molars. AR HMD improved the DNS accuracy. Both AR HMD + DNS and DNS were time-efficient for fiber postremoval in maxillary molars.

Delivering clinical tutorials to medical students using the Microsoft HoloLens 2: A mixed-methods evaluation

BACKGROUND

Mixed reality offers potential educational advantages in the delivery of clinical teaching. Holographic artefacts can be rendered within a shared learning environment using devices such as the Microsoft HoloLens 2. In addition to facilitating remote access to clinical events, mixed reality may provide a means of sharing mental models, including the vertical and horizontal integration of curricular elements at the bedside. This study aimed to evaluate the feasibility of delivering clinical tutorials using the Microsoft HoloLens 2 and the learning efficacy achieved.

METHODS

Following receipt of institutional ethical approval, tutorials on preoperative anaesthetic history taking and upper airway examination were facilitated by a tutor who wore the HoloLens device. The tutor interacted face to face with a patient and two-way audio-visual interaction was facilitated using the HoloLens 2 and Microsoft Teams with groups of students who were located in a separate tutorial room. Holographic functions were employed by the tutor. The tutor completed the System Usability Scale, the tutor, technical facilitator, patients, and students provided quantitative and qualitative feedback, and three students participated in semi-structured feedback interviews. Students completed pre- and post-tutorial, and end-of-year examinations on the tutorial topics.

RESULTS

Twelve patients and 78 students participated across 12 separate tutorials. Five students did not complete the examinations and were excluded from efficacy calculations. Student feedback contained 90 positive comments, including the technology's ability to broadcast the tutor's point-of-vision, and 62 negative comments, where students noted issues with the audio-visual quality, and concerns that the tutorial was not as beneficial as traditional in-person clinical tutorials. The technology and tutorial structure were viewed favourably by the tutor, facilitator and patients. Significant improvement was observed between students' pre- and post-tutorial MCQ scores (mean 59.2% Vs 84.7%, p < 0.001).

CONCLUSIONS

This study demonstrates the feasibility of using the HoloLens 2 to facilitate remote bedside tutorials which incorporate holographic learning artefacts. Students' examination performance supports substantial learning of the tutorial topics. The tutorial structure was agreeable to students, patients and tutor. Our results support the feasibility of offering effective clinical teaching and learning opportunities using the HoloLens 2. However, the technical limitations and costs of the device are significant, and further research is required to assess the effectiveness of this tutorial format against in-person tutorials before wider roll out of this technology can be recommended as a result of this study.

Evolutionary trends and innovations in cardiovascular intervention

Cardiovascular diseases remain a global health challenge, prompting continuous innovation in medical technology, particularly in Cardiovascular MedTech. This article provides a comprehensive exploration of the transformative landscape of Cardiovascular MedTech in the 21st century, focusing on interventions. The escalating prevalence of cardiovascular diseases and the demand for personalized care drive the evolving landscape, with technologies like wearables and AI reshaping patient-centric healthcare. Wearable devices offer real-time monitoring, enhancing procedural precision and patient outcomes. AI facilitates risk assessment and personalized treatment strategies, revolutionizing intervention precision. Minimally invasive procedures, aided by robotics and novel materials, minimize patient impact and improve outcomes. 3D printing enables patient-specific implants, while regenerative medicine promises cardiac regeneration. Augmented reality headsets empower surgeons during procedures, enhancing precision and awareness. Novel materials and radiation reduction techniques further optimize interventions, prioritizing patient safety. Data security measures ensure patient privacy in the era of connected healthcare. Modern technologies enhance traditional surgeries, refining outcomes. The integration of these innovations promises to shape a healthier future for cardiovascular procedures, emphasizing collaboration and research to maximize their transformative potential.

Feasibility and Usability of Augmented Reality Technology in the Orthopaedic Operating Room

PURPOSE OF REVIEW

Augmented reality (AR) has gained popularity in various sectors, including gaming, entertainment, and healthcare. The desire for improved surgical navigation within orthopaedic surgery has led to the evaluation of the feasibility and usability of AR in the operating room (OR). However, the safe and effective use of AR technology in the OR necessitates a proper understanding of its capabilities and limitations. This review aims to describe the fundamental elements of AR, highlight limitations for use within the field of orthopaedic surgery, and discuss potential areas for development.

RECENT FINDINGS

To date, studies have demonstrated evidence that AR technology can be used to enhance navigation and performance in orthopaedic procedures. General hardware and software limitations of the technology include the registration process, ergonomics, and battery life. Other limitations are related to the human response factors such as inattentional blindness, which may lead to the inability to see complications within the surgical field. Furthermore, the prolonged use of AR can cause eye strain and headache due to phenomena such as the vergence-convergence conflict. AR technology may prove to be a better alternative to current orthopaedic surgery navigation systems. However, the current limitations should be mitigated to further improve the feasibility and usability of AR in the OR setting. It is important for both non-clinicians and clinicians to work in conjunction to guide the development of future iterations of AR technology and its implementation into the OR workflow.

Intraoperative Augmented Reality for Complex Glioma Resection: A Case Report

Augmented reality (AR) is an emerging technology that can display three-dimensional patient anatomy in the surgeons' field of view. The use of this technology has grown considerably for both presurgical and intraoperative guidance. A patient diagnosed with breast cancer started to experience numbness in the left hand, which progressed to weakness in the left hand and arm. An MRI was performed demonstrating a 2.9 cm X 1.8 cm lesion with extensive surrounding edema in the posterior fronto-parietal lobes. Surgery was recommended for presumed metastatic disease. Preoperatively, an AR system and Brainlab navigation were registered to the patient. AR, traditional navigation, and ultrasound were all used to localize the lesion and determine the craniotomy site and size. The tumor was removed along the direction of the lesion. Intraoperatively, we used AR to reexamine the tumor details and could appreciate that we had to redirect our surgical trajectory anteriorly and laterally in order to follow along the main axis of the tumor. In doing this, we were able to more confidently remain with the tumor, which by this time was poorly defined by 2D navigation and by direct vision. Postoperative MRI confirmed gross total removal of the tumor. The patient had an uneventful postoperative course with resolution of preoperative symptoms and the final surgical pathology was grade 4 glioblastoma. Here, we describe the valuable use of AR for the resection of a glioma. The system has a seamless registration process and provides the surgeon with a unique view of 3D anatomy overlaid onto the patient's head. This exciting technology can add tremendous value to complex cranial surgeries.

Mixed reality guided root canal therapy

Root canal therapy (RCT) is a widely performed procedure in dentistry, with over 25 million individuals undergoing it annually. This procedure is carried out to address inflammation or infection within the root canal system of affected teeth. However, accurately aligning CT scan information with the patient's tooth has posed challenges, leading to errors in tool positioning and potential negative outcomes. To overcome these challenges, a mixed reality application is developed using an optical see-through head-mounted display (OST-HMD). The application incorporates visual cues, an augmented mirror, and dynamically updated multi-view CT slices to address depth perception issues and achieve accurate tooth localization, comprehensive canal exploration, and prevention of perforation during RCT. Through the preliminary experimental assessment, significant improvements in the accuracy of the procedure are observed. Specifically, with the system the accuracy in position was improved from 1.4 to 0.4 mm (more than a 70% gain) using an Optical Tracker (NDI) and from 2.8 to 2.4 mm using an HMD, thereby achieving submillimeter accuracy with NDI. 6 participants were enrolled in the user study. The result of the study suggests that the average displacement on the crown plane of 1.27 ± 0.83 cm, an average depth error of 0.90 ± 0.72 cm and an average angular deviation of 1.83 ± 0.83°. Our error analysis further highlights the impact of HMD spatial localization and head motion on the registration and calibration process. Through seamless integration of CT image information with the patient's tooth, our mixed reality application assists dentists in achieving precise tool placement. This advancement in technology has the potential to elevate the quality of root canal procedures, ensuring better accuracy and enhancing overall treatment outcomes.

Therapists and patients perceptions of a mixed reality system designed to improve trunk control and upper extremity function

A prototype system aimed at improving arm function and trunk control after stroke has been developed that combines mixed-reality (MR) feedback with a mobile seat system (Holoreach). The purpose of this study was to assess the usability of Holoreach in a rehabilitation setting from both the patient and therapist perspective. Ten therapists (eight physiotherapists and two occupational therapists) used the device in their regular therapy programs for fifteen stroke patients with trunk control issues. Each patient received four individual therapy sessions with the device performed under the supervision of the therapist. Therapists and patients kept therapy diaries and used customized questionnaires. At the end of the study two focus groups were conducted to further assess usability. Generally, the prototype system is suitable for training trunk and arm control. The therapists expressed overall positive views on the impact of Holoreach. They characterized it as new, motivating, fresh, joyful, interesting, and exciting. All therapists and 80% of the patients agreed with the statement that training with Holoreach is beneficial for rehabilitation. Nonetheless, improvements are required in the hardware and software, and design. The prototype system contributes at various levels to the rapidly evolving advances in neurorehabilitation, particularly regarding the practical aspect of exercise delivery.

Integration of Augmented Reality Into Glioma Resection Surgery: A Case Report

Augmented reality (AR) is an exciting technology that has garnered considerable attention in the field of neurosurgery. Despite this, clinical use of this technology is still in its infancy. An area of great potential for this technology is the ability to display 3D anatomy overlaid with the patient to assist with presurgical and intraoperative decision-making. A 39-year-old woman presented with headaches and was experiencing what was described as a whooshing sound. MRI revealed the presence of a large left frontal mass involving the genu of the corpus callosum, with heterogeneous enhancement and central hemorrhagic necrosis, confirmed to be a glioma. She underwent a craniotomy with intraoperative MRI for resection. An augmented reality system was used to superimpose 3D holographic anatomy onto the patient's head for surgical planning. This report highlights a new AR technology and its immediate application to cranial neurosurgery. It is critical to document new uses of this technology as the field continues to integrate AR as well as other next-generation technologies into practice.

The use of mixed reality in the preoperative planning of colorectal surgery: Preliminary experience with a narrative review

New advanced technologies have recently been developed and preliminarily applied to surgery, including virtual reality (VR), augmented reality (AR) and mixed reality (MR). We retrospectively review all colorectal cases in which we used holographic 3D reconstruction from February 2020 to December 2022. This innovative approach was used to identify vascular anomalies, pinpoint tumor locations, evaluate infiltration into neighboring organs and devise surgical plans for both training and educating trainee assistants. We have also provided a state-of-the-art analysis, briefly highlighting what has been stated by the scientific literature to date. VR facilitates training and anatomical assessments, while AR enhances training and laparoscopic performance evaluations. MR, powered by HoloLens, enriches anatomic recognition, navigation, and visualization. Successful implementation was observed in 10 colorectal cancer cases, showcasing the effectiveness of MR in improving preoperative planning and its intraoperative application. This technology holds significant promise for advancing colorectal surgery by elevating safety and reliability standards.

The Apple Vision Pro as a Neurosurgical Planning Tool: A Case Report

With its recent release, the Apple Vision Pro (Apple Inc., Cupertino, CA) represents a promising technological advancement of mixed reality in the field of neurosurgery and medicine more broadly. With all new technologies, it is critical to facilitate early use and assessment of the technology to facilitate adoption by the larger medical community. A 44-year-old female with a history of ruptured intracranial aneurysm status post anterior communicating artery aneurysm clipping presented with worsened confusion and intermittent headache. CT imaging revealed evidence of hydrocephalus due to the malfunction of a previous right parietal ventriculoperitoneal (VP) shunt. Prior to the case, the Apple Vision Pro was used in the operating room to visualize and interact with a 3D model of the patient's anatomy for the patient undergoing a VP shunt placement. A visualization of the 3D model through the headset was used to plan the approach and entry point. At the conclusion of the procedure, all clinicians and operating staff who used the technology for planning completed a survey about their initial impressions of the headset. Overall, users felt the 3D models felt realistic (4.5/5), that the display of the user's real-world view felt natural (4.3/5), and that the headset did not cause eye strain or fatigue (4.5/5). The majority of users responded that they would continue to use the headset for cases (4/5). This represents one of the first known clinical uses of the Apple Vision Pro. It is a cutting-edge technology that will likely provide immense value for healthcare providers as it becomes more integrated into clinical care.

Leveraging Emerging Technologies to Expand Accessibility and Improve Precision in Rehabilitation and Exercise for People with Disabilities

Physical rehabilitation and exercise training have emerged as promising solutions for improving health, restoring function, and preserving quality of life in populations that face disparate health challenges related to disability. Despite the immense potential for rehabilitation and exercise to help people with disabilities live longer, healthier, and more independent lives, people with disabilities can experience physical, psychosocial, environmental, and economic barriers that limit their ability to participate in rehabilitation, exercise, and other physical activities. Together, these barriers contribute to health inequities in people with disabilities, by disproportionately limiting their ability to participate in health-promoting physical activities, relative to people without disabilities. Therefore, there is great need for research and innovation focusing on the development of strategies to expand accessibility and promote participation in rehabilitation and exercise programs for people with disabilities. Here, we discuss how cutting-edge technologies related to telecommunications, wearables, virtual and augmented reality, artificial intelligence, and cloud computing are providing new opportunities to improve accessibility in rehabilitation and exercise for people with disabilities. In addition, we highlight new frontiers in digital health technology and emerging lines of scientific research that will shape the future of precision care strategies for people with disabilities.

Augmented Reality-Assisted Placement of Ommaya Reservoir for Cyst Aspiration: A Case Report

Image guidance technologies can significantly improve the accuracy and safety of intracranial catheter insertions. Augmented reality (AR) allows surgeons to visualize 3D information overlaid onto a patient's head. As such, AR has emerged as a novel image guidance technology that offers unique advantages when navigating intracranial targets. A 71-year-old woman with a history of brain metastasis from breast cancer and prior resection surgery and chemotherapy presented with altered mental status and generalized weakness worse on her left side. Magnetic resonance imaging (MRI) demonstrated right frontotemporoparietal edema with a contrast-enhancing mass. MR perfusion confirmed an active tumor with an enlarging right temporal pole cyst. A cyst aspiration was performed via Ommaya reservoir placement. Neuro-navigation (BrainLab, Munich, Germany) and AR navigation were used to plan the trajectory from the temporal gyrus to the cyst. Post-operative computed tomography (CT) demonstrated good placement of the reservoir, reconstitution of the temporal horn of the lateral ventricle with decreased external mass effect, and no areas of hemorrhage. AR has tremendous potential in the field of neurosurgery for improving the accuracy and safety of procedures. This case demonstrates an encouraging application of AR and can serve as an example to drive expanded clinical use of this technology.

Train vs. Play: Evaluating the Effects of Gamified and Non-Gamified Wheelchair Skills Training Using Virtual Reality

This study compares the influence of a gamified and a non-gamified virtual reality (VR) environment on wheelchair skills training. In specific, the study explores the integration of gamification elements and their influence on wheelchair driving performance in VR-based training. Twenty-two non-disabled participants volunteered for the study, of whom eleven undertook the gamified VR training, and eleven engaged in the non-gamified VR training. To measure the efficacy of the VR-based wheelchair skills training, we captured the heart rate (HR), number of joystick movements, completion time, and number of collisions. In addition, an adapted version of the Wheelchair Skills Training Program Questionnaire (WSTP-Q), the Igroup Presence Questionnaire (IPQ), and the Simulator Sickness Questionnaire (SSQ) questionnaires were administered after the VR training. The results showed no differences in wheelchair driving performance, the level of involvement, or the ratings of presence between the two environments. In contrast, the perceived cybersickness was statistically higher for the group of participants who trained in the non-gamified VR environment. Remarkably, heightened cybersickness symptoms aligned with increased HR, suggesting physiological connections. As such, while direct gamification effects on the efficacy of VR-based wheelchair skills training were not statistically significant, its potential to amplify user engagement and reduce cybersickness is evident.

On-Device Execution of Deep Learning Models on HoloLens2 for Real-Time Augmented Reality Medical Applications

The integration of Deep Learning (DL) models with the HoloLens2 Augmented Reality (AR) headset has enormous potential for real-time AR medical applications. Currently, most applications execute the models on an external server that communicates with the headset via Wi-Fi. This client-server architecture introduces undesirable delays and lacks reliability for real-time applications. However, due to HoloLens2's limited computation capabilities, running the DL model directly on the device and achieving real-time performances is not trivial. Therefore, this study has two primary objectives: (i) to systematically evaluate two popular frameworks to execute DL models on HoloLens2-Unity Barracuda and Windows Machine Learning (WinML)-using the inference time as the primary evaluation metric; (ii) to provide benchmark values for state-of-the-art DL models that can be integrated in different medical applications (e.g., Yolo and Unet models). In this study, we executed DL models with various complexities and analyzed inference times ranging from a few milliseconds to seconds. Our results show that Unity Barracuda is significantly faster than WinML (p-value < 0.005). With our findings, we sought to provide practical guidance and reference values for future studies aiming to develop single, portable AR systems for real-time medical assistance.

From bench to bedside - current clinical and translational challenges in fibula free flap reconstruction

Fibula free flaps (FFF) represent a working horse for different reconstructive scenarios in facial surgery. While FFF were initially established for mandible reconstruction, advancements in planning for microsurgical techniques have paved the way toward a broader spectrum of indications, including maxillary defects. Essential factors to improve patient outcomes following FFF include minimal donor site morbidity, adequate bone length, and dual blood supply. Yet, persisting clinical and translational challenges hamper the effectiveness of FFF. In the preoperative phase, virtual surgical planning and artificial intelligence tools carry untapped potential, while the intraoperative role of individualized surgical templates and bioprinted prostheses remains to be summarized. Further, the integration of novel flap monitoring technologies into postoperative patient management has been subject to translational and clinical research efforts. Overall, there is a paucity of studies condensing the body of knowledge on emerging technologies and techniques in FFF surgery. Herein, we aim to review current challenges and solution possibilities in FFF. This line of research may serve as a pocket guide on cutting-edge developments and facilitate future targeted research in FFF.

Augmented Reality and 3-Dimensional Dynamic Navigation System Integration for Osteotomy and Root-end Resection

INTRODUCTION

Augmented reality (AR) superimposes high-definition computer-generated virtual content onto the existing environment, providing users with an enhanced perception of reality. This study investigates the feasibility of integrating an AR head-mounted device into a 3-dimensional dynamic navigation system (3D-DNS) for osteotomy and root-end resection (RER). It compares the accuracy and efficiency of AR + 3D-DNS to 3D-DNS for osteotomy and RER.

METHODS

Seventy-two tooth roots of 3D-printed surgical jaw models were divided into two groups: AR + 3D-DNS (n = 36) and 3D-DNS (n = 36). Cone-beam computed tomography scans were taken pre and postoperatively. The osteotomy and RER were virtually planned on X-guide software and delivered under 3D-DNS guidance. For the AR + 3D-DNS group, an AR head-mounted device (Microsoft HoloLens 2) was integrated into the 3D-DNS. The 2D- and 3D-deviations were calculated. The osteotomy and RER time and the number of procedural mishaps were recorded.

RESULTS

Osteotomy and RER were completed in all samples (72/72). AR + 3D-DNS was more accurate than 3D-DNS, showing lower 2D- and 3D-deviation values (P < .05). The AR + 3D-DNS was more efficient in time than 3D-DNS (P < .05). There was no significant difference in the number of mishaps (P > .05).

CONCLUSIONS

Within the limitations of this in vitro study, the integration of an AR head-mounted device to 3D-DNS is feasible for osteotomy and RER. AR improved the accuracy and time efficiency of 3D-DNS in osteotomy and RER. Head-mounted AR has the potential to be safely and reliably integrated into 3D-DNS for endodontic microsurgery.

Realizing consumers' existential dreams via product marketing and mixed reality: a perspective based on affective neuroscience theories

In an era of swift societal changes and escalating consumerism, this paper presents an exploration of an innovative approach that integrates product marketing strategies, mixed reality (MR) technology, and affective neuroscience theories to actualize consumers' existential dreams. MR, with its unique capacity to blend the virtual and real worlds, can enhance the consumer experience by creating immersive, personalized environments that resonate with consumers' existential aspirations. Insights from affective neuroscience, specifically the brain's processing of emotions, guide the development of emotionally engaging marketing strategies, which strengthen the connection between consumers, products, and brands. These integrated strategies not only present a novel blueprint for companies to deepen consumer engagement but also promise more fulfilling and meaningful consumer experiences. Moreover, this approach contributes to societal well-being and prosperity, marking a significant stride in the field of marketing.

Implementation of artificial intelligence and machine learning-based methods in brain-computer interaction

Brain-computer interfaces are used for direct two-way communication between the human brain and the computer. Brain signals contain valuable information about the mental state and brain activity of the examined subject. However, due to their non-stationarity and susceptibility to various types of interference, their processing, analysis and interpretation are challenging. For these reasons, the research in the field of brain-computer interfaces is focused on the implementation of artificial intelligence, especially in five main areas: calibration, noise suppression, communication, mental condition estimation, and motor imagery. The use of algorithms based on artificial intelligence and machine learning has proven to be very promising in these application domains, especially due to their ability to predict and learn from previous experience. Therefore, their implementation within medical technologies can contribute to more accurate information about the mental state of subjects, alleviate the consequences of serious diseases or improve the quality of life of disabled patients.

The HoloLens in medicine: A systematic review and taxonomy

The HoloLens (Microsoft Corp., Redmond, WA), a head-worn, optically see-through augmented reality (AR) display, is the main player in the recent boost in medical AR research. In this systematic review, we provide a comprehensive overview of the usage of the first-generation HoloLens within the medical domain, from its release in March 2016, until the year of 2021. We identified 217 relevant publications through a systematic search of the PubMed, Scopus, IEEE Xplore and SpringerLink databases. We propose a new taxonomy including use case, technical methodology for registration and tracking, data sources, visualization as well as validation and evaluation, and analyze the retrieved publications accordingly. We find that the bulk of research focuses on supporting physicians during interventions, where the HoloLens is promising for procedures usually performed without image guidance. However, the consensus is that accuracy and reliability are still too low to replace conventional guidance systems. Medical students are the second most common target group, where AR-enhanced medical simulators emerge as a promising technology. While concerns about human-computer interactions, usability and perception are frequently mentioned, hardly any concepts to overcome these issues have been proposed. Instead, registration and tracking lie at the core of most reviewed publications, nevertheless only few of them propose innovative concepts in this direction. Finally, we find that the validation of HoloLens applications suffers from a lack of standardized and rigorous evaluation protocols. We hope that this review can advance medical AR research by identifying gaps in the current literature, to pave the way for novel, innovative directions and translation into the medical routine.

Impact of Virtual Reality Cognitive and Motor Exercises on Brain Health

Innovative technologies of the 21st century have an extremely significant impact on all activities of modern humans. Among them, virtual reality (VR) offers great opportunities for scientific research and public health. The results of research to date both demonstrate the beneficial effects of using virtual worlds, and indicate undesirable effects on bodily functions. This review presents interesting recent findings related to training/exercise in virtual environments and its impact on cognitive and motor functions. It also highlights the importance of VR as an effective tool for assessing and diagnosing these functions both in research and modern medical practice. The findings point to the enormous future potential of these rapidly developing innovative technologies. Of particular importance are applications of virtual reality in basic and clinical neuroscience.

Preoperative Mixed-Reality Visualization of Complex Tibial Plateau Fractures and Its Benefit Compared to CT and 3D Printing

BACKGROUND

Various studies have shown the benefit of three-dimensional (3D) computed tomography (CT) reconstruction and especially 3D printing in the treatment of tibial plateau fractures (TPFs). This study aimed to investigate whether mixed-reality visualization (MRV) using mixed-reality glasses can provide a benefit for CT and/or 3D printing in planning treatment strategies for complex TPFs.

METHODS

Three complex TPFs were selected for the study and processed for 3D imaging. Subsequently, the fractures were presented to specialists in trauma surgery using CT (including 3D CT reconstruction), MRV (hardware: Microsoft HoloLens 2; software: mediCAD MIXED REALITY) and 3D prints. A standardized questionnaire on fracture morphology and treatment strategy was completed after each imaging session.

RESULTS

23 surgeons from 7 hospitals were interviewed. A total of 69.6% (n = 16) of those had treated at least 50 TPFs. A change in fracture classification according to Schatzker was recorded in 7.1% of the cases and in 78.6% an adjustment of the ten-segment classification was observed after MRV. In addition, the intended patient positioning changed in 16.1% of the cases, the surgical approach in 33.9% and osteosynthesis in 39.3%. A total of 82.1% of the participants rated MRV as beneficial compared to CT regarding fracture morphology and treatment planning. An additional benefit of 3D printing was reported in 57.1% of the cases (five-point Likert scale).

CONCLUSIONS

Preoperative MRV of complex TPFs leads to improved fracture understanding, better treatment strategies and a higher detection rate of fractures in posterior segments, and it thus has the potential to improve patient care and outcomes.

Mixed reality technology enhances teaching of spinal blockade procedures

To investigate the efficacy of utilizing mixed reality technology-assisted teaching of a spinal medial branch nerve block. Twenty undergraduate students from a 5-year clinical medicine program in Fujian Medical University were selected. They were divided into group A and group B using a random number generator, with 10 students in each group. Group A used the traditional teaching method and Group B used the mixed reality technology-assisted teaching method. At the end of the teaching period, both groups were assessed on the blocking operation, number of punctures required, puncture time, and final error value (distance between the final position and the reference position). A questionnaire was administered to both groups to assess teaching satisfaction. The number of punctures required was 7.40 ± 1.26 and 2.10 ± 0.74 for groups A and B, respectively. The puncture time in group A was 297.80 ± 50.95 s and 65.60 ± 22.02 s in group B. All differences were significant p < 0.01. The final error of the puncture in group A was 2.24 ± 0.35 mm and 1.96 ± 0.26 mm in group B-not significant. Group B had (p < 0.01) higher evaluation scores than group A for teaching effectiveness, learning interest, initiative, and teaching satisfaction. The application of mixed reality technology in the teaching of posterior medial branch blocks of the spinal nerve is superior to previous methods. This method should be adopted wherever possible to enhance learning of this difficult technique.

Immersive Virtual Reality in Post-Stroke Rehabilitation: A Systematic Review

In recent years, next to conventional rehabilitation's techniques, new technologies have been applied in stroke rehabilitation. In this context, fully immersive virtual reality (FIVR) has showed interesting results thanks to the level of immersion of the subject in the illusional world, with the feeling of being a real part of the virtual environment. This study aims to investigate the efficacy of FIVR in stroke rehabilitation. PubMed, Web of Science and Scopus were screened up to November 2022 to identify eligible randomized controlled trials (RCTs). Out of 4623, we included 12 RCTs involving post-acute and chronic stroke survivors, with a total of 350 patients (234 men and 115 women; mean age 58.36 years). High heterogeneity of the outcomes considered, the results showed that FIVR provides additional benefits, in comparison with standard rehabilitation. In particular, results showed an improvement in upper limb dexterity, gait performance and dynamic balance, influencing patient independence. Therefore, FIVR represents an adaptable, multi-faceted rehabilitation tool that can be considered in post-stroke rehabilitation, improving the compliance of the patients to the treatment and increasing the level of functioning and quality of life of stroke survivors.

User's image perception improved strategy and application of augmented reality systems in smart medical care: A review

BACKGROUND

Augmented reality (AR) is a new human-computer interaction technology that combines virtual reality, computer vision, and computer networks. With the rapid advancement of the medical field towards intelligence and data visualisation, AR systems are becoming increasingly popular in the medical field because they can provide doctors with clear enough medical images and accurate image navigation in practical applications. However, it has been discovered that different display types of AR systems have different effects on doctors' perception of the image after virtual-real fusion during the actual medical application. If doctors cannot correctly perceive the image, they may be unable to correctly match the virtual information with the real world, which will have a significant impact on their ability to recognise complex structures.

METHODS

This paper uses Citespace, a literature analysis tool, to visualise and analyse the research hotspots when AR systems are used in the medical field.

RESULTS

A visual analysis of the 1163 articles retrieved from the Web of Science Core Collection database reveals that display technology and visualisation technology are the key research directions of AR systems at the moment.

CONCLUSION

This paper categorises AR systems based on their display principles, reviews current image perception optimisation schemes for various types of systems, and analyses and compares different display types of AR systems based on their practical applications in the field of smart medical care so that doctors can select the appropriate display types based on different application scenarios. Finally, the future development direction of AR display technology is anticipated in order for AR technology to be more effectively applied in the field of smart medical care. The advancement of display technology for AR systems is critical for their use in the medical field, and the advantages and disadvantages of various display types should be considered in different application scenarios to select the best AR system.

Perspectives of Motor Functional Upper Extremity Recovery with the Use of Immersive Virtual Reality in Stroke Patients

Stroke is one of the leading causes of disability, including loss of hand manipulative skills. It constitutes a major limitation in independence and the ability to perform everyday tasks. Among the numerous accessible physiotherapeutic methods, it is becoming more common to apply Virtual Reality "VR”. The aim of this study was to establish whether immersive VR was worth considering as a form of physical therapy and the advisability of applying it in restoring post-stroke hand function impairment. A proprietary application Virtual Mirror Hand 1.0 was used in the research and its effectiveness in therapy was compared to classical mirror therapy. A total of 20 survivors after ischaemic stroke with comparable functional status were divided into a study group (n = 10) and control group (n = 10). Diagnostic tools included 36-Item Short Form Survey “SF-36” and the Fugl-Meyer Assessment Upper Extremity “FMA-UE”. Collected metrics showed a normal distribution and the differences in mean values were tested by the student’s t-test. In both, the study and control groups’ changes were recorded. A statistically significant outcome for FMA-UE and SF-36 measured by the student’s t-test for dependent or independent samples (p > 0.05) were obtained in both groups. Importantly, proven by conducted studies, an advantage of VR proprietary application was subjective sensations amelioration in pain and sensory impressions. Applying Virtual Mirror Hand 1.0 treatment to patients after a stroke appears to be a good solution and definitely provides the opportunity to consider VR applications as an integral part of the neurorehabilitation process. These results give a basis to plan further larger-scale observation attempts. Moreover, the development of the Virtual Mirror Hand 1.0 as an innovative application in physiotherapy may become equivalent to classical mirror therapy in improving the quality and effectiveness of the treatment used for post-stroke patients.