Assessment of the viability of integrating virtual reality programs in practical tests for the Korean Radiological Technologists Licensing Examination: a survey study

PURPOSE

The objective of this study was to assess the feasibility of incorporating virtual reality/augmented reality (VR/AR) programs into practical tests administered as part of the Korean Radiological Technologists Licensing Examination (KRTLE). This evaluation is grounded in a comprehensive survey that targeted enrolled students in departments of radiology across the nation.

METHODS

In total, 682 students from radiology departments across the nation were participants in the survey. An online survey platform was used, and the questionnaire was structured into 5 distinct sections and 27 questions. A frequency analysis for each section of the survey was conducted using IBM SPSS ver. 27.0.

RESULTS

Direct or indirect exposure to VR/AR content was reported by 67.7% of all respondents. Furthermore, 55.4% of the respondents expressed that VR/AR could be integrated into their classes, which signified a widespread acknowledgment of VR among the students. With regards to the integration of a VR/AR or mixed reality program into the practical tests for purposes of the KRTLE, a substantial amount of the respondents (57.3%) exhibited a positive inclination and recommended its introduction.

CONCLUSION

The application of VR/AR programs within practical tests of the KRTLE will be used as an alternative for evaluating clinical examination procedures and validating job skills.

A novel mixed reality-guided dental implant placement navigation system based on virtual-actual registration

BACKGROUNDS

The key to successful dental implant surgery is to place the implants accurately along the pre-operative planned paths. The application of surgical navigation systems can significantly improve the safety and accuracy of implantation. However, the frequent shift of the views of the surgeon between the surgical site and the computer screen causes troubles, which is expected to be solved by the introduction of mixed-reality technology through the wearing of HoloLens devices by enabling the alignment of the virtual three-dimensional (3D) image with the actual surgical site in the same field of view.

METHODS

This study utilized mixed reality technology to enhance dental implant surgery navigation. Our first step was reconstructing a virtual 3D model from pre-operative cone-beam CT (CBCT) images. We then obtained the relative position between objects using the navigation device and HoloLens camera. Via the algorithms of virtual-actual registration, the transformation matrixes between the HoloLens devices and the navigation tracker were acquired through the HoloLens-tracker registration, and the transformation matrixes between the virtual model and the patient phantom through the image-phantom registration. In addition, the algorithm of surgical drill calibration assisted in acquiring transformation matrixes between the surgical drill and the patient phantom. These algorithms allow real-time tracking of the surgical drill's location and orientation relative to the patient phantom under the navigation device. With the aid of the HoloLens 2, virtual 3D images and actual patient phantoms can be aligned accurately, providing surgeons with a clear visualization of the implant path.

RESULTS

Phantom experiments were conducted using 30 patient phantoms, with a total of 102 dental implants inserted. Comparisons between the actual implant paths and the pre-operatively planned implant paths showed that our system achieved a coronal deviation of 1.507 ± 0.155 mm, an apical deviation of 1.542 ± 0.143 mm, and an angular deviation of 3.468 ± 0.339°. The deviation was not significantly different from that of the navigation-guided dental implant placement but better than the freehand dental implant placement.

CONCLUSION

Our proposed system realizes the integration of the pre-operative planned dental implant paths and the patient phantom, which helps surgeons achieve adequate accuracy in traditional dental implant surgery. Furthermore, this system is expected to be applicable to animal and cadaveric experiments in further studies.

How I do it? Preoperative Microsoft HoloLens 2 planning-assisted surgical clipping of a fetal posterior cerebral artery aneurysm

BACKGROUND

The treatment of intracranial aneurysms has predominantly shifted towards endovascular strategies, but complex cases still necessitate microsurgery. Preoperative stimulation can be beneficial for inexperienced young neurosurgeons in preparing for safe microsurgery.

METHOD

A 72-year-old female with a left irregular fetal posterior cerebral artery (PCA) aneurysm underwent clipping repair. Microsoft HoloLens 2, utilizing mixed reality technology, was employed for preoperative stimulation and anatomical study. During the operation, we successfully identified the planned relationship between the aneurysm and the fetal PCA. The patient was cured without any complications.

CONCLUSION

We hope that this report will highlight the significance of Microsoft HoloLens 2 in microsurgical planning and education.

Challenges and promises of mixed-reality interventions in acquired brain injury rehabilitation: A scoping review

BACKGROUND

Acquired brain injury (ABI) can lead to significant impairments and difficulties in everyday life, necessitating the need for rehabilitation. Mixed-reality (MR) technologies have revolutionized the delivery of neurorehabilitation therapies. However, inconsistencies in research methodology, diverse study populations and designs, and exaggerated claims in the research, media, and private consumer sectors have impacted the knowledge base of the field, including within the context of ABI rehabilitation.

OBJECTIVE

This scoping review aims to explore MR-systems in ABI rehabilitation, while assessing the evidence base and technology readiness levels of these systems.

METHODS

Seven databases were searched for studies, which were screened and analyzed by two independent raters. The types of MR systems, levels of evidence, and technology readiness levels were extracted and analyzed using descriptive analyses.

RESULTS

Twenty-six studies were included in the review, all of which focused on ABI etiologies stemming from strokes. Across studies, upper-limb motor rehabilitation was the most common rehabilitation target of MR interventions, followed by gait, cognition, and lower-extremity functioning. At present, overall results indicate low evidence for MR-applications in ABI rehabilitation, with a median technology readiness level of 6, corresponding to system prototypes being tested in relevant environments.

CONCLUSION

Although challenges regarding system usability and design were reported, results appear promising with ongoing research. With variability across studies, technologies, and populations, determining the effectiveness of MR interventions in ABI remains a challenge, necessitating the need for ongoing innovation, research, and development of these systems.

Educational value of mixed reality combined with a three-dimensional printed model of aortic disease for vascular surgery in the standardized residency training of surgical residents in China: a case control study

BACKGROUND

The simulated three-dimensional (3D) printed anatomical model of the aorta, which has become the norm in medical education, has poor authenticity, tactility, feasibility, and interactivity. Therefore, this study explored the educational value and effect of mixed reality (MR) combined with a 3D printed model of aortic disease in training surgical residents.

METHOD

Fifty-one resident physicians who rotated in vascular surgery were selected and divided into traditional (27) and experimental (24) teaching groups using the random number table method. After undergoing the experimental and traditional training routines on aortic disease, both the groups took a theoretical test on aortic disease and an assessment of the simulation based on the Michigan Standard Simulation Experience Scale (MiSSES) template. Their scores and assessment results were compared. The study was conducted at the Department of Vascular Surgery of Peking University People's Hospital, Beijing, China.

RESULTS

In the theoretical test on aortic disease, the experimental teaching group obtained higher mean total scores (79.0 ± 9.1 vs. 72.6 ± 7.5, P = 0.013) and higher scores in anatomy/ pathophysiology (30.8 ± 5.4 vs. 24.8 ± 5.8; P < 0.001) than the traditional teaching group. The differences in their scores in the differential diagnosis (25.8 ± 3.0 vs. 23.3 ± 4.9; P = 0.078) and treatment (22.5 ± 11.8 vs. 24.5 ± 8.2; P = 0.603) sessions were insignificant. The MR-assisted teaching stratified the vascular residents through the MiSSES survey. Overall, 95.8% residents (23/24) strongly or somewhat agreed that the MR was adequately realistic and the curriculum helped improve the ability to understanding aortic diseases. Further, 91.7% residents (22/24) strongly or somewhat agreed that the MR-assisted teaching was a good training tool for knowledge on aortic diseases. All residents responded with "Good" or "Outstanding" on the overall rating of the MR experience.

CONCLUSIONS

MR combined with the 3D printed model helped residents understand and master aortic disease, particularly regarding anatomy and pathophysiology. Additionally, the realistic 3D printing and MR models improved the self-efficacy of residents in studying aortic diseases, thus greatly stimulating their enthusiasm and initiative to study.

Systematic Review of Extended Reality Digital Therapy for Enhancing Mental Health Among South Korean Adolescents and Young Adults

Digital therapy using extended reality (XR) holds great promise for addressing the mental health needs of adolescents and young adults. This study addresses a notable research gap in South Korea by systematically reviewing XR-based digital therapy for the mental health of South Korean adolescents and young adults. We analyzed 26 studies encompassing various aspects, including study type, publication date, research field, research methodology, data sources, program types, program content, sample characteristics, target population, assessment tools, and program effectiveness. Notably, 46.15% of the studies employed an experimental design, whereas over 53% utilized non-experimental approaches. Experimental studies lacked a genuine design, standardized questionnaires, and control variables. Similarly, non-experimental studies failed to report specific literature selection criteria. Consequently, future studies should adopt rigorous methodologies to enhance reliability and validity. Moreover, over 85% of the 26 studies focused solely on virtual reality and did not incorporate augmented or mixed reality. This study identifies the limitations of the previous research. These findings emphasize the need for structured investigations to advance the development of XR-based digital therapy to promote mental health in adolescents and young adults in South Korea.

Merging virtual and physical experiences: extended realities in cardiovascular medicine

Technological advancement and the COVID-19 pandemic have brought virtual learning and working into our daily lives. Extended realities (XR), an umbrella term for all the immersive technologies that merge virtual and physical experiences, will undoubtedly be an indispensable part of future clinical practice. The intuitive and three-dimensional nature of XR has great potential to benefit healthcare providers and empower patients and physicians. In the past decade, the implementation of XR into cardiovascular medicine has flourished such that it is now integrated into medical training, patient education, pre-procedural planning, intra-procedural visualization, and post-procedural care. This review article discussed how XR could provide innovative care and complement traditional practice, as well as addressing its limitations and considering its future perspectives.

Virtual and augmented reality in intensive care medicine: a systematic review

BACKGROUND

Virtual reality (VR) and augmented reality (AR) are rapidly developing technologies that offer a wide range of applications and enable users to experience digitally rendered content in both physical and virtual space. Although the number of studies about the different use of VR and AR increases year by year, a systematic overview of the applications of these innovative technologies in intensive care medicine is lacking. The aim of this systematic review was to provide a detailed summary of how VR and AR are currently being used in various areas of intensive care medicine.

METHODS

We systematically searched PubMed until 1st March 2023 to identify the currently existing evidence for different applications of VR and AR for both health care providers in the intensive care unit and children or adults, who were in an intensive care unit because of a critical illness.

RESULTS

After screening the literature, a total of 59 studies were included. Of note, a substantial number of publications consists of case reports, study plans or are lacking a control group. Furthermore, study designs are seldom comparable. However, there have been a variety of use cases for VR and AR that researchers have explored. They can help intensive care unit (ICU) personnel train, plan, and perform difficult procedures such as cardiopulmonary resuscitation, vascular punctures, endotracheal intubation or percutaneous dilatational tracheostomy. Patients might benefit from VR during invasive interventions and ICU stay by alleviating stress or pain. Furthermore, it enables contact with relatives and can also assist patients in their rehabilitation programs.

CONCLUSION

Both, VR and AR, offer multiple possibilities to improve current care, both from the perspective of the healthcare professional and the patient. It can be assumed that VR and AR will develop further and their application in health care will increase.

A multi-view interactive virtual-physical registration method for mixed reality based surgical navigation in pelvic and acetabular fracture fixation

PURPOSE

The treatment of pelvic and acetabular fractures remains technically demanding, and traditional surgical navigation systems suffer from the hand-eye mis-coordination. This paper describes a multi-view interactive virtual-physical registration method to enhance the surgeon's depth perception and a mixed reality (MR)-based surgical navigation system for pelvic and acetabular fracture fixation.

METHODS

First, the pelvic structure is reconstructed by segmentation in a preoperative CT scan, and an insertion path for the percutaneous LC-II screw is computed. A custom hand-held registration cube is used for virtual-physical registration. Three strategies are proposed to improve the surgeon's depth perception: vertices alignment, tremble compensation and multi-view averaging. During navigation, distance and angular deviation visual cues are updated to help the surgeon with the guide wire insertion. The methods have been integrated into an MR module in a surgical navigation system.

RESULTS

Phantom experiments were conducted. Ablation experimental results demonstrated the effectiveness of each strategy in the virtual-physical registration method. The proposed method achieved the best accuracy in comparison with related works. For percutaneous guide wire placement, our system achieved a mean bony entry point error of 2.76 ± 1.31 mm, a mean bony exit point error of 4.13 ± 1.74 mm, and a mean angular deviation of 3.04 ± 1.22°.

CONCLUSIONS

The proposed method can improve the virtual-physical fusion accuracy. The developed MR-based surgical navigation system has clinical application potential. Cadaver and clinical experiments will be conducted in future.

Use of a mixed reality system for navigational mapping during cardiac electrophysiological testing does not prolong case duration: A subanalysis from the Cardiac Augmented REality study

Background

CommandEP™ is a mixed reality (MXR) system for cardiac electrophysiological (EP) procedures that provides a real-time 3-dimensional digital image of cardiac geometry and catheter locations. In a previous study, physicians using the system demonstrated improved navigational accuracy. This study investigated the impact of the CommandEP system on EP procedural times compared to the standard-of-care electroanatomic mapping system (EAMS) display.

Objective

The purpose of this retrospective case-controlled analysis was to evaluate the impact of a novel MXR interface on EP procedural times compared to a case-matched cohort.

Methods

Cases from the Cardiac Augmented REality (CARE) study were matched for diagnosis and weight using a contemporary cohort. Procedural time was compared from the roll-in and full implementation cohort. During routine EP procedures, operators performed tasks during the postablation waiting phase, including creation of cardiac geometry and 5-point navigation under 2 conditions: (1) EAMS first; and (2) CommandEP.

Results

From a total of 16 CARE study patients, the 10 full implementation patients were matched to a cohort of 20 control patients (2 controls:1 CARE, matched according to pathology and age/weight). No statistical difference in total case times between CARE study patients vs control group (118 ± 29 minutes vs 97 ± 20 minutes; P = .07) or fluoroscopy times (6 ± 4 minutes vs 7 ± 6 minutes; P = .9). No significant difference in case duration for CARE study patients comparing roll-in vs full-implementation cohort (121 ± 26 minutes vs 118 ± 29 minutes; P = .96). CommandEP wear time during cases was significantly longer in full implementation cases (53 ± 24 minutes vs 24 ± 5 minutes; P = .0009). During creation of a single cardiac geometry, no significant time difference was noted between CommandEP vs EAMS (284 ± 45 seconds vs 268 ± 43 seconds; P = .1) or fluoroscopy use (9 ± 19 seconds vs 6 ± 18 seconds; P = .25). During point navigation tasks, there was no difference in total time (CommandEP 31 ± 14 seconds vs EAMS 28 ± 15 seconds; P = .16) or fluoroscopy time (CommandEP 0 second vs EAMS 0 second).

Conclusion

MXR did not prolong overall procedural time compared to a matched cohort. There was no prolongation in study task completion time. Future studies with experienced CommandEP users directly assessing procedural time and task completion time in a randomized study population would be of interest.

Development and Evaluation of a Mixed-Reality Tele-ultrasound System

OBJECTIVE

The objective of this feasibility study was to develop and assess a tele-ultrasound system that would enable an expert sonographer (situated at the remote site) to provide real-time guidance to an operator (situated at the imaging site) using a mixed-reality environment.

METHODS

An architecture along with the operational workflow of the system is designed and a prototype is developed that enables guidance in form of audiovisual cues. The visual cues comprise holograms (of the ultrasound images and ultrasound probe) and is rendered to the operator using a head-mounted display device. The position and orientation of the ultrasound probe's hologram are remotely controlled by the expert sonographer and guide the placement of a physical ultrasound probe at the imaging site. The developed prototype was evaluated for its performance on a network. In addition, a user study (with 12 participants) was conducted to assess the operator's ability to align the probe under different guidance modes.

RESULTS

The network performance revealed the view of the imaging site and ultrasound images were transferred to the remote site in 233 ± 42 and 158 ± 38 ms, respectively. The expert sonographer was able to transfer, to the imaging site, data related to position and orientation of the ultrasound probe's hologram in 78 ± 13 ms. The user study indicated that the audiovisual cues are sufficient for an operator to position and orient a physical probe for accurate depiction of the targeted tissue (p < 0.001). The probe's placement translational and rotational errors were 1.4 ± 0.6 mm and 5.4 ± 2.2º.

CONCLUSION

The work illustrates the feasibility of using a mixed-reality environment for effective communication between an expert sonographer (ultrasound physician) and an operator. Further studies are required to determine its applicability in a clinical setting during tele-ultrasound.

Virtual Models Using Augmented Reality May Provide a Suitable Supplement, Although Not a Physical Specimen Replacement, in Pathology Education

There is a growing trend towards using virtual models within medical programs. In some disciplines, the use of human samples or cadavers is increasingly being replaced by technology-enhanced modes of delivery. Although this transition can occur with some success, the impact of virtual representations to replace depictions of disease states from dissected samples displayed in acrylic pathological specimen jars has never been investigated. This study assessed medical student perceptions of replacing teaching through physical specimens (i.e. specimen jars or real tissue) with virtual models across cardiovascular, neural, musculoskeletal, haematology, endocrine and immunological pathology curricula. Seventy-four year 2 (n = 31) and year 5 (n = 43) medical students participated in the study. After being provided with a demonstration of a potential tablet-based lesson on lung pathology using augmented reality, participants completed a Likert-scale survey and provided written feedback. Questions requested thoughts on the usefulness of the 3D-virtual model compared to physical specimens and whether current teaching in pathology could be replaced by technology-enhanced practices. Most students (58.15%) disagreed on the replacement of physical specimens with virtual models. Furthermore, over half the students (55.4%) indicated that the replacement of physical specimens with augmented reality models would not be beneficial for pathology learning. Nearly two-thirds of students believed that the absence of physical specimens would negatively impact their knowledge. Nonetheless, many students would appreciate the opportunity to revise pathology away from the labs with virtual options. As such, an overwhelming number of students (89.2%) would prefer having both physical specimens and virtual models for learning. This study identifies that technology-enhanced learning may be a suitable supplement alongside traditional hands-on teaching but should not replace the use of pathological specimens within a medical curriculum.

Mixed reality for the assessment of aortoiliac anatomy in patients with abdominal aortic aneurysm prior to open and endovascular repair: Feasibility and interobserver agreement

OBJECTIVES

The objective is to evaluate the feasibility and interobserver agreement of a Mixed Reality Viewer (MRV) in the assessment of aortoiliac vascular anatomy of abdominal aortic aneurysm (AAA) patients.

METHODS

Fifty preoperative computed tomography angiographies (CTAs) of AAA patients were included. CTAs were assessed in a mixed reality (MR) environment with respect to aortoiliac anatomy according to a standardized protocol by two experienced observers (Mixed Reality Viewer, MRV, Brainlab AG, Germany). Additionally, all CTAs were independently assessed applying the same protocol by the same observers using a conventional DICOM viewer on a two-dimensional screen with multi-planar reconstructions (Conventional viewer, CV, GE Centricity PACS RA1000 Workstation, GE, United States). The protocol included four sets of items: calcification, dilatation, patency, and tortuosity as well as the number of lumbar and renal arteries. Interobserver agreement (IA, Cohen's Kappa, κ) was calculated for every item set.

RESULTS

All CTAs could successfully be displayed in the MRV (100%). The MRV demonstrated equal or better IA in the assessment of anterior and posterior calcification (κMRV: 0.68 and 0.61, κCV: 0.33 and 0.45, respectively) as well as tortuosity (κMRV: 0.60, κCV: 0.48) and dilatation (κMRV: 0.68, κCV: 0.67). The CV demonstrated better IA in the assessment of patency (κMRV: 0.74, κCV: 0.93). The CV also identified significantly more lumbar arteries (CV: 379, MRV: 239, p < 0.01).

CONCLUSIONS

The MRV is a feasible imaging viewing technology in clinical routine. Future efforts should aim at improving hologram quality and enabling accurate registration of the hologram with the physical patient.

Mixed reality combined with ALPPS for colorectal liver metastases, a case report

INTRODUCTION

Improvement of treatments for patients suffering from colorectal carcinoma and extended liver metastases has increased the overall survival and enables more patients to undergo surgical therapy. If the future liver remnant (FLR) is expected to be low, Associating Liver Partition and Portal Vein Ligation for Staged Hepatectomy (ALPPS) is a potential treatment with high feasibility and an increase in overall survival. The evolving mixed reality technology could support hepatobiliary surgery. This case report demonstrates for the first time the combination of mixed reality technology and ALPPS procedure for a patient with low expected FLR.

PRESENTATION OF CASE

A 49-year-old patient is presented with adenocarcinoma of the caecum with bilateral liver metastasis. After colon resection, a palliative chemotherapy was administered with good response and partial remission, so curative liver resection was intended. Based on the low expected FLR, calculated from the 3D-model of the liver, we decided to perform an in-situ split resection supported by mixed reality intraoperatively. The total operation time was 6 + 2 h. During both steps no blood transfusion was required and no major complication occurred. The patient was discharged 15 days after the second step. Final pathology revealed multiple predominantly necrotic metastases of the pre-existing colon carcinoma (ypM1, R0).

DISCUSSION

After the first step of ALPPS, an increase of the FLR up to 57 % was achieved, so the second step was performed on postoperative day (POD)11. The 3D-model and the intraoperative use of mixed reality supported our decision making and intraoperative navigation. This technique could be implemented on a larger scale to support complex liver resections.

CONCLUSION

The combination of mixed reality with ALPPS resulted in a good surgical outcome and should be considered as a potential alternative for liver resections.

Use of Mixed Reality in Neurosurgery Training: A Single Centre Experience

BACKGROUND

Mixed reality (MR) technology has opened new avenues for planning, visualization, and education in surgery. Neurosurgical pathologies require a very clear understanding of the relationships between pathology and critical neurovascular structures. The decline in cadaveric dissections and resource constraints has pushed the educators to find newer ways of rendering the same knowledge. The aim of this study was to determine the feasibility of employing a MR device in a high-volume center for neurosurgical teaching. The study also evaluated the results of the trainee experience in using the MR platform.

METHODS

Three neurosurgical consultants who are part of the teaching faculty were asked to facilitate the session. No prior training on utilizing the MR device was given to the trainees. HoloLens 2 was used as the MR device. Two questionnaires were used to understand the experience of the trainees.

RESULTS

Eight active neurosurgical trainees who are currently training at our institution were recruited for the purposes of this study. Despite having no prior training on a MR platform, the learning curve was short for most of the trainees. Whether MR replace current traditional methods of teaching neuroanatomy, the response was divided across the trainees. The results of the User Experience Questionnaire were positive with the trainees finding the device as attractive, dependable, novel, and user-friendly.

CONCLUSION

This study demonstrates the feasibility of using MR platform in neurosurgery training without significant preparation requirements. These data are required to justify the future investment in this technology for training institutions.

An autonomous X-ray image acquisition and interpretation system for assisting percutaneous pelvic fracture fixation

PURPOSE

Percutaneous fracture fixation involves multiple X-ray acquisitions to determine adequate tool trajectories in bony anatomy. In order to reduce time spent adjusting the X-ray imager's gantry, avoid excess acquisitions, and anticipate inadequate trajectories before penetrating bone, we propose an autonomous system for intra-operative feedback that combines robotic X-ray imaging and machine learning for automated image acquisition and interpretation, respectively.

METHODS

Our approach reconstructs an appropriate trajectory in a two-image sequence, where the optimal second viewpoint is determined based on analysis of the first image. A deep neural network is responsible for detecting the tool and corridor, here a K-wire and the superior pubic ramus, respectively, in these radiographs. The reconstructed corridor and K-wire pose are compared to determine likelihood of cortical breach, and both are visualized for the clinician in a mixed reality environment that is spatially registered to the patient and delivered by an optical see-through head-mounted display.

RESULTS

We assess the upper bounds on system performance through in silico evaluation across 11 CTs with fractures present, in which the corridor and K-wire are adequately reconstructed. In post hoc analysis of radiographs across 3 cadaveric specimens, our system determines the appropriate trajectory to within 2.8 ± 1.3 mm and 2.7 ± 1.8[Formula: see text].

CONCLUSION

An expert user study with an anthropomorphic phantom demonstrates how our autonomous, integrated system requires fewer images and lower movement to guide and confirm adequate placement compared to current clinical practice. Code and data are available.

[Digital tools in musculoskeletal rehabilitation]

The demographic transition in combination with the increasing demands of society and a growing shortage of skilled workers are leading to a shortage of care in musculoskeletal rehabilitation, especially in times of the pandemic. Digital interventions represent an opportunity to reintegrate patients with musculoskeletal dysfunctions into everyday life. The changes to the legal basis enable physicians and therapists to support the rehabilitation of their patients with reimbursable apps and digital applications and to permanently integrate learned skills into their daily lives. Telerehabilitation technologies, apps, telerobotics and mixed reality offer the opportunity to complement and optimize existing care structures and to redesign specialized therapeutic home visits with modern technology in a new and contemporary way.

A systematic review of the application of immersive technologies for safety and health management in the construction sector

INTRODUCTION

The construction industry employs about 7% of global manpower and contributes about 6% to the global economy. However, statistics have depicted that the construction industry contributes significantly to workplace fatalities and injuries despite multiple interventions (including technological applications) implemented by governments and construction companies. Recently, immersive technologies as part of a suite of industry 4.0 technologies, have also strongly emerged as a viable pathway to help address poor construction occupational safety and health (OSH) performance.

METHOD

With the aim of gaining a broad view of different construction OSH issues addressed using immersive technologies, a review on the application of immersive technologies for construction OSH management is conducted using the preferred reporting items for systematic reviews and meta-analysis (PRISMA) approach and bibliometric analysis of literature. This resulted in the evaluation of 117 relevant papers collected from three online databases (Scopus, Web of Science, and Engineering Village).

RESULTS

The review revealed that literature have focused on the application of various immersive technologies for hazard identification and visualization, safety training, design for safety, risk perception, and assessment in various construction works. The review identified several limitations regarding the use of immersive technologies, which include the low level of adoption of the developed immersive technologies for OSH management by the construction industry, very limited research on the application of immersive technologies for health hazards, and limited focus on the comparison of the effectiveness of various immersive technologies for construction OSH management.

CONCLUSIONS AND PRACTICAL APPLICATIONS

For future research, it is recommended to identify possible reasons for the low transition level from research to industry practice and proffer solutions to the identified issues. Another recommendation is the study of the effectiveness of the use of immersive technologies for addressing health hazards in comparison to the conventional methods.

Movement kinematic and postural control differences when performing a visuomotor skill in real and virtual environments

Immersive technologies, like virtual and mixed reality, pose a novel challenge for our sensorimotor systems as they deliver simulated sensory inputs that may not match those of the natural environment. These include reduced fields of view, missing or inaccurate haptic information, and distortions of 3D space; differences that may impact the control of motor actions. For instance, reach-to-grasp movements without end-point haptic feedback are characterised by slower and more exaggerated movements. A general uncertainty about sensory input may also induce a more conscious form of movement control. We tested whether a more complex skill like golf putting was also characterized by more consciously controlled movement. In a repeated-measures design, kinematics of the putter swing and postural control were compared between (i) real-world putting, (ii) VR putting, and (iii) VR putting with haptic feedback from a real ball (i.e., mixed reality). Differences in putter swing were observed both between the real world and VR, and between VR conditions with and without haptic information. Further, clear differences in postural control emerged between real and virtual putting, with both VR conditions characterised by larger postural movements, which were more regular and less complex, suggesting a more conscious form of balance control. Conversely, participants actually reported less conscious awareness of their movements in VR. These findings highlight how fundamental movement differences may exist between virtual and natural environments, which may pose challenges for transfer of learning within applications to motor rehabilitation and sport.

The Effect of Holographic Heart Models and Mixed Reality for Anatomy Learning in Congenital Heart Disease: An Exploratory Study

In this paper, we present an exploratory study on the potential impact of holographic heart models and mixed reality technology on medical training, and in particular in teaching complex Congenital Heart Diseases (CHD) to medical students. Fifty-nine medical students were randomly allocated into three groups. Each participant in each group received a 30-minute lecture on a CHD condition interpretation and transcatheter treatment with different instructional tools. The participants of the first group attended a lecture in which traditional slides were projected onto a flat screen (group "regular slideware", RS). The second group was shown slides incorporating videos of holographic anatomical models (group "holographic videos", HV). Finally, those in the third group wore immersive, head-mounted devices (HMD) to interact directly with holographic anatomical models (group "mixed reality", MR). At the end of the lecture, the members of each group were asked to fill in a multiple-choice questionnaire aimed at evaluating their topic proficiency, as a proxy to evaluate the effectiveness of the training session (in terms of acquired notions); participants from group MR were also asked to fill in a questionnaire regarding the recommendability and usability of the MS Hololens HMDs, as a proxy of satisfaction regarding its use experience (UX). The findings show promising results for usability and user acceptance.

The Metaverse for Healthcare: Trends, Applications, and Future Directions of Digital Therapeutics for Urology

In recent years, the emergence of digital therapeutics as a novel approach to managing conditions has garnered significant attention. This approach involves using evidence-based therapeutic interventions that are facilitated by high-quality software programs to treat, manage, or prevent medical conditions. The incorporation of digital therapeutics into the Metaverse has increased the feasibility of their implementation and application in all areas of medical services. In urology, substantial digital therapeutics are being produced and researched, including mobile apps, bladder devices, pelvic floor muscle trainers, smart toilet systems, mixed reality-guided training and surgery, and training and telemedicine for urological consultations. The purpose of this review article is to provide a comprehensive overview of the current impact of the Metaverse on the field of digital therapeutics and identify its current trends, applications, and future perspectives in the field of urology.

Efficacy of exposure and response prevention therapy in mixed reality for patients with obsessive-compulsive disorder: study protocol for a randomized controlled trial

Many patients with obsessive-compulsive disorder (OCD) do not receive cognitive behavioral therapy with exposure and response prevention (first line treatment for OCD), for example, due to patients' fear of the exposure and reservations of the therapists. Technology-supported exposure (e.g., exposure therapy with response prevention in mixed reality [MERP]) for patients with OCD may help to overcome this obstacle. Building upon findings of our pilot study objectives of this study are to evaluate the efficacy, expectations of treatment success, feasibility, and acceptance of MERP as well as to identify possible limitations. In total, 64 outpatients with contamination-related OCD will be recruited and randomized to one of two conditions: MERP (six sessions in six weeks) and self-guided exposure therapy (six exercises in six weeks). Participants will be assessed before (baseline), after the six-week intervention period (post), as well as three months after post assessment (follow-up) regarding symptomatology (Yale-Brown Obsessive Compulsive Scale; Y-BOCS), their subjective evaluation of MERP (acceptance) and sense of presence. The planned study is the first to investigate MERP in patients with OCD.

Transanal lateral lymph node dissection with intraoperative hologram support in low rectal cancer

BACKGROUND

In Japan, the standard treatment for stage II/III advanced low rectal cancer is total mesorectal excision plus lateral lymph node dissection (LLND). There are also recent reports on the use of transanal LLND. However, the transanal anatomy is difficult to understand, and additional support tools are required to improve the surgical safety. The present study examined the utility of holograms with mixed reality as an intraoperative support tool for assessing the complex pelvic anatomy.

METHODS

Polygon (stereolithography) files of patients' pelvic organs were created and exported from the SYNAPSE VINCENT imaging system and uploaded into the Holoeyes MD virtual reality software. Three-dimensional images were automatically converted into patient-specific holograms. Each hologram was then installed into a head mount display (HoloLens2), and the surgeons and assistants wore the HoloLens2 when they performed transanal LLND. Twelve digestive surgeons with prior practice in hologram manipulation evaluated the utility of the intraoperative hologram support by means of a questionnaire.

RESULTS

Intraoperative hologram support improved the surgical understanding of the lateral lymph node region anatomy. In the questionnaire, 75% of the surgeons answered that the hologram accurately reflected the anatomy, and 92% of the surgeons answered that the anatomy was better understood by simulating the hologram intraoperatively than preoperatively. Moreover, 92% of the surgeons agreed that intraoperative holograms were a useful support tool for improving the surgical safety.

CONCLUSIONS

Intraoperative hologram support improved the surgical understanding of the pelvic anatomy for transanal LLND. Intraoperative holograms may represent a next-generation surgical tool for transanal LLND.

Student Perceptions of Superimposed Mixed Reality Anatomy: A Bridge Between the Virtual and Physical

A prototype mixed reality model was developed in which three-dimensional holograms of musculoskeletal anatomy were superimposed over a physical skeleton model, conferring tactile sensation to the bony attachments of virtually observed muscles. Fifty-three second-year medical students piloted this innovative format and provided feedback on its effectiveness as a learning modality.

Emerging Technologies in Shoulder Arthroplasty: Navigation, Mixed Reality, and Preoperative Planning

Shoulder arthroplasty is a rapidly improving and utilized management for end-stage arthritis that is associated with improved functional outcomes, pain relief, and long-term implant survival. Accurate placement of the glenoid and humeral components is critical for improved outcomes. Traditionally, preoperative planning was limited to radiographs and 2-dimensional computed tomography (CT); however, 3-dimensional CT is becoming more commonly utilized and necessary to understand complex glenoid and humeral deformities. To further increase accurate component placement, intraoperative assistive devices-patient-specific instrumentation, navigation, and mixed reality-minimize malpositioning, increase surgeon accuracy, and maximize fixation. These intraoperative technologies likely represent the future of shoulder arthroplasty.