Making Augmented and Virtual Reality Work for the Plastic Surgeon

Characterizing the untapped potential of virtual reality in plastic and reconstructive surgical training: A systematic review on skill transferability

Virtual reality (VR) integration into surgical education has gained immense traction by invigorating skill-building in ways that are unlike the traditional modes of training. This systematic review unites current literature relevant to VR in surgical education to showcase tool transferability, and subsequent impact on knowledge acquisition, skill development, and technological innovation. This review followed the PRISMA guidelines and included three databases. Among the 1926 studies that were screened, 31 studies met the inclusion criteria. ChatGPT assisted in generating variables for data extraction, and the authors reached unanimous consensus on 13 variables that provided a framework for assessing VR attributes. Surgical simulation was examined in 26 studies (83.9%). VR applications incorporated anatomy visualization (83.9%), procedure planning (67.7%), skills assessment (64.5%), continuous learning (41.9%), haptic feedback (41.9%), research and innovation (41.9%), case-based learning (22.6%), improved skill retention (19.4%), reduction of stress and anxiety (16.1%), and remote learning (12.9%). No instances of VR integration addressed patient communication or team-based training. Novice surgeons benefited the most from VR simulator experience, improving their confidence and accuracy in tackling complex procedural tasks, as well as decision-making efficiency. Enhanced dexterity compared to traditional modes of surgical training was also notable. VR confers significant potential as an adjunctive teaching method in plastic and reconstructive surgery (PRS). Studies demonstrate the utility of virtual simulation in knowledge acquisition and skill development, though they lack targeted approaches for augmenting training related to collaboration and patient communication. Given the underrepresentation of PRS among surgical disciplines regarding VR implementation in surgical education, longitudinal curriculum integration and PRS-specific technologies should be further investigated.

From Augmented to Virtual Reality in Plastic Surgery: Blazing the Trail to a New Frontier

BACKGROUND

 Augmented reality (AR) and virtual reality (VR)-termed mixed reality-have shown promise in the care of operative patients. Currently, AR and VR have well-known applications for craniofacial surgery, specifically in preoperative planning. However, the application of AR/VR technology to other reconstructive challenges has not been widely adopted. Thus, the purpose of this investigation is to outline the current applications of AR and VR in the operative setting.

METHODS

 The literature pertaining to the use of AR/VR technology in the operative setting was examined. Emphasis was placed on the use of mixed reality technology in surgical subspecialities, including plastic surgery, oral and maxillofacial surgery, colorectal surgery, neurosurgery, otolaryngology, neurosurgery, and orthopaedic surgery.

RESULTS

 Presently, mixed reality is widely used in the care of patients requiring complex reconstruction of the craniomaxillofacial skeleton for pre- and intraoperative planning. For upper extremity amputees, there is evidence that VR may be efficacious in the treatment of phantom limb pain. Furthermore, VR has untapped potential as a cost-effective tool for microsurgical education and for training residents on techniques in surgical and nonsurgical aesthetic treatment. There is utility for mixed reality in breast reconstruction for preoperative planning, mapping perforators, and decreasing operative time. VR has well- documented applications in the planning of deep inferior epigastric perforator flaps by creating three-dimensional immersive simulations based on a patient's preoperative computed tomography angiogram.

CONCLUSION

 The benefits of AR and VR are numerous for both patients and surgeons. VR has been shown to increase surgical precision and decrease operative time. Furthermore, it is effective for patient-specific rehearsal which uses the patient's exact anatomical data to rehearse the procedure before performing it on the actual patient. Taken together, AR/VR technology can improve patient outcomes, decrease operative times, and lower the burden of care on both patients and health care institutions.

Examining the Use of VR as a Study Aid for University Students with ADHD

Attention-deficit/hyperactivity disorder (ADHD) is a neurodevelopmental condition characterized by patterns of inattention and impulsivity, which lead to difficulties maintaining concentration and motivation while completing academic tasks. University settings, characterized by a high student-to-staff ratio, make treatments relying on human monitoring challenging. One potential replacement is Virtual Reality (VR) technology, which has shown potential to enhance learning outcomes and promote flow experience. In this study, we investigate the usage of VR with 27 university students with ADHD in an effort to improve their performance in ctableompleting homework, including an exploration of automated feedback via a technology probe. Quantitative results show significant increases in concentration, motivation, and effort levels during these VR sessions and qualitative data offers insight into considerations like comfort and deployment. Together, the results suggest that VR can be a valuable tool in leveling the playing field for university students with ADHD.

Building Your Future Holographic Mentor: Can We Use Mixed Reality Holograms for Visual Spatial Motor Skills Acquisition in Surgical Education?

Learning surgical skills require critical visual-spatial motor skills. Current learning methods employ costly and limited in-person teaching in addition to supplementation by videos, textbooks, and cadaveric labs. Increasingly limited healthcare resources and in-person training has led to growing concerns for skills acquisition of trainees. Recent Mixed Reality (MR) devices offer an attractive solution to these resource barriers by providing three-dimensional holographic representations of reality that mimic in-person experiences in a portable, individualized, and cost-effective form. We developed and evaluated two holographic MR models to explore the feasibility of visual-spatial motor skill acquisition from a technical development, learning, and usability perspective. In our first, a pair of holographic hands were created and projected in front of the trainee, and participants were evaluated on their ability to learn complex hand motions in comparison to traditional methods of video and apprenticeship-based learning. The second model displayed a 3D holographic model of the middle and inner ear with labeled anatomical structures which users could explore and user experience feedback was obtained. Our studies demonstrated that scores between MR and apprenticeship learning were comparable. All felt MR was an effective learning tool and most noted that the MR models were better than existing didactic methods of learning. Identified advantages of MR included the ability to provide true 3D spatial representation, improved visualization of smaller structures in detail by upscaling the models, and improved interactivity. Our results demonstrate that holographic learning is able to mimic in-person learning for visual-spatial motor skills and could be a new effective form of self-directed apprenticeship learning.

Safety and Sustainability: Optimizing Outcomes and Changing Paradigms in Global Health Endeavors

Background

The need to address inequities in global surgical care has garnered increased attention since 2015, after the Lancet Commission on Global Surgery underscored the importance of ensuring safe, accessible, affordable, and timely surgical and anesthetic care. The vast unmet global plastic surgery needs make plastic surgery care essential in reducing the global burden of disease. In the past, many nonprofit organizations undertook humanitarian activities within low- and middle-income countries that were primarily service-provision oriented. The Lancet Commission on Global Surgery report prompted a shift in focus from direct patient care models to sustainable global surgical models. The realization that 33% of deaths worldwide were due to unmet surgical needs led to a global shift of strategy toward the development of local systems, surgical capacity, and a focus on patient safety and quality of care within international global surgery partnerships.

Methods

In this report, the authors explore some of the primary components of sustainable international global surgical partnerships discussed in a recent panel at the American Society of Plastic Surgeons Plastic Surgery The Meeting 2022, titled "Safety and Sustainability Overseas: Optimizing Outcomes and Changing Paradigms in Global Health Endeavors." A literature review elaborating the topics discussed was performed.

Results

This report focuses on cultural competence and humility, international collaboration, and the use of technology and innovation, all of which are needed to promote sustainability and patient safety, within global surgery efforts.

Conclusions

The adoption of these components into international surgical collaborations will lead to greatly enhancing the development and sustainability of mutually beneficial relationships.

Live Virtual Surgery and Virtual Reality in Surgery: Potential Applications in Hand Surgery Education

Accelerated in part by the coronavirus disease 2019 pandemic, medical education has increasingly moved into the virtual sphere in recent years. Virtual surgical education encompasses several domains, including live virtual surgery and virtual and augmented reality. These technologies range in complexity from streaming audio and video of surgeries in real-time to fully immersive virtual simulations of surgery. This article reviews the current use of virtual surgical education and its possible applications in hand surgery. Applications of virtual technologies for preoperative planning and intraoperative guidance, as well as care in underresourced settings, are discussed. The authors describe their experience creating a virtual surgery subinternship with live virtual surgeries. There are many roles virtual technology can have in surgery, and this review explores potential value these technologies may have in hand surgery.

Telemedicine for Gender-Affirming Medical and Surgical Care: A Systematic Review and Call-to-Action

Telemedicine has facilitated the delivery of affordable and accessible health care. However, little has been discussed about its use in gender-affirming care (GAC). Telemedicine has the potential to overcome many barriers encountered by transgender individuals such as limited geographic access to care and financial constraints, which have both been exacerbated by the COVID-19 pandemic. Telemedicine may also enhance opportunities for training in gender-affirming surgery. A systematic review of the literature on telehealth and GAC was performed. Identified uses of telehealth included: an electronic teleconsultation service, a virtual peer health consultation service, and an open online course on LGBT+ rights and health care for health care providers and laypeople. As the medical and health care communities adjust to the new reality of health care, efforts should be made to effectively incorporate telemedicine into GAC.

Intraoperative Navigation in Plastic Surgery with Augmented Reality: A Preclinical Validation Study

BACKGROUND

Augmented reality allows users to visualize and interact with digital images including three-dimensional holograms in the real world. This technology may have value intraoperatively by improving surgical decision-making and precision but relies on the ability to accurately align a hologram to a patient. This study aims to quantify the accuracy with which a hologram of soft tissue can be aligned to a patient and used to guide intervention.

METHODS

A mannequin's face was marked in a standardized fashion with 14 incision patterns in red and nine reference points in blue. A three-dimensional photograph was then taken, converted into a hologram, and uploaded to HoloLens (Verto Studio LLC, San Diego, Calif.), a wearable augmented reality device. The red markings were then erased, leaving only the blue points. The hologram was then viewed through the HoloLens in augmented reality and aligned onto the mannequin. The user then traced the overlaid red markings present on the hologram. Three-dimensional photographs of the newly marked mannequin were then taken and compared with the baseline three-dimensional photographs of the mannequin for accuracy of the red markings. This process was repeated for 15 trials (n = 15).

RESULTS

The accuracy of the augmented reality-guided intervention, when considering all trials, was 1.35 ± 0.24 mm. Markings that were positioned laterally on the face were significantly more difficult to reproduce than those centered around the facial midline.

CONCLUSIONS

Holographic markings can be accurately translated onto a mannequin with an average error of less than 1.4 mm. These data support the notion that augmented reality navigation may be practical and reliable for clinical integration in plastic surgery.

SMaRT Assessment Tool: An Innovative Approach for Objective Assessment of Flap Designs

SUMMARY

The teaching and assessment of ideal surgical markings for local flaps required for optimal aesthetic and functional outcomes remain a challenge in the present era of competency-based surgical education. The authors utilized the bilobed flap for nasal reconstruction as a proof of concept for the development of an innovative objective assessment tool based on statistical shape analysis, with a focus on providing automated, evidence-based, objective, specific, and practical feedback to the learner. The proposed tool is based on Procrustes statistical shape analysis, previously used for the assessment of facial asymmetry in plastic surgery. For performance boundary testing, a series of optimal and suboptimal designs generated in deliberate violation of the established ideals of optimal bilobed flap design were evaluated, and a four-component feedback score of Scale, Mismatch, Rotation, and Translation (SMaRT) was generated. The SMaRT assessment tool demonstrated the capacity to proportionally score a spectrum of designs (n = 36) ranging from subtle to significant variations of optimal, with excellent computational and clinically reasonable performance boundaries. In terms of shape mismatch, changes in SMaRT score also correlated with intended violations in designs away from the ideal flap design. This innovative educational approach could aid in incorporating objective feedback in simulation-based platforms in order to facilitate deliberate practice in flap design, with the potential for adoption in other fields of plastic surgery to automate assessment processes.

Technikgestützte zahnmedizinische Hausbesuche durch nicht-ärztliches Fachpersonal zur Minderung des Ansteckungsrisikos

Ziel des Beitrags ist die Identifikation von Problemen, Meta-Anforderungen und Designprinzipien für den Einsatz von Mixed und Virtual Reality Brillen zur Unterstützung nicht-ärztlichen Fachpersonals bei zahnmedizinischen Hausbesuchen. Im Rahmen von zwei Gruppendiskussionen und einem Experteninterview wurden zunächst mögliche Einsatzszenarien identifiziert. Anschließend wurde eine systematische Literaturrecherche in den Datenbanken CINAHL, Business Source Premier und MEDLINE durchgeführt. In der gefundenen Literatur konnten 14 Probleme bei der Anwendung von Mixed und Virtual Reality Brillen identifiziert werden. Darauf basierend wurden 14 Meta-Anforderungen abgeleitet und in fünf Designprinzipien zusammengefasst. Abschließend wurden die Ergebnisse mit den Spezifikationen der Microsoft HoloLens 2 abgeglichen, um eine Eignung für die Unterstützung der geplanten Hausbesuche festzustellen. Zudem wurde ein Umsetzungskonzept skizziert. Die Ergebnisse dienen als wichtige Empfehlungen für die praxisnahe Umsetzung zukünftiger Konzepte bezüglich der Anwendung von Mixed und Virtual Reality Brillen im (zahn-)medizinischen Kontext. Die Literaturrecherche zeigt eine Forschungslücke im Bereich zahnmedizinischer Hausbesuche auf. Die Ergebnisse dieses Beitrags schaffen daher eine solide Basis für die zukünftige Forschung.

Holographic Augmented Reality for DIEP Flap Harvest

BACKGROUND

During a deep inferior epigastric perforator (DIEP) flap harvest, the identification and localization of the epigastric arteries and its perforators are crucial. Holographic augmented reality is an innovative technique that can be used to visualize this patient-specific anatomy extracted from a computed tomographic scan directly on the patient. This study describes an innovative workflow to achieve this.

METHODS

A software application for the Microsoft HoloLens was developed to visualize the anatomy as a hologram. By using abdominal nevi as natural landmarks, the anatomy hologram is registered to the patient. To ensure that the anatomy hologram remains correctly positioned when the patient or the user moves, real-time patient tracking is obtained with a quick response marker attached to the patient.

RESULTS

Holographic augmented reality can be used to visualize the epigastric arteries and its perforators in preparation for a deep inferior epigastric perforator flap harvest.

CONCLUSIONS

Potentially, this workflow can be used visualize the vessels intraoperatively. Furthermore, this workflow is intuitive to use and could be applied for other flaps or other types of surgery.