Precise positioning of an intraoral distractor using augmented reality in patients with hemifacial microsomia

Augmented Reality as a Telemedicine Platform for Remote Procedural Training

Traditionally, rural areas in many countries are limited by a lack of access to health care due to the inherent challenges associated with recruitment and retention of healthcare professionals. Telemedicine, which uses communication technology to deliver medical services over distance, is an economical and potentially effective way to address this problem. In this research, we develop a new telepresence application using an Augmented Reality (AR) system. We explore the use of the Microsoft HoloLens to facilitate and enhance remote medical training. Intrinsic advantages of AR systems enable remote learners to perform complex medical procedures such as Point of Care Ultrasound (PoCUS) without visual interference. This research uses the HoloLens to capture the first-person view of a simulated rural emergency room (ER) through mixed reality capture (MRC) and serves as a novel telemedicine platform with remote pointing capabilities. The mentor’s hand gestures are captured using a Leap Motion and virtually displayed in the AR space of the HoloLens. To explore the feasibility of the developed platform, twelve novice medical trainees were guided by a mentor through a simulated ultrasound exploration in a trauma scenario, as part of a pilot user study. The study explores the utility of the system from the trainees, mentor, and objective observers’ perspectives and compares the findings to that of a more traditional multi-camera telemedicine solution. The results obtained provide valuable insight and guidance for the development of an AR-supported telemedicine platform.

Robot-Assisted Surgery for Mandibular Angle Split Osteotomy Using Augmented Reality: Preliminary Results on Clinical Animal Experiment

Mandibular angle split osteotomy (MASO) is a procedure widely used for prominent mandibular angles. However, conventional mandibular plastic surgery is invasive and high risk. It may induce postoperative neurosensory disturbance of the inferior alveolar nerve, fractures and infection due to the complexity of the anatomical structure and the narrow surgical field of view. The success rate of MASO surgery usually depends on the clinical experience and skills of the surgeon. To evaluate the performance of inexperienced plastic surgeons conducting this surgery, a self-developed and constructed robot system based on augmented reality is used. This robot system provides for sufficient accuracy and safety within the clinical environment. To evaluate the accuracy and safety of MASO surgery, an animal study using this robot was performed in the clinical room, and the results were then evaluated. Four osteotomy planes were successfully performed on two dogs; that is, twenty tunnels (each dog drilled on bilaterally) were drilled in the dogs' mandible bones. Errors at entrance and target points were 1.04 ± 0.19 and 1.22 ± 0.24 mm, respectively. The angular error between the planned and drilled tunnels was 6.69° ± 1.05°. None of the dogs experienced severe complications. Therefore, this technique can be regarded as a useful approach for training inexperienced plastic surgeons on the various aspects of plastic surgery.

NO LEVEL ASSIGNED

This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to the Table of Contents or the online Instructions to Authors www.springer.com/00266 .

Recent Development of Augmented Reality in Surgery: A Review

INTRODUCTION

The development augmented reality devices allow physicians to incorporate data visualization into diagnostic and treatment procedures to improve work efficiency, safety, and cost and to enhance surgical training. However, the awareness of possibilities of augmented reality is generally low. This review evaluates whether augmented reality can presently improve the results of surgical procedures.

METHODS

We performed a review of available literature dating from 2010 to November 2016 by searching PubMed and Scopus using the terms "augmented reality" and "surgery." Results. The initial search yielded 808 studies. After removing duplicates and including only journal articles, a total of 417 studies were identified. By reading of abstracts, 91 relevant studies were chosen to be included. 11 references were gathered by cross-referencing. A total of 102 studies were included in this review.

CONCLUSIONS

The present literature suggest an increasing interest of surgeons regarding employing augmented reality into surgery leading to improved safety and efficacy of surgical procedures. Many studies showed that the performance of newly devised augmented reality systems is comparable to traditional techniques. However, several problems need to be addressed before augmented reality is implemented into the routine practice.

[Congenital malformations of the temporo-mandibular joint and the mandibular ramus: Grafting vs distraction osteogenesis]

Congenital deformities of the mandibular ramus and of the temporo-mandibular joint are treated by surgery since the early 20th century. However, morphological and functional results are often disappointing, accounting for iterative operations. Today, a clear consensus concerning the type of intervention to be proposed, and at what age it should be carried out does not yet exist. For mild cases, "conventional" orthognathic or osteogenic distraction procedures seem to work well, especially if they are carried out at the end of growth. In severe cases, it is often necessary to proceed in several surgical steps, usually starting with a chondrocostal graft, especially when interceptive surgery, performed before the end of growth, is preferred in order to improve the patient's quality of life.

Precision insertion of percutaneous sacroiliac screws using a novel augmented reality-based navigation system: a pilot study

PURPOSE

Augmented reality (AR) enables superimposition of virtual images onto the real world. The aim of this study is to present a novel AR-based navigation system for sacroiliac screw insertion and to evaluate its feasibility and accuracy in cadaveric experiments.

METHODS

Six cadavers with intact pelvises were employed in our study. They were CT scanned and the pelvis and vessels were segmented into 3D models. The ideal trajectory of the sacroiliac screw was planned and represented visually as a cylinder. For the intervention, the head mounted display created a real-time AR environment by superimposing the virtual 3D models onto the surgeon's field of view. The screws were drilled into the pelvis as guided by the trajectory represented by the cylinder. Following the intervention, a repeat CT scan was performed to evaluate the accuracy of the system, by assessing the screw positions and the deviations between the planned trajectories and inserted screws.

RESULTS

Post-operative CT images showed that all 12 screws were correctly placed with no perforation. The mean deviation between the planned trajectories and the inserted screws was 2.7 ± 1.2 mm at the bony entry point, 3.7 ± 1.1 mm at the screw tip, and the mean angular deviation between the two trajectories was 2.9° ± 1.1°. The mean deviation at the nerve root tunnels region on the sagittal plane was 3.6 ± 1.0 mm.

CONCLUSIONS

This study suggests an intuitive approach for guiding screw placement by way of AR-based navigation. This approach was feasible and accurate. It may serve as a valuable tool for assisting percutaneous sacroiliac screw insertion in live surgery.