1
|
Lee KH, Li M, Varble N, Negussie AH, Kassin MT, Arrichiello A, Carrafiello G, Hazen LA, Wakim PG, Li X, Xu S, Wood BJ. Smartphone Augmented Reality Outperforms Conventional CT Guidance for Composite Ablation Margins in Phantom Models. J Vasc Interv Radiol 2024; 35:452-461.e3. [PMID: 37852601 DOI: 10.1016/j.jvir.2023.10.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2022] [Revised: 09/23/2023] [Accepted: 10/08/2023] [Indexed: 10/20/2023] Open
Abstract
PURPOSE To develop and evaluate a smartphone augmented reality (AR) system for a large 50-mm liver tumor ablation with treatment planning for composite overlapping ablation zones. MATERIALS AND METHODS A smartphone AR application was developed to display tumor, probe, projected probe paths, ablated zones, and real-time percentage of the ablated target tumor volume. Fiducial markers were attached to phantoms and an ablation probe hub for tracking. The system was evaluated with tissue-mimicking thermochromic phantoms and gel phantoms. Four interventional radiologists performed 2 trials each of 3 probe insertions per trial using AR guidance versus computed tomography (CT) guidance approaches in 2 gel phantoms. Insertion points and optimal probe paths were predetermined. On Gel Phantom 2, serial ablated zones were saved and continuously displayed after each probe placement/adjustment, enabling feedback and iterative planning. The percentages of tumor ablated for AR guidance versus CT guidance, and with versus without display of recorded ablated zones, were compared among interventional radiologists with pairwise t-tests. RESULTS The means of percentages of tumor ablated for CT freehand and AR guidance were 36% ± 7 and 47% ± 4 (P = .004), respectively. The mean composite percentages of tumor ablated for AR guidance were 43% ± 1 (without) and 50% ± 2 (with display of ablation zone) (P = .033). There was no strong correlation between AR-guided percentage of ablation and years of experience (r < 0.5), whereas there was a strong correlation between CT-guided percentage of ablation and years of experience (r > 0.9). CONCLUSIONS A smartphone AR guidance system for dynamic iterative large liver tumor ablation was accurate, performed better than conventional CT guidance, especially for less experienced interventional radiologists, and enhanced more standardized performance across experience levels for ablation of a 50-mm tumor.
Collapse
Affiliation(s)
- Katerina H Lee
- McGovern Medical School at UTHealth, Houston, Texas; Center for Interventional Oncology, National Institutes of Health, Bethesda, Maryland
| | - Ming Li
- Center for Interventional Oncology, National Institutes of Health, Bethesda, Maryland
| | - Nicole Varble
- Center for Interventional Oncology, National Institutes of Health, Bethesda, Maryland; Philips Research North America, Cambridge, Massachusetts
| | - Ayele H Negussie
- Center for Interventional Oncology, National Institutes of Health, Bethesda, Maryland
| | - Michael T Kassin
- Center for Interventional Oncology, National Institutes of Health, Bethesda, Maryland
| | - Antonio Arrichiello
- Center for Interventional Oncology, National Institutes of Health, Bethesda, Maryland
| | - Gianpaolo Carrafiello
- Department of Radiology, Foundation IRCCS Ca' Granda Ospedale Maggiore Policlinico, University of Milan, Milan, Italy
| | - Lindsey A Hazen
- Center for Interventional Oncology, National Institutes of Health, Bethesda, Maryland
| | - Paul G Wakim
- Biostatistics and Clinical Epidemiology Service, National Institutes of Health, Bethesda, Maryland
| | - Xiaobai Li
- Biostatistics and Clinical Epidemiology Service, National Institutes of Health, Bethesda, Maryland
| | - Sheng Xu
- Center for Interventional Oncology, National Institutes of Health, Bethesda, Maryland
| | - Bradford J Wood
- Center for Interventional Oncology, National Institutes of Health, Bethesda, Maryland.
| |
Collapse
|
2
|
Jung Y, Muddaluru V, Gandhi P, Pahuta M, Guha D. The Development And Applications Of Augmented And Virtual Reality Technology In Spine Surgery Training: A Systematic Review. Can J Neurol Sci 2024; 51:255-264. [PMID: 37113079 DOI: 10.1017/cjn.2023.46] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/29/2023]
Abstract
BACKGROUND The COVID-19 pandemic has accelerated the growing global interest in the role of augmented and virtual reality in surgical training. While this technology grows at a rapid rate, its efficacy remains unclear. To that end, we offer a systematic review of the literature summarizing the role of virtual and augmented reality on spine surgery training. METHODS A systematic review of the literature was conducted on May 13th, 2022. PubMed, Web of Science, Medline, and Embase were reviewed for relevant studies. Studies from both orthopedic and neurosurgical spine programs were considered. There were no restrictions placed on the type of study, virtual/augmented reality modality, nor type of procedure. Qualitative data analysis was performed, and all studies were assigned a Medical Education Research Study Quality Instrument (MERSQI) score. RESULTS The initial review identified 6752 studies, of which 16 were deemed relevant and included in the final review, examining a total of nine unique augmented/virtual reality systems. These studies had a moderate methodological quality with a MERSQI score of 12.1 + 1.8; most studies were conducted at single-center institutions, and unclear response rates. Statistical pooling of the data was limited by the heterogeneity of the study designs. CONCLUSION This review examined the applications of augmented and virtual reality systems for training residents in various spine procedures. As this technology continues to advance, higher-quality, multi-center, and long-term studies are required to further the adaptation of VR/AR technologies in spine surgery training programs.
Collapse
Affiliation(s)
- Youngkyung Jung
- Department of Medicine, Faculty of Health Sciences, McMaster University, Hamilton, Ontario, Canada
| | | | - Pranjan Gandhi
- Department of Medicine, Faculty of Health Sciences, McMaster University, Hamilton, Ontario, Canada
| | - Markian Pahuta
- Division of Orthopedic Surgery, Hamilton General Hospital, McMaster University, Hamilton, ON, Canada
| | - Daipayan Guha
- Division of Neurosurgery, Hamilton General Hospital, McMaster University, Hamilton, ON, Canada
| |
Collapse
|
3
|
Bailey CR, Herrera DG, Neumeister N, Weiss CR. Magnetic resonance - guided treatment of low-flow vascular malformations and the technologies to potentiate adoption. Front Med (Lausanne) 2024; 11:1319046. [PMID: 38420359 PMCID: PMC10899448 DOI: 10.3389/fmed.2024.1319046] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2023] [Accepted: 01/25/2024] [Indexed: 03/02/2024] Open
Abstract
Vascular malformations are congenital, non-neoplastic lesions that arise secondary to defects in angiogenesis. Vascular malformations are divided into high-flow (arteriovenous malformation) and low-flow (venous malformations and lymphatic malformations). Magnetic resonance imaging (MRI) is the standard for pre-and post-intervention assessments, while ultrasound (US), X-ray fluoroscopy and computed tomography (CT) are used for intra-procedural guidance. Sclerotherapy, an image-guided therapy that involves the injection of a sclerosant directly into the malformation, is typically the first-line therapy for treating low-flow vascular malformations. Sclerotherapy induces endothelial damage and necrosis/fibrosis with eventual involution of the malformation. Image-guided thermal therapies involve freezing or heating target tissue to induce cell death and necrosis. MRI is an alternative for intra-procedural guidance and monitoring during the treatment of vascular malformations. MR can provide dynamic, multiplanar imaging that delineates surrounding critical structures such as nerves and vasculature. Multiple studies have demonstrated that MR-guided treatment of vascular malformations is safe and effective. This review will detail (1) the use of MR for the classification and diagnosis of vascular malformations, (2) the current literature surrounding MR-guided treatment of vascular malformations, (3) a series of cases of MR-guided sclerotherapy and thermal ablation for the treatment of vascular malformations, and (4) a discussion of technologies that may potentiate interventional MRI adoption including high intensity focused ultrasound and guided laser ablation.
Collapse
Affiliation(s)
- Christopher Ravi Bailey
- Department of Radiology and Radiological Science, School of Medicine, Johns Hopkins Medicine, Baltimore, MD, United States
| | - Daniel Giraldo Herrera
- Department of Radiology and Radiological Science, School of Medicine, Johns Hopkins Medicine, Baltimore, MD, United States
| | | | - Clifford Rabbe Weiss
- Department of Radiology and Radiological Science, School of Medicine, Johns Hopkins Medicine, Baltimore, MD, United States
| |
Collapse
|
4
|
Farshad-Amacker NA, Kubik-Huch RA, Kolling C, Leo C, Goldhahn J. Learning how to perform ultrasound-guided interventions with and without augmented reality visualization: a randomized study. Eur Radiol 2023; 33:2927-2934. [PMID: 36350392 PMCID: PMC10017581 DOI: 10.1007/s00330-022-09220-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2022] [Revised: 10/02/2022] [Accepted: 10/09/2022] [Indexed: 11/11/2022]
Abstract
OBJECTIVES Augmented reality (AR), which entails overlay of in situ images onto the anatomy, may be a promising technique for assisting image-guided interventions. The purpose of this study was to investigate and compare the learning experience and performance of untrained operators in puncture of soft tissue lesions, when using AR ultrasound (AR US) compared with standard US (sUS). METHODS Forty-four medical students (28 women, 16 men) who had completed a basic US course, but had no experience with AR US, were asked to perform US-guided biopsies with both sUS and AR US, with a randomized selection of the initial modality. The experimental setup aimed to simulate biopsies of superficial soft tissue lesions, such as for example breast masses in clinical practice, by use of a turkey breast containing olives. Time to puncture(s) and success (yes/no) of the biopsies was documented. All participants completed questionnaires about their coordinative skills and their experience during the training. RESULTS Despite having no experience with the AR technique, time to puncture did not differ significantly between AR US and sUS (median [range]: 17.0 s [6-60] and 14.5 s [5-41], p = 0.16), nor were there any gender-related differences (p = 0.22 and p = 0.50). AR US was considered by 79.5% of the operators to be the more enjoyable means of learning and performing US-guided biopsies. Further, a more favorable learning curve was achieved using AR US. CONCLUSIONS Students considered AR US to be the preferable and more enjoyable modality for learning how to obtain soft tissue biopsies; however, they did not perform the biopsies faster than when using sUS. KEY POINTS • Performance of standard and augmented reality US-guided biopsies was comparable • A more favorable learning curve was achieved using augmented reality US. • Augmented reality US was the preferred technique and was considered more enjoyable.
Collapse
Affiliation(s)
- Nadja A Farshad-Amacker
- Radiology, Balgrist University Hospital, University of Zurich, Forchstrasse 340, 8008, Zurich, Switzerland.
| | - Rahel A Kubik-Huch
- Institute of Radiology, Department of Medical Services, Kantonsspital Baden, Baden, Switzerland
| | - Christoph Kolling
- Institute of Translational Medicine, Department of Health Sciences and Technology, Eidgenössische Technische Hochschule (ETH), Zurich, Switzerland
| | - Cornelia Leo
- Department of Gynaecology and Obstetrics, Kantonsspital Baden, Baden, Switzerland
| | - Jörg Goldhahn
- Institute of Translational Medicine, Department of Health Sciences and Technology, Eidgenössische Technische Hochschule (ETH), Zurich, Switzerland
| |
Collapse
|
5
|
Fong KY, Tan ASM, Bin Sulaiman MS, Leong SH, Ng KW, Too CW. Phantom and Animal Study of a Robot-Assisted, CT-Guided Targeting System using Image-Only Navigation for Stereotactic Needle Insertion without Positional Sensors. J Vasc Interv Radiol 2022; 33:1416-1423.e4. [PMID: 35970505 DOI: 10.1016/j.jvir.2022.08.005] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2022] [Revised: 06/11/2022] [Accepted: 08/05/2022] [Indexed: 12/15/2022] Open
Abstract
PURPOSE To evaluate the feasibility and accuracy of a robotic system to integrate and map computed tomography (CT) and robotic coordinates, followed by automatic trajectory execution by a robotic arm. The system was hypothesized to achieve a targeting error of <5 mm without significant influence from variations in angulation or depth. MATERIALS AND METHODS An experimental study was conducted using a robotic system (Automated Needle Targeting device for CT [ANT-C]) for needle insertions into a phantom model on both moving patient table and moving gantry CT scanners. Eight spherical markers were registered as targets for 90 insertions at different trajectories. After a single ANT-C registration, the closed-loop software targeted multiple markers via the insertion of robotically aligned 18-gauge needles. Accuracy (distance from the needle tip to the target) was assessed by postinsertion CT scans. Similar procedures were repeated to guide 10 needle insertions into a porcine lung. A regression analysis was performed to test the effect of needle angulation and insertion depth on the accuracy of insertion. RESULTS In the phantom model, all needle insertions (median trajectory depth, 64.8 mm; range, 46.1-153 mm) were successfully performed in single attempts. The overall accuracy was 1.36 mm ± 0.53, which did not differ between the 2 types of CT scanners (1.39 mm ± 0.54 [moving patient table CT] vs 1.33 mm ± 0.52 [moving gantry CT]; P = .54) and was not significantly affected by the needle angulation and insertion depth. The accuracy for the porcine model was 9.09 mm ± 4.21. CONCLUSIONS Robot-assisted needle insertion using the ANT-C robotic device was feasible and accurate for targeting multiple markers in a phantom model.
Collapse
Affiliation(s)
- Khi Yung Fong
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore
| | - Alexander Sheng Ming Tan
- Department of Vascular and Interventional Radiology, Singapore General Hospital, Singapore; Radiological Sciences Academic Clinical Program, SingHealth-Duke-NUS Academic Medical Centre, Singapore
| | | | | | - Ka Wei Ng
- NDR Medical Technology Pvt Ltd, Singapore
| | - Chow Wei Too
- Department of Vascular and Interventional Radiology, Singapore General Hospital, Singapore; Radiological Sciences Academic Clinical Program, SingHealth-Duke-NUS Academic Medical Centre, Singapore.
| |
Collapse
|
6
|
Suzuki K, Morita S, Endo K, Yamamoto T, Sakai S. Noncontact measurement of puncture needle angle using augmented reality technology in computed tomography-guided biopsy: stereotactic coordinate design and accuracy evaluation. Int J Comput Assist Radiol Surg 2022; 17:745-750. [PMID: 35190975 DOI: 10.1007/s11548-022-02572-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2021] [Accepted: 01/26/2022] [Indexed: 11/26/2022]
Abstract
PURPOSE This study aims to introduce a new handheld device application for noncontact and real-time measurements of the angle of a biopsy needle using augmented reality (AR) image tracking technology. Furthermore, this study discusses the methods used to optimize the related coordinate design for computed tomography (CT)-guided biopsy procedures. METHODS An in-house noncontact angle measurement application was developed using AR platform software. This application tracks the position and direction of a printed texture located on the handle of a biopsy needle. The needle direction was factorized into two directions: tilting or rolling. Tilting was defined following the tilting of the CT gantry so that rolling would match the angle measured in CT images. In this study, CT-guided tumor biopsies were performed using a conventional guiding method with a protractor. The true value of needle rolling was measured by CT imaging and was then compared to the rolling measurement provided by the application developed in the current study using a mobile phone. RESULTS This study enrolled 18 cases of tumor biopsy (five renal tumors, five lung tumors, four retroperitoneal tumors, one soft tissue tumor, one thyroid tumor, one mesentery tumor, and one bone tumor). The measurement accuracy was - 0.2°, which was the average difference between AR and CT, and the measurement precision was 2.0°, which was the standard deviation of the difference between AR and CT measurements. The coefficient of determination (R2) was 0.996. CONCLUSION The noncontact needle measurement software using AR technology is sufficiently reliable for use in clinical settings. A real-time display of the needle angle that also shows the direction of the CT gantry is expected to enable a simple biopsy needle navigation.
Collapse
Affiliation(s)
- Kazufumi Suzuki
- Department of Diagnostic Imaging and Nuclear Medicine, Tokyo Women's Medical University, 8-1, Kawada-cho, Shinjuku-ku, Tokyo, 162-8666, Japan.
| | - Satoru Morita
- Department of Diagnostic Imaging and Nuclear Medicine, Tokyo Women's Medical University, 8-1, Kawada-cho, Shinjuku-ku, Tokyo, 162-8666, Japan
| | - Kenji Endo
- Department of Diagnostic Imaging and Nuclear Medicine, Tokyo Women's Medical University, 8-1, Kawada-cho, Shinjuku-ku, Tokyo, 162-8666, Japan
| | - Takahiro Yamamoto
- Department of Diagnostic Imaging and Nuclear Medicine, Tokyo Women's Medical University, 8-1, Kawada-cho, Shinjuku-ku, Tokyo, 162-8666, Japan
| | - Shuji Sakai
- Department of Diagnostic Imaging and Nuclear Medicine, Tokyo Women's Medical University, 8-1, Kawada-cho, Shinjuku-ku, Tokyo, 162-8666, Japan
| |
Collapse
|
7
|
Franson D, Dupuis A, Gulani V, Griswold M, Seiberlich N. A System for Real-Time, Online Mixed-Reality Visualization of Cardiac Magnetic Resonance Images. J Imaging 2021; 7:jimaging7120274. [PMID: 34940741 PMCID: PMC8709155 DOI: 10.3390/jimaging7120274] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2021] [Revised: 12/07/2021] [Accepted: 12/09/2021] [Indexed: 11/16/2022] Open
Abstract
Image-guided cardiovascular interventions are rapidly evolving procedures that necessitate imaging systems capable of rapid data acquisition and low-latency image reconstruction and visualization. Compared to alternative modalities, Magnetic Resonance Imaging (MRI) is attractive for guidance in complex interventional settings thanks to excellent soft tissue contrast and large fields-of-view without exposure to ionizing radiation. However, most clinically deployed MRI sequences and visualization pipelines exhibit poor latency characteristics, and spatial integration of complex anatomy and device orientation can be challenging on conventional 2D displays. This work demonstrates a proof-of-concept system linking real-time cardiac MR image acquisition, online low-latency reconstruction, and a stereoscopic display to support further development in real-time MR-guided intervention. Data are acquired using an undersampled, radial trajectory and reconstructed via parallelized through-time radial generalized autocalibrating partially parallel acquisition (GRAPPA) implemented on graphics processing units. Images are rendered for display in a stereoscopic mixed-reality head-mounted display. The system is successfully tested by imaging standard cardiac views in healthy volunteers. Datasets comprised of one slice (46 ms), two slices (92 ms), and three slices (138 ms) are collected, with the acquisition time of each listed in parentheses. Images are displayed with latencies of 42 ms/frame or less for all three conditions. Volumetric data are acquired at one volume per heartbeat with acquisition times of 467 ms and 588 ms when 8 and 12 partitions are acquired, respectively. Volumes are displayed with a latency of 286 ms or less. The faster-than-acquisition latencies for both planar and volumetric display enable real-time 3D visualization of the heart.
Collapse
Affiliation(s)
- Dominique Franson
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH 44106, USA;
- Correspondence: (D.F.); (A.D.)
| | - Andrew Dupuis
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH 44106, USA;
- Correspondence: (D.F.); (A.D.)
| | - Vikas Gulani
- Department of Radiology, University of Michigan, Ann Arbor, MI 48109, USA; (V.G.); (N.S.)
| | - Mark Griswold
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH 44106, USA;
- Department of Radiology, Case Western Reserve University, Cleveland, OH 44106, USA
| | - Nicole Seiberlich
- Department of Radiology, University of Michigan, Ann Arbor, MI 48109, USA; (V.G.); (N.S.)
| |
Collapse
|
8
|
Multiple sclerosis image-guided subcutaneous injections using augmented reality guided imagery. COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING: IMAGING & VISUALIZATION 2021. [DOI: 10.1080/21681163.2020.1834879] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
9
|
Cardan R, Covington EL, Popple R. A Holographic Augmented Reality Guidance System for Patient Alignment: A Feasibility Study. Cureus 2021; 13:e14695. [PMID: 34055539 PMCID: PMC8153089 DOI: 10.7759/cureus.14695] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/16/2022] Open
Abstract
Purpose To evaluate the accuracy of an augmented reality holographic guidance system for potential use in patient alignment in radiotherapy applications. Methods A cubic phantom was scanned on a CT simulator and a 3D mesh was extracted using the Eclipse Scripting API. An application was created for the Microsoft HoloLens to allow users to see the scanned mesh as a hologram overlaid in the treatment vault. Six therapists were equipped with the HoloLens glasses and instructed to move the real phantom to align with the perceived spatial hologram using only couch controls. The initial couch coordinates were recorded and then recorded at each step as the therapist moved the phantom to each new location. The application varied the position of the virtual phantom to 10 preprogrammed locations within a 40-cm cubic volume in a combination of vertical, longitudinal, and lateral axis shifts. The absolute position difference between the holographic world and real-world phantom was recorded at each step. Also, the relative position from one position to the next was recorded. Results Fifty shifts were collected across the six therapists. The mean difference between the physical position and instructed holographic position was 0.58 ± 0.31 cm for relative shifts and 0.51 ± 0.33 cm for absolute position. The maximum difference between the holographic position and the actual post shift position was 1.53 cm for relative and 1.58 cm for absolute. Conclusion Holographic augmented reality guidance using the Microsoft HoloLens provides adequate accuracy for initial treatment alignment but lacks the fine alignment accuracy of X-ray imaging systems.
Collapse
Affiliation(s)
- Rex Cardan
- Radiation Oncology, University of Alabama at Birmingham, Birmingham, USA
| | | | - Richard Popple
- Radiation Oncology, University of Alabama at Birmingham, Birmingham, USA
| |
Collapse
|
10
|
Okamoto S, Matsui Y, Hiraki T, Iguchi T, Komaki T, Yamauchi T, Uka M, Tomita K, Sakurai J, Gobara H, Kanazawa S. Needle artifact characteristics and insertion accuracy using a 1.2T open MRI scanner: A phantom study. Diagn Interv Imaging 2021; 102:363-370. [PMID: 33518449 DOI: 10.1016/j.diii.2020.12.007] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2020] [Revised: 12/23/2020] [Accepted: 12/28/2020] [Indexed: 01/20/2023]
Abstract
PURPOSE To evaluate the characteristics of needle artifacts and the accuracy of needle insertion using a 1.2 Tesla open magnetic resonance imaging (MRI) system in a phantom. MATERIALS AND METHODS First, the apparent width of the needle on the MRI and the needle tip position error of 16- and 18-gauge MRI-compatible introducer needles and a 17-gauge cryoneedle were examined with different needle angles (0°, 30°, 45°, 60°, and 90°) to the main magnetic field (B0), sequence types (balanced steady-state acquisition with rewound gradient echo [BASG] and T2-weighted fast spin echo [FSE] sequence), and frequency encoding directions. Second, the accuracy of needle insertion was evaluated after 10 MRI fluoroscopy-guided insertions in a phantom. RESULTS The apparent needle widths was larger when the angle of the needle axis relative to B0 was larger. The needles appeared larger on BASG than on T2-weighted FSE images, with the largest apparent widths of 16-, 17-, and 18-gauge needles of 14.3, 11.6, and 11.0mm, respectively. The apparent needle tip position was always more distal than the actual position on BASG images, with the largest longitudinal error of 4.0mm. Meanwhile, the 16- and 18-gauge needle tips appeared more proximal on T2-weighted FSE images with right-to-left frequency encoding direction. The mean accuracy of MRI fluoroscopy-guided needle insertion was 3.1mm. CONCLUSION These experiments clarify the characteristics of needle artifacts in a 1.2 Tesla open MRI. With this system, the MRI fluoroscopy-guided needle insertion demonstrated an acceptable accuracy for clinical use.
Collapse
Affiliation(s)
- Soichiro Okamoto
- Department of Radiology, Okayama University Medical School, 2-5-1 Shikatacho, Kitaku, Okayama 700-8558, Japan
| | - Yusuke Matsui
- Department of Radiology, Okayama University Medical School, 2-5-1 Shikatacho, Kitaku, Okayama 700-8558, Japan.
| | - Takao Hiraki
- Department of Radiology, Okayama University Medical School, 2-5-1 Shikatacho, Kitaku, Okayama 700-8558, Japan
| | - Toshihiro Iguchi
- Department of Radiology, Okayama University Medical School, 2-5-1 Shikatacho, Kitaku, Okayama 700-8558, Japan
| | - Toshiyuki Komaki
- Department of Radiology, Okayama University Medical School, 2-5-1 Shikatacho, Kitaku, Okayama 700-8558, Japan
| | - Takatsugu Yamauchi
- Central Division of Radiology, Okayama University Hospital, 2-5-1 Shikatacho, Kitaku, Okayama 700-8558, Japan
| | - Mayu Uka
- Department of Radiology, Okayama University Medical School, 2-5-1 Shikatacho, Kitaku, Okayama 700-8558, Japan
| | - Koji Tomita
- Department of Radiology, Okayama University Medical School, 2-5-1 Shikatacho, Kitaku, Okayama 700-8558, Japan
| | - Jun Sakurai
- Center for Innovative Clinical Medicine, Okayama University Hospital, 2-5-1 Shikatacho, Kitaku, Okayama 700-8558, Japan
| | - Hideo Gobara
- Division of Medical Informatics, Okayama University Hospital, 2-5-1 Shikatacho, Kitaku, 700-8558, Okayama, Japan
| | - Susumu Kanazawa
- Department of Radiology, Okayama University Medical School, 2-5-1 Shikatacho, Kitaku, Okayama 700-8558, Japan
| |
Collapse
|
11
|
Heinrich F, Schwenderling L, Joeres F, Lawonn K, Hansen C. Comparison of Augmented Reality Display Techniques to Support Medical Needle Insertion. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2020; 26:3568-3575. [PMID: 33006930 DOI: 10.1109/tvcg.2020.3023637] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Augmented reality (AR) may be a useful technique to overcome issues of conventionally used navigation systems supporting medical needle insertions, like increased mental workload and complicated hand-eye coordination. Previous research primarily focused on the development of AR navigation systems designed for specific displaying devices, but differences between employed methods have not been investigated before. To this end, a user study involving a needle insertion task was conducted comparing different AR display techniques with a monitor-based approach as baseline condition for the visualization of navigation information. A video see-through stationary display, an optical see-through head-mounted display and a spatial AR projector-camera-system were investigated in this comparison. Results suggest advantages of using projected navigation information in terms of lower task completion time, lower angular deviation and affirmative subjective participant feedback. Techniques requiring the intermediate view on screens, i.e. the stationary display and the baseline condition, showed less favorable results. Thus, benefits of providing AR navigation information compared to a conventionally used method could be identified. Significant objective measures results, as well as an identification of advantages and disadvantages of individual display techniques contribute to the development and design of improved needle navigation systems.
Collapse
|
12
|
Li M, Seifabadi R, Long D, De Ruiter Q, Varble N, Hecht R, Negussie AH, Krishnasamy V, Xu S, Wood BJ. Smartphone- versus smartglasses-based augmented reality (AR) for percutaneous needle interventions: system accuracy and feasibility study. Int J Comput Assist Radiol Surg 2020; 15:1921-1930. [PMID: 32734314 DOI: 10.1007/s11548-020-02235-7] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2020] [Accepted: 07/14/2020] [Indexed: 11/26/2022]
Abstract
PURPOSE To compare the system accuracy and needle placement performance of smartphone- and smartglasses-based augmented reality (AR) for percutaneous needle interventions. METHODS An AR platform was developed to enable the superimposition of annotated anatomy and a planned needle trajectory onto a patient in real time. The system accuracy of the AR display on smartphone (iPhone7) and smartglasses (HoloLens1) devices was evaluated on a 3D-printed phantom. The target overlay error was measured as the distance between actual and virtual targets (n = 336) on the AR display, derived from preprocedural CT. The needle overlay angle was measured as the angular difference between actual and virtual needles (n = 12) on the AR display. Three operators each used the iPhone (n = 8), HoloLens (n = 8) and CT-guided freehand (n = 8) to guide needles into targets in a phantom. Needle placement error was measured with post-placement CT. Needle placement time was recorded from needle puncture to navigation completion. RESULTS The target overlay error of the iPhone was comparable to the HoloLens (1.75 ± 0.59 mm, 1.74 ± 0.86 mm, respectively, p = 0.9). The needle overlay angle of the iPhone and HoloLens was similar (0.28 ± 0.32°, 0.41 ± 0.23°, respectively, p = 0.26). The iPhone-guided needle placements showed reduced error compared to the HoloLens (2.58 ± 1.04 mm, 3.61 ± 2.25 mm, respectively, p = 0.05) and increased time (87 ± 17 s, 71 ± 27 s, respectively, p = 0.02). Both AR devices reduced placement error compared to CT-guided freehand (15.92 ± 8.06 mm, both p < 0.001). CONCLUSION An augmented reality platform employed on smartphone and smartglasses devices may provide accurate display and navigation guidance for percutaneous needle-based interventions.
Collapse
Affiliation(s)
- Ming Li
- Center for Interventional Oncology, Radiology and Imaging Sciences, Clinical Center, National Institutes of Health, Bethesda, MD, 20892, USA.
| | - Reza Seifabadi
- Center for Interventional Oncology, Radiology and Imaging Sciences, Clinical Center, National Institutes of Health, Bethesda, MD, 20892, USA
| | - Dilara Long
- Center for Interventional Oncology, Radiology and Imaging Sciences, Clinical Center, National Institutes of Health, Bethesda, MD, 20892, USA
| | - Quirina De Ruiter
- Center for Interventional Oncology, Radiology and Imaging Sciences, Clinical Center, National Institutes of Health, Bethesda, MD, 20892, USA
| | - Nicole Varble
- Center for Interventional Oncology, Radiology and Imaging Sciences, Clinical Center, National Institutes of Health, Bethesda, MD, 20892, USA
- Philips Research of North America, Cambridge, MA, USA
| | - Rachel Hecht
- Center for Interventional Oncology, Radiology and Imaging Sciences, Clinical Center, National Institutes of Health, Bethesda, MD, 20892, USA
| | - Ayele H Negussie
- Center for Interventional Oncology, Radiology and Imaging Sciences, Clinical Center, National Institutes of Health, Bethesda, MD, 20892, USA
| | - Venkatesh Krishnasamy
- Center for Interventional Oncology, Radiology and Imaging Sciences, Clinical Center, National Institutes of Health, Bethesda, MD, 20892, USA
| | - Sheng Xu
- Center for Interventional Oncology, Radiology and Imaging Sciences, Clinical Center, National Institutes of Health, Bethesda, MD, 20892, USA
| | - Bradford J Wood
- Center for Interventional Oncology, Radiology and Imaging Sciences, Clinical Center, National Institutes of Health, Bethesda, MD, 20892, USA
| |
Collapse
|
13
|
Pan L, Valdeig S, Kägebein U, Qing K, Fetics B, Roth A, Nevo E, Hensen B, Weiss CR, Wacker FK. Integration and evaluation of a gradient-based needle navigation system for percutaneous MR-guided interventions. PLoS One 2020; 15:e0236295. [PMID: 32706813 PMCID: PMC7380643 DOI: 10.1371/journal.pone.0236295] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2020] [Accepted: 07/01/2020] [Indexed: 12/22/2022] Open
Abstract
The purpose of the present study was to integrate an interactive gradient-based needle navigation system and to evaluate the feasibility and accuracy of the system for real-time MR guided needle puncture in a multi-ring phantom and in vivo in a porcine model. The gradient-based navigation system was implemented in a 1.5T MRI. An interactive multi-slice real-time sequence was modified to provide the excitation gradients used by two sets of three orthogonal pick-up coils integrated into a needle holder. Position and orientation of the needle holder were determined and the trajectory was superimposed on pre-acquired MR images. A gel phantom with embedded ring targets was used to evaluate accuracy using 3D distance from needle tip to target. Six punctures were performed in animals to evaluate feasibility, time, overall error (target to needle tip) and system error (needle tip to the guidance needle trajectory) in vivo. In the phantom experiments, the overall error was 6.2±2.9 mm (mean±SD) and 4.4±1.3 mm, respectively. In the porcine model, the setup time ranged from 176 to 204 seconds, the average needle insertion time was 96.3±40.5 seconds (min: 42 seconds; max: 154 seconds). The overall error and the system error was 8.8±7.8 mm (min: 0.8 mm; max: 20.0 mm) and 3.3±1.4 mm (min: 1.8 mm; max: 5.2 mm), respectively.
Collapse
Affiliation(s)
- Li Pan
- Siemens Healthineers, Baltimore, MD, United States of America
| | - Steffi Valdeig
- Department of Radiology and Radiological Science, Johns Hopkins University, Baltimore, MD, United States of America
| | - Urte Kägebein
- Department of Radiology, Hannover Medical School, Hannover, Germany
- STIMULATE–Research Campus: Solution Centre for Image Guided Local Therapies, Magdeburg, Germany
| | - Kun Qing
- Department of Radiology and Medical Imaging, University of Virginia, Charlottesville, VA, United States of America
- Siemens Corporate Technology, Baltimore, MD, United States of America
| | - Barry Fetics
- Robin Medical Inc., Baltimore, MD, United States of America
| | - Amir Roth
- Robin Medical Inc., Baltimore, MD, United States of America
| | - Erez Nevo
- Robin Medical Inc., Baltimore, MD, United States of America
| | - Bennet Hensen
- Department of Radiology, Hannover Medical School, Hannover, Germany
- STIMULATE–Research Campus: Solution Centre for Image Guided Local Therapies, Magdeburg, Germany
- * E-mail:
| | - Clifford R. Weiss
- Department of Radiology and Radiological Science, Johns Hopkins University, Baltimore, MD, United States of America
| | - Frank K. Wacker
- Department of Radiology, Hannover Medical School, Hannover, Germany
- STIMULATE–Research Campus: Solution Centre for Image Guided Local Therapies, Magdeburg, Germany
| |
Collapse
|
14
|
Park BJ, Hunt SJ, Martin C, Nadolski GJ, Wood BJ, Gade TP. Augmented and Mixed Reality: Technologies for Enhancing the Future of IR. J Vasc Interv Radiol 2020; 31:1074-1082. [PMID: 32061520 DOI: 10.1016/j.jvir.2019.09.020] [Citation(s) in RCA: 52] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2019] [Revised: 08/01/2019] [Accepted: 09/20/2019] [Indexed: 10/25/2022] Open
Abstract
Augmented and mixed reality are emerging interactive and display technologies. These technologies are able to merge virtual objects, in either 2 or 3 dimensions, with the real world. Image guidance is the cornerstone of interventional radiology. With augmented or mixed reality, medical imaging can be more readily accessible or displayed in actual 3-dimensional space during procedures to enhance guidance, at times when this information is most needed. In this review, the current state of these technologies is addressed followed by a fundamental overview of their inner workings and challenges with 3-dimensional visualization. Finally, current and potential future applications in interventional radiology are highlighted.
Collapse
Affiliation(s)
- Brian J Park
- Department of Interventional Radiology, Hospital of the University of Pennsylvania, 3400 Spruce Street, Philadelphia, PA 19104.
| | - Stephen J Hunt
- Department of Interventional Radiology, Hospital of the University of Pennsylvania, 3400 Spruce Street, Philadelphia, PA 19104
| | - Charles Martin
- Department of Interventional Radiology, Cleveland Clinic, Cleveland, Ohio
| | - Gregory J Nadolski
- Department of Interventional Radiology, Hospital of the University of Pennsylvania, 3400 Spruce Street, Philadelphia, PA 19104
| | - Bradford J Wood
- Interventional Radiology, National Institutes of Health, Bethesda, Maryland
| | - Terence P Gade
- Department of Interventional Radiology, Hospital of the University of Pennsylvania, 3400 Spruce Street, Philadelphia, PA 19104
| |
Collapse
|
15
|
Smartphone Augmented Reality CT-Based Platform for Needle Insertion Guidance: A Phantom Study. Cardiovasc Intervent Radiol 2020; 43:756-764. [DOI: 10.1007/s00270-019-02403-6] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/21/2019] [Accepted: 12/21/2019] [Indexed: 01/06/2023]
|
16
|
Heinrich F, Joeres F, Lawonn K, Hansen C. Comparison of Projective Augmented Reality Concepts to Support Medical Needle Insertion. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2019; 25:2157-2167. [PMID: 30892210 DOI: 10.1109/tvcg.2019.2903942] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Augmented reality (AR) is a promising tool to improve instrument navigation in needle-based interventions. Limited research has been conducted regarding suitable navigation visualizations. In this work, three navigation concepts based on existing approaches were compared in a user study using a projective AR setup. Each concept was implemented with three different scales for accuracy-to-color mapping and two methods of navigation indicator scaling. Participants were asked to perform simulated needle insertion tasks with each of the resulting 18 prototypes. Insertion angle and insertion depth accuracies were measured and analyzed, as well as task completion time and participants' subjectively perceived task difficulty. Results show a clear ranking of visualization concepts across variables. Less consistent results were obtained for the color and indicator scaling factors. Results suggest that logarithmic indicator scaling achieved better accuracy, but participants perceived it to be more difficult than linear scaling. With specific results for angle and depth accuracy, our study contributes to the future composition of improved navigation support and systems for precise needle insertion or similar applications.
Collapse
|
17
|
Abstract
OBJECTIVES The aim of this study was to assess feasibility and accuracy of augmented reality-guided lumbar facet joint injections. MATERIALS AND METHODS A spine phantom completely embedded in hardened opaque agar with 3 ring markers was built. A 3-dimensional model of the phantom was uploaded to an augmented reality headset (Microsoft HoloLens). Two radiologists independently performed 20 augmented reality-guided and 20 computed tomography (CT)-guided facet joint injections each: for each augmented reality-guided injection, the hologram was manually aligned with the phantom container using the ring markers. The radiologists targeted the virtual facet joint and tried to place the needle tip in the holographic joint space. Computed tomography was performed after each needle placement to document final needle tip position. Time needed from grabbing the needle to final needle placement was measured for each simulated injection. An independent radiologist rated images of all needle placements in a randomized order blinded to modality (augmented reality vs CT) and performer as perfect, acceptable, incorrect, or unsafe. Accuracy and time to place needles were compared between augmented reality-guided and CT-guided facet joint injections. RESULTS In total, 39/40 (97.5%) of augmented reality-guided needle placements were either perfect or acceptable compared with 40/40 (100%) CT-guided needle placements (P = 0.5). One augmented reality-guided injection missed the facet joint space by 2 mm. No unsafe needle placements occurred. Time to final needle placement was substantially faster with augmented reality guidance (mean 14 ± 6 seconds vs 39 ± 15 seconds, P < 0.001 for both readers). CONCLUSIONS Augmented reality-guided facet joint injections are feasible and accurate without potentially harmful needle placement in an experimental setting.
Collapse
|
18
|
Kägebein U, Godenschweger F, Armstrong BSR, Rose G, Wacker FK, Speck O, Hensen B. Percutaneous MR-guided interventions using an optical Moiré Phase tracking system: Initial results. PLoS One 2018; 13:e0205394. [PMID: 30325955 PMCID: PMC6191114 DOI: 10.1371/journal.pone.0205394] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2018] [Accepted: 09/25/2018] [Indexed: 02/05/2023] Open
Abstract
The aim of this study was the development and evaluation of a real-time guidance support using optical Moiré Phase Tracking (MPT) for magnetic resonance (MR) guided percutaneous interventions. A gradient echo sequence, capable of real-time position updates by the MPT system, was modified to enable needle guidance based on four rigidly attached MPT markers at the back of a needle. Two perpendicular imaging planes were automatically aligned along the calibrated needle and centered at its tip. For user guidance, additional information about the needle trajectory and the tip to target distance were added as image overlay. Both, images and guiding information were displayed on the in-room monitor to facilitate MR guided interventions. The guidance support was evaluated by four experienced interventional radiologists and four novices targeting rubber O-rings embedded in a custom-made phantom on a 3T wide-bore MRI system (80 punctures). The skin to target time, user error, system error and total error were analyzed. The mean skin to target time was 146s±68s with no statistically significant difference between experts and novices. A low mean user error (0.91mm±0.43mm), system error (0.53mm±0.27mm) and total error (0.99mm±0.47mm) was reached in all directions. No statistically significant difference in user error, system error and total error could be found between experts and novices. The presented tracking and image guidance system combined with the user interface offers continuous and interactive control of the imaging plane while puncturing in the magnet enabling accurate real-time feedback for both, experienced and non-experienced users.
Collapse
Affiliation(s)
- Urte Kägebein
- Department of Diagnostic and Interventional Radiology, Hannover Medical School, Hannover, Germany
- Department Biomedical Magnetic Resonance, Otto-von-Guericke University Magdeburg, Magdeburg, Germany
- STIMULATE – Solution Centre for Image Guided Local Therapies, Magdeburg, Germany
- * E-mail:
| | - Frank Godenschweger
- Department Biomedical Magnetic Resonance, Otto-von-Guericke University Magdeburg, Magdeburg, Germany
| | - Brian S. R. Armstrong
- Department of Electrical Engineering, University of Wisconsin Milwaukee, Milwaukee, Wisconsin, United States of America
| | - Georg Rose
- STIMULATE – Solution Centre for Image Guided Local Therapies, Magdeburg, Germany
- Chair in Healthcare Telematics and Medical Engineering, Otto-von-Guericke University Magdeburg, Magdeburg, Germany
| | - Frank K. Wacker
- Department of Diagnostic and Interventional Radiology, Hannover Medical School, Hannover, Germany
- STIMULATE – Solution Centre for Image Guided Local Therapies, Magdeburg, Germany
| | - Oliver Speck
- Department Biomedical Magnetic Resonance, Otto-von-Guericke University Magdeburg, Magdeburg, Germany
- STIMULATE – Solution Centre for Image Guided Local Therapies, Magdeburg, Germany
| | - Bennet Hensen
- Department of Diagnostic and Interventional Radiology, Hannover Medical School, Hannover, Germany
- STIMULATE – Solution Centre for Image Guided Local Therapies, Magdeburg, Germany
| |
Collapse
|
19
|
Mewes A, Heinrich F, Hensen B, Wacker F, Lawonn K, Hansen C. Concepts for augmented reality visualisation to support needle guidance inside the MRI. Healthc Technol Lett 2018; 5:172-176. [PMID: 30464849 PMCID: PMC6222244 DOI: 10.1049/htl.2018.5076] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2018] [Accepted: 08/20/2018] [Indexed: 11/20/2022] Open
Abstract
During MRI-guided interventions, navigation support is often separated from the operating field on displays, which impedes the interpretation of positions and orientations of instruments inside the patient's body as well as hand–eye coordination. To overcome these issues projector-based augmented reality can be used to support needle guidance inside the MRI bore directly in the operating field. The authors present two visualisation concepts for needle navigation aids which were compared in an accuracy and usability study with eight participants, four of whom were experienced radiologists. The results show that both concepts are equally accurate (\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{upgreek}
\usepackage{mathrsfs}
\setlength{\oddsidemargin}{-69pt}
\begin{document}
}{}$2.0 \pm 0.6$\end{document}2.0±0.6 and \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{upgreek}
\usepackage{mathrsfs}
\setlength{\oddsidemargin}{-69pt}
\begin{document}
}{}$1.7 \pm 0.5\, {\rm mm}$\end{document}1.7±0.5mm), useful and easy to use, with clear visual feedback about the state and success of the needle puncture. For easier clinical applicability, a dynamic projection on moving surfaces and organ movement tracking are needed. For now, tests with patients with respiratory arrest are feasible.
Collapse
Affiliation(s)
- André Mewes
- Faculty of Computer Science, Otto-von-Guericke University Magdeburg, Germany.,Research Campus STIMULATE, Otto-von-Guericke University Magdeburg, Germany
| | - Florian Heinrich
- Faculty of Computer Science, Otto-von-Guericke University Magdeburg, Germany.,Research Campus STIMULATE, Otto-von-Guericke University Magdeburg, Germany
| | - Bennet Hensen
- Research Campus STIMULATE, Otto-von-Guericke University Magdeburg, Germany.,Institute of Diagnostic and Interventional Radiology, Hanover Medical School, Germany
| | - Frank Wacker
- Research Campus STIMULATE, Otto-von-Guericke University Magdeburg, Germany.,Institute of Diagnostic and Interventional Radiology, Hanover Medical School, Germany
| | - Kai Lawonn
- Faculty of Computer Science, University of Koblenz-Landau, Germany
| | - Christian Hansen
- Faculty of Computer Science, Otto-von-Guericke University Magdeburg, Germany.,Research Campus STIMULATE, Otto-von-Guericke University Magdeburg, Germany
| |
Collapse
|
20
|
Mewes A, Heinrich F, Kägebein U, Hensen B, Wacker F, Hansen C. Projector-based augmented reality system for interventional visualization inside MRI scanners. Int J Med Robot 2018; 15:e1950. [DOI: 10.1002/rcs.1950] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2017] [Revised: 07/11/2018] [Accepted: 08/01/2018] [Indexed: 11/09/2022]
Affiliation(s)
- André Mewes
- Faculty of Computer Science; Otto von Guericke University Magdeburg; Magdeburg Germany
| | - Florian Heinrich
- Faculty of Computer Science; Otto von Guericke University Magdeburg; Magdeburg Germany
| | - Urte Kägebein
- Faculty of Computer Science; Otto von Guericke University Magdeburg; Magdeburg Germany
| | - Bennet Hensen
- Institute of Diagnostic and Interventional Radiology; Hannover Medical School; Hanover Germany
| | - Frank Wacker
- Institute of Diagnostic and Interventional Radiology; Hannover Medical School; Hanover Germany
| | - Christian Hansen
- Faculty of Computer Science; Otto von Guericke University Magdeburg; Magdeburg Germany
| |
Collapse
|
21
|
Madrigal E. Commentary: What Can Augmented Reality Do for You? J Pathol Inform 2018; 9:22. [PMID: 30034920 PMCID: PMC6029011 DOI: 10.4103/jpi.jpi_22_18] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2018] [Accepted: 05/10/2018] [Indexed: 11/27/2022] Open
Affiliation(s)
- Emilio Madrigal
- Department of Pathology, Emory University Hospital, Atlanta, GA 30322, USA
| |
Collapse
|
22
|
Augmented and Virtual Reality Navigation for Interventions in the Musculoskeletal System. CURRENT RADIOLOGY REPORTS 2018. [DOI: 10.1007/s40134-018-0293-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/05/2023]
|
23
|
Dey A, Billinghurst M, Lindeman RW, Swan JE. A Systematic Review of 10 Years of Augmented Reality Usability Studies: 2005 to 2014. Front Robot AI 2018; 5:37. [PMID: 33500923 PMCID: PMC7805955 DOI: 10.3389/frobt.2018.00037] [Citation(s) in RCA: 66] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2017] [Accepted: 03/19/2018] [Indexed: 11/13/2022] Open
Abstract
Augmented Reality (AR) interfaces have been studied extensively over the last few decades, with a growing number of user-based experiments. In this paper, we systematically review 10 years of the most influential AR user studies, from 2005 to 2014. A total of 291 papers with 369 individual user studies have been reviewed and classified based on their application areas. The primary contribution of the review is to present the broad landscape of user-based AR research, and to provide a high-level view of how that landscape has changed. We summarize the high-level contributions from each category of papers, and present examples of the most influential user studies. We also identify areas where there have been few user studies, and opportunities for future research. Among other things, we find that there is a growing trend toward handheld AR user studies, and that most studies are conducted in laboratory settings and do not involve pilot testing. This research will be useful for AR researchers who want to follow best practices in designing their own AR user studies.
Collapse
Affiliation(s)
- Arindam Dey
- Empathic Computing Laboratory, University of South Australia, Mawson Lakes, SA, Australia
| | - Mark Billinghurst
- Empathic Computing Laboratory, University of South Australia, Mawson Lakes, SA, Australia
| | - Robert W Lindeman
- Human Interface Technology Lab New Zealand (HIT Lab NZ), University of Canterbury, Christchurch, New Zealand
| | - J Edward Swan
- Mississippi State University, Starkville, MS, United States
| |
Collapse
|
24
|
Tagaytayan R, Kelemen A, Sik-Lanyi C. Augmented reality in neurosurgery. Arch Med Sci 2018; 14:572-578. [PMID: 29765445 PMCID: PMC5949895 DOI: 10.5114/aoms.2016.58690] [Citation(s) in RCA: 53] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/24/2015] [Accepted: 01/18/2016] [Indexed: 01/08/2023] Open
Abstract
Neurosurgery is a medical specialty that relies heavily on imaging. The use of computed tomography and magnetic resonance images during preoperative planning and intraoperative surgical navigation is vital to the success of the surgery and positive patient outcome. Augmented reality application in neurosurgery has the potential to revolutionize and change the way neurosurgeons plan and perform surgical procedures in the future. Augmented reality technology is currently commercially available for neurosurgery for simulation and training. However, the use of augmented reality in the clinical setting is still in its infancy. Researchers are now testing augmented reality system prototypes to determine and address the barriers and limitations of the technology before it can be widely accepted and used in the clinical setting.
Collapse
Affiliation(s)
- Raniel Tagaytayan
- Department of Organizational Systems and Adult Health, School of Nursing, University of Maryland, Baltimore, USA
| | - Arpad Kelemen
- Department of Organizational Systems and Adult Health, School of Nursing, University of Maryland, Baltimore, USA
| | - Cecilia Sik-Lanyi
- Department of Electrical Engineering and Information Systems, University of Pannonia, Veszprém, Hungary
| |
Collapse
|
25
|
Fritz J, Weiss CR. The State-of-the-Art of Interventional Magnetic Resonance Imaging: Part 1. Top Magn Reson Imaging 2018; 27:1-2. [PMID: 29406407 DOI: 10.1097/rmr.0000000000000168] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Affiliation(s)
- Jan Fritz
- Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD
| | | |
Collapse
|
26
|
Hanna MG, Ahmed I, Nine J, Prajapati S, Pantanowitz L. Augmented Reality Technology Using Microsoft HoloLens in Anatomic Pathology. Arch Pathol Lab Med 2018; 142:638-644. [DOI: 10.5858/arpa.2017-0189-oa] [Citation(s) in RCA: 109] [Impact Index Per Article: 18.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Context
Augmented reality (AR) devices such as the Microsoft HoloLens have not been well used in the medical field.
Objective
To test the HoloLens for clinical and nonclinical applications in pathology.
Design
A Microsoft HoloLens was tested for virtual annotation during autopsy, viewing 3D gross and microscopic pathology specimens, navigating whole slide images, telepathology, as well as real-time pathology-radiology correlation.
Results
Pathology residents performing an autopsy wearing the HoloLens were remotely instructed with real-time diagrams, annotations, and voice instruction. 3D-scanned gross pathology specimens could be viewed as holograms and easily manipulated. Telepathology was supported during gross examination and at the time of intraoperative consultation, allowing users to remotely access a pathologist for guidance and to virtually annotate areas of interest on specimens in real-time. The HoloLens permitted radiographs to be coregistered on gross specimens and thereby enhanced locating important pathologic findings. The HoloLens also allowed easy viewing and navigation of whole slide images, using an AR workstation, including multiple coregistered tissue sections facilitating volumetric pathology evaluation.
Conclusions
The HoloLens is a novel AR tool with multiple clinical and nonclinical applications in pathology. The device was comfortable to wear, easy to use, provided sufficient computing power, and supported high-resolution imaging. It was useful for autopsy, gross and microscopic examination, and ideally suited for digital pathology. Unique applications include remote supervision and annotation, 3D image viewing and manipulation, telepathology in a mixed-reality environment, and real-time pathology-radiology correlation.
Collapse
Affiliation(s)
| | | | | | | | - Liron Pantanowitz
- From the Department of Pathology, University of Pittsburgh Medical Center (UPMC), Pittsburgh, Pennsylvania (Drs Hanna, Nine, and Pantanowitz and Mr Ahmed); Icahn School of Medicine at Mount Sinai, The Mount Sinai Hospital, New York, New York (Dr Prajapati)
| |
Collapse
|
27
|
Marker DR, U Thainual P, Ungi T, Flammang AJ, Fichtinger G, Iordachita II, Carrino JA, Fritz J. 1.5 T augmented reality navigated interventional MRI: paravertebral sympathetic plexus injections. Diagn Interv Radiol 2018; 23:227-232. [PMID: 28420598 DOI: 10.5152/dir.2017.16323] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
Abstract
PURPOSE The high contrast resolution and absent ionizing radiation of interventional magnetic resonance imaging (MRI) can be advantageous for paravertebral sympathetic nerve plexus injections. We assessed the feasibility and technical performance of MRI-guided paravertebral sympathetic injections utilizing augmented reality navigation and 1.5 T MRI scanner. METHODS A total of 23 bilateral injections of the thoracic (8/23, 35%), lumbar (8/23, 35%), and hypogastric (7/23, 30%) paravertebral sympathetic plexus were prospectively planned in twelve human cadavers using a 1.5 Tesla (T) MRI scanner and augmented reality navigation system. MRI-conditional needles were used. Gadolinium-DTPA-enhanced saline was injected. Outcome variables included the number of control magnetic resonance images, target error of the needle tip, punctures of critical nontarget structures, distribution of the injected fluid, and procedure length. RESULTS Augmented-reality navigated MRI guidance at 1.5 T provided detailed anatomical visualization for successful targeting of the paravertebral space, needle placement, and perineural paravertebral injections in 46 of 46 targets (100%). A mean of 2 images (range, 1-5 images) were required to control needle placement. Changes of the needle trajectory occurred in 9 of 46 targets (20%) and changes of needle advancement occurred in 6 of 46 targets (13%), which were statistically not related to spinal regions (P = 0.728 and P = 0.86, respectively) and cadaver sizes (P = 0.893 and P = 0.859, respectively). The mean error of the needle tip was 3.9±1.7 mm. There were no punctures of critical nontarget structures. The mean procedure length was 33±12 min. CONCLUSION 1.5 T augmented reality-navigated interventional MRI can provide accurate imaging guidance for perineural injections of the thoracic, lumbar, and hypogastric sympathetic plexus.
Collapse
Affiliation(s)
- David R Marker
- Russel H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, Maryland, USA.
| | | | | | | | | | | | | | | |
Collapse
|
28
|
Fritz J, Dellon AL, Williams EH, Rosson GD, Belzberg AJ, Eckhauser FE. Diagnostic Accuracy of Selective 3-T MR Neurography–guided Retroperitoneal Genitofemoral Nerve Blocks for the Diagnosis of Genitofemoral Neuralgia. Radiology 2017; 285:176-185. [DOI: 10.1148/radiol.2017161415] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Affiliation(s)
- Jan Fritz
- From the Russell H. Morgan Department of Radiology and Radiological Science (J.F.), Department of Plastic and Reconstructive Surgery (A.L.D., E.H.W., G.D.R.), Department of Neurosurgery (A.J.B.), and Department of Surgery (F.E.E.), The Johns Hopkins University School of Medicine, 600 N Wolfe St, Baltimore, MD 21287
| | - A. Lee Dellon
- From the Russell H. Morgan Department of Radiology and Radiological Science (J.F.), Department of Plastic and Reconstructive Surgery (A.L.D., E.H.W., G.D.R.), Department of Neurosurgery (A.J.B.), and Department of Surgery (F.E.E.), The Johns Hopkins University School of Medicine, 600 N Wolfe St, Baltimore, MD 21287
| | - Eric H. Williams
- From the Russell H. Morgan Department of Radiology and Radiological Science (J.F.), Department of Plastic and Reconstructive Surgery (A.L.D., E.H.W., G.D.R.), Department of Neurosurgery (A.J.B.), and Department of Surgery (F.E.E.), The Johns Hopkins University School of Medicine, 600 N Wolfe St, Baltimore, MD 21287
| | - Gedge D. Rosson
- From the Russell H. Morgan Department of Radiology and Radiological Science (J.F.), Department of Plastic and Reconstructive Surgery (A.L.D., E.H.W., G.D.R.), Department of Neurosurgery (A.J.B.), and Department of Surgery (F.E.E.), The Johns Hopkins University School of Medicine, 600 N Wolfe St, Baltimore, MD 21287
| | - Allan J. Belzberg
- From the Russell H. Morgan Department of Radiology and Radiological Science (J.F.), Department of Plastic and Reconstructive Surgery (A.L.D., E.H.W., G.D.R.), Department of Neurosurgery (A.J.B.), and Department of Surgery (F.E.E.), The Johns Hopkins University School of Medicine, 600 N Wolfe St, Baltimore, MD 21287
| | - Frederick E. Eckhauser
- From the Russell H. Morgan Department of Radiology and Radiological Science (J.F.), Department of Plastic and Reconstructive Surgery (A.L.D., E.H.W., G.D.R.), Department of Neurosurgery (A.J.B.), and Department of Surgery (F.E.E.), The Johns Hopkins University School of Medicine, 600 N Wolfe St, Baltimore, MD 21287
| |
Collapse
|
29
|
Abstract
BACKGROUND Small renal masses are being commonly diagnosed incidentally in older patients. A partial nephrectomy is the first-line nephron sparing treatment option for these lesions. However, probe ablative therapy such as cryoablation is emerging as an alternative option for select patients requiring nephron sparing surgery. METHODS The current literature regarding the management of small renal lesions with cryoablation was retrospectively reviewed. We selected six of the largest published series of renal cryoablation with a total of 320 patients. The diagnosis, staging, treatment options, mechanism, efficacy and morbidity associated with renal cryoablation were evaluated. RESULTS Renal cryoablation for localized small renal masses is well tolerated and associated with a low complication rate. The range of mean tumor size in our literature review series (320 patients) was 2.3 to 2.6 cm. After a range of mean follow-up of 5.9 to 72 months, including a series with a minimum of 5 years of follow-up, the cancer specific survival was 97% to 100% and overall patient survival was 82% to 90.2%. CONCLUSIONS Renal cryoablation, based on available clinical reports, appears to be a curative option for patients with small localized renal cell carcinomas (RCCs) who are unwilling or unable to undergo a partial nephrectomy. With encouraging intermediate oncological follow-up available, longer-term follow-up is needed to validate the use of cryoablation as a primary treatment option.
Collapse
Affiliation(s)
- Jason Hafron
- Section of Laparoscopic and Robotic Surgery, Glickman Urological Institute, Cleveland Clinic, OH 44195, USA
| | | |
Collapse
|
30
|
Xiao D, Li Y, Luo H, Zhang Y, Guo X, Zheng H, Hu Q, Jia F. In vivo comparison of two navigation systems for abdominal percutaneous needle intervention. Abdom Radiol (NY) 2017; 42:1993-2000. [PMID: 28217826 DOI: 10.1007/s00261-017-1083-x] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/16/2023]
Abstract
PURPOSE To compare the accuracy of a Kinect-Optical navigation system with an electromagnetic (EM) navigation system for percutaneous liver needle intervention. MATERIALS AND METHODS Five beagles with nine artificial tumors were used for validation. The Veran IG4 EM navigation system and a custom-made Kinect-Optical navigation system were used. Needle insertions into each tumor were conducted with these two guidance methods. The target positioning error (TPE) and the time cost of the puncture procedures were evaluated. RESULTS A total of 18 needle insertions were performed to evaluate the navigation accuracy of the two guidance approaches. The targeting error was 6.78 ± 3.22 mm and 8.72 ± 3.5 mm for the Kinect-Optical navigation system and the EM navigation system, respectively. There is no statistically significant difference in the TPE between the Kinect-Optical navigation system and the EM navigation system (p = 0.229). The processing time with the Kinect-Optical system (10 min) is similar to that of the Veran IG4 system (12 min). CONCLUSIONS The accuracy of the Kinect-Optical navigation system is comparable to that of the EM navigation system.
Collapse
Affiliation(s)
- Deqiang Xiao
- Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, No. 1068, Xueyuan Avenue, Xili Nanshan, Shenzhen, China
- Shenzhen College of Advanced Technology, University of Chinese Academy of Sciences, No. 1068, Xueyuan Avenue, Xili Nanshan, Shenzhen, China
| | - Yong Li
- Department of Interventional Radiology, Shenzhen People's Hospital, No. 1017, Dongmen North Rd., Luohu, Shenzhen, China
| | - Huoling Luo
- Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, No. 1068, Xueyuan Avenue, Xili Nanshan, Shenzhen, China
- Shenzhen College of Advanced Technology, University of Chinese Academy of Sciences, No. 1068, Xueyuan Avenue, Xili Nanshan, Shenzhen, China
| | - Yanfang Zhang
- Department of Interventional Radiology, Shenzhen People's Hospital, No. 1017, Dongmen North Rd., Luohu, Shenzhen, China.
| | - Xuejun Guo
- Department of Radiology, Peking University Shenzhen Hospital, No. 1120, Lianhua Rd, Futian, Shenzhen, China
| | - Huimin Zheng
- Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, No. 1068, Xueyuan Avenue, Xili Nanshan, Shenzhen, China
| | - Qingmao Hu
- Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, No. 1068, Xueyuan Avenue, Xili Nanshan, Shenzhen, China
- Shenzhen College of Advanced Technology, University of Chinese Academy of Sciences, No. 1068, Xueyuan Avenue, Xili Nanshan, Shenzhen, China
| | - Fucang Jia
- Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, No. 1068, Xueyuan Avenue, Xili Nanshan, Shenzhen, China.
- Shenzhen College of Advanced Technology, University of Chinese Academy of Sciences, No. 1068, Xueyuan Avenue, Xili Nanshan, Shenzhen, China.
| |
Collapse
|
31
|
Racadio JM, Nachabe R, Homan R, Schierling R, Racadio JM, Babić D. Augmented Reality on a C-Arm System: A Preclinical Assessment for Percutaneous Needle Localization. Radiology 2016; 281:249-55. [PMID: 27089025 DOI: 10.1148/radiol.2016151040] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Affiliation(s)
- John M Racadio
- From the Department of Radiology, Division of Pediatric Interventional Radiology, Cincinnati Children's Hospital Medical Center, 3333 Burnet Ave, Cincinnati, OH 45229-3030 (John Racadio, R.S., Judy Racadio); and Interventional X-Ray Department, Philips Healthcare, Best, the Netherlands (R.N., R.H., D.B.)
| | - Rami Nachabe
- From the Department of Radiology, Division of Pediatric Interventional Radiology, Cincinnati Children's Hospital Medical Center, 3333 Burnet Ave, Cincinnati, OH 45229-3030 (John Racadio, R.S., Judy Racadio); and Interventional X-Ray Department, Philips Healthcare, Best, the Netherlands (R.N., R.H., D.B.)
| | - Robert Homan
- From the Department of Radiology, Division of Pediatric Interventional Radiology, Cincinnati Children's Hospital Medical Center, 3333 Burnet Ave, Cincinnati, OH 45229-3030 (John Racadio, R.S., Judy Racadio); and Interventional X-Ray Department, Philips Healthcare, Best, the Netherlands (R.N., R.H., D.B.)
| | - Ross Schierling
- From the Department of Radiology, Division of Pediatric Interventional Radiology, Cincinnati Children's Hospital Medical Center, 3333 Burnet Ave, Cincinnati, OH 45229-3030 (John Racadio, R.S., Judy Racadio); and Interventional X-Ray Department, Philips Healthcare, Best, the Netherlands (R.N., R.H., D.B.)
| | - Judy M Racadio
- From the Department of Radiology, Division of Pediatric Interventional Radiology, Cincinnati Children's Hospital Medical Center, 3333 Burnet Ave, Cincinnati, OH 45229-3030 (John Racadio, R.S., Judy Racadio); and Interventional X-Ray Department, Philips Healthcare, Best, the Netherlands (R.N., R.H., D.B.)
| | - Draženko Babić
- From the Department of Radiology, Division of Pediatric Interventional Radiology, Cincinnati Children's Hospital Medical Center, 3333 Burnet Ave, Cincinnati, OH 45229-3030 (John Racadio, R.S., Judy Racadio); and Interventional X-Ray Department, Philips Healthcare, Best, the Netherlands (R.N., R.H., D.B.)
| |
Collapse
|
32
|
Abstract
Prostate cancer is the most common cancer (other than skin cancer) in American men, with one in seven men being diagnosed with this disease during his lifetime. The estimated number of new prostate cancer cases in 2016 is 180,890. For the first time, imaging has become the center of the search for contained, intraglandular, small-volume, and unifocal disease, and an increasing number of academic institutions as well as private practices are implementing programs for prostate multiplanar magnetic resonance imaging (MRI) as parts of their routine offerings. This article reviews the role of MRI-guided focal prostate ablation, as well as opportunities for further growth in this minimally invasive therapy of prostate cancer.
Collapse
Affiliation(s)
- Sherif G Nour
- Interventional MRI Program, Emory University Hospitals and School of Medicine, Atlanta, Georgia; Divisions of Abdominal Imaging, Interventional Radiology, and Image-Guided Medicine, Emory University Hospitals and School of Medicine, Atlanta, Georgia
| |
Collapse
|
33
|
Azagury DE, Dua MM, Barrese JC, Henderson JM, Buchs NC, Ris F, Cloyd JM, Martinie JB, Razzaque S, Nicolau S, Soler L, Marescaux J, Visser BC. Image-guided surgery. Curr Probl Surg 2015; 52:476-520. [PMID: 26683419 DOI: 10.1067/j.cpsurg.2015.10.001] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2015] [Accepted: 10/01/2015] [Indexed: 12/11/2022]
Affiliation(s)
- Dan E Azagury
- Department of Surgery, Stanford University School of Medicine, Stanford, CA
| | - Monica M Dua
- Department of Surgery, Stanford University School of Medicine, Stanford, CA
| | - James C Barrese
- Department of Neurosurgery, Stanford University School of Medicine, Stanford, CA
| | - Jaimie M Henderson
- Department of Neurosurgery, Stanford University School of Medicine, Stanford, CA
| | - Nicolas C Buchs
- Department of Surgery, University Hospital of Geneva, Clinic for Visceral and Transplantation Surgery, Geneva, Switzerland
| | - Frederic Ris
- Department of Surgery, University Hospital of Geneva, Clinic for Visceral and Transplantation Surgery, Geneva, Switzerland
| | - Jordan M Cloyd
- Department of Surgery, Stanford University School of Medicine, Stanford, CA
| | - John B Martinie
- Department of Surgery, Carolinas Healthcare System, Charlotte, NC
| | - Sharif Razzaque
- Department of Surgery, Carolinas Healthcare System, Charlotte, NC
| | - Stéphane Nicolau
- IRCAD (Research Institute Against Digestive Cancer), Strasbourg, France
| | - Luc Soler
- IRCAD (Research Institute Against Digestive Cancer), Strasbourg, France
| | - Jacques Marescaux
- IRCAD (Research Institute Against Digestive Cancer), Strasbourg, France
| | - Brendan C Visser
- Department of Surgery, Stanford University School of Medicine, Stanford, CA.
| |
Collapse
|
34
|
Targeting Accuracy, Procedure Times and User Experience of 240 Experimental MRI Biopsies Guided by a Clinical Add-On Navigation System. PLoS One 2015. [PMID: 26222443 PMCID: PMC4519044 DOI: 10.1371/journal.pone.0134370] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022] Open
Abstract
OBJECTIVES MRI is of great clinical utility for the guidance of special diagnostic and therapeutic interventions. The majority of such procedures are performed iteratively ("in-and-out") in standard, closed-bore MRI systems with control imaging inside the bore and needle adjustments outside the bore. The fundamental limitations of such an approach have led to the development of various assistance techniques, from simple guidance tools to advanced navigation systems. The purpose of this work was to thoroughly assess the targeting accuracy, workflow and usability of a clinical add-on navigation solution on 240 simulated biopsies by different medical operators. METHODS Navigation relied on a virtual 3D MRI scene with real-time overlay of the optically tracked biopsy needle. Smart reference markers on a freely adjustable arm ensured proper registration. Twenty-four operators - attending (AR) and resident radiologists (RR) as well as medical students (MS) - performed well-controlled biopsies of 10 embedded model targets (mean diameter: 8.5 mm, insertion depths: 17-76 mm). Targeting accuracy, procedure times and 13 Likert scores on system performance were determined (strong agreement: 5.0). RESULTS Differences in diagnostic success rates (AR: 93%, RR: 88%, MS: 81%) were not significant. In contrast, between-group differences in biopsy times (AR: 4:15, RR: 4:40, MS: 5:06 min:sec) differed significantly (p<0.01). Mean overall rating was 4.2. The average operator would use the system again (4.8) and stated that the outcome justifies the extra effort (4.4). Lowest agreement was reported for the robustness against external perturbations (2.8). CONCLUSIONS The described combination of optical tracking technology with an automatic MRI registration appears to be sufficiently accurate for instrument guidance in a standard (closed-bore) MRI environment. High targeting accuracy and usability was demonstrated on a relatively large number of procedures and operators. Between groups with different expertise there were significant differences in experimental procedure times but not in the number of successful biopsies.
Collapse
|
35
|
Papanikolaou IS, van der Voort IR, Chopra SS, Seebauer CJ, Rump J, Papas MG, Triantafyllou K, Baumgart DC, Teichgräber UK, Wiedenmann B, Rösch T. MRI-guided percutaneous transhepatic cholangiodrainage: feasibility study in a porcine model. Scand J Gastroenterol 2014; 49:722-6. [PMID: 24694300 DOI: 10.3109/00365521.2014.899619] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
BACKGROUND AND STUDY AIMS MRI-guided procedures combine high-quality imaging with lack of radiation. Percutaneous transhepatic cholangiodrainage under real-time MRI guidance (MRI-PTCD) seems promising, allowing targeted puncture and avoiding multiple blind passes and use of contrast, which are associated with standard PTCD's heaviest complications. PATIENTS AND METHODS Aim of this study was to investigate the feasibility of MRI-PTCD in three outbred piglets. Obstructive cholestasis was induced by common bile duct ligation. Two days later, MRI-PTCD was performed (open MRI, 1.0 Tesla) with prototype MRI-compatible accessories. Visualization was achieved with a balanced steady-state free precession real-time sequence (bSSFP: 0.75 frames/s, TR/TE [ms]: 7.2/3.6; flip angle: 45°; 200 × 200 matrix size; resolution: 1.3 × 1.3 mm(2), slice thickness: 7 mm). Cannulation of the bile ducts was followed by placement of Yamakawa drainages. RESULTS Twelve punctures were performed (four per animal, 10/12 successful); in 2/10 the bile ducts could not be cannulated. Animal survival was 100% and no significant complications occurred. CONCLUSIONS Initial data show that MRI-PTCD can be successfully performed. This may lead to establishment of a new optimized PTCD technique compared to the standard approach under fluoroscopy.
Collapse
Affiliation(s)
- Ioannis S Papanikolaou
- Department of Internal Medicine, Division of Hepatology & Gastroenterology, Charité Campus Virchow Clinic , Augustenburger Platz 1, D-13353, Berlin , Germany
| | | | | | | | | | | | | | | | | | | | | |
Collapse
|
36
|
Soler L, Nicolau S, Pessaux P, Mutter D, Marescaux J. Real-time 3D image reconstruction guidance in liver resection surgery. Hepatobiliary Surg Nutr 2014; 3:73-81. [PMID: 24812598 DOI: 10.3978/j.issn.2304-3881.2014.02.03] [Citation(s) in RCA: 33] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/08/2014] [Accepted: 02/20/2014] [Indexed: 12/26/2022]
Abstract
BACKGROUND Minimally invasive surgery represents one of the main evolutions of surgical techniques. However, minimally invasive surgery adds difficulty that can be reduced through computer technology. METHODS From a patient's medical image [US, computed tomography (CT) or MRI], we have developed an Augmented Reality (AR) system that increases the surgeon's intraoperative vision by providing a virtual transparency of the patient. AR is based on two major processes: 3D modeling and visualization of anatomical or pathological structures appearing in the medical image, and the registration of this visualization onto the real patient. We have thus developed a new online service, named Visible Patient, providing efficient 3D modeling of patients. We have then developed several 3D visualization and surgical planning software tools to combine direct volume rendering and surface rendering. Finally, we have developed two registration techniques, one interactive and one automatic providing intraoperative augmented reality view. RESULTS From January 2009 to June 2013, 769 clinical cases have been modeled by the Visible Patient service. Moreover, three clinical validations have been realized demonstrating the accuracy of 3D models and their great benefit, potentially increasing surgical eligibility in liver surgery (20% of cases). From these 3D models, more than 50 interactive AR-assisted surgical procedures have been realized illustrating the potential clinical benefit of such assistance to gain safety, but also current limits that automatic augmented reality will overcome. CONCLUSIONS Virtual patient modeling should be mandatory for certain interventions that have now to be defined, such as liver surgery. Augmented reality is clearly the next step of the new surgical instrumentation but remains currently limited due to the complexity of organ deformations during surgery. Intraoperative medical imaging used in new generation of automated augmented reality should solve this issue thanks to the development of Hybrid OR.
Collapse
Affiliation(s)
- Luc Soler
- 1 IRCAD France, 2 IHU Strasbourg, 1 place de l'hôpital, 67091 Strasbourg, France
| | - Stephane Nicolau
- 1 IRCAD France, 2 IHU Strasbourg, 1 place de l'hôpital, 67091 Strasbourg, France
| | - Patrick Pessaux
- 1 IRCAD France, 2 IHU Strasbourg, 1 place de l'hôpital, 67091 Strasbourg, France
| | - Didier Mutter
- 1 IRCAD France, 2 IHU Strasbourg, 1 place de l'hôpital, 67091 Strasbourg, France
| | - Jacques Marescaux
- 1 IRCAD France, 2 IHU Strasbourg, 1 place de l'hôpital, 67091 Strasbourg, France
| |
Collapse
|
37
|
Chan WY, Heng PA. Visualization of needle access pathway and a five-DoF evaluation. IEEE J Biomed Health Inform 2014; 18:643-53. [PMID: 24608064 DOI: 10.1109/jbhi.2013.2275741] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
It is a common practice nowadays to plan needle access pathways to the volumetric organs before performing surgeries. An enormous amount of needle access planning systems has been proposed in recent years. Recent works mainly focus on the system usability or target accessibility. Visualization of the planned access pathways has drawn little attention and its effect on insertion quality is left unattended. We aim to address this problem by introducing an all-round evaluation framework that links up with human motions and computer graphics. Our evaluation framework provides an objective and quantitative analysis of the illustrativeness of the needle access pathway visualization techniques to an extent of five degrees of freedom. Our experimental results show that the visualization method adopted greatly influences insertion accuracy. Based on this finding, we propose a new visualization technique that intuitively conveys placement and orientation information. We also show that our method better conveys pathway orientation and thus enables a higher quality of insertion.
Collapse
|
38
|
Onda S, Okamoto T, Kanehira M, Fujioka S, Suzuki N, Hattori A, Yanaga K. Short rigid scope and stereo-scope designed specifically for open abdominal navigation surgery: clinical application for hepatobiliary and pancreatic surgery. JOURNAL OF HEPATO-BILIARY-PANCREATIC SCIENCES 2013; 20:448-53. [PMID: 23269461 DOI: 10.1007/s00534-012-0582-y] [Citation(s) in RCA: 24] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
BACKGROUND We have reported the utility of an image display system using augmented reality (AR) technology in hepatobiliary surgery under laparotomy. Among several procedures, we herein report a system using a novel short rigid scope and stereo-scope, both designed specifically for open abdominal navigation surgery, and their clinical application for hepatobiliary and pancreatic surgery. METHODS The 3D reconstructed images were obtained from preoperative computed tomography data. In our specialized operating room, after paired-point matching registration, the reconstructed images are overlaid onto the operative field images captured by the short rigid scopes. The scopes, which are compact and sterilizable, can be used in the operative field. The stereo-scope provides depth information. Eight patients underwent operations using this system, including hepatectomy in two, distal pancreatectomy in three, and pancreaticoduodenectomy in three patients. The stereo-scope was used in five patients. RESULTS All eight operations were performed safely using the novel short rigid scopes, and stereo images were acquired in all five patients for whom the stereo-scope was used. The scopes were user friendly, and the intraoperative time requirement for our system was reduced compared with the conventional method. CONCLUSIONS The novel short rigid scope and stereo-scope seem to be suitable for clinical use in open abdominal navigation surgery. In hepatobiliary and pancreatic surgery, our novel system may improve the safety, accuracy and efficiency of operations.
Collapse
Affiliation(s)
- Shinji Onda
- Division of Digestive Surgery, The Jikei University Graduate School of Medicine, 3-25-8 Nishishimbashi, Minato-ku, Tokyo, Japan.
| | | | | | | | | | | | | |
Collapse
|
39
|
Augmented Reality Visualization Using Image Overlay Technology for MR-Guided Interventions. Invest Radiol 2013; 48:464-70. [DOI: 10.1097/rli.0b013e31827b9f86] [Citation(s) in RCA: 21] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
|
40
|
Fritz J, Bizzell C, Kathuria S, Flammang AJ, Williams EH, Belzberg AJ, Carrino JA, Chhabra A. High-resolution magnetic resonance-guided posterior femoral cutaneous nerve blocks. Skeletal Radiol 2013; 42:579-86. [PMID: 23263413 DOI: 10.1007/s00256-012-1553-8] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/19/2012] [Revised: 11/11/2012] [Accepted: 11/12/2012] [Indexed: 02/02/2023]
Abstract
OBJECTIVE To assess the feasibility, technical success, and effectiveness of high-resolution magnetic resonance (MR)-guided posterior femoral cutaneous nerve (PFCN) blocks. MATERIALS AND METHODS A retrospective analysis of 12 posterior femoral cutaneous nerve blocks in 8 patients [6 (75%) female, 2 (25%) male; mean age, 47 years; range, 42-84 years] with chronic perineal pain suggesting PFCN neuropathy was performed. Procedures were performed with a clinical wide-bore 1.5-T MR imaging system. High-resolution MR imaging was utilized for visualization and targeting of the PFCN. Commercially available, MR-compatible 20-G needles were used for drug delivery. Variables assessed were technical success (defined as injectant surrounding the targeted PFCN on post-intervention MR images) effectiveness, (defined as post-interventional regional anesthesia of the target area innervation downstream from the posterior femoral cutaneous nerve block), rate of complications, and length of procedure time. RESULTS MR-guided PFCN injections were technically successful in 12/12 cases (100%) with uniform perineural distribution of the injectant. All blocks were effective and resulted in post-interventional regional anesthesia of the expected areas (12/12, 100%). No complications occurred during the procedure or during follow-up. The average total procedure time was 45 min (30-70) min. CONCLUSIONS Our initial results demonstrate that this technique of selective MR-guided PFCN blocks is feasible and suggest high technical success and effectiveness. Larger studies are needed to confirm our initial results.
Collapse
Affiliation(s)
- Jan Fritz
- Russell H. Morgan Department of Radiology and Radiological Science, The Johns Hopkins University School of Medicine, 600 N. Wolfe St., Baltimore, MD 21287, USA.
| | | | | | | | | | | | | | | |
Collapse
|
41
|
Rothgang E, Gilson WD, Wacker F, Hornegger J, Lorenz CH, Weiss CR. Rapid freehand MR-guided percutaneous needle interventions: An image-based approach to improve workflow and feasibility. J Magn Reson Imaging 2013; 37:1202-12. [DOI: 10.1002/jmri.23894] [Citation(s) in RCA: 28] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2012] [Accepted: 09/17/2012] [Indexed: 11/11/2022] Open
|
42
|
Meyer BC, Brost A, Kraitchman DL, Gilson WD, Strobel N, Hornegger J, Lewin JS, Wacker FK. Percutaneous punctures with MR imaging guidance: comparison between MR imaging-enhanced fluoroscopic guidance and real-time MR Imaging guidance. Radiology 2013; 266:912-9. [PMID: 23297324 DOI: 10.1148/radiol.12120117] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
PURPOSE To evaluate and compare the technical accuracy and feasibility of magnetic resonance (MR) imaging-enhanced fluoroscopic guidance and real-time MR imaging guidance for percutaneous puncture procedures in phantoms and animals. MATERIALS AND METHODS The experimental protocol was approved by the institutional animal care and use committee. Punctures were performed in phantoms, aiming for markers (20 each for MR imaging-enhanced fluoroscopic guidance and real-time MR imaging guidance), and pigs, aiming for anatomic landmarks (10 for MR imaging-enhanced fluoroscopic guidance and five for MR imaging guidance). To guide the punctures, T1-weighted three-dimensional (3D) MR images of the phantom or pig were acquired. Additional axial and coronal T2-weighted images were used to visualize the anatomy in the animals. For MR imaging-enhanced fluoroscopic guidance, phantoms and pigs were transferred to the fluoroscopic system after initial MR imaging and C-arm computed tomography (CT) was performed. C-arm CT and MR imaging data sets were coregistered. Prototype navigation software was used to plan a puncture path with use of MR images and to superimpose it on fluoroscopic images. For real-time MR imaging, an interventional MR imaging prototype for interactive real-time section position navigation was used. Punctures were performed within the magnet bore. After completion, 3D MR imaging was performed to evaluate the accuracy of insertions. Puncture durations were compared by using the log-rank test. The Mann-Whitney U test was applied to compare the spatial errors. RESULTS In phantoms, the mean total error was 8.6 mm ± 2.8 with MR imaging-enhanced fluoroscopic guidance and 4.0 mm ± 1.2 with real-time MR imaging guidance (P < .001). The mean puncture time was 2 minutes 10 seconds ± 44 seconds with MR imaging-enhanced fluoroscopic guidance and 37 seconds ± 14 with real-time MR imaging guidance (P < .001). In the animal study, a tolerable distance (<1 cm) between target and needle tip was observed for both MR imaging-enhanced fluoroscopic guidance and real-time MR imaging guidance. The mean total error was 7.7 mm ± 2.4 with MR imaging-enhanced fluoroscopic guidance and 7.9 mm ± 4.9 with real-time MR imaging guidance (P = .77). The mean puncture time was 5 minutes 43 seconds ± 2 minutes 7 seconds with MR imaging-enhanced fluoroscopic guidance and 5 minutes 14 seconds ± 2 minutes 25 seconds with real-time MR imaging guidance (P = .68). CONCLUSION Both MR imaging-enhanced fluoroscopic guidance and real-time MR imaging guidance demonstrated reasonable and similar accuracy in guiding needle placement to selected targets in phantoms and animals.
Collapse
|
43
|
de Leeuw H, Seevinck PR, Bakker CJG. Center-out radial sampling with off-resonant reconstruction for efficient and accurate localization of punctate and elongated paramagnetic structures. Magn Reson Med 2012; 69:1611-22. [DOI: 10.1002/mrm.24416] [Citation(s) in RCA: 22] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2011] [Revised: 05/17/2012] [Accepted: 06/24/2012] [Indexed: 11/06/2022]
|
44
|
Fritz J, U-Thainual P, Ungi T, Flammang AJ, Fichtinger G, Iordachita II, Carrino JA. Augmented reality visualization with use of image overlay technology for MR imaging-guided interventions: assessment of performance in cadaveric shoulder and hip arthrography at 1.5 T. Radiology 2012; 265:254-9. [PMID: 22843764 DOI: 10.1148/radiol.12112640] [Citation(s) in RCA: 32] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
PURPOSE To prospectively assess overlay technology in providing accurate and efficient targeting for magnetic resonance (MR) imaging-guided shoulder and hip joint arthrography. MATERIALS AND METHODS A prototype augmented reality image overlay system was used in conjunction with a clinical 1.5-T MR imager. A total of 24 shoulder joint and 24 hip joint injections were planned in 12 human cadavers. Two operators (A and B) participated, each performing procedures on different cadavers using image overlay guidance. MR imaging was used to confirm needle positions, monitor injections, and perform MR arthrography. Accuracy was assessed according to the rate of needle adjustment, target error, and whether the injection was intraarticular. Efficiency was assessed according to arthrography procedural time. Operator differences were assessed with comparison of accuracy and procedure times between the operators. Mann-Whitney U test and Fisher exact test were used to assess group differences. RESULTS Forty-five arthrography procedures (23 shoulders, 22 hips) were performed. Three joints had prostheses and were excluded. Operator A performed 12 shoulder and 12 hip injections. Operator B performed 11 shoulder and 10 hip injections. Needle adjustment rate was 13% (six of 45; one for operator A and five for operator B). Target error was 3.1 mm±1.2 (standard deviation) (operator A, 2.9 mm±1.4; operator B, 3.5 mm±0.9). Intraarticular injection rate was 100% (45 of 45). The average arthrography time was 14 minutes (range, 6-27 minutes; 12 minutes [range, 6-25 minutes] for operator A and 16 minutes [range, 6-27 min] for operator B). Operator differences were not significant with regard to needle adjustment rate (P=.08), target error (P=.07), intraarticular injection rate (P>.99), and arthrography time (P=.22). CONCLUSION Image overlay technology provides accurate and efficient MR guidance for successful shoulder and hip arthrography in human cadavers.
Collapse
Affiliation(s)
- Jan Fritz
- Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, 601 N Caroline St, JHOC 5165, Baltimore, MD 21287, USA
| | | | | | | | | | | | | |
Collapse
|
45
|
Nakata N, Suzuki N, Hattori A, Hirai N, Miyamoto Y, Fukuda K. Informatics in radiology: Intuitive user interface for 3D image manipulation using augmented reality and a smartphone as a remote control. Radiographics 2012; 32:E169-74. [PMID: 22556316 DOI: 10.1148/rg.324115086] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
Although widely used as a pointing device on personal computers (PCs), the mouse was originally designed for control of two-dimensional (2D) cursor movement and is not suited to complex three-dimensional (3D) image manipulation. Augmented reality (AR) is a field of computer science that involves combining the physical world and an interactive 3D virtual world; it represents a new 3D user interface (UI) paradigm. A system for 3D and four-dimensional (4D) image manipulation has been developed that uses optical tracking AR integrated with a smartphone remote control. The smartphone is placed in a hard case (jacket) with a 2D printed fiducial marker for AR on the back. It is connected to a conventional PC with an embedded Web camera by means of WiFi. The touch screen UI of the smartphone is then used as a remote control for 3D and 4D image manipulation. Using this system, the radiologist can easily manipulate 3D and 4D images from computed tomography and magnetic resonance imaging in an AR environment with high-quality image resolution. Pilot assessment of this system suggests that radiologists will be able to manipulate 3D and 4D images in the reading room in the near future. Supplemental material available at http://radiographics.rsna.org/lookup/suppl/doi:10.1148/rg.324115086/-/DC1.
Collapse
Affiliation(s)
- Norio Nakata
- Department of Radiology and Institute for High Dimensional Medical Imaging, Research Center for Medical Sciences, Jikei University School of Medicine, 3-25-8 Nishi-Shinbashi, Minato-ku, Tokyo 1058461, Japan.
| | | | | | | | | | | |
Collapse
|
46
|
Augmented Reality Visualization With Image Overlay for MRI-Guided Intervention: Accuracy for Lumbar Spinal Procedures With a 1.5-T MRI System. AJR Am J Roentgenol 2012; 198:W266-73. [DOI: 10.2214/ajr.11.6918] [Citation(s) in RCA: 48] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
|
47
|
Thomas C, Wojtczyk H, Rempp H, Clasen S, Horger M, von Lassberg C, Fritz J, Claussen CD, Pereira PL. Carbon fibre and nitinol needles for MRI-guided interventions: First in vitro and in vivo application. Eur J Radiol 2011; 79:353-8. [DOI: 10.1016/j.ejrad.2010.07.007] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2009] [Revised: 07/02/2010] [Accepted: 07/07/2010] [Indexed: 10/19/2022]
Affiliation(s)
- Christoph Thomas
- Department of Diagnostic and Interventional Radiology, University of Tübingen, Tübingen, Germany.
| | | | | | | | | | | | | | | | | |
Collapse
|
48
|
A guide to stereoscopic 3D displays in medicine. Acad Radiol 2011; 18:1035-48. [PMID: 21652229 DOI: 10.1016/j.acra.2011.04.005] [Citation(s) in RCA: 61] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2011] [Revised: 04/08/2011] [Accepted: 04/22/2011] [Indexed: 01/21/2023]
Abstract
Stereoscopic displays can potentially improve many aspects of medicine. However, weighing the advantages and disadvantages of such displays remains difficult, and more insight is needed to evaluate whether stereoscopic displays are worth adopting. In this article, we begin with a review of monocular and binocular depth cues. We then apply this knowledge to examine how stereoscopic displays can potentially benefit diagnostic imaging, medical training, and surgery. It is apparent that the binocular depth information afforded by stereo displays 1) aid the detection of diagnostically relevant shapes, orientations, and positions of anatomical features, especially when monocular cues are absent or unreliable; 2) help novice surgeons orient themselves in the surgical landscape and perform complicated tasks; and 3) improve the three-dimensional anatomical understanding of students with low visual-spatial skills. The drawbacks of stereo displays are also discussed, including extra eyewear, potential three-dimensional misperceptions, and the hurdle of overcoming familiarity with existing techniques. Finally, we list suggested guidelines for the optimal use of stereo displays. We provide a concise guide for medical practitioners who want to assess the potential benefits of stereo displays before adopting them.
Collapse
|
49
|
Papanikolaou IS, van der Voort IR, Rump J, Seebauer CJ, Chopra SS, Wichlas F, Schilling R, Walter T, Papas MG, Wiedenmann B, Teichgräber UK, Rösch T. Percutaneous transhepatic cholangiodrainage under real-time MRI guidance: initial experience in an animal model. Dig Liver Dis 2011; 43:642-6. [PMID: 21592872 DOI: 10.1016/j.dld.2011.03.012] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/16/2010] [Revised: 03/01/2011] [Accepted: 03/29/2011] [Indexed: 12/11/2022]
Abstract
AIMS To assess percutaneous transhepatic cholangiodrainage (PTCD) under real-time MRI-guidance and compare it to procedures performed under fluoroscopy. METHODS We developed an in vitro model for MRI-guided and conventional PTCD, using an animal organ set including liver and bile ducts placed in an MRI-compatible box and tested it in a 1.0-Tesla open MRI-scanner. Prototype 18G needles and guide wires, standard guide wires, dilatation bougies, and drainages were used (MRI-compatible). MRI-visualization was by means of a bFFE real-time sequence using a surface coil (Flex-L). Outcome measurements were success rates and time needed for bile duct puncture using real-time MRI-guidance versus conventional radiologic methods in the model. Cannulation and drainage placement were also analysed. RESULTS Fifty MRI-guided experiments were performed, leading to rapid (mean: 43s, range: 15-72s) and successful puncture and cannulation in 96% of procedures. Median drainage placement time was 321.5s (range: 241-411s). In 35 control experiments under fluoroscopy, puncture success was 69%, whereas times were significantly longer (mean 273s, range 45-631s). CONCLUSIONS Initial in vitro experience shows that PTCD can be successfully and rapidly performed under real-time MRI-guidance and demonstrates improved performance compared to the conventional radiologic approach.
Collapse
Affiliation(s)
- Ioannis S Papanikolaou
- Central Interdisciplinary Endoscopy Unit, Charité University Hospitals Berlin, Campus Virchow Hospital, Berlin, Germany.
| | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
50
|
Abstract
This article highlights some of current state-of-the-art applications of interventional magnetic resonance imaging (MRI) technology pertaining to the musculoskeletal soft tissues. The rationale for the use of these techniques is to provide modes of minimally invasive diagnosis and/or therapy for a subset of patients whose lesions are not approachable by the traditional modes of interventional radiology and to introduce methods to mark subtle and infiltrative lesions to improve the outcomes of subsequent surgery or radiation therapy. These techniques build on the inherent attributes of MRI, particularly the high soft tissue contrast that made MRI the current mainstay diagnostic modality to identify and characterize musculoskeletal soft tissue lesions. The application of MRI technology to the musculoskeletal system, particularly for lesions related to the appendicular skeleton, does not typically suffer from the complexity related to involuntary organ motion. In addition, MRI-compatible versions of most of the needed instruments and devices for these interventions are currently available on commercial basis. Although musculoskeletal applications were not adopted early during the development of interventional MRI technology, we are likely to observe an increasing use of this technology for musculoskeletal soft tissue applications in the future.
Collapse
Affiliation(s)
- Sherif G Nour
- Department of Radiology and Imaging Sciences, Divisions of Abdominal Imaging, Interventional Radiology and Image-Guided Medicine, Emory University Hospitals and School of Medicine, 1364 Clifton Rd NE, Atlanta, GA 30322, USA.
| | | |
Collapse
|