1
|
Wang Y, Fu T, Wu C, Xiao J, Fan J, Song H, Liang P, Yang J. Multimodal registration of ultrasound and MR images using weighted self-similarity structure vector. Comput Biol Med 2023; 155:106661. [PMID: 36827789 DOI: 10.1016/j.compbiomed.2023.106661] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2022] [Revised: 01/22/2023] [Accepted: 02/09/2023] [Indexed: 02/12/2023]
Abstract
PROPOSE Multimodal registration of 2D Ultrasound (US) and 3D Magnetic Resonance (MR) for fusion navigation can improve the intraoperative detection accuracy of lesion. However, multimodal registration remains a challenge because of the poor US image quality. In the study, a weighted self-similarity structure vector (WSSV) is proposed to registrate multimodal images. METHOD The self-similarity structure vector utilizes the normalized distance of symmetrically located patches in the neighborhood to describe the local structure information. The texture weights are extracted using the local standard deviation to reduce the speckle interference in the US images. The multimodal similarity metric is constructed by combining a self-similarity structure vector with a texture weight map. RESULTS Experiments were performed on US and MR images of the liver from 88 groups of data including 8 patients and 80 simulated samples. The average target registration error was reduced from 14.91 ± 3.86 mm to 4.95 ± 2.23 mm using the WSSV-based method. CONCLUSIONS The experimental results show that the WSSV-based registration method could robustly align the US and MR images of the liver. With further acceleration, the registration framework can be potentially applied in time-sensitive clinical settings, such as US-MR image registration in image-guided surgery.
Collapse
Affiliation(s)
- Yifan Wang
- Beijing Engineering Research Center of Mixed Reality and Advanced Display, School of Optics and Photonics, Beijing Institute of Technology, Beijing, 100081, PR China
| | - Tianyu Fu
- School of Medical Technology, Beijing Institute of Technology, Beijing, 100081, PR China.
| | - Chan Wu
- Beijing Engineering Research Center of Mixed Reality and Advanced Display, School of Optics and Photonics, Beijing Institute of Technology, Beijing, 100081, PR China
| | - Jian Xiao
- School of Medical Technology, Beijing Institute of Technology, Beijing, 100081, PR China
| | - Jingfan Fan
- Beijing Engineering Research Center of Mixed Reality and Advanced Display, School of Optics and Photonics, Beijing Institute of Technology, Beijing, 100081, PR China
| | - Hong Song
- School of Software, Beijing Institute of Technology, Beijing, 100081, PR China
| | - Ping Liang
- Department of Interventional Ultrasound, Chinese PLA General Hospital, Beijing, 100853, PR China.
| | - Jian Yang
- Beijing Engineering Research Center of Mixed Reality and Advanced Display, School of Optics and Photonics, Beijing Institute of Technology, Beijing, 100081, PR China.
| |
Collapse
|
2
|
Meershoek P, van den Berg NS, Lutjeboer J, Burgmans MC, van der Meer RW, van Rijswijk CSP, van Oosterom MN, van Erkel AR, van Leeuwen FWB. Assessing the value of volume navigation during ultrasound-guided radiofrequency- and microwave-ablations of liver lesions. Eur J Radiol Open 2021; 8:100367. [PMID: 34286051 PMCID: PMC8273361 DOI: 10.1016/j.ejro.2021.100367] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2021] [Revised: 06/25/2021] [Accepted: 06/30/2021] [Indexed: 11/26/2022] Open
Abstract
Purpose The goal of our study was to determine the influence of ultrasound (US)-coupled volume navigation on the use of computed tomography (CT) during minimally-invasive radiofrequency and microwave ablation procedures of liver lesions. Method Twenty-five patients with 40 liver lesions of different histological origin were retrospectively analysed. Lesions were ablated following standard protocol, using 1) conventional US-guidance, 2) manual registered volume navigation (mVNav), 3) automatic registered (aVNav) or 4) CT-guidance. In case of ultrasonographically inconspicuous lesions, conventional US-guidance was abandoned and mVNav was used. If mVNav was also unsuccessful, the procedure was either continued with aVNav or CT-guidance. The number, size and location of the lesions targeted using the different approaches were documented. Results Of the 40 lesions, sixteen (40.0 %) could be targeted with conventional US-guidance only, sixteen (40.0 %) with mVNav, three (7.5 %) with aVNav and five (12.5 %) only through the use of CT-guidance. Of the three alternatives (mVNav, aVNav and CT only) the mean size of the lesions targeted using mVNav (9.1 ± 4.6 mm) was significantly smaller from those targeted using US-guidance only (20.4 ± 9.4 mm; p < 0.001). The location of the lesions did not influence the selection of the modality used to guide the ablation. Conclusions In our cohort, mVNav allowed the ablation procedure to become less dependent on the use of CT. mVNav supported the ablation of lesions smaller than those that could be ablated with US only and doubled the application of minimally-invasive US-guided ablations.
Collapse
Affiliation(s)
- Philippa Meershoek
- Interventional Radiology Section, Department of Radiology, Leiden University Medical Center, Albinusdreef 2, 2300 RC, Leiden, the Netherlands.,Interventional Molecular Imaging Laboratory, Department of Radiology, Leiden University Medical Center, Albinusdreef 2, 2300 RC, Leiden, the Netherlands
| | - Nynke S van den Berg
- Interventional Molecular Imaging Laboratory, Department of Radiology, Leiden University Medical Center, Albinusdreef 2, 2300 RC, Leiden, the Netherlands
| | - Jacob Lutjeboer
- Interventional Radiology Section, Department of Radiology, Leiden University Medical Center, Albinusdreef 2, 2300 RC, Leiden, the Netherlands
| | - Mark C Burgmans
- Interventional Radiology Section, Department of Radiology, Leiden University Medical Center, Albinusdreef 2, 2300 RC, Leiden, the Netherlands
| | - Rutger W van der Meer
- Interventional Radiology Section, Department of Radiology, Leiden University Medical Center, Albinusdreef 2, 2300 RC, Leiden, the Netherlands
| | - Catharina S P van Rijswijk
- Interventional Radiology Section, Department of Radiology, Leiden University Medical Center, Albinusdreef 2, 2300 RC, Leiden, the Netherlands
| | - Matthias N van Oosterom
- Interventional Molecular Imaging Laboratory, Department of Radiology, Leiden University Medical Center, Albinusdreef 2, 2300 RC, Leiden, the Netherlands
| | - Arian R van Erkel
- Interventional Radiology Section, Department of Radiology, Leiden University Medical Center, Albinusdreef 2, 2300 RC, Leiden, the Netherlands
| | - Fijs W B van Leeuwen
- Interventional Molecular Imaging Laboratory, Department of Radiology, Leiden University Medical Center, Albinusdreef 2, 2300 RC, Leiden, the Netherlands
| |
Collapse
|
3
|
Lv S, Long Y, Su Z, Zheng R, Li K, Zhou H, Qiu C, Yin T, Xu E. Investigating the Accuracy of Ultrasound-Ultrasound Fusion Imaging for Evaluating the Ablation Effect via Special Phantom-Simulated Liver Tumors. ULTRASOUND IN MEDICINE & BIOLOGY 2019; 45:3067-3074. [PMID: 31447240 DOI: 10.1016/j.ultrasmedbio.2019.07.415] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/14/2018] [Revised: 07/15/2019] [Accepted: 07/21/2019] [Indexed: 06/10/2023]
Abstract
The goal of this study was to investigate the accuracy of ultrasound-ultrasound (US-US) fusion imaging for evaluating the ablation effect via phantom-simulated liver tumors. Twenty special phantom models were established, ablated and divided into a complete ablation group (n = 10) and an incomplete ablation group (n = 10). US-US fusion imaging was performed to evaluate the ablation effect. Gross specimens were observed as a standard reference. In this US-US fusion imaging study, the registration success rate was 100% (20/20), and the assessment time was 3.8 ± 0.9 min. The accuracy rate of the evaluation was 100% (20/20). There was no significant difference in the residual pseudo-tumoral area between the evaluation with US-US fusion imaging and gross specimen observation (p = 0.811), and the measurement error was 1.1 ± 0.6 mm. In conclusion, the feasibility and accuracy of US-US fusion imaging when evaluating the ablation effect can be investigated with this phantom-simulated liver tumor ablation model in an ideal state.
Collapse
Affiliation(s)
- Shumin Lv
- Department of Medical Ultrasonics, The Third Affiliated Hospital of Sun Yat-Sen University, Guangdong Key Laboratory of Liver Disease Research, Guangzhou, Guangdong Province, China; Department of Medical Ultrasonics, Shenzhen University General Hospital, Shenzhen University Clinical Medical Academy, Shenzhen, Guangdong Province, China
| | - Yinglin Long
- Department of Medical Ultrasonics, The Third Affiliated Hospital of Sun Yat-Sen University, Guangdong Key Laboratory of Liver Disease Research, Guangzhou, Guangdong Province, China
| | - Zhongzhen Su
- Department of Medical Ultrasonics, The Third Affiliated Hospital of Sun Yat-Sen University, Guangdong Key Laboratory of Liver Disease Research, Guangzhou, Guangdong Province, China; Department of Medical Ultrasonics, Fifth Affiliated Hospital of Sun Yat-Sen University, Zhuhai, Guangdong Province, China
| | - Rongqin Zheng
- Department of Medical Ultrasonics, The Third Affiliated Hospital of Sun Yat-Sen University, Guangdong Key Laboratory of Liver Disease Research, Guangzhou, Guangdong Province, China
| | - Kai Li
- Department of Medical Ultrasonics, The Third Affiliated Hospital of Sun Yat-Sen University, Guangdong Key Laboratory of Liver Disease Research, Guangzhou, Guangdong Province, China
| | - Huichao Zhou
- Department of Medical Ultrasonics, The Third Affiliated Hospital of Sun Yat-Sen University, Guangdong Key Laboratory of Liver Disease Research, Guangzhou, Guangdong Province, China
| | - Chen Qiu
- Department of Medical Ultrasonics, The Third Affiliated Hospital of Sun Yat-Sen University, Guangdong Key Laboratory of Liver Disease Research, Guangzhou, Guangdong Province, China
| | - Tinghui Yin
- Department of Medical Ultrasonics, The Third Affiliated Hospital of Sun Yat-Sen University, Guangdong Key Laboratory of Liver Disease Research, Guangzhou, Guangdong Province, China
| | - Erjiao Xu
- Department of Medical Ultrasonics, The Third Affiliated Hospital of Sun Yat-Sen University, Guangdong Key Laboratory of Liver Disease Research, Guangzhou, Guangdong Province, China.
| |
Collapse
|
4
|
Computer-assisted surgery: virtual- and augmented-reality displays for navigation during urological interventions. Curr Opin Urol 2019; 28:205-213. [PMID: 29278582 DOI: 10.1097/mou.0000000000000478] [Citation(s) in RCA: 37] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
Abstract
PURPOSE OF REVIEW To provide an overview of the developments made for virtual- and augmented-reality navigation procedures in urological interventions/surgery. RECENT FINDINGS Navigation efforts have demonstrated potential in the field of urology by supporting guidance for various disorders. The navigation approaches differ between the individual indications, but seem interchangeable to a certain extent. An increasing number of pre- and intra-operative imaging modalities has been used to create detailed surgical roadmaps, namely: (cone-beam) computed tomography, MRI, ultrasound, and single-photon emission computed tomography. Registration of these surgical roadmaps with the real-life surgical view has occurred in different forms (e.g. electromagnetic, mechanical, vision, or near-infrared optical-based), whereby the combination of approaches was suggested to provide superior outcome. Soft-tissue deformations demand the use of confirmatory interventional (imaging) modalities. This has resulted in the introduction of new intraoperative modalities such as drop-in US, transurethral US, (drop-in) gamma probes and fluorescence cameras. These noninvasive modalities provide an alternative to invasive technologies that expose the patients to X-ray doses. Whereas some reports have indicated navigation setups provide equal or better results than conventional approaches, most trials have been performed in relatively small patient groups and clear follow-up data are missing. SUMMARY The reported computer-assisted surgery research concepts provide a glimpse in to the future application of navigation technologies in the field of urology.
Collapse
|
5
|
Davrieux CF, Giménez ME, González CA, Ancel A, Guinin M, Fahrer B, Serra E, Kwak JM, Marescaux J, Hostettler A. Mixed reality navigation system for ultrasound-guided percutaneous punctures: a pre-clinical evaluation. Surg Endosc 2019; 34:226-230. [DOI: 10.1007/s00464-019-06755-5] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2018] [Accepted: 02/06/2019] [Indexed: 11/24/2022]
|