1
|
Zhou W, Li X, Zabihollahy F, Lu DS, Wu HH. Deep learning-based automatic pipeline for 3D needle localization on intra-procedural 3D MRI. Int J Comput Assist Radiol Surg 2024; 19:2227-2237. [PMID: 38520646 PMCID: PMC11541278 DOI: 10.1007/s11548-024-03077-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2023] [Accepted: 02/09/2024] [Indexed: 03/25/2024]
Abstract
PURPOSE Accurate and rapid needle localization on 3D magnetic resonance imaging (MRI) is critical for MRI-guided percutaneous interventions. The current workflow requires manual needle localization on 3D MRI, which is time-consuming and cumbersome. Automatic methods using 2D deep learning networks for needle segmentation require manual image plane localization, while 3D networks are challenged by the need for sufficient training datasets. This work aimed to develop an automatic deep learning-based pipeline for accurate and rapid 3D needle localization on in vivo intra-procedural 3D MRI using a limited training dataset. METHODS The proposed automatic pipeline adopted Shifted Window (Swin) Transformers and employed a coarse-to-fine segmentation strategy: (1) initial 3D needle feature segmentation with 3D Swin UNEt TRansfomer (UNETR); (2) generation of a 2D reformatted image containing the needle feature; (3) fine 2D needle feature segmentation with 2D Swin Transformer and calculation of 3D needle tip position and axis orientation. Pre-training and data augmentation were performed to improve network training. The pipeline was evaluated via cross-validation with 49 in vivo intra-procedural 3D MR images from preclinical pig experiments. The needle tip and axis localization errors were compared with human intra-reader variation using the Wilcoxon signed rank test, with p < 0.05 considered significant. RESULTS The average end-to-end computational time for the pipeline was 6 s per 3D volume. The median Dice scores of the 3D Swin UNETR and 2D Swin Transformer in the pipeline were 0.80 and 0.93, respectively. The median 3D needle tip and axis localization errors were 1.48 mm (1.09 pixels) and 0.98°, respectively. Needle tip localization errors were significantly smaller than human intra-reader variation (median 1.70 mm; p < 0.01). CONCLUSION The proposed automatic pipeline achieved rapid pixel-level 3D needle localization on intra-procedural 3D MRI without requiring a large 3D training dataset and has the potential to assist MRI-guided percutaneous interventions.
Collapse
Affiliation(s)
- Wenqi Zhou
- Department of Radiological Sciences, University of California Los Angeles, 300 UCLA Medical Plaza, Suite B119, Los Angeles, CA, 90095, USA
- Department of Bioengineering, University of California Los Angeles, Los Angeles, CA, USA
| | - Xinzhou Li
- Department of Radiological Sciences, University of California Los Angeles, 300 UCLA Medical Plaza, Suite B119, Los Angeles, CA, 90095, USA
- Department of Bioengineering, University of California Los Angeles, Los Angeles, CA, USA
| | - Fatemeh Zabihollahy
- Department of Radiological Sciences, University of California Los Angeles, 300 UCLA Medical Plaza, Suite B119, Los Angeles, CA, 90095, USA
- Joint Department of Medical Imaging, Sinai Health System and University of Toronto, Toronto, Canada
| | - David S Lu
- Department of Radiological Sciences, University of California Los Angeles, 300 UCLA Medical Plaza, Suite B119, Los Angeles, CA, 90095, USA
| | - Holden H Wu
- Department of Radiological Sciences, University of California Los Angeles, 300 UCLA Medical Plaza, Suite B119, Los Angeles, CA, 90095, USA.
- Department of Bioengineering, University of California Los Angeles, Los Angeles, CA, USA.
| |
Collapse
|
2
|
Ma J, Hou L, Liang X, Yan B, Dai Q, Wang Y, Gao H, Zhu J, Song C, Yuan Q. Application value of MRI-guided wire localization to the non-palpable breast lesions only shown in Breast MRI. Front Oncol 2024; 14:1325362. [PMID: 38854734 PMCID: PMC11157007 DOI: 10.3389/fonc.2024.1325362] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2023] [Accepted: 04/30/2024] [Indexed: 06/11/2024] Open
Abstract
Introduction Magnetic resonance imaging (MRI)-guided wire localization can be applied to assist to remove suspected breast lesions accurately. This study aimed to evaluate the clinical application value of this technique in Chinese women. Methods A total of 126 patients (131 lesions) who had underwent such technique in our hospital from April 2017 to June 2023 were enrolled. 1.5T MRI system and a wire localization device were used. Image characteristics, clinical features and postoperative pathology were collected and analyzed. Results All of 126 patients (131 lesions) were successfully localized by MRI and excised for biopsy. There were 39 malignant lesions (29.77%) and 92 benign lesions (70.23%). There was no significant correlation between the morphology of DCE-MRI and the ratio of malignant lesions (P=0.763), while there was a statistical correlation between the BPE, TIC curve and the malignancy rate (P<0.05). All the lesions were assessed according to BI-RADS category of MRI (C4A=77, C4B=40, C4C=12, C5=2). The malignancy rates were as follows: 16.88% for 4A lesions (13/77), 37.50% for 4B lesions (15/40), 75.00% for 4C lesions (9/12) and 100% for 5 lesions (2/2). There was a significant correlation between the BI-RADS category and the incidence of benign-to-malignant lesions (P<0.001). Conclusion MRI-guided wire localization can assist to remove suspected breast lesions early, safely and accurately. This technique makes up for the deficiency of X-ray and ultrasound, improves the accuracy of diagnosis and resection therapy in intraductal carcinoma and early invasive carcinoma, and helps to improve the the prognosis of breast cancer.
Collapse
Affiliation(s)
- Jiaqi Ma
- Department of Radiology, Shaanxi Provincial Cancer Hospital, Xi’an, Shaanxi, China
| | - Leina Hou
- Department of Anesthesiology, Shaanxi Provincial Cancer Hospital, Xi’an, Shaanxi, China
| | - Xiufen Liang
- Department of Radiology, Shaanxi Provincial Cancer Hospital, Xi’an, Shaanxi, China
| | - Bin Yan
- Department of Radiology, Shaanxi Provincial Cancer Hospital, Xi’an, Shaanxi, China
| | - Qiang Dai
- Department of Radiology, Shaanxi Provincial Cancer Hospital, Xi’an, Shaanxi, China
| | - Yunmei Wang
- Department of Medical Oncology, Shaanxi Provincial Cancer Hospital, Xi’an, Shaanxi, China
| | - Hongbian Gao
- Department of Pathology, Shaanxi Provincial Cancer Hospital, Xi’an, Shaanxi, China
| | - Jiang Zhu
- Department of Breast Cancer, Shaanxi Provincial Cancer Hospital, Xi’an, Shaanxi, China
| | - Canxu Song
- Department of Ultrasonography, Shaanxi Provincial Cancer Hospital, Xi’an, Shaanxi, China
| | - Quan Yuan
- Department of Ultrasonography, Shaanxi Provincial Cancer Hospital, Xi’an, Shaanxi, China
| |
Collapse
|
3
|
Park GE, Lee J, Kang BJ, Kim SH. [MRI-Guided Breast Intervention: Biopsy and Needle Localization]. JOURNAL OF THE KOREAN SOCIETY OF RADIOLOGY 2023; 84:345-360. [PMID: 37051391 PMCID: PMC10083625 DOI: 10.3348/jksr.2022.0162] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/01/2022] [Revised: 02/20/2023] [Accepted: 03/14/2023] [Indexed: 06/19/2023]
Abstract
In Korea, the number of institutions providing breast MRI, as well as the number of breast MRIs, has recently increased. However, MRI-guided procedures, including biopsy and needle localization, are rarely performed compared to ultrasound-guided or stereotactic biopsy. As breast MRI has high sensitivity but limited specificity, lesions detected only on MRI require pathologic confirmation through MRI-guided biopsy or surgical excision with MRI-guided needle localization. Thus, we aimed to review MRI-guided procedures, including their indications, techniques, procedural considerations, and limitations.
Collapse
|
4
|
Dalili D, Isaac A, Garnon J, Cazzato RL, Gangi A. Towards Personalized Musculoskeletal Interventional Oncology: Enhanced Image-Guided Biopsies and Interventions. Semin Roentgenol 2022; 57:201-211. [DOI: 10.1053/j.ro.2022.02.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2022] [Revised: 02/09/2022] [Accepted: 02/11/2022] [Indexed: 11/11/2022]
|
5
|
Reply to "Additional References Relevant to Preoperative Breast Lesion Localization Techniques". AJR Am J Roentgenol 2022; 218:562. [PMID: 35107309 DOI: 10.2214/ajr.21.27128] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
|
6
|
Gao P, Kong X, Song Y, Song Y, Fang Y, Ouyang H, Wang J. Recent Progress for the Techniques of MRI-Guided Breast Interventions and their applications on Surgical Strategy. J Cancer 2020; 11:4671-4682. [PMID: 32626513 PMCID: PMC7330700 DOI: 10.7150/jca.46329] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2020] [Accepted: 05/09/2020] [Indexed: 01/20/2023] Open
Abstract
With a high sensitivity of breast lesions, MRI can detect suspicious lesions which are occult in traditional breast examination equipment. However, the lower and variable specificity of MRI makes the MRI-guided intervention, including biopsies and localizations, necessary before surgery, especially for patients who need the treatment of breast-conserving surgery (BCS). MRI techniques and patient preparation should be first carefully considered before the intervention to avoid lengthening the procedure time and compromising targeting accuracy. Doctors and radiologists need to reconfirm the target of the lesion and be very familiar with the process approach and equipment techniques involving the computer-aided diagnosis (CAD) tools and the biopsy system and follow a correct way. The basic steps of MRI-guided biopsy and localization are nearly the same regardless of the vendor or platform, and this article systematically introduces detailed methods and techniques of MRI-guided intervention. The two interventions both face different challenging situations during procedures with solutions given in the article. Post-operative statistics show that the complications of MRI-guided intervention are infrequent and mild, and MRI-guided biopsy provides the pathological information for the subsequent surgical decisions and MRI-guided localization fully prepared for follow-up surgical biopsy. New techniques for MRI-guided intervention are also elaborated in the article, which leads to future development. In a word, MRI-guided intervention is a safe, accurate, and effective technique with a low complication rate and successful MRI-guided intervention is truly teamwork with efforts from patients to surgeons, radiologists, MRI technologists, and nurses.
Collapse
Affiliation(s)
- Peng Gao
- Department of Breast Surgical Oncology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, 100021, China
| | - Xiangyi Kong
- Department of Breast Surgical Oncology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, 100021, China
| | - Ying Song
- Department of Diagnostic Radiology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, 100021, China
| | - Yan Song
- Department of Pathology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, 100021, China
| | - Yi Fang
- Department of Breast Surgical Oncology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, 100021, China
| | - Han Ouyang
- Department of Diagnostic Radiology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, 100021, China
| | - Jing Wang
- Department of Breast Surgical Oncology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, 100021, China
| |
Collapse
|
7
|
Tip Estimation Method in Phantoms for Curved Needle Using 2D Transverse Ultrasound Images. APPLIED SCIENCES-BASEL 2019. [DOI: 10.3390/app9245305] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/26/2022]
Abstract
Flexible needles have been widely used in minimally invasive surgeries, especially in percutaneous interventions. Among the interventions, tip position of the curved needle is very important, since it directly affects the success of the surgeries. In this paper, we present a method to estimate the tip position of a long-curved needle by using 2D transverse ultrasound images from a robotic ultrasound system. Ultrasound is first used to detect the cross section of long-flexible needle. A new imaging approach is proposed based on the selection of numbers of pixels with a higher gray level, which can directly remove the lower gray level to highlight the needle. After that, the needle shape tracking method is proposed by combining the image processing with the Kalman filter by using 3D needle positions, which develop a robust needle tracking procedure from 1 mm to 8 mm scan intervals. Shape reconstruction is then achieved using the curve fitting method. Finally, the needle tip position is estimated based on the curve fitting result. Experimental results showed that the estimation error of tip position is less than 1 mm within 4 mm scan intervals. The advantage of the proposed method is that the shape and tip position can be estimated through scanning the needle’s cross sections at intervals along the direction of needle insertion without detecting the tip.
Collapse
|