1
|
Jannatdoust P, Valizadeh P, Saeedi N, Valizadeh G, Salari HM, Saligheh Rad H, Gity M. Computer-Aided Detection (CADe) and Segmentation Methods for Breast Cancer Using Magnetic Resonance Imaging (MRI). J Magn Reson Imaging 2025; 61:2376-2390. [PMID: 39781684 DOI: 10.1002/jmri.29687] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2024] [Revised: 11/30/2024] [Accepted: 12/02/2024] [Indexed: 01/12/2025] Open
Abstract
Breast cancer continues to be a major health concern, and early detection is vital for enhancing survival rates. Magnetic resonance imaging (MRI) is a key tool due to its substantial sensitivity for invasive breast cancers. Computer-aided detection (CADe) systems enhance the effectiveness of MRI by identifying potential lesions, aiding radiologists in focusing on areas of interest, extracting quantitative features, and integrating with computer-aided diagnosis (CADx) pipelines. This review aims to provide a comprehensive overview of the current state of CADe systems in breast MRI, focusing on the technical details of pipelines and segmentation models including classical intensity-based methods, supervised and unsupervised machine learning (ML) approaches, and the latest deep learning (DL) architectures. It highlights recent advancements from traditional algorithms to sophisticated DL models such as U-Nets, emphasizing CADe implementation of multi-parametric MRI acquisitions. Despite these advancements, CADe systems face challenges like variable false-positive and negative rates, complexity in interpreting extensive imaging data, variability in system performance, and lack of large-scale studies and multicentric models, limiting the generalizability and suitability for clinical implementation. Technical issues, including image artefacts and the need for reproducible and explainable detection algorithms, remain significant hurdles. Future directions emphasize developing more robust and generalizable algorithms, integrating explainable AI to improve transparency and trust among clinicians, developing multi-purpose AI systems, and incorporating large language models to enhance diagnostic reporting and patient management. Additionally, efforts to standardize and streamline MRI protocols aim to increase accessibility and reduce costs, optimizing the use of CADe systems in clinical practice. LEVEL OF EVIDENCE: NA TECHNICAL EFFICACY: Stage 2.
Collapse
Affiliation(s)
- Payam Jannatdoust
- School of Medicine, Tehran University of Medical Science, Tehran, Iran
| | - Parya Valizadeh
- School of Medicine, Tehran University of Medical Science, Tehran, Iran
| | - Nikoo Saeedi
- Student Research Committee, Islamic Azad University, Mashhad Branch, Mashhad, Iran
| | - Gelareh Valizadeh
- Quantitative MR Imaging and Spectroscopy Group (QMISG), Tehran University of Medical Sciences, Tehran, Iran
| | - Hanieh Mobarak Salari
- Quantitative MR Imaging and Spectroscopy Group (QMISG), Tehran University of Medical Sciences, Tehran, Iran
| | - Hamidreza Saligheh Rad
- Quantitative MR Imaging and Spectroscopy Group (QMISG), Tehran University of Medical Sciences, Tehran, Iran
- Department of Medical Physics and Biomedical Engineering, Tehran University of Medical Sciences, Tehran, Iran
| | - Masoumeh Gity
- Advanced Diagnostic and Interventional Radiology Research Center, Tehran University of Medical Sciences, Tehran, Iran
| |
Collapse
|
2
|
Qadri SF, Rong C, Ahmad M, Li J, Qadri S, Zareen SS, Zhuang Z, Khan S, Lin H. Chan-Vese aided fuzzy C-means approach for whole breast and fibroglandular tissue segmentation: Preliminary application to real-world breast MRI. Med Phys 2025; 52:2950-2960. [PMID: 39910814 DOI: 10.1002/mp.17660] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2024] [Revised: 11/25/2024] [Accepted: 01/06/2025] [Indexed: 02/07/2025] Open
Abstract
BACKGROUND Magnetic resonance imaging (MRI) is a highly sensitive modality for diagnosing breast cancer, providing an expanding range of clinical usages that are crucial for the care of women at elevated risk of breast cancer development. Segmentation of the whole breast and fibroglandular tissue (FGT), used to evaluate breast cancer risk, is often manually delineated by radiologists in clinical practice. In this paper, we aim to substitute handcrafted breast density segmentation and categorization. The traditional fuzzy C-means (FCM) enable automatic segmentation but may be susceptible to heterogeneity or sparse FGT distribution in MRI. PURPOSE We develop a new automated technique for the segmentation of whole breast and FGT for the coronal-view MRI. METHODS We propose a Chan-Vese (CV) aided FCM segmentation approach for estimating the FGT in the whole breast using fat-suppressed (FS) precontrast T1-weighted breast MRI. We present a methodology pipeline comprising region-of-interest (ROI) extraction, nonparametric non-uniform intensity normalization N4 algorithm-based intensity inhomogeneity correction, skin-layer extraction, and then whole breast and FGT segmentation. Our approach involves the FCM algorithm to assign membership degrees to pixels, distinguishing FGT regions from surrounding adipose tissues by assessing their probability of belonging to specific FGT regions, and subsequently, the region-based active contour CV model leverages these membership degrees to direct contour evolution and enhance segmentation boundaries. The proposed method adeptly tackles common challenges in MRI, including blurred edges, low contrast, and intensity inhomogeneity, with efficiency. RESULTS We evaluated our approach on the Duke Breast Cancer MRI data (DBCM-data) and achieved good segmentation accuracy in terms of Dice similarity coefficient (DSC), Intersection-over-Union (IoU), and Sensitivity (SEN). Our method demonstrates significant accuracy, achieving a DSC (%) of 93.2 ± 3.3 and 84.1 ± 4.9, IoU (%) of 86.4 ± 3.5 and 73.2 ± 5.1, and SEN 87.3 ± 4.1 and 76.7 ± 4.1 for the segmentations of whole breast and FGT, respectively. CONCLUSION Our results demonstrated that the CV-aided FCM approach significantly outperformed the existing methods and resulted in significantly more accurate whole breast and FGT segmentation in MRI data.
Collapse
Affiliation(s)
| | | | - Mubashir Ahmad
- Department of Computer Science, COMSATS University Islamabad, Abbottabad, Pakistan
| | - Jing Li
- Zhejiang Lab, Hangzhou, China
| | - Salman Qadri
- Institute of Computing, MNS-University of Agriculture, Multan, Pakistan
| | | | | | - Salabat Khan
- College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, China
| | | |
Collapse
|
3
|
Weitz M, Pfeiffer JR, Patel S, Biancalana M, Pekis A, Kannan V, Kaklamanos E, Parker A, Bucksot JE, Romera JR, Alvin R, Zhang Y, Stefka AT, Lopez-Ramos D, Peterson JR, Antony AK, Zamora KW, Woodard S. Performance of an AI-powered visualization software platform for precision surgery in breast cancer patients. NPJ Breast Cancer 2024; 10:98. [PMID: 39543194 PMCID: PMC11564706 DOI: 10.1038/s41523-024-00696-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2024] [Accepted: 09/22/2024] [Indexed: 11/17/2024] Open
Abstract
Surgery remains the primary treatment modality in the management of early-stage invasive breast cancer. Artificial intelligence (AI)-powered visualization platforms offer the compelling potential to aid surgeons in evaluating the tumor's location and morphology within the breast and accordingly optimize their surgical approach. We sought to validate an AI platform that employs dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) to render three-dimensional (3D) representations of the tumor and 5 additional chest tissues, offering clear visualizations as well as functionalities for quantifying tumor morphology, tumor-to-landmark structure distances, excision volumes, and approximate surgical margins. This retrospective study assessed the visualization platform's performance on 100 cases with ground-truth labels vetted by 2 breast-specialized radiologists. We assessed features including automatic AI-generated clinical metrics (e.g., tumor dimensions) as well as visualization tools including convex hulls at desired margins around the tumor to help visualize lumpectomy volume. The statistical performance of the platform's automated features was robust and within the range of inter-radiologist variability. These detailed 3D tumor and surrounding multi-tissue depictions offer both qualitative and quantitative comprehension of cancer topology and may aid in formulating an optimal surgical approach for breast cancer treatment. We further establish the framework for broader data integration into the platform to enhance precision cancer care.
Collapse
Affiliation(s)
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - Kathryn W Zamora
- Department of Radiology, University of Alabama at Birmingham School of Medicine, Birmingham, AL, USA
| | - Stefanie Woodard
- Department of Radiology, University of Alabama at Birmingham School of Medicine, Birmingham, AL, USA.
| |
Collapse
|
4
|
Galli A, Marrone S, Piantadosi G, Sansone M, Sansone C. A Pipelined Tracer-Aware Approach for Lesion Segmentation in Breast DCE-MRI. J Imaging 2021; 7:jimaging7120276. [PMID: 34940743 PMCID: PMC8703956 DOI: 10.3390/jimaging7120276] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2021] [Revised: 12/09/2021] [Accepted: 12/10/2021] [Indexed: 11/16/2022] Open
Abstract
The recent spread of Deep Learning (DL) in medical imaging is pushing researchers to explore its suitability for lesion segmentation in Dynamic Contrast-Enhanced Magnetic-Resonance Imaging (DCE-MRI), a complementary imaging procedure increasingly used in breast-cancer analysis. Despite some promising proposed solutions, we argue that a "naive" use of DL may have limited effectiveness as the presence of a contrast agent results in the acquisition of multimodal 4D images requiring thorough processing before training a DL model. We thus propose a pipelined approach where each stage is intended to deal with or to leverage a peculiar characteristic of breast DCE-MRI data: the use of a breast-masking pre-processing to remove non-breast tissues; the use of Three-Time-Points (3TP) slices to effectively highlight contrast agent time course; the application of a motion-correction technique to deal with patient involuntary movements; the leverage of a modified U-Net architecture tailored on the problem; and the introduction of a new "Eras/Epochs" training strategy to handle the unbalanced dataset while performing a strong data augmentation. We compared our pipelined solution against some literature works. The results show that our approach outperforms the competitors by a large margin (+9.13% over our previous solution) while also showing a higher generalization ability.
Collapse
Affiliation(s)
- Antonio Galli
- Department of Electrical Engineering and Information Technology (DIETI), University of Naples Federico II, Via Claudio 21, 80125 Naples, Italy; (A.G.); (M.S.); (C.S.)
| | - Stefano Marrone
- Department of Electrical Engineering and Information Technology (DIETI), University of Naples Federico II, Via Claudio 21, 80125 Naples, Italy; (A.G.); (M.S.); (C.S.)
- Correspondence:
| | - Gabriele Piantadosi
- Altran Italia S.p.A., Centro Direzionale, Via Giovanni Porzio, 4, 80143 Naples, Italy;
| | - Mario Sansone
- Department of Electrical Engineering and Information Technology (DIETI), University of Naples Federico II, Via Claudio 21, 80125 Naples, Italy; (A.G.); (M.S.); (C.S.)
| | - Carlo Sansone
- Department of Electrical Engineering and Information Technology (DIETI), University of Naples Federico II, Via Claudio 21, 80125 Naples, Italy; (A.G.); (M.S.); (C.S.)
| |
Collapse
|
5
|
Development of U-Net Breast Density Segmentation Method for Fat-Sat MR Images Using Transfer Learning Based on Non-Fat-Sat Model. J Digit Imaging 2021; 34:877-887. [PMID: 34244879 PMCID: PMC8455741 DOI: 10.1007/s10278-021-00472-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2020] [Revised: 05/27/2021] [Accepted: 06/09/2021] [Indexed: 12/11/2022] Open
Abstract
To develop a U-net deep learning method for breast tissue segmentation on fat-sat T1-weighted (T1W) MRI using transfer learning (TL) from a model developed for non-fat-sat images. The training dataset (N = 126) was imaged on a 1.5 T MR scanner, and the independent testing dataset (N = 40) was imaged on a 3 T scanner, both using fat-sat T1W pulse sequence. Pre-contrast images acquired in the dynamic-contrast-enhanced (DCE) MRI sequence were used for analysis. All patients had unilateral cancer, and the segmentation was performed using the contralateral normal breast. The ground truth of breast and fibroglandular tissue (FGT) segmentation was generated using a template-based segmentation method with a clustering algorithm. The deep learning segmentation was performed using U-net models trained with and without TL, by using initial values of trainable parameters taken from the previous model for non-fat-sat images. The ground truth of each case was used to evaluate the segmentation performance of the U-net models by calculating the dice similarity coefficient (DSC) and the overall accuracy based on all pixels. Pearson’s correlation was used to evaluate the correlation of breast volume and FGT volume between the U-net prediction output and the ground truth. In the training dataset, the evaluation was performed using tenfold cross-validation, and the mean DSC with and without TL was 0.97 vs. 0.95 for breast and 0.86 vs. 0.80 for FGT. When the final model developed with and without TL from the training dataset was applied to the testing dataset, the mean DSC was 0.89 vs. 0.83 for breast and 0.81 vs. 0.81 for FGT, respectively. Application of TL not only improved the DSC, but also decreased the required training case number. Lastly, there was a high correlation (R2 > 0.90) for both the training and testing datasets between the U-net prediction output and ground truth for breast volume and FGT volume. U-net can be applied to perform breast tissue segmentation on fat-sat images, and TL is an efficient strategy to develop a specific model for each different dataset.
Collapse
|
6
|
Tao W, Lu M, Zhou X, Montemezzi S, Bai G, Yue Y, Li X, Zhao L, Zhou C, Lu G. Machine Learning Based on Multi-Parametric MRI to Predict Risk of Breast Cancer. Front Oncol 2021; 11:570747. [PMID: 33718131 PMCID: PMC7952867 DOI: 10.3389/fonc.2021.570747] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2020] [Accepted: 01/18/2021] [Indexed: 01/22/2023] Open
Abstract
Purpose Machine learning (ML) can extract high-throughput features of images to predict disease. This study aimed to develop nomogram of multi-parametric MRI (mpMRI) ML model to predict the risk of breast cancer. Methods The mpMRI included non-enhanced and enhanced T1-weighted imaging (T1WI), T2-weighted imaging (T2WI), apparent diffusion coefficient (ADC), K trans, K ep, V e, and V p. Regions of interest were annotated in an enhanced T1WI map and mapped to other maps in every slice. 1,132 features and top-10 principal components were extracted from every parameter map. Single-parametric and multi-parametric ML models were constructed via 10 rounds of five-fold cross-validation. The model with the highest area under the curve (AUC) was considered as the optimal model and validated by calibration curve and decision curve. Nomogram was built with the optimal ML model and patients' characteristics. Results This study involved 144 malignant lesions and 66 benign lesions. The average age of patients with benign and malignant lesions was 42.5 years old and 50.8 years old, respectively, which were statistically different. The sixth and fourth principal components of K trans had more importance than others. The AUCs of K trans, K ep, V e and V p, non-enhanced T1WI, enhanced T1WI, T2WI, and ADC models were 0.86, 0.81, 0.81, 0.83, 0.79, 0.81, 0.84, and 0.83 respectively. The model with an AUC of 0.90 was considered as the optimal model which was validated by calibration curve and decision curve. Nomogram for the prediction of breast cancer was built with the optimal ML models and patient age. Conclusion Nomogram could improve the ability of breast cancer prediction preoperatively.
Collapse
Affiliation(s)
- Weijing Tao
- Department of Medical Imaging, Jinling Hospital, Medical School of Nanjing University, Nanjing, China.,Department of Nuclear Medicine, The Affiliated Huai'an No. 1 People's Hospital of Nanjing Medical University, Huai'an, China
| | - Mengjie Lu
- Department of Medical Imaging, Jinling Hospital, Medical School of Nanjing University, Nanjing, China
| | - Xiaoyu Zhou
- Faculty of Mechanical Electronic and Information Engineering, Jiangsu Vocational College of Finance and Economics, Huai'an, China
| | - Stefania Montemezzi
- Radiology Unit, Department of Pathology and Diagnostics, Azienda Ospedaliera Universitaria Integrata-Verona, Verona, Italy
| | - Genji Bai
- Department of Radiology, The Affiliated Huai'an No. 1 People's Hospital of Nanjing Medical University, Huai'an, China
| | - Yangming Yue
- Deepwise AI Laboratory, Deepwise Inc., Beijing, China
| | - Xiuli Li
- Deepwise AI Laboratory, Deepwise Inc., Beijing, China
| | - Lun Zhao
- Deepwise AI Laboratory, Deepwise Inc., Beijing, China
| | - Changsheng Zhou
- Department of Medical Imaging, Jinling Hospital, Medical School of Nanjing University, Nanjing, China
| | - Guangming Lu
- Department of Medical Imaging, Jinling Hospital, Medical School of Nanjing University, Nanjing, China
| |
Collapse
|
7
|
Vairavan R, Abdullah O, Retnasamy PB, Sauli Z, Shahimin MM, Retnasamy V. A Brief Review on Breast Carcinoma and Deliberation on Current Non Invasive Imaging Techniques for Detection. Curr Med Imaging 2020; 15:85-121. [PMID: 31975658 DOI: 10.2174/1573405613666170912115617] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2017] [Revised: 08/27/2017] [Accepted: 08/29/2017] [Indexed: 12/22/2022]
Abstract
BACKGROUND Breast carcinoma is a life threatening disease that accounts for 25.1% of all carcinoma among women worldwide. Early detection of the disease enhances the chance for survival. DISCUSSION This paper presents comprehensive report on breast carcinoma disease and its modalities available for detection and diagnosis, as it delves into the screening and detection modalities with special focus placed on the non-invasive techniques and its recent advancement work done, as well as a proposal on a novel method for the application of early breast carcinoma detection. CONCLUSION This paper aims to serve as a foundation guidance for the reader to attain bird's eye understanding on breast carcinoma disease and its current non-invasive modalities.
Collapse
Affiliation(s)
- Rajendaran Vairavan
- School of Microelectronic Engineering, Universiti Malaysia Perlis, Pauh Putra Campus, 02600 Arau, Perlis, Malaysia
| | - Othman Abdullah
- Hospital Sultan Abdul Halim, 08000 Sg. Petani, Kedah, Malaysia
| | | | - Zaliman Sauli
- School of Microelectronic Engineering, Universiti Malaysia Perlis, Pauh Putra Campus, 02600 Arau, Perlis, Malaysia
| | - Mukhzeer Mohamad Shahimin
- Department of Electrical and Electronic Engineering, Faculty of Engineering, National Defence University of Malaysia (UPNM), Kem Sungai Besi, 57000 Kuala Lumpur, Malaysia
| | - Vithyacharan Retnasamy
- School of Microelectronic Engineering, Universiti Malaysia Perlis, Pauh Putra Campus, 02600 Arau, Perlis, Malaysia
| |
Collapse
|
8
|
Çetinel G, Mutlu F, Gül S. Decision support system for breast lesions via dynamic contrast enhanced magnetic resonance imaging. Phys Eng Sci Med 2020; 43:1029-1048. [PMID: 32691326 DOI: 10.1007/s13246-020-00902-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2019] [Accepted: 07/12/2020] [Indexed: 10/23/2022]
Abstract
The presented study aims to design a computer-aided detection and diagnosis system for breast dynamic contrast enhanced magnetic resonance imaging. In the proposed system, the segmentation task is performed in two stages. The first stage is called breast region segmentation in which adaptive noise filtering, local adaptive thresholding, connected component analysis, integral of horizontal projection, and breast region of interest detection algorithms are applied to the breast images consecutively. The second stage of segmentation is breast lesion detection that consists of 32-class Otsu thresholding and Markov random field techniques. Histogram, gray level co-occurrence matrix and neighboring gray tone difference matrix based feature extraction, Fisher score based feature selection and, tenfold and leave-one-out cross-validation steps are carried out after segmentation to increase the reliability of the designed system while decreasing the computational time. Finally, support vector machines, k- nearest neighbor, and artificial neural network classifiers are performed to separate the breast lesions as benign and malignant. The average accuracy, sensitivity, specificity, and positive predictive values of each classifier are calculated and the best results are compared with the existing similar studies. According to the achieved results, the proposed decision support system for breast lesion segmentation distinguishes the breast lesions with 86%, 100%, 67%, and 85% accuracy, sensitivity, specificity, and positive predictive values, respectively. These results show that the proposed system can be used to support the radiologists during a breast cancer diagnosis.
Collapse
Affiliation(s)
- Gökçen Çetinel
- Department of Electrical and Electronics Engineering, Faculty of Engineering, Sakarya University, Sakarya, Turkey.
| | - Fuldem Mutlu
- Internal Medical Sciences, Radiology Department, Education and Research Hospital, Sakarya University, Sakarya, Turkey
| | - Sevda Gül
- Department of Electronics and Automation, Adapazarı Vocational High School, Sakarya University, Sakarya, Turkey
| |
Collapse
|
9
|
Lenchik L, Heacock L, Weaver AA, Boutin RD, Cook TS, Itri J, Filippi CG, Gullapalli RP, Lee J, Zagurovskaya M, Retson T, Godwin K, Nicholson J, Narayana PA. Automated Segmentation of Tissues Using CT and MRI: A Systematic Review. Acad Radiol 2019; 26:1695-1706. [PMID: 31405724 PMCID: PMC6878163 DOI: 10.1016/j.acra.2019.07.006] [Citation(s) in RCA: 77] [Impact Index Per Article: 12.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2019] [Revised: 07/17/2019] [Accepted: 07/17/2019] [Indexed: 01/10/2023]
Abstract
RATIONALE AND OBJECTIVES The automated segmentation of organs and tissues throughout the body using computed tomography and magnetic resonance imaging has been rapidly increasing. Research into many medical conditions has benefited greatly from these approaches by allowing the development of more rapid and reproducible quantitative imaging markers. These markers have been used to help diagnose disease, determine prognosis, select patients for therapy, and follow responses to therapy. Because some of these tools are now transitioning from research environments to clinical practice, it is important for radiologists to become familiar with various methods used for automated segmentation. MATERIALS AND METHODS The Radiology Research Alliance of the Association of University Radiologists convened an Automated Segmentation Task Force to conduct a systematic review of the peer-reviewed literature on this topic. RESULTS The systematic review presented here includes 408 studies and discusses various approaches to automated segmentation using computed tomography and magnetic resonance imaging for neurologic, thoracic, abdominal, musculoskeletal, and breast imaging applications. CONCLUSION These insights should help prepare radiologists to better evaluate automated segmentation tools and apply them not only to research, but eventually to clinical practice.
Collapse
Affiliation(s)
- Leon Lenchik
- Department of Radiology, Wake Forest School of Medicine, Medical Center Boulevard, Winston-Salem, NC 27157.
| | - Laura Heacock
- Department of Radiology, NYU Langone, New York, New York
| | - Ashley A Weaver
- Department of Biomedical Engineering, Wake Forest School of Medicine, Winston-Salem, North Carolina
| | - Robert D Boutin
- Department of Radiology, University of California Davis School of Medicine, Sacramento, California
| | - Tessa S Cook
- Department of Radiology, University of Pennsylvania, Philadelphia Pennsylvania
| | - Jason Itri
- Department of Radiology, Wake Forest School of Medicine, Medical Center Boulevard, Winston-Salem, NC 27157
| | - Christopher G Filippi
- Department of Radiology, Donald and Barbara School of Medicine at Hofstra/Northwell, Lenox Hill Hospital, NY, New York
| | - Rao P Gullapalli
- Department of Radiology, University of Maryland School of Medicine, Baltimore, Maryland
| | - James Lee
- Department of Radiology, University of Kentucky, Lexington, Kentucky
| | | | - Tara Retson
- Department of Radiology, University of California San Diego, San Diego, California
| | - Kendra Godwin
- Medical Library, Memorial Sloan Kettering Cancer Center, New York, New York
| | - Joey Nicholson
- NYU Health Sciences Library, NYU School of Medicine, NYU Langone Health, New York, New York
| | - Ponnada A Narayana
- Department of Diagnostic and Interventional Imaging, McGovern Medical School, University of Texas Health Science Center at Houston, Houston, Texas
| |
Collapse
|
10
|
Reig B, Heacock L, Geras KJ, Moy L. Machine learning in breast MRI. J Magn Reson Imaging 2019; 52:998-1018. [PMID: 31276247 DOI: 10.1002/jmri.26852] [Citation(s) in RCA: 93] [Impact Index Per Article: 15.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2019] [Revised: 06/18/2019] [Accepted: 06/19/2019] [Indexed: 12/13/2022] Open
Abstract
Machine-learning techniques have led to remarkable advances in data extraction and analysis of medical imaging. Applications of machine learning to breast MRI continue to expand rapidly as increasingly accurate 3D breast and lesion segmentation allows the combination of radiologist-level interpretation (eg, BI-RADS lexicon), data from advanced multiparametric imaging techniques, and patient-level data such as genetic risk markers. Advances in breast MRI feature extraction have led to rapid dataset analysis, which offers promise in large pooled multiinstitutional data analysis. The object of this review is to provide an overview of machine-learning and deep-learning techniques for breast MRI, including supervised and unsupervised methods, anatomic breast segmentation, and lesion segmentation. Finally, it explores the role of machine learning, current limitations, and future applications to texture analysis, radiomics, and radiogenomics. Level of Evidence: 3 Technical Efficacy Stage: 2 J. Magn. Reson. Imaging 2019. J. Magn. Reson. Imaging 2020;52:998-1018.
Collapse
Affiliation(s)
- Beatriu Reig
- The Department of Radiology, New York University School of Medicine, New York, New York, USA
| | - Laura Heacock
- Bernard and Irene Schwartz Center for Biomedical Imaging, Department of Radiology, New York University School of Medicine, New York, New York, USA
| | - Krzysztof J Geras
- Bernard and Irene Schwartz Center for Biomedical Imaging, Department of Radiology, New York University School of Medicine, New York, New York, USA
| | - Linda Moy
- Bernard and Irene Schwartz Center for Biomedical Imaging, Department of Radiology, New York University School of Medicine, New York, New York, USA.,Center for Advanced Imaging Innovation and Research (CAI2 R), New York University School of Medicine, New York, New York, USA
| |
Collapse
|
11
|
Wei D, Weinstein S, Hsieh MK, Pantalone L, Kontos D. Three-Dimensional Whole Breast Segmentation in Sagittal and Axial Breast MRI With Dense Depth Field Modeling and Localized Self-Adaptation for Chest-Wall Line Detection. IEEE Trans Biomed Eng 2019; 66:1567-1579. [PMID: 30334748 PMCID: PMC6684022 DOI: 10.1109/tbme.2018.2875955] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
OBJECTIVE Whole breast segmentation is an essential task in quantitative analysis of breast MRI for cancer risk assessment. It is challenging, mainly, because the chest-wall line (CWL) can be very difficult to locate due to its spatially varying appearance-caused by both nature and imaging artifacts-and neighboring distracting structures. This paper proposes an automatic three-dimensional (3-D) segmentation method, termed DeepSeA, of whole breast for breast MRI. METHODS DeepSeA distinguishes itself from previous methods in three aspects. First, it reformulates the challenging problem of CWL localization as an equivalent problem that optimizes a smooth depth field and so fully utilizes the CWL's 3-D continuity. Second, it employs a localized self-adapting algorithm to adjust to the CWL's spatial variation. Third, it applies to breast MRI data in both sagittal and axial orientations equally well without training. RESULTS A representative set of 99 breast MRI scans with varying imaging protocols is used for evaluation. Experimental results with expert-outlined reference standard show that DeepSeA can segment breasts accurately: the average Dice similarity coefficients, sensitivity, specificity, and CWL deviation error are 96.04%, 97.27%, 98.77%, and 1.63 mm, respectively. In addition, the configuration of DeepSeA is generalized based on experimental findings, for application to broad prospective data. CONCLUSION A fully automatic method-DeepSeA-for whole breast segmentation in sagittal and axial breast MRI is reported. SIGNIFICANCE DeepSeA can facilitate cancer risk assessment with breast MRI.
Collapse
Affiliation(s)
- Dong Wei
- Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104, USA
| | - Susan Weinstein
- Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104, USA
| | - Meng-Kang Hsieh
- Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104, USA
| | - Lauren Pantalone
- Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104, USA
| | - Despina Kontos
- Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104, USA
| |
Collapse
|
12
|
Artificial Intelligence for Breast MRI in 2008-2018: A Systematic Mapping Review. AJR Am J Roentgenol 2019; 212:280-292. [PMID: 30601029 DOI: 10.2214/ajr.18.20389] [Citation(s) in RCA: 36] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
Abstract
OBJECTIVE The purpose of this study is to review literature from the past decade on applications of artificial intelligence (AI) to breast MRI. MATERIALS AND METHODS In June 2018, a systematic search of the literature was performed to identify articles on the use of AI in breast MRI. For each article identified, the surname of the first author, year of publication, journal of publication, Web of Science Core Collection journal category, country of affiliation of the first author, study design, dataset, study aim(s), AI methods used, and, when available, diagnostic performance were recorded. RESULTS Sixty-seven studies, 58 (87%) of which had a retrospective design, were analyzed. When journal categories were considered, 36% of articles were identified as being included in the radiology and imaging journal category. Contrast-enhanced sequences were used for most AI applications (n = 50; 75%) and, on occasion, were combined with other MRI sequences (n = 8; 12%). Four main clinical aims were addressed: breast lesion classification (n = 36; 54%), image processing (n = 14; 21%), prognostic imaging (n = 9; 13%), and response to neoadjuvant therapy (n = 8; 12%). Artificial neural networks, support vector machines, and clustering were the most frequently used algorithms, accounting for 66%. The performance achieved and the most frequently used techniques were then analyzed according to specific clinical aims. Supervised learning algorithms were primarily used for lesion characterization, with the AUC value from ROC analysis ranging from 0.74 to 0.98 (median, 0.87) and with that from prognostic imaging ranging from 0.62 to 0.88 (median, 0.80), whereas unsupervised learning was mainly used for image processing purposes. CONCLUSION Interest in the application of advanced AI methods to breast MRI is growing worldwide. Although this growth is encouraging, the current performance of AI applications in breast MRI means that such applications are still far from being incorporated into clinical practice.
Collapse
|
13
|
Pandey D, Yin X, Wang H, Su MY, Chen JH, Wu J, Zhang Y. Automatic and fast segmentation of breast region-of-interest (ROI) and density in MRIs. Heliyon 2018; 4:e01042. [PMID: 30582055 PMCID: PMC6299131 DOI: 10.1016/j.heliyon.2018.e01042] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2018] [Revised: 11/04/2018] [Accepted: 12/10/2018] [Indexed: 12/13/2022] Open
Abstract
Accurate segmentation of the breast region of interest (BROI) and breast density (BD) is a significant challenge during the analysis of breast MR images. Most of the existing methods for breast segmentation are semi-automatic and limited in their ability to achieve accurate results. This is because of difficulties in removing landmarks from noisy magnetic resonance images (MRI) due to similar intensity levels and the close connection to BROI. This study proposes an innovative, fully automatic and fast segmentation approach to identify and remove landmarks such as the heart and pectoral muscles. The BROI segmentation is carried out with a framework consisting of three major steps. Firstly, we use adaptive wiener filtering and k-means clustering to minimize the influence of noises, preserve edges and remove unwanted artefacts. The second step systematically excludes the heart area by utilizing active contour based level sets where initial contour points are determined by the maximum entropy thresholding and convolution method. Finally, a pectoral muscle is removed by using morphological operations and local adaptive thresholding on MR images. Prior to the elimination of the pectoral muscle, the MR image is sub divided into three sections: left, right, and central based on the geometrical information. Subsequently, a BD segmentation is achieved with 4 level fuzzy c-means (FCM) thresholding on the denoised BROI segmentation. The proposed method is validated using the 1350 breast images from 15 female subjects. The pixel-based quantitative analysis showed excellent segmentation results when compared with manually drawn BROI and BD. Furthermore, the presented results in terms of evaluation matrices: Acc, Sp, AUC, MR, P, Se and DSC demonstrate the high quality of segmentations using the proposed method. The average computational time for the segmentation of BROI and BD is 1 minute and 50 seconds.
Collapse
Affiliation(s)
- Dinesh Pandey
- Institute for Sustainable Industries and Liveable Cities, Victoria University, Melbourne, Australia
| | - Xiaoxia Yin
- Cyberspace Institute of Advanced Technology (CIAT), Guangzhou University, Guangzhou 510006, China
| | - Hua Wang
- Institute for Sustainable Industries and Liveable Cities, Victoria University, Melbourne, Australia
| | - Min-Ying Su
- Tu and Yuen Center for Functional Onco-Imaging, Department of Radiological Sciences, University of California, Irvine, CA, United States of America
| | - Jeon-Hor Chen
- Tu and Yuen Center for Functional Onco-Imaging, Department of Radiological Sciences, University of California, Irvine, CA, United States of America
- Department of Radiology, E-Da Hospital and I-Shou University, Kaohsiung, Taiwan
| | - Jianlin Wu
- Department of Radiology, Zhongshan Hospital of Dalian University, Dalian, Liaoning, China
| | - Yanchun Zhang
- Institute for Sustainable Industries and Liveable Cities, Victoria University, Melbourne, Australia
| |
Collapse
|
14
|
Thakran S, Chatterjee S, Singhal M, Gupta RK, Singh A. Automatic outer and inner breast tissue segmentation using multi-parametric MRI images of breast tumor patients. PLoS One 2018; 13:e0190348. [PMID: 29320532 PMCID: PMC5761869 DOI: 10.1371/journal.pone.0190348] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2017] [Accepted: 12/13/2017] [Indexed: 11/22/2022] Open
Abstract
The objectives of the study were to develop a framework for automatic outer and inner breast tissue segmentation using multi-parametric MRI images of the breast tumor patients; and to perform breast density and tumor tissue analysis. MRI of the breast was performed on 30 patients at 3T-MRI. T1, T2 and PD-weighted(W) images, with and without fat saturation(WWFS), and dynamic-contrast-enhanced(DCE)-MRI data were acquired. The proposed automatic segmentation approach was performed in two steps. In step-1, outer segmentation of breast tissue from rest of body parts was performed on structural images (T2-W/T1-W/PD-W without fat saturation images) using automatic landmarks detection technique based on operations like profile screening, Otsu thresholding, morphological operations and empirical observation. In step-2, inner segmentation of breast tissue into fibro-glandular(FG), fatty and tumor tissue was performed. For validation of breast tissue segmentation, manual segmentation was carried out by two radiologists and similarity coefficients(Dice and Jaccard) were computed for outer as well as inner tissues. FG density and tumor volume were also computed and analyzed. The proposed outer and inner segmentation approach worked well for all the subjects and was validated by two radiologists. The average Dice and Jaccard coefficients value for outer segmentation using T2-W images, obtained by two radiologists, were 0.977 and 0.951 respectively. These coefficient values for FG tissue were 0.915 and 0.875 respectively whereas for tumor tissue, values were 0.968 and 0.95 respectively. The volume of segmented tumor ranged over 2.1 cm3–7.08 cm3. The proposed approach provided automatic outer and inner breast tissue segmentation, which enables automatic calculations of breast tissue density and tumor volume. This is a complete framework for outer and inner breast segmentation method for all structural images.
Collapse
Affiliation(s)
- Snekha Thakran
- Centre for Biomedical Engineering, Indian Institute of Technology Delhi, New Delhi, India
| | - Subhajit Chatterjee
- Department of Computer Science and Engineering, Indian Institute of Technology Delhi, New Delhi, India
| | - Meenakshi Singhal
- Department of Radiology, Fortis Memorial Research Institute, Gurgaon, India
| | - Rakesh Kumar Gupta
- Department of Radiology, Fortis Memorial Research Institute, Gurgaon, India
| | - Anup Singh
- Centre for Biomedical Engineering, Indian Institute of Technology Delhi, New Delhi, India.,Department of Biomedical Engineering, All India Institute of Medical Sciences Delhi, New Delhi, India
| |
Collapse
|
15
|
Doran SJ, Hipwell JH, Denholm R, Eiben B, Busana M, Hawkes DJ, Leach MO, Silva IDS. Breast MRI segmentation for density estimation: Do different methods give the same results and how much do differences matter? Med Phys 2017; 44:4573-4592. [PMID: 28477346 PMCID: PMC5697622 DOI: 10.1002/mp.12320] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2016] [Revised: 03/02/2017] [Accepted: 04/03/2017] [Indexed: 11/20/2022] Open
Abstract
PURPOSE To compare two methods of automatic breast segmentation with each other and with manual segmentation in a large subject cohort. To discuss the factors involved in selecting the most appropriate algorithm for automatic segmentation and, in particular, to investigate the appropriateness of overlap measures (e.g., Dice and Jaccard coefficients) as the primary determinant in algorithm selection. METHODS Two methods of breast segmentation were applied to the task of calculating MRI breast density in 200 subjects drawn from the Avon Longitudinal Study of Parents and Children, a large cohort study with an MRI component. A semiautomated, bias-corrected, fuzzy C-means (BC-FCM) method was combined with morphological operations to segment the overall breast volume from in-phase Dixon images. The method makes use of novel, problem-specific insights. The resulting segmentation mask was then applied to the corresponding Dixon water and fat images, which were combined to give Dixon MRI density values. Contemporaneously acquired T1 - and T2 -weighted image datasets were analyzed using a novel and fully automated algorithm involving image filtering, landmark identification, and explicit location of the pectoral muscle boundary. Within the region found, fat-water discrimination was performed using an Expectation Maximization-Markov Random Field technique, yielding a second independent estimate of MRI density. RESULTS Images are presented for two individual women, demonstrating how the difficulty of the problem is highly subject-specific. Dice and Jaccard coefficients comparing the semiautomated BC-FCM method, operating on Dixon source data, with expert manual segmentation are presented. The corresponding results for the method based on T1 - and T2 -weighted data are slightly lower in the individual cases shown, but scatter plots and interclass correlations for the cohort as a whole show that both methods do an excellent job in segmenting and classifying breast tissue. CONCLUSIONS Epidemiological results demonstrate that both methods of automated segmentation are suitable for the chosen application and that it is important to consider a range of factors when choosing a segmentation algorithm, rather than focus narrowly on a single metric such as the Dice coefficient.
Collapse
Affiliation(s)
- Simon J. Doran
- Division of Radiotherapy and Imaging, The Institute of Cancer ResearchCancer Research UK Cancer Imaging CentreLondonSM2 5NGUK
| | - John H. Hipwell
- Department of Medical Physics and BioengineeringUCL, Centre for Medical Image Computing (CMIC)LondonWC1E 7JEUK
| | - Rachel Denholm
- Department of Non‐Communicable Disease EpidemiologyLondon School of Hygiene & Tropical MedicineLondonWC1E 7HTUK
| | - Björn Eiben
- Department of Medical Physics and BioengineeringUCL, Centre for Medical Image Computing (CMIC)LondonWC1E 7JEUK
| | - Marta Busana
- Department of Non‐Communicable Disease EpidemiologyLondon School of Hygiene & Tropical MedicineLondonWC1E 7HTUK
| | - David J. Hawkes
- Department of Medical Physics and BioengineeringUCL, Centre for Medical Image Computing (CMIC)LondonWC1E 7JEUK
| | - Martin O. Leach
- Division of Radiotherapy and Imaging, The Institute of Cancer ResearchCancer Research UK Cancer Imaging CentreLondonSM2 5NGUK
| | - Isabel dos Santos Silva
- Department of Non‐Communicable Disease EpidemiologyLondon School of Hygiene & Tropical MedicineLondonWC1E 7HTUK
| |
Collapse
|
16
|
Pujara AC, Mikheev A, Rusinek H, Rallapalli H, Walczyk J, Gao Y, Chhor C, Pysarenko K, Babb JS, Melsaether AN. Clinical applicability and relevance of fibroglandular tissue segmentation on routine T1 weighted breast MRI. Clin Imaging 2017; 42:119-125. [DOI: 10.1016/j.clinimag.2016.12.002] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2016] [Revised: 11/07/2016] [Accepted: 12/02/2016] [Indexed: 10/20/2022]
|
17
|
Color-coded visualization of magnetic resonance imaging multiparametric maps. Sci Rep 2017; 7:41107. [PMID: 28112222 PMCID: PMC5255548 DOI: 10.1038/srep41107] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2016] [Accepted: 12/15/2016] [Indexed: 12/11/2022] Open
Abstract
Multiparametric magnetic resonance imaging (mpMRI) data are emergingly used in the clinic e.g. for the diagnosis of prostate cancer. In contrast to conventional MR imaging data, multiparametric data typically include functional measurements such as diffusion and perfusion imaging sequences. Conventionally, these measurements are visualized with a one-dimensional color scale, allowing only for one-dimensional information to be encoded. Yet, human perception places visual information in a three-dimensional color space. In theory, each dimension of this space can be utilized to encode visual information. We addressed this issue and developed a new method for tri-variate color-coded visualization of mpMRI data sets. We showed the usefulness of our method in a preclinical and in a clinical setting: In imaging data of a rat model of acute kidney injury, the method yielded characteristic visual patterns. In a clinical data set of N = 13 prostate cancer mpMRI data, we assessed diagnostic performance in a blinded study with N = 5 observers. Compared to conventional radiological evaluation, color-coded visualization was comparable in terms of positive and negative predictive values. Thus, we showed that human observers can successfully make use of the novel method. This method can be broadly applied to visualize different types of multivariate MRI data.
Collapse
|
18
|
Ertas G, Doran SJ, Leach MO. A computerized volumetric segmentation method applicable to multi-centre MRI data to support computer-aided breast tissue analysis, density assessment and lesion localization. Med Biol Eng Comput 2017; 55:57-68. [PMID: 27106750 PMCID: PMC5222930 DOI: 10.1007/s11517-016-1484-y] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2015] [Accepted: 03/04/2016] [Indexed: 11/05/2022]
Abstract
Density assessment and lesion localization in breast MRI require accurate segmentation of breast tissues. A fast, computerized algorithm for volumetric breast segmentation, suitable for multi-centre data, has been developed, employing 3D bias-corrected fuzzy c-means clustering and morphological operations. The full breast extent is determined on T1-weighted images without prior information concerning breast anatomy. Left and right breasts are identified separately using automatic detection of the midsternum. Statistical analysis of breast volumes from eighty-two women scanned in a UK multi-centre study of MRI screening shows that the segmentation algorithm performs well when compared with manually corrected segmentation, with high relative overlap (RO), high true-positive volume fraction (TPVF) and low false-positive volume fraction (FPVF), and has an overall performance of RO 0.94 ± 0.05, TPVF 0.97 ± 0.03 and FPVF 0.04 ± 0.06, respectively (training: 0.93 ± 0.05, 0.97 ± 0.03 and 0.04 ± 0.06; test: 0.94 ± 0.05, 0.98 ± 0.02 and 0.05 ± 0.07).
Collapse
Affiliation(s)
- Gokhan Ertas
- Cancer Research UK Cancer Imaging Centre, Division of Radiotherapy and Imaging, The Institute of Cancer Research, 123 Old Brompton Road, London, SW7 3RP UK
- Department of Biomedical Engineering, Yeditepe University, Istanbul, Turkey
| | - Simon J. Doran
- Cancer Research UK Cancer Imaging Centre, Division of Radiotherapy and Imaging, The Institute of Cancer Research, 123 Old Brompton Road, London, SW7 3RP UK
| | - Martin O. Leach
- Cancer Research UK Cancer Imaging Centre, Division of Radiotherapy and Imaging, The Institute of Cancer Research, 123 Old Brompton Road, London, SW7 3RP UK
| |
Collapse
|
19
|
Rosado-Toro JA, Barr T, Galons JP, Marron MT, Stopeck A, Thomson C, Thompson P, Carroll D, Wolf E, Altbach MI, Rodríguez JJ. Automated breast segmentation of fat and water MR images using dynamic programming. Acad Radiol 2015; 22:139-48. [PMID: 25572926 PMCID: PMC4366060 DOI: 10.1016/j.acra.2014.09.015] [Citation(s) in RCA: 28] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2014] [Revised: 09/23/2014] [Accepted: 09/26/2014] [Indexed: 11/18/2022]
Abstract
RATIONALE AND OBJECTIVES To develop and test an algorithm that outlines the breast boundaries using information from fat and water magnetic resonance images. MATERIALS AND METHODS Three algorithms were implemented and tested using registered fat and water magnetic resonance images. Two of the segmentation algorithms are simple extensions of the techniques used for contrast-enhanced images: one algorithm uses clustering and local gradient (CLG) analysis and the other algorithm uses a Hessian-based sheetness filter (HSF). The third segmentation algorithm uses k-means++ and dynamic programming (KDP) for finding the breast pixels. All three algorithms separate the left and right breasts using either a fixed region or a morphological method. The performance is quantified using a mutual overlap (Dice) metric and a pectoral muscle boundary error. The algorithms are evaluated against three manual tracers using 266 breast images from 14 female subjects. RESULTS The KDP algorithm has a mean overlap percentage improvement that is statistically significant relative to the HSF and CLG algorithms. When using a fixed region to remove the tissue between breasts with tracer 1 as a reference, the KDP algorithm has a mean overlap of 0.922 compared to 0.864 (P < .01) for HSF and 0.843 (P < .01) for CLG. The performance of KDP is very similar to tracers 2 (0.926 overlap) and 3 (0.929 overlap). The performance analysis in terms of pectoral muscle boundary error showed that the fraction of the muscle boundary within three pixels of reference tracer 1 is 0.87 using KDP compared to 0.578 for HSF and 0.617 for CLG. Our results show that the performance of the KDP algorithm is independent of breast density. CONCLUSIONS We developed a new automated segmentation algorithm (KDP) to isolate breast tissue from magnetic resonance fat and water images. KDP outperforms the other techniques that focus on local analysis (CLG and HSF) and yields a performance similar to human tracers.
Collapse
Affiliation(s)
- José A Rosado-Toro
- Department of Electrical and Computer Engineering, University of Arizona, Tucson, Arizona 85721
| | - Tomoe Barr
- Department of Biomedical Engineering, University of Arizona, Tucson, Arizona 85721
| | | | | | - Alison Stopeck
- Arizona Cancer Center, Tucson, Arizona 85721; Department of Medicine, University of Arizona, Tucson, Arizona 85724
| | | | - Patricia Thompson
- Arizona Cancer Center, Tucson, Arizona 85721; Department of Cellular and Molecular Medicine, University of Arizona, Tucson, Arizona 85721
| | - Danielle Carroll
- Department of Medical Imaging, University of Arizona, Tucson, AZ 85724
| | - Eszter Wolf
- Department of Medical Imaging, University of Arizona, Tucson, AZ 85724
| | - María I Altbach
- Department of Medical Imaging, University of Arizona, Tucson, AZ 85724.
| | - Jeffrey J Rodríguez
- Department of Electrical and Computer Engineering, University of Arizona, Tucson, Arizona 85721
| |
Collapse
|
20
|
Wu S, Weinstein SP, Conant EF, Kontos D. Automated fibroglandular tissue segmentation and volumetric density estimation in breast MRI using an atlas-aided fuzzy C-means method. Med Phys 2014; 40:122302. [PMID: 24320533 DOI: 10.1118/1.4829496] [Citation(s) in RCA: 52] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
PURPOSE Breast magnetic resonance imaging (MRI) plays an important role in the clinical management of breast cancer. Studies suggest that the relative amount of fibroglandular (i.e., dense) tissue in the breast as quantified in MR images can be predictive of the risk for developing breast cancer, especially for high-risk women. Automated segmentation of the fibroglandular tissue and volumetric density estimation in breast MRI could therefore be useful for breast cancer risk assessment. METHODS In this work the authors develop and validate a fully automated segmentation algorithm, namely, an atlas-aided fuzzy C-means (FCM-Atlas) method, to estimate the volumetric amount of fibroglandular tissue in breast MRI. The FCM-Atlas is a 2D segmentation method working on a slice-by-slice basis. FCM clustering is first applied to the intensity space of each 2D MR slice to produce an initial voxelwise likelihood map of fibroglandular tissue. Then a prior learned fibroglandular tissue likelihood atlas is incorporated to refine the initial FCM likelihood map to achieve enhanced segmentation, from which the absolute volume of the fibroglandular tissue (|FGT|) and the relative amount (i.e., percentage) of the |FGT| relative to the whole breast volume (FGT%) are computed. The authors' method is evaluated by a representative dataset of 60 3D bilateral breast MRI scans (120 breasts) that span the full breast density range of the American College of Radiology Breast Imaging Reporting and Data System. The automated segmentation is compared to manual segmentation obtained by two experienced breast imaging radiologists. Segmentation performance is assessed by linear regression, Pearson's correlation coefficients, Student's paired t-test, and Dice's similarity coefficients (DSC). RESULTS The inter-reader correlation is 0.97 for FGT% and 0.95 for |FGT|. When compared to the average of the two readers' manual segmentation, the proposed FCM-Atlas method achieves a correlation of r = 0.92 for FGT% and r = 0.93 for |FGT|, and the automated segmentation is not statistically significantly different (p = 0.46 for FGT% and p = 0.55 for |FGT|). The bilateral correlation between left breasts and right breasts for the FGT% is 0.94, 0.92, and 0.95 for reader 1, reader 2, and the FCM-Atlas, respectively; likewise, for the |FGT|, it is 0.92, 0.92, and 0.93, respectively. For the spatial segmentation agreement, the automated algorithm achieves a DSC of 0.69 ± 0.1 when compared to reader 1 and 0.61 ± 0.1 for reader 2, respectively, while the DSC between the two readers' manual segmentation is 0.67 ± 0.15. Additional robustness analysis shows that the segmentation performance of the authors' method is stable both with respect to selecting different cases and to varying the number of cases needed to construct the prior probability atlas. The authors' results also show that the proposed FCM-Atlas method outperforms the commonly used two-cluster FCM-alone method. The authors' method runs at ∼5 min for each 3D bilateral MR scan (56 slices) for computing the FGT% and |FGT|, compared to ∼55 min needed for manual segmentation for the same purpose. CONCLUSIONS The authors' method achieves robust segmentation and can serve as an efficient tool for processing large clinical datasets for quantifying the fibroglandular tissue content in breast MRI. It holds a great potential to support clinical applications in the future including breast cancer risk assessment.
Collapse
Affiliation(s)
- Shandong Wu
- Department of Radiology, University of Pennsylvania, Philadelphia, Pennsylvania 19104
| | | | | | | |
Collapse
|
21
|
Payne A, Todd N, Minalga E, Wang Y, Diakite M, Hadley R, Merrill R, Factor R, Neumayer L, Parker DL. In vivo evaluation of a breast-specific magnetic resonance guided focused ultrasound system in a goat udder model. Med Phys 2014; 40:073302. [PMID: 23822456 DOI: 10.1118/1.4811103] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/04/2023] Open
Abstract
PURPOSE This work further evaluates the functionality, efficacy, and safety of a new breast-specific magnetic resonance guided high intensity focused ultrasound (MRgFUS) system in an in vivo goat udder model. METHODS Eight female goats underwent an MRgFUS ablation procedure using the breast-specific MRgFUS system. Tissue classification was achieved through the 3D magnetic resonance imaging (MRI) acquisition of several contrasts (T1w, T2w, PDw, 3-point Dixon). The MRgFUS treatment was performed with a grid trajectory executed in one or two planes within the glandular tissue of the goat udder. Temperature was monitored using a 3D proton resonance frequency (PRF) MRI technique. Delayed contrast enhanced-MR images were acquired immediately and 14 days post MRgFUS treatment. A localized tissue excision was performed in one animal and histological analysis was performed. Animals were available for adoption at the conclusion of the study. RESULTS The breast-specific MRgFUS system was able to ablate regions ranging in size from 0.4 to 3.6 cm(3) in the goat udder model. Tissue damage was confirmed through the correlation of thermal dose measurements obtained with realtime 3D MR thermometry to delayed contrast enhanced-MR images immediately after the treatment and 14 days postablation. In general, lesions were longer in the ultrasound propagation direction, which is consistent with the dimensions of the ultrasound focal spot. Thermal dose volumes had better agreement with nonenhancing areas of the DCE-MRI images obtained 14 days after the MRgFUS treatment. CONCLUSIONS The system was able to successfully ablate lesions up to 3.6 cm(3). The thermal dose volume was found to correlate better with the 14-day postablation nonenhancing delayed contrast enhanced-MR image volumes. While the goat udder is not an ideal model for the human breast, this study has proven the feasibility of using this system on a wide variety of udder shapes and sizes, demonstrating the flexibility that would be required in order to treat human subjects.
Collapse
Affiliation(s)
- A Payne
- Utah Center for Advanced Imaging Research, University of Utah, 729 Arapeen Drive, Salt Lake City, Utah 84108, USA.
| | | | | | | | | | | | | | | | | | | |
Collapse
|