1
|
Wang J, Wang L, Yang Z, Tan W, Liu Y. Application of machine learning in the analysis of multiparametric MRI data for the differentiation of treatment responses in breast cancer: retrospective study. Eur J Cancer Prev 2024:00008469-990000000-00145. [PMID: 38743632 DOI: 10.1097/cej.0000000000000892] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/16/2024]
Abstract
OBJECTIVE The objective of this study is to develop and validate a multiparametric MRI model employing machine learning to predict the effectiveness of treatment and the stage of breast cancer. METHODS The study encompassed 400 female patients diagnosed with breast cancer, with 200 individuals allocated to both the control and experimental groups, undergoing examinations in Shenzhen, China, during the period 2017-2023. This study pertains to retrospective research. Multiparametric MRI was employed to extract data concerning tumor size, blood flow, and metabolism. RESULTS The model achieved high accuracy, predicting treatment outcomes with an accuracy of 92%, sensitivity of 88%, and specificity of 95%. The model effectively classified breast cancer stages: stage I, 38% (P = 0.027); stage II, 72% (P = 0.014); stage III, 50% (P = 0.032); and stage IV, 45% (P = 0.041). CONCLUSIONS The developed model, utilizing multiparametric MRI and machine learning, exhibits high accuracy in predicting the effectiveness of treatment and breast cancer staging. These findings affirm the model's potential to enhance treatment strategies and personalize approaches for patients diagnosed with breast cancer. Our study presents an innovative approach to the diagnosis and treatment of breast cancer, integrating MRI data with machine learning algorithms. We demonstrate that the developed model exhibits high accuracy in predicting treatment efficacy and differentiating cancer stages. This underscores the importance of utilizing MRI and machine learning algorithms to enhance the diagnosis and individualization of treatment for this disease.
Collapse
Affiliation(s)
- Jinhua Wang
- Medical Image Center, Shenzhen Hospital
- The Third of Clinical Medicine, Southern Medical University
| | - Liang Wang
- Interventional Department, The University of Hong Kong-Shenzhen Hospital, Shenzhen
| | - Zhongxian Yang
- Medical Image Center, Shenzhen Hospital
- The Third of Clinical Medicine, Southern Medical University
| | - Wanchang Tan
- Department of Radiology, The Sixth Affiliated Hospital, School of Medicine, South China University of Technology, Foshan, China
| | - Yubao Liu
- Medical Image Center, Shenzhen Hospital
- The Third of Clinical Medicine, Southern Medical University
| |
Collapse
|
2
|
Guo Y, Zhang H, Yuan L, Chen W, Zhao H, Yu QQ, Shi W. Machine learning and new insights for breast cancer diagnosis. J Int Med Res 2024; 52:3000605241237867. [PMID: 38663911 PMCID: PMC11047257 DOI: 10.1177/03000605241237867] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2023] [Accepted: 02/21/2024] [Indexed: 04/28/2024] Open
Abstract
Breast cancer (BC) is the most prominent form of cancer among females all over the world. The current methods of BC detection include X-ray mammography, ultrasound, computed tomography, magnetic resonance imaging, positron emission tomography and breast thermographic techniques. More recently, machine learning (ML) tools have been increasingly employed in diagnostic medicine for its high efficiency in detection and intervention. The subsequent imaging features and mathematical analyses can then be used to generate ML models, which stratify, differentiate and detect benign and malignant breast lesions. Given its marked advantages, radiomics is a frequently used tool in recent research and clinics. Artificial neural networks and deep learning (DL) are novel forms of ML that evaluate data using computer simulation of the human brain. DL directly processes unstructured information, such as images, sounds and language, and performs precise clinical image stratification, medical record analyses and tumour diagnosis. Herein, this review thoroughly summarizes prior investigations on the application of medical images for the detection and intervention of BC using radiomics, namely DL and ML. The aim was to provide guidance to scientists regarding the use of artificial intelligence and ML in research and the clinic.
Collapse
Affiliation(s)
- Ya Guo
- Department of Oncology, Jining No.1 People’s Hospital, Shandong First Medical University, Jining, Shandong Province, China
| | - Heng Zhang
- Department of Laboratory Medicine, Shandong Daizhuang Hospital, Jining, Shandong Province, China
| | - Leilei Yuan
- Department of Oncology, Jining No.1 People’s Hospital, Shandong First Medical University, Jining, Shandong Province, China
| | - Weidong Chen
- Department of Oncology, Jining No.1 People’s Hospital, Shandong First Medical University, Jining, Shandong Province, China
| | - Haibo Zhao
- Department of Oncology, Jining No.1 People’s Hospital, Shandong First Medical University, Jining, Shandong Province, China
| | - Qing-Qing Yu
- Phase I Clinical Research Centre, Jining No.1 People’s Hospital, Shandong First Medical University, Jining, Shandong Province, China
| | - Wenjie Shi
- Molecular and Experimental Surgery, University Clinic for General-, Visceral-, Vascular- and Trans-Plantation Surgery, Medical Faculty University Hospital Magdeburg, Otto-von Guericke University, Magdeburg, Germany
| |
Collapse
|
3
|
Dell'Aquila K, Vadlamani A, Maldjian T, Fineberg S, Eligulashvili A, Chung J, Adam R, Hodges L, Hou W, Makower D, Duong TQ. Machine learning prediction of pathological complete response and overall survival of breast cancer patients in an underserved inner-city population. Breast Cancer Res 2024; 26:7. [PMID: 38200586 PMCID: PMC10782738 DOI: 10.1186/s13058-023-01762-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2023] [Accepted: 12/29/2023] [Indexed: 01/12/2024] Open
Abstract
BACKGROUND Generalizability of predictive models for pathological complete response (pCR) and overall survival (OS) in breast cancer patients requires diverse datasets. This study employed four machine learning models to predict pCR and OS up to 7.5 years using data from a diverse and underserved inner-city population. METHODS Demographics, staging, tumor subtypes, income, insurance status, and data from radiology reports were obtained from 475 breast cancer patients on neoadjuvant chemotherapy in an inner-city health system (01/01/2012 to 12/31/2021). Logistic regression, Neural Network, Random Forest, and Gradient Boosted Regression models were used to predict outcomes (pCR and OS) with fivefold cross validation. RESULTS pCR was not associated with age, race, ethnicity, tumor staging, Nottingham grade, income, and insurance status (p > 0.05). ER-/HER2+ showed the highest pCR rate, followed by triple negative, ER+/HER2+, and ER+/HER2- (all p < 0.05), tumor size (p < 0.003) and background parenchymal enhancement (BPE) (p < 0.01). Machine learning models ranked ER+/HER2-, ER-/HER2+, tumor size, and BPE as top predictors of pCR (AUC = 0.74-0.76). OS was associated with race, pCR status, tumor subtype, and insurance status (p < 0.05), but not ethnicity and incomes (p > 0.05). Machine learning models ranked tumor stage, pCR, nodal stage, and triple-negative subtype as top predictors of OS (AUC = 0.83-0.85). When grouping race and ethnicity by tumor subtypes, neither OS nor pCR were different due to race and ethnicity for each tumor subtype (p > 0.05). CONCLUSION Tumor subtypes and imaging characteristics were top predictors of pCR in our inner-city population. Insurance status, race, tumor subtypes and pCR were associated with OS. Machine learning models accurately predicted pCR and OS.
Collapse
Affiliation(s)
- Kevin Dell'Aquila
- Department of Radiology, Montefiore Health System and Albert Einstein College of Medicine, 111 E 210th St, Bronx, NY, 10467, USA
| | - Abhinav Vadlamani
- Department of Radiology, Montefiore Health System and Albert Einstein College of Medicine, 111 E 210th St, Bronx, NY, 10467, USA
| | - Takouhie Maldjian
- Department of Radiology, Montefiore Health System and Albert Einstein College of Medicine, 111 E 210th St, Bronx, NY, 10467, USA
| | - Susan Fineberg
- Department of Pathology, Montefiore Health System and Albert Einstein College of Medicine, Bronx, NY, USA
| | - Anna Eligulashvili
- Department of Radiology, Montefiore Health System and Albert Einstein College of Medicine, 111 E 210th St, Bronx, NY, 10467, USA
| | - Julie Chung
- Department of Oncology, Montefiore Health System and Albert Einstein College of Medicine, Bronx, NY, USA
| | - Richard Adam
- Department of Radiology, Montefiore Health System and Albert Einstein College of Medicine, 111 E 210th St, Bronx, NY, 10467, USA
| | - Laura Hodges
- Department of Radiology, Montefiore Health System and Albert Einstein College of Medicine, 111 E 210th St, Bronx, NY, 10467, USA
| | - Wei Hou
- Department of Radiology, Montefiore Health System and Albert Einstein College of Medicine, 111 E 210th St, Bronx, NY, 10467, USA
| | - Della Makower
- Department of Oncology, Montefiore Health System and Albert Einstein College of Medicine, Bronx, NY, USA
| | - Tim Q Duong
- Department of Radiology, Montefiore Health System and Albert Einstein College of Medicine, 111 E 210th St, Bronx, NY, 10467, USA.
- Center for Health Data Innovation, Montefiore Health System and Albert Einstein College of Medicine, Bronx, NY, USA.
| |
Collapse
|
4
|
Narongrit FW, Rispoli JV. Editorial for "MRI-Based Breast Cancer Classification and Localization by Multiparametric Feature Extraction and Combination Using Deep Learning". J Magn Reson Imaging 2024; 59:162-163. [PMID: 37052873 DOI: 10.1002/jmri.28733] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2023] [Accepted: 03/30/2023] [Indexed: 04/14/2023] Open
Affiliation(s)
- Folk W Narongrit
- Elmore Family School of Electrical and Computer Engineering, Purdue University, West Lafayette, Indiana, USA
- Weldon School of Biomedical Engineering, Purdue University, West Lafayette, Indiana, USA
| | - Joseph V Rispoli
- Elmore Family School of Electrical and Computer Engineering, Purdue University, West Lafayette, Indiana, USA
- Weldon School of Biomedical Engineering, Purdue University, West Lafayette, Indiana, USA
- Purdue Institute for Cancer Research, West Lafayette, Indiana, USA
- Department of Radiology and Medical Imaging, University of Virginia, Charlottesville, Virginia, USA
| |
Collapse
|
5
|
van Staalduinen EK, Matthews R, Khan A, Punn I, Cattell RF, Li H, Franceschi A, Samara GJ, Czerwonka L, Bangiyev L, Duong TQ. Improved Cervical Lymph Node Characterization among Patients with Head and Neck Squamous Cell Carcinoma Using MR Texture Analysis Compared to Traditional FDG-PET/MR Features Alone. Diagnostics (Basel) 2023; 14:71. [PMID: 38201380 PMCID: PMC10802850 DOI: 10.3390/diagnostics14010071] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2023] [Revised: 12/24/2023] [Accepted: 12/26/2023] [Indexed: 01/12/2024] Open
Abstract
Accurate differentiation of benign and malignant cervical lymph nodes is important for prognosis and treatment planning in patients with head and neck squamous cell carcinoma. We evaluated the diagnostic performance of magnetic resonance image (MRI) texture analysis and traditional 18F-deoxyglucose positron emission tomography (FDG-PET) features. This retrospective study included 21 patients with head and neck squamous cell carcinoma. We used texture analysis of MRI and FDG-PET features to evaluate 109 histologically confirmed cervical lymph nodes (41 metastatic, 68 benign). Predictive models were evaluated using area under the curve (AUC). Significant differences were observed between benign and malignant cervical lymph nodes for 36 of 41 texture features (p < 0.05). A combination of 22 MRI texture features discriminated benign and malignant nodal disease with AUC, sensitivity, and specificity of 0.952, 92.7%, and 86.7%, which was comparable to maximum short-axis diameter, lymph node morphology, and maximum standard uptake value (SUVmax). The addition of MRI texture features to traditional FDG-PET features differentiated these groups with the greatest AUC, sensitivity, and specificity (0.989, 97.5%, and 94.1%). The addition of the MRI texture feature to lymph node morphology improved nodal assessment specificity from 70.6% to 88.2% among FDG-PET indeterminate lymph nodes. Texture features are useful for differentiating benign and malignant cervical lymph nodes in patients with head and neck squamous cell carcinoma. Lymph node morphology and SUVmax remain accurate tools. Specificity is improved by the addition of MRI texture features among FDG-PET indeterminate lymph nodes. This approach is useful for differentiating benign and malignant cervical lymph nodes.
Collapse
Affiliation(s)
- Eric K. van Staalduinen
- Albert Einstein College of Medicine and Montefiore Medical Center, Department of Radiology, Bronx, NY 10467, USA
- Stony Brook Medicine, Department of Radiology, Stony Brook, NY 11794, USA (A.F.); (L.B.)
| | - Robert Matthews
- Stony Brook Medicine, Department of Radiology, Stony Brook, NY 11794, USA (A.F.); (L.B.)
| | - Adam Khan
- Stony Brook Medicine, Department of Radiology, Stony Brook, NY 11794, USA (A.F.); (L.B.)
| | - Isha Punn
- Stony Brook Medicine, Department of Radiology, Stony Brook, NY 11794, USA (A.F.); (L.B.)
| | - Renee F. Cattell
- Stony Brook Medicine, Department of Radiology, Stony Brook, NY 11794, USA (A.F.); (L.B.)
| | - Haifang Li
- Stony Brook Medicine, Department of Radiology, Stony Brook, NY 11794, USA (A.F.); (L.B.)
| | - Ana Franceschi
- Stony Brook Medicine, Department of Radiology, Stony Brook, NY 11794, USA (A.F.); (L.B.)
| | - Ghassan J. Samara
- Stony Brook Medicine, Department of Radiology, Stony Brook, NY 11794, USA (A.F.); (L.B.)
| | - Lukasz Czerwonka
- Stony Brook Medicine, Department of Radiology, Stony Brook, NY 11794, USA (A.F.); (L.B.)
| | - Lev Bangiyev
- Stony Brook Medicine, Department of Radiology, Stony Brook, NY 11794, USA (A.F.); (L.B.)
| | - Tim Q. Duong
- Albert Einstein College of Medicine and Montefiore Medical Center, Department of Radiology, Bronx, NY 10467, USA
| |
Collapse
|
6
|
Chen M, Kong C, Lin G, Chen W, Guo X, Chen Y, Cheng X, Chen M, Shi C, Xu M, Sun J, Lu C, Ji J. Development and validation of convolutional neural network-based model to predict the risk of sentinel or non-sentinel lymph node metastasis in patients with breast cancer: a machine learning study. EClinicalMedicine 2023; 63:102176. [PMID: 37662514 PMCID: PMC10474371 DOI: 10.1016/j.eclinm.2023.102176] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/02/2023] [Revised: 08/07/2023] [Accepted: 08/08/2023] [Indexed: 09/05/2023] Open
Abstract
Background For patients with sentinel lymph node (SLN) metastasis and low risk of residual non-SLN (NSLN) metastasis, axillary lymph node (ALN) dissection could lead to overtreatment. This study aimed to develop and validate an automated preoperative deep learning-based tool to predict the risk of SLN and NSLN metastasis in patients with breast cancer (BC) using dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) images. Methods In this machine learning study, we retrospectively enrolled 988 women with BC from three hospitals in Zhejiang, China between June 1, 2013 to December 31, 2021, June 1, 2017 to December 31, 2021, and January 1, 2019 to June 30, 2023, respectively. Patients were divided into the training set (n = 519), internal validation set (n = 129), external test set 1 (n = 296), and external test set 2 (n = 44). A convolutional neural network (CNN) model was proposed to predict the SLN and NSLN metastasis and was compared with clinical and radiomics approaches. The performance of different models to detect ALN metastasis was measured by the area under the curve (AUC), accuracy, sensitivity, and specificity. This study is registered at ChiCTR, ChiCTR2300070740. Findings For SLN prediction, the top-performing model (i.e., the CNN algorithm) achieved encouraging predictive performance in the internal validation set (AUC 0.899, 95% CI, 0.887-0.911), external test set 1 (AUC 0.885, 95% CI, 0.867-0.903), and external test set 2 (AUC 0.768, 95% CI, 0.738-0.798). For NSLN prediction, the CNN-based model also exhibited satisfactory performance in the internal validation set (AUC 0.800, 95% CI, 0.783-0.817), external test set 1 (AUC 0.763, 95% CI, 0.732-0.794), and external test set 2 (AUC 0.728, 95% CI, 0.719-0.738). Based on the subgroup analysis, the CNN model performed well in tumour group smaller than 2.0 cm, with the AUC of 0.801 (internal validation set) and 0.823 (external test set 1). Of 469 patients with BC, the false positive rate of SLN prediction declined from 77.9% to 32.9% using CNN model. Interpretation The CNN model can predict the SLN status of any detectable lesion size and condition of NSLN in patients with BC. Overall, the CNN model, employing ready DCE-MRI images could serve as a potential technique to assist surgeons in the personalized axillary treatment of in patients with BC non-invasively. Funding National Key Research and Development projects intergovernmental cooperation in science and technology of China, National Natural Science Foundation of China, Natural Science Foundation of Zhejiang Province, and Zhejiang Medical and Health Science Project.
Collapse
Affiliation(s)
- Mingzhen Chen
- Key Laboratory of Imaging Diagnosis and Minimally Invasive Interventional Research of Zhejiang Province, Lishui Hospital, International Institutes of Medicine, School of Medicine, Zhejiaing University, Lishui, Zhejiang 323000, China
| | - Chunli Kong
- Key Laboratory of Imaging Diagnosis and Minimally Invasive Interventional Research of Zhejiang Province, Lishui Hospital, International Institutes of Medicine, School of Medicine, Zhejiaing University, Lishui, Zhejiang 323000, China
- Institute of Imaging Diagnosis and Minimally Invasive Intervention Research, The Fifth Affiliated Hospital of Wenzhou Medical University, Lishui 323000, China
- Clinical College of the Affiliated Central Hospital, School of Medcine, Lishui University, Lishui 323000, China
| | - Guihan Lin
- Key Laboratory of Imaging Diagnosis and Minimally Invasive Interventional Research of Zhejiang Province, Lishui Hospital, International Institutes of Medicine, School of Medicine, Zhejiaing University, Lishui, Zhejiang 323000, China
- Institute of Imaging Diagnosis and Minimally Invasive Intervention Research, The Fifth Affiliated Hospital of Wenzhou Medical University, Lishui 323000, China
- Clinical College of the Affiliated Central Hospital, School of Medcine, Lishui University, Lishui 323000, China
| | - Weiyue Chen
- Key Laboratory of Imaging Diagnosis and Minimally Invasive Interventional Research of Zhejiang Province, Lishui Hospital, International Institutes of Medicine, School of Medicine, Zhejiaing University, Lishui, Zhejiang 323000, China
- Institute of Imaging Diagnosis and Minimally Invasive Intervention Research, The Fifth Affiliated Hospital of Wenzhou Medical University, Lishui 323000, China
- Clinical College of the Affiliated Central Hospital, School of Medcine, Lishui University, Lishui 323000, China
| | - Xinyu Guo
- Key Laboratory of Imaging Diagnosis and Minimally Invasive Interventional Research of Zhejiang Province, Lishui Hospital, International Institutes of Medicine, School of Medicine, Zhejiaing University, Lishui, Zhejiang 323000, China
| | - Yaning Chen
- Key Laboratory of Imaging Diagnosis and Minimally Invasive Interventional Research of Zhejiang Province, Lishui Hospital, International Institutes of Medicine, School of Medicine, Zhejiaing University, Lishui, Zhejiang 323000, China
| | - Xue Cheng
- Key Laboratory of Imaging Diagnosis and Minimally Invasive Interventional Research of Zhejiang Province, Lishui Hospital, International Institutes of Medicine, School of Medicine, Zhejiaing University, Lishui, Zhejiang 323000, China
- Institute of Imaging Diagnosis and Minimally Invasive Intervention Research, The Fifth Affiliated Hospital of Wenzhou Medical University, Lishui 323000, China
- Clinical College of the Affiliated Central Hospital, School of Medcine, Lishui University, Lishui 323000, China
| | - Minjiang Chen
- Key Laboratory of Imaging Diagnosis and Minimally Invasive Interventional Research of Zhejiang Province, Lishui Hospital, International Institutes of Medicine, School of Medicine, Zhejiaing University, Lishui, Zhejiang 323000, China
- Institute of Imaging Diagnosis and Minimally Invasive Intervention Research, The Fifth Affiliated Hospital of Wenzhou Medical University, Lishui 323000, China
- Clinical College of the Affiliated Central Hospital, School of Medcine, Lishui University, Lishui 323000, China
| | - Changsheng Shi
- Department of Interventional Radiology, The Third Affiliated Hospital of Wenzhou Medical University, Ruian, Zhejiang, China
| | - Min Xu
- Key Laboratory of Imaging Diagnosis and Minimally Invasive Interventional Research of Zhejiang Province, Lishui Hospital, International Institutes of Medicine, School of Medicine, Zhejiaing University, Lishui, Zhejiang 323000, China
- Institute of Imaging Diagnosis and Minimally Invasive Intervention Research, The Fifth Affiliated Hospital of Wenzhou Medical University, Lishui 323000, China
- Clinical College of the Affiliated Central Hospital, School of Medcine, Lishui University, Lishui 323000, China
| | - Junhui Sun
- Division of Hepatobiliary and Pancreatic Surgery, Hepatobiliary and Pancreatic Interventional Treatment Centre, The First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Chenying Lu
- Key Laboratory of Imaging Diagnosis and Minimally Invasive Interventional Research of Zhejiang Province, Lishui Hospital, International Institutes of Medicine, School of Medicine, Zhejiaing University, Lishui, Zhejiang 323000, China
- Institute of Imaging Diagnosis and Minimally Invasive Intervention Research, The Fifth Affiliated Hospital of Wenzhou Medical University, Lishui 323000, China
- Clinical College of the Affiliated Central Hospital, School of Medcine, Lishui University, Lishui 323000, China
| | - Jiansong Ji
- Key Laboratory of Imaging Diagnosis and Minimally Invasive Interventional Research of Zhejiang Province, Lishui Hospital, International Institutes of Medicine, School of Medicine, Zhejiaing University, Lishui, Zhejiang 323000, China
- Institute of Imaging Diagnosis and Minimally Invasive Intervention Research, The Fifth Affiliated Hospital of Wenzhou Medical University, Lishui 323000, China
- Clinical College of the Affiliated Central Hospital, School of Medcine, Lishui University, Lishui 323000, China
| |
Collapse
|
7
|
Drioua WR, Benamrane N, Sais L. Breast Cancer Histopathological Images Segmentation Using Deep Learning. Sensors (Basel) 2023; 23:7318. [PMID: 37687772 PMCID: PMC10490494 DOI: 10.3390/s23177318] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/26/2023] [Revised: 08/10/2023] [Accepted: 08/18/2023] [Indexed: 09/10/2023]
Abstract
Hospitals generate a significant amount of medical data every day, which constitute a very rich database for research. Today, this database is still not exploitable because to make its valorization possible, the images require an annotation which remains a costly and difficult task. Thus, the use of an unsupervised segmentation method could facilitate the process. In this article, we propose two approaches for the semantic segmentation of breast cancer histopathology images. On the one hand, an autoencoder architecture for unsupervised segmentation is proposed, and on the other hand, an improvement U-Net architecture for supervised segmentation is proposed. We evaluate these models on a public dataset of histological images of breast cancer. In addition, the performance of our segmentation methods is measured using several evaluation metrics such as accuracy, recall, precision and F1 score. The results are competitive with those of other modern methods.
Collapse
Affiliation(s)
- Wafaa Rajaa Drioua
- Laboratoire SIMPA, Département d’Informatique, Université des Sciences et de la Technologie d’Oran Mohamed Boudiaf (USTO-MB), Oran 31000, Algeria;
| | - Nacéra Benamrane
- Laboratoire SIMPA, Département d’Informatique, Université des Sciences et de la Technologie d’Oran Mohamed Boudiaf (USTO-MB), Oran 31000, Algeria;
| | - Lakhdar Sais
- Centre de Recherche en Informatique de Lens, CRIL, CNRS, Université d’Artois, 62307 Lens, France;
| |
Collapse
|
8
|
Adam R, Dell'Aquila K, Hodges L, Maldjian T, Duong TQ. Deep learning applications to breast cancer detection by magnetic resonance imaging: a literature review. Breast Cancer Res 2023; 25:87. [PMID: 37488621 PMCID: PMC10367400 DOI: 10.1186/s13058-023-01687-4] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2023] [Accepted: 07/11/2023] [Indexed: 07/26/2023] Open
Abstract
Deep learning analysis of radiological images has the potential to improve diagnostic accuracy of breast cancer, ultimately leading to better patient outcomes. This paper systematically reviewed the current literature on deep learning detection of breast cancer based on magnetic resonance imaging (MRI). The literature search was performed from 2015 to Dec 31, 2022, using Pubmed. Other database included Semantic Scholar, ACM Digital Library, Google search, Google Scholar, and pre-print depositories (such as Research Square). Articles that were not deep learning (such as texture analysis) were excluded. PRISMA guidelines for reporting were used. We analyzed different deep learning algorithms, methods of analysis, experimental design, MRI image types, types of ground truths, sample sizes, numbers of benign and malignant lesions, and performance in the literature. We discussed lessons learned, challenges to broad deployment in clinical practice and suggested future research directions.
Collapse
Affiliation(s)
- Richard Adam
- Department of Radiology, Albert Einstein College of Medicine and the Montefiore Medical Center, 1300 Morris Park Avenue, Bronx, NY, 10461, USA
| | - Kevin Dell'Aquila
- Department of Radiology, Albert Einstein College of Medicine and the Montefiore Medical Center, 1300 Morris Park Avenue, Bronx, NY, 10461, USA
| | - Laura Hodges
- Department of Radiology, Albert Einstein College of Medicine and the Montefiore Medical Center, 1300 Morris Park Avenue, Bronx, NY, 10461, USA
| | - Takouhie Maldjian
- Department of Radiology, Albert Einstein College of Medicine and the Montefiore Medical Center, 1300 Morris Park Avenue, Bronx, NY, 10461, USA
| | - Tim Q Duong
- Department of Radiology, Albert Einstein College of Medicine and the Montefiore Medical Center, 1300 Morris Park Avenue, Bronx, NY, 10461, USA.
| |
Collapse
|
9
|
Gao J, Zhong X, Li W, Li Q, Shao H, Wang Z, Dai Y, Ma H, Shi Y, Zhang H, Duan S, Zhang K, Yang P, Zhao F, Zhang H, Xie H, Mao N. Attention-based Deep Learning for the Preoperative Differentiation of Axillary Lymph Node Metastasis in Breast Cancer on DCE-MRI. J Magn Reson Imaging 2023; 57:1842-1853. [PMID: 36219519 DOI: 10.1002/jmri.28464] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2022] [Revised: 09/21/2022] [Accepted: 09/22/2022] [Indexed: 11/11/2022] Open
Abstract
BACKGROUND Previous studies have explored the potential on radiomics features of primary breast cancer tumor to identify axillary lymph node (ALN) metastasis. However, the value of deep learning (DL) to identify ALN metastasis remains unclear. PURPOSE To investigate the potential of the proposed attention-based DL model for the preoperative differentiation of ALN metastasis in breast cancer on dynamic contrast-enhanced MRI (DCE-MRI). STUDY TYPE Retrospective. POPULATION A total of 941 breast cancer patients who underwent DCE-MRI before surgery were included in the training (742 patients), internal test (83 patients), and external test (116 patients) cohorts. FIELD STRENGTH/SEQUENCE A 3.0 T MR scanner, DCE-MRI sequence. ASSESSMENT A DL model containing a 3D deep residual network (ResNet) architecture and a convolutional block attention module, named RCNet, was proposed for ALN metastasis identification. Three RCNet models were established based on the tumor, ALN, and combined tumor-ALN regions on the images. The performance of these models was compared with ResNet models, radiomics models, the Memorial Sloan-Kettering Cancer Center (MSKCC) model, and three radiologists (W.L., H.S., and F. L.). STATISTICAL TESTS Dice similarity coefficient for breast tumor and ALN segmentation. Accuracy, sensitivity, specificity, intercorrelation and intracorrelation coefficients, area under the curve (AUC), and Delong test for ALN classification. RESULTS The optimal RCNet model, that is, RCNet-tumor+ALN , achieved an AUC of 0.907, an accuracy of 0.831, a sensitivity of 0.824, and a specificity of 0.837 in the internal test cohort, as well as an AUC of 0.852, an accuracy of 0.828, a sensitivity of 0.792, and a specificity of 0.853 in the external test cohort. Additionally, with the assistance of RCNet-tumor+ALN , the radiologists' performance was improved (external test cohort, P < 0.05). DATA CONCLUSION DCE-MRI-based RCNet model could provide a noninvasive auxiliary tool to identify ALN metastasis preoperatively in breast cancer, which may assist radiologists in conducting more accurate evaluation of ALN status. EVIDENCE LEVEL 3 TECHNICAL EFFICACY: Stage 2.
Collapse
Affiliation(s)
- Jing Gao
- School of Medical Imaging, Binzhou Medical University, Yantai, Shandong, People's Republic of China
- Department of Radiology, Yantai Yuhuangding Hospital, Affiliated Hospital of Qingdao University, Yantai, Shandong, People's Republic of China
| | - Xin Zhong
- Department of Radiology, Affiliated Hospital of Qingdao University, Qingdao, Shandong, People's Republic of China
| | - Wenjuan Li
- Department of Radiology, Yantai Yuhuangding Hospital, Affiliated Hospital of Qingdao University, Yantai, Shandong, People's Republic of China
| | - Qin Li
- Department of Radiology, Fudan University Shanghai Cancer Center, Shanghai, People's Republic of China
| | - Huafei Shao
- Department of Radiology, Yantai Yuhuangding Hospital, Affiliated Hospital of Qingdao University, Yantai, Shandong, People's Republic of China
| | - Zhongyi Wang
- Department of Radiology, Yantai Yuhuangding Hospital, Affiliated Hospital of Qingdao University, Yantai, Shandong, People's Republic of China
| | - Yi Dai
- Department of Radiology, Peking University Shenzhen Hospital, Shenzhen, Guangdong, People's Republic of China
| | - Heng Ma
- Department of Radiology, Yantai Yuhuangding Hospital, Affiliated Hospital of Qingdao University, Yantai, Shandong, People's Republic of China
| | - Yinghong Shi
- Department of Radiology, Yantai Yuhuangding Hospital, Affiliated Hospital of Qingdao University, Yantai, Shandong, People's Republic of China
| | - Han Zhang
- Department of Radiology, Yantai Yuhuangding Hospital, Affiliated Hospital of Qingdao University, Yantai, Shandong, People's Republic of China
| | - Shaofeng Duan
- Precision Health Institution, GE Healthcare, Shanghai, People's Republic of China
| | - Kun Zhang
- Department of Breast Surgery, Yantai Yuhuangding Hospital, Affiliated Hospital of Qingdao University, Yantai, Shandong, People's Republic of China
| | - Ping Yang
- Department of Pathology, Yantai Yuhuangding Hospital, Affiliated Hospital of Qingdao University, Yantai, Shandong, People's Republic of China
| | - Feng Zhao
- School of Compute Science and Technology, Shandong Technology and Business University, Yantai, Shandong, People's Republic of China
| | - Haicheng Zhang
- Department of Radiology, Yantai Yuhuangding Hospital, Affiliated Hospital of Qingdao University, Yantai, Shandong, People's Republic of China
| | - Haizhu Xie
- Department of Radiology, Yantai Yuhuangding Hospital, Affiliated Hospital of Qingdao University, Yantai, Shandong, People's Republic of China
| | - Ning Mao
- Department of Radiology, Yantai Yuhuangding Hospital, Affiliated Hospital of Qingdao University, Yantai, Shandong, People's Republic of China
| |
Collapse
|
10
|
Trepanier C, Huang A, Liu M, Ha R. Emerging uses of artificial intelligence in breast and axillary ultrasound. Clin Imaging 2023; 100:64-68. [PMID: 37243994 DOI: 10.1016/j.clinimag.2023.05.007] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2023] [Accepted: 05/02/2023] [Indexed: 05/29/2023]
Abstract
Breast ultrasound is a valuable adjunctive tool to mammography in detecting breast cancer, especially in women with dense breasts. Ultrasound also plays an important role in staging breast cancer by assessing axillary lymph nodes. However, its utility is limited by operator dependence, high recall rate, low positive predictive value and low specificity. These limitations present an opportunity for artificial intelligence (AI) to improve diagnostic performance and pioneer novel uses of ultrasound. Research in developing AI for radiology has flourished over the past few years. A subset of AI, deep learning, uses interconnected computational nodes to form a neural network, which extracts complex visual features from image data to train itself into a predictive model. This review summarizes several key studies evaluating AI programs' performance in predicting breast cancer and demonstrates that AI can assist radiologists and address limitations of ultrasound by acting as a decision support tool. This review also touches on how AI programs allow for novel predictive uses of ultrasound, particularly predicting molecular subtypes of breast cancer and response to neoadjuvant chemotherapy, which have the potential to change how breast cancer is managed by providing non-invasive prognostic and treatment data from ultrasound images. Lastly, this review explores how AI programs demonstrate improved diagnostic accuracy in predicting axillary lymph node metastasis. The limitations and future challenges in developing and implementing AI for breast and axillary ultrasound will also be discussed.
Collapse
Affiliation(s)
- Christopher Trepanier
- Columbia University Irving Medical Center, 622 W 168th St, New York, NY 10032, United States of America.
| | - Alice Huang
- Columbia University Irving Medical Center, 622 W 168th St, New York, NY 10032, United States of America.
| | - Michael Liu
- Columbia University Irving Medical Center, 622 W 168th St, New York, NY 10032, United States of America.
| | - Richard Ha
- Columbia University Irving Medical Center, 622 W 168th St, New York, NY 10032, United States of America.
| |
Collapse
|
11
|
Vrdoljak J, Krešo A, Kumrić M, Martinović D, Cvitković I, Grahovac M, Vickov J, Bukić J, Božic J. The Role of AI in Breast Cancer Lymph Node Classification: A Comprehensive Review. Cancers (Basel) 2023; 15:cancers15082400. [PMID: 37190328 DOI: 10.3390/cancers15082400] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2023] [Revised: 04/19/2023] [Accepted: 04/19/2023] [Indexed: 05/17/2023] Open
Abstract
Breast cancer is a significant health issue affecting women worldwide, and accurately detecting lymph node metastasis is critical in determining treatment and prognosis. While traditional diagnostic methods have limitations and complications, artificial intelligence (AI) techniques such as machine learning (ML) and deep learning (DL) offer promising solutions for improving and supplementing diagnostic procedures. Current research has explored state-of-the-art DL models for breast cancer lymph node classification from radiological images, achieving high performances (AUC: 0.71-0.99). AI models trained on clinicopathological features also show promise in predicting metastasis status (AUC: 0.74-0.77), whereas multimodal (radiomics + clinicopathological features) models combine the best from both approaches and also achieve good results (AUC: 0.82-0.94). Once properly validated, such models could greatly improve cancer care, especially in areas with limited medical resources. This comprehensive review aims to compile knowledge about state-of-the-art AI models used for breast cancer lymph node metastasis detection, discusses proper validation techniques and potential pitfalls and limitations, and presents future directions and best practices to achieve high usability in real-world clinical settings.
Collapse
Affiliation(s)
- Josip Vrdoljak
- Department of Pathophysiology, University of Split School of Medicine, 21000 Split, Croatia
| | - Ante Krešo
- Department of Surgery, University Hospital of Split, 21000 Split, Croatia
| | - Marko Kumrić
- Department of Pathophysiology, University of Split School of Medicine, 21000 Split, Croatia
| | - Dinko Martinović
- Department of Surgery, University Hospital of Split, 21000 Split, Croatia
| | - Ivan Cvitković
- Department of Surgery, University Hospital of Split, 21000 Split, Croatia
| | - Marko Grahovac
- Department of Pharmacology, University of Split School of Medicine, 21000 Split, Croatia
| | - Josip Vickov
- Department of Pathophysiology, University of Split School of Medicine, 21000 Split, Croatia
| | - Josipa Bukić
- Department of Pharmacy, University of Split School of Medicine, 21000 Split, Croatia
| | - Joško Božic
- Department of Pathophysiology, University of Split School of Medicine, 21000 Split, Croatia
| |
Collapse
|
12
|
Zhao X, Bai JW, Guo Q, Ren K, Zhang GJ. Clinical applications of deep learning in breast MRI. Biochim Biophys Acta Rev Cancer 2023; 1878:188864. [PMID: 36822377 DOI: 10.1016/j.bbcan.2023.188864] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2022] [Revised: 01/05/2023] [Accepted: 01/17/2023] [Indexed: 02/25/2023]
Abstract
Deep learning (DL) is one of the most powerful data-driven machine-learning techniques in artificial intelligence (AI). It can automatically learn from raw data without manual feature selection. DL models have led to remarkable advances in data extraction and analysis for medical imaging. Magnetic resonance imaging (MRI) has proven useful in delineating the characteristics and extent of breast lesions and tumors. This review summarizes the current state-of-the-art applications of DL models in breast MRI. Many recent DL models were examined in this field, along with several advanced learning approaches and methods for data normalization and breast and lesion segmentation. For clinical applications, DL-based breast MRI models were proven useful in five aspects: diagnosis of breast cancer, classification of molecular types, classification of histopathological types, prediction of neoadjuvant chemotherapy response, and prediction of lymph node metastasis. For subsequent studies, further improvement in data acquisition and preprocessing is necessary, additional DL techniques in breast MRI should be investigated, and wider clinical applications need to be explored.
Collapse
Affiliation(s)
- Xue Zhao
- Fujian Key Laboratory of Precision Diagnosis and Treatment in Breast Cancer, Xiang'an Hospital of Xiamen University, School of Medicine, Xiamen University, Xiamen, China; National Institute for Data Science in Health and Medicine, Xiamen University, Xiamen, China; Department of Breast-Thyroid-Surgery and Cancer Center, Xiang'an Hospital of Xiamen University, School of Medicine, Xiamen University, Xiamen, China; Xiamen Research Center of Clinical Medicine in Breast & Thyroid Cancers, Xiang'an Hospital of Xiamen University, School of Medicine, Xiamen University, Xiamen, China; Xiamen Key Laboratory of Endocrine-Related Cancer Precision Medicine, Xiang'an Hospital of Xiamen University, School of Medicine, Xiamen University, Xiamen, China
| | - Jing-Wen Bai
- Fujian Key Laboratory of Precision Diagnosis and Treatment in Breast Cancer, Xiang'an Hospital of Xiamen University, School of Medicine, Xiamen University, Xiamen, China; Xiamen Research Center of Clinical Medicine in Breast & Thyroid Cancers, Xiang'an Hospital of Xiamen University, School of Medicine, Xiamen University, Xiamen, China; Xiamen Key Laboratory of Endocrine-Related Cancer Precision Medicine, Xiang'an Hospital of Xiamen University, School of Medicine, Xiamen University, Xiamen, China; Department of Oncology, Xiang'an Hospital of Xiamen University, School of Medicine, Xiamen University, Xiamen, China; Cancer Research Center, School of Medicine, Xiamen University, Xiamen, China
| | - Qiu Guo
- Department of Radiology, Xiang'an Hospital of Xiamen University, School of Medicine, Xiamen University, Xiamen, China
| | - Ke Ren
- Department of Radiology, Xiang'an Hospital of Xiamen University, School of Medicine, Xiamen University, Xiamen, China.
| | - Guo-Jun Zhang
- Fujian Key Laboratory of Precision Diagnosis and Treatment in Breast Cancer, Xiang'an Hospital of Xiamen University, School of Medicine, Xiamen University, Xiamen, China; Department of Breast-Thyroid-Surgery and Cancer Center, Xiang'an Hospital of Xiamen University, School of Medicine, Xiamen University, Xiamen, China; Xiamen Research Center of Clinical Medicine in Breast & Thyroid Cancers, Xiang'an Hospital of Xiamen University, School of Medicine, Xiamen University, Xiamen, China; Xiamen Key Laboratory of Endocrine-Related Cancer Precision Medicine, Xiang'an Hospital of Xiamen University, School of Medicine, Xiamen University, Xiamen, China; Cancer Research Center, School of Medicine, Xiamen University, Xiamen, China.
| |
Collapse
|
13
|
Syed A, Adam R, Ren T, Lu J, Maldjian T, Duong TQ. Machine learning with textural analysis of longitudinal multiparametric MRI and molecular subtypes accurately predicts pathologic complete response in patients with invasive breast cancer. PLoS One 2023; 18:e0280320. [PMID: 36649274 DOI: 10.1371/journal.pone.0280320] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2022] [Accepted: 12/27/2022] [Indexed: 01/18/2023] Open
Abstract
PURPOSE To predict pathological complete response (pCR) after neoadjuvant chemotherapy using extreme gradient boosting (XGBoost) with MRI and non-imaging data at multiple treatment timepoints. MATERIAL AND METHODS This retrospective study included breast cancer patients (n = 117) who underwent neoadjuvant chemotherapy. Data types used included tumor ADC values, diffusion-weighted and dynamic-contrast-enhanced MRI at three treatment timepoints, and patient demographics and tumor data. GLCM textural analysis was performed on MRI data. An extreme gradient boosting machine learning algorithm was used to predict pCR. Prediction performance was evaluated using the area under the curve (AUC) of the receiver operating curve along with precision and recall. RESULTS Prediction using texture features of DWI and DCE images at multiple treatment time points (AUC = 0.871; 95% CI: (0.768, 0.974; p<0.001) and (AUC = 0.903 95% CI: 0.854, 0.952; p<0.001) respectively), outperformed that using mean tumor ADC (AUC = 0.850 (95% CI: 0.764, 0.936; p<0.001)). The AUC using all MRI data was 0.933 (95% CI: 0.836, 1.03; p<0.001). The AUC using non-MRI data was 0.919 (95% CI: 0.848, 0.99; p<0.001). The highest AUC of 0.951 (95% CI: 0.909, 0.993; p<0.001) was achieved with all MRI and all non-MRI data at all time points as inputs. CONCLUSION Using XGBoost on extracted GLCM features and non-imaging data accurately predicts pCR. This early prediction of response can minimize exposure to toxic chemotherapy, allowing regimen modification mid-treatment and ultimately achieving better outcomes.
Collapse
|
14
|
Dammu H, Ren T, Duong TQ. Deep learning prediction of pathological complete response, residual cancer burden, and progression-free survival in breast cancer patients. PLoS One 2023; 18:e0280148. [PMID: 36607982 PMCID: PMC9821469 DOI: 10.1371/journal.pone.0280148] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2022] [Accepted: 12/20/2022] [Indexed: 01/07/2023] Open
Abstract
The goal of this study was to employ novel deep-learning convolutional-neural-network (CNN) to predict pathological complete response (PCR), residual cancer burden (RCB), and progression-free survival (PFS) in breast cancer patients treated with neoadjuvant chemotherapy using longitudinal multiparametric MRI, demographics, and molecular subtypes as inputs. In the I-SPY-1 TRIAL, 155 patients with stage 2 or 3 breast cancer with breast tumors underwent neoadjuvant chemotherapy met the inclusion/exclusion criteria. The inputs were dynamic-contrast-enhanced (DCE) MRI, and T2- weighted MRI as three-dimensional whole-images without the tumor segmentation, as well as molecular subtypes and demographics. The outcomes were PCR, RCB, and PFS. Three ("Integrated", "Stack" and "Concatenation") CNN were evaluated using receiver-operating characteristics and mean absolute errors. The Integrated approach outperformed the "Stack" or "Concatenation" CNN. Inclusion of both MRI and non-MRI data outperformed either alone. The combined pre- and post-neoadjuvant chemotherapy data outperformed either alone. Using the best model and data combination, PCR prediction yielded an accuracy of 0.81±0.03 and AUC of 0.83±0.03; RCB prediction yielded an accuracy of 0.80±0.02 and Cohen's κ of 0.73±0.03; PFS prediction yielded a mean absolute error of 24.6±0.7 months (survival ranged from 6.6 to 127.5 months). Deep learning using longitudinal multiparametric MRI, demographics, and molecular subtypes accurately predicts PCR, RCB, and PFS in breast cancer patients. This approach may prove useful for treatment selection, planning, execution, and mid-treatment adjustment.
Collapse
Affiliation(s)
- Hongyi Dammu
- Department of Radiology, Montefiore Medical Center and Albert Einstein College of Medicine, Bronx, New York, United States of America
| | - Thomas Ren
- Department of Radiology, Montefiore Medical Center and Albert Einstein College of Medicine, Bronx, New York, United States of America
| | - Tim Q. Duong
- Department of Radiology, Montefiore Medical Center and Albert Einstein College of Medicine, Bronx, New York, United States of America
- * E-mail:
| |
Collapse
|
15
|
Zhang X, Liu M, Ren W, Sun J, Wang K, Xi X, Zhang G. Predicting of axillary lymph node metastasis in invasive breast cancer using multiparametric MRI dataset based on CNN model. Front Oncol 2022; 12:1069733. [PMID: 36561533 PMCID: PMC9763602 DOI: 10.3389/fonc.2022.1069733] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2022] [Accepted: 11/15/2022] [Indexed: 12/12/2022] Open
Abstract
Purpose To develop a multiparametric MRI model for predicting axillary lymph node metastasis in invasive breast cancer. Methods Clinical data and T2WI, DWI, and DCE-MRI images of 252 patients with invasive breast cancer were retrospectively analyzed and divided into the axillary lymph node metastasis (ALNM) group and non-ALNM group using biopsy results as a reference standard. The regions of interest (ROI) in T2WI, DWI, and DCE-MRI images were segmented using MATLAB software, and the ROI was unified into 224 × 224 sizes, followed by image normalization as input to T2WI, DWI, and DCE-MRI models, all of which were based on ResNet 50 networks. The idea of a weighted voting method in ensemble learning was employed, and then T2WI, DWI, and DCE-MRI models were used as the base models to construct a multiparametric MRI model. The entire dataset was randomly divided into training sets and testing sets (the training set 202 cases, including 78 ALNM, 124 non-ALNM; the testing set 50 cases, including 20 ALNM, 30 non-ALNM). Accuracy, sensitivity, specificity, positive predictive value, and negative predictive value of models were calculated. The receiver operating characteristic (ROC) curve and area under the curve (AUC) were used to evaluate the diagnostic performance of each model for axillary lymph node metastasis, and the DeLong test was performed, P< 0.05 statistically significant. Results For the assessment of axillary lymph node status in invasive breast cancer on the test set, multiparametric MRI models yielded an AUC of 0.913 (95% CI, 0.799-0.974); T2WI-based model yielded an AUC of 0.908 (95% CI, 0.792-0.971); DWI-based model achieved an AUC of 0.702 (95% CI, 0.556-0.823); and the AUC of the DCE-MRI-based model was 0.572 (95% CI, 0.424-0.711). The improvement in the diagnostic performance of the multiparametric MRI model compared with the DWI and DCE-MRI-based models were significant (P< 0.01 for both). However, the increase was not meaningful compared with the T2WI-based model (P = 0.917). Conclusion Multiparametric MRI image analysis based on an ensemble CNN model with deep learning is of practical application and extension for preoperative prediction of axillary lymph node metastasis in invasive breast cancer.
Collapse
Affiliation(s)
- Xiaodong Zhang
- Department of Radiology, The First Affiliated Hospital of Shandong First Medical University, Jinan, China,Postgraduate Department, Shandong First Medical University (Shandong Academy of Medical Sciences), Jinan, China
| | - Menghan Liu
- Department of Health Management, The First Affiliated Hospital of Shandong First Medical University, Jinan, China
| | - Wanqing Ren
- Department of Radiology, The First Affiliated Hospital of Shandong First Medical University, Jinan, China,Postgraduate Department, Shandong First Medical University (Shandong Academy of Medical Sciences), Jinan, China
| | - Jingxiang Sun
- Department of Radiology, The First Affiliated Hospital of Shandong First Medical University, Jinan, China,Postgraduate Department, Shandong First Medical University (Shandong Academy of Medical Sciences), Jinan, China
| | - Kesong Wang
- School of Computer Science and Technology, Shandong Jianzhu University, Jinan, China
| | - Xiaoming Xi
- School of Computer Science and Technology, Shandong Jianzhu University, Jinan, China
| | - Guang Zhang
- Department of Health Management, The First Affiliated Hospital of Shandong First Medical University, Jinan, China,*Correspondence: Guang Zhang,
| |
Collapse
|
16
|
Khan N, Adam R, Huang P, Maldjian T, Duong TQ. Deep Learning Prediction of Pathologic Complete Response in Breast Cancer Using MRI and Other Clinical Data: A Systematic Review. Tomography 2022; 8:2784-2795. [PMID: 36412691 PMCID: PMC9680498 DOI: 10.3390/tomography8060232] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2022] [Revised: 11/12/2022] [Accepted: 11/16/2022] [Indexed: 11/24/2022] Open
Abstract
Breast cancer patients who have pathological complete response (pCR) to neoadjuvant chemotherapy (NAC) are more likely to have better clinical outcomes. The ability to predict which patient will respond to NAC early in the treatment course is important because it could help to minimize unnecessary toxic NAC and to modify regimens mid-treatment to achieve better efficacy. Machine learning (ML) is increasingly being used in radiology and medicine because it can identify relationships amongst complex data elements to inform outcomes without the need to specify such relationships a priori. One of the most popular deep learning methods that applies to medical images is the Convolutional Neural Networks (CNN). In contrast to supervised ML, deep learning CNN can operate on the whole images without requiring radiologists to manually contour the tumor on images. Although there have been many review papers on supervised ML prediction of pCR, review papers on deep learning prediction of pCR are sparse. Deep learning CNN could also incorporate multiple image types, clinical data such as demographics and molecular subtypes, as well as data from multiple treatment time points to predict pCR. The goal of this study is to perform a systematic review of deep learning methods that use whole-breast MRI images without annotation or tumor segmentation to predict pCR in breast cancer.
Collapse
|
17
|
Miao S, Jia H, Cheng K, Hu X, Li J, Huang W, Wang R. Deep learning radiomics under multimodality explore association between muscle/fat and metastasis and survival in breast cancer patients. Brief Bioinform 2022; 23:6748489. [PMID: 36198668 DOI: 10.1093/bib/bbac432] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2022] [Revised: 09/03/2022] [Accepted: 09/06/2022] [Indexed: 12/14/2022] Open
Abstract
Sarcopenia is correlated with poor clinical outcomes in breast cancer (BC) patients. However, there is no precise quantitative study on the correlation between body composition changes and BC metastasis and survival. The present study proposed a deep learning radiomics (DLR) approach to investigate the effects of muscle and fat on distant metastasis and death outcomes in BC patients. Image feature extraction was performed on 4th thoracic vertebra (T4) and 11th thoracic vertebra (T11) on computed tomography (CT) image levels by DLR, and image features were combined with clinical information to predict distant metastasis in BC patients. Clinical information combined with DLR significantly predicted distant metastasis in BC patients. In the test cohort, the area under the curve of model performance on clinical information combined with DLR was 0.960 (95% CI: 0.942-0.979, P < 0.001). The patients with distant metastases had a lower pectoral muscle index in T4 (PMI/T4) than in patients without metastases. PMI/T4 and visceral fat tissue area in T11 (VFA/T11) were independent prognostic factors for the overall survival in BC patients. The pectoralis muscle area in T4 (PMA/T4) and PMI/T4 is an independent prognostic factor for distant metastasis-free survival in BC patients. The current study further confirmed that muscle/fat of T4 and T11 levels have a significant effect on the distant metastasis of BC. Appending the network features of T4 and T11 to the model significantly enhances the prediction performance of distant metastasis of BC, providing a valuable biomarker for the early treatment of BC patients.
Collapse
Affiliation(s)
- Shidi Miao
- School of Computer Science and Technology, Harbin University of Science and Technology, Harbin, China
| | - Haobo Jia
- School of Computer Science and Technology, Harbin University of Science and Technology, Harbin, China
| | - Ke Cheng
- School of Computer Science and Technology, Harbin University of Science and Technology, Harbin, China
| | - Xiaohui Hu
- School of Computer Science and Technology, Harbin University of Science and Technology, Harbin, China
| | - Jing Li
- Department of Geriatrics, the Second Affiliated Hospital, Harbin Medical University, Harbin, China
| | - Wenjuan Huang
- Department of Internal Medicine, Harbin Medical University Cancer Hospital, Harbin Medical University, Harbin, China
| | - Ruitao Wang
- Department of Internal Medicine, Harbin Medical University Cancer Hospital, Harbin Medical University, Harbin, China
| |
Collapse
|
18
|
Wang D, Hu Y, Zhan C, Zhang Q, Wu Y, Ai T. A nomogram based on radiomics signature and deep-learning signature for preoperative prediction of axillary lymph node metastasis in breast cancer. Front Oncol 2022; 12:940655. [PMID: 36338691 PMCID: PMC9633001 DOI: 10.3389/fonc.2022.940655] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2022] [Accepted: 10/07/2022] [Indexed: 10/03/2023] Open
Abstract
PURPOSE To develop a nomogram based on radiomics signature and deep-learning signature for predicting the axillary lymph node (ALN) metastasis in breast cancer. METHODS A total of 151 patients were assigned to a training cohort (n = 106) and a test cohort (n = 45) in this study. Radiomics features were extracted from DCE-MRI images, and deep-learning features were extracted by VGG-16 algorithm. Seven machine learning models were built using the selected features to evaluate the predictive value of radiomics or deep-learning features for the ALN metastasis in breast cancer. A nomogram was then constructed based on the multivariate logistic regression model incorporating radiomics signature, deep-learning signature, and clinical risk factors. RESULTS Five radiomics features and two deep-learning features were selected for machine learning model construction. In the test cohort, the AUC was above 0.80 for most of the radiomics models except DecisionTree and ExtraTrees. In addition, the K-nearest neighbor (KNN), XGBoost, and LightGBM models using deep-learning features had AUCs above 0.80 in the test cohort. The nomogram, which incorporated the radiomics signature, deep-learning signature, and MRI-reported LN status, showed good calibration and performance with the AUC of 0.90 (0.85-0.96) in the training cohort and 0.90 (0.80-0.99) in the test cohort. The DCA showed that the nomogram could offer more net benefit than radiomics signature or deep-learning signature. CONCLUSIONS Both radiomics and deep-learning features are diagnostic for predicting ALN metastasis in breast cancer. The nomogram incorporating radiomics and deep-learning signatures can achieve better prediction performance than every signature used alone.
Collapse
Affiliation(s)
- Dawei Wang
- Department of Plastic Surgery, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Yiqi Hu
- Department of Radiology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Chenao Zhan
- Department of Radiology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Qi Zhang
- Department of Plastic Surgery, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Yiping Wu
- Department of Plastic Surgery, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Tao Ai
- Department of Radiology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| |
Collapse
|
19
|
Mahant SS, Varma AR. Artificial Intelligence in Breast Ultrasound: The Emerging Future of Modern Medicine. Cureus 2022; 14:e28945. [PMID: 36237807 PMCID: PMC9547651 DOI: 10.7759/cureus.28945] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2022] [Accepted: 09/08/2022] [Indexed: 11/25/2022] Open
Abstract
In today's world, progressively enormous popularity prevails around artificial intelligence (AI). AI is gaining popularity in the identification of various images. Therefore, it has been widely used in the ultrasound of the breast. Furthermore, AI can perform a quantitative evaluation, which further helps maintain the diagnosis's accuracy. Moreover, breast cancer is the most common cancer in women, posing a severe threat to women's health. Hence, its early detection is usually associated with a patient's prognosis. As a result, using AI in breast cancer screening and detection is highly crucial. The concept of AI in the perspective of breast ultrasound has been highlighted in this brief review article. It tends to focus on early AI, i.e., traditional machine learning and deep learning algorithms. Also, the use of AI in ultrasound and the use of it in mammography, magnetic resonance imaging, nuclear medicine imaging, and classification of breast lesions is broadly explained, along with the challenges faced in bringing AI into daily practice.
Collapse
|
20
|
Li C, Li W, Liu C, Zheng H, Cai J, Wang S. Artificial intelligence in multi-parametric magnetic resonance imaging: A review. Med Phys 2022; 49:e1024-e1054. [PMID: 35980348 DOI: 10.1002/mp.15936] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2022] [Revised: 08/01/2022] [Accepted: 08/04/2022] [Indexed: 11/06/2022] Open
Abstract
Multi-parametric magnetic resonance imaging (mpMRI) is an indispensable tool in the clinical workflow for the diagnosis and treatment planning of various diseases. Machine learning-based artificial intelligence (AI) methods, especially those adopting the deep learning technique, have been extensively employed to perform mpMRI image classification, segmentation, registration, detection, reconstruction, and super-resolution. The current availability of increasing computational power and fast-improving AI algorithms have empowered numerous computer-based systems for applying mpMRI to disease diagnosis, imaging-guided radiotherapy, patient risk and overall survival time prediction, and the development of advanced quantitative imaging technology for magnetic resonance fingerprinting. However, the wide application of these developed systems in the clinic is still limited by a number of factors, including robustness, reliability, and interpretability. This survey aims to provide an overview for new researchers in the field as well as radiologists with the hope that they can understand the general concepts, main application scenarios, and remaining challenges of AI in mpMRI. This article is protected by copyright. All rights reserved.
Collapse
Affiliation(s)
- Cheng Li
- Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China
| | - Wen Li
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Chenyang Liu
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Hairong Zheng
- Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China
| | - Jing Cai
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Shanshan Wang
- Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China.,Peng Cheng Laboratory, Shenzhen, 518066, China.,Guangdong Provincial Key Laboratory of Artificial Intelligence in Medical Image Analysis and Application, Guangzhou, 510080, China
| |
Collapse
|
21
|
Narongrit FW, Rispoli JV. Editorial for "Preoperative Prediction of Axillary Lymph Node Metastasis in Breast Cancer Using CNN Based on Multiparametric MRI". J Magn Reson Imaging 2022; 56:710-711. [PMID: 35274410 DOI: 10.1002/jmri.28141] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2022] [Accepted: 02/25/2022] [Indexed: 11/06/2022] Open
Affiliation(s)
- Folk W Narongrit
- Elmore Family School of Electrical and Computer Engineering, Purdue University, West Lafayette, Indiana, USA
| | - Joseph V Rispoli
- Elmore Family School of Electrical and Computer Engineering, Purdue University, West Lafayette, Indiana, USA.,Weldon School of Biomedical Engineering, Purdue University, West Lafayette, Indiana, USA.,Purdue University Center for Cancer Research, West Lafayette, Indiana, USA
| |
Collapse
|