1
|
Chang HH, Wu CZ, Gallogly AH. Pulmonary Nodule Classification Using a Multiview Residual Selective Kernel Network. J Imaging Inform Med 2024; 37:347-362. [PMID: 38343233 DOI: 10.1007/s10278-023-00928-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/23/2023] [Revised: 09/13/2023] [Accepted: 09/25/2023] [Indexed: 03/02/2024]
Abstract
Lung cancer is one of the leading causes of death worldwide and early detection is crucial to reduce the mortality. A reliable computer-aided diagnosis (CAD) system can help facilitate early detection of malignant nodules. Although existing methods provide adequate classification accuracy, there is still room for further improvement. This study is dedicated to investigating a new CAD scheme for predicting the malignant likelihood of lung nodules in computed tomography (CT) images in light of a deep learning strategy. Conceived from the residual learning and selective kernel, we investigated an efficient residual selective kernel (RSK) block to handle the diversity of lung nodules with various shapes and obscure structures. Founded on this RSK block, we established a multiview RSK network (MRSKNet), to which three anatomical planes in the axial, coronal, and sagittal directions were fed. To reinforce the classification efficiency, seven handcrafted texture features with a filter-like computation strategy were explored, among which the homogeneity (HOM) feature maps are combined with the corresponding intensity CT images for concatenation input, leading to an improved network architecture. Evaluated on the public benchmark Lung Image Database Consortium and Image Database Resource Initiative (LIDC-IDRI) challenge database with ten-fold cross validation of binary classification, our experimental results indicated high area under receiver operating characteristic (AUC) and accuracy scores. A better compromise between recall and specificity was struck using the suggested concatenation strategy comparing to many state-of-the-art approaches. The proposed pulmonary nodule classification framework exhibited great efficacy and achieved a higher AUC of 0.9711. The association of handcrafted texture features with deep learning models is promising in advancing the classification performance. The developed pulmonary nodule CAD network architecture is of potential in facilitating the diagnosis of lung cancer for further image processing applications.
Collapse
Affiliation(s)
- Herng-Hua Chang
- Computational Biomedical Engineering Laboratory (CBEL), Department of Engineering Science and Ocean Engineering, National Taiwan University, 1 Sec. 4 Roosevelt Road, Daan, Taipei, 10617, Taiwan.
| | - Cheng-Zhe Wu
- Computational Biomedical Engineering Laboratory (CBEL), Department of Engineering Science and Ocean Engineering, National Taiwan University, 1 Sec. 4 Roosevelt Road, Daan, Taipei, 10617, Taiwan
| | - Audrey Haihong Gallogly
- Department of Radiation Oncology, Keck Medical School, University of Southern California, Los Angeles, CA, USA
| |
Collapse
|
2
|
Kang H, Xie W, Wang H, Guo H, Jiang J, Liu Z, Ding X, Li L, Xu W, Zhao J, Bai X, Cui M, Ye H, Wang B, Yang D, Ma X, Liu J, Wang H. Multiparametric MRI-Based Machine Learning Models for the Characterization of Cystic Renal Masses Compared to the Bosniak Classification, Version 2019: A Multicenter Study. Acad Radiol 2024:S1076-6332(24)00003-5. [PMID: 38242731 DOI: 10.1016/j.acra.2024.01.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2023] [Revised: 12/26/2023] [Accepted: 01/03/2024] [Indexed: 01/21/2024]
Abstract
RATIONALE AND OBJECTIVE Accurate differentiation between benign and malignant cystic renal masses (CRMs) is challenging in clinical practice. This study aimed to develop MRI-based machine learning models for differentiating between benign and malignant CRMs and compare the best-performing model with the Bosniak classification, version 2019 (BC, version 2019). METHODS Between 2009 and 2021, consecutive surgery-proven CRM patients with renal MRI were enrolled in this multicenter study. Models were constructed to differentiate between benign and malignant CRMs using logistic regression (LR), random forest (RF), and support vector machine (SVM) algorithms, respectively. Meanwhile, two radiologists classified CRMs into I-IV categories according to the BC, version 2019 in consensus in the test set. A subgroup analysis was conducted to investigate the performance of the best-performing model in complicated CRMs (II-IV lesions in the test set). The performances of models and BC, version 2019 were evaluated using the area under the receiver operating characteristic curve (AUC). Performance was statistically compared between the best-performing model and the BC, version 2019. RESULTS 278 and 48 patients were assigned to the training and test sets, respectively. In the test set, the AUC and accuracy of the LR model, the RF model, the SVM model, and the BC, version 2019 were 0.884 and 75.0%, 0.907 and 83.3%, 0.814 and 72.9%, and 0.893 and 81.2%, respectively. Neither the AUC nor the accuracy of the RF model that performed best were significantly different from the BC, version 2019 (P = 0.780, P = 0.065). The RF model achieved an AUC and accuracy of 0.880 and 81.0% in complicated CRMs. CONCLUSIONS The MRI-based RF model can accurately differentiate between benign and malignant CRMs with comparable performance to the BC, version 2019, and has good performance in complicated CRMs, which may facilitate treatment decision-making and is less affected by interobserver disagreements.
Collapse
Affiliation(s)
- Huanhuan Kang
- Department of Radiology, First Medical Center of Chinese PLA General Hospital, No.28 Fuxing Road, Haidian District, Beijing 100853, China (H.K., H.G., W.X., J.Z., X.B., M.C., H.Y., H.W.)
| | - Wanfang Xie
- School of Engineering Medicine, Beihang University, Beijing 100191, China (W.X., J.L.); Key Laboratory of Big Data-Based Precision Medicine (Beihang University), Ministry of Industry and Information Technology of China, Beijing 100191, China (W.X., J.L.)
| | - He Wang
- Radiology Department, Peking University First Hospital, Beijing 100034, China (H.W., Z.L.)
| | - Huiping Guo
- Department of Radiology, First Medical Center of Chinese PLA General Hospital, No.28 Fuxing Road, Haidian District, Beijing 100853, China (H.K., H.G., W.X., J.Z., X.B., M.C., H.Y., H.W.)
| | - Jiahui Jiang
- Department of Radiology, Beijing Friendship Hospital, Capital Medical University, Beijing 100050, China (J.J., D.Y.)
| | - Zhe Liu
- Radiology Department, Peking University First Hospital, Beijing 100034, China (H.W., Z.L.)
| | - Xiaohui Ding
- Department of Pathology, First Medical Center, Chinese PLA General Hospital, Beijing 100853, China (X.D.)
| | - Lin Li
- Hospital Management Institute, Department of Innovative Medical Research, Chinese PLA General Hospital, Outpatient Building, Beijing 100853, China (L.L.)
| | - Wei Xu
- Department of Radiology, First Medical Center of Chinese PLA General Hospital, No.28 Fuxing Road, Haidian District, Beijing 100853, China (H.K., H.G., W.X., J.Z., X.B., M.C., H.Y., H.W.)
| | - Jian Zhao
- Department of Radiology, First Medical Center of Chinese PLA General Hospital, No.28 Fuxing Road, Haidian District, Beijing 100853, China (H.K., H.G., W.X., J.Z., X.B., M.C., H.Y., H.W.)
| | - Xu Bai
- Department of Radiology, First Medical Center of Chinese PLA General Hospital, No.28 Fuxing Road, Haidian District, Beijing 100853, China (H.K., H.G., W.X., J.Z., X.B., M.C., H.Y., H.W.)
| | - Mengqiu Cui
- Department of Radiology, First Medical Center of Chinese PLA General Hospital, No.28 Fuxing Road, Haidian District, Beijing 100853, China (H.K., H.G., W.X., J.Z., X.B., M.C., H.Y., H.W.)
| | - Huiyi Ye
- Department of Radiology, First Medical Center of Chinese PLA General Hospital, No.28 Fuxing Road, Haidian District, Beijing 100853, China (H.K., H.G., W.X., J.Z., X.B., M.C., H.Y., H.W.)
| | - Baojun Wang
- Department of Urology, Third Medical Center of Chinese PLA General Hospital, Beijing 100039, China (B.W., X.M.)
| | - Dawei Yang
- Department of Radiology, Beijing Friendship Hospital, Capital Medical University, Beijing 100050, China (J.J., D.Y.)
| | - Xin Ma
- Department of Urology, Third Medical Center of Chinese PLA General Hospital, Beijing 100039, China (B.W., X.M.)
| | - Jiangang Liu
- School of Engineering Medicine, Beihang University, Beijing 100191, China (W.X., J.L.); Key Laboratory of Big Data-Based Precision Medicine (Beihang University), Ministry of Industry and Information Technology of China, Beijing 100191, China (W.X., J.L.)
| | - Haiyi Wang
- Department of Radiology, First Medical Center of Chinese PLA General Hospital, No.28 Fuxing Road, Haidian District, Beijing 100853, China (H.K., H.G., W.X., J.Z., X.B., M.C., H.Y., H.W.).
| |
Collapse
|
3
|
Rahman H, Khan AR, Sadiq T, Farooqi AH, Khan IU, Lim WH. A Systematic Literature Review of 3D Deep Learning Techniques in Computed Tomography Reconstruction. Tomography 2023; 9:2158-2189. [PMID: 38133073 PMCID: PMC10748093 DOI: 10.3390/tomography9060169] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2023] [Revised: 11/27/2023] [Accepted: 12/01/2023] [Indexed: 12/23/2023] Open
Abstract
Computed tomography (CT) is used in a wide range of medical imaging diagnoses. However, the reconstruction of CT images from raw projection data is inherently complex and is subject to artifacts and noise, which compromises image quality and accuracy. In order to address these challenges, deep learning developments have the potential to improve the reconstruction of computed tomography images. In this regard, our research aim is to determine the techniques that are used for 3D deep learning in CT reconstruction and to identify the training and validation datasets that are accessible. This research was performed on five databases. After a careful assessment of each record based on the objective and scope of the study, we selected 60 research articles for this review. This systematic literature review revealed that convolutional neural networks (CNNs), 3D convolutional neural networks (3D CNNs), and deep learning reconstruction (DLR) were the most suitable deep learning algorithms for CT reconstruction. Additionally, two major datasets appropriate for training and developing deep learning systems were identified: 2016 NIH-AAPM-Mayo and MSCT. These datasets are important resources for the creation and assessment of CT reconstruction models. According to the results, 3D deep learning may increase the effectiveness of CT image reconstruction, boost image quality, and lower radiation exposure. By using these deep learning approaches, CT image reconstruction may be made more precise and effective, improving patient outcomes, diagnostic accuracy, and healthcare system productivity.
Collapse
Affiliation(s)
- Hameedur Rahman
- Department of Computer Games Development, Faculty of Computing & AI, Air University, E9, Islamabad 44000, Pakistan;
| | - Abdur Rehman Khan
- Department of Creative Technologies, Faculty of Computing & AI, Air University, E9, Islamabad 44000, Pakistan;
| | - Touseef Sadiq
- Centre for Artificial Intelligence Research, Department of Information and Communication Technology, University of Agder, Jon Lilletuns vei 9, 4879 Grimstad, Norway
| | - Ashfaq Hussain Farooqi
- Department of Computer Science, Faculty of Computing AI, Air University, Islamabad 44000, Pakistan;
| | - Inam Ullah Khan
- Department of Electronic Engineering, School of Engineering & Applied Sciences (SEAS), Isra University, Islamabad Campus, Islamabad 44000, Pakistan;
| | - Wei Hong Lim
- Faculty of Engineering, Technology and Built Environment, UCSI University, Kuala Lumpur 56000, Malaysia;
| |
Collapse
|
4
|
Zhu F, Yang C, Zou J, Ma W, Wei Y, Zhao Z. The classification of benign and malignant lung nodules based on CT radiomics: a systematic review, quality score assessment, and meta-analysis. Acta Radiol 2023; 64:3074-3084. [PMID: 37817511 DOI: 10.1177/02841851231205737] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/12/2023]
Abstract
Radiomics methods are increasingly used to identify benign and malignant lung nodules, and early monitoring is essential in prognosis and treatment strategy formulation. To evaluate the diagnostic performance of computed tomography (CT)-based radiomics for distinguishing between benign and malignant lung nodules by performing a meta-analysis. Between January 2000 and December 2021, we searched the PubMed and Embase electronic databases for studies in English. Studies were included if they demonstrated the sensitivity and specificity of CT-based radiomics for diagnosing benign and malignant lung nodules. The studies were evaluated using the QUADAS-2 and radiomics quality scores (RQS). The inhomogeneity of the data and publishing bias were also evaluated. Some subgroup analyses were performed to investigate the impact of diagnostic efficiency. The Preferred Reporting Items for Systematic Reviews and Meta-analysis (PRISMA) Guidelines were followed for this meta-analysis. A total of 20 studies involving 3793 patients were included. The combined sensitivity, specificity, diagnostic odds ratio, and area under the summary receiver operating characteristic curve based on CT radiomics diagnosis of benign and malignant lung nodules were 0.81, 0.86, 27.00, and 0.91, respectively. Deek's funnel plot asymmetry test confirmed no significant publication bias in all studies. Fagan nomograms showed a 40% increase in post-test probability among pretest-positive patients. Current evidence shows that CT-based radiomics has high accuracy in the diagnosis of benign and malignant lung nodules.
Collapse
Affiliation(s)
- Fandong Zhu
- Department of Radiology, Key Laboratory of Functional Molecular Imaging of Tumor and Interventional Diagnosis and Treatment of Shaoxing City, Shaoxing People's Hospital, Shaoxing, PR China
| | - Chen Yang
- Department of Radiology, Key Laboratory of Functional Molecular Imaging of Tumor and Interventional Diagnosis and Treatment of Shaoxing City, Shaoxing People's Hospital, Shaoxing, PR China
| | - Jiajun Zou
- Department of Radiology, Key Laboratory of Functional Molecular Imaging of Tumor and Interventional Diagnosis and Treatment of Shaoxing City, Shaoxing People's Hospital, Shaoxing, PR China
| | - Weili Ma
- Department of Radiology, Key Laboratory of Functional Molecular Imaging of Tumor and Interventional Diagnosis and Treatment of Shaoxing City, Shaoxing People's Hospital, Shaoxing, PR China
| | - Yuguo Wei
- Precision Health Institution, GE Healthcare, Hangzhou, Zhejiang, PR China
| | - Zhenhua Zhao
- Department of Radiology, Key Laboratory of Functional Molecular Imaging of Tumor and Interventional Diagnosis and Treatment of Shaoxing City, Shaoxing People's Hospital, Shaoxing, PR China
| |
Collapse
|
5
|
Shi L, Sheng M, Wei Z, Liu L, Zhao J. CT-Based Radiomics Predicts the Malignancy of Pulmonary Nodules: A Systematic Review and Meta-Analysis. Acad Radiol 2023; 30:3064-3075. [PMID: 37385850 DOI: 10.1016/j.acra.2023.05.026] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2023] [Revised: 05/22/2023] [Accepted: 05/24/2023] [Indexed: 07/01/2023]
Abstract
RATIONALE AND OBJECTIVES More pulmonary nodules (PNs) have been detected with the wide application of computed tomography (CT) in lung cancer screening. Radiomics is a noninvasive approach to predict the malignancy of PNs. We aimed to systematically evaluate the methodological quality of the eligible studies regarding CT-based radiomics models in predicting the malignancy of PNs and evaluate the model performance of the available studies. MATERIALS AND METHODS PubMed, Embase, and Web of Science were searched to retrieve relevant studies. The methodological quality of the included studies was assessed using the Radiomics Quality Score (RQS) and Prediction model Risk of Bias Assessment Tool. A meta-analysis was conducted to evaluate the performance of CT-based radiomics model. Meta-regression and subgroup analyses were employed to investigate the source of heterogeneity. RESULTS In total, 49 studies were eligible for qualitative analysis and 27 studies were included in quantitative synthesis. The median RQS of 49 studies was 13 (range -2 to 20). The overall risk of bias was found to be high, and the overall applicability was of low concern in all included studies. The pooled sensitivity, specificity, and diagnostic odds ratio were 0.86 95% confidence interval (CI): 0.79-0.91, 0.84 95% CI: 0.78-0.88, and 31.55 95% CI: 21.31-46.70, respectively. The overall area under the curve was 0.91 95% CI: 0.89-0.94. Meta-regression showed the type of PNs on heterogeneity. CT-based radiomics models performed better in studies including only solid PNs. CONCLUSION CT-based radiomics models exhibited excellent diagnostic performance in predicting the malignancy of PNs. Prospective, large sample size, and well-devised studies are desired to verify the prediction capabilities of CT-based radiomics model.
Collapse
Affiliation(s)
- Lili Shi
- Medical School, Nantong University, Nantong, China (L.S., Z.W.)
| | - Meihong Sheng
- Department of Radiology, The Second Affiliated Hospital of Nantong University and Nantong First People's Hospital, Nantong, China (M.S.)
| | - Zhichao Wei
- Medical School, Nantong University, Nantong, China (L.S., Z.W.)
| | - Lei Liu
- Institutes of Intelligence Medicine, Fudan University, Shanghai, China (L.L.)
| | - Jinli Zhao
- Department of Radiology, Affiliated Hospital of Nantong University, Nantong, China (J.Z.).
| |
Collapse
|
6
|
Shang Y, Chen W, Li G, Huang Y, Wang Y, Kui X, Li M, Zheng H, Zhao W, Liu J. Computed Tomography-derived intratumoral and peritumoral radiomics in predicting EGFR mutation in lung adenocarcinoma. Radiol Med 2023; 128:1483-1496. [PMID: 37749461 PMCID: PMC10700425 DOI: 10.1007/s11547-023-01722-6] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/15/2023] [Accepted: 09/04/2023] [Indexed: 09/27/2023]
Abstract
OBJECTIVE To investigate the value of Computed Tomography (CT) radiomics derived from different peritumoral volumes of interest (VOIs) in predicting epidermal growth factor receptor (EGFR) mutation status in lung adenocarcinoma patients. MATERIALS AND METHODS A retrospective cohort of 779 patients who had pathologically confirmed lung adenocarcinoma were enrolled. 640 patients were randomly divided into a training set, a validation set, and an internal testing set (3:1:1), and the remaining 139 patients were defined as an external testing set. The intratumoral VOI (VOI_I) was manually delineated on the thin-slice CT images, and seven peritumoral VOIs (VOI_P) were automatically generated with 1, 2, 3, 4, 5, 10, and 15 mm expansion along the VOI_I. 1454 radiomic features were extracted from each VOI. The t-test, the least absolute shrinkage and selection operator (LASSO), and the minimum redundancy maximum relevance (mRMR) algorithm were used for feature selection, followed by the construction of radiomics models (VOI_I model, VOI_P model and combined model). The performance of the models were evaluated by the area under the curve (AUC). RESULTS 399 patients were classified as EGFR mutant (EGFR+), while 380 were wild-type (EGFR-). In the training and validation sets, internal and external testing sets, VOI4 (intratumoral and peritumoral 4 mm) model achieved the best predictive performance, with AUCs of 0.877, 0.727, and 0.701, respectively, outperforming the VOI_I model (AUCs of 0.728, 0.698, and 0.653, respectively). CONCLUSIONS Radiomics extracted from peritumoral region can add extra value in predicting EGFR mutation status of lung adenocarcinoma patients, with the optimal peritumoral range of 4 mm.
Collapse
Affiliation(s)
- Youlan Shang
- Department of Radiology, The Second Xiangya Hospital, Central South University, No. 139 Middle Renmin Road, Changsha, 410011, Hunan, People's Republic of China
| | - Weidao Chen
- Infervision, Chaoyang District, Beijing, 100025, China
| | - Ge Li
- Department of Radiology, Xiangya Hospital, Central South University, No. 87 Xiangya Rd, Changsha, 410008, Hunan, People's Republic of China
| | - Yijie Huang
- Department of Radiology, The Second Xiangya Hospital, Central South University, No. 139 Middle Renmin Road, Changsha, 410011, Hunan, People's Republic of China
| | - Yisong Wang
- Department of Radiology, The Second Xiangya Hospital, Central South University, No. 139 Middle Renmin Road, Changsha, 410011, Hunan, People's Republic of China
| | - Xiaoyan Kui
- School of Computer Science and Engineering, Central South University, Changsha, 410083, Hunan, People's Republic of China
| | - Ming Li
- Department of Radiology, Huadong Hospital Affiliated to Fudan University, Shanghai, People's Republic of China
| | - Hairong Zheng
- Paul C. Lauterbur Research Center for Biomedical Imaging, Institute of Biomedical and Health Engineering, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, People's Republic of China
| | - Wei Zhao
- Department of Radiology, The Second Xiangya Hospital, Central South University, No. 139 Middle Renmin Road, Changsha, 410011, Hunan, People's Republic of China.
- Paul C. Lauterbur Research Center for Biomedical Imaging, Institute of Biomedical and Health Engineering, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, People's Republic of China.
- Clinical Research Center for Medical Imaging in Hunan Province, Changsha, Hunan Province, People's Republic of China.
| | - Jun Liu
- Department of Radiology, The Second Xiangya Hospital, Central South University, No. 139 Middle Renmin Road, Changsha, 410011, Hunan, People's Republic of China.
- Clinical Research Center for Medical Imaging in Hunan Province, Changsha, Hunan Province, People's Republic of China.
| |
Collapse
|
7
|
Prosper AE, Kammer MN, Maldonado F, Aberle DR, Hsu W. Expanding Role of Advanced Image Analysis in CT-detected Indeterminate Pulmonary Nodules and Early Lung Cancer Characterization. Radiology 2023; 309:e222904. [PMID: 37815447 PMCID: PMC10623199 DOI: 10.1148/radiol.222904] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2022] [Revised: 03/23/2023] [Accepted: 03/30/2023] [Indexed: 10/11/2023]
Abstract
The implementation of low-dose chest CT for lung screening presents a crucial opportunity to advance lung cancer care through early detection and interception. In addition, millions of pulmonary nodules are incidentally detected annually in the United States, increasing the opportunity for early lung cancer diagnosis. Yet, realization of the full potential of these opportunities is dependent on the ability to accurately analyze image data for purposes of nodule classification and early lung cancer characterization. This review presents an overview of traditional image analysis approaches in chest CT using semantic characterization as well as more recent advances in the technology and application of machine learning models using CT-derived radiomic features and deep learning architectures to characterize lung nodules and early cancers. Methodological challenges currently faced in translating these decision aids to clinical practice, as well as the technical obstacles of heterogeneous imaging parameters, optimal feature selection, choice of model, and the need for well-annotated image data sets for the purposes of training and validation, will be reviewed, with a view toward the ultimate incorporation of these potentially powerful decision aids into routine clinical practice.
Collapse
Affiliation(s)
- Ashley Elizabeth Prosper
- From the Department of Radiological Sciences, David Geffen School of
Medicine at UCLA, 924 Westwood Blvd, Suite 420, Los Angeles, CA 90024 (A.E.P.,
D.R.A., W.H.); Division of Allergy, Pulmonary and Critical Care Medicine,
Department of Medicine, Vanderbilt University Medical Center, Nashville, Tenn
(M.N.K., F.M.); and Department of Bioengineering, UCLA Samueli School of
Engineering, Los Angeles, Calif (D.R.A., W.H.)
| | - Michael N. Kammer
- From the Department of Radiological Sciences, David Geffen School of
Medicine at UCLA, 924 Westwood Blvd, Suite 420, Los Angeles, CA 90024 (A.E.P.,
D.R.A., W.H.); Division of Allergy, Pulmonary and Critical Care Medicine,
Department of Medicine, Vanderbilt University Medical Center, Nashville, Tenn
(M.N.K., F.M.); and Department of Bioengineering, UCLA Samueli School of
Engineering, Los Angeles, Calif (D.R.A., W.H.)
| | - Fabien Maldonado
- From the Department of Radiological Sciences, David Geffen School of
Medicine at UCLA, 924 Westwood Blvd, Suite 420, Los Angeles, CA 90024 (A.E.P.,
D.R.A., W.H.); Division of Allergy, Pulmonary and Critical Care Medicine,
Department of Medicine, Vanderbilt University Medical Center, Nashville, Tenn
(M.N.K., F.M.); and Department of Bioengineering, UCLA Samueli School of
Engineering, Los Angeles, Calif (D.R.A., W.H.)
| | - Denise R. Aberle
- From the Department of Radiological Sciences, David Geffen School of
Medicine at UCLA, 924 Westwood Blvd, Suite 420, Los Angeles, CA 90024 (A.E.P.,
D.R.A., W.H.); Division of Allergy, Pulmonary and Critical Care Medicine,
Department of Medicine, Vanderbilt University Medical Center, Nashville, Tenn
(M.N.K., F.M.); and Department of Bioengineering, UCLA Samueli School of
Engineering, Los Angeles, Calif (D.R.A., W.H.)
| | - William Hsu
- From the Department of Radiological Sciences, David Geffen School of
Medicine at UCLA, 924 Westwood Blvd, Suite 420, Los Angeles, CA 90024 (A.E.P.,
D.R.A., W.H.); Division of Allergy, Pulmonary and Critical Care Medicine,
Department of Medicine, Vanderbilt University Medical Center, Nashville, Tenn
(M.N.K., F.M.); and Department of Bioengineering, UCLA Samueli School of
Engineering, Los Angeles, Calif (D.R.A., W.H.)
| |
Collapse
|
8
|
Schroeder KE, Acharya L, Mani H, Furqan M, Sieren JC. Radiomic biomarkers from chest computed tomography are assistive in immunotherapy response prediction for non-small cell lung cancer. Transl Lung Cancer Res 2023; 12:1023-1033. [PMID: 37323179 PMCID: PMC10261870 DOI: 10.21037/tlcr-22-763] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2022] [Accepted: 04/12/2023] [Indexed: 06/17/2023]
Abstract
Background Immunotherapies, such as programmed death 1/programmed death ligand 1 (PD-1/PD-L1) antibodies have been shown to improve overall and progression-free survival (PFS) in patients with locally advanced or metastatic non-small cell lung cancer (NSCLC). However, not all patients derive a meaningful clinical benefit. Additionally, patients receiving anti-PD-1/PD-L1 therapy can experience immune-related adverse events (irAEs). Clinically significant irAEs may require temporary pause or discontinuation of treatment. Having a tool to identify patients who may not benefit and/or are at risk for developing severe irAEs from immunotherapy will aid in an informed decision-making process for the patients and their physicians. Methods Computed tomography (CT) scans and clinical data were retrospectively collected for this study to develop three prediction models using (I) radiomic features, (II) clinical features, and (III) radiomic and clinical features combined. Each subject had 6 clinical features and 849 radiomic features extracted. Selected features were run through an artificial neural network (NN) trained on 70% of the cohort, maintaining the case and control ratio. The NN was assessed by calculating the area-under-the-receiver-operating-characteristic curve (AUC-ROC), area-under-the-precision-recall curve (AUC-PR), sensitivity, and specificity. Results A cohort of 132 subjects, of which 43 (33%) had a PFS ≤90 days and 89 (67%) of which had a PFS >90 days was used to develop the prediction models. The radiomic model was able to predict progression-free survival with a training AUC-ROC of 87% and testing AUC-ROC, sensitivity, and specificity of 83%, 75%, and 81%, respectively. In this cohort, the clinical and radiomic combined features did add a slight increase in the specificity (85%) but with a decrease in sensitivity (75%) and AUC-ROC (81%). Conclusions Whole lung segmentation and feature extraction can identify those that would see a benefit from anti-PD-1/PD-L1 therapy.
Collapse
Affiliation(s)
| | - Luna Acharya
- Department of Internal Medicine, Hematology, Oncology and Blood and Marrow Transplantation, University of Iowa, Iowa City, IA, USA
| | - Hariharasudan Mani
- Department of Internal Medicine, Hematology, Oncology and Blood and Marrow Transplantation, University of Iowa, Iowa City, IA, USA
| | - Muhammad Furqan
- Department of Internal Medicine, Hematology, Oncology and Blood and Marrow Transplantation, University of Iowa, Iowa City, IA, USA
- Holden Comprehensive Cancer Center, University of Iowa, Iowa City, IA, USA
| | - Jessica C. Sieren
- Department of Radiology, University of Iowa, Iowa City, IA, USA
- Holden Comprehensive Cancer Center, University of Iowa, Iowa City, IA, USA
- Roy J. Carver Department of Biomedical Engineering, University of Iowa, Iowa City, IA, USA
| |
Collapse
|
9
|
Stogiannos N, Bougias H, Georgiadou E, Leandrou S, Papavasileiou P. Analysis of radiomic features derived from post-contrast T1-weighted images and apparent diffusion coefficient (ADC) maps for breast lesion evaluation: A retrospective study. Radiography (Lond) 2023; 29:355-361. [PMID: 36758380 DOI: 10.1016/j.radi.2023.01.019] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2022] [Revised: 01/17/2023] [Accepted: 01/25/2023] [Indexed: 02/10/2023]
Abstract
INTRODUCTION Breast cancer is the most common malignancy among women, and its diagnosis relies on medical imaging and the invasive, uncomforted biopsy. Recent advances in quantitative imaging and specifically the application of radiomics has proved to be a very promising technique, facilitating both diagnosis and therapy. The purpose of this study is to assess radiomic features derived from post-contrast T1w Magnetic Resonance Imaging (MRI) sequences and Apparent Diffusion Coefficient (ADC) maps for the evaluation of breast pathologies. METHODS MRI data from 52 women were retrospectively reviewed, involving 54 breast lesions, both malignant and benign. Diffusion Weighted Imaging (DWI) was applied as a standard MRΙ protocol, including dynamic contrast-enhanced (DCE) MRΙ in all cases. All patients were examined on a 1.5T MRI scanner, and 216 features were initially extracted from DCE-MRI images. Histological analysis of the breast lesions was performed, and a comparative analysis of the results was carried out to assess the accuracy of the method. RESULTS Following surgery and histological analysis, 30 lesions were found to be malignant and 24 benign. Implementation of a Machine Learning (ML) classification algorithm with 5-fold cross-validation resulted in a sensitivity of 70%, specificity of 66%, Negative Predictive Value of 82% and overall accuracy of 67% in differentiating malignancy from benevolence. CONCLUSION Texture analysis and ML methodology based on the first post-contrast dynamic sequences and ADC maps may be employed to differentiate between malignant and benign breast lesions, offering a promising new tool for diagnostic analysis. IMPLICATIONS FOR PRACTICE The results of this study will enhance knowledge around application and performance of radiomics in breast MRI, thus helping MRI radiographers who use AI-enabled technologies to better delineate the pros and cons of these procedures.
Collapse
Affiliation(s)
- N Stogiannos
- Discipline of Medical Imaging & Radiation Therapy, University College Cork, Ireland; Division of Midwifery & Radiography, City, University of London, UK; Medical Imaging Department, Corfu General Hospital, Greece, Felix Lames 6A, 1st Parodos, Corfu, Greece.
| | - H Bougias
- Department of Clinical Radiology, Ioannina University Hospital, Ioannina, Greece.
| | | | - S Leandrou
- School of Science, European University Cyprus, Nicosia, Cyprus; School of Mathematical Sciences, Computer Science and Engineering, City, University of London, UK.
| | - P Papavasileiou
- Section of Radiography and Radiotherapy, Dept of Biomedical Sciences, School of Health Sciences, University of West Attica, Athens, Greece.
| |
Collapse
|
10
|
Souliotis K, Golna C, Golnas P. Establishing a Pulmonary Nodule Clinic Service for Early Diagnosis of Lung Cancer - Review of International Options and Considerations for Greece. Risk Manag Healthc Policy 2023; 16:159-168. [PMID: 36777476 PMCID: PMC9912818 DOI: 10.2147/rmhp.s379014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2022] [Accepted: 11/30/2022] [Indexed: 02/09/2023] Open
Abstract
Early diagnosis of lung cancer in pulmonary nodules identified by computed tomography (CT) may be critical in reducing the epidemiological burden of the disease, particularly in countries where such a burden is considerably high and risk factors for lung cancer very prevalent. The establishment and operation of pulmonary nodule clinics (PNCs), ie, multidisciplinary services that watch and evaluate nodules found through deliberate screening efforts or as incidental findings, is increasingly becoming a key tool to implement such early-intervention, cancer-risk management policies elsewhere in the world. This review aims to research and present in a structured manner findings from published sources on options and considerations for setting up a PNC in a country such as Greece. These refer to the type of services a PNC would provide to optimize diagnosis of suspect pulmonary nodules, its structure and organization, including processes, human resources and technology infrastructure, its target audience, ie, who would be eligible to use its services, and the expected outcomes of its operation, in terms of a set of key performance indicators. Our review also revealed critical key success factors that should be considered when designing the introduction of a PNC in a health care setting, including optimal referral pathways, aligned clinical decision making and patient preferences and participation/empowerment. Our findings may inform health care systems with a high lung cancer burden and no available PNC service on options and considerations before introducing such a service in their respective settings.
Collapse
Affiliation(s)
- Kyriakos Souliotis
- Department of Social and Education Policy, University of Peloponnese, Corinth, Greece
- The Health Policy Institute, Maroussi, Greece
| | | | | |
Collapse
|
11
|
Tan M, Ma W, Yang Y, Duan S, Jin L, Wu Y, Li M. Predictive value of peritumour radiomics in the diagnosis of benign and malignant pulmonary nodules with halo sign. Clin Radiol 2023; 78:e52-e62. [PMID: 36460488 DOI: 10.1016/j.crad.2022.09.130] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2022] [Revised: 09/05/2022] [Accepted: 09/26/2022] [Indexed: 12/03/2022]
Abstract
AIM To evaluate peritumour radiomics in predicting benign and malignant pulmonary nodules with halo sign. MATERIALS AND METHODS In this retrospective study, 305 pulmonary nodules with halo sign (benign, 120; adenocarcinoma, 185) were collected. Manual segmentation was used to mark the gross tumour volume (GTV) and the peritumour volume (PTV) was established by uniform dilation (1 cm) of the tumour area in three dimensions. The GTV and PTV radiomic features were combined to produce the gross tumour and peritumour volume (GPTV). The minimum-redundancy maximum-relevance (mRMR) feature ranking method and least absolute shrinkage and selection operator (LASSO) algorithm were used to eliminate redundant radiomic features. Predictive models combined with clinical features and radiomic signatures were established. Multivarible logistic regression analysis was used to establish the combined model and develop a nomogram. Receiver operating characteristic (ROC) curve analysis was used to evaluate the predictive performance of the model. RESULTS In the testing cohort, the area under the ROC curve (AUC) of the GTV, PTV, and GPTV radiomic models was 0.701 (95% CI: 0.589-0.814), 0.674 (95% CI: 0.557-0.791) and 0.755 (95% CI: 0.643-0.867), respectively. The AUC of the nomogram model based on clinical and GPTV radiomic signatures was 0.804 (95% CI: 0.707-0.901). CONCLUSION The nomogram model based on clinical and GPTV radiomic signatures can better predict benign and malignant pulmonary nodules with halo signs, demonstrating that the model has potential as a convenient and effective auxiliary diagnostic tool for radiologists.
Collapse
Affiliation(s)
- M Tan
- Department of Radiology, Huadong Hospital Affiliated to Fudan University, Shanghai, China; Department of Radiology, Chengdu Second People's Hospital, Chengdu, China
| | - W Ma
- Department of Radiology, Huadong Hospital Affiliated to Fudan University, Shanghai, China; Department of Radiology, Shanghai Chest Hospital, Shanghai, China
| | - Y Yang
- Department of Radiology, Huadong Hospital Affiliated to Fudan University, Shanghai, China
| | - S Duan
- GE Healthcare, Shanghai, China
| | - L Jin
- Department of Radiology, Huadong Hospital Affiliated to Fudan University, Shanghai, China
| | - Y Wu
- Department of Thoracic Surgery, Huadong Hospital Affiliated to Fudan University, Shanghai, China.
| | - M Li
- Department of Radiology, Huadong Hospital Affiliated to Fudan University, Shanghai, China.
| |
Collapse
|
12
|
Balcı MA, Batrancea LM, Akgüller Ö, Nichita A. A Series-Based Deep Learning Approach to Lung Nodule Image Classification. Cancers (Basel) 2023; 15. [PMID: 36765801 DOI: 10.3390/cancers15030843] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2022] [Revised: 01/24/2023] [Accepted: 01/28/2023] [Indexed: 02/01/2023] Open
Abstract
Although many studies have shown that deep learning approaches yield better results than traditional methods based on manual features, CADs methods still have several limitations. These are due to the diversity in imaging modalities and clinical pathologies. This diversity creates difficulties because of variation and similarities between classes. In this context, the new approach from our study is a hybrid method that performs classifications using both medical image analysis and radial scanning series features. Hence, the areas of interest obtained from images are subjected to a radial scan, with their centers as poles, in order to obtain series. A U-shape convolutional neural network model is then used for the 4D data classification problem. We therefore present a novel approach to the classification of 4D data obtained from lung nodule images. With radial scanning, the eigenvalue of nodule images is captured, and a powerful classification is performed. According to our results, an accuracy of 92.84% was obtained and much more efficient classification scores resulted as compared to recent classifiers.
Collapse
|
13
|
Prisciandaro E, Sedda G, Cara A, Diotti C, Spaggiari L, Bertolaccini L. Artificial Neural Networks in Lung Cancer Research: A Narrative Review. J Clin Med 2023; 12:jcm12030880. [PMID: 36769528 PMCID: PMC9918295 DOI: 10.3390/jcm12030880] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2022] [Revised: 01/08/2023] [Accepted: 01/16/2023] [Indexed: 01/25/2023] Open
Abstract
BACKGROUND Artificial neural networks are statistical methods that mimic complex neural connections, simulating the learning dynamics of the human brain. They play a fundamental role in clinical decision-making, although their success depends on good integration with clinical protocols. When applied to lung cancer research, artificial neural networks do not aim to be biologically realistic, but rather to provide efficient models for nonlinear regression or classification. METHODS We conducted a comprehensive search of EMBASE (via Ovid), MEDLINE (via PubMed), Cochrane CENTRAL, and Google Scholar from April 2018 to December 2022, using a combination of keywords and related terms for "artificial neural network", "lung cancer", "non-small cell lung cancer", "diagnosis", and "treatment". RESULTS Artificial neural networks have shown excellent aptitude in learning the relationships between the input/output mapping from a given dataset, without any prior information or assumptions about the statistical distribution of the data. They can simultaneously process numerous variables, managing complexity; hence, they have found broad application in tasks requiring attention. CONCLUSIONS Lung cancer is the most common and lethal form of tumor, with limited diagnostic and treatment methods. The advances in tailored medicine have led to the development of novel tools for diagnosis and treatment. Artificial neural networks can provide valuable support for both basic research and clinical decision-making. Therefore, tight cooperation among surgeons, oncologists, and biostatisticians appears mandatory.
Collapse
Affiliation(s)
- Elena Prisciandaro
- Department of Thoracic Surgery, IEO, European Institute of Oncology IRCCS, 20141 Milan, Italy
| | - Giulia Sedda
- Department of Thoracic Surgery, IEO, European Institute of Oncology IRCCS, 20141 Milan, Italy
| | - Andrea Cara
- Department of Thoracic Surgery, IEO, European Institute of Oncology IRCCS, 20141 Milan, Italy
| | - Cristina Diotti
- Department of Thoracic Surgery, IEO, European Institute of Oncology IRCCS, 20141 Milan, Italy
| | - Lorenzo Spaggiari
- Department of Thoracic Surgery, IEO, European Institute of Oncology IRCCS, 20141 Milan, Italy
- Department of Oncology and Hemato-Oncology, University of Milan, 20122 Milan, Italy
| | - Luca Bertolaccini
- Department of Thoracic Surgery, IEO, European Institute of Oncology IRCCS, 20141 Milan, Italy
- Correspondence: ; Tel.: +39-02-57489665; Fax: +39-02-56562994
| |
Collapse
|
14
|
Philibert R, Dawes K, Moody J, Hoffman R, Sieren J, Long J. Using Cg05575921 methylation to predict lung cancer risk: a potentially bias-free precision epigenetics approach. Epigenetics 2022; 17:2096-2108. [PMID: 35920547 PMCID: PMC9665144 DOI: 10.1080/15592294.2022.2108082] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2022] [Accepted: 07/25/2022] [Indexed: 01/25/2023] Open
Abstract
The decision to engage in lung cancer screening (LCS) necessitates weighing benefits versus harms. Previously, clinicians in the United States have used the PLCOM2012 algorithm to guide LCS decision-making. However, that formula contains race and gender-based variables. Previously, using data from a European study, Bojesen and colleagues have suggested that cg05575921 methylation could guide decision-making. To test this hypothesis in a more diverse American population, we examined DNA and clinical data from 3081 subjects from the National Lung Screening Trial (NLST) study. Using survival analysis, we found a simple linear predictor consisting of age, pack-year consumption and cg05575921, to have the best predictive power among several alternatives (AUC = 0.66). Results showed that the highest quartile of risk was more than 2-fold more likely to develop lung cancer than those in the lowest quartile. Race, ethnicity, and gender had no effect on prediction with both cg05575921 and pack years contributing equally (both p < 0.003) to risk prediction. Current smokers had considerably lower methylation than former smokers (46% vs 67%; p < 0.001) with the average methylation of those who quit approaching 80% after 25 years of cessation. Finally, current male smokers had lower mean cg05575921 percentage than female smokers (46% vs 49%; p < 0.001). We conclude that cg05575921 (along with age and pack years) can be used to guide LCS decision-making, and additional studies might focus on how best to use methylation to inform decision-making.
Collapse
Affiliation(s)
- Rob Philibert
- Behavioural Diagnostics LLC, Coralville, IA, USA
- Department of Psychiatry, University of Iowa, Iowa City, IA, USA
- Department of Biomedical Engineering, University of Iowa, Iowa City, IA, USA
| | - Kelsey Dawes
- Behavioural Diagnostics LLC, Coralville, IA, USA
- Department of Psychiatry, University of Iowa, Iowa City, IA, USA
| | - Joanna Moody
- Department of Psychiatry, University of Iowa, Iowa City, IA, USA
| | - Richard Hoffman
- Department of Internal Medicine, University of Iowa, Iowa City, IA, USA
| | - Jessica Sieren
- Department of Biomedical Engineering, University of Iowa, Iowa City, IA, USA
- Department of Radiology, University of Iowa, Iowa City, IA, USA
- Department of Biostatistics, University of Iowa, Iowa City, IA, USA
| | - Jeffrey Long
- Department of Psychiatry, University of Iowa, Iowa City, IA, USA
- Department of Biostatistics, University of Iowa, Iowa City, IA, USA
| |
Collapse
|
15
|
Crombé A, Lafon M, Nougaret S, Kind M, Cousin S. Ranking the most influential predictors of CT-based radiomics feature values in metastatic lung adenocarcinoma. Eur J Radiol 2022; 155:110472. [PMID: 35985090 DOI: 10.1016/j.ejrad.2022.110472] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2022] [Revised: 07/09/2022] [Accepted: 08/09/2022] [Indexed: 11/28/2022]
Abstract
PURPOSE To investigate which acquisition, post-processing, tumor, and patient characteristics contribute the most to the value of radiomics features (RFs) in lung adenocarcinoma in order to better understand and order the potential sources of bias in radiomics studies in a multivariate setting. METHODS This single-center retrospective study included all consecutive patients with newly-diagnosed lung adenocarcinoma treated between December 2016 and September 2018 who had pre-treatment contrast-enhanced CT-scan showing ≥ 2 target lesions per response evaluation criteria in solid tumors (RECIST) v1.1. All measurable lesions were manually segmented; 49 RFs were extracted using LIFEx v7.0.0. Afterwards, we reverted the usual radiomics approach (i.e., predicting a clinical outcome base on multiple RFs). To do so, for each RF, random forests and linear regression algorithms were trained using cross-validation to predict the RF value depending on the following variables: patient, mutational status, phase of CT-scan acquisition, discretization (binsize), lesion location, lesion volume, and best response obtained during the first line of treatment (partial response per RECIST vs other). The most important contributors to the value of reproducible RFs (intra-class correlation coefficient > 0.80) according to the best random forests model (selected via R-squared) were ranked. RESULTS 101 patients (median age: 62.3) were included, with a median of 5 target lesions per patient (range: 2-10) providing 466 segmented lesions. Twenty-nine RFs were reproducible. The most important predictors of the reproducible RFs values were, in order: tumor volume, binsize, tumor location, CT-scan phase, KRAS mutation, and treatment response (average importance: 61.7%, 57.4%, 8.1%, 3.3%, 3%, and 2.7%, respectively). The treatment response and KRAS and EGFR/ROS1/ALK mutational status remained independently correlated with the RF value for 64.3%, 32.1%, and 50% reproducible RFs, respectively. CONCLUSION Tumor volume, location, acquisition and post-processing parameters should systematically be incorporated in radiomics-based modeling; however, most reproducible RFs do have significant relationships with mutational status and treatment response.
Collapse
Affiliation(s)
- Amandine Crombé
- Department of Oncologic Imaging, Institut Bergonié, Regional Comprehensive Cancer, F-33076 Bordeaux, France; Department of Imaging, Pellegrin University Hospital, F-33300 Bordeaux, France; University of Bordeaux, UMR CNRS 5251, INRIA Project team Models in Oncology (Monc), F-33400 Talence, France.
| | - Mathilde Lafon
- Department of Medical Oncology, Institut Bergonié, Regional Comprehensive Cancer, F-33076 Bordeaux, France
| | - Stéphanie Nougaret
- Department of Radiology, Institut Régional du Cancer de Montpellier, Montpellier Cancer Research Institute, INSERM U1194, University of Montpellier, F-34295 Montpellier, France
| | - Michèle Kind
- Department of Oncologic Imaging, Institut Bergonié, Regional Comprehensive Cancer, F-33076 Bordeaux, France
| | - Sophie Cousin
- Department of Medical Oncology, Institut Bergonié, Regional Comprehensive Cancer, F-33076 Bordeaux, France
| |
Collapse
|
16
|
Jassim MM, Jaber MM. Systematic review for lung cancer detection and lung nodule classification: Taxonomy, challenges, and recommendation future works. Journal of Intelligent Systems 2022. [DOI: 10.1515/jisys-2022-0062] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
Abstract
Abstract
Nowadays, lung cancer is one of the most dangerous diseases that require early diagnosis. Artificial intelligence has played an essential role in the medical field in general and in analyzing medical images and diagnosing diseases in particular, as it can reduce human errors that can occur with the medical expert when analyzing medical image. In this research study, we have done a systematic survey of the research published during the last 5 years in the diagnosis of lung cancer classification of lung nodules in 4 reliable databases (Science Direct, Scopus, web of science, and IEEE), and we selected 50 research paper using systematic literature review. The goal of this review work is to provide a concise overview of recent advancements in lung cancer diagnosis issues by machine learning and deep learning algorithms. This article summarizes the present state of knowledge on the subject. Addressing the findings offered in recent research publications gives the researchers a better grasp of the topic. We checked all the characteristics, such as challenges, recommendations for future work were analyzed in detail, and the published datasets and their source were presented to facilitate the researchers’ access to them and use it to develop the results achieved previously.
Collapse
Affiliation(s)
- Mustafa Mohammed Jassim
- Department of Computer Science, Informatics Institute for Postgraduate Studies (IIPS), Iraqi Commission for Computers and Informatics (ICCI) , Baghdad , Iraq
| | - Mustafa Musa Jaber
- Department of Medical Instruments Engineering Techniques, Dijlah University College , Baghdad , 10021 , Iraq
- Department of Medical Instruments Engineering Techniques, Al-Farahidi University , Baghdad , 10021 , Iraq
| |
Collapse
|
17
|
Masquelin AH, Alshaabi T, Cheney N, San José Estépar R, Bates JH, Kinsey CM. Perinodular Parenchymal Features Improve Indeterminate Lung Nodule Classification. Acad Radiol 2022; 30:1073-1080. [PMID: 35933282 PMCID: PMC9895123 DOI: 10.1016/j.acra.2022.07.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2022] [Revised: 06/24/2022] [Accepted: 07/06/2022] [Indexed: 02/05/2023]
Abstract
BACKGROUND Radiomics, defined as quantitative features extracted from images, provide a non-invasive means of assessing malignant versus benign pulmonary nodules. In this study, we evaluate the consistency with which perinodular radiomics extracted from low-dose computed tomography images serve to identify malignant pulmonary nodules. MATERIALS AND METHODS Using the National Lung Screening Trial (NLST), we selected individuals with pulmonary nodules between 4mm to 20mm in diameter. Nodules were segmented to generate four distinct datasets; 1) a Tumor dataset containing tumor-specific features, 2) a 10 mm Band dataset containing parenchymal features between the segmented nodule boundary and 10mm out from the boundary, 3) a 15mm Band dataset, and 4) a Tumor Size dataset containing the maximum nodule diameter. Models to predict malignancy were constructed using support-vector machine (SVM), random forest (RF), and least absolute shrinkage and selection operator (LASSO) approaches. Ten-fold cross validation with 10 repetitions per fold was used to evaluate the performance of each approach applied to each dataset. RESULTS With respect to the RF, the Tumor, 10mm Band, and 15mm Band datasets achieved areas under the receiver-operator curve (AUC) of 84.44%, 84.09%, and 81.57%, respectively. Significant differences in performance were observed between the Tumor and 15mm Band datasets (adj. p-value <0.001). However, when combining tumor-specific features with perinodular features, the 10mm Band + Tumor and 15mm Band + Tumor datasets (AUC 87.87% and 86.75%, respectively) performed significantly better than the Tumor Size dataset (66.76%) or the Tumor dataset. Similarly, the AUCs from the SVM and LASSO were 84.71% and 88.91%, respectively, for the 10mm Band + Tumor. CONCLUSIONS The combined 10mm Band + Tumor dataset improved the differentiation between benign and malignant lung nodules compared to the Tumor datasets across all methodologies. This demonstrates that parenchymal features capture novel diagnostic information beyond that present in the nodule itself. (data agreement: NLST-163).
Collapse
Affiliation(s)
- Axel H. Masquelin
- University of Vermont, Electrical and Biomedical Engineering, Burlington, VT, USA
| | - Thayer Alshaabi
- University of California Berkeley, Advanced Bioimaging Center Berkeley, CA, USA
| | - Nick Cheney
- University of Vermont, Computer Science, Burlington, VT, USA
| | - Raúl San José Estépar
- Brigham and Women’s Hospital Department of Radiology, Radiology 1249 Boylston St, Boston, MA, USA 02215
| | | | - C. Matthew Kinsey
- University of Vermont College of Medicine, Medicine, Pulmonary and Critical Care Given D208, 89 Beaumont Avenue, Burlington, VT, USA, 05405
| |
Collapse
|
18
|
Vicini S, Bortolotto C, Rengo M, Ballerini D, Bellini D, Carbone I, Preda L, Laghi A, Coppola F, Faggioni L. A narrative review on current imaging applications of artificial intelligence and radiomics in oncology: focus on the three most common cancers. Radiol Med 2022; 127:819-836. [DOI: 10.1007/s11547-022-01512-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2022] [Accepted: 06/01/2022] [Indexed: 12/24/2022]
|
19
|
Uthoff JM, Mott SL, Larson J, Neslund-Dudas CM, Schwartz AG, Sieren JC. Computed Tomography Features of Lung Structure Have Utility for Differentiating Malignant and Benign Pulmonary Nodules. Chronic Obstr Pulm Dis 2022; 9:154-164. [PMID: 35021316 PMCID: PMC9166332 DOI: 10.15326/jcopdf.2021.0271] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 01/12/2022] [Indexed: 06/14/2023]
Abstract
BACKGROUND Chronic obstructive pulmonary disease (COPD) is a known comorbidity for lung cancer independent of smoking history. Quantitative computed tomography (qCT) imaging features related to COPD have shown promise in the assessment of lung cancer risk. We hypothesize that qCT features from the lung, lobe, and airway tree related to the location of the pulmonary nodule can be used to provide informative malignancy risk assessment. METHODS A total of 183 qCT features were extracted from 278 individuals with a solitary pulmonary nodule of known diagnosis (71 malignant, 207 benign). These included histogram and airway characteristics of the lungs, lobe, and segmental paths. Performances of the least absolute shrinkage and selection operator (LASSO) regression analysis and an ensemble of neural networks (ENN) were compared for feature set selection and classification on a testing cohort of 49 additional individuals (15 malignant, 34 benign). RESULTS The LASSO and ENN methods produced different feature sets for classification with LASSO selecting fewer qCT features (7) than the ENN (17). The LASSO model with the highest performing training area under the curve (AUC) (0.80) incorporated automatically extracted features and reader-measured nodule diameter with a testing AUC of 0.62. The ENN model with the highest performing AUC (0.77) also incorporated qCT and reader diameter but maintained higher testing performance AUC (0.79). CONCLUSIONS Automatically extracted qCT imaging features of the lung can be informative of the differentiation between individuals with malignant pulmonary nodules and those with benign pulmonary nodules, without requiring nodule segmentation and analysis.
Collapse
Affiliation(s)
- Johanna M. Uthoff
- Department of Radiology, University of Iowa, Iowa City, Iowa, United States
- Department of Biomedical Engineering, University of Iowa, Iowa City, Iowa, United States
- Holden Comprehensive Cancer Center, University of Iowa, Iowa City, Iowa, United States
| | - Sarah L. Mott
- Holden Comprehensive Cancer Center, University of Iowa, Iowa City, Iowa, United States
| | - Jared Larson
- Department of Radiology, University of Iowa, Iowa City, Iowa, United States
| | - Christine M. Neslund-Dudas
- Department of Public Health Sciences, Henry Ford Health System, Detroit, Michigan, United States
- Henry Ford Cancer Institute, Henry Ford Health System, Detroit, Michigan, United States
| | - Ann G. Schwartz
- Karmanos Cancer Institute, Wayne State University, Detroit, Michigan, United States
| | - Jessica C. Sieren
- Department of Radiology, University of Iowa, Iowa City, Iowa, United States
- Department of Biomedical Engineering, University of Iowa, Iowa City, Iowa, United States
- Holden Comprehensive Cancer Center, University of Iowa, Iowa City, Iowa, United States
| | - the COPDGene® Investigators
- Department of Radiology, University of Iowa, Iowa City, Iowa, United States
- Department of Biomedical Engineering, University of Iowa, Iowa City, Iowa, United States
- Holden Comprehensive Cancer Center, University of Iowa, Iowa City, Iowa, United States
- Department of Public Health Sciences, Henry Ford Health System, Detroit, Michigan, United States
- Henry Ford Cancer Institute, Henry Ford Health System, Detroit, Michigan, United States
- Karmanos Cancer Institute, Wayne State University, Detroit, Michigan, United States
| |
Collapse
|
20
|
Wu YJ, Wu FZ, Yang SC, Tang EK, Liang CH. Radiomics in Early Lung Cancer Diagnosis: From Diagnosis to Clinical Decision Support and Education. Diagnostics (Basel) 2022; 12:diagnostics12051064. [PMID: 35626220 PMCID: PMC9139351 DOI: 10.3390/diagnostics12051064] [Citation(s) in RCA: 21] [Impact Index Per Article: 10.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2022] [Revised: 04/14/2022] [Accepted: 04/22/2022] [Indexed: 12/19/2022] Open
Abstract
Lung cancer is the most frequent cause of cancer-related death around the world. With the recent introduction of low-dose lung computed tomography for lung cancer screening, there has been an increasing number of smoking- and non-smoking-related lung cancer cases worldwide that are manifesting with subsolid nodules, especially in Asian populations. However, the pros and cons of lung cancer screening also follow the implementation of lung cancer screening programs. Here, we review the literature related to radiomics for early lung cancer diagnosis. There are four main radiomics applications: the classification of lung nodules as being malignant/benign; determining the degree of invasiveness of the lung adenocarcinoma; histopathologic subtyping; and prognostication in lung cancer prediction models. In conclusion, radiomics offers great potential to improve diagnosis and personalized risk stratification in early lung cancer diagnosis through patient–doctor cooperation and shared decision making.
Collapse
Affiliation(s)
- Yun-Ju Wu
- Department of Software Engineering and Management, National Kaohsiung Normal University, Kaohsiung 80201, Taiwan;
| | - Fu-Zong Wu
- Institute of Education, National Sun Yat-Sen University, 70, Lien-Hai Road, Kaohsiung 804241, Taiwan;
- Department of Radiology, Kaohsiung Veterans General Hospital, Kaohsiung 813414, Taiwan
- Faculty of Clinical Medicine, National Yang Ming Chiao Tung University, Taipei 11221, Taiwan
- Faculty of Medicine, School of Medicine, National Yang Ming Chiao Tung University, Taipei 11221, Taiwan
- Correspondence:
| | - Shu-Ching Yang
- Institute of Education, National Sun Yat-Sen University, 70, Lien-Hai Road, Kaohsiung 804241, Taiwan;
| | - En-Kuei Tang
- Department of Surgery, Kaohsiung Veterans General Hospital, Kaohsiung 813414, Taiwan;
| | - Chia-Hao Liang
- Department of Biomedical Imaging and Radiological Sciences, National Yang Ming Chiao Tung University, Taipei 11221, Taiwan;
| |
Collapse
|
21
|
Fahmy D, Kandil H, Khelifi A, Yaghi M, Ghazal M, Sharafeldeen A, Mahmoud A, El-Baz A. How AI Can Help in the Diagnostic Dilemma of Pulmonary Nodules. Cancers (Basel) 2022; 14:cancers14071840. [PMID: 35406614 PMCID: PMC8997734 DOI: 10.3390/cancers14071840] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2022] [Revised: 03/29/2022] [Accepted: 03/30/2022] [Indexed: 02/04/2023] Open
Abstract
Simple Summary Pulmonary nodules are considered a sign of bronchogenic carcinoma, detecting them early will reduce their progression and can save lives. Lung cancer is the second most common type of cancer in both men and women. This manuscript discusses the current applications of artificial intelligence (AI) in lung segmentation as well as pulmonary nodule segmentation and classification using computed tomography (CT) scans, published in the last two decades, in addition to the limitations and future prospects in the field of AI. Abstract Pulmonary nodules are the precursors of bronchogenic carcinoma, its early detection facilitates early treatment which save a lot of lives. Unfortunately, pulmonary nodule detection and classification are liable to subjective variations with high rate of missing small cancerous lesions which opens the way for implementation of artificial intelligence (AI) and computer aided diagnosis (CAD) systems. The field of deep learning and neural networks is expanding every day with new models designed to overcome diagnostic problems and provide more applicable and simply used models. We aim in this review to briefly discuss the current applications of AI in lung segmentation, pulmonary nodule detection and classification.
Collapse
Affiliation(s)
- Dalia Fahmy
- Diagnostic Radiology Department, Mansoura University Hospital, Mansoura 35516, Egypt;
| | - Heba Kandil
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA; (H.K.); (A.S.); (A.M.)
- Information Technology Department, Faculty of Computers and Informatics, Mansoura University, Mansoura 35516, Egypt
| | - Adel Khelifi
- Computer Science and Information Technology Department, Abu Dhabi University, Abu Dhabi 59911, United Arab Emirates;
| | - Maha Yaghi
- Electrical, Computer, and Biomedical Engineering Department, Abu Dhabi University, Abu Dhabi 59911, United Arab Emirates; (M.Y.); (M.G.)
| | - Mohammed Ghazal
- Electrical, Computer, and Biomedical Engineering Department, Abu Dhabi University, Abu Dhabi 59911, United Arab Emirates; (M.Y.); (M.G.)
| | - Ahmed Sharafeldeen
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA; (H.K.); (A.S.); (A.M.)
| | - Ali Mahmoud
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA; (H.K.); (A.S.); (A.M.)
| | - Ayman El-Baz
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA; (H.K.); (A.S.); (A.M.)
- Correspondence:
| |
Collapse
|
22
|
Ebrahimian S, Kalra MK, Agarwal S, Bizzo BC, Elkholy M, Wald C, Allen B, Dreyer KJ. FDA-regulated AI Algorithms: Trends, Strengths, and Gaps of Validation Studies. Acad Radiol 2022; 29:559-566. [PMID: 34969610 DOI: 10.1016/j.acra.2021.09.002] [Citation(s) in RCA: 37] [Impact Index Per Article: 18.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2021] [Revised: 08/24/2021] [Accepted: 09/04/2021] [Indexed: 12/31/2022]
Abstract
RATIONALE AND OBJECTIVES To assess key trends, strengths, and gaps in validation studies of the Food and Drug Administration (FDA)-regulated imaging-based artificial intelligence/machine learning (AI/ML) algorithms. MATERIALS AND METHODS We audited publicly available details of regulated AI/ML algorithms in imaging from 2008 until April 2021. We reviewed 127 regulated software (118 AI/ML) to classify information related to their parent company, subspecialty, body area and specific anatomy type, imaging modality, date of FDA clearance, indications for use, target pathology (such as trauma) and findings (such as fracture), technique (CAD triage, CAD detection and/or characterization, CAD acquisition or improvement, and image processing/quantification), product performance, presence, type, strength and availability of clinical validation data. Pertaining to validation data, where available, we recorded the number of patients or studies included, sensitivity, specificity, accuracy, and/or receiver operating characteristic area under the curve, along with information on ground-truthing of use-cases. Data were analyzed with pivot tables and charts for descriptive statistics and trends. RESULTS We noted an increasing number of FDA-regulated AI/ML from 2008 to 2021. Seventeen (17/118) regulated AI/ML algorithms posted no validation claims or data. Just 9/118 reviewed AI/ML algorithms had a validation dataset sizes of over 1000 patients. The most common type of AI/ML included image processing/quantification (IPQ; n = 59/118), and triage (CADt; n = 27/118). Brain, breast, and lungs dominated the targeted body regions of interest. CONCLUSION Insufficient public information on validation datasets in several FDA-regulated AI/ML algorithms makes it difficult to justify clinical applications since their generalizability and presence of bias cannot be inferred.
Collapse
|
23
|
Huang L, Lin W, Xie D, Yu Y, Cao H, Liao G, Wu S, Yao L, Wang Z, Wang M, Wang S, Wang G, Zhang D, Yao S, He Z, Cho WCS, Chen D, Zhang Z, Li W, Qiao G, Chan LWC, Zhou H. Development and validation of a preoperative CT-based radiomic nomogram to predict pathology invasiveness in patients with a solitary pulmonary nodule: a machine learning approach, multicenter, diagnostic study. Eur Radiol 2022; 32:1983-1996. [PMID: 34654966 PMCID: PMC8831242 DOI: 10.1007/s00330-021-08268-z] [Citation(s) in RCA: 19] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2020] [Revised: 07/23/2021] [Accepted: 08/06/2021] [Indexed: 02/08/2023]
Abstract
OBJECTIVES To develop and validate a preoperative CT-based nomogram combined with radiomic and clinical-radiological signatures to distinguish preinvasive lesions from pulmonary invasive lesions. METHODS This was a retrospective, diagnostic study conducted from August 1, 2018, to May 1, 2020, at three centers. Patients with a solitary pulmonary nodule were enrolled in the GDPH center and were divided into two groups (7:3) randomly: development (n = 149) and internal validation (n = 54). The SYSMH center and the ZSLC Center formed an external validation cohort of 170 patients. The least absolute shrinkage and selection operator (LASSO) algorithm and logistic regression analysis were used to feature signatures and transform them into models. RESULTS The study comprised 373 individuals from three independent centers (female: 225/373, 60.3%; median [IQR] age, 57.0 [48.0-65.0] years). The AUCs for the combined radiomic signature selected from the nodular area and the perinodular area were 0.93, 0.91, and 0.90 in the three cohorts. The nomogram combining the clinical and combined radiomic signatures could accurately predict interstitial invasion in patients with a solitary pulmonary nodule (AUC, 0.94, 0.90, 0.92) in the three cohorts, respectively. The radiomic nomogram outperformed any clinical or radiomic signature in terms of clinical predictive abilities, according to a decision curve analysis and the Akaike information criteria. CONCLUSIONS This study demonstrated that a nomogram constructed by identified clinical-radiological signatures and combined radiomic signatures has the potential to precisely predict pathology invasiveness. KEY POINTS • The radiomic signature from the perinodular area has the potential to predict pathology invasiveness of the solitary pulmonary nodule. • The new radiomic nomogram was useful in clinical decision-making associated with personalized surgical intervention and therapeutic regimen selection in patients with early-stage non-small-cell lung cancer.
Collapse
Affiliation(s)
- Luyu Huang
- Division of Thoracic Surgery, Guangdong Provincial People's Hospital & Guangdong Academy of Medical Sciences, The Second School of Clinical Medicine, Southern Medical University, Shantou University Medical College, Guangzhou, China
| | - Weihuan Lin
- Division of Thoracic Surgery, Guangdong Provincial People's Hospital & Guangdong Academy of Medical Sciences, The Second School of Clinical Medicine, Southern Medical University, Shantou University Medical College, Guangzhou, China
| | - Daipeng Xie
- Division of Thoracic Surgery, Guangdong Provincial People's Hospital & Guangdong Academy of Medical Sciences, The Second School of Clinical Medicine, Southern Medical University, Shantou University Medical College, Guangzhou, China
| | - Yunfang Yu
- Guangdong Provincial Key Laboratory of Malignant Tumor Epigenetics and Gene Regulation, Department of Medical Oncology, Phase I Clinical Trial Centre, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, Guangzhou, China
- AI & Digital Media Concentration Program, Division of Science and Technology, Beijing Normal University-Hong Kong Baptist University United International College, Zhuhai, China
| | - Hanbo Cao
- Department of Radiology, Zhoushan Hospital, Zhoushan City, Zhejiang Province, China
| | - Guoqing Liao
- Division of Thoracic Surgery, Guangdong Provincial People's Hospital & Guangdong Academy of Medical Sciences, The Second School of Clinical Medicine, Southern Medical University, Shantou University Medical College, Guangzhou, China
| | - Shaowei Wu
- Division of Thoracic Surgery, Guangdong Provincial People's Hospital & Guangdong Academy of Medical Sciences, The Second School of Clinical Medicine, Southern Medical University, Shantou University Medical College, Guangzhou, China
| | - Lintong Yao
- Division of Thoracic Surgery, Guangdong Provincial People's Hospital & Guangdong Academy of Medical Sciences, The Second School of Clinical Medicine, Southern Medical University, Shantou University Medical College, Guangzhou, China
| | - Zhaoyu Wang
- Department of Pathology, Zhoushan Hospital, Zhoushan City, Zhejiang Province, China
| | - Mei Wang
- Department of Radiology, Department of PET Center, Guangdong Provincial People's Hospital & Guangdong Academy of Medical Sciences, Guangzhou, China
| | - Siyun Wang
- Department of Radiology, Department of PET Center, Guangdong Provincial People's Hospital & Guangdong Academy of Medical Sciences, Guangzhou, China
| | - Guangyi Wang
- Department of Radiology, Department of PET Center, Guangdong Provincial People's Hospital & Guangdong Academy of Medical Sciences, Guangzhou, China
| | - Dongkun Zhang
- Division of Thoracic Surgery, Guangdong Provincial People's Hospital & Guangdong Academy of Medical Sciences, The Second School of Clinical Medicine, Southern Medical University, Shantou University Medical College, Guangzhou, China
| | - Su Yao
- Department of Pathology, Guangdong Provincial People's Hospital & Guangdong Academy of Medical Sciences, Guangzhou, China
| | - Zifan He
- Guangdong Provincial Key Laboratory of Malignant Tumor Epigenetics and Gene Regulation, Department of Medical Oncology, Phase I Clinical Trial Centre, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, Guangzhou, China
| | | | - Duo Chen
- Department of Respiratory and Critical Care Medicine, Beijing Institute of Respiratory Medicine, Beijing Chao-Yang Hospital, Capital Medical University, Beijing, China
| | - Zhengjie Zhang
- Division of Thoracic Surgery, Guangdong Provincial People's Hospital & Guangdong Academy of Medical Sciences, The Second School of Clinical Medicine, Southern Medical University, Shantou University Medical College, Guangzhou, China
| | - Wanshan Li
- Clinical Medicine, Zhongshan School of Medicine, Yat-Sen University, Guangzhou, China
| | - Guibin Qiao
- Division of Thoracic Surgery, Guangdong Provincial People's Hospital & Guangdong Academy of Medical Sciences, The Second School of Clinical Medicine, Southern Medical University, Shantou University Medical College, Guangzhou, China.
| | - Lawrence Wing-Chi Chan
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong, China.
| | - Haiyu Zhou
- Division of Thoracic Surgery, Guangdong Provincial People's Hospital & Guangdong Academy of Medical Sciences, The Second School of Clinical Medicine, Southern Medical University, Shantou University Medical College, Guangzhou, China.
| |
Collapse
|
24
|
Wu Z, Wang F, Cao W, Qin C, Dong X, Yang Z, Zheng Y, Luo Z, Zhao L, Yu Y, Xu Y, Li J, Tang W, Shen S, Wu N, Tan F, Li N, He J. Lung cancer risk prediction models based on pulmonary nodules: A systematic review. Thorac Cancer 2022; 13:664-677. [PMID: 35137543 PMCID: PMC8888150 DOI: 10.1111/1759-7714.14333] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2021] [Revised: 01/10/2022] [Accepted: 01/11/2022] [Indexed: 10/25/2022] Open
Abstract
BACKGROUND Screening with low-dose computed tomography (LDCT) is an efficient way to detect lung cancer at an earlier stage, but has a high false-positive rate. Several pulmonary nodules risk prediction models were developed to solve the problem. This systematic review aimed to compare the quality and accuracy of these models. METHODS The keywords "lung cancer," "lung neoplasms," "lung tumor," "risk," "lung carcinoma" "risk," "predict," "assessment," and "nodule" were used to identify relevant articles published before February 2021. All studies with multivariate risk models developed and validated on human LDCT data were included. Informal publications or studies with incomplete procedures were excluded. Information was extracted from each publication and assessed. RESULTS A total of 41 articles and 43 models were included. External validation was performed for 23.2% (10/43) models. Deep learning algorithms were applied in 62.8% (27/43) models; 60.0% (15/25) deep learning based researches compared their algorithms with traditional methods, and received better discrimination. Models based on Asian and Chinese populations were usually built on single-center or small sample retrospective studies, and the majority of the Asian models (12/15, 80.0%) were not validated using external datasets. CONCLUSION The existing models showed good discrimination for identifying high-risk pulmonary nodules, but lacked external validation. Deep learning algorithms are increasingly being used with good performance. More researches are required to improve the quality of deep learning models, particularly for the Asian population.
Collapse
Affiliation(s)
- Zheng Wu
- Office of Cancer Screening, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Fei Wang
- Office of Cancer Screening, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Wei Cao
- Office of Cancer Screening, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Chao Qin
- Office of Cancer Screening, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Xuesi Dong
- Office of Cancer Screening, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Zhuoyu Yang
- Office of Cancer Screening, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Yadi Zheng
- Office of Cancer Screening, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Zilin Luo
- Office of Cancer Screening, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Liang Zhao
- Office of Cancer Screening, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Yiwen Yu
- Office of Cancer Screening, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Yongjie Xu
- Office of Cancer Screening, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Jiang Li
- Office of Cancer Screening, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China.,Chinese Academy of Medical Sciences Key Laboratory for National Cancer Big Data Analysis and Implement, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Wei Tang
- PET-CT Center, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Sipeng Shen
- Department of Epidemiology, Center for Global Health, School of Public Health, Nanjing Medical University, Nanjing, China.,Jiangsu Key Lab of Cancer Biomarkers, Prevention and Treatment, Collaborative Innovation Center for Cancer Personalized Medicine, Nanjing Medical University, Nanjing, China
| | - Ning Wu
- PET-CT Center, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China.,Department of Diagnostic Radiology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Fengwei Tan
- Department of Thoracic Surgery, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Ni Li
- Office of Cancer Screening, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China.,Chinese Academy of Medical Sciences Key Laboratory for National Cancer Big Data Analysis and Implement, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Jie He
- Office of Cancer Screening, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China.,Department of Thoracic Surgery, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| |
Collapse
|
25
|
Wu S, Zhang N, Wu Z, Ren J, E L. Can Peritumoral Radiomics Improve the Prediction of Malignancy of Solid Pulmonary Nodule Smaller Than 2 cm? Acad Radiol 2022; 29 Suppl 2:S47-S52. [PMID: 33189549 DOI: 10.1016/j.acra.2020.10.029] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2020] [Revised: 10/21/2020] [Accepted: 10/31/2020] [Indexed: 12/12/2022]
Abstract
RATIONALE AND OBJECTIVES To compare the ability of radiomics models including the perinodular parenchyma and standard nodular radiomics model in lung cancer diagnosis of solid pulmonary nodules smaller than 2 cm. MATERIALS AND METHODS In this retrospective study, the computed tomography (CT) scans of 206 patients with a lung nodule from a single institution in 2012-2019 were collected. For each nodule, four volumes of interest were defined using the gross tumor volume (GTV) and peritumoral volumes (PTVs) of 5, 10, and 15 mm around the tumor. RESULTS Radiomics models created from GTV, GTV plus 5 mm of PTV, GTV plus 10 mm of PTV, and GTV plus 15 mm of PTV achieved AUCs of 0.89, 0.81, 0.81, and 0.73, respectively, in the validation cohort for the diagnostic classification of benign and malignant pulmonary nodules. The performance of the models gradually decreased as the PTV increased. Wavelet features were the primary features identified in optimal radiomics signatures (2/3 in R, 4/5 in GTV plus 5 mm PTV, 3/4 in GTV plus 10 mm PTV, 2/3 in GTV plus 15 mm PTV). CONCLUSION Our study indicated that the radiomics signatures of GTV had a good prediction ability in distinguishing benign and malignant solid pulmonary nodules smaller than 2 cm on CT. However, the radiomics feature of the surrounding parenchyma of the nodule did not enhance the effectiveness of the diagnostic model.
Collapse
Affiliation(s)
- Shan Wu
- Department of Radiology, Shanxi Bethune Hospital, 99 Longcheng Street, Taiyuan, Shanxi 030032, China
| | - Na Zhang
- Department of Radiology, Shanxi Bethune Hospital, 99 Longcheng Street, Taiyuan, Shanxi 030032, China
| | - Zhifeng Wu
- Department of Radiology, Shanxi Bethune Hospital, 99 Longcheng Street, Taiyuan, Shanxi 030032, China
| | | | - Linning E
- Department of Radiology, Shanxi Bethune Hospital, 99 Longcheng Street, Taiyuan, Shanxi 030032, China.
| |
Collapse
|
26
|
Meddeb A, Kossen T, Bressem KK, Hamm B, Nagel SN. Evaluation of a Deep Learning Algorithm for Automated Spleen Segmentation in Patients with Conditions Directly or Indirectly Affecting the Spleen. Tomography 2021; 7:950-960. [PMID: 34941650 PMCID: PMC8704906 DOI: 10.3390/tomography7040078] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2021] [Revised: 12/06/2021] [Accepted: 12/07/2021] [Indexed: 12/12/2022] Open
Abstract
The aim of this study was to develop a deep learning-based algorithm for fully automated spleen segmentation using CT images and to evaluate the performance in conditions directly or indirectly affecting the spleen (e.g., splenomegaly, ascites). For this, a 3D U-Net was trained on an in-house dataset (n = 61) including diseases with and without splenic involvement (in-house U-Net), and an open-source dataset from the Medical Segmentation Decathlon (open dataset, n = 61) without splenic abnormalities (open U-Net). Both datasets were split into a training (n = 32.52%), a validation (n = 9.15%) and a testing dataset (n = 20.33%). The segmentation performances of the two models were measured using four established metrics, including the Dice Similarity Coefficient (DSC). On the open test dataset, the in-house and open U-Net achieved a mean DSC of 0.906 and 0.897 respectively (p = 0.526). On the in-house test dataset, the in-house U-Net achieved a mean DSC of 0.941, whereas the open U-Net obtained a mean DSC of 0.648 (p < 0.001), showing very poor segmentation results in patients with abnormalities in or surrounding the spleen. Thus, for reliable, fully automated spleen segmentation in clinical routine, the training dataset of a deep learning-based algorithm should include conditions that directly or indirectly affect the spleen.
Collapse
Affiliation(s)
- Aymen Meddeb
- Charité—Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Klinik für Radiologie, Hindenburgdamm 30, 12203 Berlin, Germany; (K.K.B.); (B.H.); (S.N.N.)
- Correspondence: ; Tel.: +49-30-450-527792
| | - Tabea Kossen
- CLAIM—Charité Lab for AI in Medicine, Charité—Universitätsmedizin Berlin, Augustenburger Platz 1, 13353 Berlin, Germany;
| | - Keno K. Bressem
- Charité—Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Klinik für Radiologie, Hindenburgdamm 30, 12203 Berlin, Germany; (K.K.B.); (B.H.); (S.N.N.)
- Berlin Institute of Health, Charité—Universitätsmedizin Berlin, Charitéplatz 1, 10117 Berlin, Germany
| | - Bernd Hamm
- Charité—Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Klinik für Radiologie, Hindenburgdamm 30, 12203 Berlin, Germany; (K.K.B.); (B.H.); (S.N.N.)
| | - Sebastian N. Nagel
- Charité—Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Klinik für Radiologie, Hindenburgdamm 30, 12203 Berlin, Germany; (K.K.B.); (B.H.); (S.N.N.)
| |
Collapse
|
27
|
Seastedt KP, Moukheiber D, Mahindre SA, Thammineni C, Rosen DT, Watkins AA, Hashimoto DA, Hoang CD, Kpodonu J, Celi LA. A scoping review of artificial intelligence applications in thoracic surgery. Eur J Cardiothorac Surg 2021; 61:239-248. [PMID: 34601587 DOI: 10.1093/ejcts/ezab422] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/01/2021] [Revised: 09/16/2021] [Accepted: 09/16/2021] [Indexed: 02/07/2023] Open
Abstract
OBJECTIVES Machine learning (ML) has great potential, but there are few examples of its implementation improving outcomes. The thoracic surgeon must be aware of pertinent ML literature and how to evaluate this field for the safe translation to patient care. This scoping review provides an introduction to ML applications specific to the thoracic surgeon. We review current applications, limitations and future directions. METHODS A search of the PubMed database was conducted with inclusion requirements being the use of an ML algorithm to analyse patient information relevant to a thoracic surgeon and contain sufficient details on the data used, ML methods and results. Twenty-two papers met the criteria and were reviewed using a methodological quality rubric. RESULTS ML demonstrated enhanced preoperative test accuracy, earlier pathological diagnosis, therapies to maximize survival and predictions of adverse events and survival after surgery. However, only 4 performed external validation. One demonstrated improved patient outcomes, nearly all failed to perform model calibration and one addressed fairness and bias with most not generalizable to different populations. There was a considerable variation to allow for reproducibility. CONCLUSIONS There is promise but also challenges for ML in thoracic surgery. The transparency of data and algorithm design and the systemic bias on which models are dependent remain issues to be addressed. Although there has yet to be widespread use in thoracic surgery, it is essential thoracic surgeons be at the forefront of the eventual safe introduction of ML to the clinic and operating room.
Collapse
Affiliation(s)
- Kenneth P Seastedt
- Department of Surgery, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
| | - Dana Moukheiber
- Laboratory for Computational Physiology, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Saurabh A Mahindre
- Institute for Computational and Data Sciences, University at Buffalo, State University of New York, Buffalo, NY, USA
| | - Chaitanya Thammineni
- HILS Laboratory, University at Buffalo, State University of New York, Buffalo, NY, USA
| | - Darin T Rosen
- Department of Medicine, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
| | - Ammara A Watkins
- Department of Surgery, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
| | - Daniel A Hashimoto
- Surgical AI & Innovation Laboratory, Department of Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Chuong D Hoang
- Thoracic Surgery Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD, USA
| | - Jacques Kpodonu
- Division of Cardiac Surgery, Department of Surgery, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
| | - Leo A Celi
- Division of Pulmonary, Critical Care and Sleep Medicine, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
28
|
Frix AN, Cousin F, Refaee T, Bottari F, Vaidyanathan A, Desir C, Vos W, Walsh S, Occhipinti M, Lovinfosse P, Leijenaar RTH, Hustinx R, Meunier P, Louis R, Lambin P, Guiot J. Radiomics in Lung Diseases Imaging: State-of-the-Art for Clinicians. J Pers Med 2021; 11:602. [PMID: 34202096 DOI: 10.3390/jpm11070602] [Citation(s) in RCA: 29] [Impact Index Per Article: 9.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2021] [Revised: 06/16/2021] [Accepted: 06/21/2021] [Indexed: 12/11/2022] Open
Abstract
Artificial intelligence (AI) has increasingly been serving the field of radiology over the last 50 years. As modern medicine is evolving towards precision medicine, offering personalized patient care and treatment, the requirement for robust imaging biomarkers has gradually increased. Radiomics, a specific method generating high-throughput extraction of a tremendous amount of quantitative imaging data using data-characterization algorithms, has shown great potential in individuating imaging biomarkers. Radiomic analysis can be implemented through the following two methods: hand-crafted radiomic features extraction or deep learning algorithm. Its application in lung diseases can be used in clinical decision support systems, regarding its ability to develop descriptive and predictive models in many respiratory pathologies. The aim of this article is to review the recent literature on the topic, and briefly summarize the interest of radiomics in chest Computed Tomography (CT) and its pertinence in the field of pulmonary diseases, from a clinician's perspective.
Collapse
|
29
|
Giri PC, Chowdhury AM, Bedoya A, Chen H, Lee HS, Lee P, Henriquez C, MacIntyre NR, Huang YCT. Application of Machine Learning in Pulmonary Function Assessment Where Are We Now and Where Are We Going? Front Physiol 2021; 12:678540. [PMID: 34248665 PMCID: PMC8264499 DOI: 10.3389/fphys.2021.678540] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2021] [Accepted: 06/02/2021] [Indexed: 12/24/2022] Open
Abstract
Analysis of pulmonary function tests (PFTs) is an area where machine learning (ML) may benefit clinicians, researchers, and the patients. PFT measures spirometry, lung volumes, and carbon monoxide diffusion capacity of the lung (DLCO). The results are usually interpreted by the clinicians using discrete numeric data according to published guidelines. PFT interpretations by clinicians, however, are known to have inter-rater variability and the inaccuracy can impact patient care. This variability may be caused by unfamiliarity of the guidelines, lack of training, inadequate understanding of lung physiology, or simply mental lapses. A rules-based automated interpretation system can recapitulate expert’s pattern recognition capability and decrease errors. ML can also be used to analyze continuous data or the graphics, including the flow-volume loop, the DLCO and the nitrogen washout curves. These analyses can discover novel physiological biomarkers. In the era of wearables and telehealth, particularly with the COVID-19 pandemic restricting PFTs to be done in the clinical laboratories, ML can also be used to combine mobile spirometry results with an individual’s clinical profile to deliver precision medicine. There are, however, hurdles in the development and commercialization of the ML-assisted PFT interpretation programs, including the need for high quality representative data, the existence of different formats for data acquisition and sharing in PFT software by different vendors, and the need for collaboration amongst clinicians, biomedical engineers, and information technologists. Hurdles notwithstanding, the new developments would represent significant advances that could be the future of PFT, the oldest test still in use in clinical medicine.
Collapse
Affiliation(s)
- Paresh C Giri
- Division of Pulmonary and Critical Care Medicine, Loma Linda University Medical Center, Loma Linda, CA, United States
| | - Anand M Chowdhury
- Division of Pulmonary, Allergy and Critical Care Medicine, Duke University Medical Center, Durham, NC, United States
| | - Armando Bedoya
- Division of Pulmonary, Allergy and Critical Care Medicine, Duke University Medical Center, Durham, NC, United States
| | - Hengji Chen
- Department of Mechanical Engineering and Materials Science, Pratt School of Engineering, Duke University Medical Center, Durham, NC, United States
| | - Hyun Suk Lee
- Hartford HealthCare, Hartford, CT, United States
| | - Patty Lee
- Division of Pulmonary, Allergy and Critical Care Medicine, Duke University Medical Center, Durham, NC, United States
| | - Craig Henriquez
- Department of Mechanical Engineering and Materials Science, Pratt School of Engineering, Duke University Medical Center, Durham, NC, United States
| | - Neil R MacIntyre
- Division of Pulmonary, Allergy and Critical Care Medicine, Duke University Medical Center, Durham, NC, United States
| | - Yuh-Chin T Huang
- Division of Pulmonary, Allergy and Critical Care Medicine, Duke University Medical Center, Durham, NC, United States
| |
Collapse
|
30
|
Cheung HMC, Rubin D. Challenges and opportunities for artificial intelligence in oncological imaging. Clin Radiol 2021; 76:728-736. [PMID: 33902889 DOI: 10.1016/j.crad.2021.03.009] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2020] [Accepted: 03/15/2021] [Indexed: 02/08/2023]
Abstract
Imaging plays a key role in oncology, including the diagnosis and detection of cancer, determining clinical management, assessing treatment response, and complications of treatment or disease. The current use of clinical oncology is predominantly qualitative in nature with some relatively crude size-based measurements of tumours for assessment of disease progression or treatment response; however, it is increasingly understood that there may be significantly more information about oncological disease that can be obtained from imaging that is not currently utilized. Artificial intelligence (AI) has the potential to harness quantitative techniques to improve oncological imaging. These may include improving the efficiency or accuracy of traditional roles of imaging such as diagnosis or detection. These may also include new roles for imaging such as risk-stratifying patients for different types of therapy or determining biological tumour subtypes. This review article outlines several major areas in oncological imaging where there may be opportunities for AI technology. These include (1) screening and detection of cancer, (2) diagnosis and risk stratification, (3) tumour segmentation, (4) precision oncology, and (5) predicting prognosis and assessing treatment response. This review will also address some of the potential barriers to AI research in oncological imaging.
Collapse
Affiliation(s)
- H M C Cheung
- Department of Medical Imaging, Sunnybrook Health Sciences Centre, University of Toronto, Canada
| | - D Rubin
- Department of Radiology, Stanford University, CA, USA.
| |
Collapse
|
31
|
Aggarwal R, Sounderajah V, Martin G, Ting DSW, Karthikesalingam A, King D, Ashrafian H, Darzi A. Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis. NPJ Digit Med 2021; 4:65. [PMID: 33828217 PMCID: PMC8027892 DOI: 10.1038/s41746-021-00438-z] [Citation(s) in RCA: 202] [Impact Index Per Article: 67.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2020] [Accepted: 02/25/2021] [Indexed: 12/19/2022] Open
Abstract
Deep learning (DL) has the potential to transform medical diagnostics. However, the diagnostic accuracy of DL is uncertain. Our aim was to evaluate the diagnostic accuracy of DL algorithms to identify pathology in medical imaging. Searches were conducted in Medline and EMBASE up to January 2020. We identified 11,921 studies, of which 503 were included in the systematic review. Eighty-two studies in ophthalmology, 82 in breast disease and 115 in respiratory disease were included for meta-analysis. Two hundred twenty-four studies in other specialities were included for qualitative review. Peer-reviewed studies that reported on the diagnostic accuracy of DL algorithms to identify pathology using medical imaging were included. Primary outcomes were measures of diagnostic accuracy, study design and reporting standards in the literature. Estimates were pooled using random-effects meta-analysis. In ophthalmology, AUC's ranged between 0.933 and 1 for diagnosing diabetic retinopathy, age-related macular degeneration and glaucoma on retinal fundus photographs and optical coherence tomography. In respiratory imaging, AUC's ranged between 0.864 and 0.937 for diagnosing lung nodules or lung cancer on chest X-ray or CT scan. For breast imaging, AUC's ranged between 0.868 and 0.909 for diagnosing breast cancer on mammogram, ultrasound, MRI and digital breast tomosynthesis. Heterogeneity was high between studies and extensive variation in methodology, terminology and outcome measures was noted. This can lead to an overestimation of the diagnostic accuracy of DL algorithms on medical imaging. There is an immediate need for the development of artificial intelligence-specific EQUATOR guidelines, particularly STARD, in order to provide guidance around key issues in this field.
Collapse
Affiliation(s)
- Ravi Aggarwal
- Institute of Global Health Innovation, Imperial College London, London, UK
| | | | - Guy Martin
- Institute of Global Health Innovation, Imperial College London, London, UK
| | - Daniel S W Ting
- Singapore Eye Research Institute, Singapore National Eye Center, Singapore, Singapore
| | | | - Dominic King
- Institute of Global Health Innovation, Imperial College London, London, UK
| | - Hutan Ashrafian
- Institute of Global Health Innovation, Imperial College London, London, UK.
| | - Ara Darzi
- Institute of Global Health Innovation, Imperial College London, London, UK
| |
Collapse
|
32
|
Calheiros JLL, de Amorim LBV, de Lima LL, de Lima Filho AF, Ferreira Júnior JR, de Oliveira MC. The Effects of Perinodular Features on Solid Lung Nodule Classification. J Digit Imaging 2021; 34:798-810. [PMID: 33791910 DOI: 10.1007/s10278-021-00453-2] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2020] [Revised: 02/11/2021] [Accepted: 03/22/2021] [Indexed: 12/09/2022] Open
Abstract
Lung cancer is the most lethal malignant neoplasm worldwide, with an annual estimated rate of 1.8 million deaths. Computed tomography has been widely used to diagnose and detect lung cancer, but its diagnosis remains an intricate and challenging work, even for experienced radiologists. Computer-aided diagnosis tools and radiomics tools have provided support to the radiologist's decision, acting as a second opinion. The main focus of these tools has been to analyze the intranodular zone; nevertheless, recent works indicate that the interaction between the nodule and its surroundings (perinodular zone) could be relevant to the diagnosis process. However, only a few works have investigated the importance of specific attributes of the perinodular zone and have shown how important they are in the classification of lung nodules. In this context, the purpose of this work is to evaluate the impact of using the perinodular zone on the characterization of lung lesions. Motivated by reproducible research, we used a large public dataset of solid lung nodule images and extracted fine-tuned radiomic attributes from the perinodular and intranodular zones. Our best-evaluated model obtained an average AUC of 0.916, an accuracy of 84.26%, a sensitivity of 84.45%, and specificity of 83.84%. The combination of attributes from the perinodular and intranodular zones in the image characterization resulted in an improvement in all the metrics analyzed when compared to intranodular-only characterization. Therefore, our results highlighted the importance of using the perinodular zone in the solid pulmonary nodules classification process.
Collapse
Affiliation(s)
| | | | - Lucas Lins de Lima
- Computing Institute, Federal University of Alagoas (UFAL), Maceió, AL, Brazil
| | | | | | | |
Collapse
|
33
|
Saberi-Karimian M, Khorasanchi Z, Ghazizadeh H, Tayefi M, Saffar S, Ferns GA, Ghayour-Mobarhan M. Potential value and impact of data mining and machine learning in clinical diagnostics. Crit Rev Clin Lab Sci 2021; 58:275-296. [PMID: 33739235 DOI: 10.1080/10408363.2020.1857681] [Citation(s) in RCA: 37] [Impact Index Per Article: 12.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
Data mining involves the use of mathematical sciences, statistics, artificial intelligence, and machine learning to determine the relationships between variables from a large sample of data. It has previously been shown that data mining can improve the prediction and diagnostic precision of type 2 diabetes mellitus. A few studies have applied machine learning to assess hypertension and metabolic syndrome-related biomarkers, as well as refine the assessment of cardiovascular disease risk. Machine learning methods have also been applied to assess new biomarkers and survival outcomes in patients with renal diseases to predict the development of chronic kidney disease, disease progression, and renal graft survival. In the latter, random forest methods were found to be the best for the prediction of chronic kidney disease. Some studies have investigated the prognosis of nonalcoholic fatty liver disease and acute liver failure, as well as therapy response prediction in patients with viral disorders, using decision tree models. Machine learning techniques, such as Sparse High-Order Interaction Model with Rejection Option, have been used for diagnosing Alzheimer's disease. Data mining techniques have also been applied to identify the risk factors for serious mental illness, such as depression and dementia, and help to diagnose and predict the quality of life of such patients. In relation to child health, some studies have determined the best algorithms for predicting obesity and malnutrition. Machine learning has determined the important risk factors for preterm birth and low birth weight. Published studies of patients with cancer and bacterial diseases are limited and should perhaps be addressed more comprehensively in future studies. Herein, we provide an in-depth review of studies in which biochemical biomarker data were analyzed using machine learning methods to assess the risk of several common diseases, in order to summarize the potential applications of data mining methods in clinical diagnosis. Data mining techniques have now been increasingly applied to clinical diagnostics, and they have the potential to support this field.
Collapse
Affiliation(s)
- Maryam Saberi-Karimian
- International UNESCO Center for Health Related Basic Sciences and Human Nutrition, Mashhad University of Medical Sciences, Mashhad, Iran.,Student Research Committee, Mashhad University of Medical Sciences, Mashhad, Iran
| | - Zahra Khorasanchi
- Department of Nutrition, Faculty of Medicine, Mashhad University of Medical Sciences, Mashhad, Iran
| | - Hamideh Ghazizadeh
- International UNESCO Center for Health Related Basic Sciences and Human Nutrition, Mashhad University of Medical Sciences, Mashhad, Iran.,Student Research Committee, Mashhad University of Medical Sciences, Mashhad, Iran
| | - Maryam Tayefi
- Norwegian Center for e-health Research, University Hospital of North Norway, Tromsø, Norway
| | - Sara Saffar
- International UNESCO Center for Health Related Basic Sciences and Human Nutrition, Mashhad University of Medical Sciences, Mashhad, Iran
| | - Gordon A Ferns
- Division of Medical Education, Brighton and Sussex Medical School, Falmer, UK
| | - Majid Ghayour-Mobarhan
- International UNESCO Center for Health Related Basic Sciences and Human Nutrition, Mashhad University of Medical Sciences, Mashhad, Iran
| |
Collapse
|
34
|
Gu D, Liu G, Xue Z. On the performance of lung nodule detection, segmentation and classification. Comput Med Imaging Graph 2021; 89:101886. [PMID: 33706112 DOI: 10.1016/j.compmedimag.2021.101886] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2020] [Revised: 01/11/2021] [Accepted: 02/02/2021] [Indexed: 01/10/2023]
Abstract
Computed tomography (CT) screening is an effective way for early detection of lung cancer in order to improve the survival rate of such a deadly disease. For more than two decades, image processing techniques such as nodule detection, segmentation, and classification have been extensively studied to assist physicians in identifying nodules from hundreds of CT slices to measure shapes and HU distributions of nodules automatically and to distinguish their malignancy. Thanks to new parallel computation, multi-layer convolution, nonlinear pooling operation, and the big data learning strategy, recent development of deep-learning algorithms has shown great progress in lung nodule screening and computer-assisted diagnosis (CADx) applications due to their high sensitivity and low false positive rates. This paper presents a survey of state-of-the-art deep-learning-based lung nodule screening and analysis techniques focusing on their performance and clinical applications, aiming to help better understand the current performance, the limitation, and the future trends of lung nodule analysis.
Collapse
|
35
|
Ashraf SF, Yin K, Meng CX, Wang Q, Wang Q, Pu J, Dhupar R. Predicting benign, preinvasive, and invasive lung nodules on computed tomography scans using machine learning. J Thorac Cardiovasc Surg 2021; 163:1496-1505.e10. [PMID: 33726909 DOI: 10.1016/j.jtcvs.2021.02.010] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/31/2020] [Revised: 01/28/2021] [Accepted: 02/02/2021] [Indexed: 12/17/2022]
Abstract
OBJECTIVE The study objective was to investigate if machine learning algorithms can predict whether a lung nodule is benign, adenocarcinoma, or its preinvasive subtype from computed tomography images alone. METHODS A dataset of chest computed tomography scans containing lung nodules was collected with their pathologic diagnosis from several sources. The dataset was split randomly into training (70%), internal validation (15%), and independent test sets (15%) at the patient level. Two machine learning algorithms were developed, trained, and validated. The first algorithm used the support vector machine model, and the second used deep learning technology: a convolutional neural network. Receiver operating characteristic analysis was used to evaluate the performance of the classification on the test dataset. RESULTS The support vector machine/convolutional neural network-based models classified nodules into 6 categories resulting in an area under the curve of 0.59/0.65 when differentiating atypical adenomatous hyperplasia versus adenocarcinoma in situ, 0.87/0.86 with minimally invasive adenocarcinoma versus invasive adenocarcinoma, 0.76/0.72 atypical adenomatous hyperplasia + adenocarcinoma in situ versus minimally invasive adenocarcinoma, 0.89/0.87 atypical adenomatous hyperplasia + adenocarcinoma in situ versus minimally invasive adenocarcinoma + invasive adenocarcinoma, and 0.93/0.92 atypical adenomatous hyperplasia + adenocarcinoma in situ + minimally invasive adenocarcinoma versus invasive adenocarcinoma. Classifying benign versus atypical adenomatous hyperplasia + adenocarcinoma in situ + minimally invasive adenocarcinoma versus invasive adenocarcinoma resulted in a micro-average area under the curve of 0.93/0.94 for the support vector machine/convolutional neural network models, respectively. The convolutional neural network-based methods had higher sensitivities than the support vector machine-based methods but lower specificities and accuracies. CONCLUSIONS The machine learning algorithms demonstrated reasonable performance in differentiating benign versus preinvasive versus invasive adenocarcinoma from computed tomography images alone. However, the prediction accuracy varies across its subtypes. This holds the potential for improved diagnostic capabilities with less-invasive means.
Collapse
Affiliation(s)
- Syed Faaz Ashraf
- Department of Cardiothoracic Surgery, University of Pittsburgh School of Medicine, Pittsburgh, Pa
| | - Ke Yin
- Department of Radiology, The Affiliated Zhongshan Hospital of Dalian University, Dalian, China
| | | | - Qi Wang
- Department of Radiology, The Fourth Hospital of Hebei Medical University, Hebei, China
| | - Qiong Wang
- Department of Radiology, The Affiliated Zhongshan Hospital of Dalian University, Dalian, China
| | - Jiantao Pu
- Department of Radiology, University of Pittsburgh, Pittsburgh, Pa; Department of Bioengineering, University of Pittsburgh, Pittsburgh, Pa
| | - Rajeev Dhupar
- Department of Cardiothoracic Surgery, University of Pittsburgh School of Medicine, Pittsburgh, Pa; VA Pittsburgh Healthcare System, Pittsburgh, Pa.
| |
Collapse
|
36
|
Lin X, Jiao H, Pang Z, Chen H, Wu W, Wang X, Xiong L, Chen B, Huang Y, Li S, Li L. Lung Cancer and Granuloma Identification Using a Deep Learning Model to Extract 3-Dimensional Radiomics Features in CT Imaging. Clin Lung Cancer 2021:S1525-7304(21)00027-9. [PMID: 33678583 DOI: 10.1016/j.cllc.2021.02.004] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2020] [Revised: 02/02/2021] [Accepted: 02/02/2021] [Indexed: 12/22/2022]
Abstract
BACKGROUND We aimed to evaluate a deep learning (DL) model combining perinodular and intranodular radiomics features and clinical features for preoperative differentiation of solitary granuloma nodules (GNs) from solid lung cancer nodules in patients with spiculation, lobulation, or pleural indentation on CT. PATIENTS AND METHODS We retrospectively recruited 915 patients with solitary solid pulmonary nodules and suspicious signs of malignancy. Data including clinical characteristics and subjective CT findings were obtained. A 3-dimensional U-Net-based DL model was used for tumor segmentation and extraction of 3-dimensional radiomics features. We used the Maximum Relevance and Minimum Redundancy (mRMR) algorithm and the eXtreme Gradient Boosting (XGBoost) algorithm to select the intranodular, perinodular, and gross nodular radiomics features. We propose a medical image DL (IDL) model, a clinical image DL (CIDL) model, a radiomics DL (RDL) model, and a clinical image radiomics DL (CIRDL) model to preoperatively differentiate GNs from solid lung cancer. Five-fold cross-validation was used to select and evaluate the models. The prediction performance of the models was evaluated using receiver operating characteristic and calibration curves. RESULTS The CIRDL model achieved the best performance in differentiating between GNs and solid lung cancer (area under the curve [AUC] = 0.9069), which was significantly higher compared with the IDL (AUC = 0.8322), CIDL (AUC = 0.8652), intra-RDL (AUC = 0.8583), peri-RDL (AUC = 0.8259), and gross-RDL (AUC = 0.8705) models. CONCLUSION The proposed CIRDL model is a noninvasive diagnostic tool to differentiate between granuloma nodules and solid lung cancer nodules and reduce the need for invasive diagnostic and surgical procedures.
Collapse
|
37
|
Abstract
Lung cancer remains the leading cause of cancer related death world-wide despite advances in treatment. This largely relates to the fact that many of these patients already have advanced diseases at the time of initial diagnosis. As most lung cancers present as nodules initially, an accurate classification of pulmonary nodules as early lung cancers is critical to reducing lung cancer morbidity and mortality. There have been significant recent advances in artificial intelligence (AI) for lung nodule evaluation. Deep learning (DL) and convolutional neural networks (CNNs) have shown promising results in pulmonary nodule detection and have also excelled in segmentation and classification of pulmonary nodules. This review aims to provide an overview of progress that has been made in AI recently for pulmonary nodule detection and characterization with the ultimate goal of lung cancer prediction and classification while outlining some of the pitfalls and challenges that remain to bring such advancements to routine clinical use.
Collapse
Affiliation(s)
| | | | - Chi Wan Koo
- Department of Radiology, Mayo Clinic, Rochester, MN, USA
| |
Collapse
|
38
|
Toumazis I, Bastani M, Han SS, Plevritis SK. Risk-Based lung cancer screening: A systematic review. Lung Cancer 2020; 147:154-186. [DOI: 10.1016/j.lungcan.2020.07.007] [Citation(s) in RCA: 53] [Impact Index Per Article: 13.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2020] [Revised: 07/03/2020] [Accepted: 07/04/2020] [Indexed: 12/17/2022]
|
39
|
Said D, Hectors SJ, Wilck E, Rosen A, Stocker D, Bane O, Beksaç AT, Lewis S, Badani K, Taouli B. Characterization of solid renal neoplasms using MRI-based quantitative radiomics features. Abdom Radiol (NY) 2020; 45:2840-2850. [PMID: 32333073 DOI: 10.1007/s00261-020-02540-4] [Citation(s) in RCA: 24] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
Abstract
PURPOSE To assess the diagnostic value of magnetic resonance imaging (MRI)-based radiomics features using machine learning (ML) models in characterizing solid renal neoplasms, in comparison/combination with qualitative radiologic evaluation. METHODS Retrospective analysis of 125 patients (mean age 59 years, 67% males) with solid renal neoplasms that underwent MRI before surgery. Qualitative (signal and enhancement characteristics) and quantitative radiomics analyses (histogram and texture features) were performed on T2-weighted imaging (WI), T1-WI pre- and post-contrast, and DWI. Mann-Whitney U test and receiver-operating characteristic analysis were used in a training set (n = 88) to evaluate diagnostic performance of qualitative and radiomics features for differentiation of renal cell carcinomas (RCCs) from benign lesions, and characterization of RCC subtypes (clear cell RCC [ccRCC] and papillary RCC [pRCC]). Random forest ML models were developed for discrimination between tumor types on the training set, and validated on an independent set (n = 37). RESULTS We assessed 104 RCCs (51 ccRCC, 29 pRCC, and 24 other subtypes) and 21 benign lesions in 125 patients. Significant qualitative and quantitative radiomics features (area under the curve [AUC] between 0.62 and 0.90) were included for ML analysis. Models with best diagnostic performance on validation sets showed AUC of 0.73 (confidence interval [CI] 0.5-0.96) for differentiating RCC from benign lesions (using combination of qualitative and radiomics features); AUC of 0.77 (CI 0.62-0.92) for diagnosing ccRCC (using radiomics features), and AUC of 0.74 (CI 0.53-0.95) for diagnosing pRCC (using qualitative features). CONCLUSION ML models incorporating MRI-based radiomics features and qualitative radiologic assessment can help characterize renal masses.
Collapse
Affiliation(s)
- Daniela Said
- BioMedical Engineering and Imaging Institute, Icahn School of Medicine at Mount Sinai, New York, NY, USA
- Department of Radiology, Universidad de los Andes, Santiago, Chile
| | - Stefanie J Hectors
- BioMedical Engineering and Imaging Institute, Icahn School of Medicine at Mount Sinai, New York, NY, USA
- Department of Diagnostic, Molecular and Interventional Radiology, Icahn School of Medicine at Mount Sinai, New York, NY, USA
- Department of Radiology, Weill Cornell Medicine, New York, NY, USA
| | - Eric Wilck
- Department of Diagnostic, Molecular and Interventional Radiology, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Ally Rosen
- Department of Diagnostic, Molecular and Interventional Radiology, Icahn School of Medicine at Mount Sinai, New York, NY, USA
- Department of Radiology, Long Island School of Medicine, NYU-Winthrop Hospital, Mineola, NY, USA
| | - Daniel Stocker
- BioMedical Engineering and Imaging Institute, Icahn School of Medicine at Mount Sinai, New York, NY, USA
- Institute of Interventional and Diagnostic Radiology, University Hospital Zurich and University of Zurich, Zurich, Switzerland
| | - Octavia Bane
- BioMedical Engineering and Imaging Institute, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Alp Tuna Beksaç
- Department of Urology, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Sara Lewis
- BioMedical Engineering and Imaging Institute, Icahn School of Medicine at Mount Sinai, New York, NY, USA
- Department of Diagnostic, Molecular and Interventional Radiology, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Ketan Badani
- Department of Urology, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Bachir Taouli
- BioMedical Engineering and Imaging Institute, Icahn School of Medicine at Mount Sinai, New York, NY, USA.
- Department of Diagnostic, Molecular and Interventional Radiology, Icahn School of Medicine at Mount Sinai, New York, NY, USA.
| |
Collapse
|
40
|
Affiliation(s)
- Tobias Peikert
- Division of Pulmonary and Critical Care MedicineMayo ClinicRochester, Minnesota
| | | | - Fabien Maldonado
- Division of Allergy, Pulmonary and Critical Care MedicineVanderbilt University Medical CenterNashville, Tennessee
| |
Collapse
|
41
|
Ohno Y, Aoyagi K, Yaguchi A, Seki S, Ueno Y, Kishida Y, Takenaka D, Yoshikawa T. Differentiation of Benign from Malignant Pulmonary Nodules by Using a Convolutional Neural Network to Determine Volume Change at Chest CT. Radiology 2020; 296:432-443. [DOI: 10.1148/radiol.2020191740] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
|
42
|
Khawaja A, Bartholmai BJ, Rajagopalan S, Karwoski RA, Varghese C, Maldonado F, Peikert T. Do we need to see to believe?-radiomics for lung nodule classification and lung cancer risk stratification. J Thorac Dis 2020; 12:3303-3316. [PMID: 32642254 PMCID: PMC7330769 DOI: 10.21037/jtd.2020.03.105] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
Abstract
Despite multiple recent advances, the diagnosis and management of lung cancer remain challenging and it continues to be the deadliest malignancy. In 2011, the National Lung Screening Trial (NLST) reported 20% reduction in lung cancer related mortality using annual low dose chest computed tomography (CT). These results led to the approval and nationwide establishment of lung cancer CT-based lung cancer screening programs. These findings have been further validated by the recently published Nederlands-Leuvens Longkanker Screenings Onderzoek (NELSON) and Multicentric Italian Lung Detection (MILD) trials, the latter showing benefit of screening even beyond the 5 years. However, the implementation of lung cancer screening has been impeded by several challenges, including the differentiation between benign and malignant nodules, the large number of false positive studies and the detection of indolent, potentially clinically insignificant lung cancers (overdiagnosis). Hence, the development of non-invasive strategies to accurately classify and risk stratify screen-detected pulmonary nodules in order to individualize clinical management remains a high priority area of research. Radiomics is a recently coined term which refers to the process of imaging feature extraction and quantitative analysis of clinical diagnostic images to characterize the nodule phenotype beyond what is possible with conventional radiologist assessment. Even though it is still in early phase, several studies have already demonstrated that radiomics approaches are potentially useful for lung nodule classification, risk stratification, individualized management and prediction of overall prognosis. The goal of this review is to summarize the current literature regarding the radiomics of screen-detected lung nodules, highlight potential challenges and discuss its clinical application along with future goals and challenges.
Collapse
Affiliation(s)
- Ali Khawaja
- Divison of Pulmonary and Critical Care Medicine, Mayo Clinic, Rochester, MN, USA
| | | | | | | | - Cyril Varghese
- Divison of Pulmonary and Critical Care Medicine, Mayo Clinic, Rochester, MN, USA
| | - Fabien Maldonado
- Division of Pulmonary and Critical Care Medicine, Vanderbilt University, Nashville, TN, USA
| | - Tobias Peikert
- Divison of Pulmonary and Critical Care Medicine, Mayo Clinic, Rochester, MN, USA
| |
Collapse
|
43
|
|
44
|
Abstract
Machine learning (ML) is a discipline of computer science in which statistical methods are applied to data in order to classify, predict, or optimize, based on previously observed data. Pulmonary and critical care medicine have seen a surge in the application of this methodology, potentially delivering improvements in our ability to diagnose, treat, and better understand a multitude of disease states. Here we review the literature and provide a detailed overview of the recent advances in ML as applied to these areas of medicine. In addition, we discuss both the significant benefits of this work as well as the challenges in the implementation and acceptance of this non-traditional methodology for clinical purposes.
Collapse
Affiliation(s)
- Eric Mlodzinski
- Department of Internal Medicine, Beth Israel Deaconess Medical Center, Boston, MA, 02215, USA.
| | - David J Stone
- MIT Critical Data, Laboratory for Computational Physiology, Harvard-MIT Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA.,Departments of Anesthesiology and Neurosurgery, University of Virginia School of Medicine, Charlottesville, VA, 22908, USA.,Center for Advanced Medical Analytics, University of Virginia School of Medicine, Charlottesville, VA, 22908, USA
| | - Leo A Celi
- MIT Critical Data, Laboratory for Computational Physiology, Harvard-MIT Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA.,Division of Pulmonary Critical Care and Sleep Medicine, Beth Israel Deaconess Medical Center, Boston, MA, 02215, USA
| |
Collapse
|
45
|
Delzell DAP, Magnuson S, Peter T, Smith M, Smith BJ. Machine Learning and Feature Selection Methods for Disease Classification With Application to Lung Cancer Screening Image Data. Front Oncol 2019; 9:1393. [PMID: 31921650 PMCID: PMC6917601 DOI: 10.3389/fonc.2019.01393] [Citation(s) in RCA: 36] [Impact Index Per Article: 7.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2019] [Accepted: 11/26/2019] [Indexed: 12/31/2022] Open
Abstract
As awareness of the habits and risks associated with lung cancer has increased, so has the interest in promoting and improving upon lung cancer screening procedures. Recent research demonstrates the benefits of lung cancer screening; the National Lung Screening Trial (NLST) found as its primary result that preventative screening significantly decreases the death rate for patients battling lung cancer. However, it was also noted that the false positive rate was very high (>94%).In this work, we investigated the ability of various machine learning classifiers to accurately predict lung cancer nodule status while also considering the associated false positive rate. We utilized 416 quantitative imaging biomarkers taken from CT scans of lung nodules from 200 patients, where the nodules had been verified as cancerous or benign. These imaging biomarkers were created from both nodule and parenchymal tissue. A variety of linear, nonlinear, and ensemble predictive classifying models, along with several feature selection methods, were used to classify the binary outcome of malignant or benign status. Elastic net and support vector machine, combined with either a linear combination or correlation feature selection method, were some of the best-performing classifiers (average cross-validation AUC near 0.72 for these models), while random forest and bagged trees were the worst performing classifiers (AUC near 0.60). For the best performing models, the false positive rate was near 30%, notably lower than that reported in the NLST.The use of radiomic biomarkers with machine learning methods are a promising diagnostic tool for tumor classification. The have the potential to provide good classification and simultaneously reduce the false positive rate.
Collapse
Affiliation(s)
- Darcie A P Delzell
- Department of Mathematics and Computer Science, Wheaton College, Wheaton, IL, United States
| | - Sara Magnuson
- Department of Mathematics and Computer Science, Wheaton College, Wheaton, IL, United States
| | - Tabitha Peter
- Department of Mathematics and Computer Science, Wheaton College, Wheaton, IL, United States
| | - Michelle Smith
- Department of Mathematics and Computer Science, Wheaton College, Wheaton, IL, United States
| | - Brian J Smith
- Department of Biostatistics, University of Iowa, Iowa City, IA, United States
| |
Collapse
|
46
|
Uthoff J, Nagpal P, Sanchez R, Gross TJ, Lee C, Sieren JC. Differentiation of non-small cell lung cancer and histoplasmosis pulmonary nodules: insights from radiomics model performance compared with clinician observers. Transl Lung Cancer Res 2019; 8:979-988. [PMID: 32010576 DOI: 10.21037/tlcr.2019.12.19] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/29/2022]
Abstract
Background Histoplasmosis pulmonary nodules often present in computed tomography (CT) imaging with characteristics suspicious for lung cancer. This presents a work-up decision issue for clinicians in regions where histoplasmosis is an endemic fungal infection, when a nodule suspicious for lung cancer is detected. We hypothesize the application of radiomic features extracted from pulmonary nodules and perinodular parenchyma could accurately distinguish between suspicious histoplasmosis lung nodules and non-small cell lung cancer (NSCLC). Methods A retrospective clinical cohort of pulmonary nodules with a confirmed diagnosis of histoplasmosis or NSCLC was collected from the University of Iowa Hospitals and Clincs. Radiomic features were extracted describing characteristics of the nodule and perinodular parenchyma regions and used to build a machine learning tool. These cases were assessed by four expert clinicians who gave a blinded risk prediction for NSCLC. Tool and observer performance were assessed by calculating the area under the curve for the receiver operating characteristic (AUC-ROC) and interclass correlation coefficient (ICC). Results A cohort of 71 subjects with confirmed histopathology (40 NSCLC, 31 histoplasmosis) were case-matched based on age, sex, and smoking history. Superior performance (AUC-ROC =0.89) was demonstrated using leave-one-subject out validation in the tool that incorporated radiomics from the nodule and perinodular parenchyma region extended to 100% nodule diameter. Observers had perfect intra-repeatability (ICC =1.0) and demonstrated fair inter-reader variability (ICC =0.52). Conclusions Radiomics have potential utility in the challenging task of differentiation between lung cancer and histoplasmosis. Expert clinician readers have high intra-repeatability but demonstrated inter-reader variability which could provide context for a supplemental radiomics-based tool.
Collapse
Affiliation(s)
- Johanna Uthoff
- Department of Biomedical Engineering, University of Iowa, Iowa City, IA, USA.,Department of Radiology, University of Iowa Hospitals and Clinics, Iowa City, IA, USA
| | - Prashant Nagpal
- Department of Radiology, University of Iowa Hospitals and Clinics, Iowa City, IA, USA
| | - Rolando Sanchez
- Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, University of Iowa Hospitals and Clinics, Iowa City, IA, USA
| | - Thomas J Gross
- Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, University of Iowa Hospitals and Clinics, Iowa City, IA, USA
| | - Changhyun Lee
- Department of Radiology, University of Iowa Hospitals and Clinics, Iowa City, IA, USA.,Department of Radiology, College of Medicine, Seoul National University, Seoul, South Korea
| | - Jessica C Sieren
- Department of Biomedical Engineering, University of Iowa, Iowa City, IA, USA.,Department of Radiology, University of Iowa Hospitals and Clinics, Iowa City, IA, USA
| |
Collapse
|
47
|
Murphy A, Liszewski B. Artificial Intelligence and the Medical Radiation Profession: How Our Advocacy Must Inform Future Practice. J Med Imaging Radiat Sci 2019; 50:S15-S19. [DOI: 10.1016/j.jmir.2019.09.001] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2019] [Revised: 08/28/2019] [Accepted: 09/03/2019] [Indexed: 02/06/2023]
|
48
|
Baek S, He Y, Allen BG, Buatti JM, Smith BJ, Tong L, Sun Z, Wu J, Diehn M, Loo BW, Plichta KA, Seyedin SN, Gannon M, Cabel KR, Kim Y, Wu X. Deep segmentation networks predict survival of non-small cell lung cancer. Sci Rep 2019; 9:17286. [PMID: 31754135 PMCID: PMC6872742 DOI: 10.1038/s41598-019-53461-2] [Citation(s) in RCA: 49] [Impact Index Per Article: 9.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2019] [Accepted: 10/31/2019] [Indexed: 12/11/2022] Open
Abstract
Non-small-cell lung cancer (NSCLC) represents approximately 80-85% of lung cancer diagnoses and is the leading cause of cancer-related death worldwide. Recent studies indicate that image-based radiomics features from positron emission tomography/computed tomography (PET/CT) images have predictive power for NSCLC outcomes. To this end, easily calculated functional features such as the maximum and the mean of standard uptake value (SUV) and total lesion glycolysis (TLG) are most commonly used for NSCLC prognostication, but their prognostic value remains controversial. Meanwhile, convolutional neural networks (CNN) are rapidly emerging as a new method for cancer image analysis, with significantly enhanced predictive power compared to hand-crafted radiomics features. Here we show that CNNs trained to perform the tumor segmentation task, with no other information than physician contours, identify a rich set of survival-related image features with remarkable prognostic value. In a retrospective study on pre-treatment PET-CT images of 96 NSCLC patients before stereotactic-body radiotherapy (SBRT), we found that the CNN segmentation algorithm (U-Net) trained for tumor segmentation in PET and CT images, contained features having strong correlation with 2- and 5-year overall and disease-specific survivals. The U-Net algorithm has not seen any other clinical information (e.g. survival, age, smoking history, etc.) than the images and the corresponding tumor contours provided by physicians. In addition, we observed the same trend by validating the U-Net features against an extramural data set provided by Stanford Cancer Institute. Furthermore, through visualization of the U-Net, we also found convincing evidence that the regions of metastasis and recurrence appear to match with the regions where the U-Net features identified patterns that predicted higher likelihoods of death. We anticipate our findings will be a starting point for more sophisticated non-intrusive patient specific cancer prognosis determination. For example, the deep learned PET/CT features can not only predict survival but also visualize high-risk regions within or adjacent to the primary tumor and hence potentially impact therapeutic outcomes by optimal selection of therapeutic strategy or first-line therapy adjustment.
Collapse
Affiliation(s)
- Stephen Baek
- University of Iowa, Department of Industrial and Systems Engineering, Iowa City, IA, 52242, United States
- University of Iowa, Department of Radiation Oncology, Iowa City, IA, 52242, United States
- University of Iowa, Department of Electrical and Computer Engineering, Iowa City, IA, 52242, United States
| | - Yusen He
- University of Iowa, Department of Industrial and Systems Engineering, Iowa City, IA, 52242, United States
| | - Bryan G Allen
- University of Iowa, Department of Radiation Oncology, Iowa City, IA, 52242, United States
| | - John M Buatti
- University of Iowa, Department of Radiation Oncology, Iowa City, IA, 52242, United States
| | - Brian J Smith
- University of Iowa, Department of Biostatistics, Iowa City, IA, 52242, United States
| | - Ling Tong
- University of Iowa, Department of Business Analytics, Iowa City, IA, 52242, United States
| | - Zhiyu Sun
- University of Iowa, Department of Industrial and Systems Engineering, Iowa City, IA, 52242, United States
| | - Jia Wu
- Stanford University, Stanford Cancer Institute, Palo Alto, CA, 94304, United States
| | - Maximilian Diehn
- Stanford University, Stanford Cancer Institute, Palo Alto, CA, 94304, United States
| | - Billy W Loo
- Stanford University, Stanford Cancer Institute, Palo Alto, CA, 94304, United States
| | - Kristin A Plichta
- University of Iowa, Department of Radiation Oncology, Iowa City, IA, 52242, United States
| | - Steven N Seyedin
- University of Iowa, Department of Radiation Oncology, Iowa City, IA, 52242, United States
| | - Maggie Gannon
- University of Iowa, Department of Radiation Oncology, Iowa City, IA, 52242, United States
| | - Katherine R Cabel
- University of Iowa, Department of Radiation Oncology, Iowa City, IA, 52242, United States
| | - Yusung Kim
- University of Iowa, Department of Radiation Oncology, Iowa City, IA, 52242, United States.
| | - Xiaodong Wu
- University of Iowa, Department of Radiation Oncology, Iowa City, IA, 52242, United States.
- University of Iowa, Department of Electrical and Computer Engineering, Iowa City, IA, 52242, United States.
| |
Collapse
|
49
|
Lovejoy CA, Phillips E, Maruthappu M. Application of artificial intelligence in respiratory medicine: Has the time arrived? Respirology 2019; 24:1136-1137. [DOI: 10.1111/resp.13676] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2019] [Accepted: 07/29/2019] [Indexed: 12/30/2022]
Affiliation(s)
- Christopher A. Lovejoy
- Emergency Department, St George's Hospital, St George's University Hospitals NHS Foundation Trust London UK
- Cera Care London UK
| | - Edward Phillips
- Department of Medicine, Northwick Park Hospital, London Northwest University Healthcare NHS Trust London UK
| | | |
Collapse
|