1
|
Gouravani M, Shahrabi Farahani M, Salehi MA, Shojaei S, Mirakhori S, Harandi H, Mohammadi S, Saleh RR. Diagnostic performance of artificial intelligence in detection of renal cell carcinoma: a systematic review and meta-analysis. BMC Cancer 2025; 25:155. [PMID: 39871201 PMCID: PMC11773916 DOI: 10.1186/s12885-025-13547-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2024] [Accepted: 01/17/2025] [Indexed: 01/29/2025] Open
Abstract
OBJECTIVES The detection of renal cell carcinoma (RCC) tumors in the earlier stages is of great importance for more effective treatment. Encouraged by the key role of imaging in the management of RCC, we conducted a systematic review and meta-analysis of the studies that made use of artificial intelligence (AI) for the detection of RCC to quantitatively determine the performance of AI for distinguishing related renal lesions. MATERIALS AND METHODS PubMed, Scopus, CENTRAL, and Embase electronic databases were systematically searched in November 2024 to identify studies that applied AI for the detection or classification of RCC. We conducted a meta-analysis to evaluate the diagnostic performance of utilized algorithms. Moreover, meta-regression was conducted over suspected covariates to evaluate potential sources of inter-study heterogeneity. Publication bias and quality assessment were also done for the included studies. RESULTS Sixty-four studies were included in this systematic review, of which 31 studies were selected for meta-analysis. The studies assessing algorithms' performance on internal validation showed pooled sensitivity and specificity of 85% (95% confidence interval [CI], 82 to 87) and 76% (95% CI, 70 to 80), respectively. Moreover, externally validated Al algorithms had a pooled sensitivity and specificity of 80% (95% CI, 73 to 84) and 90% (95% CI, 84 to 93), respectively. Studies that performed internal validation for clinician performance had a pooled sensitivity of 79% (95% CI, 72 to 85) and specificity of 60% (95% CI, 49 to 70). CONCLUSION The findings of the present study validate the acceptable performance of AI algorithms when contrasted with medical professionals in the identification and categorization of RCC. Nevertheless, the presence of heterogeneity between studies and the absence of coherence in the results underscore the necessity for the cautious interpretation of these results and additional prospective studies.
Collapse
Affiliation(s)
- Mahdi Gouravani
- Musculoskeletal Imaging Research Center (MIRC), Tehran University of Medical Sciences, Tehran, Iran
| | | | - Mohammad Amin Salehi
- School of Medicine, Tehran University of Medical Sciences, Dr. Qarib St, Keshavarz Blvd, Tehran, 14194, Iran.
| | - Shayan Shojaei
- School of Medicine, Tehran University of Medical Sciences, Dr. Qarib St, Keshavarz Blvd, Tehran, 14194, Iran
| | - Sina Mirakhori
- Faculty of Medicine, Tabriz University of Medical Sciences, Tabriz, Iran
| | - Hamid Harandi
- School of Medicine, Tehran University of Medical Sciences, Dr. Qarib St, Keshavarz Blvd, Tehran, 14194, Iran
| | - Soheil Mohammadi
- Mallinckrodt Institute of Radiology, Washington University in St. Louis, Saint Louis, USA
| | - Ramy R Saleh
- Department of Oncology, McGill University, Montreal, QC, H3A 0G4, Canada
- Division of Medical Oncology, McGill University Health Centre, Montreal, QC, H4A 3J1, Canada
| |
Collapse
|
2
|
Qian L, Fu B, He H, Liu S, Lu R. CECT-Based Radiomic Nomogram of Different Machine Learning Models for Differentiating Malignant and Benign Solid-Containing Renal Masses. J Multidiscip Healthc 2025; 18:421-433. [PMID: 39881821 PMCID: PMC11776415 DOI: 10.2147/jmdh.s502210] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2024] [Accepted: 01/20/2025] [Indexed: 01/31/2025] Open
Abstract
Objective This study aimed to explore the value of a radiomic nomogram based on contrast-enhanced computed tomography (CECT) for differentiating benign and malignant solid-containing renal masses. Materials and Methods A total of 122 patients with pathologically confirmed benign (n=47) or malignant (n=75) solid-containing renal masses were enrolled in this study. Radiomic features were extracted from the arterial, venous and delayed phases and further analysed by dimensionality reduction and selection. Four mainstream machine learning algorithm training models, namely, support vector machine (SVM), k-nearest neighbour (kNN), light gradient boosting (LightGBM) and logistic regression (LR), were constructed to determine the best classifier model. Univariate and multivariate analyses were used to determine the best clinical characteristics for constructing a clinical model. The radiomic and clinical signatures were integrated to construct a combined radiomic nomogram model. Receiver operating characteristic (ROC) curves and the area under the curve (AUC) were used to evaluate the performance of the radiomic nomogram, radiomic signature, and clinical model. Results Thirteen radiomic features were selected for the development of the radiomic signature. Among the various radiomic models, the LR model demonstrated superior predictive efficiency and robustness, yielding an AUC of 0.952 in the training cohort and 0.887 in the test cohort. The AUC for the clinical model was 0.854 in the training cohort and 0.747 in the test cohort. Furthermore, the radiomic nomogram, which incorporated sex, age, alcohol consumption history, and the radiomic signature, exhibited excellent discriminative performance, yielding an AUC of 0.973 in the training cohort and 0.900 in the test cohort. Conclusion The radiomic nomogram based on CECT offers a promising and noninvasive approach for distinguishing malignant from benign solid renal masses. This tool can be used to guide treatment strategies effectively and can provide valuable insights for clinicians.
Collapse
Affiliation(s)
- Lu Qian
- Department of Pathology, the First People’s Hospital of Yunnan Province, The Affiliated Hospital of Kunming University of Science and Technology, Kunming, Yunnan, 650032, People’s Republic of China
| | - BinHai Fu
- Department of Nuclear Medicine, The First People’s Hospital of Yunnan Province, the Affiliated Hospital of Kunming University of Science and Technology, Kunming, Yunnan, 650032, People’s Republic of China
| | - Hong He
- Department of Nuclear Medicine, The First People’s Hospital of Yunnan Province, the Affiliated Hospital of Kunming University of Science and Technology, Kunming, Yunnan, 650032, People’s Republic of China
| | - Shan Liu
- Department of Pathology, the First People’s Hospital of Yunnan Province, The Affiliated Hospital of Kunming University of Science and Technology, Kunming, Yunnan, 650032, People’s Republic of China
| | - RenCai Lu
- Department of Nuclear Medicine, The First People’s Hospital of Yunnan Province, the Affiliated Hospital of Kunming University of Science and Technology, Kunming, Yunnan, 650032, People’s Republic of China
| |
Collapse
|
3
|
Reis EP, Blankemeier L, Zambrano Chaves JM, Jensen MEK, Yao S, Truyts CAM, Willis MH, Adams S, Amaro E, Boutin RD, Chaudhari AS. Automated abdominal CT contrast phase detection using an interpretable and open-source artificial intelligence algorithm. Eur Radiol 2024; 34:6680-6687. [PMID: 38683384 PMCID: PMC11456344 DOI: 10.1007/s00330-024-10769-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2023] [Revised: 03/11/2024] [Accepted: 03/20/2024] [Indexed: 05/01/2024]
Abstract
OBJECTIVES To develop and validate an open-source artificial intelligence (AI) algorithm to accurately detect contrast phases in abdominal CT scans. MATERIALS AND METHODS Retrospective study aimed to develop an AI algorithm trained on 739 abdominal CT exams from 2016 to 2021, from 200 unique patients, covering 1545 axial series. We performed segmentation of five key anatomic structures-aorta, portal vein, inferior vena cava, renal parenchyma, and renal pelvis-using TotalSegmentator, a deep learning-based tool for multi-organ segmentation, and a rule-based approach to extract the renal pelvis. Radiomics features were extracted from the anatomical structures for use in a gradient-boosting classifier to identify four contrast phases: non-contrast, arterial, venous, and delayed. Internal and external validation was performed using the F1 score and other classification metrics, on the external dataset "VinDr-Multiphase CT". RESULTS The training dataset consisted of 172 patients (mean age, 70 years ± 8, 22% women), and the internal test set included 28 patients (mean age, 68 years ± 8, 14% women). In internal validation, the classifier achieved an accuracy of 92.3%, with an average F1 score of 90.7%. During external validation, the algorithm maintained an accuracy of 90.1%, with an average F1 score of 82.6%. Shapley feature attribution analysis indicated that renal and vascular radiodensity values were the most important for phase classification. CONCLUSION An open-source and interpretable AI algorithm accurately detects contrast phases in abdominal CT scans, with high accuracy and F1 scores in internal and external validation, confirming its generalization capability. CLINICAL RELEVANCE STATEMENT Contrast phase detection in abdominal CT scans is a critical step for downstream AI applications, deploying algorithms in the clinical setting, and for quantifying imaging biomarkers, ultimately allowing for better diagnostics and increased access to diagnostic imaging. KEY POINTS Digital Imaging and Communications in Medicine labels are inaccurate for determining the abdominal CT scan phase. AI provides great help in accurately discriminating the contrast phase. Accurate contrast phase determination aids downstream AI applications and biomarker quantification.
Collapse
Affiliation(s)
- Eduardo Pontes Reis
- Department of Radiology, Stanford University, Stanford, CA, USA.
- Center for Artificial Intelligence in Medicine & Imaging (AIMI), Stanford University, Stanford, CA, USA.
- Hospital Israelita Albert Einstein, Sao Paulo, Brazil.
| | - Louis Blankemeier
- Department of Electrical Engineering, Stanford University, Stanford, CA, USA
| | - Juan Manuel Zambrano Chaves
- Department of Radiology, Stanford University, Stanford, CA, USA
- Department of Biomedical Data Science, Stanford University, Stanford, CA, USA
| | | | - Sally Yao
- Department of Radiology, Stanford University, Stanford, CA, USA
| | | | - Marc H Willis
- Department of Radiology, Stanford University, Stanford, CA, USA
| | - Scott Adams
- Department of Radiology, Stanford University, Stanford, CA, USA
| | - Edson Amaro
- Hospital Israelita Albert Einstein, Sao Paulo, Brazil
| | - Robert D Boutin
- Department of Radiology, Stanford University, Stanford, CA, USA
| | - Akshay S Chaudhari
- Department of Radiology, Stanford University, Stanford, CA, USA
- Department of Biomedical Data Science, Stanford University, Stanford, CA, USA
| |
Collapse
|
4
|
Alzu'bi D, Abdullah M, Hmeidi I, AlAzab R, Gharaibeh M, El-Heis M, Almotairi KH, Forestiero A, Hussein AM, Abualigah L. Kidney Tumor Detection and Classification Based on Deep Learning Approaches: A New Dataset in CT Scans. JOURNAL OF HEALTHCARE ENGINEERING 2022; 2022:3861161. [PMID: 37323471 PMCID: PMC10266909 DOI: 10.1155/2022/3861161] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/17/2022] [Accepted: 09/15/2022] [Indexed: 09/01/2023]
Abstract
Kidney tumor (KT) is one of the diseases that have affected our society and is the seventh most common tumor in both men and women worldwide. The early detection of KT has significant benefits in reducing death rates, producing preventive measures that reduce effects, and overcoming the tumor. Compared to the tedious and time-consuming traditional diagnosis, automatic detection algorithms of deep learning (DL) can save diagnosis time, improve test accuracy, reduce costs, and reduce the radiologist's workload. In this paper, we present detection models for diagnosing the presence of KTs in computed tomography (CT) scans. Toward detecting and classifying KT, we proposed 2D-CNN models; three models are concerning KT detection such as a 2D convolutional neural network with six layers (CNN-6), a ResNet50 with 50 layers, and a VGG16 with 16 layers. The last model is for KT classification as a 2D convolutional neural network with four layers (CNN-4). In addition, a novel dataset from the King Abdullah University Hospital (KAUH) has been collected that consists of 8,400 images of 120 adult patients who have performed CT scans for suspected kidney masses. The dataset was divided into 80% for the training set and 20% for the testing set. The accuracy results for the detection models of 2D CNN-6 and ResNet50 reached 97%, 96%, and 60%, respectively. At the same time, the accuracy results for the classification model of the 2D CNN-4 reached 92%. Our novel models achieved promising results; they enhance the diagnosis of patient conditions with high accuracy, reducing radiologist's workload and providing them with a tool that can automatically assess the condition of the kidneys, reducing the risk of misdiagnosis. Furthermore, increasing the quality of healthcare service and early detection can change the disease's track and preserve the patient's life.
Collapse
Affiliation(s)
- Dalia Alzu'bi
- Department of Computer Information Systems, Jordan University of Science and Technology, Irbid 2210, Jordan
| | - Malak Abdullah
- Department of Computer Information Systems, Jordan University of Science and Technology, Irbid 2210, Jordan
| | - Ismail Hmeidi
- Department of Computer Information Systems, Jordan University of Science and Technology, Irbid 2210, Jordan
| | - Rami AlAzab
- Department of General Surgery and Urology, University of Science and Technology, Irbid 22110, Jordan
| | - Maha Gharaibeh
- Department of Diagnostic and Interventional Radiology, Faculty of Medicine, Jordan University of Science and Technology, Irbid 2210, Jordan
| | - Mwaffaq El-Heis
- Department of Diagnostic and Interventional Radiology, Faculty of Medicine, Jordan University of Science and Technology, Irbid 2210, Jordan
| | - Khaled H. Almotairi
- Computer Engineering Department, Computer and Information Systems College, Umm Al-Qura University, Makkah 21955, Saudi Arabia
| | - Agostino Forestiero
- Institute for High Performance Computing and Networking, CNR, Rende (CS), Italy
| | - Ahmad MohdAziz Hussein
- Deanship of E-Learning and Distance Education, Umm Al-Qura University, Makkah 21955, Saudi Arabia
| | - Laith Abualigah
- Hourani Center for Applied Scientific Research, Al-Ahliyya Amman University, Amman 19328, Jordan
- Faculty of Information Technology, Middle East University, Amman 11831, Jordan
- School of Computer Sciences, Universiti Sains Malaysia, Pulau Pinang 11800, Malaysia
| |
Collapse
|
5
|
Shamija Sherryl RMR, Jaya T. Semantic Multiclass Segmentation and Classification of Kidney Lesions. Neural Process Lett 2022. [DOI: 10.1007/s11063-022-11034-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/10/2022]
|
6
|
Radiology Imaging Scans for Early Diagnosis of Kidney Tumors: A Review of Data Analytics-Based Machine Learning and Deep Learning Approaches. BIG DATA AND COGNITIVE COMPUTING 2022. [DOI: 10.3390/bdcc6010029] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/26/2022]
Abstract
Plenty of disease types exist in world communities that can be explained by humans’ lifestyles or the economic, social, genetic, and other factors of the country of residence. Recently, most research has focused on studying common diseases in the population to reduce death risks, take the best procedure for treatment, and enhance the healthcare level of the communities. Kidney Disease is one of the common diseases that have affected our societies. Sectionicularly Kidney Tumors (KT) are the 10th most prevalent tumor for men and women worldwide. Overall, the lifetime likelihood of developing a kidney tumor for males is about 1 in 466 (2.02 percent) and it is around 1 in 80 (1.03 percent) for females. Still, more research is needed on new diagnostic, early, and innovative methods regarding finding an appropriate treatment method for KT. Compared to the tedious and time-consuming traditional diagnosis, automatic detection algorithms of machine learning can save diagnosis time, improve test accuracy, and reduce costs. Previous studies have shown that deep learning can play a role in dealing with complex tasks, diagnosis and segmentation, and classification of Kidney Tumors, one of the most malignant tumors. The goals of this review article on deep learning in radiology imaging are to summarize what has already been accomplished, determine the techniques used by the researchers in previous years in diagnosing Kidney Tumors through medical imaging, and identify some promising future avenues, whether in terms of applications or technological developments, as well as identifying common problems, describing ways to expand the data set, summarizing the knowledge and best practices, and determining remaining challenges and future directions.
Collapse
|
7
|
Lim CS, Abreu-Gomez J, Thornhill R, James N, Al Kindi A, Lim AS, Schieda N. Utility of machine learning of apparent diffusion coefficient (ADC) and T2-weighted (T2W) radiomic features in PI-RADS version 2.1 category 3 lesions to predict prostate cancer diagnosis. Abdom Radiol (NY) 2021; 46:5647-5658. [PMID: 34467426 DOI: 10.1007/s00261-021-03235-0] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2021] [Revised: 07/31/2021] [Accepted: 07/31/2021] [Indexed: 12/22/2022]
Abstract
PURPOSE To evaluate if machine learning (ML) of radiomic features extracted from apparent diffusion coefficient (ADC) and T2-weighted (T2W) MRI can predict prostate cancer (PCa) diagnosis in Prostate Imaging-Reporting and Data System (PI-RADS) version 2.1 category 3 lesions. METHODS This multi-institutional review board-approved retrospective case-control study evaluated 158 men with 160 PI-RADS category 3 lesions (79 peripheral zone, 81 transition zone) diagnosed at 3-Tesla MRI with histopathology diagnosis by MRI-TRUS-guided targeted biopsy. A blinded radiologist confirmed PI-RADS v2.1 score and segmented lesions on axial T2W and ADC images using 3D Slicer, extracting radiomic features with an open-source software (Pyradiomics). Diagnostic accuracy for (1) any PCa and (2) clinically significant (CS; International Society of Urogenital Pathology Grade Group ≥ 2) PCa was assessed using XGBoost with tenfold cross -validation. RESULTS From 160 PI-RADS 3 lesions, there were 50.0% (80/160) PCa, including 36.3% (29/80) CS-PCa (63.8% [51/80] ISUP 1, 23.8% [19/80] ISUP 2, 8.8% [7/80] ISUP 3, 3.8% [3/80] ISUP 4). The remaining 50.0% (80/160) lesions were benign. ML of all radiomic features from T2W and ADC achieved area under receiver operating characteristic curve (AUC) for diagnosis of (1) CS-PCa 0.547 (95% Confidence Intervals 0.510-0.584) for T2W and 0.684 (CI 0.652-0.715) for ADC and (2) any PCa 0.608 (CI 0.579-0.636) for T2W and 0.642 (CI 0.614-0.0.670) for ADC. CONCLUSION Our results indicate ML of radiomic features extracted from T2W and ADC achieved at best moderate accuracy for determining which PI-RADS category 3 lesions represent PCa.
Collapse
Affiliation(s)
- Christopher S Lim
- Department of Medical Imaging, Sunnybrook Health Sciences Centre, University of Toronto, 2075 Bayview Avenue, Rm AB 279, Toronto, ON, M4N 3M5, Canada.
| | - Jorge Abreu-Gomez
- Department of Medical Imaging, Sunnybrook Health Sciences Centre, University of Toronto, Toronto, ON, Canada
- Department of Medical Imaging, Joint Department of Medical Imaging, University of Toronto, 585 University Avenue PMB-298, Toronto, ON, M5G2N2, Canada
| | - Rebecca Thornhill
- Department of Medical Imaging, The Ottawa Hospital, The University of Ottawa, 1053 Carling Ave, Civic Campus C1, Ottawa, ON, K1Y 4E9, Canada
| | - Nick James
- Software Solutions, The Ottawa Hospital, Ottawa, Canada
| | - Ahmed Al Kindi
- Department of Medical Imaging, Sunnybrook Health Sciences Centre, University of Toronto, 2075 Bayview Avenue, Rm AB 279, Toronto, ON, M4N 3M5, Canada
| | - Andrew S Lim
- Department of Radiation Oncology, Seattle Cancer Care Alliance, University of Washington, 825 Eastlake Ave. E, Seattle Washington, 98109-1023, USA
| | - Nicola Schieda
- Department of Medical Imaging, The Ottawa Hospital, The University of Ottawa, 1053 Carling Ave, Civic Campus C1, Ottawa, ON, K1Y 4E9, Canada
| |
Collapse
|
8
|
Hussain MA, Hamarneh G, Garbi R. Learnable image histograms-based deep radiomics for renal cell carcinoma grading and staging. Comput Med Imaging Graph 2021; 90:101924. [PMID: 33895621 DOI: 10.1016/j.compmedimag.2021.101924] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2020] [Revised: 01/07/2021] [Accepted: 04/05/2021] [Indexed: 12/11/2022]
Abstract
Fuhrman cancer grading and tumor-node-metastasis (TNM) cancer staging systems are typically used by clinicians in the treatment planning of renal cell carcinoma (RCC), a common cancer in men and women worldwide. Pathologists typically use percutaneous renal biopsy for RCC grading, while staging is performed by volumetric medical image analysis before renal surgery. Recent studies suggest that clinicians can effectively perform these classification tasks non-invasively by analyzing image texture features of RCC from computed tomography (CT) data. However, image feature identification for RCC grading and staging often relies on laborious manual processes, which is error prone and time-intensive. To address this challenge, this paper proposes a learnable image histogram in the deep neural network framework that can learn task-specific image histograms with variable bin centers and widths. The proposed approach enables learning statistical context features from raw medical data, which cannot be performed by a conventional convolutional neural network (CNN). The linear basis function of our learnable image histogram is piece-wise differentiable, enabling back-propagating errors to update the variable bin centers and widths during training. This novel approach can segregate the CT textures of an RCC in different intensity spectra, which enables efficient Fuhrman low (I/II) and high (III/IV) grading as well as RCC low (I/II) and high (III/IV) staging. The proposed method is validated on a clinical CT dataset of 159 patients from The Cancer Imaging Archive (TCIA) database, and it demonstrates 80% and 83% accuracy in RCC grading and staging, respectively.
Collapse
Affiliation(s)
| | - Ghassan Hamarneh
- Medical Image Analysis Lab, Simon Fraser University, Burnaby, BC V5A 1S6, Canada.
| | - Rafeef Garbi
- BiSICL, University of British Columbia, Vancouver, BC V6T 1Z4, Canada.
| |
Collapse
|