1
|
Dev H, Hu Z, Blumenfeld JD, Sharbatdaran A, Kim Y, Zhu C, Shimonov D, Chevalier JM, Donahue S, Wu A, RoyChoudhury A, He X, Prince MR. The Role of Baseline Total Kidney Volume Growth Rate in Predicting Tolvaptan Efficacy for ADPKD Patients: A Feasibility Study. J Clin Med 2025; 14:1449. [PMID: 40094908 PMCID: PMC11899928 DOI: 10.3390/jcm14051449] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2024] [Revised: 02/11/2025] [Accepted: 02/18/2025] [Indexed: 03/19/2025] Open
Abstract
Background/Objectives: Although tolvaptan efficacy in ADPKD has been demonstrated in randomized clinical trials, there is no definitive method for assessing its efficacy in the individual patient in the clinical setting. In this exploratory feasibility study, we report a method to quantify the change in total kidney volume (TKV) growth rate to retrospectively evaluate tolvaptan efficacy for individual patients. Treatment-related changes in estimated glomerular filtration rate (eGFR) are also assessed. Methods: MRI scans covering at least 1 year prior to and during treatment with tolvaptan were performed, with deep learning facilitated kidney segmentation and fitting multiple imaging timepoints to exponential growth in 32 ADPKD patients. Clustering analysis differentiated tolvaptan treatment "responders" and "non-responders" based upon the magnitude of change in TKV growth rate. Differences in rate of eGFR decline, urine osmolality, and other parameters were compared between responders and non-responders. Results: Eighteen (56%) tolvaptan responders (mean age 42 ± 8 years) were identified by k-means clustering, with an absolute reduction in annual TKV growth rate of >2% (mean = -5.1% ± 2.5% per year). Thirteen (44%) non-responders were identified, with <1% absolute reduction in annual TKV growth rate (mean = +2.4% ± 2.7% per year) during tolvaptan treatment. Compared to non-responders, tolvaptan responders had significantly higher mean TKV growth rates prior to tolvaptan treatment (7.1% ± 3.6% per year vs. 3.7% ± 2.4% per year; p = 0.003) and higher median pretreatment spot urine osmolality (Uosm, 393 mOsm/kg vs. 194 mOsm/kg, p = 0.03), confirmed by multivariate analysis. Mean annual rate of eGFR decline was less in responders than in non-responders (-0.25 ± 0.04, CI: [-0.27, -0.23] mL/min/1.73 m2 per year vs. -0.40 ± 0.06, CI: [-0.43, -0.37] mL/min/1.73 m2 per year, p = 0.036). Conclusions: In this feasibility study designed to assess predictors of tolvaptan treatment efficacy in individual patients with ADPKD, we found that high pretreatment levels of annual TKV growth rate and higher pretreatment spot urine osmolality were associated with a responder phenotype.
Collapse
Affiliation(s)
- Hreedi Dev
- Department of Radiology, Weill Cornell Medicine, New York, NY 10021, USA; (H.D.); (Z.H.); (A.S.); (Y.K.); (C.Z.); (X.H.)
| | - Zhongxiu Hu
- Department of Radiology, Weill Cornell Medicine, New York, NY 10021, USA; (H.D.); (Z.H.); (A.S.); (Y.K.); (C.Z.); (X.H.)
| | - Jon D. Blumenfeld
- Rogosin Institute, New York, NY 10021, USA; (J.D.B.); (D.S.); (J.M.C.); (S.D.)
- Department of Medicine, Weill Cornell Medicine, New York, NY 10021, USA
| | - Arman Sharbatdaran
- Department of Radiology, Weill Cornell Medicine, New York, NY 10021, USA; (H.D.); (Z.H.); (A.S.); (Y.K.); (C.Z.); (X.H.)
| | - Yelynn Kim
- Department of Radiology, Weill Cornell Medicine, New York, NY 10021, USA; (H.D.); (Z.H.); (A.S.); (Y.K.); (C.Z.); (X.H.)
| | - Chenglin Zhu
- Department of Radiology, Weill Cornell Medicine, New York, NY 10021, USA; (H.D.); (Z.H.); (A.S.); (Y.K.); (C.Z.); (X.H.)
| | - Daniil Shimonov
- Rogosin Institute, New York, NY 10021, USA; (J.D.B.); (D.S.); (J.M.C.); (S.D.)
- Department of Medicine, Weill Cornell Medicine, New York, NY 10021, USA
| | - James M. Chevalier
- Rogosin Institute, New York, NY 10021, USA; (J.D.B.); (D.S.); (J.M.C.); (S.D.)
- Department of Medicine, Weill Cornell Medicine, New York, NY 10021, USA
| | - Stephanie Donahue
- Rogosin Institute, New York, NY 10021, USA; (J.D.B.); (D.S.); (J.M.C.); (S.D.)
| | - Alan Wu
- Division of Biostatistics, Department of Population Health, Weill Cornell Medicine, New York, NY 10021, USA; (A.W.); (A.R.)
| | - Arindam RoyChoudhury
- Division of Biostatistics, Department of Population Health, Weill Cornell Medicine, New York, NY 10021, USA; (A.W.); (A.R.)
| | - Xinzi He
- Department of Radiology, Weill Cornell Medicine, New York, NY 10021, USA; (H.D.); (Z.H.); (A.S.); (Y.K.); (C.Z.); (X.H.)
| | - Martin R. Prince
- Department of Radiology, Weill Cornell Medicine, New York, NY 10021, USA; (H.D.); (Z.H.); (A.S.); (Y.K.); (C.Z.); (X.H.)
- Department of Radiology, Columbia Vagelos College of Physicians and Surgeons, New York, NY 10032, USA
| |
Collapse
|
2
|
Sheng TW, Onthoni DD, Gupta P, Lee TH, Sahoo PK. Segmentation of ADPKD Computed Tomography Images with Deep Learning Approach for Predicting Total Kidney Volume. Biomedicines 2025; 13:263. [PMID: 40002677 PMCID: PMC11852143 DOI: 10.3390/biomedicines13020263] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2024] [Revised: 01/11/2025] [Accepted: 01/17/2025] [Indexed: 02/27/2025] Open
Abstract
Background: Total Kidney Volume (TKV) is widely used globally to predict the progressive loss of renal function in patients with Autosomal Dominant Polycystic Kidney Disease (ADPKD). Typically, TKV is calculated using Computed Tomography (CT) images by manually locating, delineating, and segmenting the ADPKD kidneys. However, manual localization and segmentation are tedious, time-consuming tasks and are prone to human error. Specifically, there is a lack of studies that focus on CT modality variation. Methods: In contrast, our work develops a step-by-step framework, which robustly handles both Non-enhanced Computed Tomography (NCCT) and Contrast-enhanced Computed Tomography (CCT) images, ensuring balanced sample utilization and consistent performance across modalities. To achieve this, Artificial Intelligence (AI)-enabled localization and segmentation models are proposed for estimating TKV, which is designed to work robustly on both NCCT and Contrast-Computed Tomography (CCT) images. These AI-based models incorporate various image preprocessing techniques, including dilation and global thresholding, combined with Deep Learning (DL) approaches such as the adapted Single Shot Detector (SSD), Inception V2, and DeepLab V3+. Results: The experimental results demonstrate that the proposed AI-based models outperform other DL architectures, achieving a mean Average Precision (mAP) of 95% for automatic localization, a mean Intersection over Union (mIoU) of 92% for segmentation, and a mean R2 score of 97% for TKV estimation. Conclusions: These results clearly indicate that the proposed AI-based models can robustly localize and segment ADPKD kidneys and estimate TKV using both NCCT and CCT images.
Collapse
Affiliation(s)
- Ting-Wen Sheng
- Department of Medical Imaging and Intervention, New Taipei Municipal TuCheng Hospital, Chang Gung Medical Foundation, New Taipei City 236017, Taiwan;
| | - Djeane Debora Onthoni
- Department of Computer Science and Information Engineering, Chang Gung University, Guishan, Taoyuan 33302, Taiwan; (D.D.O.); (P.G.)
| | - Pushpanjali Gupta
- Department of Computer Science and Information Engineering, Chang Gung University, Guishan, Taoyuan 33302, Taiwan; (D.D.O.); (P.G.)
| | - Tsong-Hai Lee
- Department of Neurology, Chang Gung Memorial Hospital, Linkou Medical Center, Guishan, Taoyuan 333423, Taiwan;
| | - Prasan Kumar Sahoo
- Department of Computer Science and Information Engineering, Chang Gung University, Guishan, Taoyuan 33302, Taiwan; (D.D.O.); (P.G.)
- Department of Neurology, Chang Gung Memorial Hospital, Linkou Medical Center, Guishan, Taoyuan 333423, Taiwan;
| |
Collapse
|
3
|
Takahashi S, Sakaguchi Y, Kouno N, Takasawa K, Ishizu K, Akagi Y, Aoyama R, Teraya N, Bolatkan A, Shinkai N, Machino H, Kobayashi K, Asada K, Komatsu M, Kaneko S, Sugiyama M, Hamamoto R. Comparison of Vision Transformers and Convolutional Neural Networks in Medical Image Analysis: A Systematic Review. J Med Syst 2024; 48:84. [PMID: 39264388 PMCID: PMC11393140 DOI: 10.1007/s10916-024-02105-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2024] [Accepted: 08/31/2024] [Indexed: 09/13/2024]
Abstract
In the rapidly evolving field of medical image analysis utilizing artificial intelligence (AI), the selection of appropriate computational models is critical for accurate diagnosis and patient care. This literature review provides a comprehensive comparison of vision transformers (ViTs) and convolutional neural networks (CNNs), the two leading techniques in the field of deep learning in medical imaging. We conducted a survey systematically. Particular attention was given to the robustness, computational efficiency, scalability, and accuracy of these models in handling complex medical datasets. The review incorporates findings from 36 studies and indicates a collective trend that transformer-based models, particularly ViTs, exhibit significant potential in diverse medical imaging tasks, showcasing superior performance when contrasted with conventional CNN models. Additionally, it is evident that pre-training is important for transformer applications. We expect this work to help researchers and practitioners select the most appropriate model for specific medical image analysis tasks, accounting for the current state of the art and future trends in the field.
Collapse
Affiliation(s)
- Satoshi Takahashi
- Division of Medical AI Research and Development, National Cancer Center Research Institute, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
- Cancer Translational Research Team, RIKEN Center for Advanced Intelligence Project, 1-4-1 Nihonbashi, Chuo-ku, Tokyo, 103-0027, Japan
| | - Yusuke Sakaguchi
- Division of Medical AI Research and Development, National Cancer Center Research Institute, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
- Department of Neurosurgery, Graduate School of Medicine, The University of Tokyo, 7-3-1 Hongo Bunkyo-ku, Tokyo, 113-8655, Japan
| | - Nobuji Kouno
- Division of Medical AI Research and Development, National Cancer Center Research Institute, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
- Cancer Translational Research Team, RIKEN Center for Advanced Intelligence Project, 1-4-1 Nihonbashi, Chuo-ku, Tokyo, 103-0027, Japan
- Department of Surgery, Graduate School of Medicine, Kyoto University, Yoshida-konoe-cho, Sakyo-ku, Kyoto, 606-8303, Japan
| | - Ken Takasawa
- Division of Medical AI Research and Development, National Cancer Center Research Institute, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
- Cancer Translational Research Team, RIKEN Center for Advanced Intelligence Project, 1-4-1 Nihonbashi, Chuo-ku, Tokyo, 103-0027, Japan
| | - Kenichi Ishizu
- Division of Medical AI Research and Development, National Cancer Center Research Institute, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
| | - Yu Akagi
- Department of Biomedical Informatics, Graduate School of Medicine, The University of Tokyo, 7-3-1 Hongo Bunkyo-ku, Tokyo, 113-8655, Japan
| | - Rina Aoyama
- Division of Medical AI Research and Development, National Cancer Center Research Institute, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
- Department of Obstetrics and Gynecology, Showa University School of Medicine, 1-5-8 Hatanodai, Shinagawa-ku, Tokyo, 142-8666, Japan
| | - Naoki Teraya
- Division of Medical AI Research and Development, National Cancer Center Research Institute, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
- Department of Obstetrics and Gynecology, Showa University School of Medicine, 1-5-8 Hatanodai, Shinagawa-ku, Tokyo, 142-8666, Japan
| | - Amina Bolatkan
- Division of Medical AI Research and Development, National Cancer Center Research Institute, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
- Cancer Translational Research Team, RIKEN Center for Advanced Intelligence Project, 1-4-1 Nihonbashi, Chuo-ku, Tokyo, 103-0027, Japan
| | - Norio Shinkai
- Division of Medical AI Research and Development, National Cancer Center Research Institute, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
- Cancer Translational Research Team, RIKEN Center for Advanced Intelligence Project, 1-4-1 Nihonbashi, Chuo-ku, Tokyo, 103-0027, Japan
| | - Hidenori Machino
- Division of Medical AI Research and Development, National Cancer Center Research Institute, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
- Cancer Translational Research Team, RIKEN Center for Advanced Intelligence Project, 1-4-1 Nihonbashi, Chuo-ku, Tokyo, 103-0027, Japan
| | - Kazuma Kobayashi
- Division of Medical AI Research and Development, National Cancer Center Research Institute, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
- Cancer Translational Research Team, RIKEN Center for Advanced Intelligence Project, 1-4-1 Nihonbashi, Chuo-ku, Tokyo, 103-0027, Japan
| | - Ken Asada
- Division of Medical AI Research and Development, National Cancer Center Research Institute, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
- Cancer Translational Research Team, RIKEN Center for Advanced Intelligence Project, 1-4-1 Nihonbashi, Chuo-ku, Tokyo, 103-0027, Japan
| | - Masaaki Komatsu
- Division of Medical AI Research and Development, National Cancer Center Research Institute, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
- Cancer Translational Research Team, RIKEN Center for Advanced Intelligence Project, 1-4-1 Nihonbashi, Chuo-ku, Tokyo, 103-0027, Japan
| | - Syuzo Kaneko
- Division of Medical AI Research and Development, National Cancer Center Research Institute, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
| | - Masashi Sugiyama
- RIKEN Center for Advanced Intelligence Project, Tokyo, 103-0027, Japan
| | - Ryuji Hamamoto
- Division of Medical AI Research and Development, National Cancer Center Research Institute, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan.
- Cancer Translational Research Team, RIKEN Center for Advanced Intelligence Project, 1-4-1 Nihonbashi, Chuo-ku, Tokyo, 103-0027, Japan.
| |
Collapse
|
4
|
He X, Hu Z, Dev H, Romano DJ, Sharbatdaran A, Raza SI, Wang SJ, Teichman K, Shih G, Chevalier JM, Shimonov D, Blumenfeld JD, Goel A, Sabuncu MR, Prince MR. Test Retest Reproducibility of Organ Volume Measurements in ADPKD Using 3D Multimodality Deep Learning. Acad Radiol 2024; 31:889-899. [PMID: 37798206 PMCID: PMC10957335 DOI: 10.1016/j.acra.2023.09.009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2023] [Revised: 08/28/2023] [Accepted: 09/05/2023] [Indexed: 10/07/2023]
Abstract
RATIONALE AND OBJECTIVES Following autosomal dominant polycystic kidney disease (ADPKD) progression by measuring organ volumes requires low measurement variability. The objective of this study is to reduce organ volume measurement variability on MRI of ADPKD patients by utilizing all pulse sequences to obtain multiple measurements which allows outlier analysis to find errors and averaging to reduce variability. MATERIALS AND METHODS In order to make measurements on multiple pulse sequences practical, a 3D multi-modality multi-class segmentation model based on nnU-net was trained/validated using T1, T2, SSFP, DWI and CT from 413 subjects. Reproducibility was assessed with test-re-test methodology on ADPKD subjects (n = 19) scanned twice within a 3-week interval correcting outliers and averaging the measurements across all sequences. Absolute percent differences in organ volumes were compared to paired students t-test. RESULTS Dice similarlity coefficient > 97%, Jaccard Index > 0.94, mean surface distance < 1 mm and mean Hausdorff Distance < 2 cm for all three organs and all five sequences were found on internal (n = 25), external (n = 37) and test-re-test reproducibility assessment (38 scans in 19 subjects). When averaging volumes measured from five MRI sequences, the model automatically segmented kidneys with test-re-test reproducibility (percent absolute difference between exam 1 and exam 2) of 1.3% which was better than all five expert observers. It reliably stratified ADPKD into Mayo Imaging Classification (area under the curve=100%) compared to radiologist. CONCLUSION 3D deep learning measures organ volumes on five MRI sequences leveraging the power of outlier analysis and averaging to achieve 1.3% total kidney test-re-test reproducibility.
Collapse
Affiliation(s)
- Xinzi He
- School of Electrical and Computer Engineering, Cornell University and Cornell Tech, New York, New York (X.H., R.S.); Department of Radiology, Weill Cornell Medicine, New York, New York (X.H., Z.H., H.D., D.J.R., A.S., S.I.R., S.J.W., K.T., G.S., A.G., R.S., M.R.P.)
| | - Zhongxiu Hu
- Department of Radiology, Weill Cornell Medicine, New York, New York (X.H., Z.H., H.D., D.J.R., A.S., S.I.R., S.J.W., K.T., G.S., A.G., R.S., M.R.P.)
| | - Hreedi Dev
- Department of Radiology, Weill Cornell Medicine, New York, New York (X.H., Z.H., H.D., D.J.R., A.S., S.I.R., S.J.W., K.T., G.S., A.G., R.S., M.R.P.)
| | - Dominick J Romano
- Department of Radiology, Weill Cornell Medicine, New York, New York (X.H., Z.H., H.D., D.J.R., A.S., S.I.R., S.J.W., K.T., G.S., A.G., R.S., M.R.P.)
| | - Arman Sharbatdaran
- Department of Radiology, Weill Cornell Medicine, New York, New York (X.H., Z.H., H.D., D.J.R., A.S., S.I.R., S.J.W., K.T., G.S., A.G., R.S., M.R.P.)
| | - Syed I Raza
- Department of Radiology, Weill Cornell Medicine, New York, New York (X.H., Z.H., H.D., D.J.R., A.S., S.I.R., S.J.W., K.T., G.S., A.G., R.S., M.R.P.)
| | - Sophie J Wang
- Department of Radiology, Weill Cornell Medicine, New York, New York (X.H., Z.H., H.D., D.J.R., A.S., S.I.R., S.J.W., K.T., G.S., A.G., R.S., M.R.P.)
| | - Kurt Teichman
- Department of Radiology, Weill Cornell Medicine, New York, New York (X.H., Z.H., H.D., D.J.R., A.S., S.I.R., S.J.W., K.T., G.S., A.G., R.S., M.R.P.)
| | - George Shih
- Department of Radiology, Weill Cornell Medicine, New York, New York (X.H., Z.H., H.D., D.J.R., A.S., S.I.R., S.J.W., K.T., G.S., A.G., R.S., M.R.P.)
| | - James M Chevalier
- Department of Medicine, Weill Cornell Medicine, New York, New York (J.M.C., D.S., J.D.B.); The Rogosin Institute, New York, New York (J.M.C., D.S., J.D.B.)
| | - Daniil Shimonov
- Department of Medicine, Weill Cornell Medicine, New York, New York (J.M.C., D.S., J.D.B.); The Rogosin Institute, New York, New York (J.M.C., D.S., J.D.B.)
| | - Jon D Blumenfeld
- Department of Medicine, Weill Cornell Medicine, New York, New York (J.M.C., D.S., J.D.B.); The Rogosin Institute, New York, New York (J.M.C., D.S., J.D.B.)
| | - Akshay Goel
- Department of Radiology, Weill Cornell Medicine, New York, New York (X.H., Z.H., H.D., D.J.R., A.S., S.I.R., S.J.W., K.T., G.S., A.G., R.S., M.R.P.)
| | - Mert R Sabuncu
- School of Electrical and Computer Engineering, Cornell University and Cornell Tech, New York, New York (X.H., R.S.); Department of Radiology, Weill Cornell Medicine, New York, New York (X.H., Z.H., H.D., D.J.R., A.S., S.I.R., S.J.W., K.T., G.S., A.G., R.S., M.R.P.)
| | - Martin R Prince
- Department of Radiology, Weill Cornell Medicine, New York, New York (X.H., Z.H., H.D., D.J.R., A.S., S.I.R., S.J.W., K.T., G.S., A.G., R.S., M.R.P.); Columbia University Vagelos College of Physicians and Surgeons, New York, New York (M.R.P.).
| |
Collapse
|
5
|
Monaco S, Bussola N, Buttò S, Sona D, Giobergia F, Jurman G, Xinaris C, Apiletti D. AI models for automated segmentation of engineered polycystic kidney tubules. Sci Rep 2024; 14:2847. [PMID: 38310171 PMCID: PMC11289110 DOI: 10.1038/s41598-024-52677-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2023] [Accepted: 01/21/2024] [Indexed: 02/05/2024] Open
Abstract
Autosomal dominant polycystic kidney disease (ADPKD) is a monogenic, rare disease, characterized by the formation of multiple cysts that grow out of the renal tubules. Despite intensive attempts to develop new drugs or repurpose existing ones, there is currently no definitive cure for ADPKD. This is primarily due to the complex and variable pathogenesis of the disease and the lack of models that can faithfully reproduce the human phenotype. Therefore, the development of models that allow automated detection of cysts' growth directly on human kidney tissue is a crucial step in the search for efficient therapeutic solutions. Artificial Intelligence methods, and deep learning algorithms in particular, can provide powerful and effective solutions to such tasks, and indeed various architectures have been proposed in the literature in recent years. Here, we comparatively review state-of-the-art deep learning segmentation models, using as a testbed a set of sequential RGB immunofluorescence images from 4 in vitro experiments with 32 engineered polycystic kidney tubules. To gain a deeper understanding of the detection process, we implemented both pixel-wise and cyst-wise performance metrics to evaluate the algorithms. Overall, two models stand out as the best performing, namely UNet++ and UACANet: the latter uses a self-attention mechanism introducing some explainability aspects that can be further exploited in future developments, thus making it the most promising algorithm to build upon towards a more refined cyst-detection platform. UACANet model achieves a cyst-wise Intersection over Union of 0.83, 0.91 for Recall, and 0.92 for Precision when applied to detect large-size cysts. On all-size cysts, UACANet averages at 0.624 pixel-wise Intersection over Union. The code to reproduce all results is freely available in a public GitHub repository.
Collapse
Affiliation(s)
| | - Nicole Bussola
- Fondazione Bruno Kessler, 38123, Trento, Italy
- CIBIO, Università degli Studi di Trento, 38123, Trento, Italy
| | - Sara Buttò
- Istituto di Ricerche Farmacologiche Mario Negri - IRCCS, 24126, Bergamo, Italy
| | - Diego Sona
- Fondazione Bruno Kessler, 38123, Trento, Italy
| | | | | | | | | |
Collapse
|
6
|
Fu J, Fang M, Lin Z, Qiu J, Yang M, Tian J, Dong D, Zou Y. CT-based radiomics: predicting early outcomes after percutaneous transluminal renal angioplasty in patients with severe atherosclerotic renal artery stenosis. Vis Comput Ind Biomed Art 2024; 7:1. [PMID: 38212451 PMCID: PMC10784441 DOI: 10.1186/s42492-023-00152-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2023] [Accepted: 12/27/2023] [Indexed: 01/13/2024] Open
Abstract
This study aimed to comprehensively evaluate non-contrast computed tomography (CT)-based radiomics for predicting early outcomes in patients with severe atherosclerotic renal artery stenosis (ARAS) after percutaneous transluminal renal angioplasty (PTRA). A total of 52 patients were retrospectively recruited, and their clinical characteristics and pretreatment CT images were collected. During a median follow-up period of 3.7 mo, 18 patients were confirmed to have benefited from the treatment, defined as a 20% improvement from baseline in the estimated glomerular filtration rate. A deep learning network trained via self-supervised learning was used to enhance the imaging phenotype characteristics. Radiomics features, comprising 116 handcrafted features and 78 deep learning features, were extracted from the affected renal and perirenal adipose regions. More features from the latter were correlated with early outcomes, as determined by univariate analysis, and were visually represented in radiomics heatmaps and volcano plots. After using consensus clustering and the least absolute shrinkage and selection operator method for feature selection, five machine learning models were evaluated. Logistic regression yielded the highest leave-one-out cross-validation accuracy of 0.780 (95%CI: 0.660-0.880) for the renal signature, while the support vector machine achieved 0.865 (95%CI: 0.769-0.942) for the perirenal adipose signature. SHapley Additive exPlanations was used to visually interpret the prediction mechanism, and a histogram feature and a deep learning feature were identified as the most influential factors for the renal signature and perirenal adipose signature, respectively. Multivariate analysis revealed that both signatures served as independent predictive factors. When combined, they achieved an area under the receiver operating characteristic curve of 0.888 (95%CI: 0.784-0.992), indicating that the imaging phenotypes from both regions complemented each other. In conclusion, non-contrast CT-based radiomics can be leveraged to predict the early outcomes of PTRA, thereby assisting in identifying patients with ARAS suitable for this treatment, with perirenal adipose tissue providing added predictive value.
Collapse
Affiliation(s)
- Jia Fu
- Department of Interventional Radiology and Vascular Surgery, Peking University First Hospital, Beijing, 100043, China
- Department of Radiology, Peking University First Hospital, Beijing, 100043, China
| | - Mengjie Fang
- Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, School of Engineering Medicine, Beihang University, Beijing, 100191, China
- CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China
| | - Zhiyong Lin
- Department of Radiology, Peking University First Hospital, Beijing, 100043, China
| | - Jianxing Qiu
- Department of Radiology, Peking University First Hospital, Beijing, 100043, China
| | - Min Yang
- Department of Interventional Radiology and Vascular Surgery, Peking University First Hospital, Beijing, 100043, China
| | - Jie Tian
- Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, School of Engineering Medicine, Beihang University, Beijing, 100191, China
- CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China
| | - Di Dong
- CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China.
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, 100049, China.
| | - Yinghua Zou
- Department of Interventional Radiology and Vascular Surgery, Peking University First Hospital, Beijing, 100043, China.
| |
Collapse
|
7
|
Wendler T, Kreissl MC, Schemmer B, Rogasch JMM, De Benetti F. Artificial Intelligence-powered automatic volume calculation in medical images - available tools, performance and challenges for nuclear medicine. Nuklearmedizin 2023; 62:343-353. [PMID: 37995707 PMCID: PMC10667065 DOI: 10.1055/a-2200-2145] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2023] [Accepted: 10/26/2023] [Indexed: 11/25/2023]
Abstract
Volumetry is crucial in oncology and endocrinology, for diagnosis, treatment planning, and evaluating response to therapy for several diseases. The integration of Artificial Intelligence (AI) and Deep Learning (DL) has significantly accelerated the automatization of volumetric calculations, enhancing accuracy and reducing variability and labor. In this review, we show that a high correlation has been observed between Machine Learning (ML) methods and expert assessments in tumor volumetry; Yet, it is recognized as more challenging than organ volumetry. Liver volumetry has shown progression in accuracy with a decrease in error. If a relative error below 10 % is acceptable, ML-based liver volumetry can be considered reliable for standardized imaging protocols if used in patients without major anomalies. Similarly, ML-supported automatic kidney volumetry has also shown consistency and reliability in volumetric calculations. In contrast, AI-supported thyroid volumetry has not been extensively developed, despite initial works in 3D ultrasound showing promising results in terms of accuracy and reproducibility. Despite the advancements presented in the reviewed literature, the lack of standardization limits the generalizability of ML methods across diverse scenarios. The domain gap, i. e., the difference in probability distribution of training and inference data, is of paramount importance before clinical deployment of AI, to maintain accuracy and reliability in patient care. The increasing availability of improved segmentation tools is expected to further incorporate AI methods into routine workflows where volumetry will play a more prominent role in radionuclide therapy planning and quantitative follow-up of disease evolution.
Collapse
Affiliation(s)
- Thomas Wendler
- Clinical Computational Medical Imaging Research, Department of Diagnostic and Interventional Radiology and Neuroradiology, University Hospital Augsburg, Germany
- Institute of Digital Medicine, Universitätsklinikum Augsburg, Germany
- Computer-Aided Medical Procedures and Augmented Reality School of Computation, Information and Technology, Technical University of Munich, Munich, Germany
| | | | | | - Julian Manuel Michael Rogasch
- Department of Nuclear Medicine, Charité – Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin,Germany
| | - Francesca De Benetti
- Computer-Aided Medical Procedures and Augmented Reality School of Computation, Information and Technology, Technical University of Munich, Munich, Germany
| |
Collapse
|
8
|
Yoo J, Kim JU, Kim J, Jeon S, Song YJ, Choi KH, Kim SH, Yoon JW, Kim H. Non-contrast low-dose CT can be used for volumetry of ADPKD. BMC Nephrol 2023; 24:317. [PMID: 37884882 PMCID: PMC10604523 DOI: 10.1186/s12882-023-03359-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2023] [Accepted: 10/04/2023] [Indexed: 10/28/2023] Open
Abstract
BACKGROUND Kidney volume provides important information for the diagnosis and prognosis of autosomal dominant polycystic kidney disease (ADPKD), as well as for the evaluation of the effects of drugs such as tolvaptan. Non-contrast computed tomography (CT) is commonly used for volumetry, and this study examined the correspondence and correlation of kidney volume measured by standard-dose or low-dose CT. METHODS Axial standard-dose and low-dose CT images with 1-mm slices were obtained from 24 ADPKD patients. The kidney was segmented in the Synapse 3D software and the kidney volume was calculated using stereology. The kidney volume was compared between the two sets of images using R2, Bland-Altman plots, coefficient of variation, and intra-class correlation coefficients (ICCs). RESULTS The mean age of the 24 patients was 48.4 ± 10.9 years, and 45.8% were men (n = 11). The mean total kidney volume on standard-dose CT was 1501 ± 838.2 mL. The R2 of volume between standard-dose and low-dose CT was 0.995. In the Bland-Altman plot, except for one case with a large kidney volume, the two measurements were consistent, and the coefficient of variation and ICC were also good (0.02, 0.998). The CT radiation dose (dose-length product) was 229 ± 68 mGy·cm for standard-dose CT and 50 ± 19 mGy·cm for low-dose CT. A comparable volume was obtained with 20% of the radiation dose of standard-dose CT. CONCLUSIONS Standard-dose and low-dose CT showed comparable kidney volume in ADPKD. Therefore, low-dose CT can substitute for ADPKD volumetry while minimizing radiation exposure.
Collapse
Affiliation(s)
- Jaeyeong Yoo
- Department of Internal Medicine, Hallym University Medical Center, Chuncheon Sacred Heart Hospital, Chuncheon-si, Gangwon-do, 24253, Republic of Korea
| | - Jin Up Kim
- Department of Internal Medicine, Hallym University Medical Center, Chuncheon Sacred Heart Hospital, Chuncheon-si, Gangwon-do, 24253, Republic of Korea
| | - Jisu Kim
- Department of Internal Medicine, Hallym University Medical Center, Chuncheon Sacred Heart Hospital, Chuncheon-si, Gangwon-do, 24253, Republic of Korea
| | - Sohyun Jeon
- Department of Internal Medicine, Hallym University Medical Center, Chuncheon Sacred Heart Hospital, Chuncheon-si, Gangwon-do, 24253, Republic of Korea
| | - Young-Jin Song
- Department of Internal Medicine, Hallym University Medical Center, Chuncheon Sacred Heart Hospital, Chuncheon-si, Gangwon-do, 24253, Republic of Korea
| | - Kwang-Ho Choi
- Department of Internal Medicine, Hallym University Medical Center, Chuncheon Sacred Heart Hospital, Chuncheon-si, Gangwon-do, 24253, Republic of Korea
| | - Seok-Hyung Kim
- Department of Internal Medicine, Hallym University Medical Center, Chuncheon Sacred Heart Hospital, Chuncheon-si, Gangwon-do, 24253, Republic of Korea
| | - Jong-Woo Yoon
- Department of Internal Medicine, Hallym University Medical Center, Chuncheon Sacred Heart Hospital, Chuncheon-si, Gangwon-do, 24253, Republic of Korea
| | - Hyunsuk Kim
- Department of Internal Medicine, Hallym University Medical Center, Chuncheon Sacred Heart Hospital, Chuncheon-si, Gangwon-do, 24253, Republic of Korea.
| |
Collapse
|
9
|
Shin JH, Kim YH, Lee MK, Min HS, Cho H, Kim H, Kim YC, Lee YS, Shin TY. Feasibility of artificial intelligence-based decision supporting system in tolvaptan prescription for autosomal dominant polycystic kidney disease. Investig Clin Urol 2023; 64:255-264. [PMID: 37341005 DOI: 10.4111/icu.20220411] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2022] [Revised: 03/12/2023] [Accepted: 03/26/2023] [Indexed: 06/22/2023] Open
Abstract
PURPOSE Total kidney volume (TKV) measurement is crucial for selecting treatment candidates in autosomal dominant polycystic kidney disease (ADPKD). We developed and investigated the performance of fully-automated 3D-volumetry model and applied it to software as a service (SaaS) for clinical support on tolvaptan prescription in ADPKD patients. MATERIALS AND METHODS Computed tomography scans of ADPKD patients taken between January 2000 and June 2022 were acquired from seven institutions. The quality of the images was manually reviewed in advance. The acquired dataset was split into training, validation, and test datasets at a ratio of 8.5:1:0.5. Convolutional, neural network-based automatic segmentation model was trained to obtain 3D segment mask for TKV measurement. The algorithm consisted of three steps: data preprocessing, ADPKD area extraction, and post-processing. After performance validation with the Dice score, 3D-volumetry model was applied to SaaS which is based on Mayo imaging classification for ADPKD. RESULTS A total of 753 cases with 95,117 slices were included. The differences between the ground-truth ADPKD kidney mask and the predicted ADPKD kidney mask were negligible, with intersection over union >0.95. The post-process filter successfully removed false alarms. The test-set performance was homogeneously equal and the Dice score of the model was 0.971; after post-processing, it improved to 0.979. The SaaS calculated TKV from uploaded Digital Imaging and Communications in Medicine images and classified patients according to height-adjusted TKV for age. CONCLUSIONS Our artificial intelligence-3D volumetry model exhibited effective, feasible, and non-inferior performance compared with that of human experts and successfully predicted the rapid ADPKD progressor.
Collapse
Affiliation(s)
- Jung Hyun Shin
- Department of Urology, Ewha Womans University Mokdong Hospital, Seoul, Korea
| | | | | | | | | | - Hyunsuk Kim
- Department of Nephrology, Hallym University Chuncheon Sacred Hospital, Chuncheon, Korea
| | - Yong Chul Kim
- Department of Nephrology, Seoul National University Hospital, Seoul, Korea
| | - Yong Seong Lee
- Department of Urology, Chung-Ang University Gwangmyeong Hospital, Gwangmyeong, Korea.
| | - Tae Young Shin
- Department of Urology, Ewha Womans University Mokdong Hospital, Seoul, Korea
- Synergy A.I. Co., Ltd, Seoul, Korea.
| |
Collapse
|
10
|
Woznicki P, Siedek F, van Gastel MD, dos Santos DP, Arjune S, Karner LA, Meyer F, Caldeira LL, Persigehl T, Gansevoort RT, Grundmann F, Baessler B, Müller RU. Automated Kidney and Liver Segmentation in MR Images in Patients with Autosomal Dominant Polycystic Kidney Disease: A Multicenter Study. KIDNEY360 2022; 3:2048-2058. [PMID: 36591351 PMCID: PMC9802567 DOI: 10.34067/kid.0003192022] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/02/2022] [Accepted: 09/19/2022] [Indexed: 12/31/2022]
Abstract
Background Imaging-based total kidney volume (TKV) and total liver volume (TLV) are major prognostic factors in autosomal dominant polycystic kidney disease (ADPKD) and end points for clinical trials. However, volumetry is time consuming and reader dependent in clinical practice. Our aim was to develop a fully automated method for joint kidney and liver segmentation in magnetic resonance imaging (MRI) and to evaluate its performance in a multisequence, multicenter setting. Methods The convolutional neural network was trained on a large multicenter dataset consisting of 992 MRI scans of 327 patients. Manual segmentation delivered ground-truth labels. The model's performance was evaluated in a separate test dataset of 93 patients (350 MRI scans) as well as a heterogeneous external dataset of 831 MRI scans from 323 patients. Results The segmentation model yielded excellent performance, achieving a median per study Dice coefficient of 0.92-0.97 for the kidneys and 0.96 for the liver. Automatically computed TKV correlated highly with manual measurements (intraclass correlation coefficient [ICC]: 0.996-0.999) with low bias and high precision (-0.2%±4% for axial images and 0.5%±4% for coronal images). TLV estimation showed an ICC of 0.999 and bias/precision of -0.5%±3%. For the external dataset, the automated TKV demonstrated bias and precision of -1%±7%. Conclusions Our deep learning model enabled accurate segmentation of kidneys and liver and objective assessment of TKV and TLV. Importantly, this approach was validated with axial and coronal MRI scans from 40 different scanners, making implementation in clinical routine care feasible.Clinical Trial registry name and registration number: The German ADPKD Tolvaptan Treatment Registry (AD[H]PKD), NCT02497521.
Collapse
Affiliation(s)
- Piotr Woznicki
- Institute of Diagnostic and Interventional Radiology, University of Cologne, University Hospital Cologne, Cologne, Germany,Department of Diagnostic and Interventional Radiology, University Hospital Wuerzburg, Wuerzburg, Germany
| | - Florian Siedek
- Institute of Diagnostic and Interventional Radiology, University of Cologne, University Hospital Cologne, Cologne, Germany
| | - Maatje D.A. van Gastel
- Department of Nephrology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Daniel Pinto dos Santos
- Institute of Diagnostic and Interventional Radiology, University of Cologne, University Hospital Cologne, Cologne, Germany,Institute of Diagnostic and Interventional Radiology, University Hospital Frankfurt, Frankfurt, Germany
| | - Sita Arjune
- Department II of Internal Medicine and Center for Molecular Medicine Cologne, University of Cologne, Faculty of Medicine and University Hospital Cologne, Cologne, Germany
| | - Larina A. Karner
- Department II of Internal Medicine and Center for Molecular Medicine Cologne, University of Cologne, Faculty of Medicine and University Hospital Cologne, Cologne, Germany
| | - Franziska Meyer
- Institute of Diagnostic and Interventional Radiology, University of Cologne, University Hospital Cologne, Cologne, Germany
| | - Liliana Lourenco Caldeira
- Institute of Diagnostic and Interventional Radiology, University of Cologne, University Hospital Cologne, Cologne, Germany
| | - Thorsten Persigehl
- Institute of Diagnostic and Interventional Radiology, University of Cologne, University Hospital Cologne, Cologne, Germany
| | - Ron T. Gansevoort
- Department of Nephrology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Franziska Grundmann
- Department II of Internal Medicine and Center for Molecular Medicine Cologne, University of Cologne, Faculty of Medicine and University Hospital Cologne, Cologne, Germany
| | - Bettina Baessler
- Institute of Diagnostic and Interventional Radiology, University of Cologne, University Hospital Cologne, Cologne, Germany,Department of Diagnostic and Interventional Radiology, University Hospital Wuerzburg, Wuerzburg, Germany
| | - Roman-Ulrich Müller
- Cologne Excellence Cluster on Cellular Stress Responses in Aging-Associated Diseases (CECAD) University of Cologne, Faculty of Medicine and University Hospital Cologne, Cologne, Germany
| |
Collapse
|
11
|
Ong W, Zhu L, Zhang W, Kuah T, Lim DSW, Low XZ, Thian YL, Teo EC, Tan JH, Kumar N, Vellayappan BA, Ooi BC, Quek ST, Makmur A, Hallinan JTPD. Application of Artificial Intelligence Methods for Imaging of Spinal Metastasis. Cancers (Basel) 2022; 14:4025. [PMID: 36011018 PMCID: PMC9406500 DOI: 10.3390/cancers14164025] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2022] [Revised: 08/10/2022] [Accepted: 08/15/2022] [Indexed: 11/16/2022] Open
Abstract
Spinal metastasis is the most common malignant disease of the spine. Recently, major advances in machine learning and artificial intelligence technology have led to their increased use in oncological imaging. The purpose of this study is to review and summarise the present evidence for artificial intelligence applications in the detection, classification and management of spinal metastasis, along with their potential integration into clinical practice. A systematic, detailed search of the main electronic medical databases was undertaken in concordance with the PRISMA guidelines. A total of 30 articles were retrieved from the database and reviewed. Key findings of current AI applications were compiled and summarised. The main clinical applications of AI techniques include image processing, diagnosis, decision support, treatment assistance and prognostic outcomes. In the realm of spinal oncology, artificial intelligence technologies have achieved relatively good performance and hold immense potential to aid clinicians, including enhancing work efficiency and reducing adverse events. Further research is required to validate the clinical performance of the AI tools and facilitate their integration into routine clinical practice.
Collapse
Affiliation(s)
- Wilson Ong
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd., Singapore 119074, Singapore
| | - Lei Zhu
- Department of Computer Science, School of Computing, National University of Singapore, 13 Computing Drive, Singapore 117417, Singapore
| | - Wenqiao Zhang
- Department of Computer Science, School of Computing, National University of Singapore, 13 Computing Drive, Singapore 117417, Singapore
| | - Tricia Kuah
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd., Singapore 119074, Singapore
| | - Desmond Shi Wei Lim
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd., Singapore 119074, Singapore
| | - Xi Zhen Low
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd., Singapore 119074, Singapore
| | - Yee Liang Thian
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd., Singapore 119074, Singapore
- Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Drive, Singapore 117597, Singapore
| | - Ee Chin Teo
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd., Singapore 119074, Singapore
| | - Jiong Hao Tan
- University Spine Centre, Department of Orthopaedic Surgery, National University Health System, 1E, Lower Kent Ridge Road, Singapore 119228, Singapore
| | - Naresh Kumar
- University Spine Centre, Department of Orthopaedic Surgery, National University Health System, 1E, Lower Kent Ridge Road, Singapore 119228, Singapore
| | - Balamurugan A. Vellayappan
- Department of Radiation Oncology, National University Cancer Institute Singapore, National University Hospital, Singapore 119074, Singapore
| | - Beng Chin Ooi
- Department of Computer Science, School of Computing, National University of Singapore, 13 Computing Drive, Singapore 117417, Singapore
| | - Swee Tian Quek
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd., Singapore 119074, Singapore
- Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Drive, Singapore 117597, Singapore
| | - Andrew Makmur
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd., Singapore 119074, Singapore
- Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Drive, Singapore 117597, Singapore
| | - James Thomas Patrick Decourcy Hallinan
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd., Singapore 119074, Singapore
- Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Drive, Singapore 117597, Singapore
| |
Collapse
|
12
|
Sharbatdaran A, Romano D, Teichman K, Dev H, Raza SI, Goel A, Moghadam MC, Blumenfeld JD, Chevalier JM, Shimonov D, Shih G, Wang Y, Prince MR. Deep Learning Automation of Kidney, Liver, and Spleen Segmentation for Organ Volume Measurements in Autosomal Dominant Polycystic Kidney Disease. Tomography 2022; 8:1804-1819. [PMID: 35894017 PMCID: PMC9326744 DOI: 10.3390/tomography8040152] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2022] [Revised: 07/01/2022] [Accepted: 07/08/2022] [Indexed: 12/02/2022] Open
Abstract
Organ volume measurements are a key metric for managing ADPKD (the most common inherited renal disease). However, measuring organ volumes is tedious and involves manually contouring organ outlines on multiple cross-sectional MRI or CT images. The automation of kidney contouring using deep learning has been proposed, as it has small errors compared to manual contouring. Here, a deployed open-source deep learning ADPKD kidney segmentation pipeline is extended to also measure liver and spleen volumes, which are also important. This 2D U-net deep learning approach was developed with radiologist labeled T2-weighted images from 215 ADPKD subjects (70% training = 151, 30% validation = 64). Additional ADPKD subjects were utilized for prospective (n = 30) and external (n = 30) validations for a total of 275 subjects. Image cropping previously optimized for kidneys was included in training but removed for the validation and inference to accommodate the liver which is closer to the image border. An effective algorithm was developed to adjudicate overlap voxels that are labeled as more than one organ. Left kidney, right kidney, liver and spleen labels had average errors of 3%, 7%, 3%, and 1%, respectively, on external validation and 5%, 6%, 5%, and 1% on prospective validation. Dice scores also showed that the deep learning model was close to the radiologist contouring, measuring 0.98, 0.96, 0.97 and 0.96 on external validation and 0.96, 0.96, 0.96 and 0.95 on prospective validation for left kidney, right kidney, liver and spleen, respectively. The time required for manual correction of deep learning segmentation errors was only 19:17 min compared to 33:04 min for manual segmentations, a 42% time saving (p = 0.004). Standard deviation of model assisted segmentations was reduced to 7, 5, 11, 5 mL for right kidney, left kidney, liver and spleen respectively from 14, 10, 55 and 14 mL for manual segmentations. Thus, deep learning reduces the radiologist time required to perform multiorgan segmentations in ADPKD and reduces measurement variability.
Collapse
Affiliation(s)
- Arman Sharbatdaran
- Department of Radiology, Weill Cornell Medicine, Cornell University, New York, NY 10065, USA; (A.S.); (D.R.); (K.T.); (H.D.); (S.I.R.); (A.G.); (M.C.M.); (G.S.)
| | - Dominick Romano
- Department of Radiology, Weill Cornell Medicine, Cornell University, New York, NY 10065, USA; (A.S.); (D.R.); (K.T.); (H.D.); (S.I.R.); (A.G.); (M.C.M.); (G.S.)
| | - Kurt Teichman
- Department of Radiology, Weill Cornell Medicine, Cornell University, New York, NY 10065, USA; (A.S.); (D.R.); (K.T.); (H.D.); (S.I.R.); (A.G.); (M.C.M.); (G.S.)
| | - Hreedi Dev
- Department of Radiology, Weill Cornell Medicine, Cornell University, New York, NY 10065, USA; (A.S.); (D.R.); (K.T.); (H.D.); (S.I.R.); (A.G.); (M.C.M.); (G.S.)
| | - Syed I. Raza
- Department of Radiology, Weill Cornell Medicine, Cornell University, New York, NY 10065, USA; (A.S.); (D.R.); (K.T.); (H.D.); (S.I.R.); (A.G.); (M.C.M.); (G.S.)
| | - Akshay Goel
- Department of Radiology, Weill Cornell Medicine, Cornell University, New York, NY 10065, USA; (A.S.); (D.R.); (K.T.); (H.D.); (S.I.R.); (A.G.); (M.C.M.); (G.S.)
| | - Mina C. Moghadam
- Department of Radiology, Weill Cornell Medicine, Cornell University, New York, NY 10065, USA; (A.S.); (D.R.); (K.T.); (H.D.); (S.I.R.); (A.G.); (M.C.M.); (G.S.)
| | - Jon D. Blumenfeld
- The Rogosin Institute and Department of Medicine Weill Cornell Medicine, Cornell University, New York, NY 10065, USA; (J.D.B.); (J.M.C.); (D.S.)
| | - James M. Chevalier
- The Rogosin Institute and Department of Medicine Weill Cornell Medicine, Cornell University, New York, NY 10065, USA; (J.D.B.); (J.M.C.); (D.S.)
| | - Daniil Shimonov
- The Rogosin Institute and Department of Medicine Weill Cornell Medicine, Cornell University, New York, NY 10065, USA; (J.D.B.); (J.M.C.); (D.S.)
| | - George Shih
- Department of Radiology, Weill Cornell Medicine, Cornell University, New York, NY 10065, USA; (A.S.); (D.R.); (K.T.); (H.D.); (S.I.R.); (A.G.); (M.C.M.); (G.S.)
| | - Yi Wang
- Departments of Radiology at Weill Cornell Medicine and Biomedical Engineering, Cornell University, New York, NY 10065, USA;
| | - Martin R. Prince
- Department of Radiology, Weill Cornell Medicine, Cornell University, New York, NY 10065, USA; (A.S.); (D.R.); (K.T.); (H.D.); (S.I.R.); (A.G.); (M.C.M.); (G.S.)
- Columbia College of Physicians and Surgeons, Cornell University, New York, NY 10027, USA
| |
Collapse
|
13
|
Lin Z, Li Z, Cao P, Lin Y, Liang F, He J, Huang L. Deep learning for emergency ascites diagnosis using ultrasonography images. J Appl Clin Med Phys 2022; 23:e13695. [PMID: 35723875 PMCID: PMC9278686 DOI: 10.1002/acm2.13695] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2022] [Revised: 05/04/2022] [Accepted: 05/20/2022] [Indexed: 02/05/2023] Open
Abstract
PURPOSE The detection of abdominal free fluid or hemoperitoneum can provide critical information for clinical diagnosis and treatment, particularly in emergencies. This study investigates the use of deep learning (DL) for identifying peritoneal free fluid in ultrasonography (US) images of the abdominal cavity, which can help inexperienced physicians or non-professional people in diagnosis. It focuses specifically on first-response scenarios involving focused assessment with sonography for trauma (FAST) technique. METHODS A total of 2985 US images were collected from ascites patients treated from 1 January 2016 to 31 December 2017 at the Shenzhen Second People's Hospital. The data were categorized as Ascites-1, Ascites-2, or Ascites-3, based on the surrounding anatomy. A uniform standard for regions of interest (ROIs) and the lack of obstruction from acoustic shadow was used to classify positive samples. These images were then divided into training (90%) and test (10%) datasets to evaluate the performance of a U-net model, utilizing an encoder-decoder architecture and contracting and expansive paths, developed as part of the study. RESULTS Test results produced sensitivity and specificity values of 94.38% and 68.13%, respectively, in the diagnosis of Ascites-1 US images, with an average Dice coefficient of 0.65 (standard deviation [SD] = 0.21). Similarly, the sensitivity and specificity for Ascites-2 were 97.12% and 86.33%, respectively, with an average Dice coefficient of 0.79 (SD = 0.14). The accuracy and area under the curve (AUC) were 81.25% and 0.76 for Ascites-1 and 91.73% and 0.91 for Ascites-2. CONCLUSION The results produced by the U-net demonstrate the viability of DL for automated ascites diagnosis. This suggests the proposed technique could be highly valuable for improving FAST-based preliminary diagnoses, particularly in emergency scenarios.
Collapse
Affiliation(s)
- Zhanye Lin
- Shantou University Medical CollegeShantouChina
| | - Zhengyi Li
- Department of UltrasoundThe First Affiliated Hospital of Shenzhen UniversityShenzhen Second People's HospitalShenzhenChina
| | - Peng Cao
- Department of Diagnostic RadiologyThe University of Hong KongHong KongChina
| | - Yingying Lin
- Department of Diagnostic RadiologyThe University of Hong KongHong KongChina
| | - Fengting Liang
- Department of UltrasoundThe First Affiliated Hospital of Shenzhen UniversityShenzhen Second People's HospitalShenzhenChina
| | - Jiajun He
- South China University of TechnologyGuangzhouChina
| | - Libing Huang
- Department of UltrasoundThe First Affiliated Hospital of Shenzhen UniversityShenzhen Second People's HospitalShenzhenChina
| |
Collapse
|
14
|
Jagtap JM, Gregory AV, Homes HL, Wright DE, Edwards ME, Akkus Z, Erickson BJ, Kline TL. Automated measurement of total kidney volume from 3D ultrasound images of patients affected by polycystic kidney disease and comparison to MR measurements. Abdom Radiol (NY) 2022; 47:2408-2419. [PMID: 35476147 PMCID: PMC9226108 DOI: 10.1007/s00261-022-03521-5] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2022] [Revised: 04/01/2022] [Accepted: 04/04/2022] [Indexed: 11/01/2022]
Abstract
PURPOSE Total kidney volume (TKV) is the most important imaging biomarker for quantifying the severity of autosomal-dominant polycystic kidney disease (ADPKD). 3D ultrasound (US) can accurately measure kidney volume compared to 2D US; however, manual segmentation is tedious and requires expert annotators. We investigated a deep learning-based approach for automated segmentation of TKV from 3D US in ADPKD patients. METHOD We used axially acquired 3D US-kidney images in 22 ADPKD patients where each patient and each kidney were scanned three times, resulting in 132 scans that were manually segmented. We trained a convolutional neural network to segment the whole kidney and measure TKV. All patients were subsequently imaged with MRI for measurement comparison. RESULTS Our method automatically segmented polycystic kidneys in 3D US images obtaining an average Dice coefficient of 0.80 on the test dataset. The kidney volume measurement compared with linear regression coefficient and bias from human tracing were R2 = 0.81, and - 4.42%, and between AI and reference standard were R2 = 0.93, and - 4.12%, respectively. MRI and US measured kidney volumes had R2 = 0.84 and a bias of 7.47%. CONCLUSION This is the first study applying deep learning to 3D US in ADPKD. Our method shows promising performance for auto-segmentation of kidneys using 3D US to measure TKV, close to human tracing and MRI measurement. This imaging and analysis method may be useful in a number of settings, including pediatric imaging, clinical studies, and longitudinal tracking of patient disease progression.
Collapse
|
15
|
Cayot B, Milot L, Nempont O, Vlachomitrou AS, Langlois-Jacques C, Dumortier J, Boillot O, Arnaud K, Barten TRM, Drenth JPH, Valette PJ. Polycystic liver: automatic segmentation using deep learning on CT is faster and as accurate compared to manual segmentation. Eur Radiol 2022; 32:4780-4790. [PMID: 35142898 DOI: 10.1007/s00330-022-08549-1] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2021] [Revised: 12/18/2021] [Accepted: 12/20/2021] [Indexed: 11/29/2022]
Abstract
OBJECTIVE This study aimed to develop and investigate the performance of a deep learning model based on a convolutional neural network (CNN) for the automatic segmentation of polycystic livers at CT imaging. METHOD This retrospective study used CT images of polycystic livers. To develop the CNN, supervised training and validation phases were performed using 190 CT series. To assess performance, the test phase was performed using 41 CT series. Manual segmentation by an expert radiologist (Rad1a) served as reference for all comparisons. Intra-observer variability was determined by the same reader after 12 weeks (Rad1b), and inter-observer variability by a second reader (Rad2). The Dice similarity coefficient (DSC) evaluated overlap between segmentations. CNN performance was assessed using the concordance correlation coefficient (CCC) and the two-by-two difference between the CCCs; their confidence interval was estimated with bootstrap and Bland-Altman analyses. Liver segmentation time was automatically recorded for each method. RESULTS A total of 231 series from 129 CT examinations on 88 consecutive patients were collected. For the CNN, the DSC was 0.95 ± 0.03 and volume analyses yielded a CCC of 0.995 compared with reference. No statistical difference was observed in the CCC between CNN automatic segmentation and manual segmentations performed to evaluate inter-observer and intra-observer variability. While manual segmentation required 22.4 ± 10.4 min, central and graphics processing units took an average of 5.0 ± 2.1 s and 2.0 ± 1.4 s, respectively. CONCLUSION Compared with manual segmentation, automated segmentation of polycystic livers using a deep learning method achieved much faster segmentation with similar performance. KEY POINTS • Automatic volumetry of polycystic livers using artificial intelligence method allows much faster segmentation than expert manual segmentation with similar performance. • No statistical difference was observed between automatic segmentation, inter-observer variability, or intra-observer variability.
Collapse
Affiliation(s)
- Bénédicte Cayot
- Department of Medical Imaging, Hospices Civils de Lyon, University of Lyon, Lyon, France. .,Service d'imagerie médicale et interventionnelle, Hôpital Edouard Herriot, 5 Place d'Arsonval, 69003, Lyon, France.
| | - Laurent Milot
- Service d'imagerie médicale et interventionnelle, Hôpital Edouard Herriot, 5 Place d'Arsonval, 69003, Lyon, France.,Department of Medical Imaging, Edouard Herriot Hospital, Civil Hospices of Lyon, University of Lyon, Lyon, France
| | - Olivier Nempont
- Service d'imagerie médicale et interventionnelle, Hôpital Edouard Herriot, 5 Place d'Arsonval, 69003, Lyon, France.,Philips France, 33 rue de Verdun, CS 60 055, Cedex 92156, Suresnes, France
| | - Anna S Vlachomitrou
- Service d'imagerie médicale et interventionnelle, Hôpital Edouard Herriot, 5 Place d'Arsonval, 69003, Lyon, France.,Philips France, 33 rue de Verdun, CS 60 055, Cedex 92156, Suresnes, France
| | - Carole Langlois-Jacques
- Service d'imagerie médicale et interventionnelle, Hôpital Edouard Herriot, 5 Place d'Arsonval, 69003, Lyon, France.,Unit of Biostatistics, Civil Hospices of Lyon, Lyon ,CNRS UMR5558, Laboratory of Biometry and Evolutionary Biology, Biostatistics-Health Team, Lyon, France
| | - Jérôme Dumortier
- Service d'imagerie médicale et interventionnelle, Hôpital Edouard Herriot, 5 Place d'Arsonval, 69003, Lyon, France.,Department of Hepatology and Gastroenterology, Civil Hospices of Lyon, Edouard Herriot Hospital, Federation of Digestive Specialties, University of Lyon, Lyon, France.,University of Lyon, Lyon, France
| | - Olivier Boillot
- Service d'imagerie médicale et interventionnelle, Hôpital Edouard Herriot, 5 Place d'Arsonval, 69003, Lyon, France.,University of Lyon, Lyon, France.,Department of Hepatobiliary-Pancreatic Surgery and Hepatology, Civil Hospices of Lyon, Edouard Herriot Hospital, University of Lyon, Lyon, France
| | - Karine Arnaud
- Service d'imagerie médicale et interventionnelle, Hôpital Edouard Herriot, 5 Place d'Arsonval, 69003, Lyon, France.,Edouard Herriot Hospital, Civil Hospices of Lyon, Lyon, France
| | - Thijs R M Barten
- Service d'imagerie médicale et interventionnelle, Hôpital Edouard Herriot, 5 Place d'Arsonval, 69003, Lyon, France.,Radboud University Medical Center, Nijmegen, the Netherlands
| | - Joost P H Drenth
- Service d'imagerie médicale et interventionnelle, Hôpital Edouard Herriot, 5 Place d'Arsonval, 69003, Lyon, France.,Department of Gastroenterology and Hepatology, Radboud University Medical Center, Nijmegen, the Netherlands
| | - Pierre-Jean Valette
- Service d'imagerie médicale et interventionnelle, Hôpital Edouard Herriot, 5 Place d'Arsonval, 69003, Lyon, France.,Department of Medical Imaging, Edouard Herriot Hospital, Civil Hospices of Lyon, University of Lyon, Lyon, France
| |
Collapse
|
16
|
Cardobi N, Dal Palù A, Pedrini F, Beleù A, Nocini R, De Robertis R, Ruzzenente A, Salvia R, Montemezzi S, D’Onofrio M. An Overview of Artificial Intelligence Applications in Liver and Pancreatic Imaging. Cancers (Basel) 2021; 13:2162. [PMID: 33946223 PMCID: PMC8124771 DOI: 10.3390/cancers13092162] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2021] [Revised: 04/27/2021] [Accepted: 04/28/2021] [Indexed: 12/11/2022] Open
Abstract
Artificial intelligence (AI) is one of the most promising fields of research in medical imaging so far. By means of specific algorithms, it can be used to help radiologists in their routine workflow. There are several papers that describe AI approaches to solve different problems in liver and pancreatic imaging. These problems may be summarized in four different categories: segmentation, quantification, characterization and image quality improvement. Segmentation is usually the first step of successive elaborations. If done manually, it is a time-consuming process. Therefore, the semi-automatic and automatic creation of a liver or a pancreatic mask may save time for other evaluations, such as quantification of various parameters, from organs volume to their textural features. The alterations of normal liver and pancreas structure may give a clue to the presence of a diffuse or focal pathology. AI can be trained to recognize these alterations and propose a diagnosis, which may then be confirmed or not by radiologists. Finally, AI may be applied in medical image reconstruction in order to increase image quality, decrease dose administration (referring to computed tomography) and reduce scan times. In this article, we report the state of the art of AI applications in these four main categories.
Collapse
Affiliation(s)
- Nicolò Cardobi
- Radiology Unit, Department of Pathology and Diagnostics, University Hospital of Verona, Piazzale Aristide Stefani, 1, 37126 Verona, Italy; (R.D.R.); (S.M.)
| | - Alessandro Dal Palù
- Department of Mathematical, Physical and Computer Sciences, University of Parma, 43121 Parma, Italy;
| | - Federica Pedrini
- Department of Radiology, G.B. Rossi University Hospital, University of Verona, 37129 Verona, Italy; (F.P.); (A.B.); (M.D.)
| | - Alessandro Beleù
- Department of Radiology, G.B. Rossi University Hospital, University of Verona, 37129 Verona, Italy; (F.P.); (A.B.); (M.D.)
| | - Riccardo Nocini
- Otolaryngology-Head and Neck Surgery Department, University Hospital of Verona, Piazzale Aristide Stefani, 1, 37126 Verona, Italy;
| | - Riccardo De Robertis
- Radiology Unit, Department of Pathology and Diagnostics, University Hospital of Verona, Piazzale Aristide Stefani, 1, 37126 Verona, Italy; (R.D.R.); (S.M.)
| | - Andrea Ruzzenente
- Department of Surgery, General and Hepatobiliary Surgery, University Hospital G.B. Rossi, University and Hospital Trust of Verona, 37126 Verona, Italy;
| | - Roberto Salvia
- Unit of General and Pancreatic Surgery, Department of Surgery and Oncology, University of Verona Hospital Trust, 37126 Verona, Italy;
| | - Stefania Montemezzi
- Radiology Unit, Department of Pathology and Diagnostics, University Hospital of Verona, Piazzale Aristide Stefani, 1, 37126 Verona, Italy; (R.D.R.); (S.M.)
| | - Mirko D’Onofrio
- Department of Radiology, G.B. Rossi University Hospital, University of Verona, 37129 Verona, Italy; (F.P.); (A.B.); (M.D.)
| |
Collapse
|
17
|
Daniel AJ, Buchanan CE, Allcock T, Scerri D, Cox EF, Prestwich BL, Francis ST. Automated renal segmentation in healthy and chronic kidney disease subjects using a convolutional neural network. Magn Reson Med 2021; 86:1125-1136. [PMID: 33755256 DOI: 10.1002/mrm.28768] [Citation(s) in RCA: 28] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2020] [Revised: 01/22/2021] [Accepted: 02/16/2021] [Indexed: 12/13/2022]
Abstract
PURPOSE Total kidney volume (TKV) is an important measure in renal disease detection and monitoring. We developed a fully automated method to segment the kidneys from T2 -weighted MRI to calculate TKV of healthy control (HC) and chronic kidney disease (CKD) patients. METHODS This automated method uses machine learning, specifically a 2D convolutional neural network (CNN), to accurately segment the left and right kidneys from T2 -weighted MRI data. The data set consisted of 30 HC subjects and 30 CKD patients. The model was trained on 50 manually defined HC and CKD kidney segmentations. The model was subsequently evaluated on 50 test data sets, comprising data from 5 HCs and 5 CKD patients each scanned 5 times in a scan session to enable comparison of the precision of the CNN and manual segmentation of kidneys. RESULTS The unseen test data processed by the 2D CNN had a mean Dice score of 0.93 ± 0.01. The difference between manual and automatically computed TKV was 1.2 ± 16.2 mL with a mean surface distance of 0.65 ± 0.21 mm. The variance in TKV measurements from repeat acquisitions on the same subject was significantly lower using the automated method compared to manual segmentation of the kidneys. CONCLUSION The 2D CNN method provides fully automated segmentation of the left and right kidney and calculation of TKV in <10 s on a standard office computer, allowing high data throughput and is a freely available executable.
Collapse
Affiliation(s)
- Alexander J Daniel
- Sir Peter Mansfield Imaging Centre, University of Nottingham, Nottingham, United Kingdom
| | - Charlotte E Buchanan
- Sir Peter Mansfield Imaging Centre, University of Nottingham, Nottingham, United Kingdom
| | - Thomas Allcock
- Sir Peter Mansfield Imaging Centre, University of Nottingham, Nottingham, United Kingdom
| | - Daniel Scerri
- Sir Peter Mansfield Imaging Centre, University of Nottingham, Nottingham, United Kingdom
| | - Eleanor F Cox
- Sir Peter Mansfield Imaging Centre, University of Nottingham, Nottingham, United Kingdom
| | - Benjamin L Prestwich
- Sir Peter Mansfield Imaging Centre, University of Nottingham, Nottingham, United Kingdom
| | - Susan T Francis
- Sir Peter Mansfield Imaging Centre, University of Nottingham, Nottingham, United Kingdom
| |
Collapse
|