1
|
Spaanderman D, Hakkesteegt S, Hanff D, Schut A, Schiphouwer L, Vos M, Messiou C, Doran S, Jones R, Hayes A, Nardo L, Abdelhafez Y, Moawad A, Elsayes K, Lee S, Link T, Niessen W, van Leenders G, Visser J, Klein S, Grünhagen D, Verhoef C, Starmans M. Multi-center external validation of an automated method segmenting and differentiating atypical lipomatous tumors from lipomas using radiomics and deep-learning on MRI. EClinicalMedicine 2024; 76:102802. [PMID: 39351025 PMCID: PMC11440245 DOI: 10.1016/j.eclinm.2024.102802] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/21/2024] [Revised: 08/09/2024] [Accepted: 08/12/2024] [Indexed: 10/04/2024] Open
Abstract
Background As differentiating between lipomas and atypical lipomatous tumors (ALTs) based on imaging is challenging and requires biopsies, radiomics has been proposed to aid the diagnosis. This study aimed to externally and prospectively validate a radiomics model differentiating between lipomas and ALTs on MRI in three large, multi-center cohorts, and extend it with automatic and minimally interactive segmentation methods to increase clinical feasibility. Methods Three study cohorts were formed, two for external validation containing data from medical centers in the United States (US) collected from 2008 until 2018 and the United Kingdom (UK) collected from 2011 until 2017, and one for prospective validation consisting of data collected from 2020 until 2021 in the Netherlands. Patient characteristics, MDM2 amplification status, and MRI scans were collected. An automatic segmentation method was developed to segment all tumors on T1-weighted MRI scans of the validation cohorts. Segmentations were subsequently quality scored. In case of insufficient quality, an interactive segmentation method was used. Radiomics performance was evaluated for all cohorts and compared to two radiologists. Findings The validation cohorts included 150 (54% ALT), 208 (37% ALT), and 86 patients (28% ALT) from the US, UK and NL. Of the 444 cases, 78% were automatically segmented. For 22%, interactive segmentation was necessary due to insufficient quality, with only 3% of all patients requiring manual adjustment. External validation resulted in an AUC of 0.74 (95% CI: 0.66, 0.82) in US data and 0.86 (0.80, 0.92) in UK data. Prospective validation resulted in an AUC of 0.89 (0.83, 0.96). The radiomics model performed similar to the two radiologists (US: 0.79 and 0.76, UK: 0.86 and 0.86, NL: 0.82 and 0.85). Interpretation The radiomics model extended with automatic and minimally interactive segmentation methods accurately differentiated between lipomas and ALTs in two large, multi-center external cohorts, and in prospective validation, performing similar to expert radiologists, possibly limiting the need for invasive diagnostics. Funding Hanarth fonds.
Collapse
Affiliation(s)
- D.J. Spaanderman
- Department of Radiology and Nuclear Medicine, Erasmus MC, Rotterdam, the Netherlands
| | - S.N. Hakkesteegt
- Department of Surgical Oncology and Gastrointestinal Surgery, Erasmus MC Cancer Institute Erasmus University Medical Center, Rotterdam, the Netherlands
| | - D.F. Hanff
- Department of Radiology and Nuclear Medicine, Erasmus MC, Rotterdam, the Netherlands
| | - A.R.W. Schut
- Department of Surgical Oncology and Gastrointestinal Surgery, Erasmus MC Cancer Institute Erasmus University Medical Center, Rotterdam, the Netherlands
| | - L.M. Schiphouwer
- Department of Radiology and Nuclear Medicine, Erasmus MC, Rotterdam, the Netherlands
| | - M. Vos
- Department of Surgical Oncology and Gastrointestinal Surgery, Erasmus MC Cancer Institute Erasmus University Medical Center, Rotterdam, the Netherlands
| | - C. Messiou
- The Royal Marsden Hospital and The Institute of Cancer Research London, United Kingdom
| | - S.J. Doran
- The Royal Marsden Hospital and The Institute of Cancer Research London, United Kingdom
| | - R.L. Jones
- The Royal Marsden Hospital and The Institute of Cancer Research London, United Kingdom
| | - A.J. Hayes
- The Royal Marsden Hospital and The Institute of Cancer Research London, United Kingdom
| | - L. Nardo
- Department of Radiology, UC Davis Health, Sacramento, CA, USA
| | - Y.G. Abdelhafez
- Department of Radiology, UC Davis Health, Sacramento, CA, USA
| | - A.W. Moawad
- Department of Diagnostic Imaging, University of Texas MD Anderson Cancer Center, Houston, TX, USA
- Department of Diagnostic Radiology, Mercy Catholic Medical Center, Darby, PA, USA
| | - K.M. Elsayes
- Department of Diagnostic Imaging, University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - S. Lee
- Department of Radiological Sciences, University of California, Irvine, CA, USA
| | - T.M. Link
- Department of Radiology and Biomedical Imaging, University of California, San Francisco, CA, USA
| | - W.J. Niessen
- Faculty of Medical Sciences, University of Groningen, Groningen, the Netherlands
| | | | - J.J. Visser
- Department of Radiology and Nuclear Medicine, Erasmus MC, Rotterdam, the Netherlands
| | - S. Klein
- Department of Radiology and Nuclear Medicine, Erasmus MC, Rotterdam, the Netherlands
| | - D.J. Grünhagen
- Department of Surgical Oncology and Gastrointestinal Surgery, Erasmus MC Cancer Institute Erasmus University Medical Center, Rotterdam, the Netherlands
| | - C. Verhoef
- Department of Surgical Oncology and Gastrointestinal Surgery, Erasmus MC Cancer Institute Erasmus University Medical Center, Rotterdam, the Netherlands
| | - M.P.A. Starmans
- Department of Radiology and Nuclear Medicine, Erasmus MC, Rotterdam, the Netherlands
- Department of Pathology, Erasmus MC, Rotterdam, the Netherlands
| |
Collapse
|
2
|
Gitto S, Cuocolo R, Giannetta V, Badalyan J, Di Luca F, Fusco S, Zantonelli G, Albano D, Messina C, Sconfienza LM. Effects of Interobserver Segmentation Variability and Intensity Discretization on MRI-Based Radiomic Feature Reproducibility of Lipoma and Atypical Lipomatous Tumor. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024; 37:1187-1200. [PMID: 38332405 PMCID: PMC11169199 DOI: 10.1007/s10278-024-00999-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/16/2023] [Revised: 12/17/2023] [Accepted: 12/21/2023] [Indexed: 02/10/2024]
Abstract
Segmentation and image intensity discretization impact on radiomics workflow. The aim of this study is to investigate the influence of interobserver segmentation variability and intensity discretization methods on the reproducibility of MRI-based radiomic features in lipoma and atypical lipomatous tumor (ALT). Thirty patients with lipoma or ALT were retrospectively included. Three readers independently performed manual contour-focused segmentation on T1-weighted and T2-weighted sequences, including the whole tumor volume. Additionally, a marginal erosion was applied to segmentations to evaluate its influence on feature reproducibility. After image pre-processing, with included intensity discretization employing both fixed bin number and width approaches, 1106 radiomic features were extracted from each sequence. Intraclass correlation coefficient (ICC) 95% confidence interval lower bound ≥ 0.75 defined feature stability. In contour-focused vs. margin shrinkage segmentation, the rates of stable features extracted from T1-weighted and T2-weighted images ranged from 92.68 to 95.21% vs. 90.69 to 95.66% after fixed bin number discretization and from 95.75 to 97.65% vs. 95.39 to 96.47% after fixed bin width discretization, respectively, with no difference between the two segmentation approaches (p ≥ 0.175). Higher stable feature rates and higher feature ICC values were found when implementing discretization with fixed bin width compared to fixed bin number, regardless of the segmentation approach (p < 0.001). In conclusion, MRI radiomic features of lipoma and ALT are reproducible regardless of the segmentation approach and intensity discretization method, although a certain degree of interobserver variability highlights the need for a preliminary reliability analysis in future studies.
Collapse
Affiliation(s)
- Salvatore Gitto
- IRCCS Istituto Ortopedico Galeazzi, Via Cristina Belgioioso 173, 20157, Milan, Italy
- Dipartimento Di Scienze Biomediche Per La Salute, Università Degli Studi Di Milano, Milan, Italy
| | - Renato Cuocolo
- Department of Medicine, Surgery and Dentistry, University of Salerno, Baronissi, Italy
| | - Vincenzo Giannetta
- Diagnostic and Interventional Radiology Department, IRCCS Ospedale San Raffaele-Turro, Università Vita-Salute San Raffaele, Milan, Italy
| | - Julietta Badalyan
- Scuola Di Specializzazione in Statistica Sanitaria E Biometria, Università Degli Studi Di Milano, Milan, Italy
| | - Filippo Di Luca
- Scuola Di Specializzazione in Radiodiagnostica, Università Degli Studi Di Milano, Milan, Italy
| | - Stefano Fusco
- Dipartimento Di Scienze Biomediche Per La Salute, Università Degli Studi Di Milano, Milan, Italy
| | - Giulia Zantonelli
- Dipartimento Di Scienze Biomediche Per La Salute, Università Degli Studi Di Milano, Milan, Italy
| | - Domenico Albano
- IRCCS Istituto Ortopedico Galeazzi, Via Cristina Belgioioso 173, 20157, Milan, Italy
- Dipartimento Di Scienze Biomediche, Chirurgiche Ed Odontoiatriche, Università Degli Studi Di Milano, Milan, Italy
| | - Carmelo Messina
- IRCCS Istituto Ortopedico Galeazzi, Via Cristina Belgioioso 173, 20157, Milan, Italy
- Dipartimento Di Scienze Biomediche Per La Salute, Università Degli Studi Di Milano, Milan, Italy
| | - Luca Maria Sconfienza
- IRCCS Istituto Ortopedico Galeazzi, Via Cristina Belgioioso 173, 20157, Milan, Italy.
- Dipartimento Di Scienze Biomediche Per La Salute, Università Degli Studi Di Milano, Milan, Italy.
| |
Collapse
|
3
|
Crombé A, Spinnato P, Italiano A, Brisse HJ, Feydy A, Fadli D, Kind M. Radiomics and artificial intelligence for soft-tissue sarcomas: Current status and perspectives. Diagn Interv Imaging 2023; 104:567-583. [PMID: 37802753 DOI: 10.1016/j.diii.2023.09.005] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2023] [Revised: 09/18/2023] [Accepted: 09/19/2023] [Indexed: 10/08/2023]
Abstract
This article proposes a summary of the current status of the research regarding the use of radiomics and artificial intelligence to improve the radiological assessment of patients with soft tissue sarcomas (STS), a heterogeneous group of rare and ubiquitous mesenchymal malignancies. After a first part explaining the principle of radiomics approaches, from raw image post-processing to extraction of radiomics features mined with unsupervised and supervised machine-learning algorithms, and the current research involving deep learning algorithms in STS, especially convolutional neural networks, this review details their main research developments since the formalisation of 'radiomics' in oncologic imaging in 2010. This review focuses on CT and MRI and does not involve ultrasonography. Radiomics and deep radiomics have been successfully applied to develop predictive models to discriminate between benign soft-tissue tumors and STS, to predict the histologic grade (i.e., the most important prognostic marker of STS), the response to neoadjuvant chemotherapy and/or radiotherapy, and the patients' survivals and probability for presenting distant metastases. The main findings, limitations and expectations are discussed for each of these outcomes. Overall, after a first decade of publications emphasizing the potential of radiomics through retrospective proof-of-concept studies, almost all positive but with heterogeneous and often non-replicable methods, radiomics is now at a turning point in order to provide robust demonstrations of its clinical impact through open-science, independent databases, and application of good and standardized practices in radiomics such as those provided by the Image Biomarker Standardization Initiative, without forgetting innovative research paths involving other '-omics' data to better understand the relationships between imaging of STS, gene-expression profiles and tumor microenvironment.
Collapse
Affiliation(s)
- Amandine Crombé
- Department of Radiology, Pellegrin University Hospital, 33000 Bordeaux, France; Department of Oncologic Imaging, Bergonié Institute, 33076 Bordeaux, France; 'Sarcotarget' team, BRIC INSERM U1312 and Bordeaux University, 33000 Bordeaux France.
| | - Paolo Spinnato
- Diagnostic and Interventional Radiology, IRCCS Istituto Ortopedico Rizzoli, Bologna 40136, Italy
| | | | | | - Antoine Feydy
- Department of Radiology, Hopital Cochin-AP-HP, 75014 Paris, France; Université Paris Cité, Faculté de Médecine, 75006 Paris, France
| | - David Fadli
- Department of Radiology, Pellegrin University Hospital, 33000 Bordeaux, France
| | - Michèle Kind
- Department of Oncologic Imaging, Bergonié Institute, 33076 Bordeaux, France
| |
Collapse
|
4
|
Gitto S, Interlenghi M, Cuocolo R, Salvatore C, Giannetta V, Badalyan J, Gallazzi E, Spinelli MS, Gallazzi M, Serpi F, Messina C, Albano D, Annovazzi A, Anelli V, Baldi J, Aliprandi A, Armiraglio E, Parafioriti A, Daolio PA, Luzzati A, Biagini R, Castiglioni I, Sconfienza LM. MRI radiomics-based machine learning for classification of deep-seated lipoma and atypical lipomatous tumor of the extremities. LA RADIOLOGIA MEDICA 2023:10.1007/s11547-023-01657-y. [PMID: 37335422 DOI: 10.1007/s11547-023-01657-y] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/15/2023] [Accepted: 05/26/2023] [Indexed: 06/21/2023]
Abstract
PURPOSE To determine diagnostic performance of MRI radiomics-based machine learning for classification of deep-seated lipoma and atypical lipomatous tumor (ALT) of the extremities. MATERIAL AND METHODS This retrospective study was performed at three tertiary sarcoma centers and included 150 patients with surgically treated and histology-proven lesions. The training-validation cohort consisted of 114 patients from centers 1 and 2 (n = 64 lipoma, n = 50 ALT). The external test cohort consisted of 36 patients from center 3 (n = 24 lipoma, n = 12 ALT). 3D segmentation was manually performed on T1- and T2-weighted MRI. After extraction and selection of radiomic features, three machine learning classifiers were trained and validated using nested fivefold cross-validation. The best-performing classifier according to previous analysis was evaluated and compared to an experienced musculoskeletal radiologist in the external test cohort. RESULTS Eight features passed feature selection and were incorporated into the machine learning models. After training and validation (74% ROC-AUC), the best-performing classifier (Random Forest) showed 92% sensitivity and 33% specificity in the external test cohort with no statistical difference compared to the radiologist (p = 0.474). CONCLUSION MRI radiomics-based machine learning may classify deep-seated lipoma and ALT of the extremities with high sensitivity and negative predictive value, thus potentially serving as a non-invasive screening tool to reduce unnecessary referral to tertiary tumor centers.
Collapse
Affiliation(s)
- Salvatore Gitto
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
- Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milan, Italy
| | | | - Renato Cuocolo
- Department of Medicine, Surgery and Dentistry, University of Salerno, Baronissi, Italy
- Augmented Reality for Health Monitoring Laboratory (ARHeMLab), Department of Electrical Engineering and Information Technology, University of Naples "Federico II", Naples, Italy
| | - Christian Salvatore
- DeepTrace Technologies, Milan, Italy
- Department of Science, Technology and Society, University School for Advanced Studies IUSS Pavia, Pavia, Italy
| | - Vincenzo Giannetta
- Diagnostic and Interventional Radiology Department, IRCCS Ospedale San Raffaele-Turro, Università Vita-Salute San Raffaele, Milan, Italy
| | - Julietta Badalyan
- Scuola di Specializzazione in Statistica Sanitaria e Biometria, Università Degli Studi Di Milano, Milan, Italy
| | - Enrico Gallazzi
- UOC Patologia Vertebrale e Scoliosi, ASST Gaetano Pini - CTO, Milan, Italy
| | | | - Mauro Gallazzi
- UOC Radiodiagnostica, ASST Gaetano Pini - CTO, Milan, Italy
| | - Francesca Serpi
- Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milan, Italy
| | - Carmelo Messina
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
- Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milan, Italy
| | | | - Alessio Annovazzi
- Nuclear Medicine Unit, IRCCS Regina Elena National Cancer Institute, Rome, Italy
| | - Vincenzo Anelli
- Radiology and Diagnostic Imaging Unit, IRCCS Regina Elena National Cancer Institute, Rome, Italy
| | - Jacopo Baldi
- Oncological Orthopaedics Unit, IRCCS Regina Elena National Cancer Institute, Rome, Italy
| | | | | | | | | | | | - Roberto Biagini
- Oncological Orthopaedics Unit, IRCCS Regina Elena National Cancer Institute, Rome, Italy
| | - Isabella Castiglioni
- Department of Physics, Università degli Studi di Milano-Bicocca, Milan, Italy
- Institute of Biomedical Imaging and Physiology, Consiglio Nazionale Delle Ricerche, Segrate, Italy
| | - Luca Maria Sconfienza
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy.
- Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milan, Italy.
| |
Collapse
|
5
|
Liu CC, Abdelhafez YG, Yap SP, Acquafredda F, Schirò S, Wong AL, Sarohia D, Bateni C, Darrow MA, Guindani M, Lee S, Zhang M, Moawad AW, Ng QKT, Shere L, Elsayes KM, Maroldi R, Link TM, Nardo L, Qi J. AI-Based Automated Lipomatous Tumor Segmentation in MR Images: Ensemble Solution to Heterogeneous Data. J Digit Imaging 2023; 36:1049-1059. [PMID: 36854923 PMCID: PMC10287587 DOI: 10.1007/s10278-023-00785-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2022] [Revised: 01/20/2023] [Accepted: 01/20/2023] [Indexed: 03/02/2023] Open
Abstract
Deep learning (DL) has been proposed to automate image segmentation and provide accuracy, consistency, and efficiency. Accurate segmentation of lipomatous tumors (LTs) is critical for correct tumor radiomics analysis and localization. The major challenge of this task is data heterogeneity, including tumor morphological characteristics and multicenter scanning protocols. To mitigate the issue, we aimed to develop a DL-based Super Learner (SL) ensemble framework with different data correction and normalization methods. Pathologically proven LTs on pre-operative T1-weighted/proton-density MR images of 185 patients were manually segmented. The LTs were categorized by tumor locations as distal upper limb (DUL), distal lower limb (DLL), proximal upper limb (PUL), proximal lower limb (PLL), or Trunk (T) and grouped by 80%/9%/11% for training, validation and testing. Six configurations of correction/normalization were applied to data for fivefold-cross-validation trainings, resulting in 30 base learners (BLs). A SL was obtained from the BLs by optimizing SL weights. The performance was evaluated by dice-similarity-coefficient (DSC), sensitivity, specificity, and Hausdorff distance (HD95). For predictions of the BLs, the average DSC, sensitivity, and specificity from the testing data were 0.72 [Formula: see text] 0.16, 0.73 [Formula: see text] 0.168, and 0.99 [Formula: see text] 0.012, respectively, while for SL predictions were 0.80 [Formula: see text] 0.184, 0.78 [Formula: see text] 0.193, and 1.00 [Formula: see text] 0.010. The average HD95 of the BLs were 11.5 (DUL), 23.2 (DLL), 25.9 (PUL), 32.1 (PLL), and 47.9 (T) mm, whereas of SL were 1.7, 8.4, 15.9, 2.2, and 36.6 mm, respectively. The proposed method could improve the segmentation accuracy and mitigate the performance instability and data heterogeneity aiding the differential diagnosis of LTs in real clinical situations.
Collapse
Affiliation(s)
- Chih-Chieh Liu
- Department of Biomedical Engineering, University of California, Davis, CA, USA
| | - Yasser G Abdelhafez
- Department of Radiology, UC Davis Health, Sacramento, CA, USA
- Radiotherapy and Nuclear Medicine Department, South Egypt Cancer Institute, Assiut University, Assiut, Egypt
| | - S Paran Yap
- Department of Radiology, UC Davis Health, Sacramento, CA, USA
| | | | - Silvia Schirò
- Section of Radiology, Department of Medicine and Surgery (DiMeC), University of Parma, Parma, Italy
| | - Andrew L Wong
- Department of Radiology, UC Davis Health, Sacramento, CA, USA
| | - Dani Sarohia
- Department of Radiology, UC Davis Health, Sacramento, CA, USA
| | - Cyrus Bateni
- Department of Radiology, UC Davis Health, Sacramento, CA, USA
| | - Morgan A Darrow
- Pathology and Laboratory Medicine, University of California Davis, Sacramento, CA, USA
| | - Michele Guindani
- Department of Biostatistics, Fielding School of Public Health, University of California, Los Angeles, CA, USA
| | - Sonia Lee
- Department of Radiological Sciences, University of California, Irvine, CA, USA
| | - Michelle Zhang
- Department of Diagnostic Radiology, McGill University Health Center, Montreal, Canada
| | - Ahmed W Moawad
- Department of Diagnostic Imaging, University of Texas MD Anderson Cancer Center, Houston, TX, USA
- Department of Diagnostic Radiology, Mercy Catholic Medical Center, Darby, PA, USA
| | | | - Layla Shere
- Department of Diagnostic Imaging, University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Khaled M Elsayes
- Department of Diagnostic Imaging, University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | | | - Thomas M Link
- Department of Radiology and Biomedical Imaging, University of California, San Francisco, CA, USA
| | - Lorenzo Nardo
- Department of Radiology, UC Davis Health, Sacramento, CA, USA
| | - Jinyi Qi
- Department of Biomedical Engineering, University of California, Davis, CA, USA.
| |
Collapse
|