1
|
Aydin Şimşek Ş, Aydin A, Say F, Cengiz T, Özcan C, Öztürk M, Okay E, Özkan K. Enhanced enchondroma detection from x-ray images using deep learning: A step towards accurate and cost-effective diagnosis. J Orthop Res 2024; 42:2826-2834. [PMID: 39007705 DOI: 10.1002/jor.25938] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/05/2024] [Revised: 06/27/2024] [Accepted: 07/03/2024] [Indexed: 07/16/2024]
Abstract
This study investigates the automated detection of enchondromas, benign cartilage tumors, from x-ray images using deep learning techniques. Enchondromas pose diagnostic challenges due to their potential for malignant transformation and overlapping radiographic features with other conditions. Leveraging a data set comprising 1645 x-ray images from 1173 patients, a deep-learning model implemented with Detectron2 achieved an accuracy of 0.9899 in detecting enchondromas. The study employed rigorous validation processes and compared its findings with the existing literature, highlighting the superior performance of the deep learning approach. Results indicate the potential of machine learning in improving diagnostic accuracy and reducing healthcare costs associated with advanced imaging modalities. The study underscores the significance of early and accurate detection of enchondromas for effective patient management and suggests avenues for further research in musculoskeletal tumor detection.
Collapse
Affiliation(s)
- Şafak Aydin Şimşek
- Department of Orthopedics and Traumatology, Faculty of Medicine, Ondokuz Mayis University, Samsun, Turkey
| | - Ayhan Aydin
- Department of Computer Engineering, Karabuk University, Karabük, Turkey
| | - Ferhat Say
- Department of Orthopedics and Traumatology, Faculty of Medicine, Ondokuz Mayis University, Samsun, Turkey
| | - Tolgahan Cengiz
- Clinic of Orthopedics and Traumatology, Inebolu State Hospital, Kastamonu, Turkey
| | - Caner Özcan
- Department of Software Engineering, Karabuk University, Karabük, Turkey
| | - Mesut Öztürk
- Department of Radiology, Faculty of Medicine, Samsun University, Samsun, Turkey
| | - Erhan Okay
- Department of Orthopedics and Traumatology, Istanbul Medeniyet University Goztepe Education and Research Hospital, İstanbul, Turkey
| | - Korhan Özkan
- Department of Orthopedics and Traumatology, Acıbadem Atasehir Hospital, Istanbul, Turkey
| |
Collapse
|
2
|
Ghasemi A, Ahlawat S. Bone Reporting and Data System (Bone-RADS) and Other Proposed Practice Guidelines for Reporting Bone Tumors. ROFO-FORTSCHR RONTG 2024; 196:1134-1142. [PMID: 38490222 DOI: 10.1055/a-2262-8411] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/17/2024]
Abstract
BACKGROUND The purpose of this article is to review the different bone tumor radiology reporting systems [Bone Reporting and Data System (Bone-RADS), Osseous Tumor Reporting and Data System (OT-RADS), Solitary Bone Tumor Imaging Reporting and Data System (BTI-RADS), and Radiological Evaluation Score for Bone Tumors (REST)] and summarize their advantages and disadvantages. METHODS A selective search of PubMed was performed for literature regarding the definition and discussion of bone tumor reporting systems. No time frame was selected, but the search was particularly focused on current literature on musculoskeletal radiology lexicon. RESULTS To date, four major reporting systems has been proposed to standardize and systematize the reporting of imaging studies of bone tumors: Bone-RADS, OT-RADS, BTI-RADS, and REST. Both Bone-RADS and OT-RADS aid in the characterization and management of bone lesions on CT and MRI. OT-RADS and REST can be applied to MRI and radiography, respectively. CONCLUSION Radiologists play a central role in the detection and characterization of asymptomatic (or incidentally detected) and symptomatic bone tumors. There are several existing bone tumor reporting systems with various advantages and disadvantages including emphasis on lesion characterization as well as management of incidentally detected bone lesions. KEY POINTS · Four bone tumor reporting systems have been proposed thus far.. · Bone-RADS guides management of incidental bone lesions on CT and MRI.. · OT-RADS guides management of bone lesions on MRI with high accuracy.. · BTI-RADS classifies bone tumors on CT and MRI.. CITATION FORMAT · Ghasemi A, Ahlawat S, . Bone Reporting and Data System (Bone-RADS) and Other Proposed Practice Guidelines for Reporting Bone Tumors. Fortschr Röntgenstr 2024; 196: 1134 - 1142.
Collapse
Affiliation(s)
- Ali Ghasemi
- Russell H. Morgan Department of Radiology and Radiological Sciences, Johns Hopkins Medical Institutions Campus, Baltimore, United States
| | - Shivani Ahlawat
- Russell H. Morgan Department of Radiology and Radiological Sciences, Johns Hopkins Medical Institutions Campus, Baltimore, United States
| |
Collapse
|
3
|
Murthy S, Thakur U, Ghasemi A, Ahlawat S. Advances in Musculoskeletal Tumor Imaging. Semin Roentgenol 2024; 59:477-488. [PMID: 39490041 DOI: 10.1053/j.ro.2024.07.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2024] [Revised: 07/08/2024] [Accepted: 07/11/2024] [Indexed: 11/05/2024]
Affiliation(s)
- Sindhoora Murthy
- Department of Radiology and Radiological Sciences, Johns Hopkins University School of Medicine, 601 North Caroline Street, 3rd floor, Baltimore, MD, 21287
| | - Uma Thakur
- Department of Radiology, University of Texas Southwestern Medical Center, Dallas, TX
| | - Ali Ghasemi
- Department of Radiology and Radiological Sciences, Johns Hopkins University School of Medicine, 601 North Caroline Street, 3rd floor, Baltimore, MD, 21287
| | - Shivani Ahlawat
- Department of Radiology and Radiological Sciences, Johns Hopkins University School of Medicine, 601 North Caroline Street, 3rd floor, Baltimore, MD, 21287.
| |
Collapse
|
4
|
Van Den Berghe T, Delbare F, Candries E, Lejoly M, Algoet C, Chen M, Laloo F, Huysse WCJ, Creytens D, Verstraete KL. A retrospective external validation study of the Birmingham Atypical Cartilage Tumour Imaging Protocol (BACTIP) for the management of solitary central cartilage tumours of the proximal humerus and around the knee. Eur Radiol 2024; 34:4988-5006. [PMID: 38319428 DOI: 10.1007/s00330-024-10604-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2023] [Revised: 12/01/2023] [Accepted: 12/20/2023] [Indexed: 02/07/2024]
Abstract
OBJECTIVES This study aimed to externally validate the Birmingham Atypical Cartilage Tumour Imaging Protocol (BACTIP) recommendations for differentiation/follow-up of central cartilage tumours (CCTs) of the proximal humerus, distal femur, and proximal tibia and to propose BACTIP adaptations if the results provide new insights. METHODS MRIs of 123 patients (45 ± 11 years, 37 men) with an untreated CCT with MRI follow-up (n = 62) or histopathological confirmation (n = 61) were retrospectively/consecutively included and categorised following the BACTIP (2003-2020 / Ghent University Hospital/Belgium). Tumour length and endosteal scalloping differences between enchondroma, atypical cartilaginous tumour (ACT), and high-grade chondrosarcoma (CS II/III/dedifferentiated) were evaluated. ROC-curve analysis for differentiating benign from malignant CCTs and for evaluating the BACTIP was performed. RESULTS For lesion length and endosteal scalloping, ROC-AUCs were poor and fair-excellent, respectively, for differentiating different CCT groups (0.59-0.69 versus 0.73-0.91). The diagnostic performance of endosteal scalloping and the BACTIP was higher than that of lesion length. A 1° endosteal scalloping cut-off differentiated enchondroma from ACT + high-grade chondrosarcoma with a sensitivity of 90%, reducing the potential diagnostic delay. However, the specificity was 29%, inducing overmedicalisation (excessive follow-up). ROC-AUC of the BACTIP was poor for differentiating enchondroma from ACT (ROC-AUC = 0.69; 95%CI = 0.51-0.87; p = 0.041) and fair-good for differentiation between other CCT groups (ROC-AUC = 0.72-0.81). BACTIP recommendations were incorrect/unsafe in five ACTs and one CSII, potentially inducing diagnostic delay. Eleven enchondromas received unnecessary referrals/follow-up. CONCLUSION Although promising as a useful tool for management/follow-up of CCTs of the proximal humerus, distal femur, and proximal tibia, five ACTs and one chondrosarcoma grade II were discharged, potentially inducing diagnostic delay, which could be reduced by adapting BACTIP cut-off values. CLINICAL RELEVANCE STATEMENT Mostly, Birmingham Atypical Cartilage Tumour Imaging Protocol (BACTIP) assesses central cartilage tumours of the proximal humerus and the knee correctly. Both when using the BACTIP and when adapting cut-offs, caution should be taken for the trade-off between underdiagnosis/potential diagnostic delay in chondrosarcomas and overmedicalisation in enchondromas. KEY POINTS • This retrospective external validation confirms the Birmingham Atypical Cartilage Tumour Imaging Protocol as a useful tool for initial assessment and follow-up recommendation of central cartilage tumours in the proximal humerus and around the knee in the majority of cases. • Using only the Birmingham Atypical Cartilage Tumour Imaging Protocol, both atypical cartilaginous tumours and high-grade chondrosarcomas (grade II, grade III, and dedifferentiated chondrosarcomas) can be misdiagnosed, excluding them from specialist referral and further follow-up, thus creating a potential risk of delayed diagnosis and worse prognosis. • Adapted cut-offs to maximise detection of atypical cartilaginous tumours and high-grade chondrosarcomas, minimise underdiagnosis and reduce potential diagnostic delay in malignant tumours but increase unnecessary referral and follow-up of benign tumours.
Collapse
Affiliation(s)
- Thomas Van Den Berghe
- Department of Radiology and Medical Imaging, Ghent University Hospital, Corneel Heymanslaan 10, 9000, Ghent, Belgium.
- Department of Diagnostic Sciences, Ghent University, Sint-Pietersnieuwstraat 25, 9000, Ghent, Belgium.
| | - Felix Delbare
- Department of Radiology and Medical Imaging, Ghent University Hospital, Corneel Heymanslaan 10, 9000, Ghent, Belgium
- Department of Diagnostic Sciences, Ghent University, Sint-Pietersnieuwstraat 25, 9000, Ghent, Belgium
| | - Esther Candries
- Department of Radiology and Medical Imaging, Ghent University Hospital, Corneel Heymanslaan 10, 9000, Ghent, Belgium
- Department of Diagnostic Sciences, Ghent University, Sint-Pietersnieuwstraat 25, 9000, Ghent, Belgium
| | - Maryse Lejoly
- Department of Radiology and Medical Imaging, Ghent University Hospital, Corneel Heymanslaan 10, 9000, Ghent, Belgium
- Department of Diagnostic Sciences, Ghent University, Sint-Pietersnieuwstraat 25, 9000, Ghent, Belgium
| | - Chloé Algoet
- Department of Radiology and Medical Imaging, Ghent University Hospital, Corneel Heymanslaan 10, 9000, Ghent, Belgium
- Department of Diagnostic Sciences, Ghent University, Sint-Pietersnieuwstraat 25, 9000, Ghent, Belgium
| | - Min Chen
- Department of Radiology, Peking University Shenzhen Hospital, Shenzhen, 518036, China
| | - Frederiek Laloo
- Department of Radiology and Medical Imaging, Ghent University Hospital, Corneel Heymanslaan 10, 9000, Ghent, Belgium
- Department of Diagnostic Sciences, Ghent University, Sint-Pietersnieuwstraat 25, 9000, Ghent, Belgium
| | - Wouter C J Huysse
- Department of Radiology and Medical Imaging, Ghent University Hospital, Corneel Heymanslaan 10, 9000, Ghent, Belgium
- Department of Diagnostic Sciences, Ghent University, Sint-Pietersnieuwstraat 25, 9000, Ghent, Belgium
| | - David Creytens
- Department of Pathology, Ghent University Hospital, Corneel Heymanslaan 10, 9000, Ghent, Belgium
| | - Koenraad L Verstraete
- Department of Radiology and Medical Imaging, Ghent University Hospital, Corneel Heymanslaan 10, 9000, Ghent, Belgium
- Department of Diagnostic Sciences, Ghent University, Sint-Pietersnieuwstraat 25, 9000, Ghent, Belgium
| |
Collapse
|
5
|
Li X, Zhang J, Leng Y, Liu J, Li L, Wan T, Dong W, Fan B, Gong L. Preoperative prediction of histopathological grading in patients with chondrosarcoma using MRI-based radiomics with semantic features. BMC Med Imaging 2024; 24:171. [PMID: 38992609 PMCID: PMC11238384 DOI: 10.1186/s12880-024-01330-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2023] [Accepted: 06/10/2024] [Indexed: 07/13/2024] Open
Abstract
BACKGROUND Distinguishing high-grade from low-grade chondrosarcoma is extremely vital not only for guiding the development of personalized surgical treatment but also for predicting the prognosis of patients. We aimed to establish and validate a magnetic resonance imaging (MRI)-based nomogram for predicting preoperative grading in patients with chondrosarcoma. METHODS Approximately 114 patients (60 and 54 cases with high-grade and low-grade chondrosarcoma, respectively) were recruited for this retrospective study. All patients were treated via surgery and histopathologically proven, and they were randomly divided into training (n = 80) and validation (n = 34) sets at a ratio of 7:3. Next, radiomics features were extracted from two sequences using the least absolute shrinkage and selection operator (LASSO) algorithms. The rad-scores were calculated and then subjected to logistic regression to develop a radiomics model. A nomogram combining independent predictive semantic features with radiomic by using multivariate logistic regression was established. The performance of each model was assessed by the receiver operating characteristic (ROC) curve analysis and the area under the curve, while clinical efficacy was evaluated via decision curve analysis (DCA). RESULTS Ultimately, six optimal radiomics signatures were extracted from T1-weighted imaging (T1WI) and T2-weighted imaging with fat suppression (T2WI-FS) sequences to develop the radiomics model. Tumour cartilage abundance, which emerged as an independent predictor, was significantly related to chondrosarcoma grading (p < 0.05). The AUC values of the radiomics model were 0.85 (95% CI, 0.76 to 0.95) in the training sets, and the corresponding AUC values in the validation sets were 0.82 (95% CI, 0.65 to 0.98), which were far superior to the clinical model AUC values of 0.68 (95% CI, 0.58 to 0.79) in the training sets and 0.72 (95% CI, 0.57 to 0.87) in the validation sets. The nomogram demonstrated good performance in the preoperative distinction of chondrosarcoma. The DCA analysis revealed that the nomogram model had a markedly higher clinical usefulness in predicting chondrosarcoma grading preoperatively than either the rad-score or clinical model alone. CONCLUSION The nomogram based on MRI radiomics combined with optimal independent factors had better performance for the preoperative differentiation between low-grade and high-grade chondrosarcoma and has potential as a noninvasive preoperative tool for personalizing clinical plans.
Collapse
Affiliation(s)
- Xiaofen Li
- 1Department of Radiology, Jiangxi Provincial People's Hospital, The First Affiliated Hospital of Nanchang Medical College, Nanchang, 330006, China
| | - Jingkun Zhang
- 2Department of Radiology, The Affiliated Hospital of Jiangxi University of Traditional Chinese Medicine, Nanchang, 330006, China
| | - Yinping Leng
- Department of Medical Imaging Center, The Second Affiliated Hospital of Nanchang University, No.1 Minde Road, Donghu District, Nanchang, 330006, China
| | - Jiaqi Liu
- 1Department of Radiology, Jiangxi Provincial People's Hospital, The First Affiliated Hospital of Nanchang Medical College, Nanchang, 330006, China
| | - Linlin Li
- 1Department of Radiology, Jiangxi Provincial People's Hospital, The First Affiliated Hospital of Nanchang Medical College, Nanchang, 330006, China
| | - Tianyi Wan
- 1Department of Radiology, Jiangxi Provincial People's Hospital, The First Affiliated Hospital of Nanchang Medical College, Nanchang, 330006, China
| | - Wentao Dong
- 1Department of Radiology, Jiangxi Provincial People's Hospital, The First Affiliated Hospital of Nanchang Medical College, Nanchang, 330006, China
| | - Bing Fan
- 1Department of Radiology, Jiangxi Provincial People's Hospital, The First Affiliated Hospital of Nanchang Medical College, Nanchang, 330006, China
| | - Lianggeng Gong
- Department of Medical Imaging Center, The Second Affiliated Hospital of Nanchang University, No.1 Minde Road, Donghu District, Nanchang, 330006, China.
| |
Collapse
|
6
|
Usuff R, Kothandapani S, Rangan R, Dhatchnamurthy S. Enhancing radiographic image interpretation: WARES-PRS model for knee bone tumour detection. NETWORK (BRISTOL, ENGLAND) 2024:1-31. [PMID: 38932464 DOI: 10.1080/0954898x.2024.2357660] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/05/2024] [Accepted: 05/15/2024] [Indexed: 06/28/2024]
Abstract
The early diagnosis of tumour is significant in biomedical research field to lower the severity level and restrict the process extension from cancer. Moreover, the detection of early sign of cancer is undertaken with extensive research efforts that dedicated to the disclosure and recognition of tumours. However, the limited data size as well as diverse appearance of images lowered the detection performance and failed to detect complex stage of tumour. So to solve these issues, a Weighted Adaptive Random Ensemble Support Vector-based Partial Reinforcement Search (WARES-PRS) algorithm is proposed that detected bone lesions accurately and also predicted the severity level stage efficiently. Further, the detection is performed with varied stages to diminish the presence of noise and undertaken effective classification. The performance is validated with CNUH dataset that enhanced image pre-processing tasks. Despite the proposed method uncover the mutual relationships between each pixel's local texture and the overall image's global context. The detection and classification efficiency is validated with various measures and the experimental results revealed that the detection accuracy is enhanced for the proposed approach by 98.5%. The outcomes of our study have exhibited a substantial contribution to assisting physicians in the detection of knee bone tumours.
Collapse
Affiliation(s)
- Rahamathunnisa Usuff
- School of Computer Science Engineering and Information Systems, Vellore Institute of Technology, Vellore, Tamil Nadu, India
| | - Sudhakar Kothandapani
- Department of Computer Science & Engineering, Madanapalle Institute of Technology & Science, Madanapalle, Andhra Pradesh, India
| | - Rajesh Rangan
- Department of Computer Science and Engineering, School of Computing, Vel Tech Rangarajan Dr.Sagunthala R&D Institute of Science and Technology, Avadi, Chennai, India
| | - Saravanan Dhatchnamurthy
- Department of Computer Science and Engineering, School of Computing, Sathyabama Institute of Science and Technology, Chennai, India
| |
Collapse
|
7
|
Salehi MA, Mohammadi S, Harandi H, Zakavi SS, Jahanshahi A, Shahrabi Farahani M, Wu JS. Diagnostic Performance of Artificial Intelligence in Detection of Primary Malignant Bone Tumors: a Meta-Analysis. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024; 37:766-777. [PMID: 38343243 PMCID: PMC11031503 DOI: 10.1007/s10278-023-00945-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Revised: 10/04/2023] [Accepted: 10/12/2023] [Indexed: 04/20/2024]
Abstract
We aim to conduct a meta-analysis on studies that evaluated the diagnostic performance of artificial intelligence (AI) algorithms in the detection of primary bone tumors, distinguishing them from other bone lesions, and comparing them with clinician assessment. A systematic search was conducted using a combination of keywords related to bone tumors and AI. After extracting contingency tables from all included studies, we performed a meta-analysis using random-effects model to determine the pooled sensitivity and specificity, accompanied by their respective 95% confidence intervals (CI). Quality assessment was evaluated using a modified version of Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD) and Prediction Model Study Risk of Bias Assessment Tool (PROBAST). The pooled sensitivities for AI algorithms and clinicians on internal validation test sets for detecting bone neoplasms were 84% (95% CI: 79.88) and 76% (95% CI: 64.85), and pooled specificities were 86% (95% CI: 81.90) and 64% (95% CI: 55.72), respectively. At external validation, the pooled sensitivity and specificity for AI algorithms were 84% (95% CI: 75.90) and 91% (95% CI: 83.96), respectively. The same numbers for clinicians were 85% (95% CI: 73.92) and 94% (95% CI: 89.97), respectively. The sensitivity and specificity for clinicians with AI assistance were 95% (95% CI: 86.98) and 57% (95% CI: 48.66). Caution is needed when interpreting findings due to potential limitations. Further research is needed to bridge this gap in scientific understanding and promote effective implementation for medical practice advancement.
Collapse
Affiliation(s)
- Mohammad Amin Salehi
- School of Medicine, Tehran University of Medical Sciences, Pour Sina St, Keshavarz Blvd, Tehran, 1417613151, Iran
| | - Soheil Mohammadi
- School of Medicine, Tehran University of Medical Sciences, Pour Sina St, Keshavarz Blvd, Tehran, 1417613151, Iran.
| | - Hamid Harandi
- School of Medicine, Tehran University of Medical Sciences, Pour Sina St, Keshavarz Blvd, Tehran, 1417613151, Iran
| | - Seyed Sina Zakavi
- School of Medicine, Tabriz University of Medical Sciences, Tabriz, Iran
| | - Ali Jahanshahi
- School of Medicine, Guilan University of Medical Sciences, Rasht, Iran
| | | | - Jim S Wu
- Department of Radiology, Beth Israel Deaconess Medical Center, Harvard Medical School, 330 Brookline Avenue, Boston, MA, 02215, USA
| |
Collapse
|
8
|
Gitto S, Annovazzi A, Nulle K, Interlenghi M, Salvatore C, Anelli V, Baldi J, Messina C, Albano D, Di Luca F, Armiraglio E, Parafioriti A, Luzzati A, Biagini R, Castiglioni I, Sconfienza LM. X-rays radiomics-based machine learning classification of atypical cartilaginous tumour and high-grade chondrosarcoma of long bones. EBioMedicine 2024; 101:105018. [PMID: 38377797 PMCID: PMC10884340 DOI: 10.1016/j.ebiom.2024.105018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2023] [Revised: 02/03/2024] [Accepted: 02/04/2024] [Indexed: 02/22/2024] Open
Abstract
BACKGROUND Atypical cartilaginous tumour (ACT) and high-grade chondrosarcoma (CS) of long bones are respectively managed with active surveillance or curettage and wide resection. Our aim was to determine diagnostic performance of X-rays radiomics-based machine learning for classification of ACT and high-grade CS of long bones. METHODS This retrospective, IRB-approved study included 150 patients with surgically treated and histology-proven lesions at two tertiary bone sarcoma centres. At centre 1, the dataset was split into training (n = 71 ACT, n = 24 high-grade CS) and internal test (n = 19 ACT, n = 6 high-grade CS) cohorts, respectively, based on the date of surgery. At centre 2, the dataset constituted the external test cohort (n = 12 ACT, n = 18 high-grade CS). Manual segmentation was performed on frontal view X-rays, using MRI or CT for preliminary identification of lesion margins. After image pre-processing, radiomic features were extracted. Dimensionality reduction included stability, coefficient of variation, and mutual information analyses. In the training cohort, after class balancing, a machine learning classifier (Support Vector Machine) was automatically tuned using nested 10-fold cross-validation. Then, it was tested on both the test cohorts and compared to two musculoskeletal radiologists' performance using McNemar's test. FINDINGS Five radiomic features (3 morphology, 2 texture) passed dimensionality reduction. After tuning on the training cohort (AUC = 0.75), the classifier had 80%, 83%, 79% and 80%, 89%, 67% accuracy, sensitivity, and specificity in the internal (temporally independent) and external (geographically independent) test cohorts, respectively, with no difference compared to the radiologists (p ≥ 0.617). INTERPRETATION X-rays radiomics-based machine learning accurately differentiates between ACT and high-grade CS of long bones. FUNDING AIRC Investigator Grant.
Collapse
Affiliation(s)
- Salvatore Gitto
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy; Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milan, Italy
| | - Alessio Annovazzi
- Nuclear Medicine Unit, IRCCS Regina Elena National Cancer Institute, Rome, Italy
| | - Kitija Nulle
- Radiology Department, Riga East Clinical University Hospital, Riga, Latvia
| | | | - Christian Salvatore
- DeepTrace Technologies s.r.l., Milan, Italy; Department of Science, Technology and Society, University School for Advanced Studies IUSS Pavia, Pavia, Italy
| | - Vincenzo Anelli
- Radiology and Diagnostic Imaging Unit, IRCCS Regina Elena National Cancer Institute, Rome, Italy
| | - Jacopo Baldi
- Oncological Orthopaedics Unit, IRCCS Regina Elena National Cancer Institute, Rome, Italy
| | - Carmelo Messina
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy; Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milan, Italy
| | - Domenico Albano
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy; Dipartimento di Scienze Biomediche, Chirurgiche ed Odontoiatriche, Università degli Studi di Milano, Milan, Italy
| | - Filippo Di Luca
- Scuola di Specializzazione in Radiodiagnostica, Università degli Studi di Milano, Milan, Italy
| | | | | | | | - Roberto Biagini
- Oncological Orthopaedics Unit, IRCCS Regina Elena National Cancer Institute, Rome, Italy
| | - Isabella Castiglioni
- Department of Physics "G. Occhialini", Università degli Studi di Milano-Bicocca, Milan, Italy
| | - Luca Maria Sconfienza
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy; Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milan, Italy.
| |
Collapse
|
9
|
Gitto S, Cuocolo R, Huisman M, Messina C, Albano D, Omoumi P, Kotter E, Maas M, Van Ooijen P, Sconfienza LM. CT and MRI radiomics of bone and soft-tissue sarcomas: an updated systematic review of reproducibility and validation strategies. Insights Imaging 2024; 15:54. [PMID: 38411750 PMCID: PMC10899555 DOI: 10.1186/s13244-024-01614-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2023] [Accepted: 01/09/2024] [Indexed: 02/28/2024] Open
Abstract
OBJECTIVE To systematically review radiomic feature reproducibility and model validation strategies in recent studies dealing with CT and MRI radiomics of bone and soft-tissue sarcomas, thus updating a previous version of this review which included studies published up to 2020. METHODS A literature search was conducted on EMBASE and PubMed databases for papers published between January 2021 and March 2023. Data regarding radiomic feature reproducibility and model validation strategies were extracted and analyzed. RESULTS Out of 201 identified papers, 55 were included. They dealt with radiomics of bone (n = 23) or soft-tissue (n = 32) tumors. Thirty-two (out of 54 employing manual or semiautomatic segmentation, 59%) studies included a feature reproducibility analysis. Reproducibility was assessed based on intra/interobserver segmentation variability in 30 (55%) and geometrical transformations of the region of interest in 2 (4%) studies. At least one machine learning validation technique was used for model development in 34 (62%) papers, and K-fold cross-validation was employed most frequently. A clinical validation of the model was reported in 38 (69%) papers. It was performed using a separate dataset from the primary institution (internal test) in 22 (40%), an independent dataset from another institution (external test) in 14 (25%) and both in 2 (4%) studies. CONCLUSIONS Compared to papers published up to 2020, a clear improvement was noted with almost double publications reporting methodological aspects related to reproducibility and validation. Larger multicenter investigations including external clinical validation and the publication of databases in open-access repositories could further improve methodology and bring radiomics from a research area to the clinical stage. CRITICAL RELEVANCE STATEMENT An improvement in feature reproducibility and model validation strategies has been shown in this updated systematic review on radiomics of bone and soft-tissue sarcomas, highlighting efforts to enhance methodology and bring radiomics from a research area to the clinical stage. KEY POINTS • 2021-2023 radiomic studies on CT and MRI of musculoskeletal sarcomas were reviewed. • Feature reproducibility was assessed in more than half (59%) of the studies. • Model clinical validation was performed in 69% of the studies. • Internal (44%) and/or external (29%) test datasets were employed for clinical validation.
Collapse
Affiliation(s)
- Salvatore Gitto
- Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milan, Italy
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
| | - Renato Cuocolo
- Department of Medicine, Surgery and Dentistry, University of Salerno, Baronissi, Italy
| | - Merel Huisman
- Radboud University Medical Center, Department of Radiology and Nuclear Medicine, Nijmegen, The Netherlands
| | - Carmelo Messina
- Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milan, Italy
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
| | - Domenico Albano
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
- Dipartimento di Scienze Biomediche, Chirurgiche ed Odontoiatriche, Università degli Studi di Milano, Milan, Italy
| | - Patrick Omoumi
- Department of Radiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland
| | - Elmar Kotter
- Department of Radiology, Freiburg University Medical Center, Freiburg, Germany
| | - Mario Maas
- Department of Radiology and Nuclear Medicine, Amsterdam UMC Location University of Amsterdam, Amsterdam, The Netherlands
| | - Peter Van Ooijen
- Department of Radiation Oncology, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
| | - Luca Maria Sconfienza
- Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milan, Italy.
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy.
| |
Collapse
|
10
|
Gitto S, Serpi F, Albano D, Risoleo G, Fusco S, Messina C, Sconfienza LM. AI applications in musculoskeletal imaging: a narrative review. Eur Radiol Exp 2024; 8:22. [PMID: 38355767 PMCID: PMC10866817 DOI: 10.1186/s41747-024-00422-8] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2023] [Accepted: 12/29/2023] [Indexed: 02/16/2024] Open
Abstract
This narrative review focuses on clinical applications of artificial intelligence (AI) in musculoskeletal imaging. A range of musculoskeletal disorders are discussed using a clinical-based approach, including trauma, bone age estimation, osteoarthritis, bone and soft-tissue tumors, and orthopedic implant-related pathology. Several AI algorithms have been applied to fracture detection and classification, which are potentially helpful tools for radiologists and clinicians. In bone age assessment, AI methods have been applied to assist radiologists by automatizing workflow, thus reducing workload and inter-observer variability. AI may potentially aid radiologists in identifying and grading abnormal findings of osteoarthritis as well as predicting the onset or progression of this disease. Either alone or combined with radiomics, AI algorithms may potentially improve diagnosis and outcome prediction of bone and soft-tissue tumors. Finally, information regarding appropriate positioning of orthopedic implants and related complications may be obtained using AI algorithms. In conclusion, rather than replacing radiologists, the use of AI should instead help them to optimize workflow, augment diagnostic performance, and keep up with ever-increasing workload.Relevance statement This narrative review provides an overview of AI applications in musculoskeletal imaging. As the number of AI technologies continues to increase, it will be crucial for radiologists to play a role in their selection and application as well as to fully understand their potential value in clinical practice. Key points • AI may potentially assist musculoskeletal radiologists in several interpretative tasks.• AI applications to trauma, age estimation, osteoarthritis, tumors, and orthopedic implants are discussed.• AI should help radiologists to optimize workflow and augment diagnostic performance.
Collapse
Affiliation(s)
- Salvatore Gitto
- Department of Biomedical Sciences for Health, Università degli Studi di Milano, Via Cristina Belgioioso 173, Milan, 20157, Italy
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
| | - Francesca Serpi
- Department of Biomedical Sciences for Health, Università degli Studi di Milano, Via Cristina Belgioioso 173, Milan, 20157, Italy
| | - Domenico Albano
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
- Dipartimento di Scienze Biomediche, Chirurgiche ed Odontoiatriche, Università degli Studi di Milano, Milan, Italy
| | - Giovanni Risoleo
- Scuola di Specializzazione in Radiodiagnostica, Università degli Studi di Milano, Milan, Italy
| | - Stefano Fusco
- Department of Biomedical Sciences for Health, Università degli Studi di Milano, Via Cristina Belgioioso 173, Milan, 20157, Italy
| | - Carmelo Messina
- Department of Biomedical Sciences for Health, Università degli Studi di Milano, Via Cristina Belgioioso 173, Milan, 20157, Italy
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
| | - Luca Maria Sconfienza
- Department of Biomedical Sciences for Health, Università degli Studi di Milano, Via Cristina Belgioioso 173, Milan, 20157, Italy.
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy.
| |
Collapse
|
11
|
Pizzuto DA, Calandriello L, De Martino I, De Micheli ML, De Summa M, Annunziata S. Positron emission tomography/magnetic resonance in musculoskeletal disorders: proper sequences and workflow optimization. Clin Transl Imaging 2024; 12:253-261. [DOI: 10.1007/s40336-023-00611-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Accepted: 12/17/2023] [Indexed: 04/23/2025]
|
12
|
Doniselli FM, Pascuzzo R, Agrò M, Aquino D, Anghileri E, Farinotti M, Pollo B, Paterra R, Cuccarini V, Moscatelli M, DiMeco F, Sconfienza LM. Development of A Radiomic Model for MGMT Promoter Methylation Detection in Glioblastoma Using Conventional MRI. Int J Mol Sci 2023; 25:138. [PMID: 38203308 PMCID: PMC10778771 DOI: 10.3390/ijms25010138] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2023] [Revised: 12/15/2023] [Accepted: 12/18/2023] [Indexed: 01/12/2024] Open
Abstract
The methylation of the O6-methylguanine-DNA methyltransferase (MGMT) promoter is a molecular marker associated with a better response to chemotherapy in patients with glioblastoma (GB). Standard pre-operative magnetic resonance imaging (MRI) analysis is not adequate to detect MGMT promoter methylation. This study aims to evaluate whether the radiomic features extracted from multiple tumor subregions using multiparametric MRI can predict MGMT promoter methylation status in GB patients. This retrospective single-institution study included a cohort of 277 GB patients whose 3D post-contrast T1-weighted images and 3D fluid-attenuated inversion recovery (FLAIR) images were acquired using two MRI scanners. Three separate regions of interest (ROIs) showing tumor enhancement, necrosis, and FLAIR hyperintensities were manually segmented for each patient. Two machine learning algorithms (support vector machine (SVM) and random forest) were built for MGMT promoter methylation prediction from a training cohort (196 patients) and tested on a separate validation cohort (81 patients), based on a set of automatically selected radiomic features, with and without demographic variables (i.e., patients' age and sex). In the training set, SVM based on the selected radiomic features of the three separate ROIs achieved the best performances, with an average of 83.0% (standard deviation: 5.7%) for accuracy and 0.894 (0.056) for the area under the curve (AUC) computed through cross-validation. In the test set, all classification performances dropped: the best was obtained by SVM based on the selected features extracted from the whole tumor lesion constructed by merging the three ROIs, with 64.2% (95% confidence interval: 52.8-74.6%) accuracy and 0.572 (0.439-0.705) for AUC. The performances did not change when the patients' age and sex were included with the radiomic features into the models. Our study confirms the presence of a subtle association between imaging characteristics and MGMT promoter methylation status. However, further verification of the strength of this association is needed, as the low diagnostic performance obtained in this validation cohort is not sufficiently robust to allow clinically meaningful predictions.
Collapse
Affiliation(s)
- Fabio M. Doniselli
- Neuroradiology Unit, Fondazione IRCCS Istituto Neurologico Carlo Besta, 20133 Milan, Italy; (F.M.D.); (D.A.); (V.C.)
- Department of Biomedical Sciences for Health, Università Degli Studi di Milano, 20133 Milan, Italy
| | - Riccardo Pascuzzo
- Neuroradiology Unit, Fondazione IRCCS Istituto Neurologico Carlo Besta, 20133 Milan, Italy; (F.M.D.); (D.A.); (V.C.)
| | - Massimiliano Agrò
- Post-Graduate School in Radiodiagnostics, Università Degli Studi di Milano, 20122 Milan, Italy
| | - Domenico Aquino
- Neuroradiology Unit, Fondazione IRCCS Istituto Neurologico Carlo Besta, 20133 Milan, Italy; (F.M.D.); (D.A.); (V.C.)
| | - Elena Anghileri
- Neuro-Oncology Unit, Fondazione IRCCS Istituto Neurologico Carlo Besta, 20133 Milan, Italy; (E.A.)
| | - Mariangela Farinotti
- Neuroepidemiology Unit, Fondazione IRCCS Istituto Neurologico Carlo Besta, 20133 Milan, Italy;
| | - Bianca Pollo
- Neuropathology Unit, Fondazione IRCCS Istituto Neurologico Carlo Besta, 20133 Milan, Italy
| | - Rosina Paterra
- Neuro-Oncology Unit, Fondazione IRCCS Istituto Neurologico Carlo Besta, 20133 Milan, Italy; (E.A.)
| | - Valeria Cuccarini
- Neuroradiology Unit, Fondazione IRCCS Istituto Neurologico Carlo Besta, 20133 Milan, Italy; (F.M.D.); (D.A.); (V.C.)
| | - Marco Moscatelli
- Neuroradiology Unit, Fondazione IRCCS Istituto Neurologico Carlo Besta, 20133 Milan, Italy; (F.M.D.); (D.A.); (V.C.)
- Department of Biomedical Sciences for Health, Università Degli Studi di Milano, 20133 Milan, Italy
| | - Francesco DiMeco
- Department of Neurosurgery, Fondazione IRCCS Istituto Neurologico Carlo Besta, 20133 Milan, Italy;
- Department of Oncology and Hematology-Oncology, Università Degli Studi di Milano, 20122 Milan, Italy
- Department of Neurological Surgery, Johns Hopkins Medical School, Baltimore, MD 21205, USA
| | - Luca Maria Sconfienza
- Department of Biomedical Sciences for Health, Università Degli Studi di Milano, 20133 Milan, Italy
- Radiology Unit, IRCCS Istituto Ortopedico Galeazzi, 20157 Milan, Italy
| |
Collapse
|
13
|
Meng Y, Yang Y, Hu M, Zhang Z, Zhou X. Artificial intelligence-based radiomics in bone tumors: Technical advances and clinical application. Semin Cancer Biol 2023; 95:75-87. [PMID: 37499847 DOI: 10.1016/j.semcancer.2023.07.003] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2023] [Revised: 07/21/2023] [Accepted: 07/22/2023] [Indexed: 07/29/2023]
Abstract
Radiomics is the extraction of predefined mathematic features from medical images for predicting variables of clinical interest. Recent research has demonstrated that radiomics can be processed by artificial intelligence algorithms to reveal complex patterns and trends for diagnosis, and prediction of prognosis and response to treatment modalities in various types of cancer. Artificial intelligence tools can utilize radiological images to solve next-generation issues in clinical decision making. Bone tumors can be classified as primary and secondary (metastatic) tumors. Osteosarcoma, Ewing sarcoma, and chondrosarcoma are the dominating primary tumors of bone. The development of bone tumor model systems and relevant research, and the assessment of novel treatment methods are ongoing to improve clinical outcomes, notably for patients with metastases. Artificial intelligence and radiomics have been utilized in almost full spectrum of clinical care of bone tumors. Radiomics models have achieved excellent performance in the diagnosis and grading of bone tumors. Furthermore, the models enable to predict overall survival, metastases, and recurrence. Radiomics features have exhibited promise in assisting therapeutic planning and evaluation, especially neoadjuvant chemotherapy. This review provides an overview of the evolution and opportunities for artificial intelligence in imaging, with a focus on hand-crafted features and deep learning-based radiomics approaches. We summarize the current application of artificial intelligence-based radiomics both in primary and metastatic bone tumors, and discuss the limitations and future opportunities of artificial intelligence-based radiomics in this field. In the era of personalized medicine, our in-depth understanding of emerging artificial intelligence-based radiomics approaches will bring innovative solutions to bone tumors and achieve clinical application.
Collapse
Affiliation(s)
- Yichen Meng
- Department of Orthopedics, Second Affiliated Hospital of Naval Medical University, Shanghai 200003, PR China
| | - Yue Yang
- Department of Orthopedics, Second Affiliated Hospital of Naval Medical University, Shanghai 200003, PR China
| | - Miao Hu
- Department of Orthopedics, Second Affiliated Hospital of Naval Medical University, Shanghai 200003, PR China
| | - Zheng Zhang
- Department of Orthopedics, Second Affiliated Hospital of Naval Medical University, Shanghai 200003, PR China.
| | - Xuhui Zhou
- Department of Orthopedics, Second Affiliated Hospital of Naval Medical University, Shanghai 200003, PR China.
| |
Collapse
|
14
|
Özgül HA, Akin IB, Mutlu U, Balci A. Diagnostic value of machine learning-based computed tomography texture analysis for differentiating multiple myeloma from osteolytic metastatic bone lesions in the peripheral skeleton. Skeletal Radiol 2023; 52:1703-1711. [PMID: 37014470 DOI: 10.1007/s00256-023-04333-4] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/28/2022] [Revised: 03/25/2023] [Accepted: 03/26/2023] [Indexed: 04/05/2023]
Abstract
OBJECTIVES To report the diagnostic performance of machine learning-based CT texture analysis for differentiating multiple myeloma from osteolytic metastatic bone lesions in the peripheral skeleton. METHODS We retrospectively evaluated 172 patients with multiple myeloma (n = 70) and osteolytic metastatic bone lesions (n = 102) in the peripheral skeleton. Two radiologists individually used two-dimensional manual segmentation to extract texture features from non-contrast CT. In total, 762 radiomic features were extracted. Dimension reduction was performed in three stages: inter-observer agreement analysis, collinearity analysis, and feature selection. Data were randomly divided into training (n = 120) and test (n = 52) groups. Eight machine learning algorithms were used for model development. The primary performance metrics were the area under the receiver operating characteristic curve and accuracy. RESULTS In total, 476 of the 762 texture features demonstrated excellent interobserver agreement. The number of features was reduced to 22 after excluding those with strong collinearity. Of these features, six were included in the machine learning algorithms using the wrapper-based classifier-specific technique. When all eight machine learning algorithms were considered for differentiating multiple myeloma from osteolytic metastatic bone lesions in the peripheral skeleton, the area under the receiver operating characteristic curve and accuracy were 0.776-0.932 and 78.8-92.3%, respectively. The k-nearest neighbors model performed the best, with the area under the receiver operating characteristic curve and accuracy values of 0.902 and 92.3%, respectively. CONCLUSION Machine learning-based CT texture analysis is a promising method for discriminating multiple myeloma from osteolytic metastatic bone lesions.
Collapse
Affiliation(s)
- Hakan Abdullah Özgül
- Department of Radiology, Kemalpaşa State Hospital, Kırovası Küme Street, Kemalpaşa, 35730, Izmir, Turkey.
| | - Işıl Başara Akin
- Department of Radiology, Dokuz Eylul University, Faculty of Medicine, Izmir, Turkey
| | - Uygar Mutlu
- Department of Radiology, Yozgat State Hospital, Yozgat, Turkey
| | - Ali Balci
- Department of Radiology, Dokuz Eylul University, Faculty of Medicine, Izmir, Turkey
| |
Collapse
|
15
|
Gitto S, Interlenghi M, Cuocolo R, Salvatore C, Giannetta V, Badalyan J, Gallazzi E, Spinelli MS, Gallazzi M, Serpi F, Messina C, Albano D, Annovazzi A, Anelli V, Baldi J, Aliprandi A, Armiraglio E, Parafioriti A, Daolio PA, Luzzati A, Biagini R, Castiglioni I, Sconfienza LM. MRI radiomics-based machine learning for classification of deep-seated lipoma and atypical lipomatous tumor of the extremities. LA RADIOLOGIA MEDICA 2023:10.1007/s11547-023-01657-y. [PMID: 37335422 DOI: 10.1007/s11547-023-01657-y] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/15/2023] [Accepted: 05/26/2023] [Indexed: 06/21/2023]
Abstract
PURPOSE To determine diagnostic performance of MRI radiomics-based machine learning for classification of deep-seated lipoma and atypical lipomatous tumor (ALT) of the extremities. MATERIAL AND METHODS This retrospective study was performed at three tertiary sarcoma centers and included 150 patients with surgically treated and histology-proven lesions. The training-validation cohort consisted of 114 patients from centers 1 and 2 (n = 64 lipoma, n = 50 ALT). The external test cohort consisted of 36 patients from center 3 (n = 24 lipoma, n = 12 ALT). 3D segmentation was manually performed on T1- and T2-weighted MRI. After extraction and selection of radiomic features, three machine learning classifiers were trained and validated using nested fivefold cross-validation. The best-performing classifier according to previous analysis was evaluated and compared to an experienced musculoskeletal radiologist in the external test cohort. RESULTS Eight features passed feature selection and were incorporated into the machine learning models. After training and validation (74% ROC-AUC), the best-performing classifier (Random Forest) showed 92% sensitivity and 33% specificity in the external test cohort with no statistical difference compared to the radiologist (p = 0.474). CONCLUSION MRI radiomics-based machine learning may classify deep-seated lipoma and ALT of the extremities with high sensitivity and negative predictive value, thus potentially serving as a non-invasive screening tool to reduce unnecessary referral to tertiary tumor centers.
Collapse
Affiliation(s)
- Salvatore Gitto
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
- Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milan, Italy
| | | | - Renato Cuocolo
- Department of Medicine, Surgery and Dentistry, University of Salerno, Baronissi, Italy
- Augmented Reality for Health Monitoring Laboratory (ARHeMLab), Department of Electrical Engineering and Information Technology, University of Naples "Federico II", Naples, Italy
| | - Christian Salvatore
- DeepTrace Technologies, Milan, Italy
- Department of Science, Technology and Society, University School for Advanced Studies IUSS Pavia, Pavia, Italy
| | - Vincenzo Giannetta
- Diagnostic and Interventional Radiology Department, IRCCS Ospedale San Raffaele-Turro, Università Vita-Salute San Raffaele, Milan, Italy
| | - Julietta Badalyan
- Scuola di Specializzazione in Statistica Sanitaria e Biometria, Università Degli Studi Di Milano, Milan, Italy
| | - Enrico Gallazzi
- UOC Patologia Vertebrale e Scoliosi, ASST Gaetano Pini - CTO, Milan, Italy
| | | | - Mauro Gallazzi
- UOC Radiodiagnostica, ASST Gaetano Pini - CTO, Milan, Italy
| | - Francesca Serpi
- Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milan, Italy
| | - Carmelo Messina
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
- Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milan, Italy
| | | | - Alessio Annovazzi
- Nuclear Medicine Unit, IRCCS Regina Elena National Cancer Institute, Rome, Italy
| | - Vincenzo Anelli
- Radiology and Diagnostic Imaging Unit, IRCCS Regina Elena National Cancer Institute, Rome, Italy
| | - Jacopo Baldi
- Oncological Orthopaedics Unit, IRCCS Regina Elena National Cancer Institute, Rome, Italy
| | | | | | | | | | | | - Roberto Biagini
- Oncological Orthopaedics Unit, IRCCS Regina Elena National Cancer Institute, Rome, Italy
| | - Isabella Castiglioni
- Department of Physics, Università degli Studi di Milano-Bicocca, Milan, Italy
- Institute of Biomedical Imaging and Physiology, Consiglio Nazionale Delle Ricerche, Segrate, Italy
| | - Luca Maria Sconfienza
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy.
- Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milan, Italy.
| |
Collapse
|
16
|
Cilengir AH, Evrimler S, Serel TA, Uluc E, Tosun O. The diagnostic value of magnetic resonance imaging-based texture analysis in differentiating enchondroma and chondrosarcoma. Skeletal Radiol 2023; 52:1039-1049. [PMID: 36434265 DOI: 10.1007/s00256-022-04242-y] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/01/2022] [Revised: 11/12/2022] [Accepted: 11/21/2022] [Indexed: 11/26/2022]
Abstract
OBJECTIVE To assess the diagnostic performance of MRI-based texture analysis for differentiating enchondromas and chondrosarcomas, especially on fat-suppressed proton density (FS-PD) images. MATERIALS AND METHODS The whole tumor volumes of 23 chondrosarcomas and 24 enchondromas were manually segmented on both FS-PD and T1-weighted images. A total of 861 radiomic features were extracted. SelectKBest was used to select the features. The data were randomly split into training (n = 36) and test (n = 10) for T1-weighted and training (n = 37) and test (n = 10) for FS-PD datasets. Fivefold cross-validation was performed. Fifteen machine learning models were created using the training set. The best models for T1-weighted, FS-PD, and T1-weighted + FS-PD images were selected in terms of accuracy and area under the curve (AUC). RESULTS There were 7 men and 16 women in the chondrosarcoma group (mean ± standard deviation age, 45.65 ± 11.24) and 7 men and 17 women in the enchondroma group (mean ± standard deviation age, 46.17 ± 11.79). Naive Bayes was the best model for accuracy and AUC for T1-weighted images (AUC = 0.76, accuracy = 80%, recall = 80%, precision = 80%, F1 score = 80%). The best model for FS-PD images was the K neighbors classifier for accuracy and AUC (AUC = 1.00, accuracy = 80%, recall = 80%, precision = 100%, F1 score = 89%). The best model for T1-weighted + FS-PD images was logistic regression for accuracy and AUC (AUC = 0.84, accuracy = 80%, recall = 60%, precision = 100%, F1 score = 75%). CONCLUSION MRI-based machine learning models have promising results in the discrimination of enchondroma and chondrosarcoma based on radiomic features obtained from both FS-PD and T1-weighted images.
Collapse
Affiliation(s)
- Atilla Hikmet Cilengir
- Faculty of Medicine, Department of Radiology, Izmir Democracy University, 35140, Konak, Izmir, Turkey.
| | - Sehnaz Evrimler
- Faculty of Medicine, Department of Radiology, Suleyman Demirel University, 32260, Isparta, Turkey
| | - Tekin Ahmet Serel
- Faculty of Medicine, Department of Urology, Suleyman Demirel University, 32260, Isparta, Turkey
| | - Engin Uluc
- Department of Radiology, Izmir Katip Celebi University Ataturk Training and Research Hospital, 35360, Karabaglar, Izmir, Turkey
| | - Ozgur Tosun
- Department of Radiology, Izmir Katip Celebi University Ataturk Training and Research Hospital, 35360, Karabaglar, Izmir, Turkey
| |
Collapse
|
17
|
Erdem F, Tamsel İ, Demirpolat G. The use of radiomics and machine learning for the differentiation of chondrosarcoma from enchondroma. JOURNAL OF CLINICAL ULTRASOUND : JCU 2023. [PMID: 37009697 DOI: 10.1002/jcu.23461] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/08/2023] [Revised: 03/18/2023] [Accepted: 03/25/2023] [Indexed: 06/19/2023]
Abstract
PURPOSE To construct and compare machine learning models for differentiating chondrosarcoma from enchondroma using radiomic features from T1 and fat suppressed Proton density (PD) magnetic resonance imaging (MRI). METHODS Eighty-eight patients (57 with enchondroma, 31 with chondrosarcoma) were retrospectively included. Histogram matching and N4ITK MRI bias correction filters were applied. An experienced musculoskeletal radiologist and a senior resident in radiology performed manual segmentation. Voxel sizes were resampled. Laplacian of Gaussian filter and wavelet-based features were used. One thousand eight hundred eighty-eight features were obtained for each patient, with 944 from T1 and 944 from PD images. Sixty-four unstable features were removed. Seven machine learning models were used for classification. RESULTS Classification with all features showed neural network was the best model for both readers' datasets with area under the curve (AUC), classification accuracy (CA), and F1 score of 0.979, 0.984; 0.920, 0.932; and 0.889, 0.903, respectively. Four features, including one common to both readers, were selected using fast correlation based filter. The best performing models with selected features were gradient boosting for Fatih Erdem's dataset and neural network for Gülen Demirpolat's dataset with AUC, CA, and F1 score of 0.990, 0.979; 0.943, 0.955; 0.921, 0.933, respectively. Neural Network was the second-best model for FE's dataset based on AUC (0.984). CONCLUSION Using pathology as a gold standard, this study defined and compared seven well-performing models to distinguish enchondromas from chondrosarcomas and provided radiomic feature stability and reproducibility among the readers.
Collapse
Affiliation(s)
- Fatih Erdem
- Department of Radiology, Balikesir University Hospital, Paşaköy, Bigadiç yolu üzeri, 10145 Balıkesir Merkez, Altıeylül, Balıkesir, Turkey
| | - İpek Tamsel
- Department of Radiology, Ege University Hospital, 35100, Bornova, Izmir, Turkey
| | - Gülen Demirpolat
- Department of Radiology, Balikesir University Hospital, Paşaköy, Bigadiç yolu üzeri, 10145 Balıkesir Merkez, Altıeylül, Balıkesir, Turkey
| |
Collapse
|
18
|
Ong W, Zhu L, Tan YL, Teo EC, Tan JH, Kumar N, Vellayappan BA, Ooi BC, Quek ST, Makmur A, Hallinan JTPD. Application of Machine Learning for Differentiating Bone Malignancy on Imaging: A Systematic Review. Cancers (Basel) 2023; 15:cancers15061837. [PMID: 36980722 PMCID: PMC10047175 DOI: 10.3390/cancers15061837] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2023] [Revised: 03/07/2023] [Accepted: 03/16/2023] [Indexed: 03/22/2023] Open
Abstract
An accurate diagnosis of bone tumours on imaging is crucial for appropriate and successful treatment. The advent of Artificial intelligence (AI) and machine learning methods to characterize and assess bone tumours on various imaging modalities may assist in the diagnostic workflow. The purpose of this review article is to summarise the most recent evidence for AI techniques using imaging for differentiating benign from malignant lesions, the characterization of various malignant bone lesions, and their potential clinical application. A systematic search through electronic databases (PubMed, MEDLINE, Web of Science, and clinicaltrials.gov) was conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. A total of 34 articles were retrieved from the databases and the key findings were compiled and summarised. A total of 34 articles reported the use of AI techniques to distinguish between benign vs. malignant bone lesions, of which 12 (35.3%) focused on radiographs, 12 (35.3%) on MRI, 5 (14.7%) on CT and 5 (14.7%) on PET/CT. The overall reported accuracy, sensitivity, and specificity of AI in distinguishing between benign vs. malignant bone lesions ranges from 0.44–0.99, 0.63–1.00, and 0.73–0.96, respectively, with AUCs of 0.73–0.96. In conclusion, the use of AI to discriminate bone lesions on imaging has achieved a relatively good performance in various imaging modalities, with high sensitivity, specificity, and accuracy for distinguishing between benign vs. malignant lesions in several cohort studies. However, further research is necessary to test the clinical performance of these algorithms before they can be facilitated and integrated into routine clinical practice.
Collapse
Affiliation(s)
- Wilson Ong
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
- Correspondence: ; Tel.: +65-67725207
| | - Lei Zhu
- Department of Computer Science, School of Computing, National University of Singapore, 13 Computing Drive, Singapore 117417, Singapore
| | - Yi Liang Tan
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
| | - Ee Chin Teo
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
| | - Jiong Hao Tan
- University Spine Centre, Department of Orthopaedic Surgery, National University Health System, 1E, Lower Kent Ridge Road, Singapore 119228, Singapore
| | - Naresh Kumar
- University Spine Centre, Department of Orthopaedic Surgery, National University Health System, 1E, Lower Kent Ridge Road, Singapore 119228, Singapore
| | - Balamurugan A. Vellayappan
- Department of Radiation Oncology, National University Cancer Institute Singapore, National University Hospital, 5 Lower Kent Ridge Road, Singapore 119074, Singapore
| | - Beng Chin Ooi
- Department of Computer Science, School of Computing, National University of Singapore, 13 Computing Drive, Singapore 117417, Singapore
| | - Swee Tian Quek
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
- Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Drive, Singapore 117597, Singapore
| | - Andrew Makmur
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
- Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Drive, Singapore 117597, Singapore
| | - James Thomas Patrick Decourcy Hallinan
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd, Singapore 119074, Singapore
- Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Drive, Singapore 117597, Singapore
| |
Collapse
|
19
|
Kim JH, Lee SK. Classification of Chondrosarcoma: From Characteristic to Challenging Imaging Findings. Cancers (Basel) 2023; 15:cancers15061703. [PMID: 36980590 PMCID: PMC10046282 DOI: 10.3390/cancers15061703] [Citation(s) in RCA: 22] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2023] [Revised: 03/08/2023] [Accepted: 03/08/2023] [Indexed: 03/18/2023] Open
Abstract
Chondrosarcomas can be classified into various forms according to the presence or absence of a precursor lesion, location, and histological subtype. The new 2020 World Health Organization (WHO) Classification of Tumors of Soft Tissue and Bone classifies chondrogenic bone tumors as benign, intermediate (locally aggressive), or malignant, and separates atypical cartilaginous tumors (ACTs) and chondrosarcoma grade 1 (CS1) as intermediate and malignant tumors. respectively. Furthermore, the classification categorizes chondrosarcomas (including ACT) into eight subtypes: central conventional (grade 1 vs. 2–3), secondary peripheral (grade 1 vs. 2–3), periosteal, dedifferentiated, mesenchymal, and clear cell chondrosarcoma. Most chondrosarcomas are the low-grade, primary central conventional type. The rarer subtypes include clear cell, mesenchymal, and dedifferentiated chondrosarcomas. Comprehensive analysis of the characteristic imaging findings can help differentiate various forms of chondrosarcomas. However, distinguishing low-grade chondrosarcomas from enchondromas or high-grade chondrosarcomas is radiologically and histopathologically challenging, even for experienced radiologists and pathologists.
Collapse
Affiliation(s)
- Jun-Ho Kim
- Department of Orthopaedic Surgery, Center for Joint Diseases, Kyung Hee University Hospital at Gangdong, Seoul 05278, Republic of Korea
| | - Seul Ki Lee
- Department of Radiology, St. Vincent’s Hospital, College of Medicine, The Catholic University of Korea, Seoul 06591, Republic of Korea
- Correspondence:
| |
Collapse
|
20
|
Texture Feature-Based Machine Learning Classification on MRI Image for Sepsis-Associated Encephalopathy Detection: A Pilot Study. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2023; 2023:6403556. [PMID: 36778786 PMCID: PMC9911249 DOI: 10.1155/2023/6403556] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/27/2022] [Revised: 12/21/2022] [Accepted: 12/26/2022] [Indexed: 02/05/2023]
Abstract
Objective The objective of this study was to assess the performance of combining MRI-based texture analysis with machine learning for differentiating sepsis-associated encephalopathy (SAE) from sepsis alone. Method Sixty-six MRI-T1WI images of an SAE patient and 125 images of patients with sepsis alone were collected. Frontal lobe, brain stem, hippocampus, and amygdala were selected as regions of interest (ROIs). 279 texture features of each ROI were obtained using MaZda software. After the dimension reduction, 30 highly discriminative features of each ROI were adopted to differentiate SAE from sepsis alone using the CatBoost model. Results The classification models of frontal, brain stem, hippocampus, and amygdala were constructed. The classification accuracy was above 0.83, and the area under the curve (AUC) exceeded 0.90 in the validation set. Conclusion The texture features differed between SAE patients and patients with sepsis alone in different anatomical locations, suggesting that MRI-based texture analysis with machine learning might be helpful in differentiating SAE from sepsis alone.
Collapse
|
21
|
Zhong J, Hu Y, Ge X, Xing Y, Ding D, Zhang G, Zhang H, Yang Q, Yao W. A systematic review of radiomics in chondrosarcoma: assessment of study quality and clinical value needs handy tools. Eur Radiol 2023; 33:1433-1444. [PMID: 36018355 DOI: 10.1007/s00330-022-09060-3] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2022] [Revised: 06/24/2022] [Accepted: 07/24/2022] [Indexed: 02/03/2023]
Abstract
OBJECTIVE To evaluate the study quality and clinical value of radiomics studies on chondrosarcoma. METHODS PubMed, Embase, Web of Science, China National Knowledge Infrastructure, and Wanfang Data were searched for articles on radiomics for evaluating chondrosarcoma as of January 31, 2022. The study quality was assessed according to Radiomics Quality Score (RQS), Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) checklist, Image Biomarker Standardization Initiative (IBSI) guideline, and modified Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) tool. The level of evidence supporting clinical use of radiomics on chondrosarcoma differential diagnosis was determined based on meta-analyses. RESULTS Twelve articles were included. The median RQS was 10.5 (range, -3 to 15), with an adherence rate of 36%. The adherence rate was extremely low in domains of high-level evidence (0%), open science and data (17%), and imaging and segmentation (35%). The adherence rate of the TRIPOD checklist was 61%, and low for section of title and abstract (13%), introduction (42%), and results (56%). The reporting rate of pre-processing steps according to the IBSI guideline was 60%. The risk of bias and concern of application were mainly related to the index test. The meta-analysis on differential diagnosis of enchondromas vs. chondrosarcomas showed a diagnostic odds ratio of 43.90 (95% confidential interval, 25.33-76.10), which was rated as weak evidence. CONCLUSIONS The current scientific and reporting quality of radiomics studies on chondrosarcoma was insufficient. Radiomics has potential in facilitating the optimization of operation decision-making in chondrosarcoma. KEY POINTS • Among radiomics studies on chondrosarcoma, although differential diagnostic models showed promising performance, only pieces of weak level of evidence were reached with insufficient study quality. • Since the RQS rating, the TRIPOD checklist, and the IBSI guideline have largely overlapped with each other, it is necessary to establish one widely acceptable methodological and reporting guideline for radiomics research. • The TRIPOD model typing, the phase classification of image mining studies, and the level of evidence category are useful tools to assess the gap between academic research and clinical application, although their modifications for radiomics studies are needed.
Collapse
Affiliation(s)
- Jingyu Zhong
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, No. 1111 Xianxia Road, Shanghai, 200336, China
| | - Yangfan Hu
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, No. 1111 Xianxia Road, Shanghai, 200336, China
| | - Xiang Ge
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, No. 1111 Xianxia Road, Shanghai, 200336, China
| | - Yue Xing
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, No. 1111 Xianxia Road, Shanghai, 200336, China
| | - Defang Ding
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, No. 1111 Xianxia Road, Shanghai, 200336, China
| | - Guangcheng Zhang
- Department of Sports Medicine, Shanghai Jiao Tong University Affiliated Sixth People's Hospital, No. 600 Yishan Road, Shanghai, 200233, China
| | - Huan Zhang
- Department of Radiology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, No. 197 Ruijin 2nd Road, Shanghai, 200025, China
| | - Qingcheng Yang
- Department of Orthopedics, Shanghai Jiao Tong University Affiliated Sixth People's Hospital, No. 600 Yishan Road, Shanghai, 200233, China.
| | - Weiwu Yao
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, No. 1111 Xianxia Road, Shanghai, 200336, China.
| |
Collapse
|
22
|
A Computed Tomography Radiomics Nomogram in Differentiating Chordoma From Giant Cell Tumor in the Axial Skeleton. J Comput Assist Tomogr 2023; 47:453-459. [PMID: 36728104 DOI: 10.1097/rct.0000000000001436] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/03/2023]
Abstract
OBJECTIVE The aim of the study is to develop and validate a computed tomography (CT) radiomics nomogram for preoperatively differentiating chordoma from giant cell tumor (GCT) in the axial skeleton. METHODS Seventy-three chordomas and 38 GCTs in axial skeleton were retrospectively included and were divided into a training cohort (n = 63) and a test cohort (n = 48). The radiomics features were extracted from CT images. A radiomics signature was developed by using the least absolute shrinkage and selection operator model, and a radiomics score (Rad-score) was acquired. By combining the Rad-score with independent clinical risk factors using multivariate logistic regression model, a radiomics nomogram was established. Calibration and receiver operator characteristic curves were used to assess the performance of the nomogram. RESULTS Five features were selected to construct the radiomics signature. The radiomics signature showed favorable discrimination in the training cohort (area under the curve [AUC], 0.860; 95% confidence interval [CI], 0.760-0.960) and the test cohort (AUC, 0.830; 95% CI, 0.710-0.950). Age and location were the independent clinical factors. The radiomics nomogram combining the Rad-score with independent clinical factors showed good discrimination capability in the training cohort (AUC, 0.930; 95% CI, 0.880-0.990) and the test cohort (AUC, 0.980; 95% CI, 0.940-1.000) and outperformed the radiomics signature (z = 2.768, P = 0.006) in the test cohort. CONCLUSIONS The CT radiomics nomogram shows good predictive efficacy in differentiating chordoma from GCT in the axial skeleton, which might facilitate clinical decision making.
Collapse
|
23
|
Li X, Lan M, Wang X, Zhang J, Gong L, Liao F, Lin H, Dai S, Fan B, Dong W. Development and validation of a MRI-based combined radiomics nomogram for differentiation in chondrosarcoma. Front Oncol 2023; 13:1090229. [PMID: 36925933 PMCID: PMC10012421 DOI: 10.3389/fonc.2023.1090229] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2022] [Accepted: 02/13/2023] [Indexed: 03/08/2023] Open
Abstract
Objective This study aims to develop and validate the performance of an unenhanced magnetic resonance imaging (MRI)-based combined radiomics nomogram for discrimination between low-grade and high-grade in chondrosarcoma. Methods A total of 102 patients with 44 in low-grade and 58 in high-grade chondrosarcoma were enrolled and divided into training set (n=72) and validation set (n=30) with a 7:3 ratio in this retrospective study. The demographics and unenhanced MRI imaging characteristics of the patients were evaluated to develop a clinic-radiological factors model. Radiomics features were extracted from T1-weighted (T1WI) images to construct radiomics signature and calculate radiomics score (Rad-score). According to multivariate logistic regression analysis, a combined radiomics nomogram based on MRI was constructed by integrating radiomics signature and independent clinic-radiological features. The performance of the combined radiomics nomogram was evaluated in terms of calibration, discrimination, and clinical usefulness. Results Using multivariate logistic regression analysis, only one clinic-radiological feature (marrow edema OR=0.29, 95% CI=0.11-0.76, P=0.012) was found to be independent predictors of differentiation in chondrosarcoma. Combined with the above clinic-radiological predictor and the radiomics signature constructed by LASSO [least absolute shrinkage and selection operator], a combined radiomics nomogram based on MRI was constructed, and its predictive performance was better than that of clinic-radiological factors model and radiomics signature, with the AUC [area under the curve] of the training set and the validation set were 0.78 (95%CI =0.67-0.89) and 0.77 (95%CI =0.59-0.94), respectively. DCA [decision curve analysis] showed that combined radiomics nomogram has potential clinical application value. Conclusion The MRI-based combined radiomics nomogram is a noninvasive preoperative prediction tool that combines clinic-radiological feature and radiomics signature and shows good predictive effect in distinguishing low-grade and high-grade bone chondrosarcoma, which may help clinicians to make accurate treatment plans.
Collapse
Affiliation(s)
- Xiaofen Li
- Medical College of Nanchang University, Nanchang, China.,Department of Radiology, Jiangxi Provincial People's Hospital, The First Affiliated Hospital of Nanchang Medical College, Nanchang, China
| | - Min Lan
- Department of Orthopedics, Jiangxi Provincial People's Hospital, The First Affiliated Hospital of Nanchang Medical College, Nanchang, China
| | - Xiaolian Wang
- Department of Radiology, Jiangxi Provincial People's Hospital, The First Affiliated Hospital of Nanchang Medical College, Nanchang, China
| | - Jingkun Zhang
- Department of Radiology, The Affiliated Hospital of Jiangxi University of Traditional Chinese Medicine, Nanchang, China
| | - Lianggeng Gong
- Department of Medical Imaging Center, Second Affiliated Hospital of Nanchang University, Nanchang, China
| | - Fengxiang Liao
- Department of Nuclear Medicine, Jiangxi Provincial People's Hospital, The First Affiliated Hospital of Nanchang Medical College, Nanchang, China
| | - Huashan Lin
- Department of Pharmaceutical Diagnosis, General Electric Healthcare, Changsha, China
| | - Shixiang Dai
- Department of Radiology, Jiangxi Provincial People's Hospital, The First Affiliated Hospital of Nanchang Medical College, Nanchang, China
| | - Bing Fan
- Department of Radiology, Jiangxi Provincial People's Hospital, The First Affiliated Hospital of Nanchang Medical College, Nanchang, China
| | - Wentao Dong
- Department of Radiology, Jiangxi Provincial People's Hospital, The First Affiliated Hospital of Nanchang Medical College, Nanchang, China
| |
Collapse
|
24
|
Radiomics and Deep Learning for Disease Detection in Musculoskeletal Radiology: An Overview of Novel MRI- and CT-Based Approaches. Invest Radiol 2023; 58:3-13. [PMID: 36070548 DOI: 10.1097/rli.0000000000000907] [Citation(s) in RCA: 40] [Impact Index Per Article: 20.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
ABSTRACT Radiomics and machine learning-based methods offer exciting opportunities for improving diagnostic performance and efficiency in musculoskeletal radiology for various tasks, including acute injuries, chronic conditions, spinal abnormalities, and neoplasms. While early radiomics-based methods were often limited to a smaller number of higher-order image feature extractions, applying machine learning-based analytic models, multifactorial correlations, and classifiers now permits big data processing and testing thousands of features to identify relevant markers. A growing number of novel deep learning-based methods describe magnetic resonance imaging- and computed tomography-based algorithms for diagnosing anterior cruciate ligament tears, meniscus tears, articular cartilage defects, rotator cuff tears, fractures, metastatic skeletal disease, and soft tissue tumors. Initial radiomics and deep learning techniques have focused on binary detection tasks, such as determining the presence or absence of a single abnormality and differentiation of benign versus malignant. Newer-generation algorithms aim to include practically relevant multiclass characterization of detected abnormalities, such as typing and malignancy grading of neoplasms. So-called delta-radiomics assess tumor features before and after treatment, with temporal changes of radiomics features serving as surrogate markers for tumor responses to treatment. New approaches also predict treatment success rates, surgical resection completeness, and recurrence risk. Practice-relevant goals for the next generation of algorithms include diagnostic whole-organ and advanced classification capabilities. Important research objectives to fill current knowledge gaps include well-designed research studies to understand how diagnostic performances and suggested efficiency gains of isolated research settings translate into routine daily clinical practice. This article summarizes current radiomics- and machine learning-based magnetic resonance imaging and computed tomography approaches for musculoskeletal disease detection and offers a perspective on future goals and objectives.
Collapse
|
25
|
Gitto S, Corino VDA, Annovazzi A, Milazzo Machado E, Bologna M, Marzorati L, Albano D, Messina C, Serpi F, Anelli V, Ferraresi V, Zoccali C, Aliprandi A, Parafioriti A, Luzzati A, Biagini R, Mainardi L, Sconfienza LM. 3D vs. 2D MRI radiomics in skeletal Ewing sarcoma: Feature reproducibility and preliminary machine learning analysis on neoadjuvant chemotherapy response prediction. Front Oncol 2022; 12:1016123. [PMID: 36531029 PMCID: PMC9755864 DOI: 10.3389/fonc.2022.1016123] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2022] [Accepted: 11/17/2022] [Indexed: 07/29/2023] Open
Abstract
OBJECTIVE The extent of response to neoadjuvant chemotherapy predicts survival in Ewing sarcoma. This study focuses on MRI radiomics of skeletal Ewing sarcoma and aims to investigate feature reproducibility and machine learning prediction of response to neoadjuvant chemotherapy. MATERIALS AND METHODS This retrospective study included thirty patients with biopsy-proven skeletal Ewing sarcoma, who were treated with neoadjuvant chemotherapy before surgery at two tertiary sarcoma centres. 7 patients were poor responders and 23 were good responders based on pathological assessment of the surgical specimen. On pre-treatment T1-weighted and T2-weighted MRI, 2D and 3D tumour segmentations were manually performed. Features were extracted from original and wavelet-transformed images. Feature reproducibility was assessed through small geometrical transformations of the regions of interest mimicking multiple manual delineations, and intraclass correlation coefficient >0.75 defined feature reproducibility. Feature selection also consisted of collinearity and significance analysis. After class balancing in the training cohort, three machine learning classifiers were trained and tested on unseen data using hold-out cross-validation. RESULTS 1303 (77%) 3D and 620 (65%) 2D radiomic features were reproducible. 4 3D and 4 2D features passed feature selection. Logistic regression built upon 3D features achieved the best performance with 85% accuracy (AUC=0.9) in predicting response to neoadjuvant chemotherapy. CONCLUSION Compared to 2D approach, 3D MRI radiomics of Ewing sarcoma had superior reproducibility and higher accuracy in predicting response to neoadjuvant chemotherapy, particularly when using logistic regression classifier.
Collapse
Affiliation(s)
- Salvatore Gitto
- Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milan, Italy
| | - Valentina D. A. Corino
- Department of Electronics, Information and Bioengineering (DEIB), Politecnico Di Milano, Milan, Italy
- Cardiotech Lab, Centro Cardiologico Monzino IRCCS, Milan, Italy
| | - Alessio Annovazzi
- Nuclear Medicine Unit, IRCCS Regina Elena National Cancer Institute, Rome, Italy
| | | | - Marco Bologna
- Department of Electronics, Information and Bioengineering (DEIB), Politecnico Di Milano, Milan, Italy
| | - Lorenzo Marzorati
- Department of Electronics, Information and Bioengineering (DEIB), Politecnico Di Milano, Milan, Italy
| | | | - Carmelo Messina
- Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milan, Italy
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
| | - Francesca Serpi
- Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milan, Italy
| | - Vincenzo Anelli
- Radiology and Diagnostic Imaging Unit, IRCCS Regina Elena National Cancer Institute, Rome, Italy
| | - Virginia Ferraresi
- Sarcomas and Rare Tumours Departmental Unit, IRCCS Regina Elena National Cancer Institute, Rome, Italy
| | - Carmine Zoccali
- Department of Anatomical, Histological, Forensic and Musculoskeletal System Sciences, Sapienza University of Rome, Rome, Italy
- Oncological Orthopaedics Unit, IRCCS Regina Elena National Cancer Institute, Rome, Italy
| | | | | | | | - Roberto Biagini
- Oncological Orthopaedics Unit, IRCCS Regina Elena National Cancer Institute, Rome, Italy
| | - Luca Mainardi
- Department of Electronics, Information and Bioengineering (DEIB), Politecnico Di Milano, Milan, Italy
| | - Luca Maria Sconfienza
- Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milan, Italy
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
| |
Collapse
|
26
|
Li J, Li S, Li X, Miao S, Dong C, Gao C, Liu X, Hao D, Xu W, Huang M, Cui J. Primary bone tumor detection and classification in full-field bone radiographs via YOLO deep learning model. Eur Radiol 2022; 33:4237-4248. [PMID: 36449060 DOI: 10.1007/s00330-022-09289-y] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2022] [Revised: 11/02/2022] [Accepted: 11/07/2022] [Indexed: 12/02/2022]
Abstract
OBJECTIVES Automatic bone lesions detection and classifications present a critical challenge and are essential to support radiologists in making an accurate diagnosis of bone lesions. In this paper, we aimed to develop a novel deep learning model called You Only Look Once (YOLO) to handle detecting and classifying bone lesions on full-field radiographs with limited manual intervention. METHODS In this retrospective study, we used 1085 bone tumor radiographs and 345 normal bone radiographs from two centers between January 2009 and December 2020 to train and test our YOLO deep learning (DL) model. The trained model detected bone lesions and then classified these radiographs into normal, benign, intermediate, or malignant types. The intersection over union (IoU) was used to assess the model's performance in the detection task. Confusion matrices and Cohen's kappa scores were used for evaluating classification performance. Two radiologists compared diagnostic performance with the trained model using the external validation set. RESULTS In the detection task, the model achieved accuracies of 86.36% and 85.37% in the internal and external validation sets, respectively. In the DL model, radiologist 1 and radiologist 2 achieved Cohen's kappa scores of 0.8187, 0.7927, and 0.9077 for four-way classification in the external validation set, respectively. The YOLO DL model illustrated a significantly higher accuracy for intermediate bone tumor classification than radiologist 1 (95.73% vs 88.08%, p = 0.004). CONCLUSIONS The developed YOLO DL model could be used to assist radiologists at all stages of bone lesion detection and classification in full-field bone radiographs. KEY POINTS • YOLO DL model can automatically detect bone neoplasms from full-field radiographs in one shot and then simultaneously classify radiographs into normal, benign, intermediate, or malignant. • The dataset used in this retrospective study includes normal bone radiographs. • YOLO can detect even some challenging cases with small volumes.
Collapse
Affiliation(s)
- Jie Li
- Department of Radiology, The Affiliated Hospital of Qingdao University, 16 Jiangsu Road, Qingdao, 266003, Shandong, China
| | - Sudong Li
- College of Computer Science and Technology, Qingdao University, Qingdao, 266071, China
| | - Xiaoli Li
- Department of Radiology, The Affiliated Hospital of Qingdao University, 16 Jiangsu Road, Qingdao, 266003, Shandong, China
| | - Sheng Miao
- School of Information and Control Engineering, Qingdao University of Technology, Qingdao, 266520, China
| | - Cheng Dong
- Department of Radiology, The Affiliated Hospital of Qingdao University, 16 Jiangsu Road, Qingdao, 266003, Shandong, China
| | - Chuanping Gao
- Department of Radiology, The Affiliated Hospital of Qingdao University, 16 Jiangsu Road, Qingdao, 266003, Shandong, China
| | - Xuejun Liu
- Department of Radiology, The Affiliated Hospital of Qingdao University, 16 Jiangsu Road, Qingdao, 266003, Shandong, China
| | - Dapeng Hao
- Department of Radiology, The Affiliated Hospital of Qingdao University, 16 Jiangsu Road, Qingdao, 266003, Shandong, China
| | - Wenjian Xu
- Department of Radiology, The Affiliated Hospital of Qingdao University, 16 Jiangsu Road, Qingdao, 266003, Shandong, China
| | - Mingqian Huang
- Department of Radiology, The Mount Sinai Hospital, New York, NY, 10029-0310, USA
| | - Jiufa Cui
- Department of Radiology, The Affiliated Hospital of Qingdao University, 16 Jiangsu Road, Qingdao, 266003, Shandong, China.
| |
Collapse
|
27
|
Krajnc D, Spielvogel CP, Grahovac M, Ecsedi B, Rasul S, Poetsch N, Traub-Weidinger T, Haug AR, Ritter Z, Alizadeh H, Hacker M, Beyer T, Papp L. Automated data preparation for in vivo tumor characterization with machine learning. Front Oncol 2022; 12:1017911. [PMID: 36303841 PMCID: PMC9595446 DOI: 10.3389/fonc.2022.1017911] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2022] [Accepted: 09/23/2022] [Indexed: 11/23/2022] Open
Abstract
Background This study proposes machine learning-driven data preparation (MLDP) for optimal data preparation (DP) prior to building prediction models for cancer cohorts. Methods A collection of well-established DP methods were incorporated for building the DP pipelines for various clinical cohorts prior to machine learning. Evolutionary algorithm principles combined with hyperparameter optimization were employed to iteratively select the best fitting subset of data preparation algorithms for the given dataset. The proposed method was validated for glioma and prostate single center cohorts by 100-fold Monte Carlo (MC) cross-validation scheme with 80-20% training-validation split ratio. In addition, a dual-center diffuse large B-cell lymphoma (DLBCL) cohort was utilized with Center 1 as training and Center 2 as independent validation datasets to predict cohort-specific clinical endpoints. Five machine learning (ML) classifiers were employed for building prediction models across all analyzed cohorts. Predictive performance was estimated by confusion matrix analytics over the validation sets of each cohort. The performance of each model with and without MLDP, as well as with manually-defined DP were compared in each of the four cohorts. Results Sixteen of twenty established predictive models demonstrated area under the receiver operator characteristics curve (AUC) performance increase utilizing the MLDP. The MLDP resulted in the highest performance increase for random forest (RF) (+0.16 AUC) and support vector machine (SVM) (+0.13 AUC) model schemes for predicting 36-months survival in the glioma cohort. Single center cohorts resulted in complex (6-7 DP steps) DP pipelines, with a high occurrence of outlier detection, feature selection and synthetic majority oversampling technique (SMOTE). In contrast, the optimal DP pipeline for the dual-center DLBCL cohort only included outlier detection and SMOTE DP steps. Conclusions This study demonstrates that data preparation prior to ML prediction model building in cancer cohorts shall be ML-driven itself, yielding optimal prediction models in both single and multi-centric settings.
Collapse
Affiliation(s)
- Denis Krajnc
- QIMP Team, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| | - Clemens P. Spielvogel
- Department of Biomedical Imaging and Image-guided Therapy, Division of Nuclear Medicine, Medical University of Vienna, Vienna, Austria
- Christian Doppler Laboratory for Applied Metabolomics, Medical University of Vienna, Vienna, Austria
| | - Marko Grahovac
- Department of Biomedical Imaging and Image-guided Therapy, Division of Nuclear Medicine, Medical University of Vienna, Vienna, Austria
| | - Boglarka Ecsedi
- QIMP Team, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| | - Sazan Rasul
- Department of Biomedical Imaging and Image-guided Therapy, Division of Nuclear Medicine, Medical University of Vienna, Vienna, Austria
| | - Nina Poetsch
- Department of Biomedical Imaging and Image-guided Therapy, Division of Nuclear Medicine, Medical University of Vienna, Vienna, Austria
| | - Tatjana Traub-Weidinger
- Department of Biomedical Imaging and Image-guided Therapy, Division of Nuclear Medicine, Medical University of Vienna, Vienna, Austria
| | - Alexander R. Haug
- Department of Biomedical Imaging and Image-guided Therapy, Division of Nuclear Medicine, Medical University of Vienna, Vienna, Austria
- Christian Doppler Laboratory for Applied Metabolomics, Medical University of Vienna, Vienna, Austria
| | - Zsombor Ritter
- Department of Medical Imaging, University of Pécs, Medical School, Pécs, Hungary
| | - Hussain Alizadeh
- 1st Department of Internal Medicine, University of Pécs, Medical School, Pécs, Hungary
| | - Marcus Hacker
- Department of Biomedical Imaging and Image-guided Therapy, Division of Nuclear Medicine, Medical University of Vienna, Vienna, Austria
| | - Thomas Beyer
- QIMP Team, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| | - Laszlo Papp
- QIMP Team, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
- Applied Quantum Computing group, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, Austria
| |
Collapse
|
28
|
Hinterwimmer F, Consalvo S, Neumann J, Rueckert D, von Eisenhart-Rothe R, Burgkart R. Applications of machine learning for imaging-driven diagnosis of musculoskeletal malignancies-a scoping review. Eur Radiol 2022; 32:7173-7184. [PMID: 35852574 PMCID: PMC9474640 DOI: 10.1007/s00330-022-08981-3] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2022] [Revised: 05/31/2022] [Accepted: 06/22/2022] [Indexed: 11/16/2022]
Abstract
Musculoskeletal malignancies are a rare type of cancer. Consequently, sufficient imaging data for machine learning (ML) applications is difficult to obtain. The main purpose of this review was to investigate whether ML is already having an impact on imaging-driven diagnosis of musculoskeletal malignancies and what the respective reasons for this might be. A scoping review was conducted by a radiologist, an orthopaedic surgeon and a data scientist to identify suitable articles based on the PRISMA statement. Studies meeting the following criteria were included: primary malignant musculoskeletal tumours, machine/deep learning application, imaging data or data retrieved from images, human/preclinical, English language and original research. Initially, 480 articles were found and 38 met the eligibility criteria. Several continuous and discrete parameters related to publication, patient distribution, tumour specificities, ML methods, data and metrics were extracted from the final articles. For the synthesis, diagnosis-oriented studies were further examined by retrieving the number of patients and labels and metric scores. No significant correlations between metrics and mean number of samples were found. Several studies presented that ML could support imaging-driven diagnosis of musculoskeletal malignancies in distinct cases. However, data quality and quantity must be increased to achieve clinically relevant results. Compared to the experience of an expert radiologist, the studies used small datasets and mostly included only one type of data. Key to critical advancement of ML models for rare diseases such as musculoskeletal malignancies is a systematic, structured data collection and the establishment of (inter)national networks to obtain substantial datasets in the future. KEY POINTS: • Machine learning does not yet significantly impact imaging-driven diagnosis for musculoskeletal malignancies compared to other disciplines such as lung, breast or CNS cancer. • Research in the area of musculoskeletal tumour imaging and machine learning is still very limited. • Machine learning in musculoskeletal tumour imaging is impeded by insufficient availability of data and rarity of the disease.
Collapse
Affiliation(s)
- Florian Hinterwimmer
- Department of Orthopaedics and Sports Orthopaedics, Klinikum rechts der Isar, Technical University of Munich, Munich, Germany.
- Institute for AI and Informatics in Medicine, Technical University of Munich, Munich, Germany.
| | - Sarah Consalvo
- Department of Orthopaedics and Sports Orthopaedics, Klinikum rechts der Isar, Technical University of Munich, Munich, Germany
| | - Jan Neumann
- Department of Diagnostic and Interventional Radiology, Klinikum rechts der Isar, Technical University of Munich, Munich, Germany
| | - Daniel Rueckert
- Institute for AI and Informatics in Medicine, Technical University of Munich, Munich, Germany
| | - Rüdiger von Eisenhart-Rothe
- Department of Orthopaedics and Sports Orthopaedics, Klinikum rechts der Isar, Technical University of Munich, Munich, Germany
| | - Rainer Burgkart
- Department of Orthopaedics and Sports Orthopaedics, Klinikum rechts der Isar, Technical University of Munich, Munich, Germany
| |
Collapse
|
29
|
Diffusion-weighted MRI radiomics of spine bone tumors: feature stability and machine learning-based classification performance. Radiol Med 2022; 127:518-525. [PMID: 35320464 PMCID: PMC9098537 DOI: 10.1007/s11547-022-01468-7] [Citation(s) in RCA: 40] [Impact Index Per Article: 13.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2021] [Accepted: 02/11/2022] [Indexed: 10/29/2022]
Abstract
PURPOSE To evaluate stability and machine learning-based classification performance of radiomic features of spine bone tumors using diffusion- and T2-weighted magnetic resonance imaging (MRI). MATERIAL AND METHODS This retrospective study included 101 patients with histology-proven spine bone tumor (22 benign; 38 primary malignant; 41 metastatic). All tumor volumes were manually segmented on morphologic T2-weighted sequences. The same region of interest (ROI) was used to perform radiomic analysis on ADC map. A total of 1702 radiomic features was considered. Feature stability was assessed through small geometrical transformations of the ROIs mimicking multiple manual delineations. Intraclass correlation coefficient (ICC) quantified feature stability. Feature selection consisted of stability-based (ICC > 0.75) and significance-based selections (ranking features by decreasing Mann-Whitney p-value). Class balancing was performed to oversample the minority (i.e., benign) class. Selected features were used to train and test a support vector machine (SVM) to discriminate benign from malignant spine tumors using tenfold cross-validation. RESULTS A total of 76.4% radiomic features were stable. The quality metrics for the SVM were evaluated as a function of the number of selected features. The radiomic model with the best performance and the lowest number of features for classifying tumor types included 8 features. The metrics were 78% sensitivity, 68% specificity, 76% accuracy and AUC 0.78. CONCLUSION SVM classifiers based on radiomic features extracted from T2- and diffusion-weighted imaging with ADC map are promising for classification of spine bone tumors. Radiomic features of spine bone tumors show good reproducibility rates.
Collapse
|
30
|
Bone and Soft Tissue Tumors. Radiol Clin North Am 2022; 60:339-358. [DOI: 10.1016/j.rcl.2021.11.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|
31
|
Radiomics of Musculoskeletal Sarcomas: A Narrative Review. J Imaging 2022; 8:jimaging8020045. [PMID: 35200747 PMCID: PMC8876222 DOI: 10.3390/jimaging8020045] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2021] [Revised: 01/31/2022] [Accepted: 02/10/2022] [Indexed: 12/23/2022] Open
Abstract
Bone and soft-tissue primary malignant tumors or sarcomas are a large, diverse group of mesenchymal-derived malignancies. They represent a model for intra- and intertumoral heterogeneities, making them particularly suitable for radiomics analyses. Radiomic features offer information on cancer phenotype as well as the tumor microenvironment which, combined with other pertinent data such as genomics and proteomics and correlated with outcomes data, can produce accurate, robust, evidence-based, clinical-decision support systems. Our purpose in this narrative review is to offer an overview of radiomics studies dealing with Magnetic Resonance Imaging (MRI)-based radiomics models of bone and soft-tissue sarcomas that could help distinguish different histotypes, low-grade from high-grade sarcomas, predict response to multimodality therapy, and thus better tailor patients’ treatments and finally improve their survivals. Although showing promising results, interobserver segmentation variability, feature reproducibility, and model validation are three main challenges of radiomics that need to be addressed in order to translate radiomics studies to clinical applications. These efforts, together with a better knowledge and application of the “Radiomics Quality Score” and Image Biomarker Standardization Initiative reporting guidelines, could improve the quality of sarcoma radiomics studies and facilitate radiomics towards clinical translation.
Collapse
|
32
|
Chianca V, Albano D, Messina C, Gitto S, Ruffo G, Guarino S, Del Grande F, Sconfienza LM. Sarcopenia: imaging assessment and clinical application. Abdom Radiol (NY) 2022; 47:3205-3216. [PMID: 34687326 PMCID: PMC8536908 DOI: 10.1007/s00261-021-03294-3] [Citation(s) in RCA: 97] [Impact Index Per Article: 32.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2021] [Revised: 09/21/2021] [Accepted: 09/22/2021] [Indexed: 02/06/2023]
Abstract
Sarcopenia is a progressive, generalized skeletal muscle disorder characterized by reduction of muscle mass and strength. It is associated with increased adverse outcomes including falls, fractures, physical disability, and mortality, particularly, in elderly patients. Nowadays, sarcopenia has become a specific imaging biomarker able to predict clinical outcomes of patients. Muscle fibre reduction has shown to be an unfavourable pre-operative predictive factor in patients with cancer, and is associated with worse clinical outcomes in terms of postoperative complications, morbidity, mortality, and lower tolerance of chemoradiation therapy. Several imaging modalities, including dual-energy X-ray absorptiometry, CT, MRI, and US can be used to estimate muscle mass and quality to reach the diagnosis of sarcopenia. This article reviews the clinical implications of sarcopenia, how this condition can be assessed through different imaging modalities, and future perspectives of imaging of sarcopenia.
Collapse
Affiliation(s)
- Vito Chianca
- Clinica di Radiologia EOC IIMSI, Lugano, Switzerland ,Ospedale Evangelico Betania, Napoli, Italy
| | - Domenico Albano
- grid.417776.4IRCCS Istituto Ortopedico Galeazzi, Milano, Italy ,grid.10776.370000 0004 1762 5517Sezione di Scienze Radiologiche, Dipartimento di Biomedicina, Neuroscienze e Diagnostica Avanzata, Università degli Studi di Palermo, Palermo, Italy
| | - Carmelo Messina
- grid.417776.4IRCCS Istituto Ortopedico Galeazzi, Milano, Italy
| | - Salvatore Gitto
- grid.4708.b0000 0004 1757 2822Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milano, Italy
| | - Gaetano Ruffo
- grid.417776.4IRCCS Istituto Ortopedico Galeazzi, Milano, Italy
| | | | | | - Luca Maria Sconfienza
- IRCCS Istituto Ortopedico Galeazzi, Milano, Italy. .,Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milano, Italy.
| |
Collapse
|
33
|
von Schacky CE, Wilhelm NJ, Schäfer VS, Leonhardt Y, Jung M, Jungmann PM, Russe MF, Foreman SC, Gassert FG, Gassert FT, Schwaiger BJ, Mogler C, Knebel C, von Eisenhart-Rothe R, Makowski MR, Woertler K, Burgkart R, Gersing AS. Development and evaluation of machine learning models based on X-ray radiomics for the classification and differentiation of malignant and benign bone tumors. Eur Radiol 2022; 32:6247-6257. [PMID: 35396665 PMCID: PMC9381439 DOI: 10.1007/s00330-022-08764-w] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2021] [Revised: 01/03/2022] [Accepted: 02/17/2022] [Indexed: 01/19/2023]
Abstract
OBJECTIVES To develop and validate machine learning models to distinguish between benign and malignant bone lesions and compare the performance to radiologists. METHODS In 880 patients (age 33.1 ± 19.4 years, 395 women) diagnosed with malignant (n = 213, 24.2%) or benign (n = 667, 75.8%) primary bone tumors, preoperative radiographs were obtained, and the diagnosis was established using histopathology. Data was split 70%/15%/15% for training, validation, and internal testing. Additionally, 96 patients from another institution were obtained for external testing. Machine learning models were developed and validated using radiomic features and demographic information. The performance of each model was evaluated on the test sets for accuracy, area under the curve (AUC) from receiver operating characteristics, sensitivity, and specificity. For comparison, the external test set was evaluated by two radiology residents and two radiologists who specialized in musculoskeletal tumor imaging. RESULTS The best machine learning model was based on an artificial neural network (ANN) combining both radiomic and demographic information achieving 80% and 75% accuracy at 75% and 90% sensitivity with 0.79 and 0.90 AUC on the internal and external test set, respectively. In comparison, the radiology residents achieved 71% and 65% accuracy at 61% and 35% sensitivity while the radiologists specialized in musculoskeletal tumor imaging achieved an 84% and 83% accuracy at 90% and 81% sensitivity, respectively. CONCLUSIONS An ANN combining radiomic features and demographic information showed the best performance in distinguishing between benign and malignant bone lesions. The model showed lower accuracy compared to specialized radiologists, while accuracy was higher or similar compared to residents. KEY POINTS • The developed machine learning model could differentiate benign from malignant bone tumors using radiography with an AUC of 0.90 on the external test set. • Machine learning models that used radiomic features or demographic information alone performed worse than those that used both radiomic features and demographic information as input, highlighting the importance of building comprehensive machine learning models. • An artificial neural network that combined both radiomic and demographic information achieved the best performance and its performance was compared to radiology readers on an external test set.
Collapse
Affiliation(s)
- Claudio E. von Schacky
- grid.6936.a0000000123222966Department of Radiology, Klinikum rechts der Isar, School of Medicine, Technische Universität München, Ismaninger Strasse 22, 81675 Munich, Germany
| | - Nikolas J. Wilhelm
- Department for Orthopedics and Orthopedic Sports Medicine, Ismaninger Strasse 22, 81675 Munich, Germany
| | - Valerie S. Schäfer
- grid.6936.a0000000123222966Department of Radiology, Klinikum rechts der Isar, School of Medicine, Technische Universität München, Ismaninger Strasse 22, 81675 Munich, Germany
| | - Yannik Leonhardt
- grid.6936.a0000000123222966Department of Radiology, Klinikum rechts der Isar, School of Medicine, Technische Universität München, Ismaninger Strasse 22, 81675 Munich, Germany
| | - Matthias Jung
- grid.7708.80000 0000 9428 7911Department of Diagnostic and Interventional Radiology, Medical Center–University of Freiburg, Faculty of Medicine, Freiburg, Germany
| | - Pia M. Jungmann
- grid.7708.80000 0000 9428 7911Department of Diagnostic and Interventional Radiology, Medical Center–University of Freiburg, Faculty of Medicine, Freiburg, Germany
| | - Maximilian F. Russe
- grid.7708.80000 0000 9428 7911Department of Diagnostic and Interventional Radiology, Medical Center–University of Freiburg, Faculty of Medicine, Freiburg, Germany
| | - Sarah C. Foreman
- grid.6936.a0000000123222966Department of Radiology, Klinikum rechts der Isar, School of Medicine, Technische Universität München, Ismaninger Strasse 22, 81675 Munich, Germany
| | - Felix G. Gassert
- grid.6936.a0000000123222966Department of Radiology, Klinikum rechts der Isar, School of Medicine, Technische Universität München, Ismaninger Strasse 22, 81675 Munich, Germany
| | - Florian T. Gassert
- grid.6936.a0000000123222966Department of Radiology, Klinikum rechts der Isar, School of Medicine, Technische Universität München, Ismaninger Strasse 22, 81675 Munich, Germany
| | - Benedikt J. Schwaiger
- grid.6936.a0000000123222966Department of Neuroradiology, Klinikum rechts der Isar, School of Medicine, Technische Universität München, Munich, Germany
| | - Carolin Mogler
- grid.15474.330000 0004 0477 2438Institute of Pathology, Klinikum rechts der Isar, School of Medicine, Technische Universität München, Ismaninger Strasse 22, 81675 Munich, Germany
| | - Carolin Knebel
- Department for Orthopedics and Orthopedic Sports Medicine, Ismaninger Strasse 22, 81675 Munich, Germany
| | | | - Marcus R. Makowski
- grid.6936.a0000000123222966Department of Radiology, Klinikum rechts der Isar, School of Medicine, Technische Universität München, Ismaninger Strasse 22, 81675 Munich, Germany
| | - Klaus Woertler
- grid.6936.a0000000123222966Department of Radiology, Klinikum rechts der Isar, School of Medicine, Technische Universität München, Ismaninger Strasse 22, 81675 Munich, Germany
| | - Rainer Burgkart
- Department for Orthopedics and Orthopedic Sports Medicine, Ismaninger Strasse 22, 81675 Munich, Germany
| | - Alexandra S. Gersing
- grid.6936.a0000000123222966Department of Radiology, Klinikum rechts der Isar, School of Medicine, Technische Universität München, Ismaninger Strasse 22, 81675 Munich, Germany ,grid.5252.00000 0004 1936 973XDepartment of Neuroradiology, University Hospital, LMU Munich, Marchioninistraße 15, 81377 Munich, Germany
| |
Collapse
|
34
|
Gitto S, Cuocolo R, van Langevelde K, van de Sande MAJ, Parafioriti A, Luzzati A, Imbriaco M, Sconfienza LM, Bloem JL. MRI radiomics-based machine learning classification of atypical cartilaginous tumour and grade II chondrosarcoma of long bones. EBioMedicine 2022; 75:103757. [PMID: 34933178 PMCID: PMC8688587 DOI: 10.1016/j.ebiom.2021.103757] [Citation(s) in RCA: 43] [Impact Index Per Article: 14.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2021] [Revised: 11/24/2021] [Accepted: 11/30/2021] [Indexed: 12/11/2022] Open
Abstract
Background Atypical cartilaginous tumour (ACT) and grade II chondrosarcoma (CS2) of long bones are respectively managed with watchful waiting or curettage and wide resection. Preoperatively, imaging diagnosis can be challenging due to interobserver variability and biopsy suffers from sample errors. The aim of this study is to determine diagnostic performance of MRI radiomics-based machine learning in differentiating ACT from CS2 of long bones. Methods One-hundred-fifty-eight patients with surgically treated and histology-proven cartilaginous bone tumours were retrospectively included at two tertiary bone tumour centres. The training cohort consisted of 93 MRI scans from centre 1 (n=74 ACT; n=19 CS2). The external test cohort consisted of 65 MRI scans from centre 2 (n=45 ACT; n=20 CS2). Bidimensional segmentation was performed on T1-weighted MRI. Radiomic features were extracted. After dimensionality reduction and class balancing in centre 1, a machine-learning classifier (Extra Trees Classifier) was tuned on the training cohort using 10-fold cross-validation and tested on the external test cohort. In centre 2, its performance was compared with an experienced musculoskeletal oncology radiologist using McNemar's test. Findings After tuning on the training cohort (AUC=0.88), the machine-learning classifier had 92% accuracy (60/65, AUC=0.94) in identifying the lesions in the external test cohort. Its accuracies in correctly classifying ACT and CS2 were 98% (44/45) and 80% (16/20), respectively. The radiologist had 98% accuracy (64/65) with no difference compared to the classifier (p=0.134). Interpretation Machine learning showed high accuracy in classifying ACT and CS2 of long bones based on MRI radiomic features. Funding ESSR Young Researchers Grant.
Collapse
Affiliation(s)
- Salvatore Gitto
- Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milan, Italy; Radiology Department, Leiden University Medical Center, Leiden, The Netherlands
| | - Renato Cuocolo
- Dipartimento di Medicina Clinica e Chirurgia, Università degli Studi di Napoli "Federico II", Naples, Italy; Laboratory of Augmented Reality for Health Monitoring (ARHeMLab), Dipartimento di Ingegneria Elettrica e delle Tecnologie dell'Informazione, Università degli Studi di Napoli "Federico II", Naples, Italy
| | | | | | | | | | - Massimo Imbriaco
- Dipartimento di Scienze Biomediche Avanzate, Università degli Studi di Napoli "Federico II", Naples, Italy
| | - Luca Maria Sconfienza
- Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milan, Italy; IRCCS Istituto Ortopedico Galeazzi, Milan, Italy.
| | - Johan L Bloem
- Radiology Department, Leiden University Medical Center, Leiden, The Netherlands
| |
Collapse
|
35
|
Albano D, Cuocolo R, Patti C, Ugga L, Chianca V, Tarantino V, Faraone R, Albano S, Micci G, Costa A, Paratore R, Ficola U, Lagalla R, Midiri M, Galia M. Whole-body MRI radiomics model to predict relapsed/refractory Hodgkin Lymphoma: A preliminary study. Magn Reson Imaging 2021; 86:55-60. [PMID: 34808304 DOI: 10.1016/j.mri.2021.11.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2021] [Revised: 10/15/2021] [Accepted: 11/15/2021] [Indexed: 11/28/2022]
Abstract
PURPOSE A strong prognostic score that enables a stratification of newly diagnosed Hodgkin Lymphoma (HL) to identify patients at high risk of refractory/relapsed disease is still needed. Our aim was to investigate the potential value of a radiomics analysis pipeline from whole-body MRI (WB-MRI) exams for clinical outcome prediction in patients with HL. MATERIALS AND METHODS Index lesions from baseline WB-MRIs of 40 patients (22 females; mean age 31.7 ± 11.4 years) with newly diagnosed HL treated by ABVD chemotherapy regimen were manually segmented on T1-weighted, STIR, and DWI images for texture analysis feature extraction. A machine learning approach based on the Extra Trees classifier and incorporating clinical variables, 18F-FDG-PET/CT-derived metabolic tumor volume, and WB-MRI radiomics features was tested using cross-validation to predict refractory/relapsed disease. RESULTS Relapsed disease was observed in 10/40 patients (25%), two of whom died due to progression of disease and graft versus host disease, while eight reached the complete remission. In total, 1403 clinical and radiomics features were extracted, of which 11 clinical variables and 171 radiomics parameters from both original and filtered images were selected. The 3 best performing Extra Trees classifier models obtained an equivalent highest mean accuracy of 0.78 and standard deviation of 0.09, with a mean AUC of 0.82 and standard deviation of 0.08. CONCLUSIONS Our preliminary results demonstrate that a combined machine learning and texture analysis model to predict refractory/relapsed HL on WB-MRI exams is feasible and may help in the clinical outcome prediction in HL patients.
Collapse
Affiliation(s)
- Domenico Albano
- Sezione di Scienze Radiologiche, Dipartimento di Biomedicina, Neuroscienze e Diagnostica Avanzata, Università degli Studi di Palermo, Via del Vespro 129, 90127 Palermo, Italy; IRCCS Istituto Ortopedico Galeazzi, Via Riccardo Galeazzi 4, 20161 Milan, Italy.
| | - Renato Cuocolo
- Dipartimento di Medicina Clinica e Chirurgia, Università degli Studi di Napoli "Federico II", Via Pansini 5, 80131 Naples, Italy; Laboratory of Augmented Reality for Health Monitoring (ARHeMLab), Dipartimento di Ingegneria Elettrica e delle Tecnologie dell'Informazione, Università degli Studi di Napoli "Federico II", Via Claudio 21, 80125 Naples, Italy
| | - Caterina Patti
- Unità Operativa di Oncoematologia, Azienda Ospedaliera Ospedali Riuniti Villa Sofia-Cervello, Via Trabucco 180, 90146 Palermo, Italy
| | - Lorenzo Ugga
- Department of Advanced Biomedical Sciences, University of Naples "Federico II", Via Pansini 5, 80131 Naples, Italy
| | - Vito Chianca
- Ospedale Evangelico Betania, Via Argine 604, 80147 Napoli, Italy; Clinica di Radiologia EOC IIMSI, 6900 Lugano, Switzerland
| | - Vittoria Tarantino
- Unità Operativa di Oncoematologia, Azienda Ospedaliera Ospedali Riuniti Villa Sofia-Cervello, Via Trabucco 180, 90146 Palermo, Italy; PhD Program in Clinical and Experimental Medicine, University of Modena and Reggio Emilia, 41100 Modena, Italy
| | - Roberta Faraone
- Sezione di Scienze Radiologiche, Dipartimento di Biomedicina, Neuroscienze e Diagnostica Avanzata, Università degli Studi di Palermo, Via del Vespro 129, 90127 Palermo, Italy
| | - Silvia Albano
- Sezione di Scienze Radiologiche, Dipartimento di Biomedicina, Neuroscienze e Diagnostica Avanzata, Università degli Studi di Palermo, Via del Vespro 129, 90127 Palermo, Italy
| | - Giuseppe Micci
- Sezione di Scienze Radiologiche, Dipartimento di Biomedicina, Neuroscienze e Diagnostica Avanzata, Università degli Studi di Palermo, Via del Vespro 129, 90127 Palermo, Italy
| | - Alessandro Costa
- Unità Operativa di Oncoematologia, Azienda Ospedaliera Ospedali Riuniti Villa Sofia-Cervello, Via Trabucco 180, 90146 Palermo, Italy
| | - Rosario Paratore
- Nuclear Medicine Department, La Maddalena Hospital, Via San Lorenzo 312/D, 90146 Palermo, Italy
| | - Umberto Ficola
- Nuclear Medicine Department, La Maddalena Hospital, Via San Lorenzo 312/D, 90146 Palermo, Italy
| | - Roberto Lagalla
- Sezione di Scienze Radiologiche, Dipartimento di Biomedicina, Neuroscienze e Diagnostica Avanzata, Università degli Studi di Palermo, Via del Vespro 129, 90127 Palermo, Italy
| | - Massimo Midiri
- Sezione di Scienze Radiologiche, Dipartimento di Biomedicina, Neuroscienze e Diagnostica Avanzata, Università degli Studi di Palermo, Via del Vespro 129, 90127 Palermo, Italy
| | - Massimo Galia
- Sezione di Scienze Radiologiche, Dipartimento di Biomedicina, Neuroscienze e Diagnostica Avanzata, Università degli Studi di Palermo, Via del Vespro 129, 90127 Palermo, Italy
| |
Collapse
|
36
|
Radiomics and Machine Learning Can Differentiate Transient Osteoporosis from Avascular Necrosis of the Hip. Diagnostics (Basel) 2021; 11:diagnostics11091686. [PMID: 34574027 PMCID: PMC8468167 DOI: 10.3390/diagnostics11091686] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2021] [Revised: 09/12/2021] [Accepted: 09/14/2021] [Indexed: 02/07/2023] Open
Abstract
Differentiation between transient osteoporosis (TOH) and avascular necrosis (AVN) of the hip is a longstanding challenge in musculoskeletal radiology. The purpose of this study was to utilize MRI-based radiomics and machine learning (ML) for accurate differentiation between the two entities. A total of 109 hips with TOH and 104 hips with AVN were retrospectively included. Femoral heads and necks with segmented radiomics features were extracted. Three ML classifiers (XGboost, CatBoost and SVM) using 38 relevant radiomics features were trained on 70% and validated on 30% of the dataset. ML performance was compared to two musculoskeletal radiologists, a general radiologist and two radiology residents. XGboost achieved the best performance with an area under the curve (AUC) of 93.7% (95% CI from 87.7 to 99.8%) among ML models. MSK radiologists achieved an AUC of 90.6% (95% CI from 86.7% to 94.5%) and 88.3% (95% CI from 84% to 92.7%), respectively, similar to residents. The general radiologist achieved an AUC of 84.5% (95% CI from 80% to 89%), significantly lower than of XGboost (p = 0.017). In conclusion, radiomics-based ML achieved a performance similar to MSK radiologists and significantly higher compared to general radiologists in differentiating between TOH and AVN.
Collapse
|
37
|
Gitto S, Cuocolo R, Emili I, Tofanelli L, Chianca V, Albano D, Messina C, Imbriaco M, Sconfienza LM. Effects of Interobserver Variability on 2D and 3D CT- and MRI-Based Texture Feature Reproducibility of Cartilaginous Bone Tumors. J Digit Imaging 2021; 34:820-832. [PMID: 34405298 PMCID: PMC8455795 DOI: 10.1007/s10278-021-00498-3] [Citation(s) in RCA: 33] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2020] [Revised: 05/27/2021] [Accepted: 07/19/2021] [Indexed: 12/13/2022] Open
Abstract
This study aims to investigate the influence of interobserver manual segmentation variability on the reproducibility of 2D and 3D unenhanced computed tomography (CT)- and magnetic resonance imaging (MRI)-based texture analysis. Thirty patients with cartilaginous bone tumors (10 enchondromas, 10 atypical cartilaginous tumors, 10 chondrosarcomas) were retrospectively included. Three radiologists independently performed manual contour-focused segmentation on unenhanced CT and T1-weighted and T2-weighted MRI by drawing both a 2D region of interest (ROI) on the slice showing the largest tumor area and a 3D ROI including the whole tumor volume. Additionally, a marginal erosion was applied to both 2D and 3D segmentations to evaluate the influence of segmentation margins. A total of 783 and 1132 features were extracted from original and filtered 2D and 3D images, respectively. Intraclass correlation coefficient ≥ 0.75 defined feature stability. In 2D vs. 3D contour-focused segmentation, the rates of stable features were 74.71% vs. 86.57% (p < 0.001), 77.14% vs. 80.04% (p = 0.142), and 95.66% vs. 94.97% (p = 0.554) for CT and T1-weighted and T2-weighted images, respectively. Margin shrinkage did not improve 2D (p = 0.343) and performed worse than 3D (p < 0.001) contour-focused segmentation in terms of feature stability. In 2D vs. 3D contour-focused segmentation, matching stable features derived from CT and MRI were 65.8% vs. 68.7% (p = 0.191), and those derived from T1-weighted and T2-weighted images were 76.0% vs. 78.2% (p = 0.285). 2D and 3D radiomic features of cartilaginous bone tumors extracted from unenhanced CT and MRI are reproducible, although some degree of interobserver segmentation variability highlights the need for reliability analysis in future studies.
Collapse
Affiliation(s)
- Salvatore Gitto
- Dipartimento Di Scienze Biomediche Per La Salute, Università Degli Studi Di Milano, Via Luigi Mangiagalli 31, 20133, Milan, Italy.
| | - Renato Cuocolo
- Dipartimento Di Medicina Clinica E Chirurgia, Università Degli Studi Di Napoli "Federico II", Naples, Italy.,Laboratory of Augmented Reality for Health Monitoring (ARHeMLab), Dipartimento Di Ingegneria Elettrica E Delle Tecnologie Dell'Informazione, Università Degli Studi Di Napoli "Federico II", Naples, Italy
| | - Ilaria Emili
- Unità di Radiodiagnostica, Presidio CTO, ASST Pini-CTO, Milan, Italy
| | - Laura Tofanelli
- Dipartimento di Radiologia Diagnostica ed Interventistica, Università degli Studi di Milano, Ospedale San Paolo, Milan, Italy
| | - Vito Chianca
- Ospedale Evangelico Betania, Naples, Italy.,Clinica Di Radiologia, Istituto Imaging Della Svizzera Italiana - Ente Ospedaliero Cantonale, Lugano, Switzerland
| | - Domenico Albano
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy.,Sezione Di Scienze Radiologiche, Dipartimento Di Biomedicina, Neuroscienze E Diagnostica Avanzata, Università Degli Studi Di Palermo, Palermo, Italy
| | | | - Massimo Imbriaco
- Dipartimento Di Scienze Biomediche Avanzate, Università Degli Studi Di Napoli "Federico II", Naples, Italy
| | - Luca Maria Sconfienza
- Dipartimento Di Scienze Biomediche Per La Salute, Università Degli Studi Di Milano, Via Luigi Mangiagalli 31, 20133, Milan, Italy.,IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
| |
Collapse
|
38
|
Vertebral MRI-based radiomics model to differentiate multiple myeloma from metastases: influence of features number on logistic regression model performance. Eur Radiol 2021; 32:572-581. [PMID: 34255157 DOI: 10.1007/s00330-021-08150-y] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2021] [Accepted: 06/09/2021] [Indexed: 10/20/2022]
Abstract
OBJECTIVES This study aimed to use the most frequent features to establish a vertebral MRI-based radiomics model that could differentiate multiple myeloma (MM) from metastases and compare the model performance with different features number. METHODS We retrospectively analyzed conventional MRI (T1WI and fat-suppression T2WI) of 103 MM patients and 138 patients with metastases. The feature selection process included four steps. The first three steps defined as conventional feature selection (CFS), carried out 50 times (ten times with 5-fold cross-validation), included variance threshold, SelectKBest, and least absolute shrinkage and selection operator. The most frequent fixed features were selected for modeling during the last step. The number of events per independent variable (EPV) is the number of patients in a smaller subgroup divided by the number of radiomics features considered in developing the prediction model. The EPV values considered were 5, 10, 15, and 20. Therefore, we constructed four models using the top 16, 8, 6, and 4 most frequent features, respectively. The models constructed with features selected by CFS were also compared. RESULTS The AUCs of 20EPV-Model, 15EPV-Model, and CSF-Model (AUC = 0.71, 0.81, and 0.78) were poor than 10EPV-Model (AUC = 0.84, p < 0.001). The AUC of 10EPV-Model was comparable with 5EPV-Model (AUC = 0.85, p = 0.480). CONCLUSIONS The radiomics model constructed with an appropriate small number of the most frequent features could well distinguish metastases from MM based on conventional vertebral MRI. Based on our results, we recommend following the 10 EPV as the rule of thumb for feature selection. KEY POINTS • The developed radiomics model could distinguish metastases from multiple myeloma based on conventional vertebral MRI. • An accurate model based on just a handful of the most frequent features could be constructed by utilizing multiple feature reduction techniques. • An event per independent variable value of 10 is recommended as a rule of thumb for modeling feature selection.
Collapse
|
39
|
Castaldo A, De Lucia DR, Pontillo G, Gatti M, Cocozza S, Ugga L, Cuocolo R. State of the Art in Artificial Intelligence and Radiomics in Hepatocellular Carcinoma. Diagnostics (Basel) 2021; 11:1194. [PMID: 34209197 PMCID: PMC8307071 DOI: 10.3390/diagnostics11071194] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2021] [Revised: 06/24/2021] [Accepted: 06/24/2021] [Indexed: 12/12/2022] Open
Abstract
The most common liver malignancy is hepatocellular carcinoma (HCC), which is also associated with high mortality. Often HCC develops in a chronic liver disease setting, and early diagnosis as well as accurate screening of high-risk patients is crucial for appropriate and effective management of these patients. While imaging characteristics of HCC are well-defined in the diagnostic phase, challenging cases still occur, and current prognostic and predictive models are limited in their accuracy. Radiomics and machine learning (ML) offer new tools to address these issues and may lead to scientific breakthroughs with the potential to impact clinical practice and improve patient outcomes. In this review, we will present an overview of these technologies in the setting of HCC imaging across different modalities and a range of applications. These include lesion segmentation, diagnosis, prognostic modeling and prediction of treatment response. Finally, limitations preventing clinical application of radiomics and ML at the present time are discussed, together with necessary future developments to bring the field forward and outside of a purely academic endeavor.
Collapse
Affiliation(s)
- Anna Castaldo
- Department of Advanced Biomedical Sciences, University of Naples “Federico II”, 80131 Naples, Italy; (A.C.); (D.R.D.L.); (G.P.); (S.C.); (L.U.)
| | - Davide Raffaele De Lucia
- Department of Advanced Biomedical Sciences, University of Naples “Federico II”, 80131 Naples, Italy; (A.C.); (D.R.D.L.); (G.P.); (S.C.); (L.U.)
| | - Giuseppe Pontillo
- Department of Advanced Biomedical Sciences, University of Naples “Federico II”, 80131 Naples, Italy; (A.C.); (D.R.D.L.); (G.P.); (S.C.); (L.U.)
| | - Marco Gatti
- Radiology Unit, Department of Surgical Sciences, University of Turin, 10124 Turin, Italy;
| | - Sirio Cocozza
- Department of Advanced Biomedical Sciences, University of Naples “Federico II”, 80131 Naples, Italy; (A.C.); (D.R.D.L.); (G.P.); (S.C.); (L.U.)
| | - Lorenzo Ugga
- Department of Advanced Biomedical Sciences, University of Naples “Federico II”, 80131 Naples, Italy; (A.C.); (D.R.D.L.); (G.P.); (S.C.); (L.U.)
| | - Renato Cuocolo
- Department of Clinical Medicine and Surgery, University of Naples “Federico II”, 80131 Naples, Italy
| |
Collapse
|
40
|
Gitto S, Cuocolo R, Albano D, Morelli F, Pescatori LC, Messina C, Imbriaco M, Sconfienza LM. CT and MRI radiomics of bone and soft-tissue sarcomas: a systematic review of reproducibility and validation strategies. Insights Imaging 2021; 12:68. [PMID: 34076740 PMCID: PMC8172744 DOI: 10.1186/s13244-021-01008-3] [Citation(s) in RCA: 38] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2021] [Accepted: 05/05/2021] [Indexed: 02/07/2023] Open
Abstract
Background Feature reproducibility and model validation are two main challenges of radiomics. This study aims to systematically review radiomic feature reproducibility and predictive model validation strategies in studies dealing with CT and MRI radiomics of bone and soft-tissue sarcomas. The ultimate goal is to promote achieving a consensus on these aspects in radiomic workflows and facilitate clinical transferability. Results Out of 278 identified papers, forty-nine papers published between 2008 and 2020 were included. They dealt with radiomics of bone (n = 12) or soft-tissue (n = 37) tumors. Eighteen (37%) studies included a feature reproducibility analysis. Inter-/intra-reader segmentation variability was the theme of reproducibility analysis in 16 (33%) investigations, outnumbering the analyses focused on image acquisition or post-processing (n = 2, 4%). The intraclass correlation coefficient was the most commonly used statistical method to assess reproducibility, which ranged from 0.6 and 0.9. At least one machine learning validation technique was used for model development in 25 (51%) papers, and K-fold cross-validation was the most commonly employed. A clinical validation of the model was reported in 19 (39%) papers. It was performed using a separate dataset from the primary institution (i.e., internal validation) in 14 (29%) studies and an independent dataset related to different scanners or from another institution (i.e., independent validation) in 5 (10%) studies. Conclusions The issues of radiomic feature reproducibility and model validation varied largely among the studies dealing with musculoskeletal sarcomas and should be addressed in future investigations to bring the field of radiomics from a preclinical research area to the clinical stage.
Collapse
Affiliation(s)
- Salvatore Gitto
- Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Via Riccardo Galeazzi 4, 20161, Milan, Italy.
| | - Renato Cuocolo
- Dipartimento di Medicina Clinica e Chirurgia, Università degli Studi di Napoli "Federico II", Naples, Italy.,Laboratory of Augmented Reality for Health Monitoring (ARHeMLab), Dipartimento di Ingegneria Elettrica e delle Tecnologie dell'Informazione, Università degli Studi di Napoli "Federico II", Naples, Italy
| | - Domenico Albano
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy.,Sezione di Scienze Radiologiche, Dipartimento di Biomedicina, Neuroscienze e Diagnostica Avanzata, Università degli Studi di Palermo, Palermo, Italy
| | | | - Lorenzo Carlo Pescatori
- Assistance Publique - Hôpitaux de Paris (AP-HP), Service d'Imagerie Médicale, CHU Henri Mondor, Créteil, France
| | - Carmelo Messina
- Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Via Riccardo Galeazzi 4, 20161, Milan, Italy.,IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
| | - Massimo Imbriaco
- Dipartimento di Scienze Biomediche Avanzate, Università degli Studi di Napoli "Federico II", Naples, Italy
| | - Luca Maria Sconfienza
- Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Via Riccardo Galeazzi 4, 20161, Milan, Italy.,IRCCS Istituto Ortopedico Galeazzi, Milan, Italy
| |
Collapse
|
41
|
CT radiomics-based machine learning classification of atypical cartilaginous tumours and appendicular chondrosarcomas. EBioMedicine 2021; 68:103407. [PMID: 34051442 PMCID: PMC8170113 DOI: 10.1016/j.ebiom.2021.103407] [Citation(s) in RCA: 41] [Impact Index Per Article: 10.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2021] [Revised: 05/05/2021] [Accepted: 05/05/2021] [Indexed: 12/11/2022] Open
Abstract
Background Clinical management ranges from surveillance or curettage to wide resection for atypical to higher-grade cartilaginous tumours, respectively. Our aim was to investigate the performance of computed tomography (CT) radiomics-based machine learning for classification of atypical cartilaginous tumours and higher-grade chondrosarcomas of long bones. Methods One-hundred-twenty patients with histology-proven lesions were retrospectively included. The training cohort consisted of 84 CT scans from centre 1 (n=55 G1 or atypical cartilaginous tumours; n=29 G2-G4 chondrosarcomas). The external test cohort consisted of the CT component of 36 positron emission tomography-CT scans from centre 2 (n=16 G1 or atypical cartilaginous tumours; n=20 G2-G4 chondrosarcomas). Bidimensional segmentation was performed on preoperative CT. Radiomic features were extracted. After dimensionality reduction and class balancing in centre 1, the performance of a machine-learning classifier (LogitBoost) was assessed on the training cohort using 10-fold cross-validation and on the external test cohort. In centre 2, its performance was compared with preoperative biopsy and an experienced radiologist using McNemar's test. Findings The classifier had 81% (AUC=0.89) and 75% (AUC=0.78) accuracy in identifying the lesions in the training and external test cohorts, respectively. Specifically, its accuracy in classifying atypical cartilaginous tumours and higher-grade chondrosarcomas was 84% and 78% in the training cohort, and 81% and 70% in the external test cohort, respectively. Preoperative biopsy had 64% (AUC=0.66) accuracy (p=0.29). The radiologist had 81% accuracy (p=0.75). Interpretation Machine learning showed good accuracy in classifying atypical and higher-grade cartilaginous tumours of long bones based on preoperative CT radiomic features. Funding ESSR Young Researchers Grant.
Collapse
|
42
|
Chianca V, Albano D, Messina C, Vincenzo G, Rizzo S, Del Grande F, Sconfienza LM. An update in musculoskeletal tumors: from quantitative imaging to radiomics. Radiol Med 2021; 126:1095-1105. [PMID: 34009541 DOI: 10.1007/s11547-021-01368-2] [Citation(s) in RCA: 32] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2021] [Accepted: 05/02/2021] [Indexed: 02/08/2023]
Abstract
In the last two decades, relevant progress has been made in the diagnosis of musculoskeletal tumors due to the development of new imaging tools, such as diffusion-weighted imaging, diffusion kurtosis imaging, magnetic resonance spectroscopy, and diffusion tensor imaging. Another important role has been played by the development of artificial intelligence software based on complex algorithms, which employ computing power in the detection of specific tumor types. The aim of this article is to report the most advanced imaging techniques focusing on their advantages in clinical practice.
Collapse
Affiliation(s)
- Vito Chianca
- Clinica di Radiologia EOC IIMSI, Lugano, Switzerland. .,Ospedale Evangelico Betania, Napoli, Italy. .,Master in Oncologic Imaging, Diagnostic and Interventional Radiology Department of Translational Research, University of Pisa, Via Roma, 67, 56126, Pisa, Italy.
| | - Domenico Albano
- IRCCS Istituto Ortopedico Galeazzi, Milano, Italy.,Sezione di Scienze Radiologiche, Dipartimento Di Biomedicina, Neuroscienze e Diagnostica Avanzata, Università degli Studi di Palermo, Palermo, Italy
| | - Carmelo Messina
- IRCCS Istituto Ortopedico Galeazzi, Milano, Italy.,Dipartimento di Scienze Biomediche Per La Salute, Università degli Studi di Milano, Milano, Italy
| | | | | | | | - Luca Maria Sconfienza
- IRCCS Istituto Ortopedico Galeazzi, Milano, Italy.,Dipartimento di Scienze Biomediche Per La Salute, Università degli Studi di Milano, Milano, Italy
| |
Collapse
|
43
|
Artificial intelligence applications in medical imaging: A review of the medical physics research in Italy. Phys Med 2021; 83:221-241. [DOI: 10.1016/j.ejmp.2021.04.010] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/05/2020] [Revised: 03/31/2021] [Accepted: 04/03/2021] [Indexed: 02/06/2023] Open
|
44
|
Chianca V, Cuocolo R, Gitto S, Albano D, Merli I, Badalyan J, Cortese MC, Messina C, Luzzati A, Parafioriti A, Galbusera F, Brunetti A, Sconfienza LM. Radiomic Machine Learning Classifiers in Spine Bone Tumors: A Multi-Software, Multi-Scanner Study. Eur J Radiol 2021; 137:109586. [PMID: 33610852 DOI: 10.1016/j.ejrad.2021.109586] [Citation(s) in RCA: 38] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2020] [Revised: 11/22/2020] [Accepted: 02/04/2021] [Indexed: 12/13/2022]
Abstract
PURPOSE Spinal lesion differential diagnosis remains challenging even in MRI. Radiomics and machine learning (ML) have proven useful even in absence of a standardized data mining pipeline. We aimed to assess ML diagnostic performance in spinal lesion differential diagnosis, employing radiomic data extracted by different software. METHODS Patients undergoing MRI for a vertebral lesion were retrospectively analyzed (n = 146, 67 males, 79 females; mean age 63 ± 16 years, range 8-89 years) and constituted the train (n = 100) and internal test cohorts (n = 46). Part of the latter had additional prior exams which constituted a multi-scanner, external test cohort (n = 35). Lesions were labeled as benign or malignant (2-label classification), and benign, primary malignant or metastases (3-label classification) for classification analyses. Features extracted via 3D Slicer heterogeneityCAD module (hCAD) and PyRadiomics were independently used to compare different combinations of feature selection methods and ML classifiers (n = 19). RESULTS In total, 90 and 1548 features were extracted by hCAD and PyRadiomics, respectively. The best feature selection method-ML algorithm combination was selected by 10 iterations of 10-fold cross-validation in the training data. For the 2-label classification ML obtained 94% accuracy in the internal test cohort, using hCAD data, and 86% in the external one. For the 3-label classification, PyRadiomics data allowed for 80% and 69% accuracy in the internal and external test sets, respectively. CONCLUSIONS MRI radiomics combined with ML may be useful in spinal lesion assessment. More robust pre-processing led to better consistency despite scanner and protocol heterogeneity.
Collapse
Affiliation(s)
- Vito Chianca
- Clinica di Radiologia EOC, Istituto di Imaging della Svizzera Italiana (IIMSI), Lugano, Switzerland; Ospedale Evangelico Betania, Napoli, Italy
| | - Renato Cuocolo
- Dipartimento di Scienze Biomediche Avanzate, Università degli Studi di Napoli (")Federico II", Napoli, Italy; Laboratory of Augmented Reality for Health Monitoring (ARHeMLab), Dipartimento di Ingegneria Elettrica e delle Tecnologie dell'Informazione, Università degli Studi di Napoli "Federico II", Naples, Italy
| | - Salvatore Gitto
- Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milano, Italy.
| | - Domenico Albano
- IRCCS Istituto Ortopedico Galeazzi, Milano, Italy; Sezione di Scienze Radiologiche, Dipartimento di Biomedicina, Neuroscienze e Diagnostica Avanzata, Università degli Studi di Palermo, Italy
| | - Ilaria Merli
- UOC Radiodiagnostica, Presidio San Carlo Borromeo, ASST Santi Paolo e Carlo, Milano, Italy
| | - Julietta Badalyan
- International Medical School, University of Milan and Russian National Research Medical University, Milano, Italy
| | - Maria Cristina Cortese
- Istituto di Radiologia, Fondazione Policlinico A. Gemelli IRCCS - Università Cattolica Sacro Cuore, Roma, Italy
| | - Carmelo Messina
- IRCCS Istituto Ortopedico Galeazzi, Milano, Italy; Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milano, Italy
| | | | | | | | - Arturo Brunetti
- Dipartimento di Scienze Biomediche Avanzate, Università degli Studi di Napoli (")Federico II", Napoli, Italy
| | - Luca Maria Sconfienza
- IRCCS Istituto Ortopedico Galeazzi, Milano, Italy; Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di Milano, Milano, Italy
| |
Collapse
|
45
|
Diagnostic Performance and Radiation Dose of the EOS System to Image Enchondromatosis: A Phantom Study. APPLIED SCIENCES-BASEL 2020. [DOI: 10.3390/app10248941] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
Abstract
Background: Radiation doses and capability of EOS, conventional radiography (CR), and computed tomography (CT) to detect and measure enchondromas in a dedicated five-year-old anthropomorphic phantom were compared. Methods: To simulate enchondromas, minced pieces of chicken bone and cartilage were packed in conventional kitchen plastic foil to create ovoidal/rounded masses and randomly hung on the phantom. The phantom was imaged five times with CR, CT, and EOS, each time changing the number and position of inserts. All images were reviewed by a senior radiologist and a radiology resident. Results: EOS and CR detected all inserts in 4/5 cases (80%), while in one case 1/17 inserts was not seen. Excellent agreement of EOS with CR (88% reproducibility; bias = 14 mm; repeatability coefficient (CoR) 2.9; 95% CI from −2.8 to 3.1 mm; p = 0.5) and CT (81% reproducibility; bias = 15 mm; CoR 5.2; 95% CI from −5.5 to 5.2 mm; p = 0.7) was found. EOS showed 71% interobserver reproducibility (CoR 7.2; bias = 0.6 mm; 95% CI from −6.6 to 7.8 mm; p = 0.25). The EOS-Fast radiation dose was also significantly lower than the median radiation dose of CR (644.7 (599.4–651.97) mGy•cm2, p = 0.004). Conclusions: Low-dose EOS has the same capability as CR to detect and measure enchondroma-like inserts on a phantom and may be considered to monitor patients with multiple enchondromas.
Collapse
|
46
|
Alhumaid SM, Alharbi A, Aljubair H. Magnetic Resonance Imaging Role in the Differentiation Between Atypical Cartilaginous Tumors and High-Grade Chondrosarcoma: An Updated Systematic Review. Cureus 2020; 12:e11237. [PMID: 33269165 PMCID: PMC7704161 DOI: 10.7759/cureus.11237] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/29/2020] [Indexed: 12/11/2022] Open
Abstract
Chondrosarcoma (CS) is a malignant tumor affecting the bones while atypical cartilaginous tumors (ACTs) are chondral tumors with moderate cellularity, mild atypia, and with myxoid changes and mild metastatic ability. Both can have one of the worst prognoses if not identified early enough. Magnetic resonance imaging (MRI) has been one of the modalities to detect such tumors and we aim to determine the common characteristic and features to be seen while screening for CS or ACTs. We conducted a systematic review of the previously published reports that investigated the diagnostic ability of MRI and the reported characteristics that can differentiate between ACTs and high-grade chondrosarcomas (HGCS). A comprehensive relevant database search was performed to include all the relevant studies. Among these studies, seven studies investigated the overall accuracy in the classification of the different chondroma types. Additionally, many studies reported the characteristic findings of each tumor according to the MRI results. These characteristics mainly included trapped fat, bone marrow edema, cortical damage, and soft-tissue expansion. Therefore, further attention should be given to these criteria for better assessment, differentiation, and favorable outcomes. MRI can efficiently identify some of the characteristics of both ACTs and HGCS. However, combining it with other radiological modalities may lead to a better differentiation. The detection of ACTs and HGCS lesions with MRI solely has been doubted before in the literature.
Collapse
Affiliation(s)
- Salah M Alhumaid
- Department of Diagnostic Radiology, Prince Sultan Military Medical City, Riyadh, SAU
| | - Alwaleed Alharbi
- Department of Diagnostic Radiology, Prince Sultan Military Medical City, Riyadh, SAU
| | - Hamad Aljubair
- Department of Diagnostic Radiology, Prince Sultan Military Medical City, Riyadh, SAU
| |
Collapse
|
47
|
Verde F, Romeo V, Stanzione A, Maurea S. Current trends of artificial intelligence in cancer imaging. Artif Intell Med Imaging 2020; 1:87-93. [DOI: 10.35711/aimi.v1.i3.87] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/23/2020] [Revised: 09/22/2020] [Accepted: 09/23/2020] [Indexed: 02/06/2023] Open
Affiliation(s)
- Francesco Verde
- Department of Advanced Biomedical Sciences, University of Naples "Federico II", Napoli 80131, Italy
| | - Valeria Romeo
- Department of Advanced Biomedical Sciences, University of Naples "Federico II", Napoli 80131, Italy
| | - Arnaldo Stanzione
- Department of Advanced Biomedical Sciences, University of Naples "Federico II", Napoli 80131, Italy
| | - Simone Maurea
- Department of Advanced Biomedical Sciences, University of Naples "Federico II", Napoli 80131, Italy
| |
Collapse
|