1
|
Fedeli L, Benelli M, Busoni S, Belli G, Ciccarone A, Coniglio A, Esposito M, Nocetti L, Sghedoni R, Tarducci R, Altabella L, Belligotti E, Bettarini S, Betti M, Caivano R, Carnì M, Chiappiniello A, Cimolai S, Cretti F, Feliciani G, Fulcheri C, Gasperi C, Giacometti M, Levrero F, Lizio D, Maieron M, Marzi S, Mascaro L, Mazzocchi S, Meliadò G, Morzenti S, Niespolo A, Noferini L, Oberhofer N, Orsingher L, Quattrocchi M, Ricci A, Savini A, Taddeucci A, Testa C, Tortoli P, Gobbi G, Gori C, Bernardi L, Giannelli M, Mazzoni LN. Unsupervised clustering analysis-based characterization of spatial profiles of inaccuracy in apparent diffusion coefficient values with varying acquisition plan orientation and diffusion weighting gradient direction - a large multicenter phantom study. Biomed Phys Eng Express 2024; 11:015021. [PMID: 39530644 DOI: 10.1088/2057-1976/ad9156] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2024] [Accepted: 11/12/2024] [Indexed: 11/16/2024]
Abstract
This large multicenter study of 37 magnetic resonance imaging scanners aimed at characterizing, for the first time, spatial profiles of inaccuracy (namely, Δ-profiles) in apparent diffusion coefficient (ADC) values with varying acquisition plan orientation and diffusion weighting gradient direction, using a statistical approach exploiting unsupervised clustering analysis. A diffusion-weighted imaging (DWI) protocol (b-value: 0-200-400-600-800-1000 s mm-2) with different combinations of acquisition plan orientation (axial/sagittal/coronal) and diffusion weighting gradient direction (anterior-posterior/left-right/feet-head) was acquired on a standard water phantom. For each acquisition setup, Δ-profiles along the 3 main orthogonal directions were characterized by fitting data with a second order polynomial function (ar2+ br + c). Moreover, for each Δ-profile, the maximum minus minimum of the fitting function (δmax) was calculated. The parametersa,b,c, andδmaxshowed some significant variations between scanner systems by different manufacturers or with different static magnetic field strengths, as well as between different acquisition/estimation setups. Unsupervised clustering analysis showed two evident clusters with significantly different values of parametera(p< 0.0001), which can be grouped by acquisition protocol/Δ-profile direction but not scanner system. The results of ∆-profiles confirm an appreciable inter-scanner variability in ADC measurement and corroborate the importance of guarantying the reliability of ADC estimations in clinical or research studies, considering for each scanner system the specific acquisition sequence in terms of acquisition plan orientation and diffusion weighting gradient direction.
Collapse
Affiliation(s)
- Luca Fedeli
- Azienda USL Toscana Centro, Department of Hospitals Network, Medical Physics Unit Prato-Pistoia, Italy
| | - Matteo Benelli
- Bioinformatics Unit, Hospital of Prato, A.U.S.L. Toscana Centro, Italy
| | - Simone Busoni
- U.O.C. Fisica Sanitaria, A.O.U. Careggi, Firenze, Italy
| | - Giacomo Belli
- U.O.C. Fisica Sanitaria, A.O.U. Careggi, Firenze, Italy
| | | | | | - Marco Esposito
- S.C. Fisica Sanitaria Firenze-Empoli, A.U.S.L. Toscana Centro, Firenze, Italy
| | - Luca Nocetti
- Servizio di Fisica Medica, A.O.U. Policlinico di Modena, Modena, Italy
| | - Roberto Sghedoni
- Fisica Medica, Azienda USL-IRCCS di Reggio Emilia, Reggio Emilia, Italy
| | | | - Luisa Altabella
- U.O.C. Fisica Sanitaria, A.O.U. Integrata di Verona, Verona, Italy
| | - Eleonora Belligotti
- Fisica Medica e Alte Tecnologie, A.O. Ospedali Riuniti Marche Nord, Pesaro, Italy
| | | | - Margherita Betti
- Azienda USL Toscana Centro, Department of Hospitals Network, Medical Physics Unit Prato-Pistoia, Italy
| | | | - Marco Carnì
- U.O.D. Fisica Sanitaria, A.O.U. Policlinico Umberto I, Roma, Italy
| | | | - Sara Cimolai
- U.O. Fisica Sanitaria, U.L.S.S. 2 Marca Trevigiana, Treviso, Italy
| | - Fabiola Cretti
- U.S.C. Fisica Sanitaria, A.O. Papa Giovanni XXIII, Bergamo, Italy
| | - Giacomo Feliciani
- Medical Physics Unit, IRCCS Istituto Romagnolo per lo Studio dei Tumori (IRST) 'Dino Amadori', Meldola, Italy
| | | | - Chiara Gasperi
- U.O.S.D. Fisica Sanitaria Arezzo, A.U.S.L. Toscana Sud Est, Arezzo, Italy
| | - Mara Giacometti
- S.O.D. Fisica Sanitaria, A.O.U. Ospedali Riuniti di Ancona, Ancona, Italy
| | - Fabrizio Levrero
- U.O. Fisica Sanitaria, Ospedale Policlinico San Martino, Genova, Italy
| | | | - Marta Maieron
- S.O.C. Fisica Sanitaria, A.S.U.I. Udine S. Maria della Misericordia, Udine, Italy
| | - Simona Marzi
- Medical Physics Laboratory, IRCCS Regina Elena National Cancer Institute, Roma, Italy
| | - Lorella Mascaro
- U.O.C. Fisica Sanitaria, A.S.S.T. Spedali Civili di Brescia, Brescia, Italy
| | - Silvia Mazzocchi
- S.C. Fisica Sanitaria Firenze-Empoli, A.U.S.L. Toscana Centro, Firenze, Italy
| | - Gabriele Meliadò
- U.O.C. Fisica Sanitaria, A.O.U. Integrata di Verona, Verona, Italy
| | | | - Alessandra Niespolo
- U.O.C. Fisica Sanitaria Area Nord, A.U.S.L. Toscana Nord Ovest, Lucca, Italy
| | | | - Nadia Oberhofer
- Servizio Aziendale di Fisica Sanitaria, A.S. dell'Alto Adige, Bolzano, Italy
| | - Laura Orsingher
- U.O.C. Fisica Sanitaria, Azienda Provinciale per i Servizi Sanitari, Trento, Italy
| | | | | | | | | | - Claudia Testa
- Dipartimento di Fisica e Astronomia, Università di Bologna, Bologna, Italy
| | - Paolo Tortoli
- U.O.C. Fisica Sanitaria, A.O.U. Careggi, Firenze, Italy
| | - Gianni Gobbi
- Università degli Studi di Perugia, Perugia, Italy
| | - Cesare Gori
- Università degli Studi di Firenze, Firenze, Italy
| | - Luca Bernardi
- Azienda USL Toscana Centro, Department of Hospitals Network, Medical Physics Unit Prato-Pistoia, Italy
| | - Marco Giannelli
- Unit of Medical Physics, Pisa University Hospital 'Azienda Ospedaliero-Universitaria Pisana', Pisa, Italy
| | - Lorenzo Nicola Mazzoni
- Azienda USL Toscana Centro, Department of Hospitals Network, Medical Physics Unit Prato-Pistoia, Italy
| |
Collapse
|
2
|
Zong R, Ma X, Shi Y, Geng L. Can Machine Learning Models Based on Computed Tomography Radiomics and Clinical Characteristics Provide Diagnostic Value for Epstein-Barr Virus-Associated Gastric Cancer? J Comput Assist Tomogr 2024; 48:859-867. [PMID: 38924393 DOI: 10.1097/rct.0000000000001636] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/28/2024]
Abstract
OBJECTIVE The aim of this study was to explore whether machine learning model based on computed tomography (CT) radiomics and clinical characteristics can differentiate Epstein-Barr virus-associated gastric cancer (EBVaGC) from non-EBVaGC. METHODS Contrast-enhanced CT images were collected from 158 patients with GC (46 EBV-positive, 112 EBV-negative) between April 2018 and February 2023. Radiomics features were extracted from the volumes of interest. A radiomics signature was built based on radiomics features by the least absolute shrinkage and selection operator logistic regression algorithm. Multivariate analyses were used to identify significant clinicoradiological variables. We developed 6 ML models for EBVaGC, including logistic regression, Extreme Gradient Boosting, random forest (RF), support vector machine, Gaussian Naive Bayes, and K-nearest neighbor algorithm. The area under the receiver operating characteristic curve (AUC), the area under the precision-recall curves (AP), calibration plots, and decision curve analysis were applied to assess the effectiveness of each model. RESULTS Six ML models achieved AUC of 0.706-0.854 and AP of 0.480-0.793 for predicting EBV status in GC. With an AUC of 0.854 and an AP of 0.793, the RF model performed the best. The forest plot of the AUC score revealed that the RF model had the most stable performance, with a standard deviation of 0.003 for AUC score. RF also performed well in the testing dataset, with an AUC of 0.832 (95% confidence interval: 0.679-0.951), accuracy of 0.833, sensitivity of 0.857, and specificity of 0.824, respectively. CONCLUSIONS The RF model based on clinical variables and Rad_score can serve as a noninvasive tool to evaluate the EBV status of gastric cancer.
Collapse
Affiliation(s)
- Ruilong Zong
- From the Department of Radiology, Xuzhou Central Hospital, Xuzhou, China
| | - Xijuan Ma
- From the Department of Radiology, Xuzhou Central Hospital, Xuzhou, China
| | - Yibing Shi
- From the Department of Radiology, Xuzhou Central Hospital, Xuzhou, China
| | - Li Geng
- Department of Radiology, The Affiliated Hospital of Xuzhou Medical University
| |
Collapse
|
3
|
Ahmed TM, Zhu Z, Yasrab M, Blanco A, Kawamoto S, He J, Fishman EK, Chu L, Javed AA. Preoperative Prediction of Lymph Node Metastases in Nonfunctional Pancreatic Neuroendocrine Tumors Using a Combined CT Radiomics-Clinical Model. Ann Surg Oncol 2024; 31:8136-8145. [PMID: 39179862 DOI: 10.1245/s10434-024-16064-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2024] [Accepted: 08/04/2024] [Indexed: 08/26/2024]
Abstract
BACKGROUND PanNETs are a rare group of pancreatic tumors that display heterogeneous histopathological and clinical behavior. Nodal disease has been established as one of the strongest predictors of patient outcomes in PanNETs. Lack of accurate preoperative assessment of nodal disease is a major limitation in the management of these patients, in particular those with small (< 2 cm) low-grade tumors. The aim of the study was to evaluate the ability of radiomic features (RF) to preoperatively predict the presence of nodal disease in pancreatic neuroendocrine tumors (PanNETs). PATIENTS AND METHODS An institutional database was used to identify patients with nonfunctional PanNETs undergoing resection. Pancreas protocol computed tomography was obtained, manually segmented, and RF were extracted. These were analyzed using the minimum redundancy maximum relevance analysis for hierarchical feature selection. Youden index was used to identify the optimal cutoff for predicting nodal disease. A random forest prediction model was trained using RF and clinicopathological characteristics and validated internally. RESULTS Of the 320 patients included in the study, 92 (28.8%) had nodal disease based on histopathological assessment of the surgical specimen. A radiomic signature based on ten selected RF was developed. Clinicopathological characteristics predictive of nodal disease included tumor grade and size. Upon internal validation the combined radiomics and clinical feature model demonstrated adequate performance (AUC 0.80) in identifying nodal disease. The model accurately identified nodal disease in 85% of patients with small tumors (< 2 cm). CONCLUSIONS Non-invasive preoperative assessment of nodal disease using RF and clinicopathological characteristics is feasible.
Collapse
Affiliation(s)
- Taha M Ahmed
- The Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins Hospital, Baltimore, MD, USA
| | - Zhuotun Zhu
- The Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins Hospital, Baltimore, MD, USA
| | - Mohammad Yasrab
- The Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins Hospital, Baltimore, MD, USA
| | - Alejandra Blanco
- The Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins Hospital, Baltimore, MD, USA
| | - Satomi Kawamoto
- The Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins Hospital, Baltimore, MD, USA
| | - Jin He
- Department of Surgery, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Elliot K Fishman
- The Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins Hospital, Baltimore, MD, USA
| | - Linda Chu
- The Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins Hospital, Baltimore, MD, USA
| | - Ammar A Javed
- Department of Surgery, Johns Hopkins University School of Medicine, Baltimore, MD, USA.
- Division of Hepatobiliary and Pancreatic Surgery, Department of Surgery, NYU Langone Grossman School of Medicine, New York, NY, USA.
| |
Collapse
|
4
|
Mo S, Huang C, Wang Y, Zhao H, Wu W, Jiang H, Qin S. Endoscopic ultrasonography-based intratumoral and peritumoral machine learning radiomics analyses for distinguishing insulinomas from non-functional pancreatic neuroendocrine tumors. Front Endocrinol (Lausanne) 2024; 15:1383814. [PMID: 38952387 PMCID: PMC11215175 DOI: 10.3389/fendo.2024.1383814] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/08/2024] [Accepted: 06/05/2024] [Indexed: 07/03/2024] Open
Abstract
OBJECTIVES To develop and validate radiomics models utilizing endoscopic ultrasonography (EUS) images to distinguish insulinomas from non-functional pancreatic neuroendocrine tumors (NF-PNETs). METHODS A total of 106 patients, comprising 61 with insulinomas and 45 with NF-PNETs, were included in this study. The patients were randomly assigned to either the training or test cohort. Radiomics features were extracted from both the intratumoral and peritumoral regions, respectively. Six machine learning algorithms were utilized to train intratumoral prediction models, using only the nonzero coefficient features. The researchers identified the most effective intratumoral radiomics model and subsequently employed it to develop peritumoral and combined radiomics models. Finally, a predictive nomogram for insulinomas was constructed and assessed. RESULTS A total of 107 radiomics features were extracted based on EUS, and only features with nonzero coefficients were retained. Among the six intratumoral radiomics models, the light gradient boosting machine (LightGBM) model demonstrated superior performance. Furthermore, a peritumoral radiomics model was established and evaluated. The combined model, integrating both the intratumoral and peritumoral radiomics features, exhibited a comparable performance in the training cohort (AUC=0.876) and achieved the highest accuracy in predicting outcomes in the test cohorts (AUC=0.835). The Delong test, calibration curves, and decision curve analysis (DCA) were employed to validate these findings. Insulinomas exhibited a significantly smaller diameter compared to NF-PNETs. Finally, the nomogram, incorporating diameter and radiomics signature, was constructed and assessed, which owned superior performance in both the training (AUC=0.929) and test (AUC=0.913) cohorts. CONCLUSION A novel and impactful radiomics model and nomogram were developed and validated for the accurate differentiation of NF-PNETs and insulinomas utilizing EUS images.
Collapse
Affiliation(s)
- Shuangyang Mo
- Gastroenterology Department, Liuzhou People’s Hospital Affiliated to Guangxi Medical University, Liuzhou, China
- Gastroenterology Department, The First Affiliated Hospital of Guangxi Medical University, Nanning, China
| | - Cheng Huang
- Oncology Department, Liuzhou People’s Hospital Affiliated to Guangxi Medical University, Liuzhou, China
| | - Yingwei Wang
- Gastroenterology Department, Liuzhou People’s Hospital Affiliated to Guangxi Medical University, Liuzhou, China
| | - Huaying Zhao
- Gastroenterology Department, Liuzhou People’s Hospital Affiliated to Guangxi Medical University, Liuzhou, China
| | - Wenhong Wu
- Gastroenterology Department, Liuzhou People’s Hospital Affiliated to Guangxi Medical University, Liuzhou, China
| | - Haixing Jiang
- Gastroenterology Department, The First Affiliated Hospital of Guangxi Medical University, Nanning, China
| | - Shanyu Qin
- Gastroenterology Department, The First Affiliated Hospital of Guangxi Medical University, Nanning, China
| |
Collapse
|
5
|
Della Corte A, Mori M, Calabrese F, Palumbo D, Ratti F, Palazzo G, Pellegrini A, Santangelo D, Ronzoni M, Spezi E, Del Vecchio A, Fiorino C, Aldrighetti L, De Cobelli F. Preoperative MRI radiomic analysis for predicting local tumor progression in colorectal liver metastases before microwave ablation. Int J Hyperthermia 2024; 41:2349059. [PMID: 38754994 DOI: 10.1080/02656736.2024.2349059] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2023] [Revised: 03/28/2024] [Accepted: 04/25/2024] [Indexed: 05/18/2024] Open
Abstract
PURPOSE Radiomics may aid in predicting prognosis in patients with colorectal liver metastases (CLM). Consistent data is available on CT, yet limited data is available on MRI. This study assesses the capability of MRI-derived radiomic features (RFs) to predict local tumor progression-free survival (LTPFS) in patients with CLMs treated with microwave ablation (MWA). METHODS All CLM patients with pre-operative Gadoxetic acid-MRI treated with MWA in a single institution between September 2015 and February 2022 were evaluated. Pre-procedural information was retrieved retrospectively. Two observers manually segmented CLMs on T2 and T1-Hepatobiliary phase (T1-HBP) scans. After inter-observer variability testing, 148/182 RFs showed robustness on T1-HBP, and 141/182 on T2 (ICC > 0.7).Cox multivariate analysis was run to establish clinical (CLIN-mod), radiomic (RAD-T1, RAD-T2), and combined (COMB-T1, COMB-T2) models for LTPFS prediction. RESULTS Seventy-six CLMs (43 patients) were assessed. Median follow-up was 14 months. LTP occurred in 19 lesions (25%).CLIN-mod was composed of minimal ablation margins (MAMs), intra-segment progression and primary tumor grade and exhibited moderately high discriminatory power in predicting LTPFS (AUC = 0.89, p = 0.0001). Both RAD-T1 and RAD-T2 were able to predict LTPFS: (RAD-T1: AUC = 0.83, p = 0.0003; RAD-T2: AUC = 0.79, p = 0.001). Combined models yielded the strongest performance (COMB-T1: AUC = 0.98, p = 0.0001; COMB-T2: AUC = 0.95, p = 0.0003). Both combined models included MAMs and tumor regression grade; COMB-T1 also featured 10th percentile of signal intensity, while tumor flatness was present in COMB-T2. CONCLUSION MRI-based radiomic evaluation of CLMs is feasible and potentially useful for LTP prediction. Combined models outperformed clinical or radiomic models alone for LTPFS prediction.
Collapse
Affiliation(s)
- Angelo Della Corte
- Department of Radiology, IRCCS San Raffaele Hospital, Milan, Italy
- University Vita-Salute San Raffaele, Milan, Italy
| | - Martina Mori
- Department of Medical Physics, San Raffaele Scientific Institute, Milan, Italy
| | | | - Diego Palumbo
- Department of Radiology, IRCCS San Raffaele Hospital, Milan, Italy
- University Vita-Salute San Raffaele, Milan, Italy
| | - Francesca Ratti
- Hepatobiliary Surgery Division, IRCCS San Raffaele Hospital, Milan, Italy
| | - Gabriele Palazzo
- Department of Medical Physics, San Raffaele Scientific Institute, Milan, Italy
| | | | | | - Monica Ronzoni
- Unit of Oncology, IRCCS San Raffaele Scientific Institute, Milan, Italy
| | - Emiliano Spezi
- School of Engineering, Cardiff University, Cardiff, UK
- Department of Medical Physics, Velindre Cancer Centre, Cardiff, UK
| | | | - Claudio Fiorino
- Department of Medical Physics, San Raffaele Scientific Institute, Milan, Italy
| | - Luca Aldrighetti
- University Vita-Salute San Raffaele, Milan, Italy
- Hepatobiliary Surgery Division, IRCCS San Raffaele Hospital, Milan, Italy
| | - Francesco De Cobelli
- Department of Radiology, IRCCS San Raffaele Hospital, Milan, Italy
- University Vita-Salute San Raffaele, Milan, Italy
| |
Collapse
|
6
|
Battistella A, Tacelli M, Mapelli P, Schiavo Lena M, Andreasi V, Genova L, Muffatti F, De Cobelli F, Partelli S, Falconi M. Recent developments in the diagnosis of pancreatic neuroendocrine neoplasms. Expert Rev Gastroenterol Hepatol 2024; 18:155-169. [PMID: 38647016 DOI: 10.1080/17474124.2024.2342837] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/21/2023] [Accepted: 04/10/2024] [Indexed: 04/25/2024]
Abstract
INTRODUCTION Pancreatic Neuroendocrine Neoplasms (PanNENs) are characterized by a highly heterogeneous clinical and biological behavior, making their diagnosis challenging. PanNENs diagnostic work-up mainly relies on biochemical markers, pathological examination, and imaging evaluation. The latter includes radiological imaging (i.e. computed tomography [CT] and magnetic resonance imaging [MRI]), functional imaging (i.e. 68Gallium [68 Ga]Ga-DOTA-peptide PET/CT and Fluorine-18 fluorodeoxyglucose [18F]FDG PET/CT), and endoscopic ultrasound (EUS) with its associated procedures. AREAS COVERED This review provides a comprehensive assessment of the recent advancements in the PanNENs diagnostic field. PubMed and Embase databases were used for the research, performed from inception to October 2023. EXPERT OPINION A deeper understanding of PanNENs biology, recent technological improvements in imaging modalities, as well as progresses achieved in molecular and cytological assays, are fundamental players for the achievement of early diagnosis and enhanced preoperative characterization of PanNENs. A multimodal diagnostic approach is required for a thorough disease assessment.
Collapse
Affiliation(s)
- Anna Battistella
- Pancreatic Surgery Unit, Pancreas Translational and Clinical Research Center, IRCCS San Raffaele Scientific Institute, Milan, Italy
- Vita-Salute San Raffaele University, Milan, Italy
| | - Matteo Tacelli
- Vita-Salute San Raffaele University, Milan, Italy
- Pancreato-biliary Endoscopy and EUS Division, IRCCS San Raffaele Scientific Institute, Milan, Italy
| | - Paola Mapelli
- Vita-Salute San Raffaele University, Milan, Italy
- Nuclear Medicine Department, IRCCS San Raffaele Scientific Institute, Milan, Italy
| | | | - Valentina Andreasi
- Pancreatic Surgery Unit, Pancreas Translational and Clinical Research Center, IRCCS San Raffaele Scientific Institute, Milan, Italy
- Vita-Salute San Raffaele University, Milan, Italy
| | - Luana Genova
- Pancreatic Surgery Unit, Pancreas Translational and Clinical Research Center, IRCCS San Raffaele Scientific Institute, Milan, Italy
- Vita-Salute San Raffaele University, Milan, Italy
| | - Francesca Muffatti
- Pancreatic Surgery Unit, Pancreas Translational and Clinical Research Center, IRCCS San Raffaele Scientific Institute, Milan, Italy
| | - Francesco De Cobelli
- Vita-Salute San Raffaele University, Milan, Italy
- Radiology Unit, IRCCS San Raffaele Scientific Institute, Milan, Italy
| | - Stefano Partelli
- Pancreatic Surgery Unit, Pancreas Translational and Clinical Research Center, IRCCS San Raffaele Scientific Institute, Milan, Italy
- Vita-Salute San Raffaele University, Milan, Italy
| | - Massimo Falconi
- Pancreatic Surgery Unit, Pancreas Translational and Clinical Research Center, IRCCS San Raffaele Scientific Institute, Milan, Italy
- Vita-Salute San Raffaele University, Milan, Italy
| |
Collapse
|
7
|
Javed AA, Zhu Z, Kinny-Köster B, Habib JR, Kawamoto S, Hruban RH, Fishman EK, Wolfgang CL, He J, Chu LC. Accurate non-invasive grading of nonfunctional pancreatic neuroendocrine tumors with a CT derived radiomics signature. Diagn Interv Imaging 2024; 105:33-39. [PMID: 37598013 PMCID: PMC10873069 DOI: 10.1016/j.diii.2023.08.002] [Citation(s) in RCA: 17] [Impact Index Per Article: 17.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2023] [Revised: 08/02/2023] [Accepted: 08/03/2023] [Indexed: 08/21/2023]
Abstract
PURPOSE The purpose of this study was to develop a radiomics-signature using computed tomography (CT) data for the preoperative prediction of grade of nonfunctional pancreatic neuroendocrine tumors (NF-PNETs). MATERIALS AND METHODS A retrospective study was performed on patients undergoing resection for NF-PNETs between 2010 and 2019. A total of 2436 radiomic features were extracted from arterial and venous phases of pancreas-protocol CT examinations. Radiomic features that were associated with final pathologic grade observed in the surgical specimens were subjected to joint mutual information maximization for hierarchical feature selection and the development of the radiomic-signature. Youden-index was used to identify optimal cutoff for determining tumor grade. A random forest prediction model was trained and validated internally. The performance of this tool in predicting tumor grade was compared to that of EUS-FNA sampling that was used as the standard of reference. RESULTS A total of 270 patients were included and a fusion radiomic-signature based on 10 selected features was developed using the development cohort (n = 201). There were 149 men and 121 women with a mean age of 59.4 ± 12.3 (standard deviation) years (range: 23.3-85.0 years). Upon internal validation in a new set of 69 patients, a strong discrimination was observed with an area under the curve (AUC) of 0.80 (95% confidence interval [CI]: 0.71-0.90) with corresponding sensitivity and specificity of 87.5% (95% CI: 79.7-95.3) and 73.3% (95% CI: 62.9-83.8) respectively. Of the study population, 143 patients (52.9%) underwent EUS-FNA. Biopsies were non-diagnostic in 26 patients (18.2%) and could not be graded due to insufficient sample in 42 patients (29.4%). In the cohort of 75 patients (52.4%) in whom biopsies were graded the radiomic-signature demonstrated not different AUC as compared to EUS-FNA (AUC: 0.69 vs. 0.67; P = 0.723), however greater sensitivity (i.e., ability to accurately identify G2/3 lesion was observed (80.8% vs. 42.3%; P < 0.001). CONCLUSION Non-invasive assessment of tumor grade in patients with PNETs using the proposed radiomic-signature demonstrated high accuracy. Prospective validation and optimization could overcome the commonly experienced diagnostic uncertainty in the assessment of tumor grade in patients with PNETs and could facilitate clinical decision-making.
Collapse
Affiliation(s)
- Ammar A Javed
- Department of Surgery, The Johns Hopkins University School of Medicine, Baltimore, MD 21287, USA; Department of Surgery, New York University Langone Hospital, New York City, New York 10016, USA
| | - Zhuotun Zhu
- Department of Radiology, The Johns Hopkins University School of Medicine, Baltimore, MD 21287, USA
| | - Benedict Kinny-Köster
- Department of Surgery, New York University Langone Hospital, New York City, New York 10016, USA
| | - Joseph R Habib
- Department of Surgery, The Johns Hopkins University School of Medicine, Baltimore, MD 21287, USA
| | - Satomi Kawamoto
- Department of Radiology, The Johns Hopkins University School of Medicine, Baltimore, MD 21287, USA
| | - Ralph H Hruban
- Department of Pathology, The Johns Hopkins University School of Medicine, Baltimore, MD 21287, USA; Sol Goldman Pancreatic Cancer Research Center, Johns Hopkins University School of Medicine, Baltimore, MD 21287, USA
| | - Elliot K Fishman
- Department of Radiology, The Johns Hopkins University School of Medicine, Baltimore, MD 21287, USA
| | - Christopher L Wolfgang
- Department of Surgery, New York University Langone Hospital, New York City, New York 10016, USA
| | - Jin He
- Department of Surgery, The Johns Hopkins University School of Medicine, Baltimore, MD 21287, USA
| | - Linda C Chu
- Department of Radiology, The Johns Hopkins University School of Medicine, Baltimore, MD 21287, USA.
| |
Collapse
|
8
|
Grewal M, Ahmed T, Javed AA. Current state of radiomics in hepatobiliary and pancreatic malignancies. ARTIFICIAL INTELLIGENCE SURGERY 2023; 3:217-32. [DOI: 10.20517/ais.2023.28] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/05/2025]
Abstract
Rising in incidence, hepatobiliary and pancreatic (HPB) cancers continue to exhibit dismal long-term survival. The overall poor prognosis of HPB cancers is reflective of the advanced stage at which most patients are diagnosed. Late diagnosis is driven by the often-asymptomatic nature of these diseases, as well as a dearth of screening modalities. Additionally, standard imaging modalities fall short of providing accurate and detailed information regarding specific tumor characteristics, which can better inform surgical planning and sequencing of systemic therapy. Therefore, precise therapeutic planning must be delayed until histopathological examination is performed at the time of resection. Given the current shortcomings in the management of HPB cancers, investigations of numerous noninvasive biomarkers, including circulating tumor cells and DNA, proteomics, immunolomics, and radiomics, are underway. Radiomics encompasses the extraction and analysis of quantitative imaging features. Along with summarizing the general framework of radiomics, this review synthesizes the state of radiomics in HPB cancers, outlining its role in various aspects of management, present limitations, and future applications for clinical integration. Current literature underscores the utility of radiomics in early detection, tumor characterization, therapeutic selection, and prognostication for HPB cancers. Seeing as single-center, small studies constitute the majority of radiomics literature, there is considerable heterogeneity with respect to steps of the radiomics workflow such as segmentation, or delineation of the region of interest on a scan. Nonetheless, the introduction of the radiomics quality score (RQS) demonstrates a step towards greater standardization and reproducibility in the young field of radiomics. Altogether, in the setting of continually improving artificial intelligence algorithms, radiomics represents a promising biomarker avenue for promoting enhanced and tailored management of HPB cancers, with the potential to improve long-term outcomes for patients.
Collapse
|
9
|
Loi S, Mori M, Palumbo D, Crippa S, Palazzo G, Spezi E, Del Vecchio A, Falconi M, De Cobelli F, Fiorino C. Limited impact of discretization/interpolation parameters on the predictive power of CT radiomic features in a surgical cohort of pancreatic cancer patients. LA RADIOLOGIA MEDICA 2023:10.1007/s11547-023-01649-y. [PMID: 37289267 DOI: 10.1007/s11547-023-01649-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Subscribe] [Scholar Register] [Received: 02/10/2023] [Accepted: 05/15/2023] [Indexed: 06/09/2023]
Abstract
PURPOSE To explore the variation of the discriminative power of CT (Computed Tomography) radiomic features (RF) against image discretization/interpolation in predicting early distant relapses (EDR) after upfront surgery. MATERIALS AND METHODS Data of 144 patients with pre-surgical high contrast CT were processed consistently with IBSI (Image Biomarker Standardization Initiative) guidelines. Image interpolation/discretization parameters were intentionally changed, including cubic voxel size (0.21-27 mm3) and binning (32-128 grey levels) in a 15 parameter's sets. After excluding RF with poor inter-observer delineation agreement (ICC < 0.80) and not negligible inter-scanner variability, the variation of 80 RF against discretization/interpolation was first quantified. Then, their ability in classifying patients with early distant relapses (EDR, < 10 months, previously assessed at the first quartile value of time-to-relapse) was investigated in terms of AUC (Area Under Curve) variation for those RF significantly associated to EDR. RESULTS Despite RF variability against discretization/interpolation parameters was large and only 30/80 RF showed %COV < 20 (%COV = 100*STDEV/MEAN), AUC changes were relatively limited: for 30 RF significantly associated with EDR (AUC values around 0.60-0.70), the mean values of SD of AUC variability and AUC range were 0.02 and 0.05 respectively. AUC ranges were between 0.00 and 0.11, with values ≤ 0.05 in 16/30 RF. These variations were further reduced when excluding the extreme values of 32 and 128 for grey levels (Average AUC range 0.04, with values between 0.00 and 0.08). CONCLUSIONS The discriminative power of CT RF in the prediction of EDR after upfront surgery for pancreatic cancer is relatively invariant against image interpolation/discretization within a large range of voxel sizes and binning.
Collapse
Affiliation(s)
- Sara Loi
- Medical Physics, San Raffaele Scientific Institute, Via Olgettina 690, 20132, Milan, Italy
| | - Martina Mori
- Medical Physics, San Raffaele Scientific Institute, Via Olgettina 690, 20132, Milan, Italy
| | | | - Stefano Crippa
- Pancreatic Surgery Unit, Pancreas Translational and Clinical Research Center, San Raffaele Scientific Institute, Milan, Italy
- Università Vita-Salute, Milan, Italy
| | - Gabriele Palazzo
- Medical Physics, San Raffaele Scientific Institute, Via Olgettina 690, 20132, Milan, Italy
| | - Emiliano Spezi
- School of Engineering, Cardiff University, Cardiff, Wales, UK
| | - Antonella Del Vecchio
- Medical Physics, San Raffaele Scientific Institute, Via Olgettina 690, 20132, Milan, Italy
| | - Massimo Falconi
- Pancreatic Surgery Unit, Pancreas Translational and Clinical Research Center, San Raffaele Scientific Institute, Milan, Italy
- Università Vita-Salute, Milan, Italy
| | - Francesco De Cobelli
- San Raffaele Scientific Institute, Milan, Italy
- Università Vita-Salute, Milan, Italy
| | - Claudio Fiorino
- Medical Physics, San Raffaele Scientific Institute, Via Olgettina 690, 20132, Milan, Italy.
| |
Collapse
|
10
|
Staal FC, Taghavi M, Hong EK, Tissier R, van Treijen M, Heeres BC, van der Zee D, Tesselaar ME, Beets-Tan RG, Maas M. CT-based radiomics to distinguish progressive from stable neuroendocrine liver metastases treated with somatostatin analogues: an explorative study. Acta Radiol 2023; 64:1062-1070. [PMID: 35702011 DOI: 10.1177/02841851221106598] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
BACKGROUND Accurate response evaluation in patients with neuroendocrine liver metastases (NELM) remains a challenge. Radiomics has shown promising results regarding response assessment. PURPOSE To differentiate progressive (PD) from stable disease (SD) with radiomics in patients with NELM undergoing somatostatin analogue (SSA) treatment. MATERIAL AND METHODS A total of 46 patients with histologically confirmed gastroenteropancreatic neuroendocrine tumors (GEP-NET) with ≥1 NELM and ≥2 computed tomography (CT) scans were included. Response was assessed with Response Evaluation Criteria in Solid Tumors (RECIST1.1). Hepatic target lesions were manually delineated and analyzed with radiomics. Radiomics features were extracted from each NELM on both arterial-phase (AP) and portal-venous-phase (PVP) CT. Multiple instance learning with regularized logistic regression via LASSO penalization (with threefold cross-validation) was used to classify response. Three models were computed: (i) AP model; (ii) PVP model; and (iii) AP + PVP model for a lesion-based and patient-based outcome. Next, clinical features were added to each model. RESULTS In total, 19 (40%) patients had PD. Median follow-up was 13 months (range 1-50 months). Radiomics models could not accurately classify response (area under the curve 0.44-0.60). Adding clinical variables to the radiomics models did not significantly improve the performance of any model. CONCLUSION Radiomics features were not able to accurately classify response of NELM on surveillance CT scans during SSA treatment.
Collapse
Affiliation(s)
- Femke Cr Staal
- Department of Radiology, 1228The Netherlands Cancer Institute, Amsterdam, The Netherlands
- GROW School for Oncology and Developmental Biology, 5211Maastricht University Medical Centre, Maastricht, The Netherlands
- Center for Neuroendocrine Tumors, ENETS Center of Excellence, 1228Netherlands Cancer Institute Amsterdam/University Medical Center Utrecht, Utrecht, The Netherlands
| | - M Taghavi
- Department of Radiology, 1228The Netherlands Cancer Institute, Amsterdam, The Netherlands
- GROW School for Oncology and Developmental Biology, 5211Maastricht University Medical Centre, Maastricht, The Netherlands
| | - Eun K Hong
- Department of Radiology, 1228The Netherlands Cancer Institute, Amsterdam, The Netherlands
- GROW School for Oncology and Developmental Biology, 5211Maastricht University Medical Centre, Maastricht, The Netherlands
- Department of Radiology, 26725Seoul National University Hospital, Seoul, Republic of Korea
| | - Renaud Tissier
- Biostatistics Center, 1228The Netherlands Cancer Institute, Amsterdam, The Netherlands
| | - Mark van Treijen
- Center for Neuroendocrine Tumors, ENETS Center of Excellence, 1228Netherlands Cancer Institute Amsterdam/University Medical Center Utrecht, Utrecht, The Netherlands
- Department of Endocrine Oncology, 8124University Medical Centre Utrecht, Utrecht, The Netherlands
| | - Birthe C Heeres
- Department of Radiology, 1228The Netherlands Cancer Institute, Amsterdam, The Netherlands
| | | | - Margot Et Tesselaar
- Center for Neuroendocrine Tumors, ENETS Center of Excellence, 1228Netherlands Cancer Institute Amsterdam/University Medical Center Utrecht, Utrecht, The Netherlands
- Department of Medical Oncology, 1228The Netherlands Cancer Institute, Amsterdam, The Netherlands
| | - Regina Gh Beets-Tan
- Department of Radiology, 1228The Netherlands Cancer Institute, Amsterdam, The Netherlands
- GROW School for Oncology and Developmental Biology, 5211Maastricht University Medical Centre, Maastricht, The Netherlands
- Faculty of Health Sciences, University of Southern Denmark, Odense, Denmark
| | - Monique Maas
- Department of Radiology, 1228The Netherlands Cancer Institute, Amsterdam, The Netherlands
| |
Collapse
|
11
|
Mori M, Palumbo D, De Cobelli F, Fiorino C. Does radiomics play a role in the diagnosis, staging and re-staging of gastroesophageal junction adenocarcinoma? Updates Surg 2023; 75:273-279. [PMID: 36114920 DOI: 10.1007/s13304-022-01377-4] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2022] [Accepted: 09/04/2022] [Indexed: 01/24/2023]
Abstract
Radiomics is an emerging field of investigation in medicine consisting in the extraction of quantitative features from conventional medical images and exploring their potentials in improving diagnosis, prognosis and outcome prediction after therapy. Clinical applications are still limited, mostly due to reproducibility and repeatability issues as well as to limited interpretability of predictive radiomic-based features/signatures. In the specific case of gastroesophageal junction (GEJ) adenocarcinoma, the expectancies are particularly high, mainly due to its increasing incidence and to the limited performance of conventional imaging techniques in assessing correct diagnosis and accurate pre-surgical tumor characterization. Accordingly, current literature was reviewed, emphasizing the methodological quality. In addition, papers were scored according to the Radiomic Quality Score (RQS), weighting more the clinical applicability and generalizability of the resulting models. According to the criteria of the search, only two papers were retained: the resulting technical quality was relatively high for both, while the corresponding RQS were 15 and 19 (on a scale of 31). Although the potentials of radiomics in the setting of GEJ adenocarcinoma are relevant, they remain largely unexplored, warranting an urgent need of high-quality, possibly prospective, multicenter studies.
Collapse
Affiliation(s)
- Martina Mori
- School of Medicine, Vita-Salute San Raffaele University, Milan, Italy.,Medical Physics, IRCCS San Raffaele Scientific Institute, Milan, Italy
| | - Diego Palumbo
- Department of Radiology, San Raffaele Scientific Institute, Milan, Italy.,School of Medicine, Vita-Salute San Raffaele University, Milan, Italy
| | - Francesco De Cobelli
- Department of Radiology, San Raffaele Scientific Institute, Milan, Italy.,School of Medicine, Vita-Salute San Raffaele University, Milan, Italy
| | - Claudio Fiorino
- School of Medicine, Vita-Salute San Raffaele University, Milan, Italy. .,Medical Physics, IRCCS San Raffaele Scientific Institute, Milan, Italy.
| |
Collapse
|
12
|
CT radiomic predictors of local relapse after SBRT for lung oligometastases from colorectal cancer: a single institute pilot study. Strahlenther Onkol 2022; 199:477-484. [PMID: 36580087 DOI: 10.1007/s00066-022-02034-w] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2022] [Accepted: 11/20/2022] [Indexed: 12/30/2022]
Abstract
OBJECTIVES To assess the potential of radiomic features (RFs) extracted from simulation computed tomography (CT) images in discriminating local progression (LP) after stereotactic body radiotherapy (SBRT) in the management of lung oligometastases (LOM) from colorectal cancer (CRC). MATERIALS AND METHODS Thirty-eight patients with 70 LOM treated with SBRT were analyzed. The largest LOM was considered as most representative for each patient and was manually delineated by two blinded radiation oncologists. In all, 141 RFs were extracted from both contours according to IBSI (International Biomarker Standardization Initiative) recommendations. Based on the agreement between the two observers, 134/141 RFs were found to be robust against delineation (intraclass correlation coefficient [ICC] > 0.80); independent RFs were then assessed by Spearman correlation coefficients. The association between RFs and LP was assessed with Mann-Whitney test and univariate logistic regression (ULR): the discriminative power of the most informative RF was quantified by receiver-operating characteristics (ROC) analysis through area under curve (AUC). RESULTS In all, 15/38 patients presented LP. Median time to progression was 14.6 months (range 2.4-66 months); 5/141 RFs were significantly associated to LP at ULR analysis (p < 0.05); among them, 4 RFs were selected as robust and independent: Statistical_Variance (AUC = 0.75, p = 0.002), Statistical_Range (AUC = 0.72, p = 0.013), Grey Level Size Zone Matrix (GLSZM) _zoneSizeNonUniformity (AUC = 0.70, p = 0.022), Grey Level Dependence Zone Matrix (GLDZM) _zoneDistanceEntropy (AUC = 0.70, p = 0.026). Importantly, the RF with the best performance (Statisical_Variance) is simply representative of density heterogeneity within LOM. CONCLUSION Four RFs extracted from planning CT were significantly associated with LP of LOM from CRC treated with SBRT. Results encourage further research on a larger population aiming to define a usable radiomic score combining the most predictive RFs and, possibly, additional clinical features.
Collapse
|
13
|
Mori M, Palumbo D, Muffatti F, Partelli S, Mushtaq J, Andreasi V, Prato F, Ubeira MG, Palazzo G, Falconi M, Fiorino C, De Cobelli F. Prediction of the characteristics of aggressiveness of pancreatic neuroendocrine neoplasms (PanNENs) based on CT radiomic features. Eur Radiol 2022; 33:4412-4421. [PMID: 36547673 DOI: 10.1007/s00330-022-09351-9] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2022] [Revised: 10/13/2022] [Accepted: 11/29/2022] [Indexed: 12/24/2022]
Abstract
OBJECTIVES To predict tumor grade (G1 vs. G2/3), presence of distant metastasis (M+), metastatic lymph nodes (N+), and microvascular invasion (VI) of pancreatic neuroendocrine neoplasms (PanNEN) based on preoperative CT radiomic features (RFs), by applying a machine learning approach aimed to limit overfit. METHODS This retrospective study included 101 patients who underwent surgery for PanNEN; the entire population was split into training (n = 70) and validation cohort (n = 31). Based on a previously validated methodology, after tumor segmentation on contrast-enhanced CT, RFs were extracted from unenhanced CT images. In addition, conventional radiological and clinical features were combined with RFs into multivariate logistic regression models using minimum redundancy and a bootstrap-based machine learning approach. For each endpoint, models were trained and validated including only RFs (RF_model), and both (radiomic and clinicoradiological) features (COMB_model). RESULTS Twenty-five patients had G2/G3 tumor, 37 N+, and 14 M+ and 38 were shown to have VI. From a total of 182 RFs initially extracted, few independent radiomic and clinicoradiological features were identified. For M+ and G, the resulting models showed moderate to high performances: areas under the curve (AUC) for training/validation cohorts were 0.85/0.77 (RF_model) and 0.81/0.81 (COMB_model) for M+ and 0.67/0.72 and 0.68/0.70 for G. Concerning N+ and VI, only the COMB_model could be built, with poorer performance for N+ (AUC = 0.72/0.61) compared to VI (0.82/0.75). For all endpoints, the negative predictive value was good (≥ 0.75). CONCLUSIONS Combining few radiomic and clinicoradiological features resulted in presurgical prediction of histological characteristics of PanNENs. Despite the limited risk of overfit, external validations are warranted. KEY POINTS • Histology is the only tool currently available allowing characterization of PanNEN biological characteristics important for prognostic assessment; significant limitations to this approach exist. • Based upon preoperative contrast-enhanced CT images, a machine learning approach optimized to favor models' generalizability was successfully applied to train predictive models for tumor grading (G1 vs. G2/3), microvascular invasion, metastatic lymph nodes, and distant metastatic spread. • Moderate to high discriminative models (AUC: 0.67-0.85) based on few parameters (≤ 3) showing high negative predictive value (0.75-0.98) were generated and then successfully validated.
Collapse
|
14
|
Battistella A, Partelli S, Andreasi V, Marinoni I, Palumbo D, Tacelli M, Lena MS, Muffatti F, Mushtaq J, Capurso G, Arcidiacono PG, De Cobelli F, Doglioni C, Perren A, Falconi M. Preoperative assessment of microvessel density in nonfunctioning pancreatic neuroendocrine tumors (NF-PanNETs). Surgery 2022; 172:1236-1244. [PMID: 35953308 DOI: 10.1016/j.surg.2022.06.017] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2022] [Revised: 05/26/2022] [Accepted: 06/13/2022] [Indexed: 10/15/2022]
Abstract
BACKGROUND Hypervascularization is a typical feature of pancreatic neuroendocrine tumors, and it frequently allows their recognition at imaging studies. However, the density of microvessels in pancreatic neuroendocrine tumors changes according to their biological behavior, and a low microvessel density is associated with higher disease aggressiveness. The primary aim was to investigate the relationship between microvessel density and aggressiveness of nonfunctioning pancreatic neuroendocrine tumors. The secondary aim was to evaluate the ability of contrast-enhanced computed tomography and contrast-enhanced endoscopic ultrasound in predicting tumor microvessel density. METHODS The patients who underwent surgery for nonfunctioning pancreatic neuroendocrine tumors (n = 66) with an available preoperative contrast-enhanced computed tomography (n = 39) and/or contrast-enhanced endoscopic ultrasound (n = 37) performed at San Raffaele Hospital (2016-2020) were included. The tumor vascularization was assessed by CD-34 staining, contrast-enhanced computed tomography, and contrast-enhanced endoscopic ultrasound. Median microvessel density (165 microvessels/mm2) was chosen as the cutoff to define low microvessel density and high microvessel density. RESULTS The patients with a low microvessel density showed a significantly higher frequency of nodal metastases (P = .026), G2-G3 tumors (P = .022), and death domain-associated protein/α-thalassemia/mental retardation syndrome X-linked loss (P = .011) compared to patients with high microvessel density. The contrast-enhanced computed tomography tumor density in the arterial phase was significantly higher in patients with high microvessel density compared to those with low microvessel density (P = .016). The patients with a low microvessel density showed a significantly higher frequency of contrast-enhanced endoscopic ultrasound arterial hypoenhancement (P = .042) and late washout (P = .034). Contrast-enhanced computed tomography arterial hypoenhancement (P = .007) and contrast-enhanced endoscopic ultrasound late washout (P = .048) independently predicted a low microvessel density in the patients who underwent contrast-enhanced computed tomography and contrast-enhanced endoscopic ultrasound, respectively. CONCLUSION A low microvessel density represents a marker of aggressiveness in the patients with nonfunctioning pancreatic neuroendocrine tumors. Contrast-enhanced computed tomography and contrast-enhanced endoscopic ultrasound are reliable and easily available tools for preoperative assessment of microvessel density.
Collapse
Affiliation(s)
- Anna Battistella
- Pancreatic Surgery Unit, Pancreas Translational and Clinical Research Center, IRCCS San Raffaele Scientific Institute, Vita-Salute San Raffaele University, Milan, Italy. http://www.twitter.com/annabattistell
| | - Stefano Partelli
- Pancreatic Surgery Unit, Pancreas Translational and Clinical Research Center, IRCCS San Raffaele Scientific Institute, Vita-Salute San Raffaele University, Milan, Italy. http://www.twitter.com/spartelli
| | - Valentina Andreasi
- Pancreatic Surgery Unit, Pancreas Translational and Clinical Research Center, IRCCS San Raffaele Scientific Institute, Vita-Salute San Raffaele University, Milan, Italy. http://www.twitter.com/valentinandreas
| | - Ilaria Marinoni
- Institute of Pathology, University of Bern, Bern, Switzerland. http://www.twitter.com/ilamarinoni
| | - Diego Palumbo
- Radiology Unit, IRCCS San Raffaele Scientific Institute, Vita-Salute San Raffaele University, Milan, Italy. http://www.twitter.com/DiegoPalumbo89
| | - Matteo Tacelli
- Pancreato-biliary Endoscopy and EUS Division, IRCCS San Raffaele Scientific Institute, Vita-Salute San Raffaele University, Milan, Italy. http://www.twitter.com/TacelliMatteo
| | - Marco Schiavo Lena
- Pathology Unit, IRCCS San Raffaele Scientific Institute, Vita-Salute San Raffaele University, Milan, Italy
| | - Francesca Muffatti
- Pancreatic Surgery Unit, Pancreas Translational and Clinical Research Center, IRCCS San Raffaele Scientific Institute, Vita-Salute San Raffaele University, Milan, Italy
| | - Junaid Mushtaq
- Radiology Unit, IRCCS San Raffaele Scientific Institute, Vita-Salute San Raffaele University, Milan, Italy
| | - Gabriele Capurso
- Pancreato-biliary Endoscopy and EUS Division, IRCCS San Raffaele Scientific Institute, Vita-Salute San Raffaele University, Milan, Italy. http://www.twitter.com/lelecapurso
| | - Paolo Giorgio Arcidiacono
- Pancreato-biliary Endoscopy and EUS Division, IRCCS San Raffaele Scientific Institute, Vita-Salute San Raffaele University, Milan, Italy
| | - Francesco De Cobelli
- Radiology Unit, IRCCS San Raffaele Scientific Institute, Vita-Salute San Raffaele University, Milan, Italy. http://www.twitter.com/FDeCobelli
| | - Claudio Doglioni
- Pathology Unit, IRCCS San Raffaele Scientific Institute, Vita-Salute San Raffaele University, Milan, Italy
| | - Aurel Perren
- Institute of Pathology, University of Bern, Bern, Switzerland. http://www.twitter.com/AurelPerren
| | - Massimo Falconi
- Pancreatic Surgery Unit, Pancreas Translational and Clinical Research Center, IRCCS San Raffaele Scientific Institute, Vita-Salute San Raffaele University, Milan, Italy.
| |
Collapse
|
15
|
Casà C, Piras A, D’Aviero A, Preziosi F, Mariani S, Cusumano D, Romano A, Boskoski I, Lenkowicz J, Dinapoli N, Cellini F, Gambacorta MA, Valentini V, Mattiucci GC, Boldrini L. The impact of radiomics in diagnosis and staging of pancreatic cancer. Ther Adv Gastrointest Endosc 2022; 15:26317745221081596. [PMID: 35342883 PMCID: PMC8943316 DOI: 10.1177/26317745221081596] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/10/2021] [Accepted: 02/02/2022] [Indexed: 02/05/2023] Open
Abstract
INTRODUCTION Pancreatic cancer (PC) is one of the most aggressive tumours, and better risk stratification among patients is required to provide tailored treatment. The meaning of radiomics and texture analysis as predictive techniques are not already systematically assessed. The aim of this study is to assess the role of radiomics in PC. METHODS A PubMed/MEDLINE and Embase systematic review was conducted to assess the role of radiomics in PC. The search strategy was 'radiomics [All Fields] AND ("pancreas" [MeSH Terms] OR "pancreas" [All Fields] OR "pancreatic" [All Fields])' and only original articles referred to PC in humans in the English language were considered. RESULTS A total of 123 studies and 183 studies were obtained using the mentioned search strategy on PubMed and Embase, respectively. After the complete selection process, a total of 56 papers were considered eligible for the analysis of the results. Radiomics methods were applied in PC for assessment technical feasibility and reproducibility aspects analysis, risk stratification, biologic or genomic status prediction and treatment response prediction. DISCUSSION Radiomics seems to be a promising approach to evaluate PC from diagnosis to treatment response prediction. Further and larger studies are required to confirm the role and allowed to include radiomics parameter in a comprehensive decision support system.
Collapse
Affiliation(s)
- Calogero Casà
- UOC Radioterapia Oncologica, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy
| | | | - Andrea D’Aviero
- UOC Radioterapia Oncologica, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy
| | - Francesco Preziosi
- Dipartimento Universitario di Scienze Radiologiche ed Ematologiche, Università Cattolica del Sacro Cuore, Rome, Italy
| | - Silvia Mariani
- Dipartimento Universitario di Scienze Radiologiche ed Ematologiche, Università Cattolica del Sacro Cuore, Rome, Italy
| | - Davide Cusumano
- UOC Radioterapia Oncologica, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy
| | - Angela Romano
- UOC Radioterapia Oncologica, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy
| | - Ivo Boskoski
- Digestive Endoscopy Unit, Fondazione Policlinico Universitario Agostino Gemelli IRCSS, Rome, Italy
| | - Jacopo Lenkowicz
- UOC Radioterapia Oncologica, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy
| | - Nicola Dinapoli
- UOC Radioterapia Oncologica, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy
| | - Francesco Cellini
- UOC Radioterapia Oncologica, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy
| | - Maria Antonietta Gambacorta
- UOC Radioterapia Oncologica, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy
- Dipartimento Universitario di Scienze Radiologiche ed Ematologiche, Università Cattolica del Sacro Cuore, Rome, Italy
| | - Vincenzo Valentini
- UOC Radioterapia Oncologica, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy
- Dipartimento Universitario di Scienze Radiologiche ed Ematologiche, Università Cattolica del Sacro Cuore, Rome, Italy
| | - Gian Carlo Mattiucci
- UOC Radioterapia Oncologica, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy
- Dipartimento Universitario di Scienze Radiologiche ed Ematologiche, Università Cattolica del Sacro Cuore, Rome, Italy
| | - Luca Boldrini
- UOC Radioterapia Oncologica, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy
- Dipartimento Universitario di Scienze Radiologiche ed Ematologiche, Università Cattolica del Sacro Cuore, Rome, Italy
| |
Collapse
|
16
|
Xue C, Yuan J, Lo GG, Chang ATY, Poon DMC, Wong OL, Zhou Y, Chu WCW. Radiomics feature reliability assessed by intraclass correlation coefficient: a systematic review. Quant Imaging Med Surg 2021; 11:4431-4460. [PMID: 34603997 DOI: 10.21037/qims-21-86] [Citation(s) in RCA: 86] [Impact Index Per Article: 21.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2021] [Accepted: 05/17/2021] [Indexed: 12/13/2022]
Abstract
Radiomics research is rapidly growing in recent years, but more concerns on radiomics reliability are also raised. This review attempts to update and overview the current status of radiomics reliability research in the ever expanding medical literature from the perspective of a single reliability metric of intraclass correlation coefficient (ICC). To conduct this systematic review, Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines were followed. After literature search and selection, a total of 481 radiomics studies using CT, PET, or MRI, covering a wide range of subject and disease types, were included for review. In these highly heterogeneous studies, feature reliability to image segmentation was much more investigated than reliability to other factors, such as image acquisition, reconstruction, post-processing, and feature quantification. The reported ICCs also suggested high radiomics feature reliability to image segmentation. Image acquisition was found to introduce much more feature variability than image segmentation, in particular for MRI, based on the reported ICC values. Image post-processing and feature quantification yielded different levels of radiomics reliability and might be used to mitigate image acquisition-induced variability. Some common flaws and pitfalls in ICC use were identified, and suggestions on better ICC use were given. Due to the extremely high study heterogeneities and possible risks of bias, the degree of radiomics feature reliability that has been achieved could not yet be safely synthesized or derived in this review. More future researches on radiomics reliability are warranted.
Collapse
Affiliation(s)
- Cindy Xue
- Medical Physics and Research Department, Hong Kong Sanatorium & Hospital, Happy Valley, Hong Kong, China.,Department of Imaging and Interventional Radiology, Faculty of Medicine, The Chinese University of Hong Kong, Shatin, New Territories, Hong Kong, China
| | - Jing Yuan
- Medical Physics and Research Department, Hong Kong Sanatorium & Hospital, Happy Valley, Hong Kong, China
| | - Gladys G Lo
- Department of Diagnostic & Interventional Radiology, Hong Kong Sanatorium & Hospital, Happy Valley, Hong Kong, China
| | - Amy T Y Chang
- Comprehensive Oncology Centre, Hong Kong Sanatorium & Hospital, Happy Valley, Hong Kong, China
| | - Darren M C Poon
- Comprehensive Oncology Centre, Hong Kong Sanatorium & Hospital, Happy Valley, Hong Kong, China
| | - Oi Lei Wong
- Medical Physics and Research Department, Hong Kong Sanatorium & Hospital, Happy Valley, Hong Kong, China
| | - Yihang Zhou
- Medical Physics and Research Department, Hong Kong Sanatorium & Hospital, Happy Valley, Hong Kong, China
| | - Winnie C W Chu
- Department of Imaging and Interventional Radiology, Faculty of Medicine, The Chinese University of Hong Kong, Shatin, New Territories, Hong Kong, China
| |
Collapse
|
17
|
Palumbo D, Mori M, Prato F, Crippa S, Belfiori G, Reni M, Mushtaq J, Aleotti F, Guazzarotti G, Cao R, Steidler S, Tamburrino D, Spezi E, Del Vecchio A, Cascinu S, Falconi M, Fiorino C, De Cobelli F. Prediction of Early Distant Recurrence in Upfront Resectable Pancreatic Adenocarcinoma: A Multidisciplinary, Machine Learning-Based Approach. Cancers (Basel) 2021; 13:cancers13194938. [PMID: 34638421 PMCID: PMC8508250 DOI: 10.3390/cancers13194938] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2021] [Revised: 09/27/2021] [Accepted: 09/28/2021] [Indexed: 01/06/2023] Open
Abstract
Simple Summary If pancreatic adenocarcinoma is assessed to be technically resectable, curative surgery is still suggested as the primary treatment option; however, the recurrence rate can be very high even in this selected population. The aim of our retrospective study was to develop a preoperative model to accurately stratify upfront resectable patients according to the risk of early distant disease relapse after surgery (<12 months from index procedure). Through a machine learning-based approach, we identified one biochemical marker (serum level of CA19.9), one radiological finding (necrosis) and one radiomic feature (SurfAreaToVolumeRatio), all significantly associated with the early resurge of distant recurrence. A model composed of these three variables only allowed identification of those patients at high risk for early distant disease relapse (50% chance of developing metastases within 12 months after surgery), who would benefit from neoadjuvant chemotherapy instead of upfront surgery. Abstract Despite careful selection, the recurrence rate after upfront surgery for pancreatic adenocarcinoma can be very high. We aimed to construct and validate a model for the prediction of early distant recurrence (<12 months from index surgery) after upfront pancreaticoduodenectomy. After exclusions, 147 patients were retrospectively enrolled. Preoperative clinical and radiological (CT-based) data were systematically evaluated; moreover, 182 radiomics features (RFs) were extracted. Most significant RFs were selected using minimum redundancy, robustness against delineation uncertainty and an original machine learning bootstrap-based method. Patients were split into training (n = 94) and validation cohort (n = 53). Multivariable Cox regression analysis was first applied on the training cohort; the resulting prognostic index was then tested in the validation cohort. Clinical (serum level of CA19.9), radiological (necrosis), and radiomic (SurfAreaToVolumeRatio) features were significantly associated with the early resurge of distant recurrence. The model combining these three variables performed well in the training cohort (p = 0.0015, HR = 3.58, 95%CI = 1.98–6.71) and was then confirmed in the validation cohort (p = 0.0178, HR = 5.06, 95%CI = 1.75–14.58). The comparison of survival curves between low and high-risk patients showed a p-value <0.0001. Our model may help to better define resectability status, thus providing an actual aid for pancreatic adenocarcinoma patients’ management (upfront surgery vs. neoadjuvant chemotherapy). Independent validations are warranted.
Collapse
Affiliation(s)
- Diego Palumbo
- Department of Radiology, IRCCS San Raffaele Scientific Institute, 20132 Milan, Italy; (D.P.); (J.M.); (G.G.); (S.S.); (F.D.C.)
- School of Medicine, Vita-Salute San Raffaele University, 20132 Milan, Italy; (F.P.); (S.C.); (G.B.); (M.R.); (F.A.); (R.C.); (S.C.); (M.F.)
| | - Martina Mori
- Department of Medical Physics, IRCCS San Raffaele Scientific Institute, 20132 Milan, Italy; (M.M.); (A.D.V.)
| | - Francesco Prato
- School of Medicine, Vita-Salute San Raffaele University, 20132 Milan, Italy; (F.P.); (S.C.); (G.B.); (M.R.); (F.A.); (R.C.); (S.C.); (M.F.)
| | - Stefano Crippa
- School of Medicine, Vita-Salute San Raffaele University, 20132 Milan, Italy; (F.P.); (S.C.); (G.B.); (M.R.); (F.A.); (R.C.); (S.C.); (M.F.)
- Pancreatic Surgery Unit, Pancreas Translational and Clinical Research Center, IRCCS San Raffaele Scientific Institute, 20132 Milan, Italy;
| | - Giulio Belfiori
- School of Medicine, Vita-Salute San Raffaele University, 20132 Milan, Italy; (F.P.); (S.C.); (G.B.); (M.R.); (F.A.); (R.C.); (S.C.); (M.F.)
- Pancreatic Surgery Unit, Pancreas Translational and Clinical Research Center, IRCCS San Raffaele Scientific Institute, 20132 Milan, Italy;
| | - Michele Reni
- School of Medicine, Vita-Salute San Raffaele University, 20132 Milan, Italy; (F.P.); (S.C.); (G.B.); (M.R.); (F.A.); (R.C.); (S.C.); (M.F.)
- Department of Oncology, IRCCS San Raffaele Scientific Institute, 20132 Milan, Italy
| | - Junaid Mushtaq
- Department of Radiology, IRCCS San Raffaele Scientific Institute, 20132 Milan, Italy; (D.P.); (J.M.); (G.G.); (S.S.); (F.D.C.)
- School of Medicine, Vita-Salute San Raffaele University, 20132 Milan, Italy; (F.P.); (S.C.); (G.B.); (M.R.); (F.A.); (R.C.); (S.C.); (M.F.)
| | - Francesca Aleotti
- School of Medicine, Vita-Salute San Raffaele University, 20132 Milan, Italy; (F.P.); (S.C.); (G.B.); (M.R.); (F.A.); (R.C.); (S.C.); (M.F.)
- Pancreatic Surgery Unit, Pancreas Translational and Clinical Research Center, IRCCS San Raffaele Scientific Institute, 20132 Milan, Italy;
| | - Giorgia Guazzarotti
- Department of Radiology, IRCCS San Raffaele Scientific Institute, 20132 Milan, Italy; (D.P.); (J.M.); (G.G.); (S.S.); (F.D.C.)
| | - Roberta Cao
- School of Medicine, Vita-Salute San Raffaele University, 20132 Milan, Italy; (F.P.); (S.C.); (G.B.); (M.R.); (F.A.); (R.C.); (S.C.); (M.F.)
| | - Stephanie Steidler
- Department of Radiology, IRCCS San Raffaele Scientific Institute, 20132 Milan, Italy; (D.P.); (J.M.); (G.G.); (S.S.); (F.D.C.)
| | - Domenico Tamburrino
- Pancreatic Surgery Unit, Pancreas Translational and Clinical Research Center, IRCCS San Raffaele Scientific Institute, 20132 Milan, Italy;
| | - Emiliano Spezi
- School of Engineering, Cardiff University, Cardiff CF24 3AA, UK;
| | - Antonella Del Vecchio
- Department of Medical Physics, IRCCS San Raffaele Scientific Institute, 20132 Milan, Italy; (M.M.); (A.D.V.)
| | - Stefano Cascinu
- School of Medicine, Vita-Salute San Raffaele University, 20132 Milan, Italy; (F.P.); (S.C.); (G.B.); (M.R.); (F.A.); (R.C.); (S.C.); (M.F.)
- Department of Oncology, IRCCS San Raffaele Scientific Institute, 20132 Milan, Italy
| | - Massimo Falconi
- School of Medicine, Vita-Salute San Raffaele University, 20132 Milan, Italy; (F.P.); (S.C.); (G.B.); (M.R.); (F.A.); (R.C.); (S.C.); (M.F.)
- Pancreatic Surgery Unit, Pancreas Translational and Clinical Research Center, IRCCS San Raffaele Scientific Institute, 20132 Milan, Italy;
| | - Claudio Fiorino
- Department of Medical Physics, IRCCS San Raffaele Scientific Institute, 20132 Milan, Italy; (M.M.); (A.D.V.)
- Correspondence:
| | - Francesco De Cobelli
- Department of Radiology, IRCCS San Raffaele Scientific Institute, 20132 Milan, Italy; (D.P.); (J.M.); (G.G.); (S.S.); (F.D.C.)
- School of Medicine, Vita-Salute San Raffaele University, 20132 Milan, Italy; (F.P.); (S.C.); (G.B.); (M.R.); (F.A.); (R.C.); (S.C.); (M.F.)
| |
Collapse
|
18
|
Bezzi C, Mapelli P, Presotto L, Neri I, Scifo P, Savi A, Bettinardi V, Partelli S, Gianolli L, Falconi M, Picchio M. Radiomics in pancreatic neuroendocrine tumors: methodological issues and clinical significance. Eur J Nucl Med Mol Imaging 2021; 48:4002-4015. [PMID: 33835220 DOI: 10.1007/s00259-021-05338-8] [Citation(s) in RCA: 37] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2020] [Accepted: 03/24/2021] [Indexed: 12/19/2022]
Abstract
PURPOSE To present the state-of-art of radiomics in the context of pancreatic neuroendocrine tumors (PanNETs), with a focus on the methodological and technical approaches used, to support the search of guidelines for optimal applications. Furthermore, an up-to-date overview of the current clinical applications of radiomics in the field of PanNETs is provided. METHODS Original articles were searched on PubMed and Science Direct with specific keywords. Evaluations of the selected studies have been focused mainly on (i) the general radiomic workflow and the assessment of radiomic features robustness/reproducibility, as well as on the major clinical applications and investigations accomplished so far with radiomics in the field of PanNETs: (ii) grade prediction, (iii) differential diagnosis from other neoplasms, (iv) assessment of tumor behavior and aggressiveness, and (v) treatment response prediction. RESULTS Thirty-one articles involving PanNETs radiomic-related objectives were selected. In regard to the grade differentiation task, yielded AUCs are currently in the range of 0.7-0.9. For differential diagnosis, the majority of studies are still focused on the preliminary identification of discriminative radiomic features. Limited information is known on the prediction of tumors aggressiveness and of treatment response. CONCLUSIONS Radiomics is recently expanding in the setting of PanNETs. From the analysis of the published data, it is emerging how, prior to clinical application, further validations are necessary and methodological implementations require optimization. Nevertheless, this new discipline might have the potential in assisting the current urgent need of improving the management strategies in PanNETs patients.
Collapse
Affiliation(s)
- C Bezzi
- Vita-Salute San Raffaele University, Via Olgettina 58, Milan, 20132, Italy
| | - P Mapelli
- Vita-Salute San Raffaele University, Via Olgettina 58, Milan, 20132, Italy.,Nuclear Medicine Department, IRCCS San Raffaele Scientific Institute, Via Olgettina 60, 20132, Milan, Italy
| | - L Presotto
- Nuclear Medicine Department, IRCCS San Raffaele Scientific Institute, Via Olgettina 60, 20132, Milan, Italy
| | - I Neri
- Nuclear Medicine Department, IRCCS San Raffaele Scientific Institute, Via Olgettina 60, 20132, Milan, Italy
| | - P Scifo
- Nuclear Medicine Department, IRCCS San Raffaele Scientific Institute, Via Olgettina 60, 20132, Milan, Italy
| | - A Savi
- Nuclear Medicine Department, IRCCS San Raffaele Scientific Institute, Via Olgettina 60, 20132, Milan, Italy
| | - V Bettinardi
- Nuclear Medicine Department, IRCCS San Raffaele Scientific Institute, Via Olgettina 60, 20132, Milan, Italy
| | - S Partelli
- Vita-Salute San Raffaele University, Via Olgettina 58, Milan, 20132, Italy.,Pancreatic Surgery Unit, Pancreas Translational & Clinical Research Centre, IRCCS San Raffaele Scientific Institute, Via Olgettina 60, Milan, 20132, Italy
| | - L Gianolli
- Nuclear Medicine Department, IRCCS San Raffaele Scientific Institute, Via Olgettina 60, 20132, Milan, Italy
| | - M Falconi
- Vita-Salute San Raffaele University, Via Olgettina 58, Milan, 20132, Italy.,Pancreatic Surgery Unit, Pancreas Translational & Clinical Research Centre, IRCCS San Raffaele Scientific Institute, Via Olgettina 60, Milan, 20132, Italy
| | - M Picchio
- Vita-Salute San Raffaele University, Via Olgettina 58, Milan, 20132, Italy. .,Nuclear Medicine Department, IRCCS San Raffaele Scientific Institute, Via Olgettina 60, 20132, Milan, Italy.
| |
Collapse
|
19
|
Forde E, Leech M, Robert C, Herron E, Marignol L. Influence of inter-observer delineation variability on radiomic features of the parotid gland. Phys Med 2021; 82:240-248. [PMID: 33677385 DOI: 10.1016/j.ejmp.2021.01.084] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/05/2020] [Revised: 01/06/2021] [Accepted: 01/29/2021] [Indexed: 12/14/2022] Open
Abstract
PURPOSE This study aimed to quantify the variability in the values of radiomic features extracted from a right parotid gland (RPG) delineated by a series of independent observers. METHODS This was a secondary analysis of anonymous data from a delineation workshop. Inter-observer variability of the RPG from 40 participants was quantified using DICE similarity coefficient (DSC) and Hausdorff distance (HD). An additional contour was generated using Varian SmartSegmentation. Radiomic features extracted include four shape features, six histogram features, and 32 texture features. The absolute mean paired percentage difference (PPD) in feature values from the expert and participants were ranked . Feature robustness was classified using pre- determined thresholds. RESULTS 63% of participants achieved a DSC > 0.7, the auto- segmentation DSC was 0.76. The average HD for the participants was 16.16 mm ± 0.66 mm, and 15.16 mm for the auto-segmentation. 48% (n = 20) and 33% (n = 14) of features were deemed to be robust with a mean absolute PPD < 5%, for the auto-segmentation and manual delineations respectively; the majority of which were from the grey-run length matrix family. 7% (n = 3) of features from the auto- segmentation and 10% (n = 4) from the manual contours were deemed to be unstable with a mean absolute PPD > 50%. The value of the most robust feature was not related to DSC and HD. CONCLUSION Inter-observer delineation variability affects the value of the radiomic features extracted from the RPG. This study identifies the radiomic features least sensitive to these uncertainties. Further investigation of the clinical relevance of these features in prediction of xerostomia is warranted.
Collapse
Affiliation(s)
- E Forde
- Applied Radiation Therapy Trinity, Discipline of Radiation Therapy, Trinity St James' Cancer Institute, Trinity College Dublin, Dublin, Ireland.
| | - M Leech
- Applied Radiation Therapy Trinity, Discipline of Radiation Therapy, Trinity St James' Cancer Institute, Trinity College Dublin, Dublin, Ireland
| | - C Robert
- Molecular Radiotherapy and Innovative Therapeutics, INSERM UMR1030, Gustave Roussy Cancer Campus, Université Paris Salcay, Villejuif, France
| | - E Herron
- Department of Psychiatry School of Medicine, Trinity College Dublin, Dublin, Ireland
| | - L Marignol
- Applied Radiation Therapy Trinity, Discipline of Radiation Therapy, Trinity St James' Cancer Institute, Trinity College Dublin, Dublin, Ireland
| |
Collapse
|
20
|
CT-derived radiomic features to discriminate histologic characteristics of pancreatic neuroendocrine tumors. Radiol Med 2021; 126:745-760. [PMID: 33523367 DOI: 10.1007/s11547-021-01333-z] [Citation(s) in RCA: 76] [Impact Index Per Article: 19.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2020] [Accepted: 01/11/2021] [Indexed: 12/11/2022]
Abstract
PURPOSE To assess the ability of radiomic features (RF) extracted from contrast-enhanced CT images (ceCT) and non-contrast-enhanced (non-ceCT) in discriminating histopathologic characteristics of pancreatic neuroendocrine tumors (panNET). METHODS panNET contours were delineated on pre-surgical ceCT and non-ceCT. First- second- and higher-order RF (adjusted to eliminate redundancy) were extracted and correlated with histological panNET grade (G1 vs G2/G3), metastasis, lymph node invasion, microscopic vascular infiltration. Mann-Whitney with Bonferroni corrected p values assessed differences. Discriminative power of significant RF was calculated for each of the end-points. The performance of conventional-imaged-based-parameters was also compared to RF. RESULTS Thirty-nine patients were included (mean age 55-years-old; 24 male). Mean diameters of the lesions were 24 × 27 mm. Sixty-nine RF were considered. Sphericity could discriminate high grade tumors (AUC = 0.79, p = 0.002). Tumor volume (AUC = 0.79, p = 0.003) and several non-ceCT and ceCT RF were able to identify microscopic vascular infiltration: voxel-alignment, neighborhood intensity-difference and intensity-size-zone families (AUC ≥ 0.75, p < 0.001); voxel-alignment, intensity-size-zone and co-occurrence families (AUC ≥ 0.78, p ≤ 0.002), respectively). Non-ceCT neighborhood-intensity-difference (AUC = 0.75, p = 0.009) and ceCT intensity-size-zone (AUC = 0.73, p = 0.014) identified lymph nodal invasion; several non-ceCT and ceCT voxel-alignment family features were discriminative for metastasis (p < 0.01, AUC = 0.80-0.85). Conventional CT 'necrosis' could discriminate for microscopic vascular invasion (AUC = 0.76, p = 0.004) and 'arterial vascular invasion' for microscopic metastasis (AUC = 0.86, p = 0.001). No conventional-imaged-based-parameter was significantly associated with grade and lymph node invasion. CONCLUSIONS Radiomic features can discriminate histopathology of panNET, suggesting a role of radiomics as a non-invasive tool for tumor characterization. TRIAL REGISTRATION NUMBER NCT03967951, 30/05/2019.
Collapse
|
21
|
Bartoli M, Barat M, Dohan A, Gaujoux S, Coriat R, Hoeffel C, Cassinotto C, Chassagnon G, Soyer P. CT and MRI of pancreatic tumors: an update in the era of radiomics. Jpn J Radiol 2020; 38:1111-1124. [PMID: 33085029 DOI: 10.1007/s11604-020-01057-6] [Citation(s) in RCA: 44] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2020] [Accepted: 10/08/2020] [Indexed: 02/07/2023]
Abstract
Radiomics is a relatively new approach for image analysis. As a part of radiomics, texture analysis, which consists in extracting a great amount of quantitative data from original images, can be used to identify specific features that can help determining the actual nature of a pancreatic lesion and providing other information such as resectability, tumor grade, tumor response to neoadjuvant therapy or survival after surgery. In this review, the basic of radiomics, recent developments and the results of texture analysis using computed tomography and magnetic resonance imaging in the field of pancreatic tumors are presented. Future applications of radiomics, such as artificial intelligence, are discussed.
Collapse
Affiliation(s)
- Marion Bartoli
- Department of Radiology, Cochin Hospital, AP-HP, 27 Rue du Faubourg Saint-Jacques, 75014, Paris, France
| | - Maxime Barat
- Department of Radiology, Cochin Hospital, AP-HP, 27 Rue du Faubourg Saint-Jacques, 75014, Paris, France
- Université de Paris, Descartes-Paris 5, F-75006, Paris, France
| | - Anthony Dohan
- Department of Radiology, Cochin Hospital, AP-HP, 27 Rue du Faubourg Saint-Jacques, 75014, Paris, France
- Université de Paris, Descartes-Paris 5, F-75006, Paris, France
| | - Sébastien Gaujoux
- Université de Paris, Descartes-Paris 5, F-75006, Paris, France
- Department of Abdominal Surgery, Cochin Hospital, AP-HP, 75014, Paris, France
| | - Romain Coriat
- Université de Paris, Descartes-Paris 5, F-75006, Paris, France
- Department of Gastroenterology, Cochin Hospital, AP-HP, 75014, Paris, France
| | - Christine Hoeffel
- Department of Radiology, Robert Debré Hospital, 51092, Reims, France
| | - Christophe Cassinotto
- Department of Radiology, CHU Montpellier, University of Montpellier, Saint-Éloi Hospital, 34000, Montpellier, France
| | - Guillaume Chassagnon
- Department of Radiology, Cochin Hospital, AP-HP, 27 Rue du Faubourg Saint-Jacques, 75014, Paris, France
- Université de Paris, Descartes-Paris 5, F-75006, Paris, France
| | - Philippe Soyer
- Department of Radiology, Cochin Hospital, AP-HP, 27 Rue du Faubourg Saint-Jacques, 75014, Paris, France.
- Université de Paris, Descartes-Paris 5, F-75006, Paris, France.
| |
Collapse
|
22
|
Chu LC, Park S, Kawamoto S, Yuille AL, Hruban RH, Fishman EK. Pancreatic Cancer Imaging: A New Look at an Old Problem. Curr Probl Diagn Radiol 2020; 50:540-550. [PMID: 32988674 DOI: 10.1067/j.cpradiol.2020.08.002] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2020] [Accepted: 08/21/2020] [Indexed: 12/18/2022]
Abstract
Computed tomography is the most commonly used imaging modality to detect and stage pancreatic cancer. Previous advances in pancreatic cancer imaging have focused on optimizing image acquisition parameters and reporting standards. However, current state-of-the-art imaging approaches still misdiagnose some potentially curable pancreatic cancers and do not provide prognostic information or inform optimal management strategies beyond stage. Several recent developments in pancreatic cancer imaging, including artificial intelligence and advanced visualization techniques, are rapidly changing the field. The purpose of this article is to review how these recent advances have the potential to revolutionize pancreatic cancer imaging.
Collapse
Affiliation(s)
- Linda C Chu
- The Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD.
| | - Seyoun Park
- The Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD
| | - Satomi Kawamoto
- The Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD
| | - Alan L Yuille
- Department of Computer Science, Johns Hopkins University, Baltimore, MD
| | - Ralph H Hruban
- Sol Goldman Pancreatic Cancer Research Center, Department of Pathology, Johns Hopkins University School of Medicine, Baltimore, MD
| | - Elliot K Fishman
- The Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD
| |
Collapse
|
23
|
Loi S, Mori M, Benedetti G, Partelli S, Broggi S, Cattaneo GM, Palumbo D, Muffatti F, Falconi M, De Cobelli F, Fiorino C. Robustness of CT radiomic features against image discretization and interpolation in characterizing pancreatic neuroendocrine neoplasms. Phys Med 2020; 76:125-133. [PMID: 32673824 DOI: 10.1016/j.ejmp.2020.06.025] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/16/2019] [Revised: 05/20/2020] [Accepted: 06/28/2020] [Indexed: 01/06/2023] Open
Abstract
PURPOSE To explore the variation of the discriminative power of CT radiomic features (RF) against image discretization/interpolation in characterizing pancreatic neuro-endocrine (PanNEN) neoplasms. MATERIALS AND METHODS Thirty-nine PanNEN patients with pre-surgical high contrast CT available were considered. Image interpolation and discretization parameters were intentionally changed, including pixel size (0.73-2.19 mm2), slice thickness (2-5 mm) and binning (32-128 grey levels) and their combination generated 27 parameter's set. The ability of 69 RF in discriminating post-surgically assessed tumor grade (>G1), positive nodes, metastases and vascular invasion was tested: AUC changes when changing the parameters were quantified for selected RF, significantly associated to each end-point. The analysis was repeated for the corresponding images with contrast medium and in a sub-group of 29/39 patients scanned on a single scanner. RESULTS The median tumor volume was 1.57 cm3 (16%-84% percentiles: 0.62-34.58 cm3). RF variability against discretization/interpolation parameters was large: only 21/69 RF showed %COV < 20%. Despite this variability, AUC changes were limited for all end-points: with typical AUC values around 0.75-0.85, AUC ranges for the 27 parameter's set were on average 0.062 (1SD:0.037) for all end-points with maximum %COV equal to 5.5% (mean:2.3%). Performances significantly improved when excluding the 5 mm thickness case and fixing the binning to 64 (mean AUC range: 0.036, 1SD:0.019). Using contrast images or limiting the population to single-scanner patients had limited impact on AUC variability. CONCLUSIONS The discriminative power of CT RF for panNEN is relatively invariant against image interpolation/discretization within a large range of voxel sizes and binning.
Collapse
Affiliation(s)
- Sara Loi
- Medical Physics, San Raffaele Scientific Institute, Milano, Italy
| | - Martina Mori
- Medical Physics, San Raffaele Scientific Institute, Milano, Italy
| | | | - Stefano Partelli
- Pancreatic Surgery Unit, Pancreas Translational and Clinical Research Center, San Raffaele Scientific Institute, Milano, Italy; Università Vita-Salute, Milano, Italy
| | - Sara Broggi
- Medical Physics, San Raffaele Scientific Institute, Milano, Italy
| | | | - Diego Palumbo
- Radiology, San Raffaele Scientific Institute, Milano, Italy
| | - Francesca Muffatti
- Pancreatic Surgery Unit, Pancreas Translational and Clinical Research Center, San Raffaele Scientific Institute, Milano, Italy
| | - Massimo Falconi
- Pancreatic Surgery Unit, Pancreas Translational and Clinical Research Center, San Raffaele Scientific Institute, Milano, Italy; Università Vita-Salute, Milano, Italy
| | - Francesco De Cobelli
- Radiology, San Raffaele Scientific Institute, Milano, Italy; Università Vita-Salute, Milano, Italy
| | - Claudio Fiorino
- Medical Physics, San Raffaele Scientific Institute, Milano, Italy.
| |
Collapse
|
24
|
Simpson G, Spieler B, Dogan N, Portelance L, Mellon EA, Kwon D, Ford JC, Yang F. Predictive value of 0.35 T magnetic resonance imaging radiomic features in stereotactic ablative body radiotherapy of pancreatic cancer: A pilot study. Med Phys 2020; 47:3682-3690. [DOI: 10.1002/mp.14200] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2019] [Revised: 03/31/2020] [Accepted: 04/06/2020] [Indexed: 12/14/2022] Open
Affiliation(s)
- Garrett Simpson
- Department of Radiation Oncology University of Miami Miami FL 33136 USA
| | - Benjamin Spieler
- Department of Radiation Oncology University of Miami Miami FL 33136 USA
| | - Nesrin Dogan
- Department of Radiation Oncology University of Miami Miami FL 33136 USA
| | | | - Eric A. Mellon
- Department of Radiation Oncology University of Miami Miami FL 33136 USA
| | - Deukwoo Kwon
- Department of Radiation Oncology University of Miami Miami FL 33136 USA
| | - John C. Ford
- Department of Radiation Oncology University of Miami Miami FL 33136 USA
| | - Fei Yang
- Department of Radiation Oncology University of Miami Miami FL 33136 USA
| |
Collapse
|
25
|
Complementary role of computed tomography texture analysis for differentiation of pancreatic ductal adenocarcinoma from pancreatic neuroendocrine tumors in the portal-venous enhancement phase. Abdom Radiol (NY) 2020; 45:750-758. [PMID: 31953587 PMCID: PMC8081676 DOI: 10.1007/s00261-020-02406-9] [Citation(s) in RCA: 25] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
Purpose To assess the role of CT-texture analysis (CTTA) for differentiation of pancreatic ductal adenocarcinoma (PDAC) from pancreatic neuroendocrine neoplasm (PNEN) in the portal-venous phase as compared with visual assessment and tumor-to-pancreas attenuation ratios. Methods 53 patients (66.1 ± 8.6y) with PDAC and 42 patients (65.5 ± 12.2y) with PNEN who underwent contrast-enhanced CT for primary staging were evaluated. Volumes of interests (VOIs) were set in the tumor tissue at the portal-venous phase excluding adjacent structures. Based on pyradiomics library, 92 textural features were extracted including 1st, 2nd, and higher order features, and then compared between PNEN and PDAC. The visual assessment classified tumors into hypo-, iso-, or hyperdense to pancreas parenchyma or into homogeneous/heterogeneous. Additionally, attenuation ratios between the tumors and the non-involved pancreas were calculated. Results 8/92 (8.6%) highly significant (p < 0.005) discriminatory textural features between PDAC and PNEN were identified including the 1st order features “median,” “total energy,” “energy,” “10th percentile,” “90th percentile,” “minimum,” “maximum,” and the 2nd order feature “Gray-Level co-occurrence Matrix (GLCM) Informational Measure of Correlation (Imc2).” In PNEN, the higher order feature “GLSZM Small Area High Gray-Level Emphasis” proved significantly higher in G1 compared to G2/3 tumors (p < 0.05). The tumor/parenchyma ratios as well as the visual assessment into hypo-/iso-/hyperdense or homogeneous/heterogeneous did not significantly differ between PDAC and PNEN. Conclusions Our data indicate that CTTA is a feasible tool for differentiation of PNEN from PDAC and also of G1 from G2/3 PNEN in the portal-venous phase. Visual assessment and tumor-to-parenchyma ratios were not useful for discrimination. Electronic supplementary material The online version of this article (10.1007/s00261-020-02406-9) contains supplementary material, which is available to authorized users.
Collapse
|
26
|
Gatta R, Depeursinge A, Ratib O, Michielin O, Leimgruber A. Integrating radiomics into holomics for personalised oncology: from algorithms to bedside. Eur Radiol Exp 2020; 4:11. [PMID: 32034573 PMCID: PMC7007467 DOI: 10.1186/s41747-019-0143-0] [Citation(s) in RCA: 32] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2019] [Accepted: 12/06/2019] [Indexed: 12/18/2022] Open
Abstract
Radiomics, artificial intelligence, and deep learning figure amongst recent buzzwords in current medical imaging research and technological development. Analysis of medical big data in assessment and follow-up of personalised treatments has also become a major research topic in the area of precision medicine. In this review, current research trends in radiomics are analysed, from handcrafted radiomics feature extraction and statistical analysis to deep learning. Radiomics algorithms now include genomics and immunomics data to improve patient stratification and prediction of treatment response. Several applications have already shown conclusive results demonstrating the potential of including other “omics” data to existing imaging features. We also discuss further challenges of data harmonisation and management infrastructure to shed a light on the much-needed integration of radiomics and all other “omics” into clinical workflows. In particular, we point to the emerging paradigm shift in the implementation of big data infrastructures to facilitate databanks growth, data extraction and the development of expert software tools. Secured access, sharing, and integration of all health data, called “holomics”, will accelerate the revolution of personalised medicine and oncology as well as expand the role of imaging specialists.
Collapse
Affiliation(s)
- Roberto Gatta
- Personalised Analytic Oncology, Department of Oncology, Lausanne University Hospital, Lausanne, Switzerland
| | - Adrien Depeursinge
- Personalised Analytic Oncology, Department of Oncology, Lausanne University Hospital, Lausanne, Switzerland.,University of Applied Sciences and Arts Western Switzerland (HES-SO), Sierre, Switzerland
| | - Osman Ratib
- Service of Medical Imaging, Riviera-Chablais Hospital, Rennaz, Switzerland.,Department of Medical Imaging, Lausanne University Hospital, Lausanne, Switzerland
| | - Olivier Michielin
- Personalised Analytic Oncology, Department of Oncology, Lausanne University Hospital, Lausanne, Switzerland
| | - Antoine Leimgruber
- Personalised Analytic Oncology, Department of Oncology, Lausanne University Hospital, Lausanne, Switzerland. .,Service of Medical Imaging, Riviera-Chablais Hospital, Rennaz, Switzerland.
| |
Collapse
|
27
|
Chatterjee A, Vallières M, Seuntjens J. Overlooked pitfalls in multi-class machine learning classification in radiation oncology and how to avoid them. Phys Med 2020; 70:96-100. [PMID: 31991302 DOI: 10.1016/j.ejmp.2020.01.009] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/31/2019] [Revised: 01/02/2020] [Accepted: 01/09/2020] [Indexed: 12/14/2022] Open
Abstract
In radiation oncology, Machine Learning classification publications are typically related to two outcome classes, e.g. the presence or absence of distant metastasis. However, multi-class classification problems also have great clinical relevance, e.g., predicting the grade of a treatment complication following lung irradiation. This work comprised two studies aimed at making work in this domain less prone to statistical blindsides. In multi-class classification, AUC is not defined, whereas correlation coefficients are. It may seem like solely quoting the correlation coefficient value (in lieu of the AUC value) is a suitable choice. In the first study, we illustrated using Monte Carlo (MC) models why this choice is misleading. We also considered the special case where the multiple classes are not ordinal, but nominal, and explained why Pearson or Spearman correlation coefficients are not only providing incomplete information but are actually meaningless. The second study concerned surrogate biomarkers for a clinical endpoint, which have purported benefits including potential for early assessment, being inexpensive, and being non-invasive. Using a MC experiment, we showed how conclusions derived from surrogate markers can be misleading. The simulated endpoint was radiation toxicity (scale of 0-5). The surrogate marker was the true toxicity grade plus a noise term. Five patient cohorts were simulated, including one control. Two of the cohorts were designed to have a statistically significant difference in toxicity. Under 1000 repeated experiments using the biomarker, these two cohorts were often found to be statistically indistinguishable, with the fraction of such occurrences rising with the level of noise.
Collapse
Affiliation(s)
| | | | - Jan Seuntjens
- McGill University, Medical Physics Unit, Montreal, QC, Canada
| |
Collapse
|
28
|
Cattell R, Chen S, Huang C. Robustness of radiomic features in magnetic resonance imaging: review and a phantom study. Vis Comput Ind Biomed Art 2019; 2:19. [PMID: 32240418 PMCID: PMC7099536 DOI: 10.1186/s42492-019-0025-6] [Citation(s) in RCA: 62] [Impact Index Per Article: 10.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2019] [Accepted: 10/09/2019] [Indexed: 02/07/2023] Open
Abstract
Radiomic analysis has exponentially increased the amount of quantitative data that can be extracted from a single image. These imaging biomarkers can aid in the generation of prediction models aimed to further personalized medicine. However, the generalizability of the model is dependent on the robustness of these features. The purpose of this study is to review the current literature regarding robustness of radiomic features on magnetic resonance imaging. Additionally, a phantom study is performed to systematically evaluate the behavior of radiomic features under various conditions (signal to noise ratio, region of interest delineation, voxel size change and normalization methods) using intraclass correlation coefficients. The features extracted in this phantom study include first order, shape, gray level cooccurrence matrix and gray level run length matrix. Many features are found to be non-robust to changing parameters. Feature robustness assessment prior to feature selection, especially in the case of combining multi-institutional data, may be warranted. Further investigation is needed in this area of research.
Collapse
Affiliation(s)
- Renee Cattell
- Department of Biomedical Engineering, Stony Brook University, Stony Brook, NY, 11794, USA
| | - Shenglan Chen
- Department of Biomedical Engineering, Stony Brook University, Stony Brook, NY, 11794, USA
| | - Chuan Huang
- Department of Biomedical Engineering, Stony Brook University, Stony Brook, NY, 11794, USA. .,Department of Radiology, Stony Brook Medicine, Stony Brook, NY, 11794, USA. .,Department of Psychiatry, Stony Brook Medicine, Stony Brook, NY, 11794, USA.
| |
Collapse
|