151
|
Impact of Preprocessing and Harmonization Methods on the Removal of Scanner Effects in Brain MRI Radiomic Features. Cancers (Basel) 2021; 13:cancers13123000. [PMID: 34203896 PMCID: PMC8232807 DOI: 10.3390/cancers13123000] [Citation(s) in RCA: 30] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2021] [Revised: 05/06/2021] [Accepted: 06/07/2021] [Indexed: 12/22/2022] Open
Abstract
Simple Summary As a rapid-development research field, radiomics-based analysis has been applied to many clinical problems. However, the reproducibility of the radiomics studies remain challenging especially when data suffers from scanner effects, a kind of non-biological variations introduced by different image acquiring settings. This study aims to investigate how the image preprocessing methods (N4 bias field correction and image resampling) and the harmonization methods (intensity normalization methods working on images and ComBat method working on radiomic features) help to remove the scanner effects and improve the radiomics reproducibility in brain MRI radiomics. Abstract In brain MRI radiomics studies, the non-biological variations introduced by different image acquisition settings, namely scanner effects, affect the reliability and reproducibility of the radiomics results. This paper assesses how the preprocessing methods (including N4 bias field correction and image resampling) and the harmonization methods (either the six intensity normalization methods working on brain MRI images or the ComBat method working on radiomic features) help to remove the scanner effects and improve the radiomic feature reproducibility in brain MRI radiomics. The analyses were based on in vitro datasets (homogeneous and heterogeneous phantom data) and in vivo datasets (brain MRI images collected from healthy volunteers and clinical patients with brain tumors). The results show that the ComBat method is essential and vital to remove scanner effects in brain MRI radiomic studies. Moreover, the intensity normalization methods, while not able to remove scanner effects at the radiomic feature level, still yield more comparable MRI images and improve the robustness of the harmonized features to the choice among ComBat implementations.
Collapse
|
152
|
Arendt CT, Leithner D, Mayerhoefer ME, Gibbs P, Czerny C, Arnoldner C, Burck I, Leinung M, Tanyildizi Y, Lenga L, Martin SS, Vogl TJ, Schernthaner RE. Radiomics of high-resolution computed tomography for the differentiation between cholesteatoma and middle ear inflammation: effects of post-reconstruction methods in a dual-center study. Eur Radiol 2021; 31:4071-4078. [PMID: 33277670 PMCID: PMC8128805 DOI: 10.1007/s00330-020-07564-4] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2020] [Revised: 11/07/2020] [Accepted: 11/25/2020] [Indexed: 11/27/2022]
Abstract
OBJECTIVES To evaluate the performance of radiomic features extracted from high-resolution computed tomography (HRCT) for the differentiation between cholesteatoma and middle ear inflammation (MEI), and to investigate the impact of post-reconstruction harmonization and data resampling. METHODS One hundred patients were included in this retrospective dual-center study: 48 with histology-proven cholesteatoma (center A: 23; center B: 25) and 52 with MEI (A: 27; B: 25). Radiomic features (co-occurrence and run-length matrix, absolute gradient, autoregressive model, Haar wavelet transform) were extracted from manually defined 2D-ROIs. The ten best features for lesion differentiation were selected using probability of error and average correlation coefficients. A multi-layer perceptron feed-forward artificial neural network (MLP-ANN) was used for radiomics-based classification, with histopathology serving as the reference standard (70% of cases for training, 30% for validation). The analysis was performed five times each on (a) unmodified data and on data that were (b) resampled to the same matrix size, and (c) corrected for acquisition protocol differences using ComBat harmonization. RESULTS Using unmodified data, the MLP-ANN classification yielded an overall median area under the receiver operating characteristic curve (AUC) of 0.78 (0.72-0.84). Using original data from center A and resampled data from center B, an overall median AUC of 0.88 (0.82-0.99) was yielded, while using ComBat harmonized data, an overall median AUC of 0.89 (0.79-0.92) was revealed. CONCLUSION Radiomic features extracted from HRCT differentiate between cholesteatoma and MEI. When using multi-centric data obtained with differences in CT acquisition parameters, data resampling and ComBat post-reconstruction harmonization clearly improve radiomics-based lesion classification. KEY POINTS • Unenhanced high-resolution CT coupled with radiomics analysis may be useful for the differentiation between cholesteatoma and middle ear inflammation. • Pooling of data extracted from inhomogeneous CT datasets does not appear meaningful without further post-processing. • When using multi-centric CT data obtained with differences in acquisition parameters, post-reconstruction harmonization and data resampling clearly improve radiomics-based soft-tissue differentiation.
Collapse
Affiliation(s)
- Christophe T Arendt
- Department of Diagnostic and Interventional Radiology, University Hospital Frankfurt, Frankfurt am Main, Germany
| | - Doris Leithner
- Department of Diagnostic and Interventional Radiology, University Hospital Frankfurt, Frankfurt am Main, Germany
- Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Marius E Mayerhoefer
- Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY, USA.
- Department of Biomedical Imaging and Image-guided Therapy, Division of General and Pediatric Radiology, Medical University of Vienna, Waehringer Guertel 18-20, 1090, Vienna, Austria.
| | - Peter Gibbs
- Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Christian Czerny
- Department of Biomedical Imaging and Image-guided Therapy, Division of General and Pediatric Radiology, Medical University of Vienna, Waehringer Guertel 18-20, 1090, Vienna, Austria
| | - Christoph Arnoldner
- Department of Otorhinolaryngology, Head Neck Surgery, Medical University of Vienna, Vienna, Austria
| | - Iris Burck
- Department of Diagnostic and Interventional Radiology, University Hospital Frankfurt, Frankfurt am Main, Germany
| | - Martin Leinung
- Department of Otolaryngology, Head and Neck Surgery, University Hospital Frankfurt, Frankfurt am Main, Germany
| | - Yasemin Tanyildizi
- Department of Neuroradiology, University Medical Center of the Johannes Gutenberg-University, Mainz, Germany
| | - Lukas Lenga
- Department of Diagnostic and Interventional Radiology, University Hospital Frankfurt, Frankfurt am Main, Germany
| | - Simon S Martin
- Department of Diagnostic and Interventional Radiology, University Hospital Frankfurt, Frankfurt am Main, Germany
| | - Thomas J Vogl
- Department of Diagnostic and Interventional Radiology, University Hospital Frankfurt, Frankfurt am Main, Germany
| | - Ruediger E Schernthaner
- Department of Biomedical Imaging and Image-guided Therapy, Division of General and Pediatric Radiology, Medical University of Vienna, Waehringer Guertel 18-20, 1090, Vienna, Austria
| |
Collapse
|
153
|
Shayesteh S, Nazari M, Salahshour A, Sandoughdaran S, Hajianfar G, Khateri M, Yaghobi Joybari A, Jozian F, Fatehi Feyzabad SH, Arabi H, Shiri I, Zaidi H. Treatment response prediction using MRI-based pre-, post-, and delta-radiomic features and machine learning algorithms in colorectal cancer. Med Phys 2021; 48:3691-3701. [PMID: 33894058 DOI: 10.1002/mp.14896] [Citation(s) in RCA: 32] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2020] [Revised: 03/07/2021] [Accepted: 04/06/2021] [Indexed: 12/14/2022] Open
Abstract
OBJECTIVES We evaluate the feasibility of treatment response prediction using MRI-based pre-, post-, and delta-radiomic features for locally advanced rectal cancer (LARC) patients treated by neoadjuvant chemoradiation therapy (nCRT). MATERIALS AND METHODS This retrospective study included 53 LARC patients divided into a training set (Center#1, n = 36) and external validation set (Center#2, n = 17). T2-weighted (T2W) MRI was acquired for all patients, 2 weeks before and 4 weeks after nCRT. Ninety-six radiomic features, including intensity, morphological and second- and high-order texture features were extracted from segmented 3D volumes from T2W MRI. All features were harmonized using ComBat algorithm. Max-Relevance-Min-Redundancy (MRMR) algorithm was used as feature selector and k-nearest neighbors (KNN), Naïve Bayes (NB), Random forests (RF), and eXtreme Gradient Boosting (XGB) algorithms were used as classifiers. The evaluation was performed using the area under the receiver operator characteristic (ROC) curve (AUC), sensitivity, specificity and accuracy. RESULTS In univariate analysis, the highest AUC in pre-, post-, and delta-radiomic features were 0.78, 0.70, and 0.71, for GLCM_IMC1, shape (surface area and volume) and GLSZM_GLNU features, respectively. In multivariate analysis, RF and KNN achieved the highest AUC (0.85 ± 0.04 and 0.81 ± 0.14, respectively) among pre- and post-treatment features. The highest AUC was achieved for the delta-radiomic-based RF model (0.96 ± 0.01) followed by NB (0.96 ± 0.04). Overall. Delta-radiomics model, outperformed both pre- and post-treatment features (P-value <0.05). CONCLUSION Multivariate analysis of delta-radiomic T2W MRI features using machine learning algorithms could potentially be used for response prediction in LARC patients undergoing nCRT. We also observed that multivariate analysis of delta-radiomic features using RF classifiers can be used as powerful biomarkers for response prediction in LARC.
Collapse
Affiliation(s)
- Sajad Shayesteh
- Department of Physiology, Pharmacology and Medical Physics, Alborz University of Medical Sciences, Karaj, Iran
| | - Mostafa Nazari
- Department of Biomedical Engineering and Medical Physics, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Ali Salahshour
- Department of Radiology, Alborz University of Medical Sciences, Karaj, Iran
| | - Saleh Sandoughdaran
- Department of Radiation Oncology, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Ghasem Hajianfar
- Rajaie Cardiovascular, Medical & Research Centre, Iran University of Medical Science, Tehran, Iran
| | - Maziar Khateri
- Department of Medical Radiation Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran
| | - Ali Yaghobi Joybari
- Department of Radiation Oncology, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Fariba Jozian
- Department of Radiation Oncology, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | | | - Hossein Arabi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, Geneva, Switzerland
| | - Isaac Shiri
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, Geneva, Switzerland
| | - Habib Zaidi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, Geneva, Switzerland.,Geneva University Neurocenter, Geneva University, Geneva, Switzerland.,Department of Nuclear Medicine and Molecular Imaging, University of Groningen, University Medical Center Groningen, Groningen, Netherlands.,Department of Nuclear Medicine, University of Southern Denmark, Odense, Denmark
| |
Collapse
|
154
|
Ibrahim A, Refaee T, Leijenaar RTH, Primakov S, Hustinx R, Mottaghy FM, Woodruff HC, Maidment ADA, Lambin P. The application of a workflow integrating the variable reproducibility and harmonizability of radiomic features on a phantom dataset. PLoS One 2021; 16:e0251147. [PMID: 33961646 PMCID: PMC8104396 DOI: 10.1371/journal.pone.0251147] [Citation(s) in RCA: 26] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2020] [Accepted: 04/20/2021] [Indexed: 12/22/2022] Open
Abstract
Radiomics–the high throughput extraction of quantitative features from medical images and their correlation with clinical and biological endpoints- is the subject of active and extensive research. Although the field shows promise, the generalizability of radiomic signatures is affected significantly by differences in scan acquisition and reconstruction settings. Previous studies reported on the sensitivity of radiomic features (RFs) to test-retest variability, inter-observer segmentation variability, and intra-scanner variability. A framework involving robust radiomics analysis and the application of a post-reconstruction feature harmonization method using ComBat was recently proposed to address these challenges. In this study, we investigated the reproducibility of RFs across different scanners and scanning parameters using this framework. We analysed thirteen scans of a ten-layer phantom that were acquired differently. Each layer was subdivided into sixteen regions of interest (ROIs), and the scans were compared in a pairwise manner, resulting in seventy-eight different scenarios. Ninety-one RFs were extracted from each ROI. As hypothesized, we demonstrate that the reproducibility of a given RF is not a constant but is dependent on the heterogeneity found in the data under analysis. The number (%) of reproducible RFs varied across the pairwise scenarios investigated, having a wide range between 8 (8.8%) and 78 (85.7%) RFs. Furthermore, in contrast to what has been previously reported, and as hypothesized in the robust radiomics analysis framework, our results demonstrate that ComBat cannot be applied to all RFs but rather on a percentage of those–the “ComBatable” RFs–which differed depending on the data being harmonized. The number (%) of reproducible RFs following ComBat harmonization varied across the pairwise scenarios investigated, ranging from 14 (15.4%) to 80 (87.9%) RFs, and was found to depend on the heterogeneity in the data. We conclude that the standardization of image acquisition protocols remains the cornerstone for improving the reproducibility of RFs, and the generalizability of the signatures developed. Our proposed approach helps identify the reproducible RFs across different datasets.
Collapse
Affiliation(s)
- Abdalla Ibrahim
- The D-Lab, Department of Precision Medicine, GROW- School for Oncology, Maastricht University, Maastricht, The Netherlands
- Department of Radiology and Nuclear Medicine, Maastricht University Medical Centre+, Maastricht, The Netherlands
- Division of Nuclear Medicine and Oncological Imaging, Department of Medical Physics, University Hospital of Liège and GIGA CRC-in vivo imaging, University of Liège, Liege, Belgium
- Department of Nuclear Medicine and Comprehensive Diagnostic Centre Aachen (CDCA), University Hospital RWTH Aachen University, Aachen, Germany
- * E-mail:
| | - Turkey Refaee
- The D-Lab, Department of Precision Medicine, GROW- School for Oncology, Maastricht University, Maastricht, The Netherlands
- Faculty of Applied Medical Sciences, Department of Diagnostic Radiology, Jazan University, Jazan, Saudi Arabia
| | | | - Sergey Primakov
- The D-Lab, Department of Precision Medicine, GROW- School for Oncology, Maastricht University, Maastricht, The Netherlands
- Department of Nuclear Medicine and Comprehensive Diagnostic Centre Aachen (CDCA), University Hospital RWTH Aachen University, Aachen, Germany
| | - Roland Hustinx
- Division of Nuclear Medicine and Oncological Imaging, Department of Medical Physics, University Hospital of Liège and GIGA CRC-in vivo imaging, University of Liège, Liege, Belgium
| | - Felix M. Mottaghy
- Department of Radiology and Nuclear Medicine, Maastricht University Medical Centre+, Maastricht, The Netherlands
- Department of Nuclear Medicine and Comprehensive Diagnostic Centre Aachen (CDCA), University Hospital RWTH Aachen University, Aachen, Germany
| | - Henry C. Woodruff
- The D-Lab, Department of Precision Medicine, GROW- School for Oncology, Maastricht University, Maastricht, The Netherlands
- Department of Radiology and Nuclear Medicine, Maastricht University Medical Centre+, Maastricht, The Netherlands
| | - Andrew D. A. Maidment
- Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States of America
| | - Philippe Lambin
- The D-Lab, Department of Precision Medicine, GROW- School for Oncology, Maastricht University, Maastricht, The Netherlands
- Department of Radiology and Nuclear Medicine, Maastricht University Medical Centre+, Maastricht, The Netherlands
| |
Collapse
|
155
|
El Ayachy R, Giraud N, Giraud P, Durdux C, Giraud P, Burgun A, Bibault JE. The Role of Radiomics in Lung Cancer: From Screening to Treatment and Follow-Up. Front Oncol 2021; 11:603595. [PMID: 34026602 PMCID: PMC8131863 DOI: 10.3389/fonc.2021.603595] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2020] [Accepted: 04/06/2021] [Indexed: 12/12/2022] Open
Abstract
PURPOSE Lung cancer represents the first cause of cancer-related death in the world. Radiomics studies arise rapidly in this late decade. The aim of this review is to identify important recent publications to be synthesized into a comprehensive review of the current status of radiomics in lung cancer at each step of the patients' care. METHODS A literature review was conducted using PubMed/Medline for search of relevant peer-reviewed publications from January 2012 to June 2020. RESULTS We identified several studies at each point of patient's care: detection and classification of lung nodules (n=16), determination of histology and genomic (n=10) and finally treatment outcomes predictions (=23). We reported the methodology of those studies and their results and discuss the limitations and the progress to be made for clinical routine applications. CONCLUSION Promising perspectives arise from machine learning applications and radiomics based models in lung cancers, yet further data are necessary for their implementation in daily care. Multicentric collaboration and attention to quality and reproductivity of radiomics studies should be further consider.
Collapse
Affiliation(s)
- Radouane El Ayachy
- Radiation Oncology Department, Georges Pompidou European Hospital, Assistance Publique-Hôpitaux de Paris, Université de Paris, Paris, France
- Cancer Research and Personalized Medicine-Integrated Cancer Research Center (SIRIC), Georges Pompidou European Hospital, Assistance Publique-Hôpitaux de Paris, Université de Paris, Paris, France
- INSERM UMR 1138 Team 22: Information Sciences to support Personalized Medicine, Cordeliers Research Centre, Paris Descartes University, Paris, France
| | - Nicolas Giraud
- INSERM UMR 1138 Team 22: Information Sciences to support Personalized Medicine, Cordeliers Research Centre, Paris Descartes University, Paris, France
- Radiation Oncology Department, Haut-Lévêque Hospital, CHU de Bordeaux, Pessac, France
| | - Paul Giraud
- Radiation Oncology Department, Georges Pompidou European Hospital, Assistance Publique-Hôpitaux de Paris, Université de Paris, Paris, France
- Cancer Research and Personalized Medicine-Integrated Cancer Research Center (SIRIC), Georges Pompidou European Hospital, Assistance Publique-Hôpitaux de Paris, Université de Paris, Paris, France
- INSERM UMR 1138 Team 22: Information Sciences to support Personalized Medicine, Cordeliers Research Centre, Paris Descartes University, Paris, France
| | - Catherine Durdux
- Radiation Oncology Department, Georges Pompidou European Hospital, Assistance Publique-Hôpitaux de Paris, Université de Paris, Paris, France
- Cancer Research and Personalized Medicine-Integrated Cancer Research Center (SIRIC), Georges Pompidou European Hospital, Assistance Publique-Hôpitaux de Paris, Université de Paris, Paris, France
| | - Philippe Giraud
- Radiation Oncology Department, Georges Pompidou European Hospital, Assistance Publique-Hôpitaux de Paris, Université de Paris, Paris, France
- Cancer Research and Personalized Medicine-Integrated Cancer Research Center (SIRIC), Georges Pompidou European Hospital, Assistance Publique-Hôpitaux de Paris, Université de Paris, Paris, France
| | - Anita Burgun
- Cancer Research and Personalized Medicine-Integrated Cancer Research Center (SIRIC), Georges Pompidou European Hospital, Assistance Publique-Hôpitaux de Paris, Université de Paris, Paris, France
- INSERM UMR 1138 Team 22: Information Sciences to support Personalized Medicine, Cordeliers Research Centre, Paris Descartes University, Paris, France
| | - Jean Emmanuel Bibault
- Radiation Oncology Department, Georges Pompidou European Hospital, Assistance Publique-Hôpitaux de Paris, Université de Paris, Paris, France
- Cancer Research and Personalized Medicine-Integrated Cancer Research Center (SIRIC), Georges Pompidou European Hospital, Assistance Publique-Hôpitaux de Paris, Université de Paris, Paris, France
- INSERM UMR 1138 Team 22: Information Sciences to support Personalized Medicine, Cordeliers Research Centre, Paris Descartes University, Paris, France
| |
Collapse
|
156
|
Duclos V, Iep A, Gomez L, Goldfarb L, Besson FL. PET Molecular Imaging: A Holistic Review of Current Practice and Emerging Perspectives for Diagnosis, Therapeutic Evaluation and Prognosis in Clinical Oncology. Int J Mol Sci 2021; 22:4159. [PMID: 33923839 PMCID: PMC8073681 DOI: 10.3390/ijms22084159] [Citation(s) in RCA: 45] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2021] [Revised: 04/14/2021] [Accepted: 04/15/2021] [Indexed: 02/06/2023] Open
Abstract
PET/CT molecular imaging has been imposed in clinical oncological practice over the past 20 years, driven by its two well-grounded foundations: quantification and radiolabeled molecular probe vectorization. From basic visual interpretation to more sophisticated full kinetic modeling, PET technology provides a unique opportunity to characterize various biological processes with different levels of analysis. In clinical practice, many efforts have been made during the last two decades to standardize image analyses at the international level, but advanced metrics are still under use in practice. In parallel, the integration of PET imaging with radionuclide therapy, also known as radiolabeled theranostics, has paved the way towards highly sensitive radionuclide-based precision medicine, with major breakthroughs emerging in neuroendocrine tumors and prostate cancer. PET imaging of tumor immunity and beyond is also emerging, emphasizing the unique capabilities of PET molecular imaging to constantly adapt to emerging oncological challenges. However, these new horizons face the growing complexity of multidimensional data. In the era of precision medicine, statistical and computer sciences are currently revolutionizing image-based decision making, paving the way for more holistic cancer molecular imaging analyses at the whole-body level.
Collapse
Affiliation(s)
- Valentin Duclos
- Department of Biophysics and Nuclear Medicine-Molecular Imaging, Hôpitaux Universitaires Paris Saclay, Assistance Publique-Hôpitaux de Paris, CHU Bicêtre, 94270 Le Kremlin-Bicêtre, France; (V.D.); (A.I.); (L.G.)
| | - Alex Iep
- Department of Biophysics and Nuclear Medicine-Molecular Imaging, Hôpitaux Universitaires Paris Saclay, Assistance Publique-Hôpitaux de Paris, CHU Bicêtre, 94270 Le Kremlin-Bicêtre, France; (V.D.); (A.I.); (L.G.)
| | - Léa Gomez
- Department of Biophysics and Nuclear Medicine-Molecular Imaging, Hôpitaux Universitaires Paris Saclay, Assistance Publique-Hôpitaux de Paris, CHU Bicêtre, 94270 Le Kremlin-Bicêtre, France; (V.D.); (A.I.); (L.G.)
| | - Lucas Goldfarb
- Service Hospitalier Frédéric Joliot-CEA, 91401 Orsay, France;
| | - Florent L. Besson
- Department of Biophysics and Nuclear Medicine-Molecular Imaging, Hôpitaux Universitaires Paris Saclay, Assistance Publique-Hôpitaux de Paris, CHU Bicêtre, 94270 Le Kremlin-Bicêtre, France; (V.D.); (A.I.); (L.G.)
- Université Paris Saclay, CEA, CNRS, Inserm, BioMaps, 91401 Orsay, France
- School of Medicine, Université Paris Saclay, 94720 Le Kremlin-Bicêtre, France
| |
Collapse
|
157
|
Tu SJ, Chen WY, Wu CT. Uncertainty measurement of radiomics features against inherent quantum noise in computed tomography imaging. Eur Radiol 2021; 31:7865-7875. [PMID: 33852047 DOI: 10.1007/s00330-021-07943-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2020] [Revised: 03/18/2021] [Accepted: 03/25/2021] [Indexed: 12/24/2022]
Abstract
OBJECTIVES Quantum noise is a random process in X-ray-based imaging systems. We addressed and measured the uncertainty of radiomics features against this quantum noise in computed tomography (CT) images. METHODS A clinical multi-detector CT scanner, two homogeneous phantom sets, and four heterogeneous samples were used. A solid tumor tissue removed from a male BALB/c mouse was included. We the placed phantom sets on the CT scanning table and repeated 20 acquisitions with identical imaging settings. Regions of interest were delineated for feature extraction. Statistical quantities-average, standard deviation, and percentage uncertainty-were calculated from these 20 repeated scans. Percentage uncertainty was used to measure and quantify feature stability against quantum noise. Twelve radiomics features were measured. Random noise was added to study the robustness of machine learning classifiers against feature uncertainty. RESULTS We found the ranges of percentage uncertainties from homogeneous soft tissue phantoms, homogeneous bone phantoms, and solid tumor tissue to be 0.01-2138%, 0.02-15%, and 0.18-16%, respectively. Overall, it was found that the CT features ShortRunHighGrayLevelEmpha (SRHGE) (0.01-0.18%), ShortRunLowGrayLevelEmpha (SRLGE) (0.01-0.41%), LowGrayLevelRunEmpha (LGRE) (0.01-0.39%), and LongRunLowGrayLevelEmpha (LRLGE) (0.02-0.66%) were the most stable features against the inherent quantum noise. The most unstable features were cluster shade (1-2138%) and max probability (1-16%). The impact of random noise to the prediction accuracy by different machine learning classifiers was found to be between 0 and 12%. CONCLUSIONS Twelve features were used for uncertainty measurements. The upper and lower bounds of percentage uncertainties were determined. The quantum noise effect on machine learning classifiers is model dependent. KEY POINTS • Quantum noise is a random process and is intrinsic to X-ray-based imaging systems. This inherent quantum noise creates unpredictable fluctuations in the gray-level intensities of image pixels. Extra cautions and further validations are strongly recommended when unstable radiomics features are selected by a predictive model for disease classification or treatment outcome prognosis. • We addressed and used the statistical quantity of percentage uncertainty to measure the uncertainty of radiomics features against the inherent quantum noise in computed tomography (CT) images. • A clinical multi-detector CT scanner, two homogeneous phantom sets, and four heterogeneous samples were used in the stability measurement. A solid tumor tissue removed from a male BALB/c mouse was included in the heterogeneous sample.
Collapse
Affiliation(s)
- Shu-Ju Tu
- Department of Medical Imaging and Radiological Sciences, College of Medicine, Chang Gung University, 259 Wen-Hua First Road, Kwei-Shan, Tao-Yuan, 333, Taiwan. .,Department of Medical Imaging and Intervention, Linkou Chang Gung Memorial Hospital, Tao-Yuan, Taiwan.
| | - Wei-Yuan Chen
- Department of Medical Imaging and Radiological Sciences, College of Medicine, Chang Gung University, 259 Wen-Hua First Road, Kwei-Shan, Tao-Yuan, 333, Taiwan.,Department of Medical Imaging and Intervention, Linkou Chang Gung Memorial Hospital, Tao-Yuan, Taiwan
| | - Chen-Te Wu
- Department of Medical Imaging and Radiological Sciences, College of Medicine, Chang Gung University, 259 Wen-Hua First Road, Kwei-Shan, Tao-Yuan, 333, Taiwan.,Department of Medical Imaging and Intervention, Linkou Chang Gung Memorial Hospital, Tao-Yuan, Taiwan
| |
Collapse
|
158
|
Ibrahim A, Refaee T, Primakov S, Barufaldi B, Acciavatti RJ, Granzier RWY, Hustinx R, Mottaghy FM, Woodruff HC, Wildberger JE, Lambin P, Maidment ADA. The Effects of In-Plane Spatial Resolution on CT-Based Radiomic Features' Stability with and without ComBat Harmonization. Cancers (Basel) 2021; 13:cancers13081848. [PMID: 33924382 PMCID: PMC8103509 DOI: 10.3390/cancers13081848] [Citation(s) in RCA: 33] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2021] [Revised: 04/07/2021] [Accepted: 04/08/2021] [Indexed: 02/06/2023] Open
Abstract
Simple Summary Handcrafted radiomic features (HRFs) are quantitative features extracted from medical images, and they are mined for associations with different clinical endpoints. While many studies reported on the potential of HRFs to unravel clinical endpoints, the sensitivity of HRFs to variations in scanning parameters is affecting the inclusion of radiomic signatures in clinical decision-making. In this study, we investigated the effects of variations in the in-plane resolution of scans, while all other scanning parameters were fixed. Moreover, we investigated the effects of ten different image resampling methods and ComBat harmonization on the reproducibility of HRFs. Our results show that the majority of HRFs are significantly and variably affected by the differences in in-plane resolution. The majority of image resampling methods resulted in a higher number of reproducible HRFs compared to ComBat harmonization. Our developed framework guides identifying the reproducible and harmonizable HRFs in different scenarios. Abstract While handcrafted radiomic features (HRFs) have shown promise in the field of personalized medicine, many hurdles hinder its incorporation into clinical practice, including but not limited to their sensitivity to differences in acquisition and reconstruction parameters. In this study, we evaluated the effects of differences in in-plane spatial resolution (IPR) on HRFs, using a phantom dataset (n = 14) acquired on two scanner models. Furthermore, we assessed the effects of interpolation methods (IMs), the choice of a new unified in-plane resolution (NUIR), and ComBat harmonization on the reproducibility of HRFs. The reproducibility of HRFs was significantly affected by variations in IPR, with pairwise concordant HRFs, as measured by the concordance correlation coefficient (CCC), ranging from 42% to 95%. The number of concordant HRFs (CCC > 0.9) after resampling varied depending on (i) the scanner model, (ii) the IM, and (iii) the NUIR. The number of concordant HRFs after ComBat harmonization depended on the variations between the batches harmonized. The majority of IMs resulted in a higher number of concordant HRFs compared to ComBat harmonization, and the combination of IMs and ComBat harmonization did not yield a significant benefit. Our developed framework can be used to assess the reproducibility and harmonizability of RFs.
Collapse
Affiliation(s)
- Abdalla Ibrahim
- The D-Lab, Department of Precision Medicine, GROW—School for Oncology, Maastricht University, 6200 Maastricht, The Netherlands; (T.R.); (S.P.); (H.C.W.); (P.L.)
- Department of Radiology and Nuclear Medicine, Maastricht University Medical Centre+, 6200 Maastricht, The Netherlands; (F.M.M.); (J.E.W.)
- Division of Nuclear Medicine and Oncological Imaging, Department of Medical Physics, University Hospital of Liège and GIGA CRC-In Vivo Imaging, University of Liège, 4000 Liege, Belgium;
- Department of Nuclear Medicine and Comprehensive Diagnostic Center Aachen (CDCA), University Hospital RWTH Aachen University, 52074 Aachen, Germany
- Correspondence:
| | - Turkey Refaee
- The D-Lab, Department of Precision Medicine, GROW—School for Oncology, Maastricht University, 6200 Maastricht, The Netherlands; (T.R.); (S.P.); (H.C.W.); (P.L.)
- Department of Diagnostic Radiology, Faculty of Applied Medical Sciences, Jazan University, Jazan 45142, Saudi Arabia
| | - Sergey Primakov
- The D-Lab, Department of Precision Medicine, GROW—School for Oncology, Maastricht University, 6200 Maastricht, The Netherlands; (T.R.); (S.P.); (H.C.W.); (P.L.)
- Department of Nuclear Medicine and Comprehensive Diagnostic Center Aachen (CDCA), University Hospital RWTH Aachen University, 52074 Aachen, Germany
| | - Bruno Barufaldi
- Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104, USA; (B.B.); (R.J.A.); (A.D.A.M.)
| | - Raymond J. Acciavatti
- Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104, USA; (B.B.); (R.J.A.); (A.D.A.M.)
| | - Renée W. Y. Granzier
- Department of Surgery, GROW—School for Oncology, Maastricht University Medical Centre+, 6200 Maastricht, The Netherlands;
| | - Roland Hustinx
- Division of Nuclear Medicine and Oncological Imaging, Department of Medical Physics, University Hospital of Liège and GIGA CRC-In Vivo Imaging, University of Liège, 4000 Liege, Belgium;
| | - Felix M. Mottaghy
- Department of Radiology and Nuclear Medicine, Maastricht University Medical Centre+, 6200 Maastricht, The Netherlands; (F.M.M.); (J.E.W.)
- Department of Nuclear Medicine and Comprehensive Diagnostic Center Aachen (CDCA), University Hospital RWTH Aachen University, 52074 Aachen, Germany
| | - Henry C. Woodruff
- The D-Lab, Department of Precision Medicine, GROW—School for Oncology, Maastricht University, 6200 Maastricht, The Netherlands; (T.R.); (S.P.); (H.C.W.); (P.L.)
- Department of Radiology and Nuclear Medicine, Maastricht University Medical Centre+, 6200 Maastricht, The Netherlands; (F.M.M.); (J.E.W.)
| | - Joachim E. Wildberger
- Department of Radiology and Nuclear Medicine, Maastricht University Medical Centre+, 6200 Maastricht, The Netherlands; (F.M.M.); (J.E.W.)
| | - Philippe Lambin
- The D-Lab, Department of Precision Medicine, GROW—School for Oncology, Maastricht University, 6200 Maastricht, The Netherlands; (T.R.); (S.P.); (H.C.W.); (P.L.)
- Department of Radiology and Nuclear Medicine, Maastricht University Medical Centre+, 6200 Maastricht, The Netherlands; (F.M.M.); (J.E.W.)
| | - Andrew D. A. Maidment
- Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104, USA; (B.B.); (R.J.A.); (A.D.A.M.)
| |
Collapse
|
159
|
Wu S, Li H, Dong A, Tian L, Ruan G, Liu L, Shao Y. Differences in Radiomics Signatures Between Patients with Early and Advanced T-Stage Nasopharyngeal Carcinoma Facilitate Prognostication. J Magn Reson Imaging 2021; 54:854-865. [PMID: 33830573 DOI: 10.1002/jmri.27633] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2020] [Revised: 03/23/2021] [Accepted: 03/23/2021] [Indexed: 12/24/2022] Open
Abstract
BACKGROUND Accurately predicting the risk of death, recurrence, and metastasis of patients with nasopharyngeal carcinoma (NPC) is potentially important for personalized diagnosis and treatment. Survival outcomes of patients vary greatly in distinct stages of NPC. Prognostic models of stratified patients may aid in prognostication. PURPOSE To explore the prognostic performance of MRI-based radiomics signatures in stratified patients with NPC. STUDY TYPE Retrospective. POPULATION Seven hundred and seventy-eight patients with NPC (T1-2 stage: 298, T3-4 stage: 480; training cohort: 525, validation cohort: 253). FIELD STRENGTH/SEQUENCE Fast-spin echo (FSE) axial T1-weighted images, FSE axial T2-weighted images, contrast-enhanced FSE axial T1-weighted images at 1.5 T or 3.0 T. ASSESSMENT Radiomics signatures, clinical nomograms, and radiomics nomograms combining the radiomic score (Radscore) and clinical factors for predicting progression-free survival (PFS) were constructed on T1-2 stage patient cohort (A), T3-4 stage patient cohort (B), and the entire dataset (C). STATISTICAL TESTS Least absolute shrinkage and selection operator (LASSO) method was applied for radiomics modeling. Harrell's concordance indices (C-index) were employed to evaluate the predictive power of each model. RESULTS Among 4,410 MRI-extracted features, we selected 16, 16, and 14 radiomics features most relevant to PFS for Models A, B, and C, respectively. Only 0, 1, and 4 features were found overlapped between models A/B, A/C, and B/C, respectively. Radiomics signatures constructed on T1-2 stage and T3-4 stage patients yielded C-indices of 0.820 (95% confidence interval [CI]: 0.763-0.877) and 0.726 (0.687-0.765), respectively, which were larger than those on the entire validation cohort (0.675 [0.637-0.713]). Radiomics nomograms combining Radscore and clinical factors achieved significantly better performance than clinical nomograms (P < 0.05 for all). DATA CONCLUSION The selected radiomics features and prognostic performance of radiomics signatures differed per the type of NPC patients incorporated into the models. Radiomics models based on pre-stratified tumor stages had better prognostic performance than those on unstratified dataset. LEVEL OF EVIDENCE 4 Technical Efficacy Stage: 5.
Collapse
Affiliation(s)
- Shuangshuang Wu
- School of Physics, State Key Laboratory of Optoelectronic Materials and Technologies, Sun Yat-sen University, Guangzhou, PR China
| | - Haojiang Li
- Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangdong Key Laboratory of Nasopharyngeal Carcinoma Diagnosis and Therapy, Guangzhou, PR China
| | - Annan Dong
- Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangdong Key Laboratory of Nasopharyngeal Carcinoma Diagnosis and Therapy, Guangzhou, PR China
| | - Li Tian
- Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangdong Key Laboratory of Nasopharyngeal Carcinoma Diagnosis and Therapy, Guangzhou, PR China
| | - Guangying Ruan
- Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangdong Key Laboratory of Nasopharyngeal Carcinoma Diagnosis and Therapy, Guangzhou, PR China
| | - Lizhi Liu
- Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangdong Key Laboratory of Nasopharyngeal Carcinoma Diagnosis and Therapy, Guangzhou, PR China
| | - Yuanzhi Shao
- School of Physics, State Key Laboratory of Optoelectronic Materials and Technologies, Sun Yat-sen University, Guangzhou, PR China
| |
Collapse
|
160
|
Zhao B. Understanding Sources of Variation to Improve the Reproducibility of Radiomics. Front Oncol 2021; 11:633176. [PMID: 33854969 PMCID: PMC8039446 DOI: 10.3389/fonc.2021.633176] [Citation(s) in RCA: 74] [Impact Index Per Article: 18.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2020] [Accepted: 03/01/2021] [Indexed: 12/12/2022] Open
Abstract
Radiomics is the method of choice for investigating the association between cancer imaging phenotype, cancer genotype and clinical outcome prediction in the era of precision medicine. The fast dispersal of this new methodology has benefited from the existing advances of the core technologies involved in radiomics workflow: image acquisition, tumor segmentation, feature extraction and machine learning. However, despite the rapidly increasing body of publications, there is no real clinical use of a developed radiomics signature so far. Reasons are multifaceted. One of the major challenges is the lack of reproducibility and generalizability of the reported radiomics signatures (features and models). Sources of variation exist in each step of the workflow; some are controllable or can be controlled to certain degrees, while others are uncontrollable or even unknown. Insufficient transparency in reporting radiomics studies further prevents translation of the developed radiomics signatures from the bench to the bedside. This review article first addresses sources of variation, which is illustrated using demonstrative examples. Then, it reviews a number of published studies and progresses made to date in the investigation and improvement of feature reproducibility and model performance. Lastly, it discusses potential strategies and practical considerations to reduce feature variability and improve the quality of radiomics study. This review focuses on CT image acquisition, tumor segmentation, quantitative feature extraction, and the disease of lung cancer.
Collapse
Affiliation(s)
- Binsheng Zhao
- Department of Radiology, Columbia University Irving Medical Center, New York, NY, United States
| |
Collapse
|
161
|
Nakajo M, Jinguji M, Tani A, Kikuno H, Hirahara D, Togami S, Kobayashi H, Yoshiura T. Application of a Machine Learning Approach for the Analysis of Clinical and Radiomic Features of Pretreatment [ 18F]-FDG PET/CT to Predict Prognosis of Patients with Endometrial Cancer. Mol Imaging Biol 2021; 23:756-765. [PMID: 33763816 DOI: 10.1007/s11307-021-01599-9] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2020] [Revised: 03/05/2021] [Accepted: 03/10/2021] [Indexed: 12/22/2022]
Abstract
PURPOSE To examine the prognostic significance of pretreatment 2-deoxy-2-[18F]fluoro-D-glucose ([18F]-FDG) positron emission tomography (PET)-based radiomic features using a machine learning approach in patients with endometrial cancers. PROCEDURES Included in this retrospective study were 53 patients with endometrial cancers who underwent [18F]-FDG PET/X-ray computed tomography (CT) before treatment. Since two different PET scanners were used, post-reconstruction harmonization was performed for all PET parameters using the ComBat harmonization method. Four clinical (age, histological type, stage, and treatment method) and 40 [18F]-FDG PET-based radiomic features were ranked, and a subset of useful features was selected based on the decrease in the Gini impurity in terms of associations with disease progression. The machine learning algorithms (random forest, neural network, k-nearest neighbors (kNN), naive Bayes, logistic regression, and support vector machine) were compared using the areas under the receiver operating characteristic curve (AUC) and validated by the random sampling method. Progression-free survival (PFS) and overall survival (OS) were assessed by the Cox regression analysis. RESULTS The five best predictors of disease progression were coarseness, gray-level run length nonuniformity, stage, treatment method, and gray-level zone length nonuniformity. The kNN model obtained the best performance classifier for predicting the disease progression (AUC =0.890, accuracy =0.849, F1 score =0.848, precision =0.857, and recall =0.849). Coarseness which was the first ranked radiomic feature was selected for survival analyses, and only coarseness remained as a significant and independent factor for both PFS (hazard ratios (HR), 0.65; 95 % confidence interval [CI], 0.49-0.86; p=0.003) and OS (HR, 0.52; 95 % CI, 0.36-0.76; p<0.001) at multivariate Cox regression analysis. CONCLUSIONS [18F]-FDG PET-based radiomic analysis using a machine learning approach may be useful for predicting tumor progression and prognosis in patients with endometrial cancers.
Collapse
Affiliation(s)
- Masatoyo Nakajo
- Department of Radiology, Kagoshima University, Graduate School of Medical and Dental Sciences, 8-35-1 Sakuragaoka, Kagoshima, 890-8544, Japan.
| | - Megumi Jinguji
- Department of Radiology, Kagoshima University, Graduate School of Medical and Dental Sciences, 8-35-1 Sakuragaoka, Kagoshima, 890-8544, Japan
| | - Atsushi Tani
- Department of Radiology, Kagoshima University, Graduate School of Medical and Dental Sciences, 8-35-1 Sakuragaoka, Kagoshima, 890-8544, Japan
| | - Hidehiko Kikuno
- Department of Radiology, Kagoshima University, Graduate School of Medical and Dental Sciences, 8-35-1 Sakuragaoka, Kagoshima, 890-8544, Japan
| | - Daisuke Hirahara
- Department of Management Planning Division, Harada Academy, 2-54-4 Higashitaniyama, Kagoshima, 890-0113, Japan
| | - Shinichi Togami
- Department of Obstetrics and Gynecology, Kagoshima University, Graduate School of Medical and Dental Sciences, 8-35-1 Sakuragaoka, Kagoshima, 890-8544, Japan
| | - Hiroaki Kobayashi
- Department of Obstetrics and Gynecology, Kagoshima University, Graduate School of Medical and Dental Sciences, 8-35-1 Sakuragaoka, Kagoshima, 890-8544, Japan
| | - Takashi Yoshiura
- Department of Radiology, Kagoshima University, Graduate School of Medical and Dental Sciences, 8-35-1 Sakuragaoka, Kagoshima, 890-8544, Japan
| |
Collapse
|
162
|
Gang GJ, Deshpande R, Stayman JW. Standardization of histogram- and GLCM-based radiomics in the presence of blur and noise. Phys Med Biol 2021; 66:074004. [PMID: 33721845 PMCID: PMC8607458 DOI: 10.1088/1361-6560/abeea5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
Radiomics have been extensively investigated as quantitative biomarkers that can enhance the utility of imaging studies and aid the clinical decision making process. A major challenge to the clinical translation of radiomics is their variability as a result of different imaging and reconstruction protocols. In this work, we present a novel radiomics standardization framework capable of modeling and recovering the underlying radiomic feature in images that have been corrupted by the effects of spatial resolution and noise. We focus on two classes of radiomics based on pixel value distributions - i.e., histograms and gray-level co-occurrence matrices. We developed a model that predicts these distributions in the presence of system blur and noise, and used that model to invert these physical effects and recover the underlying distributions. Specifically, the effect of blur on histogram and GLCM is highly image-dependent, while additive noise convolves the histogram/GLCM of the noiseless image with those of the noise. The recovery method therefore consists of two deconvolution operations: the first in the image domain to remove the effect of system blur, the second in the histogram/GLCM domain to remove the effect of noise. The performance of the proposed recovery strategy was investigated using a set of texture phantoms and an emulated CT imaging chain with a range of realistic blur and noise levels. The proposed method was able to obtain histogram and GLCM estimates that closely resemble the ground truth. The method performed well across imaging conditions and significantly lowered the variability associated with different imaging protocols. This improvement also translated to better classification accuracy, where recovered radiomic values results in greater separation of radiomic clusters for two different texture phantoms as compared to values derived from the original blurred and noisy images. In summary, the novel radiomics standardization framework demonstrates high potential for mitigating radiomic variability as a result of the imaging system and can potentially be integrated as a preprocessing step towards more robust and reproducible radiomic models.
Collapse
Affiliation(s)
- Grace Jianan Gang
- Department of Biomedical Engineering, Johns Hopkins University, Traylor Research Building, 720 Rutland Avenue, Baltimore, Maryland, MD 21205, UNITED STATES
| | - Radhika Deshpande
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, Maryland, UNITED STATES
| | - Joseph Webster Stayman
- Department of Biomedical Engineering, Johns Hopkins University, 720 Rutland Avenue, Baltimore, Maryland, MD 21205, USA, Baltimore, 21205, UNITED STATES
| |
Collapse
|
163
|
Krajnc D, Papp L, Nakuz TS, Magometschnigg HF, Grahovac M, Spielvogel CP, Ecsedi B, Bago-Horvath Z, Haug A, Karanikas G, Beyer T, Hacker M, Helbich TH, Pinker K. Breast Tumor Characterization Using [ 18F]FDG-PET/CT Imaging Combined with Data Preprocessing and Radiomics. Cancers (Basel) 2021; 13:cancers13061249. [PMID: 33809057 PMCID: PMC8000810 DOI: 10.3390/cancers13061249] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2021] [Revised: 03/06/2021] [Accepted: 03/09/2021] [Indexed: 12/20/2022] Open
Abstract
Simple Summary Breast cancer is the second most common diagnosed malignancy in women worldwide. In this study, we examine the feasibility of breast tumor characterization based on [18F]FDG-PET/CT images using machine learning (ML) approaches in combination with data-preprocessing techniques. ML prediction models for breast cancer detection and the identification of breast cancer receptor status, proliferation rate, and molecular subtypes were established and evaluated. Furthermore, the importance of most repeatable features was investigated. Results displayed high performance of malignant/benign tumor differentiation and triple negative tumor subtype ML models. We observed high repeatability of radiomic features for both high performing predictive models. Abstract Background: This study investigated the performance of ensemble learning holomic models for the detection of breast cancer, receptor status, proliferation rate, and molecular subtypes from [18F]FDG-PET/CT images with and without incorporating data pre-processing algorithms. Additionally, machine learning (ML) models were compared with conventional data analysis using standard uptake value lesion classification. Methods: A cohort of 170 patients with 173 breast cancer tumors (132 malignant, 38 benign) was examined with [18F]FDG-PET/CT. Breast tumors were segmented and radiomic features were extracted following the imaging biomarker standardization initiative (IBSI) guidelines combined with optimized feature extraction. Ensemble learning including five supervised ML algorithms was utilized in a 100-fold Monte Carlo (MC) cross-validation scheme. Data pre-processing methods were incorporated prior to machine learning, including outlier and borderline noisy sample detection, feature selection, and class imbalance correction. Feature importance in each model was assessed by calculating feature occurrence by the R-squared method across MC folds. Results: Cross validation demonstrated high performance of the cancer detection model (80% sensitivity, 78% specificity, 80% accuracy, 0.81 area under the curve (AUC)), and of the triple negative tumor identification model (85% sensitivity, 78% specificity, 82% accuracy, 0.82 AUC). The individual receptor status and luminal A/B subtype models yielded low performance (0.46–0.68 AUC). SUVmax model yielded 0.76 AUC in cancer detection and 0.70 AUC in predicting triple negative subtype. Conclusions: Predictive models based on [18F]FDG-PET/CT images in combination with advanced data pre-processing steps aid in breast cancer diagnosis and in ML-based prediction of the aggressive triple negative breast cancer subtype.
Collapse
Affiliation(s)
- Denis Krajnc
- QIMP Team, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, 1090 Vienna, Austria; (D.K.); (L.P.); (B.E.)
| | - Laszlo Papp
- QIMP Team, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, 1090 Vienna, Austria; (D.K.); (L.P.); (B.E.)
| | - Thomas S. Nakuz
- Division of Nuclear Medicine, Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, 1090 Vienna, Austria; (T.S.N.); (M.G.); (C.P.S.); (A.H.); (G.K.); (M.H.)
| | - Heinrich F. Magometschnigg
- Division of Molecular and Gender Imaging, Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, 1090 Vienna, Austria; (H.F.M.); (T.H.H.); or (K.P.)
| | - Marko Grahovac
- Division of Nuclear Medicine, Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, 1090 Vienna, Austria; (T.S.N.); (M.G.); (C.P.S.); (A.H.); (G.K.); (M.H.)
- Christian Doppler Laboratory for Applied Metabolomics, Medical University of Vienna, 1090 Vienna, Austria
| | - Clemens P. Spielvogel
- Division of Nuclear Medicine, Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, 1090 Vienna, Austria; (T.S.N.); (M.G.); (C.P.S.); (A.H.); (G.K.); (M.H.)
- Christian Doppler Laboratory for Applied Metabolomics, Medical University of Vienna, 1090 Vienna, Austria
| | - Boglarka Ecsedi
- QIMP Team, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, 1090 Vienna, Austria; (D.K.); (L.P.); (B.E.)
| | | | - Alexander Haug
- Division of Nuclear Medicine, Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, 1090 Vienna, Austria; (T.S.N.); (M.G.); (C.P.S.); (A.H.); (G.K.); (M.H.)
- Christian Doppler Laboratory for Applied Metabolomics, Medical University of Vienna, 1090 Vienna, Austria
| | - Georgios Karanikas
- Division of Nuclear Medicine, Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, 1090 Vienna, Austria; (T.S.N.); (M.G.); (C.P.S.); (A.H.); (G.K.); (M.H.)
| | - Thomas Beyer
- QIMP Team, Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, 1090 Vienna, Austria; (D.K.); (L.P.); (B.E.)
- Correspondence:
| | - Marcus Hacker
- Division of Nuclear Medicine, Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, 1090 Vienna, Austria; (T.S.N.); (M.G.); (C.P.S.); (A.H.); (G.K.); (M.H.)
| | - Thomas H. Helbich
- Division of Molecular and Gender Imaging, Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, 1090 Vienna, Austria; (H.F.M.); (T.H.H.); or (K.P.)
| | - Katja Pinker
- Division of Molecular and Gender Imaging, Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, 1090 Vienna, Austria; (H.F.M.); (T.H.H.); or (K.P.)
- Memorial Sloan Kettering Cancer Center, Breast Imaging Service, Department of Radiology, New York, NY 10065, USA
| |
Collapse
|
164
|
Castiglioni I, Rundo L, Codari M, Di Leo G, Salvatore C, Interlenghi M, Gallivanone F, Cozzi A, D'Amico NC, Sardanelli F. AI applications to medical images: From machine learning to deep learning. Phys Med 2021; 83:9-24. [PMID: 33662856 DOI: 10.1016/j.ejmp.2021.02.006] [Citation(s) in RCA: 216] [Impact Index Per Article: 54.0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/30/2020] [Revised: 02/09/2021] [Accepted: 02/13/2021] [Indexed: 12/13/2022] Open
Abstract
PURPOSE Artificial intelligence (AI) models are playing an increasing role in biomedical research and healthcare services. This review focuses on challenges points to be clarified about how to develop AI applications as clinical decision support systems in the real-world context. METHODS A narrative review has been performed including a critical assessment of articles published between 1989 and 2021 that guided challenging sections. RESULTS We first illustrate the architectural characteristics of machine learning (ML)/radiomics and deep learning (DL) approaches. For ML/radiomics, the phases of feature selection and of training, validation, and testing are described. DL models are presented as multi-layered artificial/convolutional neural networks, allowing us to directly process images. The data curation section includes technical steps such as image labelling, image annotation (with segmentation as a crucial step in radiomics), data harmonization (enabling compensation for differences in imaging protocols that typically generate noise in non-AI imaging studies) and federated learning. Thereafter, we dedicate specific sections to: sample size calculation, considering multiple testing in AI approaches; procedures for data augmentation to work with limited and unbalanced datasets; and the interpretability of AI models (the so-called black box issue). Pros and cons for choosing ML versus DL to implement AI applications to medical imaging are finally presented in a synoptic way. CONCLUSIONS Biomedicine and healthcare systems are one of the most important fields for AI applications and medical imaging is probably the most suitable and promising domain. Clarification of specific challenging points facilitates the development of such systems and their translation to clinical practice.
Collapse
Affiliation(s)
- Isabella Castiglioni
- Department of Physics, Università degli Studi di Milano-Bicocca, Piazza della Scienza 3, 20126 Milano, Italy; Institute of Biomedical Imaging and Physiology, National Research Council, Via Fratelli Cervi 93, 20090 Segrate, Italy.
| | - Leonardo Rundo
- Department of Radiology, Box 218, Cambridge Biomedical Campus, Cambridge CB2 0QQ, United Kingdom; Cancer Research UK Cambridge Centre, University of Cambridge Li Ka Shing Centre, Robinson Way, Cambridge CB2 0RE, United Kingdom.
| | - Marina Codari
- Department of Radiology, Stanford University School of Medicine, Stanford University, 300 Pasteur Drive, Stanford, CA, USA.
| | - Giovanni Di Leo
- Unit of Radiology, IRCCS Policlinico San Donato, Via Rodolfo Morandi 30, 20097 San Donato Milanese, Italy.
| | - Christian Salvatore
- Scuola Universitaria Superiore IUSS Pavia, Piazza della Vittoria 15, 27100 Pavia, Italy; DeepTrace Technologies S.r.l., Via Conservatorio 17, 20122 Milano, Italy.
| | - Matteo Interlenghi
- DeepTrace Technologies S.r.l., Via Conservatorio 17, 20122 Milano, Italy.
| | - Francesca Gallivanone
- Institute of Biomedical Imaging and Physiology, National Research Council, Via Fratelli Cervi 93, 20090 Segrate, Italy.
| | - Andrea Cozzi
- Department of Biomedical Sciences for Health, Università degli Studi di Milano, Via Luigi Mangiagalli 31, 20133 Milano, Italy.
| | - Natascha Claudia D'Amico
- Department of Diagnostic Imaging and Stereotactic Radiosurgery, Centro Diagnostico Italiano S.p.A., Via Saint Bon 20, 20147 Milano, Italy; Unit of Computer Systems and Bioinformatics, Department of Engineering, Università Campus Bio-Medico di Roma, Via Alvaro del Portillo 21, 00128 Roma, Italy.
| | - Francesco Sardanelli
- Unit of Radiology, IRCCS Policlinico San Donato, Via Rodolfo Morandi 30, 20097 San Donato Milanese, Italy; Department of Biomedical Sciences for Health, Università degli Studi di Milano, Via Luigi Mangiagalli 31, 20133 Milano, Italy.
| |
Collapse
|
165
|
Artificial intelligence: Deep learning in oncological radiomics and challenges of interpretability and data harmonization. Phys Med 2021; 83:108-121. [PMID: 33765601 DOI: 10.1016/j.ejmp.2021.03.009] [Citation(s) in RCA: 103] [Impact Index Per Article: 25.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/02/2020] [Revised: 03/01/2021] [Accepted: 03/03/2021] [Indexed: 02/06/2023] Open
|
166
|
A Systematic Review of PET Textural Analysis and Radiomics in Cancer. Diagnostics (Basel) 2021; 11:diagnostics11020380. [PMID: 33672285 PMCID: PMC7926413 DOI: 10.3390/diagnostics11020380] [Citation(s) in RCA: 34] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2021] [Revised: 02/10/2021] [Accepted: 02/19/2021] [Indexed: 12/12/2022] Open
Abstract
Background: Although many works have supported the utility of PET radiomics, several authors have raised concerns over the robustness and replicability of the results. This study aimed to perform a systematic review on the topic of PET radiomics and the used methodologies. Methods: PubMed was searched up to 15 October 2020. Original research articles based on human data specifying at least one tumor type and PET image were included, excluding those that apply only first-order statistics and those including fewer than 20 patients. Each publication, cancer type, objective and several methodological parameters (number of patients and features, validation approach, among other things) were extracted. Results: A total of 290 studies were included. Lung (28%) and head and neck (24%) were the most studied cancers. The most common objective was prognosis/treatment response (46%), followed by diagnosis/staging (21%), tumor characterization (18%) and technical evaluations (15%). The average number of patients included was 114 (median = 71; range 20–1419), and the average number of high-order features calculated per study was 31 (median = 26, range 1–286). Conclusions: PET radiomics is a promising field, but the number of patients in most publications is insufficient, and very few papers perform in-depth validations. The role of standardization initiatives will be crucial in the upcoming years.
Collapse
|
167
|
A Multi-Center, Multi-Vendor Study to Evaluate the Generalizability of a Radiomics Model for Classifying Prostate cancer: High Grade vs. Low Grade. Diagnostics (Basel) 2021; 11:diagnostics11020369. [PMID: 33671533 PMCID: PMC7926758 DOI: 10.3390/diagnostics11020369] [Citation(s) in RCA: 31] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2020] [Revised: 02/17/2021] [Accepted: 02/19/2021] [Indexed: 12/22/2022] Open
Abstract
Radiomics applied in MRI has shown promising results in classifying prostate cancer lesions. However, many papers describe single-center studies without external validation. The issues of using radiomics models on unseen data have not yet been sufficiently addressed. The aim of this study is to evaluate the generalizability of radiomics models for prostate cancer classification and to compare the performance of these models to the performance of radiologists. Multiparametric MRI, photographs and histology of radical prostatectomy specimens, and pathology reports of 107 patients were obtained from three healthcare centers in the Netherlands. By spatially correlating the MRI with histology, 204 lesions were identified. For each lesion, radiomics features were extracted from the MRI data. Radiomics models for discriminating high-grade (Gleason score ≥ 7) versus low-grade lesions were automatically generated using open-source machine learning software. The performance was tested both in a single-center setting through cross-validation and in a multi-center setting using the two unseen datasets as external validation. For comparison with clinical practice, a multi-center classifier was tested and compared with the Prostate Imaging Reporting and Data System version 2 (PIRADS v2) scoring performed by two expert radiologists. The three single-center models obtained a mean AUC of 0.75, which decreased to 0.54 when the model was applied to the external data, the radiologists obtained a mean AUC of 0.46. In the multi-center setting, the radiomics model obtained a mean AUC of 0.75 while the radiologists obtained a mean AUC of 0.47 on the same subset. While radiomics models have a decent performance when tested on data from the same center(s), they may show a significant drop in performance when applied to external data. On a multi-center dataset our radiomics model outperformed the radiologists, and thus, may represent a more accurate alternative for malignancy prediction.
Collapse
|
168
|
Wong OL, Yuan JI, Zhou Y, Yu SK, Cheung KY. Longitudinal acquisition repeatability of MRI radiomics features: An ACR MRI phantom study on two MRI scanners using a 3D T1W TSE sequence. Med Phys 2021; 48:1239-1249. [PMID: 33370474 DOI: 10.1002/mp.14686] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2020] [Revised: 12/14/2020] [Accepted: 12/18/2020] [Indexed: 12/19/2022] Open
Abstract
PURPOSE The purpose of this study was to quantitatively assess the longitudinal acquisition repeatability of MRI radiomics features in a three-dimensional (3D) T1-weighted (T1W) TSE sequence via a well-controlled prospective phantom study. METHODS Thirty consecutive daily datasets of an ACR-MRI phantom were acquired on two 1.5T MRI simulators using a 3D T1W TSE sequence. Images were blindly segmented by two observers. Post-acquisition processing was minimized but an intensity discretization (fixed bin size of 25). One hundred and one radiomics features (shape n = 12; first order n = 16; texture n = 73) were extracted. Longitudinal repeatability of each feature was evaluated by Pearson correlation and coefficient of variance (CV68% ). Interobserver feature value agreement was also quantified using intraclass correlation coefficient (ICC) and Bland-Altman analysis. A most repeatable radiomics feature set on both scanners was determined by feature coefficient of variance (CV68% <5%), ICC (>0.75), and the ratio of the interobserver difference to the interobserver mean δ<5%. RESULTS No trend of radiomics feature value changed with time. Longitudinal feature repeatability CV68% ranged 0.01-38.60% (mean/median: 12.5%/9.9%), and 0.01-40.47%, (8.49%/7.34%) on the scanners A and B. Shape features exhibited significantly better repeatability than first-order and texture features (all P < 0.01). Significant longitudinal repeatability difference was observed in texture features (P < 0.001) between the two scanners, but not in shape and first-order features (P > 0.30). First-order and texture features had smaller interobserver-dependent variation than acquisition-dependent variation. They also showed good interobserver agreement on both scanners (A:ICC = 0.80 ± 0.23; B:ICC = 0.80 ± 0.22), independent of acquisition repeatability. The repeatable radiomics features in common on both scanners, including 12 shape features, 0 first-order features, and 3 texture features, were determined as the most repeatable MRI radiomics feature set. CONCLUSIONS Radiomics features exhibited heterogeneous longitudinal repeatability, while the shape features were the most repeatable, in this phantom study with a 3D T1W TSE acquisition. The most repeatable radiomics feature set derived in this study should be helpful for the selection of reliable radiomics features in the future clinical use.
Collapse
Affiliation(s)
- Oi Lei Wong
- Medical Physics and Research Department, Hong Kong Sanatorium & Hospital, Happy Valley, Hong Kong SAR, China
| | - JIng Yuan
- Medical Physics and Research Department, Hong Kong Sanatorium & Hospital, Happy Valley, Hong Kong SAR, China
| | - Yihang Zhou
- Medical Physics and Research Department, Hong Kong Sanatorium & Hospital, Happy Valley, Hong Kong SAR, China
| | - Siu Ki Yu
- Medical Physics and Research Department, Hong Kong Sanatorium & Hospital, Happy Valley, Hong Kong SAR, China
| | - Kin Yin Cheung
- Medical Physics and Research Department, Hong Kong Sanatorium & Hospital, Happy Valley, Hong Kong SAR, China
| |
Collapse
|
169
|
Harmonized pretreatment quantitative volume-based FDG-PET/CT parameters for prognosis of stage I-III breast cancer: Multicenter study. Oncotarget 2021; 12:95-105. [PMID: 33520114 PMCID: PMC7825640 DOI: 10.18632/oncotarget.27851] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2020] [Accepted: 12/11/2020] [Indexed: 12/22/2022] Open
Abstract
OBJECTIVES This study investigated harmonized pretreatment volume-based quantitative FDG-PET/CT parameters in breast cancer patients for prognostic value. RESULTS During a median overall follow-up period of 5.3 years, 91 patients had recurrence and 40 died. Multivariate analysis of ER-positive/HER2-negative patients showed high maximum standardized uptake value (SUVmax) (p = 0.018), high total lesion glycolysis (TLG) (p = 0.010), and clinical N-classification (p = 0.0027) as independent negative predictors of RFS, while high maximum SUVmax (p = 0.037), advanced clinical T-classification (p = 0.030), and advanced TNM stage (p = 0.0067) were independent negative predictors of OS. For recurrence and death in HER2-positive patients, high total TLG (p = 0.037, p = 0.0048, respectively) and advanced TNM stage (p = 0.048, p = 0.046, respectively) were independent prediction factors. In the triple-negative group, independent factors related to recurrence and death were high maximum SUVmax (p = 0.0014, p = 0.0003, respectively) and advanced TNM stage (p < 0.0001, p < 0.0001, respectively). MATERIALS AND METHODS Records of 546 stage I-III invasive breast cancer patients, including 344 estrogen receptor (ER)-positive/human epidermal growth factor receptor 2 (HER2)-negative, 110 HER2-positive, and 92 triple-negative cases, treated at four institutions were reviewed retrospectively. Harmonized primary tumor and nodal maximum SUVmax, metabolic tumor volume (MTV), and TLG indicated in pretreatment FDG-PET/CT results were analyzed. Evaluations of relationships of clinicopathological factors, volume-based quantitative parameters, recurrence-free survival (RFS), and overall survival (OS) for each subtype were performed with a Cox proportional hazards model and log-rank test. CONCLUSIONS The results indicated that potential surrogate markers for prognosis in patients with the three main subtypes of operable breast cancer include harmonized pretreatment quantitative volume-based FDG-PET/CT parameters, particularly whole-lesion SUVmax and TLG.
Collapse
|
170
|
Hotta M, Minamimoto R, Toyohara J, Nohara K, Nakajima K, Takase K, Yamada K. Efficacy of cell proliferation imaging with 4DST PET/CT for predicting the prognosis of patients with esophageal cancer: a comparison study with FDG PET/CT. Eur J Nucl Med Mol Imaging 2021; 48:2615-2623. [PMID: 33438100 DOI: 10.1007/s00259-020-05179-x] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2020] [Accepted: 12/26/2020] [Indexed: 12/24/2022]
Abstract
PURPOSE 4'-[Methyl-11C] thiothymidine (4DST) incorporates into DNA directly and is a PET tracer used for cell proliferation imaging. The aim of this study was to evaluate the prediction of prognosis with pretreatment 4DST PET/CT compared to fluorodeoxyglucose (FDG) PET/CT in patients with esophageal cancer. METHODS In this prospective study, we analyzed 46 patients (68.2 ± 10.0 years old) with pathologically proven esophageal squamous cell cancer who underwent pretreatment 4DST and FDG PET/CT. The maximum standardized uptake value (SUVmax), metabolic tumor volume (MTV), total lesion glycolysis (TLG), and total lesion proliferation (TLP) were measured for FDG and 4DST PET. The study endpoints were progression-free survival (PFS) and overall survival (OS). Patients' clinical backgrounds, including age, histological type, clinical stage, and surgical treatment, were adjusted using the Cox proportional-hazards model. RESULTS In the follow-up period (median 18.8 (interquartile range: 10.1-29.0) months), 26 and 19 patients showed disease progression and cancer-related death, respectively. After adjusting for clinical variables, only the 4DST parameters (SUVmax (p = 0.001) and TLP (p = 0.022)) were statistically significant for predicting PFS. FDG MTV (p = 0.031), 4DST SUVmax (p = 0.022), and TLP (p = 0.023) were statistically significant for predicting OS. Of the PET parameters, 4DST SUVmax yielded the highest adjusted hazard ratio for both PFS (4.88, 95% confidence intervals (CI): 1.83-12.97) and OS (4.19, 95% CI: 1.23-14.20). CONCLUSION Higher accumulation of 4DST in the primary tumor may lead to shorter OS and PFS. 4DST PET/CT is useful for predicting prognosis and may outperform FDG PET/CT.
Collapse
Affiliation(s)
- Masatoshi Hotta
- Department of Nuclear Medicine, National Center for Global Health and Medicine, 1-21-1, Toyama, Shinjuku-ku, Tokyo, 162-8655, Japan.
- Department of Diagnostic Radiology, Tohoku University Hospital, 1-1, Seiryo-machi, Aoba-ku, Sendai, Miyagi, 980-8574, Japan.
| | - Ryogo Minamimoto
- Department of Nuclear Medicine, National Center for Global Health and Medicine, 1-21-1, Toyama, Shinjuku-ku, Tokyo, 162-8655, Japan
| | - Jun Toyohara
- Functional Brain Research Team for Neuroimaging, Tokyo Metropolitan Institute of Gerontology, 35-2, Sakae-cho, Itabashi-ku, Tokyo, 173-0015, Japan
| | - Kyoko Nohara
- Department of Surgery, National Center for Global Health and Medicine, 1-21-1, Toyama, Shinjuku-ku, Tokyo, 162-8655, Japan
| | - Kazuhiko Nakajima
- Department of Nuclear Medicine, National Center for Global Health and Medicine, 1-21-1, Toyama, Shinjuku-ku, Tokyo, 162-8655, Japan
| | - Kei Takase
- Department of Diagnostic Radiology, Tohoku University Hospital, 1-1, Seiryo-machi, Aoba-ku, Sendai, Miyagi, 980-8574, Japan
| | - Kazuhiko Yamada
- Department of Surgery, National Center for Global Health and Medicine, 1-21-1, Toyama, Shinjuku-ku, Tokyo, 162-8655, Japan
| |
Collapse
|
171
|
Prognostic Value of Baseline Radiomic Features of 18F-FDG PET in Patients with Diffuse Large B-Cell Lymphoma. Diagnostics (Basel) 2020; 11:diagnostics11010036. [PMID: 33379166 PMCID: PMC7824203 DOI: 10.3390/diagnostics11010036] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2020] [Revised: 12/21/2020] [Accepted: 12/24/2020] [Indexed: 12/12/2022] Open
Abstract
This study investigates whether baseline 18F-FDG PET radiomic features can predict survival outcomes in patients with diffuse large B-cell lymphoma (DLBCL). We retrospectively enrolled 83 patients diagnosed with DLBCL who underwent 18F-FDG PET scans before treatment. The patients were divided into the training cohort (n = 58) and the validation cohort (n = 25). Eighty radiomic features were extracted from the PET images for each patient. Least absolute shrinkage and selection operator regression were used to reduce the dimensionality within radiomic features. Cox proportional hazards model was used to determine the prognostic factors for progression-free survival (PFS) and overall survival (OS). A prognostic stratification model was built in the training cohort and validated in the validation cohort using Kaplan-Meier survival analysis. In the training cohort, run length non-uniformity (RLN), extracted from a gray level run length matrix (GLRLM), was independently associated with PFS (hazard ratio (HR) = 15.7, p = 0.007) and OS (HR = 8.64, p = 0.040). The International Prognostic Index was an independent prognostic factor for OS (HR = 2.63, p = 0.049). A prognostic stratification model was devised based on both risk factors, which allowed identification of three risk groups for PFS and OS in the training (p < 0.001 and p < 0.001) and validation (p < 0.001 and p = 0.020) cohorts. Our results indicate that the baseline 18F-FDG PET radiomic feature, RLNGLRLM, is an independent prognostic factor for survival outcomes. Furthermore, we propose a prognostic stratification model that may enable tailored therapeutic strategies for patients with DLBCL.
Collapse
|
172
|
Abstract
Carrying out large multicenter studies is one of the key goals to be achieved towards a faster transfer of the radiomics approach in the clinical setting. This requires large-scale radiomics data analysis, hence the need for integrating radiomic features extracted from images acquired in different centers. This is challenging as radiomic features exhibit variable sensitivity to differences in scanner model, acquisition protocols and reconstruction settings, which is similar to the so-called 'batch-effects' in genomics studies. In this review we discuss existing methods to perform data integration with the aid of reducing the unwanted variation associated with batch effects. We also discuss the future potential role of deep learning methods in providing solutions for addressing radiomic multicentre studies.
Collapse
Affiliation(s)
- R Da-Ano
- LaTiM, INSERM, UMR 1101, Univ Brest, Brest, France
| | - D Visvikis
- LaTiM, INSERM, UMR 1101, Univ Brest, Brest, France
- equally contributed
| | - M Hatt
- LaTiM, INSERM, UMR 1101, Univ Brest, Brest, France
- equally contributed
| |
Collapse
|
173
|
Bagher-Ebadian H, Chetty IJ. Technical Note: ROdiomiX: A validated software for radiomics analysis of medical images in radiation oncology. Med Phys 2020; 48:354-365. [PMID: 33169367 DOI: 10.1002/mp.14590] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2020] [Revised: 10/27/2020] [Accepted: 11/03/2020] [Indexed: 12/19/2022] Open
Abstract
PURPOSE This study introduces an in-house-designed software platform (ROdiomiX) for the radiomics analysis of medical images in radiation oncology. ROdiomiX is a MATLAB-based framework for the computation of radiomic features and feature aggregation techniques in compliance with the Image-Biomarker-Standardization-Initiative (IBSI) guidelines, which includes preprocessing protocols and quantitative benchmark results for analysis of computational phantom images. METHODS AND MATERIALS The ROdiomiX software system consists of a series of computation cores implemented on the basis of the guidelines proposed by the IBSI. It is capable of quantitative computation of the following 11 different feature categories: Local-Intensity, Intensity-Histogram, Intensity-Based-Statistical, Intensity-Volume-Histogram, Gray-Level-Co-occurrence, Gray-Level-Run-Length, Gray-Level-Size-Zone, Gray-Level-Distance-Zone, Neighborhood-Grey-Tone-Difference, Neighboring-Grey-Level-Dependence, and Morphological feature. ROdiomiX was validated against benchmark values for the IBSI 3D digital phantom, as well as one designed in-house (HFH). The intraclass correlation coefficient (ICC) for estimating the degree of absolute agreement between ROdiomiX computation and benchmark values for different features at the 95% confidence level (CL) was used for comparison. RESULTS Among the 11 feature categories with 149 total features including 10 different feature aggregation methods (following the IBSI guidelines), the percent difference between absolute feature values computed by the ROdiomiX software and benchmark values reported for IBSI and HFH digital phantoms were 0.14% + 0.43% and 0.11% + 0.27%, respectively. The ICC values were >0.997 for all ten feature categories for both the IBSI and HFH digital phantoms. CONCLUSION The authors successfully developed a platform for computation of quantitative radiomic features. The image preprocessing and computational software cores were designed following the procedures specified by the IBSI. Benchmarking testing was in excellent agreement against the IBSI- and HFH-designed computational phantoms.
Collapse
Affiliation(s)
- Hassan Bagher-Ebadian
- Department of Radiation Oncology, Henry Ford Health System, 2799 West Grand Blvd, Detroit, MI, 48202, USA
| | - Indrin J Chetty
- Department of Radiation Oncology, Henry Ford Health System, 2799 West Grand Blvd, Detroit, MI, 48202, USA
| |
Collapse
|
174
|
Li W, Liu H, Cheng F, Li Y, Li S, Yan J. Artificial intelligence applications for oncological positron emission tomography imaging. Eur J Radiol 2020; 134:109448. [PMID: 33307463 DOI: 10.1016/j.ejrad.2020.109448] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2020] [Revised: 10/07/2020] [Accepted: 11/26/2020] [Indexed: 12/16/2022]
Abstract
Positron emission tomography (PET), a functional and dynamic molecular imaging technique, is generally used to reveal tumors' biological behavior. Radiomics allows a high-throughput extraction of multiple features from images with artificial intelligence (AI) approaches and develops rapidly worldwide. Quantitative and objective features of medical images have been explored to recognize reliable biomarkers, with the development of PET radiomics. This paper will review the current clinical exploration of PET-based classical machine learning and deep learning methods, including disease diagnosis, the prediction of histological subtype, gene mutation status, tumor metastasis, tumor relapse, therapeutic side effects, therapeutic intervention and evaluation of prognosis. The applications of AI in oncology will be mainly discussed. The image-guided biopsy or surgery assisted by PET-based AI will be introduced as well. This paper aims to present the applications and methods of AI for PET imaging, which may offer important details for further clinical studies. Relevant precautions are put forward and future research directions are suggested.
Collapse
Affiliation(s)
- Wanting Li
- Shanxi Medical University, Taiyuan 030009, PR China; Department of Nuclear Medicine, First Hospital of Shanxi Medical University, Taiyuan 030001, PR China; Collaborative Innovation Center for Molecular Imaging, Taiyuan 030001, PR China
| | - Haiyan Liu
- Department of Nuclear Medicine, First Hospital of Shanxi Medical University, Taiyuan 030001, PR China; Collaborative Innovation Center for Molecular Imaging, Taiyuan 030001, PR China; Cellular Physiology Key Laboratory of Ministry of Education, Translational Medicine Research Center, Shanxi Medical University, Taiyuan 030001, PR China
| | - Feng Cheng
- Shanxi Medical University, Taiyuan 030009, PR China
| | - Yanhua Li
- Shanxi Medical University, Taiyuan 030009, PR China
| | - Sijin Li
- Shanxi Medical University, Taiyuan 030009, PR China; Department of Nuclear Medicine, First Hospital of Shanxi Medical University, Taiyuan 030001, PR China; Collaborative Innovation Center for Molecular Imaging, Taiyuan 030001, PR China.
| | - Jiangwei Yan
- Shanxi Medical University, Taiyuan 030009, PR China.
| |
Collapse
|
175
|
Saint Martin MJ, Orlhac F, Akl P, Khalid F, Nioche C, Buvat I, Malhaire C, Frouin F. A radiomics pipeline dedicated to Breast MRI: validation on a multi-scanner phantom study. MAGNETIC RESONANCE MATERIALS IN PHYSICS BIOLOGY AND MEDICINE 2020; 34:355-366. [PMID: 33180226 DOI: 10.1007/s10334-020-00892-y] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/16/2020] [Revised: 09/27/2020] [Accepted: 10/23/2020] [Indexed: 12/14/2022]
Abstract
OBJECTIVE Quantitative analysis in MRI is challenging due to variabilities in intensity distributions across patients, acquisitions and scanners and suffers from bias field inhomogeneity. Radiomic studies are impacted by these effects that affect radiomic feature values. This paper describes a dedicated pipeline to increase reproducibility in breast MRI radiomic studies. MATERIALS AND METHODS T1, T2, and T1-DCE MR images of two breast phantoms were acquired using two scanners and three dual breast coils. Images were retrospectively corrected for bias field inhomogeneity and further normalised using Z score or histogram matching. Extracted radiomic features were harmonised between coils by the ComBat method. The whole pipeline was assessed qualitatively and quantitatively using statistical comparisons on two series of radiomic feature values computed in the gel mimicking the normal breast tissue or in dense lesions. RESULTS Intra and inter-acquisition variabilities were strongly reduced by the standardisation pipeline. Harmonisation by ComBat lowered the percentage of radiomic features significantly different between the three coils from 87% after bias field correction and MR normalisation to 3% in the gel, while preserving or improving performance of lesion classification in the phantoms. DISCUSSION A dedicated standardisation pipeline was developed to reduce variabilities in breast MRI, which paves the way for robust multi-scanner radiomic studies but needs to be assessed on patient data.
Collapse
Affiliation(s)
- Marie-Judith Saint Martin
- Inserm, Institut Curie,Université Paris-Saclay, Laboratoire d'Imagerie Translationnelle en Oncologie (LITO), Centre de Recherche de l'Institut Curie, Bât 101B rue Henri Becquerel, 91401, Orsay, France.
| | - Fanny Orlhac
- Inserm, Institut Curie,Université Paris-Saclay, Laboratoire d'Imagerie Translationnelle en Oncologie (LITO), Centre de Recherche de l'Institut Curie, Bât 101B rue Henri Becquerel, 91401, Orsay, France
| | - Pia Akl
- Inserm, Institut Curie,Université Paris-Saclay, Laboratoire d'Imagerie Translationnelle en Oncologie (LITO), Centre de Recherche de l'Institut Curie, Bât 101B rue Henri Becquerel, 91401, Orsay, France
- HCL, Radiologie du Groupement Hospitalier Est, Hôpital Femme Mère Enfant, Unité Fonctionnelle: Imagerie de la Femme, 3 Quai des Célestins, 69002, Lyon, France
- Institut Curie, Service de Radiodiagnostic, 26 rue d'Ulm, 75005, Paris, France
| | - Fahad Khalid
- Inserm, Institut Curie,Université Paris-Saclay, Laboratoire d'Imagerie Translationnelle en Oncologie (LITO), Centre de Recherche de l'Institut Curie, Bât 101B rue Henri Becquerel, 91401, Orsay, France
| | - Christophe Nioche
- Inserm, Institut Curie,Université Paris-Saclay, Laboratoire d'Imagerie Translationnelle en Oncologie (LITO), Centre de Recherche de l'Institut Curie, Bât 101B rue Henri Becquerel, 91401, Orsay, France
| | - Irène Buvat
- Inserm, Institut Curie,Université Paris-Saclay, Laboratoire d'Imagerie Translationnelle en Oncologie (LITO), Centre de Recherche de l'Institut Curie, Bât 101B rue Henri Becquerel, 91401, Orsay, France
| | - Caroline Malhaire
- Inserm, Institut Curie,Université Paris-Saclay, Laboratoire d'Imagerie Translationnelle en Oncologie (LITO), Centre de Recherche de l'Institut Curie, Bât 101B rue Henri Becquerel, 91401, Orsay, France
- Institut Curie, Service de Radiodiagnostic, 26 rue d'Ulm, 75005, Paris, France
| | - Frédérique Frouin
- Inserm, Institut Curie,Université Paris-Saclay, Laboratoire d'Imagerie Translationnelle en Oncologie (LITO), Centre de Recherche de l'Institut Curie, Bât 101B rue Henri Becquerel, 91401, Orsay, France
| |
Collapse
|
176
|
Hatt M, Cheze Le Rest C, Antonorsi N, Tixier F, Tankyevych O, Jaouen V, Lucia F, Bourbonne V, Schick U, Badic B, Visvikis D. Radiomics in PET/CT: Current Status and Future AI-Based Evolutions. Semin Nucl Med 2020; 51:126-133. [PMID: 33509369 DOI: 10.1053/j.semnuclmed.2020.09.002] [Citation(s) in RCA: 29] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
This short review aims at providing the readers with an update on the current status, as well as future perspectives in the quickly evolving field of radiomics applied to the field of PET/CT imaging. Numerous pitfalls have been identified in study design, data acquisition, segmentation, features calculation and modeling by the radiomics community, and these are often the same issues across all image modalities and clinical applications, however some of these are specific to PET/CT (and SPECT/CT) imaging and therefore the present paper focuses on those. In most cases, recommendations and potential methodological solutions do exist and should therefore be followed to improve the overall quality and reproducibility of published studies. In terms of future evolutions, the techniques from the larger field of artificial intelligence (AI), including those relying on deep neural networks (also known as deep learning) have already shown impressive potential to provide solutions, especially in terms of automation, but also to maybe fully replace the tools the radiomics community has been using until now in order to build the usual radiomics workflow. Some important challenges remain to be addressed before the full impact of AI may be realized but overall the field has made striking advances over the last few years and it is expected advances will continue at a rapid pace.
Collapse
Affiliation(s)
- Mathieu Hatt
- LaTIM, INSERM, UMR 1101, University of Brest, CHRU Brest, France
| | - Catherine Cheze Le Rest
- LaTIM, INSERM, UMR 1101, University of Brest, CHRU Brest, France; Nuclear Medicine Department, CHU Milétrie, Poitiers, France
| | - Nils Antonorsi
- Nuclear Medicine Department, CHU Milétrie, Poitiers, France
| | - Florent Tixier
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, NY 10065, United States of America
| | | | - Vincent Jaouen
- LaTIM, INSERM, UMR 1101, University of Brest, CHRU Brest, France; IMT-Atlantique, Plouzané, France
| | - Francois Lucia
- LaTIM, INSERM, UMR 1101, University of Brest, CHRU Brest, France
| | | | - Ulrike Schick
- LaTIM, INSERM, UMR 1101, University of Brest, CHRU Brest, France
| | - Bogdan Badic
- LaTIM, INSERM, UMR 1101, University of Brest, CHRU Brest, France
| | | |
Collapse
|
177
|
Abstract
Radiomics describes the extraction of multiple features from medical images, including molecular imaging modalities, that with bioinformatic approaches, provide additional clinically relevant information that may be invisible to the human eye. This information may complement standard radiological interpretation with data that may better characterize a disease or that may provide predictive or prognostic information. Progressing from predefined image features, often describing heterogeneity of voxel intensities within a volume of interest, there is increasing use of machine learning to classify disease characteristics and deep learning methods based on artificial neural networks that can learn features without a priori definition and without the need for preprocessing of images. There have been advances in standardization and harmonization of methods to a level that should support multicenter studies. However, in this relatively early phase of research in the field, there are limited aspects that have been adopted into routine practice. Most of the reports in the molecular imaging field describe radiomic approaches in cancer using 18F-fluorodeoxyglucose positron emission tomography (18F-FDG-PET). In this review, we will describe radiomics in molecular imaging and summarize the pertinent literature in lung cancer where reports are most prevalent and mature.
Collapse
Affiliation(s)
- Gary J R Cook
- Cancer Imaging Department, School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK; King's College London & Guy's and St Thomas' PET Centre, St Thomas' Hospital, London, UK.
| | - Vicky Goh
- Cancer Imaging Department, School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK; Radiology Department, Guy's and St Thomas' Hospitals NHS Trust, London, UK
| |
Collapse
|
178
|
Foy JJ, Al-Hallaq HA, Grekoski V, Tran T, Guruvadoo K, Armato Iii SG, Sensakovic WF. Harmonization of radiomic feature variability resulting from differences in CT image acquisition and reconstruction: assessment in a cadaveric liver. Phys Med Biol 2020; 65:205008. [PMID: 33063693 DOI: 10.1088/1361-6560/abb172] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
Abstract
Studies investigating the effects of computed tomography (CT) image acquisition and reconstruction parameters have mostly been limited to non-human phantoms to limit exposure to patients. This study investigates these variations using a cadaveric liver and determines harmonization methods to mitigate these variations. A reference CT scan of a cadaveric liver was acquired along with 16 modified scans. Modified scans were obtained with altered image acquisition and reconstruction parameters. In each slice, the liver was segmented and used to calculate 142 features. Student's t-tests assessed differences between reference and modified scans for each feature after correcting for multiple comparisons. Features were harmonized between reference and modified scans using histogram normalization, pixel resampling, Butterworth filtering, resampling and filtering combined, and ComBat harmonization. The number of features reflecting significant differences before and after harmonization were compared across imaging parameters. Reducing the field-of-view (FOV) and using coronal instead of axial scans resulted in the greatest number of features reflecting significant differences (67.6%, and 35.9%, respectively) and resulted in the greatest median relative change in feature values (25.4% and 18.2%, respectively). Changes in tube voltage, pitch, and slice interval resulted in the smallest number of features reflecting significance (0.7%) with median relative changes in feature <2%. Histogram normalization reduced or maintained the number of significantly different features for all scans, while ComBat reduced the number of significantly different features to zero for all scans. The remaining harmonization methods had mixed effects: resampling reduced the number of features reflecting significant differences for half of the imaging parameters, while filtering alone and filtering combined with resampling both reduced the number of features reflecting significance for 10 of the 16 parameters. The dependence of radiomic features on image acquisition and reconstruction parameters varies in a cadaveric liver; however, various harmonization methods have shown promise in mitigating these dependencies, particularly ComBat.
Collapse
Affiliation(s)
- Joseph J Foy
- Department of Radiology, University of Chicago, Chicago, IL, 60637, United States of America
| | | | | | | | | | | | | |
Collapse
|
179
|
Decazes P, Camus V, Bohers E, Viailly PJ, Tilly H, Ruminy P, Viennot M, Hapdey S, Gardin I, Becker S, Vera P, Jardin F. Correlations between baseline 18F-FDG PET tumour parameters and circulating DNA in diffuse large B cell lymphoma and Hodgkin lymphoma. EJNMMI Res 2020; 10:120. [PMID: 33029662 PMCID: PMC7541805 DOI: 10.1186/s13550-020-00717-y] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2020] [Accepted: 09/24/2020] [Indexed: 12/14/2022] Open
Abstract
Background 18F-FDG PET/CT is a standard for many B cell malignancies, while blood DNA measurements are emerging tools. Our objective was to evaluate the correlations between baseline PET parameters and circulating DNA in diffuse large B cell lymphoma (DLBCL) and classical Hodgkin lymphoma (cHL).
Methods Twenty-seven DLBCL and forty-eight cHL were prospectively included. Twelve PET parameters were analysed. Spearman’s correlations were used to compare PET parameters each other and to circulating cell-free DNA ([cfDNA]) and circulating tumour DNA ([ctDNA]). p values were controlled by Benjamini–Hochberg correction. Results Among the PET parameters, three different clusters for tumour burden, fragmentation/massiveness and dispersion parameters were observed. Some PET parameters were significantly correlated with blood DNA parameters, including the total metabolic tumour surface (TMTS) describing the tumour–host interface (e.g. ρ = 0.81 p < 0.001 for [ctDNA] of DLBLC), the tumour median distance between the periphery and the centroid (medPCD) describing the tumour’s massiveness (e.g. ρ = 0.81 p < 0.001 for [ctDNA] of DLBLC) and the volume of the bounding box including tumours (TumBB) describing the disease’s dispersion (e.g. ρ = 0.83 p < 0.001 for [ctDNA] of DLBLC). Conclusions Some PET parameters describing tumour burden, fragmentation/massiveness and dispersion are significantly correlated with circulating DNA parameters of DLBCL and cHL patients. These results could help to understand the pathophysiology of B cell malignancies.
Collapse
Affiliation(s)
- Pierre Decazes
- Department of Nuclear Medicine, Henri Becquerel Cancer Centre, Rouen, France. .,QuantIF-LITIS-EA4108, University of Rouen, Rouen, France.
| | - Vincent Camus
- Department of Haematology, Henri Becquerel Cancer Centre, Rouen, France.,INSERM U1245, Henri Becquerel Cancer Centre and Rouen University, Rouen, France
| | - Elodie Bohers
- Department of Haematology, Henri Becquerel Cancer Centre, Rouen, France.,INSERM U1245, Henri Becquerel Cancer Centre and Rouen University, Rouen, France
| | - Pierre-Julien Viailly
- Department of Haematology, Henri Becquerel Cancer Centre, Rouen, France.,INSERM U1245, Henri Becquerel Cancer Centre and Rouen University, Rouen, France
| | - Hervé Tilly
- Department of Haematology, Henri Becquerel Cancer Centre, Rouen, France.,INSERM U1245, Henri Becquerel Cancer Centre and Rouen University, Rouen, France
| | - Philippe Ruminy
- Department of Haematology, Henri Becquerel Cancer Centre, Rouen, France.,INSERM U1245, Henri Becquerel Cancer Centre and Rouen University, Rouen, France
| | - Mathieu Viennot
- Department of Haematology, Henri Becquerel Cancer Centre, Rouen, France.,INSERM U1245, Henri Becquerel Cancer Centre and Rouen University, Rouen, France
| | - Sébastien Hapdey
- Department of Nuclear Medicine, Henri Becquerel Cancer Centre, Rouen, France.,QuantIF-LITIS-EA4108, University of Rouen, Rouen, France
| | - Isabelle Gardin
- Department of Nuclear Medicine, Henri Becquerel Cancer Centre, Rouen, France.,QuantIF-LITIS-EA4108, University of Rouen, Rouen, France
| | - Stéphanie Becker
- Department of Nuclear Medicine, Henri Becquerel Cancer Centre, Rouen, France.,QuantIF-LITIS-EA4108, University of Rouen, Rouen, France
| | - Pierre Vera
- Department of Nuclear Medicine, Henri Becquerel Cancer Centre, Rouen, France.,QuantIF-LITIS-EA4108, University of Rouen, Rouen, France
| | - Fabrice Jardin
- Department of Haematology, Henri Becquerel Cancer Centre, Rouen, France.,INSERM U1245, Henri Becquerel Cancer Centre and Rouen University, Rouen, France
| |
Collapse
|
180
|
How can we combat multicenter variability in MR radiomics? Validation of a correction procedure. Eur Radiol 2020; 31:2272-2280. [PMID: 32975661 DOI: 10.1007/s00330-020-07284-9] [Citation(s) in RCA: 117] [Impact Index Per Article: 23.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2020] [Revised: 07/06/2020] [Accepted: 09/10/2020] [Indexed: 10/23/2022]
Abstract
OBJECTIVE Test a practical realignment approach to compensate the technical variability of MR radiomic features. METHODS T1 phantom images acquired on 2 scanners, FLAIR and contrast-enhanced T1-weighted (CE-T1w) images of 18 brain tumor patients scanned on both 1.5-T and 3-T scanners, and 36 T2-weighted (T2w) images of prostate cancer patients scanned in one of two centers were investigated. The ComBat procedure was used for harmonizing radiomic features. Differences in statistical distributions in feature values between 1.5- and 3-T images were tested before and after harmonization. The prostate studies were used to determine the impact of harmonization to distinguish between Gleason grades (GGs). RESULTS In the phantom data, 40 out of 42 radiomic feature values were significantly different between the 2 scanners before harmonization and none after. In white matter regions, the statistical distributions of features were significantly different (p < 0.05) between the 1.5- and 3-T images for 37 out of 42 features in both FLAIR and CE-T1w images. After harmonization, no statistically significant differences were observed. In brain tumors, 41 (FLAIR) or 36 (CE-T1w) out of 42 features were significantly different between the 1.5- and 3-T images without harmonization, against 1 (FLAIR) or none (CE-T1w) with harmonization. In prostate studies, 636 radiomic features were significantly different between GGs after harmonization against 461 before. The ability to distinguish between GGs using radiomic features was increased after harmonization. CONCLUSION ComBat harmonization efficiently removes inter-center technical inconsistencies in radiomic feature values and increases the sensitivity of studies using data from several scanners. KEY POINTS • Radiomic feature values obtained using different MR scanners or imaging protocols can be harmonized by combining off-the-shelf image standardization and feature realignment procedures. • Harmonized radiomic features enable one to pool data from different scanners and centers without a substantial loss of statistical power caused by intra- and inter-center variability. • The proposed realignment method is applicable to radiomic features from different MR sequences and tumor types and does not rely on any phantom acquisition.
Collapse
|
181
|
Abstract
Machine learning (ML) and artificial intelligence (AI) are aiding in improving sensitivity and specificity of diagnostic imaging. The rapid adoption of these advanced ML algorithms is transforming imaging analysis; taking us from noninvasive detection of pathology to noninvasive precise diagnosis of the pathology by identifying whether detected abnormality is a secondary to infection, inflammation and/or neoplasm. This is led to the emergence of “Radiobiogenomics”; referring to the concept of identifying biologic (genomic, proteomic) alterations in the detected lesion. Radiobiogenomic involves image segmentation, feature extraction, and ML model to predict underlying tumor genotype and clinical outcomes. Lung cancer is the most common cause of cancer related death worldwide. There are several histologic subtypes of lung cancer, e.g., small cell lung cancer (SCLC), non-small cell lung cancer (NSCLC) (adenocarcinoma, squamous cell carcinoma). These variable histologic subtypes not only appear different at microscopic level, but these also differ at genetic and transcription level. This intrinsic heterogeneity reveals itself as different morphologic appearances on diagnostic imaging, such as CT, PET/CT and MRI. Traditional evaluation of imaging findings of lung cancer is limited to morphologic characteristics, such as lesion size, margins, density. Radiomics takes image analysis a step further by looking at imaging phenotype with higher order statistics in efforts to quantify intralesional heterogeneity. This heterogeneity, in turn, can be potentially used to extract intralesional genomic and proteomic data. This review aims to highlight novel concepts in ML and AI and their potential applications in identifying radiobiogenomics of lung cancer.
Collapse
Affiliation(s)
- Chi Wah Wong
- Department of Applied AI and Data Science, City of Hope National Medical Center, Duarte, CA, USA.,Department of Diagnostic and Interventional Radiology, City of Hope National Medical Center, Duarte, CA, USA
| | - Ammar Chaudhry
- Department of Applied AI and Data Science, City of Hope National Medical Center, Duarte, CA, USA
| |
Collapse
|
182
|
Characterization of FDG PET Images Using Texture Analysis in Tumors of the Gastro-Intestinal Tract: A Review. Biomedicines 2020; 8:biomedicines8090304. [PMID: 32846986 PMCID: PMC7556033 DOI: 10.3390/biomedicines8090304] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2020] [Revised: 08/14/2020] [Accepted: 08/21/2020] [Indexed: 12/22/2022] Open
Abstract
Radiomics or textural feature extraction obtained from positron emission tomography (PET) images through complex mathematical models of the spatial relationship between multiple image voxels is currently emerging as a new tool for assessing intra-tumoral heterogeneity in medical imaging. In this paper, available literature on texture analysis using FDG PET imaging in patients suffering from tumors of the gastro-intestinal tract is reviewed. While texture analysis of FDG PET images appears clinically promising, due to the lack of technical specifications, a large variability in the implemented methodology used for texture analysis and lack of statistical robustness, at present, no firm conclusions can be drawn regarding the predictive or prognostic value of FDG PET texture analysis derived indices in patients suffering from gastro-enterologic tumors. In order to move forward in this field, a harmonized image acquisition and processing protocol as well as a harmonized protocol for texture analysis of tumor volumes, allowing multi-center studies excluding statistical biases should be considered. Furthermore, the complementary and additional value of CT-imaging, as part of the PET/CT imaging technique, warrants exploration.
Collapse
|
183
|
van Timmeren JE, Cester D, Tanadini-Lang S, Alkadhi H, Baessler B. Radiomics in medical imaging-"how-to" guide and critical reflection. Insights Imaging 2020; 11:91. [PMID: 32785796 PMCID: PMC7423816 DOI: 10.1186/s13244-020-00887-2] [Citation(s) in RCA: 731] [Impact Index Per Article: 146.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2020] [Accepted: 06/22/2020] [Indexed: 02/06/2023] Open
Abstract
Radiomics is a quantitative approach to medical imaging, which aims at enhancing the existing data available to clinicians by means of advanced mathematical analysis. Through mathematical extraction of the spatial distribution of signal intensities and pixel interrelationships, radiomics quantifies textural information by using analysis methods from the field of artificial intelligence. Various studies from different fields in imaging have been published so far, highlighting the potential of radiomics to enhance clinical decision-making. However, the field faces several important challenges, which are mainly caused by the various technical factors influencing the extracted radiomic features.The aim of the present review is twofold: first, we present the typical workflow of a radiomics analysis and deliver a practical "how-to" guide for a typical radiomics analysis. Second, we discuss the current limitations of radiomics, suggest potential improvements, and summarize relevant literature on the subject.
Collapse
Affiliation(s)
- Janita E van Timmeren
- Department of Radiation Oncology, University Hospital Zurich, University of Zurich, Raemistrasse 100, 8091, Zurich, Switzerland
| | - Davide Cester
- Institute of Diagnostic and Interventional Radiology, University Hospital Zurich, University of Zurich, Raemistrasse 100, 8091, Zurich, Switzerland
| | - Stephanie Tanadini-Lang
- Department of Radiation Oncology, University Hospital Zurich, University of Zurich, Raemistrasse 100, 8091, Zurich, Switzerland
| | - Hatem Alkadhi
- Institute of Diagnostic and Interventional Radiology, University Hospital Zurich, University of Zurich, Raemistrasse 100, 8091, Zurich, Switzerland
| | - Bettina Baessler
- Institute of Diagnostic and Interventional Radiology, University Hospital Zurich, University of Zurich, Raemistrasse 100, 8091, Zurich, Switzerland.
| |
Collapse
|
184
|
Kim G, Kim J, Cha H, Park WY, Ahn JS, Ahn MJ, Park K, Park YJ, Choi JY, Lee KH, Lee SH, Moon SH. Metabolic radiogenomics in lung cancer: associations between FDG PET image features and oncogenic signaling pathway alterations. Sci Rep 2020; 10:13231. [PMID: 32764738 PMCID: PMC7411040 DOI: 10.1038/s41598-020-70168-x] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2020] [Accepted: 07/24/2020] [Indexed: 12/22/2022] Open
Abstract
This study investigated the associations between image features extracted from tumor 18F-fluorodeoxyglucose (FDG) uptake and genetic alterations in patients with lung cancer. A total of 137 patients (age, 62.7 ± 10.2 years) who underwent FDG positron emission tomography/computed tomography (PET/CT) and targeted deep sequencing analysis for a tumor lesion, comprising 61 adenocarcinoma (ADC), 31 squamous cell carcinoma (SQCC), and 45 small cell lung cancer (SCLC) patients, were enrolled in this study. From the tumor lesions, 86 image features were extracted, and 381 genes were assessed. PET features were associated with genetic mutations: 41 genes with 24 features in ADC; 35 genes with 22 features in SQCC; and 43 genes with 25 features in SCLC (FDR < 0.05). Clusters based on PET features showed an association with alterations in oncogenic signaling pathways: Cell cycle and WNT signaling pathways in ADC (p = 0.023, p = 0.035, respectively); Cell cycle, p53, and WNT in SQCC (p = 0.045, 0.009, and 0.029, respectively); and TGFβ in SCLC (p = 0.030). In addition, SUVpeak and SUVmax were associated with a mutation of the TGFβ signaling pathway in ADC (FDR = 0.001, < 0.001). In this study, PET image features had significant associations with alterations in genes and oncogenic signaling pathways in patients with lung cancer.
Collapse
Affiliation(s)
- Gahyun Kim
- Samsung Genome Institute, Samsung Medical Center, Seoul, Republic of Korea.,Department of Health Sciences and Technology, SAIHST, Sungkyunkwan University, Seoul, Republic of Korea
| | - Jinho Kim
- Samsung Genome Institute, Samsung Medical Center, Seoul, Republic of Korea
| | - Hongui Cha
- Samsung Genome Institute, Samsung Medical Center, Seoul, Republic of Korea.,Department of Health Sciences and Technology, SAIHST, Sungkyunkwan University, Seoul, Republic of Korea
| | - Woong-Yang Park
- Samsung Genome Institute, Samsung Medical Center, Samsung Advanced Institute of Health Science and Technology, Department of Molecular Cell Biology, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea
| | - Jin Seok Ahn
- Division of Hematology/Oncology, Department of Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea
| | - Myung-Ju Ahn
- Division of Hematology/Oncology, Department of Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea
| | - Keunchil Park
- Division of Hematology/Oncology, Department of Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea
| | - Yong-Jin Park
- Department of Nuclear Medicine and Molecular Imaging, Samsung Medical Center, Seoul, Republic of Korea
| | - Joon Young Choi
- Department of Nuclear Medicine and Molecular Imaging, Samsung Medical Center, Seoul, Republic of Korea
| | - Kyung-Han Lee
- Department of Nuclear Medicine and Molecular Imaging, Samsung Medical Center, Seoul, Republic of Korea
| | - Se-Hoon Lee
- Department of Health Sciences and Technology, SAIHST, Sungkyunkwan University, Seoul, Republic of Korea. .,Division of Hematology/Oncology, Department of Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea.
| | - Seung Hwan Moon
- Department of Nuclear Medicine and Molecular Imaging, Samsung Medical Center, Seoul, Republic of Korea.
| |
Collapse
|
185
|
Intratumor Heterogeneity Assessed by 18F-FDG PET/CT Predicts Treatment Response and Survival Outcomes in Patients with Hodgkin Lymphoma. Acad Radiol 2020; 27:e183-e192. [PMID: 31761665 DOI: 10.1016/j.acra.2019.10.015] [Citation(s) in RCA: 25] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2019] [Revised: 09/16/2019] [Accepted: 10/14/2019] [Indexed: 12/15/2022]
Abstract
RATIONALE AND OBJECTIVES Radiomic analysis of 18F-fluorodeoxyglucose positron emission tomography/computed tomography (18F-FDG PET/CT) images enables the extraction of quantitative information of intratumour heterogeneity. This study investigated whether the baseline 18F-FDG PET/CT radiomics can predict treatment response and survival outcomes in patients with Hodgkin lymphoma (HL). MATERIALS AND METHODS Thirty-five patients diagnosed with HL who underwent 18F-FDG PET/CT scans before and during chemotherapy were retrospectively enrolled in this investigation. For each patient, we extracted 709 radiomic features from pretreatment PET/CT images. Clinical variables (age, gender, B symptoms, bulky tumor, and disease stage) and radiomic signatures (intensity, texture, and wavelet) were analyzed according to response to therapy, progression-free survival (PFS), and overall survival (OS). Receiver operating characteristic curve, logistic regression, and Cox proportional hazards model were used to examine potential predictive and prognostic factors. RESULTS High-intensity run emphasis (HIR) of PET and run-length nonuniformity (RLNU) of CT extracted from gray-level run-length matrix (GLRM) in high-frequency wavelets were independent predictive factors for the treatment response (odds ratio [OR] = 36.4, p = 0.014; OR = 30.4, p = 0.020). Intensity nonuniformity (INU) of PET and wavelet short run emphasis (SRE) of CT from GLRM and Ann Arbor stage were independently related to PFS (hazard ratio [HR] = 9.29, p = 0.023; HR = 18.40, p = 0.012; HR = 7.46, p = 0.049). Zone-size nonuniformity (ZSNU) of PET from gray-level size zone matrix (GLSZM) was independently associated with OS (HR = 41.02, p = 0.001). Based on these factors, a prognostic stratification model was devised for the risk stratification of patients. The proposed model allowed the identification of four risk groups for PFS and OS (p < 0.001 and p < 0.001). CONCLUSION HIR_GLRMPET and RLNU_GLRMCT in high-frequency wavelets serve as independent predictive factors for treatment response. ZSNU_GLSZMPET, INU_GLRMPET, and wavelet SRE_GLRMCT serve as independent prognostic factors for survival outcomes. The present study proposes a prognostic stratification model that may be clinically beneficial in guiding risk-adapted treatment strategies for patients with HL.
Collapse
|
186
|
Shiri I, Hajianfar G, Sohrabi A, Abdollahi H, P Shayesteh S, Geramifar P, Zaidi H, Oveisi M, Rahmim A. Repeatability of radiomic features in magnetic resonance imaging of glioblastoma: Test-retest and image registration analyses. Med Phys 2020; 47:4265-4280. [PMID: 32615647 DOI: 10.1002/mp.14368] [Citation(s) in RCA: 38] [Impact Index Per Article: 7.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2019] [Revised: 06/17/2020] [Accepted: 06/18/2020] [Indexed: 02/06/2023] Open
Abstract
PURPOSE To assess the repeatability of radiomic features in magnetic resonance (MR) imaging of glioblastoma (GBM) tumors with respect to test-retest, different image registration approaches and inhomogeneity bias field correction. METHODS We analyzed MR images of 17 GBM patients including T1- and T2-weighted images (performed within the same imaging unit on two consecutive days). For image segmentation, we used a comprehensive segmentation approach including entire tumor, active area of tumor, necrotic regions in T1-weighted images, and edema regions in T2-weighted images (test studies only; registration to retest studies is discussed next). Analysis included N3, N4 as well as no bias correction performed on raw MR images. We evaluated 20 image registration approaches, generated by cross-combination of four transformation and five cost function methods. In total, 714 images (17 patients × 2 images × ((4 transformations × 5 cost functions) + 1 test image) and 2856 segmentations (714 images × 4 segmentations) were prepared for feature extraction. Various radiomic features were extracted, including the use of preprocessing filters, specifically wavelet (WAV) and Laplacian of Gaussian (LOG), as well as discretization into fixed bin width and fixed bin count (16, 32, 64, 128, and 256), Exponential, Gradient, Logarithm, Square and Square Root scales. Intraclass correlation coefficients (ICC) were calculated to assess the repeatability of MRI radiomic features (high repeatability defined as ICC ≥ 95%). RESULTS In our ICC results, we observed high repeatability (ICC ≥ 95%) with respect to image preprocessing, different image registration algorithms, and test-retest analysis, for example: RLNU and GLNU from GLRLM, GLNU and DNU from GLDM, Coarseness and Busyness from NGTDM, GLNU and ZP from GLSZM, and Energy and RMS from first order. Highest fraction (percent) of repeatable features was observed, among registration techniques, for the method Full Affine transformation with 12 degrees of freedom using Mutual Information cost function (mean 32.4%), and among image processing methods, for the method Laplacian of Gaussian (LOG) with Sigma (2.5-4.5 mm) (mean 78.9%). The trends were relatively consistent for N4, N3, or no bias correction. CONCLUSION Our results showed varying performances in repeatability of MR radiomic features for GBM tumors due to test-retest and image registration. The findings have implications for appropriate usage in diagnostic and predictive models.
Collapse
Affiliation(s)
- Isaac Shiri
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, Geneva 4, CH-1211, Switzerland
| | - Ghasem Hajianfar
- Rajaie Cardiovascular Medical and Research Center, Iran University of Medical Science, Tehran, Iran
| | - Ahmad Sohrabi
- Cancer Control Research Center, Cancer Control Foundation, Iran University of Medical Sciences, Tehran, Iran
| | - Hamid Abdollahi
- Department of Radiologic Sciences and Medical Physics, Faculty of Allied Medicine, Kerman University of Medical Science, Kerman, Iran
| | - Sajad P Shayesteh
- Department of Physiology, Pharmacology and Medical Physics, Faculty of Medicine, Alborz University of Medical Sciences, Karaj, Iran
| | - Parham Geramifar
- Research Center for Nuclear Medicine, Shariati Hospital, Tehran University of Medical Sciences, Tehran, Iran
| | - Habib Zaidi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, Geneva 4, CH-1211, Switzerland.,Geneva University Neurocenter, Geneva University, Geneva, Switzerland.,Department of Nuclear Medicine and Molecular Imaging, University of Groningen, University Medical Center Groningen, Groningen, Netherlands.,Department of Nuclear Medicine, University of Southern Denmark, Odense, Denmark
| | - Mehrdad Oveisi
- Rajaie Cardiovascular Medical and Research Center, Iran University of Medical Science, Tehran, Iran.,Department of Computer Science, University of British Columbia, Vancouver, BC, Canada
| | - Arman Rahmim
- Departments of Radiology and Physics, University of British Columbia, Vancouver, BC, Canada.,Department of Integrative Oncology, BC Cancer Research Centre, Vancouver, BC, Canada
| |
Collapse
|
187
|
Standardization of brain MR images across machines and protocols: bridging the gap for MRI-based radiomics. Sci Rep 2020; 10:12340. [PMID: 32704007 PMCID: PMC7378556 DOI: 10.1038/s41598-020-69298-z] [Citation(s) in RCA: 149] [Impact Index Per Article: 29.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2019] [Accepted: 07/06/2020] [Indexed: 02/06/2023] Open
Abstract
Radiomics relies on the extraction of a wide variety of quantitative image-based features to provide decision support. Magnetic resonance imaging (MRI) contributes to the personalization of patient care but suffers from being highly dependent on acquisition and reconstruction parameters. Today, there are no guidelines regarding the optimal pre-processing of MR images in the context of radiomics, which is crucial for the generalization of published image-based signatures. This study aims to assess the impact of three different intensity normalization methods (Nyul, WhiteStripe, Z-Score) typically used in MRI together with two methods for intensity discretization (fixed bin size and fixed bin number). The impact of these methods was evaluated on first- and second-order radiomics features extracted from brain MRI, establishing a unified methodology for future radiomics studies. Two independent MRI datasets were used. The first one (DATASET1) included 20 institutional patients with WHO grade II and III gliomas who underwent post-contrast 3D axial T1-weighted (T1w-gd) and axial T2-weighted fluid attenuation inversion recovery (T2w-flair) sequences on two different MR devices (1.5 T and 3.0 T) with a 1-month delay. Jensen–Shannon divergence was used to compare pairs of intensity histograms before and after normalization. The stability of first-order and second-order features across the two acquisitions was analysed using the concordance correlation coefficient and the intra-class correlation coefficient. The second dataset (DATASET2) was extracted from the public TCIA database and included 108 patients with WHO grade II and III gliomas and 135 patients with WHO grade IV glioblastomas. The impact of normalization and discretization methods was evaluated based on a tumour grade classification task (balanced accuracy measurement) using five well-established machine learning algorithms. Intensity normalization highly improved the robustness of first-order features and the performances of subsequent classification models. For the T1w-gd sequence, the mean balanced accuracy for tumour grade classification was increased from 0.67 (95% CI 0.61–0.73) to 0.82 (95% CI 0.79–0.84, P = .006), 0.79 (95% CI 0.76–0.82, P = .021) and 0.82 (95% CI 0.80–0.85, P = .005), respectively, using the Nyul, WhiteStripe and Z-Score normalization methods compared to no normalization. The relative discretization makes unnecessary the use of intensity normalization for the second-order radiomics features. Even if the bin number for the discretization had a small impact on classification performances, a good compromise was obtained using the 32 bins considering both T1w-gd and T2w-flair sequences. No significant improvements in classification performances were observed using feature selection. A standardized pre-processing pipeline is proposed for the use of radiomics in MRI of brain tumours. For models based on first- and second-order features, we recommend normalizing images with the Z-Score method and adopting an absolute discretization approach. For second-order feature-based signatures, relative discretization can be used without prior normalization. In both cases, 32 bins for discretization are recommended. This study may pave the way for the multicentric development and validation of MR-based radiomics biomarkers.
Collapse
|
188
|
Dercle L, Henry T, Carré A, Paragios N, Deutsch E, Robert C. Reinventing radiation therapy with machine learning and imaging bio-markers (radiomics): State-of-the-art, challenges and perspectives. Methods 2020; 188:44-60. [PMID: 32697964 DOI: 10.1016/j.ymeth.2020.07.003] [Citation(s) in RCA: 26] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2020] [Revised: 07/02/2020] [Accepted: 07/06/2020] [Indexed: 12/14/2022] Open
Abstract
Radiation therapy is a pivotal cancer treatment that has significantly progressed over the last decade due to numerous technological breakthroughs. Imaging is now playing a critical role on deployment of the clinical workflow, both for treatment planning and treatment delivery. Machine-learning analysis of predefined features extracted from medical images, i.e. radiomics, has emerged as a promising clinical tool for a wide range of clinical problems addressing drug development, clinical diagnosis, treatment selection and implementation as well as prognosis. Radiomics denotes a paradigm shift redefining medical images as a quantitative asset for data-driven precision medicine. The adoption of machine-learning in a clinical setting and in particular of radiomics features requires the selection of robust, representative and clinically interpretable biomarkers that are properly evaluated on a representative clinical data set. To be clinically relevant, radiomics must not only improve patients' management with great accuracy but also be reproducible and generalizable. Hence, this review explores the existing literature and exposes its potential technical caveats, such as the lack of quality control, standardization, sufficient sample size, type of data collection, and external validation. Based upon the analysis of 165 original research studies based on PET, CT-scan, and MRI, this review provides an overview of new concepts, and hypotheses generating findings that should be validated. In particular, it describes evolving research trends to enhance several clinical tasks such as prognostication, treatment planning, response assessment, prediction of recurrence/relapse, and prediction of toxicity. Perspectives regarding the implementation of an AI-based radiotherapy workflow are presented.
Collapse
Affiliation(s)
- Laurent Dercle
- Department of Radiology, New York Presbyterian Hospital, Columbia University Medical Center, New York, USA
| | - Theophraste Henry
- Molecular Radiotherapy and Innovative Therapeutics, INSERM UMR1030, Gustave Roussy Cancer Campus, Université Paris Saclay, Villejuif, France; Department of Nuclear Medicine and Endocrine Oncology, Gustave Roussy Cancer Campus, Villejuif, France
| | - Alexandre Carré
- Molecular Radiotherapy and Innovative Therapeutics, INSERM UMR1030, Gustave Roussy Cancer Campus, Université Paris Saclay, Villejuif, France; Department of Radiation Oncology, Gustave Roussy Cancer Campus, Villejuif, France
| | | | - Eric Deutsch
- Molecular Radiotherapy and Innovative Therapeutics, INSERM UMR1030, Gustave Roussy Cancer Campus, Université Paris Saclay, Villejuif, France; Department of Radiation Oncology, Gustave Roussy Cancer Campus, Villejuif, France
| | - Charlotte Robert
- Molecular Radiotherapy and Innovative Therapeutics, INSERM UMR1030, Gustave Roussy Cancer Campus, Université Paris Saclay, Villejuif, France; Department of Radiation Oncology, Gustave Roussy Cancer Campus, Villejuif, France.
| |
Collapse
|
189
|
Pavic M, Bogowicz M, Kraft J, Vuong D, Mayinger M, Kroeze SGC, Friess M, Frauenfelder T, Andratschke N, Huellner M, Weder W, Guckenberger M, Tanadini-Lang S, Opitz I. FDG PET versus CT radiomics to predict outcome in malignant pleural mesothelioma patients. EJNMMI Res 2020; 10:81. [PMID: 32661672 PMCID: PMC7359199 DOI: 10.1186/s13550-020-00669-3] [Citation(s) in RCA: 32] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2020] [Accepted: 07/02/2020] [Indexed: 12/21/2022] Open
Abstract
BACKGROUND Careful selection of malignant pleural mesothelioma (MPM) patients for curative treatment is of highest importance, as the multimodal treatment regimen is challenging for patients and harbors a high risk of substantial toxicity. Radiomics-a quantitative method for image analysis-has shown its prognostic ability in different tumor entities and could therefore play an important role in optimizing patient selection for radical cancer treatment. So far, radiomics as a prognostic tool in MPM was not investigated. MATERIALS AND METHODS This study is based on 72 MPM patients treated with surgery in a curative intent at our institution between 2009 and 2017. Pre-treatment Fluorine-18 fluorodeoxyglucose (FDG) PET and CT scans were used for radiomics outcome modeling. After extraction of 1404 CT and 1410 FDG PET features from each image, a preselection by principal component analysis was performed to include only robust, non-redundant features for the cox regression to predict the progression-free survival (PFS) and the overall survival (OS). Results were validated on a separate cohort. Additionally, SUVmax and SUVmean, and volume were tested for their prognostic ability for PFS and OS. RESULTS For the PFS a concordance index (c-index) of 0.67 (95% CI 0.52-0.82) and 0.66 (95% CI 0.57-0.78) for the training cohort (n = 36) and internal validation cohort (n = 36), respectively, were obtained for the PET radiomics model. The PFS advantage of the low-risk group translated also into an OS advantage. On CT images, no radiomics model could be trained. SUV max and SUV mean were also not prognostic in terms of PFS and OS. CONCLUSION We were able to build a successful FDG PET radiomics model for the prediction of PFS in MPM. Radiomics could serve as a tool to aid clinical decision support systems for treatment of MPM in future.
Collapse
Affiliation(s)
- M Pavic
- Department of Radiation Oncology, University Hospital Zurich and University Zurich, Rämistrasse 100, 8091, Zurich, Switzerland.
| | - M Bogowicz
- Department of Radiation Oncology, University Hospital Zurich and University Zurich, Rämistrasse 100, 8091, Zurich, Switzerland
| | - J Kraft
- Department of Radiation Oncology, University Hospital Zurich and University Zurich, Rämistrasse 100, 8091, Zurich, Switzerland
| | - D Vuong
- Department of Radiation Oncology, University Hospital Zurich and University Zurich, Rämistrasse 100, 8091, Zurich, Switzerland
| | - M Mayinger
- Department of Radiation Oncology, University Hospital Zurich and University Zurich, Rämistrasse 100, 8091, Zurich, Switzerland
| | - S G C Kroeze
- Department of Radiation Oncology, University Hospital Zurich and University Zurich, Rämistrasse 100, 8091, Zurich, Switzerland
| | - M Friess
- Department of Thoracic Surgery, University Hospital Zurich and University Zurich, Rämistrasse 100, 8091, Zurich, Switzerland
| | - T Frauenfelder
- Institute of Diagnostic and Interventional Radiology, University Hospital Zurich and University Zurich, Rämistrasse 100, 8091, Zurich, Switzerland
| | - N Andratschke
- Department of Radiation Oncology, University Hospital Zurich and University Zurich, Rämistrasse 100, 8091, Zurich, Switzerland
| | - M Huellner
- Department of Nuclear Medicine, University Hospital Zurich and University Zurich, Rämistrasse 100, 8091, Zurich, Switzerland
| | - W Weder
- Department of Thoracic Surgery, University Hospital Zurich and University Zurich, Rämistrasse 100, 8091, Zurich, Switzerland
| | - M Guckenberger
- Department of Radiation Oncology, University Hospital Zurich and University Zurich, Rämistrasse 100, 8091, Zurich, Switzerland
| | - S Tanadini-Lang
- Department of Radiation Oncology, University Hospital Zurich and University Zurich, Rämistrasse 100, 8091, Zurich, Switzerland
| | - I Opitz
- Department of Thoracic Surgery, University Hospital Zurich and University Zurich, Rämistrasse 100, 8091, Zurich, Switzerland
| |
Collapse
|
190
|
Vuong D, Bogowicz M, Denzler S, Oliveira C, Foerster R, Amstutz F, Gabryś HS, Unkelbach J, Hillinger S, Thierstein S, Xyrafas A, Peters S, Pless M, Guckenberger M, Tanadini‐Lang S. Comparison of robust to standardized CT radiomics models to predict overall survival for non‐small cell lung cancer patients. Med Phys 2020; 47:4045-4053. [DOI: 10.1002/mp.14224] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2019] [Revised: 02/28/2020] [Accepted: 04/24/2020] [Indexed: 12/22/2022] Open
Affiliation(s)
- Diem Vuong
- Department of Radiation Oncology University Hospital Zurich and University of Zurich Zurich Switzerland
| | - Marta Bogowicz
- Department of Radiation Oncology University Hospital Zurich and University of Zurich Zurich Switzerland
| | - Sarah Denzler
- Department of Radiation Oncology University Hospital Zurich and University of Zurich Zurich Switzerland
| | - Carol Oliveira
- Department of Radiation Oncology University Hospital Zurich and University of Zurich Zurich Switzerland
- Department of Oncology Cancer Center of Southeastern Ontario Queen’s University Kingston Ontario Canada
| | - Robert Foerster
- Department of Radiation Oncology University Hospital Zurich and University of Zurich Zurich Switzerland
| | - Florian Amstutz
- Department of Radiation Oncology University Hospital Zurich and University of Zurich Zurich Switzerland
| | - Hubert S. Gabryś
- Department of Radiation Oncology University Hospital Zurich and University of Zurich Zurich Switzerland
| | - Jan Unkelbach
- Department of Radiation Oncology University Hospital Zurich and University of Zurich Zurich Switzerland
| | - Sven Hillinger
- Department of Thoracic Surgery University Hospital Zurich and University of Zurich Zurich Switzerland
| | - Sandra Thierstein
- Swiss Group for Clinical Cancer Research (SAKK) Coordinating Center Bern Switzerland
| | - Alexandros Xyrafas
- Swiss Group for Clinical Cancer Research (SAKK) Coordinating Center Bern Switzerland
| | - Solange Peters
- Department of Oncology Centre Hospitalier Universitaire Vaudois (CHUV) Lausanne Switzerland
| | - Miklos Pless
- Department of Medical Oncology Kantonsspital Winterthur Winterthur Switzerland
| | - Matthias Guckenberger
- Department of Radiation Oncology University Hospital Zurich and University of Zurich Zurich Switzerland
| | - Stephanie Tanadini‐Lang
- Department of Radiation Oncology University Hospital Zurich and University of Zurich Zurich Switzerland
| |
Collapse
|
191
|
Beer JC, Tustison NJ, Cook PA, Davatzikos C, Sheline YI, Shinohara RT, Linn KA. Longitudinal ComBat: A method for harmonizing longitudinal multi-scanner imaging data. Neuroimage 2020; 220:117129. [PMID: 32640273 PMCID: PMC7605103 DOI: 10.1016/j.neuroimage.2020.117129] [Citation(s) in RCA: 142] [Impact Index Per Article: 28.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2020] [Revised: 06/24/2020] [Accepted: 06/29/2020] [Indexed: 12/19/2022] Open
Abstract
While aggregation of neuroimaging datasets from multiple sites and scanners can yield increased statistical power, it also presents challenges due to systematic scanner effects. This unwanted technical variability can introduce noise and bias into estimation of biological variability of interest. We propose a method for harmonizing longitudinal multi-scanner imaging data based on ComBat, a method originally developed for genomics and later adapted to cross-sectional neuroimaging data. Using longitudinal cortical thickness measurements from 663 participants in the Alzheimer's Disease Neuroimaging Initiative (ADNI) study, we demonstrate the presence of additive and multiplicative scanner effects in various brain regions. We compare estimates of the association between diagnosis and change in cortical thickness over time using three versions of the ADNI data: unharmonized data, data harmonized using cross-sectional ComBat, and data harmonized using longitudinal ComBat. In simulation studies, we show that longitudinal ComBat is more powerful for detecting longitudinal change than cross-sectional ComBat and controls the type I error rate better than unharmonized data with scanner included as a covariate. The proposed method would be useful for other types of longitudinal data requiring harmonization, such as genomic data, or neuroimaging studies of neurodevelopment, psychiatric disorders, or other neurological diseases.
Collapse
Affiliation(s)
- Joanne C Beer
- Penn Statistics in Imaging and Visualization Endeavor (PennSIVE) Center, Department of Biostatistics, Epidemiology, and Informatics, Perelman School of Medicine, University of Pennsylvania, United States.
| | - Nicholas J Tustison
- Department of Radiology and Medical Imaging, University of Virginia, United States
| | - Philip A Cook
- Center for Neuromodulation in Depression and Stress, Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, United States; Department of Radiology, Perelman School of Medicine, University of Pennsylvania, United States
| | - Christos Davatzikos
- Center for Biomedical Computing and Analytics, Department of Radiology, Perelman School of Medicine, University of Pennsylvania, United States
| | - Yvette I Sheline
- Center for Neuromodulation in Depression and Stress, Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, United States; Department of Radiology, Perelman School of Medicine, University of Pennsylvania, United States; Department of Neurology, Perelman School of Medicine, University of Pennsylvania, United States
| | - Russell T Shinohara
- Penn Statistics in Imaging and Visualization Endeavor (PennSIVE) Center, Department of Biostatistics, Epidemiology, and Informatics, Perelman School of Medicine, University of Pennsylvania, United States; Department of Radiology, Perelman School of Medicine, University of Pennsylvania, United States
| | - Kristin A Linn
- Penn Statistics in Imaging and Visualization Endeavor (PennSIVE) Center, Department of Biostatistics, Epidemiology, and Informatics, Perelman School of Medicine, University of Pennsylvania, United States.
| | | |
Collapse
|
192
|
Mayerhoefer ME, Umutlu L, Schöder H. Functional imaging using radiomic features in assessment of lymphoma. Methods 2020; 188:105-111. [PMID: 32634555 DOI: 10.1016/j.ymeth.2020.06.020] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2020] [Revised: 06/25/2020] [Accepted: 06/26/2020] [Indexed: 02/07/2023] Open
Abstract
Lymphomas are typically large, well-defined, and relatively homogeneous tumors, and therefore represent ideal targets for the use of radiomics. Of the available functional imaging tests, [18F]FDG-PET for body lymphoma and diffusion-weighted MRI (DWI) for central nervous system (CNS) lymphoma are of particular interest. The current literature suggests that two main applications for radiomics in lymphoma show promise: differentiation of lymphomas from other tumors, and lymphoma treatment response and outcome prognostication. In particular, encouraging results reported in the limited number of presently available studies that utilize functional imaging suggest that (1) MRI-based radiomics enables differentiation of CNS lymphoma from glioblastoma, and (2) baseline [18F]FDG-PET radiomics could be useful for survival prognostication, adding to or even replacing commonly used metrics such as standardized uptake values and metabolic tumor volume. However, due to differences in biological and clinical characteristics of different lymphoma subtypes and an increasing number of treatment options, more data are required to support these findings. Furthermore, a consensus on several critical steps in the radiomics workflow -most importantly, image reconstruction and post processing, lesion segmentation, and choice of classification algorithm- is desirable to ensure comparability of results between research institutions.
Collapse
Affiliation(s)
- Marius E Mayerhoefer
- Department of Radiology, Memorial Sloan Kettering Cancer Center, NY, USA; Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Austria.
| | - Lale Umutlu
- Department of Diagnostic and Interventional Radiology and Neuroradiology, University Hospital Essen, Germany
| | - Heiko Schöder
- Department of Radiology, Memorial Sloan Kettering Cancer Center, NY, USA
| |
Collapse
|
193
|
Da-Ano R, Masson I, Lucia F, Doré M, Robin P, Alfieri J, Rousseau C, Mervoyer A, Reinhold C, Castelli J, De Crevoisier R, Rameé JF, Pradier O, Schick U, Visvikis D, Hatt M. Performance comparison of modified ComBat for harmonization of radiomic features for multicenter studies. Sci Rep 2020; 10:10248. [PMID: 32581221 PMCID: PMC7314795 DOI: 10.1038/s41598-020-66110-w] [Citation(s) in RCA: 127] [Impact Index Per Article: 25.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2020] [Accepted: 05/04/2020] [Indexed: 11/08/2022] Open
Abstract
Multicenter studies are needed to demonstrate the clinical potential value of radiomics as a prognostic tool. However, variability in scanner models, acquisition protocols and reconstruction settings are unavoidable and radiomic features are notoriously sensitive to these factors, which hinders pooling them in a statistical analysis. A statistical harmonization method called ComBat was developed to deal with the "batch effect" in gene expression microarray data and was used in radiomics studies to deal with the "center-effect". Our goal was to evaluate modifications in ComBat allowing for more flexibility in choosing a reference and improving robustness of the estimation. Two modified ComBat versions were evaluated: M-ComBat allows to transform all features distributions to a chosen reference, instead of the overall mean, providing more flexibility. B-ComBat adds bootstrap and Monte Carlo for improved robustness in the estimation. BM-ComBat combines both modifications. The four versions were compared regarding their ability to harmonize features in a multicenter context in two different clinical datasets. The first contains 119 locally advanced cervical cancer patients from 3 centers, with magnetic resonance imaging and positron emission tomography imaging. In that case ComBat was applied with 3 labels corresponding to each center. The second one contains 98 locally advanced laryngeal cancer patients from 5 centers with contrast-enhanced computed tomography. In that specific case, because imaging settings were highly heterogeneous even within each of the five centers, unsupervised clustering was used to determine two labels for applying ComBat. The impact of each harmonization was evaluated through three different machine learning pipelines for the modelling step in predicting the clinical outcomes, across two performance metrics (balanced accuracy and Matthews correlation coefficient). Before harmonization, almost all radiomic features had significantly different distributions between labels. These differences were successfully removed with all ComBat versions. The predictive ability of the radiomic models was always improved with harmonization and the improved ComBat provided the best results. This was observed consistently in both datasets, through all machine learning pipelines and performance metrics. The proposed modifications allow for more flexibility and robustness in the estimation. They also slightly but consistently improve the predictive power of resulting radiomic models.
Collapse
Affiliation(s)
- R Da-Ano
- INSERM, UMR 1101, LaTIM, University of Brest, Brest, France.
| | - I Masson
- INSERM, UMR 1101, LaTIM, University of Brest, Brest, France
- Department of Radiation Oncology, Institut de cancérologie de l'Ouest René-Gauducheau, Saint-Herblain, France
| | - F Lucia
- INSERM, UMR 1101, LaTIM, University of Brest, Brest, France
- Radiation Oncology Department, University Hospital, Brest, France
| | - M Doré
- Department of Radiation Oncology, Institut de cancérologie de l'Ouest René-Gauducheau, Saint-Herblain, France
| | - P Robin
- Department of Nuclear Medicine, University of Brest, Brest, France
| | - J Alfieri
- Department of Radiation Oncology, McGill University Health Centre, Montreal, Quebec, Canada
| | - C Rousseau
- Department of Nuclear Medicine, Institut de cancerologie de l'Ouest René-Gauducheau, Saint-Herblain, France
- CRCINA, University of Nantes, INSERM UMR1232, CNRS-ERL6001, Nantes, France
| | - A Mervoyer
- Department of Radiation Oncology, Institut de cancérologie de l'Ouest René-Gauducheau, Saint-Herblain, France
| | - C Reinhold
- Department of Radiology, McGill University Health Centre, Montreal, Canada
| | - J Castelli
- Radiotherapy Department Cancer, Institute Eugene Marquis, Rennes, France
- University of Rennes 1, LTSI, Rennes, France
| | - R De Crevoisier
- Radiotherapy Department Cancer, Institute Eugene Marquis, Rennes, France
- University of Rennes 1, LTSI, Rennes, France
| | - J F Rameé
- Department of Medical Oncology, Centre Hospitalier de Vendee, La Roche sur Yon, France
| | - O Pradier
- INSERM, UMR 1101, LaTIM, University of Brest, Brest, France
- Radiation Oncology Department, University Hospital, Brest, France
| | - U Schick
- INSERM, UMR 1101, LaTIM, University of Brest, Brest, France
- Radiation Oncology Department, University Hospital, Brest, France
| | - D Visvikis
- INSERM, UMR 1101, LaTIM, University of Brest, Brest, France
| | - M Hatt
- INSERM, UMR 1101, LaTIM, University of Brest, Brest, France
| |
Collapse
|
194
|
Garau N, Paganelli C, Summers P, Choi W, Alam S, Lu W, Fanciullo C, Bellomi M, Baroni G, Rampinelli C. External validation of radiomics-based predictive models in low-dose CT screening for early lung cancer diagnosis. Med Phys 2020; 47:4125-4136. [PMID: 32488865 DOI: 10.1002/mp.14308] [Citation(s) in RCA: 28] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2019] [Revised: 05/04/2020] [Accepted: 05/23/2020] [Indexed: 12/14/2022] Open
Abstract
PURPOSE Low-dose CT screening allows early lung cancer detection, but is affected by frequent false positive results, inter/intra observer variation and uncertain diagnoses of lung nodules. Radiomics-based models have recently been introduced to overcome these issues, but limitations in demonstrating their generalizability on independent datasets are slowing their introduction to clinic. The aim of this study is to evaluate two radiomics-based models to classify malignant pulmonary nodules in low-dose CT screening, and to externally validate them on an independent cohort. The effect of a radiomics features harmonization technique is also investigated to evaluate its impact on the classification of lung nodules from a multicenter data. METHODS Pulmonary nodules from two independent cohorts were considered in this study; the first cohort (110 subjects, 113 nodules) was used to train prediction models, and the second cohort (72 nodules) to externally validate them. Literature-based radiomics features were extracted and, after feature selection, used as predictive variables in models for malignancy identification. An in-house prediction model based on artificial neural network (ANN) was implemented and evaluated, along with an alternative model from the literature, based on a support vector machine (SVM) classifier coupled with a least absolute shrinkage and selection operator (LASSO). External validation was performed on the second cohort to evaluate models' generalization ability. Additionally, the impact of the Combat harmonization method was investigated to compensate for multicenter datasets variabilities. A new training of the models based on harmonized features was performed on the first cohort, then tested separately on the harmonized and non-harmonized features of the second cohort. RESULTS Preliminary results showed a good accuracy of the investigated models in distinguishing benign from malignant pulmonary nodules with both sets of radiomics features (i.e., non-harmonized and harmonized). The performance of the models, quantified in terms of Area Under the Curve (AUC), was > 0.89 in the training set and > 0.82 in the external validation set for all the investigated scenarios, outperforming the clinical standard (AUC of 0.76). Slightly higher performance was observed for the SVM-LASSO model than the ANN in the external dataset, although they did not result significantly different. For both harmonized and non-harmonized features, no statistical difference was found between Receiver operating characteristic (ROC) curves related to training and test set for both models. CONCLUSIONS Although no significant improvements were observed when applying the Combat harmonization method, both in-house and literature-based models were able to classify lung nodules with good generalization to an independent dataset, thus showing their potential as tools for clinical decision-making in lung cancer screening.
Collapse
Affiliation(s)
- Noemi Garau
- Dipartimento di Elettronica, Informazione e Bioingegneria, Politecnico di Milano, Milano, Italy.,Division of Radiology, IEO, European Institute of Oncology IRCCS, Milan, Italy
| | - Chiara Paganelli
- Dipartimento di Elettronica, Informazione e Bioingegneria, Politecnico di Milano, Milano, Italy
| | - Paul Summers
- Division of Radiology, IEO, European Institute of Oncology IRCCS, Milan, Italy
| | - Wookjin Choi
- Department of Engineering and Computer Science, Virginia State University, Petersburg, VA, USA
| | - Sadegh Alam
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Wei Lu
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Cristiana Fanciullo
- Postgraduate School of Diagnostic and Interventional Radiology, University of Milan, Milan, Italy
| | - Massimo Bellomi
- Division of Radiology, IEO, European Institute of Oncology IRCCS, Milan, Italy.,Department of Oncology and Hemato-oncology, University of Milan, Milan, Italy
| | - Guido Baroni
- Dipartimento di Elettronica, Informazione e Bioingegneria, Politecnico di Milano, Milano, Italy.,Bioengineering Unit, CNAO Foundation, Pavia, Italy
| | | |
Collapse
|
195
|
Ibrahim A, Primakov S, Beuque M, Woodruff HC, Halilaj I, Wu G, Refaee T, Granzier R, Widaatalla Y, Hustinx R, Mottaghy FM, Lambin P. Radiomics for precision medicine: Current challenges, future prospects, and the proposal of a new framework. Methods 2020; 188:20-29. [PMID: 32504782 DOI: 10.1016/j.ymeth.2020.05.022] [Citation(s) in RCA: 139] [Impact Index Per Article: 27.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2020] [Revised: 05/20/2020] [Accepted: 05/26/2020] [Indexed: 12/13/2022] Open
Abstract
The advancement of artificial intelligence concurrent with the development of medical imaging techniques provided a unique opportunity to turn medical imaging from mostly qualitative, to further quantitative and mineable data that can be explored for the development of clinical decision support systems (cDSS). Radiomics, a method for the high throughput extraction of hand-crafted features from medical images, and deep learning -the data driven modeling techniques based on the principles of simplified brain neuron interactions, are the most researched quantitative imaging techniques. Many studies reported on the potential of such techniques in the context of cDSS. Such techniques could be highly appealing due to the reuse of existing data, automation of clinical workflows, minimal invasiveness, three-dimensional volumetric characterization, and the promise of high accuracy and reproducibility of results and cost-effectiveness. Nevertheless, there are several challenges that quantitative imaging techniques face, and need to be addressed before the translation to clinical use. These challenges include, but are not limited to, the explainability of the models, the reproducibility of the quantitative imaging features, and their sensitivity to variations in image acquisition and reconstruction parameters. In this narrative review, we report on the status of quantitative medical image analysis using radiomics and deep learning, the challenges the field is facing, propose a framework for robust radiomics analysis, and discuss future prospects.
Collapse
Affiliation(s)
- A Ibrahim
- The D-Lab, Department of Precision Medicine, GROW - School for Oncology and Developmental Biology, Maastricht University, Maastricht, The Netherlands; Department of Radiology and Nuclear Medicine, GROW - School for Oncology and Developmental Biology, Maastricht University Medical Centre+, Maastricht, The Netherlands; Division of Nuclear Medicine and Oncological Imaging, Department of Medical Physics, Hospital Center Universitaire De Liege, Liege, Belgium; Department of Nuclear Medicine and Comprehensive Diagnostic Center Aachen (CDCA), University Hospital RWTH Aachen University, Aachen, Germany.
| | - S Primakov
- The D-Lab, Department of Precision Medicine, GROW - School for Oncology and Developmental Biology, Maastricht University, Maastricht, The Netherlands; Department of Nuclear Medicine and Comprehensive Diagnostic Center Aachen (CDCA), University Hospital RWTH Aachen University, Aachen, Germany
| | - M Beuque
- The D-Lab, Department of Precision Medicine, GROW - School for Oncology and Developmental Biology, Maastricht University, Maastricht, The Netherlands
| | - H C Woodruff
- The D-Lab, Department of Precision Medicine, GROW - School for Oncology and Developmental Biology, Maastricht University, Maastricht, The Netherlands; Department of Radiology and Nuclear Medicine, GROW - School for Oncology and Developmental Biology, Maastricht University Medical Centre+, Maastricht, The Netherlands
| | - I Halilaj
- The D-Lab, Department of Precision Medicine, GROW - School for Oncology and Developmental Biology, Maastricht University, Maastricht, The Netherlands
| | - G Wu
- The D-Lab, Department of Precision Medicine, GROW - School for Oncology and Developmental Biology, Maastricht University, Maastricht, The Netherlands
| | - T Refaee
- The D-Lab, Department of Precision Medicine, GROW - School for Oncology and Developmental Biology, Maastricht University, Maastricht, The Netherlands; Department of Diagnostic Radiology, Faculty of Applied Medical Sciences, Jazan University, Jazan, Saudi Arabia
| | - R Granzier
- Department of Radiology and Nuclear Medicine, GROW - School for Oncology and Developmental Biology, Maastricht University Medical Centre+, Maastricht, The Netherlands; Department of Surgery, GROW School for Oncology and Developmental Biology, Maastricht University Medical Center, Maastricht, The Netherlands
| | - Y Widaatalla
- The D-Lab, Department of Precision Medicine, GROW - School for Oncology and Developmental Biology, Maastricht University, Maastricht, The Netherlands
| | - R Hustinx
- Division of Nuclear Medicine and Oncological Imaging, Department of Medical Physics, Hospital Center Universitaire De Liege, Liege, Belgium
| | - F M Mottaghy
- Department of Radiology and Nuclear Medicine, GROW - School for Oncology and Developmental Biology, Maastricht University Medical Centre+, Maastricht, The Netherlands; Department of Nuclear Medicine and Comprehensive Diagnostic Center Aachen (CDCA), University Hospital RWTH Aachen University, Aachen, Germany
| | - P Lambin
- The D-Lab, Department of Precision Medicine, GROW - School for Oncology and Developmental Biology, Maastricht University, Maastricht, The Netherlands; Department of Radiology and Nuclear Medicine, GROW - School for Oncology and Developmental Biology, Maastricht University Medical Centre+, Maastricht, The Netherlands
| |
Collapse
|
196
|
Sollini M, Kirienko M, Cavinato L, Ricci F, Biroli M, Ieva F, Calderoni L, Tabacchi E, Nanni C, Zinzani PL, Fanti S, Guidetti A, Alessi A, Corradini P, Seregni E, Carlo-Stella C, Chiti A. Methodological framework for radiomics applications in Hodgkin's lymphoma. Eur J Hybrid Imaging 2020; 4:9. [PMID: 34191173 PMCID: PMC8218114 DOI: 10.1186/s41824-020-00078-8] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2020] [Accepted: 05/06/2020] [Indexed: 12/22/2022] Open
Abstract
BACKGROUND According to published data, radiomics features differ between lesions of refractory/relapsing HL patients from those of long-term responders. However, several methodological aspects have not been elucidated yet. PURPOSE The study aimed at setting up a methodological framework in radiomics applications in Hodgkin's lymphoma (HL), especially at (a) developing a novel feature selection approach, (b) evaluating radiomic intra-patient lesions' similarity, and (c) classifying relapsing refractory (R/R) vs non-(R/R) patients. METHODS We retrospectively included 85 patients (male:female = 52:33; median age 35 years, range 19-74). LIFEx (www.lifexsoft.org) was used for [18F]FDG-PET/CT segmentation and feature extraction. Features were a-priori selected if they were highly correlated or uncorrelated to the volume. Principal component analysis-transformed features were used to build the fingerprints that were tested to assess lesions' similarity, using the silhouette. For intra-patient similarity analysis, we used patients having multiple lesions only. To classify patients as non-R/R and R/R, the fingerprint considering one single lesion (fingerprint_One) and all lesions (fingerprint_All) was tested using Random Undersampling Boosting of Tree Ensemble (RUBTE). RESULTS HL fingerprints included up to 15 features. Intra-patient lesion similarity analysis resulted in mean/median silhouette values below 0.5 (low similarity especially in the non-R/R group). In the test set, the fingerprint_One classification accuracy was 62% (78% sensitivity and 53% specificity); the classification by RUBTE using fingerprint_All resulted in 82% accuracy (70% sensitivity and 88% specificity). CONCLUSIONS Lesion similarity analysis was developed, and it allowed to demonstrate that HL lesions were not homogeneous within patients in terms of radiomics signature. Therefore, a random target lesion selection should not be adopted for radiomics applications. Moreover, the classifier to predict R/R vs non-R/R performed the best when all the lesions were used.
Collapse
Affiliation(s)
- Martina Sollini
- Humanitas University, Via Rita Levi Montalcini 4, MI 20090 Pieve Emanuele, Italy
- Humanitas Clinical and Research Center – IRCCS -, via Manzoni 56, 20089 Rozzano, MI Italy
| | - Margarita Kirienko
- Humanitas University, Via Rita Levi Montalcini 4, MI 20090 Pieve Emanuele, Italy
| | - Lara Cavinato
- Humanitas Clinical and Research Center – IRCCS -, via Manzoni 56, 20089 Rozzano, MI Italy
- MOX–Modelling and Scientific Computing lab., Department of Mathematics, Politecnico di Milano, Milano, Italy
| | - Francesca Ricci
- Humanitas Clinical and Research Center – IRCCS -, via Manzoni 56, 20089 Rozzano, MI Italy
| | - Matteo Biroli
- Humanitas University, Via Rita Levi Montalcini 4, MI 20090 Pieve Emanuele, Italy
| | - Francesca Ieva
- MOX–Modelling and Scientific Computing lab., Department of Mathematics, Politecnico di Milano, Milano, Italy
- CADS–Center for Analysis, Decision, and Society, Human Technopole, Milano, Italy
| | | | | | | | - Pier Luigi Zinzani
- Institute of Hematology “Seràgnoli”, University of Bologna, Bologna, Italy
| | - Stefano Fanti
- Nuclear Medicine, AOU S.Orsola-Malpighi, Bologna, Italy
| | - Anna Guidetti
- Fondazione IRCCS Istituto Nazionale dei Tumori, Milan, Italy
- University of Milan, Milan, Italy
| | | | - Paolo Corradini
- Fondazione IRCCS Istituto Nazionale dei Tumori, Milan, Italy
- University of Milan, Milan, Italy
| | - Ettore Seregni
- Fondazione IRCCS Istituto Nazionale dei Tumori, Milan, Italy
| | - Carmelo Carlo-Stella
- Humanitas University, Via Rita Levi Montalcini 4, MI 20090 Pieve Emanuele, Italy
- Humanitas Clinical and Research Center – IRCCS -, via Manzoni 56, 20089 Rozzano, MI Italy
| | - Arturo Chiti
- Humanitas University, Via Rita Levi Montalcini 4, MI 20090 Pieve Emanuele, Italy
- Humanitas Clinical and Research Center – IRCCS -, via Manzoni 56, 20089 Rozzano, MI Italy
| |
Collapse
|
197
|
Marcadent S, Hofmeister J, Preti MG, Martin SP, Van De Ville D, Montet X. Generative Adversarial Networks Improve the Reproducibility and Discriminative Power of Radiomic Features. Radiol Artif Intell 2020; 2:e190035. [PMID: 33937823 DOI: 10.1148/ryai.2020190035] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2019] [Revised: 02/19/2020] [Accepted: 03/04/2020] [Indexed: 12/22/2022]
Abstract
Purpose To assess the contribution of a generative adversarial network (GAN) to improve intermanufacturer reproducibility of radiomic features (RFs). Materials and Methods The authors retrospectively developed a cycle-GAN to translate texture information from chest radiographs acquired using one manufacturer (Siemens) to chest radiographs acquired using another (Philips), producing fake chest radiographs with different textures. The authors prospectively evaluated the ability of this texture-translation cycle-GAN to reduce the intermanufacturer variability of RFs extracted from the lung parenchyma. This study assessed the cycle-GAN's ability to fool several machine learning (ML) classifiers tasked with recognizing the manufacturer on the basis of chest radiography inputs. The authors also evaluated the cycle-GAN's ability to mislead radiologists who were asked to perform the same recognition task. Finally, the authors tested whether the cycle-GAN had an impact on radiomic diagnostic accuracy for chest radiography in patients with congestive heart failure (CHF). Results RFs, extracted from chest radiographs after the cycle-GAN's texture translation (fake chest radiographs), showed decreased intermanufacturer RF variability. Using cycle-GAN-generated chest radiographs as inputs, ML classifiers categorized the fake chest radiographs as belonging to the target manufacturer rather than to a native one. Moreover, cycle-GAN fooled two experienced radiologists who identified fake chest radiographs as belonging to a target manufacturer class. Finally, reducing intermanufacturer RF variability with cycle-GAN improved the discriminative power of RFs for patients without CHF versus patients with CHF (from 55% to 73.5%, P < .001). Conclusion Both ML classifiers and radiologists had difficulty recognizing the chest radiographs' manufacturer. The cycle-GAN improved RF intermanufacturer reproducibility and discriminative power for identifying patients with CHF. This deep learning approach may help counteract the sensitivity of RFs to differences in acquisition.Supplemental material is available for this article.© RSNA, 2020See also the commentary by Alderson in this issue.
Collapse
Affiliation(s)
- Sandra Marcadent
- Service of Radiology, Department of Diagnostics, Geneva University Hospital, Rue Gabrielle Perret-Gentil 4, 1211 Geneva 14, Switzerland (S.M., J.H., S.P.M., X.M.); Department of Radiology and Medical Informatics, University of Geneva, Geneva, Switzerland (S.M., J.H., M.G.P., S.P.M., D.V.D.V., X.M.); and Institute of Bioengineering/Center for Neuroprosthetics, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland (S.M., M.G.P., D.V.D.V.)
| | - Jeremy Hofmeister
- Service of Radiology, Department of Diagnostics, Geneva University Hospital, Rue Gabrielle Perret-Gentil 4, 1211 Geneva 14, Switzerland (S.M., J.H., S.P.M., X.M.); Department of Radiology and Medical Informatics, University of Geneva, Geneva, Switzerland (S.M., J.H., M.G.P., S.P.M., D.V.D.V., X.M.); and Institute of Bioengineering/Center for Neuroprosthetics, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland (S.M., M.G.P., D.V.D.V.)
| | - Maria Giulia Preti
- Service of Radiology, Department of Diagnostics, Geneva University Hospital, Rue Gabrielle Perret-Gentil 4, 1211 Geneva 14, Switzerland (S.M., J.H., S.P.M., X.M.); Department of Radiology and Medical Informatics, University of Geneva, Geneva, Switzerland (S.M., J.H., M.G.P., S.P.M., D.V.D.V., X.M.); and Institute of Bioengineering/Center for Neuroprosthetics, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland (S.M., M.G.P., D.V.D.V.)
| | - Steve P Martin
- Service of Radiology, Department of Diagnostics, Geneva University Hospital, Rue Gabrielle Perret-Gentil 4, 1211 Geneva 14, Switzerland (S.M., J.H., S.P.M., X.M.); Department of Radiology and Medical Informatics, University of Geneva, Geneva, Switzerland (S.M., J.H., M.G.P., S.P.M., D.V.D.V., X.M.); and Institute of Bioengineering/Center for Neuroprosthetics, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland (S.M., M.G.P., D.V.D.V.)
| | - Dimitri Van De Ville
- Service of Radiology, Department of Diagnostics, Geneva University Hospital, Rue Gabrielle Perret-Gentil 4, 1211 Geneva 14, Switzerland (S.M., J.H., S.P.M., X.M.); Department of Radiology and Medical Informatics, University of Geneva, Geneva, Switzerland (S.M., J.H., M.G.P., S.P.M., D.V.D.V., X.M.); and Institute of Bioengineering/Center for Neuroprosthetics, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland (S.M., M.G.P., D.V.D.V.)
| | - Xavier Montet
- Service of Radiology, Department of Diagnostics, Geneva University Hospital, Rue Gabrielle Perret-Gentil 4, 1211 Geneva 14, Switzerland (S.M., J.H., S.P.M., X.M.); Department of Radiology and Medical Informatics, University of Geneva, Geneva, Switzerland (S.M., J.H., M.G.P., S.P.M., D.V.D.V., X.M.); and Institute of Bioengineering/Center for Neuroprosthetics, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland (S.M., M.G.P., D.V.D.V.)
| |
Collapse
|
198
|
Mayerhoefer ME, Staudenherz A, Kiesewetter B, Weber M, Simonitsch-Klupp I, Gibbs P, Dolak W, Lukas J, Raderer M. Pre-Therapeutic Total Lesion Glycolysis on [ 18F]FDG-PET Enables Prognostication of 2-Year Progression-Free Survival in MALT Lymphoma Patients Treated with CD20-Antibody-Based Immunotherapy. Mol Imaging Biol 2020; 21:1192-1199. [PMID: 30847823 DOI: 10.1007/s11307-019-01329-2] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
Abstract
PURPOSE Standardized uptake values (SUV), total metabolic tumor volumes (TMTV), and total lesion glycolysis (TLG) based on positron emission tomography with 2-deoxy-2-[18F]fluoro-D-glucose ([18F]FDG/positron emission tomography (PET) are established outcome predictors in FDG-avid lymphomas. We therefore investigated whether these biomarkers also have prognostic value in extranodal marginal zone B cell lymphoma of the mucosa-associated lymphoid tissue (MALT lymphoma), with a focus on patients treated with anti-CD20 antibody-based immunotherapy. PROCEDURES Pre-therapeutic [18F]FDG/PET scans of 61 treatment-naïve MALT lymphoma patients, including 35 scheduled for anti-CD20 antibody-based immunotherapy, were included in this retrospective study. SUVmean, SUVmax, TMTV, and TLG were measured and tested for 2-year progression-free survival (PFS) prognostication, using Cox regression analyses. Receiver operating characteristic curves were used to determine optimal cutoffs for prognostic [18F]FDG/PET parameters, and Kaplan-Meier estimates with log rank tests were performed. RESULTS After 2 years, progression had occurred in 12/61 patients (CD20-anitbody group 6/35). TLG emerged as the only significant prognostic factor for 2-year PFS in the multivariate analyses with forward selection, both in entire cohort (hazard ratio HR, 1.001; 95 % CI, 1.001-1.002; P < 0.0001) and in the CD20-antibody group (HR, 1.001; 95 % CI, 1.001-1.002; P = 0.001). However, in the entire population, where 8/26 patients with a TLG > 90 (30.8 %) vs. 4/35 patients with a TLG ≤ 90 (11.4 %) showed progression within the 2-year observation period, TLG-based separation of risk groups failed (HR, 0.35; 95 % CI, 0.10-1.15; P = 0.069); whereas in the CD20-antibody group, where 6/16 patients with a TLG > 90 (37.5 %) vs. 0/19 patients with a TLG ≤ 90 (0.0 %) showed progression, risk group separation was successful (HR, 0.010; 95 % CI, 0.0001-8.068; P = 0.003). CONCLUSIONS TLG may improve early risk stratification of MALT lymphoma patients treated with CD20-antibody-based immunotherapy.
Collapse
Affiliation(s)
- Marius E Mayerhoefer
- Department of Biomedical Imaging and Image-guided Therapy, Division of General and Pediatric Radiology, Medical University of Vienna, Waehringer Guertel 18-20, 1090, Vienna, Austria. .,Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY, USA.
| | - Anton Staudenherz
- Department of Biomedical Imaging and Image-guided Therapy, Division of Nuclear Medicine, Medical University of Vienna, Waehringer Guertel 18-20, 1090, Vienna, Austria
| | | | - Michael Weber
- Department of Biomedical Imaging and Image-guided Therapy, Division of General and Pediatric Radiology, Medical University of Vienna, Waehringer Guertel 18-20, 1090, Vienna, Austria
| | | | - Peter Gibbs
- Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Werner Dolak
- Department of Medicine III, Medical University of Vienna, Vienna, Austria
| | - Julius Lukas
- Department of Ophthalmology and Optometry, Medical University of Vienna, Vienna, Austria
| | - Markus Raderer
- Department of Medicine I, Medical University of Vienna, Vienna, Austria
| |
Collapse
|
199
|
Noortman WA, Vriens D, Grootjans W, Tao Q, de Geus-Oei LF, Van Velden FH. Nuclear medicine radiomics in precision medicine: why we can't do without artificial intelligence. THE QUARTERLY JOURNAL OF NUCLEAR MEDICINE AND MOLECULAR IMAGING : OFFICIAL PUBLICATION OF THE ITALIAN ASSOCIATION OF NUCLEAR MEDICINE (AIMN) [AND] THE INTERNATIONAL ASSOCIATION OF RADIOPHARMACOLOGY (IAR), [AND] SECTION OF THE SOCIETY OF RADIOPHARMACEUTICAL CHEMISTRY AND BIOLOGY 2020; 64:278-290. [PMID: 32397702 DOI: 10.23736/s1824-4785.20.03263-x] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
Abstract
In recent years, radiomics, defined as the extraction of large amounts of quantitative features from medical images, has gained emerging interest. Radiomics consists of the extraction of handcrafted features combined with sophisticated statistical methods or machine learning algorithms for modelling, or deep learning algorithms that both learn features from raw data and perform modelling. These features have the potential to serve as non-invasive biomarkers for tumor characterization, prognostic stratification and response prediction, thereby contributing to precision medicine. However, especially in nuclear medicine, variable results are obtained when using radiomics for these purposes. Individual studies show promising results, but due to small numbers of patients per study and little standardization, it is difficult to compare and validate results on other datasets. This review describes the radiomic pipeline, its applications and the increasing role of artificial intelligence within the field. Furthermore, the challenges that need to be overcome to achieve clinical translation are discussed, so that, eventually, radiomics, combined with clinical data and other biomarkers, can contribute to precision medicine, by providing the right treatment to the right patient, with the right dose, at the right time.
Collapse
Affiliation(s)
- Wyanne A Noortman
- Section of Nuclear Medicine, Department of Radiology, Leiden University Medical Center (LUMC), Leiden, the Netherlands - .,Biomedical Photonic Imaging Group, University of Twente, Enschede, the Netherlands -
| | - Dennis Vriens
- Section of Nuclear Medicine, Department of Radiology, Leiden University Medical Center (LUMC), Leiden, the Netherlands
| | - Willem Grootjans
- Department of Radiology, Leiden University Medical Center (LUMC), Leiden, the Netherlands
| | - Qian Tao
- Division of Image Processing (LKEB), Department of Radiology, Leiden University Medical Center (LUMC), Leiden, the Netherlands
| | - Lioe-Fee de Geus-Oei
- Section of Nuclear Medicine, Department of Radiology, Leiden University Medical Center (LUMC), Leiden, the Netherlands.,Biomedical Photonic Imaging Group, University of Twente, Enschede, the Netherlands
| | - Floris H Van Velden
- Section of Nuclear Medicine, Department of Radiology, Leiden University Medical Center (LUMC), Leiden, the Netherlands
| |
Collapse
|
200
|
Park YJ, Shin MH, Moon SH. Radiogenomics Based on PET Imaging. Nucl Med Mol Imaging 2020; 54:128-138. [PMID: 32582396 DOI: 10.1007/s13139-020-00642-x] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/01/2020] [Revised: 04/02/2020] [Accepted: 04/30/2020] [Indexed: 02/07/2023] Open
Abstract
Radiogenomics or imaging genomics is a novel omics strategy of associating imaging data with genetic information, which has the potential to advance personalized medicine. Imaging features extracted from PET or PET/CT enable assessment of in vivo functional and physiological activity and provide comprehensive tumor information non-invasively. However, PET features are considered secondary to features on conventional imaging, and there has not yet been a review of the radiogenomic approach using PET features. This review article summarizes the current state of PET-based radiogenomic research for cancer, which discusses some of its limitations and directions for future study.
Collapse
Affiliation(s)
- Yong-Jin Park
- Department of Nuclear Medicine and Molecular Imaging, Samsung Medical Center, Seoul, Republic of Korea
| | - Mu Heon Shin
- Department of Nuclear Medicine and Molecular Imaging, Samsung Medical Center, Seoul, Republic of Korea
| | - Seung Hwan Moon
- Department of Nuclear Medicine and Molecular Imaging, Samsung Medical Center, Seoul, Republic of Korea
| |
Collapse
|