1
|
Ibrahim A, Guha S, Lu L, Geng P, Wu Q, Chou Y, Yang H, Wang D, Schwartz LH, Xie CM, Zhao B. The reproducibility and predictivity of radiomic features extracted from dynamic contrast-enhanced computed tomography of hepatocellular carcinoma. PLoS One 2024; 19:e0310486. [PMID: 39269960 PMCID: PMC11398651 DOI: 10.1371/journal.pone.0310486] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2024] [Accepted: 09/02/2024] [Indexed: 09/15/2024] Open
Abstract
PURPOSE To assess the reproducibility of radiomic features (RFs) extracted from dynamic contrast-enhanced computed tomography (DCE-CT) scans of patients diagnosed with hepatocellular carcinoma (HCC) with regards to inter-observer variability and acquisition timing after contrast injection. The predictive ability of reproducible RFs for differentiating between the degrees of HCC differentiation is also investigated. METHODS We analyzed a set of DCE-CT scans of 39 patients diagnosed with HCC. Two radiologists independently segmented the scans, and RFs were extracted from each sequence of the DCE-CT scans. The same lesion was segmented across the DCE-CT sequences of each patient's scan. From each lesion, 127 commonly used RFs were extracted. The reproducibility of RFs was assessed with regard to (i) inter-observer variability, by evaluating the reproducibility of RFs between the two radiologists; and (ii) timing of acquisition following contrast injection (inter- and intra-imaging phase). The reproducibility of RFs was assessed using the concordance correlation coefficient (CCC), with a cut-off value of 0.90. Reproducible RFs were used for building XGBoost classification models for the differentiation of HCC differentiation. RESULTS Inter-observer analyses across the different contrast-enhancement phases showed that the number of reproducible RFs was 29 (22.8%), 52 (40.9%), and 36 (28.3%) for the non-contrast enhanced, late arterial, and portal venous phases, respectively. Intra- and inter-sequence analyses revealed that the number of reproducible RFs ranged between 1 (0.8%) and 47 (37%), inversely related with time interval between the sequences. XGBoost algorithms built using reproducible RFs in each phase were found to be high predictive ability of the degree of HCC tumor differentiation. CONCLUSIONS The reproducibility of many RFs was significantly impacted by inter-observer variability, and a larger number of RFs were impacted by the difference in the time of acquisition after contrast injection. Our findings highlight the need for quality assessment to ensure that scans are analyzed in the same physiologic imaging phase in quantitative imaging studies, or that phase-wide reproducible RFs are selected. Overall, the study emphasizes the importance of reproducibility and quality control when using RFs as biomarkers for clinical applications.
Collapse
Affiliation(s)
- Abdalla Ibrahim
- Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, New York, United States of America
| | - Siddharth Guha
- Department of Radiology, Columbia University Irving Medical Center, New York, New York, United States of America
| | - Lin Lu
- Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, New York, United States of America
| | - Pengfei Geng
- Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, New York, United States of America
| | - Qian Wu
- First Affiliated Hospital of Nanjing Medical University, Jiangsu, China
| | - Yen Chou
- Department of Medical Imaging, Fu Jen Catholic University Hospital, New Taipei City, Taiwan
| | - Hao Yang
- Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, New York, United States of America
| | - Delin Wang
- Department of Radiology, Sun Yat-Sen University Cancer Center, Guangzhou, China
| | - Lawrence H Schwartz
- Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, New York, United States of America
| | - Chuan-Miao Xie
- Department of Radiology, Sun Yat-Sen University Cancer Center, Guangzhou, China
| | - Binsheng Zhao
- Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, New York, United States of America
| |
Collapse
|
2
|
Teng X, Wang Y, Nicol AJ, Ching JCF, Wong EKY, Lam KTC, Zhang J, Lee SWY, Cai J. Enhancing the Clinical Utility of Radiomics: Addressing the Challenges of Repeatability and Reproducibility in CT and MRI. Diagnostics (Basel) 2024; 14:1835. [PMID: 39202322 PMCID: PMC11353986 DOI: 10.3390/diagnostics14161835] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2024] [Revised: 08/03/2024] [Accepted: 08/16/2024] [Indexed: 09/03/2024] Open
Abstract
Radiomics, which integrates the comprehensive characterization of imaging phenotypes with machine learning algorithms, is increasingly recognized for its potential in the diagnosis and prognosis of oncological conditions. However, the repeatability and reproducibility of radiomic features are critical challenges that hinder their widespread clinical adoption. This review aims to address the paucity of discussion regarding the factors that influence the reproducibility and repeatability of radiomic features and their subsequent impact on the application of radiomic models. We provide a synthesis of the literature on the repeatability and reproducibility of CT/MR-based radiomic features, examining sources of variation, the number of reproducible features, and the availability of individual feature repeatability indices. We differentiate sources of variation into random effects, which are challenging to control but can be quantified through simulation methods such as perturbation, and biases, which arise from scanner variability and inter-reader differences and can significantly affect the generalizability of radiomic model performance in diverse settings. Four suggestions for repeatability and reproducibility studies are suggested: (1) detailed reporting of variation sources, (2) transparent disclosure of calculation parameters, (3) careful selection of suitable reliability indices, and (4) comprehensive reporting of reliability metrics. This review underscores the importance of random effects in feature selection and harmonizing biases between development and clinical application settings to facilitate the successful translation of radiomic models from research to clinical practice.
Collapse
Affiliation(s)
- Xinzhi Teng
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, 11 Yuk Choi Rd, Hung Hom, Hong Kong SAR, China; (X.T.); (Y.W.); (A.J.N.); (J.C.F.C.); (E.K.Y.W.); (K.T.C.L.); (J.Z.)
| | - Yongqiang Wang
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, 11 Yuk Choi Rd, Hung Hom, Hong Kong SAR, China; (X.T.); (Y.W.); (A.J.N.); (J.C.F.C.); (E.K.Y.W.); (K.T.C.L.); (J.Z.)
| | - Alexander James Nicol
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, 11 Yuk Choi Rd, Hung Hom, Hong Kong SAR, China; (X.T.); (Y.W.); (A.J.N.); (J.C.F.C.); (E.K.Y.W.); (K.T.C.L.); (J.Z.)
| | - Jerry Chi Fung Ching
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, 11 Yuk Choi Rd, Hung Hom, Hong Kong SAR, China; (X.T.); (Y.W.); (A.J.N.); (J.C.F.C.); (E.K.Y.W.); (K.T.C.L.); (J.Z.)
| | - Edwin Ka Yiu Wong
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, 11 Yuk Choi Rd, Hung Hom, Hong Kong SAR, China; (X.T.); (Y.W.); (A.J.N.); (J.C.F.C.); (E.K.Y.W.); (K.T.C.L.); (J.Z.)
| | - Kenneth Tsz Chun Lam
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, 11 Yuk Choi Rd, Hung Hom, Hong Kong SAR, China; (X.T.); (Y.W.); (A.J.N.); (J.C.F.C.); (E.K.Y.W.); (K.T.C.L.); (J.Z.)
| | - Jiang Zhang
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, 11 Yuk Choi Rd, Hung Hom, Hong Kong SAR, China; (X.T.); (Y.W.); (A.J.N.); (J.C.F.C.); (E.K.Y.W.); (K.T.C.L.); (J.Z.)
| | - Shara Wee-Yee Lee
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, 11 Yuk Choi Rd, Hung Hom, Hong Kong SAR, China; (X.T.); (Y.W.); (A.J.N.); (J.C.F.C.); (E.K.Y.W.); (K.T.C.L.); (J.Z.)
| | - Jing Cai
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, 11 Yuk Choi Rd, Hung Hom, Hong Kong SAR, China; (X.T.); (Y.W.); (A.J.N.); (J.C.F.C.); (E.K.Y.W.); (K.T.C.L.); (J.Z.)
- Hong Kong Polytechnic University Shenzhen Research Institute, Shenzhen 518057, China
| |
Collapse
|
3
|
Taddese AA, Tilahun BC, Awoke T, Atnafu A, Mamuye A, Mengiste SA. Deep-learning models for image-based gynecological cancer diagnosis: a systematic review and meta- analysis. Front Oncol 2024; 13:1216326. [PMID: 38273847 PMCID: PMC10809847 DOI: 10.3389/fonc.2023.1216326] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2023] [Accepted: 11/13/2023] [Indexed: 01/27/2024] Open
Abstract
Introduction Gynecological cancers pose a significant threat to women worldwide, especially those in resource-limited settings. Human analysis of images remains the primary method of diagnosis, but it can be inconsistent and inaccurate. Deep learning (DL) can potentially enhance image-based diagnosis by providing objective and accurate results. This systematic review and meta-analysis aimed to summarize the recent advances of deep learning (DL) techniques for gynecological cancer diagnosis using various images and explore their future implications. Methods The study followed the PRISMA-2 guidelines, and the protocol was registered in PROSPERO. Five databases were searched for articles published from January 2018 to December 2022. Articles that focused on five types of gynecological cancer and used DL for diagnosis were selected. Two reviewers assessed the articles for eligibility and quality using the QUADAS-2 tool. Data was extracted from each study, and the performance of DL techniques for gynecological cancer classification was estimated by pooling and transforming sensitivity and specificity values using a random-effects model. Results The review included 48 studies, and the meta-analysis included 24 studies. The studies used different images and models to diagnose different gynecological cancers. The most popular models were ResNet, VGGNet, and UNet. DL algorithms showed more sensitivity but less specificity compared to machine learning (ML) methods. The AUC of the summary receiver operating characteristic plot was higher for DL algorithms than for ML methods. Of the 48 studies included, 41 were at low risk of bias. Conclusion This review highlights the potential of DL in improving the screening and diagnosis of gynecological cancer, particularly in resource-limited settings. However, the high heterogeneity and quality of the studies could affect the validity of the results. Further research is necessary to validate the findings of this study and to explore the potential of DL in improving gynecological cancer diagnosis.
Collapse
Affiliation(s)
- Asefa Adimasu Taddese
- Department of Health Informatics, Institute of Public Health, College of Medicine and Health Sciences, University of Gondar, Gondar, Ethiopia
- eHealthlab Ethiopia Research Center, University of Gondar, Gondar, Ethiopia
| | - Binyam Chakilu Tilahun
- Department of Health Informatics, Institute of Public Health, College of Medicine and Health Sciences, University of Gondar, Gondar, Ethiopia
- eHealthlab Ethiopia Research Center, University of Gondar, Gondar, Ethiopia
| | - Tadesse Awoke
- Department of Epidemiology and Biostatistics, Institute of Public Health, College of Medicine and Health Sciences, University of Gondar, Gondar, Ethiopia
| | - Asmamaw Atnafu
- eHealthlab Ethiopia Research Center, University of Gondar, Gondar, Ethiopia
- Department of Health Systems and Policy, Institute of Public Health, College of Medicine and Health Sciences, University of Gondar, Gondar, Ethiopia
| | - Adane Mamuye
- eHealthlab Ethiopia Research Center, University of Gondar, Gondar, Ethiopia
- School of Information Technology and Engineering, Addis Ababa University, Addis Ababa, Ethiopia
| | - Shegaw Anagaw Mengiste
- Department of Business, History and Social Sciences, University of Southeastern Norway, Vestfold, Vestfold, Norway
| |
Collapse
|
4
|
Cerrito L, Ainora ME, Borriello R, Piccirilli G, Garcovich M, Riccardi L, Pompili M, Gasbarrini A, Zocco MA. Contrast-Enhanced Imaging in the Management of Intrahepatic Cholangiocarcinoma: State of Art and Future Perspectives. Cancers (Basel) 2023; 15:3393. [PMID: 37444503 DOI: 10.3390/cancers15133393] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2023] [Revised: 06/23/2023] [Accepted: 06/25/2023] [Indexed: 07/15/2023] Open
Abstract
Intrahepatic cholangiocarcinoma (iCCA) represents the second most common liver cancer after hepatocellular carcinoma, accounting for 15% of primary liver neoplasms. Its incidence and mortality rate have been rising during the last years, and total new cases are expected to increase up to 10-fold during the next two or three decades. Considering iCCA's poor prognosis and rapid spread, early diagnosis is still a crucial issue and can be very challenging due to the heterogeneity of tumor presentation at imaging exams and the need to assess a correct differential diagnosis with other liver lesions. Abdominal contrast-enhanced computed tomography (CT) and magnetic resonance imaging (MRI) plays an irreplaceable role in the evaluation of liver masses. iCCA's most typical imaging patterns are well-described, but atypical features are not uncommon at both CT and MRI; on the other hand, contrast-enhanced ultrasound (CEUS) has shown a great diagnostic value, with the interesting advantage of lower costs and no renal toxicity, but there is still no agreement regarding the most accurate contrastographic patterns for iCCA detection. Besides diagnostic accuracy, all these imaging techniques play a pivotal role in the choice of the therapeutic approach and eligibility for surgery, and there is an increasing interest in the specific imaging features which can predict tumor behavior or histologic subtypes. Further prognostic information may also be provided by the extraction of quantitative data through radiomic analysis, creating prognostic multi-parametric models, including clinical and serological parameters. In this review, we aim to summarize the role of contrast-enhanced imaging in the diagnosis and management of iCCA, from the actual issues in the differential diagnosis of liver masses to the newest prognostic implications.
Collapse
Affiliation(s)
- Lucia Cerrito
- CEMAD Digestive Disease Center, Fondazione Policlinico Universitario "A. Gemelli" IRCCS, Università Cattolica del Sacro Cuore, 00168 Rome, Italy
| | - Maria Elena Ainora
- CEMAD Digestive Disease Center, Fondazione Policlinico Universitario "A. Gemelli" IRCCS, Università Cattolica del Sacro Cuore, 00168 Rome, Italy
| | - Raffaele Borriello
- CEMAD Digestive Disease Center, Fondazione Policlinico Universitario "A. Gemelli" IRCCS, Università Cattolica del Sacro Cuore, 00168 Rome, Italy
| | - Giulia Piccirilli
- CEMAD Digestive Disease Center, Fondazione Policlinico Universitario "A. Gemelli" IRCCS, Università Cattolica del Sacro Cuore, 00168 Rome, Italy
| | - Matteo Garcovich
- CEMAD Digestive Disease Center, Fondazione Policlinico Universitario "A. Gemelli" IRCCS, Università Cattolica del Sacro Cuore, 00168 Rome, Italy
| | - Laura Riccardi
- CEMAD Digestive Disease Center, Fondazione Policlinico Universitario "A. Gemelli" IRCCS, Università Cattolica del Sacro Cuore, 00168 Rome, Italy
| | - Maurizio Pompili
- CEMAD Digestive Disease Center, Fondazione Policlinico Universitario "A. Gemelli" IRCCS, Università Cattolica del Sacro Cuore, 00168 Rome, Italy
| | - Antonio Gasbarrini
- CEMAD Digestive Disease Center, Fondazione Policlinico Universitario "A. Gemelli" IRCCS, Università Cattolica del Sacro Cuore, 00168 Rome, Italy
| | - Maria Assunta Zocco
- CEMAD Digestive Disease Center, Fondazione Policlinico Universitario "A. Gemelli" IRCCS, Università Cattolica del Sacro Cuore, 00168 Rome, Italy
| |
Collapse
|
5
|
Kamezawa H, Arimura H. Recurrence prediction with local binary pattern-based dosiomics in patients with head and neck squamous cell carcinoma. Phys Eng Sci Med 2023; 46:99-107. [PMID: 36469245 DOI: 10.1007/s13246-022-01201-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2022] [Accepted: 11/20/2022] [Indexed: 12/12/2022]
Abstract
We investigated an approach for predicting recurrence after radiation therapy using local binary pattern (LBP)-based dosiomics in patients with head and neck squamous cell carcinoma (HNSCC). Recurrence/non-recurrence data were collected from 131 patients after intensity-modulated radiation therapy. The cases were divided into training (80%) and test (20%) datasets. A total of 327 dosiomics features, including cold spot volume, first-order features, and texture features, were extracted from the original dose distribution (ODD) and LBP on gross tumor volume, clinical target volume, and planning target volume. The CoxNet algorithm was employed in the training dataset for feature selection and dosiomics signature construction. Based on a dosiomics score (DS)-based Cox proportional hazard model, two recurrence prediction models (DSODD and DSLBP) were constructed using the ODD and LBP dosiomics features. These models were used to evaluate the overall adequacy of the recurrence prediction using the concordance index (CI), and the prediction performance was assessed based on the accuracy and area under the receiver operating characteristic curve (AUC). The CIs for the test dataset were 0.71 and 0.76 for DSODD and DSLBP, respectively. The accuracy and AUC for the test dataset were 0.71 and 0.76 for the DSODD model and 0.79 and 0.81 for the DSLBP model, respectively. LBP-based dosiomics models may be more accurate in predicting recurrence after radiation therapy in patients with HNSCC.
Collapse
Affiliation(s)
- Hidemi Kamezawa
- Department of Radiological Technology, Faculty of Fukuoka Medical Technology, Teikyo University, 6-22 Misaki-machi, Omuta-City, Fukuoka, 836-8505, Japan.
| | - Hidetaka Arimura
- Division of Medical Quantum Science, Department of Health Sciences, Faculty of Medical Sciences, Kyushu University, 3-1-1 Maidashi, Higashi-ku, Fukuoka, 812-8582, Japan
| |
Collapse
|
6
|
Wei J, Jiang H, Zhou Y, Tian J, Furtado FS, Catalano OA. Radiomics: A radiological evidence-based artificial intelligence technique to facilitate personalized precision medicine in hepatocellular carcinoma. Dig Liver Dis 2023:S1590-8658(22)00863-5. [PMID: 36641292 DOI: 10.1016/j.dld.2022.12.015] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/28/2022] [Revised: 12/15/2022] [Accepted: 12/19/2022] [Indexed: 01/16/2023]
Abstract
The high postoperative recurrence rates in hepatocellular carcinoma (HCC) remain a major hurdle in its management. Appropriate staging and treatment selection may alleviate the extent of fatal recurrence. However, effective methods to preoperatively evaluate pathophysiologic and molecular characteristics of HCC are lacking. Imaging plays a central role in HCC diagnosis and stratification due to the non-invasive diagnostic criteria. Vast and crucial information is hidden within image data. Other than providing a morphological sketch for lesion diagnosis, imaging could provide new insights to describe the pathophysiological and genetic landscape of HCC. Radiomics aims to facilitate diagnosis and prognosis of HCC using artificial intelligence techniques to harness the immense information contained in medical images. Radiomics produces a set of archetypal and robust imaging features that are correlated to key pathological or molecular biomarkers to preoperatively risk-stratify HCC patients. Inferred with outcome data, comprehensive combination of radiomic, clinical and/or multi-omics data could also improve direct prediction of response to treatment and prognosis. The evolution of radiomics is changing our understanding of personalized precision medicine in HCC management. Herein, we review the key techniques and clinical applications in HCC radiomics and discuss current limitations and future opportunities to improve clinical decision making.
Collapse
Affiliation(s)
- Jingwei Wei
- Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, PR. China; Beijing Key Laboratory of Molecular Imaging, Beijing 100190, PR. China.
| | - Hanyu Jiang
- Department of Radiology, West China Hospital, Sichuan University, Chengdu, Sichuan, 610041, PR. China
| | - Yu Zhou
- Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, PR. China; Beijing Key Laboratory of Molecular Imaging, Beijing 100190, PR. China; School of Life Science and Technology, Xidian University, Xi'an, PR. China
| | - Jie Tian
- Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, PR. China; Beijing Key Laboratory of Molecular Imaging, Beijing 100190, PR. China; Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, School of Medicine, Beihang University, Beijing, 100191, PR. China; Engineering Research Center of Molecular and Neuro Imaging of Ministry of Education, School of Life Science and Technology, Xidian University, Xi'an, Shaanxi, 710126, PR. China.
| | - Felipe S Furtado
- Department of Radiology, Massachusetts General Hospital, Boston, MA 02114, United States; Harvard Medical School, 25 Shattuck St, Boston, MA 02115, United States
| | - Onofrio A Catalano
- Department of Radiology, Massachusetts General Hospital, Boston, MA 02114, United States; Harvard Medical School, 25 Shattuck St, Boston, MA 02115, United States.
| |
Collapse
|
7
|
Miranda J, Horvat N, Fonseca GM, Araujo-Filho JDAB, Fernandes MC, Charbel C, Chakraborty J, Coelho FF, Nomura CH, Herman P. Current status and future perspectives of radiomics in hepatocellular carcinoma. World J Gastroenterol 2023; 29:43-60. [PMID: 36683711 PMCID: PMC9850949 DOI: 10.3748/wjg.v29.i1.43] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/21/2022] [Revised: 10/27/2022] [Accepted: 12/14/2022] [Indexed: 01/04/2023] Open
Abstract
Given the frequent co-existence of an aggressive tumor and underlying chronic liver disease, the management of hepatocellular carcinoma (HCC) patients requires experienced multidisciplinary team discussion. Moreover, imaging plays a key role in the diagnosis, staging, restaging, and surveillance of HCC. Currently, imaging assessment of HCC entails the assessment of qualitative characteristics which are prone to inter-reader variability. Radiomics is an emerging field that extracts high-dimensional mineable quantitative features that cannot be assessed visually with the naked eye from medical imaging. The main potential applications of radiomic models in HCC are to predict histology, response to treatment, genetic signature, recurrence, and survival. Despite the encouraging results to date, there are challenges and limitations that need to be overcome before radiomics implementation in clinical practice. The purpose of this article is to review the main concepts and challenges pertaining to radiomics, and to review recent studies and potential applications of radiomics in HCC.
Collapse
Affiliation(s)
- Joao Miranda
- Department of Radiology, University of Sao Paulo, Sao Paulo 05403-010, Brazil
| | - Natally Horvat
- Department of Radiology, Memorial Sloan-Kettering Cancer Center, New York, NY 10065, United States
| | | | | | - Maria Clara Fernandes
- Department of Radiology, Memorial Sloan-Kettering Cancer Center, New York, NY 10065, United States
| | - Charlotte Charbel
- Department of Radiology, Memorial Sloan-Kettering Cancer Center, New York, NY 10065, United States
| | - Jayasree Chakraborty
- Department of Surgery, Memorial Sloan-Kettering Cancer Center, New York, NY 10065, United States
| | | | - Cesar Higa Nomura
- Department of Radiology, University of Sao Paulo, Sao Paulo 05403-000, Brazil
| | - Paulo Herman
- Department of Gastroenterology, University of Sao Paulo, Sao Paulo 05403-000, Brazil
| |
Collapse
|
8
|
Chen P, Yang Z, Zhang H, Huang G, Li Q, Ning P, Yu H. Personalized intrahepatic cholangiocarcinoma prognosis prediction using radiomics: Application and development trend. Front Oncol 2023; 13:1133867. [PMID: 37035147 PMCID: PMC10076873 DOI: 10.3389/fonc.2023.1133867] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2022] [Accepted: 03/13/2023] [Indexed: 04/11/2023] Open
Abstract
Radiomics was proposed by Lambin et al. in 2012 and since then there has been an explosion of related research. There has been significant interest in developing high-throughput methods that can automatically extract a large number of quantitative image features from medical images for better diagnostic or predictive performance. There have also been numerous radiomics investigations on intrahepatic cholangiocarcinoma in recent years, but no pertinent review materials are readily available. This work discusses the modeling analysis of radiomics for the prediction of lymph node metastasis, microvascular invasion, and early recurrence of intrahepatic cholangiocarcinoma, as well as the use of deep learning. This paper briefly reviews the current status of radiomics research to provide a reference for future studies.
Collapse
Affiliation(s)
- Pengyu Chen
- Department of Hepatobiliary Surgery, Henan University People’s Hospital, Henan Provincial People’s Hospital, Zhengzhou, China
| | - Zhenwei Yang
- Department of Hepatobiliary Surgery, Henan University People’s Hospital, Henan Provincial People’s Hospital, Zhengzhou, China
| | - Haofeng Zhang
- Department of Hepatobiliary Surgery, People’s Hospital of Zhengzhou University, Zhengzhou, China
| | - Guan Huang
- Department of Hepatobiliary Surgery, People’s Hospital of Zhengzhou University, Zhengzhou, China
| | - Qingshan Li
- Department of Hepatobiliary Surgery, Henan Provincial People’s Hospital, Zhengzhou, China
| | - Peigang Ning
- Department of Radiology, People’s Hospital of Zhengzhou University, Zhengzhou, China
| | - Haibo Yu
- Department of Hepatobiliary Surgery, Henan University People’s Hospital, Henan Provincial People’s Hospital, Zhengzhou, China
- Department of Hepatobiliary Surgery, People’s Hospital of Zhengzhou University, Zhengzhou, China
- Department of Hepatobiliary Surgery, Henan Provincial People’s Hospital, Zhengzhou, China
- *Correspondence: Haibo Yu,
| |
Collapse
|
9
|
Horvat N, Miranda J, El Homsi M, Peoples JJ, Long NM, Simpson AL, Do RKG. A primer on texture analysis in abdominal radiology. Abdom Radiol (NY) 2022; 47:2972-2985. [PMID: 34825946 DOI: 10.1007/s00261-021-03359-3] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2021] [Revised: 11/16/2021] [Accepted: 11/17/2021] [Indexed: 01/18/2023]
Abstract
The number of publications on texture analysis (TA), radiomics, and radiogenomics has been growing exponentially, with abdominal radiologists aiming to build new prognostic or predictive biomarkers for a wide range of clinical applications including the use of oncological imaging to advance the field of precision medicine. TA is specifically concerned with the study of the variation of pixel intensity values in radiological images. Radiologists aim to capture pixel variation in radiological images to deliver new insights into tumor biology that cannot be derived from visual inspection alone. TA remains an active area of investigation and requires further standardization prior to its clinical acceptance and applicability. This review is for radiologists interested in this rapidly evolving field, who are thinking of performing research or want to better interpret results in this arena. We will review the main concepts in TA, workflow processes, and existing challenges and steps to overcome them, as well as look at publications in body imaging with external validation.
Collapse
Affiliation(s)
- Natally Horvat
- Department of Radiology, Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY, 10065, USA
| | - Joao Miranda
- Department of Radiology, University of Sao Paulo, Sao Paulo, SP, Brazil
| | - Maria El Homsi
- Department of Radiology, Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY, 10065, USA
| | - Jacob J Peoples
- School of Computing, Queen's University, Kingston, ON, Canada
| | - Niamh M Long
- Department of Radiology, Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY, 10065, USA
| | - Amber L Simpson
- School of Computing, Queen's University, Kingston, ON, Canada.,Department of Biomedical and Molecular Sciences, Queen's University, Kingston, ON, Canada
| | - Richard K G Do
- Department of Radiology, Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY, 10065, USA.
| |
Collapse
|
10
|
Lafata KJ, Wang Y, Konkel B, Yin FF, Bashir MR. Radiomics: a primer on high-throughput image phenotyping. Abdom Radiol (NY) 2022; 47:2986-3002. [PMID: 34435228 DOI: 10.1007/s00261-021-03254-x] [Citation(s) in RCA: 28] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2021] [Revised: 08/15/2021] [Accepted: 08/16/2021] [Indexed: 01/18/2023]
Abstract
Radiomics is a high-throughput approach to image phenotyping. It uses computer algorithms to extract and analyze a large number of quantitative features from radiological images. These radiomic features collectively describe unique patterns that can serve as digital fingerprints of disease. They may also capture imaging characteristics that are difficult or impossible to characterize by the human eye. The rapid development of this field is motivated by systems biology, facilitated by data analytics, and powered by artificial intelligence. Here, as part of Abdominal Radiology's special issue on Quantitative Imaging, we provide an introduction to the field of radiomics. The technique is formally introduced as an advanced application of data analytics, with illustrating examples in abdominal radiology. Artificial intelligence is then presented as the main driving force of radiomics, and common techniques are defined and briefly compared. The complete step-by-step process of radiomic phenotyping is then broken down into five key phases. Potential pitfalls of each phase are highlighted, and recommendations are provided to reduce sources of variation, non-reproducibility, and error associated with radiomics.
Collapse
Affiliation(s)
- Kyle J Lafata
- Department of Radiology, Duke University School of Medicine, Durham, NC, USA. .,Department of Radiation Oncology, Duke University School of Medicine, Durham, NC, USA. .,Department of Electrical & Computer Engineering, Duke University Pratt School of Engineering, Durham, NC, USA.
| | - Yuqi Wang
- Department of Electrical & Computer Engineering, Duke University Pratt School of Engineering, Durham, NC, USA
| | - Brandon Konkel
- Department of Radiology, Duke University School of Medicine, Durham, NC, USA
| | - Fang-Fang Yin
- Department of Radiation Oncology, Duke University School of Medicine, Durham, NC, USA
| | - Mustafa R Bashir
- Department of Radiology, Duke University School of Medicine, Durham, NC, USA.,Department of Medicine, Gastroenterology, Duke University School of Medicine, Durham, NC, USA
| |
Collapse
|
11
|
Machine learning radiomics can predict early liver recurrence after resection of intrahepatic cholangiocarcinoma. HPB (Oxford) 2022; 24:1341-1350. [PMID: 35283010 PMCID: PMC9355916 DOI: 10.1016/j.hpb.2022.02.004] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/14/2021] [Revised: 02/05/2022] [Accepted: 02/10/2022] [Indexed: 12/12/2022]
Abstract
BACKGROUND Most patients recur after resection of intrahepatic cholangiocarcinoma (IHC). We studied whether machine-learning incorporating radiomics and tumor size could predict intrahepatic recurrence within 1-year. METHODS This was a retrospective analysis of patients with IHC resected between 2000 and 2017 who had evaluable computed tomography imaging. Texture features (TFs) were extracted from the liver, tumor, and future liver remnant (FLR). Random forest classification using training (70.3%) and validation cohorts (29.7%) was used to design a predictive model. RESULTS 138 patients were included for analysis. Patients with early recurrence had a larger tumor size (7.25 cm [IQR 5.2-8.9] vs. 5.3 cm [IQR 4.0-7.2], P = 0.011) and a higher rate of lymph node metastasis (28.6% vs. 11.6%, P = 0.041), but were not more likely to have multifocal disease (21.4% vs. 17.4%, P = 0.643). Three TFs from the tumor, FD1, FD30, and IH4 and one from the FLR, ACM15, were identified by feature selection. Incorporation of TFs and tumor size achieved the highest AUC of 0.84 (95% CI 0.73-0.95) in predicting recurrence in the validation cohort. CONCLUSION This study demonstrates that radiomics and machine-learning can reliably predict patients at risk for early intrahepatic recurrence with good discrimination accuracy.
Collapse
|
12
|
Hong EK, Bodalal Z, Landolfi F, Bogveradze N, Bos P, Park SJ, Lee JM, Beets-Tan R. Identifying high-risk colon cancer on CT an a radiomics signature improve radiologist's performance for T staging? ABDOMINAL RADIOLOGY (NEW YORK) 2022; 47:2739-2746. [PMID: 35661244 DOI: 10.1007/s00261-022-03534-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/03/2022] [Revised: 04/14/2022] [Accepted: 04/18/2022] [Indexed: 01/18/2023]
Abstract
PURPOSE To assess the role of radiomics in detection of high-risk (pT3-4) colon cancer and develop a combined model that combines both radiomics and CT staging of colon cancer. METHODS We included 292 colon cancer patients who underwent pre-operative CT and primary surgical resection within 2 months. Three-dimensional segmentations and CT staging of primary colon tumors were done. From each 3D segmentation of colon tumor, radiomic features were automatically extracted. Logistic regression analysis was performed to identify associations between radiomic features and high-risk (pT3-4) colon tumors. A combined model that integrated both radiomics and CT staging was developed and their diagnostic performance was compared with that of conventional CT staging. Tenfold cross-validation was used to validate the performance of the model and CT staging. RESULTS The model that combined radiomic features and CT staging demonstrated a significantly better performance in detection of high-risk colon tumors in training set (AUC = 0.799, 95% CI: 0.720-0.839 for combined model and AUC = 0.697, 95% CI = 0.538-0.756 for CT staging only, p < 0.001 for difference). Cross-validation results also demonstrated significantly better detection performance of combined model (AUC = 0.727, 95% Confidence Interval (CI): 0.621-0.777 for combined model and AUC = 0.628, 95% CI = 0.558-0.689 for CT staging only, Boot CI = 0.099). CONCLUSION CT radiomic features of primary colon cancer, combined with CT staging, can improve the detection of high-risk colon cancer patients.
Collapse
Affiliation(s)
- Eun Kyoung Hong
- Department of Radiology, Netherlands Cancer Institute, Plesmanlaan 121, 1066 CX, Amsterdam, The Netherlands.
- GROW School for Oncology and Developmental Biology, Maastricht University Medical Center, Maastricht, The Netherlands.
- Seoul National University Hospital, Seoul, South Korea.
| | - Zuhir Bodalal
- Department of Radiology, Netherlands Cancer Institute, Plesmanlaan 121, 1066 CX, Amsterdam, The Netherlands
- GROW School for Oncology and Developmental Biology, Maastricht University Medical Center, Maastricht, The Netherlands
| | - Federica Landolfi
- Department of Radiology, Netherlands Cancer Institute, Plesmanlaan 121, 1066 CX, Amsterdam, The Netherlands
- Radiology Unit, Sant'Andrea Hospital, Sapienza University of Rome, Rome, Italy
| | - Nino Bogveradze
- Department of Radiology, Netherlands Cancer Institute, Plesmanlaan 121, 1066 CX, Amsterdam, The Netherlands
- Academic Pridon Todua Medical Center, Research Institute of Clinical Medicine, Tbilisi, Georgia
| | - Paula Bos
- Department of Radiology, Netherlands Cancer Institute, Plesmanlaan 121, 1066 CX, Amsterdam, The Netherlands
- GROW School for Oncology and Developmental Biology, Maastricht University Medical Center, Maastricht, The Netherlands
| | - Sae Jin Park
- Seoul National University Hospital, Seoul, South Korea
| | - Jeong Min Lee
- Seoul National University Hospital, Seoul, South Korea
| | - Regina Beets-Tan
- Department of Radiology, Netherlands Cancer Institute, Plesmanlaan 121, 1066 CX, Amsterdam, The Netherlands
- GROW School for Oncology and Developmental Biology, Maastricht University Medical Center, Maastricht, The Netherlands
| |
Collapse
|
13
|
Nan Y, Ser JD, Walsh S, Schönlieb C, Roberts M, Selby I, Howard K, Owen J, Neville J, Guiot J, Ernst B, Pastor A, Alberich-Bayarri A, Menzel MI, Walsh S, Vos W, Flerin N, Charbonnier JP, van Rikxoort E, Chatterjee A, Woodruff H, Lambin P, Cerdá-Alberich L, Martí-Bonmatí L, Herrera F, Yang G. Data harmonisation for information fusion in digital healthcare: A state-of-the-art systematic review, meta-analysis and future research directions. AN INTERNATIONAL JOURNAL ON INFORMATION FUSION 2022; 82:99-122. [PMID: 35664012 PMCID: PMC8878813 DOI: 10.1016/j.inffus.2022.01.001] [Citation(s) in RCA: 40] [Impact Index Per Article: 20.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/24/2021] [Revised: 12/22/2021] [Accepted: 01/07/2022] [Indexed: 05/13/2023]
Abstract
Removing the bias and variance of multicentre data has always been a challenge in large scale digital healthcare studies, which requires the ability to integrate clinical features extracted from data acquired by different scanners and protocols to improve stability and robustness. Previous studies have described various computational approaches to fuse single modality multicentre datasets. However, these surveys rarely focused on evaluation metrics and lacked a checklist for computational data harmonisation studies. In this systematic review, we summarise the computational data harmonisation approaches for multi-modality data in the digital healthcare field, including harmonisation strategies and evaluation metrics based on different theories. In addition, a comprehensive checklist that summarises common practices for data harmonisation studies is proposed to guide researchers to report their research findings more effectively. Last but not least, flowcharts presenting possible ways for methodology and metric selection are proposed and the limitations of different methods have been surveyed for future research.
Collapse
Affiliation(s)
- Yang Nan
- National Heart and Lung Institute, Imperial College London, London, Northern Ireland UK
| | - Javier Del Ser
- Department of Communications Engineering, University of the Basque Country UPV/EHU, Bilbao 48013, Spain
- TECNALIA, Basque Research and Technology Alliance (BRTA), Derio 48160, Spain
| | - Simon Walsh
- National Heart and Lung Institute, Imperial College London, London, Northern Ireland UK
| | - Carola Schönlieb
- Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Cambridge, Northern Ireland UK
| | - Michael Roberts
- Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Cambridge, Northern Ireland UK
- Oncology R&D, AstraZeneca, Cambridge, Northern Ireland UK
| | - Ian Selby
- Department of Radiology, University of Cambridge, Cambridge, Northern Ireland UK
| | - Kit Howard
- Clinical Data Interchange Standards Consortium, Austin, TX, United States of America
| | - John Owen
- Clinical Data Interchange Standards Consortium, Austin, TX, United States of America
| | - Jon Neville
- Clinical Data Interchange Standards Consortium, Austin, TX, United States of America
| | - Julien Guiot
- University Hospital of Liège (CHU Liège), Respiratory medicine department, Liège, Belgium
- University of Liege, Department of clinical sciences, Pneumology-Allergology, Liège, Belgium
| | - Benoit Ernst
- University Hospital of Liège (CHU Liège), Respiratory medicine department, Liège, Belgium
- University of Liege, Department of clinical sciences, Pneumology-Allergology, Liège, Belgium
| | | | | | - Marion I. Menzel
- Technische Hochschule Ingolstadt, Ingolstadt, Germany
- GE Healthcare GmbH, Munich, Germany
| | - Sean Walsh
- Radiomics (Oncoradiomics SA), Liège, Belgium
| | - Wim Vos
- Radiomics (Oncoradiomics SA), Liège, Belgium
| | - Nina Flerin
- Radiomics (Oncoradiomics SA), Liège, Belgium
| | | | | | - Avishek Chatterjee
- Department of Precision Medicine, Maastricht University, Maastricht, The Netherlands
| | - Henry Woodruff
- Department of Precision Medicine, Maastricht University, Maastricht, The Netherlands
| | - Philippe Lambin
- Department of Precision Medicine, Maastricht University, Maastricht, The Netherlands
| | - Leonor Cerdá-Alberich
- Medical Imaging Department, Hospital Universitari i Politècnic La Fe, Valencia, Spain
| | - Luis Martí-Bonmatí
- Medical Imaging Department, Hospital Universitari i Politècnic La Fe, Valencia, Spain
| | - Francisco Herrera
- Department of Computer Sciences and Artificial Intelligence, Andalusian Research Institute in Data Science and Computational Intelligence (DaSCI) University of Granada, Granada, Spain
- Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah 21589, Saudi Arabia
| | - Guang Yang
- National Heart and Lung Institute, Imperial College London, London, Northern Ireland UK
- Cardiovascular Research Centre, Royal Brompton Hospital, London, Northern Ireland UK
- School of Biomedical Engineering & Imaging Sciences, King's College London, London, Northern Ireland UK
| |
Collapse
|
14
|
Yao W, Yang S, Ge Y, Fan W, Xiang L, Wan Y, Gu K, Zhao Y, Zha R, Bu J. Computed Tomography Radiomics-Based Prediction of Microvascular Invasion in Hepatocellular Carcinoma. Front Med (Lausanne) 2022; 9:819670. [PMID: 35402463 PMCID: PMC8987588 DOI: 10.3389/fmed.2022.819670] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2021] [Accepted: 02/18/2022] [Indexed: 12/12/2022] Open
Abstract
Background Due to the high recurrence rate in hepatocellular carcinoma (HCC) after resection, preoperative prognostic prediction of HCC is important for appropriate patient management. Exploring and developing preoperative diagnostic methods has great clinical value in treating patients with HCC. This study sought to develop and evaluate a novel combined clinical predictive model based on standard triphasic computed tomography (CT) to discriminate microvascular invasion (MVI) in hepatocellular carcinoma (HCC). Methods The preoperative findings of 82 patients with HCC, including conventional clinical factors, CT imaging findings, and CT texture analysis (TA), were analyzed retrospectively. All included cases were divided into MVI-negative (n = 33; no MVI) and MVI-positive (n = 49; low or high risk of MVI) groups. TA parameters were extracted from non-enhanced, arterial, portal venous, and equilibrium phase images and subsequently calculated using the Artificial Intelligence Kit. After statistical analyses, a clinical model comprising conventional clinical and CT image risk factors, radiomics signature models, and a novel combined model (fused radiomic signature) was constructed. The area under the curve (AUC) of the receiver operating characteristics (ROC) curve was used to assess the performance of the various models in discriminating MVI. Results We found that tumor diameter and pathological grade were effective clinical predictors in clinical model and 12 radiomics features were effective for MVI prediction of each CT phase. The AUCs of the clinical, plain, artery, venous, and delay models were 0.77 (95% CI: 0.67–0.88), 0.75 (95% CI: 0.64–0.87), 0.79 (95% CI: 0.69–0.89), 0.73 (95% CI: 0.61–0.85), and 0.80 (95% CI: 0.70–0.91), respectively. The novel combined model exhibited the best performance, with an AUC of 0.83 (95% CI: 0.74–0.93). Conclusions Models derived from triphasic CT can preoperatively predict MVI in patients with HCC. Of the models tested here, the novel combined model was most predictive and could become a useful tool to guide subsequent personalized treatment of HCC.
Collapse
Affiliation(s)
- Wenjun Yao
- Department of Radiology, The Second Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Shuo Yang
- Department of Radiology, Anhui Mental Health Center, Hefei, China
| | | | - Wenlong Fan
- Department of Radiology, The Second Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Li Xiang
- Department of Radiology, The Second Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Yang Wan
- Department of Hematological Lab, The Second Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Kangchen Gu
- Department of Radiology, The Second Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Yan Zhao
- School of Biomedical Engineering, Anhui Medical University, Hefei, China
| | - Rujing Zha
- Department of Radiology, Division of Life Science and Medicine, The First Affiliated Hospital of USTC, School of Life Science, University of Science and Technology of China, Hefei, China
| | - Junjie Bu
- School of Biomedical Engineering, Anhui Medical University, Hefei, China.,The Fourth Affiliated Hospital of Anhui Medical University, Hefei, China
| |
Collapse
|
15
|
Ibrahim A, Widaatalla Y, Refaee T, Primakov S, Miclea RL, Öcal O, Fabritius MP, Ingrisch M, Ricke J, Hustinx R, Mottaghy FM, Woodruff HC, Seidensticker M, Lambin P. Reproducibility of CT-Based Hepatocellular Carcinoma Radiomic Features across Different Contrast Imaging Phases: A Proof of Concept on SORAMIC Trial Data. Cancers (Basel) 2021; 13:cancers13184638. [PMID: 34572870 PMCID: PMC8468150 DOI: 10.3390/cancers13184638] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2021] [Revised: 09/11/2021] [Accepted: 09/13/2021] [Indexed: 12/17/2022] Open
Abstract
Simple Summary Radiomics has been reported to have potential for correlating with clinical outcomes. However, handcrafted radiomic features (HRFs)—the quantitative features extracted from medical images—are limited by their sensitivity to variations in scanning parameters. Furthermore, radiomics analyses require big data with good quality to achieve desirable performances. In this study, we investigated the reproducibility of HRFs between scans acquired with the same scanning parameters except for the imaging phase (arterial and portal venous phases) to assess the possibilities of merging scans from different phases or replacing missing scans from a phase with other phases to increase data entries. Additionally, we assessed the potential of ComBat harmonization to remove batch effects attributed to this variation. Our results show that the majority of HRFs were not reproducible between the arterial and portal venous phases before or after ComBat harmonization. We provide a guide for analyzing scans of different imaging phases. Abstract Handcrafted radiomic features (HRFs) are quantitative imaging features extracted from regions of interest on medical images which can be correlated with clinical outcomes and biologic characteristics. While HRFs have been used to train predictive and prognostic models, their reproducibility has been reported to be affected by variations in scan acquisition and reconstruction parameters, even within the same imaging vendor. In this work, we evaluated the reproducibility of HRFs across the arterial and portal venous phases of contrast-enhanced computed tomography images depicting hepatocellular carcinomas, as well as the potential of ComBat harmonization to correct for this difference. ComBat harmonization is a method based on Bayesian estimates that was developed for gene expression arrays, and has been investigated as a potential method for harmonizing HRFs. Our results show that the majority of HRFs are not reproducible between the arterial and portal venous imaging phases, yet a number of HRFs could be used interchangeably between those phases. Furthermore, ComBat harmonization increased the number of reproducible HRFs across both phases by 1%. Our results guide the pooling of arterial and venous phases from different patients in an effort to increase cohort size, as well as joint analysis of the phases.
Collapse
Affiliation(s)
- Abdalla Ibrahim
- The D-Lab, Department of Precision Medicine, GROW—School for Oncology, Maastricht University, 6200 MD Maastricht, The Netherlands; (Y.W.); (S.P.); (H.C.W.); (P.L.)
- Department of Radiology and Nuclear Medicine, Maastricht University Medical Centre+, 6200 MD Maastricht, The Netherlands; (R.L.M.); (F.M.M.)
- Division of Nuclear Medicine and Oncological Imaging, Department of Medical Physics, University Hospital of Liege and GIGA CRC-In Vivo Imaging, University of Liege, 4000 Liege, Belgium;
- Department of Nuclear Medicine and Comprehensive Diagnostic Center Aachen (CDCA), University Hospital RWTH Aachen University, 52074 Aachen, Germany
- Correspondence: (A.I.); (T.R.)
| | - Yousif Widaatalla
- The D-Lab, Department of Precision Medicine, GROW—School for Oncology, Maastricht University, 6200 MD Maastricht, The Netherlands; (Y.W.); (S.P.); (H.C.W.); (P.L.)
| | - Turkey Refaee
- The D-Lab, Department of Precision Medicine, GROW—School for Oncology, Maastricht University, 6200 MD Maastricht, The Netherlands; (Y.W.); (S.P.); (H.C.W.); (P.L.)
- Department of Diagnostic Radiology, Faculty of Applied Medical Sciences, Jazan University, Jazan 45142, Saudi Arabia
- Correspondence: (A.I.); (T.R.)
| | - Sergey Primakov
- The D-Lab, Department of Precision Medicine, GROW—School for Oncology, Maastricht University, 6200 MD Maastricht, The Netherlands; (Y.W.); (S.P.); (H.C.W.); (P.L.)
- Department of Nuclear Medicine and Comprehensive Diagnostic Center Aachen (CDCA), University Hospital RWTH Aachen University, 52074 Aachen, Germany
| | - Razvan L. Miclea
- Department of Radiology and Nuclear Medicine, Maastricht University Medical Centre+, 6200 MD Maastricht, The Netherlands; (R.L.M.); (F.M.M.)
| | - Osman Öcal
- Department of Radiology, University Hospital, LMU Munich, 80336 Munich, Germany; (O.Ö.); (M.P.F.); (M.I.); (J.R.); (M.S.)
| | - Matthias P. Fabritius
- Department of Radiology, University Hospital, LMU Munich, 80336 Munich, Germany; (O.Ö.); (M.P.F.); (M.I.); (J.R.); (M.S.)
| | - Michael Ingrisch
- Department of Radiology, University Hospital, LMU Munich, 80336 Munich, Germany; (O.Ö.); (M.P.F.); (M.I.); (J.R.); (M.S.)
| | - Jens Ricke
- Department of Radiology, University Hospital, LMU Munich, 80336 Munich, Germany; (O.Ö.); (M.P.F.); (M.I.); (J.R.); (M.S.)
| | - Roland Hustinx
- Division of Nuclear Medicine and Oncological Imaging, Department of Medical Physics, University Hospital of Liege and GIGA CRC-In Vivo Imaging, University of Liege, 4000 Liege, Belgium;
| | - Felix M. Mottaghy
- Department of Radiology and Nuclear Medicine, Maastricht University Medical Centre+, 6200 MD Maastricht, The Netherlands; (R.L.M.); (F.M.M.)
- Department of Nuclear Medicine and Comprehensive Diagnostic Center Aachen (CDCA), University Hospital RWTH Aachen University, 52074 Aachen, Germany
| | - Henry C. Woodruff
- The D-Lab, Department of Precision Medicine, GROW—School for Oncology, Maastricht University, 6200 MD Maastricht, The Netherlands; (Y.W.); (S.P.); (H.C.W.); (P.L.)
- Department of Radiology and Nuclear Medicine, Maastricht University Medical Centre+, 6200 MD Maastricht, The Netherlands; (R.L.M.); (F.M.M.)
| | - Max Seidensticker
- Department of Radiology, University Hospital, LMU Munich, 80336 Munich, Germany; (O.Ö.); (M.P.F.); (M.I.); (J.R.); (M.S.)
| | - Philippe Lambin
- The D-Lab, Department of Precision Medicine, GROW—School for Oncology, Maastricht University, 6200 MD Maastricht, The Netherlands; (Y.W.); (S.P.); (H.C.W.); (P.L.)
- Department of Radiology and Nuclear Medicine, Maastricht University Medical Centre+, 6200 MD Maastricht, The Netherlands; (R.L.M.); (F.M.M.)
| |
Collapse
|
16
|
Budai BK, Frank V, Shariati S, Fejér B, Tóth A, Orbán V, Bérczi V, Kaposi PN. CT texture analysis of abdominal lesions – Part I.: Liver lesions. IMAGING 2021. [DOI: 10.1556/1647.2021.00007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022] Open
Abstract
AbstractArtificial Intelligence and the use of radiomics analysis have been of great interest in the last decade in the field of imaging. CT texture analysis (CTTA) is a new and emerging field in radiomics, which seems promising in the assessment and diagnosis of both focal and diffuse liver lesions. The utilization of CTTA has only been receiving great attention recently, especially for response evaluation and prognostication of different oncological diagnoses. Radiomics, combined with machine learning techniques, offers a promising opportunity to accurately detect or differentiate between focal liver lesions based on their unique texture parameters. In this review article, we discuss the unique ability of radiomics in the diagnostics and prognostication of both focal and diffuse liver lesions. We also provide a brief review of radiogenomics and summarize its potential role of in the non-invasive diagnosis of malignant liver tumors.
Collapse
Affiliation(s)
- Bettina Katalin Budai
- Department of Radiology, Medical Imaging Centre, Semmelweis University, Faculty of Medicine, Budapest, Hungary
| | - Veronica Frank
- Department of Radiology, Medical Imaging Centre, Semmelweis University, Faculty of Medicine, Budapest, Hungary
| | - Sonaz Shariati
- Department of Radiology, Medical Imaging Centre, Semmelweis University, Faculty of Medicine, Budapest, Hungary
| | - Bence Fejér
- Department of Radiology, Medical Imaging Centre, Semmelweis University, Faculty of Medicine, Budapest, Hungary
| | - Ambrus Tóth
- Department of Radiology, Medical Imaging Centre, Semmelweis University, Faculty of Medicine, Budapest, Hungary
| | - Vince Orbán
- Department of Radiology, Medical Imaging Centre, Semmelweis University, Faculty of Medicine, Budapest, Hungary
| | - Viktor Bérczi
- Department of Radiology, Medical Imaging Centre, Semmelweis University, Faculty of Medicine, Budapest, Hungary
| | - Pál Novák Kaposi
- Department of Radiology, Medical Imaging Centre, Semmelweis University, Faculty of Medicine, Budapest, Hungary
| |
Collapse
|
17
|
Starosolski Z, Courtney AN, Srivastava M, Guo L, Stupin I, Metelitsa LS, Annapragada A, Ghaghada KB. A Nanoradiomics Approach for Differentiation of Tumors Based on Tumor-Associated Macrophage Burden. CONTRAST MEDIA & MOLECULAR IMAGING 2021; 2021:6641384. [PMID: 34220380 PMCID: PMC8216795 DOI: 10.1155/2021/6641384] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/20/2020] [Revised: 02/26/2021] [Accepted: 05/21/2021] [Indexed: 12/14/2022]
Abstract
Objective Tumor-associated macrophages (TAMs) within the tumor immune microenvironment (TiME) of solid tumors play an important role in treatment resistance and disease recurrence. The purpose of this study was to investigate if nanoradiomics (radiomic analysis of nanoparticle contrast-enhanced images) can differentiate tumors based on TAM burden. Materials and Methods In vivo studies were performed in transgenic mouse models of neuroblastoma with low (N = 11) and high (N = 10) tumor-associated macrophage (TAM) burden. Animals underwent delayed nanoparticle contrast-enhanced CT (n-CECT) imaging at 4 days after intravenous administration of liposomal-iodine agent (1.1 g/kg). CT imaging-derived conventional tumor metrics (tumor volume and CT attenuation) were computed for segmented tumor CT datasets. Nanoradiomic analysis was performed using a PyRadiomics workflow implemented in the quantitative image feature pipeline (QIFP) server containing 900 radiomic features (RFs). RF selection was performed under supervised machine learning using a nonparametric neighborhood component method. A 5-fold validation was performed using a set of linear and nonlinear classifiers for group separation. Statistical analysis was performed using the Kruskal-Wallis test. Results N-CECT imaging demonstrated heterogeneous patterns of signal enhancement in low and high TAM tumors. CT imaging-derived conventional tumor metrics showed no significant differences (p > 0.05) in tumor volume between low and high TAM tumors. Tumor CT attenuation was not significantly different (p > 0.05) between low and high TAM tumors. Machine learning-augmented nanoradiomic analysis revealed two RFs that differentiated (p < 0.002) low TAM and high TAM tumors. The RFs were used to build a linear classifier that demonstrated very high accuracy and further confirmed by 5-fold cross-validation. Conclusions Imaging-derived conventional tumor metrics were unable to differentiate tumors with varying TAM burden; however, nanoradiomic analysis revealed texture differences and enabled differentiation of low and high TAM tumors.
Collapse
Affiliation(s)
- Zbigniew Starosolski
- Edward B. Singleton Department of Radiology, Texas Children's Hospital, Houston, TX, USA
- Department of Radiology, Baylor College of Medicine, Houston, TX, USA
| | - Amy N. Courtney
- Texas Children's Cancer Center, Department of Pediatrics, Baylor College of Medicine, Houston, TX, USA
| | - Mayank Srivastava
- Edward B. Singleton Department of Radiology, Texas Children's Hospital, Houston, TX, USA
| | - Linjie Guo
- Texas Children's Cancer Center, Department of Pediatrics, Baylor College of Medicine, Houston, TX, USA
| | - Igor Stupin
- Edward B. Singleton Department of Radiology, Texas Children's Hospital, Houston, TX, USA
| | - Leonid S. Metelitsa
- Texas Children's Cancer Center, Department of Pediatrics, Baylor College of Medicine, Houston, TX, USA
- Center for Cell and Gene Therapy, Baylor College of Medicine, Houston, TX, USA
| | - Ananth Annapragada
- Edward B. Singleton Department of Radiology, Texas Children's Hospital, Houston, TX, USA
- Department of Radiology, Baylor College of Medicine, Houston, TX, USA
| | - Ketan B. Ghaghada
- Edward B. Singleton Department of Radiology, Texas Children's Hospital, Houston, TX, USA
- Department of Radiology, Baylor College of Medicine, Houston, TX, USA
| |
Collapse
|
18
|
Prediction of Human Papillomavirus (HPV) Association of Oropharyngeal Cancer (OPC) Using Radiomics: The Impact of the Variation of CT Scanner. Cancers (Basel) 2021; 13:cancers13092269. [PMID: 34066857 PMCID: PMC8125906 DOI: 10.3390/cancers13092269] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2021] [Revised: 04/29/2021] [Accepted: 05/06/2021] [Indexed: 11/16/2022] Open
Abstract
Simple Summary Recent studies exploring the application of radiomics features in medicine have shown promising results. However, variation in imaging parameters may impact the robustness of these features. Feature robustness may then in turn affect the prediction performance of the machine learning models built upon these features. While numerous studies have tested feature robustness against a variety of imaging parameters, the extent to which feature robustness affects predictions remains unclear. A particularly notable application of radiomics in clinical oncology is the prediction of Human Papillomavirus (HPV) association in Oropharyngeal cancer. In this study we explore how CT scanner type affects the performance of radiomics features for HPV association prediction and highlight the need to implement precautionary approaches so as to minimize this effect. Abstract Studies have shown that radiomic features are sensitive to the variability of imaging parameters (e.g., scanner models), and one of the major challenges in these studies lies in improving the robustness of quantitative features against the variations in imaging datasets from multi-center studies. Here, we assess the impact of scanner choice on computed tomography (CT)-derived radiomic features to predict the association of oropharyngeal squamous cell carcinoma with human papillomavirus (HPV). This experiment was performed on CT image datasets acquired from two different scanner manufacturers. We demonstrate strong scanner dependency by developing a machine learning model to classify HPV status from radiological images. These experiments reveal the effect of scanner manufacturer on the robustness of radiomic features, and the extent of this dependency is reflected in the performance of HPV prediction models. The results of this study highlight the importance of implementing an appropriate approach to reducing the impact of imaging parameters on radiomic features and consequently on the machine learning models, without removing features which are deemed non-robust but may contain learning information.
Collapse
|
19
|
Liu Y, Fan H, Dong D, Liu P, He B, Meng L, Chen J, Chen C, Lang J, Tian J. Computed tomography-based radiomic model at node level for the prediction of normal-sized lymph node metastasis in cervical cancer. Transl Oncol 2021; 14:101113. [PMID: 33975178 PMCID: PMC8131712 DOI: 10.1016/j.tranon.2021.101113] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2021] [Revised: 04/22/2021] [Accepted: 04/22/2021] [Indexed: 12/14/2022] Open
Abstract
The metastatic status of lymph nodes in cervical cancer patients can be predicted. Computed tomography-based radiomic model can identify the status of the normal-sized lymph node singly. The model may help doctors to make staging and clinical decision, and realize individualized treatment.
Purpose Radiomic models have been demonstrated to have acceptable discrimination capability for detecting lymph node metastasis (LNM). We aimed to develop a computed tomography–based radiomic model and validate its usefulness in the prediction of normal-sized LNM at node level in cervical cancer. Methods A total of 273 LNs of 219 patients from 10 centers were evaluated in this study. We randomly divided the LNs from the 2 centers with the largest number of LNs into the training and internal validation cohorts, and the rest as the external validation cohort. Radiomic features were extracted from the arterial and venous phase images. We trained an artificial neural network (ANN) to develop two single-phase models. A radiomic model reflecting the features of two-phase images was also built for directly predicting LNM in cervical cancer. Moreover, four state-of-the-art methods were used for comparison. The performance of all models was assessed using the area under the receiver operating characteristic curve (AUC). Results Among the models we built, the models combining the features of two phases surpassed the single-phase models, and the models generated by ANN had better performance than the others. We found that the radiomic model achieved the highest AUCs of 0.912 and 0.859 in the training and internal validation cohorts, respectively. In the external validation cohort, the AUC of the radiomic model was 0.800. Conclusion We constructed a radiomic model that exhibited great ability in the prediction of LNM. The application of the model could optimize clinical staging and decision-making.
Collapse
Affiliation(s)
- Yujia Liu
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China; CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China.
| | - Huijian Fan
- Department of Obstetrics and Gynecology, Nanfang Hospital, Southern Medical University, Guangzhou 510515, China.
| | - Di Dong
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China; CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China; Zhuhai Precision Medical Center, Zhuhai People's Hospital (affiliated with Jinan University), Zhuhai 519000, China.
| | - Ping Liu
- Department of Obstetrics and Gynecology, Nanfang Hospital, Southern Medical University, Guangzhou 510515, China.
| | - Bingxi He
- CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China; School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China.
| | - Lingwei Meng
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China; CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China.
| | - Jiaming Chen
- Department of Obstetrics and Gynecology, Nanfang Hospital, Southern Medical University, Guangzhou 510515, China.
| | - Chunlin Chen
- Department of Obstetrics and Gynecology, Nanfang Hospital, Southern Medical University, Guangzhou 510515, China.
| | - Jinghe Lang
- Department of Obstetrics and Gynecology, Nanfang Hospital, Southern Medical University, Guangzhou 510515, China; Department of Obstetrics and Gynecology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences & Peking Union Medical College, No.1 Shuaifuyuan Wangfujing Dongcheng District, Beijing 100730, China.
| | - Jie Tian
- CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China; Zhuhai Precision Medical Center, Zhuhai People's Hospital (affiliated with Jinan University), Zhuhai 519000, China; Beijing Advanced Innovation Centre for Big Data-Based Precision Medicine, School of Medicine, Beihang University, Beijing 100191, China.
| |
Collapse
|
20
|
Li H, Gao L, Ma H, Arefan D, He J, Wang J, Liu H. Radiomics-Based Features for Prediction of Histological Subtypes in Central Lung Cancer. Front Oncol 2021; 11:658887. [PMID: 33996583 PMCID: PMC8117140 DOI: 10.3389/fonc.2021.658887] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2021] [Accepted: 04/13/2021] [Indexed: 11/13/2022] Open
Abstract
Objectives To evaluate the effectiveness of radiomic features on classifying histological subtypes of central lung cancer in contrast-enhanced CT (CECT) images. Materials and Methods A total of 200 patients with radiologically defined central lung cancer were recruited. All patients underwent dual-phase chest CECT, and the histological subtypes (adenocarcinoma (ADC), squamous cell carcinoma (SCC), small cell lung cancer (SCLC)) were confirmed by histopathological samples. 107 features were used in five machine learning classifiers to perform the predictive analysis among three subtypes. Models were trained and validated in two conditions: using radiomic features alone, and combining clinical features with radiomic features. The performance of the classification models was evaluated by the area under the receiver operating characteristic curve (AUC). Results The highest AUCs in classifying ADC vs. SCC, ADC vs. SCLC, and SCC vs. SCLC were 0.879, 0.836, 0.783, respectively by using only radiomic features in a feedforward neural network. Conclusion Our study indicates that radiomic features based on the CECT images might be a promising tool for noninvasive prediction of histological subtypes in central lung cancer and the neural network classifier might be well-suited to this task.
Collapse
Affiliation(s)
- Huanhuan Li
- Department of Radiology, The First Hospital of China Medical University, Shenyang, China
| | - Long Gao
- College of Computer, National University of Defense Technology, Changsha, China
| | - He Ma
- Sino-Dutch Biomedical and Information Engineering School, Northeastern University, Shenyang, China
| | - Dooman Arefan
- Imaging Research Division, Department of Radiology, University of Pittsburgh, Pittsburgh, PA, United States
| | - Jiachuan He
- Department of Radiology, The First Hospital of China Medical University, Shenyang, China
| | - Jiaqi Wang
- Department of Radiology, The First Hospital of China Medical University, Shenyang, China
| | - Hu Liu
- Department of Radiology, The First Hospital of China Medical University, Shenyang, China
| |
Collapse
|
21
|
Reiazi R, Abbas E, Famiyeh P, Rezaie A, Kwan JYY, Patel T, Bratman SV, Tadic T, Liu FF, Haibe-Kains B. The impact of the variation of imaging parameters on the robustness of Computed Tomography radiomic features: A review. Comput Biol Med 2021; 133:104400. [PMID: 33930766 DOI: 10.1016/j.compbiomed.2021.104400] [Citation(s) in RCA: 29] [Impact Index Per Article: 9.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2020] [Revised: 03/23/2021] [Accepted: 04/11/2021] [Indexed: 12/13/2022]
Abstract
The field of radiomics is at the forefront of personalized medicine. However, there is concern that high variation in imaging parameters will impact robustness of radiomic features and subsequently the performance of the predictive models built upon them. Therefore, our review aims to evaluate the impact of imaging parameters on the robustness of radiomic features. We also provide insights into the validity and discrepancy of different methodologies applied to investigate the robustness of radiomic features. We selected 47 papers based on our predefined inclusion criteria and grouped these papers by the imaging parameter under investigation: (i) scanner parameters, (ii) acquisition parameters and (iii) reconstruction parameters. Our review highlighted that most of the imaging parameters are disruptive parameters, and shape along with First order statistics were reported as the most robust radiomic features against variation in imaging parameters. This review identified inconsistencies related to the methodology of the reviewed studies such as the metrics used for robustness, the feature extraction techniques, the reporting style, and their outcome inclusion. We hope this review will aid the scientific community in conducting research in a way that is more reproducible and avoids the pitfalls of previous analyses.
Collapse
Affiliation(s)
- Reza Reiazi
- Princess Margaret Cancer Centre, University Health Network, Toronto, Ontario, Canada; Department of Medical Biophysics, University of Toronto, Toronto, Ontario, Canada; Department of Radiation Oncology, University of Toronto, Toronto, Ontario, Canada
| | - Engy Abbas
- Joint Department of Medical Imaging, University of Toronto, Toronto, Canada
| | - Petra Famiyeh
- Princess Margaret Cancer Centre, University Health Network, Toronto, Ontario, Canada; Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Aria Rezaie
- Princess Margaret Cancer Centre, University Health Network, Toronto, Ontario, Canada
| | - Jennifer Y Y Kwan
- Princess Margaret Cancer Centre, University Health Network, Toronto, Ontario, Canada
| | - Tirth Patel
- Techna Institute, University Health Network, Toronto, Ontario, Canada
| | - Scott V Bratman
- Princess Margaret Cancer Centre, University Health Network, Toronto, Ontario, Canada; Department of Radiation Oncology, University of Toronto, Toronto, Ontario, Canada
| | - Tony Tadic
- Princess Margaret Cancer Centre, University Health Network, Toronto, Ontario, Canada; Department of Radiation Oncology, University of Toronto, Toronto, Ontario, Canada
| | - Fei-Fei Liu
- Princess Margaret Cancer Centre, University Health Network, Toronto, Ontario, Canada; Department of Radiation Oncology, University of Toronto, Toronto, Ontario, Canada
| | - Benjamin Haibe-Kains
- Princess Margaret Cancer Centre, University Health Network, Toronto, Ontario, Canada; Department of Medical Biophysics, University of Toronto, Toronto, Ontario, Canada; Ontario Institute for Cancer Research, Toronto, Ontario, Canada; Department of Computer Science, University of Toronto, Toronto, Ontario, Canada; Vector Institute, Toronto, Ontario, Canada.
| |
Collapse
|
22
|
Beaumont H, Iannessi A, Bertrand AS, Cucchi JM, Lucidarme O. Harmonization of radiomic feature distributions: impact on classification of hepatic tissue in CT imaging. Eur Radiol 2021; 31:6059-6068. [PMID: 33459855 DOI: 10.1007/s00330-020-07641-8] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2020] [Revised: 11/23/2020] [Accepted: 12/17/2020] [Indexed: 12/15/2022]
Abstract
OBJECTIVES Following the craze for radiomic features (RF), their lack of reliability raised the question of the generalizability of classification models. Inter-site harmonization of images therefore becomes a central issue. We compared RF harmonization processing designed to detect liver diseases in CT images. METHODS We retrospectively analyzed 76 multi-center portal CT series of non-diseased (NDL) and diseased liver (DL) patients. In each series, we positioned volumes of interest in spleen and liver, then extracted 9 RF (histogram and texture). We evaluated two RF harmonization approaches. First, in each series, we computed the Z-score of liver measurements based on those computed in the spleen. Second, we evaluated the ComBat method according to each imaging center; parameters were computed in the spleen and applied to the liver. We compared RF distributions and classification performances before/after harmonization. We classified NDL versus spleen and versus DL tissues. RESULTS The RF distributions were all different between liver and spleen (p < 0.05). The Z-score harmonization outperformed for the detection of liver versus spleen: AUC = 93.1% (p < 0.001). For the detection of DL versus NDL, in a case/control setting, we found no differences between the harmonizations: mean AUC = 73.6% (p = 0.49). Using the whole datasets, the performances were improved using ComBat (p = 0.05) AUC = 82.4% and degraded with Z-score AUC = 67.4% (p = 0.008). CONCLUSIONS Data harmonization requires to first focus on data structuring to not degrade the performances of subsequent classifications. Liver tissue classification after harmonization of spleen-based RF is a promising strategy for improving the detection of DL tissue. KEY POINTS • Variability of acquisition parameter makes radiomics of CT features non-reproducible. • Data harmonization can help circumvent the inter-site variability of acquisition protocols. • Inter-site harmonization must be carefully implemented and requires designing consistent data sets.
Collapse
Affiliation(s)
| | | | | | - Jean Michel Cucchi
- Centre Hospitalier Princesse Grâce, Avenue Pasteur, 98000, Monaco, Monaco
| | | |
Collapse
|
23
|
Rizzetto F, Calderoni F, De Mattia C, Defeudis A, Giannini V, Mazzetti S, Vassallo L, Ghezzi S, Sartore-Bianchi A, Marsoni S, Siena S, Regge D, Torresin A, Vanzulli A. Impact of inter-reader contouring variability on textural radiomics of colorectal liver metastases. Eur Radiol Exp 2020; 4:62. [PMID: 33169295 PMCID: PMC7652946 DOI: 10.1186/s41747-020-00189-8] [Citation(s) in RCA: 30] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2020] [Accepted: 10/13/2020] [Indexed: 12/13/2022] Open
Abstract
BACKGROUND Radiomics is expected to improve the management of metastatic colorectal cancer (CRC). We aimed at evaluating the impact of liver lesion contouring as a source of variability on radiomic features (RFs). METHODS After Ethics Committee approval, 70 liver metastases in 17 CRC patients were segmented on contrast-enhanced computed tomography scans by two residents and checked by experienced radiologists. RFs from grey level co-occurrence and run length matrices were extracted from three-dimensional (3D) regions of interest (ROIs) and the largest two-dimensional (2D) ROIs. Inter-reader variability was evaluated with Dice coefficient and Hausdorff distance, whilst its impact on RFs was assessed using mean relative change (MRC) and intraclass correlation coefficient (ICC). For the main lesion of each patient, one reader also segmented a circular ROI on the same image used for the 2D ROI. RESULTS The best inter-reader contouring agreement was observed for 2D ROIs according to both Dice coefficient (median 0.85, interquartile range 0.78-0.89) and Hausdorff distance (0.21 mm, 0.14-0.31 mm). Comparing RF values, MRC ranged 0-752% for 2D and 0-1567% for 3D. For 24/32 RFs (75%), MRC was lower for 2D than for 3D. An ICC > 0.90 was observed for more RFs for 2D (53%) than for 3D (34%). Only 2/32 RFs (6%) showed a variability between 2D and circular ROIs higher than inter-reader variability. CONCLUSIONS A 2D contouring approach may help mitigate overall inter-reader variability, albeit stable RFs can be extracted from both 3D and 2D segmentations of CRC liver metastases.
Collapse
Affiliation(s)
- Francesco Rizzetto
- Department of Radiology, ASST Grande Ospedale Metropolitano Niguarda, Piazza Ospedale Maggiore 3, 20162, Milan, Italy
| | - Francesca Calderoni
- Department of Medical Physics, ASST Grande Ospedale Metropolitano Niguarda, Piazza Ospedale Maggiore 3, 20162, Milan, Italy
| | - Cristina De Mattia
- Department of Medical Physics, ASST Grande Ospedale Metropolitano Niguarda, Piazza Ospedale Maggiore 3, 20162, Milan, Italy
| | - Arianna Defeudis
- Department of Surgical Sciences, University of Turin, via Verdi 8, 10124, Turin, Italy
- Radiology Unit, Candiolo Cancer Institute, FPO-IRCCS, Strada Provinciale 142 km 3.95, 10060, Candiolo, Turin, Italy
| | - Valentina Giannini
- Department of Surgical Sciences, University of Turin, via Verdi 8, 10124, Turin, Italy
- Radiology Unit, Candiolo Cancer Institute, FPO-IRCCS, Strada Provinciale 142 km 3.95, 10060, Candiolo, Turin, Italy
| | - Simone Mazzetti
- Department of Surgical Sciences, University of Turin, via Verdi 8, 10124, Turin, Italy
- Radiology Unit, Candiolo Cancer Institute, FPO-IRCCS, Strada Provinciale 142 km 3.95, 10060, Candiolo, Turin, Italy
| | - Lorenzo Vassallo
- Radiology Unit, SS Annunziata Hospital ASLCN1 Cuneo, via Ospedali 14, 12038, Cuneo, Savigliano, Italy
| | - Silvia Ghezzi
- Niguarda Cancer Center, Grande Ospedale Metropolitano Niguarda, Piazza Ospedale Maggiore 3, 20162, Milan, Italy
| | - Andrea Sartore-Bianchi
- Niguarda Cancer Center, Grande Ospedale Metropolitano Niguarda, Piazza Ospedale Maggiore 3, 20162, Milan, Italy
- Department of Oncology and Hemato-Oncology, Università degli Studi di Milano, via Festa del Perdono 7, 20122, Milan, Italy
| | - Silvia Marsoni
- Precision Oncology, IFOM - The FIRC Institute of Molecular Oncology, via Adamello 16, 20139, Milan, Italy
| | - Salvatore Siena
- Niguarda Cancer Center, Grande Ospedale Metropolitano Niguarda, Piazza Ospedale Maggiore 3, 20162, Milan, Italy
- Department of Oncology and Hemato-Oncology, Università degli Studi di Milano, via Festa del Perdono 7, 20122, Milan, Italy
| | - Daniele Regge
- Department of Surgical Sciences, University of Turin, via Verdi 8, 10124, Turin, Italy
- Radiology Unit, Candiolo Cancer Institute, FPO-IRCCS, Strada Provinciale 142 km 3.95, 10060, Candiolo, Turin, Italy
| | - Alberto Torresin
- Department of Medical Physics, ASST Grande Ospedale Metropolitano Niguarda, Piazza Ospedale Maggiore 3, 20162, Milan, Italy
- Department of Physics, Università degli Studi di Milano, via Giovanni Celoria 16, 20133, Milan, Italy
| | - Angelo Vanzulli
- Department of Radiology, ASST Grande Ospedale Metropolitano Niguarda, Piazza Ospedale Maggiore 3, 20162, Milan, Italy.
- Department of Oncology and Hemato-Oncology, Università degli Studi di Milano, via Festa del Perdono 7, 20122, Milan, Italy.
| |
Collapse
|
24
|
Reproducibility of CT texture features of pancreatic neuroendocrine neoplasms. Eur J Radiol 2020; 133:109371. [PMID: 33126173 DOI: 10.1016/j.ejrad.2020.109371] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2020] [Revised: 10/14/2020] [Accepted: 10/19/2020] [Indexed: 12/12/2022]
Abstract
PURPOSE To evaluate the reproducibility of textural features of pancreatic neuroendocrine neoplasms (PNENs), obtained under various CT-scanning conditions. METHODS AND MATERIALS We included 12 patients with PNENs and 2 contrast enhanced CT (CECT): 1) from our center according to standard CT-protocol; 2) from another institution. Two radiologists independently segmented the entire neoplasm volume using a 3D region of interest by LIFEx application on the arterial phase and then copied it to the other phases. 52 texture features were calculated for each phase. As a criterion for the segmentation consistency, a value of neoplasm volume was compared using the Bland-Altman method. The Kendall concordance coefficient was calculated to assess the texture features reproducibility in three scenarios: 1) different radiologists, same CECT; 2) same radiologist, different CECT; 3) different radiologists, different CECT. RESULTS For the scenario 1 the neoplasm volumes (except one large PNEN) were found within two standard deviations; this indicates high consistency of the segmentation. For the first scenario, Kendall's coefficient exceeded a threshold of 0.7 for all 52 features for all CT phases. For the second and third scenario, the concordance coefficient exceeded a threshold of 0.7 in 38, 28, 42, 45 and in 36, 25, 36, 44 features for the native, arterial, venous and delayed phases, respectively. CONCLUSION The highest reproducibility was found in the first scenario compared to the second and third: 100 % vs. 74 % and 67 %. Reproducible texture features can be reliably used to assess the PNENs structure.
Collapse
|
25
|
Dreher C, Linde P, Boda-Heggemann J, Baessler B. Radiomics for liver tumours. Strahlenther Onkol 2020; 196:888-899. [PMID: 32296901 PMCID: PMC7498486 DOI: 10.1007/s00066-020-01615-x] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2020] [Accepted: 03/20/2020] [Indexed: 12/15/2022]
Abstract
Current research, especially in oncology, increasingly focuses on the integration of quantitative, multiparametric and functional imaging data. In this fast-growing field of research, radiomics may allow for a more sophisticated analysis of imaging data, far beyond the qualitative evaluation of visible tissue changes. Through use of quantitative imaging data, more tailored and tumour-specific diagnostic work-up and individualized treatment concepts may be applied for oncologic patients in the future. This is of special importance in cross-sectional disciplines such as radiology and radiation oncology, with already high and still further increasing use of imaging data in daily clinical practice. Liver targets are generally treated with stereotactic body radiotherapy (SBRT), allowing for local dose escalation while preserving surrounding normal tissue. With the introduction of online target surveillance with implanted markers, 3D-ultrasound on conventional linacs and hybrid magnetic resonance imaging (MRI)-linear accelerators, individualized adaptive radiotherapy is heading towards realization. The use of big data such as radiomics and the integration of artificial intelligence techniques have the potential to further improve image-based treatment planning and structured follow-up, with outcome/toxicity prediction and immediate detection of (oligo)progression. The scope of current research in this innovative field is to identify and critically discuss possible application forms of radiomics, which is why this review tries to summarize current knowledge about interdisciplinary integration of radiomics in oncologic patients, with a focus on investigations of radiotherapy in patients with liver cancer or oligometastases including multiparametric, quantitative data into (radio)-oncologic workflow from disease diagnosis, treatment planning, delivery and patient follow-up.
Collapse
Affiliation(s)
- Constantin Dreher
- Department of Radiation Oncology, University Hospital Mannheim, Medical Faculty of Mannheim, University of Heidelberg, Theodor-Kutzer Ufer 1–3, 68167 Mannheim, Germany
| | - Philipp Linde
- Department of Radiation Oncology, Medical Faculty and University Hospital Cologne, University of Cologne, Kerpener Str. 62, 50937 Cologne, Germany
| | - Judit Boda-Heggemann
- Department of Radiation Oncology, University Hospital Mannheim, Medical Faculty of Mannheim, University of Heidelberg, Theodor-Kutzer Ufer 1–3, 68167 Mannheim, Germany
| | - Bettina Baessler
- Institute of Diagnostic and Interventional Radiology, University Hospital Zurich, Raemistrasse 100, 8091 Zurich, Switzerland
| |
Collapse
|
26
|
Masokano IB, Liu W, Xie S, Marcellin DFH, Pei Y, Li W. The application of texture quantification in hepatocellular carcinoma using CT and MRI: a review of perspectives and challenges. Cancer Imaging 2020; 20:67. [PMID: 32962762 PMCID: PMC7510095 DOI: 10.1186/s40644-020-00341-y] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2020] [Accepted: 08/31/2020] [Indexed: 02/06/2023] Open
Abstract
Recently, radiomic texture quantification of tumors has received much attention from radiologists, scientists, and stakeholders because several results have shown the feasibility of using the technique to diagnose and manage oncological conditions. In patients with hepatocellular carcinoma, radiomics has been applied in all stages of tumor evaluation, including diagnosis and characterization of the genotypic behavior of the tumor, monitoring of treatment responses and prediction of various clinical endpoints. It is also useful in selecting suitable candidates for specific treatment strategies. However, the clinical validation of hepatocellular carcinoma radiomics is limited by challenges in imaging protocol and data acquisition parameters, challenges in segmentation techniques, dimensionality reduction, and modeling methods. Identification of the best segmentation and optimal modeling methods, as well as texture features most stable to imaging protocol variability would go a long way in harmonizing HCC radiomics for personalized patient care. This article reviews the process of HCC radiomics, its clinical applications, associated challenges, and current optimization strategies.
Collapse
Affiliation(s)
- Ismail Bilal Masokano
- Department of Radiology, Xiangya Hospital, Central South University, Changsha, 410008, Hunan, China
| | - Wenguang Liu
- Department of Radiology, Xiangya Hospital, Central South University, Changsha, 410008, Hunan, China
| | - Simin Xie
- Department of Radiology, Xiangya Hospital, Central South University, Changsha, 410008, Hunan, China
| | | | - Yigang Pei
- Department of Radiology, Xiangya Hospital, Central South University, Changsha, 410008, Hunan, China.
| | - Wenzheng Li
- Department of Radiology, Xiangya Hospital, Central South University, Changsha, 410008, Hunan, China.
| |
Collapse
|
27
|
Abstract
CLINICAL ISSUE The reproducible and exhaustive extraction of information from radiological images is a central task in the practice of radiology. Dynamic developments in the fields of artificial intelligence (AI) and machine learning are introducing new methods for this task. Radiomics is one such method and offers new opportunities and challenges for the future of radiology. METHODOLOGICAL INNOVATIONS Radiomics describes the quantitative evaluation, interpretation, and clinical assessment of imaging markers in radiological data. Components of a radiomics analysis are data acquisition, data preprocessing, data management, segmentation of regions of interest, computation and selection of imaging markers, as well as the development of a radiomics model used for diagnosis and prognosis. This article explains these components and aims at providing an introduction to the field of radiomics while highlighting existing limitations. MATERIALS AND METHODS This article is based on a selective literature search with the PubMed search engine. ASSESSMENT Even though radiomics applications have yet to arrive in routine clinical practice, the quantification of radiological data in terms of radiomics is underway and will increase in the future. This holds the potential for lasting change in the discipline of radiology. Through the successful extraction and interpretation of all the information encoded in radiological images the next step in the direction of a more personalized, future-oriented form of medicine can be taken.
Collapse
Affiliation(s)
- Jacob M Murray
- AG Computational Radiology, Department of Radiology, German Cancer Research Center (DKFZ), Im Neuenheimer Feld 280, 69120, Heidelberg, Deutschland.,Heidelberg University, Heidelberg, Deutschland
| | - Georgios Kaissis
- Department of Diagnostic and Interventional Radiology, School of Medicine, Technical University of Munich, München, Deutschland
| | - Rickmer Braren
- Department of Diagnostic and Interventional Radiology, School of Medicine, Technical University of Munich, München, Deutschland
| | - Jens Kleesiek
- AG Computational Radiology, Department of Radiology, German Cancer Research Center (DKFZ), Im Neuenheimer Feld 280, 69120, Heidelberg, Deutschland. .,German Cancer Consortium (DKTK), Heidelberg, Deutschland.
| |
Collapse
|
28
|
Sha X, Gong G, Qiu Q, Duan J, Li D, Yin Y. Discrimination of mediastinal metastatic lymph nodes in NSCLC based on radiomic features in different phases of CT imaging. BMC Med Imaging 2020; 20:12. [PMID: 32024469 PMCID: PMC7003415 DOI: 10.1186/s12880-020-0416-3] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2019] [Accepted: 01/27/2020] [Indexed: 12/13/2022] Open
Abstract
BACKGROUND We aimed to develop radiomic models based on different phases of computed tomography (CT) imaging and to investigate the efficacy of models for diagnosing mediastinal metastatic lymph nodes (LNs) in non-small cell lung cancer (NSCLC). METHODS Eighty-six NSCLC patients were enrolled in this study, and we selected 231 mediastinal LNs confirmed by pathology results as the subjects which were divided into training (n = 163) and validation cohorts (n = 68). The regions of interest (ROIs) were delineated on CT scans in the plain phase, arterial phase and venous phase, respectively. Radiomic features were extracted from the CT images in each phase. A least absolute shrinkage and selection operator (LASSO) algorithm was used to select features, and multivariate logistic regression analysis was used to build models. We constructed six models (orders 1-6) based on the radiomic features of the single- and dual-phase CT images. The performance of the radiomic model was evaluated by the area under the receiver operating characteristic curve (AUC), sensitivity, specificity, accuracy, positive predictive value (PPV) and negative predictive value (NPV). RESULTS A total of 846 features were extracted from each ROI, and 10, 9, 5, 2, 2, and 9 features were chosen to develop models 1-6, respectively. All of the models showed excellent discrimination, with AUCs greater than 0.8. The plain CT radiomic model, model 1, yielded the highest AUC, specificity, accuracy and PPV, which were 0.926 and 0.925; 0.860 and 0.769; 0.871 and 0.882; and 0.906 and 0.870 in the training and validation sets, respectively. When the plain and venous phase CT radiomic features were combined with the arterial phase CT images, the sensitivity increased from 0.879 and 0.919 to 0.949 and 0979 and the NPV increased from 0.821 and 0.789 to 0.878 and 0.900 in the training group, respectively. CONCLUSIONS All of the CT radiomic models based on different phases all showed high accuracy and precision for the diagnosis of LN metastasis (LNM) in NSCLC patients. When combined with arterial phase CT, the sensitivity and NPV of the model was be further improved.
Collapse
Affiliation(s)
- Xue Sha
- Shandong Key Laboratory of Medical Physics and Image Processing & Shandong Provincial Engineering and Technical Center of Light Manipulations, School of Physics and Electronics, Shandong Normal University, Jinan, 250358, China
| | - Guanzhong Gong
- Department of Radiation Oncology, Shandong Cancer Hospital and Institute, Shandong First Medical University and Shandong Academy of Medical Sciences, No.440, Jiyan Road, Jinan, 250117, Shandong, China
| | - Qingtao Qiu
- Department of Radiation Oncology, Shandong Cancer Hospital and Institute, Shandong First Medical University and Shandong Academy of Medical Sciences, No.440, Jiyan Road, Jinan, 250117, Shandong, China
| | - Jinghao Duan
- Department of Radiation Oncology, Shandong Cancer Hospital and Institute, Shandong First Medical University and Shandong Academy of Medical Sciences, No.440, Jiyan Road, Jinan, 250117, Shandong, China
| | - Dengwang Li
- Shandong Key Laboratory of Medical Physics and Image Processing & Shandong Provincial Engineering and Technical Center of Light Manipulations, School of Physics and Electronics, Shandong Normal University, Jinan, 250358, China
| | - Yong Yin
- Shandong Key Laboratory of Medical Physics and Image Processing & Shandong Provincial Engineering and Technical Center of Light Manipulations, School of Physics and Electronics, Shandong Normal University, Jinan, 250358, China.
- Department of Radiation Oncology, Shandong Cancer Hospital and Institute, Shandong First Medical University and Shandong Academy of Medical Sciences, No.440, Jiyan Road, Jinan, 250117, Shandong, China.
| |
Collapse
|
29
|
Miranda Magalhaes Santos JM, Clemente Oliveira B, Araujo-Filho JDAB, Assuncao-Jr AN, de M Machado FA, Carlos Tavares Rocha C, Horvat JV, Menezes MR, Horvat N. State-of-the-art in radiomics of hepatocellular carcinoma: a review of basic principles, applications, and limitations. Abdom Radiol (NY) 2020; 45:342-353. [PMID: 31707435 DOI: 10.1007/s00261-019-02299-3] [Citation(s) in RCA: 37] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
Radiomics is a new field in medical imaging with the potential of changing medical practice. Radiomics is characterized by the extraction of several quantitative imaging features which are not visible to the naked eye from conventional imaging modalities, and its correlation with specific relevant clinical endpoints, such as pathology, therapeutic response, and survival. Several studies have evaluated the use of radiomics in patients with hepatocellular carcinoma (HCC) with encouraging results, particularly in the pretreatment prediction of tumor biological characteristics, risk of recurrence, and survival. In spite of this, there are limitations and challenges to be overcome before the implementation of radiomics into clinical routine. In this article, we will review the concepts of radiomics and their current potential applications in patients with HCC. It is important that the multidisciplinary team involved in the treatment of patients with HCC be aware of the basic principles, benefits, and limitations of radiomics in order to achieve a balanced interpretation of the results toward a personalized medicine.
Collapse
Affiliation(s)
| | - Brunna Clemente Oliveira
- Department of Radiology, Hospital Sírio-Libanês, Adma Jafet, 91, Bela Vista, São Paulo, SP, 01308-050, Brazil
- Department of Radiology, Hospital Samaritano, São Paulo, Brazil
| | | | | | | | | | - Joao Vicente Horvat
- Department of Radiology, University of São Paulo, São Paulo, Brazil
- Department of Radiology, Hospital Sírio-Libanês, Adma Jafet, 91, Bela Vista, São Paulo, SP, 01308-050, Brazil
| | - Marcos Roberto Menezes
- Department of Radiology, University of São Paulo, São Paulo, Brazil
- Department of Radiology, Hospital Sírio-Libanês, Adma Jafet, 91, Bela Vista, São Paulo, SP, 01308-050, Brazil
| | - Natally Horvat
- Department of Radiology, University of São Paulo, São Paulo, Brazil.
- Department of Radiology, Hospital Sírio-Libanês, Adma Jafet, 91, Bela Vista, São Paulo, SP, 01308-050, Brazil.
| |
Collapse
|
30
|
Ma J, Dercle L, Lichtenstein P, Wang D, Chen A, Zhu J, Piessevaux H, Zhao J, Schwartz LH, Lu L, Zhao B. Automated Identification of Optimal Portal Venous Phase Timing with Convolutional Neural Networks. Acad Radiol 2020; 27:e10-e18. [PMID: 31151901 DOI: 10.1016/j.acra.2019.02.024] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2019] [Revised: 02/25/2019] [Accepted: 02/26/2019] [Indexed: 12/15/2022]
Abstract
OBJECTIVES To develop a deep learning-based algorithm to automatically identify optimal portal venous phase timing (PVP-timing) so that image analysis techniques can be accurately performed on post contrast studies. METHODS 681 CT-scans (training: 479 CT-scans; validation: 202 CT-scans) from a multicenter clinical trial in patients with liver metastases from colorectal cancer were retrospectively analyzed for algorithm development and validation. An additional external validation was performed on a cohort of 228 CT-scans from gastroenteropancreatic neuroendocrine cancer patients. Image acquisition was performed according to each centers' standard CT protocol for single portal venous phase, portal venous acquisition. The reference gold standard for the classification of PVP-timing as either optimal or nonoptimal was based on experienced radiologists' consensus opinion. The algorithm performed automated localization (on axial slices) of the portal vein and aorta upon which a novel dual input Convolutional Neural Network calculated a probability of the optimal PVP-timing. RESULTS The algorithm automatically computed a PVP-timing score in 3 seconds and reached area under the curve of 0.837 (95% CI: 0.765, 0.890) in validation set and 0.844 (95% CI: 0.786, 0.889) in external validation set. CONCLUSION A fully automated, deep-learning derived PVP-timing algorithm was developed to classify scans' contrast-enhancement timing and identify scans with optimal PVP-timing. The rapid identification of such scans will aid in the analysis of quantitative (radiomics) features used to characterize tumors and changes in enhancement with treatment in a multitude of settings including quantitative response criteria such as Choi and MASS which rely on reproducible measurement of enhancement.
Collapse
Affiliation(s)
- Jingchen Ma
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China; Department of Radiology, Columbia University Medical Center, 630 West 168th Street, New York, NY 10032
| | - Laurent Dercle
- Department of Radiology, Columbia University Medical Center, 630 West 168th Street, New York, NY 10032; Gustave Roussy, Université Paris-Saclay, Université Paris-Saclay, Département D'imagerie Médicale, Villejuif, France
| | - Philip Lichtenstein
- Department of Radiology, Columbia University Medical Center, 630 West 168th Street, New York, NY 10032
| | - Deling Wang
- Department of Medical Imaging, Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Guangzhou, Guangdong, China
| | - Aiping Chen
- Department of Radiology, First Affiliated Hospital of NanJing Medical University, Nanjing, China
| | - Jianguo Zhu
- Department of Radiology, the Second Affiliated Hospital of Nanjing Medical University, Nanjing, China
| | | | - Jun Zhao
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Lawrence H Schwartz
- Department of Radiology, Columbia University Medical Center, 630 West 168th Street, New York, NY 10032
| | - Lin Lu
- Department of Radiology, Columbia University Medical Center, 630 West 168th Street, New York, NY 10032.
| | - Binsheng Zhao
- Department of Radiology, Columbia University Medical Center, 630 West 168th Street, New York, NY 10032
| |
Collapse
|
31
|
Golia Pernicka JS, Gagniere J, Chakraborty J, Yamashita R, Nardo L, Creasy JM, Petkovska I, Do RRK, Bates DDB, Paroder V, Gonen M, Weiser MR, Simpson AL, Gollub MJ. Radiomics-based prediction of microsatellite instability in colorectal cancer at initial computed tomography evaluation. Abdom Radiol (NY) 2019; 44:3755-3763. [PMID: 31250180 PMCID: PMC6824954 DOI: 10.1007/s00261-019-02117-w] [Citation(s) in RCA: 66] [Impact Index Per Article: 13.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/29/2022]
Abstract
PURPOSE To predict microsatellite instability (MSI) status of colon cancer on preoperative CT imaging using radiomic analysis. METHODS This retrospective study involved radiomic analysis of preoperative CT imaging of patients who underwent resection of stage II-III colon cancer from 2004 to 2012. A radiologist blinded to MSI status manually segmented the tumor region on CT images. 254 Intensity-based radiomic features were extracted from the tumor region. Three prediction models were developed with (1) only clinical features, (2) only radiomic features, and (3) "combined" clinical and radiomic features. Patients were randomly separated into training (n = 139) and test (n = 59) sets. The model was constructed from training data only; the test set was reserved for validation only. Model performance was evaluated using AUC, sensitivity, specificity, PPV, and NPV. RESULTS Of the total 198 patients, 134 (68%) patients had microsatellite stable tumors and 64 (32%) patients had MSI tumors. The combined model performed slightly better than the other models, predicting MSI with an AUC of 0.80 for the training set and 0.79 for the test set (specificity = 96.8% and 92.5%, respectively), whereas the model with only clinical features achieved an AUC of 0.74 and the model with only radiomic features achieved an AUC of 0.76. The model with clinical features alone had the lowest specificity (70%) compared with the model with radiomic features alone (95%) and the combined model (92.5%). CONCLUSIONS Preoperative prediction of MSI status via radiomic analysis of preoperative CT adds specificity to clinical assessment and could contribute to personalized treatment selection.
Collapse
Affiliation(s)
- Jennifer S Golia Pernicka
- Body Imaging Service, Department of Radiology, Evelyn H. Lauder Breast Center, Memorial Sloan Kettering Cancer Center, 300 East 66th St., Suite 757, New York, NY, 10065, USA.
| | - Johan Gagniere
- Department of Surgery, Memorial Sloan Kettering Cancer Center, New York, NY, USA
- Department of Digestive and Hepatobiliary Surgery, U1071 INSERM / Clermont-Auvergne University, University Hospital of Clermont-Ferrand, Clermont-Ferrand, France
| | - Jayasree Chakraborty
- Department of Surgery, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Rikiya Yamashita
- Body Imaging Service, Department of Radiology, Evelyn H. Lauder Breast Center, Memorial Sloan Kettering Cancer Center, 300 East 66th St., Suite 757, New York, NY, 10065, USA
| | - Lorenzo Nardo
- Body Imaging Service, Department of Radiology, Evelyn H. Lauder Breast Center, Memorial Sloan Kettering Cancer Center, 300 East 66th St., Suite 757, New York, NY, 10065, USA
- Department of Radiology, University of California Davis, Sacramento, CA, USA
| | - John M Creasy
- Department of Surgery, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Iva Petkovska
- Body Imaging Service, Department of Radiology, Evelyn H. Lauder Breast Center, Memorial Sloan Kettering Cancer Center, 300 East 66th St., Suite 757, New York, NY, 10065, USA
| | - Richard R K Do
- Body Imaging Service, Department of Radiology, Evelyn H. Lauder Breast Center, Memorial Sloan Kettering Cancer Center, 300 East 66th St., Suite 757, New York, NY, 10065, USA
| | - David D B Bates
- Body Imaging Service, Department of Radiology, Evelyn H. Lauder Breast Center, Memorial Sloan Kettering Cancer Center, 300 East 66th St., Suite 757, New York, NY, 10065, USA
| | - Viktoriya Paroder
- Body Imaging Service, Department of Radiology, Evelyn H. Lauder Breast Center, Memorial Sloan Kettering Cancer Center, 300 East 66th St., Suite 757, New York, NY, 10065, USA
| | - Mithat Gonen
- Department of Epidemiology & Biostatistics, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Martin R Weiser
- Department of Surgery, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Amber L Simpson
- Department of Surgery, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Marc J Gollub
- Body Imaging Service, Department of Radiology, Evelyn H. Lauder Breast Center, Memorial Sloan Kettering Cancer Center, 300 East 66th St., Suite 757, New York, NY, 10065, USA
| |
Collapse
|
32
|
Yamashita R, Perrin T, Chakraborty J, Chou JF, Horvat N, Koszalka MA, Midya A, Gonen M, Allen P, Jarnagin WR, Simpson AL, Do RKG. Radiomic feature reproducibility in contrast-enhanced CT of the pancreas is affected by variabilities in scan parameters and manual segmentation. Eur Radiol 2019; 30:195-205. [PMID: 31392481 DOI: 10.1007/s00330-019-06381-8] [Citation(s) in RCA: 44] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2019] [Revised: 07/07/2019] [Accepted: 07/19/2019] [Indexed: 02/07/2023]
Abstract
OBJECTIVES This study aims to measure the reproducibility of radiomic features in pancreatic parenchyma and ductal adenocarcinomas (PDAC) in patients who underwent consecutive contrast-enhanced computed tomography (CECT) scans. METHODS In this IRB-approved and HIPAA-compliant retrospective study, 37 pairs of scans from 37 unique patients who underwent CECTs within a 2-week interval were included in the analysis of the reproducibility of features derived from pancreatic parenchyma, and a subset of 18 pairs of scans were further analyzed for the reproducibility of features derived from PDAC. In each patient, pancreatic parenchyma and pancreatic tumor (when present) were manually segmented by two radiologists independently. A total of 266 radiomic features were extracted from the pancreatic parenchyma and tumor region and also the volume and diameter of the tumor. The concordance correlation coefficient (CCC) was calculated to assess feature reproducibility for each patient in three scenarios: (1) different radiologists, same CECT; (2) same radiologist, different CECTs; and (3) different radiologists, different CECTs. RESULTS Among pancreatic parenchyma-derived features, using a threshold of CCC > 0.90, 58/266 (21.8%) and 48/266 (18.1%) features met the threshold for scenario 1, 14/266 (5.3%) and 15/266 (5.6%) for scenario 2, and 14/266 (5.3%) and 10/266 (3.8%) for scenario 3. Among pancreatic tumor-derived features, 11/268 (4.1%) and 17/268 (6.3%) features met the threshold for scenario 1, 1/268 (0.4%) and 5/268 (1.9%) features met the threshold for scenario 2, and no features for scenario 3 met the threshold, respectively. CONCLUSIONS Variations between CECT scans affected radiomic feature reproducibility to a greater extent than variation in segmentation. A smaller number of pancreatic tumor-derived radiomic features were reproducible compared with pancreatic parenchyma-derived radiomic features under the same conditions. KEY POINTS • For pancreatic-derived radiomic features from contrast-enhanced CT (CECT), fewer than 25% are reproducible (with a threshold of CCC < 0.9) in a clinical heterogeneous dataset. • Variations between CECT scans affected the number of reproducible radiomic features to a greater extent than variations in radiologist segmentation. • A smaller number of pancreatic tumor-derived radiomic features were reproducible compared with pancreatic parenchyma-derived radiomic features under the same conditions.
Collapse
Affiliation(s)
- Rikiya Yamashita
- Department of Radiology, Memorial Sloan Kettering Cancer Center, 1275 York Avenue, New York, NY, 10065, USA
| | - Thomas Perrin
- Department of Surgery, Memorial Sloan Kettering Cancer Center, 1275 York Avenue, New York, NY, 10065, USA
| | - Jayasree Chakraborty
- Department of Surgery, Memorial Sloan Kettering Cancer Center, 1275 York Avenue, New York, NY, 10065, USA
| | - Joanne F Chou
- Department of Epidemiology and Biostatistics, Memorial Sloan Kettering Cancer Center, 1275 York Avenue, New York, NY, 10065, USA
| | - Natally Horvat
- Department of Radiology, Memorial Sloan Kettering Cancer Center, 1275 York Avenue, New York, NY, 10065, USA
| | - Maura A Koszalka
- Department of Surgery, Memorial Sloan Kettering Cancer Center, 1275 York Avenue, New York, NY, 10065, USA
| | - Abhishek Midya
- Department of Surgery, Memorial Sloan Kettering Cancer Center, 1275 York Avenue, New York, NY, 10065, USA
| | - Mithat Gonen
- Department of Epidemiology and Biostatistics, Memorial Sloan Kettering Cancer Center, 1275 York Avenue, New York, NY, 10065, USA
| | - Peter Allen
- Department of Surgery, Memorial Sloan Kettering Cancer Center, 1275 York Avenue, New York, NY, 10065, USA
| | - William R Jarnagin
- Department of Surgery, Memorial Sloan Kettering Cancer Center, 1275 York Avenue, New York, NY, 10065, USA
| | - Amber L Simpson
- Department of Surgery, Memorial Sloan Kettering Cancer Center, 1275 York Avenue, New York, NY, 10065, USA
| | - Richard K G Do
- Department of Radiology, Memorial Sloan Kettering Cancer Center, 1275 York Avenue, New York, NY, 10065, USA.
| |
Collapse
|
33
|
Repeatability and reproducibility of MRI-based radiomic features in cervical cancer. Radiother Oncol 2019; 135:107-114. [DOI: 10.1016/j.radonc.2019.03.001] [Citation(s) in RCA: 82] [Impact Index Per Article: 16.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2018] [Revised: 03/02/2019] [Accepted: 03/04/2019] [Indexed: 02/05/2023]
|
34
|
Bodalal Z, Trebeschi S, Nguyen-Kim TDL, Schats W, Beets-Tan R. Radiogenomics: bridging imaging and genomics. Abdom Radiol (NY) 2019; 44:1960-1984. [PMID: 31049614 DOI: 10.1007/s00261-019-02028-w] [Citation(s) in RCA: 165] [Impact Index Per Article: 33.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/08/2023]
Abstract
From diagnostics to prognosis to response prediction, new applications for radiomics are rapidly being developed. One of the fastest evolving branches involves linking imaging phenotypes to the tumor genetic profile, a field commonly referred to as "radiogenomics." In this review, a general outline of radiogenomic literature concerning prominent mutations across different tumor sites will be provided. The field of radiogenomics originates from image processing techniques developed decades ago; however, many technical and clinical challenges still need to be addressed. Nevertheless, increasingly accurate and robust radiogenomic models are being presented and the future appears to be bright.
Collapse
|
35
|
Cannella R, Borhani AA, Tublin M, Behari J, Furlan A. Diagnostic value of MR-based texture analysis for the assessment of hepatic fibrosis in patients with nonalcoholic fatty liver disease (NAFLD). Abdom Radiol (NY) 2019; 44:1816-1824. [PMID: 30788556 DOI: 10.1007/s00261-019-01931-6] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
PURPOSE To investigate the performance of MR-based texture analysis (TA) for the assessment of hepatic fibrosis in patients with nonalcoholic fatty liver disease (NAFLD). METHODS Fifty-four adult patients (33 females, 21 males, mean age 49.8 ± 13.5 years) with biopsy-proven NAFLD were enrolled and underwent MR imaging on a 1.5 T system. TA parameters were extracted on axial noncontrast 3D-GRE T1W images (slice thickness = 4.6 mm) using a commercially available research software (TexRAD). Receiver operating curves (ROC), areas under the ROC (AUROC) and 95% confidence intervals (CI) were calculated to assess the accuracy of each TA parameter for the diagnosis of significant (F ≥ 2) and advanced fibrosis (F ≥ 3). The correlation between TA and histopathological features of nonalcoholic steatohepatitis (NASH) was tested calculating the Spearman's rank correlation coefficient (ρ). RESULTS Thirty-seven (68%) subjects had significant fibrosis and 20 (37%) had advanced fibrosis. The TA parameters with the best performance were standard deviation (SD) and entropy, respectively, with AUROC 0.755 (95% CI 0.619-0.862, p ≤ 0.0002) and 0.769 (95% CI 0.634-0.873, p < 0.0001) for significant fibrosis and AUROC 0.746 (95% CI 0.609-0.854, p ≤ 0.0004) and 0.754 (95% CI 0.618-0.861, p ≤ 0.0002) for advanced fibrosis. SD and entropy demonstrated a moderate correlation with the degree of fibrosis (ρ = 0.457 and 0.480; p < 0.01). No significant correlation was found between TA parameters and other histopathological features of NASH. CONCLUSIONS Entropy and SD extracted on T1-weighted MR images have fair accuracy for the diagnosis of significant and advanced hepatic fibrosis in patients with NAFLD.
Collapse
Affiliation(s)
- Roberto Cannella
- Department of Radiology, University of Pittsburgh School of Medicine, 200 Lothrop Street, Pittsburgh, PA, 15213, USA
- Section of Radiology - Di.Bi.Med, University Hospital "Paolo Giaccone", Via del Vespro 129, 90127, Palermo, Italy
| | - Amir A Borhani
- Department of Radiology, University of Pittsburgh School of Medicine, 200 Lothrop Street, Pittsburgh, PA, 15213, USA
| | - Mitchell Tublin
- Department of Radiology, University of Pittsburgh School of Medicine, 200 Lothrop Street, Pittsburgh, PA, 15213, USA
| | - Jaideep Behari
- Department of Medicine, Division of Gastroenterology, Hepatology and Nutrition, University of Pittsburgh School of Medicine, Pittsburgh, PA, 15213, USA
| | - Alessandro Furlan
- Department of Radiology, University of Pittsburgh School of Medicine, 200 Lothrop Street, Pittsburgh, PA, 15213, USA.
| |
Collapse
|
36
|
E L, Lu L, Li L, Yang H, Schwartz LH, Zhao B. Radiomics for Classifying Histological Subtypes of Lung Cancer Based on Multiphasic Contrast-Enhanced Computed Tomography. J Comput Assist Tomogr 2019; 43:300-306. [PMID: 30664116 DOI: 10.1097/rct.0000000000000836] [Citation(s) in RCA: 47] [Impact Index Per Article: 9.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023]
Abstract
OBJECTIVES The aim of this study was to evaluate the performance of the radiomics method in classifying lung cancer histological subtypes based on multiphasic contrast-enhanced computed tomography (CT) images. METHODS A total of 229 patients with pathologically confirmed lung cancer were retrospectively recruited. All recruited patients underwent nonenhanced and dual-phase chest contrast-enhanced CT; 1160 quantitative radiomics features were calculated to build a radiomics classification model. The performance of the classification models was evaluated by the receiver operating characteristic curve. RESULTS The areas under the curve of radiomics models in classifying adenocarcinoma and squamous cell carcinoma, adenocarcinoma and small cell lung cancer, and squamous cell carcinoma and small cell lung cancer were 0.801, 0.857, and 0.657 (nonenhanced); 0.834, 0.855, and 0.619 (arterial phase); and 0.864, 0.864, and 0.664 (venous phase), respectively. Moreover, the application of contrast-enhanced CT may affect the selection of radiomics features. CONCLUSIONS Our study indicates that radiomics may be a promising tool for noninvasive predicting histological subtypes of lung cancer based on the multiphasic contrast-enhanced CT images.
Collapse
Affiliation(s)
| | - Lin Lu
- Department of Radiology, Columbia University Medical Center, New York, NY
| | - Li Li
- Department of Pathology, Shanxi DAYI Hospital, Taiyuan, Shanxi, China
| | - Hao Yang
- Department of Radiology, Columbia University Medical Center, New York, NY
| | | | - Binsheng Zhao
- Department of Radiology, Columbia University Medical Center, New York, NY
| |
Collapse
|
37
|
|
38
|
Parameters Influencing PET Imaging Features: A Phantom Study with Irregular and Heterogeneous Synthetic Lesions. CONTRAST MEDIA & MOLECULAR IMAGING 2018; 2018:5324517. [PMID: 30275800 PMCID: PMC6151367 DOI: 10.1155/2018/5324517] [Citation(s) in RCA: 20] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/23/2018] [Revised: 07/25/2018] [Accepted: 08/02/2018] [Indexed: 02/03/2023]
Abstract
Aim To evaluate reproducibility and stability of radiomic features as effects of the use of different volume segmentation methods and reconstruction settings. The potential of radiomics in really capturing the presence of heterogeneous tumor uptake and irregular shape was also investigated. Materials and Methods An anthropomorphic phantom miming real clinical situations including synthetic lesions with irregular shape and nonuniform radiotracer uptake was used. 18F-FDG PET/CT measurements of the phantom were performed including 38 lesions of different shape, size, lesion-to-background ratio, and radiotracer uptake distribution. Different reconstruction parameters and segmentation methods were considered. COVs were calculated to quantify feature variations over the different reconstruction settings. Friedman test was applied to the values of the radiomic features obtained for the considered segmentation approaches. Two sets of test-retest measurement were acquired and the pairwise intraclass correlation coefficient was calculated. Fifty-eight morphological and statistical features were extracted from the segmented lesion volumes. A Mann–Whitney test was used to evaluate significant differences among each feature when calculated from heterogeneous versus homogeneous uptake. The significance of each radiomic feature in terms of capturing heterogeneity was evaluated also by testing correlation with gold standard indexes of heterogeneity and sphericity. Results The choice of the segmentation method has a strong impact on the stability of radiomic features (less than 20% can be considered stable features). Reconstruction affects the estimate of radiomic features (only 26% are stable). Thirty-one radiomic features (53%) resulted to be reproducible, 11 of them are able to discriminate heterogeneity. Among these, we found a subset of 3 radiomic features strongly correlated with GS heterogeneity index that can be suggested as good features for retrospective evaluations.
Collapse
|
39
|
Morin O, Vallières M, Jochems A, Woodruff HC, Valdes G, Braunstein SE, Wildberger JE, Villanueva-Meyer JE, Kearney V, Yom SS, Solberg TD, Lambin P. A Deep Look Into the Future of Quantitative Imaging in Oncology: A Statement of Working Principles and Proposal for Change. Int J Radiat Oncol Biol Phys 2018; 102:1074-1082. [PMID: 30170101 DOI: 10.1016/j.ijrobp.2018.08.032] [Citation(s) in RCA: 77] [Impact Index Per Article: 12.8] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2018] [Revised: 08/21/2018] [Accepted: 08/21/2018] [Indexed: 12/13/2022]
Abstract
The adoption of enterprise digital imaging, along with the development of quantitative imaging methods and the re-emergence of statistical learning, has opened the opportunity for more personalized cancer treatments through transformative data science research. In the last 5 years, accumulating evidence has indicated that noninvasive advanced imaging analytics (i.e., radiomics) can reveal key components of tumor phenotype for multiple lesions at multiple time points over the course of treatment. Many groups using homegrown software have extracted engineered and deep quantitative features on 3-dimensional medical images for better spatial and longitudinal understanding of tumor biology and for the prediction of diverse outcomes. These developments could augment patient stratification and prognostication, buttressing emerging targeted therapeutic approaches. Unfortunately, the rapid growth in popularity of this immature scientific discipline has resulted in many early publications that miss key information or use underpowered patient data sets, without production of generalizable results. Quantitative imaging research is complex, and key principles should be followed to realize its full potential. The fields of quantitative imaging and radiomics in particular require a renewed focus on optimal study design and reporting practices, standardization, interpretability, data sharing, and clinical trials. Standardization of image acquisition, feature calculation, and statistical analysis (i.e., machine learning) are required for the field to move forward. A new data-sharing paradigm enacted among open and diverse participants (medical institutions, vendors and associations) should be embraced for faster development and comprehensive clinical validation of imaging biomarkers. In this review and critique of the field, we propose working principles and fundamental changes to the current scientific approach, with the goal of high-impact research and development of actionable prediction models that will yield more meaningful applications of precision cancer medicine.
Collapse
Affiliation(s)
- Olivier Morin
- Department of Radiation Oncology, University of California San Francisco, San Francisco, California.
| | | | - Arthur Jochems
- The D-Lab, Grow Research Institute for Oncology, Maastricht University, Maastricht, The Netherlands
| | - Henry C Woodruff
- The D-Lab, Grow Research Institute for Oncology, Maastricht University, Maastricht, The Netherlands
| | - Gilmer Valdes
- Department of Radiation Oncology, University of California San Francisco, San Francisco, California
| | - Steve E Braunstein
- Department of Radiation Oncology, University of California San Francisco, San Francisco, California
| | - Joachim E Wildberger
- Department of Radiology and Nuclear Medicine, Maastricht University Medical Center, Maastricht, The Netherlands
| | | | - Vasant Kearney
- Department of Radiation Oncology, University of California San Francisco, San Francisco, California
| | - Sue S Yom
- Department of Radiation Oncology, University of California San Francisco, San Francisco, California
| | - Timothy D Solberg
- Department of Radiation Oncology, University of California San Francisco, San Francisco, California
| | - Philippe Lambin
- The D-Lab, Grow Research Institute for Oncology, Maastricht University, Maastricht, The Netherlands
| |
Collapse
|