1
|
Elhalawani H, Lin TA, Volpe S, Mohamed ASR, White AL, Zafereo J, Wong AJ, Berends JE, AboHashem S, Williams B, Aymard JM, Kanwar A, Perni S, Rock CD, Cooksey L, Campbell S, Yang P, Nguyen K, Ger RB, Cardenas CE, Fave XJ, Sansone C, Piantadosi G, Marrone S, Liu R, Huang C, Yu K, Li T, Yu Y, Zhang Y, Zhu H, Morris JS, Baladandayuthapani V, Shumway JW, Ghosh A, Pöhlmann A, Phoulady HA, Goyal V, Canahuate G, Marai GE, Vock D, Lai SY, Mackin DS, Court LE, Freymann J, Farahani K, Kaplathy-Cramer J, Fuller CD. Machine Learning Applications in Head and Neck Radiation Oncology: Lessons From Open-Source Radiomics Challenges. Front Oncol 2018; 8:294. [PMID: 30175071 PMCID: PMC6107800 DOI: 10.3389/fonc.2018.00294] [Citation(s) in RCA: 30] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2018] [Accepted: 07/16/2018] [Indexed: 12/13/2022] Open
Abstract
Radiomics leverages existing image datasets to provide non-visible data extraction via image post-processing, with the aim of identifying prognostic, and predictive imaging features at a sub-region of interest level. However, the application of radiomics is hampered by several challenges such as lack of image acquisition/analysis method standardization, impeding generalizability. As of yet, radiomics remains intriguing, but not clinically validated. We aimed to test the feasibility of a non-custom-constructed platform for disseminating existing large, standardized databases across institutions for promoting radiomics studies. Hence, University of Texas MD Anderson Cancer Center organized two public radiomics challenges in head and neck radiation oncology domain. This was done in conjunction with MICCAI 2016 satellite symposium using Kaggle-in-Class, a machine-learning and predictive analytics platform. We drew on clinical data matched to radiomics data derived from diagnostic contrast-enhanced computed tomography (CECT) images in a dataset of 315 patients with oropharyngeal cancer. Contestants were tasked to develop models for (i) classifying patients according to their human papillomavirus status, or (ii) predicting local tumor recurrence, following radiotherapy. Data were split into training, and test sets. Seventeen teams from various professional domains participated in one or both of the challenges. This review paper was based on the contestants' feedback; provided by 8 contestants only (47%). Six contestants (75%) incorporated extracted radiomics features into their predictive model building, either alone (n = 5; 62.5%), as was the case with the winner of the "HPV" challenge, or in conjunction with matched clinical attributes (n = 2; 25%). Only 23% of contestants, notably, including the winner of the "local recurrence" challenge, built their model relying solely on clinical data. In addition to the value of the integration of machine learning into clinical decision-making, our experience sheds light on challenges in sharing and directing existing datasets toward clinical applications of radiomics, including hyper-dimensionality of the clinical/imaging data attributes. Our experience may help guide researchers to create a framework for sharing and reuse of already published data that we believe will ultimately accelerate the pace of clinical applications of radiomics; both in challenge or clinical settings.
Collapse
Affiliation(s)
- Hesham Elhalawani
- Department of Radiation Oncology, University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Timothy A. Lin
- Department of Radiation Oncology, University of Texas MD Anderson Cancer Center, Houston, TX, United States
- Baylor College of Medicine, Houston, TX, United States
| | - Stefania Volpe
- Department of Radiation Oncology, University of Texas MD Anderson Cancer Center, Houston, TX, United States
- Università degli Studi di Milano, Milan, Italy
| | - Abdallah S. R. Mohamed
- Department of Radiation Oncology, University of Texas MD Anderson Cancer Center, Houston, TX, United States
- Department of Clinical Oncology and Nuclear Medicine, Alexandria University, Alexandria, Egypt
| | - Aubrey L. White
- Department of Radiation Oncology, University of Texas MD Anderson Cancer Center, Houston, TX, United States
- McGovern Medical School, University of Texas, Houston, TX, United States
| | - James Zafereo
- Department of Radiation Oncology, University of Texas MD Anderson Cancer Center, Houston, TX, United States
- McGovern Medical School, University of Texas, Houston, TX, United States
| | - Andrew J. Wong
- Department of Radiation Oncology, University of Texas MD Anderson Cancer Center, Houston, TX, United States
- School of Medicine, The University of Texas Health Science Center San Antonio, San Antonio, TX, United States
| | - Joel E. Berends
- Department of Radiation Oncology, University of Texas MD Anderson Cancer Center, Houston, TX, United States
- School of Medicine, The University of Texas Health Science Center San Antonio, San Antonio, TX, United States
| | - Shady AboHashem
- Department of Radiation Oncology, University of Texas MD Anderson Cancer Center, Houston, TX, United States
- Department of Cardiology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, United States
| | - Bowman Williams
- Department of Radiation Oncology, University of Texas MD Anderson Cancer Center, Houston, TX, United States
- Furman University, Greenville, SC, United States
| | - Jeremy M. Aymard
- Department of Radiation Oncology, University of Texas MD Anderson Cancer Center, Houston, TX, United States
- Abilene Christian University, Abilene, TX, United States
| | - Aasheesh Kanwar
- Department of Radiation Oncology, University of Texas MD Anderson Cancer Center, Houston, TX, United States
- Department of Radiation Oncology, Oregon Health and Science University, Portland, OR, United States
| | - Subha Perni
- Department of Radiation Oncology, University of Texas MD Anderson Cancer Center, Houston, TX, United States
- Department of Radiation Oncology, Memorial Sloan Kettering Cancer Center, New York, NY, United States
| | - Crosby D. Rock
- Department of Radiation Oncology, University of Texas MD Anderson Cancer Center, Houston, TX, United States
- Texas Tech University Health Sciences Center El Paso, El Paso, TX, United States
| | - Luke Cooksey
- Department of Radiation Oncology, University of Texas MD Anderson Cancer Center, Houston, TX, United States
- University of North Texas Health Science Center, Fort Worth, TX, United States
| | - Shauna Campbell
- Department of Radiation Oncology, University of Texas MD Anderson Cancer Center, Houston, TX, United States
- Department of Radiation Oncology, Cleveland Clinic, Cleveland, OH, United States
| | - Pei Yang
- Department of Radiation Oncology, University of Texas MD Anderson Cancer Center, Houston, TX, United States
- Baylor College of Medicine, Houston, TX, United States
| | - Khahn Nguyen
- Colgate University, Hamilton City, CA, United States
| | - Rachel B. Ger
- Graduate School of Biomedical Sciences, MD Anderson Cancer Center, Houston, TX, United States
- Department of Radiation Physics, Graduate School of Biomedical Sciences, MD Anderson Cancer Center, Houston, TX, United States
| | - Carlos E. Cardenas
- Graduate School of Biomedical Sciences, MD Anderson Cancer Center, Houston, TX, United States
- Department of Radiation Physics, Graduate School of Biomedical Sciences, MD Anderson Cancer Center, Houston, TX, United States
| | - Xenia J. Fave
- Moores Cancer Center, University of California, La Jolla, San Diego, CA, United States
| | - Carlo Sansone
- Dipartimento di Ingegneria Elettrica e delle Tecnologie dell'Informazione, Università Degli Studi di Napoli Federico II, Naples, Italy
| | - Gabriele Piantadosi
- Dipartimento di Ingegneria Elettrica e delle Tecnologie dell'Informazione, Università Degli Studi di Napoli Federico II, Naples, Italy
| | - Stefano Marrone
- Dipartimento di Ingegneria Elettrica e delle Tecnologie dell'Informazione, Università Degli Studi di Napoli Federico II, Naples, Italy
| | - Rongjie Liu
- Baylor College of Medicine, Houston, TX, United States
- Department of Biostatistics, University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Chao Huang
- Baylor College of Medicine, Houston, TX, United States
- Department of Biostatistics, University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Kaixian Yu
- Baylor College of Medicine, Houston, TX, United States
- Department of Biostatistics, University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Tengfei Li
- Baylor College of Medicine, Houston, TX, United States
- Department of Biostatistics, University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Yang Yu
- Baylor College of Medicine, Houston, TX, United States
- Department of Biostatistics, University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Youyi Zhang
- Baylor College of Medicine, Houston, TX, United States
- Department of Biostatistics, University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Hongtu Zhu
- Baylor College of Medicine, Houston, TX, United States
- Department of Biostatistics, University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Jeffrey S. Morris
- Baylor College of Medicine, Houston, TX, United States
- Department of Biostatistics, University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Veerabhadran Baladandayuthapani
- Baylor College of Medicine, Houston, TX, United States
- Department of Biostatistics, University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - John W. Shumway
- Department of Radiation Oncology, University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Alakonanda Ghosh
- Department of Radiation Oncology, University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Andrei Pöhlmann
- Fraunhofer-Institut für Fabrikbetrieb und Automatisierung (IFF), Magdeburg, Germany
| | - Hady A. Phoulady
- Department of Computer Science, University of Southern Maine, Portland, OR, United States
| | - Vibhas Goyal
- Indian Institute of Technology Hyderabad, Sangareddy, India
| | | | | | - David Vock
- Department of Biostatistics, School of Public Health, University of Minnesota, Minneapolis, MN, United States
| | - Stephen Y. Lai
- Department of Head and Neck Surgery, University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Dennis S. Mackin
- Colgate University, Hamilton City, CA, United States
- Department of Radiation Physics, Graduate School of Biomedical Sciences, MD Anderson Cancer Center, Houston, TX, United States
| | - Laurence E. Court
- Colgate University, Hamilton City, CA, United States
- Department of Radiation Physics, Graduate School of Biomedical Sciences, MD Anderson Cancer Center, Houston, TX, United States
| | - John Freymann
- Frederick National Laboratory for Cancer Research, Leidos Biomedical Research, Inc., Frederick, MD, United States
| | - Keyvan Farahani
- National Cancer Institute, Rockville, MD, United States
- The Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins Medicine, Baltimore, MD, United States
| | - Jayashree Kaplathy-Cramer
- Department of Radiology and Athinoula A. Martinos Center for Biomedical Imaging, MGH/Harvard Medical School, Boston, MA, United States
| | - Clifton D. Fuller
- Department of Radiation Oncology, University of Texas MD Anderson Cancer Center, Houston, TX, United States
- Baylor College of Medicine, Houston, TX, United States
- Department of Radiation Physics, Graduate School of Biomedical Sciences, MD Anderson Cancer Center, Houston, TX, United States
| |
Collapse
|