1
|
Levenson RM, Singh Y, Rieck B, Hathaway QA, Farrelly C, Rozenblit J, Prasanna P, Erickson B, Choudhary A, Carlsson G, Sarkar D. Advancing Precision Medicine: Algebraic Topology and Differential Geometry in Radiology and Computational Pathology. J Transl Med 2024; 104:102060. [PMID: 38626875 DOI: 10.1016/j.labinv.2024.102060] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2023] [Revised: 04/08/2024] [Accepted: 04/10/2024] [Indexed: 05/19/2024] Open
Abstract
Precision medicine aims to provide personalized care based on individual patient characteristics, rather than guideline-directed therapies for groups of diseases or patient demographics. Images-both radiology- and pathology-derived-are a major source of information on presence, type, and status of disease. Exploring the mathematical relationship of pixels in medical imaging ("radiomics") and cellular-scale structures in digital pathology slides ("pathomics") offers powerful tools for extracting both qualitative and, increasingly, quantitative data. These analytical approaches, however, may be significantly enhanced by applying additional methods arising from fields of mathematics such as differential geometry and algebraic topology that remain underexplored in this context. Geometry's strength lies in its ability to provide precise local measurements, such as curvature, that can be crucial for identifying abnormalities at multiple spatial levels. These measurements can augment the quantitative features extracted in conventional radiomics, leading to more nuanced diagnostics. By contrast, topology serves as a robust shape descriptor, capturing essential features such as connected components and holes. The field of topological data analysis was initially founded to explore the shape of data, with functional network connectivity in the brain being a prominent example. Increasingly, its tools are now being used to explore organizational patterns of physical structures in medical images and digitized pathology slides. By leveraging tools from both differential geometry and algebraic topology, researchers and clinicians may be able to obtain a more comprehensive, multi-layered understanding of medical images and contribute to precision medicine's armamentarium.
Collapse
Affiliation(s)
- Richard M Levenson
- Department of Pathology and Laboratory Medicine, UC Davis, Davis, California.
| | - Yashbir Singh
- Department of Radiology, Mayo Clinic, Rochester, Minnesota.
| | - Bastian Rieck
- Helmholtz Munich and Technical University of Munich, Munich, Germany
| | - Quincy A Hathaway
- Department of Medical Education, West Virginia University, Morgantown, West Virginia
| | | | | | - Prateek Prasanna
- Department of Biomedical Informatics, Stony Brook University, Stony Brook, New York
| | | | | | - Gunnar Carlsson
- Department of Mathematics, Stanford University, Stanford, California
| | - Deepa Sarkar
- Institute of Genomic Health, Ichan school of Medicine, Mount Sinai, New York
| |
Collapse
|
2
|
Chakrabarty N, Mahajan A. Imaging Analytics using Artificial Intelligence in Oncology: A Comprehensive Review. Clin Oncol (R Coll Radiol) 2023:S0936-6555(23)00334-5. [PMID: 37806795 DOI: 10.1016/j.clon.2023.09.013] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2023] [Revised: 08/09/2023] [Accepted: 09/21/2023] [Indexed: 10/10/2023]
Abstract
The present era has seen a surge in artificial intelligence-related research in oncology, mainly using deep learning, because of powerful computer hardware, improved algorithms and the availability of large amounts of data from open-source domains and the use of transfer learning. Here we discuss the multifaceted role of deep learning in cancer care, ranging from risk stratification, the screening and diagnosis of cancer, to the prediction of genomic mutations, treatment response and survival outcome prediction, through the use of convolutional neural networks. Another role of artificial intelligence is in the generation of automated radiology reports, which is a boon in high-volume centres to minimise report turnaround time. Although a validated and deployable deep-learning model for clinical use is still in its infancy, there is ongoing research to overcome the barriers for its universal implementation and we also delve into this aspect. We also briefly describe the role of radiomics in oncoimaging. Artificial intelligence can provide answers pertaining to cancer management at baseline imaging, saving cost and time. Imaging biobanks, which are repositories of anonymised images, are also briefly described. We also discuss the commercialisation and ethical issues pertaining to artificial intelligence. The latest generation generalist artificial intelligence model is also briefly described at the end of the article. We believe this article will not only enrich knowledge, but also promote research acumen in the minds of readers to take oncoimaging to another level using artificial intelligence and also work towards clinical translation of such research.
Collapse
Affiliation(s)
- N Chakrabarty
- Department of Radiodiagnosis, Advanced Centre for Treatment, Research and Education in Cancer, Tata Memorial Centre, Homi Bhabha National Institute (HBNI), Parel, Mumbai, Maharashtra, India.
| | - A Mahajan
- The Clatterbridge Cancer Centre NHS Foundation Trust, Liverpool, UK.
| |
Collapse
|
3
|
Shi H, Duan J, Chen Z, Huang M, Han W, Kong R, Guan X, Qi Z, Zheng S, Lu M. A prognostic gene signature for gastric cancer and the immune infiltration-associated mechanism underlying the signature gene, PLG. Clin Transl Oncol 2023; 25:995-1010. [PMID: 36376702 DOI: 10.1007/s12094-022-03003-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2022] [Accepted: 10/28/2022] [Indexed: 11/16/2022]
Abstract
BACKGROUND Globally, gastric cancer (GC) is a common and lethal solid malignant tumor. Identifying the molecular signature and its functions can provide mechanistic insights into GC development and new methods for targeted therapy. METHODS Differentially expressed genes (DEGs) and prognostic genes (from univariate Cox regression analysis) were overlapped to obtain prognostic DEGs. Subsequently, molecular modules and the functions of these prognostic DEGs were identified by Metascape and Gene Ontology (GO)/Kyoto Encyclopedia of Genes and Genomes (KEGG)/Gene Set Enrichment Analysis (GSEA) enrichment analyses, respectively. Protein-protein interaction (PPI) networks of up- and down-regulated prognostic DEGs in GC were analyzed using the MCC algorithm of the Cytohubba plug-in in Cytoscape. The prognostic gene signature was defined on hub genes of the PPI networks by least absolute shrinkage and selection operator (LASSO)-Cox regression analysis. Furthermore, the expressional level of PLG in our clinical GC samples was validated by quantitative PCR (qPCR), western blotting, and immunohistochemistry (IHC). Subsequently, the PLG expression-correlation analysis was performed to assess the role of PLG in GC progression. Immune infiltration analysis was performed by single-sample gene set enrichment analysis (ssGSEA) to assess the inhibitory effect of PLG on immune infiltration. RESULTS Firstly, Up- and down-regulated prognostic DEGs and hub genes in protein-protein interaction (PPI) networks in GC were identified. A prognostic five-gene signature (i.e., PLG, SPARC, FGB, SERPINE1, and KLHL41) was identified. Among the five genes, the relationship between plasminogen (PLG) and GC remains largely unclear. Moreover, the functions of PLG-correlated genes in GC, like 'fibrinolysis', 'hemostasis', 'ion channel complex', and 'transporter complex' were identified. In addition, PLG expression correlated negatively with the infiltration of almost all immune cell types. Interestingly, the expression of PLG was significantly and highly correlated with that of CD160, an immune checkpoint inhibitor. CONCLUSION Our findings defined a new five-gene signature for predicting GC prognosis, but more validation is required to assess the effects and mechanism of the five genes, especially PLG, for the development of new GC therapies.
Collapse
Affiliation(s)
- Hui Shi
- Department of Immunology, School of Basic Medical Sciences, Anhui Medical University, No.81, Mei Shan Road, Hefei, 230032, Anhui, China
| | - Jiangling Duan
- Department of Immunology, School of Basic Medical Sciences, Anhui Medical University, No.81, Mei Shan Road, Hefei, 230032, Anhui, China
| | - Zhangming Chen
- Department of Gastrointestinal Surgery, The First Affiliated Hospital of Anhui Medical University, Hefei, Anhui, China
| | - Mengqi Huang
- Department of Pathology, The Second Affiliated Hospital of Anhui Medical University, Hefei, Anhui, China
| | - Wenxiu Han
- Department of Gastrointestinal Surgery, The First Affiliated Hospital of Anhui Medical University, Hefei, Anhui, China
| | - Rui Kong
- Department of Immunology, School of Basic Medical Sciences, Anhui Medical University, No.81, Mei Shan Road, Hefei, 230032, Anhui, China
| | - Xiuyin Guan
- Department of Immunology, School of Basic Medical Sciences, Anhui Medical University, No.81, Mei Shan Road, Hefei, 230032, Anhui, China
| | - Zhen Qi
- Department of Immunology, School of Basic Medical Sciences, Anhui Medical University, No.81, Mei Shan Road, Hefei, 230032, Anhui, China
| | - Shuang Zheng
- Department of Rheumatology, The First Affiliated Hospital of Anhui Medical University, No.218, Ji Xi Road, Hefei, 230032, Anhui, China.
| | - Ming Lu
- Department of Immunology, School of Basic Medical Sciences, Anhui Medical University, No.81, Mei Shan Road, Hefei, 230032, Anhui, China.
| |
Collapse
|
4
|
Glory Precious J, Keren Evangeline I, Kirubha SPA. Brain tumour segmentation and survival prognostication using 3D radiomics features and machine learning algorithms. Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization 2023. [DOI: 10.1080/21681163.2023.2189487] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/29/2023]
|
5
|
McCague C, Ramlee S, Reinius M, Selby I, Hulse D, Piyatissa P, Bura V, Crispin-Ortuzar M, Sala E, Woitek R. Introduction to radiomics for a clinical audience. Clin Radiol 2023; 78:83-98. [PMID: 36639175 DOI: 10.1016/j.crad.2022.08.149] [Citation(s) in RCA: 16] [Impact Index Per Article: 16.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2022] [Accepted: 08/31/2022] [Indexed: 01/12/2023]
Abstract
Radiomics is a rapidly developing field of research focused on the extraction of quantitative features from medical images, thus converting these digital images into minable, high-dimensional data, which offer unique biological information that can enhance our understanding of disease processes and provide clinical decision support. To date, most radiomics research has been focused on oncological applications; however, it is increasingly being used in a raft of other diseases. This review gives an overview of radiomics for a clinical audience, including the radiomics pipeline and the common pitfalls associated with each stage. Key studies in oncology are presented with a focus on both those that use radiomics analysis alone and those that integrate its use with other multimodal data streams. Importantly, clinical applications outside oncology are also presented. Finally, we conclude by offering a vision for radiomics research in the future, including how it might impact our practice as radiologists.
Collapse
Affiliation(s)
- C McCague
- Department of Radiology, University of Cambridge, Cambridge, UK; Cancer Research UK Cambridge Centre, University of Cambridge, Cambridge, UK; Cancer Research UK Cambridge Institute, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK.
| | - S Ramlee
- Department of Radiology, University of Cambridge, Cambridge, UK
| | - M Reinius
- Cancer Research UK Cambridge Centre, University of Cambridge, Cambridge, UK; Cancer Research UK Cambridge Institute, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK
| | - I Selby
- Department of Radiology, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK
| | - D Hulse
- Department of Radiology, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK
| | - P Piyatissa
- Department of Radiology, University of Cambridge, Cambridge, UK
| | - V Bura
- Department of Radiology, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK; Department of Radiology and Medical Imaging, County Clinical Emergency Hospital, Cluj-Napoca, Romania
| | - M Crispin-Ortuzar
- Cancer Research UK Cambridge Centre, University of Cambridge, Cambridge, UK; Cancer Research UK Cambridge Institute, University of Cambridge, Cambridge, UK; Department of Oncology, University of Cambridge, Cambridge, UK
| | - E Sala
- Department of Radiology, University of Cambridge, Cambridge, UK; Cancer Research UK Cambridge Centre, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK
| | - R Woitek
- Department of Radiology, University of Cambridge, Cambridge, UK; Cancer Research UK Cambridge Centre, University of Cambridge, Cambridge, UK; Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK; Research Centre for Medical Image Analysis and Artificial Intelligence (MIAAI), Department of Medicine, Faculty of Medicine and Dentistry, Danube Private University, Krems, Austria
| |
Collapse
|
6
|
Alleman K, Knecht E, Huang J, Zhang L, Lam S, DeCuypere M. Multimodal Deep Learning-Based Prognostication in Glioma Patients: A Systematic Review. Cancers (Basel) 2023; 15:cancers15020545. [PMID: 36672494 PMCID: PMC9856816 DOI: 10.3390/cancers15020545] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2022] [Revised: 01/05/2023] [Accepted: 01/08/2023] [Indexed: 01/18/2023] Open
Abstract
Malignant brain tumors pose a substantial burden on morbidity and mortality. As clinical data collection improves, along with the capacity to analyze it, novel predictive clinical tools may improve prognosis prediction. Deep learning (DL) holds promise for integrating clinical data of various modalities. A systematic review of the DL-based prognostication of gliomas was performed using the Embase (Elsevier), PubMed MEDLINE (National library of Medicine), and Scopus (Elsevier) databases, in accordance with PRISMA guidelines. All included studies focused on the prognostication of gliomas, and predicted overall survival (13 studies, 81%), overall survival as well as genotype (2 studies, 12.5%), and response to immunotherapy (1 study, 6.2%). Multimodal analyses were varied, with 6 studies (37.5%) combining MRI with clinical data; 6 studies (37.5%) integrating MRI with histologic, clinical, and biomarker data; 3 studies (18.8%) combining MRI with genomic data; and 1 study (6.2%) combining histologic imaging with clinical data. Studies that compared multimodal models to unimodal-only models demonstrated improved predictive performance. The risk of bias was mixed, most commonly due to inconsistent methodological reporting. Overall, the use of multimodal data in DL assessments of gliomas leads to a more accurate overall survival prediction. However, due to data limitations and a lack of transparency in model and code reporting, the full extent of multimodal DL as a resource for brain tumor patients has not yet been realized.
Collapse
Affiliation(s)
- Kaitlyn Alleman
- Chicago Medical School, Rosalind Franklin University of Science and Medicine, Chicago, IL 60064, USA
| | - Erik Knecht
- Chicago Medical School, Rosalind Franklin University of Science and Medicine, Chicago, IL 60064, USA
| | - Jonathan Huang
- Division of Pediatric Neurosurgery, Ann and Robert H. Lurie Children’s Hospital of Chicago, Chicago, IL 60611, USA
| | - Lu Zhang
- Division of Pediatric Neurosurgery, Ann and Robert H. Lurie Children’s Hospital of Chicago, Chicago, IL 60611, USA
| | - Sandi Lam
- Division of Pediatric Neurosurgery, Ann and Robert H. Lurie Children’s Hospital of Chicago, Chicago, IL 60611, USA
- Department of Neurological Surgery, Northwestern University Feinberg School of Medicine, Chicago, IL 60611, USA
- Malnati Brain Tumor Institute of the Lurie Comprehensive Cancer Center, Northwestern University Feinberg School of Medicine, Chicago, IL 60611, USA
| | - Michael DeCuypere
- Division of Pediatric Neurosurgery, Ann and Robert H. Lurie Children’s Hospital of Chicago, Chicago, IL 60611, USA
- Department of Neurological Surgery, Northwestern University Feinberg School of Medicine, Chicago, IL 60611, USA
- Malnati Brain Tumor Institute of the Lurie Comprehensive Cancer Center, Northwestern University Feinberg School of Medicine, Chicago, IL 60611, USA
- Correspondence:
| |
Collapse
|
7
|
Kline A, Wang H, Li Y, Dennis S, Hutch M, Xu Z, Wang F, Cheng F, Luo Y. Multimodal machine learning in precision health: A scoping review. NPJ Digit Med 2022; 5:171. [PMID: 36344814 PMCID: PMC9640667 DOI: 10.1038/s41746-022-00712-8] [Citation(s) in RCA: 59] [Impact Index Per Article: 29.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2022] [Accepted: 10/14/2022] [Indexed: 11/09/2022] Open
Abstract
Machine learning is frequently being leveraged to tackle problems in the health sector including utilization for clinical decision-support. Its use has historically been focused on single modal data. Attempts to improve prediction and mimic the multimodal nature of clinical expert decision-making has been met in the biomedical field of machine learning by fusing disparate data. This review was conducted to summarize the current studies in this field and identify topics ripe for future research. We conducted this review in accordance with the PRISMA extension for Scoping Reviews to characterize multi-modal data fusion in health. Search strings were established and used in databases: PubMed, Google Scholar, and IEEEXplore from 2011 to 2021. A final set of 128 articles were included in the analysis. The most common health areas utilizing multi-modal methods were neurology and oncology. Early fusion was the most common data merging strategy. Notably, there was an improvement in predictive performance when using data fusion. Lacking from the papers were clear clinical deployment strategies, FDA-approval, and analysis of how using multimodal approaches from diverse sub-populations may improve biases and healthcare disparities. These findings provide a summary on multimodal data fusion as applied to health diagnosis/prognosis problems. Few papers compared the outputs of a multimodal approach with a unimodal prediction. However, those that did achieved an average increase of 6.4% in predictive accuracy. Multi-modal machine learning, while more robust in its estimations over unimodal methods, has drawbacks in its scalability and the time-consuming nature of information concatenation.
Collapse
Affiliation(s)
- Adrienne Kline
- Department of Preventive Medicine, Northwestern University, Chicago, 60201, IL, USA
| | - Hanyin Wang
- Department of Preventive Medicine, Northwestern University, Chicago, 60201, IL, USA
| | - Yikuan Li
- Department of Preventive Medicine, Northwestern University, Chicago, 60201, IL, USA
| | - Saya Dennis
- Department of Preventive Medicine, Northwestern University, Chicago, 60201, IL, USA
| | - Meghan Hutch
- Department of Preventive Medicine, Northwestern University, Chicago, 60201, IL, USA
| | - Zhenxing Xu
- Department of Population Health Sciences, Cornell University, New York, 10065, NY, USA
| | - Fei Wang
- Department of Population Health Sciences, Cornell University, New York, 10065, NY, USA
| | - Feixiong Cheng
- Cleveland Clinic Lerner College of Medicine, Case Western Reserve University, Cleveland, 44195, OH, USA
| | - Yuan Luo
- Department of Preventive Medicine, Northwestern University, Chicago, 60201, IL, USA.
| |
Collapse
|
8
|
Funingana I, Piyatissa P, Reinius M, Mccague C, Basu B, Sala E. Radiomic and Volumetric Measurements as Clinical Trial Endpoints—A Comprehensive Review. Cancers (Basel) 2022; 14:5076. [PMID: 36291865 PMCID: PMC9599928 DOI: 10.3390/cancers14205076] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2022] [Revised: 10/12/2022] [Accepted: 10/14/2022] [Indexed: 11/23/2022] Open
Abstract
Simple Summary The extraction of quantitative data from standard-of-care imaging modalities offers opportunities to improve the relevance and salience of imaging biomarkers used in drug development. This review aims to identify the challenges and opportunities for discovering new imaging-based biomarkers based on radiomic and volumetric assessment in the single-site solid tumor sites: breast cancer, rectal cancer, lung cancer and glioblastoma. Developing approaches to harmonize three essential areas: segmentation, validation and data sharing may expedite regulatory approval and adoption of novel cancer imaging biomarkers. Abstract Clinical trials for oncology drug development have long relied on surrogate outcome biomarkers that assess changes in tumor burden to accelerate drug registration (i.e., Response Evaluation Criteria in Solid Tumors version 1.1 (RECIST v1.1) criteria). Drug-induced reduction in tumor size represents an imperfect surrogate marker for drug activity and yet a radiologically determined objective response rate is a widely used endpoint for Phase 2 trials. With the addition of therapies targeting complex biological systems such as immune system and DNA damage repair pathways, incorporation of integrative response and outcome biomarkers may add more predictive value. We performed a review of the relevant literature in four representative tumor types (breast cancer, rectal cancer, lung cancer and glioblastoma) to assess the preparedness of volumetric and radiomics metrics as clinical trial endpoints. We identified three key areas—segmentation, validation and data sharing strategies—where concerted efforts are required to enable progress of volumetric- and radiomics-based clinical trial endpoints for wider clinical implementation.
Collapse
|
9
|
di Noia C, Grist JT, Riemer F, Lyasheva M, Fabozzi M, Castelli M, Lodi R, Tonon C, Rundo L, Zaccagna F. Predicting Survival in Patients with Brain Tumors: Current State-of-the-Art of AI Methods Applied to MRI. Diagnostics (Basel) 2022; 12:diagnostics12092125. [PMID: 36140526 PMCID: PMC9497964 DOI: 10.3390/diagnostics12092125] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2022] [Revised: 08/05/2022] [Accepted: 08/17/2022] [Indexed: 11/24/2022] Open
Abstract
Given growing clinical needs, in recent years Artificial Intelligence (AI) techniques have increasingly been used to define the best approaches for survival assessment and prediction in patients with brain tumors. Advances in computational resources, and the collection of (mainly) public databases, have promoted this rapid development. This narrative review of the current state-of-the-art aimed to survey current applications of AI in predicting survival in patients with brain tumors, with a focus on Magnetic Resonance Imaging (MRI). An extensive search was performed on PubMed and Google Scholar using a Boolean research query based on MeSH terms and restricting the search to the period between 2012 and 2022. Fifty studies were selected, mainly based on Machine Learning (ML), Deep Learning (DL), radiomics-based methods, and methods that exploit traditional imaging techniques for survival assessment. In addition, we focused on two distinct tasks related to survival assessment: the first on the classification of subjects into survival classes (short and long-term or eventually short, mid and long-term) to stratify patients in distinct groups. The second focused on quantification, in days or months, of the individual survival interval. Our survey showed excellent state-of-the-art methods for the first, with accuracy up to ∼98%. The latter task appears to be the most challenging, but state-of-the-art techniques showed promising results, albeit with limitations, with C-Index up to ∼0.91. In conclusion, according to the specific task, the available computational methods perform differently, and the choice of the best one to use is non-univocal and dependent on many aspects. Unequivocally, the use of features derived from quantitative imaging has been shown to be advantageous for AI applications, including survival prediction. This evidence from the literature motivates further research in the field of AI-powered methods for survival prediction in patients with brain tumors, in particular, using the wealth of information provided by quantitative MRI techniques.
Collapse
Affiliation(s)
- Christian di Noia
- Department of Biomedical and Neuromotor Sciences, Alma Mater Studiorum—University of Bologna, 40125 Bologna, Italy
| | - James T. Grist
- Department of Physiology, Anatomy, and Genetics, University of Oxford, Oxford OX1 3PT, UK
- Department of Radiology, Oxford University Hospitals NHS Foundation Trust, Oxford OX3 9DU, UK
- Oxford Centre for Clinical Magnetic Research Imaging, University of Oxford, Oxford OX3 9DU, UK
- Institute of Cancer and Genomic Sciences, University of Birmingham, Birmingham B15 2SY, UK
| | - Frank Riemer
- Mohn Medical Imaging and Visualization Centre (MMIV), Department of Radiology, Haukeland University Hospital, N-5021 Bergen, Norway
| | - Maria Lyasheva
- Division of Cardiovascular Medicine, Radcliffe Department of Medicine, University of Oxford, John Radcliffe Hospital, Oxford OX3 9DU, UK
| | - Miriana Fabozzi
- Centro Medico Polispecialistico (CMO), 80058 Torre Annunziata, Italy
| | - Mauro Castelli
- NOVA Information Management School (NOVA IMS), Universidade NOVA de Lisboa, Campus de Campolide, 1070-312 Lisboa, Portugal
| | - Raffaele Lodi
- Department of Biomedical and Neuromotor Sciences, Alma Mater Studiorum—University of Bologna, 40125 Bologna, Italy
- Functional and Molecular Neuroimaging Unit, IRCCS Istituto delle Scienze Neurologiche di Bologna, 40139 Bologna, Italy
| | - Caterina Tonon
- Department of Biomedical and Neuromotor Sciences, Alma Mater Studiorum—University of Bologna, 40125 Bologna, Italy
- Functional and Molecular Neuroimaging Unit, IRCCS Istituto delle Scienze Neurologiche di Bologna, 40139 Bologna, Italy
| | - Leonardo Rundo
- Department of Information and Electrical Engineering and Applied Mathematics, University of Salerno, 84084 Fisciano, Italy
| | - Fulvio Zaccagna
- Department of Biomedical and Neuromotor Sciences, Alma Mater Studiorum—University of Bologna, 40125 Bologna, Italy
- Functional and Molecular Neuroimaging Unit, IRCCS Istituto delle Scienze Neurologiche di Bologna, 40139 Bologna, Italy
- Correspondence: ; Tel.: +39-0514969951
| |
Collapse
|
10
|
Akyol K. Automatic classification of brain magnetic resonance images with hypercolumn deep features and machine learning. Phys Eng Sci Med 2022; 45:935-947. [PMID: 35997926 DOI: 10.1007/s13246-022-01166-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2021] [Accepted: 07/24/2022] [Indexed: 11/26/2022]
Abstract
Brain tumours are life-threatening and their early detection is very important in a patient's life. At the present time, magnetic resonance imaging is one of the methods used for detecting brain tumours. Expert decision support systems serve specialist physicians to make more accurate diagnoses by minimizing the errors arising from their subjective opinions in real clinical settings. The model proposed in this study detects important keypoints and then extracts hypercolumn deep features of these keypoints from some convolutional layers of VGG16. Finally, Random Forest and Logistic Regression classifiers are fed with a set of these features. Random Forest classifier offered the best performance with 94.51% accuracy, 91.61% sensitivity, 8.39% false-negative rate, 97.42% specificity, and 97.29% precision using fivefold cross-validation in this study. Consequently, it is thought that the proposed model could contribute to field experts by integrating it into computer-aided brain magnetic resonance imaging diagnosis systems.
Collapse
Affiliation(s)
- Kemal Akyol
- Department of Computer Engineering, Kastamonu University, Kastamonu, Turkey.
| |
Collapse
|
11
|
Shaheen A, Bukhari ST, Nadeem M, Burigat S, Bagci U, Mohy-Ud-Din H. Overall Survival Prediction of Glioma Patients With Multiregional Radiomics. Front Neurosci 2022; 16:911065. [PMID: 35873825 PMCID: PMC9301117 DOI: 10.3389/fnins.2022.911065] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2022] [Accepted: 06/13/2022] [Indexed: 02/05/2023] Open
Abstract
Radiomics-guided prediction of overall survival (OS) in brain gliomas is seen as a significant problem in Neuro-oncology. The ultimate goal is to develop a robust MRI-based approach (i.e., a radiomics model) that can accurately classify a novel subject as a short-term survivor, a medium-term survivor, or a long-term survivor. The BraTS 2020 challenge provides radiological imaging and clinical data (178 subjects) to develop and validate radiomics-based methods for OS classification in brain gliomas. In this study, we empirically evaluated the efficacy of four multiregional radiomic models, for OS classification, and quantified the robustness of predictions to variations in automatic segmentation of brain tumor volume. More specifically, we evaluated four radiomic models, namely, the Whole Tumor (WT) radiomics model, the 3-subregions radiomics model, the 6-subregions radiomics model, and the 21-subregions radiomics model. The 3-subregions radiomics model is based on a physiological segmentation of whole tumor volume (WT) into three non-overlapping subregions. The 6-subregions and 21-subregions radiomic models are based on an anatomical segmentation of the brain tumor into 6 and 21 anatomical regions, respectively. Moreover, we employed six segmentation schemes - five CNNs and one STAPLE-fusion method - to quantify the robustness of radiomic models. Our experiments revealed that the 3-subregions radiomics model had the best predictive performance (mean AUC = 0.73) but poor robustness (RSD = 1.99) and the 6-subregions and 21-subregions radiomics models were more robust (RSD 1.39) with lower predictive performance (mean AUC 0.71). The poor robustness of the 3-subregions radiomics model was associated with highly variable and inferior segmentation of tumor core and active tumor subregions as quantified by the Hausdorff distance metric (4.4-6.5mm) across six segmentation schemes. Failure analysis revealed that the WT radiomics model, the 6-subregions radiomics model, and the 21-subregions radiomics model failed for the same subjects which is attributed to the common requirement of accurate segmentation of the WT volume. Moreover, short-term survivors were largely misclassified by the radiomic models and had large segmentation errors (average Hausdorff distance of 7.09mm). Lastly, we concluded that while STAPLE-fusion can reduce segmentation errors, it is not a solution to learning accurate and robust radiomic models.
Collapse
Affiliation(s)
- Asma Shaheen
- Department of Mathematics, Computer Science and Physics, University of Udine, Udine, Italy
- Department of Electrical Engineering, School of Science and Engineering, Lahore University of Management Sciences, Lahore, Pakistan
| | - Syed Talha Bukhari
- Department of Electrical Engineering, School of Science and Engineering, Lahore University of Management Sciences, Lahore, Pakistan
| | - Maria Nadeem
- Department of Electrical Engineering, School of Science and Engineering, Lahore University of Management Sciences, Lahore, Pakistan
| | - Stefano Burigat
- Department of Mathematics, Computer Science and Physics, University of Udine, Udine, Italy
| | - Ulas Bagci
- Department of Radiology, Feinberg School of Medicine, Northwestern University, Chicago, IL, United States
- Department of Biomedical Engineering, Northwestern University, Chicago, IL, United States
- Department of Electrical and Computer Engineering, Northwestern University, Chicago, IL, United States
| | - Hassan Mohy-Ud-Din
- Department of Electrical Engineering, School of Science and Engineering, Lahore University of Management Sciences, Lahore, Pakistan
| |
Collapse
|
12
|
Jian A, Liu S, Di Ieva A. Artificial Intelligence for Survival Prediction in Brain Tumors on Neuroimaging. Neurosurgery 2022; 91:8-26. [PMID: 35348129 DOI: 10.1227/neu.0000000000001938] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2021] [Accepted: 01/08/2022] [Indexed: 12/30/2022] Open
Abstract
Survival prediction of patients affected by brain tumors provides essential information to guide surgical planning, adjuvant treatment selection, and patient counseling. Current reliance on clinical factors, such as Karnofsky Performance Status Scale, and simplistic radiological characteristics are, however, inadequate for survival prediction in tumors such as glioma that demonstrate molecular and clinical heterogeneity with variable survival outcomes. Advances in the domain of artificial intelligence have afforded powerful tools to capture a large number of hidden high-dimensional imaging features that reflect abundant information about tumor structure and physiology. Here, we provide an overview of current literature that apply computational analysis tools such as radiomics and machine learning methods to the pipeline of image preprocessing, tumor segmentation, feature extraction, and construction of classifiers to establish survival prediction models based on neuroimaging. We also discuss challenges relating to the development and evaluation of such models and explore ethical issues surrounding the future use of machine learning predictions.
Collapse
Affiliation(s)
- Anne Jian
- Computational NeuroSurgery (CNS) Lab, Macquarie Medical School, Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney, Australia
- Royal Melbourne Hospital, Melbourne, Australia
| | - Sidong Liu
- Computational NeuroSurgery (CNS) Lab, Macquarie Medical School, Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney, Australia
- Centre for Health Informatics, Australian Institute of Health Innovation, Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney, Australia
| | - Antonio Di Ieva
- Computational NeuroSurgery (CNS) Lab, Macquarie Medical School, Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney, Australia
| |
Collapse
|
13
|
Corr F, Grimm D, Saß B, Pojskić M, Bartsch JW, Carl B, Nimsky C, Bopp MHA. Radiogenomic Predictors of Recurrence in Glioblastoma—A Systematic Review. J Pers Med 2022; 12:jpm12030402. [PMID: 35330402 PMCID: PMC8952807 DOI: 10.3390/jpm12030402] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2022] [Revised: 02/23/2022] [Accepted: 03/01/2022] [Indexed: 12/10/2022] Open
Abstract
Glioblastoma, as the most aggressive brain tumor, is associated with a poor prognosis and outcome. To optimize prognosis and clinical therapy decisions, there is an urgent need to stratify patients with increased risk for recurrent tumors and low therapeutic success to optimize individual treatment. Radiogenomics establishes a link between radiological and pathological information. This review provides a state-of-the-art picture illustrating the latest developments in the use of radiogenomic markers regarding prognosis and their potential for monitoring recurrence. Databases PubMed, Google Scholar, and Cochrane Library were searched. Inclusion criteria were defined as diagnosis of glioblastoma with histopathological and radiological follow-up. Out of 321 reviewed articles, 43 articles met these inclusion criteria. Included studies were analyzed for the frequency of radiological and molecular tumor markers whereby radiogenomic associations were analyzed. Six main associations were described: radiogenomic prognosis, MGMT status, IDH, EGFR status, molecular subgroups, and tumor location. Prospective studies analyzing prognostic features of glioblastoma together with radiological features are lacking. By reviewing the progress in the development of radiogenomic markers, we provide insights into the potential efficacy of such an approach for clinical routine use eventually enabling early identification of glioblastoma recurrence and therefore supporting a further personalized monitoring and treatment strategy.
Collapse
Affiliation(s)
- Felix Corr
- Department of Neurosurgery, University of Marburg, Baldingerstrasse, 35043 Marburg, Germany; (D.G.); (B.S.); (M.P.); (J.W.B.); (B.C.); (C.N.); (M.H.A.B.)
- EDU Institute of Higher Education, Villa Bighi, Chaplain’s House, KKR 1320 Kalkara, Malta
- Correspondence:
| | - Dustin Grimm
- Department of Neurosurgery, University of Marburg, Baldingerstrasse, 35043 Marburg, Germany; (D.G.); (B.S.); (M.P.); (J.W.B.); (B.C.); (C.N.); (M.H.A.B.)
- EDU Institute of Higher Education, Villa Bighi, Chaplain’s House, KKR 1320 Kalkara, Malta
| | - Benjamin Saß
- Department of Neurosurgery, University of Marburg, Baldingerstrasse, 35043 Marburg, Germany; (D.G.); (B.S.); (M.P.); (J.W.B.); (B.C.); (C.N.); (M.H.A.B.)
| | - Mirza Pojskić
- Department of Neurosurgery, University of Marburg, Baldingerstrasse, 35043 Marburg, Germany; (D.G.); (B.S.); (M.P.); (J.W.B.); (B.C.); (C.N.); (M.H.A.B.)
| | - Jörg W. Bartsch
- Department of Neurosurgery, University of Marburg, Baldingerstrasse, 35043 Marburg, Germany; (D.G.); (B.S.); (M.P.); (J.W.B.); (B.C.); (C.N.); (M.H.A.B.)
- Center for Mind, Brain and Behavior (CMBB), 35043 Marburg, Germany
| | - Barbara Carl
- Department of Neurosurgery, University of Marburg, Baldingerstrasse, 35043 Marburg, Germany; (D.G.); (B.S.); (M.P.); (J.W.B.); (B.C.); (C.N.); (M.H.A.B.)
- Department of Neurosurgery, Helios Dr. Horst Schmidt Kliniken, Ludwig-Erhard-Strasse 100, 65199 Wiesbaden, Germany
| | - Christopher Nimsky
- Department of Neurosurgery, University of Marburg, Baldingerstrasse, 35043 Marburg, Germany; (D.G.); (B.S.); (M.P.); (J.W.B.); (B.C.); (C.N.); (M.H.A.B.)
- Center for Mind, Brain and Behavior (CMBB), 35043 Marburg, Germany
| | - Miriam H. A. Bopp
- Department of Neurosurgery, University of Marburg, Baldingerstrasse, 35043 Marburg, Germany; (D.G.); (B.S.); (M.P.); (J.W.B.); (B.C.); (C.N.); (M.H.A.B.)
- Center for Mind, Brain and Behavior (CMBB), 35043 Marburg, Germany
| |
Collapse
|
14
|
Williams S, Layard Horsfall H, Funnell JP, Hanrahan JG, Khan DZ, Muirhead W, Stoyanov D, Marcus HJ. Artificial Intelligence in Brain Tumour Surgery-An Emerging Paradigm. Cancers (Basel) 2021; 13:cancers13195010. [PMID: 34638495 PMCID: PMC8508169 DOI: 10.3390/cancers13195010] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2021] [Revised: 10/02/2021] [Accepted: 10/03/2021] [Indexed: 01/01/2023] Open
Abstract
Artificial intelligence (AI) platforms have the potential to cause a paradigm shift in brain tumour surgery. Brain tumour surgery augmented with AI can result in safer and more effective treatment. In this review article, we explore the current and future role of AI in patients undergoing brain tumour surgery, including aiding diagnosis, optimising the surgical plan, providing support during the operation, and better predicting the prognosis. Finally, we discuss barriers to the successful clinical implementation, the ethical concerns, and we provide our perspective on how the field could be advanced.
Collapse
Affiliation(s)
- Simon Williams
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, London WC1N 3BG, UK; (H.L.H.); (J.P.F.); (J.G.H.); (D.Z.K.); (W.M.); (H.J.M.)
- Wellcome/Engineering and Physical Sciences Research Council (EPSRC) Centre for Interventional and Surgical Sciences (WEISS), London W1W 7TY, UK;
- Correspondence:
| | - Hugo Layard Horsfall
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, London WC1N 3BG, UK; (H.L.H.); (J.P.F.); (J.G.H.); (D.Z.K.); (W.M.); (H.J.M.)
- Wellcome/Engineering and Physical Sciences Research Council (EPSRC) Centre for Interventional and Surgical Sciences (WEISS), London W1W 7TY, UK;
| | - Jonathan P. Funnell
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, London WC1N 3BG, UK; (H.L.H.); (J.P.F.); (J.G.H.); (D.Z.K.); (W.M.); (H.J.M.)
- Wellcome/Engineering and Physical Sciences Research Council (EPSRC) Centre for Interventional and Surgical Sciences (WEISS), London W1W 7TY, UK;
| | - John G. Hanrahan
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, London WC1N 3BG, UK; (H.L.H.); (J.P.F.); (J.G.H.); (D.Z.K.); (W.M.); (H.J.M.)
- Wellcome/Engineering and Physical Sciences Research Council (EPSRC) Centre for Interventional and Surgical Sciences (WEISS), London W1W 7TY, UK;
| | - Danyal Z. Khan
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, London WC1N 3BG, UK; (H.L.H.); (J.P.F.); (J.G.H.); (D.Z.K.); (W.M.); (H.J.M.)
- Wellcome/Engineering and Physical Sciences Research Council (EPSRC) Centre for Interventional and Surgical Sciences (WEISS), London W1W 7TY, UK;
| | - William Muirhead
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, London WC1N 3BG, UK; (H.L.H.); (J.P.F.); (J.G.H.); (D.Z.K.); (W.M.); (H.J.M.)
- Wellcome/Engineering and Physical Sciences Research Council (EPSRC) Centre for Interventional and Surgical Sciences (WEISS), London W1W 7TY, UK;
| | - Danail Stoyanov
- Wellcome/Engineering and Physical Sciences Research Council (EPSRC) Centre for Interventional and Surgical Sciences (WEISS), London W1W 7TY, UK;
| | - Hani J. Marcus
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, London WC1N 3BG, UK; (H.L.H.); (J.P.F.); (J.G.H.); (D.Z.K.); (W.M.); (H.J.M.)
- Wellcome/Engineering and Physical Sciences Research Council (EPSRC) Centre for Interventional and Surgical Sciences (WEISS), London W1W 7TY, UK;
| |
Collapse
|
15
|
Wu Y, Sa Y, Guo Y, Li Q, Zhang N. Identification of WHO II/III gliomas by 16 prognostic-related gene signatures using machine learning methods. Curr Med Chem 2021; 29:1622-1639. [PMID: 34455959 DOI: 10.2174/0929867328666210827103049] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2021] [Revised: 05/27/2021] [Accepted: 05/28/2021] [Indexed: 11/22/2022]
Abstract
BACKGROUND It is found that the prognosis of gliomas of the same grade has large differences among World Health Organization(WHO) grade II and III in clinical observation. Therefore, a better understanding of the genetics and molecular mechanisms underlying WHO grade II and III gliomas is required, with the aim of developing a classification scheme at the molecular level rather than the conventional pathological morphology level. METHOD We performed survival analysis combined with machine learning methods of Least Absolute Shrinkage and Selection Operator using expression datasets downloaded from the Chinese Glioma Genome Atlas as well as The Cancer Genome Atlas. Risk scores were calculated by the product of expression level of overall survival-related genes and their multivariate Cox proportional hazards regression coefficients. WHO grade II and III gliomas were categorized into the low-risk subgroup, medium-risk subgroup, and high-risk subgroup. We used the 16 prognostic-related genes as input features to build a classification model based on prognosis using a fully connected neural network. Gene function annotations were also performed. RESULTS The 16 genes (AKNAD1, C7orf13, CDK20, CHRFAM7A, CHRNA1, EFNB1, GAS1, HIST2H2BE, KCNK3, KLHL4, LRRK2, NXPH3, PIGZ, SAMD5, ERINC2, and SIX6) related to the glioma prognosis were screened. The 16 selected genes were associated with the development of gliomas and carcinogenesis. The accuracy of an external validation data set of the fully connected neural network model from the two cohorts reached 95.5%. Our method has good potential capability in classifying WHO grade II and III gliomas into low-risk, medium-risk, and high-risk subgroups. The subgroups showed significant (P<0.01) differences in overall survival. CONCLUSION This resulted in the identification of 16 genes that were related to the prognosis of gliomas. Here we developed a computational method to discriminate WHO grade II and III gliomas into three subgroups with distinct prognoses. The gene expression-based method provides a reliable alternative to determine the prognosis of gliomas.
Collapse
Affiliation(s)
- YaMeng Wu
- Department of Biomedical Engineering, Tianjin Key Lab of BME Measurement, Tianjin University, Tianjin. China
| | - Yu Sa
- Department of Biomedical Engineering, Tianjin Key Lab of BME Measurement, Tianjin University, Tianjin. China
| | - Yu Guo
- Department of Biomedical Engineering, Tianjin Key Lab of BME Measurement, Tianjin University, Tianjin. China
| | - QiFeng Li
- Department of Biomedical Engineering, Tianjin Key Lab of BME Measurement, Tianjin University, Tianjin. China
| | - Ning Zhang
- Department of Biomedical Engineering, Tianjin Key Lab of BME Measurement, Tianjin University, Tianjin. China
| |
Collapse
|
16
|
Soltani M, Bonakdar A, Shakourifar N, Babaei R, Raahemifar K. Efficacy of Location-Based Features for Survival Prediction of Patients With Glioblastoma Depending on Resection Status. Front Oncol 2021; 11:661123. [PMID: 34295809 PMCID: PMC8290179 DOI: 10.3389/fonc.2021.661123] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2021] [Accepted: 06/14/2021] [Indexed: 12/24/2022] Open
Abstract
Cancer stands out as one of the fatal diseases people are facing all the time. Each year, a countless number of people die because of the late diagnosis of cancer or wrong treatments. Glioma, one of the most common primary brain tumors, has different aggressiveness and sub-regions, which can affect the risk of disease. Although prediction of overall survival based on multimodal magnetic resonance imaging (MRI) is challenging, in this study, we assess if and how location-based features of tumors can affect overall survival prediction. This approach is evaluated independently and in combination with radiomic features. The process is carried out on a data set entailing MRI images of patients with glioblastoma. To assess the impact of resection status, the data set is divided into two groups, patients were reported as gross total resection and unknown resection status. Then, different machine learning algorithms were used to evaluate how location features are linked with overall survival. Results from regression models indicate that location-based features have considerable effects on the patients' overall survival independently. Additionally, classifier models show an improvement in prediction accuracy by the addition of location-based features to radiomic features.
Collapse
Affiliation(s)
- Madjid Soltani
- Department of Mechanical Engineering, K. N. Toosi University of Technology, Tehran, Iran
- Department of Electrical and Computer Engineering, University of Waterloo, Waterloo, ON, Canada
- Centre for Biotechnology and Bioengineering (CBB), University of Waterloo, Waterloo, ON, Canada
- Advanced Bioengineering Initiative Center, Computational Medicine Center, K. N. Toosi University of Technology, Tehran, Iran
| | - Armin Bonakdar
- Department of Mechanical Engineering, K. N. Toosi University of Technology, Tehran, Iran
| | - Nastaran Shakourifar
- Department of Mechanical Engineering, K. N. Toosi University of Technology, Tehran, Iran
| | - Reza Babaei
- Department of Mechanical Engineering, K. N. Toosi University of Technology, Tehran, Iran
| | - Kaamran Raahemifar
- College of Information Sciences and Technology (IST), Data Science and Artificial Intelligence Program, Penn State University, State College, Pennsylvania, PA, United States
- Chemical Engineering Department, University of Waterloo, Waterloo, ON, Canada
- Optometry & Vision Science Department, University of Waterloo, Waterloo, ON, Canada
| |
Collapse
|
17
|
Islam M, Wijethilake N, Ren H. Glioblastoma multiforme prognosis: MRI missing modality generation, segmentation and radiogenomic survival prediction. Comput Med Imaging Graph 2021; 91:101906. [PMID: 34175548 DOI: 10.1016/j.compmedimag.2021.101906] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2020] [Revised: 03/16/2021] [Accepted: 03/22/2021] [Indexed: 12/30/2022]
Abstract
The accurate prognosis of glioblastoma multiforme (GBM) plays an essential role in planning correlated surgeries and treatments. The conventional models of survival prediction rely on radiomic features using magnetic resonance imaging (MRI). In this paper, we propose a radiogenomic overall survival (OS) prediction approach by incorporating gene expression data with radiomic features such as shape, geometry, and clinical information. We exploit TCGA (The Cancer Genomic Atlas) dataset and synthesize the missing MRI modalities using a fully convolutional network (FCN) in a conditional generative adversarial network (cGAN). Meanwhile, the same FCN architecture enables the tumor segmentation from the available and the synthesized MRI modalities. The proposed FCN architecture comprises octave convolution (OctConv) and a novel decoder, with skip connections in spatial and channel squeeze & excitation (skip-scSE) block. The OctConv can process low and high-frequency features individually and improve model efficiency by reducing channel-wise redundancy. Skip-scSE applies spatial and channel-wise excitation to signify the essential features and reduces the sparsity in deeper layers learning parameters using skip connections. The proposed approaches are evaluated by comparative experiments with state-of-the-art models in synthesis, segmentation, and overall survival (OS) prediction. We observe that adding missing MRI modality improves the segmentation prediction, and expression levels of gene markers have a high contribution in the GBM prognosis prediction, and fused radiogenomic features boost the OS estimation.
Collapse
Affiliation(s)
- Mobarakol Islam
- Dept. of Biomedical Engineering, National University of Singapore, Singapore; NUS Graduate School for Integrative Sciences and Engineering (NGS), National University of Singapore, Singapore.
| | - Navodini Wijethilake
- Dept. of Biomedical Engineering, National University of Singapore, Singapore; Department of Electronics and Telecommunications, University of Moratuwa, Sri Lanka.
| | - Hongliang Ren
- Dept. of Biomedical Engineering, National University of Singapore, Singapore; Department of Electronic Engineering and Shun Hing Institute of Advanced Engineering, The Chinese University of Hong Kong (CUHK), Hong Kong.
| |
Collapse
|
18
|
Zeng H, Chen L, Wang M, Luo Y, Huang Y, Ma X. Integrative radiogenomics analysis for predicting molecular features and survival in clear cell renal cell carcinoma. Aging (Albany NY) 2021; 13:9960-9975. [PMID: 33795526 PMCID: PMC8064160 DOI: 10.18632/aging.202752] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2020] [Accepted: 02/18/2021] [Indexed: 02/06/2023]
Abstract
Objectives: To assess the feasibility of predicting molecular characteristics by computed tomography (CT) radiomics features, and predicting overall survival (OS) using combination of omics data in clear cell renal cell carcinoma (ccRCC). Methods: Genetic data of 207 ccRCC patients was retrieved from The Cancer Genome Atlas (TCGA) and matched contrast-enhanced CT images were obtained from The Cancer Imaging Archive (TCIA). Another cohort of 175 ccRCC patients from West China Hospital was used as external validation. We first applied radiomics features and machine learning algorithms to predict genetic mutations and mRNA-based molecular subtypes. Next, we established predictive models for OS based on single omics, combined omics (radiomics+genomics, radiomics+transcriptomics, radiomics+proteomics) and all features (multi-omics). Results: Using radiomics features, random forest algorithm showed good capacity to identify the mutations VHL (AUC=0.971), BAP1 (AUC=0.955), PBRM1 (AUC=0.972), SETD2 (AUC=0.949), and molecular subtypes m1 (AUC=0.973), m2 (AUC=0.968), m3 (AUC=0.961), m4 (AUC=0.953). The TCGA cohort was divided into training (n=104) and validation (n=103) sets. The radiomics model had promising prognostic value for OS in validation set (5-year AUC=0.775) and external validation set (5-year AUC=0.755). In the validation set, the radiomics+omics models enhanced predictive accuracy than single-omics models, and the multi-omics model made further improvement (5-year AUC=0.846). High-risk group of validation set predicted by multi-omics model showed significantly poorer OS (HR=6.20, 95%CI: 3.19-8.44, p<0.0001). Conclusions: CT radiomics might be a feasible approach to predict genetic mutations, molecular subtypes and OS in ccRCC patients. Integrative analysis of radiogenomics may improve the survival prediction of ccRCC patients.
Collapse
Affiliation(s)
- Hao Zeng
- Department of Biotherapy, Cancer Center, State Key Laboratory of Biotherapy, West China Hospital, Sichuan University, and Collaborative Innovation Center, Chengdu, China
| | - Linyan Chen
- Department of Biotherapy, Cancer Center, State Key Laboratory of Biotherapy, West China Hospital, Sichuan University, and Collaborative Innovation Center, Chengdu, China
| | - Manni Wang
- Department of Biotherapy, Cancer Center, State Key Laboratory of Biotherapy, West China Hospital, Sichuan University, and Collaborative Innovation Center, Chengdu, China
| | - Yuling Luo
- West China School of Medicine, West China Hospital, Sichuan University, Chengdu, China
| | - Yeqian Huang
- West China School of Medicine, West China Hospital, Sichuan University, Chengdu, China
| | - Xuelei Ma
- Department of Biotherapy, Cancer Center, State Key Laboratory of Biotherapy, West China Hospital, Sichuan University, and Collaborative Innovation Center, Chengdu, China
| |
Collapse
|
19
|
Huang W, Li G, Wang Z, Zhou L, Yin X, Yang T, Wang P, Teng X, Feng Y, Yu H. A Ten-N 6-Methyladenosine (m 6A)-Modified Gene Signature Based on a Risk Score System Predicts Patient Prognosis in Rectum Adenocarcinoma. Front Oncol 2021; 10:567931. [PMID: 33680913 PMCID: PMC7925823 DOI: 10.3389/fonc.2020.567931] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2020] [Accepted: 12/16/2020] [Indexed: 12/27/2022] Open
Abstract
OBJECTIVES The study aims to analyze the expression of N6-methyladenosine (m6A)-modified genes in rectum adenocarcinoma (READ) and identify reliable prognostic biomarkers to predict the prognosis of READ. MATERIALS AND METHODS RNA sequence data of READ and corresponding clinical survival data were obtained from The Cancer Genome Atlas (TCGA) database. N6-methyladenosine (m6A)-modified genes in READ were downloaded from the "m6Avar" database. Differentially expressed m6A-modified genes in READ stratified by different clinicopathological characteristics were identified using the "limma" package in R. Protein-protein interaction (PPI) network and co-expression analysis of differentially expressed genes (DEGs) were performed using "STRING" and Cytoscape, respectively. Principal component analysis (PCA) was done using R. In addition, Gene Ontology (GO) and Kyoto Encyclopedia of Genes and Genomes (KEGG) pathways were used to functionally annotate the differentially expressed genes in different subgroups. Univariate Cox regression analyses were conducted to identify the powerful independent prognostic factors in READ associated with overall survival (OS). A robust likelihood-based survival model was built using the "rbsurv" package to screen for survival-associated signature genes. The Support Vector Machine (SVM) was used to predict the prognosis of READ through the risk score of survival-associated signature genes. Correlation analysis were carried out using GraphPad prism 8. RESULTS We screened 974 differentially expressed m6A-modified genes among four types of READ samples. Two READ subgroups (group 1 and group 2) were identified by K means clustering according to the expression of DEGs. The two subgroups were significantly different in overall survival and pathological stages. Next, 118 differentially expressed genes between the two subgroups were screened and the expression of 112 genes was found to be related to the prognosis of READ. Next, a panel of 10 survival-associated signature genes including adamtsl1, csmd2, fam13c, fam184a, klhl4, olfml2b, pdzd4, sec14l5, setbp1, tmem132b was constructed. The signature performed very well for prognosis prediction, time-dependent receiver-operating characteristic (ROC) analysis displaying an area under the curve (AUC) of 0.863, 0.8721, and 0.8752 for 3-year survival rate, prognostic status, and pathological stage prediction, respectively. Correlation analysis showed that the expression levels of the 10 m6A-modified genes were positively correlated with that of m6A demethylase FTO and ALKBH5. CONCLUSION This study identified potential m6A-modified genes that may be involved in the pathophysiology of READ and constructed a novel gene expression panel for READ risk stratification and prognosis prediction.
Collapse
Affiliation(s)
- Wei Huang
- Beijing Key Laboratory of Cancer Invasion and Metastasis Research, Department of Biochemistry and Molecular Biology, School of Basic Medical Sciences, Capital Medical University, Beijing, China
| | - Gen Li
- Beijing Key Laboratory of Cancer Invasion and Metastasis Research, Department of Biochemistry and Molecular Biology, School of Basic Medical Sciences, Capital Medical University, Beijing, China
| | - Zihang Wang
- School of Information Science and Technology, University of Science and Technology of China, Hefei, China
| | - Lin Zhou
- School of Information Science and Technology, University of Science and Technology of China, Hefei, China
| | - Xin Yin
- Beijing Key Laboratory of Cancer Invasion and Metastasis Research, Department of Biochemistry and Molecular Biology, School of Basic Medical Sciences, Capital Medical University, Beijing, China
| | - Tianshu Yang
- Beijing Key Laboratory of Cancer Invasion and Metastasis Research, Department of Biochemistry and Molecular Biology, School of Basic Medical Sciences, Capital Medical University, Beijing, China
| | - Pei Wang
- Beijing Key Laboratory of Cancer Invasion and Metastasis Research, Department of Biochemistry and Molecular Biology, School of Basic Medical Sciences, Capital Medical University, Beijing, China
| | - Xu Teng
- Beijing Key Laboratory of Cancer Invasion and Metastasis Research, Department of Biochemistry and Molecular Biology, School of Basic Medical Sciences, Capital Medical University, Beijing, China
| | - Yajuan Feng
- School of Information Science and Technology, University of Science and Technology of China, Hefei, China
| | - Hefen Yu
- Beijing Key Laboratory of Cancer Invasion and Metastasis Research, Department of Biochemistry and Molecular Biology, School of Basic Medical Sciences, Capital Medical University, Beijing, China
| |
Collapse
|
20
|
Wijethilake N, Islam M, Meedeniya D, Chitraranjan C, Perera I, Ren H. Radiogenomics of Glioblastoma: Identification of Radiomics Associated with Molecular Subtypes. Machine Learning in Clinical Neuroimaging and Radiogenomics in Neuro-oncology 2020. [DOI: 10.1007/978-3-030-66843-3_22] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/28/2023]
|