1
|
Cui Y, Feng J. One solid step to general neuroradiology AI. Eur Radiol 2024:10.1007/s00330-024-11020-y. [PMID: 39179801 DOI: 10.1007/s00330-024-11020-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2024] [Revised: 07/01/2024] [Accepted: 07/19/2024] [Indexed: 08/26/2024]
Affiliation(s)
- Yuanyuan Cui
- Department of Radiology, Second Affiliated Hospital of Naval Medical University, Shanghai, China.
| | - Jie Feng
- Department of Radiology, Corps Hospital of Shanxi province of Chinese People's Armed Police Force, Taiyuan, China.
| |
Collapse
|
2
|
Mi H, Sivagnanam S, Ho WJ, Zhang S, Bergman D, Deshpande A, Baras AS, Jaffee EM, Coussens LM, Fertig EJ, Popel AS. Computational methods and biomarker discovery strategies for spatial proteomics: a review in immuno-oncology. Brief Bioinform 2024; 25:bbae421. [PMID: 39179248 PMCID: PMC11343572 DOI: 10.1093/bib/bbae421] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2024] [Revised: 07/11/2024] [Accepted: 08/09/2024] [Indexed: 08/26/2024] Open
Abstract
Advancements in imaging technologies have revolutionized our ability to deeply profile pathological tissue architectures, generating large volumes of imaging data with unparalleled spatial resolution. This type of data collection, namely, spatial proteomics, offers invaluable insights into various human diseases. Simultaneously, computational algorithms have evolved to manage the increasing dimensionality of spatial proteomics inherent in this progress. Numerous imaging-based computational frameworks, such as computational pathology, have been proposed for research and clinical applications. However, the development of these fields demands diverse domain expertise, creating barriers to their integration and further application. This review seeks to bridge this divide by presenting a comprehensive guideline. We consolidate prevailing computational methods and outline a roadmap from image processing to data-driven, statistics-informed biomarker discovery. Additionally, we explore future perspectives as the field moves toward interfacing with other quantitative domains, holding significant promise for precision care in immuno-oncology.
Collapse
Affiliation(s)
- Haoyang Mi
- Department of Biomedical Engineering, Johns Hopkins University School of Medicine, Baltimore, MD 21205, United States
| | - Shamilene Sivagnanam
- The Knight Cancer Institute, Oregon Health and Science University, Portland, OR 97201, United States
- Department of Cell, Development and Cancer Biology, Oregon Health and Science University, Portland, OR 97201, United States
| | - Won Jin Ho
- Department of Oncology, Johns Hopkins University School of Medicine, MD 21205, United States
- Convergence Institute, Johns Hopkins University, Baltimore, MD 21205, United States
| | - Shuming Zhang
- Department of Biomedical Engineering, Johns Hopkins University School of Medicine, Baltimore, MD 21205, United States
| | - Daniel Bergman
- Department of Oncology, Johns Hopkins University School of Medicine, MD 21205, United States
- Convergence Institute, Johns Hopkins University, Baltimore, MD 21205, United States
| | - Atul Deshpande
- Department of Oncology, Johns Hopkins University School of Medicine, MD 21205, United States
- Convergence Institute, Johns Hopkins University, Baltimore, MD 21205, United States
- Bloomberg-Kimmel Institute for Cancer Immunotherapy, Johns Hopkins University School of Medicine, Baltimore, MD 21205, United States
| | - Alexander S Baras
- Bloomberg-Kimmel Institute for Cancer Immunotherapy, Johns Hopkins University School of Medicine, Baltimore, MD 21205, United States
- Department of Pathology, Johns Hopkins University School of Medicine, MD 21205, United States
- The Sidney Kimmel Comprehensive Cancer Center, Johns Hopkins University School of Medicine, Baltimore, MD 21205, United States
| | - Elizabeth M Jaffee
- Department of Oncology, Johns Hopkins University School of Medicine, MD 21205, United States
- Convergence Institute, Johns Hopkins University, Baltimore, MD 21205, United States
- Bloomberg-Kimmel Institute for Cancer Immunotherapy, Johns Hopkins University School of Medicine, Baltimore, MD 21205, United States
| | - Lisa M Coussens
- The Knight Cancer Institute, Oregon Health and Science University, Portland, OR 97201, United States
- Department of Cell, Development and Cancer Biology, Oregon Health and Science University, Portland, OR 97201, United States
- Brenden-Colson Center for Pancreatic Care, Oregon Health and Science University, Portland, OR 97201, United States
| | - Elana J Fertig
- Department of Biomedical Engineering, Johns Hopkins University School of Medicine, Baltimore, MD 21205, United States
- Department of Oncology, Johns Hopkins University School of Medicine, MD 21205, United States
- Convergence Institute, Johns Hopkins University, Baltimore, MD 21205, United States
- Bloomberg-Kimmel Institute for Cancer Immunotherapy, Johns Hopkins University School of Medicine, Baltimore, MD 21205, United States
- Department of Applied Mathematics and Statistics, Johns Hopkins University Whiting School of Engineering, Baltimore, MD 21218, United States
| | - Aleksander S Popel
- Department of Biomedical Engineering, Johns Hopkins University School of Medicine, Baltimore, MD 21205, United States
- Department of Oncology, Johns Hopkins University School of Medicine, MD 21205, United States
| |
Collapse
|
3
|
Khalighi S, Reddy K, Midya A, Pandav KB, Madabhushi A, Abedalthagafi M. Artificial intelligence in neuro-oncology: advances and challenges in brain tumor diagnosis, prognosis, and precision treatment. NPJ Precis Oncol 2024; 8:80. [PMID: 38553633 PMCID: PMC10980741 DOI: 10.1038/s41698-024-00575-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2023] [Accepted: 03/13/2024] [Indexed: 04/02/2024] Open
Abstract
This review delves into the most recent advancements in applying artificial intelligence (AI) within neuro-oncology, specifically emphasizing work on gliomas, a class of brain tumors that represent a significant global health issue. AI has brought transformative innovations to brain tumor management, utilizing imaging, histopathological, and genomic tools for efficient detection, categorization, outcome prediction, and treatment planning. Assessing its influence across all facets of malignant brain tumor management- diagnosis, prognosis, and therapy- AI models outperform human evaluations in terms of accuracy and specificity. Their ability to discern molecular aspects from imaging may reduce reliance on invasive diagnostics and may accelerate the time to molecular diagnoses. The review covers AI techniques, from classical machine learning to deep learning, highlighting current applications and challenges. Promising directions for future research include multimodal data integration, generative AI, large medical language models, precise tumor delineation and characterization, and addressing racial and gender disparities. Adaptive personalized treatment strategies are also emphasized for optimizing clinical outcomes. Ethical, legal, and social implications are discussed, advocating for transparency and fairness in AI integration for neuro-oncology and providing a holistic understanding of its transformative impact on patient care.
Collapse
Affiliation(s)
- Sirvan Khalighi
- Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University, Atlanta, GA, USA
| | - Kartik Reddy
- Department of Radiology, Emory University, Atlanta, GA, USA
| | - Abhishek Midya
- Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University, Atlanta, GA, USA
| | - Krunal Balvantbhai Pandav
- Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University, Atlanta, GA, USA
| | - Anant Madabhushi
- Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University, Atlanta, GA, USA.
- Atlanta Veterans Administration Medical Center, Atlanta, GA, USA.
| | - Malak Abedalthagafi
- Department of Pathology and Laboratory Medicine, Emory University, Atlanta, GA, USA.
- The Cell and Molecular Biology Program, Winship Cancer Institute, Atlanta, GA, USA.
| |
Collapse
|
4
|
Haque R, Hassan MM, Bairagi AK, Shariful Islam SM. NeuroNet19: an explainable deep neural network model for the classification of brain tumors using magnetic resonance imaging data. Sci Rep 2024; 14:1524. [PMID: 38233516 PMCID: PMC10794704 DOI: 10.1038/s41598-024-51867-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2023] [Accepted: 01/10/2024] [Indexed: 01/19/2024] Open
Abstract
Brain tumors (BTs) are one of the deadliest diseases that can significantly shorten a person's life. In recent years, deep learning has become increasingly popular for detecting and classifying BTs. In this paper, we propose a deep neural network architecture called NeuroNet19. It utilizes VGG19 as its backbone and incorporates a novel module named the Inverted Pyramid Pooling Module (iPPM). The iPPM captures multi-scale feature maps, ensuring the extraction of both local and global image contexts. This enhances the feature maps produced by the backbone, regardless of the spatial positioning or size of the tumors. To ensure the model's transparency and accountability, we employ Explainable AI. Specifically, we use Local Interpretable Model-Agnostic Explanations (LIME), which highlights the features or areas focused on while predicting individual images. NeuroNet19 is trained on four classes of BTs: glioma, meningioma, no tumor, and pituitary tumors. It is tested on a public dataset containing 7023 images. Our research demonstrates that NeuroNet19 achieves the highest accuracy at 99.3%, with precision, recall, and F1 scores at 99.2% and a Cohen Kappa coefficient (CKC) of 99%.
Collapse
Affiliation(s)
- Rezuana Haque
- Computer Science and Engineering, BGC Trust University Bangladesh, Chittagong, Bangladesh
| | - Md Mehedi Hassan
- Computer Science and Engineering Discipline, Khulna University, Khulna, 9208, Bangladesh.
| | - Anupam Kumar Bairagi
- Computer Science and Engineering Discipline, Khulna University, Khulna, 9208, Bangladesh
| | | |
Collapse
|
5
|
Gogoshin G, Rodin AS. Graph Neural Networks in Cancer and Oncology Research: Emerging and Future Trends. Cancers (Basel) 2023; 15:5858. [PMID: 38136405 PMCID: PMC10742144 DOI: 10.3390/cancers15245858] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2023] [Revised: 12/09/2023] [Accepted: 12/14/2023] [Indexed: 12/24/2023] Open
Abstract
Next-generation cancer and oncology research needs to take full advantage of the multimodal structured, or graph, information, with the graph data types ranging from molecular structures to spatially resolved imaging and digital pathology, biological networks, and knowledge graphs. Graph Neural Networks (GNNs) efficiently combine the graph structure representations with the high predictive performance of deep learning, especially on large multimodal datasets. In this review article, we survey the landscape of recent (2020-present) GNN applications in the context of cancer and oncology research, and delineate six currently predominant research areas. We then identify the most promising directions for future research. We compare GNNs with graphical models and "non-structured" deep learning, and devise guidelines for cancer and oncology researchers or physician-scientists, asking the question of whether they should adopt the GNN methodology in their research pipelines.
Collapse
Affiliation(s)
- Grigoriy Gogoshin
- Department of Computational and Quantitative Medicine, Beckman Research Institute, and Diabetes and Metabolism Research Institute, City of Hope National Medical Center, 1500 East Duarte Road, Duarte, CA 91010, USA
| | - Andrei S. Rodin
- Department of Computational and Quantitative Medicine, Beckman Research Institute, and Diabetes and Metabolism Research Institute, City of Hope National Medical Center, 1500 East Duarte Road, Duarte, CA 91010, USA
| |
Collapse
|