1
|
Yang T, Wang X, Jin Y, Yao X, Sun Z, Chen P, Zhou S, Zhu W, Chen W. Deep learning radiopathomics predicts targeted therapy sensitivity in EGFR-mutant lung adenocarcinoma. J Transl Med 2025; 23:482. [PMID: 40301933 PMCID: PMC12039126 DOI: 10.1186/s12967-025-06480-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2024] [Accepted: 04/11/2025] [Indexed: 05/01/2025] Open
Abstract
BACKGROUND Ttyrosine kinase inhibitors (TKIs) represent the standard first-line treatment for patients with epidermal growth factor receptor (EGFR)-mutant lung adenocarcinoma. However, not all patients with EGFR mutations respond to TKIs. This study aims to develop a deep learning radiological-pathological-clinical (DLRPC) model that integrates computed tomography (CT) images, hematoxylin and eosin (H&E)-stained aspiration biopsy samples, and clinical data to predict the response in EGFR-mutant lung adenocarcinoma patients undergoing TKIs treatment. METHODS We retrospectively analyzed data from 214 lung adenocarcinoma patients who received TKIs treatment from two medical centers between September 2013 and June 2023. The DLRPC model leverages paired CT, pathological images and clinical data, incorporating a clinical-based attention mask to further explore the cross-modality associations. To evaluate its diagnostic performance, we compared the DLRPC model against single-modality models and a decision level fusion model based on Dempster-Shafer theory. Model performances metrics, including area under the curve (AUC), accuracy, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV), were used for evaluation. The Delong test assessed statistically significantly differences in AUC among models. RESULTS The DLRPC model demonstrated strong performance, achieving an AUC value of 0.8424. It outperformed the single-modality models (AUC = 0.6894, 0.7753, 0.8052 for CT model, pathology model and clinical model, respectively. P < 0.05). Additionally, the DLRPC model surpassed the decision level fusion model (AUC = 0.8132, P < 0.05). CONCLUSION The DLRPC model effectively predicts the response of EGFR-mutant lung adenocarcinoma patients to TKIs, providing a promising tool for personalized treatment decisions in lung cancer management.
Collapse
Affiliation(s)
- Taotao Yang
- Department of Radiology, Southwest Hospital, Army Medical University (Third Military Medical University), Chongqing, 400038, China
- Yu-Yue Pathology Scientific Research Center, Chongqing, 400039, China
| | - Xianqi Wang
- Department of Radiology, Southwest Hospital, Army Medical University (Third Military Medical University), Chongqing, 400038, China
- Yu-Yue Pathology Scientific Research Center, Chongqing, 400039, China
| | - Yuan Jin
- Zhejiang Lab, Hangzhou, 311121, China
| | - Xiaohong Yao
- Institute of Pathology and Southwest Cancer Center, Southwest Hospital, Army Medical University, (Third Military Medical University), Chongqing, 400038, China
| | - Zhiyuan Sun
- Department of Radiology, Jinling Hospital, Medical School of Nanjing University, Nanjing, 210002, China
| | - Pinzhen Chen
- Department of Radiology, Southwest Hospital, Army Medical University (Third Military Medical University), Chongqing, 400038, China
| | - Suyi Zhou
- Department of Radiology, Southwest Hospital, Army Medical University (Third Military Medical University), Chongqing, 400038, China
| | | | - Wei Chen
- Department of Radiology, Southwest Hospital, Army Medical University (Third Military Medical University), Chongqing, 400038, China.
- Yu-Yue Pathology Scientific Research Center, Chongqing, 400039, China.
| |
Collapse
|
2
|
Kong X, Shi J, Sun D, Cheng L, Wu C, Jiang Z, Zheng Y, Wang W, Wu H. A deep-learning model for predicting tyrosine kinase inhibitor response from histology in gastrointestinal stromal tumor. J Pathol 2025; 265:462-471. [PMID: 39950223 DOI: 10.1002/path.6399] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2024] [Revised: 09/01/2024] [Accepted: 01/06/2025] [Indexed: 03/06/2025]
Abstract
Over 90% of gastrointestinal stromal tumors (GISTs) harbor mutations in KIT or PDGFRA that can predict response to tyrosine kinase inhibitor (TKI) therapies, as recommended by NCCN (National Comprehensive Cancer Network) guidelines. However, gene sequencing for mutation testing is expensive and time-consuming and is susceptible to a variety of preanalytical factors. To overcome the challenges associated with genetic screening by sequencing, in the current study we developed an artificial intelligence-based deep-learning (DL) model that uses convolutional neural networks (CNN) to analyze digitized hematoxylin and eosin staining in tumor histological sections to predict potential response to imatinib or avapritinib treatment in GIST patients. Assessment with an independent testing set showed that our DL model could predict imatinib sensitivity with an area under the curve (AUC) of 0.902 in case-wise analysis and 0.807 in slide-wise analysis. Case-level AUCs for predicting imatinib-dose-adjustment cases, avapritinib-sensitive cases, and wildtype GISTs were 0.920, 0.958, and 0.776, respectively, while slide-level AUCs for these respective groups were 0.714, 0.922, and 0.886, respectively. Our model showed comparable or better prediction of actual response to TKI than sequencing-based screening (accuracy 0.9286 versus 0.8929; DL model versus sequencing), while predictions of nonresponse to imatinib/avapritinib showed markedly higher accuracy than sequencing (0.7143 versus 0.4286). These results demonstrate the potential of a DL model to improve predictions of treatment response to TKI therapy from histology in GIST patients. © 2025 The Pathological Society of Great Britain and Ireland.
Collapse
Affiliation(s)
- Xue Kong
- Department of Pathology, The First Affiliated Hospital of USTC, Division of Life Sciences and Medicine, University of Science and Technology of PR China, Hefei, PR China
- Intelligent Pathology Institute, Division of Life Sciences and Medicine, University of Science and Technology of PR China, Hefei, PR China
| | - Jun Shi
- School of Software, Hefei University of Technology, Hefei, PR China
| | - Dongdong Sun
- School of Computer Science and Information Engineering, Hefei University of Technology, Hefei, PR China
| | - Lanqing Cheng
- Department of Pathology, The First Affiliated Hospital of USTC, Division of Life Sciences and Medicine, University of Science and Technology of PR China, Hefei, PR China
- Intelligent Pathology Institute, Division of Life Sciences and Medicine, University of Science and Technology of PR China, Hefei, PR China
| | - Can Wu
- Department of Pathology, The First Affiliated Hospital of USTC, Division of Life Sciences and Medicine, University of Science and Technology of PR China, Hefei, PR China
- Intelligent Pathology Institute, Division of Life Sciences and Medicine, University of Science and Technology of PR China, Hefei, PR China
| | - Zhiguo Jiang
- Image Processing Center, School of Astronautics, Beihang University, Beijing, PR China
| | - Yushan Zheng
- School of Engineering Medicine, Beijing Advanced Innovation Center on Biomedical Engineering, Beihang University, Beijing, PR China
| | - Wei Wang
- Department of Pathology, The First Affiliated Hospital of USTC, Division of Life Sciences and Medicine, University of Science and Technology of PR China, Hefei, PR China
- Intelligent Pathology Institute, Division of Life Sciences and Medicine, University of Science and Technology of PR China, Hefei, PR China
| | - Haibo Wu
- Department of Pathology, The First Affiliated Hospital of USTC, Division of Life Sciences and Medicine, University of Science and Technology of PR China, Hefei, PR China
- Intelligent Pathology Institute, Division of Life Sciences and Medicine, University of Science and Technology of PR China, Hefei, PR China
| |
Collapse
|
3
|
Oliveira LD, Lu J, Erak E, Mendes AA, Dairo O, Ertunc O, Kulac I, Baena-Del Valle JA, Jones T, Hicks JL, Glavaris S, Guner G, Vidal ID, Trock BJ, Joshi U, Kondragunta C, Bonthu S, Joshu C, Singhal N, De Marzo AM, Lotan TL. Comparison of Pathologist and Artificial Intelligence-based Grading for Prediction of Metastatic Outcomes After Radical Prostatectomy. Eur Urol Oncol 2025; 8:9-13. [PMID: 39232875 PMCID: PMC11841679 DOI: 10.1016/j.euo.2024.08.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2024] [Revised: 07/05/2024] [Accepted: 08/09/2024] [Indexed: 09/06/2024]
Abstract
Gleason grade group (GG) is the most powerful prognostic variable in localized prostate cancer; however, interobserver variability remains a challenge. Artificial intelligence algorithms applied to histopathologic images standardize grading, but most have been tested only for agreement with pathologist GG, without assessment of performance with respect to oncologic outcomes. We compared deep learning-based and pathologist-based GGs for an association with metastatic outcome in three surgical cohorts comprising 777 unique patients. A digitized whole slide image of the representative hematoxylin and eosin-stained slide of the dominant tumor nodule was assigned a GG by an artificial intelligence-based grading algorithm and was compared with the GG assigned by a contemporary pathologist or the original pathologist-assigned GG for the entire prostatectomy. Harrell's C-indices based on Cox models for time to metastasis were compared. In a combined analysis of all cohorts, the C-index for the artificial intelligence-assigned GG was 0.77 (95% confidence interval [CI]: 0.73-0.81), compared with 0.77 (95% CI: 0.73-0.81) for the pathologist-assigned GG. By comparison, the original pathologist-assigned GG for the entire case had a C-index of 0.78 (95% CI: 0.73-0.82). PATIENT SUMMARY: Artificial intelligence-enabled prostate cancer grading on a single slide was comparable with pathologist grading for predicting metastatic outcome in men treated by radical prostatectomy, enabling equal access to expert grading in lower resource settings.
Collapse
Affiliation(s)
- Lia D Oliveira
- Department of Pathology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Jiayun Lu
- Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA
| | - Eric Erak
- Department of Pathology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Adrianna A Mendes
- Department of Pathology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Oluwademilade Dairo
- Department of Pathology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Onur Ertunc
- Suleyman Demirel University School of Medicine, Isparta, Turkey
| | | | | | - Tracy Jones
- Department of Pathology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Jessica L Hicks
- Department of Pathology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Stephanie Glavaris
- Department of Pathology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Gunes Guner
- Faculty of Medicine, Hacettepe University, Ankara, Turkey
| | - Igor D Vidal
- Department of Pathology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Bruce J Trock
- Department of Urology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | | | | | | | - Corinne Joshu
- Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA
| | | | - Angelo M De Marzo
- Department of Pathology, Johns Hopkins University School of Medicine, Baltimore, MD, USA; Department of Oncology, Johns Hopkins University School of Medicine, Baltimore, MD, USA; Department of Urology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Tamara L Lotan
- Department of Pathology, Johns Hopkins University School of Medicine, Baltimore, MD, USA; Department of Oncology, Johns Hopkins University School of Medicine, Baltimore, MD, USA; Department of Urology, Johns Hopkins University School of Medicine, Baltimore, MD, USA.
| |
Collapse
|
4
|
Wang X, Wang Z, Wang W, Liu Z, Ma Z, Guo Y, Su D, Sun Q, Pei D, Duan W, Qiu Y, Wang M, Yang Y, Li W, Liu H, Ma C, Yu M, Yu Y, Chen T, Fu J, Li S, Yu B, Ji Y, Li W, Yan D, Liu X, Li ZC, Zhang Z. IDH-mutant glioma risk stratification via whole slide images: Identifying pathological feature associations. iScience 2025; 28:111605. [PMID: 39845415 PMCID: PMC11751506 DOI: 10.1016/j.isci.2024.111605] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2024] [Revised: 08/12/2024] [Accepted: 12/11/2024] [Indexed: 01/24/2025] Open
Abstract
This article aims to develop and validate a pathological prognostic model for predicting prognosis in patients with isocitrate dehydrogenase (IDH)-mutant gliomas and reveal the biological underpinning of the prognostic pathological features. The pathomic model was constructed based on whole slide images (WSIs) from a training set (N = 486) and evaluated on internal validation set (N = 209), HPPH validation set (N = 54), and TCGA validation set (N = 352). Biological implications of PathScore and individual pathomic features were identified by pathogenomics set (N = 100). The WSI-based pathological signature was an independent prognostic factor. Incorporating the pathological features into a clinical model resulted in a pathological-clinical model that predicted survival better than either the pathological model or clinical model alone. Ten categories of pathways (metabolism, proliferation, immunity, DNA damage response, disease, migrate, protein modification, synapse, transcription and translation, and complex cellular functions) were significantly correlated with the WSI-based pathological features.
Collapse
Affiliation(s)
- Xiaotao Wang
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Zilong Wang
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Weiwei Wang
- Department of Pathology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Zaoqu Liu
- Institute of Basic Medical Sciences, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing 100730, China
| | - Zeyu Ma
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Yang Guo
- Department of Neurosurgery, Henan Provincial People’s Hospital, Zhengzhou, Henan, China
| | - Dingyuan Su
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Qiuchang Sun
- Institute of Biomedical and Health Engineering, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Dongling Pei
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Wenchao Duan
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Yuning Qiu
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Minkai Wang
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Yongqiang Yang
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Wenyuan Li
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Haoran Liu
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Caoyuan Ma
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Miaomiao Yu
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Yinhui Yu
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Te Chen
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Jing Fu
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Sen Li
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Bin Yu
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Yuchen Ji
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Wencai Li
- Department of Pathology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Dongming Yan
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Xianzhi Liu
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Zhi-Cheng Li
- Institute of Biomedical and Health Engineering, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
- The Key Laboratory of Biomedical Imaging Science and System, Chinese Academy of Sciences, Shenzhen, China
| | - Zhenyu Zhang
- Department of Neurosurgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| |
Collapse
|
5
|
Tian H, Tian Y, Li D, Zhao M, Luo Q, Kong L, Qin T. Artificial intelligence model predicts M2 macrophage levels and HCC prognosis with only globally labeled pathological images. Front Oncol 2024; 14:1474155. [PMID: 39759153 PMCID: PMC11695232 DOI: 10.3389/fonc.2024.1474155] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2024] [Accepted: 12/09/2024] [Indexed: 01/07/2025] Open
Abstract
Background and aims The levels of M2 macrophages are significantly associated with the prognosis of hepatocellular carcinoma (HCC), however, current detection methods in clinical settings remain challenging. Our study aims to develop a weakly supervised artificial intelligence model using globally labeled histological images, to predict M2 macrophage levels and forecast the prognosis of HCC patients by integrating clinical features. Methods CIBERSORTx was used to calculate M2 macrophage abundance. We developed a slide-level, weakly-supervised clustering method for Whole Slide Images (WSIs) by integrating Masked Autoencoders (MAE) with ResNet-32t to predict M2 macrophage abundance. Results We developed an MAE-ResNet model to predict M2 macrophage levels using WSIs. In the testing dataset, the area under the curve (AUC) (95% CI) was 0.73 (0.59-0.87). We constructed a Cox regression model showing that the predicted probabilities of M2 macrophage abundance were negatively associated with the prognosis of HCC (HR=1.89, p=0.031). Furthermore, we incorporated clinical data, screened variables using Lasso regression, and built the comprehensive prediction model that better predicted prognosis. (HR=2.359, p=0.001). Conclusion Our models effectively predicted M2 macrophage levels and HCC prognosis. The findings suggest that our models offer a novel method for determining biomarker levels and forecasting prognosis, eliminating additional clinical tests, thereby delivering substantial clinical benefits.
Collapse
Affiliation(s)
- Huiyuan Tian
- Department of Scientific Research and Foreign Affairs, Henan Provincial People’s Hospital, Zhengzhou University People’s Hospital, Zhengzhou, Henan, China
| | - Yongshao Tian
- School of Computer Science and Technology, University of Science and Technology of China, Hefei, Anhui, China
| | - Dujuan Li
- Department of Pathology, Henan Provincial People’s Hospital, Zhengzhou University People’s Hospital, Zhengzhou, Henan, China
| | - Minfan Zhao
- School of Computer Science and Technology, University of Science and Technology of China, Hefei, Anhui, China
| | - Qiankun Luo
- Department of Hepatobiliary and Pancreatic Surgery, Henan Provincial People’s Hospital, Zhengzhou University People’s Hospital, Zhengzhou, Henan, China
| | - Lingfei Kong
- Department of Pathology, Henan Provincial People’s Hospital, Zhengzhou University People’s Hospital, Zhengzhou, Henan, China
| | - Tao Qin
- Department of Hepatobiliary and Pancreatic Surgery, Henan Provincial People’s Hospital, Zhengzhou University People’s Hospital, Zhengzhou, Henan, China
| |
Collapse
|
6
|
Sagiv C, Hadar O, Najjar A, Pahnke J. Artificial intelligence in surgical pathology - Where do we stand, where do we go? EUROPEAN JOURNAL OF SURGICAL ONCOLOGY 2024:109541. [PMID: 39694737 DOI: 10.1016/j.ejso.2024.109541] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2024] [Revised: 11/14/2024] [Accepted: 12/10/2024] [Indexed: 12/20/2024]
Abstract
Surgical and neuropathologists continuously search for new and disease-specific features, such as independent predictors of tumor prognosis or determinants of tumor entities and sub-entities. This is a task where artificial intelligence (AI)/machine learning (ML) systems could significantly contribute to help with tumor outcome prediction and the search for new diagnostic or treatment stratification biomarkers. AI systems are increasingly integrated into routine pathology workflows to improve accuracy, reproducibility, productivity and to reveal difficult-to-see features in complicated histological slides, including the quantification of important markers for tumor grading and staging. In this article, we review the infrastructure needed to facilitate digital and computational pathology. We address the barriers for its full deployment in the clinical setting and describe the use of AI in intraoperative or postoperative settings were frozen or formalin-fixed, paraffin-embedded materials are used. We also summarize quality assessment issues of slide digitization, new spatial biology approaches, and the determination of specific gene-expression from whole slide images. Finally, we highlight new innovative and future technologies, such as large language models, optical biopsies, and mass spectrometry imaging.
Collapse
Affiliation(s)
- Chen Sagiv
- DeePathology Ltd., HaTidhar 5, P. O. Box 2622, Ra'anana, IL-4365104, Israel.
| | - Ofir Hadar
- DeePathology Ltd., HaTidhar 5, P. O. Box 2622, Ra'anana, IL-4365104, Israel
| | - Abderrahman Najjar
- Department of Pathology, Rabin Medical Center (RMC), Ze'ev Jabotinsky 39, Petah Tikva, IL-4941492, Israel
| | - Jens Pahnke
- Translational Neurodegeneration Research and Neuropathology Lab, Department of Clinical Medicine (KlinMed), Medical Faculty, University of Oslo (UiO) and Section of Neuropathology Research, Department of Pathology, Clinics for Laboratory Medicine (KLM), Oslo University Hospital (OUS), Sognsvannsveien 20, NO-0372, Oslo, Norway; Institute of Nutritional Medicine (INUM) and Lübeck Institute of Dermatology (LIED), University of Lübeck (UzL) and University Medical Center Schleswig-Holstein (UKSH), Ratzeburger Allee 160, D-23538, Lübeck, Germany; Department of Pharmacology, Faculty of Medicine and Life Sciences, University of Latvia, Jelgavas iela 3, LV-1004, Rīga, Latvia; Department of Neurobiology, School of Neurobiology, Biochemistry and Biophysics, The Georg S. Wise Faculty of Life Sciences, Tel Aviv University, Ramat Aviv, IL-6997801, Israel.
| |
Collapse
|
7
|
Xiaojian Y, Zhanbo Q, Jian C, Zefeng W, Jian L, Jin L, Yuefen P, Shuwen H. Deep learning application in prediction of cancer molecular alterations based on pathological images: a bibliographic analysis via CiteSpace. J Cancer Res Clin Oncol 2024; 150:467. [PMID: 39422817 PMCID: PMC11489169 DOI: 10.1007/s00432-024-05992-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2024] [Accepted: 10/09/2024] [Indexed: 10/19/2024]
Abstract
BACKGROUND The advancements in artificial intelligence (AI) technology for image recognition were propelling molecular pathology research into a new era. OBJECTIVE To summarize the hot spots and research trends in the field of molecular pathology image recognition. METHODS Relevant articles from January 1st, 2010, to August 25th, 2023, were retrieved from the Web of Science Core Collection. Subsequently, CiteSpace was employed for bibliometric and visual analysis, generating diverse network diagrams illustrating keywords, highly cited references, hot topics, and research trends. RESULTS A total of 110 relevant articles were extracted from a pool of 10,205 articles. The overall publication count exhibited a rising trend each year. The leading contributors in terms of institutions, countries, and authors were Maastricht University (11 articles), the United States (38 articles), and Kather Jacob Nicholas (9 articles), respectively. Half of the top ten research institutions, based on publication volume, were affiliated with Germany. The most frequently cited article was authored by Nicolas Coudray et al. accumulating 703 citations. The keyword "Deep learning" had the highest frequency in 2019. Notably, the highlighted keywords from 2022 to 2023 included "microsatellite instability", and there were 21 articles focusing on utilizing algorithms to recognize microsatellite instability (MSI) in colorectal cancer (CRC) pathological images. CONCLUSION The use of DL is expected to provide a new strategy to effectively solve the current problem of time-consuming and expensive molecular pathology detection. Therefore, further research is needed to address issues, such as data quality and standardization, model interpretability, and resource and infrastructure requirements.
Collapse
Affiliation(s)
- Yu Xiaojian
- Huzhou Central Hospital, Affiliated Central Hospital Huzhou University, No.1558, Sanhuan North Road, Wuxing District, Huzhou, 313000, Zhejiang Province, China
- Key Laboratory of Multiomics Research and Clinical Transformation of Digestive Cancer of Huzhou, Huzhou, China
- Huzhou Central Hospital, Fifth School of Clinical Medicine of Zhejiang Chinese Medical University, Huzhou, China
| | - Qu Zhanbo
- Huzhou Central Hospital, Affiliated Central Hospital Huzhou University, No.1558, Sanhuan North Road, Wuxing District, Huzhou, 313000, Zhejiang Province, China
- Key Laboratory of Multiomics Research and Clinical Transformation of Digestive Cancer of Huzhou, Huzhou, China
- Huzhou Central Hospital, Fifth School of Clinical Medicine of Zhejiang Chinese Medical University, Huzhou, China
| | - Chu Jian
- Huzhou Central Hospital, Affiliated Central Hospital Huzhou University, No.1558, Sanhuan North Road, Wuxing District, Huzhou, 313000, Zhejiang Province, China
- Key Laboratory of Multiomics Research and Clinical Transformation of Digestive Cancer of Huzhou, Huzhou, China
- Huzhou Central Hospital, Fifth School of Clinical Medicine of Zhejiang Chinese Medical University, Huzhou, China
| | - Wang Zefeng
- Huzhou Central Hospital, Affiliated Central Hospital Huzhou University, No.1558, Sanhuan North Road, Wuxing District, Huzhou, 313000, Zhejiang Province, China
- Key Laboratory of Multiomics Research and Clinical Transformation of Digestive Cancer of Huzhou, Huzhou, China
- Huzhou Central Hospital, Fifth School of Clinical Medicine of Zhejiang Chinese Medical University, Huzhou, China
| | - Liu Jian
- Huzhou Central Hospital, Affiliated Central Hospital Huzhou University, No.1558, Sanhuan North Road, Wuxing District, Huzhou, 313000, Zhejiang Province, China
- Key Laboratory of Multiomics Research and Clinical Transformation of Digestive Cancer of Huzhou, Huzhou, China
- Huzhou Central Hospital, Fifth School of Clinical Medicine of Zhejiang Chinese Medical University, Huzhou, China
| | - Liu Jin
- Huzhou Central Hospital, Affiliated Central Hospital Huzhou University, No.1558, Sanhuan North Road, Wuxing District, Huzhou, 313000, Zhejiang Province, China
- Key Laboratory of Multiomics Research and Clinical Transformation of Digestive Cancer of Huzhou, Huzhou, China
- Huzhou Central Hospital, Fifth School of Clinical Medicine of Zhejiang Chinese Medical University, Huzhou, China
| | - Pan Yuefen
- Huzhou Central Hospital, Affiliated Central Hospital Huzhou University, No.1558, Sanhuan North Road, Wuxing District, Huzhou, 313000, Zhejiang Province, China.
- Key Laboratory of Multiomics Research and Clinical Transformation of Digestive Cancer of Huzhou, Huzhou, China.
- Huzhou Central Hospital, Fifth School of Clinical Medicine of Zhejiang Chinese Medical University, Huzhou, China.
| | - Han Shuwen
- Huzhou Central Hospital, Affiliated Central Hospital Huzhou University, No.1558, Sanhuan North Road, Wuxing District, Huzhou, 313000, Zhejiang Province, China.
- Key Laboratory of Multiomics Research and Clinical Transformation of Digestive Cancer of Huzhou, Huzhou, China.
- Huzhou Central Hospital, Fifth School of Clinical Medicine of Zhejiang Chinese Medical University, Huzhou, China.
- ASIR(Institute - Association of intelligent systems and robotics), Rueil-Malmaison, France.
| |
Collapse
|
8
|
Viet CT, Zhang M, Dharmaraj N, Li GY, Pearson AT, Manon VA, Grandhi A, Xu K, Aouizerat BE, Young S. Artificial Intelligence Applications in Oral Cancer and Oral Dysplasia. Tissue Eng Part A 2024; 30:640-651. [PMID: 39041628 PMCID: PMC11564848 DOI: 10.1089/ten.tea.2024.0096] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2024] [Accepted: 05/16/2024] [Indexed: 07/24/2024] Open
Abstract
Oral squamous cell carcinoma (OSCC) is a highly unpredictable disease with devastating mortality rates that have not changed over the past decades, in the face of advancements in treatments and biomarkers, which have improved survival for other cancers. Delays in diagnosis are frequent, leading to more disfiguring treatments and poor outcomes for patients. The clinical challenge lies in identifying those patients at the highest risk of developing OSCC. Oral epithelial dysplasia (OED) is a precursor of OSCC with highly variable behavior across patients. There is no reliable clinical, pathological, histological, or molecular biomarker to determine individual risk in OED patients. Similarly, there are no robust biomarkers to predict treatment outcomes or mortality in OSCC patients. This review aims to highlight advancements in artificial intelligence (AI)-based methods to develop predictive biomarkers of OED transformation to OSCC or predictive biomarkers of OSCC mortality and treatment response. Biomarkers such as S100A7 demonstrate promising appraisal for the risk of malignant transformation of OED. Machine learning-enhanced multiplex immunohistochemistry workflows examine immune cell patterns and organization within the tumor immune microenvironment to generate outcome predictions in immunotherapy. Deep learning (DL) is an AI-based method using an extended neural network or related architecture with multiple "hidden" layers of simulated neurons to combine simple visual features into complex patterns. DL-based digital pathology is currently being developed to assess OED and OSCC outcomes. The integration of machine learning in epigenomics aims to examine the epigenetic modification of diseases and improve our ability to detect, classify, and predict outcomes associated with epigenetic marks. Collectively, these tools showcase promising advancements in discovery and technology, which may provide a potential solution to addressing the current limitations in predicting OED transformation and OSCC behavior, both of which are clinical challenges that must be addressed in order to improve OSCC survival.
Collapse
Affiliation(s)
- Chi T. Viet
- Department of Oral and Maxillofacial Surgery, Loma Linda University School of Dentistry, Loma Linda, California, USA
| | - Michael Zhang
- Department of Oral and Maxillofacial Surgery, Loma Linda University School of Dentistry, Loma Linda, California, USA
| | - Neeraja Dharmaraj
- Bernard & Gloria Pepper Katz Department of Oral and Maxillofacial Surgery, The University of Texas Health Science Center at Houston School of Dentistry, Houston, Texas, USA
| | - Grace Y. Li
- Department of Medicine, Section of Hematology/Oncology, University of Chicago Medical Center, Chicago, Illinois, USA
| | - Alexander T. Pearson
- Department of Medicine, Section of Hematology/Oncology, University of Chicago Medical Center, Chicago, Illinois, USA
| | - Victoria A. Manon
- Bernard & Gloria Pepper Katz Department of Oral and Maxillofacial Surgery, The University of Texas Health Science Center at Houston School of Dentistry, Houston, Texas, USA
| | - Anupama Grandhi
- Department of Oral and Maxillofacial Surgery, Loma Linda University School of Dentistry, Loma Linda, California, USA
| | - Ke Xu
- Department of Psychiatry, Yale School of Medicine, New Haven, Connecticut, USA
- Connecticut Healthcare System, West Haven, Connecticut, USA
| | - Bradley E. Aouizerat
- Translational Research Center, College of Dentistry, New York University, New York, New York, USA
| | - Simon Young
- Bernard & Gloria Pepper Katz Department of Oral and Maxillofacial Surgery, The University of Texas Health Science Center at Houston School of Dentistry, Houston, Texas, USA
| |
Collapse
|
9
|
Zhu L, Pan J, Mou W, Deng L, Zhu Y, Wang Y, Pareek G, Hyams E, Carneiro BA, Hadfield MJ, El-Deiry WS, Yang T, Tan T, Tong T, Ta N, Zhu Y, Gao Y, Lai Y, Cheng L, Chen R, Xue W. Harnessing artificial intelligence for prostate cancer management. Cell Rep Med 2024; 5:101506. [PMID: 38593808 PMCID: PMC11031422 DOI: 10.1016/j.xcrm.2024.101506] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2023] [Revised: 01/05/2024] [Accepted: 03/19/2024] [Indexed: 04/11/2024]
Abstract
Prostate cancer (PCa) is a common malignancy in males. The pathology review of PCa is crucial for clinical decision-making, but traditional pathology review is labor intensive and subjective to some extent. Digital pathology and whole-slide imaging enable the application of artificial intelligence (AI) in pathology. This review highlights the success of AI in detecting and grading PCa, predicting patient outcomes, and identifying molecular subtypes. We propose that AI-based methods could collaborate with pathologists to reduce workload and assist clinicians in formulating treatment recommendations. We also introduce the general process and challenges in developing AI pathology models for PCa. Importantly, we summarize publicly available datasets and open-source codes to facilitate the utilization of existing data and the comparison of the performance of different models to improve future studies.
Collapse
Affiliation(s)
- Lingxuan Zhu
- Department of Urology, Renji Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai 200127, China; Department of Etiology and Carcinogenesis, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China; Changping Laboratory, Beijing, China
| | - Jiahua Pan
- Department of Urology, Renji Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai 200127, China
| | - Weiming Mou
- Department of Urology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Longxin Deng
- Department of Urology, Shanghai Changhai Hospital, Second Military Medical University, Shanghai 200433, China
| | - Yinjie Zhu
- Department of Urology, Renji Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai 200127, China
| | - Yanqing Wang
- Department of Urology, Renji Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai 200127, China
| | - Gyan Pareek
- Department of Surgery (Urology), Brown University Warren Alpert Medical School, Providence, RI, USA; Minimally Invasive Urology Institute, Providence, RI, USA
| | - Elias Hyams
- Department of Surgery (Urology), Brown University Warren Alpert Medical School, Providence, RI, USA; Minimally Invasive Urology Institute, Providence, RI, USA
| | - Benedito A Carneiro
- The Legorreta Cancer Center at Brown University, Lifespan Cancer Institute, Providence, RI, USA
| | - Matthew J Hadfield
- The Legorreta Cancer Center at Brown University, Lifespan Cancer Institute, Providence, RI, USA
| | - Wafik S El-Deiry
- The Legorreta Cancer Center at Brown University, Laboratory of Translational Oncology and Experimental Cancer Therapeutics, Department of Pathology & Laboratory Medicine, The Warren Alpert Medical School of Brown University, The Joint Program in Cancer Biology, Brown University and Lifespan Health System, Division of Hematology/Oncology, The Warren Alpert Medical School of Brown University, Providence, RI, USA
| | - Tao Yang
- Department of Medical Oncology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Tao Tan
- Faculty of Applied Sciences, Macao Polytechnic University, Address: R. de Luís Gonzaga Gomes, Macao, China
| | - Tong Tong
- College of Physics and Information Engineering, Fuzhou University, Fujian 350108, China
| | - Na Ta
- Department of Pathology, Shanghai Changhai Hospital, Second Military Medical University, Shanghai 200433, China
| | - Yan Zhu
- Department of Pathology, Shanghai Changhai Hospital, Second Military Medical University, Shanghai 200433, China
| | - Yisha Gao
- Department of Pathology, Shanghai Changhai Hospital, Second Military Medical University, Shanghai 200433, China
| | - Yancheng Lai
- Department of Urology, Renji Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai 200127, China; The First School of Clinical Medicine, Southern Medical University, Guangzhou, China
| | - Liang Cheng
- Department of Surgery (Urology), Brown University Warren Alpert Medical School, Providence, RI, USA; Department of Pathology and Laboratory Medicine, Department of Surgery (Urology), Brown University Warren Alpert Medical School, Lifespan Health, and the Legorreta Cancer Center at Brown University, Providence, RI, USA.
| | - Rui Chen
- Department of Urology, Renji Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai 200127, China.
| | - Wei Xue
- Department of Urology, Renji Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai 200127, China.
| |
Collapse
|
10
|
Lubbad M, Karaboga D, Basturk A, Akay B, Nalbantoglu U, Pacal I. Machine learning applications in detection and diagnosis of urology cancers: a systematic literature review. Neural Comput Appl 2024; 36:6355-6379. [DOI: 10.1007/s00521-023-09375-2] [Citation(s) in RCA: 11] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2023] [Accepted: 12/07/2023] [Indexed: 05/14/2025]
|
11
|
Miyahira AK, Soule HR. The 29th Annual Prostate Cancer Foundation Scientific Retreat Report. Prostate 2024; 84:113-130. [PMID: 37915138 DOI: 10.1002/pros.24640] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/05/2023] [Accepted: 10/09/2023] [Indexed: 11/03/2023]
Abstract
BACKGROUND The 29th Annual Prostate Cancer Foundation (PCF) Scientific Retreat was held from October 27 to 29, 2022, at the Omni La Costa Resort in Carlsbad, CA. This was the first-ever hybrid PCF Retreat. METHODS The Annual PCF Scientific Retreat is a prominent international scientific gathering centered on groundbreaking, unpublished, and influential studies in basic, translational, and clinical prostate cancer research. It also covers research from related fields with a strong potential for influencing prostate cancer research and patient care. RESULTS Key areas of research that were focused on at the 2022 PCF Retreat included: (i) the contributions of molecular and genomic factors to prostate cancer disparities; (ii) novel clinical trial updates; (iii) lessons from primary prostate cancer; (iv) lessons from single-cell studies; (v) genetic, epigenetic, epitranscriptomic and posttranslational mechanisms and clinical heterogeneity in prostate cancer; (vi) biology of neuroendocrine and lineage-plastic prostate cancer; (vii) next generation prostate cancer theranostics and combination therapies; (viii) the biology and therapeutic potential of targeting phosphoinositide 3-kinases pathways; (ix) combining immunomodulatory treatments for prostate cancer; (x) novel gamma delta (γδ) T-cell therapy platforms for oncology; and (xi) lessons from other cancers. CONCLUSIONS This article provides a summary of the presentations from the 2022 PCF Scientific Retreat. By disseminating this knowledge, we hope to enhance our understanding of the present research landscape and guide future strides in both prostate cancer research and patient care.
Collapse
Affiliation(s)
- Andrea K Miyahira
- Science Department, Prostate Cancer Foundation, Santa Monica, California, USA
| | - Howard R Soule
- Science Department, Prostate Cancer Foundation, Santa Monica, California, USA
| |
Collapse
|