1
|
Ren CX, Xu GX, Dai DQ, Lin L, Sun Y, Liu QS. Cross-site prognosis prediction for nasopharyngeal carcinoma from incomplete multi-modal data. Med Image Anal 2024; 93:103103. [PMID: 38368752 DOI: 10.1016/j.media.2024.103103] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2022] [Revised: 12/05/2023] [Accepted: 02/05/2024] [Indexed: 02/20/2024]
Abstract
Accurate prognosis prediction for nasopharyngeal carcinoma based on magnetic resonance (MR) images assists in the guidance of treatment intensity, thus reducing the risk of recurrence and death. To reduce repeated labor and sufficiently explore domain knowledge, aggregating labeled/annotated data from external sites enables us to train an intelligent model for a clinical site with unlabeled data. However, this task suffers from the challenges of incomplete multi-modal examination data fusion and image data heterogeneity among sites. This paper proposes a cross-site survival analysis method for prognosis prediction of nasopharyngeal carcinoma from domain adaptation viewpoint. Utilizing a Cox model as the basic framework, our method equips it with a cross-attention based multi-modal fusion regularization. This regularization model effectively fuses the multi-modal information from multi-parametric MR images and clinical features onto a domain-adaptive space, despite the absence of some modalities. To enhance the feature discrimination, we also extend the contrastive learning technique to censored data cases. Compared with the conventional approaches which directly deploy a trained survival model in a new site, our method achieves superior prognosis prediction performance in cross-site validation experiments. These results highlight the key role of cross-site adaptability of our method and support its value in clinical practice.
Collapse
Affiliation(s)
- Chuan-Xian Ren
- School of Mathematics, Sun Yat-sen University, Guangzhou 510275, China.
| | - Geng-Xin Xu
- School of Mathematics, Sun Yat-sen University, Guangzhou 510275, China
| | - Dao-Qing Dai
- School of Mathematics, Sun Yat-sen University, Guangzhou 510275, China
| | - Li Lin
- Department of Radiation Oncology, Sun Yat-sen University Cancer Center; State Key Laboratory of Oncology in South China; Collaborative Innovation Center for Cancer Medicine; Guangdong Key Laboratory of Nasopharyngeal Carcinoma Diagnosis and Therapy, Guangzhou 510060, China
| | - Ying Sun
- Department of Radiation Oncology, Sun Yat-sen University Cancer Center; State Key Laboratory of Oncology in South China; Collaborative Innovation Center for Cancer Medicine; Guangdong Key Laboratory of Nasopharyngeal Carcinoma Diagnosis and Therapy, Guangzhou 510060, China
| | - Qing-Shan Liu
- School of Computer Science, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
| |
Collapse
|
2
|
van Eekelen L, Spronck J, Looijen-Salamon M, Vos S, Munari E, Girolami I, Eccher A, Acs B, Boyaci C, de Souza GS, Demirel-Andishmand M, Meesters LD, Zegers D, van der Woude L, Theelen W, van den Heuvel M, Grünberg K, van Ginneken B, van der Laak J, Ciompi F. Comparing deep learning and pathologist quantification of cell-level PD-L1 expression in non-small cell lung cancer whole-slide images. Sci Rep 2024; 14:7136. [PMID: 38531958 DOI: 10.1038/s41598-024-57067-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2023] [Accepted: 03/14/2024] [Indexed: 03/28/2024] Open
Abstract
Programmed death-ligand 1 (PD-L1) expression is currently used in the clinic to assess eligibility for immune-checkpoint inhibitors via the tumor proportion score (TPS), but its efficacy is limited by high interobserver variability. Multiple papers have presented systems for the automatic quantification of TPS, but none report on the task of determining cell-level PD-L1 expression and often reserve their evaluation to a single PD-L1 monoclonal antibody or clinical center. In this paper, we report on a deep learning algorithm for detecting PD-L1 negative and positive tumor cells at a cellular level and evaluate it on a cell-level reference standard established by six readers on a multi-centric, multi PD-L1 assay dataset. This reference standard also provides for the first time a benchmark for computer vision algorithms. In addition, in line with other papers, we also evaluate our algorithm at slide-level by measuring the agreement between the algorithm and six pathologists on TPS quantification. We find a moderately low interobserver agreement at cell-level level (mean reader-reader F1 score = 0.68) which our algorithm sits slightly under (mean reader-AI F1 score = 0.55), especially for cases from the clinical center not included in the training set. Despite this, we find good AI-pathologist agreement on quantifying TPS compared to the interobserver agreement (mean reader-reader Cohen's kappa = 0.54, 95% CI 0.26-0.81, mean reader-AI kappa = 0.49, 95% CI 0.27-0.72). In conclusion, our deep learning algorithm demonstrates promise in detecting PD-L1 expression at a cellular level and exhibits favorable agreement with pathologists in quantifying the tumor proportion score (TPS). We publicly release our models for use via the Grand-Challenge platform.
Collapse
Affiliation(s)
- Leander van Eekelen
- Department of Pathology, Radboud University Medical Center, P.O.Box 9101, 6500 HB, Nijmegen, The Netherlands.
| | - Joey Spronck
- Department of Pathology, Radboud University Medical Center, P.O.Box 9101, 6500 HB, Nijmegen, The Netherlands
| | - Monika Looijen-Salamon
- Department of Pathology, Radboud University Medical Center, P.O.Box 9101, 6500 HB, Nijmegen, The Netherlands
| | - Shoko Vos
- Department of Pathology, Radboud University Medical Center, P.O.Box 9101, 6500 HB, Nijmegen, The Netherlands
| | - Enrico Munari
- Pathology Unit, Department of Molecular and Translational Medicine, University of Brescia, Brescia, Italy
| | - Ilaria Girolami
- Department of Pathology, Provincial Hospital of Bolzano (SABES-ASDAA), Bolzano-Bozen, Italy
| | - Albino Eccher
- Department of Pathology and Diagnostics, University and Hospital Trust of Verona, Verona, Italy
| | - Balazs Acs
- Department of Clinical Pathology and Cancer Diagnostics, Karolinska University Hospital, Stockholm, Sweden
| | - Ceren Boyaci
- Department of Clinical Pathology and Cancer Diagnostics, Karolinska University Hospital, Stockholm, Sweden
| | - Gabriel Silva de Souza
- Department of Pathology, Radboud University Medical Center, P.O.Box 9101, 6500 HB, Nijmegen, The Netherlands
| | - Muradije Demirel-Andishmand
- Department of Pathology, Radboud University Medical Center, P.O.Box 9101, 6500 HB, Nijmegen, The Netherlands
| | - Luca Dulce Meesters
- Department of Pathology, Radboud University Medical Center, P.O.Box 9101, 6500 HB, Nijmegen, The Netherlands
| | - Daan Zegers
- Department of Pathology, Radboud University Medical Center, P.O.Box 9101, 6500 HB, Nijmegen, The Netherlands
| | - Lieke van der Woude
- Department of Pathology, Radboud University Medical Center, P.O.Box 9101, 6500 HB, Nijmegen, The Netherlands
| | - Willemijn Theelen
- Department of Thoracic Oncology, Netherlands Cancer Institute, Amsterdam, The Netherlands
| | - Michel van den Heuvel
- Respiratory Diseases Department, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Katrien Grünberg
- Department of Pathology, Radboud University Medical Center, P.O.Box 9101, 6500 HB, Nijmegen, The Netherlands
| | - Bram van Ginneken
- Department of Radiology, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Jeroen van der Laak
- Department of Pathology, Radboud University Medical Center, P.O.Box 9101, 6500 HB, Nijmegen, The Netherlands
| | - Francesco Ciompi
- Department of Pathology, Radboud University Medical Center, P.O.Box 9101, 6500 HB, Nijmegen, The Netherlands
| |
Collapse
|
3
|
Kumari S, Singh P. Deep learning for unsupervised domain adaptation in medical imaging: Recent advancements and future perspectives. Comput Biol Med 2024; 170:107912. [PMID: 38219643 DOI: 10.1016/j.compbiomed.2023.107912] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2023] [Revised: 11/02/2023] [Accepted: 12/24/2023] [Indexed: 01/16/2024]
Abstract
Deep learning has demonstrated remarkable performance across various tasks in medical imaging. However, these approaches primarily focus on supervised learning, assuming that the training and testing data are drawn from the same distribution. Unfortunately, this assumption may not always hold true in practice. To address these issues, unsupervised domain adaptation (UDA) techniques have been developed to transfer knowledge from a labeled domain to a related but unlabeled domain. In recent years, significant advancements have been made in UDA, resulting in a wide range of methodologies, including feature alignment, image translation, self-supervision, and disentangled representation methods, among others. In this paper, we provide a comprehensive literature review of recent deep UDA approaches in medical imaging from a technical perspective. Specifically, we categorize current UDA research in medical imaging into six groups and further divide them into finer subcategories based on the different tasks they perform. We also discuss the respective datasets used in the studies to assess the divergence between the different domains. Finally, we discuss emerging areas and provide insights and discussions on future research directions to conclude this survey.
Collapse
Affiliation(s)
- Suruchi Kumari
- Department of Computer Science and Engineering, Indian Institute of Technology Roorkee, India.
| | - Pravendra Singh
- Department of Computer Science and Engineering, Indian Institute of Technology Roorkee, India.
| |
Collapse
|
4
|
Ligero M, Serna G, El Nahhas OS, Sansano I, Mauchanski S, Viaplana C, Calderaro J, Toledo RA, Dienstmann R, Vanguri RS, Sauter JL, Sanchez-Vega F, Shah SP, Ramón y Cajal S, Garralda E, Nuciforo P, Perez-Lopez R, Kather JN. Weakly Supervised Deep Learning Predicts Immunotherapy Response in Solid Tumors Based on PD-L1 Expression. CANCER RESEARCH COMMUNICATIONS 2024; 4:92-102. [PMID: 38126740 PMCID: PMC10782919 DOI: 10.1158/2767-9764.crc-23-0287] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/06/2023] [Revised: 10/11/2023] [Accepted: 12/12/2023] [Indexed: 12/23/2023]
Abstract
Programmed death-ligand 1 (PD-L1) IHC is the most commonly used biomarker for immunotherapy response. However, quantification of PD-L1 status in pathology slides is challenging. Neither manual quantification nor a computer-based mimicking of manual readouts is perfectly reproducible, and the predictive performance of both approaches regarding immunotherapy response is limited. In this study, we developed a deep learning (DL) method to predict PD-L1 status directly from raw IHC image data, without explicit intermediary steps such as cell detection or pigment quantification. We trained the weakly supervised model on PD-L1-stained slides from the non-small cell lung cancer (NSCLC)-Memorial Sloan Kettering (MSK) cohort (N = 233) and validated it on the pan-cancer-Vall d'Hebron Institute of Oncology (VHIO) cohort (N = 108). We also investigated the performance of the model to predict response to immune checkpoint inhibitors (ICI) in terms of progression-free survival. In the pan-cancer-VHIO cohort, the performance was compared with tumor proportion score (TPS) and combined positive score (CPS). The DL model showed good performance in predicting PD-L1 expression (TPS ≥ 1%) in both NSCLC-MSK and pan-cancer-VHIO cohort (AUC 0.88 ± 0.06 and 0.80 ± 0.03, respectively). The predicted PD-L1 status showed an improved association with response to ICIs [HR: 1.5 (95% confidence interval: 1-2.3), P = 0.049] compared with TPS [HR: 1.4 (0.96-2.2), P = 0.082] and CPS [HR: 1.2 (0.79-1.9), P = 0.386]. Notably, our explainability analysis showed that the model does not just look at the amount of brown pigment in the IHC slides, but also considers morphologic factors such as lymphocyte conglomerates. Overall, end-to-end weakly supervised DL shows potential for improving patient stratification for cancer immunotherapy by analyzing PD-L1 IHC, holistically integrating morphology and PD-L1 staining intensity. SIGNIFICANCE The weakly supervised DL model to predict PD-L1 status from raw IHC data, integrating tumor staining intensity and morphology, enables enhanced patient stratification in cancer immunotherapy compared with traditional pathologist assessment.
Collapse
Affiliation(s)
- Marta Ligero
- Radiomics Group, Vall d'Hebron Institute of Oncology (VHIO), Barcelona, Spain
| | - Garazi Serna
- Molecular Oncology Group, Vall d'Hebron Institute of Oncology (VHIO), Barcelona, Spain
| | - Omar S.M. El Nahhas
- Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany
| | - Irene Sansano
- Pathology Department, Vall d'Hebron University Hospital (VHUH), Barcelona, Spain
| | - Siarhei Mauchanski
- Molecular Oncology Group, Vall d'Hebron Institute of Oncology (VHIO), Barcelona, Spain
| | - Cristina Viaplana
- Oncology Data Science (ODysSey) Group, Vall d'Hebron Institute of Oncology (VHIO), Barcelona, Spain
| | - Julien Calderaro
- Assistance Publique-Hôpitaux de Paris, Département de Pathologie, CHU Henri Mondor, Créteil, France
- Université Paris-Est Créteil, Faculté de Médecine, Créteil, France
| | - Rodrigo A. Toledo
- Biomakers and Clonal Dynamics Group, Vall d'Hebron Institute of Oncology (VHIO), Barcelona, Spain
| | - Rodrigo Dienstmann
- Oncology Data Science (ODysSey) Group, Vall d'Hebron Institute of Oncology (VHIO), Barcelona, Spain
| | - Rami S. Vanguri
- Department of Pathology and Laboratory Medicine, Children's Hospital of Philadelphia, Philadelphia, Pennsylvania
| | - Jennifer L. Sauter
- Department of Pathology and Laboratory Medicine, Memorial Sloan Kettering Cancer Center, New York, New York
| | | | - Sohrab P. Shah
- Computational Oncology, Memorial Sloan Kettering Cancer Center, New York, New York
| | | | - Elena Garralda
- Department of Medical Oncology, Vall d'Hebron University Hospital and Institute of Oncology (VHIO), Barcelona, Spain
| | - Paolo Nuciforo
- Molecular Oncology Group, Vall d'Hebron Institute of Oncology (VHIO), Barcelona, Spain
| | - Raquel Perez-Lopez
- Radiomics Group, Vall d'Hebron Institute of Oncology (VHIO), Barcelona, Spain
| | - Jakob Nikolas Kather
- Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany
- Pathology and Data Analytics, Leeds Institute of Medical Research at St James's, University of Leeds, Leeds, United Kingdom
- Department of Medicine I, University Hospital Dresden, Dresden, Germany
- Medical Oncology, National Center for Tumor Diseases (NCT), University Hospital Heidelberg, Heidelberg, Germany
| |
Collapse
|
5
|
Guo Q, Qu L, Zhu J, Li H, Wu Y, Wang S, Yu M, Wu J, Wen H, Ju X, Wang X, Bi R, Shi Y, Wu X. Predicting Lymph Node Metastasis From Primary Cervical Squamous Cell Carcinoma Based on Deep Learning in Histopathologic Images. Mod Pathol 2023; 36:100316. [PMID: 37634868 DOI: 10.1016/j.modpat.2023.100316] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2022] [Revised: 08/15/2023] [Accepted: 08/16/2023] [Indexed: 08/29/2023]
Abstract
We developed a deep learning framework to accurately predict the lymph node status of patients with cervical cancer based on hematoxylin and eosin-stained pathological sections of the primary tumor. In total, 1524 hematoxylin and eosin-stained whole slide images (WSIs) of primary cervical tumors from 564 patients were used in this retrospective, proof-of-concept study. Primary tumor sections (1161 WSIs) were obtained from 405 patients who underwent radical cervical cancer surgery at the Fudan University Shanghai Cancer Center (FUSCC) between 2008 and 2014; 165 and 240 patients were negative and positive for lymph node metastasis, respectively (including 166 with positive pelvic lymph nodes alone and 74 with positive pelvic and para-aortic lymph nodes). We constructed and trained a multi-instance deep convolutional neural network based on a multiscale attention mechanism, in which an internal independent test set (100 patients, 228 WSIs) from the FUSCC cohort and an external independent test set (159 patients, 363 WSIs) from the Cervical Squamous Cell Carcinoma and Endocervical Adenocarcinoma cohort of the Cancer Genome Atlas program database were used to evaluate the predictive performance of the network. In predicting the occurrence of lymph node metastasis, our network achieved areas under the receiver operating characteristic curve of 0.87 in the cross-validation set, 0.84 in the internal independent test set of the FUSCC cohort, and 0.75 in the external test set of the Cervical Squamous Cell Carcinoma and Endocervical Adenocarcinoma cohort of the Cancer Genome Atlas program. For patients with positive pelvic lymph node metastases, we retrained the network to predict whether they also had para-aortic lymph node metastases. Our network achieved areas under the receiver operating characteristic curve of 0.91 in the cross-validation set and 0.88 in the test set of the FUSCC cohort. Deep learning analysis based on pathological images of primary foci is very likely to provide new ideas for preoperatively assessing cervical cancer lymph node status; its true value must be validated with cervical biopsy specimens and large multicenter datasets.
Collapse
Affiliation(s)
- Qinhao Guo
- Department of Gynecologic Oncology, Fudan University Shanghai Cancer Center, Fudan University, Shanghai, China; Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, China
| | - Linhao Qu
- Digital Medical Research Center, School of Basic Medical Sciences, Fudan University, Shanghai, China; Shanghai Key Laboratory of Medical Imaging Computing and Computer Assisted Intervention, Fudan University, Shanghai, China
| | - Jun Zhu
- Department of Gynecologic Oncology, Fudan University Shanghai Cancer Center, Fudan University, Shanghai, China; Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, China
| | - Haiming Li
- Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, China; Department of Radiology, Fudan University Shanghai Cancer Center, Fudan University, Shanghai, China
| | - Yong Wu
- Department of Gynecologic Oncology, Fudan University Shanghai Cancer Center, Fudan University, Shanghai, China; Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, China
| | - Simin Wang
- Department of Gynecologic Oncology, Fudan University Shanghai Cancer Center, Fudan University, Shanghai, China; Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, China
| | - Min Yu
- Department of Gynecologic Oncology, Fudan University Shanghai Cancer Center, Fudan University, Shanghai, China; Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, China
| | - Jiangchun Wu
- Department of Gynecologic Oncology, Fudan University Shanghai Cancer Center, Fudan University, Shanghai, China; Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, China
| | - Hao Wen
- Department of Gynecologic Oncology, Fudan University Shanghai Cancer Center, Fudan University, Shanghai, China; Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, China
| | - Xingzhu Ju
- Department of Gynecologic Oncology, Fudan University Shanghai Cancer Center, Fudan University, Shanghai, China; Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, China
| | - Xin Wang
- Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, China; Department of Pathology, Fudan University Shanghai Cancer Center, Fudan University, Shanghai, China
| | - Rui Bi
- Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, China; Department of Pathology, Fudan University Shanghai Cancer Center, Fudan University, Shanghai, China.
| | - Yonghong Shi
- Digital Medical Research Center, School of Basic Medical Sciences, Fudan University, Shanghai, China; Shanghai Key Laboratory of Medical Imaging Computing and Computer Assisted Intervention, Fudan University, Shanghai, China.
| | - Xiaohua Wu
- Department of Gynecologic Oncology, Fudan University Shanghai Cancer Center, Fudan University, Shanghai, China; Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, China.
| |
Collapse
|
6
|
Davri A, Birbas E, Kanavos T, Ntritsos G, Giannakeas N, Tzallas AT, Batistatou A. Deep Learning for Lung Cancer Diagnosis, Prognosis and Prediction Using Histological and Cytological Images: A Systematic Review. Cancers (Basel) 2023; 15:3981. [PMID: 37568797 PMCID: PMC10417369 DOI: 10.3390/cancers15153981] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2023] [Revised: 07/27/2023] [Accepted: 08/03/2023] [Indexed: 08/13/2023] Open
Abstract
Lung cancer is one of the deadliest cancers worldwide, with a high incidence rate, especially in tobacco smokers. Lung cancer accurate diagnosis is based on distinct histological patterns combined with molecular data for personalized treatment. Precise lung cancer classification from a single H&E slide can be challenging for a pathologist, requiring most of the time additional histochemical and special immunohistochemical stains for the final pathology report. According to WHO, small biopsy and cytology specimens are the available materials for about 70% of lung cancer patients with advanced-stage unresectable disease. Thus, the limited available diagnostic material necessitates its optimal management and processing for the completion of diagnosis and predictive testing according to the published guidelines. During the new era of Digital Pathology, Deep Learning offers the potential for lung cancer interpretation to assist pathologists' routine practice. Herein, we systematically review the current Artificial Intelligence-based approaches using histological and cytological images of lung cancer. Most of the published literature centered on the distinction between lung adenocarcinoma, lung squamous cell carcinoma, and small cell lung carcinoma, reflecting the realistic pathologist's routine. Furthermore, several studies developed algorithms for lung adenocarcinoma predominant architectural pattern determination, prognosis prediction, mutational status characterization, and PD-L1 expression status estimation.
Collapse
Affiliation(s)
- Athena Davri
- Department of Pathology, Faculty of Medicine, School of Health Sciences, University of Ioannina, 45500 Ioannina, Greece;
| | - Effrosyni Birbas
- Faculty of Medicine, School of Health Sciences, University of Ioannina, 45110 Ioannina, Greece; (E.B.); (T.K.)
| | - Theofilos Kanavos
- Faculty of Medicine, School of Health Sciences, University of Ioannina, 45110 Ioannina, Greece; (E.B.); (T.K.)
| | - Georgios Ntritsos
- Department of Hygiene and Epidemiology, Faculty of Medicine, School of Health Sciences, University of Ioannina, 45110 Ioannina, Greece;
- Department of Informatics and Telecommunications, University of Ioannina, 47100 Arta, Greece;
| | - Nikolaos Giannakeas
- Department of Informatics and Telecommunications, University of Ioannina, 47100 Arta, Greece;
| | - Alexandros T. Tzallas
- Department of Informatics and Telecommunications, University of Ioannina, 47100 Arta, Greece;
| | - Anna Batistatou
- Department of Pathology, Faculty of Medicine, School of Health Sciences, University of Ioannina, 45500 Ioannina, Greece;
| |
Collapse
|
7
|
Artificial intelligence for prediction of response to cancer immunotherapy. Semin Cancer Biol 2022; 87:137-147. [PMID: 36372326 DOI: 10.1016/j.semcancer.2022.11.008] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2022] [Revised: 11/02/2022] [Accepted: 11/08/2022] [Indexed: 11/13/2022]
Abstract
Artificial intelligence (AI) indicates the application of machines to imitate intelligent behaviors for solving complex tasks with minimal human intervention, including machine learning and deep learning. The use of AI in medicine improves health-care systems in multiple areas such as diagnostic confirmation, risk stratification, analysis, prognosis prediction, treatment surveillance, and virtual health support, which has considerable potential to revolutionize and reshape medicine. In terms of immunotherapy, AI has been applied to unlock underlying immune signatures to associate with responses to immunotherapy indirectly as well as predict responses to immunotherapy responses directly. The AI-based analysis of high-throughput sequences and medical images can provide useful information for management of cancer immunotherapy considering the excellent abilities in selecting appropriate subjects, improving therapeutic regimens, and predicting individualized prognosis. In present review, we aim to evaluate a broad framework about AI-based computational approaches for prediction of response to cancer immunotherapy on both indirect and direct manners. Furthermore, we summarize our perspectives about challenges and opportunities of further AI applications on cancer immunotherapy relating to clinical practicability.
Collapse
|
8
|
Yin X, Liao H, Yun H, Lin N, Li S, Xiang Y, Ma X. Artificial intelligence-based prediction of clinical outcome in immunotherapy and targeted therapy of lung cancer. Semin Cancer Biol 2022; 86:146-159. [PMID: 35963564 DOI: 10.1016/j.semcancer.2022.08.002] [Citation(s) in RCA: 23] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2022] [Revised: 08/06/2022] [Accepted: 08/08/2022] [Indexed: 11/26/2022]
Abstract
Lung cancer accounts for the main proportion of malignancy-related deaths and most patients are diagnosed at an advanced stage. Immunotherapy and targeted therapy have great advances in application in clinics to treat lung cancer patients, yet the efficacy is unstable. The response rate of these therapies varies among patients. Some biomarkers have been proposed to predict the outcomes of immunotherapy and targeted therapy, including programmed cell death-ligand 1 (PD-L1) expression and oncogene mutations. Nevertheless, the detection tests are invasive, time-consuming, and have high demands on tumor tissue. The predictive performance of conventional biomarkers is also unsatisfactory. Therefore, novel biomarkers are needed to effectively predict the outcomes of immunotherapy and targeted therapy. The application of artificial intelligence (AI) can be a possible solution, as it has several advantages. AI can help identify features that are unable to be used by humans and perform repetitive tasks. By combining AI methods with radiomics, pathology, genomics, transcriptomics, proteomics, and clinical data, the integrated model has shown predictive value in immunotherapy and targeted therapy, which significantly improves the precision treatment of lung cancer patients. Herein, we reviewed the application of AI in predicting the outcomes of immunotherapy and targeted therapy in lung cancer patients, and discussed the challenges and future directions in this field.
Collapse
Affiliation(s)
- Xiaomeng Yin
- Division of Biotherapy, Cancer Center, West China Hospital and State Key Laboratory of Biotherapy, Sichuan University, No. 37 GuoXue Alley, Chengdu 610041, China
| | - Hu Liao
- Department of Thoracic Surgery, West China Hospital, Sichuan University, No. 37 GuoXue Alley, Chengdu 610041, China
| | - Hong Yun
- Division of Biotherapy, Cancer Center, West China Hospital and State Key Laboratory of Biotherapy, Sichuan University, No. 37 GuoXue Alley, Chengdu 610041, China
| | - Nan Lin
- Division of Biotherapy, Cancer Center, West China Hospital and State Key Laboratory of Biotherapy, Sichuan University, No. 37 GuoXue Alley, Chengdu 610041, China
| | - Shen Li
- West China School of Medicine, West China Hospital, Sichuan University, No. 37 GuoXue Alley, Chengdu 610041, China
| | - Yu Xiang
- Division of Biotherapy, Cancer Center, West China Hospital and State Key Laboratory of Biotherapy, Sichuan University, No. 37 GuoXue Alley, Chengdu 610041, China
| | - Xuelei Ma
- Division of Biotherapy, Cancer Center, West China Hospital and State Key Laboratory of Biotherapy, Sichuan University, No. 37 GuoXue Alley, Chengdu 610041, China.
| |
Collapse
|
9
|
Kuczkiewicz-Siemion O, Sokół K, Puton B, Borkowska A, Szumera-Ciećkiewicz A. The Role of Pathology-Based Methods in Qualitative and Quantitative Approaches to Cancer Immunotherapy. Cancers (Basel) 2022; 14:cancers14153833. [PMID: 35954496 PMCID: PMC9367614 DOI: 10.3390/cancers14153833] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2022] [Revised: 07/25/2022] [Accepted: 08/02/2022] [Indexed: 11/16/2022] Open
Abstract
Simple Summary Immunotherapy has become the filar of modern oncological treatment, and programmed death-ligand 1 expression is one of the primary immune markers assessed by pathologists. However, there are still some issues concerning the evaluation of the marker and limited information about the interaction between the tumour and associated immune cells. Recent studies have focused on cancer immunology to try to understand the complex tumour microenvironment, and multiplex imaging methods are more widely used for this purpose. The presented article aims to provide an overall review of a different multiplex in situ method using spectral imaging, supported by automated image-acquisition and software-assisted marker visualisation and interpretation. Multiplex imaging methods could improve the current understanding of complex tumour-microenvironment immunology and could probably help to better match patients to appropriate treatment regimens. Abstract Immune checkpoint inhibitors, including those concerning programmed cell death 1 (PD-1) and its ligand (PD-L1), have revolutionised the cancer therapy approach in the past decade. However, not all patients benefit from immunotherapy equally. The prediction of patient response to this type of therapy is mainly based on conventional immunohistochemistry, which is limited by intraobserver variability, semiquantitative assessment, or single-marker-per-slide evaluation. Multiplex imaging techniques and digital image analysis are powerful tools that could overcome some issues concerning tumour-microenvironment studies. This novel approach to biomarker assessment offers a better understanding of the complicated interactions between tumour cells and their environment. Multiplex labelling enables the detection of multiple markers simultaneously and the exploration of their spatial organisation. Evaluating a variety of immune cell phenotypes and differentiating their subpopulations is possible while preserving tissue histology in most cases. Multiplexing supported by digital pathology could allow pathologists to visualise and understand every cell in a single tissue slide and provide meaning in a complex tumour-microenvironment contexture. This review aims to provide an overview of the different multiplex imaging methods and their application in PD-L1 biomarker assessment. Moreover, we discuss digital imaging techniques, with a focus on slide scanners and software.
Collapse
Affiliation(s)
- Olga Kuczkiewicz-Siemion
- Department of Pathology, Maria Sklodowska-Curie National Research Institute of Oncology, 02-781 Warsaw, Poland
- Diagnostic Hematology Department, Institute of Hematology and Transfusion Medicine, 02-776 Warsaw, Poland
- Correspondence: (O.K.-S.); (A.S.-C.)
| | - Kamil Sokół
- Diagnostic Hematology Department, Institute of Hematology and Transfusion Medicine, 02-776 Warsaw, Poland
| | - Beata Puton
- Department of Pathology, Maria Sklodowska-Curie National Research Institute of Oncology, 02-781 Warsaw, Poland
| | - Aneta Borkowska
- Department of Soft Tissue/Bone Sarcoma and Melanoma, Maria Sklodowska-Curie National Research Institute of Oncology, 02-781 Warsaw, Poland
| | - Anna Szumera-Ciećkiewicz
- Department of Pathology, Maria Sklodowska-Curie National Research Institute of Oncology, 02-781 Warsaw, Poland
- Correspondence: (O.K.-S.); (A.S.-C.)
| |
Collapse
|
10
|
Puladi B, Ooms M, Kintsler S, Houschyar KS, Steib F, Modabber A, Hölzle F, Knüchel-Clarke R, Braunschweig T. Automated PD-L1 Scoring Using Artificial Intelligence in Head and Neck Squamous Cell Carcinoma. Cancers (Basel) 2021; 13:4409. [PMID: 34503218 PMCID: PMC8431396 DOI: 10.3390/cancers13174409] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2021] [Revised: 08/24/2021] [Accepted: 08/26/2021] [Indexed: 01/01/2023] Open
Abstract
Immune checkpoint inhibitors (ICI) represent a new therapeutic approach in recurrent and metastatic head and neck squamous cell carcinoma (HNSCC). The patient selection for the PD-1/PD-L1 inhibitor therapy is based on the degree of PD-L1 expression in immunohistochemistry reflected by manually determined PD-L1 scores. However, manual scoring shows variability between different investigators and is influenced by cognitive and visual traps and could therefore negatively influence treatment decisions. Automated PD-L1 scoring could facilitate reliable and reproducible results. Our novel approach uses three neural networks sequentially applied for fully automated PD-L1 scoring of all three established PD-L1 scores: tumor proportion score (TPS), combined positive score (CPS) and tumor-infiltrating immune cell score (ICS). Our approach was validated using WSIs of HNSCC cases and compared with manual PD-L1 scoring by human investigators. The inter-rater correlation (ICC) between human and machine was very similar to the human-human correlation. The ICC was slightly higher between human-machine compared to human-human for the CPS and ICS, but a slightly lower for the TPS. Our study provides deeper insights into automated PD-L1 scoring by neural networks and its limitations. This may serve as a basis to improve ICI patient selection in the future.
Collapse
Affiliation(s)
- Behrus Puladi
- Department of Oral and Maxillofacial Surgery, University Hospital RWTH Aachen, 52074 Aachen, Germany; (B.P.); (M.O.); (A.M.); (F.H.)
- Institute of Pathology, University Hospital RWTH Aachen, 52074 Aachen, Germany; (S.K.); (F.S.); (R.K.-C.)
- Institute of Medical Informatics, University Hospital RWTH Aachen, 52074 Aachen, Germany
| | - Mark Ooms
- Department of Oral and Maxillofacial Surgery, University Hospital RWTH Aachen, 52074 Aachen, Germany; (B.P.); (M.O.); (A.M.); (F.H.)
| | - Svetlana Kintsler
- Institute of Pathology, University Hospital RWTH Aachen, 52074 Aachen, Germany; (S.K.); (F.S.); (R.K.-C.)
| | - Khosrow Siamak Houschyar
- Department of Dermatology and Allergology, University Hospital RWTH Aachen, 52074 Aachen, Germany;
| | - Florian Steib
- Institute of Pathology, University Hospital RWTH Aachen, 52074 Aachen, Germany; (S.K.); (F.S.); (R.K.-C.)
| | - Ali Modabber
- Department of Oral and Maxillofacial Surgery, University Hospital RWTH Aachen, 52074 Aachen, Germany; (B.P.); (M.O.); (A.M.); (F.H.)
| | - Frank Hölzle
- Department of Oral and Maxillofacial Surgery, University Hospital RWTH Aachen, 52074 Aachen, Germany; (B.P.); (M.O.); (A.M.); (F.H.)
| | - Ruth Knüchel-Clarke
- Institute of Pathology, University Hospital RWTH Aachen, 52074 Aachen, Germany; (S.K.); (F.S.); (R.K.-C.)
| | - Till Braunschweig
- Institute of Pathology, University Hospital RWTH Aachen, 52074 Aachen, Germany; (S.K.); (F.S.); (R.K.-C.)
| |
Collapse
|