1
|
Tian H, Tian Y, Li D, Zhao M, Luo Q, Kong L, Qin T. Artificial intelligence model predicts M2 macrophage levels and HCC prognosis with only globally labeled pathological images. Front Oncol 2024; 14:1474155. [PMID: 39759153 PMCID: PMC11695232 DOI: 10.3389/fonc.2024.1474155] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2024] [Accepted: 12/09/2024] [Indexed: 01/07/2025] Open
Abstract
Background and aims The levels of M2 macrophages are significantly associated with the prognosis of hepatocellular carcinoma (HCC), however, current detection methods in clinical settings remain challenging. Our study aims to develop a weakly supervised artificial intelligence model using globally labeled histological images, to predict M2 macrophage levels and forecast the prognosis of HCC patients by integrating clinical features. Methods CIBERSORTx was used to calculate M2 macrophage abundance. We developed a slide-level, weakly-supervised clustering method for Whole Slide Images (WSIs) by integrating Masked Autoencoders (MAE) with ResNet-32t to predict M2 macrophage abundance. Results We developed an MAE-ResNet model to predict M2 macrophage levels using WSIs. In the testing dataset, the area under the curve (AUC) (95% CI) was 0.73 (0.59-0.87). We constructed a Cox regression model showing that the predicted probabilities of M2 macrophage abundance were negatively associated with the prognosis of HCC (HR=1.89, p=0.031). Furthermore, we incorporated clinical data, screened variables using Lasso regression, and built the comprehensive prediction model that better predicted prognosis. (HR=2.359, p=0.001). Conclusion Our models effectively predicted M2 macrophage levels and HCC prognosis. The findings suggest that our models offer a novel method for determining biomarker levels and forecasting prognosis, eliminating additional clinical tests, thereby delivering substantial clinical benefits.
Collapse
Affiliation(s)
- Huiyuan Tian
- Department of Scientific Research and Foreign Affairs, Henan Provincial People’s Hospital, Zhengzhou University People’s Hospital, Zhengzhou, Henan, China
| | - Yongshao Tian
- School of Computer Science and Technology, University of Science and Technology of China, Hefei, Anhui, China
| | - Dujuan Li
- Department of Pathology, Henan Provincial People’s Hospital, Zhengzhou University People’s Hospital, Zhengzhou, Henan, China
| | - Minfan Zhao
- School of Computer Science and Technology, University of Science and Technology of China, Hefei, Anhui, China
| | - Qiankun Luo
- Department of Hepatobiliary and Pancreatic Surgery, Henan Provincial People’s Hospital, Zhengzhou University People’s Hospital, Zhengzhou, Henan, China
| | - Lingfei Kong
- Department of Pathology, Henan Provincial People’s Hospital, Zhengzhou University People’s Hospital, Zhengzhou, Henan, China
| | - Tao Qin
- Department of Hepatobiliary and Pancreatic Surgery, Henan Provincial People’s Hospital, Zhengzhou University People’s Hospital, Zhengzhou, Henan, China
| |
Collapse
|
2
|
Monabbati S, Khalighi S, Fu P, Shi Q, Asa SL, Madabhushi A. A novel computational pathology approach for identifying gene signatures prognostic of disease-free survival for papillary thyroid carcinomas. Eur J Cancer 2024; 212:114326. [PMID: 39307037 PMCID: PMC11531387 DOI: 10.1016/j.ejca.2024.114326] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2024] [Revised: 09/04/2024] [Accepted: 09/08/2024] [Indexed: 10/01/2024]
Abstract
INTRODUCTION Papillary thyroid carcinoma (PTC) is the most prevalent form of thyroid cancer, with the classical and follicular variants representing most cases. Despite generally favorable prognoses, approximately 10% of patients experience recurrence post-surgery and radioactive iodine therapy. Attempts to stratify risk of recurrence have relied on gene expression-based prognostic and predictive signatures with a focus on mutations of well-known driver genes, while hallmarks of tumor morphology have been ignored. OBJECTIVES We introduce a new computational pathology approach to develop prognostic gene signatures for PTC that is informed by quantitative features of tumor and immune cell morphology. METHODS We quantified nuclear and immune-related features of tumor morphology to develop a pathomic signature, which was then used to inform an RNA-expression signature model provides a notable advancement in risk stratification compared to both standalone and pathology-informed gene-expression signatures. RESULTS There was a 17.8% improvement in the C-index (from 0.605 to 0.783) for 123 cPTCs and 15% (from 0.576 to 0.726) for 38 fvPTCs compared to the standalone gene-expression signature. Hazard ratios also improved for cPTCs from 0.89 (0.67,0.99) to 4.43 (3.65,6.68) and fvPTC from 0.98 (0.76,1.32) to 2.28 (1.87,3.64). We validated the image-based risk model on an independent cohort of 32 cPTCs with hazard ratio 1.8 (1.534,2.167).
Collapse
Affiliation(s)
- Shayan Monabbati
- Dept. of Biomedical Engineering, Case Western Reserve University, OH, United States
| | - Sirvan Khalighi
- Wallace H. Coulter Dept. of Biomedical Engineering, Georgia Institute of Technology and Emory School of Medicine, Atlanta, GA, United States
| | - Pingfu Fu
- Dept. of Population and Quantitative Health Sciences, Case Western Reserve University, OH, United States
| | - Qiuying Shi
- Dept. of Pathology, Emory University Hospital Midtown, Atlanta GA, United States
| | - Sylvia L Asa
- Dept. of Pathology, School of Medicine, Case Western Reserve University, and University Hospitals Cleveland Medical Center, OH, United States
| | - Anant Madabhushi
- Wallace H. Coulter Dept. of Biomedical Engineering, Georgia Institute of Technology and Emory School of Medicine, Atlanta, GA, United States; Atlanta Veterans Administration Medical Center, GA, United States.
| |
Collapse
|
3
|
Harahap AS, Jung CK. Educational exchange in thyroid core needle biopsy diagnosis: enhancing pathological interpretation through guideline integration and peer learning. J Pathol Transl Med 2024; 58:205-213. [PMID: 39039653 PMCID: PMC11424201 DOI: 10.4132/jptm.2024.06.24] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2024] [Accepted: 06/24/2024] [Indexed: 07/24/2024] Open
Abstract
BACKGROUND While fine needle aspiration cytology (FNAC) plays an essential role in the screening of thyroid nodules, core needle biopsy (CNB) acts as an alternative method to address FNAC limitations. However, diagnosing thyroid CNB samples can be challenging due to variations in background and levels of experience. Effective training is indispensable to mitigate this challenge. We aim to evaluate the impact of an educational program on improving the accuracy of CNB diagnostics. METHODS The 2-week observational program included a host mentor pathologist with extensive experience and a visiting pathologist. The CNB classification by The Practice Guidelines Committee of the Korean Thyroid Association was used for the report. Two rounds of reviewing the case were carried out, and the level of agreement between the reviewers was analyzed. RESULTS The first-round assessment showed a concordance between two pathologists for 247 thyroid CNB specimens by 84.2%, with a kappa coefficient of 0.74 (indicating substantial agreement). This finding was attributed to the discordance in the use of categories III and V. After peer learning, the two pathologists evaluated 30 new cases, which showed an overall improvement in the level of agreement. The percentage of agreement between pathologists on thyroid CNB diagnosis was 86.7%, as measured by kappa coefficient of 0.80. CONCLUSIONS This educational program, consisting of guided mentorship and peer learning, can substantially enhance the diagnostic accuracy of thyroid CNB. It is useful in promoting consistent diagnostic standards and contributes to the ongoing development of global pathology practices.
Collapse
Affiliation(s)
- Agnes Stephanie Harahap
- Department of Anatomical Pathology, Faculty of Medicine Universitas Indonesia - Dr. Cipto Mangunkusumo Hospital, Jakarta, Indonesia
| | - Chan Kwon Jung
- Department of Hospital Pathology, College of Medicine, The Catholic University of Korea, Seoul, Korea
- Cancer Research Institute, College of Medicine, The Catholic University of Korea, Seoul, Korea
| |
Collapse
|
4
|
Kim C, Agarwal S, Bychkov A, Hang JF, Harahap AS, Hirokawa M, Kakudo K, Keelawat S, Liu CY, Liu Z, Nguyen TPX, Rana C, Vuong HG, Zhu Y, Jung CK. Differentiating BRAF V600E- and RAS-like alterations in encapsulated follicular patterned tumors through histologic features: a validation study. Virchows Arch 2024; 484:645-656. [PMID: 38366204 DOI: 10.1007/s00428-024-03761-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2023] [Revised: 01/29/2024] [Accepted: 02/03/2024] [Indexed: 02/18/2024]
Abstract
Differentiating BRAF V600E- and RAS-altered encapsulated follicular-patterned thyroid tumors based on morphology remains challenging. This study aimed to validate an 8-score scale nuclear scoring system and investigate the importance of nuclear pseudoinclusions (NPIs) in aiding this differentiation. A cohort of 44 encapsulated follicular-patterned tumors with varying degrees of nuclear atypia and confirmed BRAF V600E or RAS alterations was studied. Nuclear parameters (area, diameter, and optical density) were analyzed using a deep learning model. Twelve pathologists from eight Asian countries visually assessed 22 cases after excluding the cases with any papillae. Eight nuclear features were applied, yielding a semi-quantitative score from 0 to 24. A threshold score of 14 was used to distinguish between RAS- and BRAF V600E-altered tumors. BRAF V600E-altered tumors typically demonstrated higher nuclear scores and notable morphometric alterations. Specifically, the nuclear area and diameter were significantly larger, and nuclear optical density was much lower compared to RAS-altered tumors. Observer accuracy varied, with two pathologists correctly identifying genotype of all cases. Observers were categorized into proficiency groups, with the highest group maintaining consistent accuracy across both evaluation methods. The lower group showed a significant improvement in accuracy upon utilizing the 8-score scale nuclear scoring system, with notably increased sensitivity and negative predictive value in BRAF V600E tumor detection. BRAF V600E-altered tumors had higher median total nuclear scores. Detailed reevaluation revealed NPIs in all BRAF V600E-altered cases, but in only 2 of 14 RAS-altered cases. These results could significantly assist pathologists, particularly those not specializing in thyroid pathology, in making a more accurate diagnosis.
Collapse
Affiliation(s)
- Chankyung Kim
- Department of Anatomical Pathology, SA Pathology, Adelaide, SA, Australia
- Faculty of Health and Medical Sciences, University of Adelaide, Adelaide, SA, Australia
| | - Shipra Agarwal
- Department of Pathology, All India Institute of Medical Sciences, New Delhi, 110029, India
| | - Andrey Bychkov
- Department of Pathology, Kameda Medical Center, Kamogawa City, Chiba 296-8602, Japan
| | - Jen-Fan Hang
- Department of Pathology and Laboratory Medicine, Taipei Veterans General Hospital, Taipei, Taiwan
| | - Agnes Stephanie Harahap
- Department of Anatomical Pathology, Faculty of Medicine Universitas Indonesia - Dr. Cipto Mangunkusumo Hospital, Jakarta, Indonesia
| | | | - Kennichi Kakudo
- Department of Pathology and Thyroid Disease Center, Izumi City General Hospital, Izumi, Japan
| | - Somboon Keelawat
- Department of Pathology, Faculty of Medicine, Chulalongkorn University, Bangkok, Thailand
| | - Chih-Yi Liu
- Division of Pathology, Sijhih Cathay General Hospital, New Taipei City, Taiwan
| | - Zhiyan Liu
- Department of Pathology, Sixth People's Hospital, Shanghai Jiao Tong University, Shanghai, China
| | | | - Chanchal Rana
- Department of Pathology, King George Medical University, Lucknow, India
| | - Huy Gia Vuong
- Department of Pathology, University of Iowa Hospitals and Clinics, Iowa City, IA, USA
| | - Yun Zhu
- Department of Pathology, Jiangsu Institute of Nuclear Medicine, Wuxi, China
| | - Chan Kwon Jung
- Department of Hospital Pathology, College of Medicine, The Catholic University of Korea, Seoul, Korea.
- College of Medicine, Cancer Research Institute, The Catholic University of Korea, Seoul, Korea.
- Department of Pathology, Seoul St. Mary's Hospital, College of Medicine, The Catholic University of Korea, 222 Banpo-daero, Seocho-gu, Seoul, 06591, Republic of Korea.
| |
Collapse
|
5
|
Nojima S, Kadoi T, Suzuki A, Kato C, Ishida S, Kido K, Fujita K, Okuno Y, Hirokawa M, Terayama K, Morii E. Deep Learning-Based Differential Diagnosis of Follicular Thyroid Tumors Using Histopathological Images. Mod Pathol 2023; 36:100296. [PMID: 37532181 DOI: 10.1016/j.modpat.2023.100296] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2023] [Revised: 07/04/2023] [Accepted: 07/25/2023] [Indexed: 08/04/2023]
Abstract
Deep learning systems (DLSs) have been developed for the histopathological assessment of various types of tumors, but none are suitable for differential diagnosis between follicular thyroid carcinoma (FTC) and follicular adenoma (FA). Furthermore, whether DLSs can identify the malignant characteristics of thyroid tumors based only on random views of tumor tissue histology has not been evaluated. In this study, we developed DLSs able to differentiate between FTC and FA based on 3 types of convolutional neural network architecture: EfficientNet, VGG16, and ResNet50. The performance of all 3 DLSs was excellent (area under the receiver operating characteristic curve = 0.91 ± 0.04; F1 score = 0.82 ± 0.06). Visual explanations using gradient-weighted class activation mapping suggested that the diagnosis of both FTC and FA was largely dependent on nuclear features. The DLSs were then trained with FTC images and linked information (presence or absence of recurrence within 10 years, vascular invasion, and wide capsular invasion). The ability of the DLSs to diagnose these characteristics was then determined. The results showed that, based on the random views of histology, the DLSs could predict the risk of FTC recurrence, vascular invasion, and wide capsular invasion with a certain level of accuracy (area under the receiver operating characteristic curve = 0.67 ± 0.13, 0.62 ± 0.11, and 0.65 ± 0.09, respectively). Further improvement of our DLSs could lead to the establishment of automated differential diagnosis systems requiring only biopsy specimens.
Collapse
Affiliation(s)
- Satoshi Nojima
- Department of Pathology, Osaka University Graduate School of Medicine, Osaka, Japan.
| | - Tokimu Kadoi
- Graduate School of Medical Life Science, Yokohama City University, Kanagawa, Japan
| | - Ayana Suzuki
- Department of Pathology, Osaka University Graduate School of Medicine, Osaka, Japan; Department of Diagnostic Pathology and Cytology, Kuma Hospital, Kobe, Japan
| | - Chiharu Kato
- International College of Arts and Science, Yokohama City University, Kanagawa, Japan
| | - Shoichi Ishida
- Graduate School of Medical Life Science, Yokohama City University, Kanagawa, Japan
| | - Kansuke Kido
- Department of Pathology, Osaka University Graduate School of Medicine, Osaka, Japan
| | - Kazutoshi Fujita
- Department of Urology, Kindai University Faculty of Medicine, Osaka, Japan
| | - Yasushi Okuno
- Graduate School of Medicine, Kyoto University, Kyoto, Japan
| | | | - Kei Terayama
- Graduate School of Medical Life Science, Yokohama City University, Kanagawa, Japan; International College of Arts and Science, Yokohama City University, Kanagawa, Japan; Graduate School of Medicine, Kyoto University, Kyoto, Japan; RIKEN Center for Advanced Intelligence Project, Tokyo, Japan.
| | - Eiichi Morii
- Department of Pathology, Osaka University Graduate School of Medicine, Osaka, Japan
| |
Collapse
|
6
|
Kim M, Jeon S, Jung CK. Preoperative Risk Stratification of Follicular-patterned Thyroid Lesions on Core Needle Biopsy by Histologic Subtyping and RAS Variant-specific Immunohistochemistry. Endocr Pathol 2023:10.1007/s12022-023-09763-3. [PMID: 37040004 DOI: 10.1007/s12022-023-09763-3] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 03/29/2023] [Indexed: 04/12/2023]
Abstract
Follicular-patterned lesions often have indeterminate results (diagnostic category III or IV) by core needle biopsy (CNB) and fine needle aspiration (FNA). However, CNB diagnoses follicular neoplasm (category IV) more frequently than FNA. Therefore, we aimed to develop a risk stratification system for CNB samples with category III/IV using immunohistochemistry (IHC). The specificity of the RAS Q61R antibody was validated on 58 thyroid nodules with six different types of RAS genetic variants and 40 cases of RAS wild-type. We then applied IHC analysis of RAS Q61R to 207 CNB samples with category III/IV in which all patients underwent surgical resection. RAS Q61R IHC had 98% sensitivity and 98% specificity for detecting the RAS p.Q16R variant. In an independent dataset, the positive rate of RAS Q61R was significantly higher in NIFTP (48%) and malignancies (45%) than in benign tumors (19%). The risk of NIFTP/malignancy was highest in the group with nuclear atypia and RAS Q61R expression (86%) and lowest in the group without both parameters (32%). The high-risk group with either nuclear atypia or RAS Q61R had 67.3% sensitivity, 73.4% specificity, 75.2% positive predictive value, and 65.1% negative predictive value for identifying NIFTP/malignancy. We conclude that RAS Q61R IHC can be a rule-in diagnostic test for NIFTP/malignancy in CNB category III/IV results. Combining of the histologic parameter (nuclear atypia) with RAS Q61R IHC results can further stratify CNB category III/IV into a high-risk group, which is sufficient for a surgical referral, and a low-risk group sufficient for observation.
Collapse
Affiliation(s)
- Meejeong Kim
- Department of Pathology, Seoul St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Seoul, Korea
| | - Sora Jeon
- College of Medicine, Cancer Research Institute, The Catholic University of Korea, Seoul, Korea
| | - Chan Kwon Jung
- Department of Pathology, Seoul St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Seoul, Korea.
- College of Medicine, Cancer Research Institute, The Catholic University of Korea, Seoul, Korea.
| |
Collapse
|