1
|
Hanna MG, Pantanowitz L, Dash R, Harrison JH, Deebajah M, Pantanowitz J, Rashidi HH. Future of Artificial Intelligence-Machine Learning Trends in Pathology and Medicine. Mod Pathol 2025; 38:100705. [PMID: 39761872 DOI: 10.1016/j.modpat.2025.100705] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2024] [Revised: 12/19/2024] [Accepted: 01/01/2025] [Indexed: 02/07/2025]
Abstract
Artificial intelligence (AI) and machine learning (ML) are transforming the field of medicine. Health care organizations are now starting to establish management strategies for integrating such platforms (AI-ML toolsets) that leverage the computational power of advanced algorithms to analyze data and to provide better insights that ultimately translate to enhanced clinical decision-making and improved patient outcomes. Emerging AI-ML platforms and trends in pathology and medicine are reshaping the field by offering innovative solutions to enhance diagnostic accuracy, operational workflows, clinical decision support, and clinical outcomes. These tools are also increasingly valuable in pathology research in which they contribute to automated image analysis, biomarker discovery, drug development, clinical trials, and productive analytics. Other related trends include the adoption of ML operations for managing models in clinical settings, the application of multimodal and multiagent AI to utilize diverse data sources, expedited translational research, and virtualized education for training and simulation. As the final chapter of our AI educational series, this review article delves into the current adoption, future directions, and transformative potential of AI-ML platforms in pathology and medicine, discussing their applications, benefits, challenges, and future perspectives.
Collapse
Affiliation(s)
- Matthew G Hanna
- Department of Pathology, University of Pittsburgh Medical Center, Pittsburgh, Pennsylvania; Computational Pathology and AI Center of Excellence, University of Pittsburgh, Pittsburgh, Pennsylvania.
| | - Liron Pantanowitz
- Department of Pathology, University of Pittsburgh Medical Center, Pittsburgh, Pennsylvania; Computational Pathology and AI Center of Excellence, University of Pittsburgh, Pittsburgh, Pennsylvania
| | - Rajesh Dash
- Department of Pathology, Duke University, Durham, North Carolina
| | - James H Harrison
- Department of Pathology, University of Virginia, Charlottesville, Virginia
| | | | | | - Hooman H Rashidi
- Department of Pathology, University of Pittsburgh Medical Center, Pittsburgh, Pennsylvania; Computational Pathology and AI Center of Excellence, University of Pittsburgh, Pittsburgh, Pennsylvania.
| |
Collapse
|
2
|
Ivanova M, Pescia C, Trapani D, Venetis K, Frascarelli C, Mane E, Cursano G, Sajjadi E, Scatena C, Cerbelli B, d’Amati G, Porta FM, Guerini-Rocco E, Criscitiello C, Curigliano G, Fusco N. Early Breast Cancer Risk Assessment: Integrating Histopathology with Artificial Intelligence. Cancers (Basel) 2024; 16:1981. [PMID: 38893102 PMCID: PMC11171409 DOI: 10.3390/cancers16111981] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2024] [Revised: 05/13/2024] [Accepted: 05/17/2024] [Indexed: 06/21/2024] Open
Abstract
Effective risk assessment in early breast cancer is essential for informed clinical decision-making, yet consensus on defining risk categories remains challenging. This paper explores evolving approaches in risk stratification, encompassing histopathological, immunohistochemical, and molecular biomarkers alongside cutting-edge artificial intelligence (AI) techniques. Leveraging machine learning, deep learning, and convolutional neural networks, AI is reshaping predictive algorithms for recurrence risk, thereby revolutionizing diagnostic accuracy and treatment planning. Beyond detection, AI applications extend to histological subtyping, grading, lymph node assessment, and molecular feature identification, fostering personalized therapy decisions. With rising cancer rates, it is crucial to implement AI to accelerate breakthroughs in clinical practice, benefiting both patients and healthcare providers. However, it is important to recognize that while AI offers powerful automation and analysis tools, it lacks the nuanced understanding, clinical context, and ethical considerations inherent to human pathologists in patient care. Hence, the successful integration of AI into clinical practice demands collaborative efforts between medical experts and computational pathologists to optimize patient outcomes.
Collapse
Affiliation(s)
- Mariia Ivanova
- Division of Pathology, European Institute of Oncology IRCCS, 20141 Milan, Italy; (M.I.); (C.P.); (K.V.); (C.F.); (E.M.); (G.C.); (E.S.); (F.M.P.); (E.G.-R.)
| | - Carlo Pescia
- Division of Pathology, European Institute of Oncology IRCCS, 20141 Milan, Italy; (M.I.); (C.P.); (K.V.); (C.F.); (E.M.); (G.C.); (E.S.); (F.M.P.); (E.G.-R.)
| | - Dario Trapani
- Division of New Drugs and Early Drug Development for Innovative Therapies, European Institute of Oncology IRCCS, 20141 Milan, Italy; (D.T.); (C.C.); (G.C.)
- Department of Oncology and Hemato-Oncology, University of Milan, 20122 Milan, Italy
| | - Konstantinos Venetis
- Division of Pathology, European Institute of Oncology IRCCS, 20141 Milan, Italy; (M.I.); (C.P.); (K.V.); (C.F.); (E.M.); (G.C.); (E.S.); (F.M.P.); (E.G.-R.)
| | - Chiara Frascarelli
- Division of Pathology, European Institute of Oncology IRCCS, 20141 Milan, Italy; (M.I.); (C.P.); (K.V.); (C.F.); (E.M.); (G.C.); (E.S.); (F.M.P.); (E.G.-R.)
- Department of Oncology and Hemato-Oncology, University of Milan, 20122 Milan, Italy
| | - Eltjona Mane
- Division of Pathology, European Institute of Oncology IRCCS, 20141 Milan, Italy; (M.I.); (C.P.); (K.V.); (C.F.); (E.M.); (G.C.); (E.S.); (F.M.P.); (E.G.-R.)
| | - Giulia Cursano
- Division of Pathology, European Institute of Oncology IRCCS, 20141 Milan, Italy; (M.I.); (C.P.); (K.V.); (C.F.); (E.M.); (G.C.); (E.S.); (F.M.P.); (E.G.-R.)
- Department of Oncology and Hemato-Oncology, University of Milan, 20122 Milan, Italy
| | - Elham Sajjadi
- Division of Pathology, European Institute of Oncology IRCCS, 20141 Milan, Italy; (M.I.); (C.P.); (K.V.); (C.F.); (E.M.); (G.C.); (E.S.); (F.M.P.); (E.G.-R.)
- Department of Oncology and Hemato-Oncology, University of Milan, 20122 Milan, Italy
| | - Cristian Scatena
- Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, 56126 Pisa, Italy;
| | - Bruna Cerbelli
- Department of Medical-Surgical Sciences and Biotechnologies, Sapienza University of Rome, 00185 Rome, Italy;
| | - Giulia d’Amati
- Department of Radiological, Oncological and Pathological Sciences, Sapienza University of Rome, 00185 Rome, Italy;
| | - Francesca Maria Porta
- Division of Pathology, European Institute of Oncology IRCCS, 20141 Milan, Italy; (M.I.); (C.P.); (K.V.); (C.F.); (E.M.); (G.C.); (E.S.); (F.M.P.); (E.G.-R.)
| | - Elena Guerini-Rocco
- Division of Pathology, European Institute of Oncology IRCCS, 20141 Milan, Italy; (M.I.); (C.P.); (K.V.); (C.F.); (E.M.); (G.C.); (E.S.); (F.M.P.); (E.G.-R.)
- Department of Oncology and Hemato-Oncology, University of Milan, 20122 Milan, Italy
| | - Carmen Criscitiello
- Division of New Drugs and Early Drug Development for Innovative Therapies, European Institute of Oncology IRCCS, 20141 Milan, Italy; (D.T.); (C.C.); (G.C.)
- Department of Oncology and Hemato-Oncology, University of Milan, 20122 Milan, Italy
| | - Giuseppe Curigliano
- Division of New Drugs and Early Drug Development for Innovative Therapies, European Institute of Oncology IRCCS, 20141 Milan, Italy; (D.T.); (C.C.); (G.C.)
- Department of Oncology and Hemato-Oncology, University of Milan, 20122 Milan, Italy
| | - Nicola Fusco
- Division of Pathology, European Institute of Oncology IRCCS, 20141 Milan, Italy; (M.I.); (C.P.); (K.V.); (C.F.); (E.M.); (G.C.); (E.S.); (F.M.P.); (E.G.-R.)
- Department of Oncology and Hemato-Oncology, University of Milan, 20122 Milan, Italy
| |
Collapse
|
3
|
Zhao Z, Chen C, Guan H, Guo L, Tian W, Liu X, Zhang H, Li J, Qiu T, Du J, Guo Q, Sun F, Zheng S, Ma J. Analysis of false reasons based on the artificial intelligence RRCART model to identify frozen sections of lymph nodes in breast cancer. Diagn Pathol 2024; 19:18. [PMID: 38254204 PMCID: PMC10802064 DOI: 10.1186/s13000-023-01432-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2023] [Accepted: 12/17/2023] [Indexed: 01/24/2024] Open
Abstract
BACKGROUND Breast cancer is the most common malignant tumor in the world. Intraoperative frozen section of sentinel lymph nodes is an important basis for determining whether axillary lymph node dissection is required for breast cancer surgery. We propose an RRCART model based on a deep-learning network to identify metastases in 2362 frozen sections and count the wrongly identified sections and the associated reasons. The purpose is to summarize the factors that affect the accuracy of the artificial intelligence model and propose corresponding solutions. METHODS We took the pathological diagnosis of senior pathologists as the gold standard and identified errors. The pathologists and artificial intelligence engineers jointly read the images and heatmaps to determine the locations of the identified errors on sections, and the pathologists found the reasons (false reasons) for the errors. Through NVivo 12 Plus, qualitative analysis of word frequency analysis and nodal analysis was performed on the error reasons, and the top-down error reason framework of "artificial intelligence RRCART model to identify frozen sections of breast cancer lymph nodes" was constructed based on the importance of false reasons. RESULTS There were 101 incorrectly identified sections in 2362 slides, including 42 false negatives and 59 false positives. Through NVivo 12 Plus software, the error causes were node-coded, and finally, 2 parent nodes (high-frequency error, low-frequency error) and 5 child nodes (section quality, normal lymph node structure, secondary reaction of lymph nodes, micrometastasis, and special growth pattern of tumor) were obtained; among them, the error of highest frequency was that caused by normal lymph node structure, with a total of 45 cases (44.55%), followed by micrometastasis, which occurred in 30 cases (29.70%). CONCLUSIONS The causes of identification errors in examination of sentinel lymph node frozen sections by artificial intelligence are, in descending order of influence, normal lymph node structure, micrometastases, section quality, special tumor growth patterns and secondary lymph node reactions. In this study, by constructing an artificial intelligence model to identify the error causes of frozen sections of lymph nodes in breast cancer and by analyzing the model in detail, we found that poor quality of slices was the preproblem of many identification errors, which can lead to other errors, such as unclear recognition of lymph node structure by computer. Therefore, we believe that the process of artificial intelligence pathological diagnosis should be optimized, and the quality control of the pathological sections included in the artificial intelligence reading should be carried out first to exclude the influence of poor section quality on the computer model. For cases of micrometastasis, we suggest that by differentiating slices into high- and low-confidence groups, low-confidence micrometastatic slices can be separated for manual identification. The normal lymph node structure can be improved by adding samples and training the model in a targeted manner.
Collapse
Affiliation(s)
- Zuxuan Zhao
- Department of Pathology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinses Academy of Medical Sciences and Peking Union Medical College, Beijing, 100021, China
| | - Cancan Chen
- Digital Health China Technologies Corporation Limited, Beijing, 100080, China
- Infervision Medical Technology Co., Ltd, Beijing, 100025, China
| | - Hanwen Guan
- School of Health Management, Harbin Medical University, Harbin, 150081, Heilongjiang Province, China
| | - Lei Guo
- Department of Pathology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinses Academy of Medical Sciences and Peking Union Medical College, Beijing, 100021, China
| | - Wanxin Tian
- Department of Medical Affairs, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, 100021, China
| | - Xiaoqi Liu
- Department of Pathology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinses Academy of Medical Sciences and Peking Union Medical College, Beijing, 100021, China
| | - Huijuan Zhang
- Department of Pathology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinses Academy of Medical Sciences and Peking Union Medical College, Beijing, 100021, China
- Department of Pathology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital/ Shenzhen Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Shenzhen, 528116, China
| | - Jiangtao Li
- Department of Pathology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinses Academy of Medical Sciences and Peking Union Medical College, Beijing, 100021, China
| | - Tinglin Qiu
- Department of Medical Affairs, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, 100021, China
| | - Jun Du
- Administration Office, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, 100021, China
| | - Qiang Guo
- Department of Big Data, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, 100021, China
| | - Fenglong Sun
- Digital Health China Technologies Corporation Limited, Beijing, 100080, China.
- Healthcare IT Department, Genertec Universal Medical Group Co., Ltd, Beijing, 100062, China.
| | - Shan Zheng
- Department of Pathology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinses Academy of Medical Sciences and Peking Union Medical College, Beijing, 100021, China.
| | - Jianhui Ma
- Department of Urology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, 100021, China
| |
Collapse
|
4
|
Subramonian S, Chopra S, Vidya R. New Alternative Techniques for Sentinel Lymph Node Biopsy. MEDICINA (KAUNAS, LITHUANIA) 2023; 59:2077. [PMID: 38138180 PMCID: PMC10744367 DOI: 10.3390/medicina59122077] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/21/2023] [Revised: 11/18/2023] [Accepted: 11/22/2023] [Indexed: 12/24/2023]
Abstract
Background and Objectives: This review paper highlights the key alternatives to the blue dye/radioisotope method of sentinel lymph node biopsy (SLNB). It analyses the research available on these alternative methods and their outcomes compared to the traditional techniques. Materials and Methods: This review focused on fifteen articles, of which five used indocyanine green (ICG) as a tracer, four used magnetic tracers, one used one-step nucleic acid amplification (OSNA) and Metasin (quantitative reverse transcriptase-polymerase chain reaction), one used the photosensitiser talaporfin sodium, one used sulphur hexafluoride gas microbubbles, one used CT-guided lymphography and two focused on general SLNB technique reviews. Results: Of the 15 papers analysed, the sentinel node detection rates were 69-100% for indocyanine green, 91.67-100% for magnetic tracers, 81% for talaporfin sodium, 9.3-55.2% for sulphur hexafluoride gas microbubbles, 90.5% for CTLG and 82.7-100% for one-step nucleic acid amplification. Conclusions: Indocyanine green fluorescence (ICG) and magnetic tracers have been proven non-inferior to traditional blue dye and isotope regarding SLNB localisation. Further studies are needed to investigate the use of these techniques in conjunction with each other and the possible use of language learning models. Dedicated studies are required to assess cost efficacy and longer-term outcomes.
Collapse
Affiliation(s)
| | - Sharat Chopra
- Aneurin Bevan University Health Board, The Royal Gwent Hospital, Newport NP20 2UB, UK;
| | - Raghavan Vidya
- The Royal Wolverhampton NHS Trust, Wolverhampton WV10 0QP, UK
| |
Collapse
|
5
|
Hanna MG, Brogi E. Future Practices of Breast Pathology Using Digital and Computational Pathology. Adv Anat Pathol 2023; 30:421-433. [PMID: 37737690 DOI: 10.1097/pap.0000000000000414] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/23/2023]
Abstract
Pathology clinical practice has evolved by adopting technological advancements initially regarded as potentially disruptive, such as electron microscopy, immunohistochemistry, and genomic sequencing. Breast pathology has a critical role as a medical domain, where the patient's pathology diagnosis has significant implications for prognostication and treatment of diseases. The advent of digital and computational pathology has brought about significant advancements in the field, offering new possibilities for enhancing diagnostic accuracy and improving patient care. Digital slide scanning enables to conversion of glass slides into high-fidelity digital images, supporting the review of cases in a digital workflow. Digitization offers the capability to render specimen diagnoses, digital archival of patient specimens, collaboration, and telepathology. Integration of image analysis and machine learning-based systems layered atop the high-resolution digital images offers novel workflows to assist breast pathologists in their clinical, educational, and research endeavors. Decision support tools may improve the detection and classification of breast lesions and the quantification of immunohistochemical studies. Computational biomarkers may help to contribute to patient management or outcomes. Furthermore, using digital and computational pathology may increase standardization and quality assurance, especially in areas with high interobserver variability. This review explores the current landscape and possible future applications of digital and computational techniques in the field of breast pathology.
Collapse
Affiliation(s)
- Matthew G Hanna
- Department of Pathology and Laboratory Medicine, Memorial Sloan Kettering Cancer Center, New York, NY
| | | |
Collapse
|
6
|
Ahn JS, Shin S, Yang SA, Park EK, Kim KH, Cho SI, Ock CY, Kim S. Artificial Intelligence in Breast Cancer Diagnosis and Personalized Medicine. J Breast Cancer 2023; 26:405-435. [PMID: 37926067 PMCID: PMC10625863 DOI: 10.4048/jbc.2023.26.e45] [Citation(s) in RCA: 29] [Impact Index Per Article: 14.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2023] [Revised: 09/25/2023] [Accepted: 10/06/2023] [Indexed: 11/07/2023] Open
Abstract
Breast cancer is a significant cause of cancer-related mortality in women worldwide. Early and precise diagnosis is crucial, and clinical outcomes can be markedly enhanced. The rise of artificial intelligence (AI) has ushered in a new era, notably in image analysis, paving the way for major advancements in breast cancer diagnosis and individualized treatment regimens. In the diagnostic workflow for patients with breast cancer, the role of AI encompasses screening, diagnosis, staging, biomarker evaluation, prognostication, and therapeutic response prediction. Although its potential is immense, its complete integration into clinical practice is challenging. Particularly, these challenges include the imperatives for extensive clinical validation, model generalizability, navigating the "black-box" conundrum, and pragmatic considerations of embedding AI into everyday clinical environments. In this review, we comprehensively explored the diverse applications of AI in breast cancer care, underlining its transformative promise and existing impediments. In radiology, we specifically address AI in mammography, tomosynthesis, risk prediction models, and supplementary imaging methods, including magnetic resonance imaging and ultrasound. In pathology, our focus is on AI applications for pathologic diagnosis, evaluation of biomarkers, and predictions related to genetic alterations, treatment response, and prognosis in the context of breast cancer diagnosis and treatment. Our discussion underscores the transformative potential of AI in breast cancer management and emphasizes the importance of focused research to realize the full spectrum of benefits of AI in patient care.
Collapse
Affiliation(s)
| | | | | | | | | | | | | | - Seokhwi Kim
- Department of Pathology, Ajou University School of Medicine, Suwon, Korea
- Department of Biomedical Sciences, Ajou University Graduate School of Medicine, Suwon, Korea.
| |
Collapse
|
7
|
Challa B, Tahir M, Hu Y, Kellough D, Lujan G, Sun S, Parwani AV, Li Z. Artificial Intelligence-Aided Diagnosis of Breast Cancer Lymph Node Metastasis on Histologic Slides in a Digital Workflow. Mod Pathol 2023; 36:100216. [PMID: 37178923 DOI: 10.1016/j.modpat.2023.100216] [Citation(s) in RCA: 20] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2023] [Revised: 04/03/2023] [Accepted: 05/05/2023] [Indexed: 05/15/2023]
Abstract
Identifying lymph node (LN) metastasis in invasive breast carcinoma can be tedious and time-consuming. We investigated an artificial intelligence (AI) algorithm to detect LN metastasis by screening hematoxylin and eosin (H&E) slides in a clinical digital workflow. The study included 2 sentinel LN (SLN) cohorts (a validation cohort with 234 SLNs and a consensus cohort with 102 SLNs) and 1 nonsentinel LN cohort (258 LNs enriched with lobular carcinoma and postneoadjuvant therapy cases). All H&E slides were scanned into whole slide images in a clinical digital workflow, and whole slide images were automatically batch-analyzed using the Visiopharm Integrator System (VIS) metastasis AI algorithm. For the SLN validation cohort, the VIS metastasis AI algorithm detected all 46 metastases, including 19 macrometastases, 26 micrometastases, and 1 with isolated tumor cells with a sensitivity of 100%, specificity of 41.5%, positive predictive value of 29.5%, and negative predictive value (NPV) of 100%. The false positivity was caused by histiocytes (52.7%), crushed lymphocytes (18.2%), and others (29.1%), which were readily recognized during pathologists' reviews. For the SLN consensus cohort, 3 pathologists examined all VIS AI annotated H&E slides and cytokeratin immunohistochemistry slides with similar average concordance rates (99% for both modalities). However, the average time consumed by pathologists using VIS AI annotated slides was significantly less than using immunohistochemistry slides (0.6 vs 1.0 minutes, P = .0377). For the nonsentinel LN cohort, the AI algorithm detected all 81 metastases, including 23 from lobular carcinoma and 31 from postneoadjuvant chemotherapy cases, with a sensitivity of 100%, specificity of 78.5%, positive predictive value of 68.1%, and NPV of 100%. The VIS AI algorithm showed perfect sensitivity and NPV in detecting LN metastasis and less time consumed, suggesting its potential utility as a screening modality in routine clinical digital pathology workflow to improve efficiency.
Collapse
Affiliation(s)
- Bindu Challa
- Department of Pathology, The Ohio State University Wexner Medical Center, Columbus, Ohio
| | - Maryam Tahir
- Department of Pathology, The Ohio State University Wexner Medical Center, Columbus, Ohio
| | - Yan Hu
- Department of Pathology, The Ohio State University Wexner Medical Center, Columbus, Ohio
| | - David Kellough
- Department of Pathology, The Ohio State University Wexner Medical Center, Columbus, Ohio
| | - Giovani Lujan
- Department of Pathology, The Ohio State University Wexner Medical Center, Columbus, Ohio
| | - Shaoli Sun
- Department of Pathology, The Ohio State University Wexner Medical Center, Columbus, Ohio
| | - Anil V Parwani
- Department of Pathology, The Ohio State University Wexner Medical Center, Columbus, Ohio
| | - Zaibo Li
- Department of Pathology, The Ohio State University Wexner Medical Center, Columbus, Ohio.
| |
Collapse
|
8
|
Chen S, Xiang J, Wang X, Zhang J, Yang S, Yang W, Zheng J, Han X. Deep learning-based pathology signature could reveal lymph node status and act as a novel prognostic marker across multiple cancer types. Br J Cancer 2023; 129:46-53. [PMID: 37137998 PMCID: PMC10307798 DOI: 10.1038/s41416-023-02262-6] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2022] [Revised: 03/22/2023] [Accepted: 03/24/2023] [Indexed: 05/05/2023] Open
Abstract
BACKGROUND Identifying lymph node metastasis (LNM) relies mainly on indirect radiology. Current studies omitted the quantified associations with traits beyond cancer types, failing to provide generalisation performance across various tumour types. METHODS 4400 whole slide images across 11 cancer types were collected for training, cross-verification, and external validation of the pan-cancer lymph node metastasis (PC-LNM) model. We proposed an attention-based weakly supervised neural network based on self-supervised cancer-invariant features for the prediction task. RESULTS PC-LNM achieved a test area under the curve (AUC) of 0.732 (95% confidence interval: 0.717-0.746, P < 0.0001) in fivefold cross-validation of multiple cancer types, which also demonstrated good generalisation in the external validation cohort with AUC of 0.699 (95% confidence interval: 0.658-0.737, P < 0.0001). The interpretability results derived from PC-LNM revealed that the regions with the highest attention scores identified by the model generally correspond to tumours with poorly differentiated morphologies. PC-LNM achieved superior performance over previously reported methods and could also act as an independent prognostic factor for patients across multiple tumour types. DISCUSSION We presented an automated pan-cancer model for predicting the LNM status from primary tumour histology, which could act as a novel prognostic marker across multiple cancer types.
Collapse
Affiliation(s)
- Siteng Chen
- Department of Urology, Renji Hospital, Shanghai Jiao Tong University School of Medicine, 200135, Shanghai, China
| | | | - Xiyue Wang
- College of Computer Science, Sichuan University, 610065, Chengdu, China
| | - Jun Zhang
- Tencent AI Lab, 518057, Shenzhen, China.
| | - Sen Yang
- Tencent AI Lab, 518057, Shenzhen, China
| | - Wei Yang
- Tencent AI Lab, 518057, Shenzhen, China
| | - Junhua Zheng
- Department of Urology, Renji Hospital, Shanghai Jiao Tong University School of Medicine, 200135, Shanghai, China.
| | - Xiao Han
- Tencent AI Lab, 518057, Shenzhen, China.
| |
Collapse
|
9
|
Caldonazzi N, Rizzo PC, Eccher A, Girolami I, Fanelli GN, Naccarato AG, Bonizzi G, Fusco N, d’Amati G, Scarpa A, Pantanowitz L, Marletta S. Value of Artificial Intelligence in Evaluating Lymph Node Metastases. Cancers (Basel) 2023; 15:2491. [PMID: 37173958 PMCID: PMC10177013 DOI: 10.3390/cancers15092491] [Citation(s) in RCA: 28] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2023] [Revised: 04/23/2023] [Accepted: 04/25/2023] [Indexed: 05/15/2023] Open
Abstract
One of the most relevant prognostic factors in cancer staging is the presence of lymph node (LN) metastasis. Evaluating lymph nodes for the presence of metastatic cancerous cells can be a lengthy, monotonous, and error-prone process. Owing to digital pathology, artificial intelligence (AI) applied to whole slide images (WSIs) of lymph nodes can be exploited for the automatic detection of metastatic tissue. The aim of this study was to review the literature regarding the implementation of AI as a tool for the detection of metastases in LNs in WSIs. A systematic literature search was conducted in PubMed and Embase databases. Studies involving the application of AI techniques to automatically analyze LN status were included. Of 4584 retrieved articles, 23 were included. Relevant articles were labeled into three categories based upon the accuracy of AI in evaluating LNs. Published data overall indicate that the application of AI in detecting LN metastases is promising and can be proficiently employed in daily pathology practice.
Collapse
Affiliation(s)
- Nicolò Caldonazzi
- Department of Diagnostics and Public Health, Section of Pathology, University of Verona, 37134 Verona, Italy; (N.C.); (P.C.R.); (A.S.); (S.M.)
| | - Paola Chiara Rizzo
- Department of Diagnostics and Public Health, Section of Pathology, University of Verona, 37134 Verona, Italy; (N.C.); (P.C.R.); (A.S.); (S.M.)
| | - Albino Eccher
- Department of Pathology and Diagnostics, University and Hospital Trust of Verona, 37126 Verona, Italy
| | - Ilaria Girolami
- Department of Pathology, Lehrkrankenhaus der Paracelsus Medizinischen Privatuniversität, Provincial Hospital of Bolzano (SABES-ASDAA), 39100 Bolzano-Bozen, Italy;
| | - Giuseppe Nicolò Fanelli
- Division of Pathology, Department of Translational Research, New Technologies in Medicine and Surgery, University of Pisa, 56126 Pisa, Italy; (G.N.F.); (A.G.N.)
| | - Antonio Giuseppe Naccarato
- Division of Pathology, Department of Translational Research, New Technologies in Medicine and Surgery, University of Pisa, 56126 Pisa, Italy; (G.N.F.); (A.G.N.)
| | - Giuseppina Bonizzi
- Division of Pathology, IEO, Europefan Institute of Oncology IRCCS, University of Milan, 20122 Milan, Italy; (G.B.); (N.F.)
| | - Nicola Fusco
- Division of Pathology, IEO, Europefan Institute of Oncology IRCCS, University of Milan, 20122 Milan, Italy; (G.B.); (N.F.)
- Department of Oncology and Hemato-Oncology, University of Milan, 20122 Milan, Italy
| | - Giulia d’Amati
- Department of Radiology, Oncology and Pathology, Sapienza, University of Rome, 00185 Rome, Italy;
| | - Aldo Scarpa
- Department of Diagnostics and Public Health, Section of Pathology, University of Verona, 37134 Verona, Italy; (N.C.); (P.C.R.); (A.S.); (S.M.)
| | - Liron Pantanowitz
- Department of Pathology, University of Michigan, Ann Arbor, MI 48104, USA;
| | - Stefano Marletta
- Department of Diagnostics and Public Health, Section of Pathology, University of Verona, 37134 Verona, Italy; (N.C.); (P.C.R.); (A.S.); (S.M.)
- Department of Pathology, Pederzoli Hospital, 37019 Peschiera del Garda, Italy
| |
Collapse
|
10
|
Chan RC, To CKC, Cheng KCT, Yoshikazu T, Yan LLA, Tse GM. Artificial intelligence in breast cancer histopathology. Histopathology 2023; 82:198-210. [PMID: 36482271 DOI: 10.1111/his.14820] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2022] [Revised: 09/22/2022] [Accepted: 09/28/2022] [Indexed: 12/13/2022]
Abstract
This is a review on the use of artificial intelligence for digital breast pathology. A systematic search on PubMed was conducted, identifying 17,324 research papers related to breast cancer pathology. Following a semimanual screening, 664 papers were retrieved and pursued. The papers are grouped into six major tasks performed by pathologists-namely, molecular and hormonal analysis, grading, mitotic figure counting, ki-67 indexing, tumour-infiltrating lymphocyte assessment, and lymph node metastases identification. Under each task, open-source datasets for research to build artificial intelligence (AI) tools are also listed. Many AI tools showed promise and demonstrated feasibility in the automation of routine pathology investigations. We expect continued growth of AI in this field as new algorithms mature.
Collapse
Affiliation(s)
- Ronald Ck Chan
- Department of Anatomical and Cellular Pathology, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong, Hong Kong
| | - Chun Kit Curtis To
- Department of Anatomical and Cellular Pathology, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong, Hong Kong
| | - Ka Chuen Tom Cheng
- Department of Anatomical and Cellular Pathology, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong, Hong Kong
| | - Tada Yoshikazu
- Department of Anatomical and Cellular Pathology, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong, Hong Kong
| | - Lai Ling Amy Yan
- Department of Anatomical and Cellular Pathology, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong, Hong Kong
| | - Gary M Tse
- Department of Anatomical and Cellular Pathology, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong, Hong Kong
| |
Collapse
|
11
|
Requa J, Godard T, Mandal R, Balzer B, Whittemore D, George E, Barcelona F, Lambert C, Lee J, Lambert A, Larson A, Osmond G. High-fidelity detection, subtyping, and localization of five skin neoplasms using supervised and semi-supervised learning. J Pathol Inform 2022; 14:100159. [PMID: 36506813 PMCID: PMC9731861 DOI: 10.1016/j.jpi.2022.100159] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2022] [Revised: 11/16/2022] [Accepted: 11/22/2022] [Indexed: 11/27/2022] Open
Abstract
Background Skin cancers are the most common malignancies diagnosed worldwide. While the early detection and treatment of pre-cancerous and cancerous skin lesions can dramatically improve outcomes, factors such as a global shortage of pathologists, increased workloads, and high rates of diagnostic discordance underscore the need for techniques that improve pathology workflows. Although AI models are now being used to classify lesions from whole slide images (WSIs), diagnostic performance rarely surpasses that of expert pathologists. Objectives The objective of the present study was to create an AI model to detect and classify skin lesions with a higher degree of sensitivity than previously demonstrated, with potential to match and eventually surpass expert pathologists to improve clinical workflows. Methods We combined supervised learning (SL) with semi-supervised learning (SSL) to produce an end-to-end multi-level skin detection system that not only detects 5 main types of skin lesions with high sensitivity and specificity, but also subtypes, localizes, and provides margin status to evaluate the proximity of the lesion to non-epidermal margins. The Supervised Training Subset consisted of 2188 random WSIs collected by the PathologyWatch (PW) laboratory between 2013 and 2018, while the Weakly Supervised Subset consisted of 5161 WSIs from daily case specimens. The Validation Set consisted of 250 curated daily case WSIs obtained from the PW tissue archives and included 50 "mimickers". The Testing Set (3821 WSIs) was composed of non-curated daily case specimens collected from July 20, 2021 to August 20, 2021 from PW laboratories. Results The performance characteristics of our AI model (i.e., Mihm) were assessed retrospectively by running the Testing Set through the Mihm Evaluation Pipeline. Our results show that the sensitivity of Mihm in classifying melanocytic lesions, basal cell carcinoma, and atypical squamous lesions, verruca vulgaris, and seborrheic keratosis was 98.91% (95% CI: 98.27%, 99.55%), 97.24% (95% CI: 96.15%, 98.33%), 95.26% (95% CI: 93.79%, 96.73%), 93.50% (95% CI: 89.14%, 97.86%), and 86.91% (95% CI: 82.13%, 91.69%), respectively. Additionally, our multi-level (i.e., patch-level, ROI-level, and WSI-level) detection algorithm includes a qualitative feature that subtypes lesions, an AI overlay in the front-end digital display that localizes diagnostic ROIs, and reports on margin status by detecting overlap between lesions and non-epidermal tissue margins. Conclusions Our AI model, developed in collaboration with dermatopathologists, detects 5 skin lesion types with higher sensitivity than previously published AI models, and provides end users with information such as subtyping, localization, and margin status in a front-end digital display. Our end-to-end system has the potential to improve pathology workflows by increasing diagnostic accuracy, expediting the course of patient care, and ultimately improving patient outcomes.
Collapse
Affiliation(s)
- James Requa
- Pathology Watch, 497 West 4800 South, Suite 201, Murray, UT 84123, USA
| | - Tuatini Godard
- Pathology Watch, 497 West 4800 South, Suite 201, Murray, UT 84123, USA
| | - Rajni Mandal
- Pathology Watch, 497 West 4800 South, Suite 201, Murray, UT 84123, USA
| | - Bonnie Balzer
- Cedars-Sinai Medical Center, 8700 Beverly Blvd, Los Angeles, CA 90048, USA
| | - Darren Whittemore
- Pathology Watch, 497 West 4800 South, Suite 201, Murray, UT 84123, USA
| | - Eva George
- Pathology Watch, 497 West 4800 South, Suite 201, Murray, UT 84123, USA
| | | | - Chalette Lambert
- Kirk Kerkorian School of Medicine at UNLV, University of Nevada, Las Vegas, Mail Stop: 3070, 2040 W Charleston Blvd., Las Vegas, NV 89102-2244, USA
| | - Jonathan Lee
- Bethesda Dermatopathology Laboratory, 1730 Elton Road, Silver Spring, MD 20903, USA
| | - Allison Lambert
- Pathology Watch, 497 West 4800 South, Suite 201, Murray, UT 84123, USA
| | - April Larson
- Pathology Watch, 497 West 4800 South, Suite 201, Murray, UT 84123, USA
| | - Gregory Osmond
- Intermountain Healthcare, Saint George Regional Hospital, Department of Pathology, 1380 East Medical Center Drive, Saint George, Utah 84790, USA,Corresponding author.
| |
Collapse
|
12
|
Vaish R, Mittal N, Mahajan A, Rane SU, Agrawal A, D'Cruz AK. Sentinel node biopsy in node negative early oral cancers: Solution to the conundrum! Oral Oncol 2022; 134:106070. [PMID: 35988294 DOI: 10.1016/j.oraloncology.2022.106070] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2022] [Revised: 07/21/2022] [Accepted: 08/07/2022] [Indexed: 11/25/2022]
Abstract
Ideal management of the node-negative neck in early oral cancers is a debated issue. Elective neck dissection (END) is recommended in these patients as it offers a survival benefit. However, about 50-70% of patients who do not harbor occult metastasis are overtreated with this approach. Surgery is associated with morbidity, predominantly shoulder dysfunction. Numerous attempts have been made to identify true node-negative patients through imaging and prediction models but none have high diagnostic accuracy to safely spare the neck dissection. The recent publications of 2 large randomized controlled trials comparing the outcomes of sentinel node biopsy (SNB) and END have spurred interest in SNB. Both the trials reported SNB to be an oncologically safe procedure and spared unnecessary neck dissections. The functional outcomes of the trials showed that SNB limits the morbidity compared to END, which albeit evens out at the end of one-year post-surgery. Despite its benefits, SNB has failed to gain widespread acceptability due to various limitations including the need for infrastructure, equipment costs, staff, and multidisciplinary collaboration of nuclear medicine, surgical, and pathology fraternity. The labor-intensive pathology protocol with serial step sectioning and immunohistochemistry poses a challenge to the feasibility at a high-volume center. This perspective discusses these limitations and propose plausible solutions to the conundrum. To make it widely applicable and feasible across the globe efforts should be directed to understand biology better, find novel solutions, and implement the lessons learned over decades from other sites.
Collapse
Affiliation(s)
- Richa Vaish
- Department of Head and Neck Oncology, Tata Memorial Hospital, Mumbai 400012, Maharashtra, India; Homi Bhabha National Institute, Mumbai 400094, Maharashtra, India.
| | - Neha Mittal
- Homi Bhabha National Institute, Mumbai 400094, Maharashtra, India; Department of Pathology, Tata Memorial Hospital, Mumbai 400012, Maharashtra, India.
| | - Abhishek Mahajan
- Consultant Radiologist, Department of Radiology, The Clatterbridge Cancer Centre NHS Foundation Trust, Pembroke Place, Liverpool L7 8YA, UK.
| | - Swapnil U Rane
- Homi Bhabha National Institute, Mumbai 400094, Maharashtra, India; Department of Pathology, Tata Memorial Hospital, Mumbai 400012, Maharashtra, India.
| | - Archi Agrawal
- Homi Bhabha National Institute, Mumbai 400094, Maharashtra, India; Department of Nuclear Medicine and Molecular Imaging, Tata Memorial Hospital, Mumbai 400012, Maharashtra, India.
| | - Anil K D'Cruz
- Director Oncology-Apollo Group of Hospitals, Dept. of Oncology, Apollo Hospital, Navi Mumbai, President Union International Cancer Control (UICC) Geneva, 400614 Maharashtra, India.
| |
Collapse
|
13
|
Harrison B. Update on sentinel node pathology in breast cancer. Semin Diagn Pathol 2022; 39:355-366. [PMID: 35803776 DOI: 10.1053/j.semdp.2022.06.016] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/04/2022] [Revised: 06/14/2022] [Accepted: 06/27/2022] [Indexed: 11/11/2022]
Abstract
Pathologic examination of the sentinel lymph nodes (SLNs) in patients with breast cancer has been impacted by the publication of practicing changing trials over the last decade. With evidence from the ACOSOG Z0011 trial to suggest that there is no significant benefit to axillary lymph node dissection (ALND) in early-stage breast cancer patients with up to 2 positive SLNs, the rate of ALND, and in turn, intraoperative evaluation of SLNs has significantly decreased. It is of limited clinical significance to pursue multiple levels and cytokeratin immunohistochemistry to detect occult small metastases, such as isolated tumor cells and micrometastases, in this setting. Patients treated with neoadjuvant therapy, who represent a population with more extensive disease and aggressive tumor biology, were not included in Z0011 and similar trials, and thus, the evidence cannot be extrapolated to them. Recent trials have supported the safety and accuracy of sentinel lymph node biopsy (SLNB) in these patients when clinically node negative at the time of surgery. ALND remains the standard of care for any amount of residual disease in the SLNs and intraoperative evaluation of SLNs is still of value for real time surgical decision making. Given the potential prognostic significance of residual small metastases in treated lymph nodes, as well as the decreased false negative rate with the use of cytokeratin immunohistochemistry (IHC), it may be reasonable to maintain a low threshold for the use of cytokeratin IHC in post-neoadjuvant cases. Further recommendations for patients treated with neoadjuvant therapy await outcomes data from ongoing clinical trials. This review will provide an evidence-based discussion of best practices in SLN evaluation.
Collapse
Affiliation(s)
- Beth Harrison
- Department of Pathology, Brigham and Women's Hospital, Boston, MA, United States.
| |
Collapse
|
14
|
Go H. Digital Pathology and Artificial Intelligence Applications in Pathology. Brain Tumor Res Treat 2022; 10:76-82. [PMID: 35545826 PMCID: PMC9098984 DOI: 10.14791/btrt.2021.0032] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2021] [Revised: 01/17/2022] [Accepted: 03/13/2022] [Indexed: 11/20/2022] Open
Abstract
Digital pathology is revolutionizing pathology. The introduction of digital pathology made it possible to comprehensively change the pathology diagnosis workflow, apply and develop pathological artificial intelligence (AI) models, generate pathological big data, and perform telepathology. AI algorithms, including machine learning and deep learning, are used for the detection, segmentation, registration, processing, and classification of digitized pathological images. Pathological AI algorithms can be helpfully utilized for diagnostic screening, morphometric analysis of biomarkers, the discovery of new meanings of prognosis and therapeutic response in pathological images, and improvement of diagnostic efficiency. In order to develop a successful pathological AI model, it is necessary to consider the selection of a suitable type of image for a subject, utilization of big data repositories, the setting of an effective annotation strategy, image standardization, and color normalization. This review will elaborate on the advantages and perspectives of digital pathology, AI-based approaches, the applications in pathology, and considerations and challenges in the development of pathological AI models.
Collapse
Affiliation(s)
- Heounjeong Go
- Department of Pathology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Korea.
| |
Collapse
|
15
|
Abstract
Over the past decade, 3D culture models of human and animal cells have found their way into tissue differentiation, drug development, personalized medicine and tumour behaviour studies. Embryoid bodies (EBs) are in vitro 3D cultures established from murine pluripotential stem cells, whereas tumoroids are patient-derived in vitro 3D cultures. This thesis aims to describe a new implication of an embryoid body model and to characterize the patient-specific microenvironment of the parental tumour in relation to tumoroid growth rate. In this thesis, we described a high-throughput monitoring method, where EBs are used as a dynamic angiogenesis model. In this model, digital image analysis (DIA) is implemented on immunohistochemistry (IHC) stained sections of the cultures over time. Furthermore, we have investigated the correlation between the genetic profile and inflammatory microenvironment of parental tumours on the in vitro growth rate of tumoroids. The EBs were cultured in spinner flasks. The samples were collected at days 4, 6, 9, 14, 18 and 21, dehydrated and embedded in paraffin. The histological sections were IHC stained for the endothelial marker CD31 and digitally scanned. The virtual whole-image slides were digitally analysed by Visiopharm® software. Histological evaluation showed vascular-like structures over time. The quantitative DIA was plausible to monitor significant increase in the total area of the EBs and an increase in endothelial differentiation. The tumoroids were established from 32 colorectal adenocarcinomas. The in vitro growth rate of the tumoroids was followed by automated microscopy over an 11-day period. The parental tumours were analysed by next-generation sequencing for KRAS, TP53, PIK3CA, SMAD4, MAP2K1, BRAF, FGFR3 and FBXW7 status. The tumoroids established from KRAS-mutated parental tumours showed a significantly higher growth rate compared to their wild-type counterparts. The density of CD3+ T lymphocytes and CD68+ macrophages was calculated in the centre of the tumours and at the invasive margin of the tumours. The high density of CD3+ cells and the low density of CD68+ cells showed a significant correlation with a higher growth rate of the tumoroids. In conclusion, a novel approach for histological monitoring of endothelial differentiation is presented in the stem cell-derived EBs. Furthermore, the KRAS status and density of CD3+ T cells and macrophages in the parental tumour influence the growth rate of the tumoroids. Our results indicate that these parameters should be included when tumoroids are to be implemented in personalized medicine.
Collapse
Affiliation(s)
- Nabi Mousavi
- Department of Pathology, Rigshospitalet, University of Copenhagen, Copenhagen, Denmark
| |
Collapse
|
16
|
Chou M, Illa-Bochaca I, Minxi B, Darvishian F, Johannet P, Moran U, Shapiro RL, Berman RS, Osman I, Jour G, Zhong H. Optimization of an automated tumor-infiltrating lymphocyte algorithm for improved prognostication in primary melanoma. Mod Pathol 2021; 34:562-571. [PMID: 33005020 PMCID: PMC7983061 DOI: 10.1038/s41379-020-00686-6] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2020] [Revised: 09/08/2020] [Accepted: 09/11/2020] [Indexed: 12/11/2022]
Abstract
Tumor-infiltrating lymphocytes (TIL) have potential prognostic value in melanoma and have been considered for inclusion in the American Joint Committee on Cancer (AJCC) staging criteria. However, interobserver discordance continues to prevent the adoption of TIL into clinical practice. Computational image analysis offers a solution to this obstacle, representing a methodological approach for reproducibly counting TIL. We sought to evaluate the ability of a TIL-quantifying machine learning algorithm to predict survival in primary melanoma. Digitized hematoxylin and eosin (H&E) slides from prospectively enrolled patients in the NYU melanoma database were scored for % TIL using machine learning and manually graded by pathologists using Clark's model. We evaluated the association of % TIL with recurrence-free survival (RFS) and overall survival (OS) using Cox proportional hazards modeling and concordance indices. Discordance between algorithmic and manual TIL quantification was assessed with McNemar's test and visually by an attending dermatopathologist. In total, 453 primary melanoma patients were scored using machine learning. Automated % TIL scoring significantly differentiated survival using an estimated cutoff of 16.6% TIL (log-rank P < 0.001 for RFS; P = 0.002 for OS). % TIL was associated with significantly longer RFS (adjusted HR = 0.92 [0.84-1.00] per 10% increase in % TIL) and OS (adjusted HR = 0.90 [0.83-0.99] per 10% increase in % TIL). In comparison, a subset of the cohort (n = 240) was graded for TIL by melanoma pathologists. However, TIL did not associate with RFS between groups (P > 0.05) when categorized as brisk, nonbrisk, or absent. A standardized and automated % TIL scoring algorithm can improve the prognostic impact of TIL. Incorporation of quantitative TIL scoring into the AJCC staging criteria should be considered.
Collapse
Affiliation(s)
- Margaret Chou
- Ronald O. Perelman Department of Dermatology, NYU Grossman School of Medicine, New York, NY, USA
| | - Irineu Illa-Bochaca
- Ronald O. Perelman Department of Dermatology, NYU Grossman School of Medicine, New York, NY, USA
| | - Ben Minxi
- Department of Population Health, NYU Grossman School of Medicine, New York, NY, USA
| | - Farbod Darvishian
- Department of Pathology, NYU Grossman School of Medicine, New York, NY, USA
| | - Paul Johannet
- Department of Medicine, NYU Grossman School of Medicine, New York, NY, USA
| | - Una Moran
- Ronald O. Perelman Department of Dermatology, NYU Grossman School of Medicine, New York, NY, USA
| | - Richard L Shapiro
- Division of Surgical Oncology, Department of Surgery, NYU Grossman School of Medicine, New York, NY, USA
| | - Russell S Berman
- Division of Surgical Oncology, Department of Surgery, NYU Grossman School of Medicine, New York, NY, USA
| | - Iman Osman
- Ronald O. Perelman Department of Dermatology, NYU Grossman School of Medicine, New York, NY, USA
| | - George Jour
- Ronald O. Perelman Department of Dermatology, NYU Grossman School of Medicine, New York, NY, USA.
- Department of Pathology, NYU Grossman School of Medicine, New York, NY, USA.
| | - Hua Zhong
- Department of Population Health, NYU Grossman School of Medicine, New York, NY, USA.
| |
Collapse
|
17
|
Application of digital image analysis on histological images of a murine embryoid body model for monitoring endothelial differentiation. Pathol Res Pract 2020; 216:153225. [PMID: 32987302 DOI: 10.1016/j.prp.2020.153225] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/05/2020] [Revised: 08/29/2020] [Accepted: 09/14/2020] [Indexed: 11/22/2022]
Abstract
The in vitro 3D model established from murine pluripotential stem cells (i.e., embryoid bodies (EBs)) is a dynamic model for endothelial differentiation. The aim of the present study was to investigate whether digital image analysis (DIA) can be applied on histological sections of EBs in order to quantify endothelial differentiation over time. The EBs were established in suspension cultures for 21 days in three independent replicate experiments. At day 4, 6, 9, 14, 18, and 21, the EBs were fixed in formaldehyde, embedded in paraffin and immunohistochemically (IHC) stained for CD31. The IHC-stained slides were digitally scanned and analysed using the Visiopharm® Quantitative Digital Pathology software Oncotopix™. The EBs developed CD31+ vascular-like structures during their differentiation. The quantitative DIA of the EBs showed that the log10 values of the relative CD31+ areas increased from -0.574 ± 0.470 (mean ± SD) at day 4 to 0.093 ± 0.688 (mean ± SD) at day 21 (p < 0.001). The approach presented in this study is a fast, quantitative and reproducible alternative method for an otherwise time-consuming and observer-dependent histological investigation. The future perspectives for such a system would be implementation of a modified version of the method on different 3D cultures and IHC markers.
Collapse
|
18
|
Cykowska A, Marano L, D'Ignazio A, Marrelli D, Swierblewski M, Jaskiewicz J, Roviello F, Polom K. New technologies in breast cancer sentinel lymph node biopsy; from the current gold standard to artificial intelligence. Surg Oncol 2020; 34:324-335. [PMID: 32791443 DOI: 10.1016/j.suronc.2020.06.005] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2020] [Revised: 05/28/2020] [Accepted: 06/18/2020] [Indexed: 01/14/2023]
Abstract
Sentinel lymph node biopsy is an important diagnostic procedure performed in early breast cancer patients with clinically negative axillary lymph nodes. Detection and examination of sentinel lymph nodes determine further therapy decisions, therefore a choice of optimal technique minimising the risk of false-negative results is of great importance. Currently, the gold standard is the dual technique comprising the blue dye and radiotracer, however, this method creates a logistical problem for many medical units. The intrinsic constraints of the existing methods led to the development of a very wide range of alternatives with varying clinical efficiency and feasibility. While each method presents with its own advantages and disadvantages, many techniques have improved enough to become a non-inferior alternative in the sentinel lymph node biopsy. Along with the improvement of the existing technologies, there are evolving trends such as multimodality of the techniques maximising the diagnostic outcome or an emerging use of artificial intelligence (AI) improving the workflow of the procedure. This literature review aims to give an overview of the current status of the standard techniques and emerging cutting-edge technologies in the sentinel lymph node biopsy.
Collapse
Affiliation(s)
- Anna Cykowska
- Department of Clinical and Biological Sciences, University of Turin, Orbassano, 10043, Italy.
| | - Luigi Marano
- Department of Medicine, Surgery and Neurosciences, Unit of General Surgery and Surgical Oncology, University of Siena, Strada Delle Scotte, 4, 53100, Siena, Italy
| | - Alessia D'Ignazio
- Department of Medicine, Surgery and Neurosciences, Unit of General Surgery and Surgical Oncology, University of Siena, Strada Delle Scotte, 4, 53100, Siena, Italy
| | - Daniele Marrelli
- Department of Medicine, Surgery and Neurosciences, Unit of General Surgery and Surgical Oncology, University of Siena, Strada Delle Scotte, 4, 53100, Siena, Italy
| | - Maciej Swierblewski
- Department of Surgical Oncology, Medical University of Gdansk, Gdańsk, 80-211, Poland
| | - Janusz Jaskiewicz
- Department of Surgical Oncology, Medical University of Gdansk, Gdańsk, 80-211, Poland
| | - Franco Roviello
- Department of Medicine, Surgery and Neurosciences, Unit of General Surgery and Surgical Oncology, University of Siena, Strada Delle Scotte, 4, 53100, Siena, Italy
| | - Karol Polom
- Department of Surgical Oncology, Medical University of Gdansk, Gdańsk, 80-211, Poland
| |
Collapse
|
19
|
Acs B, Rantalainen M, Hartman J. Artificial intelligence as the next step towards precision pathology. J Intern Med 2020; 288:62-81. [PMID: 32128929 DOI: 10.1111/joim.13030] [Citation(s) in RCA: 218] [Impact Index Per Article: 43.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/01/2019] [Revised: 12/16/2019] [Accepted: 12/30/2019] [Indexed: 12/13/2022]
Abstract
Pathology is the cornerstone of cancer care. The need for accuracy in histopathologic diagnosis of cancer is increasing as personalized cancer therapy requires accurate biomarker assessment. The appearance of digital image analysis holds promise to improve both the volume and precision of histomorphological evaluation. Recently, machine learning, and particularly deep learning, has enabled rapid advances in computational pathology. The integration of machine learning into routine care will be a milestone for the healthcare sector in the next decade, and histopathology is right at the centre of this revolution. Examples of potential high-value machine learning applications include both model-based assessment of routine diagnostic features in pathology, and the ability to extract and identify novel features that provide insights into a disease. Recent groundbreaking results have demonstrated that applications of machine learning methods in pathology significantly improves metastases detection in lymph nodes, Ki67 scoring in breast cancer, Gleason grading in prostate cancer and tumour-infiltrating lymphocyte (TIL) scoring in melanoma. Furthermore, deep learning models have also been demonstrated to be able to predict status of some molecular markers in lung, prostate, gastric and colorectal cancer based on standard HE slides. Moreover, prognostic (survival outcomes) deep neural network models based on digitized HE slides have been demonstrated in several diseases, including lung cancer, melanoma and glioma. In this review, we aim to present and summarize the latest developments in digital image analysis and in the application of artificial intelligence in diagnostic pathology.
Collapse
Affiliation(s)
- B Acs
- From the, Department of Oncology and Pathology, Karolinska Institutet, Stockholm, Sweden
| | - M Rantalainen
- Department of Medical Epidemiology and Biostatistics, Karolinska Institutet, Stockholm, Sweden
| | - J Hartman
- From the, Department of Oncology and Pathology, Karolinska Institutet, Stockholm, Sweden
| |
Collapse
|
20
|
Huss R, Coupland SE. Software‐assisted decision support in digital histopathology. J Pathol 2020; 250:685-692. [DOI: 10.1002/path.5388] [Citation(s) in RCA: 39] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2019] [Revised: 01/09/2020] [Accepted: 01/17/2020] [Indexed: 12/16/2022]
Affiliation(s)
- Ralf Huss
- Institute of Pathology and Molecular Diagnostics University Hospital Augsburg Augsburg Germany
| | - Sarah E Coupland
- Department of Cellular and Molecular Pathology University of Liverpool Liverpool UK
| |
Collapse
|
21
|
Chuang WY, Chang SH, Yu WH, Yang CK, Yeh CJ, Ueng SH, Liu YJ, Chen TD, Chen KH, Hsieh YY, Hsia Y, Wang TH, Hsueh C, Kuo CF, Yeh CY. Successful Identification of Nasopharyngeal Carcinoma in Nasopharyngeal Biopsies Using Deep Learning. Cancers (Basel) 2020; 12:cancers12020507. [PMID: 32098314 PMCID: PMC7072217 DOI: 10.3390/cancers12020507] [Citation(s) in RCA: 32] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2020] [Revised: 02/16/2020] [Accepted: 02/19/2020] [Indexed: 12/14/2022] Open
Abstract
Pathologic diagnosis of nasopharyngeal carcinoma (NPC) can be challenging since most cases are nonkeratinizing carcinoma with little differentiation and many admixed lymphocytes. Our aim was to evaluate the possibility to identify NPC in nasopharyngeal biopsies using deep learning. A total of 726 nasopharyngeal biopsies were included. Among them, 100 cases were randomly selected as the testing set, 20 cases as the validation set, and all other 606 cases as the training set. All three datasets had equal numbers of NPC cases and benign cases. Manual annotation was performed. Cropped square image patches of 256 × 256 pixels were used for patch-level training, validation, and testing. The final patch-level algorithm effectively identified NPC patches, with an area under the receiver operator characteristic curve (AUC) of 0.9900. Using gradient-weighted class activation mapping, we demonstrated that the identification of NPC patches was based on morphologic features of tumor cells. At the second stage, whole-slide images were sequentially cropped into patches, inferred with the patch-level algorithm, and reconstructed into images with a smaller size for training, validation, and testing. Finally, the AUC was 0.9848 for slide-level identification of NPC. Our result shows for the first time that deep learning algorithms can identify NPC.
Collapse
Affiliation(s)
- Wen-Yu Chuang
- Department of Pathology, Chang Gung Memorial Hospital and Chang Gung University, No. 5, Fuxing Street, Guishan District, Taoyuan City 333, Taiwan; (W.-Y.C.); (C.-J.Y.); (S.-H.U.); (Y.-J.L.); (T.-D.C.); (K.-H.C.); (Y.-Y.H.); (Y.H.); (C.H.)
- Center for Vascularized Composite Allotransplantation, Chang Gung Memorial Hospital, No. 5, Fuxing Street, Guishan District, Taoyuan City 333, Taiwan
| | - Shang-Hung Chang
- Center for Big Data Analytics and Statistics, Chang Gung Memorial Hospital, No. 5, Fuxing Street, Guishan District, Taoyuan City 333, Taiwan;
| | - Wei-Hsiang Yu
- aetherAI, Co., Ltd., No. 3-2, Yuan-Qu Street, Nangang District, Taipei City 115, Taiwan; (W.-H.Y.); (C.-K.Y.)
| | - Cheng-Kun Yang
- aetherAI, Co., Ltd., No. 3-2, Yuan-Qu Street, Nangang District, Taipei City 115, Taiwan; (W.-H.Y.); (C.-K.Y.)
| | - Chi-Ju Yeh
- Department of Pathology, Chang Gung Memorial Hospital and Chang Gung University, No. 5, Fuxing Street, Guishan District, Taoyuan City 333, Taiwan; (W.-Y.C.); (C.-J.Y.); (S.-H.U.); (Y.-J.L.); (T.-D.C.); (K.-H.C.); (Y.-Y.H.); (Y.H.); (C.H.)
| | - Shir-Hwa Ueng
- Department of Pathology, Chang Gung Memorial Hospital and Chang Gung University, No. 5, Fuxing Street, Guishan District, Taoyuan City 333, Taiwan; (W.-Y.C.); (C.-J.Y.); (S.-H.U.); (Y.-J.L.); (T.-D.C.); (K.-H.C.); (Y.-Y.H.); (Y.H.); (C.H.)
- Chang Gung Molecular Medicine Research Center, Chang Gung University, No. 259, Wenhua First Road, Guishan District, Taoyuan City 333, Taiwan
| | - Yu-Jen Liu
- Department of Pathology, Chang Gung Memorial Hospital and Chang Gung University, No. 5, Fuxing Street, Guishan District, Taoyuan City 333, Taiwan; (W.-Y.C.); (C.-J.Y.); (S.-H.U.); (Y.-J.L.); (T.-D.C.); (K.-H.C.); (Y.-Y.H.); (Y.H.); (C.H.)
| | - Tai-Di Chen
- Department of Pathology, Chang Gung Memorial Hospital and Chang Gung University, No. 5, Fuxing Street, Guishan District, Taoyuan City 333, Taiwan; (W.-Y.C.); (C.-J.Y.); (S.-H.U.); (Y.-J.L.); (T.-D.C.); (K.-H.C.); (Y.-Y.H.); (Y.H.); (C.H.)
| | - Kuang-Hua Chen
- Department of Pathology, Chang Gung Memorial Hospital and Chang Gung University, No. 5, Fuxing Street, Guishan District, Taoyuan City 333, Taiwan; (W.-Y.C.); (C.-J.Y.); (S.-H.U.); (Y.-J.L.); (T.-D.C.); (K.-H.C.); (Y.-Y.H.); (Y.H.); (C.H.)
| | - Yi-Yin Hsieh
- Department of Pathology, Chang Gung Memorial Hospital and Chang Gung University, No. 5, Fuxing Street, Guishan District, Taoyuan City 333, Taiwan; (W.-Y.C.); (C.-J.Y.); (S.-H.U.); (Y.-J.L.); (T.-D.C.); (K.-H.C.); (Y.-Y.H.); (Y.H.); (C.H.)
| | - Yi Hsia
- Department of Pathology, Chang Gung Memorial Hospital and Chang Gung University, No. 5, Fuxing Street, Guishan District, Taoyuan City 333, Taiwan; (W.-Y.C.); (C.-J.Y.); (S.-H.U.); (Y.-J.L.); (T.-D.C.); (K.-H.C.); (Y.-Y.H.); (Y.H.); (C.H.)
- Department of Pathology, MacKay Memorial Hospital, No. 92, Section 2, Zhongshan North Road, Zhongshan District, Taipei City 104, Taiwan
| | - Tong-Hong Wang
- Tissue Bank, Chang Gung Memorial Hospital, No. 5, Fuxing Street, Guishan District, Taoyuan City 333, Taiwan;
| | - Chuen Hsueh
- Department of Pathology, Chang Gung Memorial Hospital and Chang Gung University, No. 5, Fuxing Street, Guishan District, Taoyuan City 333, Taiwan; (W.-Y.C.); (C.-J.Y.); (S.-H.U.); (Y.-J.L.); (T.-D.C.); (K.-H.C.); (Y.-Y.H.); (Y.H.); (C.H.)
- Chang Gung Molecular Medicine Research Center, Chang Gung University, No. 259, Wenhua First Road, Guishan District, Taoyuan City 333, Taiwan
| | - Chang-Fu Kuo
- Center for Artificial Intelligence in Medicine, Chang Gung Memorial Hospital, No. 5, Fuxing Street, Guishan District, Taoyuan City 333, Taiwan;
| | - Chao-Yuan Yeh
- aetherAI, Co., Ltd., No. 3-2, Yuan-Qu Street, Nangang District, Taipei City 115, Taiwan; (W.-H.Y.); (C.-K.Y.)
- Correspondence: ; Tel.: +886-2-27856892
| |
Collapse
|
22
|
Pham HHN, Futakuchi M, Bychkov A, Furukawa T, Kuroda K, Fukuoka J. Detection of Lung Cancer Lymph Node Metastases from Whole-Slide Histopathologic Images Using a Two-Step Deep Learning Approach. THE AMERICAN JOURNAL OF PATHOLOGY 2019; 189:2428-2439. [DOI: 10.1016/j.ajpath.2019.08.014] [Citation(s) in RCA: 33] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/16/2019] [Revised: 07/30/2019] [Accepted: 08/20/2019] [Indexed: 12/27/2022]
|
23
|
Transcripts of cytokeratins as predictors of breast cancer. GENE REPORTS 2018. [DOI: 10.1016/j.genrep.2018.08.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
|
24
|
Digital image analysis of pan-cytokeratin stained tumor slides for evaluation of tumor budding in pT1/pT2 colorectal cancer: Results of a feasibility study. Pathol Res Pract 2018; 214:1273-1281. [DOI: 10.1016/j.prp.2018.07.002] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/05/2018] [Revised: 07/03/2018] [Accepted: 07/05/2018] [Indexed: 12/25/2022]
|
25
|
Robertson S, Azizpour H, Smith K, Hartman J. Digital image analysis in breast pathology-from image processing techniques to artificial intelligence. Transl Res 2018; 194:19-35. [PMID: 29175265 DOI: 10.1016/j.trsl.2017.10.010] [Citation(s) in RCA: 128] [Impact Index Per Article: 18.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/01/2017] [Revised: 10/28/2017] [Accepted: 10/30/2017] [Indexed: 01/04/2023]
Abstract
Breast cancer is the most common malignant disease in women worldwide. In recent decades, earlier diagnosis and better adjuvant therapy have substantially improved patient outcome. Diagnosis by histopathology has proven to be instrumental to guide breast cancer treatment, but new challenges have emerged as our increasing understanding of cancer over the years has revealed its complex nature. As patient demand for personalized breast cancer therapy grows, we face an urgent need for more precise biomarker assessment and more accurate histopathologic breast cancer diagnosis to make better therapy decisions. The digitization of pathology data has opened the door to faster, more reproducible, and more precise diagnoses through computerized image analysis. Software to assist diagnostic breast pathology through image processing techniques have been around for years. But recent breakthroughs in artificial intelligence (AI) promise to fundamentally change the way we detect and treat breast cancer in the near future. Machine learning, a subfield of AI that applies statistical methods to learn from data, has seen an explosion of interest in recent years because of its ability to recognize patterns in data with less need for human instruction. One technique in particular, known as deep learning, has produced groundbreaking results in many important problems including image classification and speech recognition. In this review, we will cover the use of AI and deep learning in diagnostic breast pathology, and other recent developments in digital image analysis.
Collapse
Affiliation(s)
- Stephanie Robertson
- Department of Oncology-Pathology, Karolinska Institutet, Stockholm, Sweden; Department of Clinical Pathology and Cytology, Karolinska University Laboratory, Stockholm, Sweden
| | - Hossein Azizpour
- School of Computer Science and Communication, KTH Royal Institute of Technology, Stockholm, Sweden; Science for Life Laboratory, Stockholm, Sweden
| | - Kevin Smith
- School of Computer Science and Communication, KTH Royal Institute of Technology, Stockholm, Sweden; Science for Life Laboratory, Stockholm, Sweden
| | - Johan Hartman
- Department of Oncology-Pathology, Karolinska Institutet, Stockholm, Sweden; Department of Clinical Pathology and Cytology, Karolinska University Laboratory, Stockholm, Sweden; Stockholm South General Hospital, Stockholm, Sweden.
| |
Collapse
|