1
|
Tran M, Schmidle P, Guo RR, Wagner SJ, Koch V, Lupperger V, Novotny B, Murphree DH, Hardway HD, D'Amato M, Lefkes J, Geijs DJ, Feuchtinger A, Böhner A, Kaczmarczyk R, Biedermann T, Amir AL, Mooyaart AL, Ciompi F, Litjens G, Wang C, Comfere NI, Eyerich K, Braun SA, Marr C, Peng T. Generating dermatopathology reports from gigapixel whole slide images with HistoGPT. Nat Commun 2025; 16:4886. [PMID: 40419470 DOI: 10.1038/s41467-025-60014-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2024] [Accepted: 05/12/2025] [Indexed: 05/28/2025] Open
Abstract
Histopathology is the reference standard for diagnosing the presence and nature of many diseases, including cancer. However, analyzing tissue samples under a microscope and summarizing the findings in a comprehensive pathology report is time-consuming, labor-intensive, and non-standardized. To address this problem, we present HistoGPT, a vision language model that generates pathology reports from a patient's multiple full-resolution histology images. It is trained on 15,129 whole slide images from 6705 dermatology patients with corresponding pathology reports. The generated reports match the quality of human-written reports for common and homogeneous malignancies, as confirmed by natural language processing metrics and domain expert analysis. We evaluate HistoGPT in an international, multi-center clinical study and show that it can accurately predict tumor subtypes, tumor thickness, and tumor margins in a zero-shot fashion. Our model demonstrates the potential of artificial intelligence to assist pathologists in evaluating, reporting, and understanding routine dermatopathology cases.
Collapse
Affiliation(s)
- Manuel Tran
- Helmholtz AI, Helmholtz Munich, Neuherberg, Germany
- School of Computation, Information and Technology, Technical University of Munich, Munich, Germany
| | - Paul Schmidle
- Department of Dermatology, Medical Center, University of Freiburg, Freiburg, Germany
| | - Ruifeng Ray Guo
- Department of Laboratory Medicine and Pathology, Mayo Clinic, Jacksonville, FL, USA
| | - Sophia J Wagner
- Helmholtz AI, Helmholtz Munich, Neuherberg, Germany
- School of Computation, Information and Technology, Technical University of Munich, Munich, Germany
| | - Valentin Koch
- School of Computation, Information and Technology, Technical University of Munich, Munich, Germany
- Institute of AI for Health, Helmholtz Munich, Neuherberg, Germany
| | | | - Brenna Novotny
- Department of Quantitative Health Sciences, Mayo Clinic, Rochester, MN, USA
| | - Dennis H Murphree
- Digital Health, Artificial Intelligence and Innovations Program, Mayo Clinic, Rochester, MN, USA
| | - Heather D Hardway
- Digital Health, Artificial Intelligence and Innovations Program, Mayo Clinic, Rochester, MN, USA
| | - Marina D'Amato
- Computational Pathology Group, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Judith Lefkes
- Computational Pathology Group, Radboud University Medical Center, Nijmegen, The Netherlands
- Oncode Institute, Utrecht, The Netherlands
| | - Daan J Geijs
- Computational Pathology Group, Radboud University Medical Center, Nijmegen, The Netherlands
- Oncode Institute, Utrecht, The Netherlands
| | - Annette Feuchtinger
- Core Facility Pathology and Tissue Analytics, Helmholtz Munich, Neuherberg, Germany
| | - Alexander Böhner
- Department of Dermatology and Allergy, Technical University of Munich, Munich, Germany
| | - Robert Kaczmarczyk
- Department of Dermatology and Allergy, Technical University of Munich, Munich, Germany
| | - Tilo Biedermann
- Department of Dermatology and Allergy, Technical University of Munich, Munich, Germany
| | - Avital L Amir
- Department of Pathology, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Antien L Mooyaart
- Department of Pathology, Erasmus University Medical Center, Rotterdam, The Netherlands
| | - Francesco Ciompi
- Computational Pathology Group, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Geert Litjens
- Computational Pathology Group, Radboud University Medical Center, Nijmegen, The Netherlands
- Oncode Institute, Utrecht, The Netherlands
| | - Chen Wang
- Department of Quantitative Health Sciences, Mayo Clinic, Rochester, MN, USA
| | - Nneka I Comfere
- Digital Health, Artificial Intelligence and Innovations Program, Mayo Clinic, Rochester, MN, USA
- Department of Dermatology and Laboratory Medicine & Pathology, Mayo Clinic, Rochester, MN, USA
| | - Kilian Eyerich
- Department of Dermatology, Medical Center, University of Freiburg, Freiburg, Germany.
| | - Stephan A Braun
- Dermatology Department, University Hospital Münster, Münster, Germany.
- Department of Dermatology, Medical Faculty, Heinrich-Heine University, Düsseldorf, Germany.
| | - Carsten Marr
- Helmholtz AI, Helmholtz Munich, Neuherberg, Germany.
- Institute of AI for Health, Helmholtz Munich, Neuherberg, Germany.
| | - Tingying Peng
- Helmholtz AI, Helmholtz Munich, Neuherberg, Germany.
- School of Computation, Information and Technology, Technical University of Munich, Munich, Germany.
| |
Collapse
|
2
|
Belgaid YC, Moktefi A. Publication productivity of pathology residents: a nationwide cohort study in France. Virchows Arch 2025; 486:923-930. [PMID: 39285024 DOI: 10.1007/s00428-024-03923-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2024] [Revised: 08/15/2024] [Accepted: 08/31/2024] [Indexed: 05/22/2025]
Abstract
The publication productivity of residents has been reported in various specialties, mainly in North America, but never in pathology. In France, pathology residents must defend a medical thesis to obtain the title of medical doctor and to practice medicine. The aim of this study was to assess the thesis performance and publication output of a nationwide cohort of pathology residents from six graduating classes in France. Among 231 theses, 110 (48%) resulted in publications, of which 95% were original articles (OA) and 74% were resident first-author publications. The median impact factor (IF) was 3.6 (2.8-5.9). During residency and in the 4 years following defense, residents published a median of 5 (2-10) total publications, 2 (1-6) OA, and 1 (0-3) first-author manuscripts. Among 1849 publications, 822 (44%) were first, second, or last-authored by residents. The median IF of the 362 (20%) OA published as first, second, and last author was 3.1 (2.4-5), 3.3 (2.2-5.2), and 3.2 (0.9-3.3), respectively. Only 44% of these OA were indexed in the pathology category according to Web of Science, with Virchows Arch being the most common journal. Residents who published their medical thesis had a higher median number of total publications, as well as first- and last-author OA (p = 0.0005, p = 0.001 and p = 0.007, respectively). The publication record of pathology residents goes beyond the field of pathology, with most contributions to non-pathology journals. The mandatory medical thesis provides a valuable opportunity for pathology residents to engage in research and may be the first step towards publication productivity.
Collapse
Affiliation(s)
- Youcef-Chafik Belgaid
- Pathology Department, Assistance Publique des Hôpitaux de Paris (AP-HP), Hôpitaux Universitaires Henri Mondor, 51 Avenue du Maréchal de Lattre de Tassigny, Créteil, F-94010, France
| | - Anissa Moktefi
- Pathology Department, Assistance Publique des Hôpitaux de Paris (AP-HP), Hôpitaux Universitaires Henri Mondor, 51 Avenue du Maréchal de Lattre de Tassigny, Créteil, F-94010, France.
- Univ Paris Est Créteil, Créteil, F-94010, France.
| |
Collapse
|
3
|
Tran M, Wagner S, Weichert W, Matek C, Boxberg M, Peng T. Navigating Through Whole Slide Images With Hierarchy, Multi-Object, and Multi-Scale Data. IEEE TRANSACTIONS ON MEDICAL IMAGING 2025; 44:2002-2015. [PMID: 40031287 DOI: 10.1109/tmi.2025.3532728] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/05/2025]
Abstract
Building deep learning models that can rapidly segment whole slide images (WSIs) using only a handful of training samples remains an open challenge in computational pathology. The difficulty lies in the histological images themselves: many morphological structures within a slide are closely related and very similar in appearance, making it difficult to distinguish between them. However, a skilled pathologist can quickly identify the relevant phenotypes. Through years of training, they have learned to organize visual features into a hierarchical taxonomy (e.g., identifying carcinoma versus healthy tissue, or distinguishing regions within a tumor as cancer cells, the microenvironment, …). Thus, each region is associated with multiple labels representing different tissue types. Pathologists typically deal with this by analyzing the specimen at multiple scales and comparing visual features between different magnifications. Inspired by this multi-scale diagnostic workflow, we introduce the Navigator, a vision model that navigates through WSIs like a domain expert: it searches for the region of interest at a low scale, zooms in gradually, and localizes ever finer microanatomical classes. As a result, the Navigator can detect coarse-grained patterns at lower resolution and fine-grained features at higher resolution. In addition, to deal with sparsely annotated samples, we train the Navigator with a novel semi-supervised framework called S5CL v2. The proposed model improves the F1 score by up to 8% on various datasets including our challenging new TCGA-COAD-30CLS and Erlangen cohorts.
Collapse
|
4
|
Loth AG, Wild PJ. [Individualization and standardization in head and neck pathology]. HNO 2025:10.1007/s00106-025-01627-y. [PMID: 40237827 DOI: 10.1007/s00106-025-01627-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/24/2025] [Indexed: 04/18/2025]
Abstract
Individualization and standardization are seemingly contradictory requirements in medicine. In the treatment of head and neck cancer, both terms have a direct influence on diagnostic procedures, which are usually carried out in pathology institutes. The current article examines the conflicting requirements arising from various technical analyses, regulatory requirements, structural changes due to digitalization, and the advent of personalized medicine. On the one hand, the goal is to promote interdisciplinary exchange by understanding the challenges and, on the other, to provide the otorhinolaryngologist with a practical understanding of the common and current pathological diagnostic tests. Using pathology as an example, it can be shown that standardization of procedures ultimately serves to improve individualized treatment. At the same time, however, the following challenges are also apparent: despite comprehensive regulations and a laboratory environment with digital support, standardization is very time consuming and costly. If similar standardization approaches are to be implemented in an operative environment such as, e.g., ENT surgery, the effort involved can be expected to be equivalent or higher due to the human factor.
Collapse
Affiliation(s)
- Andreas G Loth
- Universitätsklinikum Frankfurt, Klinik für Hals‑, Nasen- und Ohrenheilkunde, Goethe-Universität Frankfurt, Theodor-Stern-Kai 7, 60450, Frankfurt am Main, Deutschland.
| | - Peter J Wild
- Universitätsklinikum Frankfurt, Dr. Senckenbergisches Institut für Pathologie und Humangenetik, Goethe-Universität Frankfurt, Frankfurt am Main, Deutschland
| |
Collapse
|
5
|
Ke X, Yang M, Chen J, Hong R, Wang Z, Wang S, Zhang H, Lu J, Pan B, Gao Y, Liu X, Li X, Zhang Y, Su S, Wu H, Liang Z. Labor-Efficient Pathological Auxiliary Diagnostic Model for Primary and Metastatic Tumor Tissue Detection in Pancreatic Ductal Adenocarcinoma. Mod Pathol 2025; 38:100764. [PMID: 40199428 DOI: 10.1016/j.modpat.2025.100764] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2024] [Revised: 03/09/2025] [Accepted: 03/20/2025] [Indexed: 04/10/2025]
Abstract
Accurate histopathological evaluation of pancreatic ductal adenocarcinoma (PDAC), including primary tumor lesions and lymph node metastases, is critical for prognostic evaluation and personalized therapeutic strategies. Distinct from other solid tumors, PDAC presents unique diagnostic challenges owing to its extensive desmoplasia, unclear tumor boundary, and difficulty in differentiating from chronic pancreatitis. These characteristics not only complicate pathological diagnosis but also hinder the acquisition of pixel-level annotations required for training computational pathology models. In this study, we present PANseg, a multiscale weakly supervised deep learning framework for PDAC segmentation, trained and tested on 368 whole-slide images (WSIs) from 208 patients across 2 independent centers. Using only image-level labels (2048 × 2048 pixels), PANseg achieved comparable performance with fully supervised baseline (FSB) across the internal test set 1 (17 patients/58 WSIs; PANseg area under the receiver operating characteristic curve [AUROC]: 0.969 vs FSB AUROC: 0.968), internal test set 2 (40 patients/44 WSIs; PANseg AUROC: 0.991 vs FSB AUROC: 0.980), and external test set (20 patients/20 WSIs; PANseg AUROC: 0.950 vs FSB AUROC: 0.958). Moreover, the model demonstrated considerable generalizability with previously unseen sample types, attaining AUROCs of 0.878 on fresh-frozen specimens (20 patients/20 WSIs) and 0.821 on biopsy sections (20 patients/20 WSIs). In lymph node metastasis detection, PANseg augmented the diagnostic accuracy of 6 pathologists from 0.888 to 0.961, while reducing the average diagnostic time by 32.6% (72.0 vs 48.5 minutes). This study demonstrates that our weakly supervised model can achieve expert-level segmentation performance and substantially reduce annotation burden. The clinical implementation of PANseg holds great potential in enhancing diagnostic precision and workflow efficiency in the routine histopathological assessment of PDAC.
Collapse
Affiliation(s)
- Xinyi Ke
- Department of Pathology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Moxuan Yang
- Thorough Lab, Thorough Future, Beijing, China; Department of Physics, Capital Normal University, Beijing, China
| | - Jingci Chen
- Department of Pathology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Ruping Hong
- Department of Pathology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Zheng Wang
- Department of Pathology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Shuhao Wang
- Thorough Lab, Thorough Future, Beijing, China
| | - Hui Zhang
- Department of Pathology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Junliang Lu
- Department of Pathology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Boju Pan
- Department of Pathology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Yike Gao
- Department of Pathology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Xiaoding Liu
- Department of Pathology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Xiaoyu Li
- Department of Pathology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Yang Zhang
- Department of Pathology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Si Su
- Department of Pathology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Huanwen Wu
- Department of Pathology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China.
| | - Zhiyong Liang
- Department of Pathology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China.
| |
Collapse
|
6
|
Du X, Hao S, Olsson H, Kartasalo K, Mulliqi N, Rai B, Menges D, Heintz E, Egevad L, Eklund M, Clements M. Effectiveness and Cost-effectiveness of Artificial Intelligence-assisted Pathology for Prostate Cancer Diagnosis in Sweden: A Microsimulation Study. Eur Urol Oncol 2025; 8:80-86. [PMID: 38789385 DOI: 10.1016/j.euo.2024.05.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2024] [Revised: 04/23/2024] [Accepted: 05/13/2024] [Indexed: 05/26/2024]
Abstract
BACKGROUND AND OBJECTIVE Image-based artificial intelligence (AI) methods have shown high accuracy in prostate cancer (PCa) detection. Their impact on patient outcomes and cost effectiveness in comparison to human pathologists remains unknown. Our aim was to evaluate the effectiveness and cost-effectiveness of AI-assisted pathology for PCa diagnosis in Sweden. METHODS We modeled quadrennial prostate-specific antigen (PSA) screening for men between the ages of 50 and 74 yr over a lifetime horizon using a health care perspective. Men with PSA ≥3 ng/ml were referred for standard biopsy (SBx), for which cores were either examined via AI followed by a pathologist for AI-labeled positive cores, or a pathologist alone. The AI performance characteristics were estimated using an internal STHLM3 validation data set. Outcome measures included the number of tests, PCa incidence and mortality, overdiagnosis, quality-adjusted life years (QALYs), and the potential reduction in pathologist-evaluated biopsy cores if AI were used. Cost-effectiveness was assessed using the incremental cost-effectiveness ratio. KEY FINDINGS AND LIMITATIONS In comparison to a pathologist alone, the AI-assisted workflow increased the number of PSA tests, SBx procedures, and PCa deaths by ≤0.03%, and slightly reduced PCa incidence and overdiagnosis. AI would reduce the proportion of biopsy cores evaluated by a pathologist by 80%. At a cost of €10 per case, the AI-assisted workflow would cost less and result in <0.001% lower QALYs in comparison to a pathologist alone. The results were sensitive to the AI cost. CONCLUSIONS AND CLINICAL IMPLICATIONS According to our model, AI-assisted pathology would significantly decrease the workload of pathologists, would not affect patient quality of life, and would yield cost savings in Sweden when compared to a human pathologist alone. PATIENT SUMMARY We compared outcomes for prostate cancer patients and relevant costs for two methods of assessing prostate biopsies in Sweden: (1) artificial intelligence (AI) technology and review of positive biopsies by a human pathologist; and (2) a human pathologist alone for all biopsies. We found that addition of AI would reduce the pathology workload and save money, and would not affect patient outcomes when compared to a human pathologist alone. The results suggest that adding AI to prostate pathology in Sweden would save costs.
Collapse
Affiliation(s)
- Xiaoyang Du
- Department of Medical Epidemiology and Biostatistics, Karolinska Institutet, Stockholm, Sweden.
| | - Shuang Hao
- Department of Medical Epidemiology and Biostatistics, Karolinska Institutet, Stockholm, Sweden
| | - Henrik Olsson
- Department of Medical Epidemiology and Biostatistics, Karolinska Institutet, Stockholm, Sweden
| | - Kimmo Kartasalo
- Department of Medical Epidemiology and Biostatistics, Karolinska Institutet, Stockholm, Sweden
| | - Nita Mulliqi
- Department of Medical Epidemiology and Biostatistics, Karolinska Institutet, Stockholm, Sweden
| | - Balram Rai
- Department of Medical Epidemiology and Biostatistics, Karolinska Institutet, Stockholm, Sweden
| | - Dominik Menges
- Epidemiology, Biostatistics and Prevention Institute, University of Zurich, Zurich, Switzerland
| | - Emelie Heintz
- Department of Learning, Informatics, Management and Ethics, Karolinska Institutet, Stockholm, Sweden; Centre for Health Economics, Informatics and Health Services Research, Stockholm Health Care Services, Stockholm, Sweden
| | - Lars Egevad
- Department of Oncology and Pathology, Karolinska Institutet, Stockholm, Sweden
| | - Martin Eklund
- Department of Medical Epidemiology and Biostatistics, Karolinska Institutet, Stockholm, Sweden
| | - Mark Clements
- Department of Medical Epidemiology and Biostatistics, Karolinska Institutet, Stockholm, Sweden
| |
Collapse
|
7
|
Li L, Geng Y, Chen T, Lin K, Xie C, Qi J, Wei H, Wang J, Wang D, Yuan Z, Wan Z, Li T, Luo Y, Niu D, Li J, Yu H. Deep learning model targeting cancer surrounding tissues for accurate cancer diagnosis based on histopathological images. J Transl Med 2025; 23:110. [PMID: 39849586 PMCID: PMC11755804 DOI: 10.1186/s12967-024-06017-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2024] [Accepted: 12/18/2024] [Indexed: 01/25/2025] Open
Abstract
Accurate and fast histological diagnosis of cancers is crucial for successful treatment. The deep learning-based approaches have assisted pathologists in efficient cancer diagnosis. The remodeled microenvironment and field cancerization may enable the cancer-specific features in the image of non-cancer regions surrounding cancer, which may provide additional information not available in the cancer region to improve cancer diagnosis. Here, we proposed a deep learning framework with fine-tuning target proportion towards cancer surrounding tissues in histological images for gastric cancer diagnosis. Through employing six deep learning-based models targeting region-of-interest (ROI) with different proportions of no-cancer and cancer regions, we uncovered the diagnostic value of non-cancer ROI, and the model performance for cancer diagnosis depended on the proportion. Then, we constructed a model based on MobileNetV2 with the optimized weights targeting non-cancer and cancer ROI to diagnose gastric cancer (DeepNCCNet). In the external validation, the optimized DeepNCCNet demonstrated excellent generalization abilities with an accuracy of 93.96%. In conclusion, we discovered a non-cancer ROI weight-dependent model performance, indicating the diagnostic value of non-cancer regions with potential remodeled microenvironment and field cancerization, which provides a promising image resource for cancer diagnosis. The DeepNCCNet could be readily applied to clinical diagnosis for gastric cancer, which is useful for some clinical settings such as the absence or minimum amount of tumor tissues in the insufficient biopsy.
Collapse
Affiliation(s)
- Lanlan Li
- Fujian Key Lab for Intelligent Processing and Wireless Transmission of Media Information, College of Physics and Information Engineering, Fuzhou University, Fuzhou, 350108, China
| | - Yi Geng
- Fujian Key Lab for Intelligent Processing and Wireless Transmission of Media Information, College of Physics and Information Engineering, Fuzhou University, Fuzhou, 350108, China
| | - Tao Chen
- Fujian Key Lab for Intelligent Processing and Wireless Transmission of Media Information, College of Physics and Information Engineering, Fuzhou University, Fuzhou, 350108, China
| | - Kaixin Lin
- Department of General Surgery (Colorectal Surgery), The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, Guangdong, China
- Guangdong Institute of Gastroenterology, Guangzhou, 510655, Guangdong, China
- Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, 510655, Guangdong, China
- Biomedical Innovation Center, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, 510655, Guangdong, China
- Key Laboratory of Human Microbiome and Chronic Diseases (Sun Yat-sen University), Ministry of Education, Guangzhou, China
| | - Chengjie Xie
- Fujian Key Lab for Intelligent Processing and Wireless Transmission of Media Information, College of Physics and Information Engineering, Fuzhou University, Fuzhou, 350108, China
| | - Jing Qi
- Fujian Key Lab for Intelligent Processing and Wireless Transmission of Media Information, College of Physics and Information Engineering, Fuzhou University, Fuzhou, 350108, China
| | - Hongan Wei
- Fujian Key Lab for Intelligent Processing and Wireless Transmission of Media Information, College of Physics and Information Engineering, Fuzhou University, Fuzhou, 350108, China
| | - Jianping Wang
- Department of Gastroenterology, Third People's Hospital, Fujian University of Traditional Chinese Medicine, Fuzhou, 350108, Fujian, China
| | - Dabiao Wang
- College of Chemical and Engineering, Fuzhou University, Fuzhou, 350108, China
| | - Ze Yuan
- Guangdong Institute of Gastroenterology, Guangzhou, 510655, Guangdong, China
- Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, 510655, Guangdong, China
- Biomedical Innovation Center, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, 510655, Guangdong, China
| | - Zixiao Wan
- Guangdong Institute of Gastroenterology, Guangzhou, 510655, Guangdong, China
- Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, 510655, Guangdong, China
- Biomedical Innovation Center, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, 510655, Guangdong, China
| | - Tuoyang Li
- Department of General Surgery (Colorectal Surgery), The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, Guangdong, China
- Guangdong Institute of Gastroenterology, Guangzhou, 510655, Guangdong, China
- Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, 510655, Guangdong, China
- Biomedical Innovation Center, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, 510655, Guangdong, China
| | - Yanxin Luo
- Department of General Surgery (Colorectal Surgery), The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, Guangdong, China
- Guangdong Institute of Gastroenterology, Guangzhou, 510655, Guangdong, China
- Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, 510655, Guangdong, China
- Biomedical Innovation Center, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, 510655, Guangdong, China
- Key Laboratory of Human Microbiome and Chronic Diseases (Sun Yat-sen University), Ministry of Education, Guangzhou, China
| | - Decao Niu
- Department of Urology, Guangdong Second Provincial General Hospital, Guangzhou, 510000, China.
| | - Juan Li
- Department of General Surgery (Colorectal Surgery), The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, Guangdong, China.
- Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, 510655, Guangdong, China.
- Biomedical Innovation Center, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, 510655, Guangdong, China.
- Department of Endoscopic Surgery, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, 510655, Guangdong, China.
| | - Huichuan Yu
- Department of General Surgery (Colorectal Surgery), The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, Guangdong, China.
- Guangdong Institute of Gastroenterology, Guangzhou, 510655, Guangdong, China.
- Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, 510655, Guangdong, China.
- Biomedical Innovation Center, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, 510655, Guangdong, China.
- Key Laboratory of Human Microbiome and Chronic Diseases (Sun Yat-sen University), Ministry of Education, Guangzhou, China.
| |
Collapse
|
8
|
Walsh E, Orsi NM. The current troubled state of the global pathology workforce: a concise review. Diagn Pathol 2024; 19:163. [PMID: 39709433 DOI: 10.1186/s13000-024-01590-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2024] [Accepted: 12/17/2024] [Indexed: 12/23/2024] Open
Abstract
The histopathology workforce is a cornerstone of cancer diagnostics and is essential to the delivery of cancer services and patient care. The workforce has been subject to significant pressures over recent years, and this review considers them in the UK and internationally. These pressures include declining pathologist numbers, the increasing age of the workforce, and greater workload volume and complexity. Forecasts of the workforce's future in numerous countries are also not favourable - although this is not universal. Some in the field suggest that the effects of these pressures are already coming to bear, such as the financial costs of the additional measures needed to maintain clinical services. There is also some evidence of a detrimental impact on service delivery, patient care and pathologists themselves. Various solutions have been considered, including increasing the number of training places, enhancing recruitment, shortening pathology training and establishing additional support roles within pathology departments. A few studies have examined the effect of some of these solutions. However, the broader extent of their implementation and impact, if any, remains to be determined. In this regard, it is critical that future endeavours should focus on gaining a better understanding of the benefits of implemented workforce solutions, as well as obtaining more detailed and updated pathology workforce numbers. With a concentrated effort in these areas, the future of the pathology workforce could become brighter in the face of the increased demands on its services.
Collapse
Affiliation(s)
- Elizabeth Walsh
- Women's Health Research Group, Leeds Institute of Medical Research, St James's University Hospital, University of Leeds, Wellcome Trust Brenner Building, Beckett Street, Leeds, LS9 7TF, UK.
- Department of Histopathology, St James's University Hospital, Leeds Teaching Hospitals NHS Trust, Beckett Street, Leeds, LS9 7TF, UK.
| | - Nicolas M Orsi
- Women's Health Research Group, Leeds Institute of Medical Research, St James's University Hospital, University of Leeds, Wellcome Trust Brenner Building, Beckett Street, Leeds, LS9 7TF, UK
- Department of Histopathology, St James's University Hospital, Leeds Teaching Hospitals NHS Trust, Beckett Street, Leeds, LS9 7TF, UK
| |
Collapse
|
9
|
Zerbe N, Schwen LO, Geißler C, Wiesemann K, Bisson T, Boor P, Carvalho R, Franz M, Jansen C, Kiehl TR, Lindequist B, Pohlan NC, Schmell S, Strohmenger K, Zakrzewski F, Plass M, Takla M, Küster T, Homeyer A, Hufnagl P. Joining forces for pathology diagnostics with AI assistance: The EMPAIA initiative. J Pathol Inform 2024; 15:100387. [PMID: 38984198 PMCID: PMC11231750 DOI: 10.1016/j.jpi.2024.100387] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2024] [Accepted: 05/28/2024] [Indexed: 07/11/2024] Open
Abstract
Over the past decade, artificial intelligence (AI) methods in pathology have advanced substantially. However, integration into routine clinical practice has been slow due to numerous challenges, including technical and regulatory hurdles in translating research results into clinical diagnostic products and the lack of standardized interfaces. The open and vendor-neutral EMPAIA initiative addresses these challenges. Here, we provide an overview of EMPAIA's achievements and lessons learned. EMPAIA integrates various stakeholders of the pathology AI ecosystem, i.e., pathologists, computer scientists, and industry. In close collaboration, we developed technical interoperability standards, recommendations for AI testing and product development, and explainability methods. We implemented the modular and open-source EMPAIA Platform and successfully integrated 14 AI-based image analysis apps from eight different vendors, demonstrating how different apps can use a single standardized interface. We prioritized requirements and evaluated the use of AI in real clinical settings with 14 different pathology laboratories in Europe and Asia. In addition to technical developments, we created a forum for all stakeholders to share information and experiences on digital pathology and AI. Commercial, clinical, and academic stakeholders can now adopt EMPAIA's common open-source interfaces, providing a unique opportunity for large-scale standardization and streamlining of processes. Further efforts are needed to effectively and broadly establish AI assistance in routine laboratory use. To this end, a sustainable infrastructure, the non-profit association EMPAIA International, has been established to continue standardization and support broad implementation and advocacy for an AI-assisted digital pathology future.
Collapse
Affiliation(s)
- Norman Zerbe
- Charité-Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Institute of Pathology, Charitéplatz 1, 10117 Berlin, Germany
| | - Lars Ole Schwen
- Fraunhofer Institute for Digital Medicine MEVIS, Max-von-Laue-Straße 2, 28359 Bremen, Germany
| | - Christian Geißler
- Technische Universität Berlin, DAI-Labor, Ernst-Reuter-Platz 7, 10587 Berlin, Germany
| | | | - Tom Bisson
- Charité-Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Institute of Pathology, Charitéplatz 1, 10117 Berlin, Germany
| | - Peter Boor
- Institute of Pathology, University Hospital RWTH Aachen, Pauwelsstraße 30, 52074 Aachen, Germany
| | - Rita Carvalho
- Charité-Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Institute of Pathology, Charitéplatz 1, 10117 Berlin, Germany
| | - Michael Franz
- Charité-Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Institute of Pathology, Charitéplatz 1, 10117 Berlin, Germany
| | - Christoph Jansen
- Charité-Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Institute of Pathology, Charitéplatz 1, 10117 Berlin, Germany
| | - Tim-Rasmus Kiehl
- Charité-Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Institute of Pathology, Charitéplatz 1, 10117 Berlin, Germany
| | - Björn Lindequist
- Charité-Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Institute of Pathology, Charitéplatz 1, 10117 Berlin, Germany
| | - Nora Charlotte Pohlan
- Charité-Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Institute of Pathology, Charitéplatz 1, 10117 Berlin, Germany
| | - Sarah Schmell
- Institute of Pathology, Carl Gustav Carus University Hospital Dresden (UKD), TU Dresden (TUD), Fetscherstraße 74, 01307 Dresden, Germany
| | - Klaus Strohmenger
- Charité-Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Institute of Pathology, Charitéplatz 1, 10117 Berlin, Germany
| | - Falk Zakrzewski
- Institute of Pathology, Carl Gustav Carus University Hospital Dresden (UKD), TU Dresden (TUD), Fetscherstraße 74, 01307 Dresden, Germany
| | - Markus Plass
- Medical University of Graz, Diagnostic and Research Center for Molecular BioMedicine, Diagnostic & Research Institute of Pathology, Neue Stiftingtalstrasse 6, 8010 Graz, Austria
| | - Michael Takla
- Vitasystems GmbH, Gottlieb-Daimler-Straße 8, 68165 Mannheim, Germany
| | - Tobias Küster
- Technische Universität Berlin, DAI-Labor, Ernst-Reuter-Platz 7, 10587 Berlin, Germany
| | - André Homeyer
- Fraunhofer Institute for Digital Medicine MEVIS, Max-von-Laue-Straße 2, 28359 Bremen, Germany
| | - Peter Hufnagl
- Charité-Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Institute of Pathology, Charitéplatz 1, 10117 Berlin, Germany
| |
Collapse
|
10
|
Kurowski K, Timme S, Föll MC, Backhaus C, Holzner PA, Bengsch B, Schilling O, Werner M, Bronsert P. AI-Assisted High-Throughput Tissue Microarray Workflow. Methods Protoc 2024; 7:96. [PMID: 39728616 DOI: 10.3390/mps7060096] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2024] [Revised: 11/14/2024] [Accepted: 11/20/2024] [Indexed: 12/28/2024] Open
Abstract
Immunohistochemical (IHC) studies of formalin-fixed paraffin-embedded (FFPE) samples are a gold standard in oncology for tumor characterization, and the identification of prognostic and predictive markers. However, despite the abundance of archived FFPE samples, their research use is limited due to the labor-intensive nature of IHC on large cohorts. This study aimed to create a high-throughput workflow using modern technologies to facilitate IHC biomarker studies on large patient groups. Semiautomatic constructed tissue microarrays (TMAs) were created for two tumor patient cohorts and IHC stained for seven antibodies (ABs). AB expression in the tumor and surrounding stroma was quantified using the AI-supported image analysis software QuPath. The data were correlated with clinicopathological information using an R-script, all results were automatically compiled into formatted reports. By minimizing labor time to 7.7%-compared to whole-slide studies-the established workflow significantly reduced human and material resource consumption. It successfully correlated AB expression with overall patient survival and additional clinicopathological data, providing publication-ready figures and tables. The AI-assisted high-throughput TMA workflow, validated on two patient cohorts, streamlines modern histopathological research by offering cost and time efficiency compared to traditional whole-slide studies. It maintains research quality and preserves patient tissue while significantly reducing material and human resources, making it ideal for high-throughput research centers and collaborations.
Collapse
Affiliation(s)
- Konrad Kurowski
- Institute for Surgical Pathology, Medical Center, Faculty of Medicine, University of Freiburg, 79106 Freiburg, Germany
- Core Facility Histopathology and Digital Pathology Freiburg, Medical Center, University of Freiburg, 79106 Freiburg, Germany
- Tumorbank Comprehensive Cancer Center Freiburg, Medical Center, University of Freiburg, 79106 Freiburg, Germany
| | - Sylvia Timme
- Institute for Surgical Pathology, Medical Center, Faculty of Medicine, University of Freiburg, 79106 Freiburg, Germany
| | - Melanie Christine Föll
- Institute for Surgical Pathology, Medical Center, Faculty of Medicine, University of Freiburg, 79106 Freiburg, Germany
| | - Clara Backhaus
- Department of Obstetrics & Gynecology Medical Center, University of Freiburg, 79106 Freiburg, Germany
| | - Philipp Anton Holzner
- Department of General and Visceral Surgery, Medical Center, Faculty of Medicine, University of Freiburg, 79106 Freiburg, Germany
| | - Bertram Bengsch
- Clinic for Internal Medicine II, Gastroenterology, Hepatology, Endocrinology, and Infectious Disease, Medical Center, University of Freiburg, 79106 Freiburg, Germany
| | - Oliver Schilling
- Institute for Surgical Pathology, Medical Center, Faculty of Medicine, University of Freiburg, 79106 Freiburg, Germany
| | - Martin Werner
- Institute for Surgical Pathology, Medical Center, Faculty of Medicine, University of Freiburg, 79106 Freiburg, Germany
- Core Facility Histopathology and Digital Pathology Freiburg, Medical Center, University of Freiburg, 79106 Freiburg, Germany
- Tumorbank Comprehensive Cancer Center Freiburg, Medical Center, University of Freiburg, 79106 Freiburg, Germany
| | - Peter Bronsert
- Institute for Surgical Pathology, Medical Center, Faculty of Medicine, University of Freiburg, 79106 Freiburg, Germany
- Core Facility Histopathology and Digital Pathology Freiburg, Medical Center, University of Freiburg, 79106 Freiburg, Germany
- Tumorbank Comprehensive Cancer Center Freiburg, Medical Center, University of Freiburg, 79106 Freiburg, Germany
| |
Collapse
|
11
|
Orzan RI, Santa D, Lorenzovici N, Zareczky TA, Pojoga C, Agoston R, Dulf EH, Seicean A. Deep Learning in Endoscopic Ultrasound: A Breakthrough in Detecting Distal Cholangiocarcinoma. Cancers (Basel) 2024; 16:3792. [PMID: 39594747 PMCID: PMC11593152 DOI: 10.3390/cancers16223792] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2024] [Revised: 10/30/2024] [Accepted: 11/08/2024] [Indexed: 11/28/2024] Open
Abstract
INTRODUCTION Cholangiocarcinoma (CCA) is a highly lethal malignancy originating in the bile ducts, often diagnosed late with poor prognosis. Differentiating benign from malignant biliary tumors remains challenging, necessitating advanced diagnostic techniques. OBJECTIVE This study aims to enhance the diagnostic accuracy of endoscopic ultrasound (EUS) for distal cholangiocarcinoma (dCCA) using advanced convolutional neural networks (CCNs) for the classification and segmentation of EUS images, specifically targeting dCCAs, the pancreas, and the bile duct. MATERIALS AND METHODS In this retrospective study, EUS images from patients diagnosed with dCCA via biopsy and an EUS-identified bile duct tumor were evaluated. A custom CNN was developed for classification, trained on 156 EUS images. To enhance the model's robustness, image augmentation techniques were applied, generating a total of 1248 images. For tumor and organ segmentation, the DeepLabv3+ network with ResNet50 architecture was utilized, employing Tversky loss to manage unbalanced classes. Performance evaluation included metrics such as accuracy, sensitivity, specificity, and Intersection over Union (IoU). These methods were implemented in collaboration with the ADAPTED Research Group at the Technical University of Cluj-Napoca. RESULTS The classification model achieved a high accuracy of 97.82%, with precision and specificity both at 100% and sensitivity at 94.44%. The segmentation models for the pancreas and bile duct demonstrated global accuracies of 84% and 90%, respectively, with robust IoU scores indicating good overlap between predicted and actual contours. The application performed better than the UNet model, particularly in generalization and boundary delineation. CONCLUSIONS This study demonstrates the significant potential of AI in EUS imaging for dCCA, presenting a robust tool that enhances diagnostic accuracy and efficiency. The developed MATLAB application serves as a valuable aid for medical professionals, facilitating informed decision-making and improving patient outcomes in the diagnosis of cholangiocarcinoma and related pathologies.
Collapse
Affiliation(s)
- Rares Ilie Orzan
- 3rd Department of Internal Medicine, Iuliu Hațieganu University of Medicine and Pharmacy, Victor Babeș Str., No. 8, 400012 Cluj-Napoca, Romania
- Regional Institute of Gastroenterology and Hepatology, Croitorilor Str., No. 19-21, 400162 Cluj-Napoca, Romania;
| | - Delia Santa
- Automation Department, Faculty of Automation and Computer Science, Technical University of Cluj-Napoca, G. Baritiu Str., No. 26-28, 400027 Cluj-Napoca, Romania (N.L.)
| | - Noemi Lorenzovici
- Automation Department, Faculty of Automation and Computer Science, Technical University of Cluj-Napoca, G. Baritiu Str., No. 26-28, 400027 Cluj-Napoca, Romania (N.L.)
| | - Thomas Andrei Zareczky
- Automation Department, Faculty of Automation and Computer Science, Technical University of Cluj-Napoca, G. Baritiu Str., No. 26-28, 400027 Cluj-Napoca, Romania (N.L.)
| | - Cristina Pojoga
- Regional Institute of Gastroenterology and Hepatology, Croitorilor Str., No. 19-21, 400162 Cluj-Napoca, Romania;
- Department of Clinical Psychology and Psychotherapy, Babeș-Bolyai University, Sindicatelor Str., No. 7, 400029 Cluj-Napoca, Romania
| | - Renata Agoston
- Faculty of Medicine, Iuliu Hațieganu University of Medicine and Pharmacy, Victor Babes Str., No. 8, 400012 Cluj-Napoca, Romania
| | - Eva-Henrietta Dulf
- Automation Department, Faculty of Automation and Computer Science, Technical University of Cluj-Napoca, G. Baritiu Str., No. 26-28, 400027 Cluj-Napoca, Romania (N.L.)
| | - Andrada Seicean
- 3rd Department of Internal Medicine, Iuliu Hațieganu University of Medicine and Pharmacy, Victor Babeș Str., No. 8, 400012 Cluj-Napoca, Romania
- Regional Institute of Gastroenterology and Hepatology, Croitorilor Str., No. 19-21, 400162 Cluj-Napoca, Romania;
| |
Collapse
|
12
|
Luwei W, Huimin M. From jobs to careers: drivers and barriers to career development in emerging labor markets. FRONTIERS IN SOCIOLOGY 2024; 9:1486871. [PMID: 39569066 PMCID: PMC11576451 DOI: 10.3389/fsoc.2024.1486871] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/27/2024] [Accepted: 10/23/2024] [Indexed: 11/22/2024]
Abstract
Introduction This study aims to reveal the intrinsic and extrinsic drivers of career development in emerging labor markets and to explore the impact of these drivers and barriers on career development. With the rapid transformation of global industrial structure, career development in emerging industries such as artificial intelligence, big data, new energy and e-commerce is gradually attracting attention. Methods This study utilizes a mixed research method of questionnaires and in-depth interviews. The research team distributed a total of 700 questionnaires to practitioners in China, the United States, Japan, Germany and India, and collected interview data from 20 industry practitioners. These data were analyzed from both quantitative and qualitative perspectives to analyze the drivers and barriers to career development, and structural equation modeling was used to analyze the relationship between career motivation, barriers, social networks, and career satisfaction. Results The results indicate that career development motivation significantly and positively influences career satisfaction, while individuals with high career satisfaction perceive fewer career barriers. In addition, career barriers significantly influenced individuals' perceptions of career discrimination. The study also found that social networks play an important supportive role in career development, and that extensive social networks increase career satisfaction. Individuals with high motivation were more resilient in the face of external barriers and were willing to retrain to improve their occupational skills. Discussion To promote career development in emerging industries, labor market policies should optimize and create fair and inclusive work environments for emerging industries. By eliminating gender, age, and racial discrimination and providing employee support programs, career development satisfaction and opportunities can be effectively enhanced. Conclusion Rapid technological updates, high work pressure, and cross-cultural barriers in emerging industries are the main challenges to career development today. This study suggests that governments and enterprises should jointly provide flexible vocational training and support policies to help practitioners adapt to the rapidly changing occupational environment.
Collapse
Affiliation(s)
- Wang Luwei
- School of Accounting, Sichuan Technology and Business University, Meishan, China
| | - Ma Huimin
- School of Accounting, Sichuan Technology and Business University, Meishan, China
| |
Collapse
|
13
|
He T, Shi S, Liu Y, Zhu L, Wei Y, Zhang F, Shi H, He Y, Han A. Pathology diagnosis of intraoperative frozen thyroid lesions assisted by deep learning. BMC Cancer 2024; 24:1069. [PMID: 39210289 PMCID: PMC11363383 DOI: 10.1186/s12885-024-12849-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2024] [Accepted: 08/26/2024] [Indexed: 09/04/2024] Open
Abstract
BACKGROUND Thyroid cancer is a common thyroid malignancy. The majority of thyroid lesion needs intraoperative frozen pathology diagnosis, which provides important information for precision operation. As digital whole slide images (WSIs) develop, deep learning methods for histopathological classification of the thyroid gland (paraffin sections) have achieved outstanding results. Our current study is to clarify whether deep learning assists pathology diagnosis for intraoperative frozen thyroid lesions or not. METHODS We propose an artificial intelligence-assisted diagnostic system for frozen thyroid lesions that applies prior knowledge in tandem with a dichotomous judgment of whether the lesion is cancerous or not and a quadratic judgment of the type of cancerous lesion to categorize the frozen thyroid lesions into five categories: papillary thyroid carcinoma, medullary thyroid carcinoma, anaplastic thyroid carcinoma, follicular thyroid tumor, and non-cancerous lesion. We obtained 4409 frozen digital pathology sections (WSI) of thyroid from the First Affiliated Hospital of Sun Yat-sen University (SYSUFH) to train and test the model, and the performance was validated by a six-fold cross validation, 101 papillary microcarcinoma sections of thyroid were used to validate the system's sensitivity, and 1388 WSIs of thyroid were used for the evaluation of the external dataset. The deep learning models were compared in terms of several metrics such as accuracy, F1 score, recall, precision and AUC (Area Under Curve). RESULTS We developed the first deep learning-based frozen thyroid diagnostic classifier for histopathological WSI classification of papillary carcinoma, medullary carcinoma, follicular tumor, anaplastic carcinoma, and non-carcinoma lesion. On test slides, the system had an accuracy of 0.9459, a precision of 0.9475, and an AUC of 0.9955. In the papillary carcinoma test slides, the system was able to accurately predict even lesions as small as 2 mm in diameter. Tested with the acceleration component, the cut processing can be performed in 346.12 s and the visual inference prediction results can be obtained in 98.61 s, thus meeting the time requirements for intraoperative diagnosis. Our study employs a deep learning approach for high-precision classification of intraoperative frozen thyroid lesion distribution in the clinical setting, which has potential clinical implications for assisting pathologists and precision surgery of thyroid lesions.
Collapse
MESH Headings
- Humans
- Deep Learning
- Thyroid Neoplasms/pathology
- Thyroid Neoplasms/diagnosis
- Thyroid Neoplasms/surgery
- Frozen Sections
- Thyroid Cancer, Papillary/pathology
- Thyroid Cancer, Papillary/diagnosis
- Thyroid Cancer, Papillary/surgery
- Carcinoma, Papillary/pathology
- Carcinoma, Papillary/surgery
- Carcinoma, Papillary/diagnosis
- Adenocarcinoma, Follicular/pathology
- Adenocarcinoma, Follicular/diagnosis
- Adenocarcinoma, Follicular/surgery
- Thyroid Gland/pathology
- Thyroid Gland/surgery
- Carcinoma, Neuroendocrine/pathology
- Carcinoma, Neuroendocrine/diagnosis
- Carcinoma, Neuroendocrine/surgery
- Female
- Male
- Middle Aged
- Adult
- Intraoperative Period
- Thyroid Carcinoma, Anaplastic/pathology
- Thyroid Carcinoma, Anaplastic/diagnosis
- Thyroid Carcinoma, Anaplastic/surgery
Collapse
Affiliation(s)
- Tingting He
- Institute of Biopharmaceutical and Health Engineering, Tsinghua Shenzhen International Graduate School, Shenzhen, Guangdong, China
| | - Shanshan Shi
- Institute of Biopharmaceutical and Health Engineering, Tsinghua Shenzhen International Graduate School, Shenzhen, Guangdong, China
| | - Yiqing Liu
- Institute of Biopharmaceutical and Health Engineering, Tsinghua Shenzhen International Graduate School, Shenzhen, Guangdong, China
| | - Lianghui Zhu
- Institute of Biopharmaceutical and Health Engineering, Tsinghua Shenzhen International Graduate School, Shenzhen, Guangdong, China
| | - Yani Wei
- Department of Pathology, the First Affiliated Hospital of Sun Yat-sen University, Guangzhou, Guangdong, China
| | - Fenfen Zhang
- Department of Pathology, the First Affiliated Hospital of Sun Yat-sen University, Guangzhou, Guangdong, China
| | - Huijuan Shi
- Department of Pathology, the First Affiliated Hospital of Sun Yat-sen University, Guangzhou, Guangdong, China.
| | - Yonghong He
- Institute of Biopharmaceutical and Health Engineering, Tsinghua Shenzhen International Graduate School, Shenzhen, Guangdong, China.
| | - Anjia Han
- Department of Pathology, the First Affiliated Hospital of Sun Yat-sen University, Guangzhou, Guangdong, China.
| |
Collapse
|
14
|
Youssef A, Rosenwald A, Rosenfeldt MT. TelePi: an affordable telepathology microscope camera system anyone can build and use. Virchows Arch 2024; 485:115-122. [PMID: 37935902 PMCID: PMC11271423 DOI: 10.1007/s00428-023-03685-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2023] [Revised: 10/20/2023] [Accepted: 10/24/2023] [Indexed: 11/09/2023]
Abstract
Telepathology facilitates histological diagnoses through sharing expertise between pathologists. However, the associated costs are high and frequently prohibitive, especially in low-resource settings, where telepathology would paradoxically be of paramount importance due to a paucity of pathologists.We have constructed a telepathology system (TelePi) with a budget of < €120 using the small, single-board computer Raspberry Pi Zero and its High-Quality Camera Module in conjunction with a standard microscope and open-source software. The system requires no maintenance costs or service contracts, has a small footprint, can be moved and shared across several microscopes, and is independent from other computer operating systems. TelePi uses a responsive and high-resolution web-based live stream which allows remote consultation between two or more locations. TelePi can serve as a telepathology system for remote diagnostics of frozen sections. Additionally, it can be used as a standard microscope camera for teaching of medical students and for basic research. The quality of the TelePi system compared favorable to a commercially available telepathology system that exceed its cost by more than 125-fold. Additionally, still images are of publication quality equal to that of a whole slide scanner that costs 800 times more.In summary, TelePi is an affordable, versatile, and inexpensive camera system that potentially enables telepathology in low-resource settings without sacrificing image quality.
Collapse
Affiliation(s)
- Almoatazbellah Youssef
- Institute of Pathology and Comprehensive Cancer Centre Mainfranken, Julius Maximilian University of Würzburg, Josef-Schneider-Str. 2, 97080, Würzburg, Germany.
| | - Andreas Rosenwald
- Institute of Pathology and Comprehensive Cancer Centre Mainfranken, Julius Maximilian University of Würzburg, Josef-Schneider-Str. 2, 97080, Würzburg, Germany
| | - Mathias Tillmann Rosenfeldt
- Institute of Pathology and Comprehensive Cancer Centre Mainfranken, Julius Maximilian University of Würzburg, Josef-Schneider-Str. 2, 97080, Würzburg, Germany
| |
Collapse
|
15
|
Schmidt-Barbo P, Kalweit G, Naouar M, Paschold L, Willscher E, Schultheiß C, Märkl B, Dirnhofer S, Tzankov A, Binder M, Kalweit M. Detection of disease-specific signatures in B cell repertoires of lymphomas using machine learning. PLoS Comput Biol 2024; 20:e1011570. [PMID: 38954728 PMCID: PMC11249212 DOI: 10.1371/journal.pcbi.1011570] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2023] [Revised: 07/15/2024] [Accepted: 06/07/2024] [Indexed: 07/04/2024] Open
Abstract
The classification of B cell lymphomas-mainly based on light microscopy evaluation by a pathologist-requires many years of training. Since the B cell receptor (BCR) of the lymphoma clonotype and the microenvironmental immune architecture are important features discriminating different lymphoma subsets, we asked whether BCR repertoire next-generation sequencing (NGS) of lymphoma-infiltrated tissues in conjunction with machine learning algorithms could have diagnostic utility in the subclassification of these cancers. We trained a random forest and a linear classifier via logistic regression based on patterns of clonal distribution, VDJ gene usage and physico-chemical properties of the top-n most frequently represented clonotypes in the BCR repertoires of 620 paradigmatic lymphoma samples-nodular lymphocyte predominant B cell lymphoma (NLPBL), diffuse large B cell lymphoma (DLBCL) and chronic lymphocytic leukemia (CLL)-alongside with 291 control samples. With regard to DLBCL and CLL, the models demonstrated optimal performance when utilizing only the most prevalent clonotype for classification, while in NLPBL-that has a dominant background of non-malignant bystander cells-a broader array of clonotypes enhanced model accuracy. Surprisingly, the straightforward logistic regression model performed best in this seemingly complex classification problem, suggesting linear separability in our chosen dimensions. It achieved a weighted F1-score of 0.84 on a test cohort including 125 samples from all three lymphoma entities and 58 samples from healthy individuals. Together, we provide proof-of-concept that at least the 3 studied lymphoma entities can be differentiated from each other using BCR repertoire NGS on lymphoma-infiltrated tissues by a trained machine learning model.
Collapse
MESH Headings
- Humans
- Machine Learning
- Receptors, Antigen, B-Cell/genetics
- High-Throughput Nucleotide Sequencing/methods
- Leukemia, Lymphocytic, Chronic, B-Cell/genetics
- Leukemia, Lymphocytic, Chronic, B-Cell/immunology
- Computational Biology/methods
- Lymphoma, B-Cell/genetics
- B-Lymphocytes/metabolism
- B-Lymphocytes/immunology
- Lymphoma, Large B-Cell, Diffuse/genetics
- Lymphoma, Large B-Cell, Diffuse/pathology
- Lymphoma, Large B-Cell, Diffuse/classification
- Algorithms
Collapse
Affiliation(s)
- Paul Schmidt-Barbo
- Department of Biomedicine, Translational Immuno-Oncology, University Hospital Basel, Basel, Switzerland
- Collaborative Research Institute Intelligent Oncology (CRIION), Freiburg, Germany
| | - Gabriel Kalweit
- Collaborative Research Institute Intelligent Oncology (CRIION), Freiburg, Germany
- Neurorobotics Lab, University of Freiburg, Freiburg, Germany
| | - Mehdi Naouar
- Collaborative Research Institute Intelligent Oncology (CRIION), Freiburg, Germany
- Neurorobotics Lab, University of Freiburg, Freiburg, Germany
| | - Lisa Paschold
- Internal Medicine IV, Oncology/Hematology, Martin-Luther-University Halle-Wittenberg, Halle (Saale), Germany
| | - Edith Willscher
- Internal Medicine IV, Oncology/Hematology, Martin-Luther-University Halle-Wittenberg, Halle (Saale), Germany
| | - Christoph Schultheiß
- Department of Biomedicine, Translational Immuno-Oncology, University Hospital Basel, Basel, Switzerland
| | - Bruno Märkl
- Pathology, University Hospital Augsburg, Augsburg, Germany
| | | | | | - Mascha Binder
- Department of Biomedicine, Translational Immuno-Oncology, University Hospital Basel, Basel, Switzerland
- Collaborative Research Institute Intelligent Oncology (CRIION), Freiburg, Germany
- Medical Oncology, University Hospital Basel, Basel, Switzerland
| | - Maria Kalweit
- Collaborative Research Institute Intelligent Oncology (CRIION), Freiburg, Germany
- Neurorobotics Lab, University of Freiburg, Freiburg, Germany
| |
Collapse
|
16
|
Bülow RD, Lan YC, Amann K, Boor P. [Artificial intelligence in kidney transplant pathology]. PATHOLOGIE (HEIDELBERG, GERMANY) 2024; 45:277-283. [PMID: 38598097 DOI: 10.1007/s00292-024-01324-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 03/12/2024] [Indexed: 04/11/2024]
Abstract
BACKGROUND Artificial intelligence (AI) systems have showed promising results in digital pathology, including digital nephropathology and specifically also kidney transplant pathology. AIM Summarize the current state of research and limitations in the field of AI in kidney transplant pathology diagnostics and provide a future outlook. MATERIALS AND METHODS Literature search in PubMed and Web of Science using the search terms "deep learning", "transplant", and "kidney". Based on these results and studies cited in the identified literature, a selection was made of studies that have a histopathological focus and use AI to improve kidney transplant diagnostics. RESULTS AND CONCLUSION Many studies have already made important contributions, particularly to the automation of the quantification of some histopathological lesions in nephropathology. This likely can be extended to automatically quantify all relevant lesions for a kidney transplant, such as Banff lesions. Important limitations and challenges exist in the collection of representative data sets and the updates of Banff classification, making large-scale studies challenging. The already positive study results make future AI support in kidney transplant pathology appear likely.
Collapse
Affiliation(s)
- Roman David Bülow
- Institut für Pathologie, Sektion Nephropathologie, Universitätsklinikum RWTH Aachen, Pauwelsstraße 30, 52074, Aachen, Deutschland
| | - Yu-Chia Lan
- Institut für Pathologie, Sektion Nephropathologie, Universitätsklinikum RWTH Aachen, Pauwelsstraße 30, 52074, Aachen, Deutschland
| | - Kerstin Amann
- Abteilung Nephropathologie, Institut für Pathologie, Universitätsklinikum Erlangen, Friedrich-Alexander Universität Erlangen-Nürnberg, Erlangen, Deutschland
| | - Peter Boor
- Institut für Pathologie, Sektion Nephropathologie, Universitätsklinikum RWTH Aachen, Pauwelsstraße 30, 52074, Aachen, Deutschland.
- Medizinische Klinik II, Universitätsklinikum RWTH Aachen, Aachen, Deutschland.
| |
Collapse
|
17
|
Zhang S, Yang B, Yang H, Zhao J, Zhang Y, Gao Y, Monteiro O, Zhang K, Liu B, Wang S. Potential rapid intraoperative cancer diagnosis using dynamic full-field optical coherence tomography and deep learning: A prospective cohort study in breast cancer patients. Sci Bull (Beijing) 2024; 69:1748-1756. [PMID: 38702279 DOI: 10.1016/j.scib.2024.03.061] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2023] [Revised: 03/18/2024] [Accepted: 03/19/2024] [Indexed: 05/06/2024]
Abstract
An intraoperative diagnosis is critical for precise cancer surgery. However, traditional intraoperative assessments based on hematoxylin and eosin (H&E) histology, such as frozen section, are time-, resource-, and labor-intensive, and involve specimen-consuming concerns. Here, we report a near-real-time automated cancer diagnosis workflow for breast cancer that combines dynamic full-field optical coherence tomography (D-FFOCT), a label-free optical imaging method, and deep learning for bedside tumor diagnosis during surgery. To classify the benign and malignant breast tissues, we conducted a prospective cohort trial. In the modeling group (n = 182), D-FFOCT images were captured from April 26 to June 20, 2018, encompassing 48 benign lesions, 114 invasive ductal carcinoma (IDC), 10 invasive lobular carcinoma, 4 ductal carcinoma in situ (DCIS), and 6 rare tumors. Deep learning model was built up and fine-tuned in 10,357 D-FFOCT patches. Subsequently, from June 22 to August 17, 2018, independent tests (n = 42) were conducted on 10 benign lesions, 29 IDC, 1 DCIS, and 2 rare tumors. The model yielded excellent performance, with an accuracy of 97.62%, sensitivity of 96.88% and specificity of 100%; only one IDC was misclassified. Meanwhile, the acquisition of the D-FFOCT images was non-destructive and did not require any tissue preparation or staining procedures. In the simulated intraoperative margin evaluation procedure, the time required for our novel workflow (approximately 3 min) was significantly shorter than that required for traditional procedures (approximately 30 min). These findings indicate that the combination of D-FFOCT and deep learning algorithms can streamline intraoperative cancer diagnosis independently of traditional pathology laboratory procedures.
Collapse
MESH Headings
- Humans
- Breast Neoplasms/diagnostic imaging
- Breast Neoplasms/surgery
- Breast Neoplasms/pathology
- Tomography, Optical Coherence/methods
- Deep Learning
- Female
- Prospective Studies
- Middle Aged
- Carcinoma, Ductal, Breast/diagnostic imaging
- Carcinoma, Ductal, Breast/surgery
- Carcinoma, Ductal, Breast/pathology
- Aged
- Adult
- Carcinoma, Intraductal, Noninfiltrating/diagnostic imaging
- Carcinoma, Intraductal, Noninfiltrating/surgery
- Carcinoma, Intraductal, Noninfiltrating/pathology
- Intraoperative Period
Collapse
Affiliation(s)
- Shuwei Zhang
- Breast Center, Peking University People's Hospital, Beijing 100044, China
| | - Bin Yang
- China ESG Institute, Capital University of Economics and Business, Beijing 100070, China; Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China
| | - Houpu Yang
- Breast Center, Peking University People's Hospital, Beijing 100044, China
| | - Jin Zhao
- Breast Center, Peking University People's Hospital, Beijing 100044, China
| | - Yuanyuan Zhang
- Department of Pathology, Peking University People's Hospital, Beijing 100044, China
| | - Yuanxu Gao
- Center for Biomedicine and Innovations, Faculty of Medicine, Macau University of Science and Technology, Macao 999078, China
| | - Olivia Monteiro
- Center for Biomedicine and Innovations, Faculty of Medicine, Macau University of Science and Technology, Macao 999078, China
| | - Kang Zhang
- Center for Biomedicine and Innovations, Faculty of Medicine, Macau University of Science and Technology, Macao 999078, China; College of Future Technology, Peking University, Beijing 100091, China.
| | - Bo Liu
- School of Mathematical and Computational Sciences, Massey University, Auckland 0745, New Zealand.
| | - Shu Wang
- Breast Center, Peking University People's Hospital, Beijing 100044, China.
| |
Collapse
|
18
|
Reitsam NG, Enke JS, Vu Trung K, Märkl B, Kather JN. Artificial Intelligence in Colorectal Cancer: From Patient Screening over Tailoring Treatment Decisions to Identification of Novel Biomarkers. Digestion 2024; 105:331-344. [PMID: 38865982 PMCID: PMC11457979 DOI: 10.1159/000539678] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/04/2024] [Accepted: 06/04/2024] [Indexed: 06/14/2024]
Abstract
BACKGROUND Artificial intelligence (AI) is increasingly entering and transforming not only medical research but also clinical practice. In the last 10 years, new AI methods have enabled computers to perform visual tasks, reaching high performance and thereby potentially supporting and even outperforming human experts. This is in particular relevant for colorectal cancer (CRC), which is the 3rd most common cancer type in general, as along the CRC patient journey many complex visual tasks need to be performed: from endoscopy over imaging to histopathology; the screening, diagnosis, and treatment of CRC involve visual image analysis tasks. SUMMARY In all these clinical areas, AI models have shown promising results by supporting physicians, improving accuracy, and providing new biological insights and biomarkers. By predicting prognostic and predictive biomarkers from routine images/slides, AI models could lead to an improved patient stratification for precision oncology approaches in the near future. Moreover, it is conceivable that AI models, in particular together with innovative techniques such as single-cell or spatial profiling, could help identify novel clinically as well as biologically meaningful biomarkers that could pave the way to new therapeutic approaches. KEY MESSAGES Here, we give a comprehensive overview of AI in colorectal cancer, describing and discussing these developments as well as the next steps which need to be taken to incorporate AI methods more broadly into the clinical care of CRC.
Collapse
Affiliation(s)
- Nic Gabriel Reitsam
- Pathology, Faculty of Medicine, University of Augsburg, Augsburg, Germany,
- Bavarian Cancer Research Center (BZKF), Augsburg, Germany,
| | - Johanna Sophie Enke
- Nuclear Medicine, Faculty of Medicine, University of Augsburg, Augsburg, Germany
| | - Kien Vu Trung
- Division of Gastroenterology, Medical Department II, University of Leipzig Medical Center, Leipzig, Germany
| | - Bruno Märkl
- Pathology, Faculty of Medicine, University of Augsburg, Augsburg, Germany
- Bavarian Cancer Research Center (BZKF), Augsburg, Germany
| | - Jakob Nikolas Kather
- Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany
- Pathology and Data Analytics, Leeds Institute of Medical Research at St James's, University of Leeds, Leeds, UK
- Department of Medicine I, University Hospital Dresden, Dresden, Germany
- Medical Oncology, National Center for Tumor Diseases (NCT), University Hospital Heidelberg, Heidelberg, Germany
| |
Collapse
|
19
|
Schukow CP, Allen TC. Remote Pathology Practice: The Time for Remote Diagnostic Pathology in This Digital Era is Now. Arch Pathol Lab Med 2024; 148:508-514. [PMID: 38133942 DOI: 10.5858/arpa.2023-0385-ed] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/04/2023] [Indexed: 12/24/2023]
Affiliation(s)
- Casey P Schukow
- From the Department of Pathology, Corewell Health's Beaumont Hospital, Royal Oak, Michigan
| | - Timothy Craig Allen
- From the Department of Pathology, Corewell Health's Beaumont Hospital, Royal Oak, Michigan
| |
Collapse
|
20
|
McCoy CA, Coleman HG, McShane CM, McCluggage WG, Wylie J, Quinn D, McMenamin ÚC. Factors associated with interobserver variation amongst pathologists in the diagnosis of endometrial hyperplasia: A systematic review. PLoS One 2024; 19:e0302252. [PMID: 38683770 PMCID: PMC11057740 DOI: 10.1371/journal.pone.0302252] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Accepted: 03/30/2024] [Indexed: 05/02/2024] Open
Abstract
OBJECTIVE Reproducible diagnoses of endometrial hyperplasia (EH) remains challenging and has potential implications for patient management. This systematic review aimed to identify pathologist-specific factors associated with interobserver variation in the diagnosis and reporting of EH. METHODS Three electronic databases, namely MEDLINE, Embase and Web of Science, were searched from 1st January 2000 to 25th March 2023, using relevant key words and subject headings. Eligible studies reported on pathologist-specific factors or working practices influencing interobserver variation in the diagnosis of EH, using either the World Health Organisation (WHO) 2014 or 2020 classification or the endometrioid intraepithelial neoplasia (EIN) classification system. Quality assessment was undertaken using the QUADAS-2 tool, and findings were narratively synthesised. RESULTS Eight studies were identified. Interobserver variation was shown to be significant even amongst specialist gynaecological pathologists in most studies. Few studies investigated pathologist-specific characteristics, but pathologists were shown to have different diagnostic styles, with some more likely to under-diagnose and others likely to over-diagnose EH. Some novel working practices were identified, such as grading the "degree" of nuclear atypia and the incorporation of objective methods of diagnosis such as semi-automated quantitative image analysis/deep learning models. CONCLUSIONS This review highlighted the impact of pathologist-specific factors and working practices in the accurate diagnosis of EH, although few studies have been conducted. Further research is warranted in the development of more objective criteria that could improve reproducibility in EH diagnostic reporting, as well as determining the applicability of novel methods such as grading the degree of nuclear atypia in clinical settings.
Collapse
Affiliation(s)
- Chloe A. McCoy
- Centre for Public Health, Queen’s University Belfast, Belfast, Northern Ireland, United Kingdom
| | - Helen G. Coleman
- Centre for Public Health, Queen’s University Belfast, Belfast, Northern Ireland, United Kingdom
| | - Charlene M. McShane
- Centre for Public Health, Queen’s University Belfast, Belfast, Northern Ireland, United Kingdom
| | - W. Glenn McCluggage
- Department of Pathology, Belfast Health and Social Care Trust, Belfast, Northern Ireland, United Kingdom
| | - James Wylie
- Department of Obstetrics and Gynaecology, Antrim Area Hospital, Northern Health and Social Care Trust, Antrim, Northern Ireland, United Kingdom
| | - Declan Quinn
- Department of Obstetrics and Gynaecology, Antrim Area Hospital, Northern Health and Social Care Trust, Antrim, Northern Ireland, United Kingdom
| | - Úna C. McMenamin
- Centre for Public Health, Queen’s University Belfast, Belfast, Northern Ireland, United Kingdom
| |
Collapse
|
21
|
Iwuajoku V, Haas A, Ekici K, Khan MZ, Stögbauer F, Steiger K, Mogler C, Schüffler PJ. [Digital transformation of a routine histopathology lab : Dos and don'ts!]. PATHOLOGIE (HEIDELBERG, GERMANY) 2024; 45:98-105. [PMID: 38189845 PMCID: PMC10902067 DOI: 10.1007/s00292-023-01291-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 11/15/2023] [Indexed: 01/09/2024]
Abstract
The implementation of digital histopathology in the laboratory marks a crucial milestone in the overall digital transformation of pathology. This shift offers a range of new possibilities, including access to extensive datasets for AI-assisted analyses, the flexibility of remote work and home office arrangements for specialists, and the expedited and simplified sharing of images and data for research, conferences, and tumor boards. However, the transition to a fully digital workflow involves significant technological and personnel-related efforts. It necessitates careful and adaptable change management to minimize disruptions, particularly in the personnel domain, and to prevent the loss of valuable potential from employees who may be resistant to change. This article consolidates our institute's experiences, highlighting technical and personnel-related challenges encountered during the transition to digital pathology. It also presents a comprehensive overview of potential difficulties at various interfaces when converting routine operations to a digital workflow.
Collapse
Affiliation(s)
- Viola Iwuajoku
- Institut für Pathologie, TUM School of Medicine and Health, Technische Universität München, Trogerstraße 18, 81675, München, Deutschland
| | - Anette Haas
- Institut für Pathologie, TUM School of Medicine and Health, Technische Universität München, Trogerstraße 18, 81675, München, Deutschland
| | - Kübra Ekici
- Institut für Pathologie, TUM School of Medicine and Health, Technische Universität München, Trogerstraße 18, 81675, München, Deutschland
| | - Mohammad Zaid Khan
- Institut für Pathologie, TUM School of Medicine and Health, Technische Universität München, Trogerstraße 18, 81675, München, Deutschland
| | - Fabian Stögbauer
- Institut für Pathologie, TUM School of Medicine and Health, Technische Universität München, Trogerstraße 18, 81675, München, Deutschland
| | - Katja Steiger
- Institut für Pathologie, TUM School of Medicine and Health, Technische Universität München, Trogerstraße 18, 81675, München, Deutschland
| | - Carolin Mogler
- Institut für Pathologie, TUM School of Medicine and Health, Technische Universität München, Trogerstraße 18, 81675, München, Deutschland
| | - Peter J Schüffler
- Institut für Pathologie, TUM School of Medicine and Health, Technische Universität München, Trogerstraße 18, 81675, München, Deutschland.
- TUM School of Computational Information and Technology, Technische Universität München, München, Deutschland.
| |
Collapse
|
22
|
Schwaibold L, Mattern S, Mählmann M, Lobert L, Breunig T, Schürch CM. [Effects of upstream laboratory processes on the digitization of histological slides]. PATHOLOGIE (HEIDELBERG, GERMANY) 2024; 45:90-97. [PMID: 38386056 PMCID: PMC10901962 DOI: 10.1007/s00292-024-01303-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 01/10/2024] [Indexed: 02/23/2024]
Abstract
BACKGROUND Several factors in glass slide (GS) preparation affect the quality and data volume of a digitized histological slide. In particular, reducing contamination and selecting the appropriate coverslip have the potential to significantly reduce scan time and data volume. GOALS To objectify observations from our institute's digitization process to determine the impact of laboratory processes on the quality of digital histology slides. MATERIALS AND METHODS Experiment 1: Scanning the GS before and after installation of a central console in the microtomy area to reduce dirt and statistical analysis of the determined parameters. Experiment 2: Re-coverslipping the GS (post diagnostics) with glass and film. Scanning the GS and statistical analysis of the collected parameters. CONCLUSION The targeted restructuring in the laboratory process leads to a reduction of GS contamination. This causes a significant reduction in the amount of data generated and scanning time required for the digitized sections. Film as a coverslip material minimizes processing errors in contrast to glass. According to our estimation, all the above-mentioned points lead to considerable cost savings.
Collapse
Affiliation(s)
- Leander Schwaibold
- Institut für Pathologie, Universitätsklinikum Tübingen, Liebermeisterstr. 8, 72076, Tübingen, Deutschland
| | - Sven Mattern
- Institut für Pathologie, Universitätsklinikum Tübingen, Liebermeisterstr. 8, 72076, Tübingen, Deutschland
| | - Markus Mählmann
- Institut für Pathologie, Universitätsklinikum Tübingen, Liebermeisterstr. 8, 72076, Tübingen, Deutschland
| | - Leon Lobert
- Institut für Pathologie, Universitätsklinikum Tübingen, Liebermeisterstr. 8, 72076, Tübingen, Deutschland
| | - Thomas Breunig
- Institut für Pathologie, Universitätsklinikum Tübingen, Liebermeisterstr. 8, 72076, Tübingen, Deutschland
| | - Christian M Schürch
- Institut für Pathologie, Universitätsklinikum Tübingen, Liebermeisterstr. 8, 72076, Tübingen, Deutschland.
| |
Collapse
|
23
|
Wegscheider AS, Gorniak J, Rollinson S, Gough L, Dhaliwal N, Guardiola A, Gasior A, Helmer D, Pounce Z, Niendorf A. Comprehensive and Accurate Molecular Profiling of Breast Cancer through mRNA Expression of ESR1, PGR, ERBB2, MKI67, and a Novel Proliferation Signature. Diagnostics (Basel) 2024; 14:241. [PMID: 38337757 PMCID: PMC10855423 DOI: 10.3390/diagnostics14030241] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2023] [Revised: 01/13/2024] [Accepted: 01/19/2024] [Indexed: 02/12/2024] Open
Abstract
BACKGROUND An accurate status determination of breast cancer biomarkers (ER, PR, HER2, Ki67) is crucial for guiding patient management. The "gold standard" for assessing these biomarkers in FFPE tissue is IHC, which faces challenges in standardization and exhibits substantial variability. In this study, we compare the concordance of a new commercial RT-qPCR kit with IHC in determining BC biomarker status. METHODS The performance was evaluated using 634 FFPE specimens, which underwent histological analysis in accordance with standard of care methods. HER2 2+ tumors were referred to ISH testing. An immunoreactive score of ≥2/12 was considered positive for ER/PR and 20% staining was used as a cut-off for Ki67 high/low score. RT-qPCR and results calling were performed according to the manufacturer's instructions. RESULTS High concordance with IHC was seen for all markers (93.2% for ER, 87.1% for PR, 93.9% for HER2, 77.9% for Ki67 and 80.1% for proliferative signature (assessed against Ki67 IHC)). CONCLUSIONS By assessing the concordance with the results obtained through IHC, we sought to demonstrate the reliability and utility of the kit for precise BC subtyping. Our findings suggest that the kit provides a highly precise and accurate quantitative assessment of BC biomarkers.
Collapse
Affiliation(s)
- Anne-Sophie Wegscheider
- MVZ Prof. Dr. Med. A. Niendorf Pathologie Hamburg-West GmbH, Institute for Histology, Cytology and Molecular Diagnostics, Lornsenstr. 4, 22767 Hamburg, Germany (D.H.)
| | - Joanna Gorniak
- APIS Assay Technologies Ltd., Second Floor, Citylabs 1.0, Nelson Street, Manchester M13 9NQ, UK
| | - Sara Rollinson
- APIS Assay Technologies Ltd., Second Floor, Citylabs 1.0, Nelson Street, Manchester M13 9NQ, UK
| | - Leanne Gough
- APIS Assay Technologies Ltd., Second Floor, Citylabs 1.0, Nelson Street, Manchester M13 9NQ, UK
| | - Navdeep Dhaliwal
- APIS Assay Technologies Ltd., Second Floor, Citylabs 1.0, Nelson Street, Manchester M13 9NQ, UK
| | - Agustin Guardiola
- APIS Assay Technologies Ltd., Second Floor, Citylabs 1.0, Nelson Street, Manchester M13 9NQ, UK
| | - Anna Gasior
- APIS Assay Technologies Ltd., Second Floor, Citylabs 1.0, Nelson Street, Manchester M13 9NQ, UK
| | - Denise Helmer
- MVZ Prof. Dr. Med. A. Niendorf Pathologie Hamburg-West GmbH, Institute for Histology, Cytology and Molecular Diagnostics, Lornsenstr. 4, 22767 Hamburg, Germany (D.H.)
| | - Zoe Pounce
- APIS Assay Technologies Ltd., Second Floor, Citylabs 1.0, Nelson Street, Manchester M13 9NQ, UK
| | - Axel Niendorf
- MVZ Prof. Dr. Med. A. Niendorf Pathologie Hamburg-West GmbH, Institute for Histology, Cytology and Molecular Diagnostics, Lornsenstr. 4, 22767 Hamburg, Germany (D.H.)
| |
Collapse
|
24
|
Vafaei Sadr A, Bülow R, von Stillfried S, Schmitz NEJ, Pilva P, Hölscher DL, Ha PP, Schweiker M, Boor P. Operational greenhouse-gas emissions of deep learning in digital pathology: a modelling study. Lancet Digit Health 2024; 6:e58-e69. [PMID: 37996339 PMCID: PMC10728828 DOI: 10.1016/s2589-7500(23)00219-4] [Citation(s) in RCA: 13] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2023] [Revised: 10/04/2023] [Accepted: 10/16/2023] [Indexed: 11/25/2023]
Abstract
BACKGROUND Deep learning is a promising way to improve health care. Image-processing medical disciplines, such as pathology, are expected to be transformed by deep learning. The first clinically applicable deep-learning diagnostic support tools are already available in cancer pathology, and their number is increasing. However, data on the environmental sustainability of these tools are scarce. We aimed to conduct an environmental-sustainability analysis of a theoretical implementation of deep learning in patient-care pathology. METHODS For this modelling study, we first assembled and calculated relevant data and parameters of a digital-pathology workflow. Data were breast and prostate specimens from the university clinic at the Institute of Pathology of the Rheinisch-Westfälische Technische Hochschule Aachen (Aachen, Germany), for which commercially available deep learning was already available. Only specimens collected between Jan 1 and Dec 31, 2019 were used, to omit potential biases due to the COVID-19 pandemic. Our final selection was based on 2 representative weeks outside holidays, covering different types of specimens. To calculate carbon dioxide (CO2) or CO2 equivalent (CO2 eq) emissions of deep learning in pathology, we gathered relevant data for exact numbers and sizes of whole-slide images (WSIs), which were generated by scanning histopathology samples of prostate and breast specimens. We also evaluated different data input scenarios (including all slide tiles, only tiles containing tissue, or only tiles containing regions of interest). To convert estimated energy consumption from kWh to CO2 eq, we used the internet protocol address of the computational server and the Electricity Maps database to obtain information on the sources of the local electricity grid (ie, renewable vs non-renewable), and estimated the number of trees and proportion of the local and world's forests needed to sequester the CO2 eq emissions. We calculated the computational requirements and CO2 eq emissions of 30 deep-learning models that varied in task and size. The first scenario represented the use of one commercially available deep-learning model for one task in one case (1-task), the second scenario considered two deep-learning models for two tasks per case (2-task), the third scenario represented a future, potentially automated workflow that could handle 7 tasks per case (7-task), and the fourth scenario represented the use of a single potential, large, computer-vision model that could conduct multiple tasks (multitask). We also compared the performance (ie, accuracy) and CO2 eq emissions of different deep-learning models for the classification of renal cell carcinoma on WSIs, also from Rheinisch-Westfälische Technische Hochschule Aachen. We also tested other approaches to reducing CO2 eq emissions, including model pruning and an alternative method for histopathology analysis (pathomics). FINDINGS The pathology database contained 35 552 specimens (237 179 slides), 6420 of which were prostate specimens (10 115 slides) and 11 801 of which were breast specimens (19 763 slides). We selected and subsequently digitised 140 slides from eight breast-cancer cases and 223 slides from five prostate-cancer cases. Applying large deep-learning models on all WSI tiles of prostate and breast pathology cases would result in yearly CO2 eq emissions of 7·65 metric tons (t; 95% CI 7·62-7·68) with the use of a single deep-learning model per case; yearly CO2 eq emissions were up to 100·56 t (100·21-100·99) with the use of seven deep-learning models per case. CO2 eq emissions for different deep-learning model scenarios, data inputs, and deep-learning model sizes for all slides varied from 3·61 t (3·59-3·63) to 2795·30 t (1177·51-6482·13. For the estimated number of overall pathology cases worldwide, the yearly CO2 eq emissions varied, reaching up to 16 megatons (Mt) of CO2 eq, requiring up to 86 590 km2 (0·22%) of world forest to sequester the CO2 eq emissions. Use of the 7-task scenario and small deep-learning models on slides containing tissue only could substantially reduce CO2 eq emissions worldwide by up to 141 times (0·1 Mt, 95% CI 0·1-0·1). Considering the local environment in Aachen, Germany, the maximum CO2 eq emission from the use of deep learning in digital pathology only would require 32·8% (95% CI 13·8-76·6) of the local forest to sequester the CO2 eq emissions. A single pathomics run on a tissue could provide information that was comparable to or even better than the output of multitask deep-learning models, but with 147 times reduced CO2 eq emissions. INTERPRETATION Our findings suggest that widespread use of deep learning in pathology might have considerable global-warming potential. The medical community, policy decision makers, and the public should be aware of this potential and encourage the use of CO2 eq emissions reduction strategies where possible. FUNDING German Research Foundation, European Research Council, German Federal Ministry of Education and Research, Health, Economic Affairs and Climate Action, and the Innovation Fund of the Federal Joint Committee.
Collapse
Affiliation(s)
- Alireza Vafaei Sadr
- Institute of Pathology, University Hospital Aachen, Rheinisch-Westfälische Technische Hochschule Aachen, Aachen, Germany; Department of Public Health Sciences, College of Medicine, Pennsylvania State University, Hershey, PA, USA
| | - Roman Bülow
- Institute of Pathology, University Hospital Aachen, Rheinisch-Westfälische Technische Hochschule Aachen, Aachen, Germany
| | - Saskia von Stillfried
- Institute of Pathology, University Hospital Aachen, Rheinisch-Westfälische Technische Hochschule Aachen, Aachen, Germany
| | - Nikolas E J Schmitz
- Institute of Pathology, University Hospital Aachen, Rheinisch-Westfälische Technische Hochschule Aachen, Aachen, Germany
| | - Pourya Pilva
- Institute of Pathology, University Hospital Aachen, Rheinisch-Westfälische Technische Hochschule Aachen, Aachen, Germany
| | - David L Hölscher
- Institute of Pathology, University Hospital Aachen, Rheinisch-Westfälische Technische Hochschule Aachen, Aachen, Germany
| | - Peiman Pilehchi Ha
- Healthy Living Spaces Lab, Institute for Occupational, Social and Environmental Medicine, Medical Faculty, Rheinisch-Westfälische Technische Hochschule Aachen, Aachen, Germany
| | - Marcel Schweiker
- Healthy Living Spaces Lab, Institute for Occupational, Social and Environmental Medicine, Medical Faculty, Rheinisch-Westfälische Technische Hochschule Aachen, Aachen, Germany
| | - Peter Boor
- Institute of Pathology, University Hospital Aachen, Rheinisch-Westfälische Technische Hochschule Aachen, Aachen, Germany; Department of Nephrology and Immunology, Rheinisch-Westfälische Technische Hochschule Aachen, Aachen, Germany.
| |
Collapse
|
25
|
Jensen CL, Thomsen LK, Zeuthen M, Johnsen S, El Jashi R, Nielsen MFB, Hemstra LE, Smith J. Biomedical laboratory scientists and technicians in digital pathology - Is there a need for professional development? Digit Health 2024; 10:20552076241237392. [PMID: 38495864 PMCID: PMC10943708 DOI: 10.1177/20552076241237392] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/19/2024] [Indexed: 03/19/2024] Open
Abstract
Objective Digital pathology (DP) is moving into Danish pathology departments at high pace. Conventionally, biomedical laboratory scientists (BLS) and technicians have prepared tissue sections for light microscopy, but workflow alterations are required for the new digital era with whole slide imaging (WSI); digitally assisted image analysis (DAIA) and artificial intelligence (AI). We aim to explore the role of BLS in DP and assess a potential need for professional development. Methods We investigated the roles of BLS in the new digital era through qualitative interviews at Danish Pathology Departments in 2019/2020 before DP implementation (supported by a questionnaire); and in 2022 after DP implementation. Additionally, senior lecturers from three Danish University Colleges reported on how DP was integrated into the 2023 bachelor's degree educational curricula for BLS students. Results At some Danish pathology departments, BLS were involved in the implementation process of DP and their greatest concerns were lack of physical laboratory requirements (69%) and implementation strategies (63%). BLS were generally positive towards working with DP, however, some expressed concern about extended working hours for scanning. Work-task transfers from pathologists were generally greeted positively from both management and pathologists; however, at follow-up interviews after DP implementation, job transfers had not been effectuated. At Danish university colleges, DP had been integrated systematically in the curricula for BLS students, especially WSI. Conclusion Involving BLS in DP implementation and development may benefit the process, as BLS have a hands-on workflow perspective with a focus on quality assurance. Several new work opportunities for BLS may occur with DP including WSI, DAIA and AI, and therefore new qualifications are warranted, which must be considered in future undergraduate programmes for BLS students or postgraduate programmes for BLS.
Collapse
Affiliation(s)
- Charlotte Lerbech Jensen
- Center for Engineering and Science, Biomedical Laboratory Science, University College Absalon, Næstved, Denmark
| | - Lisbeth Koch Thomsen
- Center for Engineering and Science, Biomedical Laboratory Science, University College Absalon, Næstved, Denmark
| | - Mette Zeuthen
- Department of Technology, Faculty of Health, University College Copenhagen, Copenhagen, Denmark
| | - Sys Johnsen
- Department of Technology, Faculty of Health, University College Copenhagen, Copenhagen, Denmark
| | - Rima El Jashi
- Department of Biomedical Laboratory Science, Physiotherapy and Radiography, Biomedical Laboratory Science, UCL University College, Odense, Denmark
| | - Michael Friberg Bruun Nielsen
- Department of Biomedical Laboratory Science, Physiotherapy and Radiography, Biomedical Laboratory Science, UCL University College, Odense, Denmark
| | - Line E Hemstra
- Center for Engineering and Science, Biomedical Laboratory Science, University College Absalon, Næstved, Denmark
| | - Julie Smith
- Department of Technology, Faculty of Health, University College Copenhagen, Copenhagen, Denmark
| |
Collapse
|
26
|
McKenzie CA, Gupta R, Jackett L, Anderson L, Chen V, Dahlstrom JE, Dray M, Farshid G, Hemmings C, Karim R, Kench JG, Klebe S, Kramer N, Kumarasinghe P, Maclean F, Morey A, Nguyen MA, O'Toole S, Rowbotham B, Salisbury ELC, Scolyer RA, Stewart K, Waring L, Cooper CL, Cooper WA. Looking beyond workforce parity: addressing gender inequity in pathology. Pathology 2023; 55:760-771. [PMID: 37573162 DOI: 10.1016/j.pathol.2023.07.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2023] [Revised: 07/17/2023] [Accepted: 07/18/2023] [Indexed: 08/14/2023]
Abstract
While women pathologists have made up over one-third of pathologists in the Australian workforce for over 15 years and at least 50% since 2019, they are under-represented in senior leadership roles, scientific publications, grant recipients, editorial boards, key presentations, and professional awards. This is not unique to pathology and is seen in the broader medical and academic community. Barriers to gender equity and equality in pathology, medicine and academia include gender stereotypes, gender-based discrimination, structural and organisational barriers as well as broader social and cultural barriers. A diverse leadership reflective of the whole professional body and the broader community is important for optimal health outcomes. It is the responsibility and moral duty of individuals and organisations to address any gender disparities, inequities, and inequalities by monitoring, identifying, and acting on gender biases and systemic barriers that hinder appropriate levels of representation by women.
Collapse
Affiliation(s)
- Catriona A McKenzie
- Department of Tissue Pathology and Diagnostic Oncology, NSW Health Pathology, Royal Prince Alfred Hospital, Sydney, NSW, Australia; Sydney Medical School, University of Sydney, Sydney, NSW, Australia.
| | - Ruta Gupta
- Department of Tissue Pathology and Diagnostic Oncology, NSW Health Pathology, Royal Prince Alfred Hospital, Sydney, NSW, Australia; Sydney Medical School, University of Sydney, Sydney, NSW, Australia
| | | | - Lyndal Anderson
- Department of Tissue Pathology and Diagnostic Oncology, NSW Health Pathology, Royal Prince Alfred Hospital, Sydney, NSW, Australia; Sydney Medical School, University of Sydney, Sydney, NSW, Australia
| | - Vivien Chen
- Sydney Medical School, University of Sydney, Sydney, NSW, Australia; Department of Haematology Concord Repatriation and General Hospital, Sydney, NSW, Australia
| | - Jane E Dahlstrom
- ACT Pathology Canberra Health Services, Canberra, ACT, Australia; Australian National University, Canberra, ACT, Australia
| | | | - Gelareh Farshid
- SA Pathology, Adelaide, SA, Australia; University of Adelaide, Adelaide, SA, Australia
| | - Chris Hemmings
- Department of Anatomic Pathology Canterbury Health Laboratories, Christchurch, New Zealand; Department of Pathology and Biomedical Science University of Otago, Christchurch, New Zealand
| | - Rooshdiya Karim
- Department of Tissue Pathology and Diagnostic Oncology, NSW Health Pathology, Royal Prince Alfred Hospital, Sydney, NSW, Australia; Sydney Medical School, University of Sydney, Sydney, NSW, Australia
| | - James G Kench
- Department of Tissue Pathology and Diagnostic Oncology, NSW Health Pathology, Royal Prince Alfred Hospital, Sydney, NSW, Australia; Sydney Medical School, University of Sydney, Sydney, NSW, Australia
| | - Sonja Klebe
- SA Pathology, Adelaide, SA, Australia; Flinders University, Adelaide, SA, Australia
| | | | | | - Fiona Maclean
- Douglass Hanly Moir Pathology Sonic Healthcare, Sydney, NSW, Australia; Macquarie University, Sydney, NSW, Australia
| | - Adrienne Morey
- ACT Pathology Canberra Health Services, Canberra, ACT, Australia; Australian National University, Canberra, ACT, Australia
| | - Minh Anh Nguyen
- Department of Tissue Pathology and Diagnostic Oncology, NSW Health Pathology, Royal Prince Alfred Hospital, Sydney, NSW, Australia
| | - Sandra O'Toole
- Department of Tissue Pathology and Diagnostic Oncology, NSW Health Pathology, Royal Prince Alfred Hospital, Sydney, NSW, Australia; Sydney Medical School, University of Sydney, Sydney, NSW, Australia; School of Medicine, University of Western Sydney, Sydney, NSW, Australia
| | - Beverley Rowbotham
- Sullivan Nicolaides Pathology, Brisbane, Qld, Australia; The University of Queensland, Brisbane, Qld, Australia
| | - Elizabeth L C Salisbury
- Sydney Medical School, University of Sydney, Sydney, NSW, Australia; School of Medicine, University of Western Sydney, Sydney, NSW, Australia; ICPMR Westmead Hospital, NSW Health Pathology, Westmead, NSW, Australia
| | - Richard A Scolyer
- Department of Tissue Pathology and Diagnostic Oncology, NSW Health Pathology, Royal Prince Alfred Hospital, Sydney, NSW, Australia; Sydney Medical School, University of Sydney, Sydney, NSW, Australia; Melanoma Institute Australia, Sydney, NSW, Australia; Faculty of Medicine and Health, The University of Sydney, Sydney, NSW, Australia; Charles Perkins Centre, The University of Sydney, Sydney, NSW, Australia
| | | | | | - Caroline L Cooper
- The University of Queensland, Brisbane, Qld, Australia; Pathology Queensland, Princess Alexandra Hospital, Brisbane, Qld, Australia
| | - Wendy A Cooper
- Department of Tissue Pathology and Diagnostic Oncology, NSW Health Pathology, Royal Prince Alfred Hospital, Sydney, NSW, Australia; Sydney Medical School, University of Sydney, Sydney, NSW, Australia; School of Medicine, University of Western Sydney, Sydney, NSW, Australia
| |
Collapse
|
27
|
Kriegsmann M, Kriegsmann K, Steinbuss G, Zgorzelski C, Albrecht T, Heinrich S, Farkas S, Roth W, Dang H, Hausen A, Gaida MM. Implementation of deep learning in liver pathology optimizes diagnosis of benign lesions and adenocarcinoma metastasis. Clin Transl Med 2023; 13:e1299. [PMID: 37415390 PMCID: PMC10326372 DOI: 10.1002/ctm2.1299] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2023] [Accepted: 05/28/2023] [Indexed: 07/08/2023] Open
Abstract
INTRODUCTION Differentiation of histologically similar structures in the liver, including anatomical structures, benign bile duct lesions, or common types of liver metastases, can be challenging with conventional histological tissue sections alone. Accurate histopathological classification is paramount for the diagnosis and adequate treatment of the disease. Deep learning algorithms have been proposed for objective and consistent assessment of digital histopathological images. MATERIALS AND METHODS In the present study, we trained and evaluated deep learning algorithms based on the EfficientNetV2 and ResNetRS architectures to discriminate between different histopathological classes. For the required dataset, specialized surgical pathologists annotated seven different histological classes, including different non-neoplastic anatomical structures, benign bile duct lesions, and liver metastases from colorectal and pancreatic adenocarcinoma in a large patient cohort. Annotation resulted in a total of 204.159 image patches, followed by discrimination analysis using our deep learning models. Model performance was evaluated on validation and test data using confusion matrices. RESULTS Evaluation of the test set based on tiles and cases revealed overall highly satisfactory prediction capability of our algorithm for the different histological classes, resulting in a tile accuracy of 89% (38 413/43 059) and case accuracy of 94% (198/211). Importantly, the separation of metastasis versus benign lesions was certainly confident on case level, confirming the classification model performed with high diagnostic accuracy. Moreover, the whole curated raw data set is made publically available. CONCLUSIONS Deep learning is a promising approach in surgical liver pathology supporting decision making in personalized medicine.
Collapse
Affiliation(s)
- Mark Kriegsmann
- Institute of PathologyHeidelberg UniversityHeidelbergGermany
- Pathology WiesbadenWiesbadenGermany
| | - Katharina Kriegsmann
- Department of HematologyOncology and RheumatologyHeidelberg UniversityHeidelbergGermany
- Laborarztpraxis Rhein‐Main MVZ GbRFrankfurt am MainFrankfurtGermany
| | - Georg Steinbuss
- Department of HematologyOncology and RheumatologyHeidelberg UniversityHeidelbergGermany
| | | | - Thomas Albrecht
- Institute of PathologyHeidelberg UniversityHeidelbergGermany
| | - Stefan Heinrich
- Department of SurgeryJGU‐MainzUniversity Medical Center MainzMainzGermany
| | - Stefan Farkas
- Department of SurgerySt. Josefs‐ HospitalWiesbadenGermany
| | - Wilfried Roth
- Institute of PathologyJGU‐MainzUniversity Medical Center MainzMainzGermany
| | - Hien Dang
- Department of SurgeryDepartment of Surgical ResearchThomas Jefferson UniversityPhiladelphiaPennsylvaniaUSA
| | - Anne Hausen
- Institute of PathologyJGU‐MainzUniversity Medical Center MainzMainzGermany
| | - Matthias M. Gaida
- Institute of PathologyJGU‐MainzUniversity Medical Center MainzMainzGermany
- TRONJGU‐MainzTranslational Oncology at the University Medical CenterMainzGermany
- Research Center for ImmunotherapyJGU‐MainzUniversity Medical Center MainzMainzGermany
| |
Collapse
|
28
|
Ahmed AA, Brychcy A, Abouzid M, Witt M, Kaczmarek E. Perception of Pathologists in Poland of Artificial Intelligence and Machine Learning in Medical Diagnosis-A Cross-Sectional Study. J Pers Med 2023; 13:962. [PMID: 37373951 DOI: 10.3390/jpm13060962] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2023] [Revised: 05/31/2023] [Accepted: 06/04/2023] [Indexed: 06/29/2023] Open
Abstract
BACKGROUND In the past vicennium, several artificial intelligence (AI) and machine learning (ML) models have been developed to assist in medical diagnosis, decision making, and design of treatment protocols. The number of active pathologists in Poland is low, prolonging tumor patients' diagnosis and treatment journey. Hence, applying AI and ML may aid in this process. Therefore, our study aims to investigate the knowledge of using AI and ML methods in the clinical field in pathologists in Poland. To our knowledge, no similar study has been conducted. METHODS We conducted a cross-sectional study targeting pathologists in Poland from June to July 2022. The questionnaire included self-reported information on AI or ML knowledge, experience, specialization, personal thoughts, and level of agreement with different aspects of AI and ML in medical diagnosis. Data were analyzed using IBM® SPSS® Statistics v.26, PQStat Software v.1.8.2.238, and RStudio Build 351. RESULTS Overall, 68 pathologists in Poland participated in our study. Their average age and years of experience were 38.92 ± 8.88 and 12.78 ± 9.48 years, respectively. Approximately 42% used AI or ML methods, which showed a significant difference in the knowledge gap between those who never used it (OR = 17.9, 95% CI = 3.57-89.79, p < 0.001). Additionally, users of AI had higher odds of reporting satisfaction with the speed of AI in the medical diagnosis process (OR = 4.66, 95% CI = 1.05-20.78, p = 0.043). Finally, significant differences (p = 0.003) were observed in determining the liability for legal issues used by AI and ML methods. CONCLUSION Most pathologists in this study did not use AI or ML models, highlighting the importance of increasing awareness and educational programs regarding applying AI and ML in medical diagnosis.
Collapse
Affiliation(s)
- Alhassan Ali Ahmed
- Department of Bioinformatics and Computational Biology, Poznan University of Medical Sciences, 61-806 Poznan, Poland
- Doctoral School, Poznan University of Medical Sciences, 61-806 Poznan, Poland
| | - Agnieszka Brychcy
- Department of Clinical Patomorphology, Heliodor Swiecicki Clinical Hospital of the Poznan University of Medical Sciences, 61-806 Poznan, Poland
| | - Mohamed Abouzid
- Doctoral School, Poznan University of Medical Sciences, 61-806 Poznan, Poland
- Department of Physical Pharmacy and Pharmacokinetics, Poznan University of Medical Sciences, 60-806 Poznan, Poland
| | - Martin Witt
- Department of Anatomy, Rostock University Medical Centre, 18057 Rostock, Germany
- Department of Anatomy, Technische Universität Dresden, 01307 Dresden, Germany
| | - Elżbieta Kaczmarek
- Department of Bioinformatics and Computational Biology, Poznan University of Medical Sciences, 61-806 Poznan, Poland
| |
Collapse
|
29
|
D’Abbronzo G, Lucà S, Carraturo E, Franco R, Ronchi A. Shortage of pathologists in Italy: survey of students and residents. Pathologica 2023; 115:172-180. [PMID: 37387442 PMCID: PMC10462991 DOI: 10.32074/1591-951x-852] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2023] [Accepted: 02/13/2023] [Indexed: 07/01/2023] Open
Abstract
Objective In Italy, shortage of pathologists is a problem that affects the quality of the National Health System (NHS). The cause of the shortage of pathologists in Italy must be sought in the lack of interests in the pathologist career by Medical Course Students (MCS) and in drop out of Post-Graduate Medical Schools (PGMS). We investigated reasons of both through two surveys. Methods We developed and proposed on Facebook two surveys, one to MCSs attending last years of study and one to Pathology School Residents (PSRs). Survey for MCSs consisted of 10 questions centered on their perception about pathologist activity; survey for PSRs consisted of 8 questions and investigated the most and least appreciated aspects of Italian PGMS. Results We obtained 500 responses from the MCSs and 51 responses from the PSRs. Our results show that lack of interest of MCS may be due to their incomplete knowledge of the pathologist's activities. On the other hand, PSR answers show that some teaching aspects should be improved. Conclusions Our surveys showed that lack of interest of MCS in the pathology career depends on poor knowledge about the real clinical significance of pathology and PSRs believe that Italian PGMS do not meet their interest. One solution could be a renewal of teaching both in the pathology courses for MCS and in PGMS.
Collapse
Affiliation(s)
| | | | | | - Renato Franco
- Pathology Unit, Department of Mental and Physical Health and Preventive Medicine, University of Campania “Luigi Vanvitelli”, Naples, Italy
| | | |
Collapse
|
30
|
Lan J, Chen M, Wang J, Du M, Wu Z, Zhang H, Xue Y, Wang T, Chen L, Xu C, Han Z, Hu Z, Zhou Y, Zhou X, Tong T, Chen G. Using less annotation workload to establish a pathological auxiliary diagnosis system for gastric cancer. Cell Rep Med 2023; 4:101004. [PMID: 37044091 PMCID: PMC10140598 DOI: 10.1016/j.xcrm.2023.101004] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2022] [Revised: 10/20/2022] [Accepted: 03/17/2023] [Indexed: 04/14/2023]
Abstract
Pathological diagnosis of gastric cancer requires pathologists to have extensive clinical experience. To help pathologists improve diagnostic accuracy and efficiency, we collected 1,514 cases of stomach H&E-stained specimens with complete diagnostic information to establish a pathological auxiliary diagnosis system based on deep learning. At the slide level, our system achieves a specificity of 0.8878 while maintaining a high sensitivity close to 1.0 on 269 biopsy specimens (147 malignancies) and 163 surgical specimens (80 malignancies). The classified accuracy of our system is 0.9034 at the slide level for 352 biopsy specimens (201 malignancies) from 50 medical centers. With the help of our system, the pathologists' average false-negative rate and average false-positive rate on 100 biopsy specimens (50 malignancies) are reduced to 1/5 and 1/2 of the original rates, respectively. At the same time, the average uncertainty rate and the average diagnosis time are reduced by approximately 22% and 20%, respectively.
Collapse
Affiliation(s)
- Junlin Lan
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, Fujian 350108, China; Key Lab of Medical Instrumentation & Pharmaceutical Technology of Fujian Province, Fuzhou University, Fuzhou, Fujian 350108, China
| | - Musheng Chen
- Department of Pathology, Clinical Oncology School of Fujian Medical University, Fujian Cancer Hospital, Fuzhou, Fujian 350014, China; Fujian Key Laboratory of Translational Cancer Medicine, Fuzhou, Fujian 350014, China
| | - Jianchao Wang
- Department of Pathology, Clinical Oncology School of Fujian Medical University, Fujian Cancer Hospital, Fuzhou, Fujian 350014, China; Fujian Key Laboratory of Translational Cancer Medicine, Fuzhou, Fujian 350014, China
| | - Min Du
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, Fujian 350108, China; Key Lab of Medical Instrumentation & Pharmaceutical Technology of Fujian Province, Fuzhou University, Fuzhou, Fujian 350108, China
| | - Zhida Wu
- Department of Pathology, Clinical Oncology School of Fujian Medical University, Fujian Cancer Hospital, Fuzhou, Fujian 350014, China; Fujian Key Laboratory of Translational Cancer Medicine, Fuzhou, Fujian 350014, China
| | - Hejun Zhang
- Department of Pathology, Clinical Oncology School of Fujian Medical University, Fujian Cancer Hospital, Fuzhou, Fujian 350014, China; Fujian Key Laboratory of Translational Cancer Medicine, Fuzhou, Fujian 350014, China
| | - Yuyang Xue
- School of Engineering, University of Edinburgh, Edinburgh EH8 9JU, UK
| | - Tao Wang
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, Fujian 350108, China; Key Lab of Medical Instrumentation & Pharmaceutical Technology of Fujian Province, Fuzhou University, Fuzhou, Fujian 350108, China
| | - Lifan Chen
- Department of Pathology, Clinical Oncology School of Fujian Medical University, Fujian Cancer Hospital, Fuzhou, Fujian 350014, China; Fujian Key Laboratory of Translational Cancer Medicine, Fuzhou, Fujian 350014, China
| | - Chaohui Xu
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, Fujian 350108, China; Key Lab of Medical Instrumentation & Pharmaceutical Technology of Fujian Province, Fuzhou University, Fuzhou, Fujian 350108, China
| | - Zixin Han
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, Fujian 350108, China; Key Lab of Medical Instrumentation & Pharmaceutical Technology of Fujian Province, Fuzhou University, Fuzhou, Fujian 350108, China
| | - Ziwei Hu
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, Fujian 350108, China; Key Lab of Medical Instrumentation & Pharmaceutical Technology of Fujian Province, Fuzhou University, Fuzhou, Fujian 350108, China
| | - Yuanbo Zhou
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, Fujian 350108, China; Key Lab of Medical Instrumentation & Pharmaceutical Technology of Fujian Province, Fuzhou University, Fuzhou, Fujian 350108, China
| | - Xiaogen Zhou
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, Fujian 350108, China; Key Lab of Medical Instrumentation & Pharmaceutical Technology of Fujian Province, Fuzhou University, Fuzhou, Fujian 350108, China
| | - Tong Tong
- College of Physics and Information Engineering, Fuzhou University, Fuzhou, Fujian 350108, China; Key Lab of Medical Instrumentation & Pharmaceutical Technology of Fujian Province, Fuzhou University, Fuzhou, Fujian 350108, China; Imperial Vision Technology, Fuzhou, Fujian 350100, China.
| | - Gang Chen
- Department of Pathology, Clinical Oncology School of Fujian Medical University, Fujian Cancer Hospital, Fuzhou, Fujian 350014, China; Fujian Key Laboratory of Translational Cancer Medicine, Fuzhou, Fujian 350014, China.
| |
Collapse
|
31
|
Schiavinato A. Mapping the current state of the medical specialties in laboratory medicine in Italy. J Clin Pathol 2023; 76:281-284. [PMID: 35840321 DOI: 10.1136/jcp-2022-208431] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2022] [Accepted: 07/04/2022] [Indexed: 11/04/2022]
Abstract
Laboratory medicine is the single highest volume medical activity and it plays an increasingly essential role in the modern healthcare systems. In vitro diagnostic tests are now used in virtually every aspect of the patient care, including disease prevention, diagnosis, disease monitoring as well as personalised medicine. Nevertheless, the profession of laboratory medicine differs between countries in many respects, such as specialist training (medical or scientific), fields of interest, responsibilities and professional organisation. Many attempts have been made to quantify the role of laboratory medicine in patient outcomes, but the precise figures are still not clear. Moreover, the relative contribution of medical specialists in laboratory medicine is not well known and somehow controversial. To start exploring these aspects, we studied the current state of the two medical specialties that make up the majority of laboratory medicine in Italy: clinical pathology and medical microbiology. Our analysis revealed that both specialties suffer from a low attractivity among postgraduate physicians, and suggest that a restructuring of the training programme and professional reorganisation should be considered.
Collapse
Affiliation(s)
- Alvise Schiavinato
- Department of Pediatrics and Adolescent Medicine, University of Cologne, Cologne, Germany
- Department of Laboratory Medicine, University Hospital of Udine, Udine, Italy
| |
Collapse
|
32
|
Huss R, Raffler J, Märkl B. Artificial intelligence and digital biomarker in precision pathology guiding immune therapy selection and precision oncology. Cancer Rep (Hoboken) 2023:e1796. [PMID: 36813293 PMCID: PMC10363837 DOI: 10.1002/cnr2.1796] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2022] [Revised: 01/15/2023] [Accepted: 02/09/2023] [Indexed: 02/24/2023] Open
Abstract
BACKGROUND The currently available immunotherapies already changed the strategy how many cancers are treated from first to last line. Understanding even the most complex heterogeneity in tumor tissue and mapping the spatial cartography of the tumor immunity allows the best and optimized selection of immune modulating agents to (re-)activate the patient's immune system and direct it against the individual cancer in the most effective way. RECENT FINDINGS Primary cancer and metastases maintain a high degree of plasticity to escape any immune surveillance and continue to evolve depending on many intrinsic and extrinsic factors In the field of immune-oncology (IO) immune modulating agents are recognized as practice changing therapeutic modalities. Recent studies have shown that an optimal and lasting efficacy of IO therapeutics depends on the understanding of the spatial communication network and functional context of immune and cancer cells within the tumor microenvironment. Artificial intelligence (AI) provides an insight into the immune-cancer-network through the visualization of very complex tumor and immune interactions in cancer tissue specimens and allows the computer-assisted development and clinical validation of such digital biomarker. CONCLUSIONS The successful implementation of AI-supported digital biomarker solutions guides the clinical selection of effective immune therapeutics based on the retrieval and visualization of spatial and contextual information from cancer tissue images and standardized data. As such, computational pathology (CP) turns into "precision pathology" delivering individual therapy response prediction. Precision Pathology does not only include digital and computational solutions but also high levels of standardized processes in the routine histopathology workflow and the use of mathematical tools to support clinical and diagnostic decisions as the basic principle of a "precision oncology".
Collapse
Affiliation(s)
- Ralf Huss
- Medical Faculty University Augsburg, Augsburg, Germany
- Institute for Digital Medicine, University Hospital Augsburg, Augsburg, Germany
| | - Johannes Raffler
- Institute for Digital Medicine, University Hospital Augsburg, Augsburg, Germany
| | - Bruno Märkl
- Medical Faculty University Augsburg, Augsburg, Germany
| |
Collapse
|
33
|
Tran C, Virine B, Gershon A, Kwan KF, Ettler HC. Characterising the use of surgical pathology rush requests: a descriptive analysis and survey. J Clin Pathol 2023; 76:64-67. [PMID: 35292442 DOI: 10.1136/jclinpath-2022-208170] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2022] [Accepted: 02/24/2022] [Indexed: 12/27/2022]
Abstract
This study aimed to characterise priority or 'rush' surgical pathology requests and identify potentially targetable factors. We performed a retrospective descriptive analysis of rush requests at our institution from 2016 to 2019 and conducted a survey asking pathologists about their perspectives on rush cases. There were 3677 rush cases, with case characteristics generally stable over the study period. Two categories of requests were identified based on hospital status; outpatient requests more frequently provided a specific date for diagnosis, while inpatient rush requests generally required a diagnosis as soon as possible. Most pathologists found rush cases to be somewhat more stressful compared with routine cases (65.2%) and found it very or extremely useful to know when a result is needed (86.9%). The use of hospitalisation status, and identifying if results are required by a certain date, may help in more effective triaging of rush surgical pathology cases.
Collapse
Affiliation(s)
- Christopher Tran
- Department of Pathology and Laboratory Medicine, London Health Sciences Centre, London, Ontario, Canada
| | - Boris Virine
- Department of Pathology and Laboratory Medicine, London Health Sciences Centre, London, Ontario, Canada.,Department of Laboratory Medicine and Pathobiology, University of Toronto, Toronto, Ontario, Canada
| | - Ariel Gershon
- Department of Pathology and Laboratory Medicine, London Health Sciences Centre, London, Ontario, Canada.,Department of Laboratory Medicine and Pathobiology, University of Toronto, Toronto, Ontario, Canada
| | - Keith F Kwan
- Department of Pathology and Laboratory Medicine, London Health Sciences Centre, London, Ontario, Canada
| | - Helen C Ettler
- Department of Pathology and Laboratory Medicine, London Health Sciences Centre, London, Ontario, Canada
| |
Collapse
|
34
|
Validation and real-world clinical application of an artificial intelligence algorithm for breast cancer detection in biopsies. NPJ Breast Cancer 2022; 8:129. [PMID: 36473870 PMCID: PMC9723672 DOI: 10.1038/s41523-022-00496-w] [Citation(s) in RCA: 48] [Impact Index Per Article: 16.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2022] [Accepted: 11/11/2022] [Indexed: 12/12/2022] Open
Abstract
Breast cancer is the most common malignant disease worldwide, with over 2.26 million new cases in 2020. Its diagnosis is determined by a histological review of breast biopsy specimens, which can be labor-intensive, subjective, and error-prone. Artificial Intelligence (AI)-based tools can support cancer detection and classification in breast biopsies ensuring rapid, accurate, and objective diagnosis. We present here the development, external clinical validation, and deployment in routine use of an AI-based quality control solution for breast biopsy review. The underlying AI algorithm is trained to identify 51 different types of clinical and morphological features, and it achieves very high accuracy in a large, multi-site validation study. Specifically, the area under the receiver operating characteristic curves (AUC) for the detection of invasive carcinoma and of ductal carcinoma in situ (DCIS) are 0.99 (specificity and sensitivity of 93.57 and 95.51%, respectively) and 0.98 (specificity and sensitivity of 93.79 and 93.20% respectively), respectively. The AI algorithm differentiates well between subtypes of invasive and different grades of in situ carcinomas with an AUC of 0.97 for invasive ductal carcinoma (IDC) vs. invasive lobular carcinoma (ILC) and AUC of 0.92 for DCIS high grade vs. low grade/atypical ductal hyperplasia, respectively, as well as accurately identifies stromal tumor-infiltrating lymphocytes (TILs) with an AUC of 0.965. Deployment of this AI solution as a real-time quality control solution in clinical routine leads to the identification of cancers initially missed by the reviewing pathologist, demonstrating both clinical utility and accuracy in real-world clinical application.
Collapse
|
35
|
Kriegsmann K, Lobers F, Zgorzelski C, Kriegsmann J, Janßen C, Meliß RR, Muley T, Sack U, Steinbuss G, Kriegsmann M. Deep learning for the detection of anatomical tissue structures and neoplasms of the skin on scanned histopathological tissue sections. Front Oncol 2022; 12:1022967. [PMID: 36483044 PMCID: PMC9723465 DOI: 10.3389/fonc.2022.1022967] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2022] [Accepted: 10/24/2022] [Indexed: 01/25/2023] Open
Abstract
Basal cell carcinoma (BCC), squamous cell carcinoma (SqCC) and melanoma are among the most common cancer types. Correct diagnosis based on histological evaluation after biopsy or excision is paramount for adequate therapy stratification. Deep learning on histological slides has been suggested to complement and improve routine diagnostics, but publicly available curated and annotated data and usable models trained to distinguish common skin tumors are rare and often lack heterogeneous non-tumor categories. A total of 16 classes from 386 cases were manually annotated on scanned histological slides, 129,364 100 x 100 µm (~395 x 395 px) image tiles were extracted and split into a training, validation and test set. An EfficientV2 neuronal network was trained and optimized to classify image categories. Cross entropy loss, balanced accuracy and Matthews correlation coefficient were used for model evaluation. Image and patient data were assessed with confusion matrices. Application of the model to an external set of whole slides facilitated localization of melanoma and non-tumor tissue. Automated differentiation of BCC, SqCC, melanoma, naevi and non-tumor tissue structures was possible, and a high diagnostic accuracy was achieved in the validation (98%) and test (97%) set. In summary, we provide a curated dataset including the most common neoplasms of the skin and various anatomical compartments to enable researchers to train, validate and improve deep learning models. Automated classification of skin tumors by deep learning techniques is possible with high accuracy, facilitates tumor localization and has the potential to support and improve routine diagnostics.
Collapse
Affiliation(s)
- Katharina Kriegsmann
- Department of Hematology, Oncology and Rheumatology, Heidelberg University, Heidelberg, Germany
| | - Frithjof Lobers
- Department of Clinical Immunology, Medical Faculty, University of Leipzig, Leipzig, Germany
| | | | - Jörg Kriegsmann
- MVZ Histology, Cytology and Molecular Diagnostics Trier, Trier, Germany,Proteopath Trier, Trier, Germany
| | - Charlotte Janßen
- Center for Industrial Mathematics (ZeTeM), University of Bremen, Bremen, Germany
| | | | - Thomas Muley
- Translational Lung Research Centre (TLRC) Heidelberg, Member of the German Centre for Lung Research (DZL), Heidelberg, Germany
| | - Ulrich Sack
- Department of Clinical Immunology, Medical Faculty, University of Leipzig, Leipzig, Germany
| | - Georg Steinbuss
- Department of Hematology, Oncology and Rheumatology, Heidelberg University, Heidelberg, Germany
| | - Mark Kriegsmann
- Institute of Pathology, Heidelberg University, Heidelberg, Germany,*Correspondence: Mark Kriegsmann,
| |
Collapse
|
36
|
Jarkman S, Karlberg M, Pocevičiūtė M, Bodén A, Bándi P, Litjens G, Lundström C, Treanor D, van der Laak J. Generalization of Deep Learning in Digital Pathology: Experience in Breast Cancer Metastasis Detection. Cancers (Basel) 2022; 14:5424. [PMID: 36358842 PMCID: PMC9659028 DOI: 10.3390/cancers14215424] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2022] [Revised: 10/13/2022] [Accepted: 10/28/2022] [Indexed: 11/06/2022] Open
Abstract
Poor generalizability is a major barrier to clinical implementation of artificial intelligence in digital pathology. The aim of this study was to test the generalizability of a pretrained deep learning model to a new diagnostic setting and to a small change in surgical indication. A deep learning model for breast cancer metastases detection in sentinel lymph nodes, trained on CAMELYON multicenter data, was used as a base model, and achieved an AUC of 0.969 (95% CI 0.926-0.998) and FROC of 0.838 (95% CI 0.757-0.913) on CAMELYON16 test data. On local sentinel node data, the base model performance dropped to AUC 0.929 (95% CI 0.800-0.998) and FROC 0.744 (95% CI 0.566-0.912). On data with a change in surgical indication (axillary dissections) the base model performance indicated an even larger drop with a FROC of 0.503 (95%CI 0.201-0.911). The model was retrained with addition of local data, resulting in about a 4% increase for both AUC and FROC for sentinel nodes, and an increase of 11% in AUC and 49% in FROC for axillary nodes. Pathologist qualitative evaluation of the retrained model´s output showed no missed positive slides. False positives, false negatives and one previously undetected micro-metastasis were observed. The study highlights the generalization challenge even when using a multicenter trained model, and that a small change in indication can considerably impact the model´s performance.
Collapse
Affiliation(s)
- Sofia Jarkman
- Department of Clinical Pathology, and Department of Biomedical and Clinical Sciences, Linköping University, 581 83 Linköping, Sweden
- Center for Medical Image Science and Visualization (CMIV), Linköping University, 581 85 Linköping, Sweden
| | - Micael Karlberg
- Center for Medical Image Science and Visualization (CMIV), Linköping University, 581 85 Linköping, Sweden
- Department of Pathology, Radboud University Medical Center, P.O. Box 9101, 6500 HB Nijmegen, The Netherlands
| | - Milda Pocevičiūtė
- Center for Medical Image Science and Visualization (CMIV), Linköping University, 581 85 Linköping, Sweden
| | - Anna Bodén
- Department of Clinical Pathology, and Department of Biomedical and Clinical Sciences, Linköping University, 581 83 Linköping, Sweden
- Center for Medical Image Science and Visualization (CMIV), Linköping University, 581 85 Linköping, Sweden
| | - Péter Bándi
- Department of Pathology, Radboud University Medical Center, P.O. Box 9101, 6500 HB Nijmegen, The Netherlands
| | - Geert Litjens
- Department of Pathology, Radboud University Medical Center, P.O. Box 9101, 6500 HB Nijmegen, The Netherlands
| | - Claes Lundström
- Center for Medical Image Science and Visualization (CMIV), Linköping University, 581 85 Linköping, Sweden
- Sectra AB, Teknikringen 20, 583 30 Linköping, Sweden
| | - Darren Treanor
- Department of Clinical Pathology, and Department of Biomedical and Clinical Sciences, Linköping University, 581 83 Linköping, Sweden
- Center for Medical Image Science and Visualization (CMIV), Linköping University, 581 85 Linköping, Sweden
- Leeds Teaching Hospitals NHS Trust, St James´s University Hospital, Beckett Street, Leeds LS9 7TF, UK
- Department of Pathology, University of Leeds, Woodhouse Lane, Leeds LS2 9JT, UK
| | - Jeroen van der Laak
- Center for Medical Image Science and Visualization (CMIV), Linköping University, 581 85 Linköping, Sweden
- Department of Pathology, Radboud University Medical Center, P.O. Box 9101, 6500 HB Nijmegen, The Netherlands
| |
Collapse
|
37
|
Schmidle P, Braun SA. [Digitalization in dermatopathology]. DERMATOLOGIE (HEIDELBERG, GERMANY) 2022; 73:845-852. [PMID: 36085178 DOI: 10.1007/s00105-022-05059-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 08/24/2022] [Indexed: 06/15/2023]
Abstract
The histomorphological analysis of tissue sections by specially trained dermatopathologists is a central component for making the dermatological diagnosis. It is the foundation for the understanding of clinical aspects, pathophysiology and not least the treatment of skin diseases and is therefore an essential part of modern dermatology. New technological developments in recent years offer a variety of possibilities to digitalize dermatopathology, which could significantly change and even revolutionize the work of dermatopathologists in the coming years; however, like any new development there are limiting factors and open questions that need to be discussed. This article is intended to provide an overview of the current state of the art and to highlight the corresponding opportunities and risks on the road to digital dermatopathology.
Collapse
Affiliation(s)
- Paul Schmidle
- Klinik für Hautkrankheiten, Universitätsklinikum Münster, Von-Esmarch-Str. 58, 48149, Münster, Deutschland.
| | - Stephan A Braun
- Klinik für Hautkrankheiten, Universitätsklinikum Münster, Von-Esmarch-Str. 58, 48149, Münster, Deutschland
- Klinik für Dermatologie, Medizinische Fakultät, Heinrich-Heine-Universität, Düsseldorf, Deutschland
| |
Collapse
|
38
|
Hofmarcher T, Lindgren P, Wilking N. Systemic anti-cancer therapy patterns in advanced non-small cell lung cancer in Europe. J Cancer Policy 2022; 34:100362. [PMID: 36087918 DOI: 10.1016/j.jcpo.2022.100362] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2022] [Revised: 09/02/2022] [Accepted: 09/05/2022] [Indexed: 10/14/2022]
Abstract
BACKGROUND Systemic anti-cancer therapy (SACT) is the recommended treatment modality in patients with advanced non-small cell lung cancer (aNSCLC) in clinical guidelines. SACT options in aNSCLC have multiplied in recent years with the introduction of immunotherapy and targeted therapy. This article presents findings from the first comparative analysis of SACT patterns in Europe. METHODS SACT rates in aNSCLC were estimated as the ratio between the number of patients treated with SACT (chemotherapy, immunotherapy, targeted therapy) and the number of potentially eligible patients for SACT in 11 countries (Belgium, Bulgaria, Finland, Hungary, Ireland, Netherlands, Norway, Poland, Portugal, Romania, UK) between 2014 and 2020. Treated patients were estimated by combining national sales volume data of cancer drugs and average drug use per patient based on clinical trials. Potentially eligible patients were estimated from national epidemiological data. RESULTS SACT rates in aNSCLC differed greatly, ranging from around 30 % in Hungary, Poland, and the UK to almost 60 % in Ireland, Norway, and Portugal in 2014. SACT rates seemed to increase over time in most countries, but differences were still large by 2020, ranging from around 40 % in the UK to 75 % or more in Belgium, Norway, and Portugal. Even in countries with the highest SACT rates, far from all patients seemed to receive guideline-recommended SACT options, as underuse of immunotherapy and targeted therapy was common. CONCLUSION Up to 35 % of eligible patients with aNSCLC receives no SACT in certain European countries, although improvements have been achieved over time. The use of immunotherapy and targeted therapy is suboptimal even in countries with high SACT rates, indicating room to improve the quality of care and patient outcomes. POLICY SUMMARY Measuring if and what kind of therapy cancer patients have access to is vital to assess quality of care. The care of aNSCLC patients seems to be suboptimal in Europe, due to factors such as exclusion of patients with moderate performance status from SACT, limited resources for diagnostic testing, long reimbursement timelines and slow adoption of new medicines in clinical practice.
Collapse
Affiliation(s)
- Thomas Hofmarcher
- IHE - The Swedish Institute for Health Economics, Råbygatan 2, SE-22361, Lund, Sweden.
| | - Peter Lindgren
- IHE - The Swedish Institute for Health Economics, Råbygatan 2, SE-22361, Lund, Sweden; Karolinska Institutet, Solnavägen 1, SE-17177, Solna, Sweden
| | - Nils Wilking
- Karolinska Institutet, Solnavägen 1, SE-17177, Solna, Sweden
| |
Collapse
|
39
|
Bülow RD, Hölscher DL, Boor P. Automatische Bildanalyse und künstliche Intelligenz in der Nephropathologie. DIE NEPHROLOGIE 2022. [PMCID: PMC9360682 DOI: 10.1007/s11560-022-00598-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Abstract
Hintergrund Fragestellung Material und Methoden Ergebnisse Diskussion
Collapse
Affiliation(s)
- Roman D. Bülow
- Institut für Pathologie, Uniklinik RWTH Aachen, Pauwelsstr. 30, 52074 Aachen, Deutschland
| | - David L. Hölscher
- Institut für Pathologie, Uniklinik RWTH Aachen, Pauwelsstr. 30, 52074 Aachen, Deutschland
| | - Peter Boor
- Institut für Pathologie, Uniklinik RWTH Aachen, Pauwelsstr. 30, 52074 Aachen, Deutschland
- Medizinische Klinik II, Uniklinik RWTH Aachen, Pauwelsstr. 30, 52074 Aachen, Deutschland
| |
Collapse
|
40
|
Herbst H, Rüdiger T. [Automation and the use of robots in the pathology laboratory : A journey through time and a consideration of efficiency]. PATHOLOGIE (HEIDELBERG, GERMANY) 2022; 43:56-63. [PMID: 36422660 DOI: 10.1007/s00292-022-01157-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 10/12/2022] [Indexed: 06/16/2023]
Abstract
In the past 20 years, numerous technical innovations were introduced to the histopathology laboratory, providing tools for improved standardization and occupational safety. Digital tracking serves as a backbone accompanying the workflow from the labeling of cassettes and slides to the final steps of preparing whole slide images and archiving blocks and sections. Multifunctional devices eliminated time consuming manual work prone to mistakes and loss of materials. At present, collaborative robots take over manual work that was considered to be exclusive to humans. The advent of these new technologies is expected to ameliorate the increasing staffing shortage in the laboratory but also of histopathologists.
Collapse
Affiliation(s)
- Hermann Herbst
- Fachbereich Pathologie, Klinikum Neukölln, Vivantes Netzwerk für Gesundheit GmbH, Rudower Str. 48, 12351, Berlin, Deutschland.
| | - Thomas Rüdiger
- Pathologisches Institut, Städtisches Klinikum Karlsruhe, Karlsruhe, Deutschland
| |
Collapse
|
41
|
Rau TT, Neppl C, Esposito I. [A European comparison of continuing education in pathology]. PATHOLOGIE (HEIDELBERG, GERMANY) 2022; 43:106-110. [PMID: 36378288 DOI: 10.1007/s00292-022-01153-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 10/12/2022] [Indexed: 11/16/2022]
Abstract
In the coming years, the shortage of pathologists will become internationally evident. In addition, the increase in knowledge, technical transformation processes, and the attractiveness of working conditions pose clear challenges for the field of pathology. A bi-directional opening for international mobility of pathologists could be a potential solution.In this analysis, the European training concept of the European Union of Medical Specialists (UEMS) was compared with its implementation in the 27 countries of the EU plus its 4 associated countries with regard to nationally differentiated concepts, type and implementation of the specialist examination, and additional qualifications. Subsequently, questions regarding the recognition of exams, titles, and specialist exams were elicited.The duration of training ranges between 4 and 6 years. The number of cases also varies considerably. Obtaining the specialist title can be done by simply completing the specifications up to a structured examination. In the EU, exams are mutually recognized, but this does not necessarily apply to academic titles and additional qualifications. Increasingly, on-site training centers are also subject to auditing procedures.The European agreements allow a high degree of permeability. However, national regulations pose hurdles for international mobility. The UEMS is therefore focusing on harmonization, including the certification of training centers. The so-called European Pathology Progress Test of the European Society of Pathology (ESP) is a further step towards the development of a future European specialist title. It remains the joint responsibility of residents and institutes to shape the future of the next generation of pathologists from the variety of different concepts.
Collapse
Affiliation(s)
- Tilman T Rau
- Institut für Pathologie, Universitätsklinikum Düsseldorf, Moorenstr. 5, 40225, Düsseldorf, Deutschland.
| | - Christina Neppl
- Institut für Pathologie, Universitätsklinikum Düsseldorf, Moorenstr. 5, 40225, Düsseldorf, Deutschland
| | - Irene Esposito
- Institut für Pathologie, Universitätsklinikum Düsseldorf, Moorenstr. 5, 40225, Düsseldorf, Deutschland
| |
Collapse
|
42
|
Mass Spectrometry Imaging Spatial Tissue Analysis toward Personalized Medicine. LIFE (BASEL, SWITZERLAND) 2022; 12:life12071037. [PMID: 35888125 PMCID: PMC9318569 DOI: 10.3390/life12071037] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/20/2022] [Revised: 07/04/2022] [Accepted: 07/10/2022] [Indexed: 12/19/2022]
Abstract
Novel profiling methodologies are redefining the diagnostic capabilities and therapeutic approaches towards more precise and personalized healthcare. Complementary information can be obtained from different omic approaches in combination with the traditional macro- and microscopic analysis of the tissue, providing a more complete assessment of the disease. Mass spectrometry imaging, as a tissue typing approach, provides information on the molecular level directly measured from the tissue. Lipids, metabolites, glycans, and proteins can be used for better understanding imbalances in the DNA to RNA to protein translation, which leads to aberrant cellular behavior. Several studies have explored the capabilities of this technology to be applied to tumor subtyping, patient prognosis, and tissue profiling for intraoperative tissue evaluation. In the future, intercenter studies may provide the needed confirmation on the reproducibility, robustness, and applicability of the developed classification models for tissue characterization to assist in disease management.
Collapse
|
43
|
van der Kamp A, Waterlander TJ, de Bel T, van der Laak J, van den Heuvel-Eibrink MM, Mavinkurve-Groothuis AMC, de Krijger RR. Artificial Intelligence in Pediatric Pathology: The Extinction of a Medical Profession or the Key to a Bright Future? Pediatr Dev Pathol 2022; 25:380-387. [PMID: 35238696 DOI: 10.1177/10935266211059809] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Artificial Intelligence (AI) has become of increasing interest over the past decade. While digital image analysis (DIA) is already being used in radiology, it is still in its infancy in pathology. One of the reasons is that large-scale digitization of glass slides has only recently become available. With the advent of digital slide scanners, that digitize glass slides into whole slide images, many labs are now in a transition phase towards digital pathology. However, only few departments worldwide are currently fully digital. Digital pathology provides the ability to annotate large datasets and train computers to develop and validate robust algorithms, similar to radiology. In this opinionated overview, we will give a brief introduction into AI in pathology, discuss the potential positive and negative implications and speculate about the future role of AI in the field of pediatric pathology.
Collapse
Affiliation(s)
- Ananda van der Kamp
- 541199Princess Máxima Center for Pediatric Oncology, Utrecht, the Netherlands
| | - Tomas J Waterlander
- 541199Princess Máxima Center for Pediatric Oncology, Utrecht, the Netherlands
| | - Thomas de Bel
- Department of Pathology, 234134Radboud University Medical Center, Nijmegen, the Netherlands
| | - Jeroen van der Laak
- Department of Pathology, 234134Radboud University Medical Center, Nijmegen, the Netherlands.,Center for Medical Image Science and Visualization, 4566Linköping University, Linköping, Sweden
| | | | | | - Ronald R de Krijger
- 541199Princess Máxima Center for Pediatric Oncology, Utrecht, the Netherlands.,Department of Pathology, University Medical Center Utrecht, Utrecht, the Netherlands
| |
Collapse
|
44
|
Kantasiripitak C, Laohawetwanit T, Apornvirat S, Niemnapa K. Validation of whole slide imaging for frozen section diagnosis of lymph node metastasis: A retrospective study from a tertiary care hospital in Thailand. Ann Diagn Pathol 2022; 60:151987. [PMID: 35700561 DOI: 10.1016/j.anndiagpath.2022.151987] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2022] [Revised: 05/23/2022] [Accepted: 06/03/2022] [Indexed: 11/01/2022]
Abstract
BACKGROUND The use of whole slide imaging (WSI) for frozen section (FS) diagnosis is helpful, particularly in the context of pathologist shortages. However, there is minimal data on such usage in resource-limited settings. This study aims to validate the use of WSI for FS diagnosis of lymph node metastasis using a low-cost virtual microscope scanner with consumer-grade laptops at a tertiary care hospital in Thailand. METHODS FS slides were retrieved for which the clinical query was to evaluate lymph node metastasis. They were digitized by a virtual microscope scanner (MoticEasyScan, Hong Kong) using up to 40× optical magnification. Three observers with different pathology experience levels diagnosed each slide, reviewing glass slides (GS) followed by digital slides (DS) after two weeks of a wash out period. WSI and GS diagnoses were compared. The time used for scanning and diagnosis of each slide was recorded. RESULTS 295 FS slides were retrieved and digitized. The first-time successful scanning rate was 93.6 %. The mean scanning time was 2 min per slide. Both intraobserver agreement and interobserver agreement of WSI and GS diagnoses were high (Cohen's K; kappa value >0.84). The time used for DS diagnosis decreased as the observer's experience with WSI increased. CONCLUSIONS Despite varying pathological experiences, observers using WSI provided accurate FS diagnoses of lymph node metastasis. The time required for DS diagnoses decreased with additional observer's experience with WSI. Therefore, a WSI system containing low-cost scanners and consumer-grade laptops could be used for FS services in hospital laboratories lacking pathologists.
Collapse
Affiliation(s)
| | - Thiyaphat Laohawetwanit
- Division of Pathology, Thammasat University Hospital, Pathum Thani, Thailand; Division of Pathology, Chulabhorn International College of Medicine, Thammasat University, Pathum Thani, Thailand.
| | - Sompon Apornvirat
- Division of Pathology, Thammasat University Hospital, Pathum Thani, Thailand; Division of Pathology, Chulabhorn International College of Medicine, Thammasat University, Pathum Thani, Thailand
| | - Kongkot Niemnapa
- Advanced Digital Simulation Center, Chulabhorn International College of Medicine, Thammasat University, Pathum Thani, Thailand
| |
Collapse
|
45
|
Development of an intraoperative breast cancer margin assessment method using quantitative fluorescence measurements. Sci Rep 2022; 12:8520. [PMID: 35595810 PMCID: PMC9122917 DOI: 10.1038/s41598-022-12614-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2022] [Accepted: 05/09/2022] [Indexed: 11/08/2022] Open
Abstract
Breast-conserving surgery has become the preferred treatment method for breast cancer. Surgical margin assessment is performed during surgery, as it can reduce local recurrence in the preserved breast. Development of reliable and lower-cost ex vivo cancer detection methods would offer several benefits for patient care. Here, a practical and quantitative evaluation method for the ex vivo fluorescent diagnosis of breast lesions was developed and confirmed through a three-step clinical study. Gamma-glutamyl-hydroxymethyl rhodamine green (gGlu-HMRG) has been reported to generate fluorescence in breast lesions. Using this probe, we constructed a reliable and reproducible procedure for the quantitative evaluation of fluorescence levels. We evaluated the reliability of the method by considering reproducibility, temperature sensitivity, and the effects of other clinicopathological factors. The results suggest that the fluorescence increase of gGlu-HMRG is a good indicator of the malignancy of breast lesions. However, the distributions overlapped. A 5 min reaction with this probe could be used to distinguish at least part of the normal breast tissue. This method did not affect the final pathological examination. In summary, our results indicate that the methods developed in this study may serve as a feasible intraoperative negative-margin assessment tool during breast-conserving surgery.
Collapse
|
46
|
Herbst H, Rüdiger T, Hofmann C. [Automation and application of robotics in the pathology laboratory]. DER PATHOLOGE 2022; 43:210-217. [PMID: 35462567 DOI: 10.1007/s00292-022-01073-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 03/22/2022] [Indexed: 06/14/2023]
Abstract
Over the last 20 years, numerous technical innovations have been introduced to the histopathology laboratory, providing tools for improved standardization and occupational safety. Digital tracking serves as a backbone accompanying the workflow from labeling cassettes and slides to the final steps of preparation of whole slide images and archiving blocks and sections. Multifunctional devices eliminated time consuming manual work prone to mistakes and loss of materials. At present, collaborative robots take over manual work that was considered to be exclusive to humans. The advent of these new technologies is expected to ameliorate the increasing staffing shortage in the laboratory and on the side of histopathologists as well.
Collapse
Affiliation(s)
- Hermann Herbst
- Fachbereich Pathologie, Klinikum Neukölln, Vivantes Netzwerk für Gesundheit GmbH, Rudower Str. 48, 12351, Berlin, Deutschland.
| | - Thomas Rüdiger
- Pathologisches Institut, Städtisches Klinikum Karlsruhe, Karlsruhe, Deutschland
| | - Constantin Hofmann
- wbk Institut für Produktionstechnik, Karlsruher Institut für Technologie (KIT), Karlsruhe, Deutschland
| |
Collapse
|
47
|
Kuo BJ, Busmanis I, Tan BP, Tan PH, Teoh WC, Tan BS. The Lancet Commission on diagnostics: What it means for Singapore. ANNALS OF THE ACADEMY OF MEDICINE, SINGAPORE 2022; 51:300-303. [PMID: 35658153 DOI: 10.47102/annals-acadmedsg.202242] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
|
48
|
Renal Cancer Detection: Fusing Deep and Texture Features from Histopathology Images. BIOMED RESEARCH INTERNATIONAL 2022; 2022:9821773. [PMID: 35386304 PMCID: PMC8979690 DOI: 10.1155/2022/9821773] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/29/2021] [Revised: 02/16/2022] [Accepted: 02/21/2022] [Indexed: 11/18/2022]
Abstract
Histopathological images contain morphological markers of disease progression that have diagnostic and predictive values, with many computer-aided diagnosis systems using common deep learning methods that have been proposed to save time and labour. Even though deep learning methods are an end-to-end method, they perform exceptionally well given a large dataset and often show relatively inferior results for a small dataset. In contrast, traditional feature extraction methods have greater robustness and perform well with a small/medium dataset. Moreover, a texture representation-based global approach is commonly used to classify histological tissue images expect in explicit segmentation to extract the structure properties. Considering the scarcity of medical datasets and the usefulness of texture representation, we would like to integrate both the advantages of deep learning and traditional machine learning, i.e., texture representation. To accomplish this task, we proposed a classification model to detect renal cancer using a histopathology dataset by fusing the features from a deep learning model with the extracted texture feature descriptors. Here, five texture feature descriptors from three texture feature families were applied to complement Alex-Net for the extensive validation of the fusion between the deep features and texture features. The texture features are from (1) statistic feature family: histogram of gradient, gray-level cooccurrence matrix, and local binary pattern; (2) transform-based texture feature family: Gabor filters; and (3) model-based texture feature family: Markov random field. The final experimental results for classification outperformed both Alex-Net and a singular texture descriptor, showing the effectiveness of combining the deep features and texture features in renal cancer detection.
Collapse
|
49
|
MIXTURE of human expertise and deep learning-developing an explainable model for predicting pathological diagnosis and survival in patients with interstitial lung disease. Mod Pathol 2022; 35:1083-1091. [PMID: 35197560 PMCID: PMC9314248 DOI: 10.1038/s41379-022-01025-7] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2021] [Revised: 01/30/2022] [Accepted: 01/31/2022] [Indexed: 02/07/2023]
Abstract
Interstitial pneumonia is a heterogeneous disease with a progressive course and poor prognosis, at times even worse than those in the main cancer types. Histopathological examination is crucial for its diagnosis and estimation of prognosis. However, the evaluation strongly depends on the experience of pathologists, and the reproducibility of diagnosis is low. Herein, we propose MIXTURE (huMan-In-the-loop eXplainable artificial intelligence Through the Use of REcurrent training), an original method to develop deep learning models for extracting pathologically significant findings based on an expert pathologist's perspective with a small annotation effort. The procedure of MIXTURE consists of three steps as follows. First, we created feature extractors for tiles from whole slide images using self-supervised learning. The similar looking tiles were clustered based on the output features and then pathologists integrated the pathologically synonymous clusters. Using the integrated clusters as labeled data, deep learning models to classify the tiles into pathological findings were created by transfer-learning the feature extractors. We developed three models for different magnifications. Using these extracted findings, our model was able to predict the diagnosis of usual interstitial pneumonia, a finding suggestive of progressive disease, with high accuracy (AUC 0.90 in validation set and AUC 0.86 in test set). This high accuracy could not be achieved without the integration of findings by pathologists. The patients predicted as UIP had poorer prognosis (5-year overall survival [OS]: 55.4%) than those predicted as non-UIP (OS: 95.2%). The Cox proportional hazards model for each microscopic finding and prognosis pointed out dense fibrosis, fibroblastic foci, elastosis, and lymphocyte aggregation as independent risk factors. We suggest that MIXTURE may serve as a model approach to different diseases evaluated by medical imaging, including pathology and radiology, and be the prototype for explainable artificial intelligence that can collaborate with humans.
Collapse
|
50
|
Yamaguchi M, Sasaki T, Uemura K, Tajima Y, Kato S, Takagi K, Yamazaki Y, Saito-Koyama R, Inoue C, Kawaguchi K, Soma T, Miyata T, Suzuki T. Automatic breast carcinoma detection in histopathological micrographs based on Single Shot Multibox Detector. J Pathol Inform 2022; 13:100147. [PMID: 36268083 PMCID: PMC9577133 DOI: 10.1016/j.jpi.2022.100147] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2022] [Revised: 09/13/2022] [Accepted: 09/22/2022] [Indexed: 12/24/2022] Open
Abstract
Background A diagnosis with histological classification by pathologists is very important for appropriate treatments to improve the prognosis of patients with breast cancer. However, the number of pathologists is limited, and assisting the pathological diagnosis by artificial intelligence becomes very important. Here, we presented an automatic breast lesions detection model using microscopic histopathological images based on a Single Shot Multibox Detector (SSD) for the first time and evaluated its significance in assisting the diagnosis. Methods We built the data set and trained the SSD model with 1361 microscopic images and evaluated using 315 images. Pathologists and medical students diagnosed the images with or without the assistance of the model to investigate the significance of our model in assisting the diagnosis. Results The model achieved 88.3% and 90.5% diagnostic accuracies in 3-class (benign, non-invasive carcinoma, or invasive carcinoma) or 2-class (benign or malignant) classification tasks, respectively, and the mean intersection over union was 0.59. Medical students achieved a remarkably higher diagnostic accuracy score (average 84.7%) with the assistance of the model compared to those without assistance (average 67.4%). Some people diagnosed images in a short time using the assistance of the model (shorten by average 6.4 min) while others required a longer time (extended by 7.2 min). Conclusion We presented the automatic breast lesions detection method at high speed using histopathological micrographs. The present system may conveniently support the histological diagnosis by pathologists in laboratories.
Collapse
|