Computational pathology in the identification of HER2-low breast cancer: Opportunities and challenges

For the past 2 decades, pathologists have been accustomed to reporting the HER2 status of breast cancer as either positive or negative, based on HER2 IHC. Today, however, there is a clinical imperative to employ a 3-tier approach to interpreting HER2 IHC that can also identify tumours categorised as HER2-low. Meeting this need for a finer degree of discrimination may be challenging, and in this article, we consider the potential for the integration of computational approaches to support pathologists in achieving accurate and reproducible HER2 IHC scoring as well as outlining some of the practicalities involved.

Automated curation of large-scale cancer histopathology image datasets using deep learning

BACKGROUND

Artificial intelligence (AI) has numerous applications in pathology, supporting diagnosis and prognostication in cancer. However, most AI models are trained on highly selected data, typically one tissue slide per patient. In reality, especially for large surgical resection specimens, dozens of slides can be available for each patient. Manually sorting and labelling whole-slide images (WSIs) is a very time-consuming process, hindering the direct application of AI on the collected tissue samples from large cohorts. In this study we addressed this issue by developing a deep-learning (DL)-based method for automatic curation of large pathology datasets with several slides per patient.

METHODS

We collected multiple large multicentric datasets of colorectal cancer histopathological slides from the United Kingdom (FOXTROT, N = 21,384 slides; CR07, N = 7985 slides) and Germany (DACHS, N = 3606 slides). These datasets contained multiple types of tissue slides, including bowel resection specimens, endoscopic biopsies, lymph node resections, immunohistochemistry-stained slides, and tissue microarrays. We developed, trained, and tested a deep convolutional neural network model to predict the type of slide from the slide overview (thumbnail) image. The primary statistical endpoint was the macro-averaged area under the receiver operating curve (AUROCs) for detection of the type of slide.

RESULTS

In the primary dataset (FOXTROT), with an AUROC of 0.995 [95% confidence interval [CI]: 0.994-0.996] the algorithm achieved a high classification performance and was able to accurately predict the type of slide from the thumbnail image alone. In the two external test cohorts (CR07, DACHS) AUROCs of 0.982 [95% CI: 0.979-0.985] and 0.875 [95% CI: 0.864-0.887] were observed, which indicates the generalizability of the trained model on unseen datasets. With a confidence threshold of 0.95, the model reached an accuracy of 94.6% (7331 classified cases) in CR07 and 85.1% (2752 classified cases) for the DACHS cohort.

CONCLUSION

Our findings show that using the low-resolution thumbnail image is sufficient to accurately classify the type of slide in digital pathology. This can support researchers to make the vast resource of existing pathology archives accessible to modern AI models with only minimal manual annotations.

Whole Slide Imaging Technology and Its Applications: Current and Emerging Perspectives

Background. Whole slide imaging (WSI) represents a paradigm shift in pathology, serving as a necessary first step for a wide array of digital tools to enter the field. It utilizes virtual microscopy wherein glass slides are converted into digital slides and are viewed by pathologists by automated image analysis. Its impact on pathology workflow, reproducibility, dissemination of educational material, expansion of service to underprivileged areas, and institutional collaboration exemplifies a significant innovative movement. The recent US Food and Drug Administration approval to WSI for its use in primary surgical pathology diagnosis has opened opportunities for wider application of this technology in routine practice. Main Text. The ongoing technological advances in digital scanners, image visualization methods, and the integration of artificial intelligence-derived algorithms with these systems provide avenues to exploit its applications. Its benefits are innumerable such as ease of access through the internet, avoidance of physical storage space, and no risk of deterioration of staining quality or breakage of slides to name a few. Although the benefits of WSI to pathology practices are many, the complexities of implementation remain an obstacle to widespread adoption. Some barriers including the high cost, technical glitches, and most importantly professional hesitation to adopt a new technology have hindered its use in routine pathology. Conclusions. In this review, we summarize the technical aspects of WSI, its applications in diagnostic pathology, training, and research along with future perspectives. It also highlights improved understanding of the current challenges to implementation, as well as the benefits and successes of the technology. WSI provides a golden opportunity for pathologists to guide its evolution, standardization, and implementation to better acquaint them with the key aspects of this technology and its judicial use. Also, implementation of routine digital pathology is an extra step requiring resources which (currently) does not usually result increased efficiency or payment.

Hourglass, a compass navigating global and regional heterogeneity of pancreatic cancer†

Advances in the digital pathology field have facilitated the characterization of histology samples for both clinical and preclinical research. However, uncovering subtle correlations between bioimaging, clinical and molecular parameters requires extensive statistical analysis. As a user-friendly software, Hourglass, simplifies multiparametric dataset analysis through intuitive data visualization and statistical tools. Systemic analysis of interleukin-6 (IL-6)/pStat3 signaling pathway through Hourglass revealed differences in regional immune cell composition within tumors. Moreover, these regional disparities were partially mediated by sex. Overall, Hourglass simplifies information extraction from complex datasets, resolving overlooked regional and global spatial tumor differences. © 2024 The Authors. The Journal of Pathology published by John Wiley & Sons Ltd on behalf of The Pathological Society of Great Britain and Ireland.

Prediction of immunochemotherapy response for diffuse large B-cell lymphoma using artificial intelligence digital pathology

Diffuse large B-cell lymphoma (DLBCL) is a heterogeneous and prevalent subtype of aggressive non-Hodgkin lymphoma that poses diagnostic and prognostic challenges, particularly in predicting drug responsiveness. In this study, we used digital pathology and deep learning to predict responses to immunochemotherapy in patients with DLBCL. We retrospectively collected 251 slide images from 216 DLBCL patients treated with rituximab, cyclophosphamide, doxorubicin, vincristine, and prednisone (R-CHOP), with their immunochemotherapy response labels. The digital pathology images were processed using contrastive learning for feature extraction. A multi-modal prediction model was developed by integrating clinical data and pathology image features. Knowledge distillation was employed to mitigate overfitting on gigapixel histopathology images to create a model that predicts responses based solely on pathology images. Based on the importance derived from the attention mechanism of the model, we extracted histological features that were considered key textures associated with drug responsiveness. The multi-modal prediction model achieved an impressive area under the ROC curve of 0.856, demonstrating significant associations with clinical variables such as Ann Arbor stage, International Prognostic Index, and bulky disease. Survival analyses indicated their effectiveness in predicting relapse-free survival. External validation using TCGA datasets supported the model's ability to predict survival differences. Additionally, pathology-based predictions show promise as independent prognostic indicators. Histopathological analysis identified centroblastic and immunoblastic features to be associated with treatment response, aligning with previous morphological classifications and highlighting the objectivity and reproducibility of artificial intelligence-based diagnosis. This study introduces a novel approach that combines digital pathology and clinical data to predict the response to immunochemotherapy in patients with DLBCL. This model shows great promise as a diagnostic and prognostic tool for clinical management of DLBCL. Further research and genomic data integration hold the potential to enhance its impact on clinical practice, ultimately improving patient outcomes.

AI-guided histopathology predicts brain metastasis in lung cancer patients

Brain metastases can occur in nearly half of patients with early and locally advanced (stage I-III) non-small cell lung cancer (NSCLC). There are no reliable histopathologic or molecular means to identify those who are likely to develop brain metastases. We sought to determine if deep learning (DL) could be applied to routine H&E-stained primary tumor tissue sections from stage I-III NSCLC patients to predict the development of brain metastasis. Diagnostic slides from 158 patients with stage I-III NSCLC followed for at least 5 years for the development of brain metastases (Met+, 65 patients) versus no progression (Met-, 93 patients) were subjected to whole-slide imaging. Three separate iterations were performed by first selecting 118 cases (45 Met+, 73 Met-) to train and validate the DL algorithm, while 40 separate cases (20 Met+, 20 Met-) were used as the test set. The DL algorithm results were compared to a blinded review by four expert pathologists. The DL-based algorithm was able to distinguish the eventual development of brain metastases with an accuracy of 87% (p < 0.0001) compared with an average of 57.3% by the four pathologists and appears to be particularly useful in predicting brain metastases in stage I patients. The DL algorithm appears to focus on a complex set of histologic features. DL-based algorithms using routine H&E-stained slides may identify patients who are likely to develop brain metastases from those who will remain disease free over extended (>5 year) follow-up and may thus be spared systemic therapy. © 2024 The Authors. The Journal of Pathology published by John Wiley & Sons Ltd on behalf of The Pathological Society of Great Britain and Ireland.

Pros and cons of artificial intelligence implementation in diagnostic pathology

The rapid introduction of digital pathology has greatly facilitated development of artificial intelligence (AI) models in pathology that have shown great promise in assisting morphological diagnostics and quantitation of therapeutic targets. We are now at a tipping point where companies have started to bring algorithms to the market, and questions arise whether the pathology community is ready to implement AI in routine workflow. However, concerns also arise about the use of AI in pathology. This article reviews the pros and cons of introducing AI in diagnostic pathology.

Computational pathology: an evolving concept

The initial enthusiasm about computational pathology (CP) and artificial intelligence (AI) was that they will replace pathologists entirely on the way to fully automated diagnostics. It is becoming clear that currently this is not the immediate model to pursue. On top of the legal and regulatory complexities surrounding its implementation, the majority of tested machine learning (ML)-based predictive algorithms do not display the exquisite performance needed to render them unequivocal, standalone decision makers for matters with direct implications to human health. We are thus moving into a different model of "computer-assisted diagnostics", where AI is there to provide support, rather than replacing, the pathologist. Herein we focus on the practical aspects of CP, from a pathologist perspective. There is a wide range of potential applications where CP can enhance precision of pathology diagnosis, tailor prognostic and predictive information, as well as save time. There are, however, a number of potential limitations for CP that currently hinder their wider adoption in the clinical setting. We address the key necessary steps towards clinical implementation of computational pathology, discuss the significant obstacles that hinders its adoption in the clinical context and summarize some proposed solutions. We conclude that the advancement of CP in the clinic is a promising resource-intensive endeavour that requires broad and inclusive collaborations between academia, industry, and regulatory bodies.

Fast-track development and multi-institutional clinical validation of an artificial intelligence algorithm for detection of lymph node metastasis in colorectal cancer

Lymph node metastasis (LNM) detection can be automated using artificial intelligence-based diagnostic tools. Only limited studies have addressed this task for colorectal cancer. The aim of this study was to develop of a clinical-grade digital pathology tool for LNM detection in colorectal cancer (CRC) using the original fast-track framework. The training cohort included 432 slides from one department. A segmentation algorithm detecting 8 relevant tissue classes was trained. The test cohorts consisted of materials from five pathology departments digitized by four different scanning systems. A high-quality, large training dataset was generated within 7 days, and a minimal amount of annotation work using fast-track principles. The AI tool showed very high accuracy for LNM detection in all cohorts, with sensitivity, negative predictive value, and specificity ranges of 0.980-1.000, 0.997-1.000, and 0.913-0.990, correspondingly. Only 5 of 14460 analyzed test slides with tumor cells over all cohorts were classified as false negative (3/5 representing clusters of tumor cells in lymphatic vessels). A clinical-grade tool was trained in a short time using fast-track development principles and validated using the largest international, multi-institutional, multi-scanner cohort of cases to date, showing very high precision for LNM detection in CRC. We are releasing a part of the test datasets to facilitate academic research.

The digital revolution in pathology: Towards a smarter approach to research and treatment

Artificial intelligence (AI) applications in oncology are at the forefront of transforming healthcare during the Fourth Industrial Revolution, driven by the digital data explosion. This review provides an accessible introduction to the field of AI, presenting a concise yet structured overview of the foundations of AI, including expert systems, classical machine learning, and deep learning, along with their contextual application in clinical research and healthcare. We delve into the current applications of AI in oncology, with a particular focus on diagnostic imaging and pathology. Numerous AI tools have already received regulatory approval, and more are under active development, bringing clear benefits but not without challenges. We discuss the importance of data security, the need for transparent and interpretable models, and the ethical considerations that must guide AI development in healthcare. By providing a perspective on the opportunities and challenges, this review aims to inform and guide researchers, clinicians, and policymakers in the adoption of AI in oncology.

Reproducible Reporting of the Collection and Evaluation of Annotations for Artificial Intelligence Models

This work puts forth and demonstrates the utility of a reporting framework for collecting and evaluating annotations of medical images used for training and testing artificial intelligence (AI) models in assisting detection and diagnosis. AI has unique reporting requirements, as shown by the AI extensions to the Consolidated Standards of Reporting Trials (CONSORT) and Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) checklists and the proposed AI extensions to the Standards for Reporting Diagnostic Accuracy (STARD) and Transparent Reporting of a Multivariable Prediction model for Individual Prognosis or Diagnosis (TRIPOD) checklists. AI for detection and/or diagnostic image analysis requires complete, reproducible, and transparent reporting of the annotations and metadata used in training and testing data sets. In an earlier work by other researchers, an annotation workflow and quality checklist for computational pathology annotations were proposed. In this manuscript, we operationalize this workflow into an evaluable quality checklist that applies to any reader-interpreted medical images, and we demonstrate its use for an annotation effort in digital pathology. We refer to this quality framework as the Collection and Evaluation of Annotations for Reproducible Reporting of Artificial Intelligence (CLEARR-AI).

Digital pathology for reporting histopathology samples, including cancer screening samples - definitive evidence from a multisite study

AIMS

To conduct a definitive multicentre comparison of digital pathology (DP) with light microscopy (LM) for reporting histopathology slides including breast and bowel cancer screening samples.

METHODS

A total of 2024 cases (608 breast, 607 GI, 609 skin, 200 renal) were studied, including 207 breast and 250 bowel cancer screening samples. Cases were examined by four pathologists (16 study pathologists across the four speciality groups), using both LM and DP, with the order randomly assigned and 6 weeks between viewings. Reports were compared for clinical management concordance (CMC), meaning identical diagnoses plus differences which do not affect patient management. Percentage CMCs were computed using logistic regression models with crossed random-effects terms for case and pathologist. The obtained percentage CMCs were referenced to 98.3% calculated from previous studies.

RESULTS

For all cases LM versus DP comparisons showed the CMC rates were 99.95% [95% confidence interval (CI) = 99.90-99.97] and 98.96 (95% CI = 98.42-99.32) for cancer screening samples. In speciality groups CMC for LM versus DP showed: breast 99.40% (99.06-99.62) overall and 96.27% (94.63-97.43) for cancer screening samples; [gastrointestinal (GI) = 99.96% (99.89-99.99)] overall and 99.93% (99.68-99.98) for bowel cancer screening samples; skin 99.99% (99.92-100.0); renal 99.99% (99.57-100.0). Analysis of clinically significant differences revealed discrepancies in areas where interobserver variability is known to be high, in reads performed with both modalities and without apparent trends to either.

CONCLUSIONS

Comparing LM and DP CMC, overall rates exceed the reference 98.3%, providing compelling evidence that pathologists provide equivalent results for both routine and cancer screening samples irrespective of the modality used.

Automated whole slide morphometry of sural nerve biopsy using machine learning

AIM

The morphometry of sural nerve biopsies, such as fibre diameter and myelin thickness, helps us understand the underlying mechanism of peripheral neuropathies. However, in current clinical practice, only a portion of the specimen is measured manually because of its labour-intensive nature. In this study, we aimed to develop a machine learning-based application that inputs a whole slide image (WSI) of the biopsied sural nerve and automatically performs morphometric analyses.

METHODS

Our application consists of three supervised learning models: (1) nerve fascicle instance segmentation, (2) myelinated fibre detection and (3) myelin sheath segmentation. We fine-tuned these models using 86 toluidine blue-stained slides from various neuropathies and developed an open-source Python library.

RESULTS

Performance evaluation showed (1) a mask average precision (AP) of 0.861 for fascicle segmentation, (2) box AP of 0.711 for fibre detection and (3) a mean intersection over union (mIoU) of 0.817 for myelin segmentation. Our software identified 323,298 nerve fibres and 782 fascicles in 70 WSIs. Small and large fibre populations were objectively determined based on clustering analysis. The demyelination group had large fibres with thinner myelin sheaths and higher g-ratios than the vasculitis group. The slope of the regression line from the scatter plots of the diameters and g-ratios was higher in the demyelination group than in the vasculitis group.

CONCLUSION

We developed an application that performs whole slide morphometry of human biopsy samples. Our open-source software can be used by clinicians and pathologists without specific machine learning skills, which we expect will facilitate data-driven analysis of sural nerve biopsies for a more detailed understanding of these diseases.

Blueprints from plane to space: outlook of next-generation three-dimensional histopathology

Here, we summarize the literature relevant to recent advances in three-dimensional (3D) histopathology in relation to clinical oncology, highlighting serial sectioning, tissue clearing, light-sheet microscopy, and digital image analysis with artificial intelligence. We look forward to a future where 3D histopathology expands our understanding of human pathophysiology and improves patient care through cross-disciplinary collaboration and innovation.

Deep Learning-Based Spermatogenic Staging in Tissue Sections of Cynomolgus Macaque Testes

The indirect assessment of adverse effects on fertility in cynomolgus monkeys requires that tissue sections of the testis be microscopically evaluated with awareness of the stage of spermatogenesis that a particular cross-section of a seminiferous tubule is in. This difficult and subjective task could very much benefit from automation. Using digital whole slide images (WSIs) from tissue sections of testis, we have developed a deep learning model that can annotate the stage of each tubule with high sensitivity, precision, and accuracy. The model was validated on six WSI using a six-stage spermatogenic classification system. Whole slide images contained an average number of 4938 seminiferous tubule cross-sections. On average, 78% of these tubules were staged with 29% in stage I-IV, 12% in stage V-VI, 4% in stage VII, 19% in stage VIII-IX, 18% in stage X-XI, and 17% in stage XII. The deep learning model supports pathologists in conducting a stage-aware evaluation of the testis. It also allows derivation of a stage-frequency map. The diagnostic value of this stage-frequency map is still unclear, as further data on its variability and relevance need to be generated for testes with spermatogenic disturbances.

Invisible for a few but essential for many: the role of Histotechnologists in the establishment of digital pathology

Digital pathology (DP) is indisputably the future for histopathology laboratories. The process of digital implementation requires deep workflow reorganisation which involves an interdisciplinary team. This transformation may have the greatest impact on the Histotechnologist (HTL) profession. Our review of the literature has clearly revealed that the role of HTLs in the establishment of DP is being unnoticed and guidance is limited. This article aims to bring HTLs from behind-the-scenes into the spotlight. Our objective is to provide them guidance and practical recommendations to successfully contribute to the implementation of a new digital workflow. Furthermore, it also intends to contribute for improvement of study programs, ensuring the role of HTL in DP is addressed as part of graduate and post-graduate education. In our review, we report on the differences encountered between workflow schemes and the limitations observed in this process. The authors propose a digital workflow to achieve its limitless potential, focusing on the HTL's role. This article explores the novel responsibilities of HTLs during specimen gross dissection, embedding, microtomy, staining, digital scanning, and whole slide image quality control. Furthermore, we highlight the benefits and challenges that DP implementation might bring the HTLs career. HTLs have an important role in the digital workflow: the responsibility of achieving the perfect glass slide.

Improved assessment of donor liver steatosis using Banff consensus recommendations and deep learning algorithms

BACKGROUND & AIMS

The Banff Liver Working Group recently published consensus recommendations for steatosis assessment in donor liver biopsy, but few studies reported their use and no automated deep-learning algorithms based on the proposed criteria have been developed so far. We evaluated Banff recommendations on a large monocentric series of donor liver needle biopsies by comparing pathologists' scores with those generated by convolutional neural networks (CNNs) we specifically developed for automated steatosis assessment.

METHODS

We retrospectively retrieved 292 allograft liver needle biopsies collected between January 2016 and January 2020 and performed steatosis assessment using a former intra-institution method (pre-Banff method) and the newly introduced Banff recommendations. Scores provided by pathologists and CNN models were then compared, and the degree of agreement was measured with the intraclass correlation coefficient (ICC).

RESULTS

Regarding the pre-Banff method, poor agreement was observed between the pathologist and CNN models for small droplet macrovesicular steatosis (ICC: 0.38), large droplet macrovesicular steatosis (ICC: 0.08), and the final combined score (ICC: 0.16) evaluation, but none of these reached statistically significance. Interestingly, significantly improved agreement was observed using the Banff approach: ICC was 0.93 for the low-power score (p <0.001), 0.89 for the high-power score (p <0.001), and 0.93 for the final score (p <0.001). Comparing the pre-Banff method with the Banff approach on the same biopsy, pathologist and CNN model assessment showed a mean (±SD) percentage of discrepancy of 26.89 (±22.16) and 1.20 (±5.58), respectively.

CONCLUSIONS

Our findings support the use of Banff recommendations in daily practice and highlight the need for a granular analysis of their effect on liver transplantation outcomes.

IMPACT AND IMPLICATIONS

We developed and validated the first automated deep-learning algorithms for standardized steatosis assessment based on the Banff Liver Working Group consensus recommendations. Our algorithm provides an unbiased automated evaluation of steatosis, which will lay the groundwork for granular analysis of steatosis's short- and long-term effects on organ viability, enabling the identification of clinically relevant steatosis cut-offs for donor organ acceptance. Implementing our algorithm in daily clinical practice will allow for a more efficient and safe allocation of donor organs, improving the post-transplant outcomes of patients.

Pathology in the Age of Artificial Intelligence (AI): Redefining Roles and Responsibilities for Tomorrow's Practitioners

The evolution of pathology from its rudimentary beginnings around 1700 BC to the present day has been marked by profound advancement in understanding and diagnosing diseases. This journey, from the earliest dissections to the modern era of histochemical analysis, sets the stage for the next transformative leap to the integration of artificial intelligence (AI) in pathology. Recent research highlights AI's significant potential to revolutionize healthcare within the next decade, with a particular impact on diagnostic processes. A majority of pathologists foresee AI becoming a cornerstone in diagnostic workflow, driven by the advent of image-based algorithms and computational pathology. These innovations promise to enhance the precision of disease diagnosis, particularly in complex cases, such as cancers, by offering detailed insights into the molecular and cellular mechanisms. Moreover, AI-assisted tools are improving the efficiency and accuracy of histological analysis by automating the evaluation of immunohistochemical biomarkers and tissue architecture. This shift not only accelerates diagnostic processes but also facilitates early disease management, crucial for improving patient outcomes. Furthermore, AI is reshaping educational paradigms in pathology, offering interactive learning environments that promise to enrich the training of future pathologists. Despite these advancements, the integration of AI in pathology raises ethical considerations regarding patient consent and data privacy. As pathology embarks on this AI-augmented era, it is imperative to navigate these challenges thoughtfully, ensuring that AI enhances rather than replaces the pathologist's role. This editorial discussed the historical progression of pathology, the current impact of AI on diagnostic practices, and the ethical implications of its adoption, underscoring the need for a symbiotic relationship between pathologists and AI to unlock the full potential of healthcare.

Magnifying Networks for Histopathological Images with Billions of Pixels

Amongst the other benefits conferred by the shift from traditional to digital pathology is the potential to use machine learning for diagnosis, prognosis, and personalization. A major challenge in the realization of this potential emerges from the extremely large size of digitized images, which are often in excess of 100,000 × 100,000 pixels. In this paper, we tackle this challenge head-on by diverging from the existing approaches in the literature-which rely on the splitting of the original images into small patches-and introducing magnifying networks (MagNets). By using an attention mechanism, MagNets identify the regions of the gigapixel image that benefit from an analysis on a finer scale. This process is repeated, resulting in an attention-driven coarse-to-fine analysis of only a small portion of the information contained in the original whole-slide images. Importantly, this is achieved using minimal ground truth annotation, namely, using only global, slide-level labels. The results from our tests on the publicly available Camelyon16 and Camelyon17 datasets demonstrate the effectiveness of MagNets-as well as the proposed optimization framework-in the task of whole-slide image classification. Importantly, MagNets process at least five times fewer patches from each whole-slide image than any of the existing end-to-end approaches.

A deep-learning workflow to predict upper tract urothelial carcinoma protein-based subtypes from H&E slides supporting the prioritization of patients for molecular testing

Upper tract urothelial carcinoma (UTUC) is a rare and aggressive, yet understudied, urothelial carcinoma (UC). The more frequent UC of the bladder comprises several molecular subtypes, associated with different targeted therapies and overlapping with protein-based subtypes. However, if and how these findings extend to UTUC remains unclear. Artificial intelligence-based approaches could help elucidate UTUC's biology and extend access to targeted treatments to a wider patient audience. Here, UTUC protein-based subtypes were identified, and a deep-learning (DL) workflow was developed to predict them directly from routine histopathological H&E slides. Protein-based subtypes in a retrospective cohort of 163 invasive tumors were assigned by hierarchical clustering of the immunohistochemical expression of three luminal (FOXA1, GATA3, and CK20) and three basal (CD44, CK5, and CK14) markers. Cluster analysis identified distinctive luminal (N = 80) and basal (N = 42) subtypes. The luminal subtype mostly included pushing, papillary tumors, whereas the basal subtype diffusely infiltrating, non-papillary tumors. DL model building relied on a transfer-learning approach by fine-tuning a pre-trained ResNet50. Classification performance was measured via three-fold repeated cross-validation. A mean area under the receiver operating characteristic curve of 0.83 (95% CI: 0.67-0.99), 0.8 (95% CI: 0.62-0.99), and 0.81 (95% CI: 0.65-0.96) was reached in the three repetitions. High-confidence DL-based predicted subtypes showed significant associations (p < 0.001) with morphological features, i.e. tumor type, histological subtypes, and infiltration type. Furthermore, a significant association was found with programmed cell death ligand 1 (PD-L1) combined positive score (p < 0.001) and FGFR3 mutational status (p = 0.002), with high-confidence basal predictions containing a higher proportion of PD-L1 positive samples and high-confidence luminal predictions a higher proportion of FGFR3-mutated samples. Testing of the DL model on an independent cohort highlighted the importance to accommodate histological subtypes. Taken together, our DL workflow can predict protein-based UTUC subtypes, associated with the presence of targetable alterations, directly from H&E slides.

Immunotherapy and lung cytopathology: Overview and possibilities

Immunotherapy has become a promising cancer treatment in the past decade, and IHC is the most commonly used testing method for PDL-1/PD1 evaluation. In general, PD-L1 assays can be performed on both FFPE specimens and cytological samples. However, their use on smears is not yet well-established or validated. Nowadays, digital images and advanced algorithms can aid in interpreting PD-L1 in cytological samples. Understanding the immune environment of non-small cell lung cancer (NSCLC) is critical in developing successful anticancer immunotherapies. The use of a multiplexed immunofluorescence (mIF) assay on cytological samples obtained through minimally invasive methods appears to be a viable option for investigating the immune environment of NSCLC. This review aims to briefly summarize the knowledge of the role of cytopathology in the analysis of PD-L1 by immunocytochemistry (ICC) and future directions of cytopathology in the immunotherapy setting.

Bridging bytes and biopsies: A comparative analysis of ChatGPT and histopathologists in pathology diagnosis and collaborative potential

BACKGROUND AND AIMS

ChatGPT is a powerful artificial intelligence (AI) chatbot developed by the OpenAI research laboratory which is capable of analysing human input and generating human-like responses. Early research into the potential application of ChatGPT in healthcare has focused mainly on clinical and administrative functions. The diagnostic ability and utility of ChatGPT in histopathology is not well defined. We benchmarked the performance of ChatGPT against pathologists in diagnostic histopathology, and evaluated the collaborative potential between pathologists and ChatGPT to deliver more accurate diagnoses.

METHODS AND RESULTS

In Part 1 of the study, pathologists and ChatGPT were subjected to a series of questions encompassing common diagnostic conundrums in histopathology. For Part 2, pathologists reviewed a series of challenging virtual slides and provided their diagnoses before and after consultation with ChatGPT. We found that ChatGPT performed worse than pathologists in reaching the correct diagnosis. Consultation with ChatGPT provided limited help and information generated from ChatGPT is dependent on the prompts provided by the pathologists and is not always correct. Finally, we surveyed pathologists who rated the diagnostic accuracy of ChatGPT poorly, but found it useful as an advanced search engine.

CONCLUSIONS

The use of ChatGPT4 as a diagnostic tool in histopathology is limited by its inherent shortcomings. Judicious evaluation of the information and histopathology diagnosis generated from ChatGPT4 is essential and cannot replace the acuity and judgement of a pathologist. However, future advances in generative AI may expand its role in the field of histopathology.

Tissue Contamination Challenges the Credibility of Machine Learning Models in Real World Digital Pathology

Machine learning (ML) models are poised to transform surgical pathology practice. The most successful use attention mechanisms to examine whole slides, identify which areas of tissue are diagnostic, and use them to guide diagnosis. Tissue contaminants, such as floaters, represent unexpected tissue. Although human pathologists are extensively trained to consider and detect tissue contaminants, we examined their impact on ML models. We trained 4 whole-slide models. Three operate in placenta for the following functions: (1) detection of decidual arteriopathy, (2) estimation of gestational age, and (3) classification of macroscopic placental lesions. We also developed a model to detect prostate cancer in needle biopsies. We designed experiments wherein patches of contaminant tissue are randomly sampled from known slides and digitally added to patient slides and measured model performance. We measured the proportion of attention given to contaminants and examined the impact of contaminants in the t-distributed stochastic neighbor embedding feature space. Every model showed performance degradation in response to one or more tissue contaminants. Decidual arteriopathy detection--balanced accuracy decreased from 0.74 to 0.69 ± 0.01 with addition of 1 patch of prostate tissue for every 100 patches of placenta (1% contaminant). Bladder, added at 10% contaminant, raised the mean absolute error in estimating gestational age from 1.626 weeks to 2.371 ± 0.003 weeks. Blood, incorporated into placental sections, induced false-negative diagnoses of intervillous thrombi. Addition of bladder to prostate cancer needle biopsies induced false positives, a selection of high-attention patches, representing 0.033 mm2, and resulted in a 97% false-positive rate when added to needle biopsies. Contaminant patches received attention at or above the rate of the average patch of patient tissue. Tissue contaminants induce errors in modern ML models. The high level of attention given to contaminants indicates a failure to encode biological phenomena. Practitioners should move to quantify and ameliorate this problem.

Advancing Artificial Intelligence Integration Into the Pathology Workflow: Exploring Opportunities in Gastrointestinal Tract Biopsies

This review aims to present a comprehensive overview of the current landscape of artificial intelligence (AI) applications in the analysis of tubular gastrointestinal biopsies. These publications cover a spectrum of conditions, ranging from inflammatory ailments to malignancies. Moving beyond the conventional diagnosis based on hematoxylin and eosin-stained whole-slide images, the review explores additional implications of AI, including its involvement in interpreting immunohistochemical results, molecular subtyping, and the identification of cellular spatial biomarkers. Furthermore, the review examines how AI can contribute to enhancing the quality and control of diagnostic processes, introducing new workflow options, and addressing the limitations and caveats associated with current AI platforms in this context.

Co-registration of MALDI-MSI and histology demonstrates gangliosides co-localize with amyloid beta plaques in Alzheimer's disease

Alzheimer's disease (AD) is a progressive neurological condition characterized by impaired cognitive function and behavioural alterations. While AD research historically centered around mis-folded proteins, advances in mass spectrometry techniques have triggered increased exploration of the AD lipidome with lipid dysregulation emerging as a critical player in AD pathogenesis. Gangliosides are a class of glycosphingolipids enriched within the central nervous system. Previous work has suggested a shift in a-series gangliosides from complex (GM1) to simple (GM2 and GM3) species may be related to the development of neurodegenerative disease. Additionally, complex gangliosides with 20 carbon sphingosine chains have been shown to increase in the aging brain. In this study, we utilized matrix assisted laser desorption ionization mass spectrometry imaging (MALDI-MSI) to interrogate the in situ relationship of a-series gangliosides with either 18 or 20 carbon sphingosine chains (d18:1 or d20:1 respectively) in the post-mortem human AD brain. Here, we expanded upon previous literature and demonstrated a significant decrease in the GM1 d20:1:GM1 d18:1 ratio in regions of the dentate gyrus and entorhinal cortex in AD relative to control brain tissue. Then we demonstrated that the MALDI-MSI profile of GM3 co-localizes with histologically confirmed amyloid beta (Aβ) plaques and found a significant increase in both GM1 and GM3 in proximity to Aβ plaques. Collectively these results support past literature and demonstrate a perturbation of the ganglioside profile in AD. Moreover, this work validates a pipeline for MALDI-MSI and classic histological staining in the same tissue sections. This demonstrates feasibility for integrating untargeted mass spectrometry imaging approaches into a digital pathology framework.

Digital Pathology Applications for PD-L1 Scoring in Head and Neck Squamous Cell Carcinoma: A Challenging Series

The assessment of programmed death-ligand 1 (PD-L1) combined positive scoring (CPS) in head and neck squamous cell carcinoma (HNSCC) is challenged by pre-analytical and inter-observer variabilities. An educational program to compare the diagnostic performances between local pathologists and a board of pathologists on 11 challenging cases from different Italian pathology centers stained with PD-L1 immunohistochemistry on a digital pathology platform is reported. A laboratory-developed test (LDT) using both 22C3 (Dako) and SP263 (Ventana) clones on Dako or Ventana platforms was compared with the companion diagnostic (CDx) Dako 22C3 pharm Dx assay. A computational approach was performed to assess possible correlations between stain features and pathologists' visual assessments. Technical discordances were noted in five cases (LDT vs. CDx, 45%), due to an abnormal nuclear/cytoplasmic diaminobenzidine (DAB) stain in LDT (n = 2, 18%) and due to variation in terms of intensity, dirty background, and DAB droplets (n = 3, 27%). Interpretative discordances were noted in six cases (LDT vs. CDx, 54%). CPS remained unchanged, increased, or decreased from LDT to CDx in three (27%) cases, two (18%) cases, and one (9%) case, respectively, around relevant cutoffs (1 and 20, k = 0.63). Differences noted in DAB intensity/distribution using computational pathology partly explained the LDT vs. CDx differences in two cases (18%). Digital pathology may help in PD-L1 scoring, serving as a second opinion consultation platform in challenging cases. Computational and artificial intelligence tools will improve clinical decision-making and patient outcomes.

Artificial intelligence-based algorithms for the diagnosis of prostate cancer: A systematic review

OBJECTIVES

The high incidence of prostate cancer causes prostatic samples to significantly affect pathology laboratories workflow and turnaround times (TATs). Whole-slide imaging (WSI) and artificial intelligence (AI) have both gained approval for primary diagnosis in prostate pathology, providing physicians with novel tools for their daily routine.

METHODS

A systematic review according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines was carried out in electronic databases to gather the available evidence on the application of AI-based algorithms to prostate cancer.

RESULTS

Of 6290 articles, 80 were included, mostly (59%) dealing with biopsy specimens. Glass slides were digitized to WSI in most studies (89%), roughly two-thirds of which (66%) exploited convolutional neural networks for computational analysis. The algorithms achieved good to excellent results about cancer detection and grading, along with significantly reduced TATs. Furthermore, several studies showed a relevant correlation between AI-identified histologic features and prognostic predictive variables such as biochemical recurrence, extraprostatic extension, perineural invasion, and disease-free survival.

CONCLUSIONS

The published evidence suggests that AI can be reliably used for prostate cancer detection and grading, assisting pathologists in the time-consuming screening of slides. Further technologic improvement would help widening AI's adoption in prostate pathology, as well as expanding its prognostic predictive potential.

Artificial intelligence-based analysis of tumor-infiltrating lymphocyte spatial distribution for colorectal cancer prognosis

BACKGROUND

Artificial intelligence (AI) technology represented by deep learning has made remarkable achievements in digital pathology, enhancing the accuracy and reliability of diagnosis and prognosis evaluation. The spatial distribution of CD3 + and CD8 + T cells within the tumor microenvironment has been demonstrated to have a significant impact on the prognosis of colorectal cancer (CRC). This study aimed to investigate CD3 CT (CD3 + T cells density in the core of the tumor [CT]) prognostic ability in patients with CRC by using AI technology.

METHODS

The study involved the enrollment of 492 patients from two distinct medical centers, with 358 patients assigned to the training cohort and an additional 134 patients allocated to the validation cohort. To facilitate tissue segmentation and T-cells quantification in whole-slide images (WSIs), a fully automated workflow based on deep learning was devised. Upon the completion of tissue segmentation and subsequent cell segmentation, a comprehensive analysis was conducted.

RESULTS

The evaluation of various positive T cell densities revealed comparable discriminatory ability between CD3 CT and CD3-CD8 (the combination of CD3 + and CD8 + T cells density within the CT and invasive margin) in predicting mortality (C-index in training cohort: 0.65 vs. 0.64; validation cohort: 0.69 vs. 0.69). The CD3 CT was confirmed as an independent prognostic factor, with high CD3 CT density associated with increased overall survival (OS) in the training cohort (hazard ratio [HR] = 0.22, 95% confidence interval [CI]: 0.12-0.38, P <0.001) and validation cohort (HR = 0.21, 95% CI: 0.05-0.92, P = 0.037).

CONCLUSIONS

We quantify the spatial distribution of CD3 + and CD8 + T cells within tissue regions in WSIs using AI technology. The CD3 CT confirmed as a stage-independent predictor for OS in CRC patients. Moreover, CD3 CT shows promise in simplifying the CD3-CD8 system and facilitating its practical application in clinical settings.

Keratin 17 modulates the immune topography of pancreatic cancer

Background

The immune microenvironment impacts tumor growth, invasion, metastasis, and patient survival and may provide opportunities for therapeutic intervention in pancreatic ductal adenocarcinoma (PDAC). Although never studied as a potential modulator of the immune response in most cancers, Keratin 17 (K17), a biomarker of the most aggressive (basal) molecular subtype of PDAC, is intimately involved in the histogenesis of the immune response in psoriasis, basal cell carcinoma, and cervical squamous cell carcinoma. Thus, we hypothesized that K17 expression could also impact the immune cell response in PDAC, and that uncovering this relationship could provide insight to guide the development of immunotherapeutic opportunities to extend patient survival.

Methods

Multiplex immunohistochemistry (mIHC) and automated image analysis based on novel computational imaging technology were used to decipher the abundance and spatial distribution of T cells, macrophages, and tumor cells, relative to K17 expression in 235 PDACs.

Results

K17 expression had profound effects on the exclusion of intratumoral CD8 + T cells and was also associated with decreased numbers of peritumoral CD8 + T cells, CD16 + macrophages, and CD163 + macrophages (p < 0.0001). The differences in the intratumor and peritumoral CD8 + T cell abundance were not impacted by neoadjuvant therapy, tumor stage, grade, lymph node status, histologic subtype, nor KRAS, p53, SMAD4, or CDKN2A mutations.

Conclusions

Thus, K17 expression correlates with major differences in the immune microenvironment that are independent of any tested clinicopathologic or tumor intrinsic variables, suggesting that targeting K17-mediated immune effects on the immune system could restore the innate immunologic response to PDAC and might provide novel opportunities to restore immunotherapeutic approaches for this most deadly form of cancer.

Quantitative Evaluation by Digital Pathology of Immunohistochemical Expression of CK7, CK19, and EpCAM in Advanced Stages of NASH

(1) Background: Nonalcoholic Steatohepatitis/Nonalcoholic Fatty Liver Disease (NASH/NAFLD) is the most recurrent chronic liver disease. NASH could present with a cholestatic (C) or hepatic (H) pattern of damage. Recently, we observed that increased Epithelial Cell Adhesion Molecule (EpCAM) expression was the main immunohistochemical feature to distinguish C from H pattern in NASH. (2) Methods: In the present study, we used digital pathology to compare the quantitative results of digital image analysis by QuPath software (Q-results), with the semi-quantitative results of observer assessment (S-results) for cytokeratin 7 and 19, (CK7, CK19) as well as EpCAM expression. Patients were classified into H or C group on the basis of the ratio between alanine transaminase (ALT) and alkaline phosphatase (ALP) values, using the "R-ratio formula". (3) Results: Q- and S-results showed a significant correlation for all markers (p < 0.05). Q-EpCAM expression was significantly higher in the C group than in the H group (p < 0.05). Importantly ALP, an indicator of hepatobiliary disorder, was the only biochemical parameter significantly correlated with Q-EpCAM. Instead, Q-CK7, but not Q-CK19, correlated only with γGlutamyl-Transferase (γGT). Of note, Stage 4 fibrosis correlated with Q-EpCAM, Q-CK19, and ALP but not with γGT or ALT. Conclusions: Image analysis confirms the relation between cholestatic-like pattern, associated with a worse prognosis, with increased ALP values, EpCAM positive biliary metaplasia, and advanced fibrosis. These preliminary data could be useful for the implementation of AI algorithms for the assessment of cholestatic NASH.

Banff scoring of kidney allograft biopsies: "Manual" application vs software-assisted sign-out

OBJECTIVES

Pathologists interpreting kidney allograft biopsies using the Banff system usually start by recording component scores (eg, i, t, cg) using histopathologic criteria committed to memory. Component scores are then melded into diagnoses using the same manual/mental processes. This approach to complex Banff rules during routine sign-out produces a lack of fidelity and needs improvement.

METHODS

We constructed a web-based "smart template" (software-assisted sign-out) system that uniquely starts with upstream Banff-defined additional diagnostic parameters (eg, infection) and histopathologic criteria (eg, percent interstitial inflammation) collectively referred to as feeder data that is then translated into component scores and integrated into final diagnoses using software-encoded decision trees.

RESULTS

Software-assisted sign-out enables pathologists to (1) accurately and uniformly apply Banff rules, thereby eliminating human inconsistencies (present in 25% of the cohort); (2) document areas of improvement; (3) show improved correlation with function; (4) examine t-Distributed Stochastic Neighbor Embedding clustering for diagnosis stratification; and (5) ready upstream incorporation of artificial intelligence-assisted scoring of biopsies.

CONCLUSIONS

Compared with the legacy approach, software-assisted sign-out improves Banff accuracy and fidelity, more closely correlates with kidney function, is practical for routine clinical work and translational research studies, facilitates downstream integration with nonpathology data, and readies biopsy scoring for artificial intelligence algorithms.

Keeping Pathologists in the Loop and an Adaptive F1-Score Threshold Method for Mitosis Detection in Canine Perivascular Wall Tumours

Performing a mitosis count (MC) is the diagnostic task of histologically grading canine Soft Tissue Sarcoma (cSTS). However, mitosis count is subject to inter- and intra-observer variability. Deep learning models can offer a standardisation in the process of MC used to histologically grade canine Soft Tissue Sarcomas. Subsequently, the focus of this study was mitosis detection in canine Perivascular Wall Tumours (cPWTs). Generating mitosis annotations is a long and arduous process open to inter-observer variability. Therefore, by keeping pathologists in the loop, a two-step annotation process was performed where a pre-trained Faster R-CNN model was trained on initial annotations provided by veterinary pathologists. The pathologists reviewed the output false positive mitosis candidates and determined whether these were overlooked candidates, thus updating the dataset. Faster R-CNN was then trained on this updated dataset. An optimal decision threshold was applied to maximise the F1-score predetermined using the validation set and produced our best F1-score of 0.75, which is competitive with the state of the art in the canine mitosis domain.

A Preliminary Investigation into Search and Matching for Tumor Discrimination in World Health Organization Breast Taxonomy Using Deep Networks

Breast cancer is one of the most common cancers affecting women worldwide. It includes a group of malignant neoplasms with a variety of biological, clinical, and histopathologic characteristics. There are more than 35 different histologic forms of breast lesions that can be classified and diagnosed histologically according to cell morphology, growth, and architecture patterns. Recently, deep learning, in the field of artificial intelligence, has drawn a lot of attention for the computerized representation of medical images. Searchable digital atlases can provide pathologists with patch-matching tools, allowing them to search among evidently diagnosed and treated archival cases, a technology that may be regarded as computational second opinion. In this study, we indexed and analyzed the World Health Organization breast taxonomy (Classification of Tumors fifth ed.) spanning 35 tumor types. We visualized all tumor types using deep features extracted from a state-of-the-art deep-learning model, pretrained on millions of diagnostic histopathology images from the Cancer Genome Atlas repository. Furthermore, we tested the concept of a digital "atlas" as a reference for search and matching with rare test cases. The patch similarity search within the World Health Organization breast taxonomy data reached >88% accuracy when validating through "majority vote" and >91% accuracy when validating using top n tumor types. These results show for the first time that complex relationships among common and rare breast lesions can be investigated using an indexed digital archive.

Artificial intelligence-assisted digital pathology for non-alcoholic steatohepatitis: current status and future directions

The worldwide prevalence of non-alcoholic steatohepatitis (NASH) is increasing, causing a significant medical burden, but no approved therapeutics are currently available. NASH drug development requires histological analysis of liver biopsies by expert pathologists for trial enrolment and efficacy assessment, which can be hindered by multiple issues including sample heterogeneity, inter-reader and intra-reader variability, and ordinal scoring systems. Consequently, there is a high unmet need for accurate, reproducible, quantitative, and automated methods to assist pathologists with histological analysis to improve the precision around treatment and efficacy assessment. Digital pathology (DP) workflows in combination with artificial intelligence (AI) have been established in other areas of medicine and are being actively investigated in NASH to assist pathologists in the evaluation and scoring of NASH histology. DP/AI models can be used to automatically detect, localise, quantify, and score histological parameters and have the potential to reduce the impact of scoring variability in NASH clinical trials. This narrative review provides an overview of DP/AI tools in development for NASH, highlights key regulatory considerations, and discusses how these advances may impact the future of NASH clinical management and drug development. This should be a high priority in the NASH field, particularly to improve the development of safe and effective therapeutics.

Investigation of Ki67 and Phospho-Histone H3 Expressions in Urothelial Carcinoma of the Bladder by Immunohistochemical Method

BACKGROUND

In our study, it is aimed to investigate the relationship between Ki67 and phospho-histone H3 (pHH3) expressions in bladder urothelial carcinomas, with clinicopathological parameters and survival, which have prognostic value.

METHODS

The study included 44 cases of high-grade urothelial carcinoma (HGUC), 37 cases of low-grade urothelial carcinoma (LGUC), and 11 nontumoral bladder cases. Ki67 and pHH3 were applied to the paraffin blocks of the tissues of 81 urothelial carcinoma and 11 nontumoral bladder cases by immunohistochemical method. Percentages of Ki67 and pHH3 expressions were evaluated by digital imaging analysis method. Expression percentages were compared with various clinicopathological parameters, and the relationship between them was evaluated.

RESULTS

Ki67 was expressed in 28% of urothelial carcinoma cases and 1% of nontumoral cases. pHH3 was expressed in 10.32% of urothelial carcinoma cases and 0.16% of nontumoral cases. In our study, we found significantly higher Ki67 and pHH3 expressions in urothelial carcinoma compared to nontumoral cases. There was a statistically significant relationship (p < 0.05) and a positive correlation between Ki67 expression and lymphovascular invasion, pT stage, and histological grade. A statistically significant relationship (p < 0.05) and a positive correlation were found between pHH3 expression and lymphovascular invasion, pT stage, recurrence, and histological grade. In addition, a statistically significant relationship was found between Ki67 and pHH3 expressions. In our study, survival was found to be low in high-grade urothelial carcinoma cases with lymphovascular invasion, advanced age (65 years and older), and high Ki67 and pHH3 expression rates.

CONCLUSIONS

According to our findings, high Ki67 and pHH3 expressions were found to be associated with poor prognostic parameters such as advanced pathologic stage, high histologic grade, and low survival. Our findings suggest that Ki67 and pHH3 may play a role in the differentiation, progression, and aggressive behavior of urothelial carcinoma. However, further studies are needed to confirm our findings and determine the role of these markers in urothelial carcinoma.

Endometrial Pipelle Biopsy Computer-Aided Diagnosis: A Feasibility Study

Endometrial biopsies are important in the diagnostic workup of women who present with abnormal uterine bleeding or hereditary risk of endometrial cancer. In general, approximately 10% of all endometrial biopsies demonstrate endometrial (pre)malignancy that requires specific treatment. As the diagnostic evaluation of mostly benign cases results in a substantial workload for pathologists, artificial intelligence (AI)-assisted preselection of biopsies could optimize the workflow. This study aimed to assess the feasibility of AI-assisted diagnosis for endometrial biopsies (endometrial Pipelle biopsy computer-aided diagnosis), trained on daily-practice whole-slide images instead of highly selected images. Endometrial biopsies were classified into 6 clinically relevant categories defined as follows: nonrepresentative, normal, nonneoplastic, hyperplasia without atypia, hyperplasia with atypia, and malignant. The agreement among 15 pathologists, within these classifications, was evaluated in 91 endometrial biopsies. Next, an algorithm (trained on a total of 2819 endometrial biopsies) rated the same 91 cases, and we compared its performance using the pathologist's classification as the reference standard. The interrater reliability among pathologists was moderate with a mean Cohen's kappa of 0.51, whereas for a binary classification into benign vs (pre)malignant, the agreement was substantial with a mean Cohen's kappa of 0.66. The AI algorithm performed slightly worse for the 6 categories with a moderate Cohen's kappa of 0.43 but was comparable for the binary classification with a substantial Cohen's kappa of 0.65. AI-assisted diagnosis of endometrial biopsies was demonstrated to be feasible in discriminating between benign and (pre)malignant endometrial tissues, even when trained on unselected cases. Endometrial premalignancies remain challenging for both pathologists and AI algorithms. Future steps to improve reliability of the diagnosis are needed to achieve a more refined AI-assisted diagnostic solution for endometrial biopsies that covers both premalignant and malignant diagnoses.

Reliability and Variability of Ki-67 Digital Image Analysis Methods for Clinical Diagnostics in Breast Cancer

Ki-67 is a nuclear protein associated with proliferation, and a strong potential biomarker in breast cancer, but is not routinely measured in current clinical management owing to a lack of standardization. Digital image analysis (DIA) is a promising technology that could allow high-throughput analysis and standardization. There is a dearth of data on the clinical reliability as well as intra- and interalgorithmic variability of different DIA methods. In this study, we scored and compared a set of breast cancer cases in which manually counted Ki-67 has already been demonstrated to have prognostic value (n = 278) to 5 DIA methods, namely Aperio ePathology (Lieca Biosystems), Definiens Tissue Studio (Definiens AG), Qupath, an unsupervised immunohistochemical color histogram algorithm, and a deep-learning pipeline piNET. The piNET system achieved high agreement (interclass correlation coefficient: 0.850) and correlation (R = 0.85) with the reference score. The Qupath algorithm exhibited a high degree of reproducibility among all rater instances (interclass correlation coefficient: 0.889). Although piNET performed well against absolute manual counts, none of the tested DIA methods classified common Ki-67 cutoffs with high agreement or reached the clinically relevant Cohen's κ of at least 0.8. The highest agreement achieved was a Cohen's κ statistic of 0.73 for cutoffs 20% and 25% by the piNET system. The main contributors to interalgorithmic variation and poor cutoff characterization included heterogeneous tumor biology, varying algorithm implementation, and setting assignments. It appears that image segmentation is the primary explanation for semiautomated intra-algorithmic variation, which involves significant manual intervention to correct. Automated pipelines, such as piNET, may be crucial in developing robust and reproducible unbiased DIA approaches to accurately quantify Ki-67 for clinical diagnosis in the future.

Ensemble Deep Learning Model to Predict Lymphovascular Invasion in Gastric Cancer

Lymphovascular invasion (LVI) is one of the most important prognostic factors in gastric cancer as it indicates a higher likelihood of lymph node metastasis and poorer overall outcome for the patient. Despite its importance, the detection of LVI(+) in histopathology specimens of gastric cancer can be a challenging task for pathologists as invasion can be subtle and difficult to discern. Herein, we propose a deep learning-based LVI(+) detection method using H&E-stained whole-slide images. The ConViT model showed the best performance in terms of both AUROC and AURPC among the classification models (AUROC: 0.9796; AUPRC: 0.9648). The AUROC and AUPRC of YOLOX computed based on the augmented patch-level confidence score were slightly lower (AUROC: -0.0094; AUPRC: -0.0225) than those of the ConViT classification model. With weighted averaging of the patch-level confidence scores, the ensemble model exhibited the best AUROC, AUPRC, and F1 scores of 0.9880, 0.9769, and 0.9280, respectively. The proposed model is expected to contribute to precision medicine by potentially saving examination-related time and labor and reducing disagreements among pathologists.

Diagnostic Challenges during Inflammation and Cancer: Current Biomarkers and Future Perspectives in Navigating through the Minefield of Reactive versus Dysplastic and Cancerous Lesions in the Digestive System

In the setting of pronounced inflammation, changes in the epithelium may overlap with neoplasia, often rendering it impossible to establish a diagnosis with certainty in daily clinical practice. Here, we discuss the underlying molecular mechanisms driving tissue response during persistent inflammatory signaling along with the potential association with cancer in the gastrointestinal tract, pancreas, extrahepatic bile ducts, and liver. We highlight the histopathological challenges encountered in the diagnosis of chronic inflammation in routine practice and pinpoint tissue-based biomarkers that could complement morphology to differentiate reactive from dysplastic or cancerous lesions. We refer to the advantages and limitations of existing biomarkers employing immunohistochemistry and point to promising new markers, including the generation of novel antibodies targeting mutant proteins, miRNAs, and array assays. Advancements in experimental models, including mouse and 3D models, have improved our understanding of tissue response. The integration of digital pathology along with artificial intelligence may also complement routine visual inspections. Navigating through tissue responses in various chronic inflammatory contexts will help us develop novel and reliable biomarkers that will improve diagnostic decisions and ultimately patient treatment.

Refining PD-1/PD-L1 assessment for biomarker-guided immunotherapy: A review

Anti-programmed cell death ligand 1 (anti-PD-L1)  immunotherapy is an increasingly crucial in cancer treatment. To date, the Federal Drug Administration (FDA) has approved four PD-L1 immunohistochemistry (IHC) staining protocols, commercially available in the form of "kits", facilitating testing for PD-L1 expression. These kits comprise four PD-L1 antibodies on two separate IHC platforms, each utilizing distinct, non-interchangeable scoring systems. Several factors, including tumor heterogeneity and the size of the tissue specimens assessed, can lead to PD-L1 status misclassification, potentially hindering the initiation of therapy. Therefore, the development of more accurate predictive biomarkers to distinguish between responders and non-responders prior to anti-PD-1/PD-L1 therapy warrants further research. Achieving this goal necessitates refining sampling criteria, enhancing current methods of PD-L1 detection, and deepening our understanding of the impact of additional biomarkers. In this article, we review potential solutions to improve the predictive accuracy of PD-L1 assessment in order to more precisely anticipate patients' responses to anti-PD-1/PD-L1 therapy, monitor disease progression and predict clinical outcomes.

Comparing Accuracy of Helicobacter pylori Identification Using Traditional Hematoxylin and Eosin-Stained Glass Slides With Digital Whole Slide Imaging

With advancements in the field of digital pathology, there has been a growing need to compare the diagnostic abilities of pathologists using digitized whole slide images against those when using traditional hematoxylin and eosin (H&E)-stained glass slides for primary diagnosis. One of the most common specimens received in pathology practices is an endoscopic gastric biopsy with a request to rule out Helicobacter pylori (H. pylori) infection. The current standard of care is the identification of the organisms on H&E-stained slides. Immunohistochemical or histochemical stains are used selectively. However, due to their small size (2-4 μm in length by 0.5-1 μm in width), visualization of the organisms can present a diagnostic challenge. The goal of the study was to compare the ability of pathologists to identify H. pylori on H&E slides using a digital platform against the gold standard of H&E glass slides using routine light microscopy. Diagnostic accuracy rates using glass slides vs digital slides were 81% vs 72% (P = .0142) based on H&E slides alone. When H. pylori immunohistochemical slides were provided, the diagnostic accuracy was significantly improved to comparable rates (96% glass vs 99% digital, P = 0.2199). Furthermore, differences in practice settings (academic/subspecialized vs community/general) and the duration of sign-out experience did not significantly impact the accuracy of detecting H. pylori on digital slides. We concluded that digital whole slide images, although amenable in different practice settings and teaching environments, does present some shortcomings in accuracy and precision, especially in certain circumstances and thus is not yet fully capable of completely replacing glass slide review for identification of H. pylori. We specifically recommend reviewing glass slides and/or performing ancillary stains, especially when there is a discrepancy between the degree of inflammation and the presence of microorganisms on digital images.

Identifying primary tumor site of origin for liver metastases via a combination of handcrafted and deep learning features

Liver is one of the most common sites for metastases, which can occur on account of primary tumors from multiple sites of origin. Identifying the primary site of origin (PSO) of a metastasis can help in guiding therapeutic options for liver metastases. In this pilot study, we hypothesized that computer extracted handcrafted (HC) histomorphometric features can be utilized to identify the PSO of liver metastases. Cellular features, including tumor nuclei morphological and graph features as well as cytoplasm texture features, were extracted by computer algorithms from 175 slides (114 patients). The study comprised three experiments: (1) comparing and (2) fusing a machine learning (ML) model trained with HC pathomic features and deep learning (DL)-based classifiers to predict site of origin; (3) identifying the section of the primary tumor from which metastases were derived. For experiment 1, we divided the cohort into training sets composed of primary and matched liver metastases [60 patients, 121 whole slide images (WSIs)], and a hold-out validation set (54 patients, 54 WSIs) composed solely of liver metastases of known site of origin. Using the extracted HC features of the training set, a combination of supervised machine classifiers and unsupervised clustering was applied to identify the PSO. A random forest classifier achieved areas under the curve (AUCs) of 0.83, 0.64, 0.82, and 0.64 in classifying the metastatic tumor from colon, esophagus, breast, and pancreas on the validation set. The top features related to nuclear and peri-nuclear shape and textural attributes. We also trained a DL network to serve as a direct comparison to our method. The DL model achieved AUCs for colon: 0.94, esophagus: 0.66, breast: 0.79, and pancreas: 0.67 in identifying PSO. A decision fusion-based strategy was deployed to fuse the trained ML and DL classifiers and achieved slightly better results than ML or DL classifier alone (colon: 0.93, esophagus: 0.68, breast: 0.81, and pancreas: 0.69). For the third experiment, WSI-level attention maps were also generated using a trained DL network to generate a composite feature similarity heat map between paired primaries and their associated metastases. Our experiments revealed that epithelium-rich and moderately differentiated tumor regions of primary tumors were quantitatively similar to paired metastatic tumors. Our findings suggest that a combination of HC and DL features could potentially help identify the PSO for liver metastases while at the same time also potentially identify the spatial sites of origin for the metastases within primary tumors.

Engineering the future of 3D pathology

In recent years, technological advances in tissue preparation, high-throughput volumetric microscopy, and computational infrastructure have enabled rapid developments in nondestructive 3D pathology, in which high-resolution histologic datasets are obtained from thick tissue specimens, such as whole biopsies, without the need for physical sectioning onto glass slides. While 3D pathology generates massive datasets that are attractive for automated computational analysis, there is also a desire to use 3D pathology to improve the visual assessment of tissue histology. In this perspective, we discuss and provide examples of potential advantages of 3D pathology for the visual assessment of clinical specimens and the challenges of dealing with large 3D datasets (of individual or multiple specimens) that pathologists have not been trained to interpret. We discuss the need for artificial intelligence triaging algorithms and explainable analysis methods to assist pathologists or other domain experts in the interpretation of these novel, often complex, large datasets.

A Multicenter Study Validates the WHO 2022 Classification for Conjunctival Melanocytic Intraepithelial Lesions With Clinical and Prognostic Relevance

Several nomenclature and grading systems have been proposed for conjunctival melanocytic intraepithelial lesions (C-MIL). The fourth "WHO Classification of Eye Tumors" (WHO-EYE04) proposed a C-MIL classification, capturing the progression of noninvasive neoplastic melanocytes from low- to high-grade lesions, onto melanoma in situ (MIS), and then to invasive melanoma. This proposal was revised to the WHO-EYE05 C-MIL system, which simplified the high-grade C-MIL, whereby MIS was subsumed into high-grade C-MIL. Our aim was to validate the WHO-EYE05 C-MIL system using digitized images of C-MIL, stained with hematoxylin and eosin and immunohistochemistry. However, C-MIL cases were retrieved from 3 supraregional ocular pathology centers. Adequate conjunctival biopsies were stained with hematoxylin and eosin, Melan-A, SOX10, and PReferentially expressed Antigen in Melanoma. Digitized slides were uploaded on the SmartZoom platform and independently scored by 4 ocular pathologists to obtain a consensus score, before circulating to 14 expert eye pathologists for independent scoring. In total, 105 cases from 97 patients were evaluated. The initial consensus diagnoses using the WHO-EYE04 C-MIL system were as follows: 28 benign conjunctival melanoses, 13 low-grade C-MIL, 37 high-grade C-MIL, and 27 conjunctival MIS. Using this system resulted in 93% of the pathologists showing only fair-to-moderate agreement (kappa statistic) with the consensus score. The WHO-EYE05 C-MIL system (with high-grade C-MIL and MIS combined) improved consistency between pathologists, with the greatest level of agreement being seen with benign melanosis (74.5%) and high-grade C-MIL (85.4%). Lowest agreements remained between pathologists for low-grade C-MIL (38.7%). Regarding WHO-EYE05 C-MIL scoring and clinical outcomes, local recurrences of noninvasive lesions developed in 8% and 34% of the low- and high-grade cases. Invasive melanoma only occurred in 47% of the cases that were assessed as high-grade C-MIL. This extensive international collaborative study is the first to undertake a comprehensive review of the WHO-EYE05 C-MIL scoring system, which showed good interobserver agreement and reproducibility.

Artificial Intelligence in Predicting Microsatellite Instability and KRAS, BRAF Mutations from Whole-Slide Images in Colorectal Cancer: A Systematic Review

Mismatch repair deficiency (d-MMR)/microsatellite instability (MSI), KRAS, and BRAF mutational status are crucial for treating advanced colorectal cancer patients. Traditional methods like immunohistochemistry or polymerase chain reaction (PCR) can be challenged by artificial intelligence (AI) based on whole slide images (WSI) to predict tumor status. In this systematic review, we evaluated the role of AI in predicting MSI status, KRAS, and BRAF mutations in colorectal cancer. Studies published in PubMed up to June 2023 were included (n = 17), and we reported the risk of bias and the performance for each study. Some studies were impacted by the reduced number of slides included in the data set and the lack of external validation cohorts. Deep learning models for the d-MMR/MSI status showed a good performance in training cohorts (mean AUC = 0.89, [0.74-0.97]) but slightly less than expected in the validation cohort when available (mean AUC = 0.82, [0.63-0.98]). Contrary to the MSI status, the prediction of KRAS and BRAF mutations was less explored with a less robust methodology. The performance was lower, with a maximum of 0.77 in the training cohort, 0.58 in the validation cohort for KRAS, and 0.82 AUC in the training cohort for BRAF.

Improving HCC Prognostic Models after Liver Resection by AI-Extracted Tissue Fiber Framework Analytics

Despite advances in diagnostic and treatment technologies, predicting outcomes of patients with hepatocellular carcinoma (HCC) remains a challenge. Prognostic models are further obscured by the variable impact of the tumor properties and the remaining liver parenchyma, often affected by cirrhosis or non-alcoholic fatty liver disease that tend to precede HCC. This study investigated the prognostic value of reticulin and collagen microarchitecture in liver resection samples. We analyzed 105 scanned tissue sections that were stained using a Gordon and Sweet's silver impregnation protocol combined with Picric Acid-Sirius Red. A convolutional neural network was utilized to segment the red-staining collagen and black linear reticulin strands, generating a detailed map of the fiber structure within the HCC and adjacent liver tissue. Subsequent hexagonal grid subsampling coupled with automated epithelial edge detection and computational fiber morphometry provided the foundation for region-specific tissue analysis. Two penalized Cox regression models using LASSO achieved a concordance index (C-index) greater than 0.7. These models incorporated variables such as patient age, tumor multifocality, and fiber-derived features from the epithelial edge in both the tumor and liver compartments. The prognostic value at the tumor edge was derived from the reticulin structure, while collagen characteristics were significant at the epithelial edge of peritumoral liver. The prognostic performance of these models was superior to models solely reliant on conventional clinicopathologic parameters, highlighting the utility of AI-extracted microarchitectural features for the management of HCC.

Artificial intelligence-based morphometric signature to identify ductal carcinoma in situ with low risk of progression to invasive breast cancer

Ductal carcinoma in situ (DCIS) may progress to ipsilateral invasive breast cancer (iIBC), but often never will. Because DCIS is treated as early breast cancer, many women with harmless DCIS face overtreatment. To identify these women that may forego treatment, we hypothesized that DCIS morphometric features relate to the risk of subsequent iIBC. We developed an artificial intelligence-based DCIS morphometric analysis pipeline (AIDmap) to detect DCIS as a pathologist and measure morphological structures in hematoxylin-eosin-stained (H&E) tissue sections. These were from a case-control study of patients diagnosed with primary DCIS, treated by breast-conserving surgery without radiotherapy. We analyzed 689 WSIs of DCIS of which 226 were diagnosed with subsequent iIBC (cases) and 463 were not (controls). The distribution of 15 duct morphological measurements in each H&E was summarized in 55 morphometric variables. A ridge regression classifier with cross validation predicted 5-years-free of iIBC with an area-under the curve of 0.65 (95% CI 0.55-0.76). A morphometric signature based on the 30 variables most associated with outcome, identified lesions containing small-sized ducts, low number of cells and low DCIS/stroma area ratio. This signature was associated with lower iIBC risk in a multivariate regression model including grade, ER, HER2 and COX-2 expression (HR = 0.56; 95% CI 0.28-0.78). AIDmap has potential to identify harmless DCIS that may not need treatment.

Evaluation of A Computer-Aided Detection Software for Prostate Cancer Prediction: Excellent Diagnostic Accuracy Independent of Preanalytical Factors

Prostate cancer (PCa) is the most common noncutaneous cancer in men in the Western world. In addition to accurate diagnosis, Gleason grading and tumor volume estimates are critical for patient management. Computer-aided detection (CADe) software can be used to facilitate the diagnosis and improve the diagnostic accuracy and reporting consistency. However, preanalytical factors such as fixation and staining of prostate biopsy specimens and whole slide images (WSI) on scanners can vary significantly between pathology laboratories and may, therefore, impact the quality of WSI and utility of CADe algorithms. We evaluated the performance of a CADe software in predicting PCa on WSIs of prostate biopsy specimens and focused on whether there were any significant differences in image quality between WSIs obtained on different scanners and specimens from different histopathology laboratories. Thirty prostate biopsy specimens from 2 histopathology laboratories in the United States were included in this study. The hematoxylin and eosin slides of the biopsy specimens were scanned on 3 scanners, generating 90 WSIs. These WSIs were then analyzed using a CADe software (INIFY Prostate, Algorithm), which identified and annotated all areas suspicious for PCa and calculated the tumor volume (percentage area of the biopsy core involved). Study pathologists then reviewed the Algorithm's annotations and tumor volume calculation to confirm the diagnosis and identify benign glands that were misclassified as cancer (false positive) and cancer glands that were misclassified as benign (false negative). The CADe software worked equally well on WSIs from all 3 scanners and from both laboratories, with similar sensitivity and specificity. The overall sensitivity was 99.4%, and specificity was 97%. The percentage of suspicious cancer areas calculated by the Algorithm was similar for all 3 scanners. For WSIs with small foci of cancer (<1 mm), the Algorithm identified all cancer glands (sensitivity, 100%). Preanalytical factors had no significant impact on whole slide imaging and subsequent application of a CADe software. Prediction accuracy could potentially be further improved by processing biopsy specimens in a centralized histology laboratory and training the Algorithm on WSIs from the same laboratory in order to minimize variations in preanalytical factors and optimize the diagnostic performance of the Algorithm.

National resident survey in dermatopathology: The role of slide scanners in resident learning

BACKGROUND

Dermatology residents gain exposure to dermatopathology through a variety of educational modalities. While virtual pathology applications have risen dramatically, resident utilization of digital libraries, slide scanner availability, and comfort with virtual slides are not well-known. This study aims to assess the current landscape of educational resources used by dermatology residents.

METHODS

A 17-question survey was sent to dermatology residents through a national email database. The survey was a self-assessment of their experience in dermatopathology education and the use of departmental slide scanners.

RESULTS

The use of digital dermatopathology is high among trainees, despite only half of respondents reporting slide scanner access. Residents report using virtual images more often in non-clinical dermatopathology didactics and independent studies compared to clinical dermatopathology rotations. Public slide set use was common, while professional society and departmental slide sets may be underutilized. Over half of respondents report being extremely or very comfortable navigating interactive scanned slides.

CONCLUSIONS

Survey data suggests digital slides are currently predominantly used in non-clinical dermatopathology rotations and independent studies. Incorporation of slide scanners into departments may benefit resident education through the development of high-quality, curated departmental slide sets.

Natural Language Processing to extract SNOMED-CT codes from pathological reports

Objective

The use of standardized structured reports (SSR) and suitable terminologies like SNOMED-CT can enhance data retrieval and analysis, fostering large-scale studies and collaboration. However, the still large prevalence of narrative reports in our laboratories warrants alternative and automated labeling approaches. In this project, natural language processing (NLP) methods were used to associate SNOMED-CT codes to structured and unstructured reports from an Italian Digital Pathology Department.

Methods

Two NLP-based automatic coding systems (support vector machine, SVM, and long-short term memory, LSTM) were trained and applied to a series of narrative reports.

Results

The 1163 cases were tested with both algorithms, showing good performances in terms of accuracy, precision, recall, and F1 score, with SVM showing slightly better performances as compared to LSTM (0.84, 0.87, 0.83, 0.82 vs 0.83, 0.85, 0.83, 0.82, respectively). The integration of an explainability allowed identification of terms and groups of words of importance, enabling fine-tuning, balancing semantic meaning and model performance.

Conclusions

AI tools allow the automatic SNOMED-CT labeling of the pathology archives, providing a retrospective fix to the large lack of organization of narrative reports.