Developing a Qualification and Verification Strategy for Digital Tissue Image Analysis in Toxicological Pathology

Invisible for a few but essential for many: the role of Histotechnologists in the establishment of digital pathology

Digital pathology (DP) is indisputably the future for histopathology laboratories. The process of digital implementation requires deep workflow reorganisation which involves an interdisciplinary team. This transformation may have the greatest impact on the Histotechnologist (HTL) profession. Our review of the literature has clearly revealed that the role of HTLs in the establishment of DP is being unnoticed and guidance is limited. This article aims to bring HTLs from behind-the-scenes into the spotlight. Our objective is to provide them guidance and practical recommendations to successfully contribute to the implementation of a new digital workflow. Furthermore, it also intends to contribute for improvement of study programs, ensuring the role of HTL in DP is addressed as part of graduate and post-graduate education. In our review, we report on the differences encountered between workflow schemes and the limitations observed in this process. The authors propose a digital workflow to achieve its limitless potential, focusing on the HTL's role. This article explores the novel responsibilities of HTLs during specimen gross dissection, embedding, microtomy, staining, digital scanning, and whole slide image quality control. Furthermore, we highlight the benefits and challenges that DP implementation might bring the HTLs career. HTLs have an important role in the digital workflow: the responsibility of achieving the perfect glass slide.

Building a nonclinical pathology laboratory of the future for pharmaceutical research excellence

We describe a roadmap for a fully digital artificial intelligence (AI)-augmented nonclinical pathology laboratory across three continents. Underpinning the design are Good Laboratory Practice (GLP)-validated laboratory information management systems (LIMS), whole slide-scanners (WSS), image management systems (IMS), and a digital microscope intended for use by the nonclinical pathologist. Digital diagnostics are supported by tools that include AI-based virtual staining and deep learning-based decision support. Implemented during the COVID-19 pandemic, the initial digitized workflow largely mitigated disruption of pivotal nonclinical studies required to support pharmaceutical clinical testing. We believe that this digital transformation of our nonclinical pathology laboratories will promote efficiency and innovation in the future and enhance the quality and speed of drug development decision making.

Analysis of cellularity in H&E-stained rat bone marrow tissue via deep learning

Our objective was to develop an automated deep-learning-based method to evaluate cellularity in rat bone marrow hematoxylin and eosin whole slide images for preclinical safety assessment. We trained a shallow CNN for segmenting marrow, 2 Mask R-CNN models for segmenting megakaryocytes (MKCs), and small hematopoietic cells (SHCs), and a SegNet model for segmenting red blood cells. We incorporated the models into a pipeline that identifies and counts MKCs and SHCs in rat bone marrow. We compared cell segmentation and counts that our method generated to those that pathologists generated on 10 slides with a range of cell depletion levels from 10 studies. For SHCs, we compared cell counts that our method generated to counts generated by Cellpose and Stardist. The median Dice and object Dice scores for MKCs using our method vs pathologist consensus and the inter- and intra-pathologist variation were comparable, with overlapping first-third quartile ranges. For SHCs, the median scores were close, with first-third quartile ranges partially overlapping intra-pathologist variation. For SHCs, in comparison to Cellpose and Stardist, counts from our method were closer to pathologist counts, with a smaller 95% limits of agreement range. The performance of the bone marrow analysis pipeline supports its incorporation into routine use as an aid for hematotoxicity assessment by pathologists. The pipeline could help expedite hematotoxicity assessment in preclinical studies and consequently could expedite drug development. The method may enable meta-analysis of rat bone marrow characteristics from future and historical whole slide images and may generate new biological insights from cross-study comparisons.

Assessment of Skin Toxicity in an in Vitro Reconstituted Human Epidermis Model Using Deep Learning

Skin toxicity is a common safety concern associated with drugs that inhibit epidermal growth factor receptors as well as other targets involved in epidermal growth and differentiation. Recently, the use of a three-dimensional reconstructed human epidermis model enabled large-scale drug screening and showed potential for predicting skin toxicity. Although a decrease in epidermal thickness was often observed when the three-dimensional reconstructed tissues were exposed to drugs causing skin toxicity, the thickness evaluation of epidermal layers from a pathologist was subjective and not easily reproducible or scalable. In addition, the subtle differences in thickness among tissues, as well as the large number of samples tested, made cross-study comparison difficult when a manual evaluation strategy was used. The current study used deep learning and image-processing algorithms to measure the viable epidermal thickness from multiple studies and found that the measured thickness was not only significantly correlated with a pathologist's semi-quantitative evaluation but was also in close agreement with the quantitative measurement performed by pathologists. Moreover, a sensitivity of 0.8 and a specificity of 0.75 were achieved when predicting the toxicity of 18 compounds with clinical observations with these epidermal thickness algorithms. This approach is fully automated, reproducible, and highly scalable. It not only shows reasonable accuracy in predicting skin toxicity but also enables cross-study comparison and high-throughput compound screening.

Canine Vaginal Cytology: A Revised Definition of Exfoliated Vaginal Cells

Vaginal cytology is an important examination method in the context of gynecological disorders and cycle staging in the bitch. While collection and preparation of samples are easy, the evaluation appears to be challenging. Inconsistent definitions of cell attributes such as size, cornification and the appearance of the nucleus have been published. The aim of the project was to develop a tutorial for vaginal cell determination. To get a deeper insight into the use of cytology in practice, an online survey was distributed to veterinarians interested in small animal reproduction. Participants were asked to define eight cells and answer questions. The agreement of the 16 participants, working in eight different countries, determining the cells was poor (κ = 0.412). Eleven respondents stated that vaginal cytology has a low reliability. Nevertheless, 13 participants use this tool regularly. The tutorial was developed as a flowchart based on the survey results, scientific literature and own measurements. It guides the user systematically through the evaluation of specific cell characteristics. An evaluation of the results of five raters with difference experience levels led to a high agreement (κ = 0.858). Vaginal cytology is a useful diagnostic tool, but it seems helpful to standardize the determination of cell types.

Quantification of Hepatocellular Mitoses in a Toxicological Study in Rats Using a Convolutional Neural Network

Convolutional neural networks (CNNs) have been recognized as valuable tools for rapid quantitative analysis of morphological changes in toxicologic histopathology. We have assessed the performance of CNN-based (Halo-AI) mitotic figure detection in hepatocytes in comparison with detection by pathologists. In addition, we compared with Ki-67 and 5-bromodesoxyuridin (BrdU) immunohistochemistry labeling indices (LIs) obtained by image analysis. Tissues were from an exploratory toxicity study with a glycogen synthase kinase-3 (GSK-3) inhibitor. Our investigations revealed that (1) the CNN achieved similarly accurate but faster results than pathologists, (2) results of mitotic figure detection were comparable to Ki-67 and BrdU LIs, and (3) data from different methods were only moderately correlated. The latter is likely related to differences in the cell cycle component captured by each method. This highlights the importance of considering the differences of the available methods upon selection. Also, the pharmacology of our test item acting as a GSK-3 inhibitor potentially reduced the correlation. We conclude that hepatocyte cell proliferation assessment by CNNs can have several advantages when compared with the current gold standard: it relieves the pathologist of tedious routine tasks and contributes to standardization of results; the CNN algorithm can be shared and iteratively improved; it can be performed on routine histological slides; it does not require an additional animal experiment and in this way can contribute to animal welfare according to the 3R principles.

Deep Learning Approaches and Applications in Toxicologic Histopathology: Current Status and Future Perspectives

Whole slide imaging enables the use of a wide array of digital image analysis tools that are revolutionizing pathology. Recent advances in digital pathology and deep convolutional neural networks have created an enormous opportunity to improve workflow efficiency, provide more quantitative, objective, and consistent assessments of pathology datasets, and develop decision support systems. Such innovations are already making their way into clinical practice. However, the progress of machine learning - in particular, deep learning (DL) - has been rather slower in nonclinical toxicology studies. Histopathology data from toxicology studies are critical during the drug development process that is required by regulatory bodies to assess drug-related toxicity in laboratory animals and its impact on human safety in clinical trials. Due to the high volume of slides routinely evaluated, low-throughput, or narrowly performing DL methods that may work well in small-scale diagnostic studies or for the identification of a single abnormality are tedious and impractical for toxicologic pathology. Furthermore, regulatory requirements around good laboratory practice are a major hurdle for the adoption of DL in toxicologic pathology. This paper reviews the major DL concepts, emerging applications, and examples of DL in toxicologic pathology image analysis. We end with a discussion of specific challenges and directions for future research.

Whole-slide imaging, tissue image analysis, and artificial intelligence in veterinary pathology: An updated introduction and review

Since whole-slide imaging has been commercially available for over 2 decades, digital pathology has become a constantly expanding aspect of the pathology profession that will continue to significantly impact how pathologists conduct their craft. While some aspects, such as whole-slide imaging for archiving, consulting, and teaching, have gained broader acceptance, other facets such as quantitative tissue image analysis and artificial intelligence-based assessments are still met with some reservations. While most vendors in this space have focused on diagnostic applications, that is, viewing one or few slides at a time, some are developing solutions tailored more specifically to the various aspects of veterinary pathology including updated diagnostic, discovery, and research applications. This has especially advanced the use of digital pathology in toxicologic pathology and drug development, for primary reads as well as peer reviews. It is crucial that pathologists gain a deeper understanding of digital pathology and tissue image analysis technology and their applications in order to fully use these tools in a way that enhances and improves the pathologist's assessment as well as work environment. This review focuses on an updated introduction to the basics of digital pathology and image analysis and introduces emerging topics around artificial intelligence and machine learning.

Tissue Multiplex Analyte Detection in Anatomic Pathology - Pathways to Clinical Implementation

Background: Multiplex tissue analysis has revolutionized our understanding of the tumor microenvironment (TME) with implications for biomarker development and diagnostic testing. Multiplex labeling is used for specific clinical situations, but there remain barriers to expanded use in anatomic pathology practice.

Methods: We review immunohistochemistry (IHC) and related assays used to localize molecules in tissues, with reference to United States regulatory and practice landscapes. We review multiplex methods and strategies used in clinical diagnosis and in research, particularly in immuno-oncology. Within the framework of assay design and testing phases, we examine the suitability of multiplex immunofluorescence (mIF) for clinical diagnostic workflows, considering its advantages and challenges to implementation.

Results: Multiplex labeling is poised to radically transform pathologic diagnosis because it can answer questions about tissue-level biology and single-cell phenotypes that cannot be addressed with traditional IHC biomarker panels. Widespread implementation will require improved detection chemistry, illustrated by InSituPlex technology (Ultivue, Inc., Cambridge, MA) that allows coregistration of hematoxylin and eosin (H&E) and mIF images, greater standardization and interoperability of workflow and data pipelines to facilitate consistent interpretation by pathologists, and integration of multichannel images into digital pathology whole slide imaging (WSI) systems, including interpretation aided by artificial intelligence (AI). Adoption will also be facilitated by evidence that justifies incorporation into clinical practice, an ability to navigate regulatory pathways, and adequate health care budgets and reimbursement. We expand the brightfield WSI system “pixel pathway” concept to multiplex workflows, suggesting that adoption might be accelerated by data standardization centered on cell phenotypes defined by coexpression of multiple molecules.

Conclusion: Multiplex labeling has the potential to complement next generation sequencing in cancer diagnosis by allowing pathologists to visualize and understand every cell in a tissue biopsy slide. Until mIF reagents, digital pathology systems including fluorescence scanners, and data pipelines are standardized, we propose that diagnostic labs will play a crucial role in driving adoption of multiplex tissue diagnostics by using retrospective data from tissue collections as a foundation for laboratory-developed test (LDT) implementation and use in prospective trials as companion diagnostics (CDx).

Mini Review: The Last Mile-Opportunities and Challenges for Machine Learning in Digital Toxicologic Pathology

The 2019 manuscript by the Special Interest Group on Digital Pathology and Image Analysis of the Society of Toxicologic pathology suggested that a synergism between artificial intelligence (AI) and machine learning (ML) technologies and digital toxicologic pathology would improve the daily workflow and future impact of toxicologic pathologists globally. Now 2 years later, the authors of this review consider whether, in their opinion, there is any evidence that supports that thesis. Specifically, we consider the opportunities and challenges for applying ML (the study of computer algorithms that are able to learn from example data and extrapolate the learned information to unseen data) algorithms in toxicologic pathology and how regulatory bodies are navigating this rapidly evolving field. Although we see similarities with the "Last Mile" metaphor, the weight of evidence suggests that toxicologic pathologists should approach ML with an equal dose of skepticism and enthusiasm. There are increasing opportunities for impact in our field that leave the authors cautiously excited and optimistic. Toxicologic pathologists have the opportunity to critically evaluate ML applications with a "call-to-arms" mentality. Why should we be late adopters? There is ample evidence to encourage engagement, growth, and leadership in this field.