Deep learning detection of melanoma metastases in lymph nodes

Advancements and implications of artificial intelligence for early detection, diagnosis and tailored treatment of cancer

The complexity and heterogeneity of cancer makes early detection and effective treatment crucial to enhance patient survival and quality of life. The intrinsic creative ability of artificial intelligence (AI) offers improvements in patient screening, diagnosis, and individualized care. Advanced technologies, like computer vision, machine learning, deep learning, and natural language processing, can analyze large datasets and identify patterns that permit early cancer detection, diagnosis, management and incorporation of conclusive treatment plans, ensuring improved quality of life for patients by personalizing care and minimizing unnecessary interventions. Genomics, transcriptomics and proteomics data can be combined with AI algorithms to unveil an extensive overview of cancer biology, assisting in its detailed understanding and will help in identifying new drug targets and developing effective therapies. This can also help to identify personalized molecular signatures which can facilitate tailored interventions addressing the unique aspects of each patient. AI-driven transcriptomics, proteomics, and genomes represents a revolutionary strategy to improve patient outcome by offering precise diagnosis and tailored therapy. The inclusion of AI in oncology may boost efficiency, reduce errors, and save costs, but it cannot take the role of medical professionals. While clinicians and doctors have the final say in all matters, it might serve as their faithful assistant.

Artificial Intelligence and Convolutional Neural Networks-Driven Detection of Micro and Macro Metastasis of Cutaneous Melanoma to the Lymph Nodes

BACKGROUND

Lymph node (LN) assessment is a critical component in the staging and management of cutaneous melanoma. Traditional histopathological evaluation, supported by immunohistochemical staining, is the gold standard for detecting LN metastases. However, the process is labor-intensive, requiring the analysis of multiple tissue levels, which increases both time and cost. With the growing integration of artificial intelligence (AI) into clinical workflows, there is potential to streamline this process, enhancing efficiency and accuracy.

METHOD

This study analyzed 53 WSIs (12 negative samples). Images are all derived from hematoxylin-eosin (H&E) stains and were uploaded to the Orca AI cloud-based platform (SpatialX Diagnostics, Inc.), a commercially available platform specifically designed for AI pathology. An AI-driven model was developed and trained to detect melanoma metastases directly from H&E histopathological images, bypassing additional immunohistochemical staining. The algorithm was designed to identify the presence of metastases and classify tumor deposits based on size, specifically distinguishing deposits greater than 0.1 mm and less than 1.0 mm in diameter, which are critical thresholds for prognostic evaluation. The model was validated on 9 WSIs (2 negative) that were not seen by the model. For every WSI in the validation set, one of the following 4 classes was assigned: normal, metastasis (<0.1 mm), metastasis (0.1-1 mm), and metastasis (>1 mm). The class corresponding to the highest metastasis size range was assigned to the whole sample. The results were then examined by a board-certified pathologist.

RESULTS

The AI algorithm demonstrated high accuracy in detecting LN metastases in patients with melanoma. It effectively identified and classified tumor deposits with a specificity of 0.91 and a sensitivity of 0.74. The model also distinguishes between smaller deposits (>0.1 mm) and larger deposits (>1.0 mm). This stratification is essential for accurate staging, prognosis determination, and treatment planning, highlighting the algorithm's potential clinical value. When evaluating the model performance in the WSI classification tasks, the model showed high agreement with the pathologist's classification, correctly identifying 7 WSIs as metastasis (>1 mm) and labeling 1 normal WSI as metastasis (0.7 mm).

CONCLUSION

The study's findings underscore the potential of AI in revolutionizing the detection of melanoma metastasis in lymph nodes. By significantly reducing the reliance on time-consuming and costly immunohistochemical staining, AI-driven tools can streamline diagnostic workflows, improve accuracy, and potentially enhance patient outcomes. As AI technology continues to evolve, its application in melanoma management could become a cornerstone of modern pathology, offering a powerful adjunct to traditional diagnostic methods.

[State of digitalization in dermatopathology]

As in general pathology, digitalization is also inexorably making its way into dermatopathology. This article examines the current state of digitalization in German dermatopathology laboratories based on the authors' own experiences, the current study situation, and a survey of members of the Dermatological Histology Working Group (ADH). Experiences with the establishment of a digital laboratory workflow, artificial intelligence (AI)-based assistance systems, and whole slide images (WSI)-based training programs are discussed. Digitalization in dermatopathology is an opportunity to simplify and accelerate processes, but there are some hurdles to overcome.

Computational methods for metastasis detection in lymph nodes and characterization of the metastasis-free lymph node microarchitecture: A systematic-narrative hybrid review

Background

Histological examination of tumor draining lymph nodes (LNs) plays a vital role in cancer staging and prognostication. However, as soon as a LN is classed as metastasis-free, no further investigation will be performed and thus, potentially clinically relevant information detectable in tumor-free LNs is currently not captured.

Objective

To systematically study and critically assess methods for the analysis of digitized histological LN images described in published research.

Methods

A systematic search was conducted in several public databases up to December 2023 using relevant search terms. Studies using brightfield light microscopy images of hematoxylin and eosin or immunohistochemically stained LN tissue sections aiming to detect and/or segment LNs, their compartments or metastatic tumor using artificial intelligence (AI) were included. Dataset, AI methodology, cancer type, and study objective were compared between articles.

Results

A total of 7201 articles were collected and 73 articles remained for detailed analyses after article screening. Of the remaining articles, 86% aimed at LN metastasis identification, 8% aimed at LN compartment segmentation, and remaining focused on LN contouring. Furthermore, 78% of articles used patch classification and 22% used pixel segmentation models for analyses. Five out of six studies (83%) of metastasis-free LNs were performed on publicly unavailable datasets, making quantitative article comparison impossible.

Conclusions

Multi-scale models mimicking multiple microscopy zooms show promise for computational LN analysis. Large-scale datasets are needed to establish the clinical relevance of analyzing metastasis-free LN in detail. Further research is needed to identify clinically interpretable metrics for LN compartment characterization.

Artificial Intelligence-Based Sentinel Lymph Node Metastasis Detection in Cervical Cancer

Background/objectives: Pathological ultrastaging, an essential part of sentinel lymph node (SLN) mapping, involves serial sectioning and immunohistochemical (IHC) staining in order to reliably detect clinically relevant metastases. However, ultrastaging is labor-intensive, time-consuming, and costly. Deep learning algorithms offer a potential solution by assisting pathologists in efficiently assessing serial sections for metastases, reducing workload and costs while enhancing accuracy. This proof-of-principle study evaluated the effectiveness of a deep learning algorithm for SLN metastasis detection in early-stage cervical cancer. Methods: We retrospectively analyzed whole slide images (WSIs) of hematoxylin and eosin (H&E)-stained SLNs from early-stage cervical cancer patients diagnosed with an SLN metastasis with either H&E or IHC. A CE-IVD certified commercially available deep learning algorithm, initially developed for detection of breast and colon cancer lymph node metastases, was employed off-label to assess its sensitivity in cervical cancer. Results: This study included 21 patients with early-stage cervical cancer, comprising 15 with squamous cell carcinoma, five with adenocarcinoma, and one with clear cell carcinoma. Among these patients, 10 had macrometastases and 11 had micrometastases in at least one SLN. The algorithm was applied to evaluate H&E WSIs of 47 SLN specimens, including 22 that were negative for metastasis, 13 with macrometastases, and 12 with micrometastases in the H&E slides. The algorithm detected all H&E macro- and micrometastases with 100% sensitivity. Conclusions: This proof-of-principle study demonstrated high sensitivity of a deep learning algorithm for detection of clinically relevant SLN metastasis in early-stage cervical cancer, despite being originally developed for adenocarcinomas of the breast and colon. Our findings highlight the potential of leveraging an existing algorithm for use in cervical cancer, warranting further prospective validation in a larger population.

Deep learning model shows pathologist-level detection of sentinel node metastasis of melanoma and intra-nodal nevi on whole slide images

Introduction

Nodal metastasis (NM) in sentinel node biopsies (SNB) is crucial for melanoma staging. However, an intra-nodal nevus (INN) may often be misclassified as NM, leading to potential misdiagnosis and incorrect staging. There is high discordance among pathologists in assessing SNB positivity, which may lead to false staging. Digital whole slide imaging offers the potential for implementing artificial intelligence (AI) in digital pathology. In this study, we assessed the capability of AI to detect NM and INN in SNBs.

Methods

A total of 485 hematoxylin and eosin whole slide images (WSIs), including NM and INN from 196 SNBs, were collected and divided into training (279 WSIs), validation (89 WSIs), and test sets (117 WSIs). A deep learning model was trained with 5,956 manual pixel-wise annotations. The AI and three blinded dermatopathologists assessed the test set, with immunohistochemistry serving as the reference standard.

Results

The AI model showed excellent performance with an area under the curve receiver operating characteristic (AUC) of 0.965 for detecting NM. In comparison, the AUC for NM detection among dermatopathologists ranged between 0.94 and 0.98. For the detection of INN, the AUC was lower for both AI (0.781) and dermatopathologists (range of 0.63-0.79).

Discussion

In conclusion, the deep learning AI model showed excellent accuracy in detecting NM, achieving dermatopathologist-level performance in detecting both NM and INN. Importantly, the AI model showed the potential to differentiate between these two entities. However, further validation is warranted.

Advancements in computer vision and pathology: Unraveling the potential of artificial intelligence for precision diagnosis and beyond

The integration of computer vision into pathology through slide digitalization represents a transformative leap in the field's evolution. Traditional pathology methods, while reliable, are often time-consuming and susceptible to intra- and interobserver variability. In contrast, computer vision, empowered by artificial intelligence (AI) and machine learning (ML), promises revolutionary changes, offering consistent, reproducible, and objective results with ever-increasing speed and scalability. The applications of advanced algorithms and deep learning architectures like CNNs and U-Nets augment pathologists' diagnostic capabilities, opening new frontiers in automated image analysis. As these technologies mature and integrate into digital pathology workflows, they are poised to provide deeper insights into disease processes, quantify and standardize biomarkers, enhance patient outcomes, and automate routine tasks, reducing pathologists' workload. However, this transformative force calls for cross-disciplinary collaboration between pathologists, computer scientists, and industry innovators to drive research and development. While acknowledging its potential, this chapter addresses the limitations of AI in pathology, encompassing technical, practical, and ethical considerations during development and implementation.

An artificial intelligence model for detecting pathological lymph node metastasis in prostate cancer using whole slide images: a retrospective, multicentre, diagnostic study

Background

The pathological examination of lymph node metastasis (LNM) is crucial for treating prostate cancer (PCa). However, the limitations with naked-eye detection and pathologist workload contribute to a high missed-diagnosis rate for nodal micrometastasis. We aimed to develop an artificial intelligence (AI)-based, time-efficient, and high-precision PCa LNM detector (ProCaLNMD) and evaluate its clinical application value.

Methods

In this multicentre, retrospective, diagnostic study, consecutive patients with PCa who underwent radical prostatectomy and pelvic lymph node dissection at five centres between Sep 2, 2013 and Apr 28, 2023 were included, and histopathological slides of resected lymph nodes were collected and digitised as whole-slide images for model development and validation. ProCaLNMD was trained at a dataset from a single centre (the Sun Yat-sen Memorial Hospital of Sun Yat-sen University [SYSMH]), and externally validated in the other four centres. A bladder cancer dataset from SYSMH was used to further validate ProCaLNMD, and an additional validation (human-AI comparison and collaboration study) containing consecutive patients with PCa from SYSMH was implemented to evaluate the application value of integrating ProCaLNMD into the clinical workflow. The primary endpoint was the area under the receiver operating characteristic curve (AUROC) of ProCaLNMD. In addition, the performance measures for pathologists with ProCaLNMD assistance was also assessed.

Findings

In total, 8225 slides from 1297 patients with PCa were collected and digitised. Overall, 8158 slides (18,761 lymph nodes) from 1297 patients with PCa (median age 68 years [interquartile range 64-73]; 331 [26%] with LNM) were used to train and validate ProCaLNMD. The AUROC of ProCaLNMD ranged from 0.975 (95% confidence interval 0.953-0.998) to 0.992 (0.982-1.000) in the training and validation datasets, with sensitivities > 0.955 and specificities > 0.921. ProCaLNMD also demonstrated an AUROC of 0.979 in the cross-cancer dataset. ProCaLNMD use triggered true reclassification in 43 (4.3%) slides in which micrometastatic tumour regions were initially missed by pathologists, thereby correcting 28 (8.5%) missed-diagnosed cases of previous routine pathological reports. In the human-AI comparison and collaboration study, the sensitivity of ProCaLNMD (0.983 [0.908-1.000]) surpassed that of two junior pathologists (0.862 [0.746-0.939], P = 0.023; 0.879 [0.767-0.950], P = 0.041) by 10-12% and showed no difference to that of two senior pathologists (both 0.983 [0.908-1.000], both P > 0.99). Furthermore, ProCaLNMD significantly boosted the diagnostic sensitivity of two junior pathologists (both P = 0.041) to the level of senior pathologists (both P > 0.99), and substantially reduced the four pathologists' slide reviewing time (-31%, P < 0.0001; -34%, P < 0.0001; -29%, P < 0.0001; and -27%, P = 0.00031).

Interpretation

ProCaLNMD demonstrated high diagnostic capabilities for identifying LNM in prostate cancer, reducing the likelihood of missed diagnoses by pathologists and decreasing the slide reviewing time, highlighting its potential for clinical application.

Funding

National Natural Science Foundation of China, the Science and Technology Planning Project of Guangdong Province, the National Key Research and Development Programme of China, the Guangdong Provincial Clinical Research Centre for Urological Diseases, and the Science and Technology Projects in Guangzhou.

Pros and cons of artificial intelligence implementation in diagnostic pathology

The rapid introduction of digital pathology has greatly facilitated development of artificial intelligence (AI) models in pathology that have shown great promise in assisting morphological diagnostics and quantitation of therapeutic targets. We are now at a tipping point where companies have started to bring algorithms to the market, and questions arise whether the pathology community is ready to implement AI in routine workflow. However, concerns also arise about the use of AI in pathology. This article reviews the pros and cons of introducing AI in diagnostic pathology.

Deep learning based histological classification of adnex tumors

BACKGROUND

Cutaneous adnexal tumors are a diverse group of tumors arising from structures of the hair appendages. Although often benign, malignant entities occur which can metastasize and lead to patients´ death. Correct diagnosis is critical to ensure optimal treatment and best possible patient outcome. Artificial intelligence (AI) in the form of deep neural networks has recently shown enormous potential in the field of medicine including pathology, where we and others have found common cutaneous tumors can be detected with high sensitivity and specificity. To become a widely applied tool, AI approaches will also need to reliably detect and distinguish less common tumor entities including the diverse group of cutaneous adnexal tumors.

METHODS

To assess the potential of AI to recognize cutaneous adnexal tumors, we selected a diverse set of these entities from five German centers. The algorithm was trained with samples from four centers and then tested on slides from the fifth center.

RESULTS

The neural network was able to differentiate 14 different cutaneous adnexal tumors and distinguish them from more common cutaneous tumors (i.e. basal cell carcinoma and seborrheic keratosis). The total accuracy on the test set for classifying 248 samples into these 16 diagnoses was 89.92 %. Our findings support AI can distinguish rare tumors, for morphologically distinct entities even with very limited case numbers (< 50) for training.

CONCLUSION

This study further underlines the enormous potential of AI in pathology which could become a standard tool to aid pathologists in routine diagnostics in the foreseeable future. The final diagnostic responsibility will remain with the pathologist.

Principles, applications, and future of artificial intelligence in dermatology

This paper provides an overview of artificial-intelligence (AI), as applied to dermatology. We focus our discussion on methodology, AI applications for various skin diseases, limitations, and future opportunities. We review how the current image-based models are being implemented in dermatology across disease subsets, and highlight the challenges facing widespread adoption. Additionally, we discuss how the future of AI in dermatology might evolve and the emerging paradigm of large language, and multi-modal models to emphasize the importance of developing responsible, fair, and equitable models in dermatology.