Diagnostic Performance of Deep Learning Algorithms Applied to Three Common Diagnoses in Dermatopathology

Assessing the performance of an artificial intelligence based chatbot in the differential diagnosis of oral mucosal lesions: clinical validation study

OBJECTIVES

Artificial intelligence (AI) is becoming more popular in medicine. The current study aims to investigate, primarily, if an AI-based chatbot, such as ChatGPT, could be a valid tool for assisting in establishing a differential diagnosis of oral mucosal lesions.

METHODS

Data was gathered from patients who were referred to our clinic for an oral mucosal biopsy by one oral medicine specialist. Clinical description, differential diagnoses, and final histopathologic diagnoses were retrospectively extracted from patient records. The lesion description was inputted into ChatGPT version 4.0 under a uniform script to generate three differential diagnoses. ChatGPT and an oral medicine specialist's differential diagnosis were compared to the final histopathologic diagnosis.

RESULTS

100 oral soft tissue lesions were evaluated. A statistically significant correlation was found between the ability of the Chatbot and the Specialist to accurately diagnose the cases (P < 0.001). ChatGPT demonstrated remarkable sensitivity for diagnosing urgent cases, as none of the malignant lesions were missed by the chatbot. At the same time, the specificity of the specialist was higher in cases of malignant lesion diagnosis (p < 0.05). The chatbot performance was reliable in two different events (p < 0.01).

CONCLUSION

ChatGPT-4 has shown the ability to pinpoint suspicious malignant lesions and suggest an adequate differential diagnosis for soft tissue lesions, in a consistent and repetitive manner.

CLINICAL RELEVANCE

This study serves as a primary insight into the role of AI chatbots, as assisting tools in oral medicine and assesses their clinical capabilities.

Mini review on skin biopsy: traditional and modern techniques

The incidence of skin cancer continues to rise due to increased sun exposure and tanning habits, requiring early detection and treatment for favorable outcomes. Skin biopsy is an important diagnostic tool in dermatology and pathology, as it provides a valuable understanding of various skin diseases. Proper handling of skin biopsy specimens is vital to ensure accurate histopathological assessment. Still, the use of light microscopy and immunofluorescence provides a comprehensive approach to evaluating skin biopsy specimens, with each contributing unique information to aid in accurate diagnosis and management. This review highlights the evolution of skin biopsy practices, from traditional techniques to advanced methods incorporating artificial intelligence (AI) and convolutional neural networks. AI technologies enhance diagnostic accuracy and efficiency, aiding in the rapid analysis of skin lesions and biopsies. Despite challenges such as the need for extensively annotated datasets and ethical considerations, AI shows promise in dermatological diagnostics. The future of skin biopsy lies in minimally invasive techniques, liquid biopsies, and integrated pharmacogenomics for personalized medicine.

Artificial intelligence in dermatopathology: a systematic review

Medical research, driven by advancing technologies like artificial intelligence (AI), is transforming healthcare. Dermatology, known for its visual nature, benefits from AI, especially in dermatopathology with digitized slides. This review explores AI's role, challenges, opportunities and future potential in enhancing dermatopathological diagnosis and care. Adhering to PRISMA and Cochrane Handbook standards, this systematic review explored AI's function in dermatopathology. It employed an interdisciplinary method, encompassing diverse study types and comprehensive database searches. Inclusion criteria encompassed peer-reviewed articles from 2000 to 2023, with a focus on practical AI use in dermatopathology. Numerous studies have investigated AI's potential in dermatopathology. We reviewed 112 papers. Notable applications include AI classifying histopathological images of naevi and melanomas, although challenges exist regarding subtype differentiation and generalizability. AI achieved high accuracy in melanoma recognition from formalin-fixed paraffin-embedded samples but faced limitations due to small datasets. Deep learning algorithms showed diagnostic accuracy for specific skin conditions, but challenges persisted, such as small sample sizes and the need for prospective validation. This systematic review underscores AI's potential in enhancing dermatopathology for better diagnosis and patient care. Addressing challenges like limited datasets and potential biases is essential. Future directions involve expanding datasets, conducting validation studies, promoting interdisciplinary collaboration, and creating patient-centred AI tools in dermatopathology to enhance accuracy, accessibility and patient-focused care.

Comprehensive Evaluation of Multi-Omics Clustering Algorithms for Cancer Molecular Subtyping

As a highly heterogeneous and complex disease, the identification of cancer's molecular subtypes is crucial for accurate diagnosis and personalized treatment. The integration of multi-omics data enables a comprehensive interpretation of the molecular characteristics of cancer at various biological levels. In recent years, an increasing number of multi-omics clustering algorithms for cancer molecular subtyping have been proposed. However, the absence of a definitive gold standard makes it challenging to evaluate and compare these methods effectively. In this study, we developed a general framework for the comprehensive evaluation of multi-omics clustering algorithms and introduced an innovative metric, the accuracy-weighted average index, which simultaneously considers both clustering performance and clinical relevance. Using this framework, we performed a thorough evaluation and comparison of 11 state-of-the-art multi-omics clustering algorithms, including deep learning-based methods. By integrating the accuracy-weighted average index with computational efficiency, our analysis reveals that PIntMF demonstrates the best overall performance, making it a promising tool for molecular subtyping across a wide range of cancers.

Deep learning methods for improving the accuracy and efficiency of pathological image analysis

This study presents a novel integration of two advanced deep learning models, U-Net and EfficientNetV2, to achieve high-precision segmentation and rapid classification of pathological images. A key innovation is the development of a new heatmap generation algorithm, which leverages meticulous image preprocessing, data enhancement strategies, ensemble learning, attention mechanisms, and deep feature fusion techniques. This algorithm not only produces highly accurate and interpretatively rich heatmaps but also significantly improves the accuracy and efficiency of pathological image analysis. Unlike existing methods, our approach integrates these advanced techniques into a cohesive framework, enhancing its ability to reveal critical features in pathological images. Rigorous experimental validation demonstrated that our algorithm excels in key performance indicators such as accuracy, recall rate, and processing speed, underscoring its potential for broader applications in pathological image analysis and beyond.

Artificial intelligence for nonmelanoma skin cancer

Nonmelanoma skin cancers (NMSCs) are among the top five most common cancers globally. NMSC is an area with great potential for novel application of diagnostic tools including artificial intelligence (AI). In this scoping review, we aimed to describe the applications of AI in the diagnosis and treatment of NMSC. Twenty-nine publications described AI applications to dermatopathology including lesion classification and margin assessment. Twenty-five publications discussed AI use in clinical image analysis, showing that algorithms are not superior to dermatologists and may rely on unbalanced, nonrepresentative, and nontransparent training data sets. Sixteen publications described the use of AI in cutaneous surgery for NMSC including use in margin assessment during excisions and Mohs surgery, as well as predicting procedural complexity. Eleven publications discussed spectroscopy, confocal microscopy, thermography, and the AI algorithms that analyze and interpret their data. Ten publications pertained to AI applications for the discovery and use of NMSC biomarkers. Eight publications discussed the use of smartphones and AI, specifically how they enable clinicians and patients to have increased access to instant dermatologic assessments but with varying accuracies. Five publications discussed large language models and NMSC, including how they may facilitate or hinder patient education and medical decision-making. Three publications pertaining to the skin of color and AI for NMSC discussed concerns regarding limited diverse data sets for the training of convolutional neural networks. AI demonstrates tremendous potential to improve diagnosis, patient and clinician education, and management of NMSC. Despite excitement regarding AI, data sets are often not transparently reported, may include low-quality images, and may not include diverse skin types, limiting generalizability. AI may serve as a tool to increase access to dermatology services for patients in rural areas and save health care dollars. These benefits can only be achieved, however, with consideration of potential ethical costs.

Artificial intelligence in dermatopathology: Updates, strengths, and challenges

Artificial intelligence (AI) has evolved to become a significant force in various domains, including medicine. We explore the role of AI in pathology, with a specific focus on dermatopathology and neoplastic dermatopathology. AI, encompassing machine learning and deep learning, has demonstrated its potential in tasks ranging from diagnostic applications on whole slide imaging to predictive and prognostic functions in skin pathology. In dermatopathology, studies have assessed AI's ability to identify skin lesions, classify melanomas, and improve diagnostic accuracy. Results indicate that AI, particularly convolutional neural networks, can outperform human pathologists in terms of sensitivity and specificity. AI aids in predicting disease outcomes, identifying aggressive tumors, and differentiating between various skin conditions. Neoplastic dermatopathology showcases AI's prowess in classifying melanocytic lesions, discriminating between melanomas and nevi, and aids dermatopathologists in making accurate diagnoses. Studies emphasize the reproducibility and diagnostic aid that AI provides, especially in challenging cases. In inflammatory and lymphoproliferative dermatopathology, limited research exists, but studies show attempts to use AI to differentiate conditions such as mycosis fungoides and eczema. Although some results are promising, further exploration is needed in these areas. We highlight the extraordinary interest AI has garnered in the scientific community and its potential to assist clinicians and pathologists. Despite the advancements, we have stressed the importance of collaboration between medical professionals, computer scientists, bioinformaticians, and engineers to harness AI's benefits and acknowledging its limitations and risks. The integration of AI into dermatopathology holds great promise, positioning it as a valuable tool rather than as a replacement for human expertise.

Integrating telepathology and digital pathology with artificial intelligence: An inevitable future

Telepathology and digital pathology, enhanced with artificial intelligence (AI), represent groundbreaking technology advancements. These entities offer information exchange, enhanced teaching and research, and automated diagnosis with high precision through a computerized approach. Machine learning in pathology shows promise for both human and veterinary medicine, yielding favorable results and in some cases, surpassing the accuracy of human pathologists. This study aimed to highlight the significance of integrated AI with telepathology and digital pathology, outlining both its advantages and limitations while emphasizing the crucial role of pathologists in its implementation. A literature review was conducted to uncover publications and data on telepathology and AI, and their implementation in human and veterinary medicine. This approach has facilitated information exchange, enhancing both teaching and research. In addition, it facilitates the creation of innovative methods and offers more precise patient diagnoses, adhering to ethical and legal standards. This study delivers valuable and comparable data on telepathology, digital pathology, and AI integration. Given the continually emerging nature of these technologies, further studies are essential for their application to human and veterinary medicine.

Revolutionizing diagnostic pathology: The emergence and impact of artificial intelligence-what doesn't kill you makes you stronger?

This study explored the integration and impact of artificial intelligence (AI) in diagnostic pathology, particularly dermatopathology, assessing its challenges and potential solutions for global health care enhancement. A comprehensive literature search in PubMed and Google Scholar, conducted on March 30, 2023, and using terms related to AI, pathology, and machine learning, yielded 44 relevant publications. These were analyzed under themes including the evolution of deep learning in pathology, AI's role in replacing pathologists, development challenges of diagnostic algorithms, clinical implementation hurdles, strategies for practical application in dermatopathology, and future prospects of AI in this field. The findings highlight AI's transformative potential in pathology, underscore the need for ongoing research, collaboration, and regulatory dialogue, and emphasize the importance of addressing the ethical and practical challenges in AI implementation for improved global health care outcomes.

Applications of Machine Learning (ML) and Mathematical Modeling (MM) in Healthcare with Special Focus on Cancer Prognosis and Anticancer Therapy: Current Status and Challenges

The use of data-driven high-throughput analytical techniques, which has given rise to computational oncology, is undisputed. The widespread use of machine learning (ML) and mathematical modeling (MM)-based techniques is widely acknowledged. These two approaches have fueled the advancement in cancer research and eventually led to the uptake of telemedicine in cancer care. For diagnostic, prognostic, and treatment purposes concerning different types of cancer research, vast databases of varied information with manifold dimensions are required, and indeed, all this information can only be managed by an automated system developed utilizing ML and MM. In addition, MM is being used to probe the relationship between the pharmacokinetics and pharmacodynamics (PK/PD interactions) of anti-cancer substances to improve cancer treatment, and also to refine the quality of existing treatment models by being incorporated at all steps of research and development related to cancer and in routine patient care. This review will serve as a consolidation of the advancement and benefits of ML and MM techniques with a special focus on the area of cancer prognosis and anticancer therapy, leading to the identification of challenges (data quantity, ethical consideration, and data privacy) which are yet to be fully addressed in current studies.

The Integration of Artificial Intelligence into Clinical Practice

The purpose of this literature review is to provide a fundamental synopsis of current research pertaining to artificial intelligence (AI) within the domain of clinical practice. Artificial intelligence has revolutionized the field of medicine and healthcare by providing innovative solutions to complex problems. One of the most important benefits of AI in clinical practice is its ability to investigate extensive volumes of data with efficiency and precision. This has led to the development of various applications that have improved patient outcomes and reduced the workload of healthcare professionals. AI can support doctors in making more accurate diagnoses and developing personalized treatment plans. Successful examples of AI applications are outlined for a series of medical specialties like cardiology, surgery, gastroenterology, pneumology, nephrology, urology, dermatology, orthopedics, neurology, gynecology, ophthalmology, pediatrics, hematology, and critically ill patients, as well as diagnostic methods. Special reference is made to legal and ethical considerations like accuracy, informed consent, privacy issues, data security, regulatory framework, product liability, explainability, and transparency. Finally, this review closes by critically appraising AI use in clinical practice and its future perspectives. However, it is also important to approach its development and implementation cautiously to ensure ethical considerations are met.

Einsatz künstlicher Intelligenz mittels Deep Learning in der dermatopathologischen Routinediagnostik des Basalzellkarzinoms: Applying an artificial intelligence deep learning approach to routine dermatopathological diagnosis of basal cell carcinoma

Hintergrund

Dermatopathologische Institute stehen aufgrund immer höherer Anforderungen bei andererseits schwindenden Ressourcen vor zunehmenden Herausforderungen. Basalzellkarzinome stellen einen Großteil des Einsendeguts mit entsprechendem Arbeitsaufwand dar. Gleichzeitig ermöglicht die Digitalisierung von Glasobjektträgern den Einsatz künstlicher Intelligenz (KI)‐basierter Verfahren in der Dermatopathologie. Bislang haben diese Verfahren keinen Einzug in die Routinediagnostik gefunden. Ziel dieser Studie war daher, den Einsatz eines KI‐basierten Modells zur automatisierten Basalzellkarzinom‐Erkennung zu etablieren.

Patienten und Methodik

In drei dermatopathologischen Zentren wurden während des täglichen Routinebetriebs Basalzellkarzinom‐Fälle digitalisiert und sowohl klassisch am Mikroskop als auch mittels KI‐basierter Methodik basierend auf neuronalen Netzen mit U‐Net‐Architektur befundet.

Ergebnisse

Im Routinebetrieb erzielte das Modell eine Sensitivität von 98,23 % und eine Spezifität von 98,51 % (Zentrum 1). Das Modell konnte übergangslos in den anderen Zentren Einsatz finden und erreichte ähnlich hohe Genauigkeiten in der Basalzellkarzinom‐Erkennung (Sensitivität von 97,67 % beziehungsweise 98,57 %, Spezifität von 96,77 % beziehungsweise 98,73 %). Zusätzlich wurden eine automatisierte, KI‐basierte Basalzellkarzinom‐Subtypisierung und Tumordickenmessung etabliert.

Schlussfolgerungen

KI‐basierte Verfahren können mit einer hohen Genauigkeit im Routinebetrieb Basalzellkarzinome erkennen und signifikant die dermatopathologische Arbeit unterstützen.

Applying an artificial intelligence deep learning approach to routine dermatopathological diagnosis of basal cell carcinoma

BACKGROUND

Institutes of dermatopathology are faced with considerable challenges including a continuously rising numbers of submitted specimens and a shortage of specialized health care practitioners. Basal cell carcinoma (BCC) is one of the most common tumors in the fair-skinned western population and represents a major part of samples submitted for histological evaluation. Digitalizing glass slides has enabled the application of artificial intelligence (AI)-based procedures. To date, these methods have found only limited application in routine diagnostics. The aim of this study was to establish an AI-based model for automated BCC detection.

PATIENTS AND METHODS

In three dermatopathological centers, daily routine practice BCC cases were digitalized. The diagnosis was made both conventionally by analog microscope and digitally through an AI-supported algorithm based on a U-Net architecture neural network.

RESULTS

In routine practice, the model achieved a sensitivity of 98.23% (center 1) and a specificity of 98.51%. The model generalized successfully without additional training to samples from the other centers, achieving similarly high accuracies in BCC detection (sensitivities of 97.67% and 98.57% and specificities of 96.77% and 98.73% in centers 2 and 3, respectively). In addition, automated AI-based basal cell carcinoma subtyping and tumor thickness measurement were established.

CONCLUSIONS

AI-based methods can detect BCC with high accuracy in a routine clinical setting and significantly support dermatopathological work.

Performance of Automated Classification of Diagnostic Entities in Dermatopathology Validated on Multisite Data Representing the Real-World Variability of Pathology Workload

CONTEXT.—

More people receive a diagnosis of skin cancer each year in the United States than all other cancers combined. Many patients around the globe do not have access to highly trained dermatopathologists, whereas some biopsy diagnoses of patients who do have access result in disagreements between such specialists. Mechanomind has developed software based on a deep-learning algorithm to classify 40 different diagnostic dermatopathology entities to improve diagnostic accuracy and to enable improvements in turnaround times and effort allocation.

OBJECTIVE.—

To assess the value of machine learning for microscopic tissue evaluation in dermatopathology.

DESIGN.—

A retrospective study comparing diagnoses of hematoxylin and eosin-stained glass slides rendered by 2 senior board-certified pathologists not involved in algorithm creation with the machine learning algorithm's classification was conducted. A total of 300 glass slides (1 slide per patient's case) from 4 hospitals in the United States and Africa with common variations in tissue preparation, staining, and scanning methods were included in the study.

RESULTS.—

The automated algorithm demonstrated sensitivity of 89 of 91 (97.8%), 107 of 107 (100%), and 101 of 102 (99%), as well as specificity of 204 of 209 (97.6%), 189 of 193 (97.9%), and 198 of 198 (100%) while identifying melanoma, nevi, and basal cell carcinoma in whole slide images, respectively.

CONCLUSIONS.—

Appropriately trained deep learning image analysis algorithms demonstrate high specificity and high sensitivity sufficient for use in screening, quality assurance, and workload distribution in anatomic pathology.

The accuracy of artificial intelligence used for non-melanoma skin cancer diagnoses: a meta-analysis

BACKGROUND

With rising incidence of skin cancer and relatively increased mortality rates, an improved diagnosis of such a potentially fatal disease is of vital importance. Although frequently curable, it nevertheless places a considerable burden upon healthcare systems. Among the various types of skin cancers, non-melanoma skin cancer is most prevalent. Despite such prevalence and its associated cost, scant proof concerning the diagnostic accuracy via Artificial Intelligence (AI) for non-melanoma skin cancer exists. This study meta-analyzes the diagnostic test accuracy of AI used to diagnose non-melanoma forms of skin cancer, and it identifies potential covariates that account for heterogeneity between extant studies.

METHODS

Various electronic databases (Scopus, PubMed, ScienceDirect, SpringerLink, and Dimensions) were examined to discern eligible studies beginning from March 2022. Those AI studies predictive of non-melanoma skin cancer were included. Summary estimates of sensitivity, specificity, and area under receiver operating characteristic curves were used to evaluate diagnostic accuracy. The revised Quality Assessment of Diagnostic Studies served to assess any risk of bias.

RESULTS

A literature search produced 39 eligible articles for meta-analysis. The summary sensitivity, specificity, and area under receiver operating characteristic curve of AI for diagnosing non-melanoma skin cancer was 0.78, 0.98, & 0.97, respectively. Skin cancer typology, data sources, cross validation, ensemble models, types of techniques, pre-trained models, and image augmentation became significant covariates accounting for heterogeneity in terms of both sensitivity and/or specificity.

CONCLUSIONS

Meta-analysis results revealed that AI is predictive of non-melanoma with an acceptable performance, but sensitivity may become improved. Further, ensemble models and pre-trained models are employable to improve true positive rating.

Artificial intelligence in digital pathology of cutaneous lymphomas: a review of the current state and future perspectives

Primary cutaneous lymphomas (CLs) represent a heterogeneous group of T-cell lymphomas and B-cell lymphomas that present in the skin without evidence of extracutaneous involvement at time of diagnosis. CLs are largely distinct from their systemic counterparts in clinical presentation, histopathology, and biological behavior and, therefore, require different therapeutic management. Additional diagnostic burden is added by the fact that several benign inflammatory dermatoses mimic CL subtypes, requiring clinicopathological correlation for definitive diagnosis. Due to the heterogeneity and rarity of CL, adjunct diagnostic tools are welcomed, especially by pathologists without expertise in this field or with limited access to a centralized specialist panel. The transition into digital pathology workflows enables artificial intelligence (AI)-based analysis of patients' whole-slide pathology images (WSIs). AI can be used to automate manual processes in histopathology but, more importantly, can be applied to complex diagnostic tasks, especially suitable for rare disease like CL. To date, AI-based applications for CL have been minimally explored in literature. However, in other skin cancers and systemic lymphomas, disciplines that are recognized here as the building blocks for CLs, several studies demonstrated promising results using AI for disease diagnosis and subclassification, cancer detection, specimen triaging, and outcome prediction. Additionally, AI allows discovery of novel biomarkers or may help to quantify established biomarkers. This review summarizes and blends applications of AI in pathology of skin cancer and lymphoma and proposes how these findings can be applied to diagnostics of CL.

Weakly supervised detection and classification of basal cell carcinoma using graph-transformer on whole slide images

The high incidence rates of basal cell carcinoma (BCC) cause a significant burden at pathology laboratories. The standard diagnostic process is time-consuming and prone to inter-pathologist variability. Despite the application of deep learning approaches in grading of other cancer types, there is limited literature on the application of vision transformers to BCC on whole slide images (WSIs). A total of 1832 WSIs from 479 BCCs, divided into training and validation (1435 WSIs from 369 BCCs) and testing (397 WSIs from 110 BCCs) sets, were weakly annotated into four aggressivity subtypes. We used a combination of a graph neural network and vision transformer to (1) detect the presence of tumor (two classes), (2) classify the tumor into low and high-risk subtypes (three classes), and (3) classify four aggressivity subtypes (five classes). Using an ensemble model comprised of the models from cross-validation, accuracies of 93.5%, 86.4%, and 72% were achieved on two, three, and five class classifications, respectively. These results show high accuracy in both tumor detection and grading of BCCs. The use of automated WSI analysis could increase workflow efficiency.

Artificial intelligence for basal cell carcinoma: diagnosis and distinction from histological mimics

We trained an artificial intelligence (AI) algorithm to identify basal cell carcinoma (BCC), and to distinguish BCC from histological mimics. A total of 1061 glass slides were collected: 616 containing BCC and 445 without BCC. BCC slides were collected prospectively, reflecting the range of specimen types and morphological variety encountered in routine pathology practice. Benign and malignant histological mimics of BCC were selected prospectively and retrospectively, including cases considered diagnostically challenging for pathologists. Glass slides were digitally scanned to create a whole slide image (WSI), which was divided into patches representing a tissue area of 65,535 μm². Pathologists annotated the data, yielding 87,205 patches labelled BCC present and 1,688,697 patches labelled BCC absent. The COMPASS model (COntext-aware Multi-scale tool for Pathologists Assessing SlideS) based on Convolutional Neural Networks, was trained to provide a probability of BCC being present at the patch level and the slide level. The test set comprised 246 slides, 147 of which contained BCC. The COMPASS AI model demonstrated high accuracy, classifying WSIs as containing BCC with a sensitivity of 98.0% and a specificity of 97.0%, representing 240 WSIs classified correctly, three false positives, and three false negatives. Using BCC as a proof of concept, we demonstrate how AI can account for morphological variation within an entity, and accurately distinguish from histologically similar entities. Our study highlights the potential for AI in routine pathology practice.

Artificial intelligence in Dermatopathology

INTRODUCTION

Ever evolving research in medical field has reached an exciting stage with advent of newer technologies. With the introduction of digital microscopy, pathology has transitioned to become more digitally oriented speciality. The potential of artificial intelligence (AI) in dermatopathology is to aid the diagnosis, and it requires dermatopathologists' guidance for efficient functioning of artificial intelligence.

METHOD

Comprehensive literature search was performed using electronic online databases "PubMed" and "Google Scholar." Articles published in English language were considered for the review.

RESULTS

Convolutional neural network, a type of deep neural network, is considered as an ideal tool in image recognition, processing, classification, and segmentation. Implementation of AI in tumor pathology is involved in the diagnosis, grading, staging, and prognostic prediction as well as in identification of genetic or pathological features. In this review, we attempt to discuss the use of AI in dermatopathology, the attitude of patients and clinicians, its challenges, limitation, and potential opportunities in future implementation.

Artificial intelligence: Its role in dermatopathology

Artificial intelligence (AI), a major frontier in the field of medical research, can potentially lead to a paradigm shift in clinical practice. A type of artificial intelligence system known as convolutional neural network points to the possible utility of deep learning in dermatopathology. Though pathology has been traditionally restricted to microscopes and glass slides, recent advancement in digital pathological imaging has led to a transition making it a potential branch for the implementation of artificial intelligence. The current application of artificial intelligence in dermatopathology is to complement the diagnosis and requires a well-trained dermatopathologist's guidance for better designing and development of deep learning algorithms. Here we review the recent advances of artificial intelligence in dermatopathology, its applications in disease diagnosis and in research, along with its limitations and future potential.

Deep learning for dermatologists: Part II. Current applications

Because of a convergence of the availability of large data sets, graphics-specific computer hardware, and important theoretical advancements, artificial intelligence has recently contributed to dramatic progress in medicine. One type of artificial intelligence known as deep learning has been particularly impactful for medical image analysis. Deep learning applications have shown promising results in dermatology and other specialties, including radiology, cardiology, and ophthalmology. The modern clinician will benefit from an understanding of the basic features of deep learning to effectively use new applications and to better gauge their utility and limitations. In this second article of a 2-part series, we review the existing and emerging clinical applications of deep learning in dermatology and discuss future opportunities and limitations. Part 1 of this series offered an introduction to the basic concepts of deep learning to facilitate effective communication between clinicians and technical experts.

High-fidelity detection, subtyping, and localization of five skin neoplasms using supervised and semi-supervised learning

Background

Skin cancers are the most common malignancies diagnosed worldwide. While the early detection and treatment of pre-cancerous and cancerous skin lesions can dramatically improve outcomes, factors such as a global shortage of pathologists, increased workloads, and high rates of diagnostic discordance underscore the need for techniques that improve pathology workflows. Although AI models are now being used to classify lesions from whole slide images (WSIs), diagnostic performance rarely surpasses that of expert pathologists.

Objectives

The objective of the present study was to create an AI model to detect and classify skin lesions with a higher degree of sensitivity than previously demonstrated, with potential to match and eventually surpass expert pathologists to improve clinical workflows.

Methods

We combined supervised learning (SL) with semi-supervised learning (SSL) to produce an end-to-end multi-level skin detection system that not only detects 5 main types of skin lesions with high sensitivity and specificity, but also subtypes, localizes, and provides margin status to evaluate the proximity of the lesion to non-epidermal margins. The Supervised Training Subset consisted of 2188 random WSIs collected by the PathologyWatch (PW) laboratory between 2013 and 2018, while the Weakly Supervised Subset consisted of 5161 WSIs from daily case specimens. The Validation Set consisted of 250 curated daily case WSIs obtained from the PW tissue archives and included 50 "mimickers". The Testing Set (3821 WSIs) was composed of non-curated daily case specimens collected from July 20, 2021 to August 20, 2021 from PW laboratories.

Results

The performance characteristics of our AI model (i.e., Mihm) were assessed retrospectively by running the Testing Set through the Mihm Evaluation Pipeline. Our results show that the sensitivity of Mihm in classifying melanocytic lesions, basal cell carcinoma, and atypical squamous lesions, verruca vulgaris, and seborrheic keratosis was 98.91% (95% CI: 98.27%, 99.55%), 97.24% (95% CI: 96.15%, 98.33%), 95.26% (95% CI: 93.79%, 96.73%), 93.50% (95% CI: 89.14%, 97.86%), and 86.91% (95% CI: 82.13%, 91.69%), respectively. Additionally, our multi-level (i.e., patch-level, ROI-level, and WSI-level) detection algorithm includes a qualitative feature that subtypes lesions, an AI overlay in the front-end digital display that localizes diagnostic ROIs, and reports on margin status by detecting overlap between lesions and non-epidermal tissue margins.

Conclusions

Our AI model, developed in collaboration with dermatopathologists, detects 5 skin lesion types with higher sensitivity than previously published AI models, and provides end users with information such as subtyping, localization, and margin status in a front-end digital display. Our end-to-end system has the potential to improve pathology workflows by increasing diagnostic accuracy, expediting the course of patient care, and ultimately improving patient outcomes.

Improvement of Mucosal Lesion Diagnosis with Machine Learning Based on Medical and Semiological Data: An Observational Study

Despite artificial intelligence used in skin dermatology diagnosis is booming, application in oral pathology remains to be developed. Early diagnosis and therefore early management, remain key points in the successful management of oral mucosa cancers. The objective was to develop and evaluate a machine learning algorithm that allows the prediction of oral mucosa lesions diagnosis. This cohort study included patients followed between January 2015 and December 2020 in the oral mucosal pathology consultation of the Toulouse University Hospital. Photographs and demographic and medical data were collected from each patient to constitute clinical cases. A machine learning model was then developed and optimized and compared to 5 models classically used in the field. A total of 299 patients representing 1242 records of oral mucosa lesions were used to train and evaluate machine learning models. Our model reached a mean accuracy of 0.84 for diagnostic prediction. The specificity and sensitivity range from 0.89 to 1.00 and 0.72 to 0.92, respectively. The other models were proven to be less efficient in performing this task. These results suggest the utility of machine learning-based tools in diagnosing oral mucosal lesions with high accuracy. Moreover, the results of this study confirm that the consideration of clinical data and medical history, in addition to the lesion itself, appears to play an important role.

Two-step artificial intelligence system for endoscopic gastric biopsy improves the diagnostic accuracy of pathologists

Background

Endoscopic biopsy is the pivotal procedure for the diagnosis of gastric cancer. In this study, we applied whole-slide images (WSIs) of endoscopic gastric biopsy specimens to develop an endoscopic gastric biopsy assistant system (EGBAS).

Methods

The EGBAS was trained using 2373 WSIs expertly annotated and internally validated on 245 WSIs. A large-scale, multicenter test dataset of 2003 WSIs was used to externally evaluate EGBAS. Eight pathologists were compared with the EGBAS using a man-machine comparison test dataset. The fully manual performance of the pathologists was also compared with semi-manual performance using EGBAS assistance.

Results

The average area under the curve of the EGBAS was 0·979 (0·958-0·990). For the diagnosis of all four categories, the overall accuracy of EGBAS was 86·95%, which was significantly higher than pathologists (P< 0·05). The EGBAS achieved a higher κ score (0·880, very good κ) than junior and senior pathologists (0·641 ± 0·088 and 0·729 ± 0·056). With EGBAS assistance, the overall accuracy (four-tier classification) of the pathologists increased from 66·49 ± 7·73% to 73·83 ± 5·73% (P< 0·05). The length of time for pathologists to manually complete the dataset was 461·44 ± 117·96 minutes; this time was reduced to 305·71 ± 82·43 minutes with EGBAS assistance (P = 0·00).

Conclusions

The EGBAS is a promising system for improving the diagnosis ability and reducing the workload of pathologists.

Histologic Screening of Malignant Melanoma, Spitz, Dermal and Junctional Melanocytic Nevi Using a Deep Learning Model

OBJECTIVE

The integration of an artificial intelligence tool into pathologists' workflow may lead to a more accurate and timely diagnosis of melanocytic lesions, directly patient care. The objective of this study was to create and evaluate the performance of such a model in achieving clinical-grade diagnoses of Spitz nevi, dermal and junctional melanocytic nevi, and melanomas.

METHODS

We created a beginner-level training environment by teaching our algorithm to perform cytologic inferences on 136,216 manually annotated tiles of hematoxylin and eosin-stained slides consisting of unequivocal melanocytic nevi, Spitz nevi, and invasive melanoma cases. We sequentially trained and tested our network to provide a final diagnosis-classification on 39 cases in total. Positive predictive value (precision) and sensitivity (recall) were used to measure our performance.

RESULTS

The tile-classification algorithm predicted the 136,216 irrelevant, melanoma, melanocytic nevi, and Spitz nevi tiles at sensitivities of 96%, 93%, 94% and 73%, respectively. The final trained model was able to correctly classify and predict the correct diagnosis in 85.7% of unseen cases (n = 28), reporting at or near screening-level performances for precision and recall of melanoma (76.2%, 100.0%), melanocytic nevi (100.0%, 75.0%), and Spitz nevi (100.0%, 75.0%).

CONCLUSIONS

Our pilot study proves that convolutional networks trained on cellular morphology to classify melanocytic proliferations can be used as a powerful tool to assist pathologists in screening for melanoma versus other benign lesions.

Evaluation of a Deep Learning Approach to Differentiate Bowen's Disease and Seborrheic Keratosis

Background: Some of the most common cutaneous neoplasms are Bowen’s disease and seborrheic keratosis, a malignant and a benign proliferation, respectively. These entities represent a significant fraction of a dermatopathologists’ workload, and in some cases, histological differentiation may be challenging. The potential of deep learning networks to distinguish these diseases is assessed. Methods: In total, 1935 whole-slide images from three institutions were scanned on two different slide scanners. A U-Net-based segmentation deep learning algorithm was trained on data from one of the centers to differentiate Bowen’s disease, seborrheic keratosis, and normal tissue, learning from annotations performed by dermatopathologists. Optimal thresholds for the class distinction of diagnoses were extracted and assessed on a test set with data from all three institutions. Results: We aimed to diagnose Bowen’s diseases with the highest sensitivity. A good performance was observed across all three centers, underlining the model’s robustness. In one of the centers, the distinction between Bowen’s disease and all other diagnoses was achieved with an AUC of 0.9858 and a sensitivity of 0.9511. Seborrheic keratosis was detected with an AUC of 0.9764 and a sensitivity of 0.9394. Nevertheless, distinguishing irritated seborrheic keratosis from Bowen’s disease remained challenging. Conclusions: Bowen’s disease and seborrheic keratosis could be correctly identified by the evaluated deep learning model on test sets from three different centers, two of which were not involved in training, and AUC scores > 0.97 were obtained. The method proved robust to changes in the staining solution and scanner model. We believe this demonstrates that deep learning algorithms can aid in clinical routine; however, the results should be confirmed by qualified histopathologists.

Artificial intelligence and machine learning in precision and genomic medicine

The advancement of precision medicine in medical care has led behind the conventional symptom-driven treatment process by allowing early risk prediction of disease through improved diagnostics and customization of more effective treatments. It is necessary to scrutinize overall patient data alongside broad factors to observe and differentiate between ill and relatively healthy people to take the most appropriate path toward precision medicine, resulting in an improved vision of biological indicators that can signal health changes. Precision and genomic medicine combined with artificial intelligence have the potential to improve patient healthcare. Patients with less common therapeutic responses or unique healthcare demands are using genomic medicine technologies. AI provides insights through advanced computation and inference, enabling the system to reason and learn while enhancing physician decision making. Many cell characteristics, including gene up-regulation, proteins binding to nucleic acids, and splicing, can be measured at high throughput and used as training objectives for predictive models. Researchers can create a new era of effective genomic medicine with the improved availability of a broad range of datasets and modern computer techniques such as machine learning. This review article has elucidated the contributions of ML algorithms in precision and genome medicine.

Artificial intelligence and machine learning in precision and genomic medicine

The advancement of precision medicine in medical care has led behind the conventional symptom-driven treatment process by allowing early risk prediction of disease through improved diagnostics and customization of more effective treatments. It is necessary to scrutinize overall patient data alongside broad factors to observe and differentiate between ill and relatively healthy people to take the most appropriate path toward precision medicine, resulting in an improved vision of biological indicators that can signal health changes. Precision and genomic medicine combined with artificial intelligence have the potential to improve patient healthcare. Patients with less common therapeutic responses or unique healthcare demands are using genomic medicine technologies. AI provides insights through advanced computation and inference, enabling the system to reason and learn while enhancing physician decision making. Many cell characteristics, including gene up-regulation, proteins binding to nucleic acids, and splicing, can be measured at high throughput and used as training objectives for predictive models. Researchers can create a new era of effective genomic medicine with the improved availability of a broad range of datasets and modern computer techniques such as machine learning. This review article has elucidated the contributions of ML algorithms in precision and genome medicine.

Identification of metastatic primary cutaneous squamous cell carcinoma utilizing artificial intelligence analysis of whole slide images

Cutaneous squamous cell carcinoma (cSCC) harbors metastatic potential and causes mortality. However, clinical assessment of metastasis risk is challenging. We approached this challenge by harnessing artificial intelligence (AI) algorithm to identify metastatic primary cSCCs. Residual neural network-architectures were trained with cross-validation to identify metastatic tumors on clinician annotated, hematoxylin and eosin-stained whole slide images representing primary non-metastatic and metastatic cSCCs (n = 104). Metastatic primary tumors were divided into two subgroups, which metastasize rapidly (≤ 180 days) (n = 22) or slowly (> 180 days) (n = 23) after primary tumor detection. Final model was able to predict whether primary tumor was non-metastatic or rapidly metastatic with slide-level area under the receiver operating characteristic curve (AUROC) of 0.747. Furthermore, risk factor (RF) model including prediction by AI, Clark’s level and tumor diameter provided higher AUROC (0.917) than other RF models and predicted high 5-year disease specific survival (DSS) for patients with cSCC with 0 or 1 RFs (100% and 95.7%) and poor DSS for patients with cSCCs with 2 or 3 RFs (41.7% and 40.0%). These results indicate, that AI recognizes unknown morphological features associated with metastasis and may provide added value to clinical assessment of metastasis risk and prognosis of primary cSCC.

Computer-Aided Assessment of Melanocytic Lesions by Means of a Mitosis Algorithm

An increasing number of pathology laboratories are now fully digitised, using whole slide imaging (WSI) for routine diagnostics. WSI paves the road to use artificial intelligence (AI) that will play an increasing role in computer-aided diagnosis (CAD). In melanocytic skin lesions, the presence of a dermal mitosis may be an important clue for an intermediate or a malignant lesion and may indicate worse prognosis. In this study a mitosis algorithm primarily developed for breast carcinoma is applied to melanocytic skin lesions. This study aimed to assess whether the algorithm could be used in diagnosing melanocytic lesions, and to study the added value in diagnosing melanocytic lesions in a practical setting. WSI’s of a set of hematoxylin and eosin (H&E) stained slides of 99 melanocytic lesions (35 nevi, 4 intermediate melanocytic lesions, and 60 malignant melanomas, including 10 nevoid melanomas), for which a consensus diagnosis was reached by three academic pathologists, were subjected to a mitosis algorithm based on AI. Two academic and six general pathologists specialized in dermatopathology examined the WSI cases two times, first without mitosis annotations and after a washout period of at least 2 months with mitosis annotations based on the algorithm. The algorithm indicated true mitosis in lesional cells, i.e., melanocytes, and non-lesional cells, i.e., mainly keratinocytes and inflammatory cells. A high number of false positive mitosis was indicated as well, comprising melanin pigment, sebaceous glands nuclei, and spindle cell nuclei such as stromal cells and neuroid differentiated melanocytes. All but one pathologist reported more often a dermal mitosis with the mitosis algorithm, which on a regular basis, was incorrectly attributed to mitoses from mainly inflammatory cells. The overall concordance of the pathologists with the consensus diagnosis for all cases excluding nevoid melanoma (n = 89) appeared to be comparable with and without the use of AI (89% vs. 90%). However, the concordance increased by using AI in nevoid melanoma cases (n = 10) (75% vs. 68%). This study showed that in general cases, pathologists perform similarly with the aid of a mitosis algorithm developed primarily for breast cancer. In nevoid melanoma cases, pathologists perform better with the algorithm. From this study, it can be learned that pathologists need to be aware of potential pitfalls using CAD on H&E slides, e.g., misinterpreting dermal mitoses in non-melanotic cells.

Artificial Intelligence-Based Approaches to Reflectance Confocal Microscopy Image Analysis in Dermatology

Reflectance confocal microscopy (RCM) is a non-invasive imaging method designed to identify various skin diseases. Confocal based diagnosis may be subjective due to the learning curve of the method, the scarcity of training programs available for RCM, and the lack of clearly defined diagnostic criteria for all skin conditions. Given that in vivo RCM is becoming more widely used in dermatology, numerous deep learning technologies have been developed in recent years to provide a more objective approach to RCM image analysis. Machine learning-based algorithms are used in RCM image quality assessment to reduce the number of artifacts the operator has to view, shorten evaluation times, and decrease the number of patient visits to the clinic. However, the current visual method for identifying the dermal-epidermal junction (DEJ) in RCM images is subjective, and there is a lot of variation. The delineation of DEJ on RCM images could be automated through artificial intelligence, saving time and assisting novice RCM users in studying the key DEJ morphological structure. The purpose of this paper is to supply a current summary of machine learning and artificial intelligence’s impact on the quality control of RCM images, key morphological structures identification, and detection of different skin lesion types on static RCM images.

A machine learning algorithm for early detection of heel deep tissue injuries based on a daily history of sub-epidermal moisture measurements

Sub‐epidermal moisture is an established biophysical marker of pressure ulcer formation based on biocapacitance changes in affected soft tissues, which has been shown to facilitate early detection of these injuries. Artificial intelligence shows great promise in wound prevention and care, including in automated analyses of quantitative measures of tissue health such as sub‐epidermal moisture readings acquired over time for effective, patient‐specific, and anatomical‐site‐specific pressure ulcer prophylaxis. Here, we developed a novel machine learning algorithm for early detection of heel deep tissue injuries, which was trained using a database comprising six consecutive daily sub‐epidermal moisture measurements recorded from 173 patients in acute and post‐acute care settings. This algorithm was able to achieve strong predictive power in forecasting heel deep tissue injury events the next day, with sensitivity and specificity of 77% and 80%, respectively, revealing the clinical potential of artificial intelligence‐powered technology for hospital‐acquired pressure ulcer prevention. The current work forms the scientific basis for clinical implementation of machine learning algorithms that provide effective, early, and anatomy‐specific preventive interventions to minimise the occurrence of hospital‐acquired pressure ulcers based on routine tissue health status measurements.

Artificial intelligence as a tool for diagnosis in digital pathology whole slide images: A systematic review

Digital pathology had a recent growth, stimulated by the implementation of digital whole slide images (WSIs) in clinical practice, and the pathology field faces shortage of pathologists in the last few years. This scenario created fronts of research applying artificial intelligence (AI) to help pathologists. One of them is the automated diagnosis, helping in the clinical decision support, increasing efficiency and quality of diagnosis. However, the complexity nature of the WSIs requires special treatments to create a reliable AI model for diagnosis. Therefore, we systematically reviewed the literature to analyze and discuss all the methods and results in AI in digital pathology performed in WSIs on H&E stain, investigating the capacity of AI as a diagnostic support tool for the pathologist in the routine real-world scenario. This review analyzes 26 studies, reporting in detail all the best methods to apply AI as a diagnostic tool, as well as the main limitations, and suggests new ideas to improve the AI field in digital pathology as a whole. We hope that this study could lead to a better use of AI as a diagnostic tool in pathology, helping future researchers in the development of new studies and projects.

Artificial intelligence in dermatology for the clinician

As medicine enters the era of artificial intelligence (AI)-augmented practice, dermatology is beginning to witness the integration of AI into the daily practice, particularly in the areas of diagnosis, prognosis, and treatment of skin diseases. Many of the current electronic medical records that dermatologists have incorporated provide guidance in billing, a form of AI at work. The recent advances in visual recognition AI make application and integration of the technology particularly suited for perceptual specialties such as radiology and dermatology. In dermatology, AI is poised to improve the efficiency and accuracy of traditional diagnostic approaches, including visual examination, skin biopsy, and histopathologic examination. This review highlights the current progress of AI in dermatology and provides a basic overview of the technology.

Artificial intelligence in dermatology

Dermatology and medicine are producing data at an increasing rate that are progressively difficult to sort and manage. Artificial intelligence (AI) and machine learning are examples of tools that may have the capability to produce significant and meaningful results from these data. Currently, AI and machine learning have a variety of applications in medicine including, but not limited to, diagnostics, patient management, preventive medicine, and genomic analysis. Although the role of AI in dermatology is greater than ever, its use is still extremely limited. As AI is continually developed and implemented, it is essential that stakeholders understand AI terminology, applications, limitations, and projected uses in dermatology. With the continued development of AI technology, however, its implementation may afford greater dermatologist efficiency, greater increased patient access to dermatologic care, and improved patient outcomes.

Artificial Intelligence in Dermatopathology: New Insights and Perspectives

In recent years, an increasing enthusiasm has been observed towards artificial intelligence and machine learning, involving different areas of medicine. Among these, although still in the embryonic stage, the dermatopathological field has also been partially involved, with the attempt to develop and train algorithms that could assist the pathologist in the differential diagnosis of complex melanocytic lesions. In this article, we face this new challenge of the modern era, carry out a review of the literature regarding the state of the art and try to determine promising future perspectives.

The Enterprise Imaging Value Proposition

As resources in the healthcare environment continue to wane, leaders are seeking ways to continue to provide quality care bounded by the constraints of a reduced budget. This manuscript synthesizes the experience from a number of institutions to provide the healthcare leadership with an understanding of the value of an enterprise imaging program. The value of such a program extends across the entire health system. It leads to operational efficiencies through infrastructure and application consolidation and the creation of focused support capabilities with increased depth of skill. An enterprise imaging program provides a centralized foundation for all phases of image management from every image-producing specialty. Through centralization, standardized image exchange functions can be provided to all image producers. Telehealth services can be more tightly integrated into the electronic medical record. Mobile platforms can be utilized for image viewing and sharing by patients and providers. Mobile tools can also be utilized for image upload directly into the centralized image repository. Governance and data standards are more easily distributed, setting the stage for artificial intelligence and data analytics. Increased exposure to all image producers provides opportunities for cybersecurity optimization and increased awareness.

Artificial Intelligence-Aided Recognition of Pathological Characteristics and Subtype Classification of Superficial Perivascular Dermatitis

Background: Superficial perivascular dermatitis, an important type of inflammatory dermatosis, comprises various skin diseases, which are difficult to distinguish by clinical manifestations and need pathological imaging observation. Coupled with its complex pathological characteristics, the subtype classification depends to a great extent on dermatopathologists. There is an urgent need to develop an efficient approach to recognize the pathological characteristics and classify the subtypes of superficial perivascular dermatitis.

Methods: 3,954 pathological images (4 × and 10 ×) of three subtypes—psoriasiform, spongiotic and interface—of superficial perivascular dermatitis were captured from 327 cases diagnosed both clinically and pathologically. The control group comprised 1,337 pathological images of 85 normal skin tissue slides taken from the edge of benign epidermal cysts. First, senior dermatologists and dermatopathologists followed the structure–pattern analysis method to label the pathological characteristics that significantly contribute to classifying different subtypes on 4 × and 10 × images. A cascaded deep learning algorithm framework was then proposed to establish pixel-level pathological characteristics' masks and classify the subtypes by supervised learning.

Results: 13 different pathological characteristics were recognized, and the accuracy of subtype classification was 85.24%. In contrast, the accuracy of the subtype classification model without recognition was 71.35%.

Conclusion: Our cascaded deep learning model used small samples to deliver efficient recognition of pathological characteristics and subtype classification simultaneously. Moreover, the proposed method could be applied to both microscopic images and digital scanned images.

Deeply Supervised UNet for Semantic Segmentation to Assist Dermatopathological Assessment of Basal Cell Carcinoma

Accurate and fast assessment of resection margins is an essential part of a dermatopathologist's clinical routine. In this work, we successfully develop a deep learning method to assist the dermatopathologists by marking critical regions that have a high probability of exhibiting pathological features in whole slide images (WSI). We focus on detecting basal cell carcinoma (BCC) through semantic segmentation using several models based on the UNet architecture. The study includes 650 WSI with 3443 tissue sections in total. Two clinical dermatopathologists annotated the data, marking tumor tissues' exact location on 100 WSI. The rest of the data, with ground-truth sectionwise labels, are used to further validate and test the models. We analyze two different encoders for the first part of the UNet network and two additional training strategies: (a) deep supervision, (b) linear combination of decoder outputs, and obtain some interpretations about what the network's decoder does in each case. The best model achieves over 96%, accuracy, sensitivity, and specificity on the Test set.

Artificial intelligence in dermatopathology: Diagnosis, education, and research

Artificial intelligence (AI) utilizes computer algorithms to carry out tasks with human-like intelligence. Convolutional neural networks, a type of deep learning AI, can classify basal cell carcinoma, seborrheic keratosis, and conventional nevi, highlighting the potential for deep learning algorithms to improve diagnostic workflow in dermatopathology of highly routine diagnoses. Additionally, convolutional neural networks can support the diagnosis of melanoma and may help predict disease outcomes. Capabilities of machine learning in dermatopathology can extend beyond clinical diagnosis to education and research. Intelligent tutoring systems can teach visual diagnoses in inflammatory dermatoses, with measurable cognitive effects on learners. Natural language interfaces can instruct dermatopathology trainees to produce diagnostic reports that capture relevant detail for diagnosis in compliance with guidelines. Furthermore, deep learning can power computation- and population-based research. However, there are many limitations of deep learning that need to be addressed before broad incorporation into clinical practice. The current potential of AI in dermatopathology is to supplement diagnosis, and dermatopathologist guidance is essential for the development of useful deep learning algorithms. Herein, the recent progress of AI in dermatopathology is reviewed with emphasis on how deep learning can influence diagnosis, education, and research.

Computer vision applied to dual-energy computed tomography images for precise calcinosis cutis quantification in patients with systemic sclerosis

Background

Although treatments have been proposed for calcinosis cutis (CC) in patients with systemic sclerosis (SSc), a standardized and validated method for CC burden quantification is necessary to enable valid clinical trials. We tested the hypothesis that computer vision applied to dual-energy computed tomography (DECT) finger images is a useful approach for precise and accurate CC quantification in SSc patients.

Methods

De-identified 2-dimensional (2D) DECT images from SSc patients with clinically evident lesser finger CC lesions were obtained. An expert musculoskeletal radiologist confirmed accurate manual segmentation (subtraction) of the phalanges for each image as a gold standard, and a U-Net Convolutional Neural Network (CNN) computer vision model for segmentation of healthy phalanges was developed and tested. A validation study was performed in an independent dataset whereby two independent radiologists manually measured the longest length and perpendicular short axis of each lesion and then calculated an estimated area by assuming the lesion was elliptical using the formula long axis/2 × short axis/2 × π, and a computer scientist used a region growing technique to calculate the area of CC lesions. Spearman’s correlation coefficient, Lin’s concordance correlation coefficient with 95% confidence intervals (CI), and a Bland-Altman plot (Stata V 15.1, College Station, TX) were used to test for equivalence between the radiologists’ and the CNN algorithm-generated area estimates.

Results

Forty de-identified 2D DECT images from SSc patients with clinically evident finger CC lesions were obtained and divided into training (N = 30 with image rotation × 3 to expand the set to N = 120) and test sets (N = 10). In the training set, five hundred epochs (iterations) were required to train the CNN algorithm to segment phalanges from adjacent CC, and accurate segmentation was evaluated using the ten held-out images. To test model performance, CC lesional area estimates calculated by two independent radiologists and a computer scientist were compared (radiologist 1 vs. radiologist 2 and radiologist 1 vs. computer vision approach) using an independent test dataset comprised of 31 images (8 index finger and 23 other fingers). For the two radiologists’, and the radiologist vs. computer vision measurements, Spearman’s rho was 0.91 and 0.94, respectively, both p < 0.0001; Lin’s concordance correlation coefficient was 0.91 (95% CI 0.85–0.98, p < 0.001) and 0.95 (95% CI 0.91–0.99, p < 0.001); and Bland-Altman plots demonstrated a mean difference between radiologist vs. radiologist, and radiologist vs. computer vision area estimates of − 0.5 mm² (95% limits of agreement − 10.0–9.0 mm²) and 1.7 mm² (95% limits of agreement − 6.0–9.5 mm², respectively.

Conclusions

We demonstrate that CNN quantification has a high degree of correlation with expert radiologist measurement of finger CC area measurements. Future work will include segmentation of 3-dimensional (3D) images for volumetric and density quantification, as well as validation in larger, independent cohorts.

Osteoid Metaplasia in Femoral Artery Plaques Is Associated With the Clinical Severity of Lower Extremity Artery Disease in Men

Lamellar metaplastic bone, osteoid metaplasia (OM), is found in atherosclerotic plaques, especially in the femoral arteries. In the carotid arteries, OM has been documented to be associated with plaque stability. This study investigated the clinical impact of OM load in femoral artery plaques of patients with lower extremity artery disease (LEAD) by using a deep learning-based image analysis algorithm. Plaques from 90 patients undergoing endarterectomy of the common femoral artery were collected and analyzed. After decalcification and fixation, 4-μm-thick longitudinal sections were stained with hematoxylin and eosin, digitized, and uploaded as whole-slide images on a cloud-based platform. A deep learning-based image analysis algorithm was trained to analyze the area percentage of OM in whole-slide images. Clinical data were extracted from electronic patient records, and the association with OM was analyzed. Fifty-one (56.7%) sections had OM. Females with diabetes had a higher area percentage of OM than females without diabetes. In male patients, the area percentage of OM inversely correlated with toe pressure and was significantly associated with severe symptoms of LEAD including rest pain, ulcer, or gangrene. According to our results, OM is a typical feature of femoral artery plaques and can be quantified using a deep learning-based image analysis method. The association of OM load with clinical features of LEAD appears to differ between male and female patients, highlighting the need for a gender-specific approach in the study of the mechanisms of atherosclerotic disease. In addition, the role of plaque characteristics in the treatment of atherosclerotic lesions warrants further consideration in the future.

Recent advances in bioelectronics chemistry

Research in bioelectronics is highly interdisciplinary, with many new developments being based on techniques from across the physical and life sciences. Advances in our understanding of the fundamental chemistry underlying the materials used in bioelectronic applications have been a crucial component of many recent discoveries. In this review, we highlight ways in which a chemistry-oriented perspective may facilitate novel and deep insights into both the fundamental scientific understanding and the design of materials, which can in turn tune the functionality and biocompatibility of bioelectronic devices. We provide an in-depth examination of several developments in the field, organized by the chemical properties of the materials. We conclude by surveying how some of the latest major topics of chemical research may be further integrated with bioelectronics.

Recent advances in bioelectronics chemistry

Research in bioelectronics is highly interdisciplinary, with many new developments being based on techniques from across the physical and life sciences. Advances in our understanding of the fundamental chemistry underlying the materials used in bioelectronic applications have been a crucial component of many recent discoveries. In this review, we highlight ways in which a chemistry-oriented perspective may facilitate novel and deep insights into both the fundamental scientific understanding and the design of materials, which can in turn tune the functionality and biocompatibility of bioelectronic devices. We provide an in-depth examination of several developments in the field, organized by the chemical properties of the materials. We conclude by surveying how some of the latest major topics of chemical research may be further integrated with bioelectronics.

[Pattern analysis of inflammatory skin diseases according to A. B. Ackerman-always up to date]

The exact microscopic diagnosis of inflammatory skin diseases requires the linking of histopathological findings with clinical features. This is not easy when skin biopsies are rarely assessed and the terminology of dermatopathology and dermatology is itself unfamiliar.The infiltrates of almost all inflammatory skin diseases tend to show eight specific patterns in high magnification. By further classifying according to architectural and cytological features, a specific diagnosis can be made in most cases. At the same time, clinically suspected diagnoses are simply excluded or greatly reduced in number. This procedure, starting with the overview magnification and the recognition of clearly defined histomorphological features, corresponds to an algorithm.Another algorithmic approach uses histomorphological changes under high magnification. Here, "nonspecific" findings are added to the pattern analysis as a diagnostic vehicle.Occasionally, inflammatory skin diseases cannot be assessed conclusively with current modern methods. Such pathology reports should be written descriptively and possible differential diagnoses should be mentioned as notes. The report should be written in a language understandable to the clinician.Artificial intelligence, with its ability to transform and integrate extensive clinical as well as image data, will play an important role in the future of decision making, diagnosing, and personalizing medicine. In the field of pathology, it could be seen as a second opinion. It is important that physicians always contribute their opinion where important algorithmic decisions are made, such as in algorithm design, data quality, interpretation, action, and feedback.

Artificial Intelligence in Dermatology: A Practical Introduction to a Paradigm Shift

Artificial Intelligence (AI) has surpassed dermatologists in skin cancer detection, but dermatology still lags behind radiology in its broader adoption. Building and using AI applications are becoming increasingly accessible. However, complex use cases may still require specialized expertise for design and deployment. AI has many applications in dermatology ranging from fundamental research, diagnostics, therapeutics, and cosmetic dermatology. The lack of standardization of images and privacy concerns are the foremost challenges stifling AI adoption. Dermatologists have a significant role to play in standardized data collection, curating data for machine learning, clinically validating AI solutions, and ultimately adopting this paradigm shift that is changing the way we practice.

Attitudes Toward Artificial Intelligence Within Dermatopathology: An International Online Survey

Background: Artificial intelligence (AI) has recently surfaced as a research topic in dermatology and dermatopathology. In a recent survey, dermatologists were overall positive toward a development with an increased use of AI, but little is known about the corresponding attitudes among pathologists working with dermatopathology. The objective of this investigation was to make an inventory of these attitudes.

Participants and Methods: An anonymous and voluntary online survey was prepared and distributed to pathologists who regularly analyzed dermatopathology slides/images. The survey consisted of 39 question divided in five sections; (1) AI as a topic in pathology; (2) previous exposure to AI as a topic in general; (3) applications for AI in dermatopathology; (4) feelings and attitudes toward AI and (5) self-reported tech-savviness and demographics. The survey opened on March 13, 2020 and closed on May 5, 2020.

Results: Overall, 718 responders (64.1% females) representing 91 countries were analyzed. While 81.5% of responders were aware of AI as an emerging topic in pathology, only 18.8% had either good or excellent knowledge about AI. In terms of diagnosis classification, 42.6% saw strong or very strong potential for automated suggestion of skin tumor diagnoses. The corresponding figure for inflammatory skin diseases was 23.0% (P_adj < 0.0001). For specific applications, the highest potential was considered for automated detection of mitosis (79.2%), automated suggestion of tumor margins (62.1%) and immunostaining evaluation (62.7%). The potential for automated suggestion of immunostaining (37.6%) and genetic panels (48.3%) were lower. Age did not impact the overall attitudes toward AI. Only 6.0% of the responders agreed or strongly agreed that the human pathologist will be replaced by AI in the foreseeable future. For the entire group, 72.3% agreed or strongly agreed that AI will improve dermatopathology and 84.1% thought that AI should be a part of medical training.

Conclusions: Pathologists are generally optimistic about the impact and potential benefit of AI in dermatopathology. The highest potential is expected for narrow specified tasks rather than a global automated suggestion of diagnoses. There is a strong need for education about AI and its use within dermatopathology.