Artificial intelligence-based image classification methods for diagnosis of skin cancer: Challenges and opportunities

Skin Lesion Classification and Detection Using Machine Learning Techniques: A Systematic Review

Skin lesions are essential for the early detection and management of a number of dermatological disorders. Learning-based methods for skin lesion analysis have drawn much attention lately because of improvements in computer vision and machine learning techniques. A review of the most-recent methods for skin lesion classification, segmentation, and detection is presented in this survey paper. The significance of skin lesion analysis in healthcare and the difficulties of physical inspection are discussed in this survey paper. The review of state-of-the-art papers targeting skin lesion classification is then covered in depth with the goal of correctly identifying the type of skin lesion from dermoscopic, macroscopic, and other lesion image formats. The contribution and limitations of various techniques used in the selected study papers, including deep learning architectures and conventional machine learning methods, are examined. The survey then looks into study papers focused on skin lesion segmentation and detection techniques that aimed to identify the precise borders of skin lesions and classify them accordingly. These techniques make it easier to conduct subsequent analyses and allow for precise measurements and quantitative evaluations. The survey paper discusses well-known segmentation algorithms, including deep-learning-based, graph-based, and region-based ones. The difficulties, datasets, and evaluation metrics particular to skin lesion segmentation are also discussed. Throughout the survey, notable datasets, benchmark challenges, and evaluation metrics relevant to skin lesion analysis are highlighted, providing a comprehensive overview of the field. The paper concludes with a summary of the major trends, challenges, and potential future directions in skin lesion classification, segmentation, and detection, aiming to inspire further advancements in this critical domain of dermatological research.

Artificial intelligence in cancer diagnosis and therapy: Current status and future perspective

Artificial intelligence (AI) in healthcare plays a pivotal role in combating many fatal diseases, such as skin, breast, and lung cancer. AI is an advanced form of technology that uses mathematical-based algorithmic principles similar to those of the human mind for cognizing complex challenges of the healthcare unit. Cancer is a lethal disease with many etiologies, including numerous genetic and epigenetic mutations. Cancer being a multifactorial disease is difficult to be diagnosed at an early stage. Therefore, genetic variations and other leading factors could be identified in due time through AI and machine learning (ML). AI is the synergetic approach for mining the drug targets, their mechanism of action, and drug-organism interaction from massive raw data. This synergetic approach is also facing several challenges in data mining but computational algorithms from different scientific communities for multi-target drug discovery are highly helpful to overcome the bottlenecks in AI for drug-target discovery. AI and ML could be the epicenter in the medical world for the diagnosis, treatment, and evaluation of almost any disease in the near future. In this comprehensive review, we explore the immense potential of AI and ML when integrated with the biological sciences, specifically in the context of cancer research. Our goal is to illuminate the many ways in which AI and ML are being applied to the study of cancer, from diagnosis to individualized treatment. We highlight the prospective role of AI in supporting oncologists and other medical professionals in making informed decisions and improving patient outcomes by examining the intersection of AI and cancer control. Although AI-based medical therapies show great potential, many challenges must be overcome before they can be implemented in clinical practice. We critically assess the current hurdles and provide insights into the future directions of AI-driven approaches, aiming to pave the way for enhanced cancer interventions and improved patient care.

MBT: Model-Based Transformer for retinal optical coherence tomography image and video multi-classification

BACKGROUND AND OBJECTIVE

The detection of retinal diseases using optical coherence tomography (OCT) images and videos is a concrete example of a data classification problem. In recent years, Transformer architectures have been successfully applied to solve a variety of real-world classification problems. Although they have shown impressive discriminative abilities compared to other state-of-the-art models, improving their performance is essential, especially in healthcare-related problems.

METHODS

This paper presents an effective technique named model-based transformer (MBT). It is based on popular pre-trained transformer models, particularly, vision transformer, swin transformer for OCT image classification, and multiscale vision transformer for OCT video classification. The proposed approach is designed to represent OCT data by taking advantage of an approximate sparse representation technique. Then, it estimates the optimal features, and performs data classification.

RESULTS

The experiments are carried out using three real-world retinal datasets. The experimental results on OCT image and OCT video datasets show that the proposed method outperforms existing state-of-the-art deep learning approaches in terms of classification accuracy, precision, recall, and f1-score, kappa, AUC-ROC, and AUC-PR. It can also boost the performance of existing transformer models, including Vision transformer and Swin transformer for OCT image classification, and Multiscale Vision Transformers for OCT video classification.

CONCLUSIONS

This work presents an approach for the automated detection of retinal diseases. Although deep neural networks have proven great potential in ophthalmology applications, our findings demonstrate for the first time a new way to identify retinal pathologies using OCT videos instead of images. Moreover, our proposal can help researchers enhance the discriminative capacity of a variety of powerful deep learning models presented in published papers. This can be valuable for future directions in medical research and clinical practice.

Deep Learning-Based Skin Lesion Multi-class Classification with Global Average Pooling Improvement

Cancerous skin lesions are one of the deadliest diseases that have the ability in spreading across other body parts and organs. Conventionally, visual inspection and biopsy methods are widely used to detect skin cancers. However, these methods have some drawbacks, and the prediction is not highly accurate. This is where a dependable automatic recognition system for skin cancers comes into play. With the extensive usage of deep learning in various aspects of medical health, a novel computer-aided dermatologist tool has been suggested for the accurate identification and classification of skin lesions by deploying a novel deep convolutional neural network (DCNN) model that incorporates global average pooling along with preprocessing to discern the skin lesions. The proposed model is trained and tested on the HAM10000 dataset, which contains seven different classes of skin lesions as target classes. The black hat filtering technique has been applied to remove artifacts in the preprocessing stage along with the resampling techniques to balance the data. The performance of the proposed model is evaluated by comparing it with some of the transfer learning models such as ResNet50, VGG-16, MobileNetV2, and DenseNet121. The proposed model provides an accuracy of 97.20%, which is the highest among the previous state-of-art models for multi-class skin lesion classification. The efficacy of the proposed model is also validated by visualizing the results obtained using a graphical user interface (GUI).

Artificial Intelligence (AI) Game Changer in Cancer Biology

Healthcare is one of many industries where the most modern technologies, such as artificial intelligence and machine learning, have shown a wide range of applications. Cancer, one of the most prevalent non-communicable diseases in modern times, accounts for a sizable portion of worldwide mortality. Investigations are continuously being conducted to find ways to reduce cancer mortality and morbidity. Artificial Intelligence (AI) is currently being used in cancer research, with promising results. Two main features play a vital role in improving cancer prognosis: early detection and proper diagnosis using imaging and molecular techniques. AI's use as a tool in these sectors has demonstrated its capacity to precisely detect and diagnose, which is one of AI's many applications in cancer research. The purpose of this chapter is to review the literature and find AI applications in a range of cancers that are commonly seen.

Implementation of a dermatoscopy curriculum during residency at Augsburg University Hospital in Germany

BACKGROUND AND OBJECTIVES

To date, there is no structured program for dermatoscopy training during residency in Germany. Whether and how much dermatoscopy training is acquired is left to the initiative of each resident, although dermatoscopy is one of the core competencies of dermatological training and daily practice. The aim of the study was to establish a structured dermatoscopy curriculum during residency at the University Hospital Augsburg.

PATIENTS AND METHODS

An online platform with dermatoscopy modules was created, accessible regardless of time and place. Practical skills were acquired under the personal guidance of a dermatoscopy expert. Participants were tested on their level of knowledge before and after completing the modules. Test scores on management decisions and correct dermatoscopic diagnosis were analyzed.

RESULTS

Results of 28 participants showed improvements in management decisions from pre- to posttest (74.0% vs. 89.4%) and in dermatoscopic accuracy (65.0% vs. 85.6%). Pre- vs. posttest differences in test score (7.05/10 vs. 8.94/10 points) and correct diagnosis were significant (p < 0.001).

CONCLUSIONS

The dermatoscopy curriculum increases the number of correct management decisions and dermatoscopy diagnoses. This will result in more skin cancers being detected, and fewer benign lesions being excised. The curriculum can be offered to other dermatology training centers and medical professionals.

Implementierung eines Dermatoskopie-Curriculums in der Facharztausbildung am Universitätsklinikum Augsburg

Hintergrund und Ziele

Bislang gibt es in Deutschland kein strukturiertes Programm für die Dermatoskopieausbildung während der Facharztausbildung. Es bleibt der Initiative des einzelnen Assistenzarztes überlassen, ob und in welchem Umfang er sich in der Dermatoskopie weiterbildet, obwohl die Dermatoskopie zu den Kernkompetenzen der dermatologischen Ausbildung und der täglichen Praxis gehört. Ziel der Studie war die Etablierung eines strukturierten Dermatoskopie‐Curriculums während der dermatologischen Facharztausbildung am Universitätsklinikum Augsburg.

Patienten und Methodik

Es wurde eine Online‐Plattform mit Dermatoskopie‐Modulen geschaffen, auf die von überall und jederzeit zugegriffen werden kann. Praktische Fertigkeiten wurden unter individueller Anleitung eines Dermatoskopie‐Experten erworben. Die Teilnehmer wurden vor und nach Abschluss der Module auf ihren Wissensstand getestet. Die Testergebnisse zum therapeutischen Management und zur korrekten dermatoskopischen Diagnose wurden analysiert.

Ergebnisse

Die Ergebnisse der 28 Teilnehmer verbesserten sich vom Eingangs‐ zum Abschlusstest bei der Managemententscheidung (74,0% vs. 89,4%) und bei der dermatoskopischen Genauigkeit (65,0% vs. 85,6%). Die Unterschiede zwischen Eingangs‐ und Abschlusstest bei der Gesamtpunktzahl (7,05/10 vs. 8,94/10 Punkte) und bei der richtigen Diagnose waren signifikant (p < 0,001).

Schlussfolgerungen

Das Dermatoskopie‐Curriculum verbessert die Managemententscheidungen und die dermatoskopische Diagnostik der Teilnehmer. Das wird dazu führen, dass mehr Hautkrebsfälle erkannt werden und weniger gutartige Läsionen reseziert werden müssen. Das Curriculum kann anderen dermatologischen Ausbildungszentren und Gesundheitsberufen angeboten werden.

Assessment of Diagnostic Performance of Dermatologists Cooperating With a Convolutional Neural Network in a Prospective Clinical Study: Human With Machine

Importance

Studies suggest that convolutional neural networks (CNNs) perform equally to trained dermatologists in skin lesion classification tasks. Despite the approval of the first neural networks for clinical use, prospective studies demonstrating benefits of human with machine cooperation are lacking.

Objective

To assess whether dermatologists benefit from cooperation with a market-approved CNN in classifying melanocytic lesions.

Design, Setting, and Participants

In this prospective diagnostic 2-center study, dermatologists performed skin cancer screenings using naked-eye examination and dermoscopy. Dermatologists graded suspect melanocytic lesions by the probability of malignancy (range 0-1, threshold for malignancy ≥0.5) and indicated management decisions (no action, follow-up, excision). Next, dermoscopic images of suspect lesions were assessed by a market-approved CNN, Moleanalyzer Pro (FotoFinder Systems). The CNN malignancy scores (range 0-1, threshold for malignancy ≥0.5) were transferred to dermatologists with the request to re-evaluate lesions and revise initial decisions in consideration of CNN results. Reference diagnoses were based on histopathologic examination in 125 (54.8%) lesions or, in the case of nonexcised lesions, on clinical follow-up data and expert consensus. Data were collected from October 2020 to October 2021.

Main Outcomes and Measures

Primary outcome measures were diagnostic sensitivity and specificity of dermatologists alone and dermatologists cooperating with the CNN. Accuracy and receiver operator characteristic area under the curve (ROC AUC) were considered as additional measures.

Results

A total of 22 dermatologists detected 228 suspect melanocytic lesions (190 nevi, 38 melanomas) in 188 patients (mean [range] age, 53.4 [19-91] years; 97 [51.6%] male patients). Diagnostic sensitivity and specificity significantly improved when dermatologists additionally integrated CNN results into decision-making (mean sensitivity from 84.2% [95% CI, 69.6%-92.6%] to 100.0% [95% CI, 90.8%-100.0%]; P = .03; mean specificity from 72.1% [95% CI, 65.3%-78.0%] to 83.7% [95% CI, 77.8%-88.3%]; P < .001; mean accuracy from 74.1% [95% CI, 68.1%-79.4%] to 86.4% [95% CI, 81.3%-90.3%]; P < .001; and mean ROC AUC from 0.895 [95% CI, 0.836-0.954] to 0.968 [95% CI, 0.948-0.988]; P = .005). In addition, the CNN alone achieved a comparable sensitivity, higher specificity, and higher diagnostic accuracy compared with dermatologists alone in classifying melanocytic lesions. Moreover, unnecessary excisions of benign nevi were reduced by 19.2%, from 104 (54.7%) of 190 benign nevi to 84 nevi when dermatologists cooperated with the CNN (P < .001). Most lesions were examined by dermatologists with 2 to 5 years (96, 42.1%) or less than 2 years of experience (78, 34.2%); others (54, 23.7%) were evaluated by dermatologists with more than 5 years of experience. Dermatologists with less dermoscopy experience cooperating with the CNN had the most diagnostic improvement compared with more experienced dermatologists.

Conclusions and Relevance

In this prospective diagnostic study, these findings suggest that dermatologists may improve their performance when they cooperate with the market-approved CNN and that a broader application of this human with machine approach could be beneficial for dermatologists and patients.

Quality, Usability, and Effectiveness of mHealth Apps and the Role of Artificial Intelligence: Current Scenario and Challenges

The use of artificial intelligence (AI) and big data in medicine has increased in recent years. Indeed, the use of AI in mobile health (mHealth) apps could considerably assist both individuals and health care professionals in the prevention and management of chronic diseases, in a person-centered manner. Nonetheless, there are several challenges that must be overcome to provide high-quality, usable, and effective mHealth apps. Here, we review the rationale and guidelines for the implementation of mHealth apps and the challenges regarding quality, usability, and user engagement and behavior change, with a special focus on the prevention and management of noncommunicable diseases. We suggest that a cocreation-based framework is the best method to address these challenges. Finally, we describe the current and future roles of AI in improving personalized medicine and provide recommendations for developing AI-based mHealth apps. We conclude that the implementation of AI and mHealth apps for routine clinical practice and remote health care will not be feasible until we overcome the main challenges regarding data privacy and security, quality assessment, and the reproducibility and uncertainty of AI results. Moreover, there is a lack of both standardized methods to measure the clinical outcomes of mHealth apps and techniques to encourage user engagement and behavior changes in the long term. We expect that in the near future, these obstacles will be overcome and that the ongoing European project, Watching the risk factors (WARIFA), will provide considerable advances in the implementation of AI-based mHealth apps for disease prevention and health promotion.

Digital health-high tech or high touch?

Digital transformation in medicine refers to the implementation of information technology-driven developments in the healthcare system and their impact on the way we teach, share, and practice medicine. We would like to provide an overview of current developments and opportunities but also of the risks of digital transformation in medicine. Therefore, we examine the possibilities wearables and digital biomarkers provide for early detection and monitoring of diseases and discuss the potential of artificial intelligence applications in medicine. Furthermore, we outline new opportunities offered by telemedicine applications and digital therapeutics, discuss the aspects of social media in healthcare, and provide an outlook on "Health 4.0."

Artificial intelligence for basal cell carcinoma: diagnosis and distinction from histological mimics

We trained an artificial intelligence (AI) algorithm to identify basal cell carcinoma (BCC), and to distinguish BCC from histological mimics. A total of 1061 glass slides were collected: 616 containing BCC and 445 without BCC. BCC slides were collected prospectively, reflecting the range of specimen types and morphological variety encountered in routine pathology practice. Benign and malignant histological mimics of BCC were selected prospectively and retrospectively, including cases considered diagnostically challenging for pathologists. Glass slides were digitally scanned to create a whole slide image (WSI), which was divided into patches representing a tissue area of 65,535 μm². Pathologists annotated the data, yielding 87,205 patches labelled BCC present and 1,688,697 patches labelled BCC absent. The COMPASS model (COntext-aware Multi-scale tool for Pathologists Assessing SlideS) based on Convolutional Neural Networks, was trained to provide a probability of BCC being present at the patch level and the slide level. The test set comprised 246 slides, 147 of which contained BCC. The COMPASS AI model demonstrated high accuracy, classifying WSIs as containing BCC with a sensitivity of 98.0% and a specificity of 97.0%, representing 240 WSIs classified correctly, three false positives, and three false negatives. Using BCC as a proof of concept, we demonstrate how AI can account for morphological variation within an entity, and accurately distinguish from histologically similar entities. Our study highlights the potential for AI in routine pathology practice.

Analysis: Flawed Datasets of Monkeypox Skin Images

The self-proclaimed first publicly available dataset of Monkeypox skin images consists of medically irrelevant images extracted from Google and photography repositories through a process denominated web-scrapping. Yet, this did not stop other researchers from employing it to build Machine Learning (ML) solutions aimed at computer-aided diagnosis of Monkeypox and other viral infections presenting skin lesions. Neither did it stop the reviewers or editors from publishing these subsequent works in peer-reviewed journals. Several of these works claimed extraordinary performance in the classification of Monkeypox, Chickenpox and Measles, employing ML and the aforementioned dataset. In this work, we analyse the initiator work that has catalysed the development of several ML solutions, and whose popularity is continuing to grow. Further, we provide a rebuttal experiment that showcases the risks of such methodologies, proving that the ML solutions do not necessarily obtain their performance from the features relevant to the diseases at issue.

Exploring the potential of artificial intelligence in improving skin lesion diagnosis in primary care

Dermatological conditions are a relevant health problem. Machine learning (ML) models are increasingly being applied to dermatology as a diagnostic decision support tool using image analysis, especially for skin cancer detection and disease classification. The objective of this study was to perform a prospective validation of an image analysis ML model, which is capable of screening 44 skin diseases, comparing its diagnostic accuracy with that of General Practitioners (GPs) and teledermatology (TD) dermatologists in a real-life setting. Prospective, diagnostic accuracy study including 100 consecutive patients with a skin problem who visited a participating GP in central Catalonia, Spain, between June 2021 and October 2021. The skin issue was first assessed by the GPs. Then an anonymised skin disease picture was taken and uploaded to the ML application, which returned a list with the Top-5 possible diagnosis in order of probability. The same image was then sent to a dermatologist via TD for diagnosis, as per clinical practice. The GPs Top-3, ML model's Top-5 and dermatologist's Top-3 assessments were compared to calculate the accuracy, sensitivity, specificity and diagnostic accuracy of the ML models. The overall Top-1 accuracy of the ML model (39%) was lower than that of GPs (64%) and dermatologists (72%). When the analysis was limited to the diagnoses on which the algorithm had been explicitly trained (n = 82), the balanced Top-1 accuracy of the ML model increased (48%) and in the Top-3 (75%) was comparable to the GPs Top-3 accuracy (76%). The Top-5 accuracy of the ML model (89%) was comparable to the dermatologist Top-3 accuracy (90%). For the different diseases, the sensitivity of the model (Top-3 87% and Top-5 96%) is higher than that of the clinicians (Top-3 GPs 76% and Top-3 dermatologists 84%) only in the benign tumour pathology group, being on the other hand the most prevalent category (n = 53). About the satisfaction of professionals, 92% of the GPs considered it as a useful diagnostic support tool (DST) for the differential diagnosis and in 60% of the cases as an aid in the final diagnosis of the skin lesion. The overall diagnostic accuracy of the model in this study, under real-life conditions, is lower than that of both GPs and dermatologists. This result aligns with the findings of few existing prospective studies conducted under real-life conditions. The outcomes emphasize the significance of involving clinicians in the training of the model and the capability of ML models to assist GPs, particularly in differential diagnosis. Nevertheless, external testing in real-life conditions is crucial for data validation and regulation of these AI diagnostic models before they can be used in primary care.

Interpretable Skin Cancer Classification based on Incremental Domain Knowledge Learning

The recent advances in artificial intelligence have led to the rapid development of computer-aided skin cancer diagnosis applications that perform on par with dermatologists. However, the black-box nature of such applications makes it difficult for physicians to trust the predicted decisions, subsequently preventing the proliferation of such applications in the clinical workflow. In this work, we aim to address this challenge by developing an interpretable skin cancer diagnosis approach using clinical images. Accordingly, a skin cancer diagnosis model consolidated with two interpretability methods is developed. The first interpretability method integrates skin cancer diagnosis domain knowledge, characterized by a skin lesion taxonomy, into model development, whereas the other method focuses on visualizing the decision-making process by highlighting the dominant of interest regions of skin lesion images. The proposed model is trained and validated on clinical images since the latter are easily obtainable by non-specialist healthcare providers. The results demonstrate the effectiveness of incorporating lesion taxonomy in improving model classification accuracy, where our model can predict the skin lesion origin as melanocytic or non-melanocytic with an accuracy of 87%, predict lesion malignancy with 77% accuracy, and provide disease diagnosis with an accuracy of 71%. In addition, the implemented interpretability methods assist understand the model's decision-making process and detecting misdiagnoses. This work is a step toward achieving interpretability in skin cancer diagnosis using clinical images. The developed approach can assist general practitioners to make an early diagnosis, thus reducing the redundant referrals that expert dermatologists receive for further investigations.

Melanoma classification from dermatoscopy images using knowledge distillation for highly imbalanced data

Melanoma is a deadly malignant skin cancer that generally grows and spreads rapidly. Early detection of melanoma can improve the prognosis of a patient. However, large-scale screening for melanoma is arduous due to human error and the unavailability of trained experts. Accurate automatic melanoma classification from dermoscopy images can help mitigate such issues. However, the classification task is challenging due to class-imbalance, high inter-class, and low intra-class similarity problems. It results in poor sensitivity scores when it comes to the disease classification task. The work proposes a novel knowledge-distilled lightweight Deep-CNN-based framework for melanoma classification to tackle the high inter-class and low intra-class similarity problems. To handle the high class-imbalance problem, the work proposes using Cost-Sensitive Learning with Focal Loss, to achieve better sensitivity scores. As a pre-processing step, an in-painting algorithm is used to remove artifacts from dermoscopy images. New CutOut variants, namely, Sprinkled and microscopic Cutout augmentations, have been employed as regularizers to avoid over-fitting. The robustness of the model has been studied through stratified K-fold cross-validation. Ablation studies with test time augmentation (TTA) and the addition of various noises like salt & pepper, pepper-only, and Gaussian noises have been studied. All the models trained in the work have been evaluated on the SIIM-ISIC Melanoma Classification Challenge - ISIC-2020 dataset. With our EfficientNet-B5 (FL) teacher model, the EfficientNet-B2 student model achieved an Area under the Curve (AUC) of 0.9295, and a sensitivity of 0.8087 on the ISIC-2020 test data. The sensitivity value of 0.8087 for melanoma classification is the current state-of-the-art result in the literature for the ISIC-2020 dataset which is a significant 49.48% increase from the best non-distilled standalone model, EfficientNet B5 (FL) teacher with 0.5410.

AI-Powered Diagnosis of Skin Cancer: A Contemporary Review, Open Challenges and Future Research Directions

Skin cancer continues to remain one of the major healthcare issues across the globe. If diagnosed early, skin cancer can be treated successfully. While early diagnosis is paramount for an effective cure for cancer, the current process requires the involvement of skin cancer specialists, which makes it an expensive procedure and not easily available and affordable in developing countries. This dearth of skin cancer specialists has given rise to the need to develop automated diagnosis systems. In this context, Artificial Intelligence (AI)-based methods have been proposed. These systems can assist in the early detection of skin cancer and can consequently lower its morbidity, and, in turn, alleviate the mortality rate associated with it. Machine learning and deep learning are branches of AI that deal with statistical modeling and inference, which progressively learn from data fed into them to predict desired objectives and characteristics. This survey focuses on Machine Learning and Deep Learning techniques deployed in the field of skin cancer diagnosis, while maintaining a balance between both techniques. A comparison is made to widely used datasets and prevalent review papers, discussing automated skin cancer diagnosis. The study also discusses the insights and lessons yielded by the prior works. The survey culminates with future direction and scope, which will subsequently help in addressing the challenges faced within automated skin cancer diagnosis.

AI in the hands of imperfect users

As the use of artificial intelligence and machine learning (AI/ML) continues to expand in healthcare, much attention has been given to mitigating bias in algorithms to ensure they are employed fairly and transparently. Less attention has fallen to addressing potential bias among AI/ML's human users or factors that influence user reliance. We argue for a systematic approach to identifying the existence and impacts of user biases while using AI/ML tools and call for the development of embedded interface design features, drawing on insights from decision science and behavioral economics, to nudge users towards more critical and reflective decision making using AI/ML.

Detection and Classification of Skin Cancer Using Unmanned Transfer Learning Based Probabilistic Multi-Layer Dense Networks

Skin cancer is one of the most dangerous cancers that may occur for different age groups of people. As a result, early identification of skin cancer has the potential to save millions of lives. In Traditional machine learning approaches, there are various drawbacks in detection and classification of skin lesions. As a result, to achieve the robust performance, initially the joint trilateral and bilateral filter (JTBF) with convolutional auto encoder and decoder (CAED)-based preprocessing method is used to enhance the skin lesion and also removes hair from lesions. Then, transfer learning-based probabilistic multi-layer dense networks (PMDN) method-based unmanned Transfer learning segmentation method is adapted for accurately detecting the cancer region on skin lesions. Further, transfer learning convolution neural network (TL-CNN) is used to extract the features from the segmented region, which extracts the detailed inter-disease-dependent (IDD) and intra-disease specific (IDS) features. Finally, Alexa Net model is trained and tested with the IDD, IDS features and classifies the eight different skin cancer types. The complexity of the transfer learning networks is optimized by the using the Adam optimizer. Finally, the simulation results show that the proposed model resulted in superior segmentation, feature extraction, and classification performances as compared to conventional approaches. Further, the proposed method achieved 99.937% segmentation accuracy, 99.47% feature extraction accuracy, and 99.27% classification accuracy on ISIC-2019 public challenge dataset.

Artificial intelligence in Dermatopathology

INTRODUCTION

Ever evolving research in medical field has reached an exciting stage with advent of newer technologies. With the introduction of digital microscopy, pathology has transitioned to become more digitally oriented speciality. The potential of artificial intelligence (AI) in dermatopathology is to aid the diagnosis, and it requires dermatopathologists' guidance for efficient functioning of artificial intelligence.

METHOD

Comprehensive literature search was performed using electronic online databases "PubMed" and "Google Scholar." Articles published in English language were considered for the review.

RESULTS

Convolutional neural network, a type of deep neural network, is considered as an ideal tool in image recognition, processing, classification, and segmentation. Implementation of AI in tumor pathology is involved in the diagnosis, grading, staging, and prognostic prediction as well as in identification of genetic or pathological features. In this review, we attempt to discuss the use of AI in dermatopathology, the attitude of patients and clinicians, its challenges, limitation, and potential opportunities in future implementation.

Deep Learning for Skin Melanocytic Tumors in Whole-Slide Images: A Systematic Review

The rise of Artificial Intelligence (AI) has shown promising performance as a support tool in clinical pathology workflows. In addition to the well-known interobserver variability between dermatopathologists, melanomas present a significant challenge in their histological interpretation. This study aims to analyze all previously published studies on whole-slide images of melanocytic tumors that rely on deep learning techniques for automatic image analysis. Embase, Pubmed, Web of Science, and Virtual Health Library were used to search for relevant studies for the systematic review, in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist. Articles from 2015 to July 2022 were included, with an emphasis placed on the used artificial intelligence methods. Twenty-eight studies that fulfilled the inclusion criteria were grouped into four groups based on their clinical objectives, including pathologists versus deep learning models (n = 10), diagnostic prediction (n = 7); prognosis (n = 5), and histological features (n = 6). These were then analyzed to draw conclusions on the general parameters and conditions of AI in pathology, as well as the necessary factors for better performance in real scenarios.

Squeeze-MNet: Precise Skin Cancer Detection Model for Low Computing IoT Devices Using Transfer Learning

Cancer remains a deadly disease. We developed a lightweight, accurate, general-purpose deep learning algorithm for skin cancer classification. Squeeze-MNet combines a Squeeze algorithm for digital hair removal during preprocessing and a MobileNet deep learning model with predefined weights. The Squeeze algorithm extracts important image features from the image, and the black-hat filter operation removes noise. The MobileNet model (with a dense neural network) was developed using the International Skin Imaging Collaboration (ISIC) dataset to fine-tune the model. The proposed model is lightweight; the prototype was tested on a Raspberry Pi 4 Internet of Things device with a Neo pixel 8-bit LED ring; a medical doctor validated the device. The average precision (AP) for benign and malignant diagnoses was 99.76% and 98.02%, respectively. Using our approach, the required dataset size decreased by 66%. The hair removal algorithm increased the accuracy of skin cancer detection to 99.36% with the ISIC dataset. The area under the receiver operating curve was 98.9%.

Artificial intelligence: Its role in dermatopathology

Artificial intelligence (AI), a major frontier in the field of medical research, can potentially lead to a paradigm shift in clinical practice. A type of artificial intelligence system known as convolutional neural network points to the possible utility of deep learning in dermatopathology. Though pathology has been traditionally restricted to microscopes and glass slides, recent advancement in digital pathological imaging has led to a transition making it a potential branch for the implementation of artificial intelligence. The current application of artificial intelligence in dermatopathology is to complement the diagnosis and requires a well-trained dermatopathologist's guidance for better designing and development of deep learning algorithms. Here we review the recent advances of artificial intelligence in dermatopathology, its applications in disease diagnosis and in research, along with its limitations and future potential.

ENTAIL: yEt aNoTher amyloid fIbrils cLassifier

BACKGROUND

This research aims to increase our knowledge of amyloidoses. These disorders cause incorrect protein folding, affecting protein functionality (on structure). Fibrillar deposits are the basis of some wellknown diseases, such as Alzheimer, Creutzfeldt-Jakob diseases and type II diabetes. For many of these amyloid proteins, the relative precursors are known. Discovering new protein precursors involved in forming amyloid fibril deposits would improve understanding the pathological processes of amyloidoses.

RESULTS

A new classifier, called ENTAIL, was developed using over than 4000 molecular descriptors. ENTAIL was based on the Naive Bayes Classifier with Unbounded Support and Gaussian Kernel Type, with an accuracy on the test set of 81.80%, SN of 100%, SP of 63.63% and an MCC of 0.683 on a balanced dataset.

CONCLUSIONS

The analysis carried out has demonstrated how, despite the various configurations of the tests, performances are superior in terms of performance on a balanced dataset.

Attention Cost-Sensitive Deep Learning-Based Approach for Skin Cancer Detection and Classification

Deep learning-based models have been employed for the detection and classification of skin diseases through medical imaging. However, deep learning-based models are not effective for rare skin disease detection and classification. This is mainly due to the reason that rare skin disease has very a smaller number of data samples. Thus, the dataset will be highly imbalanced, and due to the bias in learning, most of the models give better performances. The deep learning models are not effective in detecting the affected tiny portions of skin disease in the overall regions of the image. This paper presents an attention-cost-sensitive deep learning-based feature fusion ensemble meta-classifier approach for skin cancer detection and classification. Cost weights are included in the deep learning models to handle the data imbalance during training. To effectively learn the optimal features from the affected tiny portions of skin image samples, attention is integrated into the deep learning models. The features from the finetuned models are extracted and the dimensionality of the features was further reduced by using a kernel-based principal component (KPCA) analysis. The reduced features of the deep learning-based finetuned models are fused and passed into ensemble meta-classifiers for skin disease detection and classification. The ensemble meta-classifier is a two-stage model. The first stage performs the prediction of skin disease and the second stage performs the classification by considering the prediction of the first stage as features. Detailed analysis of the proposed approach is demonstrated for both skin disease detection and skin disease classification. The proposed approach demonstrated an accuracy of 99% on skin disease detection and 99% on skin disease classification. In all the experimental settings, the proposed approach outperformed the existing methods and demonstrated a performance improvement of 4% accuracy for skin disease detection and 9% accuracy for skin disease classification. The proposed approach can be used as a computer-aided diagnosis (CAD) tool for the early diagnosis of skin cancer detection and classification in healthcare and medical environments. The tool can accurately detect skin diseases and classify the skin disease into their skin disease family.

Integrated Design of Optimized Weighted Deep Feature Fusion Strategies for Skin Lesion Image Classification

This study mainly focuses on pre-processing the HAM10000 and BCN20000 skin lesion datasets to select important features that will drive for proper skin cancer classification. In this work, three feature fusion strategies have been proposed by utilizing three pre-trained Convolutional Neural Network (CNN) models, namely VGG16, EfficientNet B0, and ResNet50 to select the important features based on the weights of the features and are coined as Adaptive Weighted Feature Set (AWFS). Then, two other strategies, Model-based Optimized Weighted Feature Set (MOWFS) and Feature-based Optimized Weighted Feature Set (FOWFS), are proposed by optimally and adaptively choosing the weights using a meta-heuristic artificial jellyfish (AJS) algorithm. The MOWFS-AJS is a model-specific approach whereas the FOWFS-AJS is a feature-specific approach for optimizing the weights chosen for obtaining optimal feature sets. The performances of those three proposed feature selection strategies are evaluated using Decision Tree (DT), Naïve Bayesian (NB), Multi-Layer Perceptron (MLP), and Support Vector Machine (SVM) classifiers and the performance are measured through accuracy, precision, sensitivity, and F1-score. Additionally, the area under the receiver operating characteristics curves (AUC-ROC) is plotted and it is observed that FOWFS-AJS shows the best accuracy performance based on the SVM with 94.05% and 94.90%, respectively, for HAM 10000 and BCN 20000 datasets. Finally, the experimental results are also analyzed using a non-parametric Friedman statistical test and the computational times are recorded; the results show that, out of those three proposed feature selection strategies, the FOWFS-AJS performs very well because its quick converging nature is inculcated with the help of AJS.

Computer Aided Diagnosis of Melanoma Using Deep Neural Networks and Game Theory: Application on Dermoscopic Images of Skin Lesions

Early detection of melanoma remains a daily challenge due to the increasing number of cases and the lack of dermatologists. Thus, AI-assisted diagnosis is considered as a possible solution for this issue. Despite the great advances brought by deep learning and especially convolutional neural networks (CNNs), computer-aided diagnosis (CAD) systems are still not used in clinical practice. This may be explained by the dermatologist's fear of being misled by a false negative and the assimilation of CNNs to a "black box", making their decision process difficult to understand by a non-expert. Decision theory, especially game theory, is a potential solution as it focuses on identifying the best decision option that maximizes the decision-maker's expected utility. This study presents a new framework for automated melanoma diagnosis. Pursuing the goal of improving the performance of existing systems, our approach also attempts to bring more transparency in the decision process. The proposed framework includes a multi-class CNN and six binary CNNs assimilated to players. The players' strategies is to first cluster the pigmented lesions (melanoma, nevus, and benign keratosis), using the introduced method of evaluating the confidence of the predictions, into confidence level (confident, medium, uncertain). Then, a subset of players has the strategy to refine the diagnosis for difficult lesions with medium and uncertain prediction. We used EfficientNetB5 as the backbone of our networks and evaluated our approach on the public ISIC dataset consisting of 8917 lesions: melanoma (1113), nevi (6705) and benign keratosis (1099). The proposed framework achieved an area under the receiver operating curve (AUROC) of 0.93 for melanoma, 0.96 for nevus and 0.97 for benign keratosis. Furthermore, our approach outperformed existing methods in this task, improving the balanced accuracy (BACC) of the best compared method from 77% to 86%. These results suggest that our framework provides an effective and explainable decision-making strategy. This approach could help dermatologists in their clinical practice for patients with atypical and difficult-to-diagnose pigmented lesions. We also believe that our system could serve as a didactic tool for less experienced dermatologists.

Introducing AI to the molecular tumor board: one direction toward the establishment of precision medicine using large-scale cancer clinical and biological information

Since U.S. President Barack Obama announced the Precision Medicine Initiative in his New Year's State of the Union address in 2015, the establishment of a precision medicine system has been emphasized worldwide, particularly in the field of oncology. With the advent of next-generation sequencers specifically, genome analysis technology has made remarkable progress, and there are active efforts to apply genome information to diagnosis and treatment. Generally, in the process of feeding back the results of next-generation sequencing analysis to patients, a molecular tumor board (MTB), consisting of experts in clinical oncology, genetic medicine, etc., is established to discuss the results. On the other hand, an MTB currently involves a large amount of work, with humans searching through vast databases and literature, selecting the best drug candidates, and manually confirming the status of available clinical trials. In addition, as personalized medicine advances, the burden on MTB members is expected to increase in the future. Under these circumstances, introducing cutting-edge artificial intelligence (AI) technology and information and communication technology to MTBs while reducing the burden on MTB members and building a platform that enables more accurate and personalized medical care would be of great benefit to patients. In this review, we introduced the latest status of elemental technologies that have potential for AI utilization in MTB, and discussed issues that may arise in the future as we progress with AI implementation.

Skin Lesion Classification on Imbalanced Data Using Deep Learning with Soft Attention

Today, the rapid development of industrial zones leads to an increased incidence of skin diseases because of polluted air. According to a report by the American Cancer Society, it is estimated that in 2022 there will be about 100,000 people suffering from skin cancer and more than 7600 of these people will not survive. In the context that doctors at provincial hospitals and health facilities are overloaded, doctors at lower levels lack experience, and having a tool to support doctors in the process of diagnosing skin diseases quickly and accurately is essential. Along with the strong development of artificial intelligence technologies, many solutions to support the diagnosis of skin diseases have been researched and developed. In this paper, a combination of one Deep Learning model (DenseNet, InceptionNet, ResNet, etc) with Soft-Attention, which unsupervisedly extract a heat map of main skin lesions. Furthermore, personal information including age and gender are also used. It is worth noting that a new loss function that takes into account the data imbalance is also proposed. Experimental results on data set HAM10000 show that using InceptionResNetV2 with Soft-Attention and the new loss function gives 90 percent accuracy, mean of precision, F1-score, recall, and AUC of 0.81, 0.81, 0.82, and 0.99, respectively. Besides, using MobileNetV3Large combined with Soft-Attention and the new loss function, even though the number of parameters is 11 times less and the number of hidden layers is 4 times less, it achieves an accuracy of 0.86 and 30 times faster diagnosis than InceptionResNetV2.

Analysis of Skin Cancer and Patient Healthcare Using Data Mining Techniques

Skin cancer is the uncontrolled growth of irregular cancer cells in the human-skin's outer layer. Skin cells commonly grow in an uneven pattern on exposed skin surfaces. The majority of melanomas, aside from this variety, form in areas that are rarely exposed to sunlight. Harmful sunlight, which results in a mutation in the DNA and irreparable DNA damage, is the primary cause of skin cancer. This demonstrates a close connection between skin cancer and molecular biology and genetics. Males and females both experience the same incidence rate. Avoiding revelation to ultraviolet (UV) emissions can lower the risk rate. This needed to be known about in order to be prevented from happening. To identify skin cancer, an improved image analysis technique was put forth in this work. The skin alterations are routinely monitored by this proposed skin cancer categorization approach. Therefore, early detection of suspicious skin changes can aid in the early discovery of skin cancer, increasing the likelihood of a favourable outcome. Due to the blessing of diagnostic technology and recent advancements in cancer treatment, the survival rate of patients with skin cancer has grown. The strategy for detecting skin cancer using image processing technologies is presented in this paper. The system receives the image of the skin lesion as an input and analyses it using cutting-edge image processing methods to determine whether skin cancer is present. The Lesion Image Analysis Tools use texture, size, and shape assessment for image segmentation and feature phases to check for various cancer criteria including asymmetries, borders, pigment, and diameter. The image is classified as Normal skin and a lesion caused by skin cancer using the derived feature parameters.

An extensive review of state-of-the-art transfer learning techniques used in medical imaging: Open issues and challenges

Deep learning techniques, which use a massive technology known as convolutional neural networks, have shown excellent results in a variety of areas, including image processing and interpretation. However, as the depth of these networks grows, so does the demand for a large amount of labeled data required to train these networks. In particular, the medical field suffers from a lack of images because the procedure for obtaining labeled medical images in the healthcare field is difficult, expensive, and requires specialized expertise to add labels to images. Moreover, the process may be prone to errors and time-consuming. Current research has revealed transfer learning as a viable solution to this problem. Transfer learning allows us to transfer knowledge gained from a previous process to improve and tackle a new problem. This study aims to conduct a comprehensive survey of recent studies that dealt with solving this problem and the most important metrics used to evaluate these methods. In addition, this study identifies problems in transfer learning techniques and highlights the problems of the medical dataset and potential problems that can be addressed in future research. According to our review, many researchers use pre-trained models on the Imagenet dataset (VGG16, ResNet, Inception v3) in many applications such as skin cancer, breast cancer, and diabetic retinopathy classification tasks. These techniques require further investigation of these models, due to training them on natural, non-medical images. In addition, many researchers use data augmentation techniques to expand their dataset and avoid overfitting. However, not enough studies have shown the effect of performance with or without data augmentation. Accuracy, recall, precision, F1 score, receiver operator characteristic curve, and area under the curve (AUC) were the most widely used measures in these studies. Furthermore, we identified problems in the datasets for melanoma and breast cancer and suggested corresponding solutions.

Neural Networks-Based On-Site Dermatologic Diagnosis through Hyperspectral Epidermal Images

Cancer originates from the uncontrolled growth of healthy cells into a mass. Chromophores, such as hemoglobin and melanin, characterize skin spectral properties, allowing the classification of lesions into different etiologies. Hyperspectral imaging systems gather skin-reflected and transmitted light into several wavelength ranges of the electromagnetic spectrum, enabling potential skin-lesion differentiation through machine learning algorithms. Challenged by data availability and tiny inter and intra-tumoral variability, here we introduce a pipeline based on deep neural networks to diagnose hyperspectral skin cancer images, targeting a handheld device equipped with a low-power graphical processing unit for routine clinical testing. Enhanced by data augmentation, transfer learning, and hyperparameter tuning, the proposed architectures aim to meet and improve the well-known dermatologist-level detection performances concerning both benign-malignant and multiclass classification tasks, being able to diagnose hyperspectral data considering real-time constraints. Experiments show 87% sensitivity and 88% specificity for benign-malignant classification and specificity above 80% for the multiclass scenario. AUC measurements suggest classification performance improvement above 90% with adequate thresholding. Concerning binary segmentation, we measured skin DICE and IOU higher than 90%. We estimated 1.21 s, at most, consuming 5 Watts to segment the epidermal lesions with the U-Net++ architecture, meeting the imposed time limit. Hence, we can diagnose hyperspectral epidermal data assuming real-time constraints.

An Efficient Deep Learning-Based Skin Cancer Classifier for an Imbalanced Dataset

Efficient skin cancer detection using images is a challenging task in the healthcare domain. In today’s medical practices, skin cancer detection is a time-consuming procedure that may lead to a patient’s death in later stages. The diagnosis of skin cancer at an earlier stage is crucial for the success rate of complete cure. The efficient detection of skin cancer is a challenging task. Therefore, the numbers of skilful dermatologists around the globe are not enough to deal with today’s healthcare. The huge difference between data from various healthcare sector classes leads to data imbalance problems. Due to data imbalance issues, deep learning models are often trained on one class more than others. This study proposes a novel deep learning-based skin cancer detector using an imbalanced dataset. Data augmentation was used to balance various skin cancer classes to overcome the data imbalance. The Skin Cancer MNIST: HAM10000 dataset was employed, which consists of seven classes of skin lesions. Deep learning models are widely used in disease diagnosis through images. Deep learning-based models (AlexNet, InceptionV3, and RegNetY-320) were employed to classify skin cancer. The proposed framework was also tuned with various combinations of hyperparameters. The results show that RegNetY-320 outperformed InceptionV3 and AlexNet in terms of the accuracy, F1-score, and receiver operating characteristic (ROC) curve both on the imbalanced and balanced datasets. The performance of the proposed framework was better than that of conventional methods. The accuracy, F1-score, and ROC curve value obtained with the proposed framework were 91%, 88.1%, and 0.95, which were significantly better than those of the state-of-the-art method, which achieved 85%, 69.3%, and 0.90, respectively. Our proposed framework may assist in disease identification, which could save lives, reduce unnecessary biopsies, and reduce costs for patients, dermatologists, and healthcare professionals.

Background selection schema on deep learning-based classification of dermatological disease

Skin diseases are one of the most common ailments affecting humans. Artificial intelligence based on deep learning can significantly improve the efficiency of identifying skin disorders and alleviate the scarcity of medical resources. However, the distribution of background information in dermatological datasets is imbalanced, causing generalized deep learning models to perform poorly in skin disease classification. We propose a deep learning schema that combines data preprocessing, data augmentation, and residual networks to study the influence of color-based background selection on a deep model's capacity to learn foreground lesion subject attributes in a skin disease classification problem. First, clinical photographs are annotated by dermatologists, and then the original background information is masked with unique colors to generate several subsets with distinct background colors. Sample-balanced training and test sets are generated using random over/undersampling and data augmentation techniques. Finally, the deep learning networks are independently trained on diverse subsets of backdrop colors to compare the performance of classifiers based on different background information. Extensive experiments demonstrate that color-based background information significantly affects the classification of skin diseases and that classifiers trained on the green subset achieve state-of-the-art performance for classifying black and red skin lesions.

Deep learning-based fully automated differential diagnosis of eyelid basal cell and sebaceous carcinoma using whole slide images

Background

The differential diagnosis of eyelid basal cell carcinoma (BCC) and sebaceous carcinoma (SC) is highly dependent on pathologist’s experience. Herein, we proposed a fully automated differential diagnostic method, which used deep learning (DL) to accurately classify eyelid BCC and SC based on whole slide images (WSIs).

Methods

We used 116 haematoxylin and eosin (H&E)-stained sections from 116 eyelid BCC patients and 180 H&E-stained sections from 129 eyelid SC patients treated at the Shanghai Ninth People’s Hospital from 2017 to 2019. The method comprises two stages: patch prediction by the DenseNet-161 architecture-based DL model and WSI differentiation by an average-probability strategy-based integration module, and its differential performance was assessed by the carcinoma differentiation accuracy and F1 score. We compared the classification performance of the method with that of three pathologists, two junior and one senior. To validate the auxiliary value of the method, we compared the pathologists’ BCC and SC classification with and without the assistance of our proposed method.

Results

Our proposed method achieved an accuracy of 0.983, significantly higher than that of the three pathologists (0.644 and 0.729 for the two junior pathologists and 0.831 for the senior pathologist). With the method’s assistance, the pathologists’ accuracy increased significantly (P<0.05), by 28.8% and 15.2%, respectively, for the two junior pathologists and by 11.8% for the senior pathologist.

Conclusions

Our proposed method accurately classifies eyelid BCC and SC and effectively improves the diagnostic accuracy of pathologists. It may therefore facilitate the development of appropriate and timely therapeutic plans.

A Machine Vision Approach for Classification of Skin Cancer Using Hybrid Texture Features

The main purpose of this study is to observe the importance of machine vision (MV) approach for the identification of five types of skin cancers, namely, actinic-keratosis, benign, solar-lentigo, malignant, and nevus. The 1000 (200 × 5) benchmark image datasets of skin cancers are collected from the International Skin Imaging Collaboration (ISIC). The acquired ISIC image datasets were transformed into texture feature dataset that was a combination of first-order histogram and gray level co-occurrence matrix (GLCM) features. For the skin cancer image, a total of 137,400 (229 × 3 x 200) texture features were acquired on three nonover-lapping regions of interest (ROIs). Principal component analysis (PCA) clustering approach was employed for reducing the dimension of feature dataset. Each image acquired twenty most discriminate features based on two different approaches of statistical features such as average correlation coefficient plus probability of error (ACC + POE) and Fisher (Fis). Furthermore, a correlation-based feature selection (CFS) approach was employed for feature reduction, and optimized 12 features were acquired. Furthermore, a classification algorithm naive bayes (NB), Bayes Net (BN), LMT Tree, and multilayer perception (MLP) using 10 K-fold cross-validation approach were employed on optimized feature datasets and the overall accuracy achieved by MLP is 97.1333%.

Skin Cancer Classification With Deep Learning: A Systematic Review

Skin cancer is one of the most dangerous diseases in the world. Correctly classifying skin lesions at an early stage could aid clinical decision-making by providing an accurate disease diagnosis, potentially increasing the chances of cure before cancer spreads. However, achieving automatic skin cancer classification is difficult because the majority of skin disease images used for training are imbalanced and in short supply; meanwhile, the model's cross-domain adaptability and robustness are also critical challenges. Recently, many deep learning-based methods have been widely used in skin cancer classification to solve the above issues and achieve satisfactory results. Nonetheless, reviews that include the abovementioned frontier problems in skin cancer classification are still scarce. Therefore, in this article, we provide a comprehensive overview of the latest deep learning-based algorithms for skin cancer classification. We begin with an overview of three types of dermatological images, followed by a list of publicly available datasets relating to skin cancers. After that, we review the successful applications of typical convolutional neural networks for skin cancer classification. As a highlight of this paper, we next summarize several frontier problems, including data imbalance, data limitation, domain adaptation, model robustness, and model efficiency, followed by corresponding solutions in the skin cancer classification task. Finally, by summarizing different deep learning-based methods to solve the frontier challenges in skin cancer classification, we can conclude that the general development direction of these approaches is structured, lightweight, and multimodal. Besides, for readers' convenience, we have summarized our findings in figures and tables. Considering the growing popularity of deep learning, there are still many issues to overcome as well as chances to pursue in the future.

Dermoscopic Photographs Impact Confidence and Management of Remotely Triaged Skin Lesions

Introduction

Improving remote triage is crucial given expansions in tele-dermatology and with limited in-person care during COVID-19. In addition to clinical pictures, dermoscopic images may provide utility for triage.

Objectives

To determine if dermoscopic images enhance confidence, triage accuracy, and triage prioritization for tele-dermatology.

Methods

In this preliminary parallel convergent mixed-methods study, a cohort of dermatologists and residents assessed skin lesions using clinical and dermoscopic images. For each case, participants viewed a clinical image and determined diagnostic category, management, urgency, and decision-making confidence. They subsequently viewed the associated dermoscopy and answered the same questions. A moderated focus group discussion followed to explore perceptions on the role of dermoscopy in tele-dermatology.

Results

Dermoscopy improved recognition of malignancies by 23% and significantly reduced triage urgency measures for non-malignant lesions. Participants endorsed specific utilities of tele-dermoscopy, such as for evaluating pigmented lesions, with limitations including poor image quality.

Conclusions

Dermoscopic images may be useful when remotely triaging skin lesions. Standardized imaging protocols are needed.

Modern views on skin biopsy in the diagnostic algorithm of dermatooncological diseases

Background. Malignant neoplasms of the skin are fairly common tumors in the world population and among the population of Ukraine. The main method of diagnosing skintumors is a biopsy, which allows establishing a diagnosis at an early stage and ensures the cure of most patients. Purpose. To evaluate modern recommendations for skin biopsy in the diagnosis of dermato-onсological diseases. Materials and methods. The search for sources of information was conducted using the MEDLINE/PubMed, EMBASE/ExcerptaMedica, CochraneLibrary, PubMed та Google Scholar databases using the following keywords: skin biopsy, skin tumors, diagnosis, melanoma. Among the identified sources, works without statistical analysis, descriptions of individual cases, articles without conclusions, and sources with duplicate results were excluded. The search depth was 10 years. Results. As a result of the conducted search, 57 publications were found that corresponded to the declared purpose. The most common methods are: puncture, shaving, excisional and incisional biopsy. Most guidelines recommend full-thickness excisional biopsy as the preferred procedure for the diagnosis of suspected melanoma. It is indicated that a statistically significant mortality rate was found in the puncture biopsy group. Most observations showed no significant differences in melanoma recurrence between excisional biopsy and puncture groups. Given the clinical diversity of melanoma, there is no uniformity in the types of biopsies performed to diagnose melanoma. The most inaccurate method turned out to be the punch biopsy method, which is associated with an increased risk of underdiagnosis of melanoma. Conclusions. A skin biopsy is a mandatory first step to establish a definitive diagnosis of a skin tumor. Excisional complete biopsy is the most justified in most cases of diagnosis. Rational biopsy technique remains an issue that needs further study.

Effective active learning in digital pathology: A case study in tumor infiltrating lymphocytes

BACKGROUND AND OBJECTIVE

Deep learning methods have demonstrated remarkable performance in pathology image analysis, but they require a large amount of annotated training data from expert pathologists. The aim of this study is to minimize the data annotation need in these analyses.

METHODS

Active learning (AL) is an iterative approach to training deep learning models. It was used in our context with a Tumor Infiltrating Lymphocytes (TIL) classification task to minimize annotation. State-of-the-art AL methods were evaluated with the TIL application and we have proposed and evaluated a more efficient and effective AL acquisition method. The proposed method uses data grouping based on imaging features and model prediction uncertainty to select meaningful training samples (image patches).

RESULTS

An experimental evaluation with a collection of cancer tissue images shows that: (i) Our approach reduces the number of patches required to attain a given AUC as compared to other approaches, and (ii) our optimization (subpooling) leads to AL execution time improvement of about 2.12×.

CONCLUSIONS

This strategy enabled TIL based deep learning analyses using smaller annotation demand. We expect this approach may be used to build other analyses in digital pathology with fewer training samples.

Classification of skin cancer using convolutional neural networks analysis of Raman spectra

BACKGROUND AND OBJECTIVE

Skin cancer is the most common malignancy in whites accounting for about one third of all cancers diagnosed per year. Portable Raman spectroscopy setups for skin cancer "optical biopsy" are utilized to detect tumors based on their spectral features caused by the comparative presence of different chemical components. However, low signal-to-noise ratio in such systems may prevent accurate tumors classification. Thus, there is a challenge to develop methods for efficient skin tumors classification.

METHODS

We compare the performance of convolutional neural networks and the projection on latent structures with discriminant analysis for discriminating skin cancer using the analysis of Raman spectra with a high autofluorescence background stimulated by a 785 nm laser. We have registered the spectra of 617 cases of skin neoplasms (615 patients, 70 melanomas, 122 basal cell carcinomas, 12 squamous cell carcinomas and 413 benign tumors) in vivo with a portable Raman setup and created classification models both for convolutional neural networks and projection on latent structures approaches. To check the classification models stability, a 10-fold cross-validation was performed for all created models. To avoid models overfitting, the data was divided into a training set (80% of spectral dataset) and a test set (20% of spectral dataset).

RESULTS

The results for different classification tasks demonstrate that the convolutional neural networks significantly (p<0.01) outperforms the projection on latent structures. For the convolutional neural networks implementation we obtained ROC AUCs of 0.96 (0.94 - 0.97; 95% CI), 0.90 (0.85-0.94; 95% CI), and 0.92 (0.87 - 0.97; 95% CI) for classifying a) malignant vs benign tumors, b) melanomas vs pigmented tumors and c) melanomas vs seborrheic keratosis respectively.

CONCLUSIONS

The performance of the convolutional neural networks classification of skin tumors based on Raman spectra analysis is higher or comparable to the accuracy provided by trained dermatologists. The increased accuracy with the convolutional neural networks implementation is due to a more precise accounting of low intensity Raman bands in the intense autofluorescence background. The achieved high performance of skin tumors classifications with convolutional neural networks analysis opens a possibility for wide implementation of Raman setups in clinical setting.

Building Efficient CNN Architectures for Histopathology Images Analysis: A Case-Study in Tumor-Infiltrating Lymphocytes Classification

Background

Deep learning methods have demonstrated remarkable performance in pathology image analysis, but they are computationally very demanding. The aim of our study is to reduce their computational cost to enable their use with large tissue image datasets.

Methods

We propose a method called Network Auto-Reduction (NAR) that simplifies a Convolutional Neural Network (CNN) by reducing the network to minimize the computational cost of doing a prediction. NAR performs a compound scaling in which the width, depth, and resolution dimensions of the network are reduced together to maintain a balance among them in the resulting simplified network. We compare our method with a state-of-the-art solution called ResRep. The evaluation is carried out with popular CNN architectures and a real-world application that identifies distributions of tumor-infiltrating lymphocytes in tissue images.

Results

The experimental results show that both ResRep and NAR are able to generate simplified, more efficient versions of ResNet50 V2. The simplified versions by ResRep and NAR require 1.32× and 3.26× fewer floating-point operations (FLOPs), respectively, than the original network without a loss in classification power as measured by the Area under the Curve (AUC) metric. When applied to a deeper and more computationally expensive network, Inception V4, NAR is able to generate a version that requires 4× lower than the original version with the same AUC performance.

Conclusions

NAR is able to achieve substantial reductions in the execution cost of two popular CNN architectures, while resulting in small or no loss in model accuracy. Such cost savings can significantly improve the use of deep learning methods in digital pathology. They can enable studies with larger tissue image datasets and facilitate the use of less expensive and more accessible graphics processing units (GPUs), thus reducing the computing costs of a study.

Green Polymer Nanocomposites for Skin Tissue Engineering

Fabrication of an appropriate skin scaffold needs to meet several standards related to the mechanical and biological properties. Fully natural/green scaffolds with acceptable biodegradability, biocompatibility, and physiological properties quite often suffer from poor mechanical properties. Therefore, for appropriate skin tissue engineering and to mimic the real functions, we need to use synthetic polymers and/or additives as complements to green polymers. Green nanocomposites (either nanoscale natural macromolecules or biopolymers containing nanoparticles) are a class of scaffolds with acceptable biomedical properties window (drug delivery and cardiac, nerve, bone, cartilage as well as skin tissue engineering), enabling one to achieve the required level of skin regeneration and wound healing. In this review, we have collected, summarized, screened, analyzed, and interpreted the properties of green nanocomposites used in skin tissue engineering and wound dressing. We particularly emphasize the mechanical and biological properties that skin cells need to meet when seeded on the scaffold. In this regard, the latest state of the art studies directed at fabrication of skin tissue and bionanocomposites as well as their mechanistic features are discussed, whereas some unspoken complexities and challenges for future developments are highlighted.

Automated Detection of Infection in Diabetic Foot Ulcer Images Using Convolutional Neural Network

A bacterial or bone infection in the feet causes diabetic foot infection (DFI), which results in reddish skin in the wound and surrounding area. DFI is the most prevalent and dangerous type of diabetic mellitus. It will mainly occur in people with heart disease, renal illness, or eye disease. The clinical signs and symptoms of local inflammation are used to diagnose diabetic foot infection. In assessing diabetic foot ulcers, the infection has significant clinical implications in predicting the likelihood of amputation. In this work, a diabetic foot infection network (DFINET) is proposed to assess infection and no infection from diabetic foot ulcer images. A DFINET consists of 22 layers with a unique parallel convolution layer with ReLU, a normalization layer, and a fully connected layer with a dropout connection. Experiments have shown that the DFINET, when combined with this technique and improved image augmentation, should yield promising results in infection recognition, with an accuracy of 91.98%, and a Matthews correlation coefficient of 0.84 on binary classification. Such enhancements to existing methods shows that the suggested approach can assist medical experts in automated detection of DFI.