Artificial Intelligence in the Non-Invasive Detection of Melanoma

Skin cancer is one of the most prevalent cancers worldwide, with increasing incidence. Skin cancer is typically classified as melanoma or non-melanoma skin cancer. Although melanoma is less common than basal or squamous cell carcinomas, it is the deadliest form of cancer, with nearly 8300 Americans expected to die from it each year. Biopsies are currently the gold standard in diagnosing melanoma; however, they can be invasive, expensive, and inaccessible to lower-income individuals. Currently, suspicious lesions are triaged with image-based technologies, such as dermoscopy and confocal microscopy. While these techniques are useful, there is wide inter-user variability and minimal training for dermatology residents on how to properly use these devices. The use of artificial intelligence (AI)-based technologies in dermatology has emerged in recent years to assist in the diagnosis of melanoma that may be more accessible to all patients and more accurate than current methods of screening. This review explores the current status of the application of AI-based algorithms in the detection of melanoma, underscoring its potential to aid dermatologists in clinical practice. We specifically focus on AI application in clinical imaging, dermoscopic evaluation, algorithms that can distinguish melanoma from non-melanoma skin cancers, and in vivo skin imaging devices.

Is thermography an effective screening tool for differentiating benign and malignant skin lesions in the head and neck? A systematic review

The aim of this study was to assess, through a systematic review, the status of infrared thermography (IRT) as a diagnostic tool for skin neoplasms of the head and neck region and in order to validate its effectiveness in differentiating benign and malignant lesions. A search was carried out in the LILACS, PubMed/MEDLINE, SCOPUS, Web of Science and EMBASE databases including studies published between 2004 and 2024, written in the Latin-Roman alphabet. Accuracy studies with patients aged 18 years or over presenting benign and malignant lesions in the head and neck region that evaluated the performance of IRT in differentiating these lesions were included. Lesions of mesenchymal origin and studies that did not mention histopathological diagnosis were excluded. The systematic review protocol was registered in the PROSPERO database (CRD42023416079). Reviewers independently analyzed titles, abstracts, and full-texts. After extracting data, the risk of bias of the selected studies was assessed using the QUADAS - 2 tool. Results were narratively synthesized and the certainty of evidence was measured using the GRADE approach. The search resulted in 1,587 records and three studies were included. Only one of the assessed studies used static IRT, while the other two studies used cold thermal stress. All studies had an uncertain risk of bias. In general, studies have shown wide variation in the accuracy of IRT for differentiating between malignant and benign lesions, with a low level of certainty in the evidence for both specificity and sensitivity.

Artificial intelligence and skin cancer

Artificial intelligence is poised to rapidly reshape many fields, including that of skin cancer screening and diagnosis, both as a disruptive and assistive technology. Together with the collection and availability of large medical data sets, artificial intelligence will become a powerful tool that can be leveraged by physicians in their diagnoses and treatment plans for patients. This comprehensive review focuses on current progress toward AI applications for patients, primary care providers, dermatologists, and dermatopathologists, explores the diverse applications of image and molecular processing for skin cancer, and highlights AI's potential for patient self-screening and improving diagnostic accuracy for non-dermatologists. We additionally delve into the challenges and barriers to clinical implementation, paths forward for implementation and areas of active research.

WBC YOLO-ViT: 2 Way - 2 stage white blood cell detection and classification with a combination of YOLOv5 and vision transformer

Accurate detection and classification of white blood cells, otherwise known as leukocytes, play a critical role in diagnosing and monitoring various illnesses. However, conventional methods, such as manual classification by trained professionals, must be revised in terms of accuracy, efficiency, and potential bias. Moreover, applying deep learning techniques to detect and classify white blood cells using microscopic images is challenging owing to limited data, resolution noise, irregular shapes, and varying colors from different sources. This study presents a novel approach integrating object detection and classification for numerous type-white blood cell. We designed a 2-way approach to use two types of images: WBC and nucleus. YOLO (fast object detection) and ViT (powerful image representation capabilities) are effectively integrated into 16 classes. The proposed model demonstrates an exceptional 96.449% accuracy rate in classification.

SA-RPN: A Spacial Aware Region Proposal Network for Acne Detection

Automated detection of skin lesions offers excellent potential for interpretative diagnosis and precise treatment of acne vulgar. However, the blurry boundary and small size of lesions make it challenging to detect acne lesions with traditional object detection methods. To better understand the acne detection task, we construct a new benchmark dataset named AcneSCU, consisting of 276 facial images with 31777 instance-level annotations from clinical dermatology. To the best of our knowledge, AcneSCU is the first acne dataset with high-resolution imageries, precise annotations, and fine-grained lesion categories, which enables the comprehensive study of acne detection. More importantly, we propose a novel method called Spatial Aware Region Proposal Network (SA-RPN) to improve the proposal quality of two-stage detection methods. Specifically, the representation learning for the classification and localization task is disentangled with a double head component to promote the proposals for hard samples. Then, Normalized Wasserstein Distance of each proposal is predicted to improve the correlation between the classification scores and the proposals' intersection-over-unions (IoUs). SA-RPN can serve as a plug-and-play module to enhance standard two-stage detectors. Extensive experiments are conducted on both AcneSCU and the public dataset ACNE04, and the results show that the proposed method can consistently outperform state-of-the-art methods.

Dermo-Seg: ResNet-UNet Architecture and Hybrid Loss Function for Detection of Differential Patterns to Diagnose Pigmented Skin Lesions

Convolutional neural network (CNN) models have been extensively applied to skin lesions segmentation due to their information discrimination capabilities. However, CNNs' struggle to capture the connection between long-range contexts when extracting deep semantic features from lesion images, resulting in a semantic gap that causes segmentation distortion in skin lesions. Therefore, detecting the presence of differential structures such as pigment networks, globules, streaks, negative networks, and milia-like cysts becomes difficult. To resolve these issues, we have proposed an approach based on semantic-based segmentation (Dermo-Seg) to detect differential structures of lesions using a UNet model with a transfer-learning-based ResNet-50 architecture and a hybrid loss function. The Dermo-Seg model uses ResNet-50 backbone architecture as an encoder in the UNet model. We have applied a combination of focal Tversky loss and IOU loss functions to handle the dataset's highly imbalanced class ratio. The obtained results prove that the intended model performs well compared to the existing models. The dataset was acquired from various sources, such as ISIC18, ISBI17, and HAM10000, to evaluate the Dermo-Seg model. We have dealt with the data imbalance present within each class at the pixel level using our hybrid loss function. The proposed model achieves a mean IOU score of 0.53 for streaks, 0.67 for pigment networks, 0.66 for globules, 0.58 for negative networks, and 0.53 for milia-like-cysts. Overall, the Dermo-Seg model is efficient in detecting different skin lesion structures and achieved 96.4% on the IOU index. Our Dermo-Seg system improves the IOU index compared to the most recent network.

Skin Lesion Segmentation in Dermoscopic Images with Noisy Data

We propose a deep learning approach to segment the skin lesion in dermoscopic images. The proposed network architecture uses a pretrained EfficientNet model in the encoder and squeeze-and-excitation residual structures in the decoder. We applied this approach on the publicly available International Skin Imaging Collaboration (ISIC) 2017 Challenge skin lesion segmentation dataset. This benchmark dataset has been widely used in previous studies. We observed many inaccurate or noisy ground truth labels. To reduce noisy data, we manually sorted all ground truth labels into three categories - good, mildly noisy, and noisy labels. Furthermore, we investigated the effect of such noisy labels in training and test sets. Our test results show that the proposed method achieved Jaccard scores of 0.807 on the official ISIC 2017 test set and 0.832 on the curated ISIC 2017 test set, exhibiting better performance than previously reported methods. Furthermore, the experimental results showed that the noisy labels in the training set did not lower the segmentation performance. However, the noisy labels in the test set adversely affected the evaluation scores. We recommend that the noisy labels should be avoided in the test set in future studies for accurate evaluation of the segmentation algorithms.

A survey on deep learning for skin lesion segmentation

Skin cancer is a major public health problem that could benefit from computer-aided diagnosis to reduce the burden of this common disease. Skin lesion segmentation from images is an important step toward achieving this goal. However, the presence of natural and artificial artifacts (e.g., hair and air bubbles), intrinsic factors (e.g., lesion shape and contrast), and variations in image acquisition conditions make skin lesion segmentation a challenging task. Recently, various researchers have explored the applicability of deep learning models to skin lesion segmentation. In this survey, we cross-examine 177 research papers that deal with deep learning-based segmentation of skin lesions. We analyze these works along several dimensions, including input data (datasets, preprocessing, and synthetic data generation), model design (architecture, modules, and losses), and evaluation aspects (data annotation requirements and segmentation performance). We discuss these dimensions both from the viewpoint of select seminal works, and from a systematic viewpoint, examining how those choices have influenced current trends, and how their limitations should be addressed. To facilitate comparisons, we summarize all examined works in a comprehensive table as well as an interactive table available online³.

Convolution Neural Network with Coordinate Attention for Real-Time Wound Segmentation and Automatic Wound Assessment

BACKGROUND

Wound treatment in emergency care requires the rapid assessment of wound size by medical staff. Limited medical resources and the empirical assessment of wounds can delay the treatment of patients, and manual contact measurement methods are often inaccurate and susceptible to wound infection. This study aimed to prepare an Automatic Wound Segmentation Assessment (AWSA) framework for real-time wound segmentation and automatic wound region estimation.

METHODS

This method comprised a short-term dense concatenate classification network (STDC-Net) as the backbone, realizing a segmentation accuracy-prediction speed trade-off. A coordinated attention mechanism was introduced to further improve the network segmentation performance. A functional relationship model between prior graphics pixels and shooting heights was constructed to achieve wound area measurement. Finally, extensive experiments on two types of wound datasets were conducted.

RESULTS

The experimental results showed that real-time AWSA outperformed state-of-the-art methods such as mAP, mIoU, recall, and dice score. The AUC value, which reflected the comprehensive segmentation ability, also reached the highest level of about 99.5%. The FPS values of our proposed segmentation method in the two datasets were 100.08 and 102.11, respectively, which were about 42% higher than those of the second-ranked method, reflecting better real-time performance. Moreover, real-time AWSA could automatically estimate the wound area in square centimeters with a relative error of only about 3.1%.

CONCLUSION

The real-time AWSA method used the STDC-Net classification network as its backbone and improved the network processing speed while accurately segmenting the wound, realizing a segmentation accuracy-prediction speed trade-off.

An IoMT-Based Melanoma Lesion Segmentation Using Conditional Generative Adversarial Networks

Currently, Internet of medical things-based technologies provide a foundation for remote data collection and medical assistance for various diseases. Along with developments in computer vision, the application of Artificial Intelligence and Deep Learning in IOMT devices aids in the design of effective CAD systems for various diseases such as melanoma cancer even in the absence of experts. However, accurate segmentation of melanoma skin lesions from images by CAD systems is necessary to carry out an effective diagnosis. Nevertheless, the visual similarity between normal and melanoma lesions is very high, which leads to less accuracy of various traditional, parametric, and deep learning-based methods. Hence, as a solution to the challenge of accurate segmentation, we propose an advanced generative deep learning model called the Conditional Generative Adversarial Network (cGAN) for lesion segmentation. In the suggested technique, the generation of segmented images is conditional on dermoscopic images of skin lesions to generate accurate segmentation. We assessed the proposed model using three distinct datasets including DermQuest, DermIS, and ISCI2016, and attained optimal segmentation results of 99%, 97%, and 95% performance accuracy, respectively.

Development and Narrow Validation of Computer Vision Approach to Facilitate Assessment of Change in Pigmented Cutaneous Lesions

The documentation of the change in the number and appearance of pigmented cutaneous lesions over time is critical to the early detection of skin cancers and may provide preliminary signals of efficacy in early-phase therapeutic prevention trials for melanoma. Despite substantial progress in computer-aided diagnosis of melanoma, automated methods to assess the evolution of lesions are relatively undeveloped. This report describes the development and narrow validation of mathematical algorithms to register nevi between sequential digital photographs of large areas of skin and to align images for improved detection and quantification of changes. Serial posterior truncal photographs from a pre-existing database were processed and analyzed by the software, and the results were evaluated by a panel of clinicians using a separate Extensible Markup Language‒based application. The software had a high sensitivity for the detection of cutaneous lesions as small as 2 mm. The software registered lesions accurately, with occasional errors at the edges of the images. In one pilot study with 17 patients, the use of the software enabled clinicians to identify new and/or enlarged lesions in 3‒11 additional patients versus the unregistered images. Automated quantification of size change performed similarly to that of human raters. These results support the further development and broader validation of this technique.

A survey, review, and future trends of skin lesion segmentation and classification

The Computer-aided Diagnosis or Detection (CAD) approach for skin lesion analysis is an emerging field of research that has the potential to alleviate the burden and cost of skin cancer screening. Researchers have recently indicated increasing interest in developing such CAD systems, with the intention of providing a user-friendly tool to dermatologists to reduce the challenges encountered or associated with manual inspection. This article aims to provide a comprehensive literature survey and review of a total of 594 publications (356 for skin lesion segmentation and 238 for skin lesion classification) published between 2011 and 2022. These articles are analyzed and summarized in a number of different ways to contribute vital information regarding the methods for the development of CAD systems. These ways include: relevant and essential definitions and theories, input data (dataset utilization, preprocessing, augmentations, and fixing imbalance problems), method configuration (techniques, architectures, module frameworks, and losses), training tactics (hyperparameter settings), and evaluation criteria. We intend to investigate a variety of performance-enhancing approaches, including ensemble and post-processing. We also discuss these dimensions to reveal their current trends based on utilization frequencies. In addition, we highlight the primary difficulties associated with evaluating skin lesion segmentation and classification systems using minimal datasets, as well as the potential solutions to these difficulties. Findings, recommendations, and trends are disclosed to inform future research on developing an automated and robust CAD system for skin lesion analysis.

Early Melanoma Diagnosis With Sequential Dermoscopic Images

Dermatologists often diagnose or rule out early melanoma by evaluating the follow-up dermoscopic images of skin lesions. However, existing algorithms for early melanoma diagnosis are developed using single time-point images of lesions. Ignoring the temporal, morphological changes of lesions can lead to misdiagnosis in borderline cases. In this study, we propose a framework for automated early melanoma diagnosis using sequential dermoscopic images. To this end, we construct our method in three steps. First, we align sequential dermoscopic images of skin lesions using estimated Euclidean transformations, extract the lesion growth region by computing image differences among the consecutive images, and then propose a spatio-temporal network to capture the dermoscopic changes from aligned lesion images and the corresponding difference images. Finally, we develop an early diagnosis module to compute probability scores of malignancy for lesion images over time. We collected 179 serial dermoscopic imaging data from 122 patients to verify our method. Extensive experiments show that the proposed model outperforms other commonly used sequence models. We also compared the diagnostic results of our model with those of seven experienced dermatologists and five registrars. Our model achieved higher diagnostic accuracy than clinicians (63.69% vs. 54.33%, respectively) and provided an earlier diagnosis of melanoma (60.7% vs. 32.7% of melanoma correctly diagnosed on the first follow-up images). These results demonstrate that our model can be used to identify melanocytic lesions that are at high-risk of malignant transformation earlier in the disease process and thereby redefine what is possible in the early detection of melanoma.

Multiclass Skin Lesion Classification Using Hybrid Deep Features Selection and Extreme Learning Machine

The variation in skin textures and injuries, as well as the detection and classification of skin cancer, is a difficult task. Manually detecting skin lesions from dermoscopy images is a difficult and time-consuming process. Recent advancements in the domains of the internet of things (IoT) and artificial intelligence for medical applications demonstrated improvements in both accuracy and computational time. In this paper, a new method for multiclass skin lesion classification using best deep learning feature fusion and an extreme learning machine is proposed. The proposed method includes five primary steps: image acquisition and contrast enhancement; deep learning feature extraction using transfer learning; best feature selection using hybrid whale optimization and entropy-mutual information (EMI) approach; fusion of selected features using a modified canonical correlation based approach; and, finally, extreme learning machine based classification. The feature selection step improves the system's computational efficiency and accuracy. The experiment is carried out on two publicly available datasets, HAM10000 and ISIC2018. The achieved accuracy on both datasets is 93.40 and 94.36 percent. When compared to state-of-the-art (SOTA) techniques, the proposed method's accuracy is improved. Furthermore, the proposed method is computationally efficient.

Multi-Class Skin Lesion Detection and Classification via Teledermatology

Teledermatology is one of the most illustrious applications of telemedicine and e-health. In this field, telecommunication technologies are utilized to transfer medical information to the experts. Due to the skin's visual nature, teledermatology is an effective tool for the diagnosis of skin lesions especially in rural areas. Furthermore, it can also be useful to limit gratuitous clinical referrals and triage dermatology cases. The objective of this research is to classify the skin lesion image samples, received from different servers. The proposed framework is comprised of two module, which include the skin lesion localization/segmentation and the classification. In the localization module, we propose a hybrid strategy that fuses the binary images generated from the designed 16-layered convolutional neural network model and an improved high dimension contrast transform (HDCT) based saliency segmentation. To utilize maximum information extracted from the binary images, a maximal mutual information method is proposed, which returns the segmented RGB lesion image. In the classification module, a pre-trained DenseNet201 model is re-trained on the segmented lesion images using transfer learning. Afterward, the extracted features from the two fully connected layers are down-sampled using the t-distribution stochastic neighbor embedding (t-SNE) method. These resultant features are finally fused using a multi canonical correlation (MCCA) approach and are passed to a multi-class ELM classifier. Four datasets (i.e., ISBI2016, ISIC2017, PH2, and ISBI2018) are employed for the evaluation of the segmentation task, while HAM10000, the most challenging dataset, is used for the classification task. The experimental results in comparison with the state-of-the-art methods affirm the strength of our proposed framework.

Melanoma classification using light-Fields with morlet scattering transform and CNN: Surface depth as a valuable tool to increase detection rate

Medical image classification through learning-based approaches has been increasingly used, namely in the discrimination of melanoma. However, for skin lesion classification in general, such methods commonly rely on dermoscopic or other 2D-macro RGB images. This work proposes to exploit beyond conventional 2D image characteristics, by considering a third dimension (depth) that characterises the skin surface rugosity, which can be obtained from light-field images, such as those available in the SKINL2 dataset. To achieve this goal, a processing pipeline was deployed using a morlet scattering transform and a CNN model, allowing to perform a comparison between using 2D information, only 3D information, or both. Results show that discrimination between Melanoma and Nevus reaches an accuracy of 84.00, 74.00 or 94.00% when using only 2D, only 3D, or both, respectively. An increase of 14.29pp in sensitivity and 8.33pp in specificity is achieved when expanding beyond conventional 2D information by also using depth. When discriminating between Melanoma and all other types of lesions (a further imbalanced setting), an increase of 28.57pp in sensitivity and decrease of 1.19pp in specificity is achieved for the same test conditions. Overall the results of this work demonstrate significant improvements over conventional approaches.

Machine Learning and Deep Learning Methods for Skin Lesion Classification and Diagnosis: A Systematic Review

Computer-aided systems for skin lesion diagnosis is a growing area of research. Recently, researchers have shown an increasing interest in developing computer-aided diagnosis systems. This paper aims to review, synthesize and evaluate the quality of evidence for the diagnostic accuracy of computer-aided systems. This study discusses the papers published in the last five years in ScienceDirect, IEEE, and SpringerLink databases. It includes 53 articles using traditional machine learning methods and 49 articles using deep learning methods. The studies are compared based on their contributions, the methods used and the achieved results. The work identified the main challenges of evaluating skin lesion segmentation and classification methods such as small datasets, ad hoc image selection and racial bias.

Short-Term Lesion Change Detection for Melanoma Screening With Novel Siamese Neural Network

Short-term monitoring of lesion changes has been a widely accepted clinical guideline for melanoma screening. When there is a significant change of a melanocytic lesion at three months, the lesion will be excised to exclude melanoma. However, the decision on change or no-change heavily depends on the experience and bias of individual clinicians, which is subjective. For the first time, a novel deep learning based method is developed in this paper for automatically detecting short-term lesion changes in melanoma screening. The lesion change detection is formulated as a task measuring the similarity between two dermoscopy images taken for a lesion in a short time-frame, and a novel Siamese structure based deep network is proposed to produce the decision: changed (i.e. not similar) or unchanged (i.e. similar enough). Under the Siamese framework, a novel structure, namely Tensorial Regression Process, is proposed to extract the global features of lesion images, in addition to deep convolutional features. In order to mimic the decision-making process of clinicians who often focus more on regions with specific patterns when comparing a pair of lesion images, a segmentation loss (SegLoss) is further devised and incorporated into the proposed network as a regularization term. To evaluate the proposed method, an in-house dataset with 1,000 pairs of lesion images taken in a short time-frame at a clinical melanoma centre was established. Experimental results on this first-of-a-kind large dataset indicate that the proposed model is promising in detecting the short-term lesion change for objective melanoma screening.

Toward automated assessment of mole similarity on dermoscopic images

Purpose: Current skin cancer detection relies on dermatologists' visual assessments of moles directly or dermoscopically. Our goal is to show that our similarity assessment algorithm on dermoscopic images can perform as well as a dermatologist's assessment. Approach: Given one target mole and two other moles from the same patient, our model determines which mole is more similar to the target mole. Similarity was quantified as the Euclidean distance in a feature space designed to capture mole properties such as size, shape, and color. We tested our model on 18 patients, each of whom had at least five moles, and compared the model assessments of mole similarity with that of three dermatologists. Fleiss' Kappa agreement coefficients and iteration tests were used to evaluate the agreement in similarity assessment among dermatologists and our model. Results: With the selected features of size, entropy (color variation), and cluster prominence (asymmetry), our algorithm's similarity assessments agreed moderately with the similarity assessments of dermatologists. The mean Kappa of 1000 iteration tests was 0.49 ( confidence interval   ( CI ) = [ 0.23 , 0.74 ] ) when comparing three dermatologists and our model, which is comparable to the agreement in similarity assessment among the dermatologists themselves (the mean Kappa of 1000 iteration tests for three dermatologists was 0.48, CI = [ 0.19 , 0.77 ] .) By contrast, the mean Kappa was 0.22 ( CI = [ - 0.00 , 0.43 ] ) when comparing the similarity assessments of three dermatologists and random guesses. Conclusions: Our study showed that our image feature-engineering-based algorithm can effectively assess the similarity of moles as dermatologists do. Such a similarity assessment could serve as the foundation for computer-assisted intra-patient evaluation of moles.

Segmenting skin ulcers and measuring the wound area using deep convolutional networks

BACKGROUND AND OBJECTIVES

Bedridden patients presenting chronic skin ulcers often need to be examined at home. Healthcare professionals follow the evolution of the patients' condition by regularly taking pictures of the wounds, as different aspects of the wound can indicate the healing stages of the ulcer, including depth, location, and size. The manual measurement of the wounds' size is often inaccurate, time-consuming, and can also cause discomfort to the patient. In this work, we propose the Automatic Skin Ulcer Region Assessment ASURA framework to accurately segment the wound and automatically measure its size.

METHODS

ASURA uses an encoder/decoder deep neural network to perform the segmentation, which detects the measurement ruler/tape present in the image and estimates its pixel density.

RESULTS

Experimental results show that ASURA outperforms the state-of-the-art methods by up to 16% regarding the Dice score, being able to correctly segment the wound with a Dice score higher than 90%. ASURA automatically estimates the pixel density of the images with a relative error of 5%. When using a semi-automatic approach, ASURA was able to estimate the area of the wound in square centimeters with a relative error of 14%.

CONCLUSIONS

The results show that ASURA is well-suited for the problem of segmenting and automatically measuring skin ulcers.

Artificial Intelligence in Dermatology: A Primer

Artificial intelligence is becoming increasingly important in dermatology, with studies reporting accuracy matching or exceeding dermatologists for the diagnosis of skin lesions from clinical and dermoscopic images. However, real-world clinical validation is currently lacking. We review dermatological applications of deep learning, the leading artificial intelligence technology for image analysis, and discuss its current capabilities, potential failure modes, and challenges surrounding performance assessment and interpretability. We address the following three primary applications: (i) teledermatology, including triage for referral to dermatologists; (ii) augmenting clinical assessment during face-to-face visits; and (iii) dermatopathology. We discuss equity and ethical issues related to future clinical adoption and recommend specific standardization of metrics for reporting model performance.

Integration of morphological preprocessing and fractal based feature extraction with recursive feature elimination for skin lesion types classification

BACKGROUND AND OBJECTIVE

Skin cancer is the commonest form of cancer in the worldwide population. Non-invasive and non-contact imaging modalities are being used for the screening of melanoma and other cutaneous malignancies to endorse early detection and prevention of the disease. Traditionally it has been a problem for medical personnel to differentiate melanoma, dysplastic nevi and basal cell carcinoma (BCC) diseases from one another due to the confusing appearance and similarity in the characteristics of the pigmented lesions. The paper reports an integrated method developed for identifying these skin diseases from the dermoscopic images.

METHODS

The proposed integrated computer-aided method has been employed for the identification of each of these diseases using recursive feature elimination (RFE) based layered structured multiclass image classification technique. Prior to the classification, different quantitative features have been extracted by analyzing the shape, the border irregularity, the texture and the color of the skin lesions, using different image processing tools. Primarily, a combination of gray level co-occurrence matrix (GLCM) and a proposed fractal-based regional texture analysis (FRTA) algorithm has been used for the quantification of textural information. The performance of the framework has been evaluated using a layered structure classification model using support vector machine (SVM) classifier with radial basis function (RBF).

RESULTS

The performance of the morphological skin lesion segmentation algorithm has been evaluated by estimating the pixel level sensitivity (Sen) of 0.9172, 0.9788 specificity (Spec), 0.9521 accuracy (ACU), along with the image similarity measuring indices as Jaccard similarity index (JSI) of 0.8562 and Dice similarity coefficient (DSC) of 0.9142 with respect to the corresponding ground truth (GT) images. The quantitative features extracted from the proposed feature extraction algorithms have been employed for the proposed multi-class skin disease identification. The proposed layered structure identifies all the three classes of skin diseases with a highly acceptable classification accuracy of 98.99%, 97.54% and 99.65% for melanoma, dysplastic nevi and BCC respectively.

CONCLUSION

To overcome the difficulties of proper diagnosis of diseases based on visual evaluation, the proposed integrated system plays an important role by quantifying the effective features and identifying the diseases with higher degree of accuracy. This combined approach of quantitative and qualitative analysis not only increases the diagnostic accuracy, but also provides some important information not obtainable from qualitative assessment alone.

Region Extraction and Classification of Skin Cancer: A Heterogeneous framework of Deep CNN Features Fusion and Reduction

Cancer is one of the leading causes of deaths in the last two decades. It is either diagnosed malignant or benign - depending upon the severity of the infection and the current stage. The conventional methods require a detailed physical inspection by an expert dermatologist, which is time-consuming and imprecise. Therefore, several computer vision methods are introduced lately, which are cost-effective and somewhat accurate. In this work, we propose a new automated approach for skin lesion detection and recognition using a deep convolutional neural network (DCNN). The proposed cascaded design incorporates three fundamental steps including; a) contrast enhancement through fast local Laplacian filtering (FlLpF) along HSV color transformation; b) lesion boundary extraction using color CNN approach by following XOR operation; c) in-depth features extraction by applying transfer learning using Inception V3 model prior to feature fusion using hamming distance (HD) approach. An entropy controlled feature selection method is also introduced for the selection of the most discriminant features. The proposed method is tested on PH2 and ISIC 2017 datasets, whereas the recognition phase is validated on PH2, ISBI 2016, and ISBI 2017 datasets. From the results, it is concluded that the proposed method outperforms several existing methods and attained accuracy 98.4% on PH2 dataset, 95.1% on ISBI dataset and 94.8% on ISBI 2017 dataset.

An Efficient Melanoma Diagnosis Approach Using Integrated HMF Multi-Atlas Map Based Segmentation

Melanoma is a life threading disease when it grows outside the corium layer of the skin. Mortality rates of the Melanoma cases are maximum among the skin cancer patients. The cost required for the treatment of advanced melanoma cases is very high and the survival rate is low. Numerous computerized dermoscopy systems are developed based on the combination of shape, texture and color features to facilitate early diagnosis of melanoma. The availability and cost of the dermoscopic imaging system is still an issue. To mitigate this issue, this paper presented an integrated segmentation and Third Dimensional (3D) feature extraction approach for the accurate diagnosis of melanoma. A multi-atlas method is applied for the image segmentation. The patch-based label fusion model is expressed in a Bayesian framework to improve the segmentation accuracy. A depth map is obtained from the Two-dimensional (2D) dermoscopic image for reconstructing the 3D skin lesion represented as structure tensors. The 3D shape features including the relative depth features are obtained. Streaks are the significant morphological terms of the melanoma in the radial growth phase. The proposed method yields maximum segmentation accuracy, sensibility, specificity and minimum cost function than the existing segmentation technique and classifier.