Artificial intelligence-based image classification methods for diagnosis of skin cancer: Challenges and opportunities

Artificial Intelligence in Gas Sensing: A Review

The role of artificial intelligence (AI), machine learning (ML), and deep learning (DL) in enhancing and automating gas sensing methods and the implications of these technologies for emergent gas sensor systems is reviewed. Applications of AI-based intelligent gas sensors include environmental monitoring, industrial safety, remote sensing, and medical diagnostics. AI, ML, and DL methods can process and interpret complex sensor data, allowing for improved accuracy, sensitivity, and selectivity, enabling rapid gas detection and quantitative concentration measurements based on sophisticated multiband, multispecies sensor systems. These methods can discern subtle patterns in sensor signals, allowing sensors to readily distinguish between gases with similar sensor signatures, enabling adaptable, cross-sensitive sensor systems for multigas detection under various environmental conditions. Integrating AI in gas sensor technology represents a paradigm shift, enabling sensors to achieve unprecedented performance, selectivity, and adaptability. This review describes gas sensor technologies and AI while highlighting approaches to AI-sensor integration.

Absorption Coefficient Estimation of Pigmented Skin Phantoms Using Colorimetric Parameters

The increasing use of light-based treatments requires a better understanding of the light tissue interaction for pigmented skin. To enhance comprehension in this area, this study proposes the use of pigmented-mimicking skin phantoms to assess the optical properties based on their tone, represented by the individual typology angle (ITA) color scale. In this study, an epoxy resin matrix alongside compact facial powder and titanium dioxide was used to mimic the absorption, scattering, and shade properties of human skins. Eight phantoms covering the skin tones, light (ITA = 45.2°), tan (ITA = 23.3°), brown (ITA = 6.9°, -5.7°, and -16.9°), and dark (ITA = -34.6°, -41.6°, and -48.6°), were crafted. The absorption and reduced scattering coefficients were obtained using integrating spheres and calibrated spectrometers in the 500-900 nm range, and tones were measured using a commercial colorimeter. The experimental fitting proposed in this study could estimate the optical properties as a function of the skin tones through ITA values, by using an exponential function with a second-order polynomial exponent. This investigation aligns with prior studies involving human skin samples, and these findings hold promise for future clinical and diagnostic applications, particularly in the realm of light-based treatments to individual dermatological corrections in pigmented skin.

A fuzzy rank-based deep ensemble methodology for multi-class skin cancer classification

Skin cancer is widespread and can be potentially fatal. According to the World Health Organisation (WHO), it has been identified as a leading cause of mortality. It is essential to detect skin cancer early so that effective treatment can be provided at an initial stage. In this study, the widely-used HAM10000 dataset, containing high-resolution images of various skin lesions, is employed to train and evaluate. Our methodology for the HAM10000 dataset involves balancing the imbalanced dataset by augmenting images followed by splitting the dataset into train, test and validation set, preprocessing the images, training the individual models Xception, InceptionResNetV2 and MobileNetV2, and then combining their outputs using fuzzy logic to generate a final prediction. We examined the performance of the ensemble using standard metrics like classification accuracy, confusion matrix, etc. and achieved an impressive accuracy of 95.14% and the result demonstrates the effectiveness of our approach in accurately identifying skin cancer lesions. To further assess the efficiency of the model, additional tests have been performed on the DermaMNIST dataset from the MedMNISTv2 collection. The model performs well on the dataset and transcends the benchmark accuracy of 76.8%, achieving 78.25%. Thus the model is efficient for skin cancer classification, showcasing its potential for clinical applications.

Current status and future direction of cancer research using artificial intelligence for clinical application

The expectations for artificial intelligence (AI) technology have increased considerably in recent years, mainly due to the emergence of deep learning. At present, AI technology is being used for various purposes and has brought about change in society. In particular, the rapid development of generative AI technology, exemplified by ChatGPT, has amplified the societal impact of AI. The medical field is no exception, with a wide range of AI technologies being introduced for basic and applied research. Further, AI-equipped software as a medical device (AI-SaMD) is also being approved by regulatory bodies. Combined with the advent of big data, data-driven research utilizing AI is actively pursued. Nevertheless, while AI technology has great potential, it also presents many challenges that require careful consideration. In this review, we introduce the current status of AI-based cancer research, especially from the perspective of clinical application, and discuss the associated challenges and future directions, with the aim of helping to promote cancer research that utilizes effective AI technology.

Optimizing Skin Cancer Diagnosis: A Modified Ensemble Convolutional Neural Network for Classification

Skin cancer is recognized as one of the most harmful cancers worldwide. Early detection of this cancer is an effective measure for treating the disease efficiently. Traditional skin cancer detection methods face scalability challenges and overfitting issues. To address these complexities, this study proposes a random cat swarm optimization (CSO)with an ensemble convolutional neural network (RCS-ECNN) method to categorize the different stages of skin cancer. In this study, two deep learning classifiers, deep neural network (DNN) and Keras DNN (KDNN), are utilized to identify the stages of skin cancer. In this method, an effective preprocessing phase is presented to simplify the classification process. The optimal features are selected using the feature extraction phase. Then, the GrabCut algorithm is employed to carry out the segmentation process. Also, the CSO is employed to enhance the effectiveness of the method. The HAM10000 and ISIC datasets are utilized to evaluate the RCS-ECNN method. The RCS-ECNN method achieved an accuracy of 99.56%, a recall of 99.66%, a specificity value of 99.254%, a precision value of 99.18%, and an F1-score value of 98.545%, respectively. The experimental results demonstrated that the RCS-ECNN method outperforms the existing techniques.

Minimal sourced and lightweight federated transfer learning models for skin cancer detection

One of the most fatal diseases that affect people is skin cancer. Because nevus and melanoma lesions are so similar and there is a high likelihood of false negative diagnoses challenges in hospitals. The aim of this paper is to propose and develop a technique to classify type of skin cancer with high accuracy using minimal resources and lightweight federated transfer learning models. Here minimal resource based pre-trained deep learning models including EfficientNetV2S, EfficientNetB3, ResNet50, and NasNetMobile have been used to apply transfer learning on data of shape[Formula: see text]. To compare with applied minimal resource transfer learning, same methodology has been applied using best identified model i.e. EfficientNetV2S for images of shape[Formula: see text]. The identified minimal and lightweight resource based EfficientNetV2S with images of shape [Formula: see text] have been applied for federated learning ecosystem. Both, identically and non-identically distributed datasets of shape [Formula: see text] have been applied and analyzed through federated learning implementations. The results have been analyzed to show the impact of low-pixel images with non-identical distributions over clients using parameters such as accuracy, precision, recall and categorical losses. The classification of skin cancer shows an accuracy of IID 89.83% and Non-IID 90.64%.

Boosting skin cancer diagnosis accuracy with ensemble approach

Skin cancer is common and deadly, hence a correct diagnosis at an early age is essential. Effective therapy depends on precise classification of the several skin cancer forms, each with special traits. Because dermoscopy and other sophisticated imaging methods produce detailed lesion images, early detection has been enhanced. It's still difficult to analyze the images to differentiate benign from malignant tumors, though. Better predictive modeling methods are needed since the diagnostic procedures used now frequently produce inaccurate and inconsistent results. In dermatology, Machine learning (ML) models are becoming essential for the automatic detection and classification of skin cancer lesions from image data. With the ensemble model, which mix several ML approaches to take use of their advantages and lessen their disadvantages, this work seeks to improve skin cancer predictions. We introduce a new method, the Max Voting method, for optimization of skin cancer classification. On the HAM10000 and ISIC 2018 datasets, we trained and assessed three distinct ML models: Random Forest (RF), Multi-layer Perceptron Neural Network (MLPN), and Support Vector Machine (SVM). Overall performance was increased by the combined predictions made with the Max Voting technique. Moreover, feature vectors that were optimally produced from image data by a Genetic Algorithm (GA) were given to the ML models. We demonstrate that the Max Voting method greatly improves predictive performance, reaching an accuracy of 94.70% and producing the best results for F1-measure, recall, and precision. The most dependable and robust approach turned out to be Max Voting, which combines the benefits of numerous pre-trained ML models to provide a new and efficient method for classifying skin cancer lesions.

Data journey map: a process for co-creating data requirements for health care artificial intelligence

The Caribbean small island developing states have limited resources for comprehensive health care provision and are facing an increasing burden of noncommunicable diseases which is driven by an aging regional population. Artificial intelligence (AI) and other digital technologies offer promise for contributing to health care efficiencies, but themselves are dependent on the availability and accessibility of accurate health care data. A regional shortfall in data professionals continues to hamper legislative recognition and promotion of increased data production in Caribbean countries. Tackling the data shortfall will take time and will require a sustainably wider pool of data producers. The data journey map is one approach that can contribute to overcoming such challenges. A data journey map is a process for organizing the collection of health data that focuses on interactions between patient and health care provider. It introduces the idea that data collection is an integral part of the patient journey and that interactions between patient and provider can be enhanced by building data collection into daily health care. A carefully developed and enacted data journey map highlights key points in the care pathway for data collection. These so-called data hotspots can be used to plan - then eventually implement - appropriate AI health care solutions. In this article we introduce the idea of journey mapping, offer an example using cervical cancer prevention and treatment, and discuss the benefits and challenges to implementing such an approach.

Rapid and noninvasive estimation of human arsenic exposure based on 4-photo-set of the hand and foot photos through artificial intelligence

Chronic exposure to arsenic is linked to the development of cancers in the skin, lungs, and bladder. Arsenic exposure manifests as variegated pigmentation and characteristic pitted keratosis on the hands and feet, which often precede the onset of internal cancers. Traditionally, human arsenic exposure is estimated through arsenic levels in biological tissues; however, these methods are invasive and time-consuming. This study aims to develop a noninvasive approach to predict arsenic exposure using artificial intelligence (AI) to analyze photographs of hands and feet. By incorporating well water consumption data and arsenic concentration levels, we developed an AI algorithm trained on 9988 hand and foot photographs from 2497 subjects. This algorithm correlates visual features of palmoplantar hyperkeratosis with arsenic exposure levels. Four pictures per patient, capturing both ventral and dorsal aspects of hands and feet, were analyzed. The AI model utilized existing arsenic exposure data, including arsenic concentration (AC) and cumulative arsenic exposure (CAE), to make binary predictions of high and low arsenic exposure. The AI model achieved an optimal area under the curve (AUC) values of 0.813 for AC and 0.779 for CAE. Recall and precision metrics were 0.729 and 0.705 for CAE, and 0.750 and 0.763 for AC, respectively. While biomarkers have traditionally been used to assess arsenic exposure, efficient noninvasive methods are lacking. To our knowledge, this is the first study to leverage deep learning for noninvasive arsenic exposure assessment. Despite challenges with binary classification due to imbalanced and sparse data, this approach demonstrates the potential for noninvasive estimation of arsenic concentration. Future studies should focus on increasing data volume and categorizing arsenic concentration statistics to enhance model accuracy. This rapid estimation method could significantly contribute to epidemiological studies and aid physicians in diagnosis.

Analysis of international publication trends in artificial intelligence in skin cancer

Bibliometric methods were used to analyze publications on the use of artificial intelligence (AI) in skin cancer from 2010 to 2022, aiming to explore current publication trends and future directions. A comprehensive search using four terms, "artificial intelligence," "machine learning," "deep learning," and "skin cancer," was performed in the Web of Science database for original English language publications on AI in skin cancer from 2010 to 2022. We visually analyzed publication, citation, and coupling information, focusing on authors, countries and regions, publishing journals, institutions, and core keywords. The analysis of 989 publications revealed a consistent year-on-year increase in publications from 2010 to 2022 (0.51% versus 33.57%). The United States, India, and China emerged as the leading contributors. IEEE Access was identified as the most prolific journal in this area. Key journals and influential authors were highlighted. Examination of the top 10 most cited publications highlights the significant potential of AI in oncology. Co-citation network analysis identified four primary categories of classical literature on AI in skin tumors. Keyword analysis indicated that "melanoma," "classification," and "deep learning" were the most prevalent keywords, suggesting that deep learning for melanoma diagnosis and grading is the current research focus. The term "pigmented skin lesions" showed the strongest burst and longest duration, whereas "texture" was the latest emerging keyword. AI represents a rapidly growing area of research in skin cancer with the potential to significantly improve skin cancer management. Future research will likely focus on machine learning and deep learning technologies for screening and diagnostic purposes.

Ensemble feature selection and tabular data augmentation with generative adversarial networks to enhance cutaneous melanoma identification and interpretability

BACKGROUND

Cutaneous melanoma is the most aggressive form of skin cancer, responsible for most skin cancer-related deaths. Recent advances in artificial intelligence, jointly with the availability of public dermoscopy image datasets, have allowed to assist dermatologists in melanoma identification. While image feature extraction holds potential for melanoma detection, it often leads to high-dimensional data. Furthermore, most image datasets present the class imbalance problem, where a few classes have numerous samples, whereas others are under-represented.

METHODS

In this paper, we propose to combine ensemble feature selection (FS) methods and data augmentation with the conditional tabular generative adversarial networks (CTGAN) to enhance melanoma identification in imbalanced datasets. We employed dermoscopy images from two public datasets, PH2 and Derm7pt, which contain melanoma and not-melanoma lesions. To capture intrinsic information from skin lesions, we conduct two feature extraction (FE) approaches, including handcrafted and embedding features. For the former, color, geometric and first-, second-, and higher-order texture features were extracted, whereas for the latter, embeddings were obtained using ResNet-based models. To alleviate the high-dimensionality in the FE, ensemble FS with filter methods were used and evaluated. For data augmentation, we conducted a progressive analysis of the imbalance ratio (IR), related to the amount of synthetic samples created, and evaluated the impact on the predictive results. To gain interpretability on predictive models, we used SHAP, bootstrap resampling statistical tests and UMAP visualizations.

RESULTS

The combination of ensemble FS, CTGAN, and linear models achieved the best predictive results, achieving AUCROC values of 87% (with support vector machine and IR=0.9) and 76% (with LASSO and IR=1.0) for the PH2 and Derm7pt, respectively. We also identified that melanoma lesions were mainly characterized by features related to color, while not-melanoma lesions were characterized by texture features.

CONCLUSIONS

Our results demonstrate the effectiveness of ensemble FS and synthetic data in the development of models that accurately identify melanoma. This research advances skin lesion analysis, contributing to both melanoma detection and the interpretation of main features for its identification.

LesionNet: an automated approach for skin lesion classification using SIFT features with customized convolutional neural network

Accurate detection of skin lesions through computer-aided diagnosis has emerged as a critical advancement in dermatology, addressing the inefficiencies and errors inherent in manual visual analysis. Despite the promise of automated diagnostic approaches, challenges such as image size variability, hair artifacts, color inconsistencies, ruler markers, low contrast, lesion dimension differences, and gel bubbles must be overcome. Researchers have made significant strides in binary classification problems, particularly in distinguishing melanocytic lesions from normal skin conditions. Leveraging the "MNIST HAM10000" dataset from the International Skin Image Collaboration, this study integrates Scale-Invariant Feature Transform (SIFT) features with a custom convolutional neural network model called LesionNet. The experimental results reveal the model's robustness, achieving an impressive accuracy of 99.28%. This high accuracy underscores the effectiveness of combining feature extraction techniques with advanced neural network models in enhancing the precision of skin lesion detection.

A multi-model approach integrating whole-slide imaging and clinicopathologic features to predict breast cancer recurrence risk

Breast cancer is the most common malignancy affecting women worldwide and is notable for its morphologic and biologic diversity, with varying risks of recurrence following treatment. The Oncotype DX Breast Recurrence Score test is an important predictive and prognostic genomic assay for estrogen receptor positive/HER2 negative breast cancer that guides therapeutic strategies; however, such tests can be expensive, delay care, and are not widely available. The aim of this study was to develop a multi-model approach integrating the analysis of whole-slide images and clinicopathologic data to predict their associated breast cancer recurrence risks and categorize these patients into two risk groups according to the predicted score: low-risk and high-risk. The proposed novel methodology uses convolutional neural networks for feature extraction and vision transformers for contextual aggregation, complemented by a logistic regression model that analyzes clinicopathologic data for classification into two risk categories. This method was trained and tested on 956 hematoxylin and eosin-stained whole-slide images of 950 ER+/HER2- breast cancer patients with corresponding clinicopathological features that had prior Oncotype DX testing. The model's performance was evaluated using an internal test set of 192 patients from Dartmouth Health and an external test set of 405 patients from the University of Chicago. The multi-model approach achieved an AUC of 0.91 (95% CI: 0.87-0.95) on the internal set and an AUC of 0.84 (95% CI: 0.78-0.89) on the external cohort for predicting low- and high-breast cancer recurrence risk categories based on the Oncotype DX recurrence score. With further validation, the proposed methodology could provide an alternative to assist clinicians in personalizing treatment for breast cancer patients and potentially improving their outcomes.

Artificial intelligence for nonmelanoma skin cancer

Nonmelanoma skin cancers (NMSCs) are among the top five most common cancers globally. NMSC is an area with great potential for novel application of diagnostic tools including artificial intelligence (AI). In this scoping review, we aimed to describe the applications of AI in the diagnosis and treatment of NMSC. Twenty-nine publications described AI applications to dermatopathology including lesion classification and margin assessment. Twenty-five publications discussed AI use in clinical image analysis, showing that algorithms are not superior to dermatologists and may rely on unbalanced, nonrepresentative, and nontransparent training data sets. Sixteen publications described the use of AI in cutaneous surgery for NMSC including use in margin assessment during excisions and Mohs surgery, as well as predicting procedural complexity. Eleven publications discussed spectroscopy, confocal microscopy, thermography, and the AI algorithms that analyze and interpret their data. Ten publications pertained to AI applications for the discovery and use of NMSC biomarkers. Eight publications discussed the use of smartphones and AI, specifically how they enable clinicians and patients to have increased access to instant dermatologic assessments but with varying accuracies. Five publications discussed large language models and NMSC, including how they may facilitate or hinder patient education and medical decision-making. Three publications pertaining to the skin of color and AI for NMSC discussed concerns regarding limited diverse data sets for the training of convolutional neural networks. AI demonstrates tremendous potential to improve diagnosis, patient and clinician education, and management of NMSC. Despite excitement regarding AI, data sets are often not transparently reported, may include low-quality images, and may not include diverse skin types, limiting generalizability. AI may serve as a tool to increase access to dermatology services for patients in rural areas and save health care dollars. These benefits can only be achieved, however, with consideration of potential ethical costs.

Deep Deblurring in Teledermatology: Deep Learning Models Restore the Accuracy of Blurry Images' Classification

Background: Blurry images in teledermatology and consultation increased the diagnostic difficulty for both deep learning models and physicians. We aim to determine the extent of restoration in diagnostic accuracy after blurry images are deblurred by deep learning models. Methods: We used 19,191 skin images from a public skin image dataset that includes 23 skin disease categories, 54 skin images from a public dataset of blurry skin images, and 53 blurry dermatology consultation photos in a medical center to compare the diagnosis accuracy of trained diagnostic deep learning models and subjective sharpness between blurry and deblurred images. We evaluated five different deblurring models, including models for motion blur, Gaussian blur, Bokeh blur, mixed slight blur, and mixed strong blur. Main Outcomes and Measures: Diagnostic accuracy was measured as sensitivity and precision of correct model prediction of the skin disease category. Sharpness rating was performed by board-certified dermatologists on a 4-point scale, with 4 being the highest image clarity. Results: The sensitivity of diagnostic models dropped 0.15 and 0.22 on slightly and strongly blurred images, respectively, and deblurring models restored 0.14 and 0.17 for each group. The sharpness ratings perceived by dermatologists improved from 1.87 to 2.51 after deblurring. Activation maps showed the focus of diagnostic models was compromised by the blurriness but was restored after deblurring. Conclusions: Deep learning models can restore the diagnostic accuracy of diagnostic models for blurry images and increase image sharpness perceived by dermatologists. The model can be incorporated into teledermatology to help the diagnosis of blurry images.

Deep Learning for Grading Endometrial Cancer

Endometrial cancer is the fourth most common cancer in women in the United States, with a lifetime risk of approximately 2.8%. Precise histologic evaluation and molecular classification of endometrial cancer are important for effective patient management and determining the best treatment options. This study introduces EndoNet, which uses convolutional neural networks for extracting histologic features and a vision transformer for aggregating these features and classifying slides into high- and low-grade cases. The model was trained on 929 digitized hematoxylin and eosin-stained whole-slide images of endometrial cancer from hysterectomy cases at Dartmouth-Health. It classifies these slides into low-grade (endometrioid grades 1 and 2) and high-grade (endometrioid carcinoma International Federation of Gynecology and Obstetrics grade 3, uterine serous carcinoma, or carcinosarcoma) categories. EndoNet was evaluated on an internal test set of 110 patients and an external test set of 100 patients from The Cancer Genome Atlas database. The model achieved a weighted average F1 score of 0.91 (95% CI, 0.86 to 0.95) and an area under the curve of 0.95 (95% CI, 0.89 to 0.99) on the internal test, and 0.86 (95% CI, 0.80 to 0.94) for F1 score and 0.86 (95% CI, 0.75 to 0.93) for area under the curve on the external test. Pending further validation, EndoNet has the potential to support pathologists without the need of manual annotations in classifying the grades of gynecologic pathology tumors.

High-Precision Skin Disease Diagnosis through Deep Learning on Dermoscopic Images

Dermatological conditions are primarily prevalent in humans and are primarily caused by environmental and climatic fluctuations, as well as various other reasons. Timely identification is the most effective remedy to avert minor ailments from escalating into severe conditions. Diagnosing skin illnesses is consistently challenging for health practitioners. Presently, they rely on conventional methods, such as examining the condition of the skin. State-of-the-art technologies can enhance the accuracy of skin disease diagnosis by utilizing data-driven approaches. This paper presents a Computer Assisted Diagnosis (CAD) framework that has been developed to detect skin illnesses at an early stage. We suggest a computationally efficient and lightweight deep learning model that utilizes a CNN architecture. We then do thorough experiments to compare the performance of shallow and deep learning models. The CNN model under consideration consists of seven convolutional layers and has obtained an accuracy of 87.64% when applied to three distinct disease categories. The studies were conducted using the International Skin Imaging Collaboration (ISIC) dataset, which exclusively consists of dermoscopic images. This study enhances the field of skin disease diagnostics by utilizing state-of-the-art technology, attaining exceptional levels of accuracy, and striving for efficiency improvements. The unique features and future considerations of this technology create opportunities for additional advancements in the automated diagnosis of skin diseases and tailored treatment.

Artificial Intelligence-Driven Analysis of Antimicrobial-Resistant and Biofilm-Forming Pathogens on Biotic and Abiotic Surfaces

The growing threat of antimicrobial-resistant (AMR) pathogens to human health worldwide emphasizes the need for more effective infection control strategies. Bacterial and fungal biofilms pose a major challenge in treating AMR pathogen infections. Biofilms are formed by pathogenic microbes encased in extracellular polymeric substances to confer protection from antimicrobials and the host immune system. Biofilms also promote the growth of antibiotic-resistant mutants and latent persister cells and thus complicate therapeutic approaches. Biofilms are ubiquitous and cause serious health risks due to their ability to colonize various surfaces, including human tissues, medical devices, and food-processing equipment. Detection and characterization of biofilms are crucial for prompt intervention and infection control. To this end, traditional approaches are often effective, yet they fail to identify the microbial species inside biofilms. Recent advances in artificial intelligence (AI) have provided new avenues to improve biofilm identification. Machine-learning algorithms and image-processing techniques have shown promise for the accurate and efficient detection of biofilm-forming microorganisms on biotic and abiotic surfaces. These advancements have the potential to transform biofilm research and clinical practice by allowing faster diagnosis and more tailored therapy. This comprehensive review focuses on the application of AI techniques for the identification of biofilm-forming pathogens in various industries, including healthcare, food safety, and agriculture. The review discusses the existing approaches, challenges, and potential applications of AI in biofilm research, with a particular focus on the role of AI in improving diagnostic capacities and guiding preventative actions. The synthesis of the current knowledge and future directions, as described in this review, will guide future research and development efforts in combating biofilm-associated infections.

Patient-led skin cancer teledermatology without dermoscopy during the COVID-19 pandemic: important lessons for the development of future patient-facing teledermatology and artificial intelligence-assisted -self-diagnosis

MySkinSelfie is a mobile phone application for skin self-monitoring, enabling secure sharing of patient-captured images with healthcare providers. This retrospective study assessed MySkinSelfie's role in remote skin cancer assessment at two centres for urgent (melanoma and squamous cell carcinoma) and nonurgent skin cancer referrals, investigating the feasibility of using patient-captured images without dermoscopy for remote diagnosis. The total number of lesions using MySkinSelfie was 814, with a mean patient age of 63 years. Remote consultations reduced face-to-face appointments by 90% for basal cell carcinoma and by 63% for referrals on a 2-week waiting list. Diagnostic concordance (consultant vs. histological diagnosis) rates of 72% and 83% were observed for basal cell carcinoma (n = 107) and urgent skin cancers (n = 704), respectively. Challenges included image quality, workflow integration and lack of dermoscopy. Higher sensitivities were observed in recent artificial intelligence algorithms employing dermoscopy. While patient-captured images proved useful during the COVID-19 pandemic, further research is needed to explore the feasibility of widespread patient-led dermoscopy to enable direct patient-to-artificial intelligence diagnostic assessment.

Review of neuromorphic computing based on NAND flash memory

The proliferation of data has facilitated global accessibility, which demands escalating amounts of power for data storage and processing purposes. In recent years, there has been a rise in research in the field of neuromorphic electronics, which draws inspiration from biological neurons and synapses. These electronics possess the ability to perform in-memory computing, which helps alleviate the limitations imposed by the 'von Neumann bottleneck' that exists between the memory and processor in the traditional von Neumann architecture. By leveraging their multi-bit non-volatility, characteristics that mimic biology, and Kirchhoff's law, neuromorphic electronics offer a promising solution to reduce the power consumption in processing vector-matrix multiplication tasks. Among all the existing nonvolatile memory technologies, NAND flash memory is one of the most competitive integrated solutions for the storage of large volumes of data. This work provides a comprehensive overview of the recent developments in neuromorphic computing based on NAND flash memory. Neuromorphic architectures using NAND flash memory for off-chip learning are presented with various quantization levels of input and weight. Next, neuromorphic architectures for on-chip learning are presented using standard backpropagation and feedback alignment algorithms. The array architecture, operation scheme, and electrical characteristics of NAND flash memory are discussed with a focus on the use of NAND flash memory in various neural network structures. Furthermore, the discrepancy of array architecture between on-chip learning and off-chip learning is addressed. This review article provides a foundation for understanding the neuromorphic computing based on the NAND flash memory and methods to utilize it based on application requirements.

Skin cancer detection through attention guided dual autoencoder approach with extreme learning machine

Skin cancer is a lethal disease, and its early detection plays a pivotal role in preventing its spread to other body organs and tissues. Artificial Intelligence (AI)-based automated methods can play a significant role in its early detection. This study presents an AI-based novel approach, termed 'DualAutoELM' for the effective identification of various types of skin cancers. The proposed method leverages a network of autoencoders, comprising two distinct autoencoders: the spatial autoencoder and the FFT (Fast Fourier Transform)-autoencoder. The spatial-autoencoder specializes in learning spatial features within input lesion images whereas the FFT-autoencoder learns to capture textural and distinguishing frequency patterns within transformed input skin lesion images through the reconstruction process. The use of attention modules at various levels within the encoder part of these autoencoders significantly improves their discriminative feature learning capabilities. An Extreme Learning Machine (ELM) with a single layer of feedforward is trained to classify skin malignancies using the characteristics that were recovered from the bottleneck layers of these autoencoders. The 'HAM10000' and 'ISIC-2017' are two publicly available datasets used to thoroughly assess the suggested approach. The experimental findings demonstrate the accuracy and robustness of the proposed technique, with AUC, precision, and accuracy values for the 'HAM10000' dataset being 0.98, 97.68% and 97.66%, and for the 'ISIC-2017' dataset being 0.95, 86.75% and 86.68%, respectively. This study highlights the possibility of the suggested approach for accurate detection of skin cancer.

Systematic review of approaches to detection and classification of skin cancer using artificial intelligence: Development and prospects

In recent years, there has been a significant improvement in the accuracy of the classification of pigmented skin lesions using artificial intelligence algorithms. Intelligent analysis and classification systems are significantly superior to visual diagnostic methods used by dermatologists and oncologists. However, the application of such systems in clinical practice is severely limited due to a lack of generalizability and risks of potential misclassification. Successful implementation of artificial intelligence-based tools into clinicopathological practice requires a comprehensive study of the effectiveness and performance of existing models, as well as further promising areas for potential research development. The purpose of this systematic review is to investigate and evaluate the accuracy of artificial intelligence technologies for detecting malignant forms of pigmented skin lesions. For the study, 10,589 scientific research and review articles were selected from electronic scientific publishers, of which 171 articles were included in the presented systematic review. All selected scientific articles are distributed according to the proposed neural network algorithms from machine learning to multimodal intelligent architectures and are described in the corresponding sections of the manuscript. This research aims to explore automated skin cancer recognition systems, from simple machine learning algorithms to multimodal ensemble systems based on advanced encoder-decoder models, visual transformers (ViT), and generative and spiking neural networks. In addition, as a result of the analysis, future directions of research, prospects, and potential for further development of automated neural network systems for classifying pigmented skin lesions are discussed.

Artificial intelligence in clinical nutrition and dietetics: A brief overview of current evidence

The rapid surge in artificial intelligence (AI) has dominated technological innovation in today's society. As experts begin to understand the potential, a spectrum of opportunities could yield a remarkable revolution. The upsurge in healthcare could transform clinical interventions and outcomes, but it risks dehumanization and increased unethical practices. The field of clinical nutrition and dietetics is no exception. This article finds a multitude of developments underway, which include the use of AI for malnutrition screening; predicting clinical outcomes, such as disease onset, and clinical risks, such as drug interactions; aiding interventions, such as estimating nutrient intake; applying precision nutrition, such as measuring postprandial glycemic response; and supporting workflow through chatbots trained on natural language models. Although the opportunity and scalability of AI is incalculably attractive, especially in the face of poor healthcare resources, the threat cannot be ignored. The risk of malpractice and lack of accountability are some of the main concerns. As such, the healthcare professional's responsibility remains paramount. The data used to train AI models could be biased, which could risk the quality of care to vulnerable or minority patient groups. Standardized AI-development protocols, benchmarked to care recommendations, with rigorous large-scale validation are required to maximize application among different settings. AI could overturn the healthcare landscape, and this article skims the surface of its potential in clinical nutrition and dietetics.

The Role of Artificial Intelligence in Early Diagnosis and Molecular Classification of Head and Neck Skin Cancers: A Multidisciplinary Approach

Cancer remains a significant global health concern, with increasing genetic and metabolic irregularities linked to its onset. Among various forms of cancer, skin cancer, including squamous cell carcinoma, basal cell carcinoma, and melanoma, is on the rise worldwide, often triggered by ultraviolet (UV) radiation. The propensity of skin cancer to metastasize highlights the importance of early detection for successful treatment. This narrative review explores the evolving role of artificial intelligence (AI) in diagnosing head and neck skin cancers from both radiological and pathological perspectives. In the past two decades, AI has made remarkable progress in skin cancer research, driven by advances in computational capabilities, digitalization of medical images, and radiomics data. AI has shown significant promise in image-based diagnosis across various medical domains. In dermatology, AI has played a pivotal role in refining diagnostic and treatment strategies, including genomic risk assessment. This technology offers substantial potential to aid primary clinicians in improving patient outcomes. Studies have demonstrated AI's effectiveness in identifying skin lesions, categorizing them, and assessing their malignancy, contributing to earlier interventions and better prognosis. The rising incidence and mortality rates of skin cancer, coupled with the high cost of treatment, emphasize the need for early diagnosis. Further research and integration of AI into clinical practice are warranted to maximize its benefits in skin cancer diagnosis and treatment.

A deep image classification model based on prior feature knowledge embedding and application in medical diagnosis

Aiming at the problem of image classification with insignificant morphological structural features, strong target correlation, and low signal-to-noise ratio, combined with prior feature knowledge embedding, a deep learning method based on ResNet and Radial Basis Probabilistic Neural Network (RBPNN) is proposed model. Taking ResNet50 as a visual modeling network, it uses feature pyramid and self-attention mechanism to extract appearance and semantic features of images at multiple scales, and associate and enhance local and global features. Taking into account the diversity of category features, channel cosine similarity attention and dynamic C-means clustering algorithms are used to select representative sample features in different category of sample subsets to implicitly express prior category feature knowledge, and use them as the kernel centers of radial basis probability neurons (RBPN) to realize the embedding of diverse prior feature knowledge. In the RBPNN pattern aggregation layer, the outputs of RBPN are selectively summed according to the category of the kernel center, that is, the subcategory features are combined into category features, and finally the image classification is implemented based on Softmax. The functional module of the proposed method is designed specifically for image characteristics, which can highlight the significance of local and structural features of the image, form a non-convex decision-making area, and reduce the requirements for the completeness of the sample set. Applying the proposed method to medical image classification, experiments were conducted based on the brain tumor MRI image classification public dataset and the actual cardiac ultrasound image dataset, and the accuracy rate reached 85.82% and 83.92% respectively. Compared with the three mainstream image classification models, the performance indicators of this method have been significantly improved.

A Narrative Review: Opportunities and Challenges in Artificial Intelligence Skin Image Analyses Using Total Body Photography

Artificial intelligence (AI) algorithms for skin lesion classification have reported accuracy at par with and even outperformance of expert dermatologists in experimental settings. However, the majority of algorithms do not represent real-world clinical approach where skin phenotype and clinical background information are considered. We review the current state of AI for skin lesion classification and present opportunities and challenges when applied to total body photography (TBP). AI in TBP analysis presents opportunities for intrapatient assessment of skin phenotype and holistic risk assessment by incorporating patient-level metadata, although challenges exist for protecting patient privacy in algorithm development and improving explainable AI methods.

Facilitating clinically relevant skin tumor diagnostics with spectroscopy-driven machine learning

In the dawning era of artificial intelligence (AI), health care stands to undergo a significant transformation with the increasing digitalization of patient data. Digital imaging, in particular, will serve as an important platform for AI to aid decision making and diagnostics. A growing number of studies demonstrate the potential of automatic pre-surgical skin tumor delineation, which could have tremendous impact on clinical practice. However, current methods rely on having ground truth images in which tumor borders are already identified, which is not clinically possible. We report a novel approach where hyperspectral images provide spectra from small regions representing healthy tissue and tumor, which are used to generate prediction maps using artificial neural networks (ANNs), after which a segmentation algorithm automatically identifies the tumor borders. This circumvents the need for ground truth images, since an ANN model is trained with data from each individual patient, representing a more clinically relevant approach.

Performance of an automated total body mapping algorithm to detect melanocytic lesions of clinical relevance

IMPORTANCE

Total body photography for skin cancer screening is a well-established tool allowing documentation and follow-up of the entire skin surface. Artificial intelligence-based systems are increasingly applied for automated lesion detection and diagnosis.

DESIGN AND PATIENTS

In this prospective observational international multicentre study experienced dermatologists performed skin cancer screenings and identified clinically relevant melanocytic lesions (CRML, requiring biopsy or observation). Additionally, patients received 2D automated total body mapping (ATBM) with automated lesion detection (ATBM master, Fotofinder Systems GmbH). Primary endpoint was the percentage of CRML detected by the bodyscan software. Secondary endpoints included the percentage of correctly identified "new" and "changed" lesions during follow-up examinations.

RESULTS

At baseline, dermatologists identified 1075 CRML in 236 patients and 999 CRML (92.9%) were also detected by the automated software. During follow-up examinations dermatologists identified 334 CRMLs in 55 patients, with 323 (96.7%) also being detected by ATBM with automated lesions detection. Moreover, all new (n = 13) or changed CRML (n = 24) during follow-up were detected by the software. Average time requirements per baseline examination was 14.1 min (95% CI [12.8-15.5]). Subgroup analysis of undetected lesions revealed either technical (e.g. covering by clothing, hair) or lesion-specific reasons (e.g. hypopigmentation, palmoplantar sites).

CONCLUSIONS

ATBM with lesion detection software correctly detected the vast majority of CRML and new or changed CRML during follow-up examinations in a favourable amount of time. Our prospective international study underlines that automated lesion detection in TBP images is feasible, which is of relevance for developing AI-based skin cancer screenings.

Early automated detection system for skin cancer diagnosis using artificial intelligent techniques

Recently, skin cancer is one of the spread and dangerous cancers around the world. Early detection of skin cancer can reduce mortality. Traditional methods for skin cancer detection are painful, time-consuming, expensive, and may cause the disease to spread out. Dermoscopy is used for noninvasive diagnosis of skin cancer. Artificial Intelligence (AI) plays a vital role in diseases' diagnosis especially in biomedical engineering field. The automated detection systems based on AI reduce the complications in the traditional methods and can improve skin cancer's diagnosis rate. In this paper, automated early detection system for skin cancer dermoscopic images using artificial intelligent is presented. Adaptive snake (AS) and region growing (RG) algorithms are used for automated segmentation and compared with each other. The results show that AS is accurate and efficient (accuracy = 96%) more than RG algorithm (accuracy = 90%). Artificial Neural networks (ANN) and support vector machine (SVM) algorithms are used for automated classification compared with each other. The proposed system with ANN algorithm shows high accuracy (94%), precision (96%), specificity (95.83%), sensitivity (recall) (92.30%), and F1-score (0.94). The proposed system is easy to use, time consuming, enables patients to make early detection for skin cancer and has high efficiency.

How might the rapid development of artificial intelligence affect the delivery of UK Defence healthcare?

Artificial intelligence (AI) has developed greatly and is now at the centre of technological advancements. Current and recent military conflicts have highlighted the evolving complexity of warfare with rapid technological change at the heart of it. AI aims to understand and design systems that show signs of intelligence and are able to learn by deriving knowledge from data. There have been multiple AI-related developments in the medical field in areas such as diagnostics, triage, wearable technology and training with direct translations that may benefit UK Defence healthcare. With the increasing use of AI in society and medical practice, it is important to consider whether AI can be trustworthy and has any legal implications, and evaluate its use through an ethical lens. In conclusion, the rapid development of AI presents exciting opportunities for UK Defence to enhance its healthcare delivery. This paper was selected as the BMJ Military Health Essay Prize winner at the Royal Society of Medicine Colt Foundation Meeting 2023.

Artificial intelligence in dermatology: advancements and challenges in skin of color

Artificial intelligence (AI) uses algorithms and large language models in computers to simulate human-like problem-solving and decision-making. AI programs have recently acquired widespread popularity in the field of dermatology through the application of online tools in the assessment, diagnosis, and treatment of skin conditions. A literature review was conducted using PubMed and Google Scholar analyzing recent literature (from the last 10 years through October 2023) to evaluate current AI programs in use for dermatologic purposes, identifying challenges in this technology when applied to skin of color (SOC), and proposing future steps to enhance the role of AI in dermatologic practice. Challenges surrounding AI and its application to SOC stem from the underrepresentation of SOC in datasets and issues with image quality and standardization. With these existing issues, current AI programs inevitably do worse at identifying lesions in SOC. Additionally, only 30% of the programs identified in this review had data reported on their use in dermatology, specifically in SOC. Significant development of these applications is required for the accurate depiction of darker skin tone images in datasets. More research is warranted in the future to better understand the efficacy of AI in aiding diagnosis and treatment options for SOC patients.

DVFNet: A deep feature fusion-based model for the multiclassification of skin cancer utilizing dermoscopy images

Skin cancer is a common cancer affecting millions of people annually. Skin cells inside the body that grow in unusual patterns are a sign of this invasive disease. The cells then spread to other organs and tissues through the lymph nodes and destroy them. Lifestyle changes and increased solar exposure contribute to the rise in the incidence of skin cancer. Early identification and staging are essential due to the high mortality rate associated with skin cancer. In this study, we presented a deep learning-based method named DVFNet for the detection of skin cancer from dermoscopy images. To detect skin cancer images are pre-processed using anisotropic diffusion methods to remove artifacts and noise which enhances the quality of images. A combination of the VGG19 architecture and the Histogram of Oriented Gradients (HOG) is used in this research for discriminative feature extraction. SMOTE Tomek is used to resolve the problem of imbalanced images in the multiple classes of the publicly available ISIC 2019 dataset. This study utilizes segmentation to pinpoint areas of significantly damaged skin cells. A feature vector map is created by combining the features of HOG and VGG19. Multiclassification is accomplished by CNN using feature vector maps. DVFNet achieves an accuracy of 98.32% on the ISIC 2019 dataset. Analysis of variance (ANOVA) statistical test is used to validate the model's accuracy. Healthcare experts utilize the DVFNet model to detect skin cancer at an early clinical stage.

Review of the application of the most current sophisticated image processing methods for the skin cancer diagnostics purposes

This paper presents the most current and innovative solutions applying modern digital image processing methods for the purpose of skin cancer diagnostics. Skin cancer is one of the most common types of cancers. It is said that in the USA only, one in five people will develop skin cancer and this trend is constantly increasing. Implementation of new, non-invasive methods plays a crucial role in both identification and prevention of skin cancer occurrence. Early diagnosis and treatment are needed in order to decrease the number of deaths due to this disease. This paper also contains some information regarding the most common skin cancer types, mortality and epidemiological data for Poland, Europe, Canada and the USA. It also covers the most efficient and modern image recognition methods based on the artificial intelligence applied currently for diagnostics purposes. In this work, both professional, sophisticated as well as inexpensive solutions were presented. This paper is a review paper and covers the period of 2017 and 2022 when it comes to solutions and statistics. The authors decided to focus on the latest data, mostly due to the rapid technology development and increased number of new methods, which positively affects diagnosis and prognosis.

Differences in the annotation between facial images and videos for training an artificial intelligence for skin type determination

BACKGROUND

The Grand-AID research project, consisting of GRANDEL-The Beautyness Company, the dermatology department of Augsburg University Hospital and the Chair of IT Infrastructure for Translational Medical Research at Augsburg University, is currently researching the development of a digital skin consultation tool that uses artificial intelligence (AI) to analyze the user's skin and ultimately perform a personalized skin analysis and a customized skin care routine. Training the AI requires annotation of various skin features on facial images. The central question is whether videos are better suited than static images for assessing dynamic parameters such as wrinkles and elasticity. For this purpose, a pilot study was carried out in which the annotations on images and videos were compared.

MATERIALS AND METHODS

Standardized image sequences as well as a video with facial expressions were taken from 25 healthy volunteers. Four raters with dermatological expertise annotated eight features (wrinkles, redness, shine, pores, pigmentation spots, dark circles, skin sagging, and blemished skin) with a semi-quantitative and a linear scale in a cross-over design to evaluate differences between the image modalities and between the raters.

RESULTS

In the videos, most parameters tended to be assessed with higher scores than in the images, and in some cases significantly. Furthermore, there were significant differences between the raters.

CONCLUSION

The present study shows significant differences between the two evaluation methods using image or video analysis. In addition, the evaluation of the skin analysis depends on subjective criteria. Therefore, when training the AI, we recommend regular training of the annotating individuals and cross-validation of the annotation.

The State of Artificial Intelligence in Skin Cancer Publications

BACKGROUND

Artificial intelligence (AI) in skin cancer is a promising research field to assist physicians and to provide support to patients remotely. Physicians' awareness to new developments in AI research is important to define the best practices and scope of integrating AI-enabled technologies within a clinical setting.

OBJECTIVES

To analyze the characteristics and trends of AI skin cancer publications from dermatology journals.

METHODS

AI skin cancer publications were retrieved in June 2022 from the Web of Science. Publications were screened by title, abstract, and keywords to assess eligibility. Publications were fully reviewed. Publications were divided between nonmelanoma skin cancer (NMSC), melanoma, and skin cancer studies. The primary measured outcome was the number of citations. The secondary measured outcomes were articles' general characteristics and features related to AI.

RESULTS

A total of 168 articles were included: 25 on NMSC, 77 on melanoma, and 66 on skin cancer. The most common types of skin cancers were melanoma (134, 79.8%), basal cell carcinoma (61, 36.3%), and squamous cell carcinoma (45, 26.9%). All articles were published between 2000 and 2022, with 49 (29.2%) of them being published in 2021. Original studies that developed or assessed an algorithm predominantly used supervised learning (66, 97.0%) and deep neural networks (42, 67.7%). The most used imaging modalities were standard dermoscopy (76, 45.2%) and clinical images (39, 23.2%).

CONCLUSIONS

Most publications focused on developing or assessing screening technologies with mainly deep neural network algorithms. This indicates the eminent need for dermatologists to label or annotate images used by novel AI systems.

Developing an efficient method for melanoma detection using CNN techniques

BACKGROUND

More and more genetic and metabolic abnormalities are now known to cause cancer, which is typically deadly. Any bodily part may become infected by cancerous cells, which can be fatal. Skin cancer is one of the most prevalent types of cancer, and its prevalence is rising across the globe. Squamous and basal cell carcinomas, as well as melanoma, which is clinically aggressive and causes the majority of deaths, are the primary subtypes of skin cancer. Screening for skin cancer is therefore essential.

METHODS

The best way to quickly and precisely detect skin cancer is by using deep learning techniques. In this research deep learning techniques like MobileNetv2 and Dense net will be used for detecting or identifying two main kinds of tumors malignant and benign. For this research HAM10000 dataset is considered. This dataset consists of 10,000 skin lesion images and the disease comprises nonmelanocytic and melanocytic tumors. These two techniques can be used for detecting the malignant and benign. All these methods are compared and then a result can be inferred from their performance.

RESULTS

After the model evaluation, the accuracy for the MobileNetV2 was 85% and customized CNN was 95%. A web application has been developed with the Python framework that provides a graphical user interface with the best-trained model. The graphical user interface allows the user to enter the patient details and upload the lesion image. The image will be classified with the appropriate trained model which can predict whether the uploaded image is cancerous or non-cancerous. This web application also displays the percentage of cancer affected.

CONCLUSION

As per the comparisons between the two techniques customized CNN gives higher accuracy for the detection of melanoma.

Color Analysis of Merkel Cell Carcinoma: A Comparative Study with Cherry Angiomas, Hemangiomas, Basal Cell Carcinomas, and Squamous Cell Carcinomas

Merkel cell carcinoma (MCC) is recognized as one of the most malignant skin tumors. Its rarity might explain the limited exploration of digital color studies in this area. The objective of this study was to delineate color alterations in MCCs compared to benign lesions resembling MCC, such as cherry angiomas and hemangiomas, along with other non-melanoma skin cancer lesions like basal cell carcinoma (BCC) and squamous cell carcinoma (SCC), utilizing computer-aided digital color analysis. This was a retrospective study where clinical images of the color of the lesion and adjacent normal skin from 11 patients with primary MCC, 11 patients with cherry angiomas, 12 patients with hemangiomas, and 12 patients with BCC/SCC (totaling 46 patients) were analyzed using the RGB (red, green, and blue) and the CIE Lab color system. The Lab color system aided in estimating the Individual Typology Angle (ITA) change in the skin, and these results are documented in this study. It was demonstrated that the estimation of color components can assist in the differential diagnosis of these types of lesions because there were significant differences in color parameters between MCC and other categories of skin lesions such as hemangiomas, common skin carcinomas, and cherry hemangiomas. Significant differences in values were observed in the blue color of RGB (p = 0.003) and the b* parameter of Lab color (p < 0.0001) of MCC versus cherry angiomas. Similarly, the mean a* value of Merkel cell carcinoma (MCC) compared to basal cell carcinoma and squamous cell carcinoma showed a statistically significant difference (p < 0.0001). Larger prospective studies are warranted to further validate the clinical application of these findings.

Acceptance of Medical Artificial Intelligence in Skin Cancer Screening: Choice-Based Conjoint Survey

BACKGROUND

There is great interest in using artificial intelligence (AI) to screen for skin cancer. This is fueled by a rising incidence of skin cancer and an increasing scarcity of trained dermatologists. AI systems capable of identifying melanoma could save lives, enable immediate access to screenings, and reduce unnecessary care and health care costs. While such AI-based systems are useful from a public health perspective, past research has shown that individual patients are very hesitant about being examined by an AI system.

OBJECTIVE

The aim of this study was two-fold: (1) to determine the relative importance of the provider (in-person physician, physician via teledermatology, AI, personalized AI), costs of screening (free, 10€, 25€, 40€; 1€=US $1.09), and waiting time (immediate, 1 day, 1 week, 4 weeks) as attributes contributing to patients' choices of a particular mode of skin cancer screening; and (2) to investigate whether sociodemographic characteristics, especially age, were systematically related to participants' individual choices.

METHODS

A choice-based conjoint analysis was used to examine the acceptance of medical AI for a skin cancer screening from the patient's perspective. Participants responded to 12 choice sets, each containing three screening variants, where each variant was described through the attributes of provider, costs, and waiting time. Furthermore, the impacts of sociodemographic characteristics (age, gender, income, job status, and educational background) on the choices were assessed.

RESULTS

Among the 383 clicks on the survey link, a total of 126 (32.9%) respondents completed the online survey. The conjoint analysis showed that the three attributes had more or less equal importance in contributing to the participants' choices, with provider being the most important attribute. Inspecting the individual part-worths of conjoint attributes showed that treatment by a physician was the most preferred modality, followed by electronic consultation with a physician and personalized AI; the lowest scores were found for the three AI levels. Concerning the relationship between sociodemographic characteristics and relative importance, only age showed a significant positive association to the importance of the attribute provider (r=0.21, P=.02), in which younger participants put less importance on the provider than older participants. All other correlations were not significant.

CONCLUSIONS

This study adds to the growing body of research using choice-based experiments to investigate the acceptance of AI in health contexts. Future studies are needed to explore the reasons why AI is accepted or rejected and whether sociodemographic characteristics are associated with this decision.

Artificial intelligence for skin cancer detection and classification for clinical environment: a systematic review

Background

Skin cancer is one of the most common forms worldwide, with a significant increase in incidence over the last few decades. Early and accurate detection of this type of cancer can result in better prognoses and less invasive treatments for patients. With advances in Artificial Intelligence (AI), tools have emerged that can facilitate diagnosis and classify dermatological images, complementing traditional clinical assessments and being applicable where there is a shortage of specialists. Its adoption requires analysis of efficacy, safety, and ethical considerations, as well as considering the genetic and ethnic diversity of patients.

Objective

The systematic review aims to examine research on the detection, classification, and assessment of skin cancer images in clinical settings.

Methods

We conducted a systematic literature search on PubMed, Scopus, Embase, and Web of Science, encompassing studies published until April 4th, 2023. Study selection, data extraction, and critical appraisal were carried out by two independent reviewers. Results were subsequently presented through a narrative synthesis.

Results

Through the search, 760 studies were identified in four databases, from which only 18 studies were selected, focusing on developing, implementing, and validating systems to detect, diagnose, and classify skin cancer in clinical settings. This review covers descriptive analysis, data scenarios, data processing and techniques, study results and perspectives, and physician diversity, accessibility, and participation.

Conclusion

The application of artificial intelligence in dermatology has the potential to revolutionize early detection of skin cancer. However, it is imperative to validate and collaborate with healthcare professionals to ensure its clinical effectiveness and safety.

Combining State-of-the-Art Pre-Trained Deep Learning Models: A Noble Approach for Skin Cancer Detection Using Max Voting Ensemble

Skin cancer poses a significant healthcare challenge, requiring precise and prompt diagnosis for effective treatment. While recent advances in deep learning have dramatically improved medical image analysis, including skin cancer classification, ensemble methods offer a pathway for further enhancing diagnostic accuracy. This study introduces a cutting-edge approach employing the Max Voting Ensemble Technique for robust skin cancer classification on ISIC 2018: Task 1-2 dataset. We incorporate a range of cutting-edge, pre-trained deep neural networks, including MobileNetV2, AlexNet, VGG16, ResNet50, DenseNet201, DenseNet121, InceptionV3, ResNet50V2, InceptionResNetV2, and Xception. These models have been extensively trained on skin cancer datasets, achieving individual accuracies ranging from 77.20% to 91.90%. Our method leverages the synergistic capabilities of these models by combining their complementary features to elevate classification performance further. In our approach, input images undergo preprocessing for model compatibility. The ensemble integrates the pre-trained models with their architectures and weights preserved. For each skin lesion image under examination, every model produces a prediction. These are subsequently aggregated using the max voting ensemble technique to yield the final classification, with the majority-voted class serving as the conclusive prediction. Through comprehensive testing on a diverse dataset, our ensemble outperformed individual models, attaining an accuracy of 93.18% and an AUC score of 0.9320, thus demonstrating superior diagnostic reliability and accuracy. We evaluated the effectiveness of our proposed method on the HAM10000 dataset to ensure its generalizability. Our ensemble method delivers a robust, reliable, and effective tool for the classification of skin cancer. By utilizing the power of advanced deep neural networks, we aim to assist healthcare professionals in achieving timely and accurate diagnoses, ultimately reducing mortality rates and enhancing patient outcomes.

Recent Advancements and Perspectives in the Diagnosis of Skin Diseases Using Machine Learning and Deep Learning: A Review

OBJECTIVE

Skin diseases constitute a widespread health concern, and the application of machine learning and deep learning algorithms has been instrumental in improving diagnostic accuracy and treatment effectiveness. This paper aims to provide a comprehensive review of the existing research on the utilization of machine learning and deep learning in the field of skin disease diagnosis, with a particular focus on recent widely used methods of deep learning. The present challenges and constraints were also analyzed and possible solutions were proposed.

METHODS

We collected comprehensive works from the literature, sourced from distinguished databases including IEEE, Springer, Web of Science, and PubMed, with a particular emphasis on the most recent 5-year advancements. From the extensive corpus of available research, twenty-nine articles relevant to the segmentation of dermatological images and forty-five articles about the classification of dermatological images were incorporated into this review. These articles were systematically categorized into two classes based on the computational algorithms utilized: traditional machine learning algorithms and deep learning algorithms. An in-depth comparative analysis was carried out, based on the employed methodologies and their corresponding outcomes.

CONCLUSIONS

Present outcomes of research highlight the enhanced effectiveness of deep learning methods over traditional machine learning techniques in the field of dermatological diagnosis. Nevertheless, there remains significant scope for improvement, especially in improving the accuracy of algorithms. The challenges associated with the availability of diverse datasets, the generalizability of segmentation and classification models, and the interpretability of models also continue to be pressing issues. Moreover, the focus of future research should be appropriately shifted. A significant amount of existing research is primarily focused on melanoma, and consequently there is a need to broaden the field of pigmented dermatology research in the future. These insights not only emphasize the potential of deep learning in dermatological diagnosis but also highlight directions that should be focused on.

The Use of Artificial Intelligence for the Classification of Craniofacial Deformities

Positional cranial deformities are a common finding in toddlers, yet differentiation from craniosynostosis can be challenging. The aim of this study was to train convolutional neural networks (CNNs) to classify craniofacial deformities based on 2D images generated using photogrammetry as a radiation-free imaging technique. A total of 487 patients with photogrammetry scans were included in this retrospective cohort study: children with craniosynostosis (n = 227), positional deformities (n = 206), and healthy children (n = 54). Three two-dimensional images were extracted from each photogrammetry scan. The datasets were divided into training, validation, and test sets. During the training, fine-tuned ResNet-152s were utilized. The performance was quantified using tenfold cross-validation. For the detection of craniosynostosis, sensitivity was at 0.94 with a specificity of 0.85. Regarding the differentiation of the five existing classes (trigonocephaly, scaphocephaly, positional plagiocephaly left, positional plagiocephaly right, and healthy), sensitivity ranged from 0.45 (positional plagiocephaly left) to 0.95 (scaphocephaly) and specificity ranged from 0.87 (positional plagiocephaly right) to 0.97 (scaphocephaly). We present a CNN-based approach to classify craniofacial deformities on two-dimensional images with promising results. A larger dataset would be required to identify rarer forms of craniosynostosis as well. The chosen 2D approach enables future applications for digital cameras or smartphones.

Deep skin diseases diagnostic system with Dual-channel Image and Extracted Text

Background

Due to the lower reliability of laboratory tests, skin diseases are more suitable for diagnosis with AI models. There are limited AI dermatology diagnostic models combining images and text; few of these are for Asian populations, and few cover the most common types of diseases.

Methods

Leveraging a dataset sourced from Asia comprising over 200,000 images and 220,000 medical records, we explored a deep learning-based system for Dual-channel images and extracted text for the diagnosis of skin diseases model DIET-AI to diagnose 31 skin diseases, which covers the majority of common skin diseases. From 1 September to 1 December 2021, we prospectively collected images from 6,043 cases and medical records from 15 hospitals in seven provinces in China. Then the performance of DIET-AI was compared with that of six doctors of different seniorities in the clinical dataset.

Results

The average performance of DIET-AI in 31 diseases was not less than that of all the doctors of different seniorities. By comparing the area under the curve, sensitivity, and specificity, we demonstrate that the DIET-AI model is effective in clinical scenarios. In addition, medical records affect the performance of DIET-AI and physicians to varying degrees.

Conclusion

This is the largest dermatological dataset for the Chinese demographic. For the first time, we built a Dual-channel image classification model on a non-cancer dermatitis dataset with both images and medical records and achieved comparable diagnostic performance to senior doctors about common skin diseases. It provides references for exploring the feasibility and performance evaluation of DIET-AI in clinical use afterward.

Federated and Transfer Learning Methods for the Classification of Melanoma and Nonmelanoma Skin Cancers: A Prospective Study

Skin cancer is considered a dangerous type of cancer with a high global mortality rate. Manual skin cancer diagnosis is a challenging and time-consuming method due to the complexity of the disease. Recently, deep learning and transfer learning have been the most effective methods for diagnosing this deadly cancer. To aid dermatologists and other healthcare professionals in classifying images into melanoma and nonmelanoma cancer and enabling the treatment of patients at an early stage, this systematic literature review (SLR) presents various federated learning (FL) and transfer learning (TL) techniques that have been widely applied. This study explores the FL and TL classifiers by evaluating them in terms of the performance metrics reported in research studies, which include true positive rate (TPR), true negative rate (TNR), area under the curve (AUC), and accuracy (ACC). This study was assembled and systemized by reviewing well-reputed studies published in eminent fora between January 2018 and July 2023. The existing literature was compiled through a systematic search of seven well-reputed databases. A total of 86 articles were included in this SLR. This SLR contains the most recent research on FL and TL algorithms for classifying malignant skin cancer. In addition, a taxonomy is presented that summarizes the many malignant and non-malignant cancer classes. The results of this SLR highlight the limitations and challenges of recent research. Consequently, the future direction of work and opportunities for interested researchers are established that help them in the automated classification of melanoma and nonmelanoma skin cancers.

Refactoring and performance analysis of the main CNN architectures: using false negative rate minimization to solve the clinical images melanoma detection problem

BACKGROUND

Melanoma is one of the deadliest tumors in the world. Early detection is critical for first-line therapy in this tumor pathology and it remains challenging due to the need for histological analysis to ensure correctness in diagnosis. Therefore, multiple computer-aided diagnosis (CAD) systems working on melanoma images were proposed to mitigate the need of a biopsy. However, although the high global accuracy is declared in literature results, the CAD systems for the health fields must focus on the lowest false negative rate (FNR) possible to qualify as a diagnosis support system. The final goal must be to avoid classification type 2 errors to prevent life-threatening situations. Another goal could be to create an easy-to-use system for both physicians and patients.

RESULTS

To achieve the minimization of type 2 error, we performed a wide exploratory analysis of the principal convolutional neural network (CNN) architectures published for the multiple image classification problem; we adapted these networks to the melanoma clinical image binary classification problem (MCIBCP). We collected and analyzed performance data to identify the best CNN architecture, in terms of FNR, usable for solving the MCIBCP problem. Then, to provide a starting point for an easy-to-use CAD system, we used a clinical image dataset (MED-NODE) because clinical images are easier to access: they can be taken by a smartphone or other hand-size devices. Despite the lower resolution than dermoscopic images, the results in the literature would suggest that it would be possible to achieve high classification performance by using clinical images. In this work, we used MED-NODE, which consists of 170 clinical images (70 images of melanoma and 100 images of naevi). We optimized the following CNNs for the MCIBCP problem: Alexnet, DenseNet, GoogleNet Inception V3, GoogleNet, MobileNet, ShuffleNet, SqueezeNet, and VGG16.

CONCLUSIONS

The results suggest that a CNN built on the VGG or AlexNet structure can ensure the lowest FNR (0.07) and (0.13), respectively. In both cases, discrete global performance is ensured: 73% (accuracy), 82% (sensitivity) and 59% (specificity) for VGG; 89% (accuracy), 87% (sensitivity) and 90% (specificity) for AlexNet.

Deep convolutional neural network with fusion strategy for skin cancer recognition: model development and validation

We aimed to develop an accurate and efficient skin cancer classification system using deep-learning technology with a relatively small dataset of clinical images. We proposed a novel skin cancer classification method, SkinFLNet, which utilizes model fusion and lifelong learning technologies. The SkinFLNet's deep convolutional neural networks were trained using a dataset of 1215 clinical images of skin tumors diagnosed at Taichung and Taipei Veterans General Hospital between 2015 and 2020. The dataset comprised five categories: benign nevus, seborrheic keratosis, basal cell carcinoma, squamous cell carcinoma, and malignant melanoma. The SkinFLNet's performance was evaluated using 463 clinical images between January and December 2021. SkinFLNet achieved an overall classification accuracy of 85%, precision of 85%, recall of 82%, F-score of 82%, sensitivity of 82%, and specificity of 93%, outperforming other deep convolutional neural network models. We also compared SkinFLNet's performance with that of three board-certified dermatologists, and the average overall performance of SkinFLNet was comparable to, or even better than, the dermatologists. Our study presents an efficient skin cancer classification system utilizing model fusion and lifelong learning technologies that can be trained on a relatively small dataset. This system can potentially improve skin cancer screening accuracy in clinical practice.