Computer-aided diagnosis of psoriasis skin images with HOS, texture and color features: A first comparative study of its kind

CAD-PsorNet: deep transfer learning for computer-assisted diagnosis of skin psoriasis

Psoriasis, being a chronic, inflammatory, lifelong skin disorder, has become a major threat to the human population. The precise and effective diagnosis of psoriasis continues to be difficult for clinicians due to its varied nature. In northern India, the prevalence of psoriasis among adult population ranges from 0.44 to 2.8%. Chronic plaque psoriasis accounts for over 90% of cases. This study utilized a dataset of 325 raw images collected from a reputable local hospital using a digital camera under uniform lighting conditions. These images were processed to generate 496 image patches (both diseased and normal), which were then normalized and resized for model training. An automated psoriasis image recognition framework was developed using four state-of-the-art deep transfer learning models: VGG16, VGG19, MobileNetV1, and ResNet-50. The convolutional layers adopted various edge, shape, and color filters to generate the feature map for psoriasis detection. Each pre-trained model was adapted with two dense layers, one dropout layer, and one output layer to classify input images. Among these models, MobileNetV1 achieved the best performance, with 94.84% sensitivity, 89.37% specificity, and 97.24% overall accuracy. Hyper-parameter tuning was performed using grid search to optimize learning rates, batch sizes, and dropout rates. The AdaGrad (Adaptive gradient)) optimizer was chosen for its adaptive learning rate capabilities, facilitating quicker convergence in model performance. Consequently, the methodology's performance improved to 94.25% sensitivity, 96.42% specificity, and 99.13% overall accuracy. The model's performance was also compared with non-machine learning-based diagnostic methods, yielding a Dice coefficient of 0.98. However, the model's effectiveness is dependent upon high-quality input images, as poor image conditions may affect accuracy, and it may not generalize well across diverse demographics or psoriasis variations, highlighting the need for varied training datasets for robustness.

AI in Psoriatic Disease: Scoping Review

BACKGROUND

Artificial intelligence (AI) has many applications in numerous medical fields, including dermatology. Although the majority of AI studies in dermatology focus on skin cancer, there is growing interest in the applicability of AI models in inflammatory diseases, such as psoriasis. Psoriatic disease is a chronic, inflammatory, immune-mediated systemic condition with multiple comorbidities and a significant impact on patients' quality of life. Advanced treatments, including biologics and small molecules, have transformed the management of psoriatic disease. Nevertheless, there are still considerable unmet needs. Globally, delays in the diagnosis of the disease and its severity are common due to poor access to health care systems. Moreover, despite the abundance of treatments, we are unable to predict which is the right medication for the right patient, especially in resource-limited settings. AI could be an additional tool to address those needs. In this way, we can improve rates of diagnosis, accurately assess severity, and predict outcomes of treatment.

OBJECTIVE

This study aims to provide an up-to-date literature review on the use of AI in psoriatic disease, including diagnostics and clinical management as well as addressing the limitations in applicability.

METHODS

We searched the databases MEDLINE, PubMed, and Embase using the keywords "AI AND psoriasis OR psoriatic arthritis OR psoriatic disease," "machine learning AND psoriasis OR psoriatic arthritis OR psoriatic disease," and "prognostic model AND psoriasis OR psoriatic arthritis OR psoriatic disease" until June 1, 2023. Reference lists of relevant papers were also cross-examined for other papers not detected in the initial search.

RESULTS

Our literature search yielded 38 relevant papers. AI has been identified as a key component in digital health technologies. Within this field, there is the potential to apply specific techniques such as machine learning and deep learning to address several aspects of managing psoriatic disease. This includes diagnosis, particularly useful for remote teledermatology via photographs taken by patients as well as monitoring and estimating severity. Similarly, AI can be used to synthesize the vast data sets already in place through patient registries which can help identify appropriate biologic treatments for future cohorts and those individuals most likely to develop complications.

CONCLUSIONS

There are multiple advantageous uses for AI and digital health technologies in psoriatic disease. With wider implementation of AI, we need to be mindful of potential limitations, such as validation and standardization or generalizability of results in specific populations, such as patients with darker skin phototypes.

Herbal Medicinal Nanoformulations for Psoriasis Treatment: Current State of Knowledge and Future Directions

Background:

Psoriasis is a persistent immune system disorder that influences the skin, leading to red, flaky patches that can be painful and irritated.

Objective:

Traditional treatments for psoriasis, such as topical creams and oral medications, may be effective but also have potential side effects. Herbal remedies have been used for centuries to treat skin conditions, and advancements in nanotechnology have led to the development of herbal nanoformulations that offer several advantages over traditional herbal remedies, such as efficacy, safety, and targeted delivery.

Methods:

The studies and reviews published under the title were looked up in several databases (including PubMed, Elsevier, and Google Scholar).

Results:

Several herbal nanoformulations, including those containing curcumin, aloe vera, and neem, have been shown to exhibit anti-inflammatory and immunomodulatory impacts, which will be useful within the treatment of psoriasis. However, more study is required to decide the efficacy and safety of these details, as well as the optimal dosing, duration of treatment, and potential side effects.

Conclusion:

Overall, herbal nanoformulations represent a promising area of research for the treatment of psoriasis, and may offer a safe and effective alternative or adjunct therapy to conventional treatments. This review article summarizes the present state of information for the herbal nanoformulations role in the treatment of psoriasis and their future perspectives.

A review of psoriasis image analysis based on machine learning

Machine Learning (ML), an Artificial Intelligence (AI) technique that includes both Traditional Machine Learning (TML) and Deep Learning (DL), aims to teach machines to automatically learn tasks by inferring patterns from data. It holds significant promise in aiding medical care and has become increasingly important in improving professional processes, particularly in the diagnosis of psoriasis. This paper presents the findings of a systematic literature review focusing on the research and application of ML in psoriasis analysis over the past decade. We summarized 53 publications by searching the Web of Science, PubMed and IEEE Xplore databases and classified them into three categories: (i) lesion localization and segmentation; (ii) lesion recognition; (iii) lesion severity and area scoring. We have presented the most common models and datasets for psoriasis analysis, discussed the key challenges, and explored future trends in ML within this field. Our aim is to suggest directions for subsequent research.

Artificial Intelligence: A Snapshot of Its Application in Chronic Inflammatory and Autoimmune Skin Diseases

Immuno-correlated dermatological pathologies refer to skin disorders that are closely associated with immune system dysfunction or abnormal immune responses. Advancements in the field of artificial intelligence (AI) have shown promise in enhancing the diagnosis, management, and assessment of immuno-correlated dermatological pathologies. This intersection of dermatology and immunology plays a pivotal role in comprehending and addressing complex skin disorders with immune system involvement. The paper explores the knowledge known so far and the evolution and achievements of AI in diagnosis; discusses segmentation and the classification of medical images; and reviews existing challenges, in immunological-related skin diseases. From our review, the role of AI has emerged, especially in the analysis of images for both diagnostic and severity assessment purposes. Furthermore, the possibility of predicting patients' response to therapies is emerging, in order to create tailored therapies.

Polygenic Risk Score for Cardiovascular Diseases in Artificial Intelligence Paradigm: A Review

Cardiovascular disease (CVD) related mortality and morbidity heavily strain society. The relationship between external risk factors and our genetics have not been well established. It is widely acknowledged that environmental influence and individual behaviours play a significant role in CVD vulnerability, leading to the development of polygenic risk scores (PRS). We employed the PRISMA search method to locate pertinent research and literature to extensively review artificial intelligence (AI)-based PRS models for CVD risk prediction. Furthermore, we analyzed and compared conventional vs. AI-based solutions for PRS. We summarized the recent advances in our understanding of the use of AI-based PRS for risk prediction of CVD. Our study proposes three hypotheses: i) Multiple genetic variations and risk factors can be incorporated into AI-based PRS to improve the accuracy of CVD risk predicting. ii) AI-based PRS for CVD circumvents the drawbacks of conventional PRS calculators by incorporating a larger variety of genetic and non-genetic components, allowing for more precise and individualised risk estimations. iii) Using AI approaches, it is possible to significantly reduce the dimensionality of huge genomic datasets, resulting in more accurate and effective disease risk prediction models. Our study highlighted that the AI-PRS model outperformed traditional PRS calculators in predicting CVD risk. Furthermore, using AI-based methods to calculate PRS may increase the precision of risk predictions for CVD and have significant ramifications for individualized prevention and treatment plans.

Artificial intelligence in psoriasis: Where we are and where we are going

Artificial intelligence (AI) is a field of computer science that involves the development of programs designed to replicate human cognitive processes and the analysis of complex data. In dermatology, which is predominantly a visual-based diagnostic field, AI has become increasingly important in improving professional processes, particularly in the diagnosis of psoriasis. In this review, we summarized current AI applications in psoriasis: (i) diagnosis, including identification, classification, lesion segmentation, lesion severity and area scoring; (ii) treatment, including prediction treatment efficiency and prediction candidate drugs; (iii) management, including e-health and preventive medicine. Key challenges and future aspects of AI in psoriasis were also discussed, in hope of providing potential directions for future studies.

Principles, applications, and future of artificial intelligence in dermatology

This paper provides an overview of artificial-intelligence (AI), as applied to dermatology. We focus our discussion on methodology, AI applications for various skin diseases, limitations, and future opportunities. We review how the current image-based models are being implemented in dermatology across disease subsets, and highlight the challenges facing widespread adoption. Additionally, we discuss how the future of AI in dermatology might evolve and the emerging paradigm of large language, and multi-modal models to emphasize the importance of developing responsible, fair, and equitable models in dermatology.

DermAI 1.0: A Robust, Generalized, and Novel Attention-Enabled Ensemble-Based Transfer Learning Paradigm for Multiclass Classification of Skin Lesion Images

Skin lesion classification plays a crucial role in dermatology, aiding in the early detection, diagnosis, and management of life-threatening malignant lesions. However, standalone transfer learning (TL) models failed to deliver optimal performance. In this study, we present an attention-enabled ensemble-based deep learning technique, a powerful, novel, and generalized method for extracting features for the classification of skin lesions. This technique holds significant promise in enhancing diagnostic accuracy by using seven pre-trained TL models for classification. Six ensemble-based DL (EBDL) models were created using stacking, softmax voting, and weighted average techniques. Furthermore, we investigated the attention mechanism as an effective paradigm and created seven attention-enabled transfer learning (aeTL) models before branching out to construct three attention-enabled ensemble-based DL (aeEBDL) models to create a reliable, adaptive, and generalized paradigm. The mean accuracy of the TL models is 95.30%, and the use of an ensemble-based paradigm increased it by 4.22%, to 99.52%. The aeTL models' performance was superior to the TL models in accuracy by 3.01%, and aeEBDL models outperformed aeTL models by 1.29%. Statistical tests show significant p-value and Kappa coefficient along with a 99.6% reliability index for the aeEBDL models. The approach is highly effective and generalized for the classification of skin lesions.

Cardiovascular disease/stroke risk stratification in deep learning framework: a review

The global mortality rate is known to be the highest due to cardiovascular disease (CVD). Thus, preventive, and early CVD risk identification in a non-invasive manner is vital as healthcare cost is increasing day by day. Conventional methods for risk prediction of CVD lack robustness due to the non-linear relationship between risk factors and cardiovascular events in multi-ethnic cohorts. Few recently proposed machine learning-based risk stratification reviews without deep learning (DL) integration. The proposed study focuses on CVD risk stratification by the use of techniques mainly solo deep learning (SDL) and hybrid deep learning (HDL). Using a PRISMA model, 286 DL-based CVD studies were selected and analyzed. The databases included were Science Direct, IEEE Xplore, PubMed, and Google Scholar. This review is focused on different SDL and HDL architectures, their characteristics, applications, scientific and clinical validation, along with plaque tissue characterization for CVD/stroke risk stratification. Since signal processing methods are also crucial, the study further briefly presented Electrocardiogram (ECG)-based solutions. Finally, the study presented the risk due to bias in AI systems. The risk of bias tools used were (I) ranking method (RBS), (II) region-based map (RBM), (III) radial bias area (RBA), (IV) prediction model risk of bias assessment tool (PROBAST), and (V) risk of bias in non-randomized studies-of interventions (ROBINS-I). The surrogate carotid ultrasound image was mostly used in the UNet-based DL framework for arterial wall segmentation. Ground truth (GT) selection is vital for reducing the risk of bias (RoB) for CVD risk stratification. It was observed that the convolutional neural network (CNN) algorithms were widely used since the feature extraction process was automated. The ensemble-based DL techniques for risk stratification in CVD are likely to supersede the SDL and HDL paradigms. Due to the reliability, high accuracy, and faster execution on dedicated hardware, these DL methods for CVD risk assessment are powerful and promising. The risk of bias in DL methods can be best reduced by considering multicentre data collection and clinical evaluation.

Attention-Enabled Ensemble Deep Learning Models and Their Validation for Depression Detection: A Domain Adoption Paradigm

Depression is increasingly prevalent, leading to higher suicide risk. Depression detection and sentimental analysis of text inputs in cross-domain frameworks are challenging. Solo deep learning (SDL) and ensemble deep learning (EDL) models are not robust enough. Recently, attention mechanisms have been introduced in SDL. We hypothesize that attention-enabled EDL (aeEDL) architectures are superior compared to attention-not-enabled SDL (aneSDL) or aeSDL models. We designed EDL-based architectures with attention blocks to build eleven kinds of SDL model and five kinds of EDL model on four domain-specific datasets. We scientifically validated our models by comparing "seen" and "unseen" paradigms (SUP). We benchmarked our results against the SemEval (2016) sentimental dataset and established reliability tests. The mean increase in accuracy for EDL over their corresponding SDL components was 4.49%. Regarding the effect of attention block, the increase in the mean accuracy (AUC) of aeSDL over aneSDL was 2.58% (1.73%), and the increase in the mean accuracy (AUC) of aeEDL over aneEDL was 2.76% (2.80%). When comparing EDL vs. SDL for non-attention and attention, the mean aneEDL was greater than aneSDL by 4.82% (3.71%), and the mean aeEDL was greater than aeSDL by 5.06% (4.81%). For the benchmarking dataset (SemEval), the best-performing aeEDL model (ALBERT+BERT-BiLSTM) was superior to the best aeSDL (BERT-BiLSTM) model by 3.86%. Our scientific validation and robust design showed a difference of only 2.7% in SUP, thereby meeting the regulatory constraints. We validated all our hypotheses and further demonstrated that aeEDL is a very effective and generalized method for detecting symptoms of depression in cross-domain settings.

Fused deep learning paradigm for the prediction of o6-methylguanine-DNA methyltransferase genotype in glioblastoma patients: A neuro-oncological investigation

BACKGROUND

The O6-methylguanine-DNA methyltransferase (MGMT) is a deoxyribonucleic acid (DNA) repairing enzyme that has been established as an essential clinical brain tumor biomarker for Glioblastoma Multiforme (GBM). Knowing the status of MGMT methylation biomarkers using multi-parametric MRI (mp-MRI) helps neuro-oncologists to analyze GBM and its treatment plan.

METHOD

The hand-crafted radiomics feature extraction of GBM's subregions, such as edema(ED), tumor core (TC), and enhancing tumor (ET) in the machine learning (ML) framework, was investigated using support vector machine(SVM), K-Nearest Neighbours (KNN), random forest (RF), LightGBM, and extreme gradient boosting (XGB). For tissue-level analysis of the promotor genes in GBM, we used the deep residual neural network (ResNet-18) with 3D architecture, followed by EfficientNet-based investigation for variants as B0 and B1. Lastly, we analyzed the fused deep learning (FDL) framework that combines ML and DL frameworks.

RESULT

Structural mp-MRI consisting of T1, T2, FLAIR, and T1GD having a size of 400 and 185 patients, respectively, for discovery and replication cohorts. Using the CV protocol in the ResNet-3D framework, MGMT methylation status prediction in mp-MRI gave the AUC of 0.753 (p < 0.0001) and 0.72 (p < 0.0001) for the discovery and replication cohort, respectively. We presented that the FDL is ∼7% superior to solo DL and ∼15% to solo ML.

CONCLUSION

The proposed study aims to provide solutions for building an efficient predictive model of MGMT for GBM patients using deep radiomics features obtained from mp-MRI with the end-to-end ResNet-18 3D and FDL imaging signatures.

Deep learning artificial intelligence framework for multiclass coronary artery disease prediction using combination of conventional risk factors, carotid ultrasound, and intraplaque neovascularization

OBJECTIVE

Cardiovascular disease (CVD) is a major healthcare challenge and therefore early risk assessment is vital. Previous assessment techniques use either "conventional CVD risk calculators (CCVRC)" or machine learning (ML) paradigms. These techniques are ad-hoc, unreliable, not fully automated, and have variabilities. We, therefore, introduce AtheroEdge-MCDLAI (AE3.0DL) windows-based platform using multiclass Deep Learning (DL) system.

METHODS

Data was collected on 500 patients having both carotid ultrasound and corresponding coronary angiography scores (CAS), measured as stenosis in coronary arteries and considered as the gold standard. A total of 39 covariates were used, clubbed into three clusters, namely (i) Office-based: age, gender, body mass index, smoker, hypertension, systolic blood pressure, and diastolic blood pressure; (ii) Laboratory-based: Hyperlipidemia, hemoglobin A1c, and estimated glomerular filtration rate; and (iii) Carotid ultrasound image phenotypes: maximum plaque height, total plaque area, and intra-plaque neovascularization. Baseline characteristics for four classes (target labels) having significant (p < 0.0001) values were calculated using Chi-square and ANOVA. For handling the cohort's imbalance in the risk classes, AE3.0DL used the synthetic minority over-sampling technique (SMOTE). AE3.0DL used Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) DL models and the performance (accuracy and area-under-the-curve) was computed using 10-fold cross-validation (90% training, 10% testing) frameworks. AE3.0DL was validated and benchmarked.

RESULTS

The AE3.0DL using RNN and LSTM showed an accuracy and AUC (p < 0.0001) pairs as (95.00% and 0.98), and (95.34% and 0.99), respectively, and showed an improvement of 32.93% and 9.94% against CCVRC and ML, respectively. AE3.0DL runs in <1 s.

CONCLUSION

DL algorithms are a powerful paradigm for coronary artery disease (CAD) risk prediction and CVD risk stratification.

Dermoscopic image segmentation based on Pyramid Residual Attention Module

We propose a stacked convolutional neural network incorporating a novel and efficient pyramid residual attention (PRA) module for the task of automatic segmentation of dermoscopic images. Precise segmentation is a significant and challenging step for computer-aided diagnosis technology in skin lesion diagnosis and treatment. The proposed PRA has the following characteristics: First, we concentrate on three widely used modules in the PRA. The purpose of the pyramid structure is to extract the feature information of the lesion area at different scales, the residual means is aimed to ensure the efficiency of model training, and the attention mechanism is used to screen effective features maps. Thanks to the PRA, our network can still obtain precise boundary information that distinguishes healthy skin from diseased areas for the blurred lesion areas. Secondly, the proposed PRA can increase the segmentation ability of a single module for lesion regions through efficient stacking. The third, we incorporate the idea of encoder-decoder into the architecture of the overall network. Compared with the traditional networks, we divide the segmentation procedure into three levels and construct the pyramid residual attention network (PRAN). The shallow layer mainly processes spatial information, the middle layer refines both spatial and semantic information, and the deep layer intensively learns semantic information. The basic module of PRAN is PRA, which is enough to ensure the efficiency of the three-layer architecture network. We extensively evaluate our method on ISIC2017 and ISIC2018 datasets. The experimental results demonstrate that PRAN can obtain better segmentation performance comparable to state-of-the-art deep learning models under the same experiment environment conditions.

Brain Tumor Characterization Using Radiogenomics in Artificial Intelligence Framework

Brain tumor characterization (BTC) is the process of knowing the underlying cause of brain tumors and their characteristics through various approaches such as tumor segmentation, classification, detection, and risk analysis. The substantial brain tumor characterization includes the identification of the molecular signature of various useful genomes whose alteration causes the brain tumor. The radiomics approach uses the radiological image for disease characterization by extracting quantitative radiomics features in the artificial intelligence (AI) environment. However, when considering a higher level of disease characteristics such as genetic information and mutation status, the combined study of "radiomics and genomics" has been considered under the umbrella of "radiogenomics". Furthermore, AI in a radiogenomics' environment offers benefits/advantages such as the finalized outcome of personalized treatment and individualized medicine. The proposed study summarizes the brain tumor's characterization in the prospect of an emerging field of research, i.e., radiomics and radiogenomics in an AI environment, with the help of statistical observation and risk-of-bias (RoB) analysis. The PRISMA search approach was used to find 121 relevant studies for the proposed review using IEEE, Google Scholar, PubMed, MDPI, and Scopus. Our findings indicate that both radiomics and radiogenomics have been successfully applied aggressively to several oncology applications with numerous advantages. Furthermore, under the AI paradigm, both the conventional and deep radiomics features have made an impact on the favorable outcomes of the radiogenomics approach of BTC. Furthermore, risk-of-bias (RoB) analysis offers a better understanding of the architectures with stronger benefits of AI by providing the bias involved in them.

Role of Artificial Intelligence in Radiogenomics for Cancers in the Era of Precision Medicine

Simple Summary

Recently, radiogenomics has played a significant role and offered a new understanding of cancer’s biology and behavior in response to standard therapy. It also provides a more precise prognosis, investigation, and analysis of the patient’s cancer. Over the years, Artificial Intelligence (AI) has provided a significant strength in radiogenomics. In this paper, we offer computational and oncological prospects of the role of AI in radiogenomics, as well as its offers, achievements, opportunities, and limitations in the current clinical practices.

Abstract

Radiogenomics, a combination of “Radiomics” and “Genomics,” using Artificial Intelligence (AI) has recently emerged as the state-of-the-art science in precision medicine, especially in oncology care. Radiogenomics syndicates large-scale quantifiable data extracted from radiological medical images enveloped with personalized genomic phenotypes. It fabricates a prediction model through various AI methods to stratify the risk of patients, monitor therapeutic approaches, and assess clinical outcomes. It has recently shown tremendous achievements in prognosis, treatment planning, survival prediction, heterogeneity analysis, reoccurrence, and progression-free survival for human cancer study. Although AI has shown immense performance in oncology care in various clinical aspects, it has several challenges and limitations. The proposed review provides an overview of radiogenomics with the viewpoints on the role of AI in terms of its promises for computational as well as oncological aspects and offers achievements and opportunities in the era of precision medicine. The review also presents various recommendations to diminish these obstacles.

Cardiovascular Risk Stratification in Diabetic Retinopathy via Atherosclerotic Pathway in COVID-19/Non-COVID-19 Frameworks Using Artificial Intelligence Paradigm: A Narrative Review

Diabetes is one of the main causes of the rising cases of blindness in adults. This microvascular complication of diabetes is termed diabetic retinopathy (DR) and is associated with an expanding risk of cardiovascular events in diabetes patients. DR, in its various forms, is seen to be a powerful indicator of atherosclerosis. Further, the macrovascular complication of diabetes leads to coronary artery disease (CAD). Thus, the timely identification of cardiovascular disease (CVD) complications in DR patients is of utmost importance. Since CAD risk assessment is expensive for low-income countries, it is important to look for surrogate biomarkers for risk stratification of CVD in DR patients. Due to the common genetic makeup between the coronary and carotid arteries, low-cost, high-resolution imaging such as carotid B-mode ultrasound (US) can be used for arterial tissue characterization and risk stratification in DR patients. The advent of artificial intelligence (AI) techniques has facilitated the handling of large cohorts in a big data framework to identify atherosclerotic plaque features in arterial ultrasound. This enables timely CVD risk assessment and risk stratification of patients with DR. Thus, this review focuses on understanding the pathophysiology of DR, retinal and CAD imaging, the role of surrogate markers for CVD, and finally, the CVD risk stratification of DR patients. The review shows a step-by-step cyclic activity of how diabetes and atherosclerotic disease cause DR, leading to the worsening of CVD. We propose a solution to how AI can help in the identification of CVD risk. Lastly, we analyze the role of DR/CVD in the COVID-19 framework.

Segmentation and identification of spectral and statistical textures for computer medical diagnostics in dermatology

An important component of the computer systems of medical diagnostics in dermatology is the device for recognition of visual images (DRVI), which includes identification and segmentation procedures to build the image of the object for recognition. In this study, the peculiarities of the application of detection, classification and vector-difference approaches for the segmentation of textures of different types in images of dermatological diseases were considered. To increase the quality of segmented images in dermatologic diagnostic systems using a DRVI, an improved vector-difference method for spectral-statistical texture segmentation has been developed. The method is based on the estimation of the number of features and subsequent calculation of a specific texture feature, and it uses wavelets obtained by transforming the graph of the power function at the stage of contour segmentation. Based on the above, the authors developed a modulus for spectral-statistical texture segmentation, which they applied to segment images of psoriatic disease; the Pratt's criterion was used to assess the quality of segmentation. The reliability of the classification of the spectral-statistical texture images was confirmed by using the True Positive Rate (TPR) and False Positive Rate (FPR) metrics calculated on the basis of the confusion matrix. The results of the experimental research confirmed the advantage of the proposed vector-difference method for the segmentation of spectral-statistical textures. The method enables further supplementation of the vector of features at the stage of identification through the use of the most informative features based on characteristic points for different degrees and types of psoriatic disease.

Three-Dimensional Skin CT Based on Intelligent Algorithm in the Analysis of Skin Lesion Sites Features in Children with Psoriasis

This research was to explore the application value of three-dimensional computed tomography (CT) based on artificial intelligent algorithm in analyzing the characteristics of skin lesions in children with psoriasis. In this study, 15 children with psoriasis were selected as the observation group, and 15 children with other skin diseases were selected as the control group. The CT images were optimized, and the feature selection was carried out based on artificial intelligent algorithm. Firstly, the results were compared with the results of simple skin three-dimensional CT to determine the effectiveness. Then, the two groups of three-dimensional skin CT image features of skin psoriasis-like hyperplasia, Munro microabscess, dermal papillary vascular dilation, and squamous epithelium based on intelligent algorithms were compared. After comparison, the detection rate of psoriasis-like hyperplasia, Munro microabscess, dermal papillary vascular dilation, and squamous epithelium in the observation group was higher than that in the control group, with significant difference and statistical significance (P < 0.05). In addition, the sensitivity of psoriasis-like hyperplasia, Munro microabscess, dermal papilla vascular dilatation, and squamous epithelium in children with psoriasis was 80.0%, 86.7%, 80.0%, and 93.3%, respectively. The specificity of psoriasis-like hyperplasia, Munro microabscess, dermal papilla vascular dilatation, and squamous epithelium in children with psoriasis was 86.7%, 93.3%, 60.0%, and 73.3%, respectively. The results showed that Munro microabscess and psoriasis-like hyperplasia had high sensitivity and specificity in all diagnostic items, which could be used as important features of skin lesion sites in the diagnosis of psoriasis in children. The research provides a basis for the clinical diagnosis of psoriasis in children, which is worthy of clinical promotion.

Human activity recognition in artificial intelligence framework: a narrative review

Human activity recognition (HAR) has multifaceted applications due to its worldly usage of acquisition devices such as smartphones, video cameras, and its ability to capture human activity data. While electronic devices and their applications are steadily growing, the advances in Artificial intelligence (AI) have revolutionized the ability to extract deep hidden information for accurate detection and its interpretation. This yields a better understanding of rapidly growing acquisition devices, AI, and applications, the three pillars of HAR under one roof. There are many review articles published on the general characteristics of HAR, a few have compared all the HAR devices at the same time, and few have explored the impact of evolving AI architecture. In our proposed review, a detailed narration on the three pillars of HAR is presented covering the period from 2011 to 2021. Further, the review presents the recommendations for an improved HAR design, its reliability, and stability. Five major findings were: (1) HAR constitutes three major pillars such as devices, AI and applications; (2) HAR has dominated the healthcare industry; (3) Hybrid AI models are in their infancy stage and needs considerable work for providing the stable and reliable design. Further, these trained models need solid prediction, high accuracy, generalization, and finally, meeting the objectives of the applications without bias; (4) little work was observed in abnormality detection during actions; and (5) almost no work has been done in forecasting actions. We conclude that: (a) HAR industry will evolve in terms of the three pillars of electronic devices, applications and the type of AI. (b) AI will provide a powerful impetus to the HAR industry in future.

Supplementary Information

The online version contains supplementary material available at 10.1007/s10462-021-10116-x.

A machine learning algorithm for early detection of heel deep tissue injuries based on a daily history of sub-epidermal moisture measurements

Sub‐epidermal moisture is an established biophysical marker of pressure ulcer formation based on biocapacitance changes in affected soft tissues, which has been shown to facilitate early detection of these injuries. Artificial intelligence shows great promise in wound prevention and care, including in automated analyses of quantitative measures of tissue health such as sub‐epidermal moisture readings acquired over time for effective, patient‐specific, and anatomical‐site‐specific pressure ulcer prophylaxis. Here, we developed a novel machine learning algorithm for early detection of heel deep tissue injuries, which was trained using a database comprising six consecutive daily sub‐epidermal moisture measurements recorded from 173 patients in acute and post‐acute care settings. This algorithm was able to achieve strong predictive power in forecasting heel deep tissue injury events the next day, with sensitivity and specificity of 77% and 80%, respectively, revealing the clinical potential of artificial intelligence‐powered technology for hospital‐acquired pressure ulcer prevention. The current work forms the scientific basis for clinical implementation of machine learning algorithms that provide effective, early, and anatomy‐specific preventive interventions to minimise the occurrence of hospital‐acquired pressure ulcers based on routine tissue health status measurements.

Bias Investigation in Artificial Intelligence Systems for Early Detection of Parkinson's Disease: A Narrative Review

Background and Motivation: Diagnosis of Parkinson's disease (PD) is often based on medical attention and clinical signs. It is subjective and does not have a good prognosis. Artificial Intelligence (AI) has played a promising role in the diagnosis of PD. However, it introduces bias due to lack of sample size, poor validation, clinical evaluation, and lack of big data configuration. The purpose of this study is to compute the risk of bias (RoB) automatically.

METHOD

The PRISMA search strategy was adopted to select the best 39 AI studies out of 85 PD studies closely associated with early diagnosis PD. The studies were used to compute 30 AI attributes (based on 6 AI clusters), using AP(ai)Bias 1.0 (AtheroPointTM, Roseville, CA, USA), and the mean aggregate score was computed. The studies were ranked and two cutoffs (Moderate-Low (ML) and High-Moderate (MH)) were determined to segregate the studies into three bins: low-, moderate-, and high-bias.

RESULT

The ML and HM cutoffs were 3.50 and 2.33, respectively, which constituted 7, 13, and 6 for low-, moderate-, and high-bias studies. The best and worst architectures were "deep learning with sketches as outcomes" and "machine learning with Electroencephalography," respectively. We recommend (i) the usage of power analysis in big data framework, (ii) that it must undergo scientific validation using unseen AI models, and (iii) that it should be taken towards clinical evaluation for reliability and stability tests.

CONCLUSION

The AI is a vital component for the diagnosis of early PD and the recommendations must be followed to lower the RoB.

Using Health Concept Surveying to Elicit Usable Evidence: Case Studies of a Novel Evaluation Methodology

BACKGROUND

Developers, designers, and researchers use rapid prototyping methods to project the adoption and acceptability of their health intervention technology (HIT) before the technology becomes mature enough to be deployed. Although these methods are useful for gathering feedback that advances the development of HITs, they rarely provide usable evidence that can contribute to our broader understanding of HITs.

OBJECTIVE

In this research, we aim to develop and demonstrate a variation of vignette testing that supports developers and designers in evaluating early-stage HIT designs while generating usable evidence for the broader research community.

METHODS

We proposed a method called health concept surveying for untangling the causal relationships that people develop around conceptual HITs. In health concept surveying, investigators gather reactions to design concepts through a scenario-based survey instrument. As the investigator manipulates characteristics related to their HIT, the survey instrument also measures proximal cognitive factors according to a health behavior change model to project how HIT design decisions may affect the adoption and acceptability of an HIT. Responses to the survey instrument were analyzed using path analysis to untangle the causal effects of these factors on the outcome variables.

RESULTS

We demonstrated health concept surveying in 3 case studies of sensor-based health-screening apps. Our first study (N=54) showed that a wait time incentive could influence more people to go see a dermatologist after a positive test for skin cancer. Our second study (N=54), evaluating a similar application design, showed that although visual explanations of algorithmic decisions could increase participant trust in negative test results, the trust would not have been enough to affect people's decision-making. Our third study (N=263) showed that people might prioritize test specificity or sensitivity depending on the nature of the medical condition.

CONCLUSIONS

Beyond the findings from our 3 case studies, our research uses the framing of the Health Belief Model to elicit and understand the intrinsic and extrinsic factors that may affect the adoption and acceptability of an HIT without having to build a working prototype. We have made our survey instrument publicly available so that others can leverage it for their own investigations.

COVLIAS 1.0 vs. MedSeg: Artificial Intelligence-Based Comparative Study for Automated COVID-19 Computed Tomography Lung Segmentation in Italian and Croatian Cohorts

(1) Background: COVID-19 computed tomography (CT) lung segmentation is critical for COVID lung severity diagnosis. Earlier proposed approaches during 2020-2021 were semiautomated or automated but not accurate, user-friendly, and industry-standard benchmarked. The proposed study compared the COVID Lung Image Analysis System, COVLIAS 1.0 (GBTI, Inc., and AtheroPointTM, Roseville, CA, USA, referred to as COVLIAS), against MedSeg, a web-based Artificial Intelligence (AI) segmentation tool, where COVLIAS uses hybrid deep learning (HDL) models for CT lung segmentation. (2) Materials and Methods: The proposed study used 5000 ITALIAN COVID-19 positive CT lung images collected from 72 patients (experimental data) that confirmed the reverse transcription-polymerase chain reaction (RT-PCR) test. Two hybrid AI models from the COVLIAS system, namely, VGG-SegNet (HDL 1) and ResNet-SegNet (HDL 2), were used to segment the CT lungs. As part of the results, we compared both COVLIAS and MedSeg against two manual delineations (MD 1 and MD 2) using (i) Bland-Altman plots, (ii) Correlation coefficient (CC) plots, (iii) Receiver operating characteristic curve, and (iv) Figure of Merit and (v) visual overlays. A cohort of 500 CROATIA COVID-19 positive CT lung images (validation data) was used. A previously trained COVLIAS model was directly applied to the validation data (as part of Unseen-AI) to segment the CT lungs and compare them against MedSeg. (3) Result: For the experimental data, the four CCs between COVLIAS (HDL 1) vs. MD 1, COVLIAS (HDL 1) vs. MD 2, COVLIAS (HDL 2) vs. MD 1, and COVLIAS (HDL 2) vs. MD 2 were 0.96, 0.96, 0.96, and 0.96, respectively. The mean value of the COVLIAS system for the above four readings was 0.96. CC between MedSeg vs. MD 1 and MedSeg vs. MD 2 was 0.98 and 0.98, respectively. Both had a mean value of 0.98. On the validation data, the CC between COVLIAS (HDL 1) vs. MedSeg and COVLIAS (HDL 2) vs. MedSeg was 0.98 and 0.99, respectively. For the experimental data, the difference between the mean values for COVLIAS and MedSeg showed a difference of <2.5%, meeting the standard of equivalence. The average running times for COVLIAS and MedSeg on a single lung CT slice were ~4 s and ~10 s, respectively. (4) Conclusions: The performances of COVLIAS and MedSeg were similar. However, COVLIAS showed improved computing time over MedSeg.

A hybrid deep learning paradigm for carotid plaque tissue characterization and its validation in multicenter cohorts using a supercomputer framework

BACKGROUND

Early and automated detection of carotid plaques prevents strokes, which are the second leading cause of death worldwide according to the World Health Organization. Artificial intelligence (AI) offers automated solutions for plaque tissue characterization. Recently, solo deep learning (SDL) models have been used, but they do not take advantage of the tandem connectivity offered by AI's hybrid nature. Therefore, this study explores the use of hybrid deep learning (HDL) models in a multicenter framework, making this study the first of its kind.

METHODS

We hypothesize that HDL techniques perform better than SDL and transfer learning (TL) techniques. We propose two kinds of HDL frameworks: (i) the fusion of two SDLs (Inception with ResNet) or (ii) 10 other kinds of tandem models that fuse SDL with ML. The system Atheromatic™ 2.0_HDL (AtheroPoint, CA, USA) was designed on an augmentation framework and three kinds of loss functions (cross-entropy, hinge, and mean-square-error) during training to determine the best optimization paradigm. These 11 combined HDL models were then benchmarked against one SDL model and five types of TL models; thus, this study considers a total of 17 AI models.

RESULTS

Among the 17 AI models, the best performing HDL system was that comprising CNN and decision tree (DT), as its accuracy and area-under-the-curve were 99.78 ± 1.05% and 0.99 (p<0.0001), respectively. These values are 6.4% and 3.2% better than those recorded for the SDL and TL models, respectively. We validated the performance of the HDL models with diagnostics odds ratio (DOR) and Cohen and Kappa statistics; here, HDL outperformed DL and TL by 23% and 7%, respectively. The online system ran in <2 s.

CONCLUSION

HDL is a fast, reliable, and effective tool for characterizing the carotid plaque for early stroke risk stratification.

Artificial intelligence in dermatology

Dermatology and medicine are producing data at an increasing rate that are progressively difficult to sort and manage. Artificial intelligence (AI) and machine learning are examples of tools that may have the capability to produce significant and meaningful results from these data. Currently, AI and machine learning have a variety of applications in medicine including, but not limited to, diagnostics, patient management, preventive medicine, and genomic analysis. Although the role of AI in dermatology is greater than ever, its use is still extremely limited. As AI is continually developed and implemented, it is essential that stakeholders understand AI terminology, applications, limitations, and projected uses in dermatology. With the continued development of AI technology, however, its implementation may afford greater dermatologist efficiency, greater increased patient access to dermatologic care, and improved patient outcomes.

Ten Fast Transfer Learning Models for Carotid Ultrasound Plaque Tissue Characterization in Augmentation Framework Embedded with Heatmaps for Stroke Risk Stratification

Background and Purpose: Only 1-2% of the internal carotid artery asymptomatic plaques are unstable as a result of >80% stenosis. Thus, unnecessary efforts can be saved if these plaques can be characterized and classified into symptomatic and asymptomatic using non-invasive B-mode ultrasound. Earlier plaque tissue characterization (PTC) methods were machine learning (ML)-based, which used hand-crafted features that yielded lower accuracy and unreliability. The proposed study shows the role of transfer learning (TL)-based deep learning models for PTC. Methods: As pertained weights were used in the supercomputer framework, we hypothesize that transfer learning (TL) provides improved performance compared with deep learning. We applied 11 kinds of artificial intelligence (AI) models, 10 of them were augmented and optimized using TL approaches-a class of Atheromatic™ 2.0 TL (AtheroPoint™, Roseville, CA, USA) that consisted of (i-ii) Visual Geometric Group-16, 19 (VGG16, 19); (iii) Inception V3 (IV3); (iv-v) DenseNet121, 169; (vi) XceptionNet; (vii) ResNet50; (viii) MobileNet; (ix) AlexNet; (x) SqueezeNet; and one DL-based (xi) SuriNet-derived from UNet. We benchmark 11 AI models against our earlier deep convolutional neural network (DCNN) model. Results: The best performing TL was MobileNet, with accuracy and area-under-the-curve (AUC) pairs of 96.10 ± 3% and 0.961 (p < 0.0001), respectively. In DL, DCNN was comparable to SuriNet, with an accuracy of 95.66% and 92.7 ± 5.66%, and an AUC of 0.956 (p < 0.0001) and 0.927 (p < 0.0001), respectively. We validated the performance of the AI architectures with established biomarkers such as greyscale median (GSM), fractal dimension (FD), higher-order spectra (HOS), and visual heatmaps. We benchmarked against previously developed Atheromatic™ 1.0 ML and showed an improvement of 12.9%. Conclusions: TL is a powerful AI tool for PTC into symptomatic and asymptomatic plaques.

Inter-Variability Study of COVLIAS 1.0: Hybrid Deep Learning Models for COVID-19 Lung Segmentation in Computed Tomography

Background: For COVID-19 lung severity, segmentation of lungs on computed tomography (CT) is the first crucial step. Current deep learning (DL)-based Artificial Intelligence (AI) models have a bias in the training stage of segmentation because only one set of ground truth (GT) annotations are evaluated. We propose a robust and stable inter-variability analysis of CT lung segmentation in COVID-19 to avoid the effect of bias. Methodology: The proposed inter-variability study consists of two GT tracers for lung segmentation on chest CT. Three AI models, PSP Net, VGG-SegNet, and ResNet-SegNet, were trained using GT annotations. We hypothesized that if AI models are trained on the GT tracings from multiple experience levels, and if the AI performance on the test data between these AI models is within the 5% range, one can consider such an AI model robust and unbiased. The K5 protocol (training to testing: 80%:20%) was adapted. Ten kinds of metrics were used for performance evaluation. Results: The database consisted of 5000 CT chest images from 72 COVID-19-infected patients. By computing the coefficient of correlations (CC) between the output of the two AI models trained corresponding to the two GT tracers, computing their differences in their CC, and repeating the process for all three AI-models, we show the differences as 0%, 0.51%, and 2.04% (all < 5%), thereby validating the hypothesis. The performance was comparable; however, it had the following order: ResNet-SegNet > PSP Net > VGG-SegNet. Conclusions: The AI models were clinically robust and stable during the inter-variability analysis on the CT lung segmentation on COVID-19 patients.

Artificial intelligence-based hybrid deep learning models for image classification: The first narrative review

BACKGROUND

Artificial intelligence (AI) has served humanity in many applications since its inception. Currently, it dominates the imaging field-in particular, image classification. The task of image classification became much easier with machine learning (ML) and subsequently got automated and more accurate by using deep learning (DL). By default, DL consists of a single architecture and is termed solo deep learning (SDL). When two or more DL architectures are fused, the result is termed a hybrid deep learning (HDL) model. The use of HDL models is becoming popular in several applications, but no review of these uses has been designed thus far. Therefore, this study provides the first narrative HDL review by considering all facets of image classification using AI.

APPROACH

Our review employs a PRISMA search strategy using Google Scholar, PubMed, IEEE, and Elsevier Science Direct, through which 127 relevant HDL studies were considered. Based on the computer vision evolution, HDLs were subsequently classified into three categories (spatial, temporal, and spatial-temporal). Each study was then analyzed based on several attributes, including continent, publisher, hybridization of two DL or ML, architecture layout, application type, data set type, dataset size, feature extraction methodology, connecting classifier, performance evaluation metrics, and risk-of-bias.

CONCLUSION

The HDL models have shown stable and superior performance by taking the best aspects of two or more solo DL or fusion of DL with ML models. Our findings indicate that HDL is being applied aggressively to several medical and non-medical applications. Furthermore, risk-of-bias is highly debatable for DL and HDL models.

Accuracy of Deep Neural Network in Triaging Common Skin Diseases of Primary Care Attention

Access to dermatological care can be challenging in certain regions of the world. The triage process is usually conducted by primary care physicians; however, they may not be able to diagnose and assign the correct referral and level of priority for different dermatosis. The present research aimed to test different deep neural networks to obtain the highest level of accuracy for the following: (1) diagnosing groups of dermatoses; (2) correct referrals; and (3) the level of priority given to the referral compared to dermatologists. Using 140,446 images from a teledermatology project, previously labeled with the clinical diagnosis, and their respective referrals, namely biopsy, in-person dermatologist visits or monitoring the case via teledermatology along with the general physician, 27 different scenarios of neural networks were derived, and the algorithm accuracies in classifying different dermatosis, according to the group of the diagnosis they belong to, were calculated. The most accurate algorithm was then tested for accuracy in diagnosis, referral, and level of priority given to 6,945 cases. The GoogLeNet architecture, trained with 24,000 images and 1,000 epochs, using weight random initialization and learning rates of 10⁻³ was found to be the most accurate network, showing an accuracy of 89.72% for diagnosis, 96.03% for referrals and 92.54% for priority level in 6,975 image testing. Our study population, however, was confined to individuals with chronic skin conditions and, therefore, it has limited value as a triage tool because it has not been tested for acute conditions. Deep neural networks are accurate in triaging, correct referral and prioritizing common chronic skin diseases related to primary care attention. They can also help health-care systems optimize patients' access to dermatologists.

Optimization of psoriasis assessment system based on patch images

Psoriasis is a chronic inflammatory skin disease that occurs in various forms throughout the body and is associated with certain conditions such as heart disease, diabetes, and depression. The psoriasis area severity index (PASI) score, a tool used to evaluate the severity of psoriasis, is currently used in clinical trials and clinical research. The determination of severity is based on the subjective judgment of the clinician. Thus, the disease evaluation deviations are induced. Therefore, we propose optimal algorithms that can effectively segment the lesion area and classify the severity. In addition, a new dataset on psoriasis was built, including patch images of erythema and scaling. We performed psoriasis lesion segmentation and classified the disease severity. In addition, we evaluated the best-performing segmentation method and classifier and analyzed features that are highly related to the severity of psoriasis. In conclusion, we presented the optimal techniques for evaluating the severity of psoriasis. Our newly constructed dataset improved the generalization performance of psoriasis diagnosis and evaluation. It proposed an optimal system for specific evaluation indicators of the disease and a quantitative PASI scoring method. The proposed system can help to evaluate the severity of localized psoriasis more accurately.

COVLIAS 1.0: Lung Segmentation in COVID-19 Computed Tomography Scans Using Hybrid Deep Learning Artificial Intelligence Models

BACKGROUND

COVID-19 lung segmentation using Computed Tomography (CT) scans is important for the diagnosis of lung severity. The process of automated lung segmentation is challenging due to (a) CT radiation dosage and (b) ground-glass opacities caused by COVID-19. The lung segmentation methodologies proposed in 2020 were semi- or automated but not reliable, accurate, and user-friendly. The proposed study presents a COVID Lung Image Analysis System (COVLIAS 1.0, AtheroPoint™, Roseville, CA, USA) consisting of hybrid deep learning (HDL) models for lung segmentation.

METHODOLOGY

The COVLIAS 1.0 consists of three methods based on solo deep learning (SDL) or hybrid deep learning (HDL). SegNet is proposed in the SDL category while VGG-SegNet and ResNet-SegNet are designed under the HDL paradigm. The three proposed AI approaches were benchmarked against the National Institute of Health (NIH)-based conventional segmentation model using fuzzy-connectedness. A cross-validation protocol with a 40:60 ratio between training and testing was designed, with 10% validation data. The ground truth (GT) was manually traced by a radiologist trained personnel. For performance evaluation, nine different criteria were selected to perform the evaluation of SDL or HDL lung segmentation regions and lungs long axis against GT.

RESULTS

Using the database of 5000 chest CT images (from 72 patients), COVLIAS 1.0 yielded AUC of ~0.96, ~0.97, ~0.98, and ~0.96 (p-value < 0.001), respectively within 5% range of GT area, for SegNet, VGG-SegNet, ResNet-SegNet, and NIH. The mean Figure of Merit using four models (left and right lung) was above 94%. On benchmarking against the National Institute of Health (NIH) segmentation method, the proposed model demonstrated a 58% and 44% improvement in ResNet-SegNet, 52% and 36% improvement in VGG-SegNet for lung area, and lung long axis, respectively. The PE statistics performance was in the following order: ResNet-SegNet > VGG-SegNet > NIH > SegNet. The HDL runs in <1 s on test data per image.

CONCLUSIONS

The COVLIAS 1.0 system can be applied in real-time for radiology-based clinical settings.

Hybrid deep learning segmentation models for atherosclerotic plaque in internal carotid artery B-mode ultrasound

The automated and accurate carotid plaque segmentation in B-mode ultrasound (US) is an essential part of stroke risk stratification. Previous segmented methods used AtheroEdge™ 2.0 (AtheroPoint™, Roseville, CA) for the common carotid artery (CCA). This study focuses on automated plaque segmentation in the internal carotid artery (ICA) using solo deep learning (SDL) and hybrid deep learning (HDL) models. The methodology consists of a novel design of 10 types of SDL/HDL models (AtheroEdge™ 3.0 systems (AtheroPoint™, Roseville, CA) with a depth of four layers each. Five of the models use cross-entropy (CE)-loss, and the other five models use Dice similarity coefficient (DSC)-loss functions derived from UNet, UNet+, SegNet, SegNet-UNet, and SegNet-UNet+. The K10 protocol (Train:Test:90%:10%) was applied for all 10 models for training and predicting (segmenting) the plaque region, which was then quantified to compute the plaque area in mm². Further, the data augmentation effect was analyzed. The database consisted of 970 ICA B-mode US scans taken from 99 moderate to high-risk patients. Using the difference area threshold of 10 mm² between ground truth (GT) and artificial intelligence (AI), the area under the curve (AUC) values were 0.91, 0.911, 0.908, 0.905, and 0.898, all with a p-value of <0.001 (for CE-loss models) and 0.883, 0.889, 0.905, 0.889, and 0.907, all with a p-value of <0.001 (for DSC-loss models). The correlations between the AI-based plaque area and GT plaque area were 0.98, 0.96, 0.97, 0.98, and 0.97, all with a p-value of <0.001 (for CE-loss models) and 0.98, 0.98, 0.97, 0.98, and 0.98 (for DSC-loss models). Overall, the online system performs plaque segmentation in less than 1 s. We validate our hypothesis that HDL and SDL models demonstrate comparable performance. SegNet-UNet was the best-performing hybrid architecture.

Machine Learning and Deep Learning Methods for Skin Lesion Classification and Diagnosis: A Systematic Review

Computer-aided systems for skin lesion diagnosis is a growing area of research. Recently, researchers have shown an increasing interest in developing computer-aided diagnosis systems. This paper aims to review, synthesize and evaluate the quality of evidence for the diagnostic accuracy of computer-aided systems. This study discusses the papers published in the last five years in ScienceDirect, IEEE, and SpringerLink databases. It includes 53 articles using traditional machine learning methods and 49 articles using deep learning methods. The studies are compared based on their contributions, the methods used and the achieved results. The work identified the main challenges of evaluating skin lesion segmentation and classification methods such as small datasets, ad hoc image selection and racial bias.

Multimodality carotid plaque tissue characterization and classification in the artificial intelligence paradigm: a narrative review for stroke application

Cardiovascular disease (CVD) is one of the leading causes of morbidity and mortality in the United States of America and globally. Carotid arterial plaque, a cause and also a marker of such CVD, can be detected by various non-invasive imaging modalities such as magnetic resonance imaging (MRI), computer tomography (CT), and ultrasound (US). Characterization and classification of carotid plaque-type in these imaging modalities, especially into symptomatic and asymptomatic plaque, helps in the planning of carotid endarterectomy or stenting. It can be challenging to characterize plaque components due to (I) partial volume effect in magnetic resonance imaging (MRI) or (II) varying Hausdorff values in plaque regions in CT, and (III) attenuation of echoes reflected by the plaque during US causing acoustic shadowing. Artificial intelligence (AI) methods have become an indispensable part of healthcare and their applications to the non-invasive imaging technologies such as MRI, CT, and the US. In this narrative review, three main types of AI models (machine learning, deep learning, and transfer learning) are analyzed when applied to MRI, CT, and the US. A link between carotid plaque characteristics and the risk of coronary artery disease is presented. With regard to characterization, we review tools and techniques that use AI models to distinguish carotid plaque types based on signal processing and feature strengths. We conclude that AI-based solutions offer an accurate and robust path for tissue characterization and classification for carotid artery plaque imaging in all three imaging modalities. Due to cost, user-friendliness, and clinical effectiveness, AI in the US has dominated the most.

Artificial intelligence in dermatology and healthcare: An overview

Many aspects of our life are affected by technology. One of the most discussed advancements of modern technologies is artificial intelligence. It involves computational methods which in some way mimic the human thought process. Just like other branches, the medical field also has come under the ambit of artificial intelligence. Almost every field in medicine has been touched by its effect in one way or the other. Prominent among them are medical diagnosis, medical statistics, robotics, and human biology. Medical imaging is one of the foremost specialties with artificial intelligence applications, wherein deep learning methods like artificial neural networks are commonly used. artificial intelligence application in dermatology was initially restricted to the analysis of melanoma and pigmentary skin lesions, has now expanded and covers many dermatoses. Though the applications of artificial intelligence are ever increasing, large data requirements, interpretation of data and ethical concerns are some of its limitations in the present day.

Machine Learning Applications in the Evaluation and Management of Psoriasis: A Systematic Review

Background

Machine learning (ML), a subset of artificial intelligence (AI) that aims to teach machines to automatically learn tasks by inferring patterns from data, holds significant promise to aid psoriasis care. Applications include evaluation of skin images for screening and diagnosis as well as clinical management including treatment and complication prediction.

Objective

To summarize literature on ML applications to psoriasis evaluation and management and to discuss challenges and opportunities for future advances.

Methods

We searched MEDLINE, Google Scholar, ACM Digital Library, and IEEE Xplore for peer-reviewed publications published in English through December 1, 2019. Our search queries identified publications with any of the 10 computing-related keywords and "psoriasis" in the title and/or abstract.

Results

Thirty-three studies were identified. Articles were organized by topic and synthesized as evaluation- or management-focused articles covering 5 content categories: (A) Evaluation using skin images: (1) identification and differential diagnosis of psoriasis lesions, (2) lesion segmentation, and (3) lesion severity and area scoring; (B) clinical management: (1) prediction of complications and (2) treatment.

Conclusion

Machine learning has significant potential to aid psoriasis evaluation and management. Current topics popular in ML research on psoriasis are the evaluation of medical images, prediction of complications, and treatment discovery. For patients to derive the greatest benefit from ML advancements, it is helpful for dermatologists to have an understanding of ML and how it can effectively aid their assessments and decision-making.

A Novel Convolutional Neural Network for the Diagnosis and Classification of Rosacea: Usability Study

BACKGROUND

Rosacea is a chronic inflammatory disease with variable clinical presentations, including transient flushing, fixed erythema, papules, pustules, and phymatous changes on the central face. Owing to the diversity in the clinical manifestations of rosacea, the lack of objective biochemical examinations, and nonspecificity in histopathological findings, accurate identification of rosacea is a big challenge. Artificial intelligence has emerged as a potential tool in the identification and evaluation of some skin diseases such as melanoma, basal cell carcinoma, and psoriasis.

OBJECTIVE

The objective of our study was to utilize a convolutional neural network (CNN) to differentiate the clinical photos of patients with rosacea (taken from 3 different angles) from those of patients with other skin diseases such as acne, seborrheic dermatitis, and eczema that could be easily confused with rosacea.

METHODS

In this study, 24,736 photos comprising of 18,647 photos of patients with rosacea and 6089 photos of patients with other skin diseases such as acne, facial seborrheic dermatitis, and eczema were included and analyzed by our CNN model based on ResNet-50.

RESULTS

The CNN in our study achieved an overall accuracy and precision of 0.914 and 0.898, with an area under the receiver operating characteristic curve of 0.972 for the detection of rosacea. The accuracy of classifying 3 subtypes of rosacea, that is, erythematotelangiectatic rosacea, papulopustular rosacea, and phymatous rosacea was 83.9%, 74.3%, and 80.0%, respectively. Moreover, the accuracy and precision of our CNN to distinguish rosacea from acne reached 0.931 and 0.893, respectively. For the differentiation between rosacea, seborrheic dermatitis, and eczema, the overall accuracy of our CNN was 0.757 and the precision was 0.667. Finally, by comparing the CNN diagnosis with the diagnoses by dermatologists of different expertise levels, we found that our CNN system is capable of identifying rosacea with a performance superior to that of resident doctors or attending physicians and comparable to that of experienced dermatologists.

CONCLUSIONS

The findings of our study showed that by assessing clinical images, the CNN system in our study could identify rosacea with accuracy and precision comparable to that of an experienced dermatologist.

A narrative review on characterization of acute respiratory distress syndrome in COVID-19-infected lungs using artificial intelligence

COVID-19 has infected 77.4 million people worldwide and has caused 1.7 million fatalities as of December 21, 2020. The primary cause of death due to COVID-19 is Acute Respiratory Distress Syndrome (ARDS). According to the World Health Organization (WHO), people who are at least 60 years old or have comorbidities that have primarily been targeted are at the highest risk from SARS-CoV-2. Medical imaging provides a non-invasive, touch-free, and relatively safer alternative tool for diagnosis during the current ongoing pandemic. Artificial intelligence (AI) scientists are developing several intelligent computer-aided diagnosis (CAD) tools in multiple imaging modalities, i.e., lung computed tomography (CT), chest X-rays, and lung ultrasounds. These AI tools assist the pulmonary and critical care clinicians through (a) faster detection of the presence of a virus, (b) classifying pneumonia types, and (c) measuring the severity of viral damage in COVID-19-infected patients. Thus, it is of the utmost importance to fully understand the requirements of for a fast and successful, and timely lung scans analysis. This narrative review first presents the pathological layout of the lungs in the COVID-19 scenario, followed by understanding and then explains the comorbid statistical distributions in the ARDS framework. The novelty of this review is the approach to classifying the AI models as per the by school of thought (SoTs), exhibiting based on segregation of techniques and their characteristics. The study also discusses the identification of AI models and its extension from non-ARDS lungs (pre-COVID-19) to ARDS lungs (post-COVID-19). Furthermore, it also presents AI workflow considerations of for medical imaging modalities in the COVID-19 framework. Finally, clinical AI design considerations will be discussed. We conclude that the design of the current existing AI models can be improved by considering comorbidity as an independent factor. Furthermore, ARDS post-processing clinical systems must involve include (i) the clinical validation and verification of AI-models, (ii) reliability and stability criteria, and (iii) easily adaptable, and (iv) generalization assessments of AI systems for their use in pulmonary, critical care, and radiological settings.

Wilson disease tissue classification and characterization using seven artificial intelligence models embedded with 3D optimization paradigm on a weak training brain magnetic resonance imaging datasets: a supercomputer application

Wilson's disease (WD) is caused by copper accumulation in the brain and liver, and if not treated early, can lead to severe disability and death. WD has shown white matter hyperintensity (WMH) in the brain magnetic resonance scans (MRI) scans, but the diagnosis is challenging due to (i) subtle intensity changes and (ii) weak training MRI when using artificial intelligence (AI). Design and validate seven types of high-performing AI-based computer-aided design (CADx) systems consisting of 3D optimized classification, and characterization of WD against controls. We propose a "conventional deep convolution neural network" (cDCNN) and an "improved DCNN" (iDCNN) where rectified linear unit (ReLU) activation function was modified ensuring "differentiable at zero." Three-dimensional optimization was achieved by recording accuracy while changing the CNN layers and augmentation by several folds. WD was characterized using (i) CNN-based feature map strength and (ii) Bispectrum strengths of pixels having higher probabilities of WD. We further computed the (a) area under the curve (AUC), (b) diagnostic odds ratio (DOR), (c) reliability, and (d) stability and (e) benchmarking. Optimal results were achieved using 9 layers of CNN, with 4-fold augmentation. iDCNN yields superior performance compared to cDCNN with accuracy and AUC of 98.28 ± 1.55, 0.99 (p < 0.0001), and 97.19 ± 2.53%, 0.984 (p < 0.0001), respectively. DOR of iDCNN outperformed cDCNN fourfold. iDCNN also outperformed (a) transfer learning-based "Inception V3" paradigm by 11.92% and (b) four types of "conventional machine learning-based systems": k-NN, decision tree, support vector machine, and random forest by 55.13%, 28.36%, 15.35%, and 14.11%, respectively. The AI-based systems can potentially be useful in the early WD diagnosis. Graphical Abstract.

A Novel Block Imaging Technique Using Nine Artificial Intelligence Models for COVID-19 Disease Classification, Characterization and Severity Measurement in Lung Computed Tomography Scans on an Italian Cohort

Computer Tomography (CT) is currently being adapted for visualization of COVID-19 lung damage. Manual classification and characterization of COVID-19 may be biased depending on the expert's opinion. Artificial Intelligence has recently penetrated COVID-19, especially deep learning paradigms. There are nine kinds of classification systems in this study, namely one deep learning-based CNN, five kinds of transfer learning (TL) systems namely VGG16, DenseNet121, DenseNet169, DenseNet201 and MobileNet, three kinds of machine-learning (ML) systems, namely artificial neural network (ANN), decision tree (DT), and random forest (RF) that have been designed for classification of COVID-19 segmented CT lung against Controls. Three kinds of characterization systems were developed namely (a) Block imaging for COVID-19 severity index (CSI); (b) Bispectrum analysis; and (c) Block Entropy. A cohort of Italian patients with 30 controls (990 slices) and 30 COVID-19 patients (705 slices) was used to test the performance of three types of classifiers. Using K10 protocol (90% training and 10% testing), the best accuracy and AUC was for DCNN and RF pairs were 99.41 ± 5.12%, 0.991 (p < 0.0001), and 99.41 ± 0.62%, 0.988 (p < 0.0001), respectively, followed by other ML and TL classifiers. We show that diagnostics odds ratio (DOR) was higher for DL compared to ML, and both, Bispecturm and Block Entropy shows higher values for COVID-19 patients. CSI shows an association with Ground Glass Opacities (0.9146, p < 0.0001). Our hypothesis holds true that deep learning shows superior performance compared to machine learning models. Block imaging is a powerful novel approach for pinpointing COVID-19 severity and is clinically validated.

Machine learning in primary care: potential to improve public health

It is estimated that missed opportunities for diagnosis occur in 1 in 20 primary care appointments. This is not only detrimental to individual patients, but also to the healthcare system as health outcomes are affected and healthcare expenditure inevitably increases. There are many potential solutions to limit the number of missed opportunities for diagnosis and management, one of which is through the use of artificial intelligence. Artificial intelligence and machine learning research and capabilities have exponentially grown in the past decades, with their applications in medicine showing great promise. As such, this review aims to discuss the possible uses of machine learning in primary care to maximise the quality of care provided.