1
|
Han G, Guo W, Zhang H, Jin J, Gan X, Zhao X. Sample self-selection using dual teacher networks for pathological image classification with noisy labels. Comput Biol Med 2024; 174:108489. [PMID: 38640633 DOI: 10.1016/j.compbiomed.2024.108489] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2023] [Revised: 04/02/2024] [Accepted: 04/15/2024] [Indexed: 04/21/2024]
Abstract
Deep neural networks (DNNs) involve advanced image processing but depend on large quantities of high-quality labeled data. The presence of noisy data significantly degrades the DNN model performance. In the medical field, where model accuracy is crucial and labels for pathological images are scarce and expensive to obtain, the need to handle noisy data is even more urgent. Deep networks exhibit a memorization effect, they tend to prioritize remembering clean labels initially. Therefore, early stopping is highly effective in managing learning with noisy labels. Previous research has often concentrated on developing robust loss functions or implementing training constraints to mitigate the impact of noisy labels; however, such approaches have frequently resulted in underfitting. We propose using knowledge distillation to slow the learning process of the target network rather than preventing late-stage training from being affected by noisy labels. In this paper, we introduce a data sample self-selection strategy based on early stopping to filter out most of the noisy data. Additionally, we employ the distillation training method with dual teacher networks to ensure the steady learning of the student network. The experimental results show that our method outperforms current state-of-the-art methods for handling noisy labels on both synthetic and real-world noisy datasets. In particular, on the real-world pathological image dataset Chaoyang, the highest classification accuracy increased by 2.39 %. Our method leverages the model's predictions based on training history to select cleaner datasets and retrains them using these cleaner datasets, significantly mitigating the impact of noisy labels on model performance.
Collapse
Affiliation(s)
- Gang Han
- School of Information and Electronic Engineering, Zhejiang University of Science and Technology, Hangzhou 310023, China; School of Electronic and Information Engineering, Taizhou University, Taizhou 318000, China
| | - Wenping Guo
- School of Electronic and Information Engineering, Taizhou University, Taizhou 318000, China.
| | - Haibo Zhang
- School of Electronic and Information Engineering, Taizhou University, Taizhou 318000, China
| | - Jie Jin
- School of Electronic and Information Engineering, Taizhou University, Taizhou 318000, China
| | - Xingli Gan
- School of Information and Electronic Engineering, Zhejiang University of Science and Technology, Hangzhou 310023, China
| | - Xiaoming Zhao
- School of Electronic and Information Engineering, Taizhou University, Taizhou 318000, China
| |
Collapse
|
2
|
Williams KS. Evaluations of artificial intelligence and machine learning algorithms in neurodiagnostics. J Neurophysiol 2024; 131:825-831. [PMID: 38533950 DOI: 10.1152/jn.00404.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2023] [Revised: 03/05/2024] [Accepted: 03/24/2024] [Indexed: 03/28/2024] Open
Abstract
This article evaluates the ethical implications of utilizing artificial intelligence (AI) algorithms in neurological diagnostic examinations. Applications of AI technology have been utilized to aid in the determination of pharmacological dosages of gadolinium for brain lesion detection, localization of seizure foci, and the characterization of large vessel occlusion in ischemic stroke patients. Multiple subtypes of AI/machine learning (ML) algorithms are analyzed, as AI-assisted neurology utilizes supervised, unsupervised, artificial neural network (ANN), and deep neural network (DNN) learning models. As ANN and DNN analyses can be applied to data with an unknown clinical diagnosis, these algorithms are evaluated according to Bayesian statistical analyses. Bayesian neural network analyses are incorporated, as these algorithms indicate that the predictive accuracy and model performance are dependent upon accurate configurations of the model's hyperparameters and neural inputs. Thus, mathematical evaluations of AI algorithms are comprehensively explored to examine their clinical utility, as underperformance of AI/ML models may have deleterious consequences that affect patient outcomes due to misdiagnosis and false-negative test results.
Collapse
|
3
|
Prinzi F, Currieri T, Gaglio S, Vitabile S. Shallow and deep learning classifiers in medical image analysis. Eur Radiol Exp 2024; 8:26. [PMID: 38438821 PMCID: PMC10912073 DOI: 10.1186/s41747-024-00428-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2023] [Accepted: 01/03/2024] [Indexed: 03/06/2024] Open
Abstract
An increasingly strong connection between artificial intelligence and medicine has enabled the development of predictive models capable of supporting physicians' decision-making. Artificial intelligence encompasses much more than machine learning, which nevertheless is its most cited and used sub-branch in the last decade. Since most clinical problems can be modeled through machine learning classifiers, it is essential to discuss their main elements. This review aims to give primary educational insights on the most accessible and widely employed classifiers in radiology field, distinguishing between "shallow" learning (i.e., traditional machine learning) algorithms, including support vector machines, random forest and XGBoost, and "deep" learning architectures including convolutional neural networks and vision transformers. In addition, the paper outlines the key steps for classifiers training and highlights the differences between the most common algorithms and architectures. Although the choice of an algorithm depends on the task and dataset dealing with, general guidelines for classifier selection are proposed in relation to task analysis, dataset size, explainability requirements, and available computing resources. Considering the enormous interest in these innovative models and architectures, the problem of machine learning algorithms interpretability is finally discussed, providing a future perspective on trustworthy artificial intelligence.Relevance statement The growing synergy between artificial intelligence and medicine fosters predictive models aiding physicians. Machine learning classifiers, from shallow learning to deep learning, are offering crucial insights for the development of clinical decision support systems in healthcare. Explainability is a key feature of models that leads systems toward integration into clinical practice. Key points • Training a shallow classifier requires extracting disease-related features from region of interests (e.g., radiomics).• Deep classifiers implement automatic feature extraction and classification.• The classifier selection is based on data and computational resources availability, task, and explanation needs.
Collapse
Affiliation(s)
- Francesco Prinzi
- Department of Biomedicine, Neuroscience and Advanced Diagnostics (BiND), University of Palermo, Palermo, Italy
- Department of Computer Science and Technology, University of Cambridge, Cambridge, CB2 1TN, UK
| | - Tiziana Currieri
- Department of Biomedicine, Neuroscience and Advanced Diagnostics (BiND), University of Palermo, Palermo, Italy
| | - Salvatore Gaglio
- Department of Engineering, University of Palermo, Palermo, Italy
- Institute for High-Performance Computing and Networking, National Research Council (ICAR-CNR), Palermo, Italy
| | - Salvatore Vitabile
- Department of Biomedicine, Neuroscience and Advanced Diagnostics (BiND), University of Palermo, Palermo, Italy.
| |
Collapse
|
4
|
Veeramani N, Jayaraman P, Krishankumar R, Ravichandran KS, Gandomi AH. DDCNN-F: double decker convolutional neural network 'F' feature fusion as a medical image classification framework. Sci Rep 2024; 14:676. [PMID: 38182607 PMCID: PMC10770172 DOI: 10.1038/s41598-023-49721-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2023] [Accepted: 12/11/2023] [Indexed: 01/07/2024] Open
Abstract
Melanoma is a severe skin cancer that involves abnormal cell development. This study aims to provide a new feature fusion framework for melanoma classification that includes a novel 'F' Flag feature for early detection. This novel 'F' indicator efficiently distinguishes benign skin lesions from malignant ones known as melanoma. The article proposes an architecture that is built in a Double Decker Convolutional Neural Network called DDCNN future fusion. The network's deck one, known as a Convolutional Neural Network (CNN), finds difficult-to-classify hairy images using a confidence factor termed the intra-class variance score. These hirsute image samples are combined to form a Baseline Separated Channel (BSC). By eliminating hair and using data augmentation techniques, the BSC is ready for analysis. The network's second deck trains the pre-processed BSC and generates bottleneck features. The bottleneck features are merged with features generated from the ABCDE clinical bio indicators to promote classification accuracy. Different types of classifiers are fed to the resulting hybrid fused features with the novel 'F' Flag feature. The proposed system was trained using the ISIC 2019 and ISIC 2020 datasets to assess its performance. The empirical findings expose that the DDCNN feature fusion strategy for exposing malignant melanoma achieved a specificity of 98.4%, accuracy of 93.75%, precision of 98.56%, and Area Under Curve (AUC) value of 0.98. This study proposes a novel approach that can accurately identify and diagnose fatal skin cancer and outperform other state-of-the-art techniques, which is attributed to the DDCNN 'F' Feature fusion framework. Also, this research ascertained improvements in several classifiers when utilising the 'F' indicator, resulting in the highest specificity of + 7.34%.
Collapse
Affiliation(s)
- Nirmala Veeramani
- School of Computing, SASTRA Deemed to Be University, Thanjavur, India
| | | | - Raghunathan Krishankumar
- Information Technology Systems and Analytics Area, Indian Institute of Management Bodh Gaya, Bodh Gaya, Bihar, 824234, India
| | | | - Amir H Gandomi
- Faculty of Engineering and Information Technology, University of Technology Sydney, Ultimo, NSW, Australia.
- University Research and Innovation Center (EKIK), Obuda University, Buddapest, Hungary.
| |
Collapse
|
5
|
Brutti F, La Rosa F, Lazzeri L, Benvenuti C, Bagnoni G, Massi D, Laurino M. Artificial Intelligence Algorithms for Benign vs. Malignant Dermoscopic Skin Lesion Image Classification. Bioengineering (Basel) 2023; 10:1322. [PMID: 38002446 PMCID: PMC10669580 DOI: 10.3390/bioengineering10111322] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2023] [Revised: 11/13/2023] [Accepted: 11/14/2023] [Indexed: 11/26/2023] Open
Abstract
In recent decades, the incidence of melanoma has grown rapidly. Hence, early diagnosis is crucial to improving clinical outcomes. Here, we propose and compare a classical image analysis-based machine learning method with a deep learning one to automatically classify benign vs. malignant dermoscopic skin lesion images. The same dataset of 25,122 publicly available dermoscopic images was used to train both models, while a disjointed test set of 200 images was used for the evaluation phase. The training dataset was randomly divided into 10 datasets of 19,932 images to obtain an equal distribution between the two classes. By testing both models on the disjoint set, the deep learning-based method returned accuracy of 85.4 ± 3.2% and specificity of 75.5 ± 7.6%, while the machine learning one showed accuracy and specificity of 73.8 ± 1.1% and 44.5 ± 4.7%, respectively. Although both approaches performed well in the validation phase, the convolutional neural network outperformed the ensemble boosted tree classifier on the disjoint test set, showing better generalization ability. The integration of new melanoma detection algorithms with digital dermoscopic devices could enable a faster screening of the population, improve patient management, and achieve better survival rates.
Collapse
Affiliation(s)
- Francesca Brutti
- Institute of Clinical Physiology, National Research Council, 56124 Pisa, Italy; (F.B.); (F.L.R.); (C.B.)
| | - Federica La Rosa
- Institute of Clinical Physiology, National Research Council, 56124 Pisa, Italy; (F.B.); (F.L.R.); (C.B.)
| | - Linda Lazzeri
- Uniti of Dermatologia, Specialist Surgery Area, Department of General Surgery, Livorno Hospital, Azienda Usl Toscana Nord Ovest, 57124 Livorno, Italy; (L.L.); (G.B.)
| | - Chiara Benvenuti
- Institute of Clinical Physiology, National Research Council, 56124 Pisa, Italy; (F.B.); (F.L.R.); (C.B.)
| | - Giovanni Bagnoni
- Uniti of Dermatologia, Specialist Surgery Area, Department of General Surgery, Livorno Hospital, Azienda Usl Toscana Nord Ovest, 57124 Livorno, Italy; (L.L.); (G.B.)
| | - Daniela Massi
- Department of Health Sciences, Section of Pathological Anatomy, University of Florence, 50139 Florence, Italy;
| | - Marco Laurino
- Institute of Clinical Physiology, National Research Council, 56124 Pisa, Italy; (F.B.); (F.L.R.); (C.B.)
| |
Collapse
|
6
|
Sengupta D. Artificial Intelligence in Diagnostic Dermatology: Challenges and the Way Forward. Indian Dermatol Online J 2023; 14:782-787. [PMID: 38099026 PMCID: PMC10718130 DOI: 10.4103/idoj.idoj_462_23] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2023] [Revised: 08/07/2023] [Accepted: 08/17/2023] [Indexed: 12/17/2023] Open
Abstract
Artificial Intelligence (AI) has emerged as a transformative force in the field of diagnostic dermatology, offering unprecedented capabilities in image recognition and data analysis. Despite its promise, the integration of AI into clinical practice faces multifaceted challenges that span technical, ethical, and regulatory domains. This article provides a narrative overview of the current state of AI in dermatology, tracing its historical evolution from early diagnostic tools to contemporary hybrid supervised models. We identify and categorize six critical challenges: data quality and quantity, algorithmic development and explainability, ethical considerations, clinical workflow integration, regulatory frameworks, and stakeholder collaboration. Each challenge is dissected from the perspectives of academia, industry, and healthcare providers, offering actionable recommendations for future research and implementation. We also highlight the paradigm shift in AI research, emphasizing the potential of transformer architectures in revolutionizing diagnostic methodologies. By addressing the challenges and harnessing the latest advancements, AI has the potential to significantly impact diagnostic accuracy and patient outcomes in dermatology.
Collapse
Affiliation(s)
- Dipayan Sengupta
- Consultant Dermatologist, Euro Skin Cliniq, Kolkata, West Bengal, India
| |
Collapse
|
7
|
Li H, Zhang P, Wei Z, Qian T, Tang Y, Hu K, Huang X, Xia X, Zhang Y, Cheng H, Yu F, Zhang W, Dan K, Liu X, Ye S, He G, Jiang X, Liu L, Fan Y, Song T, Zhou G, Wang Z, Zhang D, Lv J. Deep skin diseases diagnostic system with Dual-channel Image and Extracted Text. Front Artif Intell 2023; 6:1213620. [PMID: 37928449 PMCID: PMC10620802 DOI: 10.3389/frai.2023.1213620] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2023] [Accepted: 09/12/2023] [Indexed: 11/07/2023] Open
Abstract
Background Due to the lower reliability of laboratory tests, skin diseases are more suitable for diagnosis with AI models. There are limited AI dermatology diagnostic models combining images and text; few of these are for Asian populations, and few cover the most common types of diseases. Methods Leveraging a dataset sourced from Asia comprising over 200,000 images and 220,000 medical records, we explored a deep learning-based system for Dual-channel images and extracted text for the diagnosis of skin diseases model DIET-AI to diagnose 31 skin diseases, which covers the majority of common skin diseases. From 1 September to 1 December 2021, we prospectively collected images from 6,043 cases and medical records from 15 hospitals in seven provinces in China. Then the performance of DIET-AI was compared with that of six doctors of different seniorities in the clinical dataset. Results The average performance of DIET-AI in 31 diseases was not less than that of all the doctors of different seniorities. By comparing the area under the curve, sensitivity, and specificity, we demonstrate that the DIET-AI model is effective in clinical scenarios. In addition, medical records affect the performance of DIET-AI and physicians to varying degrees. Conclusion This is the largest dermatological dataset for the Chinese demographic. For the first time, we built a Dual-channel image classification model on a non-cancer dermatitis dataset with both images and medical records and achieved comparable diagnostic performance to senior doctors about common skin diseases. It provides references for exploring the feasibility and performance evaluation of DIET-AI in clinical use afterward.
Collapse
Affiliation(s)
- Huanyu Li
- The Third Affiliated Hospital of Chongqing Medical University (CQMU), Chongqing, China
- Shanghai Botanee Bio-technology AI Lab, Shanghai, China
| | - Peng Zhang
- School of Medicine, Shanghai University, Shanghai, China
| | - Zikun Wei
- Shanghai Botanee Bio-technology AI Lab, Shanghai, China
| | - Tian Qian
- The Third Affiliated Hospital of Chongqing Medical University (CQMU), Chongqing, China
| | - Yiqi Tang
- Shanghai Botanee Bio-technology AI Lab, Shanghai, China
| | - Kun Hu
- Shanghai Botanee Bio-technology AI Lab, Shanghai, China
| | - Xianqiong Huang
- Department of Dermatology, Army Medical Center, Chongqing, China
| | - Xinxin Xia
- School of Public Health, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Pokfulam, Hong Kong SAR, China
| | - Yishuang Zhang
- School of Pharmacy, East China University of Science and Technology, Shanghai, China
| | - Haixing Cheng
- The Third Affiliated Hospital of Chongqing Medical University (CQMU), Chongqing, China
| | - Fubing Yu
- The Third Affiliated Hospital of Chongqing Medical University (CQMU), Chongqing, China
| | - Wenjia Zhang
- Shanghai Botanee Bio-technology AI Lab, Shanghai, China
| | - Kena Dan
- The Third Affiliated Hospital of Chongqing Medical University (CQMU), Chongqing, China
| | - Xuan Liu
- Faculty of Science, The University of Sydney, Sydney, NSW, Australia
| | - Shujun Ye
- Faculty of Science, The University of Melbourne, Parkville, VIC, Australia
| | - Guangqiao He
- The Third Affiliated Hospital of Chongqing Medical University (CQMU), Chongqing, China
| | - Xia Jiang
- The Third Affiliated Hospital of Chongqing Medical University (CQMU), Chongqing, China
| | - Liwei Liu
- Chongqing Shapingba District People's Hospital, Chongqing, China
| | - Yukun Fan
- The Third Affiliated Hospital of Chongqing Medical University (CQMU), Chongqing, China
| | - Tingting Song
- The Third Affiliated Hospital of Chongqing Medical University (CQMU), Chongqing, China
| | - Guomin Zhou
- Shanghai Medical College, Fudan University, Shanghai, China
| | - Ziyi Wang
- Huazhong Agricultural University, Wuhan, Hubei, China
| | - Daojun Zhang
- The Third Affiliated Hospital of Chongqing Medical University (CQMU), Chongqing, China
| | - Junwei Lv
- Shanghai Botanee Bio-technology AI Lab, Shanghai, China
| |
Collapse
|
8
|
Tian C, Xu Y, Zhang Y, Zhang Z, An H, Liu Y, Chen Y, Zhao H, Zhang Z, Zhao Q, Li W. Combining hyperspectral imaging techniques with deep learning to aid in early pathological diagnosis of melanoma. Photodiagnosis Photodyn Ther 2023; 43:103708. [PMID: 37482369 DOI: 10.1016/j.pdpdt.2023.103708] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2023] [Revised: 07/11/2023] [Accepted: 07/14/2023] [Indexed: 07/25/2023]
Abstract
BACKGROUND Cutaneous melanoma, an exceedingly aggressive form of skin cancer, holds the top rank in both malignancy and mortality among skin cancers. In early stages, distinguishing malignant melanomas from benign pigmented nevi pathologically becomes a significant challenge due to their indistinguishable traits. Traditional skin histological examination techniques, largely reliant on light microscopic imagery, offer constrained information and yield low-contrast results, underscoring the necessity for swift and effective early diagnostic methodologies. As a non-contact, non-ionizing, and label-free imaging tool, hyperspectral imaging offers potential in assisting pathologists with identification procedures sans contrast agents. METHODS This investigation leverages hyperspectral cameras to ascertain the optical properties and to capture the spectral features of malignant melanoma and pigmented nevus tissues, intending to facilitate early pathological diagnostic applications. We further enhance the diagnostic process by integrating transfer learning with deep convolutional networks to classify melanomas and pigmented nevi in hyperspectral pathology images. The study encompasses pathological sections from 50 melanoma and 50 pigmented nevus patients. To accurately represent the spectral variances between different tissues, we employed reflectance calibration, highlighting that the most distinctive spectral differences emerged within the 500-675 nm band range. RESULTS The classification accuracy of pigmented tumors and pigmented nevi was 89% for one-dimensional sample data and 98% for two-dimensional sample data. CONCLUSIONS Our findings have the potential to expedite pathological diagnoses, enhance diagnostic precision, and offer novel research perspectives in differentiating melanoma and nevus.
Collapse
Affiliation(s)
- Chongxuan Tian
- School of Control Science and Engineering, Shandong University, Jinan, Shandong, 250061, China
| | - Yanjing Xu
- The Affiliated Qingdao Central Hospital of Qingdao University, Qingdao, Shandong, 266042, China
| | - Yanbing Zhang
- School of Control Science and Engineering, Shandong University, Jinan, Shandong, 250061, China
| | - Zhenlei Zhang
- School of Control Science and Engineering, Shandong University, Jinan, Shandong, 250061, China
| | - Haoyuan An
- School of Control Science and Engineering, Shandong University, Jinan, Shandong, 250061, China
| | - Yelin Liu
- Zolix Instruments Co. Ltd., 16 Huanke Middle Road, Tongzhou District, Beijing 101102, China
| | - Yuzhuo Chen
- School of Control Science and Engineering, Shandong University, Jinan, Shandong, 250061, China
| | - Hanzhu Zhao
- School of Control Science and Engineering, Shandong University, Jinan, Shandong, 250061, China
| | - Zhenyu Zhang
- Shandong Cancer Hospital, Shandong First Medical University and Shandong Academy of Medical Sciences, China
| | - Qi Zhao
- Department of Burn and Plastic surgery, Qilu hospital of Shandong University, Jinan, Shandong, 250012, China.
| | - Wei Li
- School of Control Science and Engineering, Shandong University, Jinan, Shandong, 250061, China.
| |
Collapse
|
9
|
Elshahawy M, Elnemr A, Oproescu M, Schiopu AG, Elgarayhi A, Elmogy MM, Sallah M. Early Melanoma Detection Based on a Hybrid YOLOv5 and ResNet Technique. Diagnostics (Basel) 2023; 13:2804. [PMID: 37685342 PMCID: PMC10486497 DOI: 10.3390/diagnostics13172804] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2023] [Revised: 08/11/2023] [Accepted: 08/22/2023] [Indexed: 09/10/2023] Open
Abstract
Skin cancer, specifically melanoma, is a serious health issue that arises from the melanocytes, the cells that produce melanin, the pigment responsible for skin color. With skin cancer on the rise, the timely identification of skin lesions is crucial for effective treatment. However, the similarity between some skin lesions can result in misclassification, which is a significant problem. It is important to note that benign skin lesions are more prevalent than malignant ones, which can lead to overly cautious algorithms and incorrect results. As a solution, researchers are developing computer-assisted diagnostic tools to detect malignant tumors early. First, a new model based on the combination of "you only look once" (YOLOv5) and "ResNet50" is proposed for melanoma detection with its degree using humans against a machine with 10,000 training images (HAM10000). Second, feature maps integrate gradient change, which allows rapid inference, boosts precision, and reduces the number of hyperparameters in the model, making it smaller. Finally, the current YOLOv5 model is changed to obtain the desired outcomes by adding new classes for dermatoscopic images of typical lesions with pigmented skin. The proposed approach improves melanoma detection with a real-time speed of 0.4 MS of non-maximum suppression (NMS) per image. The performance metrics average is 99.0%, 98.6%, 98.8%, 99.5, 98.3%, and 98.7% for the precision, recall, dice similarity coefficient (DSC), accuracy, mean average precision (MAP) from 0.0 to 0.5, and MAP from 0.5 to 0.95, respectively. Compared to current melanoma detection approaches, the provided approach is more efficient in using deep features.
Collapse
Affiliation(s)
- Manar Elshahawy
- Information Technology Department, Faculty of Computers and Information, Mansoura University, Mansoura 35516, Egypt;
| | - Ahmed Elnemr
- Applied Mathematical Physics Research Group, Physics Department, Faculty of Science, Mansoura University, Mansoura 35516, Egypt; (A.E.); (A.E.)
| | - Mihai Oproescu
- Faculty of Electronics, Communication, and Computer Science, University of Pitesti, 110040 Pitesti, Romania
| | - Adriana-Gabriela Schiopu
- Department of Manufacturing and Industrial Management, Faculty of Mechanics and Technology, University of Pitesti, 110040 Pitesti, Romania;
| | - Ahmed Elgarayhi
- Applied Mathematical Physics Research Group, Physics Department, Faculty of Science, Mansoura University, Mansoura 35516, Egypt; (A.E.); (A.E.)
| | - Mohammed M. Elmogy
- Information Technology Department, Faculty of Computers and Information, Mansoura University, Mansoura 35516, Egypt;
| | - Mohammed Sallah
- Department of Physics, College of Sciences, University of Bisha, P.O. Box 344, Bisha 61922, Saudi Arabia;
| |
Collapse
|
10
|
Lee H, Lee Y, Jung SW, Lee S, Oh B, Yang S. Deep Learning-Based Evaluation of Ultrasound Images for Benign Skin Tumors. SENSORS (BASEL, SWITZERLAND) 2023; 23:7374. [PMID: 37687830 PMCID: PMC10490539 DOI: 10.3390/s23177374] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/19/2023] [Revised: 08/07/2023] [Accepted: 08/22/2023] [Indexed: 09/10/2023]
Abstract
In this study, a combined convolutional neural network for the diagnosis of three benign skin tumors was designed, and its effectiveness was verified through quantitative and statistical analysis. To this end, 698 sonographic images were taken and diagnosed at the Department of Dermatology at Severance Hospital in Seoul, Korea, between 10 November 2017 and 17 January 2020. Through an empirical process, a convolutional neural network combining two structures, which consist of a residual structure and an attention-gated structure, was designed. Five-fold cross-validation was applied, and the train set for each fold was augmented by the Fast AutoAugment technique. As a result of training, for three benign skin tumors, an average accuracy of 95.87%, an average sensitivity of 90.10%, and an average specificity of 96.23% were derived. Also, through statistical analysis using a class activation map and physicians' findings, it was found that the judgment criteria of physicians and the trained combined convolutional neural network were similar. This study suggests that the model designed and trained in this study can be a diagnostic aid to assist physicians and enable more efficient and accurate diagnoses.
Collapse
Affiliation(s)
- Hyunwoo Lee
- Department of Biomedical Engineering, Yonsei University, Wonju 26493, Republic of Korea
| | - Yerin Lee
- Department of Precision Medicine, Yonsei University Wonju College of Medicine, Wonju 26426, Republic of Korea
| | - Seung-Won Jung
- Department of Dermatology, Yonsei University Wonju College of Medicine, Wonju 26426, Republic of Korea
| | - Solam Lee
- Department of Dermatology, Yonsei University Wonju College of Medicine, Wonju 26426, Republic of Korea
| | - Byungho Oh
- Department of Dermatology, Cutaneous Biology Research Institute, Yonsei University College of Medicine, Seoul 03722, Republic of Korea
| | - Sejung Yang
- Department of Precision Medicine, Yonsei University Wonju College of Medicine, Wonju 26426, Republic of Korea
| |
Collapse
|
11
|
Rai HM. Cancer detection and segmentation using machine learning and deep learning techniques: a review. MULTIMEDIA TOOLS AND APPLICATIONS 2023. [DOI: 10.1007/s11042-023-16520-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/16/2022] [Revised: 05/12/2023] [Accepted: 08/13/2023] [Indexed: 09/16/2023]
|
12
|
Kalpana B, Reshmy A, Senthil Pandi S, Dhanasekaran S. OESV-KRF: Optimal ensemble support vector kernel random forest based early detection and classification of skin diseases. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2023.104779] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/30/2023]
|
13
|
Pandey D, Onkara Perumal P. A scoping review on deep learning for next-generation RNA-Seq. data analysis. Funct Integr Genomics 2023; 23:134. [PMID: 37084004 DOI: 10.1007/s10142-023-01064-6] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2022] [Revised: 03/24/2023] [Accepted: 04/17/2023] [Indexed: 04/22/2023]
Abstract
In the last decade, transcriptome research adopting next-generation sequencing (NGS) technologies has gathered incredible momentum amongst functional genomics scientists, particularly amongst clinical/biomedical research groups. The progressive enfoldment/adoption of NGS technologies has incited an abundance of next-generation transcriptomic data harbouring an opulence of new knowledge in public databases. Nevertheless, knowledge discovery from these next-generation RNA-Seq. data analysis necessitates extensive bioinformatics know-how besides elaborate data analysis software packages consistent with the type and context of data analysis. Several reliability and reproducibility concerns continue to impede RNA-Seq. data analysis. Characteristic challenges comprise of data quality, hardware and networking provisions, selection and prioritisation of data analysis tools, and yet significantly implementing of robust machine learning algorithms for maximised exploitation of these experimental transcriptomic data. Over the years, numerous machine learning algorithms have been implemented for improved transcriptomic data analysis executing predominantly shallow learning approaches. More recently, deep learning algorithms are becoming more mainstream, and enactment for next-generation RNA-Seq. data analysis could be revolutionary in the coming years in the biomedical domain. In this scoping review, we attempt to determine the existing literature's size and potential nature in deep learning and NGS RNA-Seq. data analysis. An analysis of the contemporary topics of next-generation RNA-Seq. data analysis based on deep learning algorithms is critically reviewed, emphasising open-source resources.
Collapse
Affiliation(s)
- Diksha Pandey
- Department of Biotechnology, National Institute of Technology, Warangal, Telanga na, 506004, India
| | - P Onkara Perumal
- Department of Biotechnology, National Institute of Technology, Warangal, Telanga na, 506004, India.
| |
Collapse
|
14
|
Dash S, Parida P, Mohanty JR. Illumination robust deep convolutional neural network for medical image classification. Soft comput 2023. [DOI: 10.1007/s00500-023-07918-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/19/2023]
|
15
|
Wavelet-Based Classification of Enhanced Melanoma Skin Lesions through Deep Neural Architectures. INFORMATION 2022. [DOI: 10.3390/info13120583] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
Abstract
In recent years, skin cancer diagnosis has been aided by the most sophisticated and advanced machine learning algorithms, primarily implemented in the spatial domain. In this research work, we concentrated on two crucial phases of a computer-aided diagnosis system: (i) image enhancement through enhanced median filtering algorithms based on the range method, fuzzy relational method, and similarity coefficient, and (ii) wavelet decomposition using DB4, Symlet, RBIO, and extracting seven unique entropy features and eight statistical features from the segmented image. The extracted features were then normalized and provided for classification based on supervised and deep-learning algorithms. The proposed system is comprised of enhanced filtering algorithms, Normalized Otsu’s Segmentation, and wavelet-based entropy. Statistical feature extraction led to a classification accuracy of 93.6%, 0.71% higher than the spatial domain-based classification. With better classification accuracy, the proposed system will assist clinicians and dermatology specialists in identifying skin cancer early in its stages.
Collapse
|
16
|
A Survey on Computer-Aided Intelligent Methods to Identify and Classify Skin Cancer. INFORMATICS 2022. [DOI: 10.3390/informatics9040099] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022] Open
Abstract
Melanoma is one of the skin cancer types that is more dangerous to human society. It easily spreads to other parts of the human body. An early diagnosis is necessary for a higher survival rate. Computer-aided diagnosis (CAD) is suitable for providing precise findings before the critical stage. The computer-aided diagnostic process includes preprocessing, segmentation, feature extraction, and classification. This study discusses the advantages and disadvantages of various computer-aided algorithms. It also discusses the current approaches, problems, and various types of datasets for skin images. Information about possible future works is also highlighted in this paper. The inferences derived from this survey will be useful for researchers carrying out research in skin cancer image analysis.
Collapse
|
17
|
Xia D, Chen G, Wu K, Yu M, Zhang Z, Lu Y, Xu L, Wang Y. Research progress and hotspot of the artificial intelligence application in the ultrasound during 2011-2021: A bibliometric analysis. Front Public Health 2022; 10:990708. [PMID: 36187670 PMCID: PMC9520910 DOI: 10.3389/fpubh.2022.990708] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2022] [Accepted: 08/26/2022] [Indexed: 01/26/2023] Open
Abstract
Ultrasound, as a common clinical examination tool, inevitably has human errors due to the limitations of manual operation. Artificial intelligence is an advanced computer program that can solve this problem. Therefore, the relevant literature on the application of artificial intelligence in the ultrasonic field from 2011 to 2021 was screened by authors from the Web of Science Core Collection, which aims to summarize the trend of artificial intelligence application in the field of ultrasound, meanwhile, visualize and predict research hotspots. A total of 908 publications were included in the study. Overall, the number of global publications is on the rise, and studies on the application of artificial intelligence in the field of ultrasound continue to increase. China has made the largest contribution in this field. In terms of institutions, Fudan University has the most number of publications. Recently, IEEE Access is the most published journal. Suri J. S. published most of the articles and had the highest number of citations in this field (29 articles). It's worth noting that, convolutional neural networks (CNN), as a kind of deep learning algorithm, was considered to bring better image analysis and processing ability in recent most-cited articles. According to the analysis of keywords, the latest keyword is "COVID-19" (2020.8). The co-occurrence analysis of keywords by VOSviewer visually presented four clusters which consisted of "deep learning," "machine learning," "application in the field of visceral organs," and "application in the field of cardiovascular". The latest hot words of these clusters were "COVID-19; neural-network; hepatocellular carcinoma; atherosclerotic plaques". This study reveals the importance of multi-institutional and multi-field collaboration in promoting research progress.
Collapse
Affiliation(s)
- Demeng Xia
- Luodian Clinical Drug Research Center, Shanghai Baoshan Luodian Hospital, Shanghai University, Shanghai, China
| | - Gaoqi Chen
- Department of Pancreatic Hepatobiliary Surgery, Changhai Hospital, Naval Medical University, Shanghai, China
| | - Kaiwen Wu
- Department of Gastroenterology, The Third People's Hospital of Chengdu, The Affiliated Hospital of Southwest Jiaotong University, Chengdu, China
| | - Mengxin Yu
- Department of Ultrasound, Shanghai Pulmonary Hospital, Tongji University School of Medicine, Shanghai, China
| | - Zhentao Zhang
- Department of Clinical Medicine, The Naval Medical University, Shanghai, China
| | - Yixian Lu
- Department of Clinical Medicine, The Naval Medical University, Shanghai, China
| | - Lisha Xu
- Department of Ultrasound, Shanghai Pulmonary Hospital, Tongji University School of Medicine, Shanghai, China,Lisha Xu
| | - Yin Wang
- Department of Ultrasound, Shanghai Pulmonary Hospital, Tongji University School of Medicine, Shanghai, China,*Correspondence: Yin Wang
| |
Collapse
|
18
|
Lee JRH, Pavlova M, Famouri M, Wong A. Cancer-Net SCa: tailored deep neural network designs for detection of skin cancer from dermoscopy images. BMC Med Imaging 2022; 22:143. [PMID: 35945505 PMCID: PMC9364616 DOI: 10.1186/s12880-022-00871-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2021] [Accepted: 07/26/2022] [Indexed: 11/25/2022] Open
Abstract
Background Skin cancer continues to be the most frequently diagnosed form of cancer in the U.S., with not only significant effects on health and well-being but also significant economic costs associated with treatment. A crucial step to the treatment and management of skin cancer is effective early detection with key screening approaches such as dermoscopy examinations, leading to stronger recovery prognoses. Motivated by the advances of deep learning and inspired by the open source initiatives in the research community, in this study we introduce Cancer-Net SCa, a suite of deep neural network designs tailored for the detection of skin cancer from dermoscopy images that is open source and available to the general public. To the best of the authors’ knowledge, Cancer-Net SCa comprises the first machine-driven design of deep neural network architectures tailored specifically for skin cancer detection, one of which leverages attention condensers for an efficient self-attention design. Results We investigate and audit the behaviour of Cancer-Net SCa in a responsible and transparent manner through explainability-driven performance validation. All the proposed designs achieved improved accuracy when compared to the ResNet-50 architecture while also achieving significantly reduced architectural and computational complexity. In addition, when evaluating the decision making process of the networks, it can be seen that diagnostically relevant critical factors are leveraged rather than irrelevant visual indicators and imaging artifacts. Conclusion The proposed Cancer-Net SCa designs achieve strong skin cancer detection performance on the International Skin Imaging Collaboration (ISIC) dataset, while providing a strong balance between computation and architectural efficiency and accuracy. While Cancer-Net SCa is not a production-ready screening solution, the hope is that the release of Cancer-Net SCa in open source, open access form will encourage researchers, clinicians, and citizen data scientists alike to leverage and build upon them.
Collapse
Affiliation(s)
- James Ren Hou Lee
- Vision and Image Processing Research Group, University of Waterloo, Waterloo, Canada.
| | - Maya Pavlova
- Vision and Image Processing Research Group, University of Waterloo, Waterloo, Canada.,DarwinAI Corp, Waterloo, Canada
| | | | - Alexander Wong
- Vision and Image Processing Research Group, University of Waterloo, Waterloo, Canada.,Waterloo Artificial Intelligence Institute, University of Waterloo, Waterloo, Canada.,DarwinAI Corp, Waterloo, Canada
| |
Collapse
|
19
|
DTP-Net: A convolutional neural network model to predict threshold for localizing the lesions on dermatological macro-images. Comput Biol Med 2022; 148:105852. [PMID: 35853397 DOI: 10.1016/j.compbiomed.2022.105852] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2021] [Revised: 05/07/2022] [Accepted: 05/13/2022] [Indexed: 11/22/2022]
Abstract
Highly focused images of skin captured with ordinary cameras, called macro-images, are extensively used in dermatology. Being highly focused views, the macro-images contain only lesions and background regions. Hence, the localization of lesions on the macro-images is a simple thresholding problem. However, algorithms that offer an accurate estimate of threshold and retain consistent performance on different dermatological macro-images are rare. A deep learning model, termed 'Deep Threshold Prediction Network (DTP-Net)', is proposed in this paper to address this issue. For training the model, grayscale versions of the macro-images are fed as input to the model, and the corresponding gray-level threshold values at which the Dice similarity index (DSI) between the segmented and the ground-truth images are maximized are defined as the targets. The DTP-Net exhibited the least value of root mean square error for the predicted threshold, compared with 11 state-of-the-art threshold estimation algorithms (such as Otsu's thresholding, Valley emphasized otsu's thresholding, Isodata thresholding, Histogram slope difference distribution-based thresholding, Minimum error thresholding, Poisson's distribution-based minimum error thresholding, Kapur's maximum entropy thresholding, Entropy-weighted otsu's thresholding, Minimum cross-entropy thresholding, Type-2 fuzzy-based thresholding, and Fuzzy entropy thresholding). The DTP-Net could learn the difference between the lesion and background in the intensity space and accurately predict the threshold that separates the lesion from the background. The proposed DTP-Net can be integrated into the segmentation module in automated tools that detect skin cancer from dermatological macro-images.
Collapse
|
20
|
Venugopal V, Joseph J, Vipin Das M, Kumar Nath M. An EfficientNet-based modified sigmoid transform for enhancing dermatological macro-images of melanoma and nevi skin lesions. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2022; 222:106935. [PMID: 35724474 DOI: 10.1016/j.cmpb.2022.106935] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/15/2022] [Revised: 04/28/2022] [Accepted: 06/03/2022] [Indexed: 06/15/2023]
Abstract
BACKGROUND AND OBJECTIVE During the initial stages, skin lesions may not have sufficient intensity difference or contrast from the background region on dermatological macro-images. The lack of proper light exposure at the time of capturing the image also reduces the contrast. Low contrast between lesion and background regions adversely impacts segmentation. Enhancement techniques for improving the contrast between lesion and background skin on dermatological macro-images are limited in the literature. An EfficientNet-based modified sigmoid transform for enhancing the contrast on dermatological macro-images is proposed to address this issue. METHODS A modified sigmoid transform is applied in the HSV color space. The crossover point in the modified sigmoid transform that divides the macro-image into lesion and background is predicted using a modified EfficientNet regressor to exclude manual intervention and subjectivity. The Modified EfficientNet regressor is constructed by replacing the classifier layer in the conventional EfficientNet with a regression layer. Transfer learning is employed to reduce the training time and size of the dataset required to train the modified EfficientNet regressor. For training the modified EfficientNet regressor, a set of value components extracted from the HSV color space representation of the macro-images in the training dataset is fed as input. The corresponding set of ideal crossover points at which the values of Dice similarity coefficient (DSC) between the ground-truth images and the segmented output images obtained from Otsu's thresholding are maximum, is defined as the target. RESULTS On images enhanced with the proposed framework, the DSC of segmented results obtained by Otsu's thresholding increased from 0.68 ± 0.34 to 0.81 ± 0.17. CONCLUSIONS The proposed algorithm could consistently improve the contrast between lesion and background on a comprehensive set of test images, justifying its applications in automated analysis of dermatological macro-images.
Collapse
Affiliation(s)
- Vipin Venugopal
- Department of Electronics and Communication Engineering, National Institute of Technology Puducherry, Karaikal, Puducherry 609609, India.
| | - Justin Joseph
- School of Bioengineering, VIT Bhopal University, Sehore, Madhya Pradesh 466114, India.
| | - M Vipin Das
- Department of Dermatology, Kerala Health Services, Trivandrum, Kerala 695035, India.
| | - Malaya Kumar Nath
- Department of Electronics and Communication Engineering, National Institute of Technology Puducherry, Karaikal, Puducherry 609609, India.
| |
Collapse
|
21
|
Fraiwan M, Faouri E. On the Automatic Detection and Classification of Skin Cancer Using Deep Transfer Learning. SENSORS 2022; 22:s22134963. [PMID: 35808463 PMCID: PMC9269808 DOI: 10.3390/s22134963] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/04/2022] [Revised: 06/22/2022] [Accepted: 06/29/2022] [Indexed: 12/15/2022]
Abstract
Skin cancer (melanoma and non-melanoma) is one of the most common cancer types and leads to hundreds of thousands of yearly deaths worldwide. It manifests itself through abnormal growth of skin cells. Early diagnosis drastically increases the chances of recovery. Moreover, it may render surgical, radiographic, or chemical therapies unnecessary or lessen their overall usage. Thus, healthcare costs can be reduced. The process of diagnosing skin cancer starts with dermoscopy, which inspects the general shape, size, and color characteristics of skin lesions, and suspected lesions undergo further sampling and lab tests for confirmation. Image-based diagnosis has undergone great advances recently due to the rise of deep learning artificial intelligence. The work in this paper examines the applicability of raw deep transfer learning in classifying images of skin lesions into seven possible categories. Using the HAM1000 dataset of dermoscopy images, a system that accepts these images as input without explicit feature extraction or preprocessing was developed using 13 deep transfer learning models. Extensive evaluation revealed the advantages and shortcomings of such a method. Although some cancer types were correctly classified with high accuracy, the imbalance of the dataset, the small number of images in some categories, and the large number of classes reduced the best overall accuracy to 82.9%.
Collapse
|
22
|
A Secure Framework toward IoMT-Assisted Data Collection, Modeling, and Classification for Intelligent Dermatology Healthcare Services. CONTRAST MEDIA & MOLECULAR IMAGING 2022; 2022:6805460. [PMID: 35845738 PMCID: PMC9259277 DOI: 10.1155/2022/6805460] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/28/2022] [Revised: 05/01/2022] [Accepted: 06/02/2022] [Indexed: 12/11/2022]
Abstract
The abnormal growth of the skin cells is known as skin cancer. It is one of the main problems in the dermatology area. Skin lesions or malignancies have been a source of worry for many individuals in recent years. Irrespective of the skin tone, there exist three major classes of skin lesions, i.e., basal cell carcinoma, squamous cell carcinoma, and melanoma. The early diagnosis of these lesions is equally important for human life. In the proposed work, a secure IoMT-Assisted framework is introduced that can help the patients to do the initial screening of skin lesions remotely. The initially proposed approach uses an IoMT-based data collection device which is accessible by patients to capture skin lesions images. Next, the captured skin sample is encrypted and sent to the collected image toward cloud storage. Later, the received sample image is classified into appropriate class labels using an ensemble classifier. In the proposed framework, four CNN models were ensemble i.e., VGG-16, DenseNet-201, Inception-V3, and Efficient-B7. The framework has experimented with the “HAM10000” dataset having 7 different kinds of skin lesions data. Although DenseNet-201 performed well, the ensemble model provides the highest accuracy with 87.22 percent as well as its test loss/error is lower than others with 0.4131. Moreover, the ensemble model's classification ability is much higher with an AUC score of 0.9745. Moreover, A recommendation team has been assigned to assess the sample of the patient as well as suggest the patient according to classified results by the CAD.
Collapse
|
23
|
Xue C, Yu L, Chen P, Dou Q, Heng PA. Robust Medical Image Classification From Noisy Labeled Data With Global and Local Representation Guided Co-Training. IEEE TRANSACTIONS ON MEDICAL IMAGING 2022; 41:1371-1382. [PMID: 34982680 DOI: 10.1109/tmi.2021.3140140] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Deep neural networks have achieved remarkable success in a wide variety of natural image and medical image computing tasks. However, these achievements indispensably rely on accurately annotated training data. If encountering some noisy-labeled images, the network training procedure would suffer from difficulties, leading to a sub-optimal classifier. This problem is even more severe in the medical image analysis field, as the annotation quality of medical images heavily relies on the expertise and experience of annotators. In this paper, we propose a novel collaborative training paradigm with global and local representation learning for robust medical image classification from noisy-labeled data to combat the lack of high quality annotated medical data. Specifically, we employ the self-ensemble model with a noisy label filter to efficiently select the clean and noisy samples. Then, the clean samples are trained by a collaborative training strategy to eliminate the disturbance from imperfect labeled samples. Notably, we further design a novel global and local representation learning scheme to implicitly regularize the networks to utilize noisy samples in a self-supervised manner. We evaluated our proposed robust learning strategy on four public medical image classification datasets with three types of label noise, i.e., random noise, computer-generated label noise, and inter-observer variability noise. Our method outperforms other learning from noisy label methods and we also conducted extensive experiments to analyze each component of our method.
Collapse
|
24
|
Painuli D, Bhardwaj S, Köse U. Recent advancement in cancer diagnosis using machine learning and deep learning techniques: A comprehensive review. Comput Biol Med 2022; 146:105580. [PMID: 35551012 DOI: 10.1016/j.compbiomed.2022.105580] [Citation(s) in RCA: 33] [Impact Index Per Article: 16.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2022] [Revised: 04/14/2022] [Accepted: 04/30/2022] [Indexed: 02/07/2023]
Abstract
Being a second most cause of mortality worldwide, cancer has been identified as a perilous disease for human beings, where advance stage diagnosis may not help much in safeguarding patients from mortality. Thus, efforts to provide a sustainable architecture with proven cancer prevention estimate and provision for early diagnosis of cancer is the need of hours. Advent of machine learning methods enriched cancer diagnosis area with its overwhelmed efficiency & low error-rate then humans. A significant revolution has been witnessed in the development of machine learning & deep learning assisted system for segmentation & classification of various cancers during past decade. This research paper includes a review of various types of cancer detection via different data modalities using machine learning & deep learning-based methods along with different feature extraction techniques and benchmark datasets utilized in the recent six years studies. The focus of this study is to review, analyse, classify, and address the recent development in cancer detection and diagnosis of six types of cancers i.e., breast, lung, liver, skin, brain and pancreatic cancer, using machine learning & deep learning techniques. Various state-of-the-art technique are clustered into same group and results are examined through key performance indicators like accuracy, area under the curve, precision, sensitivity, dice score on benchmark datasets and concluded with future research work challenges.
Collapse
Affiliation(s)
- Deepak Painuli
- Department of Computer Science and Engineering, Gurukula Kangri Vishwavidyalaya, Haridwar, India.
| | - Suyash Bhardwaj
- Department of Computer Science and Engineering, Gurukula Kangri Vishwavidyalaya, Haridwar, India
| | - Utku Köse
- Department of Computer Engineering, Suleyman Demirel University, Isparta, Turkey
| |
Collapse
|
25
|
A Dermoscopic Inspired System for Localization and Malignancy Classification of Melanocytic Lesions. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12094243] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
This study aims at developing a clinically oriented automated diagnostic tool for distinguishing malignant melanocytic lesions from benign melanocytic nevi in diverse image databases. Due to the presence of artifacts, smooth lesion boundaries, and subtlety in diagnostic features, the accuracy of such systems gets hampered. Thus, the proposed framework improves the accuracy of melanoma detection by combining the clinical aspects of dermoscopy. Two methods have been adopted for achieving the aforementioned objective. Firstly, artifact removal and lesion localization are performed. In the second step, various clinically significant features such as shape, color, texture, and pigment network are detected. Features are further reduced by checking their individual significance (i.e., hypothesis testing). These reduced feature vectors are then classified using SVM classifier. Features specific to the domain have been used for this design as opposed to features of the abstract images. The domain knowledge of an expert gets enhanced by this methodology. The proposed approach is implemented on a multi-source dataset (PH2 + ISBI 2016 and 2017) of 515 annotated images, thereby resulting in sensitivity, specificity and accuracy of 83.8%, 88.3%, and 86%, respectively. The experimental results are promising, and can be applied to detect asymmetry, pigment network, colors, and texture of the lesions.
Collapse
|
26
|
Khanam N, Kumar R. Recent Applications of Artificial Intelligence in Early Cancer Detection. Curr Med Chem 2022; 29:4410-4435. [PMID: 35196970 DOI: 10.2174/0929867329666220222154733] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2021] [Revised: 11/30/2021] [Accepted: 12/08/2021] [Indexed: 11/22/2022]
Abstract
Cancer is a deadly disease often caused by the accumulation of various genetic mutations and pathological alterations. The death rate can only be reduced when it is detected in the early stages because treatment of cancer when the tumor has not metastasized in many regions of the body is more effective. However, early cancer detection is fraught with difficulties. Advances in artificial intelligence (AI) have developed a new scope for efficient and early detection of such a fatal disease. AI algorithms have a remarkable ability to perform well on a variety of tasks that are presented or fed to the system. Numerous studies have produced machine learning and deep learning-assisted cancer prediction models to detect cancer from previously accessible data with better accuracy, sensitivity, and specificity. It has been observed that the accuracy of prediction models in classifying fed data as benign, malignant, or normal is improved by implementing efficient image processing techniques and data segmentation augmentation methodologies, along with advanced algorithms. In this review, recent AI-based models for the diagnosis of the most prevalent cancers in the breast, lung, brain, and skin have been analysed. Available AI techniques, data preparation, modeling processes, and performance assessments have been included in the review.
Collapse
Affiliation(s)
- Nausheen Khanam
- Amity Institute of Biotechnology, Amity University Uttar Pradesh Lucknow Campus, Uttar Pradesh, India
| | - Rajnish Kumar
- Amity Institute of Biotechnology, Amity University Uttar Pradesh Lucknow Campus, Uttar Pradesh, India
| |
Collapse
|
27
|
Preprocessing Effects on Performance of Skin Lesion Saliency Segmentation. Diagnostics (Basel) 2022; 12:diagnostics12020344. [PMID: 35204435 PMCID: PMC8871329 DOI: 10.3390/diagnostics12020344] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2021] [Revised: 01/21/2022] [Accepted: 01/27/2022] [Indexed: 11/16/2022] Open
Abstract
Despite the recent advances in immune therapies, melanoma remains one of the deadliest and most difficult skin cancers to treat. Literature reports that multifarious driver oncogenes with tumor suppressor genes are responsible for melanoma progression and its complexity can be demonstrated by alterations in expression with signaling cascades. However, a further improvement in the therapeutic outcomes of the disease is highly anticipated with the aid of humanoid assistive technologies that are nowadays touted as a superlative alternative for the clinical diagnosis of diseases. The development of the projected technology-assistive diagnostics will be based on the innovations of medical imaging, artificial intelligence, and humanoid robots. Segmentation of skin lesions in dermoscopic images is an important requisite component of such a breakthrough innovation for an accurate melanoma diagnosis. However, most of the existing segmentation methods tend to perform poorly on dermoscopic images with undesirable heterogeneous properties. Novel image segmentation methods are aimed to address these undesirable heterogeneous properties of skin lesions with the help of image preprocessing methods. Nevertheless, these methods come with the extra cost of computational complexity and their performances are highly dependent on the preprocessing methods used to alleviate the deteriorating effects of the inherent artifacts. The overarching objective of this study is to investigate the effects of image preprocessing on the performance of a saliency segmentation method for skin lesions. The resulting method from the collaboration of color histogram clustering with Otsu thresholding is applied to demonstrate that preprocessing can be abolished in the saliency segmentation of skin lesions in dermoscopic images with heterogeneous properties. The color histogram clustering is used to automatically determine the initial clusters that represent homogenous regions in an input image. Subsequently, a saliency map is computed by agglutinating color contrast, contrast ratio, spatial feature, and central prior to efficiently detect regions of skin lesions in dermoscopic images. The final stage of the segmentation process is accomplished by applying Otsu thresholding followed by morphological analysis to obliterate the undesirable artifacts that may be present at the saliency detection stage. Extensive experiments were conducted on the available benchmarking datasets to validate the performance of the segmentation method. Experimental results generally indicate that it is passable to segment skin lesions in dermoscopic images without preprocessing because the applied segmentation method is ferociously competitive with each of the numerous leading supervised and unsupervised segmentation methods investigated in this study.
Collapse
|
28
|
Lustig M, Schwartz D, Bryant R, Gefen A. A machine learning algorithm for early detection of heel deep tissue injuries based on a daily history of sub-epidermal moisture measurements. Int Wound J 2022; 19:1339-1348. [PMID: 35019208 PMCID: PMC9493225 DOI: 10.1111/iwj.13728] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2021] [Revised: 11/21/2021] [Accepted: 12/01/2021] [Indexed: 12/28/2022] Open
Abstract
Sub‐epidermal moisture is an established biophysical marker of pressure ulcer formation based on biocapacitance changes in affected soft tissues, which has been shown to facilitate early detection of these injuries. Artificial intelligence shows great promise in wound prevention and care, including in automated analyses of quantitative measures of tissue health such as sub‐epidermal moisture readings acquired over time for effective, patient‐specific, and anatomical‐site‐specific pressure ulcer prophylaxis. Here, we developed a novel machine learning algorithm for early detection of heel deep tissue injuries, which was trained using a database comprising six consecutive daily sub‐epidermal moisture measurements recorded from 173 patients in acute and post‐acute care settings. This algorithm was able to achieve strong predictive power in forecasting heel deep tissue injury events the next day, with sensitivity and specificity of 77% and 80%, respectively, revealing the clinical potential of artificial intelligence‐powered technology for hospital‐acquired pressure ulcer prevention. The current work forms the scientific basis for clinical implementation of machine learning algorithms that provide effective, early, and anatomy‐specific preventive interventions to minimise the occurrence of hospital‐acquired pressure ulcers based on routine tissue health status measurements.
Collapse
Affiliation(s)
- Maayan Lustig
- Department of Biomedical Engineering, Faculty of Engineering, Tel Aviv University, Tel Aviv, Israel
| | - Dafna Schwartz
- Department of Biomedical Engineering, Faculty of Engineering, Tel Aviv University, Tel Aviv, Israel
| | - Ruth Bryant
- Principal Research Scientist/Nursing and President, Association for the Advancement of Wound Care (AAWC), Abbott Northwestern Hospital, part of Allina Health, Minneapolis, MN, USA
| | - Amit Gefen
- Department of Biomedical Engineering, Faculty of Engineering, Tel Aviv University, Tel Aviv, Israel
| |
Collapse
|
29
|
Jain A, Rao ACS, Jain PK, Abraham A. Multi-type skin diseases classification using OP-DNN based feature extraction approach. MULTIMEDIA TOOLS AND APPLICATIONS 2022; 81:6451-6476. [PMID: 35035267 PMCID: PMC8752183 DOI: 10.1007/s11042-021-11823-x] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/13/2021] [Revised: 10/20/2021] [Accepted: 12/17/2021] [Indexed: 06/14/2023]
Abstract
In the current world, the disorders occurring in dermatological images are among the foremost widespread diseases. Despite being common, its identification is tremendously hard because of the complexities like skin tone and color variation due to the presence of hair regions. Therefore the type of skin disease prediction is not accurately achieved in many pieces of research. To deal with mentioned concerns, a novel optimal probability-based deep neural network is proposed to assist medical professionals in appropriately diagnosing the type of skin disease. Initially, the input dataset is fed into the pre-processing stage, which helps to remove unwanted contents in the image. Afterward, features extracted for all the pre-processed images are subjected to the proposed Optimal Probability-Based Deep Neural Network (OP-DNN) for the training process. This classification algorithm classifies incoming clinical images as different skin diseases with the help of probability values. While learning OP-DNN, it is essential to determine the optimal weight values for reducing the training error. For optimizing weight in OP-DNN structure, an optimization approach is implemented in this research. For that, whale optimization is utilized because it works faster than other methods. The proposed multi-type skin disease prediction model is implemented in MatLab software and achieved 95% of accuracy, 0.97 of specificity, and 0.91 of sensitivity. This exposes the superiority of the proposed multi-type skin disease prediction model using an effective OP-DNN based feature extraction approach to attain a high accuracy rate and also it predict several kinds of skin disease than the previous models, which can protect the patients survives as well as can assist the physicians in making a decision certainly.
Collapse
Affiliation(s)
- Arushi Jain
- Department of Computer Science & Engineering, Indian Institute of Technology (Indian School of Mines), Dhanbad, JH 826004 India
| | - Annavarapu Chandra Sekhara Rao
- Department of Computer Science & Engineering, Indian Institute of Technology (Indian School of Mines), Dhanbad, JH 826004 India
| | - Praphula Kumar Jain
- Department of Computer Science & Engineering, Indian Institute of Technology (Indian School of Mines), Dhanbad, JH 826004 India
| | - Ajith Abraham
- Machine Intelligence Research Labs (MIR Labs), Auburn, WA 98071 USA
- Center for Artificial Intelligence, Innopolis University, Innopolis, Russia
| |
Collapse
|
30
|
Artificial Intelligence in Radiotherapy and Patient Care. Artif Intell Med 2022. [DOI: 10.1007/978-3-030-64573-1_143] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
31
|
Bektaş J, Bektaş Y, Ersin Kangal E. Integrating a novel SRCRN network for segmentation with representative batch-mode experiments for detecting melanoma. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2021.103218] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
|
32
|
Takiddin A, Schneider J, Yang Y, Abd-Alrazaq A, Househ M. Artificial Intelligence for Skin Cancer Detection: Scoping Review. J Med Internet Res 2021; 23:e22934. [PMID: 34821566 PMCID: PMC8663507 DOI: 10.2196/22934] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2020] [Revised: 01/05/2021] [Accepted: 08/03/2021] [Indexed: 01/12/2023] Open
Abstract
Background Skin cancer is the most common cancer type affecting humans. Traditional skin cancer diagnosis methods are costly, require a professional physician, and take time. Hence, to aid in diagnosing skin cancer, artificial intelligence (AI) tools are being used, including shallow and deep machine learning–based methodologies that are trained to detect and classify skin cancer using computer algorithms and deep neural networks. Objective The aim of this study was to identify and group the different types of AI-based technologies used to detect and classify skin cancer. The study also examined the reliability of the selected papers by studying the correlation between the data set size and the number of diagnostic classes with the performance metrics used to evaluate the models. Methods We conducted a systematic search for papers using Institute of Electrical and Electronics Engineers (IEEE) Xplore, Association for Computing Machinery Digital Library (ACM DL), and Ovid MEDLINE databases following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews (PRISMA-ScR) guidelines. The studies included in this scoping review had to fulfill several selection criteria: being specifically about skin cancer, detecting or classifying skin cancer, and using AI technologies. Study selection and data extraction were independently conducted by two reviewers. Extracted data were narratively synthesized, where studies were grouped based on the diagnostic AI techniques and their evaluation metrics. Results We retrieved 906 papers from the 3 databases, of which 53 were eligible for this review. Shallow AI-based techniques were used in 14 studies, and deep AI-based techniques were used in 39 studies. The studies used up to 11 evaluation metrics to assess the proposed models, where 39 studies used accuracy as the primary evaluation metric. Overall, studies that used smaller data sets reported higher accuracy. Conclusions This paper examined multiple AI-based skin cancer detection models. However, a direct comparison between methods was hindered by the varied use of different evaluation metrics and image types. Performance scores were affected by factors such as data set size, number of diagnostic classes, and techniques. Hence, the reliability of shallow and deep models with higher accuracy scores was questionable since they were trained and tested on relatively small data sets of a few diagnostic classes.
Collapse
Affiliation(s)
- Abdulrahman Takiddin
- Department of Electrical and Computer Engineering, Texas A&M University, College Station, TX, United States.,College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar
| | - Jens Schneider
- College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar
| | - Yin Yang
- College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar
| | - Alaa Abd-Alrazaq
- College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar
| | - Mowafa Househ
- College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar
| |
Collapse
|
33
|
Daneshjou R, Smith MP, Sun MD, Rotemberg V, Zou J. Lack of Transparency and Potential Bias in Artificial Intelligence Data Sets and Algorithms: A Scoping Review. JAMA Dermatol 2021; 157:1362-1369. [PMID: 34550305 DOI: 10.1001/jamadermatol.2021.3129] [Citation(s) in RCA: 83] [Impact Index Per Article: 27.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
Importance Clinical artificial intelligence (AI) algorithms have the potential to improve clinical care, but fair, generalizable algorithms depend on the clinical data on which they are trained and tested. Objective To assess whether data sets used for training diagnostic AI algorithms addressing skin disease are adequately described and to identify potential sources of bias in these data sets. Data Sources In this scoping review, PubMed was used to search for peer-reviewed research articles published between January 1, 2015, and November 1, 2020, with the following paired search terms: deep learning and dermatology, artificial intelligence and dermatology, deep learning and dermatologist, and artificial intelligence and dermatologist. Study Selection Studies that developed or tested an existing deep learning algorithm for triage, diagnosis, or monitoring using clinical or dermoscopic images of skin disease were selected, and the articles were independently reviewed by 2 investigators to verify that they met selection criteria. Consensus Process Data set audit criteria were determined by consensus of all authors after reviewing existing literature to highlight data set transparency and sources of bias. Results A total of 70 unique studies were included. Among these studies, 1 065 291 images were used to develop or test AI algorithms, of which only 257 372 (24.2%) were publicly available. Only 14 studies (20.0%) included descriptions of patient ethnicity or race in at least 1 data set used. Only 7 studies (10.0%) included any information about skin tone in at least 1 data set used. Thirty-six of the 56 studies developing new AI algorithms for cutaneous malignant neoplasms (64.3%) met the gold standard criteria for disease labeling. Public data sets were cited more often than private data sets, suggesting that public data sets contribute more to new development and benchmarks. Conclusions and Relevance This scoping review identified 3 issues in data sets that are used to develop and test clinical AI algorithms for skin disease that should be addressed before clinical translation: (1) sparsity of data set characterization and lack of transparency, (2) nonstandard and unverified disease labels, and (3) inability to fully assess patient diversity used for algorithm development and testing.
Collapse
Affiliation(s)
- Roxana Daneshjou
- Stanford Department of Dermatology, Stanford School of Medicine, Redwood City, California.,Stanford Department of Biomedical Data Science, Stanford School of Medicine, Stanford, California
| | - Mary P Smith
- Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, New York
| | - Mary D Sun
- currently a medical student at Icahn School of Medicine at Mount Sinai, New York, New York
| | - Veronica Rotemberg
- Dermatology Service, Memorial Sloan Kettering Cancer Center, New York, New York
| | - James Zou
- Department of Electrical Engineering, Stanford University, Stanford, California.,Department of Biomedical Data Science, Stanford University, Stanford, California.,Chan Zuckerberg Biohub, San Francisco, California
| |
Collapse
|
34
|
|
35
|
|
36
|
Abstract
Deep learning proved its efficiency in many fields of computer science such as computer vision, image classifications, object detection, image segmentation, and more. Deep learning models primarily depend on the availability of huge datasets. Without the existence of many images in datasets, different deep learning models will not be able to learn and produce accurate models. Unfortunately, several fields don't have access to large amounts of evidence, such as medical image processing. For example. The world is suffering from the lack of COVID-19 virus datasets, and there is no benchmark dataset from the beginning of 2020. This pandemic was the main motivation of this survey to deliver and discuss the current image data augmentation techniques which can be used to increase the number of images. In this paper, a survey of data augmentation for digital images in deep learning will be presented. The study begins and with the introduction section, which reflects the importance of data augmentation in general. The classical image data augmentation taxonomy and photometric transformation will be presented in the second section. The third section will illustrate the deep learning image data augmentation. Finally, the fourth section will survey the state of the art of using image data augmentation techniques in the different deep learning research and application.
Collapse
|
37
|
Haggenmüller S, Krieghoff-Henning E, Jutzi T, Trapp N, Kiehl L, Utikal JS, Fabian S, Brinker TJ. Digital Natives' Preferences on Mobile Artificial Intelligence Apps for Skin Cancer Diagnostics: Survey Study. JMIR Mhealth Uhealth 2021; 9:e22909. [PMID: 34448722 PMCID: PMC8433862 DOI: 10.2196/22909] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2020] [Revised: 10/02/2020] [Accepted: 04/13/2021] [Indexed: 01/01/2023] Open
Abstract
Background Artificial intelligence (AI) has shown potential to improve diagnostics of various diseases, especially for early detection of skin cancer. Studies have yet to investigate the clear application of AI technology in clinical practice or determine the added value for younger user groups. Translation of AI-based diagnostic tools can only be successful if they are accepted by potential users. Young adults as digital natives may offer the greatest potential for successful implementation of AI into clinical practice, while at the same time, representing the future generation of skin cancer screening participants. Objective We conducted an anonymous online survey to examine how and to what extent individuals are willing to accept AI-based mobile apps for skin cancer diagnostics. We evaluated preferences and relative influences of concerns, with a focus on younger age groups. Methods We recruited participants below 35 years of age using three social media channels—Facebook, LinkedIn, and Xing. Descriptive analysis and statistical tests were performed to evaluate participants’ attitudes toward mobile apps for skin examination. We integrated an adaptive choice-based conjoint to assess participants’ preferences. We evaluated potential concerns using maximum difference scaling. Results We included 728 participants in the analysis. The majority of participants (66.5%, 484/728; 95% CI 0.631-0.699) expressed a positive attitude toward the use of AI-based apps. In particular, participants residing in big cities or small towns (P=.02) and individuals that were familiar with the use of health or fitness apps (P=.02) were significantly more open to mobile diagnostic systems. Hierarchical Bayes estimation of the preferences of participants with a positive attitude (n=484) revealed that the use of mobile apps as an assistance system was preferred. Participants ruled out app versions with an accuracy of ≤65%, apps using data storage without encryption, and systems that did not provide background information about the decision-making process. However, participants did not mind their data being used anonymously for research purposes, nor did they object to the inclusion of clinical patient information in the decision-making process. Maximum difference scaling analysis for the negative-minded participant group (n=244) showed that data security, insufficient trust in the app, and lack of personal interaction represented the dominant concerns with respect to app use. Conclusions The majority of potential future users below 35 years of age were ready to accept AI-based diagnostic solutions for early detection of skin cancer. However, for translation into clinical practice, the participants’ demands for increased transparency and explainability of AI-based tools seem to be critical. Altogether, digital natives between 18 and 24 years and between 25 and 34 years of age expressed similar preferences and concerns when compared both to each other and to results obtained by previous studies that included other age groups.
Collapse
Affiliation(s)
- Sarah Haggenmüller
- Digital Biomarkers for Oncology Group, National Center for Tumor Diseases, German Cancer Research Center, Heidelberg, Germany
| | - Eva Krieghoff-Henning
- Digital Biomarkers for Oncology Group, National Center for Tumor Diseases, German Cancer Research Center, Heidelberg, Germany
| | - Tanja Jutzi
- Digital Biomarkers for Oncology Group, National Center for Tumor Diseases, German Cancer Research Center, Heidelberg, Germany
| | - Nicole Trapp
- Digital Biomarkers for Oncology Group, National Center for Tumor Diseases, German Cancer Research Center, Heidelberg, Germany
| | - Lennard Kiehl
- Digital Biomarkers for Oncology Group, National Center for Tumor Diseases, German Cancer Research Center, Heidelberg, Germany
| | - Jochen Sven Utikal
- Department of Dermatology, Heidelberg University, Mannheim, Germany.,Skin Cancer Unit, German Cancer Research Center, Heidelberg, Germany
| | - Sascha Fabian
- Department of Economics, University of Applied Science Neu-Ulm, Neu-Ulm, Germany
| | - Titus Josef Brinker
- Digital Biomarkers for Oncology Group, National Center for Tumor Diseases, German Cancer Research Center, Heidelberg, Germany
| |
Collapse
|
38
|
Baig R, Bibi M, Hamid A, Kausar S, Khalid S. Deep Learning Approaches Towards Skin Lesion Segmentation and Classification from Dermoscopic Images - A Review. Curr Med Imaging 2021; 16:513-533. [PMID: 32484086 DOI: 10.2174/1573405615666190129120449] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2018] [Revised: 12/17/2018] [Accepted: 01/02/2019] [Indexed: 02/08/2023]
Abstract
BACKGROUND Automated intelligent systems for unbiased diagnosis are primary requirement for the pigment lesion analysis. It has gained the attention of researchers in the last few decades. These systems involve multiple phases such as pre-processing, feature extraction, segmentation, classification and post processing. It is crucial to accurately localize and segment the skin lesion. It is observed that recent enhancements in machine learning algorithms and dermoscopic techniques reduced the misclassification rate therefore, the focus towards computer aided systems increased exponentially in recent years. Computer aided diagnostic systems are reliable source for dermatologists to analyze the type of cancer, but it is widely acknowledged that even higher accuracy is needed for computer aided diagnostic systems to be adopted practically in the diagnostic process of life threatening diseases. INTRODUCTION Skin cancer is one of the most threatening cancers. It occurs by the abnormal multiplication of cells. The core three types of skin cells are: Squamous, Basal and Melanocytes. There are two wide classes of skin cancer; Melanocytic and non-Melanocytic. It is difficult to differentiate between benign and malignant melanoma, therefore dermatologists sometimes misclassify the benign and malignant melanoma. Melanoma is estimated as 19th most frequent cancer, it is riskier than the Basel and Squamous carcinoma because it rapidly spreads throughout the body. Hence, to lower the death risk, it is critical to diagnose the correct type of cancer in early rudimentary phases. It can occur on any part of body, but it has higher probability to occur on chest, back and legs. METHODS The paper presents a review of segmentation and classification techniques for skin lesion detection. Dermoscopy and its features are discussed briefly. After that Image pre-processing techniques are described. A thorough review of segmentation and classification phases of skin lesion detection using deep learning techniques is presented Literature is discussed and a comparative analysis of discussed methods is presented. CONCLUSION In this paper, we have presented the survey of more than 100 papers and comparative analysis of state of the art techniques, model and methodologies. Malignant melanoma is one of the most threating and deadliest cancers. Since the last few decades, researchers are putting extra attention and effort in accurate diagnosis of melanoma. The main challenges of dermoscopic skin lesion images are: low contrasts, multiple lesions, irregular and fuzzy borders, blood vessels, regression, hairs, bubbles, variegated coloring and other kinds of distortions. The lack of large training dataset makes these problems even more challenging. Due to recent advancement in the paradigm of deep learning, and specially the outstanding performance in medical imaging, it has become important to review the deep learning algorithms performance in skin lesion segmentation. Here, we have discussed the results of different techniques on the basis of different evaluation parameters such as Jaccard coefficient, sensitivity, specificity and accuracy. And the paper listed down the major achievements in this domain with the detailed discussion of the techniques. In future, it is expected to improve results by utilizing the capabilities of deep learning frameworks with other pre and post processing techniques so reliable and accurate diagnostic systems can be built.
Collapse
Affiliation(s)
- Ramsha Baig
- Department of Computer Science, Bahria University, Islamabad, Pakistan
| | - Maryam Bibi
- Department of Computer Science, Bahria University, Islamabad, Pakistan
| | - Anmol Hamid
- Department of Computer Science, Bahria University, Islamabad, Pakistan
| | - Sumaira Kausar
- Department of Computer Science, Bahria University, Islamabad, Pakistan
| | - Shahzad Khalid
- Department of Computer Engineering, Bahria University, Islamabad, Pakistan
| |
Collapse
|
39
|
Park S, Saw SN, Li X, Paknezhad M, Coppola D, Dinish US, Ebrahim Attia AB, Yew YW, Guan Thng ST, Lee HK, Olivo M. Model learning analysis of 3D optoacoustic mesoscopy images for the classification of atopic dermatitis. BIOMEDICAL OPTICS EXPRESS 2021; 12:3671-3683. [PMID: 34221687 PMCID: PMC8221944 DOI: 10.1364/boe.415105] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/16/2020] [Revised: 02/15/2021] [Accepted: 03/09/2021] [Indexed: 05/07/2023]
Abstract
Atopic dermatitis (AD) is a skin inflammatory disease affecting 10% of the population worldwide. Raster-scanning optoacoustic mesoscopy (RSOM) has recently shown promise in dermatological imaging. We conducted a comprehensive analysis using three machine-learning models, random forest (RF), support vector machine (SVM), and convolutional neural network (CNN) for classifying healthy versus AD conditions, and sub-classifying different AD severities using RSOM images and clinical information. CNN model successfully differentiates healthy from AD patients with 97% accuracy. With limited data, RF achieved 65% accuracy in sub-classifying AD patients into mild versus moderate-severe cases. Identification of disease severities is vital in managing AD treatment.
Collapse
Affiliation(s)
- Sojeong Park
- Bioinformatics Institute, Agency of Science, Technology and Research, ASTAR, 30 Biopolis Street, #07-01 Matrix, 138671, Singapore
- Co-first authors
| | - Shier Nee Saw
- Bioinformatics Institute, Agency of Science, Technology and Research, ASTAR, 30 Biopolis Street, #07-01 Matrix, 138671, Singapore
- Current address: Department of Artificial Intelligence, Faculty of Computer Science and Information Technology, University of Malaya, Malaysia
- Co-first authors
| | - Xiuting Li
- Laboratory of Bio-Optical Imaging, Singapore Bioimaging Consortium, ASTAR, 11 Biopolis Way, 138667, Singapore
- Co-first authors
| | - Mahsa Paknezhad
- Bioinformatics Institute, Agency of Science, Technology and Research, ASTAR, 30 Biopolis Street, #07-01 Matrix, 138671, Singapore
| | - Davide Coppola
- Bioinformatics Institute, Agency of Science, Technology and Research, ASTAR, 30 Biopolis Street, #07-01 Matrix, 138671, Singapore
| | - U S Dinish
- Laboratory of Bio-Optical Imaging, Singapore Bioimaging Consortium, ASTAR, 11 Biopolis Way, 138667, Singapore
| | | | - Yik Weng Yew
- National Skin Centre, 1 Mandalay, 308205, Singapore
| | | | - Hwee Kuan Lee
- Bioinformatics Institute, Agency of Science, Technology and Research, ASTAR, 30 Biopolis Street, #07-01 Matrix, 138671, Singapore
- School of Computing, National University of Singapore, 13 Computing Drive, Singapore, 117417, Singapore
- Singapore Eye Research Institute (SERI), 11 Third Hospital Ave, Singapore, 168751, Singapore
- Image and Pervasive Access Laboratory (IPAL), 1 Fusionopolis Way, #21-01 Connexis (South Tower), 138632, Singapore
- Rehabilitation Research Institute of Singapore, 11 Mandalay Road #14-03, Clinical Sciences Building, 308232, Singapore
| | - Malini Olivo
- Laboratory of Bio-Optical Imaging, Singapore Bioimaging Consortium, ASTAR, 11 Biopolis Way, 138667, Singapore
| |
Collapse
|
40
|
Zanddizari H, Nguyen N, Zeinali B, Chang JM. A new preprocessing approach to improve the performance of CNN-based skin lesion classification. Med Biol Eng Comput 2021; 59:1123-1131. [PMID: 33904008 DOI: 10.1007/s11517-021-02355-5] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2020] [Accepted: 03/19/2021] [Indexed: 10/21/2022]
Abstract
Skin lesion is one of the severe diseases which in many cases endanger the lives of patients on a worldwide extent. Early detection of disease in dermoscopy images can significantly increase the survival rate. However, the accurate detection of disease is highly challenging due to the following reasons: e.g., visual similarity between different classes of disease (e.g., melanoma and non-melanoma lesions), low contrast between lesions and skin, background noise, and artifacts. Machine learning models based on convolutional neural networks (CNN) have been widely used for automatic recognition of lesion diseases with high accuracy in comparison to conventional machine learning methods. In this research, we proposed a new preprocessing technique in order to extract the region of interest (RoI) of skin lesion dataset. We compare the performance of the most state-of-the-art CNN classifiers with two datasets which contain (1) raw, and (2) RoI extracted images. Our experiment results show that training CNN models by RoI extracted dataset can improve the accuracy of the prediction (e.g., InceptionResNetV2, 2.18% improvement). Moreover, it significantly decreases the evaluation (inference) and training time of classifiers as well.
Collapse
Affiliation(s)
- Hadi Zanddizari
- Department of Electrical Engineering, University of South Florida, Tampa, 33620, USA.
| | - Nam Nguyen
- Department of Electrical Engineering, University of South Florida, Tampa, 33620, USA
| | - Behnam Zeinali
- Department of Electrical Engineering, University of South Florida, Tampa, 33620, USA
| | - J Morris Chang
- Department of Electrical Engineering, University of South Florida, Tampa, 33620, USA
| |
Collapse
|
41
|
Ningrum DNA, Yuan SP, Kung WM, Wu CC, Tzeng IS, Huang CY, Li JYC, Wang YC. Deep Learning Classifier with Patient's Metadata of Dermoscopic Images in Malignant Melanoma Detection. J Multidiscip Healthc 2021; 14:877-885. [PMID: 33907414 PMCID: PMC8071207 DOI: 10.2147/jmdh.s306284] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2021] [Accepted: 03/25/2021] [Indexed: 02/05/2023] Open
Abstract
BACKGROUND Incidence of skin cancer is one of the global burdens of malignancies that increase each year, with melanoma being the deadliest one. Imaging-based automated skin cancer detection still remains challenging owing to variability in the skin lesions and limited standard dataset availability. Recent research indicates the potential of deep convolutional neural networks (CNN) in predicting outcomes from simple as well as highly complicated images. However, its implementation requires high-class computational facility, that is not feasible in low resource and remote areas of health care. There is potential in combining image and patient's metadata, but the study is still lacking. OBJECTIVE We want to develop malignant melanoma detection based on dermoscopic images and patient's metadata using an artificial intelligence (AI) model that will work on low-resource devices. METHODS We used an open-access dermatology repository of International Skin Imaging Collaboration (ISIC) Archive dataset consist of 23,801 biopsy-proven dermoscopic images. We tested performance for binary classification malignant melanomas vs nonmalignant melanomas. From 1200 sample images, we split the data for training (72%), validation (18%), and testing (10%). We compared CNN with image data only (CNN model) vs CNN for image data combined with an artificial neural network (ANN) for patient's metadata (CNN+ANN model). RESULTS The balanced accuracy for CNN+ANN model was higher (92.34%) than the CNN model (73.69%). Combination of the patient's metadata using ANN prevents the overfitting that occurs in the CNN model using dermoscopic images only. This small size (24 MB) of this model made it possible to run on a medium class computer without the need of cloud computing, suitable for deployment on devices with limited resources. CONCLUSION The CNN+ANN model can increase the accuracy of classification in malignant melanoma detection even with limited data and is promising for development as a screening device in remote and low resources health care.
Collapse
Affiliation(s)
- Dina Nur Anggraini Ningrum
- Graduate Institute of Biomedical Informatics, College of Medical Science and Technology, Taipei Medical University, Taipei, Taiwan
- Public Health Department, Universitas Negeri Semarang, Semarang City, Indonesia
| | - Sheng-Po Yuan
- Graduate Institute of Biomedical Informatics, College of Medical Science and Technology, Taipei Medical University, Taipei, Taiwan
- Department of Otorhinolaryngology, Shuang-Ho Hospital, Taipei Medical University, New Taipei City, Taiwan
| | - Woon-Man Kung
- Department of Exercise and Health Promotion, College of Kinesiology and Health, Chinese Culture University, Taipei, Taiwan
| | - Chieh-Chen Wu
- Department of Exercise and Health Promotion, College of Kinesiology and Health, Chinese Culture University, Taipei, Taiwan
| | - I-Shiang Tzeng
- Department of Exercise and Health Promotion, College of Kinesiology and Health, Chinese Culture University, Taipei, Taiwan
- Department of Research, Taipei Tzu Chi Hospital, Buddhist Tzu Chi Medical Foundation, New Taipei City, Taiwan
- Department of Statistics, National Taipei University, Taipei, Taiwan
| | - Chu-Ya Huang
- Taiwan College of Healthcare Executives, Taipei, Taiwan
| | - Jack Yu-Chuan Li
- Graduate Institute of Biomedical Informatics, College of Medical Science and Technology, Taipei Medical University, Taipei, Taiwan
- Department Dermatology, Wan Fang Hospital, Taipei, Taiwan
- Taipei Medical University Research Center of Cancer Translational Medicine, Taipei, Taiwan
| | - Yao-Chin Wang
- Graduate Institute of Injury Prevention and Control, College of Public Health, Taipei Medical University, Taipei, Taiwan
- Department of Emergency Medicine, Min-Sheng General Hospital, Taoyuan, Taiwan
| |
Collapse
|
42
|
Zhao Z, Wu CM, Zhang S, He F, Liu F, Wang B, Huang Y, Shi W, Jian D, Xie H, Yeh CY, Li J. A Novel Convolutional Neural Network for the Diagnosis and Classification of Rosacea: Usability Study. JMIR Med Inform 2021; 9:e23415. [PMID: 33720027 PMCID: PMC8077711 DOI: 10.2196/23415] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2020] [Revised: 11/30/2020] [Accepted: 12/12/2020] [Indexed: 12/13/2022] Open
Abstract
BACKGROUND Rosacea is a chronic inflammatory disease with variable clinical presentations, including transient flushing, fixed erythema, papules, pustules, and phymatous changes on the central face. Owing to the diversity in the clinical manifestations of rosacea, the lack of objective biochemical examinations, and nonspecificity in histopathological findings, accurate identification of rosacea is a big challenge. Artificial intelligence has emerged as a potential tool in the identification and evaluation of some skin diseases such as melanoma, basal cell carcinoma, and psoriasis. OBJECTIVE The objective of our study was to utilize a convolutional neural network (CNN) to differentiate the clinical photos of patients with rosacea (taken from 3 different angles) from those of patients with other skin diseases such as acne, seborrheic dermatitis, and eczema that could be easily confused with rosacea. METHODS In this study, 24,736 photos comprising of 18,647 photos of patients with rosacea and 6089 photos of patients with other skin diseases such as acne, facial seborrheic dermatitis, and eczema were included and analyzed by our CNN model based on ResNet-50. RESULTS The CNN in our study achieved an overall accuracy and precision of 0.914 and 0.898, with an area under the receiver operating characteristic curve of 0.972 for the detection of rosacea. The accuracy of classifying 3 subtypes of rosacea, that is, erythematotelangiectatic rosacea, papulopustular rosacea, and phymatous rosacea was 83.9%, 74.3%, and 80.0%, respectively. Moreover, the accuracy and precision of our CNN to distinguish rosacea from acne reached 0.931 and 0.893, respectively. For the differentiation between rosacea, seborrheic dermatitis, and eczema, the overall accuracy of our CNN was 0.757 and the precision was 0.667. Finally, by comparing the CNN diagnosis with the diagnoses by dermatologists of different expertise levels, we found that our CNN system is capable of identifying rosacea with a performance superior to that of resident doctors or attending physicians and comparable to that of experienced dermatologists. CONCLUSIONS The findings of our study showed that by assessing clinical images, the CNN system in our study could identify rosacea with accuracy and precision comparable to that of an experienced dermatologist.
Collapse
Affiliation(s)
- Zhixiang Zhao
- Department of Dermatology, Xiangya Hospital of Central South University, Changsha, China
- Hunan Key Laboratory of Aging Biology, Xiangya Hospital of Central South University, Changsha, China
| | | | - Shuping Zhang
- Department of Dermatology, Xiangya Hospital of Central South University, Changsha, China
- Hunan Key Laboratory of Aging Biology, Xiangya Hospital of Central South University, Changsha, China
| | - Fanping He
- Department of Dermatology, Xiangya Hospital of Central South University, Changsha, China
- Hunan Key Laboratory of Aging Biology, Xiangya Hospital of Central South University, Changsha, China
| | - Fangfen Liu
- Department of Dermatology, Xiangya Hospital of Central South University, Changsha, China
- Hunan Key Laboratory of Aging Biology, Xiangya Hospital of Central South University, Changsha, China
| | - Ben Wang
- Department of Dermatology, Xiangya Hospital of Central South University, Changsha, China
- Hunan Key Laboratory of Aging Biology, Xiangya Hospital of Central South University, Changsha, China
| | - Yingxue Huang
- Department of Dermatology, Xiangya Hospital of Central South University, Changsha, China
- Hunan Key Laboratory of Aging Biology, Xiangya Hospital of Central South University, Changsha, China
| | - Wei Shi
- Department of Dermatology, Xiangya Hospital of Central South University, Changsha, China
- Hunan Key Laboratory of Aging Biology, Xiangya Hospital of Central South University, Changsha, China
| | - Dan Jian
- Department of Dermatology, Xiangya Hospital of Central South University, Changsha, China
- Hunan Key Laboratory of Aging Biology, Xiangya Hospital of Central South University, Changsha, China
| | - Hongfu Xie
- Department of Dermatology, Xiangya Hospital of Central South University, Changsha, China
- Hunan Key Laboratory of Aging Biology, Xiangya Hospital of Central South University, Changsha, China
| | | | - Ji Li
- Department of Dermatology, Xiangya Hospital of Central South University, Changsha, China
- Hunan Key Laboratory of Aging Biology, Xiangya Hospital of Central South University, Changsha, China
- National Clinical Research Center for Geriatric Disorders, Xiangya Hospital of Central South University, Changsha, China
- Key Laboratory of Organ Injury, Aging and Regenerative Medicine of Hunan Province, Changsha, China
| |
Collapse
|
43
|
Saba T. Computer vision for microscopic skin cancer diagnosis using handcrafted and non-handcrafted features. Microsc Res Tech 2021; 84:1272-1283. [PMID: 33399251 DOI: 10.1002/jemt.23686] [Citation(s) in RCA: 24] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2020] [Revised: 11/15/2020] [Accepted: 11/30/2020] [Indexed: 12/31/2022]
Abstract
Skin covers the entire body and is the largest organ. Skin cancer is one of the most dreadful cancers that is primarily triggered by sensitivity to ultraviolet rays from the sun. However, the riskiest is melanoma, although it starts in a few different ways. The patient is extremely unaware of recognizing skin malignant growth at the initial stage. Literature is evident that various handcrafted and automatic deep learning features are employed to diagnose skin cancer using the traditional machine and deep learning techniques. The current research presents a comparison of skin cancer diagnosis techniques using handcrafted and non-handcrafted features. Additionally, clinical features such as Menzies method, seven-point detection, asymmetry, border color and diameter, visual textures (GRC), local binary patterns, Gabor filters, random fields of Markov, fractal dimension, and an oriental histography are also explored in the process of skin cancer detection. Several parameters, such as jacquard index, accuracy, dice efficiency, preciseness, sensitivity, and specificity, are compared on benchmark data sets to assess reported techniques. Finally, publicly available skin cancer data sets are described and the remaining issues are highlighted.
Collapse
Affiliation(s)
- Tanzila Saba
- Artificial Intelligence & Data Analytics Lab, CCIS Prince Sultan University, Riyadh, Saudi Arabia
| |
Collapse
|
44
|
Optical Technologies for the Improvement of Skin Cancer Diagnosis: A Review. SENSORS 2021; 21:s21010252. [PMID: 33401739 PMCID: PMC7795742 DOI: 10.3390/s21010252] [Citation(s) in RCA: 22] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/04/2020] [Revised: 12/24/2020] [Accepted: 12/26/2020] [Indexed: 02/04/2023]
Abstract
The worldwide incidence of skin cancer has risen rapidly in the last decades, becoming one in three cancers nowadays. Currently, a person has a 4% chance of developing melanoma, the most aggressive form of skin cancer, which causes the greatest number of deaths. In the context of increasing incidence and mortality, skin cancer bears a heavy health and economic burden. Nevertheless, the 5-year survival rate for people with skin cancer significantly improves if the disease is detected and treated early. Accordingly, large research efforts have been devoted to achieve early detection and better understanding of the disease, with the aim of reversing the progressive trend of rising incidence and mortality, especially regarding melanoma. This paper reviews a variety of the optical modalities that have been used in the last years in order to improve non-invasive diagnosis of skin cancer, including confocal microscopy, multispectral imaging, three-dimensional topography, optical coherence tomography, polarimetry, self-mixing interferometry, and machine learning algorithms. The basics of each of these technologies together with the most relevant achievements obtained are described, as well as some of the obstacles still to be resolved and milestones to be met.
Collapse
|
45
|
Artificial Intelligence in Radiotherapy and Patient Care. Artif Intell Med 2021. [DOI: 10.1007/978-3-030-58080-3_143-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
46
|
A deep facial recognition system using computational intelligent algorithms. PLoS One 2020; 15:e0242269. [PMID: 33270670 PMCID: PMC7714107 DOI: 10.1371/journal.pone.0242269] [Citation(s) in RCA: 22] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2020] [Accepted: 10/25/2020] [Indexed: 11/19/2022] Open
Abstract
The development of biometric applications, such as facial recognition (FR), has recently become important in smart cities. Many scientists and engineers around the world have focused on establishing increasingly robust and accurate algorithms and methods for these types of systems and their applications in everyday life. FR is developing technology with multiple real-time applications. The goal of this paper is to develop a complete FR system using transfer learning in fog computing and cloud computing. The developed system uses deep convolutional neural networks (DCNN) because of the dominant representation; there are some conditions including occlusions, expressions, illuminations, and pose, which can affect the deep FR performance. DCNN is used to extract relevant facial features. These features allow us to compare faces between them in an efficient way. The system can be trained to recognize a set of people and to learn via an online method, by integrating the new people it processes and improving its predictions on the ones it already has. The proposed recognition method was tested with different three standard machine learning algorithms (Decision Tree (DT), K Nearest Neighbor(KNN), Support Vector Machine (SVM)). The proposed system has been evaluated using three datasets of face images (SDUMLA-HMT, 113, and CASIA) via performance metrics of accuracy, precision, sensitivity, specificity, and time. The experimental results show that the proposed method achieves superiority over other algorithms according to all parameters. The suggested algorithm results in higher accuracy (99.06%), higher precision (99.12%), higher recall (99.07%), and higher specificity (99.10%) than the comparison algorithms.
Collapse
|
47
|
Zghal NS, Derbel N. Melanoma Skin Cancer Detection based on Image Processing. Curr Med Imaging 2020; 16:50-58. [PMID: 31989893 DOI: 10.2174/1573405614666180911120546] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2018] [Revised: 08/24/2018] [Accepted: 08/28/2018] [Indexed: 11/22/2022]
Abstract
BACKGROUND Skin cancer is one of the most common forms of cancers among humans. It can be classified as non-melanoma and melanoma. Although melanomas are less common than non-melanomas, the former is the most common cause of mortality. Therefore, it becomes necessary to develop a Computer-aided Diagnosis (CAD) aiming to detect this kind of lesion and enable the diagnosis of the disease at an early stage in order to augment the patient's survival likelihood. AIMS This paper aims to develop a simple method capable of detecting and classifying skin lesions using dermoscopy images based on ABCD rules. METHODS The proposed approach follows four steps. 1) The preprocessing stage consists of filtering and contrast enhancing algorithms. 2) The segmentation stage aims at detecting the lesion. 3) The feature extraction stage based on the calculation of the four parameters which are asymmetry, border irregularity, color and diameter. 4) The classification stage based on the summation of the four extracted parameters multiplied by their weights yields the total dermoscopy value (TDV); hence, the lesion is classified into benign, suspicious or malignant. The proposed approach is implemented in the MATLAB environment and the experiment is based on PH2 database containing suspicious melanoma skin cancer. RESULTS AND CONCLUSION Based on the experiment, the accuracy of the developed approach is 90%, which reflects its reliability.
Collapse
Affiliation(s)
- Nadia Smaoui Zghal
- Industrial Computer, Control and Energy Management Laboratory, National School of Engineers of Sfax, University of Sfax, Sfax, Tunisia
| | - Nabil Derbel
- Industrial Computer, Control and Energy Management Laboratory, National School of Engineers of Sfax, University of Sfax, Sfax, Tunisia
| |
Collapse
|
48
|
Pacal I, Karaboga D, Basturk A, Akay B, Nalbantoglu U. A comprehensive review of deep learning in colon cancer. Comput Biol Med 2020; 126:104003. [DOI: 10.1016/j.compbiomed.2020.104003] [Citation(s) in RCA: 28] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2020] [Revised: 08/28/2020] [Accepted: 08/28/2020] [Indexed: 12/17/2022]
|
49
|
Hosny KM, Kassem MA, Fouad MM. Classification of Skin Lesions into Seven Classes Using Transfer Learning with AlexNet. J Digit Imaging 2020; 33:1325-1334. [PMID: 32607904 PMCID: PMC7573031 DOI: 10.1007/s10278-020-00371-9] [Citation(s) in RCA: 34] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
Abstract
Melanoma is deadly skin cancer. There is a high similarity between different kinds of skin lesions, which lead to incorrect classification. Accurate classification of a skin lesion in its early stages saves human life. In this paper, a highly accurate method proposed for the skin lesion classification process. The proposed method utilized transfer learning with pre-trained AlexNet. The parameters of the original model used as initial values, where we randomly initialize the weights of the last three replaced layers. The proposed method was tested using the most recent public dataset, ISIC 2018. Based on the obtained results, we could say that the proposed method achieved a great success where it accurately classifies the skin lesions into seven classes. These classes are melanoma, melanocytic nevus, basal cell carcinoma, actinic keratosis, benign keratosis, dermatofibroma, and vascular lesion. The achieved percentages are 98.70%, 95.60%, 99.27%, and 95.06% for accuracy, sensitivity, specificity, and precision, respectively.
Collapse
Affiliation(s)
- Khalid M. Hosny
- Department of Information Technology, Faculty of Computers and Informatics, Zagazig, University, Zagazig 44519, Egypt
| | - Mohamed A. Kassem
- Department of Robotics and Intelligent Machines, Faculty of Artificial Intelligence, KafrElSheikh University, KafrElSheikh, 33511 Egypt
| | - Mohamed M. Fouad
- Department of Electronics and Communication, Faculty of Engineering, Zagazig University, Zagazig 44519, Egypt
| |
Collapse
|
50
|
Saba T. Recent advancement in cancer detection using machine learning: Systematic survey of decades, comparisons and challenges. J Infect Public Health 2020; 13:1274-1289. [DOI: 10.1016/j.jiph.2020.06.033] [Citation(s) in RCA: 73] [Impact Index Per Article: 18.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2020] [Revised: 06/21/2020] [Accepted: 06/28/2020] [Indexed: 12/24/2022] Open
|