1
|
Al-Saidi M, Ballagi Á, Hassen OA, Saad SM. Type-2 Neutrosophic Markov Chain Model for Subject-Independent Sign Language Recognition: A New Uncertainty-Aware Soft Sensor Paradigm. SENSORS (BASEL, SWITZERLAND) 2024; 24:7828. [PMID: 39686365 DOI: 10.3390/s24237828] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/27/2024] [Revised: 11/23/2024] [Accepted: 12/05/2024] [Indexed: 12/18/2024]
Abstract
Uncertainty-aware soft sensors in sign language recognition (SLR) integrate methods to quantify and manage the uncertainty in their predictions. This is particularly crucial in SLR due to the variability in sign language gestures and differences in individual signing styles. Managing uncertainty allows the system to handle variations in signing styles, lighting conditions, and occlusions more effectively. While current techniques for handling uncertainty in SLR systems offer significant benefits in terms of improved accuracy and robustness, they also come with notable disadvantages. High computational complexity, data dependency, scalability issues, sensor and environmental limitations, and real-time constraints all pose significant hurdles. The aim of the work is to develop and evaluate a Type-2 Neutrosophic Hidden Markov Model (HMM) for SLR that leverages the advanced uncertainty handling capabilities of Type-2 neutrosophic sets. In the suggested soft sensor model, the Foot of Uncertainty (FOU) allows Type-2 Neutrosophic HMMs to represent uncertainty as intervals, capturing the range of possible values for truth, falsity, and indeterminacy. This is especially useful in SLR, where gestures can be ambiguous or imprecise. This enhances the model's ability to manage complex uncertainties in sign language gestures and mitigate issues related to model drift. The FOU provides a measure of confidence for each recognition result by indicating the range of uncertainty. By effectively addressing uncertainty and enhancing subject independence, the model can be integrated into real-life applications, improving interactions, learning, and accessibility for the hearing-impaired. Examples such as assistive devices, educational tools, and customer service automation highlight its transformative potential. The experimental evaluation demonstrates the superiority of the Type-2 Neutrosophic HMM over the Type-1 Neutrosophic HMM in terms of accuracy for SLR. Specifically, the Type-2 Neutrosophic HMM consistently outperforms its Type-1 counterpart across various test scenarios, achieving an average accuracy improvement of 10%.
Collapse
Affiliation(s)
- Muslem Al-Saidi
- Doctoral School of Multidisciplinary Engineering Sciences, Széchenyi István University, Egyetem tér 1, 9026 Gyor, Hungary
| | - Áron Ballagi
- Department of Automation, Széchenyi István University, Egyetem tér 1, 9026 Gyor, Hungary
| | - Oday Ali Hassen
- Ministry of Education, Wasit Education Directorate, Kut 52001, Iraq
| | - Saad M Saad
- Department of Information Technology, Institute of Graduate Studies and Research, Alexandria University, Alexandria 21526, Egypt
- Department of Artificial Intelligence, Faculty of Computer Sciences and Artificial Intelligence, Pharos University in Alexandria, Canal El Mahmoudia Street, Beside Green Plaza, Alexandria 21648, Egypt
| |
Collapse
|
2
|
Devadhas DNP, Isaac Sugirtharaj HP, Fernandez MH, Periyasamy D. Effective prediction of human skin cancer using stacking based ensemble deep learning algorithm. NETWORK (BRISTOL, ENGLAND) 2024:1-37. [PMID: 38804548 DOI: 10.1080/0954898x.2024.2346608] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/17/2023] [Accepted: 04/19/2024] [Indexed: 05/29/2024]
Abstract
Automated diagnosis of cancer from skin lesion data has been the focus of numerous research. Despite that it can be challenging to interpret these images because of features like colour illumination changes, variation in the sizes and forms of the lesions. To tackle these problems, the proposed model develops an ensemble of deep learning techniques for skin cancer diagnosis. Initially, skin imaging data are collected and preprocessed using resizing and anisotropic diffusion to enhance the quality of the image. Preprocessed images are fed into the Fuzzy-C-Means clustering technique to segment the region of diseases. Stacking-based ensemble deep learning approach is used for classification and the LSTM acts as a meta-classifier. Deep Neural Network (DNN) and Convolutional Neural Network (CNN) are used as input for LSTM. This segmented images are utilized to be input into the CNN, and the local binary pattern (LBP) technique is employed to extract DNN features from the segments of the image. The output from these two classifiers will be fed into the LSTM Meta classifier. This LSTM classifies the input data and predicts the skin cancer disease. The proposed approach had a greater accuracy of 97%. Hence, the developed model accurately predicts skin cancer disease.
Collapse
Affiliation(s)
- David Neels Ponkumar Devadhas
- Department of Electronics and Communication Engineering, Vel Tech Rangarajan Dr.Sagunthala R & D Institute of Science and Technology, Chennai, India
| | | | - Mary Harin Fernandez
- Department of Computer Science and Engineering, Saveetha School of Engineering, Saveetha Institute of Medical and Technical Sciences, Chennai, Tamil Nadu, India
| | - Duraipandy Periyasamy
- Department of Electrical and Electronics Engineering, J. B. Institute of Engineering & Technology, Telangana, Hyderabad, India
| |
Collapse
|
3
|
Ramadas M, Abraham A. Segmentation on remote sensing imagery for atmospheric air pollution using divergent differential evolution algorithm. Neural Comput Appl 2023; 35:3977-3990. [PMID: 36276657 PMCID: PMC9579638 DOI: 10.1007/s00521-022-07922-x] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2022] [Accepted: 10/03/2022] [Indexed: 01/31/2023]
Abstract
Air pollution is a global issue causing major health hazards. By proper monitoring of air quality, actions can be taken to control air pollution. Satellite remote sensing is an effective way to monitor global atmosphere. Various sensors and instruments fitted to satellites and airplanes are used to obtain the radar images. These images are quite complex with various wavelength differentiated by very close color differences. Clustering of such images based on its wavelengths can provide the much-needed relief in better understanding of these complex images. Such task related to image segmentation is a universal optimization issue that can be resolved with evolutionary techniques. Differential Evolution (DE) is a fairly fast and operative parallel search algorithm. Though classical DE algorithm is popular, there is a need for varying the mutation strategy for enhancing the performance for varied applications. Several alternatives of classical DE are considered by altering the trial vector and control parameter. In this work, a new alteration of DE technique labeled as DiDE (Divergent Differential Evolution Algorithm) is anticipated. The outcomes of this algorithm were tested and verified with the traditional DE techniques using fifteen benchmark functions. The new variant DiDE exhibited much superior outcomes compared to traditional approaches. The novel approach was then applied on remote sensing imagery collected form TEMIS, a web based service for atmospheric satellite images and the image was segmented. Fuzzy Tsallis entropy method of multi-level thresholding technique is applied over DiDE to develop image segmentation. The outcomes obtained were related with the segmented results using traditional DE and the outcome attained was found to be improved profoundly. Experimental results illustrate that by acquainting DiDE in multilevel thresholding, the computational delay was greatly condensed and the image quality was significantly improved.
Collapse
Affiliation(s)
- Meera Ramadas
- Machine Intelligence Research Labs (MIR Labs), Scientific Network for Innovation and Research Excellence, Auburn, WA 98071 USA
| | - Ajith Abraham
- Machine Intelligence Research Labs (MIR Labs), Scientific Network for Innovation and Research Excellence, Auburn, WA 98071 USA
| |
Collapse
|
4
|
Singh M, Pant M, Kong L, Alijani Z, Snášel V. A PCA-based fuzzy tensor evaluation model for multiple-criteria group decision making. Appl Soft Comput 2022. [DOI: 10.1016/j.asoc.2022.109753] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
|
5
|
Uncertainty analysis in document publications using single-valued neutrosophic set and collaborative entropy. Artif Intell Rev 2022. [DOI: 10.1007/s10462-022-10249-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
|
6
|
Segmentation for Multimodal Brain Tumor Images Using Dual-Tree Complex Wavelet Transform and Deep Reinforcement Learning. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:5369516. [PMID: 35655520 PMCID: PMC9152408 DOI: 10.1155/2022/5369516] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/04/2022] [Revised: 04/27/2022] [Accepted: 05/04/2022] [Indexed: 11/18/2022]
Abstract
Image segmentation is an effective tool for computer-aided medical treatment, to retain the detailed features and edges of the segmented image and improve the segmentation accuracy. Therefore, a segmentation algorithm using deep reinforcement learning (DRL) and dual-tree complex wavelet transform (DTCWT) for multimodal brain tumor images is proposed. First, the bivariate concept in DTCWT is used to determine whether the image noise points belong to the real or imaginary region, and the noise probability is checked after calculation; second, the wavelet coefficients corresponding to the region where the noise is located are selected to transform the noise into normal pixel points by bivariate; then, the conditional probability of occurrence of marker points in the edge and center regions of the image is calculated with the target points, and the initial segmentation of the image is achieved by the known wavelet coefficients; finally, the segmentation framework is constructed using DRL, and the network is trained by loss function to optimize the segmentation results and achieve accurate image segmentation. The experiment was evaluated on BraTS2018 dataset, CQ500 dataset, and a hospital brain tumor dataset. The results show that the algorithm in this paper can effectively remove multimodal brain tumor image noise, and the segmented image has good retention of detail features and edges, and the segmented image has high similarity with the original image. The highest information loss index of the segmentation results is only 0.18, the image boundary error is only about 0.3, and F-value is high, which indicates that the proposed algorithm is accurate and can operate efficiently, and has practical applicability.
Collapse
|
7
|
Jayaseelan SM, Gopal ST, Muthu S, Selvaraju S, Patel MS. A Hybrid Fuzzy based Cross Neighbor Filtering (HF-CNF) for Image Enhancement of fine and coarse powder Scanned Electron Microscopy (SEM) images. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2022. [DOI: 10.3233/jifs-212561] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Image enhancement is one of the most critical stages towards any image processing application. The outcome of image enhancement determines the accuracy and precise nature of the overall output from the image processing under interest. This research paper has shown specific interests towards enhancement of Scanned Electron Microscopic (SEM) images which are primarily concerned with projection of fine details exist in internal details of surfaces, metals, fine powders, fibers etc. These fine details play a dominant role in detection of minute cracks, artifacts, progressing faults, texture of powders, their coarseness or fineness, internal details of fibers in forensics. However, due to the image capturing process which is through conventional camera-based models, noise tends to be a major source in degrading or blurring the underlying vital information. A cross neighbor fuzzy filter is a hybrid combination called Hybrid Fuzzy Based Cross Neighbor Filtering (HF-CNF) which is proposed in this research paper in order to minimize impulse and random noise to a great extent also to fine tune the further processing stages. The proposed method has been subjected to extensive analysis by comparison with state of art and recent benchmark methods and superior performance justified in terms of several validation metrics.
Collapse
Affiliation(s)
| | | | - Sangeetha Muthu
- School of Computing and Information Technology, REVA University, Bangalore, India
| | - Sivamani Selvaraju
- Chemical Engineering Department, University of Technology and Applied Sciences, Salalah, Oman
| | - Md Saad Patel
- Department of Mechanical Engineering, R.V College of Engineering, Bengaluru, Karnataka, India
| |
Collapse
|
8
|
Rai R, Das A, Dhal KG. Nature-inspired optimization algorithms and their significance in multi-thresholding image segmentation: an inclusive review. EVOLVING SYSTEMS 2022; 13:889-945. [PMID: 37520044 PMCID: PMC8859498 DOI: 10.1007/s12530-022-09425-5] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2021] [Accepted: 01/15/2022] [Indexed: 12/14/2022]
Abstract
Multilevel Thresholding (MLT) is considered as a significant and imperative research field in image segmentation that can efficiently resolve difficulties aroused while analyzing the segmented regions of multifaceted images with complicated nonlinear conditions. MLT being a simple exponential combinatorial optimization problem is commonly phrased by means of a sophisticated objective function requirement that can only be addressed by nondeterministic approaches. Consequently, researchers are engaging Nature-Inspired Optimization Algorithms (NIOA) as an alternate methodology that can be widely employed for resolving problems related to MLT. This paper delivers an acquainted review related to novel NIOA shaped lately in last three years (2019-2021) highlighting and exploring the major challenges encountered during the development of image multi-thresholding models based on NIOA.
Collapse
Affiliation(s)
- Rebika Rai
- Department of Computer Applications, Sikkim University, Sikkim, India
| | - Arunita Das
- Department of Computer Science and Application, Midnapore College (Autonomous), Paschim Medinipur, West Bengal India
| | - Krishna Gopal Dhal
- Department of Computer Science and Application, Midnapore College (Autonomous), Paschim Medinipur, West Bengal India
| |
Collapse
|
9
|
Interpretable Model Based on Pyramid Scene Parsing Features for Brain Tumor MRI Image Segmentation. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2022; 2022:8000781. [PMID: 35140806 PMCID: PMC8820931 DOI: 10.1155/2022/8000781] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/08/2021] [Accepted: 01/15/2022] [Indexed: 12/05/2022]
Abstract
Due to the black box model nature of convolutional neural networks, computer-aided diagnosis methods based on depth learning are usually poorly interpretable. Therefore, the diagnosis results obtained by these unexplained methods are difficult to gain the trust of patients and doctors, which limits their application in the medical field. To solve this problem, an interpretable depth learning image segmentation framework is proposed in this paper for processing brain tumor magnetic resonance images. A gradient-based class activation mapping method is introduced into the segmentation model based on pyramid structure to visually explain it. The pyramid structure constructs global context information with features after multiple pooling layers to improve image segmentation performance. Therefore, class activation mapping is used to visualize the features concerned by each layer of pyramid structure and realize the interpretation of PSPNet. After training and testing the model on the public dataset BraTS2018, several sets of visualization results were obtained. By analyzing these visualization results, the effectiveness of pyramid structure in brain tumor segmentation task is proved, and some improvements are made to the structure of pyramid model based on the shortcomings of the model shown in the visualization results. In summary, the interpretable brain tumor image segmentation method proposed in this paper can well explain the role of pyramid structure in brain tumor image segmentation, which provides a certain idea for the application of interpretable method in brain tumor segmentation and has certain practical value for the evaluation and optimization of brain tumor segmentation model.
Collapse
|
10
|
Singh P, Bose SS. A quantum-clustering optimization method for COVID-19 CT scan image segmentation. EXPERT SYSTEMS WITH APPLICATIONS 2021; 185:115637. [PMID: 34334964 PMCID: PMC8316646 DOI: 10.1016/j.eswa.2021.115637] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/17/2020] [Revised: 04/25/2021] [Accepted: 07/18/2021] [Indexed: 06/12/2023]
Abstract
The World Health Organization (WHO) has declared Coronavirus Disease 2019 (COVID-19) as one of the highly contagious diseases and considered this epidemic as a global health emergency. Therefore, medical professionals urgently need an early diagnosis method for this new type of disease as soon as possible. In this research work, a new early screening method for the investigation of COVID-19 pneumonia using chest CT scan images has been introduced. For this purpose, a new image segmentation method based on K-means clustering algorithm (KMC) and novel fast forward quantum optimization algorithm (FFQOA) is proposed. The proposed method, called FFQOAK (FFQOA+KMC), initiates by clustering gray level values with the KMC algorithm and generating an optimal segmented image with the FFQOA. The main objective of the proposed FFQOAK is to segment the chest CT scan images so that infected regions can be accurately detected. The proposed method is verified and validated with different chest CT scan images of COVID-19 patients. The segmented images obtained using FFQOAK method are compared with various benchmark image segmentation methods. The proposed method achieves mean squared error, peak signal-to-noise ratio, Jaccard similarity coefficient and correlation coefficient of 712.30, 19.61, 0.90 and 0.91 in case of four experimental sets, namely Experimental_Set_1, Experimental_Set_2, Experimental_Set_3 and Experimental_Set_4, respectively. These four performance evaluation metrics show the effectiveness of FFQOAK method over these existing methods.
Collapse
Affiliation(s)
- Pritpal Singh
- Institute of Theoretical Physics, Jagiellonian University, ul.Łojasiewicza 11, Kraków 30-348, Poland
| | - Surya Sekhar Bose
- Department of Mathematics, Madras Institute of Technology, MIT Rd, Radha Nagar, Chromepet, Chennai, Tamil Nadu 600044, India
| |
Collapse
|
11
|
Singh P, Bose SS. Ambiguous D-means fusion clustering algorithm based on ambiguous set theory: Special application in clustering of CT scan images of COVID-19. Knowl Based Syst 2021; 231:107432. [PMID: 34462624 PMCID: PMC8387206 DOI: 10.1016/j.knosys.2021.107432] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2021] [Revised: 08/17/2021] [Accepted: 08/20/2021] [Indexed: 01/18/2023]
Abstract
Coronavirus Disease 2019 (COVID-19) has been considered one of the most critical diseases of the 21st century. Only early detection can aid in the prevention of personal transmission of the disease. Recent scientific research reports indicate that computed tomography (CT) images of COVID-19 patients exhibit acute infections and lung abnormalities. However, analyzing these CT scan images is very difficult because of the presence of noise and low-resolution. Therefore, this study suggests the development of a new early detection method to detect abnormalities in chest CT scan images of COVID-19 patients. By this motivation, a novel image clustering algorithm, called ambiguous D-means fusion clustering algorithm (ADMFCA), is introduced in this study. This algorithm is based on the newly proposed ambiguous set theory and associated concepts. The ambiguous set is used in the proposed technique to characterize the ambiguity associated with grayscale values of pixels as true, false, true-ambiguous and false-ambiguous. The proposed algorithm performs the clustering operation on the CT scan images based on the entropies of different grayscale values. Finally, a final outcome image is obtained from the clustered images by image fusion operation. The experiment is carried out on 40 different CT scan images of COVID-19 patients. The clustered images obtained by the proposed algorithm are compared to five well-known clustering methods. The comparative study based on statistical metrics shows that the proposed ADMFCA is more efficient than the five existing clustering methods.
Collapse
Affiliation(s)
- Pritpal Singh
- Institute of Theoretical Physics, Jagiellonian University, ul.Ł,ojasiewicza 11, Kraków 30-348, Poland
| | - Surya Sekhar Bose
- Department of Mathematics, Madras Institute of Technology, MIT Rd, Radha Nagar, Chromepet, Chennai, Tamil Nadu 600044, India
| |
Collapse
|
12
|
Karamustafa M, Cebi S. Extension of safety and critical effect analysis to neutrosophic sets for the evaluation of occupational risks. Appl Soft Comput 2021. [DOI: 10.1016/j.asoc.2021.107719] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|