1
|
Wong HT, Mai J, Wang Z, Leung CS. Generalized M-sparse algorithms for constructing fault tolerant RBF networks. Neural Netw 2024; 180:106633. [PMID: 39208461 DOI: 10.1016/j.neunet.2024.106633] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2023] [Revised: 11/02/2023] [Accepted: 08/12/2024] [Indexed: 09/04/2024]
Abstract
In the construction process of radial basis function (RBF) networks, two common crucial issues arise: the selection of RBF centers and the effective utilization of the given source without encountering the overfitting problem. Another important issue is the fault tolerant capability. That is, when noise or faults exist in a trained network, it is crucial that the network's performance does not undergo significant deterioration or decrease. However, without employing a fault tolerant procedure, a trained RBF network may exhibit significantly poor performance. Unfortunately, most existing algorithms are unable to simultaneously address all of the aforementioned issues. This paper proposes fault tolerant training algorithms that can simultaneously select RBF nodes and train RBF output weights. Additionally, our algorithms can directly control the number of RBF nodes in an explicit manner, eliminating the need for a time-consuming procedure to tune the regularization parameter and achieve the target RBF network size. Based on simulation results, our algorithms demonstrate improved test set performance when more RBF nodes are used, effectively utilizing the given source without encountering the overfitting problem. This paper first defines a fault tolerant objective function, which includes a term to suppress the effects of weight faults and weight noise. This term also prevents the issue of overfitting, resulting in better test set performance when more RBF nodes are utilized. With the defined objective function, the training process is designed to solve a generalized M-sparse problem by incorporating an ℓ0-norm constraint. The ℓ0-norm constraint allows us to directly and explicitly control the number of RBF nodes. To address the generalized M-sparse problem, we introduce the noise-resistant iterative hard thresholding (NR-IHT) algorithm. The convergence properties of the NR-IHT algorithm are subsequently discussed theoretically. To further enhance performance, we incorporate the momentum concept into the NR-IHT algorithm, referring to the modified version as "NR-IHT-Mom". Simulation results show that both the NR-IHT algorithm and the NR-IHT-Mom algorithm outperform several state-of-the-art comparison algorithms.
Collapse
Affiliation(s)
- Hiu-Tung Wong
- Center for Intelligent Multidimensional Data Analysis, Hong Kong Science Park, Shatin, Hong Kong Special Administrative Region of China; Department of Electrical Engineering, City University of Hong Kong, Tat Chee Avenue, Kowloon, Hong Kong Special Administrative Region of China.
| | - Jiajie Mai
- Department of Electrical Engineering, City University of Hong Kong, Tat Chee Avenue, Kowloon, Hong Kong Special Administrative Region of China.
| | - Zhenni Wang
- Department of Electrical Engineering, City University of Hong Kong, Tat Chee Avenue, Kowloon, Hong Kong Special Administrative Region of China.
| | - Chi-Sing Leung
- Department of Electrical Engineering, City University of Hong Kong, Tat Chee Avenue, Kowloon, Hong Kong Special Administrative Region of China.
| |
Collapse
|
2
|
Zhao A, Li L, Liu S. UIDF-Net: Unsupervised Image Dehazing and Fusion Utilizing GAN and Encoder-Decoder. J Imaging 2024; 10:164. [PMID: 39057735 PMCID: PMC11278268 DOI: 10.3390/jimaging10070164] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2024] [Revised: 06/27/2024] [Accepted: 07/09/2024] [Indexed: 07/28/2024] Open
Abstract
Haze weather deteriorates image quality, causing images to become blurry with reduced contrast. This makes object edges and features unclear, leading to lower detection accuracy and reliability. To enhance haze removal effectiveness, we propose an image dehazing and fusion network based on the encoder-decoder paradigm (UIDF-Net). This network leverages the Image Fusion Module (MDL-IFM) to fuse the features of dehazed images, producing clearer results. Additionally, to better extract haze information, we introduce a haze encoder (Mist-Encode) that effectively processes different frequency features of images, improving the model's performance in image dehazing tasks. Experimental results demonstrate that the proposed model achieves superior dehazing performance compared to existing algorithms on outdoor datasets.
Collapse
Affiliation(s)
- Anxin Zhao
- School of Communication and Information Engineering, Xi’an University of Science and Technology, Xi’an 710054, China
| | | | | |
Collapse
|
3
|
Zhang S, Ren W, Tan X, Wang ZJ, Liu Y, Zhang J, Zhang X, Cao X. Semantic-Aware Dehazing Network With Adaptive Feature Fusion. IEEE TRANSACTIONS ON CYBERNETICS 2023; 53:454-467. [PMID: 34797770 DOI: 10.1109/tcyb.2021.3124231] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Despite that convolutional neural networks (CNNs) have shown high-quality reconstruction for single image dehazing, recovering natural and realistic dehazed results remains a challenging problem due to semantic confusion in the hazy scene. In this article, we show that it is possible to recover textures faithfully by incorporating semantic prior into dehazing network since objects in haze-free images tend to show certain shapes, textures, and colors. We propose a semantic-aware dehazing network (SDNet) in which the semantic prior is taken as a color constraint for dehazing, benefiting the acquisition of a reasonable scene configuration. In addition, we design a densely connected block to capture global and local information for dehazing and semantic prior estimation. To eliminate the unnatural appearance of some objects, we propose to fuse the features from shallow and deep layers adaptively. Experimental results demonstrate that our proposed model performs favorably against the state-of-the-art single image dehazing approaches.
Collapse
|
4
|
Application Analysis of Radial Basis Function Neural Network Algorithm of Genetic Algorithm for Environmental Restoration and Treatment Effect Evaluation of Decommissioned Uranium Tailings Ponds. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2021; 2021:1650096. [PMID: 34868285 PMCID: PMC8635904 DOI: 10.1155/2021/1650096] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/24/2021] [Revised: 11/02/2021] [Accepted: 11/05/2021] [Indexed: 11/18/2022]
Abstract
A new analysis method for the environmental stability of uranium tailing ponds is established in this paper, and the stability intervals and environmental stability rates of indicators are defined in precise mathematical language and analyzed with examples. The results show that the overall environmental stability of this uranium tailings pond is still in a poor state after the first phase of decommissioning treatment, and special decommissioning treatment should be carried out for factors such as pH and radionuclides Po and Pb. Using the powerful nonlinear mapping function of the artificial neural network, a radial basis function neural network algorithm was constructed to predict the environmental stability of the uranium tailing pond. It provides a new feasible method for the comprehensive evaluation technology of uranium tailings ponds. Accuracy in DOA Estimation. The research work in this paper mainly analyzed the environmental stabilization process and stability of decommissioned uranium tailings ponds, proposed a new concept of environmental stability with ecological and environmental protection concepts and gave it a new connotation, established an environmental stability evaluation index system for decommissioned uranium tailings ponds through index screening by using rough set theory, comprehensively considered the influence of environmental factors such as external wastewater and exhaust gas, and realized the multifactor. The system of evaluation indexes for the stability of decommissioned uranium tailings ponds was established by combining multiple factors, and the long-term monitoring and modeling of the environmental stabilization process of decommissioned uranium tailings ponds was carried out by using mathematical methods. The results show that the RBFNN-GA algorithm can reduce the training error of the random radial basis function neural network, improve the generalization ability of the network, and make it capable of handling large data sets.
Collapse
|
5
|
Wang YT, Zhao XL, Jiang TX, Deng LJ, Chang Y, Huang TZ. Rain Streaks Removal for Single Image via Kernel-Guided Convolutional Neural Network. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2021; 32:3664-3676. [PMID: 32822310 DOI: 10.1109/tnnls.2020.3015897] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Recently emerged deep learning methods have achieved great success in single image rain streaks removal. However, existing methods ignore an essential factor in the rain streaks generation mechanism, i.e., the motion blur leading to the line pattern appearances. Thus, they generally produce overderaining or underderaining results. In this article, inspired by the generation mechanism, we propose a novel rain streaks removal framework using a kernel-guided convolutional neural network (KGCNN), achieving state-of-the-art performance with a simple network architecture. More precisely, our framework consists of three steps. First, we learn the motion blur kernel by a plain neural network, termed parameter network, from the detail layer of a rainy patch. Then, we stretch the learned motion blur kernel into a degradation map with the same spatial size as the rainy patch. Finally, we use the stretched degradation map together with the detail patches to train a deraining network with a typical ResNet architecture, which produces the rain streaks with the guidance of the learned motion blur kernel. Experiments conducted on extensive synthetic and real data demonstrate the effectiveness of the proposed KGCNN, in terms of rain streaks removal and image detail preservation.
Collapse
|
6
|
Ngo D, Lee S, Ngo TM, Lee GD, Kang B. Visibility Restoration: A Systematic Review and Meta-Analysis. SENSORS 2021; 21:s21082625. [PMID: 33918021 PMCID: PMC8069147 DOI: 10.3390/s21082625] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/03/2021] [Revised: 03/29/2021] [Accepted: 04/06/2021] [Indexed: 11/16/2022]
Abstract
Image acquisition is a complex process that is affected by a wide variety of internal and environmental factors. Hence, visibility restoration is crucial for many high-level applications in photography and computer vision. This paper provides a systematic review and meta-analysis of visibility restoration algorithms with a focus on those that are pertinent to poor weather conditions. This paper starts with an introduction to optical image formation and then provides a comprehensive description of existing algorithms as well as a comparative evaluation. Subsequently, there is a thorough discussion on current difficulties that are worthy of a scientific effort. Moreover, this paper proposes a general framework for visibility restoration in hazy weather conditions while using haze-relevant features and maximum likelihood estimates. Finally, a discussion on the findings and future developments concludes this paper.
Collapse
Affiliation(s)
- Dat Ngo
- Department of Electronics Engineering, Dong-A University, Busan 49315, Korea; (D.N.); (S.L.); (G.-D.L.)
| | - Seungmin Lee
- Department of Electronics Engineering, Dong-A University, Busan 49315, Korea; (D.N.); (S.L.); (G.-D.L.)
| | - Tri Minh Ngo
- Faculty of Electronics and Telecommunication Engineering, The University of Danang—University of Science and Technology, Danang 550000, Vietnam;
| | - Gi-Dong Lee
- Department of Electronics Engineering, Dong-A University, Busan 49315, Korea; (D.N.); (S.L.); (G.-D.L.)
| | - Bongsoon Kang
- Department of Electronics Engineering, Dong-A University, Busan 49315, Korea; (D.N.); (S.L.); (G.-D.L.)
- Correspondence: ; Tel.: +82-51-200-7703
| |
Collapse
|
7
|
|
8
|
|
9
|
|
10
|
Abiodun OI, Jantan A, Omolara AE, Dada KV, Mohamed NA, Arshad H. State-of-the-art in artificial neural network applications: A survey. Heliyon 2018; 4:e00938. [PMID: 30519653 PMCID: PMC6260436 DOI: 10.1016/j.heliyon.2018.e00938] [Citation(s) in RCA: 501] [Impact Index Per Article: 71.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2018] [Revised: 10/19/2018] [Accepted: 11/13/2018] [Indexed: 11/16/2022] Open
Abstract
This is a survey of neural network applications in the real-world scenario. It provides a taxonomy of artificial neural networks (ANNs) and furnish the reader with knowledge of current and emerging trends in ANN applications research and area of focus for researchers. Additionally, the study presents ANN application challenges, contributions, compare performances and critiques methods. The study covers many applications of ANN techniques in various disciplines which include computing, science, engineering, medicine, environmental, agriculture, mining, technology, climate, business, arts, and nanotechnology, etc. The study assesses ANN contributions, compare performances and critiques methods. The study found that neural-network models such as feedforward and feedback propagation artificial neural networks are performing better in its application to human problems. Therefore, we proposed feedforward and feedback propagation ANN models for research focus based on data analysis factors like accuracy, processing speed, latency, fault tolerance, volume, scalability, convergence, and performance. Moreover, we recommend that instead of applying a single method, future research can focus on combining ANN models into one network-wide application.
Collapse
Affiliation(s)
- Oludare Isaac Abiodun
- School of Computer Sciences, Universiti Sains Malaysia, Penang, Malaysia
- Department of Computer Science, Bingham University, Karu, Nigeria
| | - Aman Jantan
- School of Computer Sciences, Universiti Sains Malaysia, Penang, Malaysia
| | | | - Kemi Victoria Dada
- Department of Mathematical Sciences, Nasarawa State University, Keffi, Nigeria
| | | | - Humaira Arshad
- Department of Computer Science and Information Technology, Islamia University of Bahawalpur, Pakistan
| |
Collapse
|
11
|
Iterative Refinement of Transmission Map for Stereo Image Defogging Using a Dual Camera Sensor. SENSORS 2017; 17:s17122861. [PMID: 29232826 PMCID: PMC5751095 DOI: 10.3390/s17122861] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/28/2017] [Revised: 11/27/2017] [Accepted: 12/06/2017] [Indexed: 11/17/2022]
Abstract
Recently, the stereo imaging-based image enhancement approach has attracted increasing attention in the field of video analysis. This paper presents a dual camera-based stereo image defogging algorithm. Optical flow is first estimated from the stereo foggy image pair, and the initial disparity map is generated from the estimated optical flow. Next, an initial transmission map is generated using the initial disparity map. Atmospheric light is then estimated using the color line theory. The defogged result is finally reconstructed using the estimated transmission map and atmospheric light. The proposed method can refine the transmission map iteratively. Experimental results show that the proposed method can successfully remove fog without color distortion. The proposed method can be used as a pre-processing step for an outdoor video analysis system and a high-end smartphone with a dual camera system.
Collapse
|