1
|
Zhang Z, Liu Z, Ning L, Martin A, Xiong J. Representation of Imprecision in Deep Neural Networks for Image Classification. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2025; 36:1199-1212. [PMID: 37948150 DOI: 10.1109/tnnls.2023.3329712] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/12/2023]
Abstract
Quantification and reduction of uncertainty in deep-learning techniques have received much attention but ignored how to characterize the imprecision caused by such uncertainty. In some tasks, we prefer to obtain an imprecise result rather than being willing or unable to bear the cost of an error. For this purpose, we investigate the representation of imprecision in deep-learning (RIDL) techniques based on the theory of belief functions (TBF). First, the labels of some training images are reconstructed using the learning mechanism of neural networks to characterize the imprecision in the training set. In the process, a label assignment rule is proposed to reassign one or more labels to each training image. Once an image is assigned with multiple labels, it indicates that the image may be in an overlapping region of different categories from the feature perspective or the original label is wrong. Second, those images with multiple labels are rechecked. As a result, the imprecision (multiple labels) caused by the original labeling errors will be corrected, while the imprecision caused by insufficient knowledge is retained. Images with multiple labels are called imprecise ones, and they are considered to belong to meta-categories, the union of some specific categories. Third, the deep network model is retrained based on the reconstructed training set, and the test images are then classified. Finally, some test images that specific categories cannot distinguish will be assigned to meta-categories to characterize the imprecision in the results. Experiments based on some remarkable networks have shown that RIDL can improve accuracy (AC) and reasonably represent imprecision both in the training and testing sets.
Collapse
|
2
|
Ali Shah SM, Casado-Mansilla D, López-de-Ipiña D. An Image-Based Sensor System for Low-Cost Airborne Particle Detection in Citizen Science Air Quality Monitoring. SENSORS (BASEL, SWITZERLAND) 2024; 24:6425. [PMID: 39409465 PMCID: PMC11479298 DOI: 10.3390/s24196425] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/09/2024] [Revised: 09/30/2024] [Accepted: 10/02/2024] [Indexed: 10/20/2024]
Abstract
Air pollution poses significant public health risks, necessitating accurate and efficient monitoring of particulate matter (PM). These organic compounds may be released from natural sources like trees and vegetation, as well as from anthropogenic, or human-made sources including industrial activities and motor vehicle emissions. Therefore, measuring PM concentrations is paramount to understanding people's exposure levels to pollutants. This paper introduces a novel image processing technique utilizing photographs/pictures of Do-it-Yourself (DiY) sensors for the detection and quantification of PM10 particles, enhancing community involvement and data collection accuracy in Citizen Science (CS) projects. A synthetic data generation algorithm was developed to overcome the challenge of data scarcity commonly associated with citizen-based data collection to validate the image processing technique. This algorithm generates images by precisely defining parameters such as image resolution, image dimension, and PM airborne particle density. To ensure these synthetic images mimic real-world conditions, variations like Gaussian noise, focus blur, and white balance adjustments and combinations were introduced, simulating the environmental and technical factors affecting image quality in typical smartphone digital cameras. The detection algorithm for PM10 particles demonstrates robust performance across varying levels of noise, maintaining effectiveness in realistic mobile imaging conditions. Therefore, the methodology retains sufficient accuracy, suggesting its practical applicability for environmental monitoring in diverse real-world conditions using mobile devices.
Collapse
Affiliation(s)
| | - Diego Casado-Mansilla
- Faculty of Engineering, University of Deusto, 48007 Bilbao, Spain; (D.C.-M.); (D.L.d.-I.)
| | - Diego López-de-Ipiña
- Faculty of Engineering, University of Deusto, 48007 Bilbao, Spain; (D.C.-M.); (D.L.d.-I.)
| |
Collapse
|
3
|
Dong W, Wang Q, Tao S, Tian C. Blind multi-Poissonian image deconvolution with sparse log-step gradient prior. OPTICS EXPRESS 2024; 32:9061-9080. [PMID: 38571148 DOI: 10.1364/oe.513604] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/07/2023] [Accepted: 02/16/2024] [Indexed: 04/05/2024]
Abstract
Blind image deconvolution plays a very important role in the fields such as astronomical observation and fluorescence microscopy imaging, in which the noise follows Poisson distribution. However, due to the ill-posedness, it is a very challenging task to reach a satisfactory result from a single blurred image especially when the power of the Poisson noise is at a high level. Therefore, in this paper, we try to achieve high-quality restoration results with multi-blurred images which are contaminated by Poisson noise. Firstly, we design a novel sparse log-step gradient prior which adopts a mixture of logarithm and step functions to regularize the image gradients and combine it with the Poisson distribution to formulate the blind multi-image deconvolution problem. Secondly, we incorporate the methods of variable splitting and Lagrange multiplier to convert the original problem into sub-problems, then we alternately solve them to achieve the estimation of all the blur kernels of corresponding blurred images. Besides, we also design a non-blind multi-image deconvolution algorithm which is based on the log-step gradient prior to reach the final restored image. Experimental results on both synthetic and real-world blurred images show that the proposed prior is very capable of suppressing negative artifacts caused by ill-posedness. The algorithm can achieve restored image of very high quality which is competitive with some state-of-the-art methods.
Collapse
|
4
|
Zhou F, Wen G, Ma Y, Ma Y, Pan H, Geng H, Cao J, Fu Y, Zhou S, Wang K. A two-branch cloud detection algorithm based on the fusion of a feature enhancement module and Gaussian mixture model. MATHEMATICAL BIOSCIENCES AND ENGINEERING : MBE 2023; 20:21588-21610. [PMID: 38124611 DOI: 10.3934/mbe.2023955] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/23/2023]
Abstract
Accurate cloud detection is an important step to improve the utilization rate of remote sensing (RS). However, existing cloud detection algorithms have difficulty in identifying edge clouds and broken clouds. Therefore, based on the channel data of the Himawari-8 satellite, this work proposes a method that combines the feature enhancement module with the Gaussian mixture model (GMM). First, statistical analysis using the probability density functions (PDFs) of spectral data from clouds and underlying surface pixels was conducted, selecting cluster features suitable for daytime and nighttime. Then, in this work, the Laplacian operator is introduced to enhance the spectral features of cloud edges and broken clouds. Additionally, enhanced spectral features are input into the debugged GMM model for cloud detection. Validation against visual interpretation shows promising consistency, with the proposed algorithm outperforming other methods such as RF, KNN and GMM in accuracy metrics, demonstrating its potential for high-precision cloud detection in RS images.
Collapse
Affiliation(s)
- Fangrong Zhou
- Joint Laboratory of Power Remote Sensing Technology (Electric Power Research Institute, Yunnan Power Grid Company ltd.), Kunming 650217, China
| | - Gang Wen
- Joint Laboratory of Power Remote Sensing Technology (Electric Power Research Institute, Yunnan Power Grid Company ltd.), Kunming 650217, China
| | - Yi Ma
- Joint Laboratory of Power Remote Sensing Technology (Electric Power Research Institute, Yunnan Power Grid Company ltd.), Kunming 650217, China
| | - Yutang Ma
- Joint Laboratory of Power Remote Sensing Technology (Electric Power Research Institute, Yunnan Power Grid Company ltd.), Kunming 650217, China
| | - Hao Pan
- Joint Laboratory of Power Remote Sensing Technology (Electric Power Research Institute, Yunnan Power Grid Company ltd.), Kunming 650217, China
| | - Hao Geng
- Joint Laboratory of Power Remote Sensing Technology (Electric Power Research Institute, Yunnan Power Grid Company ltd.), Kunming 650217, China
| | - Jun Cao
- Joint Laboratory of Power Remote Sensing Technology (Electric Power Research Institute, Yunnan Power Grid Company ltd.), Kunming 650217, China
| | - Yitong Fu
- Faculty of Electric Power Engineering, Kunming University of Science and Technology, Kunming 650000, China
| | - Shunzhen Zhou
- Faculty of Electric Power Engineering, Kunming University of Science and Technology, Kunming 650000, China
| | - Kaizheng Wang
- Faculty of Electric Power Engineering, Kunming University of Science and Technology, Kunming 650000, China
| |
Collapse
|
5
|
Cao S, Chang Y, Xu S, Fang H, Yan L. Nonlinear Deblurring for Low-Light Saturated Image. SENSORS (BASEL, SWITZERLAND) 2023; 23:3784. [PMID: 37112126 PMCID: PMC10146853 DOI: 10.3390/s23083784] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/19/2023] [Revised: 03/17/2023] [Accepted: 03/24/2023] [Indexed: 06/19/2023]
Abstract
Single image deblurring has achieved significant progress for natural daytime images. Saturation is a common phenomenon in blurry images, due to the low light conditions and long exposure times. However, conventional linear deblurring methods usually deal with natural blurry images well but result in severe ringing artifacts when recovering low-light saturated blurry images. To solve this problem, we formulate the saturation deblurring problem as a nonlinear model, in which all the saturated and unsaturated pixels are modeled adaptively. Specifically, we additionally introduce a nonlinear function to the convolution operator to accommodate the procedure of the saturation in the presence of the blurring. The proposed method has two advantages over previous methods. On the one hand, the proposed method achieves the same high quality of restoring the natural image as seen in conventional deblurring methods, while also reducing the estimation errors in saturated areas and suppressing ringing artifacts. On the other hand, compared with the recent saturated-based deblurring methods, the proposed method captures the formation of unsaturated and saturated degradations straightforwardly rather than with cumbersome and error-prone detection steps. Note that, this nonlinear degradation model can be naturally formulated into a maximum-a posterioriframework, and can be efficiently decoupled into several solvable sub-problems via the alternating direction method of multipliers (ADMM). Experimental results on both synthetic and real-world images demonstrate that the proposed deblurring algorithm outperforms the state-of-the-art low-light saturation-based deblurring methods.
Collapse
Affiliation(s)
- Shuning Cao
- The National Key Laboratory of Science and Technology on Multispectral Information Processing, School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan 430074, China; (S.C.)
- The Artificial Intelligence Center, Peng Cheng Laboratory, Shenzhen 518055, China
| | - Yi Chang
- The National Key Laboratory of Science and Technology on Multispectral Information Processing, School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan 430074, China; (S.C.)
| | - Shengqi Xu
- The National Key Laboratory of Science and Technology on Multispectral Information Processing, School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan 430074, China; (S.C.)
| | - Houzhang Fang
- The School of Computer Science and Technology, Xidian University, Xi’an 710071, China
| | - Luxin Yan
- The National Key Laboratory of Science and Technology on Multispectral Information Processing, School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan 430074, China; (S.C.)
| |
Collapse
|
6
|
Nasonov AV, Nasonova AA. Linear Blur Parameters Estimation Using a Convolutional Neural Network. PATTERN RECOGNITION AND IMAGE ANALYSIS 2022. [DOI: 10.1134/s1054661822030270] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
7
|
|