Parameter estimation for blind and non-blind deblurring using residual whiteness measures

ADMM-inspired image reconstruction for terahertz off-axis digital holography

Image reconstruction in off-axis terahertz digital holography is complicated due to the harsh recording conditions and the non-convexity form of the problem. In this paper, we propose an inverse problem-based reconstruction technique that jointly reconstructs the object field and the amplitude of the reference field. Regularization in the wavelet domain promotes a sparse object solution. A single objective function combining the data-fidelity and regularization terms is optimized with a dedicated algorithm based on an alternating direction method of multipliers framework. Each iteration alternates between two consecutive optimizations using projections operating on each solution and one soft thresholding operator applying to the object solution. The method is preceded by a windowing process to alleviate artifacts due to the mismatch between camera frame truncation and periodic boundary conditions assumed to implement convolution operators. Experiments demonstrate the effectiveness of the proposed method, in particular, improvements of reconstruction quality, compared to two other methods.

A review of microscopic cell imaging and neural network recognition for synergistic cyanobacteria identification and enumeration

Real-time cyanobacteria/algal monitoring is a valuable tool for early detection of harmful algal blooms, water treatment efficacy evaluation, and assists tailored water quality risk assessments by considering taxonomy and cell counts. This review evaluates and proposes a synergistic approach using neural network image recognition and microscopic imaging devices by first evaluating published literature for both imaging microscopes and image recognition. Quantitative phase imaging was considered the most promising of the investigated imaging techniques due to the provision of enhanced information relative to alternatives. This information provides significant value to image recognition neural networks, such as the convolutional neural networks discussed within this review. Considering published literature, a cyanobacteria monitoring system and corresponding image processing workflow using in situ sample collection buoys and on-shore sample processing was proposed. This system can be implemented using commercially available equipment to facilitate accurate, real-time water quality monitoring.

Blind Deblurring of Text Images Using a Text-Specific Hybrid Dictionary

In this paper, we propose a blind text image deblurring algorithm by using a text-specific hybrid dictionary. After careful analysis, we find that the text-specific hybrid dictionary has the great ability of providing powerful contextual information for text image deblurring. Here, it is worth noting that our proposed method is inspired by our observation that an intermediate latent image contains not only sharp regions, but also multiple types of small blurred regions. Based upon our discovery, we propose a prior for text images based on sparse representation, which models the relationship between an intermediate latent image and a desired sharp image. To this end, we carefully collect three different image patch pairs, which are 1) Gaussian blur-sharp, 2) motion blur-sharp, and 3) sharp-sharp, in order to construct the text-specific hybrid dictionary. We also propose a new optimization framework suitable for the task of text image deblurring in this paper. Extensive experiments have been conducted on a challenging dataset of synthetic and real-world text images. Our results demonstrate that the proposed method outperforms the state-of-the-art image deblurring methods both quantitatively and qualitatively.

Comparison-Based Image Quality Assessment for Selecting Image Restoration Parameters

Image quality assessment (IQA) is traditionally classified into full-reference (FR) IQA, reduced-reference (RR) IQA, and no-reference (NR) IQA according to the amount of information required from the original image. Although NR-IQA and RR-IQA are widely used in practical applications, room for improvement still remains because of the lack of the reference image. Inspired by the fact that in many applications, such as parameter selection for image restoration algorithms, a series of distorted images are available, the authors propose a novel comparison-based IQA (C-IQA) framework. The new comparison-based framework parallels FR-IQA by requiring two input images and resembles NR-IQA by not using the original image. As a result, the new comparison-based approach has more application scenarios than FR-IQA does, and takes greater advantage of the accessible information than the traditional single-input NR-IQA does. Further, C-IQA is compared with other state-of-the-art NR-IQA methods and another RR-IQA method on two widely used IQA databases. Experimental results show that C-IQA outperforms the other methods for parameter selection, and the parameter trimming framework combined with C-IQA saves the computation of iterative image reconstruction up to 80%.

A Framework for Fast Image Deconvolution With Incomplete Observations

In image deconvolution problems, the diagonalization of the underlying operators by means of the fast Fourier transform (FFT) usually yields very large speedups. When there are incomplete observations (e.g., in the case of unknown boundaries), standard deconvolution techniques normally involve non-diagonalizable operators, resulting in rather slow methods or, otherwise, use inexact convolution models, resulting in the occurrence of artifacts in the enhanced images. In this paper, we propose a new deconvolution framework for images with incomplete observations that allows us to work with diagonalized convolution operators, and therefore is very fast. We iteratively alternate the estimation of the unknown pixels and of the deconvolved image, using, e.g., an FFT-based deconvolution method. This framework is an efficient, high-quality alternative to existing methods of dealing with the image boundaries, such as edge tapering. It can be used with any fast deconvolution method. We give an example in which a state-of-the-art method that assumes periodic boundary conditions is extended, using this framework, to unknown boundary conditions. Furthermore, we propose a specific implementation of this framework, based on the alternating direction method of multipliers (ADMM). We provide a proof of convergence for the resulting algorithm, which can be seen as a "partial" ADMM, in which not all variables are dualized. We report experimental comparisons with other primal-dual methods, where the proposed one performed at the level of the state of the art. Four different kinds of applications were tested in the experiments: deconvolution, deconvolution with inpainting, superresolution, and demosaicing, all with unknown boundaries.

Closed-Loop Restoration Approach to Blurry Images Based on Machine Learning and Feedback Optimization

Blind image deconvolution (BID) aims to remove or reduce the degradations that have occurred during the acquisition or processing. It is a challenging ill-posed problem due to a lack of enough information in degraded image for unambiguous recovery of both point spread function (PSF) and clear image. Although recently many powerful algorithms appeared; however, it is still an active research area due to the diversity of degraded images as well as degradations. Closed-loop control systems are characterized with their powerful ability to stabilize the behavior response and overcome external disturbances by designing an effective feedback optimization. In this paper, we employed feedback control to enhance the stability of BID by driving the current estimation quality of PSF to the desired level without manually selecting restoration parameters and using an effective combination of machine learning with feedback optimization. The foremost challenge when designing a feedback structure is to construct or choose a suitable performance metric as a controlled index and a feedback information. Our proposed quality metric is based on the blur assessment of deconvolved patches to identify the best PSF and computing its relative quality. The Kalman filter-based extremum seeking approach is employed to find the optimum value of controlled variable. To find better restoration parameters, learning algorithms, such as multilayer perceptron and bagged decision trees, are used to estimate the generic PSF support size instead of trial and error methods. The problem is modeled as a combination of pattern classification and regression using multiple training features, including noise metrics, blur metrics, and low-level statistics. Multi-objective genetic algorithm is used to find key patches from multiple saliency maps which enhance performance and save extra computation by avoiding ineffectual regions of the image. The proposed scheme is shown to outperform corresponding open-loop schemes, which often fails or needs many assumptions regarding images and thus resulting in sub-optimal results.

Image deconvolution by means of frequency blur invariant concept

Different blur invariant descriptors have been proposed so far, which are either in the spatial domain or based on the properties available in the moment domain. In this paper, a frequency framework is proposed to develop blur invariant features that are used to deconvolve a degraded image caused by a Gaussian blur. These descriptors are obtained by establishing an equivalent relationship between the normalized Fourier transforms of the blurred and original images, both normalized by their respective fixed frequencies set to one. Advantage of using the proposed invariant descriptors is that it is possible to estimate both the point spread function (PSF) and the original image. The performance of frequency invariants will be demonstrated through experiments. An image deconvolution is done as an additional application to verify the proposed blur invariant features.

Moment domain representation of nonblind image deblurring

In this paper, we propose the use of geometric moments to the field of nonblind image deblurring. Using the developed relationship of geometric moments for original and blurred images, a mathematical formulation based on the Euler-Lagrange identity and variational techniques is proposed. It uses an iterative procedure to deblur the image in moment domain. The theoretical framework is validated by a set of experiments. A comparative analysis of the results obtained using the spatial and moment domains are evaluated using a quality assessment method known as the Blind/Reference-less Image Spatial Quality Evaluator (BRISQUE). The results show that the proposed method yields a higher quality score when compared with the spatial domain method for the same number of iterations.