Super-Resolution of Optical Coherence Tomography Images by Scale Mixture Models

Tensor Methods in Biomedical Image Analysis

In the past decade, tensors have become increasingly attractive in different aspects of signal and image processing areas. The main reason is the inefficiency of matrices in representing and analyzing multimodal and multidimensional datasets. Matrices cannot preserve the multidimensional correlation of elements in higher-order datasets and this highly reduces the effectiveness of matrix-based approaches in analyzing multidimensional datasets. Besides this, tensor-based approaches have demonstrated promising performances. These together, encouraged researchers to move from matrices to tensors. Among different signal and image processing applications, analyzing biomedical signals and images is of particular importance. This is due to the need for extracting accurate information from biomedical datasets which directly affects patient's health. In addition, in many cases, several datasets have been recorded simultaneously from a patient. A common example is recording electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) of a patient with schizophrenia. In such a situation, tensors seem to be among the most effective methods for the simultaneous exploitation of two (or more) datasets. Therefore, several tensor-based methods have been developed for analyzing biomedical datasets. Considering this reality, in this paper, we aim to have a comprehensive review on tensor-based methods in biomedical image analysis. The presented study and classification between different methods and applications can show the importance of tensors in biomedical image enhancement and open new ways for future studies.

Tensor Ring Decomposition Guided Dictionary Learning for OCT Image Denoising

Optical coherence tomography (OCT) is a non-invasive and effective tool for the imaging of retinal tissue. However, the heavy speckle noise, resulting from multiple scattering of the light waves, obscures important morphological structures and impairs the clinical diagnosis of ocular diseases. In this paper, we propose a novel and powerful model known as tensor ring decomposition-guided dictionary learning (TRGDL) for OCT image denoising, which can simultaneously utilize two useful complementary priors, i.e., three-dimensional low-rank and sparsity priors, under a unified framework. Specifically, to effectively use the strong correlation between nearby OCT frames, we construct the OCT group tensors by extracting cubic patches from OCT images and clustering similar patches. Then, since each created OCT group tensor has a low-rank structure, to exploit spatial, non-local, and its temporal correlations in a balanced way, we enforce the TR decomposition model on each OCT group tensor. Next, to use the beneficial three-dimensional inter-group sparsity, we learn shared dictionaries in both spatial and temporal dimensions from all of the stacked OCT group tensors. Furthermore, we develop an effective algorithm to solve the resulting optimization problem by using two efficient optimization approaches, including proximal alternating minimization and the alternative direction method of multipliers. Finally, extensive experiments on OCT datasets from various imaging devices are conducted to prove the generality and usefulness of the proposed TRGDL model. Experimental simulation results show that the suggested TRGDL model outperforms state-of-the-art approaches for OCT image denoising both qualitatively and quantitatively.

Total variation regularized tensor ring decomposition for OCT image denoising and super-resolution

This paper suggests a novel hybrid tensor-ring (TR) decomposition and first-order tensor-based total variation (FOTTV) model, known as the TRFOTTV model, for super-resolution and noise suppression of optical coherence tomography (OCT) images. OCT imaging faces two fundamental problems undermining correct OCT-based diagnosis: significant noise levels and low sampling rates to speed up the capturing process. Inspired by the effectiveness of TR decomposition in analyzing complicated data structures, we suggest the TRFOTTV model for noise suppression and super-resolution of OCT images. Initially, we extract the nonlocal 3D patches from OCT data and group them to create a third-order low-rank tensor. Subsequently, using TR decomposition, we extract the correlations among all modes of the grouped OCT tensor. Finally, FOTTV is integrated into the TR model to enhance spatial smoothness in OCT images and conserve layer structures more effectively. The proximal alternating minimization and alternative direction method of multipliers are applied to solve the obtained optimization problem. The effectiveness of the suggested method is verified by four OCT datasets, demonstrating superior visual and numerical outcomes compared to state-of-the-art procedures.

Super-resolution of Retinal Optical Coherence Tomography Images Using Statistical Modeling

Background

Optical coherence tomography (OCT) imaging has emerged as a promising diagnostic tool, especially in ophthalmology. However, speckle noise and downsampling significantly degrade the quality of OCT images and hinder the development of OCT-assisted diagnostics. In this article, we address the super-resolution (SR) problem of retinal OCT images using a statistical modeling point of view.

Methods

In the first step, we utilized Weibull mixture model (WMM) as a comprehensive model to establish the specific features of the intensity distribution of retinal OCT data, such as asymmetry and heavy tailed. To fit the WMM to the low-resolution OCT images, expectation-maximization algorithm is used to estimate the parameters of the model. Then, to reduce the existing noise in the data, a combination of Gaussian transform and spatially constraint Gaussian mixture model is applied. Now, to super-resolve OCT images, the expected patch log-likelihood is used which is a patch-based algorithm with multivariate GMM prior assumption. It restores the high-resolution (HR) images with maximum a posteriori (MAP) estimator.

Results

The proposed method is compared with some well-known super-resolution algorithms visually and numerically. In terms of the mean-to-standard deviation ratio (MSR) and the equivalent number of looks, our method makes a great superiority compared to the other competitors.

Conclusion

The proposed method is simple and does not require any special preprocessing or measurements. The results illustrate that our method not only significantly suppresses the noise but also successfully reconstructs the image, leading to improved visual quality.

Tensor Ring Based Image Enhancement

Background

Image enhancement, including image de-noising, super-resolution, registration, reconstruction, in-painting, and so on, is an important issue in different research areas. Different methods which have been exploited for image analysis were mostly based on matrix or low order analysis. However, recent researches show the superior power of tensor-based methods for image enhancement.

Method

In this article, a new method for image super-resolution using Tensor Ring decomposition has been proposed. The proposed image super-resolution technique has been derived for the super-resolution of low resolution and noisy images. The new approach is based on a modification and extension of previous tensor-based approaches used for super-resolution of datasets. In this method, a weighted combination of the original and the resulting image of the previous stage has been computed and used to provide a new input to the algorithm.

Result

This enables the method to do the super-resolution and de-noising simultaneously.

Conclusion

Simulation results show the effectiveness of the proposed approach, especially in highly noisy situations.

MAD-Net: Multi-attention dense network for functional bone marrow segmentation

Radiotherapy is the main treatment modality for various pelvic malignancies. However, high intensity radiation can damage the functional bone marrow (FBM), resulting in hematological toxicity (HT). Accurate identification and protection of the FBM during radiotherapy planning can reduce pelvic HT. The traditional manual method for contouring the FBM is time-consuming and laborious. Therefore, development of an efficient and accurate automatic segmentation mode can provide a distinct leverage in clinical settings. In this paper, we propose the first network for performing the FBM segmentation task, which is referred to as the multi-attention dense network (named MAD-Net). Primarily, we introduce the dense convolution block to promote the gradient flow in the network as well as incite feature reuse. Next, a novel slide-window attention module is proposed to emphasize long-range dependencies and exploit interdependencies between features. Finally, we design a residual-dual attention module as the bottleneck layer, which further aggregates useful spatial details and explores intra-class responsiveness of high-level features. In this work, we conduct extensive experiments on our dataset of 3838 two-dimensional pelvic slices. Experimental results demonstrate that the proposed MAD-Net transcends previous state-of-the-art models in various metrics. In addition, the contributions of the proposed components are verified by ablation analysis, and we conduct experiments on three other datasets to manifest the generalizability of MAD-Net.

Mixed multiscale BM4D for three-dimensional optical coherence tomography denoising

A multiscale extension for the well-known block matching and 4D filtering (BM4D) method is proposed by analyzing and extending the wavelet subbands denoising method in such a way that the proposed method avoids directly denoising detail subbands, which considerably simplifies the computations and makes the multiscale processing feasible in 3D. To this end, we first derive the multiscale construction method in 2D and propose multiscale extensions for three 2D natural image denoising methods. Then, the derivation is extended to 3D by proposing mixed multiscale BM4D (mmBM4D) for optical coherence tomography (OCT) image denoising. We tested mmBM4D on three public OCT datasets captured by various imaging devices. The experiments revealed that mmBM4D significantly outperforms its original counterpart and performs on par with the state-of-the-art OCT denoising methods. In terms of peak-signal-to-noise-ratio (PSNR), mmBM4D surpasses the original BM4D by more than 0.68 decibels over the first dataset. In the second and third datasets, significant improvements in the mean to standard deviation ratio, contrast to noise ratio, and equivalent number of looks were achieved. Furthermore, on the downstream task of retinal layer segmentation, the layer quality preservation of the compared OCT denoising methods is evaluated.

Screen Content Video Quality Assessment Model Using Hybrid Spatiotemporal Features

In this paper, a full-reference video quality assessment (VQA) model is designed for the perceptual quality assessment of the screen content videos (SCVs), called the hybrid spatiotemporal feature-based model (HSFM). The SCVs are of hybrid structure including screen and natural scenes, which are perceived by the human visual system (HVS) with different visual effects. With this consideration, the three dimensional Laplacian of Gaussian (3D-LOG) filter and three dimensional Natural Scene Statistics (3D-NSS) are exploited to extract the screen and natural spatiotemporal features, based on the reference and distorted SCV sequences separately. The similarities of these extracted features are then computed independently, followed by generating the distorted screen and natural quality scores for screen and natural scenes. After that, an adaptive screen and natural quality fusion scheme through the local video activity is developed to combine them for arriving at the final VQA score of the distorted SCV under evaluation. The experimental results on the Screen Content Video Database (SCVD) and Compressed Screen Content Video Quality (CSCVQ) databases have shown that the proposed HSFM is more in line with the perceptual quality assessment of the SCVs perceived by the HVS, compared with a variety of classic and latest IQA/VQA models.

Noise-Powered Disentangled Representation for Unsupervised Speckle Reduction of Optical Coherence Tomography Images

Due to its noninvasive character, optical coherence tomography (OCT) has become a popular diagnostic method in clinical settings. However, the low-coherence interferometric imaging procedure is inevitably contaminated by heavy speckle noise, which impairs both visual quality and diagnosis of various ocular diseases. Although deep learning has been applied for image denoising and achieved promising results, the lack of well-registered clean and noisy image pairs makes it impractical for supervised learning-based approaches to achieve satisfactory OCT image denoising results. In this paper, we propose an unsupervised OCT image speckle reduction algorithm that does not rely on well-registered image pairs. Specifically, by employing the ideas of disentangled representation and generative adversarial network, the proposed method first disentangles the noisy image into content and noise spaces by corresponding encoders. Then, the generator is used to predict the denoised OCT image with the extracted content features. In addition, the noise patches cropped from the noisy image are utilized to facilitate more accurate disentanglement. Extensive experiments have been conducted, and the results suggest that our proposed method is superior to the classic methods and demonstrates competitive performance to several recently proposed learning-based approaches in both quantitative and qualitative aspects. Code is available at: https://github.com/tsmotlp/DRGAN-OCT.

Noise Reduction for SD-OCT Using a Structure-Preserving Domain Transfer Approach

Spectral-domain optical coherence tomography (SD-OCT) images inevitably suffer from multiplicative speckle noise caused by random interference. This study proposes an unsupervised domain adaptation approach for noise reduction by translating the SD-OCT to the corresponding high-quality enhanced depth imaging (EDI)-OCT. We propose a structure-persevered cycle-consistent generative adversarial network for unpaired image-to-image translation, which can be applied to imbalanced unpaired data, and can effectively preserve retinal details based on a structure-specific cross-domain description. It also imposes smoothness by penalizing the intensity variation of the low reflective region between consecutive slices. Our approach was tested on a local data set that consisted of 268 SD-OCT volumes and two public independent validation datasets including 20 SD-OCT volumes and 17 B-scans, respectively. Experimental results show that our method can effectively suppress noise and maintain the retinal structure, compared with other traditional approaches and deep learning methods in terms of qualitative and quantitative assessments. Our proposed method shows good performance for speckle noise reduction and can assist downstream tasks of OCT analysis.

A Multichannel Intraluminal Impedance Gastroesophageal Reflux Characterization Algorithm Based On Sparse Representation

Gastroesophageal reflux disease (GERD) is a common digestive disorder with troublesome symptoms that has been affected millions of people worldwide. Multichannel Intraluminal Impedance-pH (MII-pH) monitoring is a recently developed technique, which is currently considered as the gold standard for the diagnosis of GERD. In this paper, we address the problem of characterizing gastroesophageal reflux events in MII signals. A GER detection algorithm has been developed based on the sparse representation of local segments. Two dictionaries are trained using the online dictionary learning approach from the distal impedance data of selected patches of GER and no specific patterns intervals. A classifier is then designed based on the l_p-norm of dictionary approximations. Next, a preliminary permutation mask is obtained from the classification results of patches, which is then used in post-processing procedure to investigate the exact timings of GERs at all impedance sites. Our algorithm was tested on 33 MII episodes, resulting a sensitivity of 96.97% and a positive predictive value of 94.12%.

Statistical modeling of retinal optical coherence tomography using the Weibull mixture model

In this paper, a novel statistical model is proposed for retinal optical coherence tomography (OCT) images. According to the layered structure of the retina, a mixture of six Weibull distributions is proposed to describe the main statistical features of OCT images. We apply Weibull distribution to establish a more comprehensive model but with fewer parameters that has better goodness of fit (GoF) than previous models. Our new model also takes care of features such as asymmetry and heavy-tailed nature of the intensity distribution of retinal OCT data. In order to test the effectiveness of this new model, we apply it to improve the low quality of the OCT images. For this purpose, the spatially constrained Gaussian mixture model (SCGMM) is implemented. Since SCGMM is designed for data with Gaussian distribution, we convert our Weibull mixture model to a Gaussian mixture model using histogram matching before applying SCGMM. The denoising results illustrate the remarkable performance in terms of the contrast to noise ratio (CNR) and texture preservation (TP) compared to other peer methods. In another test to evaluate the efficiency of our proposed model, the parameters and GoF criteria are considered as a feature vector for support vector machine (SVM) to classify the healthy retinal OCT images from pigment epithelial detachment (PED) disease. The confusion matrix demonstrates the impact of the proposed model in our preliminary study on the OCT classification problem.

Modeling of Retinal Optical Coherence Tomography Based on Stochastic Differential Equations: Application to Denoising

In this paper a statistical modeling, based on stochastic differential equations (SDEs), is proposed for retinal Optical Coherence Tomography (OCT) images. In this method, pixel intensities of image are considered as discrete realizations of a Levy stable process. This process has independent increments and can be expressed as response of SDE to a white symmetric alpha stable (s [Formula: see text]) noise. Based on this assumption, applying appropriate differential operator makes intensities statistically independent. Mentioned white stable noise can be regenerated by applying fractional Laplacian operator to image intensities. In this way, we modeled OCT images as s [Formula: see text] distribution. We applied fractional Laplacian operator to image and fitted s [Formula: see text] to its histogram. Statistical tests were used to evaluate goodness of fit of stable distribution and its heavy tailed and stability characteristics. We used modeled s [Formula: see text] distribution as prior information in maximum a posteriori (MAP) estimator in order to reduce the speckle noise of OCT images. Such a statistically independent prior distribution simplified denoising optimization problem to a regularization algorithm with an adjustable shrinkage operator for each image. Alternating Direction Method of Multipliers (ADMM) algorithm was utilized to solve the denoising problem. We presented visual and quantitative evaluation results of the performance of this modeling and denoising methods for normal and abnormal images. Applying parameters of model in classification task as well as indicating effect of denoising in layer segmentation improvement illustrates that the proposed method describes OCT data more accurately than other models that do not remove statistical dependencies between pixel intensities.