1
|
Sivaanpu A, Noga M, Becher H, Punithakumar K, Le LH. Denoising Echocardiography with an Improved Diffusion Model. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2024; 2024:1-4. [PMID: 40039219 DOI: 10.1109/embc53108.2024.10782561] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/06/2025]
Abstract
Echocardiography has been a crucial role in diagnosing cardiac disease. However, its effectiveness is often hindered by poor image clarity. Acoustic interference arises from multipath reflections caused by skin layers, subcutaneous fat, and intercostal muscle between the US transducer and the heart. Consequently, the appearance of noise and other artifacts presents a substantial obstacle to the accuracy of cardiac ultrasound imaging. Therefore, effective despeckling techniques are necessary to enhance the interpretability of ultrasound images and diagnostic results. Recently, diffusion approach has become a trending topic in computer vision. This paper proposes a diffusion model-based denoising method with an interpolation technique and a simple U-Net architecture to enhance ultrasound images' quality in an unsupervised manner. The proposed method generates the interim image by interpolating the initial noise-free image and its corresponding noisy image at each diffusion step. This method iteratively reduces the noise and preserves its texture to improve the quality of degraded images. The proposed approach was trained and then validated on two benchmarks. The experimental outcomes demonstrate that the proposed approach outperforms the other denoising approaches in clinically relevant qualitative and quantitative visual metrics. The source code will be made available at https://github.com/RPRO5/DiffUS.
Collapse
|
2
|
Varadarajan D, Magnain C, Fogarty M, Boas DA, Fischl B, Wang H. A novel algorithm for multiplicative speckle noise reduction in ex vivo human brain OCT images. Neuroimage 2022; 257:119304. [PMID: 35568350 PMCID: PMC10018743 DOI: 10.1016/j.neuroimage.2022.119304] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2022] [Revised: 05/06/2022] [Accepted: 05/10/2022] [Indexed: 10/18/2022] Open
Abstract
Optical coherence tomography (OCT) images of ex vivo human brain tissue are corrupted by multiplicative speckle noise that degrades the contrast to noise ratio (CNR) of microstructural compartments. This work proposes a novel algorithm to reduce noise corruption in OCT images that minimizes the penalized negative log likelihood of gamma distributed speckle noise. The proposed method is formulated as a majorize-minimize problem that reduces to solving an iterative regularized least squares optimization. We demonstrate the usefulness of the proposed method by removing speckle in simulated data, phantom data and real OCT images of human brain tissue. We compare the proposed method with state of the art filtering and non-local means based denoising methods. We demonstrate that our approach removes speckle accurately, improves CNR between different tissue types and better preserves small features and edges in human brain tissue.
Collapse
Affiliation(s)
- Divya Varadarajan
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA 02129, USA; Radiology, Harvard Medical School, Boston, MA 02115, USA.
| | - Caroline Magnain
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA 02129, USA; Radiology, Harvard Medical School, Boston, MA 02115, USA
| | - Morgan Fogarty
- Imaging Science Program, Washington University McKelvey School of Engineering, St. Louis, MO 63130, USA; Radiology, Washington University School of Medicine, St. Louis, MO 63110, USA
| | - David A Boas
- Biomedical Engineering and Electrical and Computer Engineering, Boston University, Boston, MA 02215, USA
| | - Bruce Fischl
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA 02129, USA; Radiology, Harvard Medical School, Boston, MA 02115, USA; Harvard-MIT Health Science and Technology, Massachusetts Institute of Technology, Cambridge, MA 02139, USA
| | - Hui Wang
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA 02129, USA; Radiology, Harvard Medical School, Boston, MA 02115, USA
| |
Collapse
|
3
|
Lévêque L, Outtas M, Liu H, Zhang L. Comparative study of the methodologies used for subjective medical image quality assessment. Phys Med Biol 2021; 66. [PMID: 34225264 DOI: 10.1088/1361-6560/ac1157] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2021] [Accepted: 07/05/2021] [Indexed: 11/12/2022]
Abstract
Healthcare professionals have been increasingly viewing medical images and videos in their routine clinical practice, and this in a wide variety of environments. Both the perception and interpretation of medical visual information, across all branches of practice or medical specialties (e.g. diagnostic, therapeutic, or surgical medicine), career stages, and practice settings (e.g. emergency care), appear to be critical for patient care. However, medical images and videos are not self-explanatory and, therefore, need to be interpreted by humans, i.e. medical experts. In addition, various types of degradations and artifacts may appear during image acquisition or processing, and consequently affect medical imaging data. Such distortions tend to impact viewers' quality of experience, as well as their clinical practice. It is accordingly essential to better understand how medical experts perceive the quality of visual content. Thankfully, progress has been made in the recent literature towards such understanding. In this article, we present an up-to-date state-of the-art of relatively recent (i.e. not older than ten years old) existing studies on the subjective quality assessment of medical images and videos, as well as research works using task-based approaches. Furthermore, we discuss the merits and drawbacks of the methodologies used, and we provide recommendations about experimental designs and statistical processes to evaluate the perception of medical images and videos for future studies, which could then be used to optimise the visual experience of image readers in real clinical practice. Finally, we tackle the issue of the lack of available annotated medical image and video quality databases, which appear to be indispensable for the development of new dedicated objective metrics.
Collapse
Affiliation(s)
- Lucie Lévêque
- Nantes Laboratory of Digital Sciences (LS2N), University of Nantes, Nantes, France
| | - Meriem Outtas
- Department of Industrial Computer Science and Electronics, National Institute of Applied Sciences, Rennes, France
| | - Hantao Liu
- School of Computer Science and Informatics, Cardiff University, Cardiff, United Kingdom
| | - Lu Zhang
- Department of Industrial Computer Science and Electronics, National Institute of Applied Sciences, Rennes, France
| |
Collapse
|
4
|
Ilesanmi AE, Idowu OP, Chaumrattanakul U, Makhanov SS. Multiscale hybrid algorithm for pre-processing of ultrasound images. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2020.102396] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
5
|
Yan H, Zhao P, Du Z, Xu Y, Liu P. Frequency division denoising algorithm based on VIF adaptive 2D-VMD ultrasound image. PLoS One 2021; 16:e0248146. [PMID: 33690702 PMCID: PMC7946199 DOI: 10.1371/journal.pone.0248146] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2020] [Accepted: 02/22/2021] [Indexed: 11/19/2022] Open
Abstract
Ultrasound imaging has developed into an indispensable imaging technology in medical diagnosis and treatment applications due to its unique advantages, such as safety, affordability, and convenience. With the development of data information acquisition technology, ultrasound imaging is increasingly susceptible to speckle noise, which leads to defects, such as low resolution, poor contrast, spots, and shadows, which affect the accuracy of physician analysis and diagnosis. To solve this problem, we proposed a frequency division denoising algorithm combining transform domain and spatial domain. First, the ultrasound image was decomposed into a series of sub-modal images using 2D variational mode decomposition (2D-VMD), and adaptively determined 2D-VMD parameter K value based on visual information fidelity (VIF) criterion. Then, an anisotropic diffusion filter was used to denoise low-frequency sub-modal images, and a 3D block matching algorithm (BM3D) was used to reduce noise for high-frequency images with high noise. Finally, each sub-modal image was reconstructed after processing to obtain the denoised ultrasound image. In the comparative experiments of synthetic, simulation, and real images, the performance of this method was quantitatively evaluated. Various results show that the ability of this algorithm in denoising and maintaining structural details is significantly better than that of other algorithms.
Collapse
Affiliation(s)
- Hongbo Yan
- School of Mechanical Engineering, Inner Mongolia University of Science and Technology, Baotou, Inner Mongolia, China
| | - Pengbo Zhao
- School of Mechanical Engineering, Inner Mongolia University of Science and Technology, Baotou, Inner Mongolia, China
- * E-mail:
| | - Zhuang Du
- School of Mechanical Engineering, Inner Mongolia University of Science and Technology, Baotou, Inner Mongolia, China
| | - Yang Xu
- The First Affiliated Hospital of Baotou Medical College, Inner Mongolia University of Science and Technology, Baotou, Inner Mongolia, China
| | - Pei Liu
- School of Mechanical Engineering, Inner Mongolia University of Science and Technology, Baotou, Inner Mongolia, China
| |
Collapse
|
6
|
Febin IP, Jidesh P. Despeckling and enhancement of ultrasound images using non-local variational framework. THE VISUAL COMPUTER 2021; 38:1413-1426. [PMID: 33678932 PMCID: PMC7912973 DOI: 10.1007/s00371-021-02076-8] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Accepted: 01/27/2021] [Indexed: 06/12/2023]
Abstract
Speckles are introduced in the ultrasound data due to constructive and destructive interference of the probing signals that are used for capturing the characteristics of the tissue being imaged. There are a plethora of models discussed in the literature to improve the contrast and resolution of the ultrasound images by despeckling them. There is a class of models that assumes that the noise is multiplicative in its original form, and transforming the model to a log domain makes it an additive one. Nevertheless, such a transformation duly oversimplifies the scenario and does not capture the inherent properties of the data-correlated nature of speckles. Therefore, it results in poor reconstruction. This problem is addressed to a considerable extent in the subsequent works by adopting various models to address the data-correlated nature of the noise and its distributions. This work introduces a weberized non-local total bounded variational model based on the noise distribution built on the Retinex theory. This perceptually inspired model apparently restores and improves the contrast of the images without compromising much on the details inherently present in the data. The numerical implementation of the model is carried out using the Bregman formulation to improve the convergence rate and reduce the parameter sensitivity. The experimental results are highlighted and compared to demonstrate the efficiency of the model.
Collapse
Affiliation(s)
- I. P. Febin
- Department of Mathematical and computational sciences, National Institute of Technology Karnataka, Surathkal, Mangalore, 575025 India
| | - P. Jidesh
- Department of Mathematical and computational sciences, National Institute of Technology Karnataka, Surathkal, Mangalore, 575025 India
| |
Collapse
|
7
|
COVID-19 Detection from Chest X-ray Images Using Feature Fusion and Deep Learning. SENSORS 2021; 21:s21041480. [PMID: 33672585 PMCID: PMC8078171 DOI: 10.3390/s21041480] [Citation(s) in RCA: 48] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/08/2021] [Revised: 02/15/2021] [Accepted: 02/17/2021] [Indexed: 12/15/2022]
Abstract
Currently, COVID-19 is considered to be the most dangerous and deadly disease for the human body caused by the novel coronavirus. In December 2019, the coronavirus spread rapidly around the world, thought to be originated from Wuhan in China and is responsible for a large number of deaths. Earlier detection of the COVID-19 through accurate diagnosis, particularly for the cases with no obvious symptoms, may decrease the patient's death rate. Chest X-ray images are primarily used for the diagnosis of this disease. This research has proposed a machine vision approach to detect COVID-19 from the chest X-ray images. The features extracted by the histogram-oriented gradient (HOG) and convolutional neural network (CNN) from X-ray images were fused to develop the classification model through training by CNN (VGGNet). Modified anisotropic diffusion filtering (MADF) technique was employed for better edge preservation and reduced noise from the images. A watershed segmentation algorithm was used in order to mark the significant fracture region in the input X-ray images. The testing stage considered generalized data for performance evaluation of the model. Cross-validation analysis revealed that a 5-fold strategy could successfully impair the overfitting problem. This proposed feature fusion using the deep learning technique assured a satisfactory performance in terms of identifying COVID-19 compared to the immediate, relevant works with a testing accuracy of 99.49%, specificity of 95.7% and sensitivity of 93.65%. When compared to other classification techniques, such as ANN, KNN, and SVM, the CNN technique used in this study showed better classification performance. K-fold cross-validation demonstrated that the proposed feature fusion technique (98.36%) provided higher accuracy than the individual feature extraction methods, such as HOG (87.34%) or CNN (93.64%).
Collapse
|
8
|
Intelligent System for Vehicles Number Plate Detection and Recognition Using Convolutional Neural Networks. TECHNOLOGIES 2021. [DOI: 10.3390/technologies9010009] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Vehicles on the road are rising in extensive numbers, particularly in proportion to the industrial revolution and growing economy. The significant use of vehicles has increased the probability of traffic rules violation, causing unexpected accidents, and triggering traffic crimes. In order to overcome these problems, an intelligent traffic monitoring system is required. The intelligent system can play a vital role in traffic control through the number plate detection of the vehicles. In this research work, a system is developed for detecting and recognizing of vehicle number plates using a convolutional neural network (CNN), a deep learning technique. This system comprises of two parts: number plate detection and number plate recognition. In the detection part, a vehicle’s image is captured through a digital camera. Then the system segments the number plate region from the image frame. After extracting the number plate region, a super resolution method is applied to convert the low-resolution image into a high-resolution image. The super resolution technique is used with the convolutional layer of CNN to reconstruct the pixel quality of the input image. Each character of the number plate is segmented using a bounding box method. In the recognition part, features are extracted and classified using the CNN technique. The novelty of this research is the development of an intelligent system employing CNN to recognize number plates, which have less resolution, and are written in the Bengali language.
Collapse
|
9
|
A SAR Image Despeckling Method Based on an Extended Adaptive Wiener Filter and Extended Guided Filter. REMOTE SENSING 2020. [DOI: 10.3390/rs12152371] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
The elimination of multiplicative speckle noise is the main issue in synthetic aperture radar (SAR) images. In this study, a SAR image despeckling filter based on a proposed extended adaptive Wiener filter (EAWF), extended guided filter (EGF), and weighted least squares (WLS) filter is proposed. The proposed EAWF and EGF have been developed from the adaptive Wiener filter (AWF) and guided Filter (GF), respectively. The proposed EAWF can be applied to the SAR image, without the need for logarithmic transformation, considering the fact that the denoising performance of EAWF is better than AWF. The proposed EGF can remove the additive noise and preserve the edges’ information more efficiently than GF. First, the EAWF is applied to the input image. Then, a logarithmic transformation is applied to the resulting EAWF image in order to convert multiplicative noise into additive noise. Next, EGF is employed to remove the additive noise and preserve edge information. In order to remove unwanted spots on the image that is filtered by EGF, it is applied twice with different parameters. Finally, the WLS filter is applied in the homogeneous region. Results show that the proposed algorithm has a better performance in comparison with the other existing filters.
Collapse
|
10
|
Focal Liver Lesion Detection in Ultrasound Image Using Deep Feature Fusions and Super Resolution. MACHINE LEARNING AND KNOWLEDGE EXTRACTION 2020. [DOI: 10.3390/make2030010] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
This research presents a machine vision approach to detect lesions in liver ultrasound as well as resolving some issues in ultrasound such as artifacts, speckle noise, and blurring effect. The anisotropic diffusion is modified using the edge preservation conditions which found better than traditional ones in quantitative evolution. To dig for more potential information, a learnable super-resolution (SR) is embedded into the deep CNN. The feature is fused using Gabor Wavelet Transform (GWT) and Local Binary Pattern (LBP) with a pre-trained deep CNN model. Moreover, we propose a Bayes rule-based informative patch selection approach to reduce the processing time with the selective image patches and design an algorithm to mark the lesion region from identified ultrasound image patches. To train this model, standard data ensures promising resolution. The testing phase considers generalized data with a varying resolution and test the performance of the model. Exploring cross-validation, it finds that a 5-fold strategy can successfully eradicate the overfitting problem. Experiment data are collected using 298 consecutive ultrasounds comprising 15,296 image patches. This proposed feature fusion technique confirms satisfactory performance compared to the current relevant works with an accuracy of 98.40%.
Collapse
|
11
|
Abstract
Ultrasound (US) imaging can examine human bodies of various ages; however, in the process of obtaining a US image, speckle noise is generated. The speckle noise inhibits physicians from accurately examining lesions; thus, a speckle noise removal method is essential technology. To enhance speckle noise elimination, we propose a novel algorithm using the characteristics of speckle noise and filtering methods based on speckle reducing anisotropic diffusion (SRAD) filtering, discrete wavelet transform (DWT) using symmetry characteristics, weighted guided image filtering (WGIF), and gradient domain guided image filtering (GDGIF). The SRAD filter is exploited as a preprocessing filter because it can be directly applied to a medical US image containing speckle noise without a log-compression. The wavelet domain has the advantage of suppressing the additive noise. Therefore, a homomorphic transformation is utilized to convert the multiplicative noise into additive noise. After two-level DWT decomposition is applied, to suppress the residual noise of an SRAD filtered image, GDGIF and WGIF are exploited to reduce noise from seven high-frequency sub-band images and one low-frequency sub-band image, respectively. Finally, a noise-free image is attained through inverse DWT and an exponential transform. The proposed algorithm exhibits excellent speckle noise elimination and edge conservation as compared with conventional denoising methods.
Collapse
|
12
|
Mor E, Bar-Hillel A. A unified deep network for beamforming and speckle reduction in plane wave imaging: A simulation study. ULTRASONICS 2020; 103:106069. [PMID: 32045744 DOI: 10.1016/j.ultras.2020.106069] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/07/2019] [Revised: 01/05/2020] [Accepted: 01/07/2020] [Indexed: 06/10/2023]
Abstract
Plane Wave Imaging is a fast imaging method used in ultrasound, which allows a high frame rate, but with compromised image quality when a single wave is used. In this work a learning-based approach was used to obtain improved image quality. The entire process of beamforming and speckle reduction was embedded in a single deep convolutional network, and trained with two types of simulated data. The network architecture was designed based on traditional physical considerations of the ultrasonic image formation pipe. As such, it includes beamforming with spatial matched filters, envelope detection, and a speckle reduction stage done in log-signal representation, with all stages containing trainable parameters. The approach was tested on the publicly available PICMUS datasets, achieving axial and lateral full-width-half-maximum (FWHM) resolution values of 0.22 mm and 0.35 mm respectively, and a Contrast to Noise Ratio (CNR) metric of 16.75 on the experimental datasets.
Collapse
Affiliation(s)
- Etai Mor
- Department of Non Destructive Testing, Soreq Nuclear Research Center, Yavne 81800, Israel; Department of Industrial Engineering and Management, Ben-Gurion University of the Negev, Beer-Sheva 84105, Israel.
| | - Aharon Bar-Hillel
- Department of Industrial Engineering and Management, Ben-Gurion University of the Negev, Beer-Sheva 84105, Israel.
| |
Collapse
|
13
|
Cui W, Li M, Gong G, Lu K, Sun S, Dong F. Guided trilateral filter and its application to ultrasound image despeckling. Biomed Signal Process Control 2020. [DOI: 10.1016/j.bspc.2019.101625] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
|
14
|
Mei K, Hu B, Fei B, Qin B. Phase asymmetry ultrasound despeckling with fractional anisotropic diffusion and total variation. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2019; 29:10.1109/TIP.2019.2953361. [PMID: 31751240 PMCID: PMC7370834 DOI: 10.1109/tip.2019.2953361] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/12/2023]
Abstract
We propose an ultrasound speckle filtering method for not only preserving various edge features but also filtering tissue-dependent complex speckle noises in ultrasound images. The key idea is to detect these various edges using a phase congruence-based edge significance measure called phase asymmetry (PAS), which is invariant to the intensity amplitude of edges and takes 0 in non-edge smooth regions and 1 at the idea step edge, while also taking intermediate values at slowly varying ramp edges. By leveraging the PAS metric in designing weighting coefficients to maintain a balance between fractional-order anisotropic diffusion and total variation (TV) filters in TV cost function, we propose a new fractional TV framework to not only achieve the best despeckling performance with ramp edge preservation but also reduce the staircase effect produced by integral-order filters. Then, we exploit the PAS metric in designing a new fractional-order diffusion coefficient to properly preserve low-contrast edges in diffusion filtering. Finally, different from fixed fractional-order diffusion filters, an adaptive fractional order is introduced based on the PAS metric to enhance various weak edges in the spatially transitional areas between objects. The proposed fractional TV model is minimized using the gradient descent method to obtain the final denoised image. The experimental results and real application of ultrasound breast image segmentation show that the proposed method outperforms other state-of-the-art ultrasound despeckling filters for both speckle reduction and feature preservation in terms of visual evaluation and quantitative indices. The best scores on feature similarity indices have achieved 0.867, 0.844 and 0.834 under three different levels of noise, while the best breast ultrasound segmentation accuracy in terms of the mean and median dice similarity coefficient are 96.25% and 96.15%, respectively.
Collapse
Affiliation(s)
- Kunqiang Mei
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Bin Hu
- Department of Ultrasound in Medicine, Shanghai Jiao Tong University Affiliated Sixth People’s Hospital, Shanghai Institute of Ultrasound in Medicine, Shanghai 200233, China
| | - Baowei Fei
- Department of Bioengineering, Erik Jonsson School of Engineering and Computer Science, The University of Texas at Dallas, Richardson, TX 75080 USA
| | - Binjie Qin
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
| |
Collapse
|
15
|
Kushwaha S, Singh RK. Optimization of the proposed hybrid denoising technique to overcome over-filtering issue. ACTA ACUST UNITED AC 2019; 64:601-618. [PMID: 30978168 DOI: 10.1515/bmt-2018-0101] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2018] [Accepted: 10/18/2018] [Indexed: 11/15/2022]
Abstract
Image denoising has become a crucial task in medical ultrasound (US) imaging due to the presence of speckle or multiplicative noise and additive Gaussian noise. Recently, several denoising techniques such as adaptive wavelet thresholding & joint bilateral (AWT + JB) filter, adaptive fuzzy switching weighted mean (AFSWM) filter and median patch-based locally optimal Wiener (MPBLOW) filter have been proposed to remove the speckle noise. However, these denoising techniques were found to remove noise along with the essential parts of the actual image data which is known as over-filtering. Thereby, it reduces the accuracy of the recognition process. In this paper, a new hybrid filter technique is proposed by combining anisotropic diffusion (AD) with Butterworth band pass filter to overcome over-filtering of the image. In addition, the performance of the proposed hybrid filter and its design parameters are enhanced using the particle swarm optimization (PSO) algorithm. The simulation results show that the proposed filtering technique achieves a better denoising performance when compared with other filtering techniques in terms of peak signal-to-noise ratio (PSNR), signal-to-noise ratio (SNR), structural similarity index (SSIM) and edge preservation index (EPI). Moreover, the results validated that the proposed filtering technique using PSO achieves effective performance than using the harmony search algorithm (HSA) and other filtering techniques.
Collapse
Affiliation(s)
- Sumit Kushwaha
- Electronics Engineering Department, Kamla Nehru Institute of Technology, Sultanpur 228118, India
| | - Rabindra Kumar Singh
- Electronics Engineering Department, Kamla Nehru Institute of Technology, Sultanpur 228118, India
| |
Collapse
|
16
|
Brain MR Imaging Tumor Detection Using Monogenic Signal Analysis-Based Invariant Texture Descriptors. ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING 2019. [DOI: 10.1007/s13369-019-03989-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
17
|
Anisotropic Diffusion Based Multiplicative Speckle Noise Removal. SENSORS 2019; 19:s19143164. [PMID: 31323876 PMCID: PMC6679264 DOI: 10.3390/s19143164] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/17/2019] [Revised: 07/06/2019] [Accepted: 07/13/2019] [Indexed: 11/17/2022]
Abstract
Multiplicative speckle noise removal is a challenging task in image processing. Motivated by the performance of anisotropic diffusion in additive noise removal and the structure of the standard deviation of a compressed speckle noisy image, we address this problem with anisotropic diffusion theories. Firstly, an anisotropic diffusion model based on image statistics, including information on the gradient of the image, gray levels, and noise standard deviation of the image, is proposed. Although the proposed model can effectively remove multiplicative speckle noise, it does not consider the noise at the edge during the denoising process. Hence, we decompose the divergence term in order to make the diffusion at the edge occur along the boundaries rather than perpendicular to the boundaries, and improve the model to meet our requirements. Secondly, the iteration stopping criteria based on kurtosis and correlation in view of the lack of ground truth in real image experiments, is proposed. The optimal values of the parameters in the model are obtained by learning. To improve the denoising effect, post-processing is performed. Finally, the simulation results show that the proposed model can effectively remove the speckle noise and retain minute details of the images for the real ultrasound and RGB color images.
Collapse
|
18
|
Speckle Noise Reduction Technique for SAR Images Using Statistical Characteristics of Speckle Noise and Discrete Wavelet Transform. REMOTE SENSING 2019. [DOI: 10.3390/rs11101184] [Citation(s) in RCA: 27] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Synthetic aperture radar (SAR) images map Earth’s surface at high resolution, regardless of the weather conditions or sunshine phenomena. Therefore, SAR images have applications in various fields. Speckle noise, which has the characteristic of multiplicative noise, degrades the image quality of SAR images, which causes information loss. This study proposes a speckle noise reduction algorithm while using the speckle reducing anisotropic diffusion (SRAD) filter, discrete wavelet transform (DWT), soft threshold, improved guided filter (IGF), and guided filter (GF), with the aim of removing speckle noise. First, the SRAD filter is applied to the SAR images, and a logarithmic transform is used to convert multiplicative noise in the resulting SRAD image into additive noise. A two-level DWT is used to divide the resulting SRAD image into one low-frequency and six high-frequency sub-band images. To remove the additive noise and preserve edge information, horizontal and vertical sub-band images employ the soft threshold; the diagonal sub-band images employ the IGF; while, the low- frequency sub-band image removes additive noise using the GF. The experiments used both standard and real SAR images. The experimental results reveal that the proposed method, in comparison to state-of-the art methods, obtains excellent speckle noise removal, while preserving the edges and maintaining low computational complexity.
Collapse
|
19
|
Isla JA, Cegla FB. Simultaneous transmission and reception on all elements of an array: binary code excitation. Proc Math Phys Eng Sci 2019; 475:20180831. [PMID: 31236046 PMCID: PMC6545054 DOI: 10.1098/rspa.2018.0831] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2018] [Accepted: 04/10/2019] [Indexed: 12/27/2022] Open
Abstract
Pulse-echo arrays are used in radar, sonar, seismic, medical and non-destructive evaluation. There is a trend to produce arrays with an ever-increasing number of elements. This trend presents two major challenges: (i) often the size of the elements is reduced resulting in a lower signal-to-noise ratio (SNR) and (ii) the time required to record all of the signals that correspond to every transmit-receive path increases. Coded sequences with good autocorrelation properties can increase the SNR while orthogonal sets can be used to simultaneously acquire all of the signals that correspond to every transmit-receive path. However, a central problem of conventional coded sequences is that they cannot achieve good autocorrelation and orthogonality properties simultaneously due to their length being limited by the location of the closest reflectors. In this paper, a solution to this problem is presented by using coded sequences that have receive intervals. The proposed approach can be more than one order of magnitude faster than conventional methods. In addition, binary excitation and quantization can be employed, which reduces the data throughput by roughly an order of magnitude and allows for higher sampling rates. While this concept is generally applicable to any field, a 16-element system was built to experimentally demonstrate this principle for the first time using a conventional medical ultrasound probe.
Collapse
|
20
|
Natarajan A, Kumarasamy S. Efficient Segmentation of Brain Tumor Using FL-SNM with a Metaheuristic Approach to Optimization. J Med Syst 2019; 43:25. [PMID: 30604101 DOI: 10.1007/s10916-018-1135-y] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2018] [Accepted: 12/03/2018] [Indexed: 10/27/2022]
Abstract
Nowadays, automatic tumor detection from brain images is extremely significant for many diagnostic as well as therapeutic purposes, due to the unpredictable shape and appearance of tumors. In medical image analysis, the automatic segmentation of tumors from brain using magnetic resonance imaging (MRI) data is the most critical issue. Existing research has some limitations, such as high processing time and lower accuracy, because of the time required for the training process. In this research, a new automatic segmentation process is introduced using machine learning and a swarm intelligence scheme. Here, a fuzzy logic with spiking neuron model (FL-SNM) is proposed for segmenting the brain tumor region in MR images. Initially, input images are preprocessed to remove Gaussian and Poisson noise using a modified Kuan filter (MKF). In the MKF, the optimal selection of the minimum MSE of image pixels is achieved using a random search algorithm (RSA), which improves the peak signal-to-noise ratio (PSNR). Then, the image is smoothed using an anisotropic diffusion filter (ADF) to reduce the over-filtering problem. Afterwards, to extract statistical texture features, Fisher's linear-discriminant analysis (FLDA) is used. Finally, extracted features are transferred to the FL-SNM process and this scheme effectively segments the tumor region. In FL-SNM, the consequent parameters such as weight and bias play an important role in segmenting the region. Therefore, optimizing the weight parameter values using a chicken behavior-based swarm intelligence (CSI) algorithm, is proposed. The proposed (FL-SNM) scheme attained better performance in terms of high accuracy (94.87%), sensitivity (92.07%), specificity (99.34%), precision rate (89.36%), recall rate (88.39%), F-measure (95.06%), G-mean (95.63%), and DSC rate (91.2%), compared to existing convolutional neural networks (CNNs) and hierarchical self-organizing maps (HSOMs).
Collapse
Affiliation(s)
- Aparna Natarajan
- Department of EEE, SRS College of Engineering and Technology, Salem, India.
| | | |
Collapse
|
21
|
Paul A, Mukherjee DP, Acton ST. Speckle Removal Using Diffusion Potential for Optical Coherence Tomography Images. IEEE J Biomed Health Inform 2019; 23:264-272. [DOI: 10.1109/jbhi.2018.2791624] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
22
|
Roy R, Ghosh S, Ghosh A. Speckle de-noising of clinical ultrasound images based on fuzzy spel conformity in its adjacency. Appl Soft Comput 2018. [DOI: 10.1016/j.asoc.2018.08.014] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
23
|
Jaouen V, Bert J, Boussion N, Fayad H, Hatt M, Visvikis D. Image enhancement with PDEs and nonconservative advection flow fields. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2018; 28:3075-3088. [PMID: 30452364 DOI: 10.1109/tip.2018.2881838] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
|
24
|
Outtas M, Zhang L, Deforges O, Serir A, Hamidouche W, Chen Y. Subjective and objective evaluations of feature selected multi output filter for speckle reduction on ultrasound images. ACTA ACUST UNITED AC 2018; 63:185014. [DOI: 10.1088/1361-6560/aadbc9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
|
25
|
Mishra D, Chaudhury S, Sarkar M, Soin AS. Ultrasound Image Enhancement Using Structure Oriented Adversarial Network. IEEE SIGNAL PROCESSING LETTERS 2018; 25:1349-1353. [DOI: 10.1109/lsp.2018.2858147] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/19/2023]
|
26
|
Mishra D, Tyagi S, Chaudhury S, Sarkar M, Singh Soin A. Despeckling CNN with Ensembles of Classical Outputs. 2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR) 2018. [DOI: 10.1109/icpr.2018.8545031] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/19/2023]
|
27
|
Mishra D, Chaudhury S, Sarkar M, Soin AS, Sharma V. Edge Probability and Pixel Relativity-Based Speckle Reducing Anisotropic Diffusion. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2018; 27:649-664. [PMID: 29028196 DOI: 10.1109/tip.2017.2762590] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
Anisotropic diffusion filters are one of the best choices for speckle reduction in the ultrasound images. These filters control the diffusion flux flow using local image statistics and provide the desired speckle suppression. However, inefficient use of edge characteristics results in either oversmooth image or an image containing misinterpreted spurious edges. As a result, the diagnostic quality of the images becomes a concern. To alleviate such problems, a novel anisotropic diffusion-based speckle reducing filter is proposed in this paper. A probability density function of the edges along with pixel relativity information is used to control the diffusion flux flow. The probability density function helps in removing the spurious edges and the pixel relativity reduces the oversmoothing effects. Furthermore, the filtering is performed in superpixel domain to reduce the execution time, wherein a minimum of 15% of the total number of image pixels can be used. For performance evaluation, 31 frames of three synthetic images and 40 real ultrasound images are used. In most of the experiments, the proposed filter shows a better performance as compared to the state-of-the-art filters in terms of the speckle region's signal-to-noise ratio and mean square error. It also shows a comparative performance for figure of merit and structural similarity measure index. Furthermore, in the subjective evaluation, performed by the expert radiologists, the proposed filter's outputs are preferred for the improved contrast and sharpness of the object boundaries. Hence, the proposed filtering framework is suitable to reduce the unwanted speckle and improve the quality of the ultrasound images.
Collapse
|
28
|
Baselice F, Ferraioli G, Ambrosanio M, Pascazio V, Schirinzi G. Enhanced Wiener filter for ultrasound image restoration. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2018; 153:71-81. [PMID: 29157463 DOI: 10.1016/j.cmpb.2017.10.006] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/19/2017] [Revised: 09/07/2017] [Accepted: 10/02/2017] [Indexed: 06/07/2023]
Abstract
BACKGROUND AND OBJECTIVE Speckle phenomenon strongly affects UltraSound (US) images. In the last years, several efforts have been done in order to provide an effective denoising methodology. Although good results have been achieved in terms of noise reduction effectiveness, most of the proposed approaches are not characterized by low computational burden and require the supervision of an external operator for tuning the input parameters. METHODS Within this manuscript, a novel approach is investigated, based on Wiener filter. Working in the frequency domain, it is characterized by high computational efficiency. With respect to classical Wiener filter, the proposed Enhanced Wiener filter is able to locally adapt itself by tuning its kernel in order to combine edges and details preservation with effective noise reduction. This characteristic is achieved by implementing a Local Gaussian Markov Random Field for modeling the image. Due to its intrinsic characteristics, the computational burden of the algorithm is sensibly low compared to other widely adopted filters and the parameter tuning effort is minimal, being well suited for quasi real time applications. RESULTS The approach has been tested on both simulated and real datasets, showing interesting performances compared to other state of art methods. CONCLUSIONS A novel denoising method for UltraSound images is proposed. The approach is able to combine low computational burden with interesting denoising performances and details preservation.
Collapse
Affiliation(s)
- Fabio Baselice
- Dipartimento di Ingegneria, Università degli Studi di Napoli Parthenope, Napoli, Italy.
| | - Giampaolo Ferraioli
- Dipartimento di Scienze e Tecnologie, Università degli Studi di Napoli Parthenope, Napoli, Italy.
| | - Michele Ambrosanio
- Dipartimento di Ingegneria, Università degli Studi di Napoli Parthenope, Napoli, Italy.
| | - Vito Pascazio
- Dipartimento di Ingegneria, Università degli Studi di Napoli Parthenope, Napoli, Italy.
| | - Gilda Schirinzi
- Dipartimento di Ingegneria, Università degli Studi di Napoli Parthenope, Napoli, Italy.
| |
Collapse
|
29
|
Ramos-Llorden G, den Dekker AJ, Sijbers J. Partial Discreteness: A Novel Prior for Magnetic Resonance Image Reconstruction. IEEE TRANSACTIONS ON MEDICAL IMAGING 2017; 36:1041-1053. [PMID: 28026759 DOI: 10.1109/tmi.2016.2645122] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/22/2023]
Abstract
An important factor influencing the quality of magnetic resonance (MR) images is the reconstruction method that is employed, and specifically, the type of prior knowledge that is exploited during reconstruction. In this work, we introduce a new type of prior knowledge, partial discreteness (PD), where a small number of regions in the image are assumed to be homogeneous and can be well represented by a constant magnitude. In particular, we mathematically formalize the partial discreteness property based on a Gaussian Mixture Model (GMM) and derive a partial discreteness image representation that characterizes the salient features of partially discrete images: a constant intensity in homogeneous areas and texture in heterogeneous areas. The partial discreteness representation is then used to construct a novel prior dedicated to the reconstruction of partially discrete MR images. The strength of the proposed prior is demonstrated on various simulated and real k-space data-based experiments with partially discrete images. Results demonstrate that the PD algorithm performs competitively with state-of-the-art reconstruction methods, being flexible and easy to implement.
Collapse
|
30
|
Mishra D, Chaudhury S, Sarkar M, Soin AS. Cardiac Ultrasound Image Enhancement Using Tissue Selective Total Variation Regularization. COMPUTER VISION, GRAPHICS, AND IMAGE PROCESSING 2017:367-379. [DOI: 10.1007/978-3-319-68124-5_32] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/19/2023]
|
31
|
Mishra D, Chaudhury S, Sarkar M, Soin AS. Edge Aware Geometric Filter for Ultrasound Image Enhancement. COMMUNICATIONS IN COMPUTER AND INFORMATION SCIENCE 2017:109-120. [DOI: 10.1007/978-3-319-60964-5_10] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/19/2023]
|
32
|
Nagare MB, Patil BD, Holambe RS. A Multi Directional Perfect Reconstruction Filter Bank Designed with 2-D Eigenfilter Approach: Application to Ultrasound Speckle Reduction. J Med Syst 2016; 41:31. [PMID: 28035640 DOI: 10.1007/s10916-016-0675-2] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2016] [Accepted: 12/07/2016] [Indexed: 10/20/2022]
Abstract
B-Mode ultrasound images are degraded by inherent noise called Speckle, which creates a considerable impact on image quality. This noise reduces the accuracy of image analysis and interpretation. Therefore, reduction of speckle noise is an essential task which improves the accuracy of the clinical diagnostics. In this paper, a Multi-directional perfect-reconstruction (PR) filter bank is proposed based on 2-D eigenfilter approach. The proposed method used for the design of two-dimensional (2-D) two-channel linear-phase FIR perfect-reconstruction filter bank. In this method, the fan shaped, diamond shaped and checkerboard shaped filters are designed. The quadratic measure of the error function between the passband and stopband of the filter has been used an objective function. First, the low-pass analysis filter is designed and then the PR condition has been expressed as a set of linear constraints on the corresponding synthesis low-pass filter. Subsequently, the corresponding synthesis filter is designed using the eigenfilter design method with linear constraints. The newly designed 2-D filters are used in translation invariant pyramidal directional filter bank (TIPDFB) for reduction of speckle noise in ultrasound images. The proposed 2-D filters give better symmetry, regularity and frequency selectivity of the filters in comparison to existing design methods. The proposed method is validated on synthetic and real ultrasound data which ensures improvement in the quality of ultrasound images and efficiently suppresses the speckle noise compared to existing methods.
Collapse
Affiliation(s)
- Mukund B Nagare
- S.G.G.S Institute of Engineering and Technology, Vishnupuri, Nanded, 431606, India.
| | - Bhushan D Patil
- S.G.G.S Institute of Engineering and Technology, Vishnupuri, Nanded, 431606, India
| | - Raghunath S Holambe
- S.G.G.S Institute of Engineering and Technology, Vishnupuri, Nanded, 431606, India
| |
Collapse
|
33
|
|