1
|
Wang L, Zeng C, Zhang X, Zhao L. Denoising of 3D magnetic resonance images via edge-enhanced low-rank tensor decomposition. Magn Reson Imaging 2025; 119:110365. [PMID: 40058737 DOI: 10.1016/j.mri.2025.110365] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/24/2024] [Revised: 02/23/2025] [Accepted: 03/02/2025] [Indexed: 03/15/2025]
Abstract
Magnetic Resonance images (MRI) denoising is to obtain high quality image from infectant version. Recently, low-rank tensor (LRT) methods have been developed and attained resounding success in MRI denoising. However, these pure LRT models are incapable of utilizing the comprehensive inherent information of clean MRI. To overcome these drawbacks, we design a novel edge-enhanced low-rank tensor approximation (EELRTA) framework for Rician noise removal. The tensor gradient L0 norm regularization with describing the local structure information is incorporated into the weighted core tensor rank model for improving texture edge preservation. The application of weights can further preserve the potentially useful information distributed on the different core tensor coefficients with different physical meanings. What's more, non-local self-similarity tactic is employed for low-rank sparsity-encourage and enhancing anti-noise capability of EELRTA model. The proposed EELRTA method is tackled by an efficient alternating direction method of multipliers (ADMM). The Experiment results on simulation and multiple sclerosis lesion (MSL) data illustrate that the proposed method can effectively remove noise while reasonably retaining pathological structure information.
Collapse
Affiliation(s)
- Li Wang
- School of Electrical Engineering, Chongqing University of Arts and Sciences, Chongqing, China; College of Physics, Chongqing University, Chongqing, China.
| | - Chong Zeng
- School of Electrical Engineering, Chongqing University of Arts and Sciences, Chongqing, China
| | - Xingtuo Zhang
- School of Electrical Engineering, Chongqing University of Arts and Sciences, Chongqing, China
| | - Liang Zhao
- School of Electrical and Information Engineering, Chongqing University of Arts and Sciences, Chongqing, China
| |
Collapse
|
2
|
Sun Y, Wang L, Li G, Lin W, Wang L. A foundation model for enhancing magnetic resonance images and downstream segmentation, registration and diagnostic tasks. Nat Biomed Eng 2025; 9:521-538. [PMID: 39638876 DOI: 10.1038/s41551-024-01283-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2023] [Accepted: 10/17/2024] [Indexed: 12/07/2024]
Abstract
In structural magnetic resonance (MR) imaging, motion artefacts, low resolution, imaging noise and variability in acquisition protocols frequently degrade image quality and confound downstream analyses. Here we report a foundation model for the motion correction, resolution enhancement, denoising and harmonization of MR images. Specifically, we trained a tissue-classification neural network to predict tissue labels, which are then leveraged by a 'tissue-aware' enhancement network to generate high-quality MR images. We validated the model's effectiveness on a large and diverse dataset comprising 2,448 deliberately corrupted images and 10,963 images spanning a wide age range (from foetuses to elderly individuals) acquired using a variety of clinical scanners across 19 public datasets. The model consistently outperformed state-of-the-art algorithms in improving the quality of MR images, handling pathological brains with multiple sclerosis or gliomas, generating 7-T-like images from 3 T scans and harmonizing images acquired from different scanners. The high-quality, high-resolution and harmonized images generated by the model can be used to enhance the performance of models for tissue segmentation, registration, diagnosis and other downstream tasks.
Collapse
Affiliation(s)
- Yue Sun
- Developing Brain Computing Lab, Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
- Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill and North Carolina State University, Chapel Hill, NC, USA
| | - Limei Wang
- Developing Brain Computing Lab, Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
- Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill and North Carolina State University, Chapel Hill, NC, USA
| | - Gang Li
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Weili Lin
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Li Wang
- Developing Brain Computing Lab, Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.
| |
Collapse
|
3
|
Shi S, Wang C, Xiao S, Li H, Zhao X, Guo F, Shi L, Zhou X. Magnetic resonance image denoising for Rician noise using a novel hybrid transformer-CNN network (HTC-net) and self-supervised pretraining. Med Phys 2025; 52:1643-1660. [PMID: 39641989 DOI: 10.1002/mp.17562] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2024] [Revised: 11/10/2024] [Accepted: 11/14/2024] [Indexed: 12/07/2024] Open
Abstract
BACKGROUND Magnetic resonance imaging (MRI) is a crucial technique for both scientific research and clinical diagnosis. However, noise generated during MR data acquisition degrades image quality, particularly in hyperpolarized (HP) gas MRI. While deep learning (DL) methods have shown promise for MR image denoising, most of them fail to adequately utilize the long-range information which is important to improve denoising performance. Furthermore, the sample size of paired noisy and noise-free MR images also limits denoising performance. PURPOSE To develop an effective DL method that enhances denoising performance and reduces the requirement of paired MR images by utilizing the long-range information and pretraining. METHODS In this work, a hybrid Transformer-convolutional neural network (CNN) network (HTC-net) and a self-supervised pretraining strategy are proposed, which effectively enhance the denoising performance. In HTC-net, a CNN branch is exploited to extract the local features. Then a Transformer-CNN branch with two parallel encoders is designed to capture the long-range information. Within this branch, a residual fusion block (RFB) with a residual feature processing module and a feature fusion module is proposed to aggregate features at different resolutions extracted by two parallel encoders. After that, HTC-net exploits the comprehensive features from the CNN branch and the Transformer-CNN branch to accurately predict noise-free MR images through a reconstruction module. To further enhance the performance on limited MRI datasets, a self-supervised pretraining strategy is proposed. This strategy employs self-supervised denoising to equip the HTC-net with denoising capabilities during pretraining, and then the pre-trained parameters are transferred to facilitate subsequent supervised training. RESULTS Experimental results on the pulmonary HP 129Xe MRI dataset (1059 images) and IXI dataset (5000 images) all demonstrate the proposed method outperforms the state-of-the-art methods, exhibiting superior preservation of edges and structures. Quantitatively, on the pulmonary HP 129Xe MRI dataset, the proposed method outperforms the state-of-the-art methods by 0.254-0.597 dB in PSNR and 0.007-0.013 in SSIM. On the IXI dataset, the proposed method outperforms the state-of-the-art methods by 0.3-0.927 dB in PSNR and 0.003-0.016 in SSIM. CONCLUSIONS The proposed method can effectively enhance the quality of MR images, which helps improve the diagnosis accuracy in clinical.
Collapse
Affiliation(s)
- Shengjie Shi
- Key Laboratory of Magnetic Resonance in Biological Systems, State Key Laboratory of Magnetic Resonance and Atomic and Molecular Physics, National Center for Magnetic Resonance in Wuhan, Wuhan Institute of Physics and Mathematics, Innovation Academy for Precision Measurement Science and Technology, Chinese Academy of Sciences-Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan, China
| | - Cheng Wang
- Key Laboratory of Magnetic Resonance in Biological Systems, State Key Laboratory of Magnetic Resonance and Atomic and Molecular Physics, National Center for Magnetic Resonance in Wuhan, Wuhan Institute of Physics and Mathematics, Innovation Academy for Precision Measurement Science and Technology, Chinese Academy of Sciences-Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan, China
- University of Chinese Academy of Sciences, Beijing, China
- School of Physics and Optoelectronic Engineering, Yangtze University, Jingzhou, China
| | - Sa Xiao
- Key Laboratory of Magnetic Resonance in Biological Systems, State Key Laboratory of Magnetic Resonance and Atomic and Molecular Physics, National Center for Magnetic Resonance in Wuhan, Wuhan Institute of Physics and Mathematics, Innovation Academy for Precision Measurement Science and Technology, Chinese Academy of Sciences-Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan, China
- University of Chinese Academy of Sciences, Beijing, China
| | - Haidong Li
- Key Laboratory of Magnetic Resonance in Biological Systems, State Key Laboratory of Magnetic Resonance and Atomic and Molecular Physics, National Center for Magnetic Resonance in Wuhan, Wuhan Institute of Physics and Mathematics, Innovation Academy for Precision Measurement Science and Technology, Chinese Academy of Sciences-Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan, China
- University of Chinese Academy of Sciences, Beijing, China
| | - Xiuchao Zhao
- Key Laboratory of Magnetic Resonance in Biological Systems, State Key Laboratory of Magnetic Resonance and Atomic and Molecular Physics, National Center for Magnetic Resonance in Wuhan, Wuhan Institute of Physics and Mathematics, Innovation Academy for Precision Measurement Science and Technology, Chinese Academy of Sciences-Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan, China
- University of Chinese Academy of Sciences, Beijing, China
| | - Fumin Guo
- Wuhan National Laboratory for Optoelectronics, Department of Biomedical Engineering, Huazhong University of Science and Technology, Wuhan, China
| | - Lei Shi
- Key Laboratory of Magnetic Resonance in Biological Systems, State Key Laboratory of Magnetic Resonance and Atomic and Molecular Physics, National Center for Magnetic Resonance in Wuhan, Wuhan Institute of Physics and Mathematics, Innovation Academy for Precision Measurement Science and Technology, Chinese Academy of Sciences-Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan, China
- University of Chinese Academy of Sciences, Beijing, China
| | - Xin Zhou
- Key Laboratory of Magnetic Resonance in Biological Systems, State Key Laboratory of Magnetic Resonance and Atomic and Molecular Physics, National Center for Magnetic Resonance in Wuhan, Wuhan Institute of Physics and Mathematics, Innovation Academy for Precision Measurement Science and Technology, Chinese Academy of Sciences-Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan, China
- University of Chinese Academy of Sciences, Beijing, China
- Key Laboratory of Biomedical Engineering of Hainan Province, School of Biomedical Engineering, Hainan University, Haikou, China
| |
Collapse
|
4
|
Singh R, Singh N, Kaur L. Deep learning methods for 3D magnetic resonance image denoising, bias field and motion artifact correction: a comprehensive review. Phys Med Biol 2024; 69:23TR01. [PMID: 39569887 DOI: 10.1088/1361-6560/ad94c7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2024] [Accepted: 11/19/2024] [Indexed: 11/22/2024]
Abstract
Magnetic resonance imaging (MRI) provides detailed structural information of the internal body organs and soft tissue regions of a patient in clinical diagnosis for disease detection, localization, and progress monitoring. MRI scanner hardware manufacturers incorporate various post-acquisition image-processing techniques into the scanner's computer software tools for different post-processing tasks. These tools provide a final image of adequate quality and essential features for accurate clinical reporting and predictive interpretation for better treatment planning. Different post-acquisition image-processing tasks for MRI quality enhancement include noise removal, motion artifact reduction, magnetic bias field correction, and eddy electric current effect removal. Recently, deep learning (DL) methods have shown great success in many research fields, including image and video applications. DL-based data-driven feature-learning approaches have great potential for MR image denoising and image-quality-degrading artifact correction. Recent studies have demonstrated significant improvements in image-analysis tasks using DL-based convolutional neural network techniques. The promising capabilities and performance of DL techniques in various problem-solving domains have motivated researchers to adapt DL methods to medical image analysis and quality enhancement tasks. This paper presents a comprehensive review of DL-based state-of-the-art MRI quality enhancement and artifact removal methods for regenerating high-quality images while preserving essential anatomical and physiological feature maps without destroying important image information. Existing research gaps and future directions have also been provided by highlighting potential research areas for future developments, along with their importance and advantages in medical imaging.
Collapse
Affiliation(s)
- Ram Singh
- Department of Computer Science & Engineering, Punjabi University, Chandigarh Road, Patiala 147002, Punjab, India
| | - Navdeep Singh
- Department of Computer Science & Engineering, Punjabi University, Chandigarh Road, Patiala 147002, Punjab, India
| | - Lakhwinder Kaur
- Department of Computer Science & Engineering, Punjabi University, Chandigarh Road, Patiala 147002, Punjab, India
| |
Collapse
|
5
|
Ahmed MM, Hossain MM, Islam MR, Ali MS, Nafi AAN, Ahmed MF, Ahmed KM, Miah MS, Rahman MM, Niu M, Islam MK. Brain tumor detection and classification in MRI using hybrid ViT and GRU model with explainable AI in Southern Bangladesh. Sci Rep 2024; 14:22797. [PMID: 39354009 PMCID: PMC11445444 DOI: 10.1038/s41598-024-71893-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2024] [Accepted: 09/02/2024] [Indexed: 10/03/2024] Open
Abstract
Brain tumor, a leading cause of uncontrolled cell growth in the central nervous system, presents substantial challenges in medical diagnosis and treatment. Early and accurate detection is essential for effective intervention. This study aims to enhance the detection and classification of brain tumors in Magnetic Resonance Imaging (MRI) scans using an innovative framework combining Vision Transformer (ViT) and Gated Recurrent Unit (GRU) models. We utilized primary MRI data from Bangabandhu Sheikh Mujib Medical College Hospital (BSMMCH) in Faridpur, Bangladesh. Our hybrid ViT-GRU model extracts essential features via ViT and identifies relationships between these features using GRU, addressing class imbalance and outperforming existing diagnostic methods. We extensively processed the dataset, and then trained the model using various optimizers (SGD, Adam, AdamW) and evaluated through rigorous 10-fold cross-validation. Additionally, we incorporated Explainable Artificial Intelligence (XAI) techniques-Attention Map, SHAP, and LIME-to enhance the interpretability of the model's predictions. For the primary dataset BrTMHD-2023, the ViT-GRU model achieved precision, recall, and F1-score metrics of 97%. The highest accuracies obtained with SGD, Adam, and AdamW optimizers were 81.66%, 96.56%, and 98.97%, respectively. Our model outperformed existing Transfer Learning models by 1.26%, as validated through comparative analysis and cross-validation. The proposed model also shows excellent performances with another Brain Tumor Kaggle Dataset outperforming the existing research done on the same dataset with 96.08% accuracy. The proposed ViT-GRU framework significantly improves the detection and classification of brain tumors in MRI scans. The integration of XAI techniques enhances the model's transparency and reliability, fostering trust among clinicians and facilitating clinical application. Future work will expand the dataset and apply findings to real-time diagnostic devices, advancing the field.
Collapse
Affiliation(s)
- Md Mahfuz Ahmed
- Shaanxi Int'l Innovation Center for Transportation-Energy-Information Fusion and Sustainability, Chang'an University, Xi'an, 710064, China
- Department of Biomedical Engineering, Islamic University, 7003, Kushtia, Bangladesh
- Bio-Imaging Research Lab, Islamic University, 7003, Kushtia, Bangladesh
| | - Md Maruf Hossain
- Department of Biomedical Engineering, Islamic University, 7003, Kushtia, Bangladesh
- Bio-Imaging Research Lab, Islamic University, 7003, Kushtia, Bangladesh
| | - Md Rakibul Islam
- Bio-Imaging Research Lab, Islamic University, 7003, Kushtia, Bangladesh
- Department of Information and Communication Technology, Islamic University, 7003, Kushtia, Bangladesh
- Department of Computer Science and Engineering, Northern University Bangladesh, 1230, Dhaka, Bangladesh
| | - Md Shahin Ali
- Department of Biomedical Engineering, Islamic University, 7003, Kushtia, Bangladesh
- Bio-Imaging Research Lab, Islamic University, 7003, Kushtia, Bangladesh
| | - Abdullah Al Noman Nafi
- Department of Information and Communication Technology, Islamic University, 7003, Kushtia, Bangladesh
| | - Md Faisal Ahmed
- Ship International Hospital, 1230, Uttara, Dhaka, Bangladesh
| | - Kazi Mowdud Ahmed
- Department of Information and Communication Technology, Islamic University, 7003, Kushtia, Bangladesh
| | - Md Sipon Miah
- Shaanxi Int'l Innovation Center for Transportation-Energy-Information Fusion and Sustainability, Chang'an University, Xi'an, 710064, China
- Department of Information and Communication Technology, Islamic University, 7003, Kushtia, Bangladesh
- Wireless Communications with Machine Learning (WCML) Laboratory, Islamic University, 7003, Kushtia, Bangladesh
| | - Md Mahbubur Rahman
- Department of Information and Communication Technology, Islamic University, 7003, Kushtia, Bangladesh
| | - Mingbo Niu
- Shaanxi Int'l Innovation Center for Transportation-Energy-Information Fusion and Sustainability, Chang'an University, Xi'an, 710064, China.
| | - Md Khairul Islam
- Department of Biomedical Engineering, Islamic University, 7003, Kushtia, Bangladesh
- Bio-Imaging Research Lab, Islamic University, 7003, Kushtia, Bangladesh
| |
Collapse
|
6
|
Srivastava N, Sahoo GR, Voss HU, Niogi SN, Freed JH, Srivastava M. MRI Denoising Using Pixel-Wise Threshold Selection. IEEE ACCESS : PRACTICAL INNOVATIONS, OPEN SOLUTIONS 2024; 12:135730-135745. [PMID: 39640512 PMCID: PMC11619618 DOI: 10.1109/access.2024.3449811] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/07/2024]
Abstract
Magnetic resonance imaging (MRI) has emerged as a promising technique for non-invasive medical imaging. The primary challenge in MRI is the trade-off between image visual quality and acquisition time. Current MRI image denoising algorithms employ global thresholding to denoise the whole image, which leads to inadequate denoising or image distortion. This study introduces a novel pixel-wise (localized) thresholding approach of singular vectors, obtained from singular value decomposition, to denoise magnetic resonance (MR) images. The pixel-wise thresholding of singular vectors is performed using separate singular values as thresholds at each pixel, which is advantageous given the spatial noise variation throughout the image. The method presented is validated on MR images of a standard phantom approved by the magnetic resonance accreditation program (MRAP). The denoised images display superior visual quality and recover minute structural information otherwise suppressed in the noisy image. The increase in peak-signal-to-noise-ratio (PSNR) and contrast-to-noise-ratio (CNR) values of ≥ 18% and ≥ 200% of the denoised images, respectively, imply efficient noise removal and visual quality enhancement. The structural similarity index (SSIM) of ≥ 0.95 for denoised images indicates that the crucial structural information is recovered through the presented method. A comparison with the standard filtering methods widely used for MRI denoising establishes the superior performance of the presented method. The presented pixel-wise denoising technique reduces the scan time by 2-3 times and has the potential to be integrated into any MRI system to obtain faster and better quality images.
Collapse
Affiliation(s)
- Nimesh Srivastava
- Department of Chemistry and Chemical Biology, Cornell University, Ithaca, NY 14853, USA
- EZ Diagnostics Inc., Ithaca, NY 14850, USA
| | - Gyana Ranjan Sahoo
- Department of Chemistry and Chemical Biology, Cornell University, Ithaca, NY 14853, USA
| | - Henning U Voss
- Cornell MRI Facility, College of Human Ecology, Cornell University, Ithaca, NY 14853, USA
| | - Sumit N Niogi
- Cornell MRI Facility, College of Human Ecology, Cornell University, Ithaca, NY 14853, USA
- Department of Radiology, Weil Cornell Medicine, New York-Presbyterian Hospital, New York City, NY 10065, USA
| | - Jack H Freed
- Department of Chemistry and Chemical Biology, Cornell University, Ithaca, NY 14853, USA
- National Biomedical Center for Advanced Electron Spin Resonance Technology, Cornell University, Ithaca, NY 14853, USA
| | - Madhur Srivastava
- Department of Chemistry and Chemical Biology, Cornell University, Ithaca, NY 14853, USA
- National Biomedical Center for Advanced Electron Spin Resonance Technology, Cornell University, Ithaca, NY 14853, USA
- Cornell Atkinson Center for Sustainability, Cornell University, Ithaca, NY 14853, USA
| |
Collapse
|
7
|
Yun SY, Heo YJ. Clinical feasibility of post-contrast accelerated 3D T1-Sampling Perfection with Application-optimized Contrasts using different flip angle Evolutions (SPACE) with iterative denoising for intracranial enhancing lesions: a retrospective study. Acta Radiol 2024; 65:654-662. [PMID: 38623647 DOI: 10.1177/02841851241245104] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/17/2024]
Abstract
BACKGROUND Post-contrast T1-Sampling Perfection with Application-optimized Contrasts using different flip angle Evolutions (SPACE) is the preferred 3D T1 spin-echo sequence for evaluating brain metastases, regardless of the prolonged scan time. PURPOSE To evaluate the application of accelerated post-contrast T1-SPACE with iterative denoising (ID) for intracranial enhancing lesions in oncologic patients. MATERIAL AND METHODS For evaluation of intracranial lesions, 108 patients underwent standard and accelerated T1-SPACE during the same imaging session. Two neuroradiologists evaluated the overall image quality, artifacts, degree of enhancement, mean contrast-to-noise ratiolesion/parenchyma, and number of enhancing lesions for standard and accelerated T1-SPACE without ID. RESULTS Although there was a significant difference in the overall image quality and mean contrast-to-noise ratiolesion/parenchyma between standard and accelerated T1-SPACE without ID and accelerated SPACE with and without ID, there was no significant difference between standard and accelerated T1-SPACE with ID. Accelerated T1-SPACE showed more artifacts than standard T1-SPACE; however, accelerated T1-SPACE with ID showed significantly fewer artifacts than accelerated T1-SPACE without ID. Accelerated T1-SPACE without ID showed a significantly lower number of enhancing lesions than standard- and accelerated T1-SPACE with ID; however, there was no significant difference between standard and accelerated T1-SPACE with ID, regardless of lesion size. CONCLUSION Although accelerated T1-SPACE markedly decreased the scan time, it showed lower overall image quality and lesion detectability than the standard T1-SPACE. Application of ID to accelerated T1-SPACE resulted in comparable overall image quality and detection of enhancing lesions in brain parenchyma as standard T1-SPACE. Accelerated T1-SPACE with ID may be a promising replacement for standard T1-SPACE.
Collapse
Affiliation(s)
- Su Young Yun
- Department of Radiology, Inje University Busan Paik Hospital, Busan, Republic of Korea
| | - Young Jin Heo
- Department of Radiology, Inje University Busan Paik Hospital, Busan, Republic of Korea
| |
Collapse
|
8
|
Haacke EM, Xu Q, Kokeny P, Gharabaghi S, Chen Y, Wu B, Liu Y, He N, Yan F. Strategically Acquired Gradient Echo (STAGE) Imaging, part IV: Constrained Reconstruction of White Noise (CROWN) Processing as a Means to Improve Signal-to-Noise in STAGE Imaging at 3 Tesla. Magn Reson Imaging 2024; 107:55-68. [PMID: 38181834 DOI: 10.1016/j.mri.2024.01.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2023] [Revised: 10/30/2023] [Accepted: 01/01/2024] [Indexed: 01/07/2024]
Abstract
Increasing the signal-to-noise ratio (SNR) has always been of critical importance for magnetic resonance imaging. Although increasing field strength provides a linear increase in SNR, it is more and more costly as field strength increases. Therefore, there is a major effort today to use signal processing methods to improve SNR since it is more efficient and economical. There are a variety of methods to improve SNR such as averaging the data at the expense of imaging time, or collecting the data with a lower resolution, all of these methods, including imaging processing methods, usually come at the expense of loss of image detail or image blurring. Therefore, we developed a new mathematical approach called CROWN (Constrained Reconstruction of White Noise) to enhance SNR without loss of structural detail and without affecting scanning time. In this study, we introduced and tested the concept behind CROWN specifically for STAGE (strategically acquired gradient echo) imaging. The concept itself is presented first, followed by simulations to demonstrate its theoretical effectiveness. Then the SNR improvement on proton spin density (PSD) and R2⁎ maps was investigated using brain STAGE data acquired from 10 healthy controls (HCs) and 10 patients with Parkinson's disease (PD). For the PSD and R2* maps, the SNR and CNR between white matter and gray matter were improved by a factor of 1.87 ± 0.50 and 1.72 ± 0.88, respectively. The white matter hyperintensity lesions in PD patients were more clearly defined after CROWN processing. Using these improved maps, simulated images for any repeat time, echo time or flip angle can be created with improved SNR. The potential applications of this technology are to trade off the increased SNR for higher resolution images and/or faster imaging.
Collapse
Affiliation(s)
- E Mark Haacke
- SpinTech MRI, Bingham Farms, MI 48025, United States of America; Wayne State University, Department of Neurology, Detroit, MI 48201, United States of America; Wayne State University, Department of Radiology, Detroit, MI 48201, United States of America; Zhuyan Limited, Shanghai, China.
| | - Qiuyun Xu
- SpinTech MRI, Bingham Farms, MI 48025, United States of America
| | - Paul Kokeny
- SpinTech MRI, Bingham Farms, MI 48025, United States of America
| | - Sara Gharabaghi
- SpinTech MRI, Bingham Farms, MI 48025, United States of America
| | - Yongsheng Chen
- Wayne State University, Department of Neurology, Detroit, MI 48201, United States of America
| | - Bo Wu
- Zhuyan Limited, Shanghai, China
| | - Yu Liu
- Ruijin Hospital, School of Medicine, Shanghai Jiao Tong University, Department of Radiology, Shanghai, China
| | - Naying He
- Ruijin Hospital, School of Medicine, Shanghai Jiao Tong University, Department of Radiology, Shanghai, China
| | - Fuhua Yan
- Ruijin Hospital, School of Medicine, Shanghai Jiao Tong University, Department of Radiology, Shanghai, China
| |
Collapse
|
9
|
Brzostowski K, Obuchowicz R. Combining variational mode decomposition with regularisation techniques to denoise MRI data. Magn Reson Imaging 2024; 106:55-76. [PMID: 37972800 DOI: 10.1016/j.mri.2023.10.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2022] [Revised: 10/11/2023] [Accepted: 10/24/2023] [Indexed: 11/19/2023]
Abstract
In this paper, we propose a novel method for removing noise from MRI data by exploiting regularisation techniques combined with variational mode decomposition. Variational mode decomposition is a new decomposition technique for sparse decomposition of a 1D or 2D signal into a set of modes. In turn, regularisation is a method that can translate the ill-posed problem (e.g., image denoising) into a well-posed problem. The proposed method aims to remove the noise from the image in two steps. In the first step, the MR imaging data are decomposed by the 2D variational mode decomposition algorithm. In the second step, for effective suppression of Rician noise from MRI data, we used the fused lasso signal approximator with all modes acquired from the medical scan. The performance of the proposed approach was compared with state-of-the-art reference methods based on different metrics, that is, the peak signal-to-noise ratio, the structural similarity index metrics, the high-frequency error norm, the quality index based on local variance, and the sharpness index. The experiments were performed on the basis of both simulated and real images. The presented results prove the high denoising performance of the proposed algorithm; particularly under heavy noise conditions.
Collapse
Affiliation(s)
- Krzysztof Brzostowski
- Department of Computer Science and Systems Engineering, Faculty of Information and Communication Technology, Wrocław University of Science and Technology, Wrocław 50-370, Poland.
| | - Rafał Obuchowicz
- Department of Diagnostic Imaging, Jagiellonian University Medical College, Kraków 31-501, Poland
| |
Collapse
|
10
|
Giaccone P, D'Antoni F, Russo F, Volpecina M, Mallio CA, Papalia GF, Vadalà G, Denaro V, Vollero L, Merone M. Fully automated evaluation of paraspinal muscle morphology and composition in patients with low back pain. INTELLIGENCE-BASED MEDICINE 2024; 9:100130. [DOI: 10.1016/j.ibmed.2023.100130] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/14/2024]
|
11
|
Pfaff L, Hossbach J, Preuhs E, Wagner F, Arroyo Camejo S, Kannengiesser S, Nickel D, Wuerfl T, Maier A. Self-supervised MRI denoising: leveraging Stein's unbiased risk estimator and spatially resolved noise maps. Sci Rep 2023; 13:22629. [PMID: 38114575 PMCID: PMC10730523 DOI: 10.1038/s41598-023-49023-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2023] [Accepted: 12/03/2023] [Indexed: 12/21/2023] Open
Abstract
Thermal noise caused by the imaged object is an intrinsic limitation in magnetic resonance imaging (MRI), resulting in an impaired clinical value of the acquisitions. Recently, deep learning (DL)-based denoising methods achieved promising results by extracting complex feature representations from large data sets. Most approaches are trained in a supervised manner by directly mapping noisy to noise-free ground-truth data and, therefore, require extensive paired data sets, which can be expensive or infeasible to obtain for medical imaging applications. In this work, a DL-based denoising approach is investigated which operates on complex-valued reconstructed magnetic resonance (MR) images without noise-free target data. An extension of Stein's unbiased risk estimator (SURE) and spatially resolved noise maps quantifying the noise level with pixel accuracy were employed during the training process. Competitive denoising performance was achieved compared to supervised training with mean squared error (MSE) despite optimizing the model without noise-free target images. The proposed DL-based method can be applied for MR image enhancement without requiring noise-free target data for training. Integrating the noise maps as an additional input channel further enables the regulation of the desired level of denoising to adjust to the preference of the radiologist.
Collapse
Affiliation(s)
- Laura Pfaff
- Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, 91058, Erlangen, Germany.
- Magnetic Resonance, Siemens Healthcare GmbH, 91052, Erlangen, Germany.
| | - Julian Hossbach
- Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, 91058, Erlangen, Germany
- Magnetic Resonance, Siemens Healthcare GmbH, 91052, Erlangen, Germany
| | - Elisabeth Preuhs
- Magnetic Resonance, Siemens Healthcare GmbH, 91052, Erlangen, Germany
| | - Fabian Wagner
- Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, 91058, Erlangen, Germany
| | | | | | - Dominik Nickel
- Magnetic Resonance, Siemens Healthcare GmbH, 91052, Erlangen, Germany
| | - Tobias Wuerfl
- Magnetic Resonance, Siemens Healthcare GmbH, 91052, Erlangen, Germany
| | - Andreas Maier
- Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, 91058, Erlangen, Germany
| |
Collapse
|
12
|
Christensen NV, Vaeggemose M, Bøgh N, Hansen ESS, Olesen JL, Kim Y, Vigneron DB, Gordon JW, Jespersen SN, Laustsen C. A user independent denoising method for x-nuclei MRI and MRS. Magn Reson Med 2023; 90:2539-2556. [PMID: 37526128 DOI: 10.1002/mrm.29817] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2023] [Revised: 07/12/2023] [Accepted: 07/13/2023] [Indexed: 08/02/2023]
Abstract
PURPOSE X-nuclei (also called non-proton MRI) MRI and spectroscopy are limited by the intrinsic low SNR as compared to conventional proton imaging. Clinical translation of x-nuclei examination warrants the need of a robust and versatile tool improving image quality for diagnostic use. In this work, we compare a novel denoising method with fewer inputs to the current state-of-the-art denoising method. METHODS Denoising approaches were compared on human acquisitions of sodium (23 Na) brain, deuterium (2 H) brain, carbon (13 C) heart and brain, and simulated dynamic hyperpolarized 13 C brain scans, with and without additional noise. The current state-of-the-art denoising method Global-local higher order singular value decomposition (GL-HOSVD) was compared to the few-input method tensor Marchenko-Pastur principal component analysis (tMPPCA). Noise-removal was quantified by residual distributions, and statistical analyses evaluated the differences in mean-square-error and Bland-Altman analysis to quantify agreement between original and denoised results of noise-added data. RESULTS GL-HOSVD and tMPPCA showed similar performance for the variety of x-nuclei data analyzed in this work, with tMPPCA removing ˜5% more noise on average over GL-HOSVD. The mean ratio between noise-added and denoising reproducibility coefficients of the Bland-Altman analysis when compared to the original are also similar for the two methods with 3.09 ± 1.03 and 2.83 ± 0.79 for GL-HOSVD and tMPPCA, respectively. CONCLUSION The strength of tMPPCA lies in the few-input approach, which generalizes well to different data sources. This makes the use of tMPPCA denoising a robust and versatile tool in x-nuclei imaging improvements and the preferred denoising method.
Collapse
Affiliation(s)
| | - Michael Vaeggemose
- The MR Research Centre, Department of Clinical Medicine, Aarhus University, Aarhus, Denmark
- GE Healthcare, Brøndby, Denmark
| | - Nikolaj Bøgh
- The MR Research Centre, Department of Clinical Medicine, Aarhus University, Aarhus, Denmark
- A&E, Gødstrup Hospital, Herning, Denmark
| | - Esben S S Hansen
- The MR Research Centre, Department of Clinical Medicine, Aarhus University, Aarhus, Denmark
| | - Jonas L Olesen
- Center of Functionally Integrative Neuroscience (CFIN) and MINDLab, Department of Clinical Medicine, Aarhus University, Aarhus, Denmark
| | - Yaewon Kim
- Department of Radiology and Biomedical Imaging, University of California San Francisco (UCSF), San Francisco, California, USA
| | - Daniel B Vigneron
- Department of Radiology and Biomedical Imaging, University of California San Francisco (UCSF), San Francisco, California, USA
| | - Jeremy W Gordon
- Department of Radiology and Biomedical Imaging, University of California San Francisco (UCSF), San Francisco, California, USA
| | - Sune N Jespersen
- Center of Functionally Integrative Neuroscience (CFIN) and MINDLab, Department of Clinical Medicine, Aarhus University, Aarhus, Denmark
| | - Christoffer Laustsen
- The MR Research Centre, Department of Clinical Medicine, Aarhus University, Aarhus, Denmark
| |
Collapse
|
13
|
Alsayat A, Elmezain M, Alanazi S, Alruily M, Mostafa AM, Said W. Multi-Layer Preprocessing and U-Net with Residual Attention Block for Retinal Blood Vessel Segmentation. Diagnostics (Basel) 2023; 13:3364. [PMID: 37958260 PMCID: PMC10648654 DOI: 10.3390/diagnostics13213364] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2023] [Revised: 10/21/2023] [Accepted: 10/30/2023] [Indexed: 11/15/2023] Open
Abstract
Retinal blood vessel segmentation is a valuable tool for clinicians to diagnose conditions such as atherosclerosis, glaucoma, and age-related macular degeneration. This paper presents a new framework for segmenting blood vessels in retinal images. The framework has two stages: a multi-layer preprocessing stage and a subsequent segmentation stage employing a U-Net with a multi-residual attention block. The multi-layer preprocessing stage has three steps. The first step is noise reduction, employing a U-shaped convolutional neural network with matrix factorization (CNN with MF) and detailed U-shaped U-Net (D_U-Net) to minimize image noise, culminating in the selection of the most suitable image based on the PSNR and SSIM values. The second step is dynamic data imputation, utilizing multiple models for the purpose of filling in missing data. The third step is data augmentation through the utilization of a latent diffusion model (LDM) to expand the training dataset size. The second stage of the framework is segmentation, where the U-Nets with a multi-residual attention block are used to segment the retinal images after they have been preprocessed and noise has been removed. The experiments show that the framework is effective at segmenting retinal blood vessels. It achieved Dice scores of 95.32, accuracy of 93.56, precision of 95.68, and recall of 95.45. It also achieved efficient results in removing noise using CNN with matrix factorization (MF) and D-U-NET according to values of PSNR and SSIM for (0.1, 0.25, 0.5, and 0.75) levels of noise. The LDM achieved an inception score of 13.6 and an FID of 46.2 in the augmentation step.
Collapse
Affiliation(s)
- Ahmed Alsayat
- Department of Computer Science, College of Computer and Information Sciences, Jouf University, Sakaka 72341, Saudi Arabia; (S.A.); (M.A.)
| | - Mahmoud Elmezain
- Computer Science Division, Faculty of Science, Tanta University, Tanta 31527, Egypt;
- Computer Science Department, College of Computer Science and Engineering, Taibah University, Yanbu 966144, Saudi Arabia
| | - Saad Alanazi
- Department of Computer Science, College of Computer and Information Sciences, Jouf University, Sakaka 72341, Saudi Arabia; (S.A.); (M.A.)
| | - Meshrif Alruily
- Department of Computer Science, College of Computer and Information Sciences, Jouf University, Sakaka 72341, Saudi Arabia; (S.A.); (M.A.)
| | - Ayman Mohamed Mostafa
- Information Systems Department, College of Computer and Information Sciences, Jouf University, Sakaka 72341, Saudi Arabia
| | - Wael Said
- Computer Science Department, Faculty of Computers and Informatics, Zagazig University, Zagazig 44511, Egypt;
- Computer Science Department, College of Computer Science and Engineering, Taibah University, Medina 42353, Saudi Arabia
| |
Collapse
|
14
|
Nafees Ahmed S, Prakasam P. A systematic review on intracranial aneurysm and hemorrhage detection using machine learning and deep learning techniques. PROGRESS IN BIOPHYSICS AND MOLECULAR BIOLOGY 2023; 183:1-16. [PMID: 37499766 DOI: 10.1016/j.pbiomolbio.2023.07.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/21/2023] [Revised: 07/05/2023] [Accepted: 07/15/2023] [Indexed: 07/29/2023]
Abstract
The risk of discovering an intracranial aneurysm during the initial screening and follow-up screening are reported as around 11%, and 7% respectively (Zuurbie et al., 2023) to these mass effects, unruptured aneurysms frequently generate symptoms, however, the real hazard occurs when an aneurysm ruptures and results in a cerebral hemorrhage known as a subarachnoid hemorrhage. The objective is to study the multiple kinds of hemorrhage and aneurysm detection problems and develop machine and deep learning models to recognise them. Due to its early stage, subarachnoid hemorrhage, the most typical symptom after aneurysm rupture, is an important medical condition. It frequently results in severe neurological emergencies or even death. Although most aneurysms are asymptomatic and won't burst, because of their unpredictable growth, even small aneurysms are susceptible. A timely diagnosis is essential to prevent early mortality because a large percentage of hemorrhage cases present can be fatal. Physiological/imaging markers and the degree of the subarachnoid hemorrhage can be used as indicators for potential early treatments in hemorrhage. The hemodynamic pathomechanisms and microcellular environment should remain a priority for academics and medical professionals. There is still disagreement about how and when to care for aneurysms that have not ruptured despite studies reporting on the risk of rupture and outcomes. We are optimistic that with the progress in our understanding of the pathophysiology of hemorrhages and aneurysms and the advancement of artificial intelligence has made it feasible to conduct analyses with a high degree of precision, effectiveness and reliability.
Collapse
Affiliation(s)
- S Nafees Ahmed
- School of Electronics Engineering, Vellore Institute of Technology, Vellore, India.
| | - P Prakasam
- School of Electronics Engineering, Vellore Institute of Technology, Vellore, India.
| |
Collapse
|
15
|
Boone L, Biparva M, Mojiri Forooshani P, Ramirez J, Masellis M, Bartha R, Symons S, Strother S, Black SE, Heyn C, Martel AL, Swartz RH, Goubran M. ROOD-MRI: Benchmarking the robustness of deep learning segmentation models to out-of-distribution and corrupted data in MRI. Neuroimage 2023; 278:120289. [PMID: 37495197 DOI: 10.1016/j.neuroimage.2023.120289] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2023] [Revised: 04/26/2023] [Accepted: 07/20/2023] [Indexed: 07/28/2023] Open
Abstract
Deep artificial neural networks (DNNs) have moved to the forefront of medical image analysis due to their success in classification, segmentation, and detection challenges. A principal challenge in large-scale deployment of DNNs in neuroimage analysis is the potential for shifts in signal-to-noise ratio, contrast, resolution, and presence of artifacts from site to site due to variances in scanners and acquisition protocols. DNNs are famously susceptible to these distribution shifts in computer vision. Currently, there are no benchmarking platforms or frameworks to assess the robustness of new and existing models to specific distribution shifts in MRI, and accessible multi-site benchmarking datasets are still scarce or task-specific. To address these limitations, we propose ROOD-MRI: a novel platform for benchmarking the Robustness of DNNs to Out-Of-Distribution (OOD) data, corruptions, and artifacts in MRI. This flexible platform provides modules for generating benchmarking datasets using transforms that model distribution shifts in MRI, implementations of newly derived benchmarking metrics for image segmentation, and examples for using the methodology with new models and tasks. We apply our methodology to hippocampus, ventricle, and white matter hyperintensity segmentation in several large studies, providing the hippocampus dataset as a publicly available benchmark. By evaluating modern DNNs on these datasets, we demonstrate that they are highly susceptible to distribution shifts and corruptions in MRI. We show that while data augmentation strategies can substantially improve robustness to OOD data for anatomical segmentation tasks, modern DNNs using augmentation still lack robustness in more challenging lesion-based segmentation tasks. We finally benchmark U-Nets and vision transformers, finding robustness susceptibility to particular classes of transforms across architectures. The presented open-source platform enables generating new benchmarking datasets and comparing across models to study model design that results in improved robustness to OOD data and corruptions in MRI.
Collapse
Affiliation(s)
- Lyndon Boone
- Department of Medical Biophysics, University of Toronto, Toronto, Canada; Hurvitz Brain Sciences Research Program, Sunnybrook Research Institute, Toronto, Canada; Physical Sciences, Sunnybrook Research Institute, Toronto, Canada.
| | - Mahdi Biparva
- Hurvitz Brain Sciences Research Program, Sunnybrook Research Institute, Toronto, Canada; Physical Sciences, Sunnybrook Research Institute, Toronto, Canada; Canadian Partnership for Stroke Recovery, Heart and Stroke Foundation, Toronto, Canada
| | - Parisa Mojiri Forooshani
- Hurvitz Brain Sciences Research Program, Sunnybrook Research Institute, Toronto, Canada; Physical Sciences, Sunnybrook Research Institute, Toronto, Canada; Canadian Partnership for Stroke Recovery, Heart and Stroke Foundation, Toronto, Canada
| | - Joel Ramirez
- Hurvitz Brain Sciences Research Program, Sunnybrook Research Institute, Toronto, Canada; Physical Sciences, Sunnybrook Research Institute, Toronto, Canada; Canadian Partnership for Stroke Recovery, Heart and Stroke Foundation, Toronto, Canada
| | - Mario Masellis
- Hurvitz Brain Sciences Research Program, Sunnybrook Research Institute, Toronto, Canada; Canadian Partnership for Stroke Recovery, Heart and Stroke Foundation, Toronto, Canada; Department of Medicine, University of Toronto, Toronto, Canada
| | - Robert Bartha
- Department of Medical Biophysics, Western University, London, Canada; Robarts Research Institute, Western University, London, Canada
| | - Sean Symons
- Hurvitz Brain Sciences Research Program, Sunnybrook Research Institute, Toronto, Canada; Physical Sciences, Sunnybrook Research Institute, Toronto, Canada; Department of Medical Imaging, University of Toronto, Toronto, Canada
| | - Stephen Strother
- Department of Medical Biophysics, University of Toronto, Toronto, Canada; Rotman Research Institute, Baycrest, Toronto, Canada
| | - Sandra E Black
- Hurvitz Brain Sciences Research Program, Sunnybrook Research Institute, Toronto, Canada; Canadian Partnership for Stroke Recovery, Heart and Stroke Foundation, Toronto, Canada; Department of Medicine, University of Toronto, Toronto, Canada
| | - Chris Heyn
- Hurvitz Brain Sciences Research Program, Sunnybrook Research Institute, Toronto, Canada; Physical Sciences, Sunnybrook Research Institute, Toronto, Canada; Department of Medical Imaging, University of Toronto, Toronto, Canada
| | - Anne L Martel
- Department of Medical Biophysics, University of Toronto, Toronto, Canada; Physical Sciences, Sunnybrook Research Institute, Toronto, Canada
| | - Richard H Swartz
- Hurvitz Brain Sciences Research Program, Sunnybrook Research Institute, Toronto, Canada; Canadian Partnership for Stroke Recovery, Heart and Stroke Foundation, Toronto, Canada; Department of Medicine, University of Toronto, Toronto, Canada
| | - Maged Goubran
- Department of Medical Biophysics, University of Toronto, Toronto, Canada; Hurvitz Brain Sciences Research Program, Sunnybrook Research Institute, Toronto, Canada; Physical Sciences, Sunnybrook Research Institute, Toronto, Canada; Canadian Partnership for Stroke Recovery, Heart and Stroke Foundation, Toronto, Canada.
| |
Collapse
|
16
|
Si T, Patra DK, Mallik S, Bandyopadhyay A, Sarkar A, Qin H. Identification of breast lesion through integrated study of gorilla troops optimization and rotation-based learning from MRI images. Sci Rep 2023; 13:11577. [PMID: 37463919 PMCID: PMC10354050 DOI: 10.1038/s41598-023-36300-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/24/2022] [Accepted: 05/31/2023] [Indexed: 07/20/2023] Open
Abstract
Breast cancer has emerged as the most life-threatening disease among women around the world. Early detection and treatment of breast cancer are thought to reduce the need for surgery and boost the survival rate. The Magnetic Resonance Imaging (MRI) segmentation techniques for breast cancer diagnosis are investigated in this article. Kapur's entropy-based multilevel thresholding is used in this study to determine optimal values for breast DCE-MRI lesion segmentation using Gorilla Troops Optimization (GTO). An improved GTO, is developed by incorporating Rotational opposition based-learning (RBL) into GTO called (GTORBL) and applied it to the same problem. The proposed approaches are tested on 20 patients' T2 Weighted Sagittal (T2 WS) DCE-MRI 100 slices. The proposed approaches are compared with Tunicate Swarm Algorithm (TSA), Particle Swarm Optimization (PSO), Arithmetic Optimization Algorithm (AOA), Slime Mould Algorithm (SMA), Multi-verse Optimization (MVO), Hidden Markov Random Field (HMRF), Improved Markov Random Field (IMRF), and Conventional Markov Random Field (CMRF). The Dice Similarity Coefficient (DSC), sensitivity, and accuracy of the proposed GTO-based approach is achieved [Formula: see text], [Formula: see text], and [Formula: see text] respectively. Another proposed GTORBL-based segmentation method achieves accuracy values of [Formula: see text] , sensitivity of [Formula: see text] , and DSC of [Formula: see text]. The one-way ANOVA test followed by Tukey HSD and Wilcoxon Signed Rank Test are used to examine the results. Furthermore, Multi-Criteria Decision Making is used to evaluate overall performance focused on sensitivity, accuracy, false-positive rate, precision, specificity, [Formula: see text]-score, Geometric-Mean, and DSC. According to both quantitative and qualitative findings, the proposed strategies outperform other compared methodologies.
Collapse
Affiliation(s)
- Tapas Si
- Department of Computer Science & Engineering, University of Engineering & Management, Jaipur, GURUKUL, Sikar Road (NH-11), Udaipuria Mod, Jaipur, Rajasthan, 303807, India
| | - Dipak Kumar Patra
- Department of Computer Science, Hijli College, Kharagpur, West Bengal, 721306, India
| | - Saurav Mallik
- Department of Environmental Health, Harvard T H Chan School of Public Health, Boston, MA, USA.
| | - Anjan Bandyopadhyay
- School of Computer Engineering, Kalinga Institute of Industrial Technology (KIIT), Bhubaneswar, Odisha, India
| | - Achyuth Sarkar
- Department of Computer Science & Engineering, National Institute of Technology Arunachal Pradesh, Arunachal Pradesh, 791113, India
| | - Hong Qin
- Department of Computer Science and Engineering, University of Tennessee at Chattanooga, Chattanooga, TN, USA.
| |
Collapse
|
17
|
Jiang X, Hu Z, Wang S, Zhang Y. Deep Learning for Medical Image-Based Cancer Diagnosis. Cancers (Basel) 2023; 15:3608. [PMID: 37509272 PMCID: PMC10377683 DOI: 10.3390/cancers15143608] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2023] [Revised: 07/10/2023] [Accepted: 07/10/2023] [Indexed: 07/30/2023] Open
Abstract
(1) Background: The application of deep learning technology to realize cancer diagnosis based on medical images is one of the research hotspots in the field of artificial intelligence and computer vision. Due to the rapid development of deep learning methods, cancer diagnosis requires very high accuracy and timeliness as well as the inherent particularity and complexity of medical imaging. A comprehensive review of relevant studies is necessary to help readers better understand the current research status and ideas. (2) Methods: Five radiological images, including X-ray, ultrasound (US), computed tomography (CT), magnetic resonance imaging (MRI), positron emission computed tomography (PET), and histopathological images, are reviewed in this paper. The basic architecture of deep learning and classical pretrained models are comprehensively reviewed. In particular, advanced neural networks emerging in recent years, including transfer learning, ensemble learning (EL), graph neural network, and vision transformer (ViT), are introduced. Five overfitting prevention methods are summarized: batch normalization, dropout, weight initialization, and data augmentation. The application of deep learning technology in medical image-based cancer analysis is sorted out. (3) Results: Deep learning has achieved great success in medical image-based cancer diagnosis, showing good results in image classification, image reconstruction, image detection, image segmentation, image registration, and image synthesis. However, the lack of high-quality labeled datasets limits the role of deep learning and faces challenges in rare cancer diagnosis, multi-modal image fusion, model explainability, and generalization. (4) Conclusions: There is a need for more public standard databases for cancer. The pre-training model based on deep neural networks has the potential to be improved, and special attention should be paid to the research of multimodal data fusion and supervised paradigm. Technologies such as ViT, ensemble learning, and few-shot learning will bring surprises to cancer diagnosis based on medical images.
Collapse
Grants
- RM32G0178B8 BBSRC
- MC_PC_17171 MRC, UK
- RP202G0230 Royal Society, UK
- AA/18/3/34220 BHF, UK
- RM60G0680 Hope Foundation for Cancer Research, UK
- P202PF11 GCRF, UK
- RP202G0289 Sino-UK Industrial Fund, UK
- P202ED10, P202RE969 LIAS, UK
- P202RE237 Data Science Enhancement Fund, UK
- 24NN201 Fight for Sight, UK
- OP202006 Sino-UK Education Fund, UK
- RM32G0178B8 BBSRC, UK
- 2023SJZD125 Major project of philosophy and social science research in colleges and universities in Jiangsu Province, China
Collapse
Affiliation(s)
- Xiaoyan Jiang
- School of Mathematics and Information Science, Nanjing Normal University of Special Education, Nanjing 210038, China; (X.J.); (Z.H.)
| | - Zuojin Hu
- School of Mathematics and Information Science, Nanjing Normal University of Special Education, Nanjing 210038, China; (X.J.); (Z.H.)
| | - Shuihua Wang
- School of Computing and Mathematical Sciences, University of Leicester, Leicester LE1 7RH, UK;
| | - Yudong Zhang
- School of Computing and Mathematical Sciences, University of Leicester, Leicester LE1 7RH, UK;
| |
Collapse
|
18
|
Atal DK. Optimal Deep CNN-Based Vectorial Variation Filter for Medical Image Denoising. J Digit Imaging 2023; 36:1216-1236. [PMID: 36650303 PMCID: PMC10287890 DOI: 10.1007/s10278-022-00768-8] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2022] [Revised: 12/22/2022] [Accepted: 12/23/2022] [Indexed: 01/19/2023] Open
Abstract
Medical imaging has acquired more attention due to the emerging design of wireless technologies, the internet, and data storage. The reflection of these technologies has gained attraction in medicine and medical sciences facilitating the diagnosis and treatment of different diseases in an effective manner. However, medical images are vulnerable to noise, which can make the image unclear and perplex the identification. Thus, denoising of medical images is imperative for processing medical images. This paper devises a novel optimal deep convolution neural network-based vectorial variation (ODVV) filter for denoising medical computed tomography (CT) images and Lena images. Here, the input medical images are fed to a noisy pixel map identification module wherein the deep convolutional neural network (Deep CNN) is adapted for discovering noisy pixel maps. Here, Deep CNN training is done with the Adam algorithm. Once noisy pixels are identified, it is further given to noise removal module which is performed using the proposed optimization algorithm, namely Feedback Artificial Lion (FAL). Here, the FAL is devised by combining the FAT and Lion algorithm. After noise removal, the pixel enhancement is performed using the vectorial total variation norm to get final pixel-enhanced image. The proposed FAL algorithm offered enhanced performance in contrast to other techniques with the highest peak signal-to-noise ratio (PSNR) of 24.149 dB, highest second-derivative-like measure of enhancement (SDME) of 32.142 dB, highest structural index similarity (SSIM) of 0.800, and Edge Preserve Index (EPI) of 0.9267.
Collapse
Affiliation(s)
- Dinesh Kumar Atal
- Dept. of Biomedical Engineering, Deenbandhu Chhotu Ram University of Science and Technology, Sonipat, Haryana, 131039, India.
| |
Collapse
|
19
|
Wang D, Sun Y, Tang X, Liu C, Liu R. Deep learning-based magnetic resonance imaging of the spine in the diagnosis and physiological evaluation of spinal metastases. J Bone Oncol 2023; 40:100483. [PMID: 37228896 PMCID: PMC10205450 DOI: 10.1016/j.jbo.2023.100483] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2023] [Revised: 04/26/2023] [Accepted: 04/30/2023] [Indexed: 05/27/2023] Open
Abstract
Background and objective Spinal metastasis accounts for 70% of the bone metastases of tumors, so how to diagnose and predict spinal metastasis in time through effective methods is very important for the physiological evaluation of the therapy of patients. Methods MRI scans of 941 patients with spinal metastases from the affiliated hospital of Guilin Medical University were collected, analyzed, and preprocessed, and the data were submitted to a deep learning model designed with our convolutional neural network. We also used the Softmax classifier to classify the results and compared them with the actual data to judge the accuracy of our model. Results Our research showed that the practical model method could effectively predict spinal metastases. The accuracy was up to 96.45%, which could be used to diagnose the physiological evaluation of spinal metastases. Conclusion The model obtained in the final experiment can capture the focal signs of patients with spinal metastases more accurately and can predict the disease in time, which has a good application prospect.
Collapse
Affiliation(s)
- Dapeng Wang
- The Department of Traumatology, Affiliated Hospital of Guilin Medical University, Guilin 541001, China
| | - Yan Sun
- The Department of Spinal Surgery, Affiliated Hospital of Guilin Medical University, Guilin 541001, China
| | - Xing Tang
- The Department of Spinal Surgery, Affiliated Hospital of Guilin Medical University, Guilin 541001, China
| | - Caijun Liu
- The Third Affiliated Hospital of Guangzhou University of Chinese Medicine, Guangdong Research Institute for Orthopedics & Traumatology of Chinese Medicine, Guangdong 510378, China
| | - Ruiduan Liu
- The Department of Spinal Surgery, Affiliated Hospital of Guilin Medical University, Guilin 541001, China
| |
Collapse
|
20
|
2D MRI registration using glowworm swarm optimization with partial opposition-based learning for brain tumor progression. Pattern Anal Appl 2023. [DOI: 10.1007/s10044-023-01153-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/24/2023]
|
21
|
Chen Z, Pawar K, Ekanayake M, Pain C, Zhong S, Egan GF. Deep Learning for Image Enhancement and Correction in Magnetic Resonance Imaging-State-of-the-Art and Challenges. J Digit Imaging 2023; 36:204-230. [PMID: 36323914 PMCID: PMC9984670 DOI: 10.1007/s10278-022-00721-9] [Citation(s) in RCA: 32] [Impact Index Per Article: 16.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2022] [Revised: 09/09/2022] [Accepted: 10/17/2022] [Indexed: 11/06/2022] Open
Abstract
Magnetic resonance imaging (MRI) provides excellent soft-tissue contrast for clinical diagnoses and research which underpin many recent breakthroughs in medicine and biology. The post-processing of reconstructed MR images is often automated for incorporation into MRI scanners by the manufacturers and increasingly plays a critical role in the final image quality for clinical reporting and interpretation. For image enhancement and correction, the post-processing steps include noise reduction, image artefact correction, and image resolution improvements. With the recent success of deep learning in many research fields, there is great potential to apply deep learning for MR image enhancement, and recent publications have demonstrated promising results. Motivated by the rapidly growing literature in this area, in this review paper, we provide a comprehensive overview of deep learning-based methods for post-processing MR images to enhance image quality and correct image artefacts. We aim to provide researchers in MRI or other research fields, including computer vision and image processing, a literature survey of deep learning approaches for MR image enhancement. We discuss the current limitations of the application of artificial intelligence in MRI and highlight possible directions for future developments. In the era of deep learning, we highlight the importance of a critical appraisal of the explanatory information provided and the generalizability of deep learning algorithms in medical imaging.
Collapse
Affiliation(s)
- Zhaolin Chen
- Monash Biomedical Imaging, Monash University, Melbourne, VIC, 3168, Australia.
- Department of Data Science and AI, Monash University, Melbourne, VIC, Australia.
| | - Kamlesh Pawar
- Monash Biomedical Imaging, Monash University, Melbourne, VIC, 3168, Australia
| | - Mevan Ekanayake
- Monash Biomedical Imaging, Monash University, Melbourne, VIC, 3168, Australia
- Department of Electrical and Computer Systems Engineering, Monash University, Melbourne, VIC, Australia
| | - Cameron Pain
- Monash Biomedical Imaging, Monash University, Melbourne, VIC, 3168, Australia
- Department of Electrical and Computer Systems Engineering, Monash University, Melbourne, VIC, Australia
| | - Shenjun Zhong
- Monash Biomedical Imaging, Monash University, Melbourne, VIC, 3168, Australia
- National Imaging Facility, Brisbane, QLD, Australia
| | - Gary F Egan
- Monash Biomedical Imaging, Monash University, Melbourne, VIC, 3168, Australia
- Turner Institute for Brain and Mental Health, Monash University, Melbourne, VIC, Australia
| |
Collapse
|
22
|
Quantitative estimation of closed cell porosity in low density ceramic composites using X-ray microtomography. Sci Rep 2023; 13:127. [PMID: 36599870 DOI: 10.1038/s41598-022-27114-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2022] [Accepted: 12/26/2022] [Indexed: 01/06/2023] Open
Abstract
X-ray Microtomography is a proven tool for phase fraction analysis of multi-phase systems, provided that each phase is adequately partitioned by some means of data processing. For porosity in materials containing low-density ceramic phases, differentiation between pores and the low-density phase(s) can be intractable due to low scattering in the low-density phase, particularly if small pores necessitate low binning. We present a novel, combined methodology for accurate porosity analysis-despite these shortcomings. A 3-stage process is proposed, consisting of (1) Signal/noise enhancement using non-local means denoising, (2) Phase segmentation using a convolutional neural network, and (3) Quantitative analysis of the resulting 3D pore metrics. This particular combination of denoising and segmentation is robust against the fragmentation of common segmentation algorithms, while avoiding the volitional aspects of model selection associated with histogram fitting. We discuss the procedure applied to ternary phase SiC-TiC-diamond composites produced by reactive spark plasma sintering with porosity spanning 2-9 vol%.
Collapse
|
23
|
Uslu F, Bharath AA. TMS-Net: A segmentation network coupled with a run-time quality control method for robust cardiac image segmentation. Comput Biol Med 2023; 152:106422. [PMID: 36535210 DOI: 10.1016/j.compbiomed.2022.106422] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2022] [Revised: 12/02/2022] [Accepted: 12/11/2022] [Indexed: 12/15/2022]
Abstract
Recently, deep networks have shown impressive performance for the segmentation of cardiac Magnetic Resonance Imaging (MRI) images. However, their achievement is proving slow to transition to widespread use in medical clinics because of robustness issues leading to low trust of clinicians to their results. Predicting run-time quality of segmentation masks can be useful to warn clinicians against poor results. Despite its importance, there are few studies on this problem. To address this gap, we propose a quality control method based on the agreement across decoders of a multi-view network, TMS-Net, measured by the cosine similarity. The network takes three view inputs resliced from the same 3D image along different axes. Different from previous multi-view networks, TMS-Net has a single encoder and three decoders, leading to better noise robustness, segmentation performance and run-time quality estimation in our experiments on the segmentation of the left atrium on STACOM 2013 and STACOM 2018 challenge datasets. We also present a way to generate poor segmentation masks by using noisy images generated with engineered noise and Rician noise to simulate undertraining, high anisotropy and poor imaging settings problems. Our run-time quality estimation method show a good classification of poor and good quality segmentation masks with an AUC reaching to 0.97 on STACOM 2018. We believe that TMS-Net and our run-time quality estimation method has a high potential to increase the thrust of clinicians to automatic image analysis tools.
Collapse
Affiliation(s)
- Fatmatülzehra Uslu
- Bursa Technical University, Electrical and Electronics Engineering Department, Bursa, 16310, Turkey.
| | - Anil A Bharath
- Imperial College London, Bioengineering Department, London, SW7 2AZ, UK.
| |
Collapse
|
24
|
Abstract
Medical imaging is a great asset for modern medicine, since it allows physicians to spatially interrogate a disease site, resulting in precise intervention for diagnosis and treatment, and to observe particular aspect of patients' conditions that otherwise would not be noticeable. Computational analysis of medical images, moreover, can allow the discovery of disease patterns and correlations among cohorts of patients with the same disease, thus suggesting common causes or providing useful information for better therapies and cures. Machine learning and deep learning applied to medical images, in particular, have produced new, unprecedented results that can pave the way to advanced frontiers of medical discoveries. While computational analysis of medical images has become easier, however, the possibility to make mistakes or generate inflated or misleading results has become easier, too, hindering reproducibility and deployment. In this article, we provide ten quick tips to perform computational analysis of medical images avoiding common mistakes and pitfalls that we noticed in multiple studies in the past. We believe our ten guidelines, if taken into practice, can help the computational-medical imaging community to perform better scientific research that eventually can have a positive impact on the lives of patients worldwide.
Collapse
Affiliation(s)
- Davide Chicco
- Institute of Health Policy Management and Evaluation, University of Toronto, Toronto, Ontario, Canada
| | - Rakesh Shiradkar
- Department of Biomedical Engineering, Emory University, Atlanta, Georgia, United States of America
| |
Collapse
|
25
|
A Systematic Literature Review on Applications of GAN-Synthesized Images for Brain MRI. FUTURE INTERNET 2022. [DOI: 10.3390/fi14120351] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022] Open
Abstract
With the advances in brain imaging, magnetic resonance imaging (MRI) is evolving as a popular radiological tool in clinical diagnosis. Deep learning (DL) methods can detect abnormalities in brain images without an extensive manual feature extraction process. Generative adversarial network (GAN)-synthesized images have many applications in this field besides augmentation, such as image translation, registration, super-resolution, denoising, motion correction, segmentation, reconstruction, and contrast enhancement. The existing literature was reviewed systematically to understand the role of GAN-synthesized dummy images in brain disease diagnosis. Web of Science and Scopus databases were extensively searched to find relevant studies from the last 6 years to write this systematic literature review (SLR). Predefined inclusion and exclusion criteria helped in filtering the search results. Data extraction is based on related research questions (RQ). This SLR identifies various loss functions used in the above applications and software to process brain MRIs. A comparative study of existing evaluation metrics for GAN-synthesized images helps choose the proper metric for an application. GAN-synthesized images will have a crucial role in the clinical sector in the coming years, and this paper gives a baseline for other researchers in the field.
Collapse
|
26
|
Khairuzzaman AKM, Chaudhury S. Brain MR Image Multilevel Thresholding by Using Particle Swarm Optimization, Otsu Method and Anisotropic Diffusion. RESEARCH ANTHOLOGY ON IMPROVING MEDICAL IMAGING TECHNIQUES FOR ANALYSIS AND INTERVENTION 2022:1036-1051. [DOI: 10.4018/978-1-6684-7544-7.ch052] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/19/2023]
Abstract
Multilevel thresholding is widely used in brain magnetic resonance (MR) image segmentation. In this article, a multilevel thresholding-based brain MR image segmentation technique is proposed. The image is first filtered using anisotropic diffusion. Then multilevel thresholding based on particle swarm optimization (PSO) is performed on the filtered image to get the final segmented image. Otsu function is used to select the thresholds. The proposed technique is compared with standard PSO and bacterial foraging optimization (BFO) based multilevel thresholding techniques. The objective image quality metrics such as Peak Signal to Noise Ratio (PSNR) and Mean Structural SIMilarity (MSSIM) index are used to evaluate the quality of the segmented images. The experimental results suggest that the proposed technique gives significantly better-quality image segmentation compared to the other techniques when applied to T2-weitghted brain MR images.
Collapse
Affiliation(s)
| | - Saurabh Chaudhury
- Department of Electrical Engineering, National Institute of Technology Silchar, Silchar, India
| |
Collapse
|
27
|
Segmentation of breast lesion in DCE-MRI by multi-level thresholding using sine cosine algorithm with quasi opposition-based learning. Pattern Anal Appl 2022. [DOI: 10.1007/s10044-022-01099-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
28
|
An Improved Deep Persistent Memory Network for Rician Noise Reduction in MR Images. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103736] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
29
|
Yamamoto T, Lacheret C, Fukutomi H, Kamraoui RA, Denat L, Zhang B, Prevost V, Zhang L, Ruet A, Triaire B, Dousset V, Coupé P, Tourdias T. Validation of a Denoising Method Using Deep Learning-Based Reconstruction to Quantify Multiple Sclerosis Lesion Load on Fast FLAIR Imaging. AJNR Am J Neuroradiol 2022; 43:1099-1106. [PMID: 35902124 PMCID: PMC9575422 DOI: 10.3174/ajnr.a7589] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2021] [Accepted: 06/13/2022] [Indexed: 12/27/2022]
Abstract
BACKGROUND AND PURPOSE Accurate quantification of WM lesion load is essential for the care of patients with multiple sclerosis. We tested whether the combination of accelerated 3D-FLAIR and denoising using deep learning-based reconstruction could provide a relevant strategy while shortening the imaging examination. MATERIALS AND METHODS Twenty-eight patients with multiple sclerosis were prospectively examined using 4 implementations of 3D-FLAIR with decreasing scan times (4 minutes 54 seconds, 2 minutes 35 seconds, 1 minute 40 seconds, and 1 minute 15 seconds). Each FLAIR sequence was reconstructed without and with denoising using deep learning-based reconstruction, resulting in 8 FLAIR sequences per patient. Image quality was assessed with the Likert scale, apparent SNR, and contrast-to-noise ratio. Manual and automatic lesion segmentations, performed randomly and blindly, were quantitatively evaluated against ground truth using the absolute volume difference, true-positive rate, positive predictive value, Dice similarity coefficient, Hausdorff distance, and F1 score based on the lesion count. The Wilcoxon signed-rank test and 2-way ANOVA were performed. RESULTS Both image-quality evaluation and the various metrics showed deterioration when the FLAIR scan time was accelerated. However, denoising using deep learning-based reconstruction significantly improved subjective image quality and quantitative performance metrics, particularly for manual segmentation. Overall, denoising using deep learning-based reconstruction helped to recover contours closer to those from the criterion standard and to capture individual lesions otherwise overlooked. The Dice similarity coefficient was equivalent between the 2-minutes-35-seconds-long FLAIR with denoising using deep learning-based reconstruction and the 4-minutes-54-seconds-long reference FLAIR sequence. CONCLUSIONS Denoising using deep learning-based reconstruction helps to recognize multiple sclerosis lesions buried in the noise of accelerated FLAIR acquisitions, a possibly useful strategy to efficiently shorten the scan time in clinical practice.
Collapse
Affiliation(s)
- T Yamamoto
- From the Institut de Bio-imagerie (T.Y., H.F., L.D., V.D., T.T.), University Bordeaux, Bordeaux, France
| | - C Lacheret
- Neuroimagerie Diagnostique et Thérapeutique (C.L., V.D., T.T.)
| | - H Fukutomi
- From the Institut de Bio-imagerie (T.Y., H.F., L.D., V.D., T.T.), University Bordeaux, Bordeaux, France
| | - R A Kamraoui
- Laboratoire Bordelais de Recherche en Informatique (R.A.K., P.C.), University Bordeaux, Le Centre National de la Recherche Scientifique, Bordeaux Institut National Polytechnique, Talence, France
| | - L Denat
- From the Institut de Bio-imagerie (T.Y., H.F., L.D., V.D., T.T.), University Bordeaux, Bordeaux, France
| | - B Zhang
- Canon Medical Systems Europe (B.Z.), Zoetermeer, the Netherlands
| | - V Prevost
- Canon Medical Systems (V.P., B.T.), Tochigi, Japan
| | - L Zhang
- Canon Medical Systems China (L.Z.), Beijing, China
| | - A Ruet
- Service de Neurologie (A.R.), Centre Hospitalier Universitaire de Bordeaux, Bordeaux, France
| | - B Triaire
- Canon Medical Systems (V.P., B.T.), Tochigi, Japan
| | - V Dousset
- From the Institut de Bio-imagerie (T.Y., H.F., L.D., V.D., T.T.), University Bordeaux, Bordeaux, France.,Neuroimagerie Diagnostique et Thérapeutique (C.L., V.D., T.T.).,NeurocentreMagendie (V.D., T.T.), University of Bordeaux, L'Institut National de la Santé et de la Recherche Médicale, Bordeaux, France
| | - P Coupé
- Laboratoire Bordelais de Recherche en Informatique (R.A.K., P.C.), University Bordeaux, Le Centre National de la Recherche Scientifique, Bordeaux Institut National Polytechnique, Talence, France
| | - T Tourdias
- From the Institut de Bio-imagerie (T.Y., H.F., L.D., V.D., T.T.), University Bordeaux, Bordeaux, France .,Neuroimagerie Diagnostique et Thérapeutique (C.L., V.D., T.T.).,NeurocentreMagendie (V.D., T.T.), University of Bordeaux, L'Institut National de la Santé et de la Recherche Médicale, Bordeaux, France
| |
Collapse
|
30
|
Kumar V, Srivastava S. Performance analysis of reshaped Gabor filter for removing the Rician distributed noise in brain MR images. Proc Inst Mech Eng H 2022; 236:1216-1231. [DOI: 10.1177/09544119221105690] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Magnetic Resonance Imaging (MRI) is an essential clinical tool for detecting the abnormalities such as tumors and clots in the human brain. The brain MR images are contaminated by artifacts and noise that follow Rician distribution during the acquisition process. It causes the loss of fine details information, distortion, and a blurred vision of the image. A reshaped Gabor filter-based denoising technique is proposed to overcome these issues. To develop the reshaped Gabor filter, the range of reshaping parameters of the filter is initially obtained by a random search method. Further, to evaluate the better performance of the proposed filter, a manual search is used to find the optimal parametric values and tested on T1, T2, and PD weighted MR data sets one by one. Also, the proposed technique is compared with the existing state of the art filtering methods such as Wiener, Median, Partial differential equation (PDE), Anisotropic diffusion filter (ADF), Non-local means filter (NLM), Modified complex diffusion filter (MCD), Multichannel residual learning of CNN (MRL), Maximum a posteriori (MAP), Adaptive non-local means algorithm (ADNLM), and Advance NLM filtering with non-sub sampled (AVNLMNS) on the basic reference and no reference parameter. The parameters such as mean square error (MSE), peak signal to noise ratio (PSNR), structural similarity index metric (SSIM), perception-based image quality evaluator (PIQE), and blind/referenceless image spatial quality evaluator (BRISQE) are evaluated on T1, T2, and PD weighted MR images with different noise variances such as 1%, 3%, 5%, 7%, and 9%. The proposed method may be used as a better denoising scheme for Rician distributed noise, edge preservation, fine details restoration, and enhancement of abnormalities.
Collapse
Affiliation(s)
- Vinay Kumar
- Department of ECE, National Institute of Technology, Patna, Bihar, India
| | - Subodh Srivastava
- Department of ECE, National Institute of Technology, Patna, Bihar, India
| |
Collapse
|
31
|
Akinyelu AA, Zaccagna F, Grist JT, Castelli M, Rundo L. Brain Tumor Diagnosis Using Machine Learning, Convolutional Neural Networks, Capsule Neural Networks and Vision Transformers, Applied to MRI: A Survey. J Imaging 2022; 8:205. [PMID: 35893083 PMCID: PMC9331677 DOI: 10.3390/jimaging8080205] [Citation(s) in RCA: 24] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2022] [Revised: 06/20/2022] [Accepted: 07/12/2022] [Indexed: 02/01/2023] Open
Abstract
Management of brain tumors is based on clinical and radiological information with presumed grade dictating treatment. Hence, a non-invasive assessment of tumor grade is of paramount importance to choose the best treatment plan. Convolutional Neural Networks (CNNs) represent one of the effective Deep Learning (DL)-based techniques that have been used for brain tumor diagnosis. However, they are unable to handle input modifications effectively. Capsule neural networks (CapsNets) are a novel type of machine learning (ML) architecture that was recently developed to address the drawbacks of CNNs. CapsNets are resistant to rotations and affine translations, which is beneficial when processing medical imaging datasets. Moreover, Vision Transformers (ViT)-based solutions have been very recently proposed to address the issue of long-range dependency in CNNs. This survey provides a comprehensive overview of brain tumor classification and segmentation techniques, with a focus on ML-based, CNN-based, CapsNet-based, and ViT-based techniques. The survey highlights the fundamental contributions of recent studies and the performance of state-of-the-art techniques. Moreover, we present an in-depth discussion of crucial issues and open challenges. We also identify some key limitations and promising future research directions. We envisage that this survey shall serve as a good springboard for further study.
Collapse
Affiliation(s)
- Andronicus A. Akinyelu
- NOVA Information Management School (NOVA IMS), Universidade NOVA de Lisboa, Campus de Campolide, 1070-312 Lisboa, Portugal;
- Department of Computer Science and Informatics, University of the Free State, Phuthaditjhaba 9866, South Africa
| | - Fulvio Zaccagna
- Department of Biomedical and Neuromotor Sciences, Alma Mater Studiorum-University of Bologna, 40138 Bologna, Italy;
- IRCCS Istituto delle Scienze Neurologiche di Bologna, Functional and Molecular Neuroimaging Unit, 40139 Bologna, Italy
| | - James T. Grist
- Department of Physiology, Anatomy, and Genetics, University of Oxford, Oxford OX1 3PT, UK;
- Department of Radiology, Oxford University Hospitals NHS Foundation Trust, Oxford OX3 9DU, UK
- Oxford Centre for Clinical Magnetic Research Imaging, University of Oxford, Oxford OX3 9DU, UK
- Institute of Cancer and Genomic Sciences, University of Birmingham, Birmingham B15 2SY, UK
| | - Mauro Castelli
- NOVA Information Management School (NOVA IMS), Universidade NOVA de Lisboa, Campus de Campolide, 1070-312 Lisboa, Portugal;
| | - Leonardo Rundo
- Department of Information and Electrical Engineering and Applied Mathematics, University of Salerno, 84084 Fisciano, Italy
| |
Collapse
|
32
|
Kondo S, Nakamura Y, Higaki T, Nishihara T, Takizawa M, Shirai T, Fujimori M, Bito Y, Narita K, Sueoka T, Honda Y, Tani C, Awai K. Utility of Wavelet Denoising with Geometry Factor Weighting for Gadoxetic Acid-enhanced Hepatobiliary-phase MR Imaging. Magn Reson Med Sci 2022; 22:241-252. [PMID: 35650028 PMCID: PMC10086400 DOI: 10.2463/mrms.mp.2022-0041] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022] Open
Abstract
PURPOSE The wavelet denoising with geometry factor weighting (g-denoising) method can reduce the image noise by adapting to spatially varying noise levels induced by parallel imaging. The aim of this study was to investigate the clinical applicability of g-denoising on hepatobiliary-phase (HBP) images with gadoxetic acid. METHODS We subjected 53 patients suspected of harboring hepatic neoplastic lesions to gadoxetic acid-enhanced HBP imaging with and without g-denoising (g+HBP and g-HBP). The matrix size was reduced for g+HBP images to avoid prolonging the scanning time. Two radiologists calculated the SNR, the portal vein-, and paraspinal muscle contrast-to-noise ratio (CNR) relative to the hepatic parenchyma (liver-to-portal vein- and liver-to-muscle CNR). Two other radiologists independently graded the sharpness of the liver edge, the visibility of intrahepatic vessels, the image noise, the homogeneity of liver parenchyma, and the overall image quality using a 5-point scale. Differences between g-HBP and g+HBP images were determined with the two-sided Wilcoxon signed-rank test. RESULTS The liver-to-portal- and liver-to-muscle CNR and the SNR were significantly higher on g+HBP- than g-HBP images (P < 0.01), as was the qualitative score for the image noise, homogeneity of liver parenchyma, and overall image quality (P < 0.01). Although there were no significant differences in the scores for the sharpness of the liver edge or the score assigned for the visibility of intrahepatic vessels (P = 0.05, 0.43), with g+HBP the score was lower in three patients for the sharpness of the liver edge and in six patients for the visibility of intrahepatic vessels. CONCLUSION At gadoxetic acid-enhanced HBP imaging, g-denoising yielded a better image quality than conventional HBP imaging although the anatomic details may be degraded.
Collapse
Affiliation(s)
- Shota Kondo
- Department of Diagnostic Radiology, Hiroshima University
| | - Yuko Nakamura
- Department of Diagnostic Radiology, Hiroshima University
| | - Toru Higaki
- Department of Diagnostic Radiology, Hiroshima University
| | | | | | | | | | | | - Keigo Narita
- Department of Diagnostic Radiology, Hiroshima University
| | | | - Yukiko Honda
- Department of Diagnostic Radiology, Hiroshima University
| | - Chihiro Tani
- Department of Diagnostic Radiology, Hiroshima University
| | - Kazuo Awai
- Department of Diagnostic Radiology, Hiroshima University
| |
Collapse
|
33
|
Hong JS, Hermann I, Zöllner FG, Schad LR, Wang SJ, Lee WK, Chen YL, Chang Y, Wu YT. Acceleration of Magnetic Resonance Fingerprinting Reconstruction Using Denoising and Self-Attention Pyramidal Convolutional Neural Network. SENSORS 2022; 22:s22031260. [PMID: 35162007 PMCID: PMC8838455 DOI: 10.3390/s22031260] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/01/2021] [Revised: 01/27/2022] [Accepted: 02/05/2022] [Indexed: 02/01/2023]
Abstract
Magnetic resonance fingerprinting (MRF) based on echo-planar imaging (EPI) enables whole-brain imaging to rapidly obtain T1 and T2* relaxation time maps. Reconstructing parametric maps from the MRF scanned baselines by the inner-product method is computationally expensive. We aimed to accelerate the reconstruction of parametric maps for MRF-EPI by using a deep learning model. The proposed approach uses a two-stage model that first eliminates noise and then regresses the parametric maps. Parametric maps obtained by dictionary matching were used as a reference and compared with the prediction results of the two-stage model. MRF-EPI scans were collected from 32 subjects. The signal-to-noise ratio increased significantly after the noise removal by the denoising model. For prediction with scans in the testing dataset, the mean absolute percentage errors between the standard and the final two-stage model were 3.1%, 3.2%, and 1.9% for T1, and 2.6%, 2.3%, and 2.8% for T2* in gray matter, white matter, and lesion locations, respectively. Our proposed two-stage deep learning model can effectively remove noise and accurately reconstruct MRF-EPI parametric maps, increasing the speed of reconstruction and reducing the storage space required by dictionaries.
Collapse
Affiliation(s)
- Jia-Sheng Hong
- Department of Biomedical Imaging and Radiological Sciences, National Yang Ming Chiao Tung University, Taipei 112, Taiwan; (J.-S.H.); (W.-K.L.)
| | - Ingo Hermann
- Computer Assisted Clinical Medicine, Mannheim Institute for Intelligent Systems in Medicine, Medical Faculty Mannheim, Heidelberg University, 68167 Mannheim, Germany; (I.H.); (F.G.Z.); (L.R.S.)
| | - Frank Gerrit Zöllner
- Computer Assisted Clinical Medicine, Mannheim Institute for Intelligent Systems in Medicine, Medical Faculty Mannheim, Heidelberg University, 68167 Mannheim, Germany; (I.H.); (F.G.Z.); (L.R.S.)
| | - Lothar R. Schad
- Computer Assisted Clinical Medicine, Mannheim Institute for Intelligent Systems in Medicine, Medical Faculty Mannheim, Heidelberg University, 68167 Mannheim, Germany; (I.H.); (F.G.Z.); (L.R.S.)
| | - Shuu-Jiun Wang
- Department of Neurology, Neurological Institute, Taipei Veterans General Hospital, Taipei 112, Taiwan;
- College of Medicine, National Yang Ming Chiao Tung University, Taipei 112, Taiwan
- Brain Research Center, National Yang Ming Chiao Tung University, Taipei 112, Taiwan
| | - Wei-Kai Lee
- Department of Biomedical Imaging and Radiological Sciences, National Yang Ming Chiao Tung University, Taipei 112, Taiwan; (J.-S.H.); (W.-K.L.)
| | - Yung-Lin Chen
- Institute of Biophotonics, National Yang Ming Chiao Tung University, Taipei 112, Taiwan; (Y.-L.C.); (Y.C.)
| | - Yu Chang
- Institute of Biophotonics, National Yang Ming Chiao Tung University, Taipei 112, Taiwan; (Y.-L.C.); (Y.C.)
| | - Yu-Te Wu
- Brain Research Center, National Yang Ming Chiao Tung University, Taipei 112, Taiwan
- Institute of Biophotonics, National Yang Ming Chiao Tung University, Taipei 112, Taiwan; (Y.-L.C.); (Y.C.)
- Correspondence:
| |
Collapse
|
34
|
Wang L, Xiao D, Hou WS, Wu XY, Jiang B, Chen L. A nonlocal enhanced Low-Rank tensor approximation framework for 3D Magnetic Resonance image denoising. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2021.103302] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
35
|
Shukla V, Khandekar P, Khaparde A. Noise estimation in 2D MRI using DWT coefficients and optimized neural network. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2021.103225] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/18/2023]
|
36
|
Mera Jiménez L, Ochoa Gómez JF. Volume Reduction Techniques for the Classification of Independent Components of rs-fMRI Data: a Study with Convolutional Neural Networks. Neuroinformatics 2022; 20:73-90. [PMID: 33829386 DOI: 10.1007/s12021-021-09524-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/31/2021] [Indexed: 01/05/2023]
Abstract
In the last decade, neurosciences have had an increasing interest in resting state functional magnetic resonance imaging (rs-fMRI) as a result of its advantages, such as high spatial resolution, compared to other brain exploration techniques. To improve the technique, the elimination of artifacts through Independent Components Analysis (ICA) has been proposed, as this can separate neural signal and noise, opening possibilities for automatic classification. The main classification techniques have focused on processes based on typical machine learning. However, there are currently more robust approaches such as convolutional neural networks, which can deal with complex problems directly from the data without feature selection and even with data that does not have a simple interpretation, being limited by the amount of data necessary for training and its high computational cost. This research focused on studying four methods of volume reduction mitigating the computational cost for the training of 3 models based on convolutional neural networks. One of the reduction techniques is a novel approach that we call Reduction by Consecutive Binary Patterns (RCBP), which was shown to preserve the spatial features of the independent components. In addition, the RCBP showed networks in components associated with neuronal activity more clearly. The networks achieved accuracy above 98 % in classification, and one network was even found to be over 99 % accurate, outperforming most machine learning-based classification algorithms.
Collapse
Affiliation(s)
- Leonel Mera Jiménez
- Bioinstrumentation and Clinical Engineering Research Group, Bioengineering Program, Universidad de Antioquia, Calle 70 No. 52-21, Medellín, Colombia. .,Facultad de Ingeniería, Cl. 67 #53-108, Medellín, Colombia.
| | - John F Ochoa Gómez
- Bioinstrumentation and Clinical Engineering Research Group, Bioengineering Program, Universidad de Antioquia, Calle 70 No. 52-21, Medellín, Colombia.,Neuropsychology and Behavior Group, Medicine Program, Universidad de Antioquia, Calle 70 No. 52-21, Medellín, Colombia
| |
Collapse
|
37
|
Chaudhari A, Kulkarni J. Noise estimation in single coil MR images. BIOMEDICAL ENGINEERING ADVANCES 2021. [DOI: 10.1016/j.bea.2021.100017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022] Open
|
38
|
Hadri A, Laghrib A, Oummi H. An optimal variable exponent model for Magnetic Resonance Images denoising. Pattern Recognit Lett 2021. [DOI: 10.1016/j.patrec.2021.08.031] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
39
|
Kavinkumar K, Meeradevi T. Classification of Tumor of MRI Brain Image Using Hybrid Feature Extraction Method and Support Vector Machine Classifier. JOURNAL OF MEDICAL IMAGING AND HEALTH INFORMATICS 2021. [DOI: 10.1166/jmihi.2021.3842] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
Brain tumors Analysis is problematic somewhat due to varied size, shape, location of tumor and the appearance and presence of brain tumor. Clinicians and radiologist have difficulty in identifying the tumor type. An efficient hybrid feature extraction method to classify the type of
tumor accurately as meningioma, gliomas and pituitary tumor using SVM (support vector machine) classifier is proposed. The modified Non-Local Means (NLM) filter may be effectively used to get the pure image. The NLM filter is compared with common filters like median and wiener. From the denoised
image the classification is done by training SVM using the texture features from the hybrid and efficient feature extraction technique.The accuracy of the classification is calculated and the SVM classifier training individual type of texture features and also with combined texture features
and the performance is analyzed.
Collapse
Affiliation(s)
- K. Kavinkumar
- Department of Electronics and Communication Engineering, Kongu Engineering College, Perundurai, Erode 638060, TamilNadu, India
| | - T. Meeradevi
- Department of Electronics and Communication Engineering, Kongu Engineering College, Perundurai, Erode 638060, TamilNadu, India
| |
Collapse
|
40
|
Xu Y, Han K, Zhou Y, Wu J, Xie X, Xiang W. Deep Adaptive Blending Network for 3D Magnetic Resonance Image Denoising. IEEE J Biomed Health Inform 2021; 25:3321-3331. [PMID: 34101607 DOI: 10.1109/jbhi.2021.3087407] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
The visual quality of magnetic resonance images (MRIs) is crucial for clinical diagnosis and scientific research. The main source of quality degradation is the noise generated during MRI acquisition. Although denoising MRI by deep learning methods shows great superiority compared with traditional methods, the deep learning methods reported to date in the literature cannot simultaneously leverage long-range and hierarchical information, and cannot adequately utilize the similarity in 3D MRI. In this paper, we address the two issues by proposing a deep adaptive blending network (DABN) characterized by a large receptive field residual dense block and an adaptive blending method. We first propose the large receptive field residual dense block that can capture long-range information and fuse hierarchical features simultaneously. Then we propose the adaptive blending method that produces denoised pixels by adaptively filtering 3D MRI, which explicitly utilizes the similarity in 3D MRI. Residual is also considered as a compensating item after adaptive filtering. The blending adaptive filter and residual are predicted by a network consisting of several large receptive field residual dense blocks. Experimental results show that the proposed DABN outperforms state-of-the-art denoising methods in both clinical and simulated MRI data.
Collapse
|
41
|
Mzoughi H, Njeh I, Wali A, Slima MB, BenHamida A, Mhiri C, Mahfoudhe KB. Deep Multi-Scale 3D Convolutional Neural Network (CNN) for MRI Gliomas Brain Tumor Classification. J Digit Imaging 2021; 33:903-915. [PMID: 32440926 DOI: 10.1007/s10278-020-00347-9] [Citation(s) in RCA: 96] [Impact Index Per Article: 24.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023] Open
Abstract
Accurate and fully automatic brain tumor grading from volumetric 3D magnetic resonance imaging (MRI) is an essential procedure in the field of medical imaging analysis for full assistance of neuroradiology during clinical diagnosis. We propose, in this paper, an efficient and fully automatic deep multi-scale three-dimensional convolutional neural network (3D CNN) architecture for glioma brain tumor classification into low-grade gliomas (LGG) and high-grade gliomas (HGG) using the whole volumetric T1-Gado MRI sequence. Based on a 3D convolutional layer and a deep network, via small kernels, the proposed architecture has the potential to merge both the local and global contextual information with reduced weights. To overcome the data heterogeneity, we proposed a preprocessing technique based on intensity normalization and adaptive contrast enhancement of MRI data. Furthermore, for an effective training of such a deep 3D network, we used a data augmentation technique. The paper studied the impact of the proposed preprocessing and data augmentation on classification accuracy.Quantitative evaluations, over the well-known benchmark (Brats-2018), attest that the proposed architecture generates the most discriminative feature map to distinguish between LG and HG gliomas compared with 2D CNN variant. The proposed approach offers promising results outperforming the recently supervised and unsupervised state-of-the-art approaches by achieving an overall accuracy of 96.49% using the validation dataset. The obtained experimental results confirm that adequate MRI's preprocessing and data augmentation could lead to an accurate classification when exploiting CNN-based approaches.
Collapse
Affiliation(s)
- Hiba Mzoughi
- Advanced Technologies for Medecine and Signal (ATMS), Sfax university, ENIS, Route de la Soukra km 4, 3038, Sfax, Tunisia.
- National Engineering School of Gabes, Gabes university, Avenue Omar Ibn El Khattab, Zrig Gabes, 6029, Gabes, Tunisia.
| | - Ines Njeh
- Advanced Technologies for Medecine and Signal (ATMS), Sfax university, ENIS, Route de la Soukra km 4, 3038, Sfax, Tunisia
- Higher Institute of Computer Science and Multimedia of Gabes, Gabes university, Gabes, Tunisia
| | - Ali Wali
- National Engineering School of Sfax, Regim-Lab, Sfax university, Sfax, Tunisia
| | - Mohamed Ben Slima
- Advanced Technologies for Medecine and Signal (ATMS), Sfax university, ENIS, Route de la Soukra km 4, 3038, Sfax, Tunisia
- National School of Electronics and Telecommunications of Sfax, Sfax university, Sfax, Tunisia
| | - Ahmed BenHamida
- Advanced Technologies for Medecine and Signal (ATMS), Sfax university, ENIS, Route de la Soukra km 4, 3038, Sfax, Tunisia
- National Engineering School of Sfax, Regim-Lab, Sfax university, Sfax, Tunisia
| | - Chokri Mhiri
- Department of Neurology, Habib Bourguiba University Hospital, Sfax, Tunisia
| | | |
Collapse
|
42
|
A novel method for removing Rician noise from MRI based on variational mode decomposition. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.102737] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
|
43
|
Cao Q, Hao H. A Chaotic Neural Network Model for English Machine Translation Based on Big Data Analysis. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2021; 2021:3274326. [PMID: 34306051 PMCID: PMC8270720 DOI: 10.1155/2021/3274326] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/02/2021] [Revised: 06/21/2021] [Accepted: 06/26/2021] [Indexed: 11/22/2022]
Abstract
In this paper, the chaotic neural network model of big data analysis is used to conduct in-depth analysis and research on the English translation. Firstly, under the guidance of the translation strategy of text type theory, the translation generated by the machine translation system is edited after translation, and then professionals specializing in computer and translation are invited to confirm the translation. After that, the errors in the translations generated by the machine translation system are classified based on the Double Quantum Filter-Muttahida Quami Movement (DQF-MQM) error type classification framework. Due to the characteristics of the source text as an informative academic text, long and difficult sentences, passive voice, and terminology translation are the main causes of machine translation errors. In view of the rigorous logic of the source text and the fixed language steps, this research proposes corresponding post-translation editing strategies for each type of error. It is suggested that translators should maintain the logic of the source text by converting implicit connections into explicit connections, maintain the academic accuracy of the source text by adding subjects and adjusting the word order to deal with the passive voice, and deal with semitechnical terms by appropriately selecting word meanings in postediting. The errors of machine translation in computer science and technology text abstracts are systematically categorized, and the corresponding post-translation editing strategies are proposed to provide reference suggestions for translators in this field, to improve the quality of machine translation in this field.
Collapse
Affiliation(s)
- Qianyu Cao
- School of Foreign Languages, Chengdu University of Information Technology, Chengdu 610036, China
| | - Hanmei Hao
- Chengdu Angke Technologies Co., Ltd., Chengdu 610000, China
| |
Collapse
|
44
|
Moreno López M, Frederick JM, Ventura J. Evaluation of MRI Denoising Methods Using Unsupervised Learning. Front Artif Intell 2021; 4:642731. [PMID: 34151253 PMCID: PMC8212039 DOI: 10.3389/frai.2021.642731] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2020] [Accepted: 05/17/2021] [Indexed: 11/13/2022] Open
Abstract
In this paper we evaluate two unsupervised approaches to denoise Magnetic Resonance Images (MRI) in the complex image space using the raw information that k-space holds. The first method is based on Stein’s Unbiased Risk Estimator, while the second approach is based on a blindspot network, which limits the network’s receptive field. Both methods are tested on two different datasets, one containing real knee MRI and the other consists of synthetic brain MRI. These datasets contain information about the complex image space which will be used for denoising purposes. Both networks are compared against a state-of-the-art algorithm, Non-Local Means (NLM) using quantitative and qualitative measures. For most given metrics and qualitative measures, both networks outperformed NLM, and they prove to be reliable denoising methods.
Collapse
Affiliation(s)
- Marc Moreno López
- Department of Computer Science, University of Colorado Colorado Springs, Colorado Springs, CO, United States
| | - Joshua M Frederick
- Department of Computer Science and Software Engineering, California Polytechnic State University, San Luis Obispo, CA, United States
| | - Jonathan Ventura
- Department of Computer Science and Software Engineering, California Polytechnic State University, San Luis Obispo, CA, United States
| |
Collapse
|
45
|
Denoising of 3D Brain MR Images with Parallel Residual Learning of Convolutional Neural Network Using Global and Local Feature Extraction. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2021; 2021:5577956. [PMID: 34054939 PMCID: PMC8112927 DOI: 10.1155/2021/5577956] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/23/2021] [Revised: 04/15/2021] [Accepted: 04/21/2021] [Indexed: 11/22/2022]
Abstract
Magnetic resonance (MR) images often suffer from random noise pollution during image acquisition and transmission, which impairs disease diagnosis by doctors or automated systems. In recent years, many noise removal algorithms with impressive performances have been proposed. In this work, inspired by the idea of deep learning, we propose a denoising method named 3D-Parallel-RicianNet, which will combine global and local information to remove noise in MR images. Specifically, we introduce a powerful dilated convolution residual (DCR) module to expand the receptive field of the network and to avoid the loss of global features. Then, to extract more local information and reduce the computational complexity, we design the depthwise separable convolution residual (DSCR) module to learn the channel and position information in the image, which not only reduces parameters dramatically but also improves the local denoising performance. In addition, a parallel network is constructed by fusing the features extracted from each DCR module and DSCR module to improve the efficiency and reduce the complexity for training a denoising model. Finally, a reconstruction (REC) module aims to construct the clean image through the obtained noise deviation and the given noisy image. Due to the lack of ground-truth images in the real MR dataset, the performance of the proposed model was tested qualitatively and quantitatively on one simulated T1-weighted MR image dataset and then expanded to four real datasets. The experimental results show that the proposed 3D-Parallel-RicianNet network achieves performance superior to that of several state-of-the-art methods in terms of the peak signal-to-noise ratio, structural similarity index, and entropy metric. In particular, our method demonstrates powerful abilities in both noise suppression and structure preservation.
Collapse
|
46
|
Aetesam H, Maji SK. Noise dependent training for deep parallel ensemble denoising in magnetic resonance images. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2020.102405] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
|
47
|
Addressing signal alterations induced in CT images by deep learning processing: A preliminary phantom study. Phys Med 2021; 83:88-100. [DOI: 10.1016/j.ejmp.2021.02.022] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/18/2020] [Revised: 02/19/2021] [Accepted: 02/23/2021] [Indexed: 12/13/2022] Open
|
48
|
Hermann I, Martínez-Heras E, Rieger B, Schmidt R, Golla AK, Hong JS, Lee WK, Yu-Te W, Nagtegaal M, Solana E, Llufriu S, Gass A, Schad LR, Weingärtner S, Zöllner FG. Accelerated white matter lesion analysis based on simultaneous T 1 and T 2 ∗ quantification using magnetic resonance fingerprinting and deep learning. Magn Reson Med 2021; 86:471-486. [PMID: 33547656 DOI: 10.1002/mrm.28688] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2020] [Revised: 12/27/2020] [Accepted: 12/28/2020] [Indexed: 02/06/2023]
Abstract
PURPOSE To develop an accelerated postprocessing pipeline for reproducible and efficient assessment of white matter lesions using quantitative magnetic resonance fingerprinting (MRF) and deep learning. METHODS MRF using echo-planar imaging (EPI) scans with varying repetition and echo times were acquired for whole brain quantification of T 1 and T 2 ∗ in 50 subjects with multiple sclerosis (MS) and 10 healthy volunteers along 2 centers. MRF T 1 and T 2 ∗ parametric maps were distortion corrected and denoised. A CNN was trained to reconstruct the T 1 and T 2 ∗ parametric maps, and the WM and GM probability maps. RESULTS Deep learning-based postprocessing reduced reconstruction and image processing times from hours to a few seconds while maintaining high accuracy, reliability, and precision. Mean absolute error performed the best for T 1 (deviations 5.6%) and the logarithmic hyperbolic cosinus loss the best for T 2 ∗ (deviations 6.0%). CONCLUSIONS MRF is a fast and robust tool for quantitative T 1 and T 2 ∗ mapping. Its long reconstruction and several postprocessing steps can be facilitated and accelerated using deep learning.
Collapse
Affiliation(s)
- Ingo Hermann
- Computer Assisted Clinical Medicine, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany.,Department of Imaging Physics, Delft University of Technology, Delft, the Netherlands
| | - Eloy Martínez-Heras
- Center of Neuroimmunology, Laboratory of Advanced Imaging in Neuroimmunological Diseases, Hospital Clinic Barcelona, Institut d'Investigacions Biomédiques August Pi i Sunyer (IDIBAPS) and Universitat de Barcelona, Barcelona, Spain
| | - Benedikt Rieger
- Computer Assisted Clinical Medicine, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
| | - Ralf Schmidt
- Computer Assisted Clinical Medicine, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
| | - Alena-Kathrin Golla
- Computer Assisted Clinical Medicine, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany.,Mannheim Institute for Intelligent Systems in Medicine, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
| | - Jia-Sheng Hong
- Department of Biomedical Imaging and Radiological Sciences, National Yang-Ming University, Taipei, Taiwan
| | - Wei-Kai Lee
- Department of Biomedical Imaging and Radiological Sciences, National Yang-Ming University, Taipei, Taiwan
| | - Wu Yu-Te
- Department of Biomedical Imaging and Radiological Sciences, National Yang-Ming University, Taipei, Taiwan.,Institute of Biophotonics and Brain Research Center, National Yang-Ming University, Taipei, Taiwan
| | - Martijn Nagtegaal
- Department of Imaging Physics, Delft University of Technology, Delft, the Netherlands
| | - Elisabeth Solana
- Center of Neuroimmunology, Laboratory of Advanced Imaging in Neuroimmunological Diseases, Hospital Clinic Barcelona, Institut d'Investigacions Biomédiques August Pi i Sunyer (IDIBAPS) and Universitat de Barcelona, Barcelona, Spain
| | - Sara Llufriu
- Center of Neuroimmunology, Laboratory of Advanced Imaging in Neuroimmunological Diseases, Hospital Clinic Barcelona, Institut d'Investigacions Biomédiques August Pi i Sunyer (IDIBAPS) and Universitat de Barcelona, Barcelona, Spain
| | - Achim Gass
- Department of Neurology, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
| | - Lothar R Schad
- Computer Assisted Clinical Medicine, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
| | - Sebastian Weingärtner
- Department of Imaging Physics, Delft University of Technology, Delft, the Netherlands
| | - Frank G Zöllner
- Computer Assisted Clinical Medicine, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany.,Mannheim Institute for Intelligent Systems in Medicine, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
| |
Collapse
|
49
|
Mishro PK, Agrawal S, Panda R, Abraham A. A Survey on State-of-the-art Denoising Techniques for Brain Magnetic Resonance Images. IEEE Rev Biomed Eng 2021; 15:184-199. [PMID: 33513109 DOI: 10.1109/rbme.2021.3055556] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
The accuracy of the magnetic resonance (MR) image diagnosis depends on the quality of the image, which degrades mainly due to noise and artifacts. The noise is introduced because of erroneous imaging environment or distortion in the transmission system. Therefore, denoising methods play an important role in enhancing the image quality. However, a tradeoff between denoising and preserving the structural details is required. Most of the existing surveys are conducted on a specific MR image modality or on limited denoising schemes. In this context, a comprehensive review on different MR image denoising techniques is inevitable. This survey suggests a new direction in categorizing the MR image denoising techniques. The categorization of the different image models used in medical image processing serves as the basis of our classification. This study includes recent improvements on deep learning-based denoising methods alongwith important traditional MR image denoising methods. The major challenges and their scope of improvement are also discussed. Further, many more evaluation indices are considered for a fair comparison. An elaborate discussion on selecting appropriate method and evaluation metric as per the kind of data is presented. This study may encourage researchers for further work in this domain.
Collapse
|
50
|
Romdhane F, Villano D, Irrera P, Consolino L, Longo DL. Evaluation of a similarity anisotropic diffusion denoising approach for improving in vivo CEST-MRI tumor pH imaging. Magn Reson Med 2021; 85:3479-3496. [PMID: 33496986 DOI: 10.1002/mrm.28676] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2020] [Revised: 12/18/2020] [Accepted: 12/18/2020] [Indexed: 12/16/2022]
Abstract
PURPOSE Chemical exchange saturation transfer MRI provides new approaches for investigating tumor microenvironment, including tumor acidosis that plays a key role in tumor progression and resistance to therapy. Following iopamidol injection, the detection of the contrast agent inside the tumor tissue allows measurements of tumor extracellular pH. However, accurate tumor pH quantifications are hampered by the low contrast efficiency of the CEST technique and by the low SNR of the acquired CEST images, hence in a reduced detectability of the injected agent. This work aims to investigate a novel denoising method for improving both tumor pH quantification and accuracy of CEST-MRI pH imaging. METHODS An hybrid denoising approach was investigated for CEST-MRI pH imaging based on the combination of the nonlocal mean filter and the anisotropic diffusion tensor method. The denoising approach was tested in simulated and in vitro data and compared with previously reported methods for CEST imaging and with established denoising approaches. Finally, it was validated with in vivo data to improve the accuracy of tumor pH maps. RESULTS The proposed method outperforms current denoising methods in CEST contrast quantification and detection of the administered contrast agent at several increasing noise levels with simulated data. In addition, it achieved a better pH quantification in in vitro data and demonstrated a marked improvement in contrast detection and a substantial improvement in tumor pH accuracy in in vivo data. CONCLUSION The proposed approach effectively reduces the noise in CEST images and increases the sensitivity detection in CEST-MRI pH imaging.
Collapse
Affiliation(s)
- Feriel Romdhane
- Molecular Imaging Center, Department of Molecular Biotechnology and Health Sciences, University of Torino, Torino, Italy.,National Engineering School of Tunis, University al Manar, Tunis, Tunisia
| | - Daisy Villano
- Molecular Imaging Center, Department of Molecular Biotechnology and Health Sciences, University of Torino, Torino, Italy
| | - Pietro Irrera
- University of Campania "Luigi Vanvitelli,", Caserta, Italy.,Institute of Biostructures and Bioimaging (IBB), Italian National Research Council (CNR), Torino, Italy
| | - Lorena Consolino
- Molecular Imaging Center, Department of Molecular Biotechnology and Health Sciences, University of Torino, Torino, Italy
| | - Dario Livio Longo
- Institute of Biostructures and Bioimaging (IBB), Italian National Research Council (CNR), Torino, Italy
| |
Collapse
|