DAGAN: Deep De-Aliasing Generative Adversarial Networks for Fast Compressed Sensing MRI Reconstruction

DGEDDGAN: A dual-domain generator and edge-enhanced dual discriminator generative adversarial network for MRI reconstruction

Magnetic resonance imaging (MRI) as a critical clinical tool in medical imaging, requires a long scan time for producing high-quality MRI images. To accelerate the speed of MRI while reconstructing high-quality images with sharper edges and fewer aliases, a novel dual-domain generator and edge-enhancement dual discriminator generative adversarial network structure named DGEDDGAN for MRI reconstruction is proposed, in which one discriminator is responsible for holistic image reconstruction, whereas the other is adopted to enhance the edge preservation. A dual-domain U-Net structure that cascades the frequency domain and image domain is designed for the generator. The densely connected residual block is used to replace the traditional U-Net convolution block to improve the feature reuse capability while overcoming the gradient vanishing problem. The coordinate attention mechanism in each skip connection is employed to effectively reduce the loss of spatial information and enforce the feature selection capability. Extensive experiments on two publicly available datasets i.e., IXI dataset and CC-359, demonstrate that the proposed method can reconstruct the high-quality MRI images with more edge details and fewer artifacts, outperforming several state-of-the-art methods under various sampling rates and masks. The time of single-image reconstruction is below 13 ms, which meets the demand of faster processing.

MHWT: Wide-range attention modeling using window transformer for multi-modal MRI reconstruction

The Swin Transformer, with its window-based attention mechanism, demonstrates strong feature modeling capabilities. However, it struggles with high-resolution feature maps due to its fixed window size, particularly when capturing long-range dependencies in magnetic resonance image reconstruction tasks. To overcome this, we propose a novel multi-modal hybrid window attention Transformer (MHWT) that introduces a retractable attention mechanism combined with shape-alternating window design. This approach expands attention coverage while maintaining computational efficiency. Additionally, we employ a variable and shifted window attention strategy to model both local and global dependencies more flexibly. Improvements to the Transformer encoder, including adjustments to normalization and attention score computation, enhance training stability and reconstruction performance. Experimental results on multiple public datasets show that our method outperforms state-of-the-art approaches in both single-modal and multi-modal scenarios, demonstrating superior image reconstruction ability and adaptability. The code is publicly available at https://github.com/EnieHan/MHWT.

MMR-Mamba: Multi-modal MRI reconstruction with Mamba and spatial-frequency information fusion

Multi-modal MRI offers valuable complementary information for diagnosis and treatment; however, its clinical utility is limited by prolonged scanning time. To accelerate the acquisition process, a practical approach is to reconstruct images of the target modality, which requires longer scanning time, from under-sampled k-space data using the fully-sampled reference modality with shorter scanning time as guidance. The primary challenge of this task lies in comprehensively and efficiently integrating complementary information from different modalities to achieve high-quality reconstruction. Existing methods struggle with this challenge: (1) convolution-based models fail to capture long-range dependencies; (2) transformer-based models, while excelling in global feature modeling, suffer from quadratic computational complexity. To address this dilemma, we propose MMR-Mamba, a novel framework that thoroughly and efficiently integrates multi-modal features for MRI reconstruction, leveraging Mamba's capability to capture long-range dependencies with linear computational complexity while exploiting global properties of the Fourier domain. Specifically, we first design a Target modality-guided Cross Mamba (TCM) module in the spatial domain, which maximally restores the target modality information by selectively incorporating relevant information from the reference modality. Then, we introduce a Selective Frequency Fusion (SFF) module to efficiently integrate global information in the Fourier domain and recover high-frequency signals for the reconstruction of structural details. Furthermore, we devise an Adaptive Spatial-Frequency Fusion (ASFF) module, which mutually enhances the spatial and frequency domains by supplementing less informative channels from one domain with corresponding channels from the other. Extensive experiments on the BraTS and fastMRI knee datasets demonstrate the superiority of our MMR-Mamba over state-of-the-art reconstruction methods. The code is publicly available at https://github.com/zoujing925/MMR-Mamba.

AutoDPS: An unsupervised diffusion model based method for multiple degradation removal in MRI

BACKGROUND AND OBJECTIVE

Diffusion models have demonstrated their ability in image generation and solving inverse problems like restoration. Unlike most existing deep-learning based image restoration techniques which rely on unpaired or paired data for degradation awareness, diffusion models offer an unsupervised degradation independent alternative. This is well-suited in the context of restoring artifact-corrupted Magnetic Resonance Images (MRI), where it is impractical to exactly model the degradations apriori. In MRI, multiple corruptions arise, for instance, from patient movement compounded by undersampling artifacts from the acquisition settings.

METHODS

To tackle this scenario, we propose AutoDPS, an unsupervised method for corruption removal in brain MRI based on Diffusion Posterior Sampling. Our method (i) performs motion-related corruption parameter estimation using a blind iterative solver, and (ii) utilizes the knowledge of the undersampling pattern when the corruption consists of both motion and undersampling artifacts. We incorporate this corruption operation during sampling to guide the generation in recovering high-quality images.

RESULTS

Despite being trained to denoise and tested on completely unseen corruptions, our method AutoDPS has shown ∼ 1.63 dB of improvement in PSNR over baselines for realistic 3D motion restoration and ∼ 0.5 dB of improvement for random motion with undersampling. Additionally, our experiments demonstrate AutoDPS's resilience to noise and its generalization capability under domain shift, showcasing its robustness and adaptability.

CONCLUSION

In this paper, we propose an unsupervised method that removes multiple corruptions, mainly motion with undersampling, in MRI images which are essential for accurate diagnosis. The experiments show promising results on realistic and composite artifacts with higher improvement margins as compared to other methods. Our code is available at https://github.com/arunima101/AutoDPS/tree/master.

Dual-way magnetic resonance image translation with transformer-based adversarial network

BACKGROUND

The magnetic resonance (MR) image translation model is designed to generate MR images of required sequence from the images of existing sequence. However, the generalization performance of MR image generation models on external datasets tends to be unsatisfactory due to the inconsistency in the data distribution of MR images across different centers or scanners.

PURPOSE

The aim of this study is to propose a cross-sequence MR image synthesis model that could generate high-quality MR synthetic images with high transferability for small-sized external datasets.

METHODS

We proposed a dual-way magnetic resonance image translation model using transformer-based adversarial network (DMTrans) for MR image synthesis across sequences. It integrates a transformer-based generative architecture with an innovative discriminator design. The shifted window-based multi-head self-attention mechanism in DMTrans enables efficient capture of global and local features from MR images. The sequential dual-scale discriminator is designed to distinguish features of the generated images at multi-scale.

RESULTS

We pre-trained DMTrans model for bi-directional image synthesis on a T1/T2-weighted MR image dataset comprising 4229 slices. It demonstrates superior performance to baseline methods on both qualitative and quantitative measurements. The SSIM, PSNR, and MAE metrics for synthetic T1 images generation based on T2 images are 0.91 ± 0.04, 25.30 ± 2.40, and 24.65 ± 10.46, while the metric values are 0.90 ± 0.04, 24.72 ± 1.62, and 23.28 ± 7.40 for the opposite direction. Fine-tuning is then utilized to adapt the model to another public dataset with T1/T2/proton-weighted (PD) images, so that only 6 patients of 500 slices are required for model adaptation to achieve high-quality T1/T2, T1/PD, and T2/PD image translation results.

CONCLUSIONS

The proposed DMTrans achieves the state-of-the-art performance for cross-sequence MR image conversion, which could provide more information assisting clinical diagnosis and treatment. It also offered a versatile and efficient solution to the needs of high-quality MR image synthesis in data-scarce conditions at different centers.

Deep Learning-Driven Abbreviated Shoulder MRI Protocols: Diagnostic Accuracy in Clinical Practice

BACKGROUND

Deep learning (DL) reconstruction techniques have shown promise in reducing MRI acquisition times while maintaining image quality. However, the impact of different acceleration factors on diagnostic accuracy in shoulder MRI remains unexplored in clinical practice.

PURPOSE

The purpose of this study was to evaluate the diagnostic accuracy of 2-fold and 4-fold DL-accelerated shoulder MRI protocols compared to standard protocols in clinical practice.

MATERIALS AND METHODS

In this prospective single-center study, 88 consecutive patients (49 males, 39 females; mean age, 51 years) underwent shoulder MRI examinations using standard, 2-fold (DL2), and 4-fold (DL4) accelerated protocols between June 2023 and January 2024. Four independent radiologists (experience range: 4-25 years) evaluated the presence of bone marrow edema (BME), rotator cuff tears, and labral lesions. The sensitivity, specificity, and interobserver agreement were calculated. Diagnostic confidence was assessed using a 4-point scale. The impact of reader experience was analyzed by stratifying the radiologists into ≤10 and >10 years of experience.

RESULTS

Both accelerated protocols demonstrated high diagnostic accuracy. For BME detection, DL2 and DL4 achieved 100% sensitivity and specificity. In rotator cuff evaluation, DL2 showed a sensitivity of 98-100% and specificity of 99-100%, while DL4 maintained a sensitivity of 95-98% and specificity of 99-100%. Labral tear detection showed perfect sensitivity (100%) with DL2 and slightly lower sensitivity (89-100%) with DL4. Interobserver agreement was excellent across the protocols (Kendall's W = 0.92-0.98). Reader experience did not significantly impact diagnostic performance. The area under the ROC curve was 0.94 for DL2 and 0.90 for DL4 (p = 0.32).

CLINICAL IMPLICATIONS

The implementation of DL-accelerated protocols, particularly DL2, could improve workflow efficiency by reducing acquisition times by 50% while maintaining diagnostic reliability. This could increase patient throughput and accessibility to MRI examinations without compromising diagnostic quality.

CONCLUSIONS

DL-accelerated shoulder MRI protocols demonstrate high diagnostic accuracy, with DL2 showing performance nearly identical to that of the standard protocol. While DL4 maintains acceptable diagnostic accuracy, it shows a slight sensitivity reduction for subtle pathologies, particularly among less experienced readers. The DL2 protocol represents an optimal balance between acquisition time reduction and diagnostic confidence.

Generative adversarial networks in medical image reconstruction: A systematic literature review

PURPOSE

Recent advancements in generative adversarial networks (GANs) have demonstrated substantial potential in medical image processing. Despite this progress, reconstructing images from incomplete data remains a challenge, impacting image quality. This systematic literature review explores the use of GANs in enhancing and reconstructing medical imaging data.

METHOD

A document survey of computing literature was conducted using the ACM Digital Library to identify relevant articles from journals and conference proceedings using keyword combinations, such as "generative adversarial networks or generative adversarial network," "medical image or medical imaging," and "image reconstruction."

RESULTS

Across the reviewed articles, there were 122 datasets used in 175 instances, 89 top metrics employed 335 times, 10 different tasks with a total count of 173, 31 distinct organs featured in 119 instances, and 18 modalities utilized in 121 instances, collectively depicting significant utilization of GANs in medical imaging. The adaptability and efficacy of GANs were showcased across diverse medical tasks, organs, and modalities, utilizing top public as well as private/synthetic datasets for disease diagnosis, including the identification of conditions like cancer in different anatomical regions. The study emphasized GAN's increasing integration and adaptability in diverse radiology modalities, showcasing their transformative impact on diagnostic techniques, including cross-modality tasks. The intricate interplay between network size, batch size, and loss function refinement significantly impacts GAN's performance, although challenges in training persist.

CONCLUSIONS

The study underscores GANs as dynamic tools shaping medical imaging, contributing significantly to image quality, training methodologies, and overall medical advancements, positioning them as substantial components driving medical advancements.

Deep Learning-Based Reconstruction for Accelerated Cervical Spine MRI: Utility in the Evaluation of Myelopathy and Degenerative Diseases

BACKGROUND AND PURPOSE

Deep learning (DL)-based reconstruction enables improving the quality of MR images acquired with a short scan time. We aimed to prospectively compare the image quality and diagnostic performance in evaluating cervical degenerative spine diseases and myelopathy between conventional cervical MRI and accelerated cervical MRI with a commercially available vendor-neutral DL-based reconstruction.

MATERIALS AND METHODS

Fifty patients with degenerative cervical spine disease or myelopathy underwent both conventional cervical MRI and accelerated cervical MRI by using a DL-based reconstruction operating within the DICOM domain. The images were evaluated both quantitatively, based on SNR and contrast-to-noise ratio (CNR), and qualitatively, by using a 5-point scoring system for the overall image quality and clarity of anatomic structures on sagittal T1WI, sagittal contrast-enhanced (CE) T1WI, and axial/sagittal T2WI. Four radiologists assessed the sensitivity and specificity of the 2 protocols for detecting degenerative diseases and myelopathy.

RESULTS

The DL-based protocol reduced MRI acquisition time by 47%-48% compared with the conventional protocol. DL-reconstructed images demonstrated a higher SNR on sagittal T1WI (P = .046) and a higher CNR on sagittal T2WI (P = .03) than conventional images. The SNR on sagittal T2WI and the CNR on sagittal T1WI did not significantly differ (P > .05). DL-reconstructed images had better overall image quality on sagittal T1WI (P < .001), sagittal T2WI (Dixon in-phase or TSE) (P < .001), and sagittal T2WI (Dixon water-only) (P = .013) and similar image quality on axial T2WI and sagittal CE T1WI (P > .05). DL-reconstructed images had better clarity of anatomic structures (P values were < .001 for all structures, except for the neural foramen [P = .024]). DL-reconstructed images had a higher sensitivity for detecting neural foraminal stenosis (P = .005) and similar sensitivities for diagnosing other degenerative spinal diseases and myelopathy (P > .05). The specificities for diagnosing degenerative spinal diseases and myelopathy did not differ between the 2 images (P > .05).

CONCLUSIONS

The accelerated cervical MRI reconstructed with a vendor-neutral DL-based reconstruction algorithm did not compromise image quality and had higher or similar diagnostic performance for diagnosing cervical degenerative spine diseases and myelopathy compared with the conventional protocol.

FDuDoCLNet: Fully dual-domain contrastive learning network for parallel MRI reconstruction

Magnetic resonance imaging (MRI) is a non-invasive medical imaging technique that is widely used for high-resolution imaging of soft tissues and organs. However, the slow speed of MRI imaging, especially in high-resolution or dynamic scans, makes MRI reconstruction an important research topic. Currently, MRI reconstruction methods based on deep learning (DL) have garnered significant attention, and they improve the reconstruction quality by learning complex image features. However, DL-based MR image reconstruction methods exhibit certain limitations. First, the existing reconstruction networks seldom account for the diverse frequency features in the wavelet domain. Second, existing dual-domain reconstruction methods may pay too much attention to the features of a single domain (such as the global information in the image domain or the local details in the wavelet domain), resulting in the loss of either critical global structures or fine details in certain regions of the reconstructed image. In this work, inspired by the lifting scheme in wavelet theory, we propose a novel Fully Dual-Domain Contrastive Learning Network (FDuDoCLNet) based on variational networks (VarNet) for accelerating PI in both the image and wavelet domains. It is composed of several cascaded dual-domain regularization units and data consistency (DC) layers, in which a novel dual-domain contrastive loss is introduced to optimize the reconstruction performance effectively. The proposed FDuDoCLNet was evaluated on the publicly available fastMRI multi-coil knee dataset under a 6× acceleration factor, achieving a PSNR of 34.439 dB and a SSIM of 0.895.

A lightweight adaptive spatial channel attention efficient net B3 based generative adversarial network approach for MR image reconstruction from under sampled data

Magnetic Resonance Imaging (MRI) stands out as a notable non-invasive method for medical imaging assessments, widely employed in early medical diagnoses due to its exceptional resolution in portraying soft tissue structures. However, the MRI method faces challenges with its inherently slow acquisition process, stemming from the sequential sampling in k-space and limitations in traversal speed due to physiological and hardware constraints. Compressed Sensing in MRI (CS-MRI) accelerates image acquisition by utilizing greatly under-sampled k-space information. Despite its advantages, conventional CS-MRI encounters issues such as sluggish iterations and artefacts at higher acceleration factors. Recent advancements integrate deep learning models into CS-MRI, inspired by successes in various computer vision domains. It has drawn significant attention from the MRI community because of its great potential for image reconstruction from undersampled k-space data in fast MRI. This paper proposes a lightweight Adaptive Spatial-Channel Attention EfficientNet B3-based Generative Adversarial Network (ASCA-EffNet GAN) for fast, high-quality MR image reconstruction from greatly under-sampled k-space information in CS-MRI. The proposed GAN employs a U-net generator with ASCA-based EfficientNet B3 for encoder blocks and a ResNet decoder. The discriminator is a binary classifier with ASCA-based EfficientNet B3, a fully connected layer and a sigmoid layer. The EfficientNet B3 utilizes a compound scaling strategy that achieves a balance amongst model depth, width, and resolution, resulting in optimal performance with a reduced number of parameters. Furthermore, the adaptive attention mechanisms in the proposed ASCA-EffNet GAN effectively capture spatial and channel-wise features, contributing to detailed anatomical structure reconstruction. Experimental evaluations on the dataset demonstrate ASCA-EffNet GAN's superior performance across various metrics, surpassing conventional reconstruction methods. Hence, ASCA-EffNet GAN showcases remarkable reconstruction capabilities even under high under-sampling rates, making it suitable for clinical applications.

SHFormer: Dynamic spectral filtering convolutional neural network and high-pass kernel generation transformer for adaptive MRI reconstruction

Attention Mechanism (AM) selectively focuses on essential information for imaging tasks and captures relationships between regions from distant pixel neighborhoods to compute feature representations. Accelerated magnetic resonance image (MRI) reconstruction can benefit from AM, as the imaging process involves acquiring Fourier domain measurements that influence the image representation in a non-local manner. However, AM-based models are more adept at capturing low-frequency information and have limited capacity in constructing high-frequency representations, restricting the models to smooth reconstruction. Secondly, AM-based models need mode-specific retraining for multimodal MRI data as their knowledge is restricted to local contextual variations within modes that might be inadequate to capture the diverse transferable features across heterogeneous data domains. To address these challenges, we propose a neuromodulation-based discriminative multi-spectral AM for scalable MRI reconstruction, that can (i) propagate the context-aware high-frequency details for high-quality image reconstruction, and (ii) capture features reusable to deviated unseen domains in multimodal MRI, to offer high practical value for the healthcare industry and researchers. The proposed network consists of a spectral filtering convolutional neural network to capture mode-specific transferable features to generalize to deviated MRI data domains and a dynamic high-pass kernel generation transformer that focuses on high-frequency details for improved reconstruction. We have evaluated our model on various aspects, such as comparative studies in supervised and self-supervised learning, diffusion model-based training, closed-set and open-set generalization under heterogeneous MRI data, and interpretation-based analysis. Our results show that the proposed method offers scalable and high-quality reconstruction with best improvement margins of ∼1 dB in PSNR and ∼0.01 in SSIM under unseen scenarios. Our code is available at https://github.com/sriprabhar/SHFormer.

CAMP-Net: Consistency-Aware Multi-Prior Network for Accelerated MRI Reconstruction

Undersampling -space data in magnetic resonance imaging (MRI) reduces scan time but pose challenges in image reconstruction. Considerable progress has been made in reconstructing accelerated MRI. However, restoration of high-frequency image details in highly undersampled data remains challenging. To address this issue, we propose CAMP-Net, an unrolling-based Consistency-Aware Multi-Prior Network for accelerated MRI reconstruction. CAMP-Net leverages complementary multi-prior knowledge and multi-slice information from various domains to enhance reconstruction quality. Specifically, CAMP-Net comprises three interleaved modules for image enhancement, -space restoration, and calibration consistency, respectively. These modules jointly learn priors from data in image domain, -domain, and calibration region, respectively, in data-driven manner during each unrolled iteration. Notably, the encoded calibration prior knowledge extracted from auto-calibrating signals implicitly guides the learning of consistency-aware -space correlation for reliable interpolation of missing -space data. To maximize the benefits of image domain and -domain prior knowledge, the reconstructions are aggregated in a frequency fusion module, exploiting their complementary properties to optimize the trade-off between artifact removal and fine detail preservation. Additionally, we incorporate a surface data fidelity layer during the learning of -domain and calibration domain priors to prevent degradation of the reconstruction caused by padding-induced data imperfections. We evaluate the generalizability and robustness of our method on three large public datasets with varying acceleration factors and sampling patterns. The experimental results demonstrate that our method outperforms state-of-the-art approaches in terms of both reconstruction quality and mapping estimation, particularly in scenarios with high acceleration factors.

DPI-MoCo: Deep Prior Image Constrained Motion Compensation Reconstruction for 4D CBCT

4D cone-beam computed tomography (CBCT) plays a critical role in adaptive radiation therapy for lung cancer. However, extremely sparse sampling projection data will cause severe streak artifacts in 4D CBCT images. Existing deep learning (DL) methods heavily rely on large labeled training datasets which are difficult to obtain in practical scenarios. Restricted by this dilemma, DL models often struggle with simultaneously retaining dynamic motions, removing streak degradations, and recovering fine details. To address the above challenging problem, we introduce a Deep Prior Image Constrained Motion Compensation framework (DPI-MoCo) that decouples the 4D CBCT reconstruction into two sub-tasks including coarse image restoration and structural detail fine-tuning. In the first stage, the proposed DPI-MoCo combines the prior image guidance, generative adversarial network, and contrastive learning to globally suppress the artifacts while maintaining the respiratory movements. After that, to further enhance the local anatomical structures, the motion estimation and compensation technique is adopted. Notably, our framework is performed without the need for paired datasets, ensuring practicality in clinical cases. In the Monte Carlo simulation dataset, the DPI-MoCo achieves competitive quantitative performance compared to the state-of-the-art (SOTA) methods. Furthermore, we test DPI-MoCo in clinical lung cancer datasets, and experiments validate that DPI-MoCo not only restores small anatomical structures and lesions but also preserves motion information.

DONet: Dual-Octave Network for Fast MR Image Reconstruction

Magnetic resonance (MR) image acquisition is an inherently prolonged process, whose acceleration has long been the subject of research. This is commonly achieved by obtaining multiple undersampled images, simultaneously, through parallel imaging. In this article, we propose the dual-octave network (DONet), which is capable of learning multiscale spatial-frequency features from both the real and imaginary components of MR data, for parallel fast MR image reconstruction. More specifically, our DONet consists of a series of dual-octave convolutions (Dual-OctConvs), which are connected in a dense manner for better reuse of features. In each Dual-OctConv, the input feature maps and convolutional kernels are first split into two components (i.e., real and imaginary) and then divided into four groups according to their spatial frequencies. Then, our Dual-OctConv conducts intragroup information updating and intergroup information exchange to aggregate the contextual information across different groups. Our framework provides three appealing benefits: 1) it encourages information interaction and fusion between the real and imaginary components at various spatial frequencies to achieve richer representational capacity; 2) the dense connections between the real and imaginary groups in each Dual-OctConv make the propagation of features more efficient by feature reuse; and 3) DONet enlarges the receptive field by learning multiple spatial-frequency features of both the real and imaginary components. Extensive experiments on two popular datasets (i.e., clinical knee and fastMRI), under different undersampling patterns and acceleration factors, demonstrate the superiority of our model in accelerated parallel MR image reconstruction.

Clinical Application of Artificial Intelligence in Breast MRI

Breast MRI is the most sensitive imaging modality for detecting breast cancer. However, its widespread use is limited by factors such as extended examination times, need for contrast agents, and susceptibility to motion artifacts. Artificial intelligence (AI) has emerged as a promising solution for these challenges by enhancing the efficiency and accuracy of breast MRI in multiple domains. AI-driven image reconstruction techniques have significantly reduced scan times while preserving image quality. This method outperforms traditional parallel imaging and compressed sensing. AI has also shown great promise for lesion classification and segmentation, with convolutional neural networks and U-Net architectures improving the differentiation between benign and malignant lesions. AI-based segmentation methods enable accurate tumor detection and characterization, thereby aiding personalized treatment planning. An AI triaging system has demonstrated the potential to streamline workflow efficiency by identifying low-suspicion cases and reducing the workload of radiologists. Another promising application is synthetic breast MR image generation, which aims to generate contrast enhanced images from non-contrast sequences, thereby improving accessibility and patient safety. Further research is required to validate AI models across diverse populations and imaging protocols. As AI continues to evolve, it is expected to play an important role in the optimization of breast MRI.

Physics-guided self-supervised learning: Demonstration for generalized RF pulse design

PURPOSE

To introduce a new method for generalized RF pulse design using physics-guided self-supervised learning (GPS), which uses the Bloch equations as the guiding physics model.

THEORY AND METHODS

The GPS framework consists of a neural network module and a physics module, where the physics module is a Bloch simulator for MRI applications. For RF pulse design, the neural network module maps an input target profile to an RF pulse, which is subsequently loaded into the physics module. Through the supervision of the physics module, the neural network module designs an RF pulse corresponding to the target profile. GPS was applied to design 1D selective,B 1 $$ {B}_1 $$ -insensitive, saturation, and multidimensional RF pulses, each conventionally requiring dedicated design algorithms. We further demonstrate our method's flexibility and versatility by compensating for experimental and scanner imperfections through online adaptation.

RESULTS

Both simulations and experiments show that GPS can design a variety of RF pulses with corresponding profiles that agree well with the target input. Despite these verifications, GPS-designed pulses have unique differences compared to conventional designs, such as achievingB 1 $$ {B}_1 $$ -insensitivity using different mechanisms and using non-sampled regions of the conventional design to lower its peak power. Experiments, both ex vivo and in vivo, further verify that it can also be used for online adaptation to correct system imperfections, such asB 0 $$ {B}_0 $$ /B 1 + $$ {B}_1^{+} $$ inhomogeneity.

CONCLUSION

This work demonstrates the generalizability, versatility, and flexibility of the GPS method for designing RF pulses and showcases its utility in several applications.

BreathVisionNet: A pulmonary-function-guided CNN-transformer hybrid model for expiratory CT image synthesis

BACKGROUND AND OBJECTIVE

Chronic obstructive pulmonary disease (COPD) has high heterogeneity in etiologies and clinical manifestations. Expiratory Computed tomography (CT) can effectively assess air trapping, aiding in disease diagnosis. However, due to concerns about radiation exposure and cost, expiratory CT is not routinely performed. Recent work on synthesizing expiratory CT has primarily focused on imaging features while neglecting patient-specific pulmonary function.

METHODS

To address these issues, we developed a novel model named BreathVisionNet that incorporates pulmonary function data to guide the synthesis of expiratory CT from inspiratory CT. An architecture combining a convolutional neural network and transformer is introduced to leverage the irregular phenotypic distribution in COPD patients. The model can better understand the long-range and global contexts by incorporating global information into the encoder. The utilization of edge information and multi-view data further enhances the quality of the synthesized CT. Parametric response mapping (PRM) can be estimated by using synthesized expiratory CT and inspiratory CT to quantify COPD phenotypes of the normal, emphysema, and functional small airway disease (fSAD), including their percentages, spatial distributions, and voxel distribution maps.

RESULTS

BreathVisionNet outperforms other generative models in terms of synthesized image quality. It achieves a mean absolute error, normalized mean square error, structural similarity index and peak signal-to-noise ratio of 78.207 HU, 0.643, 0.847 and 25.828 dB, respectively. Comparing the predicted and real PRM, the Dice coefficient can reach 0.732 (emphysema) and 0.560 (fSAD). The mean of differences between true and predicted fSAD percentage is 4.42 for the development dataset (low radiation dose CT scans), and 9.05 for an independent external validation dataset (routine dose), indicating that model has great generalizability. A classifier trained on voxel distribution maps can achieve an accuracy of 0.891 in predicting the presence of COPD.

CONCLUSIONS

BreathVisionNet can accurately synthesize expiratory CT images from inspiratory CT and predict their voxel distribution. The estimated PRM can help to quantify COPD phenotypes of the normal, emphysema, and fSAD. This capability provides additional insights into COPD diversity while only inspiratory CT images are available.

Let UNet Play an Adversarial Game: Investigating the Effect of Adversarial Training in Enhancing Low-Resolution MRI

Adversarial training has attracted much attention in enhancing the visual realism of images, but its efficacy in clinical imaging has not yet been explored. This work investigated adversarial training in a clinical context, by training 206 networks on the OASIS-1 dataset for improving low-resolution and low signal-to-noise ratio (SNR) magnetic resonance images. Each network corresponded to a different combination of perceptual and adversarial loss weights and distinct learning rate values. For each perceptual loss weighting, we identified its corresponding adversarial loss weighting that minimized structural disparity. Each optimally weighted adversarial loss yielded an average SSIM reduction of 1.5%. We further introduced a set of new metrics to assess other clinically relevant image features: Gradient Error (GE) to measure structural disparities; Sharpness to compute edge clarity; and Edge-Contrast Error (ECE) to quantify any distortion of the pixel distribution around edges. Including adversarial loss increased structural enhancement in visual inspection, which correlated with statistically consistent GE reductions (p-value << 0.05). This also resulted in increased Sharpness; however, the level of statistical significance was dependent on the perceptual loss weighting. Additionally, adversarial loss yielded ECE reductions for smaller perceptual loss weightings, while showing non-significant increases (p-value >> 0.05) when these weightings were higher, demonstrating that the increased Sharpness does not adversely distort the pixel distribution around the edges in the image. These studies clearly suggest that adversarial training significantly improves the performance of an MRI enhancement pipeline, and highlights the need for systematic studies of hyperparameter optimization and investigation of alternative image quality metrics.

Data- and Physics-Driven Deep Learning Based Reconstruction for Fast MRI: Fundamentals and Methodologies

Magnetic Resonance Imaging (MRI) is a pivotal clinical diagnostic tool, yet its extended scanning times often compromise patient comfort and image quality, especially in volumetric, temporal and quantitative scans. This review elucidates recent advances in MRI acceleration via data and physics-driven models, leveraging techniques from algorithm unrolling models, enhancement-based methods, and plug-and-play models to the emerging full spectrum of generative model-based methods. We also explore the synergistic integration of data models with physics-based insights, encompassing the advancements in multi-coil hardware accelerations like parallel imaging and simultaneous multi-slice imaging, and the optimization of sampling patterns. We then focus on domain-specific challenges and opportunities, including image redundancy exploitation, image integrity, evaluation metrics, data heterogeneity, and model generalization. This work also discusses potential solutions and future research directions, with an emphasis on the role of data harmonization and federated learning for further improving the general applicability and performance of these methods in MRI reconstruction.

AI-Assisted Compressed Sensing Enables Faster Brain MRI for the Elderly: Image Quality and Diagnostic Equivalence with Conventional Imaging

Purpose

Conventional brain MRI protocols are time-consuming, which can lead to patient discomfort and inefficiency in clinical settings. This study aims to assess the feasibility of using artificial intelligence-assisted compressed sensing (ACS) to reduce brain MRI scan time while maintaining image quality and diagnostic accuracy compared to a conventional imaging protocol.

Patients and Methods

Seventy patients from the department of neurology underwent brain MRI scans using both conventional and ACS protocols, including axial and sagittal T2-weighted fast spin-echo sequences and T2-fluid attenuated inversion recovery (FLAIR) sequence. Two radiologists independently evaluated image quality based on avoidance of artifacts, boundary sharpness, visibility of lesions, and overall image quality using a 5-point Likert scale. Pathological features, including white matter hyperintensities, lacunar infarcts, and enlarged perivascular spaces, were also assessed. The interchangeability of the two protocols was determined by calculating the 95% confidence interval (CI) for the individual equivalence index. Additionally, Cohen's weighted kappa statistic was used to assess inter-protocol intra-observer agreement.

Results

The ACS images demonstrated superior quality across all qualitative features compared to the conventional ones. Both protocols showed no significant difference in detecting pathological conditions. The 95% CI for the individual equivalence index was below 5% for all variables except enlarged perivascular spaces, indicating the interchangeability of the conventional and ACS protocols in most cases. The inter-rater reliability between the two radiologists was strong, with kappa values of 0.78, 0.74, 0.70 and 0.86 for image quality evaluation and 0.74, 0.80 and 0.70 for diagnostic performance, indicating good-to-excellent agreement in their evaluations.

Conclusion

The ACS technique reduces brain MRI scan time by 29.2% while achieving higher image quality and equivalent diagnostic accuracy compared to the conventional protocol. This suggests that ACS could be potentially adopted for routine clinical use in brain MRI.

Cardiac MR image reconstruction using cascaded hybrid dual domain deep learning framework

Recovering diagnostic-quality cardiac MR images from highly under-sampled data is a current research focus, particularly in addressing cardiac and respiratory motion. Techniques such as Compressed Sensing (CS) and Parallel Imaging (pMRI) have been proposed to accelerate MRI data acquisition and improve image quality. However, these methods have limitations in high spatial-resolution applications, often resulting in blurring or residual artifacts. Recently, deep learning-based techniques have gained attention for their accuracy and efficiency in image reconstruction. Deep learning-based MR image reconstruction methods are divided into two categories: (a) single domain methods (image domain learning and k-space domain learning) and (b) cross/dual domain methods. Single domain methods, which typically use U-Net in either the image or k-space domain, fail to fully exploit the correlation between these domains. This paper introduces a dual-domain deep learning approach that incorporates multi-coil data consistency (MCDC) layers for reconstructing cardiac MR images from 1-D Variable Density (VD) random under-sampled data. The proposed hybrid dual-domain deep learning models integrate data from both the domains to improve image quality, reduce artifacts, and enhance overall robustness and accuracy of the reconstruction process. Experimental results demonstrate that the proposed methods outperform than conventional deep learning and CS techniques, as evidenced by higher Structural Similarity Index (SSIM), lower Root Mean Square Error (RMSE), and higher Peak Signal-to-Noise Ratio (PSNR).

Deep unfolding network with spatial alignment for multi-modal MRI reconstruction

Multi-modal Magnetic Resonance Imaging (MRI) offers complementary diagnostic information, but some modalities are limited by the long scanning time. To accelerate the whole acquisition process, MRI reconstruction of one modality from highly under-sampled k-space data with another fully-sampled reference modality is an efficient solution. However, the misalignment between modalities, which is common in clinic practice, can negatively affect reconstruction quality. Existing deep learning-based methods that account for inter-modality misalignment perform better, but still share two main common limitations: (1) The spatial alignment task is not adaptively integrated with the reconstruction process, resulting in insufficient complementarity between the two tasks; (2) the entire framework has weak interpretability. In this paper, we construct a novel Deep Unfolding Network with Spatial Alignment, termed DUN-SA, to appropriately embed the spatial alignment task into the reconstruction process. Concretely, we derive a novel joint alignment-reconstruction model with a specially designed aligned cross-modal prior term. By relaxing the model into cross-modal spatial alignment and multi-modal reconstruction tasks, we propose an effective algorithm to solve this model alternatively. Then, we unfold the iterative stages of the proposed algorithm and design corresponding network modules to build DUN-SA with interpretability. Through end-to-end training, we effectively compensate for spatial misalignment using only reconstruction loss, and utilize the progressively aligned reference modality to provide inter-modality prior to improve the reconstruction of the target modality. Comprehensive experiments on four real datasets demonstrate that our method exhibits superior reconstruction performance compared to state-of-the-art methods.

Enhancing global sensitivity and uncertainty quantification in medical image reconstruction with Monte Carlo arbitrary-masked mamba

Deep learning has been extensively applied in medical image reconstruction, where Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) represent the predominant paradigms, each possessing distinct advantages and inherent limitations: CNNs exhibit linear complexity with local sensitivity, whereas ViTs demonstrate quadratic complexity with global sensitivity. The emerging Mamba has shown superiority in learning visual representation, which combines the advantages of linear scalability and global sensitivity. In this study, we introduce MambaMIR, an Arbitrary-Masked Mamba-based model with wavelet decomposition for joint medical image reconstruction and uncertainty estimation. A novel Arbitrary Scan Masking (ASM) mechanism "masks out" redundant information to introduce randomness for further uncertainty estimation. Compared to the commonly used Monte Carlo (MC) dropout, our proposed MC-ASM provides an uncertainty map without the need for hyperparameter tuning and mitigates the performance drop typically observed when applying dropout to low-level tasks. For further texture preservation and better perceptual quality, we employ the wavelet transformation into MambaMIR and explore its variant based on the Generative Adversarial Network, namely MambaMIR-GAN. Comprehensive experiments have been conducted for multiple representative medical image reconstruction tasks, demonstrating that the proposed MambaMIR and MambaMIR-GAN outperform other baseline and state-of-the-art methods in different reconstruction tasks, where MambaMIR achieves the best reconstruction fidelity and MambaMIR-GAN has the best perceptual quality. In addition, our MC-ASM provides uncertainty maps as an additional tool for clinicians, while mitigating the typical performance drop caused by the commonly used dropout.

Fourier Convolution Block with global receptive field for MRI reconstruction

Reconstructing images from under-sampled Magnetic Resonance Imaging (MRI) signals significantly reduces scan time and improves clinical practice. However, Convolutional Neural Network (CNN)-based methods, while demonstrating great performance in MRI reconstruction, may face limitations due to their restricted receptive field (RF), hindering the capture of global features. This is particularly crucial for reconstruction, as aliasing artifacts are distributed globally. Recent advancements in Vision Transformers have further emphasized the significance of a large RF. In this study, we proposed a novel global Fourier Convolution Block (FCB) with whole image RF and low computational complexity by transforming the regular spatial domain convolutions into frequency domain. Visualizations of the effective RF and trained kernels demonstrated that FCB improves the RF of reconstruction models in practice. The proposed FCB was evaluated on four popular CNN architectures using brain and knee MRI datasets. Models with FCB achieved superior PSNR and SSIM than baseline models and exhibited more details and texture recovery. The code is publicly available at https://github.com/Haozhoong/FCB.

Artificial Intelligence-Derived Risk Prediction: A Novel Risk Calculator Using Office and Ambulatory Blood Pressure

BACKGROUND

Quantification of total cardiovascular risk is essential for individualizing hypertension treatment. This study aimed to develop and validate a novel, machine-learning-derived model to predict cardiovascular mortality risk using office blood pressure (OBP) and ambulatory blood pressure (ABP).

METHODS

The performance of the novel risk score was compared with existing risk scores, and the possibility of predicting ABP phenotypes utilizing clinical variables was assessed. Using data from 59 124 patients enrolled in the Spanish ABP Monitoring registry, machine-learning approaches (logistic regression, gradient-boosted decision trees, and deep neural networks) and stepwise forward feature selection were used.

RESULTS

For the prediction of cardiovascular mortality, deep neural networks yielded the highest clinical performance. The novel mortality prediction models using OBP and ABP outperformed other risk scores. The area under the curve achieved by the novel approach, already when using OBP variables, was significantly higher when compared with the area under the curve of the Framingham risk score, Systemic Coronary Risk Estimation 2, and Atherosclerotic Cardiovascular Disease score. However, the prediction of cardiovascular mortality with ABP instead of OBP data significantly increased the area under the curve (0.870 versus 0.865; P=3.61×10-28), accuracy, and specificity, respectively. The prediction of ABP phenotypes (ie, white-coat, ambulatory, and masked hypertension) using clinical characteristics was limited.

CONCLUSIONS

The receiver operating characteristic curves for cardiovascular mortality using ABP and OBP with deep neural network models outperformed all other risk metrics, indicating the potential for improving current risk scores by applying state-of-the-art machine learning approaches. The prediction of cardiovascular mortality using ABP data led to a significant increase in area under the curve and performance metrics.

AutoSamp: Autoencoding k-Space Sampling via Variational Information Maximization for 3D MRI

Accelerated MRI protocols routinely involve a predefined sampling pattern that undersamples the k-space. Finding an optimal pattern can enhance the reconstruction quality, however this optimization is a challenging task. To address this challenge, we introduce a novel deep learning framework, AutoSamp, based on variational information maximization that enables joint optimization of sampling pattern and reconstruction of MRI scans. We represent the encoder as a non-uniform Fast Fourier Transform that allows continuous optimization of k-space sample locations on a non-Cartesian plane, and the decoder as a deep reconstruction network. Experiments on public 3D acquired MRI datasets show improved reconstruction quality of the proposed AutoSamp method over the prevailing variable density and variable density Poisson disc sampling for both compressed sensing and deep learning reconstructions. We demonstrate that our data-driven sampling optimization method achieves 4.4dB, 2.0dB, 0.75dB, 0.7dB PSNR improvements over reconstruction with Poisson Disc masks for acceleration factors of R =5, 10, 15, 25, respectively. Prospectively accelerated acquisitions with 3D FSE sequences using our optimized sampling patterns exhibit improved image quality and sharpness. Furthermore, we analyze the characteristics of the learned sampling patterns with respect to changes in acceleration factor, measurement noise, underlying anatomy, and coil sensitivities. We show that all these factors contribute to the optimization result by affecting the sampling density, k-space coverage and point spread functions of the learned sampling patterns.

Blip-up blip-down circular EPI (BUDA-cEPI) for distortion-free dMRI with rapid unrolled deep learning reconstruction

PURPOSE

BUDA-cEPI has been shown to achieve high-quality, high-resolution diffusion magnetic resonance imaging (dMRI) with fast acquisition time, particularly when used in conjunction with S-LORAKS reconstruction. However, this comes at a cost of more complex reconstruction that is computationally prohibitive. In this work we develop rapid reconstruction pipeline for BUDA-cEPI to pave the way for its deployment in routine clinical and neuroscientific applications. The proposed reconstruction includes the development of ML-based unrolled reconstruction as well as rapid ML-based B0 and eddy current estimations that are needed. The architecture of the unroll network was designed so that it can mimic S-LORAKS regularization well, with the addition of virtual coil channels.

METHODS

BUDA-cEPI RUN-UP - a model-based framework that incorporates off-resonance and eddy current effects was unrolled through an artificial neural network with only six gradient updates. The unrolled network alternates between data consistency (i.e., forward BUDA-cEPI and its adjoint) and regularization steps where U-Net plays a role as the regularizer. To handle the partial Fourier effect, the virtual coil concept was also introduced into the reconstruction to effectively take advantage of the smooth phase prior and trained to predict the ground-truth images obtained by BUDA-cEPI with S-LORAKS.

RESULTS

The introduction of the Virtual Coil concept into the unrolled network was shown to be key to achieving high-quality reconstruction for BUDA-cEPI. With the inclusion of an additional non-diffusion image (b-value = 0 s/mm2), a slight improvement was observed, with the normalized root mean square error further reduced by approximately 5 %. The reconstruction times for S-LORAKS and the proposed unrolled networks were approximately 225 and 3 s per slice, respectively.

CONCLUSION

BUDA-cEPI RUN-UP was shown to reduce the reconstruction time by ∼88× when compared to the state-of-the-art technique, while preserving imaging details as demonstrated through DTI application.

PixCUE: Joint Uncertainty Estimation and Image Reconstruction in MRI using Deep Pixel Classification

Deep learning (DL) models are effective in leveraging latent representations from MR data, emerging as state-of-the-art solutions for accelerated MRI reconstruction. However, challenges arise due to the inherent uncertainties associated with undersampling in k-space, coupled with the over- or under-parameterized and opaque nature of DL models. Addressing uncertainty has thus become a critical issue in DL MRI reconstruction. Monte Carlo (MC) inference techniques are commonly employed to estimate uncertainty, involving multiple reconstructions of the same scan to compute variance as a measure of uncertainty. Nevertheless, these methods entail significant computational expenses, requiring multiple inferences through the DL model. In this context, we propose a novel approach to uncertainty estimation during MRI reconstruction using a pixel classification framework. Our method, PixCUE (Pixel Classification Uncertainty Estimation), generates both the reconstructed image and an uncertainty map in a single forward pass through the DL model. We validate the efficacy of this approach by demonstrating that PixCUE-generated uncertainty maps exhibit a strong correlation with reconstruction errors across various MR imaging sequences and under diverse adversarial conditions. We present an empirical relationship between uncertainty estimations using PixCUE and established reconstruction metrics such as NMSE, PSNR, and SSIM. Furthermore, we establish a correlation between the estimated uncertainties from PixCUE and the conventional MC method. Our findings affirm that PixCUE reliably estimates uncertainty in MRI reconstruction with minimal additional computational cost.

Research on deep unfolding network reconstruction method based on scalable sampling of transient signals

In order to solve the problems of long reconstruction time and low reconstruction accuracy of compressed sensing reconstruction algorithm in the measurement of transient signals, a deep unfolding network reconstruction method based on scalable sampling is proposed to achieve fast and high-quality reconstruction of transient signal under low number of measurements. Firstly, the measurement process of compressed sensing is embedded into the neural network to realize automatic design and optimization of the observation matrix, which can reduce the number of measurements. Secondly, scalable sampling is introduced into the measurement process of compressed sensing, which can realize the training of data with different sampling ratios in the same model. Finally, a deep unfolding network model is designed to reconstruct the transient signal, which not only realizes the interpretability of the reconstructed network, but also achieves fast and high-quality reconstruction of the transient signal under the low number of measurements. Experimental results show that compared with the traditional compressed sensing reconstruction algorithms, the proposed method can obtain high-quality reconstruction accuracy with lower measurement times, and the reconstruction time is greatly reduced. The algorithm in this paper also obtains good reconstruction results under different sampling ratios, which shows that the method in this paper has good adaptability and effectiveness.

A review of deep learning-based reconstruction methods for accelerated MRI using spatiotemporal and multi-contrast redundancies

Accelerated magnetic resonance imaging (MRI) has played an essential role in reducing data acquisition time for MRI. Acceleration can be achieved by acquiring fewer data points in k-space, which results in various artifacts in the image domain. Conventional reconstruction methods have resolved the artifacts by utilizing multi-coil information, but with limited robustness. Recently, numerous deep learning-based reconstruction methods have been developed, enabling outstanding reconstruction performances with higher acceleration. Advances in hardware and developments of specialized network architectures have produced such achievements. Besides, MRI signals contain various redundant information including multi-coil redundancy, multi-contrast redundancy, and spatiotemporal redundancy. Utilization of the redundant information combined with deep learning approaches allow not only higher acceleration, but also well-preserved details in the reconstructed images. Consequently, this review paper introduces the basic concepts of deep learning and conventional accelerated MRI reconstruction methods, followed by review of recent deep learning-based reconstruction methods that exploit various redundancies. Lastly, the paper concludes by discussing the challenges, limitations, and potential directions of future developments.

Accelerating Brain MR Imaging With Multisequence and Convolutional Neural Networks

PURPOSE

Magnetic resonance imaging (MRI) refers to one of the critical image modalities for diagnosis, whereas its long acquisition time limits its application. In this study, the aim was to investigate whether deep learning-based techniques are capable of using the common information in different MRI sequences to reduce the scan time of the most time-consuming sequences while maintaining the image quality.

METHOD

Fully sampled T1-FLAIR, T2-FLAIR, and T2WI brain MRI raw data originated from 217 patients and 105 healthy subjects. The T1-FLAIR and T2-FLAIR sequences were subsampled using Cartesian masks based on four different acceleration factors. The fully sampled T1/T2-FLAIR images were predicted from undersampled T1/T2-FLAIR images and T2WI images through deep learning-based reconstruction. They were qualitatively assessed by two senior radiologists in accordance with the diagnosis decision and a four-point scale image quality score. Furthermore, the images were quantitatively assessed based on regional signal-to-noise ratios (SNRs) and contrast-to-noise ratios (CNRs). The chi-square test was performed, where p < 0.05 indicated a difference with statistical significance.

RESULTS

The diagnosis decisions from two senior radiologists remained unchanged in accordance with the accelerated and fully sampled images. There were no significant differences in the regional SNRs and CNRs of most assessed regions (p > 0.05) between the accelerated and fully sampled images. Moreover, no significant difference was identified in the image quality assessed by two senior radiologists (p > 0.05).

CONCLUSION

Deep learning-based image reconstruction is capable of significantly expediting the brain MR imaging process and producing acceptable image quality without affecting diagnosis decisions.

FEFA: Frequency Enhanced Multi-Modal MRI Reconstruction With Deep Feature Alignment

Integrating complementary information from multiple magnetic resonance imaging (MRI) modalities is often necessary to make accurate and reliable diagnostic decisions. However, the different acquisition speeds of these modalities mean that obtaining information can be time consuming and require significant effort. Reference-based MRI reconstruction aims to accelerate slower, under-sampled imaging modalities, such as T2-modality, by utilizing redundant information from faster, fully sampled modalities, such as T1-modality. Unfortunately, spatial misalignment between different modalities often negatively impacts the final results. To address this issue, we propose FEFA, which consists of cascading FEFA blocks. The FEFA block first aligns and fuses the two modalities at the feature level. The combined features are then filtered in the frequency domain to enhance the important features while simultaneously suppressing the less essential ones, thereby ensuring accurate reconstruction. Furthermore, we emphasize the advantages of combining the reconstruction results from multiple cascaded blocks, which also contributes to stabilizing the training process. Compared to existing registration-then-reconstruction and cross-attention-based approaches, our method is end-to-end trainable without requiring additional supervision, extensive parameters, or heavy computation. Experiments on the public fastMRI, IXI and in-house datasets demonstrate that our approach is effective across various under-sampling patterns and ratios.

An unrolled neural network for accelerated dynamic MRI based on second-order half-quadratic splitting model

The reconstruction of dynamic magnetic resonance images from incomplete k-space data has sparked significant research interest due to its potential to reduce scan time. However, traditional iterative optimization algorithms fail to faithfully reconstruct images at higher acceleration factors and incur long reconstruction time. Furthermore, end-to-end deep learning-based reconstruction algorithms suffer from large model parameters and lack robustness in the reconstruction results. Recently, unrolled deep learning models, have shown immense potential in algorithm stability and applicability flexibility. In this paper, we propose an unrolled deep learning network based on a second-order Half-Quadratic Splitting(HQS) algorithm, where the forward propagation process of this framework strictly follows the computational flow of the HQS algorithm. In particular, we propose a degradation-sense module by associating random sampling patterns with intermediate variables to guide the iterative process. We introduce the Information Fusion Transformer(IFT) to extract both local and non-local prior information from image sequences, thereby removing aliasing artifacts resulting from random undersampling. Finally, we impose low-rank constraints within the HQS algorithm to further enhance the reconstruction results. The experiments demonstrate that each component module of our proposed model contributes to the improvement of the reconstruction task. Our proposed method achieves comparably satisfying performance to the state-of-the-art methods and it exhibits excellent generalization capabilities across different sampling masks. At the low acceleration factor, there is a 0.7% enhancement in the PSNR. Furthermore, when the acceleration factor reached 8 and 12, the PSNR achieves an improvement of 3.4% and 5.8% respectively.

Comprehensive assessment of imaging quality of artificial intelligence-assisted compressed sensing-based MR images in routine clinical settings

BACKGROUND

Conventional MR acceleration techniques, such as compressed sensing, parallel imaging, and half Fourier often face limitations, including noise amplification, reduced signal-to-noise ratio (SNR) and increased susceptibility to artifacts, which can compromise image quality, especially in high-speed acquisitions. Artificial intelligence (AI)-assisted compressed sensing (ACS) has emerged as a novel approach that combines the conventional techniques with advanced AI algorithms. The objective of this study was to examine the imaging quality of the ACS approach by qualitative and quantitative analysis for brain, spine, kidney, liver, and knee MR imaging, as well as compare the performance of this method with conventional (non-ACS) MR imaging.

METHODS

This study included 50 subjects. Three radiologists independently assessed the quality of MR images based on artefacts, image sharpness, overall image quality and diagnostic efficacy. SNR, contrast-to-noise ratio (CNR), edge content (EC), enhancement measure (EME), scanning time were used for quantitative evaluation. The Cohen's kappa correlation coefficient (k) was employed to measure radiologists' inter-observer agreement, and the Mann Whitney U-test used for comparison between non-ACS and ACS.

RESULTS

The qualitative analysis of three radiologists demonstrated that ACS images showed superior clinical information than non-ACS images with a mean k of ~ 0.70. The images acquired with ACS approach showed statistically higher values (p < 0.05) for SNR, CNR, EC, and EME compared to the non-ACS images. Furthermore, the study's findings indicated that ACS-enabled images reduced scan time by more than 50% while maintaining high imaging quality.

CONCLUSION

Integrating ACS technology into routine clinical settings has the potential to speed up image acquisition, improve image quality, and enhance diagnostic procedures and patient throughput.

Deep plug-and-play MRI reconstruction based on multiple complementary priors

Magnetic resonance imaging (MRI) is widely used in clinical diagnosis as a safe, non-invasive, high-resolution medical imaging technology, but long scanning time has been a major challenge for this technology. The undersampling reconstruction method has become an important technical means to accelerate MRI by reducing the data sampling rate while maintaining high-quality imaging. However, traditional undersampling reconstruction techniques such as compressed sensing mainly rely on relatively single sparse or low-rank prior information to reconstruct the image, which has limitations in capturing the comprehensive features of images, resulting in the insufficient performance of the reconstructed image in terms of details and key information. In this paper, we propose a deep plug-and-play multiple complementary priors MRI reconstruction model, which combines traditional low-rank matrix recovery model methods and deep learning methods, and integrates global, local and nonlocal priors to improve reconstruction quality. Specifically, we capture the global features of the image through the matrix nuclear norm, and use the deep convolutional neural network denoiser Swin-Conv-UNet (SCUNet) and block-matching and 3-D filtering (BM3D) algorithm to preserve the local details and structural texture of the image, respectively. In addition, we utilize an efficient half-quadratic splitting (HQS) algorithm to solve the proposed model. The experimental results show that our proposed method has better reconstruction ability than the existing popular methods in terms of visual effects and numerical results.

Numerical and Clinical Evaluation of the Robustness of Open-source Networks for Parallel MR Imaging Reconstruction

PURPOSE

Deep neural networks (DNNs) for MRI reconstruction often require large datasets for training. Still, in clinical settings, the domains of datasets are diverse, and how robust DNNs are to domain differences between training and testing datasets has been an open question. Here, we numerically and clinically evaluate the generalization of the reconstruction networks across various domains under clinically practical conditions and provide practical guidance on what points to consider when selecting models for clinical application.

METHODS

We compare the reconstruction performance between four network models: U-Net, the deep cascade of convolutional neural networks (DC-CNNs), Hybrid Cascade, and variational network (VarNet). We used the public multicoil dataset fastMRI for training and testing and performed a single-domain test, where the domains of the dataset used for training and testing were the same, and cross-domain tests, where the source and target domains were different. We conducted a single-domain test (Experiment 1) and cross-domain tests (Experiments 2-4), focusing on six factors (the number of images, sampling pattern, acceleration factor, noise level, contrast, and anatomical structure) both numerically and clinically.

RESULTS

U-Net had lower performance than the three model-based networks and was less robust to domain shifts between training and testing datasets. VarNet had the highest performance and robustness among the three model-based networks, followed by Hybrid Cascade and DC-CNN. Especially, VarNet showed high performance even with a limited number of training images (200 images/10 cases). U-Net was more robust to domain shifts concerning noise level than the other model-based networks. Hybrid Cascade showed slightly better performance and robustness than DC-CNN, except for robustness to noise-level domain shifts. The results of the clinical evaluations generally agreed with the results of the quantitative metrics.

CONCLUSION

In this study, we numerically and clinically evaluated the robustness of the publicly available networks using the multicoil data. Therefore, this study provided practical guidance for clinical applications.

An insight into the concept of neuroinflammation and neurodegeneration in Alzheimer's disease: targeting molecular approach Nrf2, NF-κB, and CREB

Alzheimer's disease (AD) is a most prevalent neurologic disorder characterized by cognitive dysfunction, amyloid-β (Aβ) protein accumulation, and excessive neuroinflammation. It affects various life tasks and reduces thinking, memory, capability, reasoning and orientation ability, decision, and language. The major parts responsible for these abnormalities are the cerebral cortex, amygdala, and hippocampus. Excessive inflammatory markers release, and microglial activation affect post-synaptic neurotransmission. Various mechanisms of AD pathogenesis have been explored, but still, there is a need to debate the role of NF-κB, Nrf2, inflammatory markers, CREB signaling, etc. In this review, we have briefly discussed the signaling mechanisms and function of the NF-ĸB signaling pathway, inflammatory mediators, microglia activation, and alteration of autophagy. NF-κB inhibition is a current strategy to counter neuroinflammation and neurodegeneration in the brain of individuals with AD. In clinical trials, numbers of NF-κB modulators are being examined. Recent reports revealed that molecular and cellular pathways initiate complex pathological competencies that cause AD. Moreover, this review will provide extensive knowledge of the cAMP response element binding protein (CREB) and how these nuclear proteins affect neuronal plasticity.

Deep Convolutional Neural Network for Dedicated Regions-of-Interest Based Multi-Parameter Quantitative Ultrashort Echo Time (UTE) Magnetic Resonance Imaging of the Knee Joint

We proposed an end-to-end deep learning convolutional neural network (DCNN) for region-of-interest based multi-parameter quantification (RMQ-Net) to accelerate quantitative ultrashort echo time (UTE) MRI of the knee joint with automatic multi-tissue segmentation and relaxometry mapping. The study involved UTE-based T1 (UTE-T1) and Adiabatic T1ρ (UTE-AdiabT1ρ) mapping of the knee joint of 65 human subjects, including 20 normal controls, 29 with doubtful-minimal osteoarthritis (OA), and 16 with moderate-severe OA. Comparison studies were performed on UTE-T1 and UTE-AdiabT1ρ measurements using 100%, 43%, 26%, and 18% UTE MRI data as the inputs and the effects on the prediction quality of the RMQ-Net. The RMQ-net was modified and retrained accordingly with different combinations of inputs. Both ROI-based and voxel-based Pearson correlation analyses were performed. High Pearson correlation coefficients were achieved between the RMQ-Net predicted UTE-T1 and UTE-AdiabT1ρ results and the ground truth for segmented cartilage with acceleration factors ranging from 2.3 to 5.7. With an acceleration factor of 5.7, the Pearson r-value achieved 0.908 (ROI-based) and 0.945 (voxel-based) for UTE-T1, and 0.733 (ROI-based) and 0.895 (voxel-based) for UTE-AdiabT1ρ, correspondingly. The results demonstrated that RMQ-net can significantly accelerate quantitative UTE imaging with automated segmentation of articular cartilage in the knee joint.

Dehazing Ultrasound Using Diffusion Models

Echocardiography has been a prominent tool for the diagnosis of cardiac disease. However, these diagnoses can be heavily impeded by poor image quality. Acoustic clutter emerges due to multipath reflections imposed by layers of skin, subcutaneous fat, and intercostal muscle between the transducer and heart. As a result, haze and other noise artifacts pose a real challenge to cardiac ultrasound imaging. In many cases, especially with difficult-to-image patients such as patients with obesity, a diagnosis from B-Mode ultrasound imaging is effectively rendered unusable, forcing sonographers to resort to contrast-enhanced ultrasound examinations or refer patients to other imaging modalities. Tissue harmonic imaging has been a popular approach to combat haze, but in severe cases is still heavily impacted by haze. Alternatively, denoising algorithms are typically unable to remove highly structured and correlated noise, such as haze. It remains a challenge to accurately describe the statistical properties of structured haze, and develop an inference method to subsequently remove it. Diffusion models have emerged as powerful generative models and have shown their effectiveness in a variety of inverse problems. In this work, we present a joint posterior sampling framework that combines two separate diffusion models to model the distribution of both clean ultrasound and haze in an unsupervised manner. Furthermore, we demonstrate techniques for effectively training diffusion models on radio-frequency ultrasound data and highlight the advantages over image data. Experiments on both in-vitro and in-vivo cardiac datasets show that the proposed dehazing method effectively removes haze while preserving signals from weakly reflected tissue.

LUCMT: Learnable under-sampling and reconstructed network with cross multi-head attention transformer for accelerating MR image reconstruction

BACKGROUND AND OBJECTIVE

As a widely used technique for Magnetic Resonance Image (MRI) acceleration, compressed sensing MRI involves two main issues: designing an effective sampling strategy and reconstructing the image from significantly under-sampled K-space data. In this paper, an innovative approach is proposed to address these two challenges simultaneously.

METHODS

A novel MRI reconstruction method, termed as LUCMT, is implemented by integrating a learnable under-sampling strategy with a reconstruction network based on the Cross Multi-head Attention Transformer. In contrast to conventional static sampling methods, the proposed adaptive sampling scheme is processed optimally by learning the optimal sampling technique, which involves binarizing the sampling pattern by a sigmoid function and computing gradients by backpropagation. And the reconstruction network is designed by using CS-MRI depth unfolding network that incorporates a Cross Multi-head Attention (CMA) module with inertial and gradient descent terms.

RESULTS

T1 brain MR images from the FastMRI dataset are used to validate the performance of the proposed method. A series of experiments are conducted to validate the superior performance of our proposed network in terms of quantitative metrics and visual quality. Compared with other state-of-the-art reconstruction methods, LUCMT achieves better reconstruction performances with more accurate details. Specifically, LUCMT achieves PSNR and SSIM results of 41.87/0.9749, 46.64/0.9868, 50.41/0.9924, and 53.51/0.9955 at sampling rates of 10 %, 20 %, 30 %, and 40 %, respectively.

CONCLUSIONS

The proposed LUCMT method can provide a promising way for generating optimal under-sampling mask and accelerating MRI reconstruction accurately.

Deep learning and AI in reducing magnetic resonance imaging scanning time: advantages and pitfalls in clinical practice

Magnetic resonance imaging (MRI) is a powerful imaging modality, but one of its drawbacks is its relatively long scanning time to acquire high-resolution images. Reducing the scanning time has become a critical area of focus in MRI, aiming to enhance patient comfort, reduce motion artifacts, and increase MRI throughput. In the past 5 years, artificial intelligence (AI)-based algorithms, particularly deep learning models, have been developed to reconstruct high-resolution images from significantly fewer data points. These new techniques significantly enhance MRI efficiency, improve patient comfort and lower patient motion artifacts. Improving MRI throughput with lower scanning duration increases accessibility, potentially reducing the need for additional MRI machines and associated costs. Several fields can benefit from shortened protocols, especially for routine exams. In oncologic imaging, faster MRI scans can facilitate more regular monitoring of cancer patients. In patients suffering from neurological disorders, rapid brain imaging can aid in the quick assessment of conditions like stroke, multiple sclerosis, and epilepsy, improving patient outcomes. In chronic inflammatory disease, faster imaging may help in reducing the interval between imaging to better check therapy outcomes. Additionally, reducing scanning time could effectively help MRI to play a role in emergency medicine and acute conditions such as trauma or acute ischaemic stroke. The purpose of this paper is to describe and discuss the advantages and disadvantages of introducing deep learning reconstruction techniques to reduce MRI scanning times in clinical practice.

Uncertainty Estimation and Out-of-Distribution Detection for Deep Learning-Based Image Reconstruction Using the Local Lipschitz

Accurate image reconstruction is at the heart of diagnostics in medical imaging. Supervised deep learning-based approaches have been investigated for solving inverse problems including image reconstruction. However, these trained models encounter unseen data distributions that are widely shifted from training data during deployment. Therefore, it is essential to assess whether a given input falls within the training data distribution. Current uncertainty estimation approaches focus on providing an uncertainty map to radiologists, rather than assessing the training distribution fit. In this work, we propose a method based on the local Lipschitz metric to distinguish out-of-distribution images from in-distribution with an area under the curve of 99.94% for True Positive Rate versus False Positive Rate. We demonstrate a very strong relationship between the local Lipschitz value and mean absolute error (MAE), supported by a Spearman's rank correlation coefficient of 0.8475, to determine an uncertainty estimation threshold for optimal performance. Through the identification of false positives, we demonstrate the local Lipschitz and MAE relationship can guide data augmentation and reduce uncertainty. Our study was validated using the AUTOMAP architecture for sensor-to-image Magnetic Resonance Imaging (MRI) reconstruction. We demonstrate our approach outperforms baseline techniques of Monte-Carlo dropout and deep ensembles as well as the state-of-the-art Mean Variance Estimation network approach. We expand our application scope to MRI denoising and Computed Tomography sparse-to-full view reconstructions using UNET architectures. We show our approach is applicable to various architectures and applications, especially in medical imaging, where preserving diagnostic accuracy of reconstructed images remains paramount.

DIRECTION: Deep cascaded reconstruction residual-based feature modulation network for fast MRI reconstruction

Deep cascaded networks have been extensively studied and applied to accelerate Magnetic Resonance Imaging (MRI) and have shown promising results. Most existing works employ a large cascading number for the sake of superior performances. However, due to the lack of proper guidance, the reconstruction performance can easily reach a plateau and even face degradation if simply increasing the cascading number. In this paper, we aim to boost the reconstruction performance from a novel perspective by proposing a parallel architecture called DIRECTION that fully exploits the guiding value of the reconstruction residual of each subnetwork. Specifically, we introduce a novel Reconstruction Residual-Based Feature Modulation Mechanism (RRFMM) which utilizes the reconstruction residual of the previous subnetwork to guide the next subnetwork at the feature level. To achieve this, a Residual Attention Modulation Block (RAMB) is proposed to generate attention maps using multi-scale residual features to modulate the image features of the corresponding scales. Equipped with this strategy, each subnetwork within the cascaded network possesses its unique optimization objective and emphasis rather than blindly updating its parameters. To further boost the performance, we introduce the Cross-Stage Feature Reuse Connection (CSFRC) and the Reconstruction Dense Connection (RDC), which can reduce information loss and enhance representative ability. We conduct sufficient experiments and evaluate our method on the fastMRI knee dataset using multiple subsampling masks. Comprehensive experimental results show that our method can markedly boost the performance of cascaded networks and significantly outperforms other compared state-of-the-art methods quantitatively and qualitatively.

Attention-Based MultiOffset Deep Learning Reconstruction of Chemical Exchange Saturation Transfer (AMO-CEST) MRI

One challenge of chemical exchange saturation transfer (CEST) magnetic resonance imaging (MRI) is the long scan time due to multiple acquisitions of images at different saturation frequency offsets. k-space under-sampling strategy is commonly used to accelerate MRI acquisition, while this could introduce artifacts and reduce signal-to-noise ratio (SNR). To accelerate CEST-MRI acquisition while maintaining suitable image quality, we proposed an attention-based multioffset deep learning reconstruction network (AMO-CEST) with a multiple radial k-space sampling strategy for CEST-MRI. The AMO-CEST also contains dilated convolution to enlarge the receptive field and data consistency module to preserve the sampled k-space data. We evaluated the proposed method on a mouse brain dataset containing 5760 CEST images acquired at a pre-clinical 3 T MRI scanner. Quantitative results demonstrated that AMO-CEST showed obvious improvement over zero-filling method with a PSNR enhancement of 11 dB, a SSIM enhancement of 0.15, and a NMSE decrease of [Formula: see text] in three acquisition orientations. Compared with other deep learning-based models, AMO-CEST showed visual and quantitative improvements in images from three different orientations. We also extracted molecular contrast maps, including the amide proton transfer (APT) and the relayed nuclear Overhauser enhancement (rNOE). The results demonstrated that the CEST contrast maps derived from the CEST images of AMO-CEST were comparable to those derived from the original high-resolution CEST images. The proposed AMO-CEST can efficiently reconstruct high-quality CEST images from under-sampled k-space data and thus has the potential to accelerate CEST-MRI acquisition.

Knowledge-driven deep learning for fast MR imaging: Undersampled MR image reconstruction from supervised to un-supervised learning

Deep learning (DL) has emerged as a leading approach in accelerating MRI. It employs deep neural networks to extract knowledge from available datasets and then applies the trained networks to reconstruct accurate images from limited measurements. Unlike natural image restoration problems, MRI involves physics-based imaging processes, unique data properties, and diverse imaging tasks. This domain knowledge needs to be integrated with data-driven approaches. Our review will introduce the significant challenges faced by such knowledge-driven DL approaches in the context of fast MRI along with several notable solutions, which include learning neural networks and addressing different imaging application scenarios. The traits and trends of these techniques have also been given which have shifted from supervised learning to semi-supervised learning, and finally, to unsupervised learning methods. In addition, MR vendors' choices of DL reconstruction have been provided along with some discussions on open questions and future directions, which are critical for the reliable imaging systems.

Feature Fusion for Multi-Coil Compressed MR Image Reconstruction

Magnetic resonance imaging (MRI) occupies a pivotal position within contemporary diagnostic imaging modalities, offering non-invasive and radiation-free scanning. Despite its significance, MRI's principal limitation is the protracted data acquisition time, which hampers broader practical application. Promising deep learning (DL) methods for undersampled magnetic resonance (MR) image reconstruction outperform the traditional approaches in terms of speed and image quality. However, the intricate inter-coil correlations have been insufficiently addressed, leading to an underexploitation of the rich information inherent in multi-coil acquisitions. In this article, we proposed a method called "Multi-coil Feature Fusion Variation Network" (MFFVN), which introduces an encoder to extract the feature from multi-coil MR image directly and explicitly, followed by a feature fusion operation. Coil reshaping enables the 2D network to achieve satisfactory reconstruction results, while avoiding the introduction of a significant number of parameters and preserving inter-coil information. Compared with VN, MFFVN yields an improvement in the average PSNR and SSIM of the test set, registering enhancements of 0.2622 dB and 0.0021 dB respectively. This uplift can be attributed to the integration of feature extraction and fusion stages into the network's architecture, thereby effectively leveraging and combining the multi-coil information for enhanced image reconstruction quality. The proposed method outperforms the state-of-the-art methods on fastMRI dataset of multi-coil brains under a fourfold acceleration factor without incurring substantial computation overhead.

Learning to deep learning: statistics and a paradigm test in selecting a UNet architecture to enhance MRI

OBJECTIVE

This study aims to assess the statistical significance of training parameters in 240 dense UNets (DUNets) used for enhancing low Signal-to-Noise Ratio (SNR) and undersampled MRI in various acquisition protocols. The objective is to determine the validity of differences between different DUNet configurations and their impact on image quality metrics.

MATERIALS AND METHODS

To achieve this, we trained all DUNets using the same learning rate and number of epochs, with variations in 5 acquisition protocols, 24 loss function weightings, and 2 ground truths. We calculated evaluation metrics for two metric regions of interest (ROI). We employed both Analysis of Variance (ANOVA) and Mixed Effects Model (MEM) to assess the statistical significance of the independent parameters, aiming to compare their efficacy in revealing differences and interactions among fixed parameters.

RESULTS

ANOVA analysis showed that, except for the acquisition protocol, fixed variables were statistically insignificant. In contrast, MEM analysis revealed that all fixed parameters and their interactions held statistical significance. This emphasizes the need for advanced statistical analysis in comparative studies, where MEM can uncover finer distinctions often overlooked by ANOVA.

DISCUSSION

These findings highlight the importance of utilizing appropriate statistical analysis when comparing different deep learning models. Additionally, the surprising effectiveness of the UNet architecture in enhancing various acquisition protocols underscores the potential for developing improved methods for characterizing and training deep learning models. This study serves as a stepping stone toward enhancing the transparency and comparability of deep learning techniques for medical imaging applications.

Deep learning for accelerated and robust MRI reconstruction

Deep learning (DL) has recently emerged as a pivotal technology for enhancing magnetic resonance imaging (MRI), a critical tool in diagnostic radiology. This review paper provides a comprehensive overview of recent advances in DL for MRI reconstruction, and focuses on various DL approaches and architectures designed to improve image quality, accelerate scans, and address data-related challenges. It explores end-to-end neural networks, pre-trained and generative models, and self-supervised methods, and highlights their contributions to overcoming traditional MRI limitations. It also discusses the role of DL in optimizing acquisition protocols, enhancing robustness against distribution shifts, and tackling biases. Drawing on the extensive literature and practical insights, it outlines current successes, limitations, and future directions for leveraging DL in MRI reconstruction, while emphasizing the potential of DL to significantly impact clinical imaging practices.

Adaptive High-frequency Enhancement Network with Equilibrated Mechanism for MR Imaging

Unrolling is a promising deep learning (DL)-based technique in accelerating Magnetic Resonance (MR) imaging. It incorporates deep learning networks into the iterative optimization algorithm, enabling the flexible and adaptive learning of undefined parameters or functions. However, unrolling methods employ a limited number of iterations owing to memory constraints and exhibit detail loss, which hinders their overall performance and practical applications. In this work, we propose a novel network that adaptively improves the high-frequency feature representation and integrates a deep equilibrium model for fixed-point iteration to enhance the robustness of the reconstruction. Experimental results demonstrate superior performance of the proposed method in detail preservation, generalization across various test datasets, and robustness against noise interference and number of iterations.

Deep Learning-based Image Enhancement Techniques for Fast MRI in Neuroimaging

Despite its superior soft tissue contrast and non-invasive nature, MRI requires long scan times due to its intrinsic signal acquisition principles, a main drawback which technological advancements in MRI have been focused on. In particular, scan time reduction is a natural requirement in neuroimaging due to detailed structures requiring high resolution imaging and often volumetric (3D) acquisitions, and numerous studies have recently attempted to harness deep learning (DL) technology in enabling scan time reduction and image quality improvement. Various DL-based image reconstruction products allow for additional scan time reduction on top of existing accelerated acquisition methods without compromising the image quality.