Improving Image Segmentation with Contextual and Structural Similarity

Deep learning models for medical image segmentation are usually trained with voxel-wise losses, e.g., cross-entropy loss, focusing on unary supervision without considering inter-voxel relationships. This oversight potentially leads to semantically inconsistent predictions. Here, we propose a contextual similarity loss (CSL) and a structural similarity loss (SSL) to explicitly and efficiently incorporate inter-voxel relationships for improved performance. The CSL promotes consistency in predicted object categories for each image sub-region compared to ground truth. The SSL enforces compatibility between the predictions of voxel pairs by computing pair-wise distances between them, ensuring that voxels of the same class are close together whereas those from different classes are separated by a wide margin in the distribution space. The effectiveness of the CSL and SSL is evaluated using a clinical cone-beam computed tomography (CBCT) dataset of patients with various craniomaxillofacial (CMF) deformities and a public pancreas dataset. Experimental results show that the CSL and SSL outperform state-of-the-art regional loss functions in preserving segmentation semantics.

Federated learning for medical image analysis: A survey

Machine learning in medical imaging often faces a fundamental dilemma, namely, the small sample size problem. Many recent studies suggest using multi-domain data pooled from different acquisition sites/centers to improve statistical power. However, medical images from different sites cannot be easily shared to build large datasets for model training due to privacy protection reasons. As a promising solution, federated learning, which enables collaborative training of machine learning models based on data from different sites without cross-site data sharing, has attracted considerable attention recently. In this paper, we conduct a comprehensive survey of the recent development of federated learning methods in medical image analysis. We have systematically gathered research papers on federated learning and its applications in medical image analysis published between 2017 and 2023. Our search and compilation were conducted using databases from IEEE Xplore, ACM Digital Library, Science Direct, Springer Link, Web of Science, Google Scholar, and PubMed. In this survey, we first introduce the background of federated learning for dealing with privacy protection and collaborative learning issues. We then present a comprehensive review of recent advances in federated learning methods for medical image analysis. Specifically, existing methods are categorized based on three critical aspects of a federated learning system, including client end, server end, and communication techniques. In each category, we summarize the existing federated learning methods according to specific research problems in medical image analysis and also provide insights into the motivations of different approaches. In addition, we provide a review of existing benchmark medical imaging datasets and software platforms for current federated learning research. We also conduct an experimental study to empirically evaluate typical federated learning methods for medical image analysis. This survey can help to better understand the current research status, challenges, and potential research opportunities in this promising research field.

Source-free unsupervised domain adaptation: A survey

Unsupervised domain adaptation (UDA) via deep learning has attracted appealing attention for tackling domain-shift problems caused by distribution discrepancy across different domains. Existing UDA approaches highly depend on the accessibility of source domain data, which is usually limited in practical scenarios due to privacy protection, data storage and transmission cost, and computation burden. To tackle this issue, many source-free unsupervised domain adaptation (SFUDA) methods have been proposed recently, which perform knowledge transfer from a pre-trained source model to the unlabeled target domain with source data inaccessible. A comprehensive review of these works on SFUDA is of great significance. In this paper, we provide a timely and systematic literature review of existing SFUDA approaches from a technical perspective. Specifically, we categorize current SFUDA studies into two groups, i.e., white-box SFUDA and black-box SFUDA, and further divide them into finer subcategories based on different learning strategies they use. We also investigate the challenges of methods in each subcategory, discuss the advantages/disadvantages of white-box and black-box SFUDA methods, conclude the commonly used benchmark datasets, and summarize the popular techniques for improved generalizability of models learned without using source data. We finally discuss several promising future directions in this field.

Optimal shrinkage denoising breaks the noise floor in high-resolution diffusion MRI

The spatial resolution attainable in diffusion magnetic resonance (MR) imaging is inherently limited by noise. The weaker signal associated with a smaller voxel size, especially at a high level of diffusion sensitization, is often buried under the noise floor owing to the non-Gaussian nature of the MR magnitude signal. Here, we show how the noise floor can be suppressed remarkably via optimal shrinkage of singular values associated with noise in complex-valued k-space data from multiple receiver channels. We explore and compare different low-rank signal matrix recovery strategies to utilize the inherently redundant information from multiple channels. In combination with background phase removal, the optimal strategy reduces the noise floor by 11 times. Our framework enables imaging with substantially improved resolution for precise characterization of tissue microstructure and white matter pathways without relying on expensive hardware upgrades and time-consuming acquisition repetitions, outperforming other related denoising methods.

A multimodal submillimeter MRI atlas of the human cerebellum

The human cerebellum is engaged in a broad array of tasks related to motor coordination, cognition, language, attention, memory, and emotional regulation. A detailed cerebellar atlas can facilitate the investigation of the structural and functional organization of the cerebellum. However, existing cerebellar atlases are typically limited to a single imaging modality with insufficient characterization of tissue properties. Here, we introduce a multifaceted cerebellar atlas based on high-resolution multimodal MRI, facilitating the understanding of the neurodevelopment and neurodegeneration of the cerebellum based on cortical morphology, tissue microstructure, and intra-cerebellar and cerebello-cerebral connectivity.

Learning multi-site harmonization of magnetic resonance images without traveling human phantoms

Harmonization improves Magn. Reson. Imaging (MRI) data consistency and is central to effective integration of diverse imaging data acquired across multiple sites. Recent deep learning techniques for harmonization are predominantly supervised in nature and hence require imaging data of the same human subjects to be acquired at multiple sites. Data collection as such requires the human subjects to travel across sites and is hence challenging, costly, and impractical, more so when sufficient sample size is needed for reliable network training. Here we show how harmonization can be achieved with a deep neural network that does not rely on traveling human phantom data. Our method disentangles site-specific appearance information and site-invariant anatomical information from images acquired at multiple sites and then employs the disentangled information to generate the image of each subject for any target site. We demonstrate with more than 6,000 multi-site T1- and T2-weighted images that our method is remarkably effective in generating images with realistic site-specific appearances without altering anatomical details. Our method allows retrospective harmonization of data in a wide range of existing modern large-scale imaging studies, conducted via different scanners and protocols, without additional data collection.

Aberrant dynamic functional network connectivity in type 2 diabetes mellitus individuals

An increasing number of recent brain imaging studies are dedicated to understanding the neuro mechanism of cognitive impairment in type 2 diabetes mellitus (T2DM) individuals. In contrast to efforts to date that are limited to static functional connectivity, here we investigate abnormal connectivity in T2DM individuals by characterizing the time-varying properties of brain functional networks. Using group independent component analysis (GICA), sliding-window analysis, and k-means clustering, we extracted thirty-one intrinsic connectivity networks (ICNs) and estimated four recurring brain states. We observed significant group differences in fraction time (FT) and mean dwell time (MDT), and significant negative correlation between the Montreal Cognitive Assessment (MoCA) scores and FT/MDT. We found that in the T2DM group the inter- and intra-network connectivity decreases and increases respectively for the default mode network (DMN) and task-positive network (TPN). We also found alteration in the precuneus network (PCUN) and enhanced connectivity between the salience network (SN) and the TPN. Our study provides evidence of alterations of large-scale resting networks in T2DM individuals and shed light on the fundamental mechanisms of neurocognitive deficits in T2DM.

Longitudinal Prediction of Postnatal Brain Magnetic Resonance Images via a Metamorphic Generative Adversarial Network

Missing scans are inevitable in longitudinal studies due to either subject dropouts or failed scans. In this paper, we propose a deep learning framework to predict missing scans from acquired scans, catering to longitudinal infant studies. Prediction of infant brain MRI is challenging owing to the rapid contrast and structural changes particularly during the first year of life. We introduce a trustworthy metamorphic generative adversarial network (MGAN) for translating infant brain MRI from one time-point to another. MGAN has three key features: (i) Image translation leveraging spatial and frequency information for detail-preserving mapping; (ii) Quality-guided learning strategy that focuses attention on challenging regions. (iii) Multi-scale hybrid loss function that improves translation of image contents. Experimental results indicate that MGAN outperforms existing GANs by accurately predicting both tissue contrasts and anatomical details.

Organ-aware CBCT enhancement via dual path learning for prostate cancer treatment

BACKGROUND

Cone-beam computed tomography (CBCT) plays a crucial role in the intensity modulated radiotherapy (IMRT) of prostate cancer. However, poor image contrast and fuzzy organ boundaries pose challenges to precise targeting for dose delivery and plan reoptimization for adaptive therapy.

PURPOSE

In this work, we aim to enhance pelvic CBCT images by translating them to high-quality CT images with a particular focus on the anatomical structures important for radiotherapy.

METHODS

We develop a novel dual-path learning framework, covering both global and local information, for organ-aware enhancement of the prostate, bladder and rectum. The global path learns coarse inter-modality translation at the image level. The local path learns organ-aware translation at the regional level. This dual-path learning architecture can serve as a plug-and-play module adaptable to other medical image-to-image translation frameworks.

RESULTS

We evaluated the performance of the proposed method both quantitatively and qualitatively. The training dataset consists of unpaired 40 CBCT and 40 CT scans, the validation dataset consists of 5 paired CBCT-CT scans, and the testing dataset consists of 10 paired CBCT-CT scans. The peak signal-to-noise ratio (PSNR) between enhanced CBCT and reference CT images is 27.22 ± 1.79, and the structural similarity (SSIM) between enhanced CBCT and the reference CT images is 0.71 ± 0.03. We also compared our method with state-of-the-art image-to-image translation methods, where our method achieves the best performance. Moreover, the statistical analysis confirms that the improvements achieved by our method are statistically significant.

CONCLUSIONS

The proposed method demonstrates its superiority in enhancing pelvic CBCT images, especially at the organ level, compared to relevant methods.

Mapping the evolution of regional brain network efficiency and its association with cognitive abilities during the first twenty-eight months of life

Human brain undergoes rapid growth during the first few years of life. While previous research has employed graph theory to study early brain development, it has mostly focused on the topological attributes of the whole brain. However, examining regional graph-theory features may provide unique insights into the development of cognitive abilities. Utilizing a large and longitudinal rsfMRI dataset from the UNC/UMN Baby Connectome Project, we investigated the developmental trajectories of regional efficiency and evaluated the relationships between these changes and cognitive abilities using Mullen Scales of Early Learning during the first twenty-eight months of life. Our results revealed a complex and spatiotemporally heterogeneous development pattern of regional global and local efficiency during this age period. Furthermore, we found that the trajectories of the regional global efficiency at the left temporal occipital fusiform and bilateral occipital fusiform gyri were positively associated with cognitive abilities, including visual reception, expressive language, receptive language, and early learning composite scores (P < 0.05, FDR corrected). However, these associations were weakened with age. These findings offered new insights into the regional developmental features of brain topologies and their associations with cognition and provided evidence of ongoing optimization of brain networks at both whole-brain and regional levels.

Structural MRI Harmonization via Disentangled Latent Energy-Based Style Translation

Multi-site brain magnetic resonance imaging (MRI) has been widely used in clinical and research domains, but usually is sensitive to non-biological variations caused by site effects (e.g., field strengths and scanning protocols). Several retrospective data harmonization methods have shown promising results in removing these non-biological variations at feature or whole-image level. Most existing image-level harmonization methods are implemented through generative adversarial networks, which are generally computationally expensive and generalize poorly on independent data. To this end, this paper proposes a disentangled latent energy-based style translation (DLEST) framework for image-level structural MRI harmonization. Specifically, DLEST disentangles site-invariant image generation and site-specific style translation via a latent autoencoder and an energy-based model. The autoencoder learns to encode images into low-dimensional latent space, and generates faithful images from latent codes. The energy-based model is placed in between the encoding and generation steps, facilitating style translation from a source domain to a target domain implicitly. This allows highly generalizable image generation and efficient style translation through the latent space. We train our model on 4,092 T1-weighted MRIs in 3 tasks: histogram comparison, acquisition site classification, and brain tissue segmentation. Qualitative and quantitative results demonstrate the superiority of our approach, which generally outperforms several state-of-the-art methods.

The Devil is in the Upsampling: Architectural Decisions Made Simpler for Denoising with Deep Image Prior

Deep Image Prior (DIP) shows that some network architectures inherently tend towards generating smooth images while resisting noise, a phenomenon known as spectral bias. Image denoising is a natural application of this property. Although denoising with DIP mitigates the need for large training sets, two often intertwined practical challenges need to be overcome: architectural design and noise fitting. Existing methods either handcraft or search for suitable architectures from a vast design space, due to the limited understanding of how architectural choices affect the denoising outcome. In this study, we demonstrate from a frequency perspective that unlearnt upsampling is the main driving force behind the denoising phenomenon with DIP. This finding leads to straightforward strategies for identifying a suitable architecture for every image without laborious search. Extensive experiments show that the estimated architectures achieve superior denoising results than existing methods with up to 95% fewer parameters. Thanks to this under-parameterization, the resulting architectures are less prone to noise-fitting.

Tractography passes the test: Results from the diffusion-simulated connectivity (disco) challenge

Estimating structural connectivity from diffusion-weighted magnetic resonance imaging is a challenging task, partly due to the presence of false-positive connections and the misestimation of connection weights. Building on previous efforts, the MICCAI-CDMRI Diffusion-Simulated Connectivity (DiSCo) challenge was carried out to evaluate state-of-the-art connectivity methods using novel large-scale numerical phantoms. The diffusion signal for the phantoms was obtained from Monte Carlo simulations. The results of the challenge suggest that methods selected by the 14 teams participating in the challenge can provide high correlations between estimated and ground-truth connectivity weights, in complex numerical environments. Additionally, the methods used by the participating teams were able to accurately identify the binary connectivity of the numerical dataset. However, specific false positive and false negative connections were consistently estimated across all methods. Although the challenge dataset doesn't capture the complexity of a real brain, it provided unique data with known macrostructure and microstructure ground-truth properties to facilitate the development of connectivity estimation methods.

A paired dataset of T1- and T2-weighted MRI at 3 Tesla and 7 Tesla

Brain magnetic resonance imaging (MRI) provides detailed soft tissue contrasts that are critical for disease diagnosis and neuroscience research. Higher MRI resolution typically comes at the cost of signal-to-noise ratio (SNR) and tissue contrast, particularly for more common 3 Tesla (3T) MRI scanners. At ultra-high magnetic field strength, 7 Tesla (7T) MRI allows for higher resolution with greater tissue contrast and SNR. However, the prohibitively high costs of 7T MRI scanners deter their widespread adoption in clinical and research centers. To obtain higher-quality images without 7T MRI scanners, algorithms that can synthesize 7T MR images from 3T MR images are under active development. Here, we make available a dataset of paired T1-weighted and T2-weighted MR images at 3T and 7T of 10 healthy subjects to facilitate the development and evaluation of 3T-to-7T MR image synthesis models. The quality of the dataset is assessed using image quality metrics implemented in MRIQC.

Deep learning prediction of diffusion MRI data with microstructure-sensitive loss functions

Deep learning prediction of diffusion MRI (DMRI) data relies on the utilization of effective loss functions. Existing losses typically measure the signal-wise differences between the predicted and target DMRI data without considering the quality of derived diffusion scalars that are eventually utilized for quantification of tissue microstructure. Here, we propose two novel loss functions, called microstructural loss and spherical variance loss, to explicitly consider the quality of both the predicted DMRI data and derived diffusion scalars. We apply these loss functions to the prediction of multi-shell data and enhancement of angular resolution. Evaluation based on infant and adult DMRI data indicates that both microstructural loss and spherical variance loss improve the quality of derived diffusion scalars.

Feasibility of free-breathing 19 F MRI image acquisition to characterize ventilation defects in CF and healthy volunteers at wash-in

PURPOSE

To explore the feasibility of measuring ventilation defect percentage (VDP) using ¹⁹ F MRI during free-breathing wash-in of fluorinated gas mixture with postacquisition denoising and to compare these results with those obtained through traditional Cartesian breath-hold acquisitions.

METHODS

Eight adults with cystic fibrosis and 5 healthy volunteers completed a single MR session on a Siemens 3T Prisma. ¹ H Ultrashort-TE MRI sequences were used for registration and masking, and ventilation images with ¹⁹ F MRI were obtained while the subjects breathed a normoxic mixture of 79% perfluoropropane and 21% oxygen (O₂ ). ¹⁹ F MRI was performed during breath holds and while free breathing with one overlapping spiral scan at breath hold for VDP value comparison. The ¹⁹ F spiral data were denoised using a low-rank matrix recovery approach.

RESULTS

VDP measured using ¹⁹ F VIBE and ¹⁹ F spiral images were highly correlated (r = 0.84) at 10 wash-in breaths. Second-breath VDPs were also highly correlated (r = 0.88). Denoising greatly increased SNR (pre-denoising spiral SNR, 2.46 ± 0.21; post-denoising spiral SNR, 33.91 ± 6.12; and breath-hold SNR, 17.52 ± 2.08).

CONCLUSION

Free-breathing ¹⁹ F lung MRI VDP analysis was feasible and highly correlated with breath-hold measurements. Free-breathing methods are expected to increase patient comfort and extend ventilation MRI use to patients who are unable to perform breath holds, including younger subjects and those with more severe lung disease.

Accumulation of network redundancy marks the early stage of Alzheimer's disease

Brain wiring redundancy counteracts aging-related cognitive decline by reserving additional communication channels as a neuroprotective mechanism. Such a mechanism plays a potentially important role in maintaining cognitive function during the early stages of neurodegenerative disorders such as Alzheimer's disease (AD). AD is characterized by severe cognitive decline and involves a long prodromal stage of mild cognitive impairment (MCI). Since MCI subjects are at high risk of converting to AD, identifying MCI individuals is essential for early intervention. To delineate the redundancy profile during AD progression and enable better MCI diagnosis, we define a metric that reflects redundant disjoint connections between brain regions and extract redundancy features in three high-order brain networks-medial frontal, frontoparietal, and default mode networks-based on dynamic functional connectivity (dFC) captured by resting-state functional magnetic resonance imaging (rs-fMRI). We show that redundancy increases significantly from normal control (NC) to MCI individuals and decreases slightly from MCI to AD individuals. We further demonstrate that statistical features of redundancy are highly discriminative and yield state-of-the-art accuracy of up to 96.8 ± 1.0% in support vector machine (SVM) classification between NC and MCI individuals. This study provides evidence supporting the notion that redundancy serves as a crucial neuroprotective mechanism in MCI.

Learn2Reg: Comprehensive Multi-Task Medical Image Registration Challenge, Dataset and Evaluation in the Era of Deep Learning

Image registration is a fundamental medical image analysis task, and a wide variety of approaches have been proposed. However, only a few studies have comprehensively compared medical image registration approaches on a wide range of clinically relevant tasks. This limits the development of registration methods, the adoption of research advances into practice, and a fair benchmark across competing approaches. The Learn2Reg challenge addresses these limitations by providing a multi-task medical image registration data set for comprehensive characterisation of deformable registration algorithms. A continuous evaluation will be possible at https://learn2reg.grand-challenge.org. Learn2Reg covers a wide range of anatomies (brain, abdomen, and thorax), modalities (ultrasound, CT, MR), availability of annotations, as well as intra- and inter-patient registration evaluation. We established an easily accessible framework for training and validation of 3D registration methods, which enabled the compilation of results of over 65 individual method submissions from more than 20 unique teams. We used a complementary set of metrics, including robustness, accuracy, plausibility, and runtime, enabling unique insight into the current state-of-the-art of medical image registration. This paper describes datasets, tasks, evaluation methods and results of the challenge, as well as results of further analysis of transferability to new datasets, the importance of label supervision, and resulting bias. While no single approach worked best across all tasks, many methodological aspects could be identified that push the performance of medical image registration to new state-of-the-art performance. Furthermore, we demystified the common belief that conventional registration methods have to be much slower than deep-learning-based methods.

High-Resolution 3D Magnetic Resonance Fingerprinting With a Graph Convolutional Network

Magnetic resonance fingerprinting (MRF) is a novel quantitative imaging framework for rapid and simultaneous quantification of multiple tissue properties. 3D MRF allows higher through-plane resolution, but the acquisition process is slow when whole-brain coverage is needed. Existing methods for acceleration mainly rely on GRAPPA for k-space interpolation in the partition-encoding direction, limiting the acceleration factor to 2 or 3. In this work, we replace GRAPPA with a deep learning approach for accurate tissue quantification with greater acceleration. Specifically, a graph convolution network (GCN) is developed to cater to the non-Cartesian spiral sampling trajectories typical in MRF acquisition. The GCN maintains high quantification accuracy with up to 6-fold acceleration and allows 1mm isotropic resolution whole-brain 3D MRF data to be acquired in 3min and submillimeter 3D MRF (0.8mm) in 5min, greatly improving the feasibility of MRF in clinical settings.

Simulation of Postoperative Facial Appearances via Geometric Deep Learning for Efficient Orthognathic Surgical Planning

Orthognathic surgery corrects jaw deformities to improve aesthetics and functions. Due to the complexity of the craniomaxillofacial (CMF) anatomy, orthognathic surgery requires precise surgical planning, which involves predicting postoperative changes in facial appearance. To this end, most conventional methods involve simulation with biomechanical modeling methods, which are labor intensive and computationally expensive. Here we introduce a learning-based framework to speed up the simulation of postoperative facial appearances. Specifically, we introduce a facial shape change prediction network (FSC-Net) to learn the nonlinear mapping from bony shape changes to facial shape changes. FSC-Net is a point transform network weakly-supervised by paired preoperative and postoperative data without point-wise correspondence. In FSC-Net, a distance-guided shape loss places more emphasis on the jaw region. A local point constraint loss restricts point displacements to preserve the topology and smoothness of the surface mesh after point transformation. Evaluation results indicate that FSC-Net achieves 15× speedup with accuracy comparable to a state-of-the-art (SOTA) finite-element modeling (FEM) method.

Bidirectional prediction of facial and bony shapes for orthognathic surgical planning

This paper proposes a deep learning framework to encode subject-specific transformations between facial and bony shapes for orthognathic surgical planning. Our framework involves a bidirectional point-to-point convolutional network (P2P-Conv) to predict the transformations between facial and bony shapes. P2P-Conv is an extension of the state-of-the-art P2P-Net and leverages dynamic point-wise convolution (i.e., PointConv) to capture local-to-global spatial information. Data augmentation is carried out in the training of P2P-Conv with multiple point subsets from the facial and bony shapes. During inference, network outputs generated for multiple point subsets are combined into a dense transformation. Finally, non-rigid registration using the coherent point drift (CPD) algorithm is applied to generate surface meshes based on the predicted point sets. Experimental results on real-subject data demonstrate that our method substantially improves the prediction of facial and bony shapes over state-of-the-art methods.

Multifaceted atlases of the human brain in its infancy

Brain atlases are spatial references for integrating, processing, and analyzing brain features gathered from different individuals, sources, and scales. Here we introduce a collection of joint surface-volume atlases that chart postnatal development of the human brain in a spatiotemporally dense manner from two weeks to two years of age. Our month-specific atlases chart normative patterns and capture key traits of early brain development and are therefore conducive to identifying aberrations from normal developmental trajectories. These atlases will enhance our understanding of early structural and functional development by facilitating the mapping of diverse features of the infant brain to a common reference frame for precise multifaceted quantification of cortical and subcortical changes.

Attention-Guided Autoencoder for Automated Progression Prediction of Subjective Cognitive Decline With Structural MRI

Subjective cognitive decline (SCD) is the preclinical stage of Alzheimer's disease (AD) which happens even earlier than mild cognitive impairment (MCI). Progressive SCD will convert to MCI with the potential of further evolving to AD. Therefore, early identification of progressive SCD with neuroimaging techniques (eg, structural MRI) is of great clinical value for early intervention of AD. However, existing MRI-based machine/deep learning methods usually suffer the small-sample-size problem and lack interpretability. To this end, we propose an interpretable autoencoder model with domain transfer learning (IADT) for progression prediction of SCD. Firstly, the proposed model can leverage MRIs from both the target domain (eg., SCD) and auxiliary domains (, AD and NC) for progressive SCD identification. Besides, it can automatically locate the disease-related brain regions of interest (defined in brain atlases) through an attention mechanism, which shows good interpretability. In addition, the IADT model is straightforward to train and test with only 5  ∼ 10 seconds on CPUs and is suitable for medical tasks with small datasets. Extensive experiments on the publicly available ADNI dataset and a private CLAS dataset have demonstrated the effectiveness of the proposed method.

Dual Adversarial Attention Mechanism for Unsupervised Domain Adaptive Medical Image Segmentation

Domain adaptation techniques have been demonstrated to be effective in addressing label deficiency challenges in medical image segmentation. However, conventional domain adaptation based approaches often concentrate on matching global marginal distributions between different domains in a class-agnostic fashion. In this paper, we present a dual-attention domain-adaptative segmentation network (DADASeg-Net) for cross-modality medical image segmentation. The key contribution of DADASeg-Net is a novel dual adversarial attention mechanism, which regularizes the domain adaptation module with two attention maps respectively from the space and class perspectives. Specifically, the spatial attention map guides the domain adaptation module to focus on regions that are challenging to align in adaptation. The class attention map encourages the domain adaptation module to capture class-specific instead of class-agnostic knowledge for distribution alignment. DADASeg-Net shows superior performance in two challenging medical image segmentation tasks.

Localization of Craniomaxillofacial Landmarks on CBCT Images Using 3D Mask R-CNN and Local Dependency Learning

Cephalometric analysis relies on accurate detection of craniomaxillofacial (CMF) landmarks from cone-beam computed tomography (CBCT) images. However, due to the complexity of CMF bony structures, it is difficult to localize landmarks efficiently and accurately. In this paper, we propose a deep learning framework to tackle this challenge by jointly digitalizing 105 CMF landmarks on CBCT images. By explicitly learning the local geometrical relationships between the landmarks, our approach extends Mask R-CNN for end-to-end prediction of landmark locations. Specifically, we first apply a detection network on a down-sampled 3D image to leverage global contextual information to predict the approximate locations of the landmarks. We subsequently leverage local information provided by higher-resolution image patches to refine the landmark locations. On patients with varying non-syndromic jaw deformities, our method achieves an average detection accuracy of 1.38± 0.95mm, outperforming a related state-of-the-art method.

Rapid Diffusion Magnetic Resonance Imaging Using Slice-Interleaved Encoding

In this paper, we present a robust reconstruction scheme for diffusion MRI (dMRI) data acquired using slice-interleaved diffusion encoding (SIDE). When combined with SIDE undersampling and simultaneous multi-slice (SMS) imaging, our reconstruction strategy is capable of significantly reducing the amount of data that needs to be acquired, enabling high-speed diffusion imaging for pediatric, elderly, and claustrophobic individuals. In contrast to the conventional approach of acquiring a full diffusion-weighted (DW) volume per diffusion wavevector, SIDE acquires in each repetition time (TR) a volume that consists of interleaved slice groups, each group corresponding to a different diffusion wavevector. This strategy allows SIDE to rapidly acquire data covering a large number of wavevectors within a short period of time. The proposed reconstruction method uses a diffusion spectrum model and multi-dimensional total variation to recover full DW images from DW volumes that are slice-undersampled due to unacquired SIDE volumes. We formulate an inverse problem that can be solved efficiently using the alternating direction method of multipliers (ADMM). Experiment results demonstrate that DW images can be reconstructed with high fidelity even when the acquisition is accelerated by 25 folds.

Hybrid Graph Transformer for Tissue Microstructure Estimation with Undersampled Diffusion MRI Data

Advanced contemporary diffusion models for tissue microstructure often require diffusion MRI (DMRI) data with sufficiently dense sampling in the diffusion wavevector space for reliable model fitting, which might not always be feasible in practice. A potential remedy to this problem is by using deep learning techniques to predict high-quality diffusion microstructural indices from sparsely sampled data. However, existing methods are either agnostic to the data geometry in the diffusion wavevector space ( q -space) or limited to leveraging information from only local neighborhoods in the physical coordinate space ( x -space). Here, we propose a hybrid graph transformer (HGT) to explicitly consider the q -space geometric structure with a graph neural network (GNN) and make full use of spatial information with a novel residual dense transformer (RDT). The RDT consists of multiple densely connected transformer layers and a residual connection to facilitate model training. Extensive experiments on the data from the Human Connectome Project (HCP) demonstrate that our method significantly improves the quality of microstructural estimations over existing state-of-the-art methods.

Harmonization of Multi-site Cortical Data Across the Human Lifespan

Neuroimaging data harmonization has become a prerequisite in integrative data analytics for standardizing a wide variety of data collected from multiple studies and enabling interdisciplinary research. The lack of standardized image acquisition and computational procedures introduces non-biological variability and inconsistency in multi-site data, complicating downstream statistical analyses. Here, we propose a novel statistical technique to retrospectively harmonize multi-site cortical data collected longitudinally and cross-sectionally between birth and 100 years. We demonstrate that our method can effectively eliminate non-biological disparities from cortical thickness and myelination measurements, while preserving biological variation across the entire lifespan. Our harmonization method will foster large-scale population studies by providing comparable data required for investigating developmental and aging processes.

From descriptive connectome to mechanistic connectome: Generative modeling in functional magnetic resonance imaging analysis

As a newly emerging field, connectomics has greatly advanced our understanding of the wiring diagram and organizational features of the human brain. Generative modeling-based connectome analysis, in particular, plays a vital role in deciphering the neural mechanisms of cognitive functions in health and dysfunction in diseases. Here we review the foundation and development of major generative modeling approaches for functional magnetic resonance imaging (fMRI) and survey their applications to cognitive or clinical neuroscience problems. We argue that conventional structural and functional connectivity (FC) analysis alone is not sufficient to reveal the complex circuit interactions underlying observed neuroimaging data and should be supplemented with generative modeling-based effective connectivity and simulation, a fruitful practice that we term "mechanistic connectome." The transformation from descriptive connectome to mechanistic connectome will open up promising avenues to gain mechanistic insights into the delicate operating principles of the human brain and their potential impairments in diseases, which facilitates the development of effective personalized treatments to curb neurological and psychiatric disorders.

Recurrent Tissue-Aware Network for Deformable Registration of Infant Brain MR Images

Deformable registration is fundamental to longitudinal and population-based image analyses. However, it is challenging to precisely align longitudinal infant brain MR images of the same subject, as well as cross-sectional infant brain MR images of different subjects, due to fast brain development during infancy. In this paper, we propose a recurrently usable deep neural network for the registration of infant brain MR images. There are three main highlights of our proposed method. (i) We use brain tissue segmentation maps for registration, instead of intensity images, to tackle the issue of rapid contrast changes of brain tissues during the first year of life. (ii) A single registration network is trained in a one-shot manner, and then recurrently applied in inference for multiple times, such that the complex deformation field can be recovered incrementally. (iii) We also propose both the adaptive smoothing layer and the tissue-aware anti-folding constraint into the registration network to ensure the physiological plausibility of estimated deformations without degrading the registration accuracy. Experimental results, in comparison to the state-of-the-art registration methods, indicate that our proposed method achieves the highest registration accuracy while still preserving the smoothness of the deformation field. The implementation of our proposed registration network is available online https://github.com/Barnonewdm/ACTA-Reg-Net.

A cascaded nested network for 3T brain MR image segmentation guided by 7T labeling

Accurate segmentation of the brain into gray matter, white matter, and cerebrospinal fluid using magnetic resonance (MR) imaging is critical for visualization and quantification of brain anatomy. Compared to 3T MR images, 7T MR images exhibit higher tissue contrast that is contributive to accurate tissue delineation for training segmentation models. In this paper, we propose a cascaded nested network (CaNes-Net) for segmentation of 3T brain MR images, trained by tissue labels delineated from the corresponding 7T images. We first train a nested network (Nes-Net) for a rough segmentation. The second Nes-Net uses tissue-specific geodesic distance maps as contextual information to refine the segmentation. This process is iterated to build CaNes-Net with a cascade of Nes-Net modules to gradually refine the segmentation. To alleviate the misalignment between 3T and corresponding 7T MR images, we incorporate a correlation coefficient map to allow well-aligned voxels to play a more important role in supervising the training process. We compared CaNes-Net with SPM and FSL tools, as well as four deep learning models on 18 adult subjects and the ADNI dataset. Our results indicate that CaNes-Net reduces segmentation errors caused by the misalignment and improves segmentation accuracy substantially over the competing methods.

Alterations of dynamic redundancy of functional brain subnetworks in Alzheimer's disease and major depression disorders

The human brain is not only efficiently but also "redundantly" connected. The redundancy design could help the brain maintain resilience to disease attacks. This paper explores subnetwork-level redundancy dynamics and the potential of such metrics in disease studies. As such, we looked into specific functional subnetworks, including those associated with high-level functions. We investigated how the subnetwork redundancy dynamics change along with Alzheimer's disease (AD) progression and with major depressive disorder (MDD), two major disorders that could share similar subnetwork alterations. We found an increased dynamic redundancy of the subcortical-cerebellum subnetwork and its connections to other high-order subnetworks in the mild cognitive impairment (MCI) and AD compared to the normal control (NC). With gained spatial specificity, we found such a redundancy index was sensitive to disease symptoms and could act as a protective mechanism to prevent the collapse of the brain network and functions. The dynamic redundancy of the medial frontal subnetwork and its connections to the frontoparietal subnetwork was also found decreased in MDD compared to NC. The spatial specificity of the redundancy dynamics changes may provide essential knowledge for a better understanding of shared neural substrates in AD and MDD.

Fast and Accurate Craniomaxillofacial Landmark Detection via 3D Faster R-CNN

Automatic craniomaxillofacial (CMF) landmark localization from cone-beam computed tomography (CBCT) images is challenging, considering that 1) the number of landmarks in the images may change due to varying deformities and traumatic defects, and 2) the CBCT images used in clinical practice are typically large. In this paper, we propose a two-stage, coarse-to-fine deep learning method to tackle these challenges with both speed and accuracy in mind. Specifically, we first use a 3D faster R-CNN to roughly locate landmarks in down-sampled CBCT images that have varying numbers of landmarks. By converting the landmark point detection problem to a generic object detection problem, our 3D faster R-CNN is formulated to detect virtual, fixed-size objects in small boxes with centers indicating the approximate locations of the landmarks. Based on the rough landmark locations, we then crop 3D patches from the high-resolution images and send them to a multi-scale UNet for the regression of heatmaps, from which the refined landmark locations are finally derived. We evaluated the proposed approach by detecting up to 18 landmarks on a real clinical dataset of CMF CBCT images with various conditions. Experiments show that our approach achieves state-of-the-art accuracy of 0.89 ± 0.64mm in an average time of 26.2 seconds per volume.

Altered Connectedness of the Brain Chronnectome During the Progression to Alzheimer's Disease

Graph theory has been extensively used to investigate brain network topology and its changes in disease cohorts. However, many graph theoretic analysis-based brain network studies focused on the shortest paths or, more generally, cost-efficiency. In this work, we use two new concepts, connectedness and 2-connectedness, to measure different global properties compared to the previously widely adopted ones. We apply them to unravel interesting characteristics in the brain, such as redundancy design and further conduct a time-varying brain functional network analysis for characterizing the progression of Alzheimer's disease (AD). Specifically, we define different connectedness and 2-connectedness states and evaluate their dynamics in AD and its preclinical stage, mild cognitive impairment (MCI), compared to the normal controls (NC). Results indicate that, compared to MCI and NC, brain networks of AD tend to be more frequently connected at a sparse level. For MCI, we found that their brains are more likely to be 2-connected in the minimal connected state as well indicating increasing redundancy in brain connectivity. Such a redundant design could ensure maintained connectedness of the MCI's brain network in the case that pathological damages break down any link or silenced any node, making it possible to preserve cognitive abilities. Our study suggests that the redundancy in the brain functional chronnectome could be altered in the preclinical stage of AD. The findings can be successfully replicated in a retest study and with an independent MCI dataset. Characterizing redundancy design in the brain chronnectome using connectedness and 2-connectedness analysis provides a unique viewpoint for understanding disease affected brain networks.

Magnetic Resonance Fingerprinting of the Pediatric Brain

Magnetic resonance fingerprinting (MRF) is increasingly being used to evaluate brain development and differentiate normal and pathologic tissues in children. MRF can provide reliable and accurate intrinsic tissue properties, such as T1 and T2 relaxation times. MRF is a powerful tool in evaluating brain disease in pediatric population. MRF is a new quantitative MR imaging technique for rapid and simultaneous quantification of multiple tissue properties.

Synthetic digital reconstructed radiographs for MR-only robotic stereotactic radiation therapy: A proof of concept

PURPOSE

To create synthetic CTs and digital reconstructed radiographs (DRRs) from MR images that allow for fiducial visualization and accurate dose calculation for MR-only radiosurgery.

METHODS

We developed a machine learning model to create synthetic CTs from pelvic MRs for prostate treatments. This model has been previously proven to generate synthetic CTs with accuracy on par or better than alternate methods, such as atlas-based registration. Our dataset consisted of 11 paired CT and conventional MR (T2) images used for previous CyberKnife (Accuray, Inc) radiotherapy treatments. The MR images were pre-processed to mimic the appearance of fiducial-enhancing images. Two models were trained for each parameter case, using a sub-set of the available image pairs, with the remaining images set aside for testing and validation of the model to identify the optimal patch size and number of image pairs used for training. Four models were then trained using the identified parameters and used to generate synthetic CTs, which in turn were used to generate DRRs at angles 45° and 315°, as would be used for a CyberKnife treatment. The synthetic CTs and DRRs were compared visually and using the mean squared error and peak signal-to-noise ratio against the ground-truth images to evaluate their similarity.

RESULTS

The synthetic CTs, as well as the DRRs generated from them, gave similar visualization of the fiducial markers in the prostate as the true counterparts. There was no significant difference found for the fiducial localization for the CTs and DRRs. Across the 8 DRRs analyzed, the mean MSE between the normalized true and synthetic DRRs was 0.66 ± 0.42% and the mean PSNR for this region was 22.9 ± 3.7 dB. For the full CTs, the mean MAE was 72.9 ± 88.1 HU and the mean PSNR was 31.2 ± 2.2 dB.

CONCLUSIONS

Our machine learning-based method provides a proof of concept of a way to generate synthetic CTs and DRRs for accurate dose calculation and fiducial localization for use in radiation treatment of the prostate.

Dilated perivascular space is related to reduced free-water in surrounding white matter among healthy adults and elderlies but not in patients with severe cerebral small vessel disease

Perivascular space facilitates cerebral interstitial water clearance. However, it is unclear how dilated perivascular space (dPVS) affects the interstitial water of surrounding white matter. We aimed to determine the presence and extent of changes in normal-appearing white matter water components around dPVS in different populations. Twenty healthy elderly subjects and 15 elderly subjects with severe cerebral small vessel disease (CSVD, with lacunar infarction 6 months before the scan) were included in our study. And other 28 healthy adult subjects were enrolled under a different scanning parameter to see if the results are comparable. The normal-appearing white matter around dPVS was categorized into 10 layers (1 mm thickness each) based on their distance to dPVS. We evaluated the mean isotropic-diffusing water volume fraction in each layer. We discovered a significantly reduced free-water content in the layers closely adjacent to the dPVS in the healthy elderlies. however, this reduction around dPVS was weaker in the CSVD subjects. We also discovered an elevated free-water content within dPVS. DPVS played different roles in healthy subjects or CSVD subjects. The reduced water content around dPVS in healthy subjects suggests these MR-visible PVSs are not always related to the stagnation of fluid.

Real-Time Mapping of Tissue Properties for Magnetic Resonance Fingerprinting

Magnetic resonance fingerprinting (MRF) is a relatively new multi-parametric quantitative imaging method that involves a two-step process: (i) reconstructing a series of time frames from highly-undersampled non-Cartesian spiral k-space data and (ii) pattern matching using the time frames to infer tissue properties (e.g., T 1 and T 2 relaxation times). In this paper, we introduce a novel end-to-end deep learning framework to seamlessly map the tissue properties directly from spiral k-space MRF data, thereby avoiding time-consuming processing such as the non-uniform fast Fourier transform (NUFFT) and the dictionary-based fingerprint matching. Our method directly consumes the non-Cartesian k -space data, performs adaptive density compensation, and predicts multiple tissue property maps in one forward pass. Experiments on both 2D and 3D MRF data demonstrate that quantification accuracy comparable to state-of-the-art methods can be accomplished within 0.5 s, which is 1,100 to 7,700 times faster than the original MRF framework. The proposed method is thus promising for facilitating the adoption of MRF in clinical settings.

Highly Reproducible Whole Brain Parcellation in Individuals via Voxel Annotation with Fiber Clusters

A central goal in systems neuroscience is to parcellate the brain into discrete units that are neurobiologically coherent. Here, we propose a strategy for consistent whole-brain parcellation of white matter (WM) and gray matter (GM) in individuals. We parcellate the brain into coherent parcels using non-negative matrix factorization based on voxel annotation using fiber clusters. Tractography is performed using an algorithm that mitigates gyral bias, allowing full gyral and sulcal coverage for reliable parcellation of the cortical ribbon. Experimental results indicate that parcellation using our approach is highly reproducible with 100% test-retest parcel identification rate and is highly consistent with significantly lower inter-subject variability than FreeSurfer parcellation. This implies that reproducible parcellation can be obtained for subject-specific investigation of brain structure and function.

Vox2Surf: Implicit Surface Reconstruction from Volumetric Data

Surface reconstruction from volumetric T1-weighted and T2-weighted images is a time-consuming multi-step process that often involves careful parameter fine-tuning, hindering a more wide-spread utilization of surface-based analysis particularly in large-scale studies. In this work, we propose a fast surface reconstruction method that is based on directly learning a continuous-valued signed distance function (SDF) as implicit surface representation. This continuous representation implicitly encodes the boundary of the surface as the zero isosurface. Given the predicted SDF, the target 3D surface is reconstructed by applying the marching cubes algorithm. Our implicit reconstruction method concurrently predicts the surfaces of the brain parenchyma, the white matter and pial surfaces, the subcortical structures, and the ventricles. Evaluation based on data from the Human Connectome Project indicates that surface reconstruction of a total of 22 cortical and subcortical structures can be completed in less than 20 min.

DLLNet: An Attention-Based Deep Learning Method for Dental Landmark Localization on High-Resolution 3D Digital Dental Models

Dental landmark localization is a fundamental step to analyzing dental models in the planning of orthodontic or orthognathic surgery. However, current clinical practices require clinicians to manually digitize more than 60 landmarks on 3D dental models. Automatic methods to detect landmarks can release clinicians from the tedious labor of manual annotation and improve localization accuracy. Most existing landmark detection methods fail to capture local geometric contexts, causing large errors and misdetections. We propose an end-to-end learning framework to automatically localize 68 landmarks on high-resolution dental surfaces. Our network hierarchically extracts multi-scale local contextual features along two paths: a landmark localization path and a landmark area-of-interest segmentation path. Higher-level features are learned by combining local-to-global features from the two paths by feature fusion to predict the landmark heatmap and the landmark area segmentation map. An attention mechanism is then applied to the two maps to refine the landmark position. We evaluated our framework on a real-patient dataset consisting of 77 high-resolution dental surfaces. Our approach achieves an average localization error of 0.42 mm, significantly outperforming related start-of-the-art methods.

Active Cortex Tractography

Most existing diffusion tractography algorithms are affected by gyral bias, causing the termination of streamlines at gyral crowns instead of sulcal banks. In this paper, we propose a tractography technique, called active cortex tractography (ACT), to overcome gyral bias by enabling fiber streamlines to curve naturally into the cortex. We show that the cortex can play an active role in cortical tractography by providing anatomical information to overcome orientation ambiguities as the streamlines enter the superficial white matter in gyral blades and approach the cortex. This is achieved by devising a direction scouting mechanism that takes into account the white matter surface normal vectors. The scouting mechanism allows probing of directions further in space to prepare the streamlines to turn at appropriate angles. The surface normal vectors guide the streamlines to turn into the cortex, perpendicular to the white-gray matter interface. Evaluation using synthetic, macaque and human data with different streamline seeding schemes demonstrates that ACT improves cortical tractography.

SkullEngine: A Multi-Stage CNN Framework for Collaborative CBCT Image Segmentation and Landmark Detection

Accurate bone segmentation and landmark detection are two essential preparation tasks in computer-aided surgical planning for patients with craniomaxillofacial (CMF) deformities. Surgeons typically have to complete the two tasks manually, spending ~12 hours for each set of CBCT or ~5 hours for CT. To tackle these problems, we propose a multi-stage coarse-to-fine CNN-based framework, called SkullEngine, for high-resolution segmentation and large-scale landmark detection through a collaborative, integrated, and scalable JSD model and three segmentation and landmark detection refinement models. We evaluated our framework on a clinical dataset consisting of 170 CBCT/CT images for the task of segmenting 2 bones (midface and mandible) and detecting 175 clinically common landmarks on bones, teeth, and soft tissues. Experimental results show that SkullEngine significantly improves segmentation quality, especially in regions where the bone is thin. In addition, SkullEngine also efficiently and accurately detect all of the 175 landmarks. Both tasks were completed simultaneously within 3 minutes regardless of CBCT or CT with high segmentation quality. Currently, SkullEngine has been integrated into a clinical workflow to further evaluate its clinical efficiency.

Surface-Guided Image Fusion for Preserving Cortical Details in Human Brain Templates

Human brain templates are a basis for comparison of brain features across individuals. They should ideally capture an atomical details at both coarse and fine scales to facilitate comparison at varying granularity. Brain template construction typically involves spatial normalization and image fusion. While significant efforts have been dedicated to improving brain templates with sophisticated spatial normalization algorithms, image fusion is typically carried out using intensity-based averaging, causing blurring of anatomical structures. Here, we present an image fusion method that exploits cortical surfaces as guidance to help preserve details in brain templates. Our method encodes cortical boundary information given by a cortical surface mesh in a signed distance function (SDF) map. We use the SDF map to help determine localized contributions of the individual images, especially at cortical boundaries, in image fusion. Experimental results demonstrate that our method significantly improves the preservation of fine gyral and sulcal details, resulting in detailed brain templates with good surface-volume agreement.

Skull Segmentation from CBCT Images via Voxel-Based Rendering

Skull segmentation from three-dimensional (3D) cone-beam computed tomography (CBCT) images is critical for the diagnosis and treatment planning of the patients with craniomaxillofacial (CMF) deformities. Convolutional neural network (CNN)-based methods are currently dominating volumetric image segmentation, but these methods suffer from the limited GPU memory and the large image size (e.g., 512 × 512 × 448). Typical ad-hoc strategies, such as down-sampling or patch cropping, will degrade segmentation accuracy due to insufficient capturing of local fine details or global contextual information. Other methods such as Global-Local Networks (GLNet) are focusing on the improvement of neural networks, aiming to combine the local details and the global contextual information in a GPU memory-efficient manner. However, all these methods are operating on regular grids, which are computationally inefficient for volumetric image segmentation. In this work, we propose a novel VoxelRend-based network (VR-U-Net) by combining a memory-efficient variant of 3D U-Net with a voxel-based rendering (VoxelRend) module that refines local details via voxel-based predictions on non-regular grids. Establishing on relatively coarse feature maps, the VoxelRend module achieves significant improvement of segmentation accuracy with a fraction of GPU memory consumption. We evaluate our proposed VR-U-Net in the skull segmentation task on a high-resolution CBCT dataset collected from local hospitals. Experimental results show that the proposed VR-U-Net yields high-quality segmentation results in a memory-efficient manner, highlighting the practical value of our method.

A Self-Supervised Deep Framework for Reference Bony Shape Estimation in Orthognathic Surgical Planning

Virtual orthognathic surgical planning involves simulating surgical corrections of jaw deformities on 3D facial bony shape models. Due to the lack of necessary guidance, the planning procedure is highly experience-dependent and the planning results are often suboptimal. A reference facial bony shape model representing normal anatomies can provide an objective guidance to improve planning accuracy. Therefore, we propose a self-supervised deep framework to automatically estimate reference facial bony shape models. Our framework is an end-to-end trainable network, consisting of a simulator and a corrector. In the training stage, the simulator maps jaw deformities of a patient bone to a normal bone to generate a simulated deformed bone. The corrector then restores the simulated deformed bone back to normal. In the inference stage, the trained corrector is applied to generate a patient-specific normal-looking reference bone from a real deformed bone. The proposed framework was evaluated using a clinical dataset and compared with a state-of-the-art method that is based on a supervised point-cloud network. Experimental results show that the estimated shape models given by our approach are clinically acceptable and significantly more accurate than that of the competing method.

Deep Simulation of Facial Appearance Changes Following Craniomaxillofacial Bony Movements in Orthognathic Surgical Planning

Facial appearance changes with the movements of bony segments in orthognathic surgery of patients with craniomaxillofacial (CMF) deformities. Conventional bio-mechanical methods, such as finite element modeling (FEM), for simulating such changes, are labor intensive and computationally expensive, preventing them from being used in clinical settings. To overcome these limitations, we propose a deep learning framework to predict post-operative facial changes. Specifically, FC-Net, a facial appearance change simulation network, is developed to predict the point displacement vectors associated with a facial point cloud. FC-Net learns the point displacements of a pre-operative facial point cloud from the bony movement vectors between pre-operative and simulated post-operative bony models. FC-Net is a weakly-supervised point displacement network trained using paired data with strict point-to-point correspondence. To preserve the topology of the facial model during point transform, we employ a local-point-transform loss to constrain the local movements of points. Experimental results on real patient data reveal that the proposed framework can predict post-operative facial appearance changes remarkably faster than a state-of-the-art FEM method with comparable prediction accuracy.

Noise Mapping and Removal in Complex-Valued Multi-Channel MRI via Optimal Shrinkage of Singular Values

In magnetic resonance imaging (MRI), noise is a limiting factor for higher spatial resolution and a major cause of prolonged scan time, owing to the need for repeated scans. Improving the signal-to-noise ratio is therefore key to faster and higher-resolution MRI. Here we propose a method for mapping and reducing noise in MRI by leveraging the inherent redundancy in complex-valued multi-channel MRI data. Our method leverages a provably optimal strategy for shrinking the singular values of a data matrix, allowing it to outperform state-of-the-art methods such as Marchenko-Pastur PCA in noise reduction. Our method reduces the noise floor in brain diffusion MRI by 5-fold and remarkably improves the contrast of spiral lung ¹⁹F MRI. Our framework is fast and does not require training and hyper-parameter tuning, therefore providing a convenient means for improving SNR in MRI.

Estimating Reference Bony Shape Models for Orthognathic Surgical Planning Using 3D Point-Cloud Deep Learning

Orthognathic surgical outcomes rely heavily on the quality of surgical planning. Automatic estimation of a reference facial bone shape significantly reduces experience-dependent variability and improves planning accuracy and efficiency. We propose an end-to-end deep learning framework to estimate patient-specific reference bony shape models for patients with orthognathic deformities. Specifically, we apply a point-cloud network to learn a vertex-wise deformation field from a patient's deformed bony shape, represented as a point cloud. The estimated deformation field is then used to correct the deformed bony shape to output a patient-specific reference bony surface model. To train our network effectively, we introduce a simulation strategy to synthesize deformed bones from any given normal bone, producing a relatively large and diverse dataset of shapes for training. Our method was evaluated using both synthetic and real patient data. Experimental results show that our framework estimates realistic reference bony shape models for patients with varying deformities. The performance of our method is consistently better than an existing method and several deep point-cloud networks. Our end-to-end estimation framework based on geometric deep learning shows great potential for improving clinical workflows.