A new improved version of the realistic digital brain phantom

Use of a virtual phantom to assess the capability of a treatment planning system to perform magnetic resonance image distortion correction

Treatment Planning Systems (TPS) offer algorithms for distortion correction (DC) of Magnetic Resonance (MR) images, whose performances demand proper evaluation. This work develops a procedure using a virtual phantom to quantitatively assess a TPS DC algorithm. Variations of the digital Brainweb MR study were created by introducing known distortions and Control Points (CPs). A synthetic Computed Tomography (sCT) study was created based upon the MR study. Elements TPS (Brainlab, Munich, Germany) was used to apply DC to the MR images, choosing the sCT as the gold standard. Deviations in the CP locations between the original images, the distorted images and the corrected images were calculated. Structural Similarity Metric (SSIM) tests were applied for further assessment of image corrections. The introduced distortion deviated the CP locations by a median (range) value of 1.8 (0.2-4.4) mm. After DC was applied, these values were reduced to 0.6 (0.1-1.9) mm. Correction of the original image deviated the CP locations by 0.2 (0-1.1) mm. The SSIM comparisons between the original and the distorted images yielded values of 0.23 and 0.67 before and after DC, respectively. The SSIM comparison of the original study, before and after DC, yielded a value of 0.97. The proposed methodology using a virtual phantom with CPs can be used to assess a TPS DC algorithm. Elements TPS effectively reduced MR distorsions below radiosurgery tolerances.

Spatially constrained hyperpolarized 13C MRI pharmacokinetic rate constant map estimation using a digital brain phantom and a U-Net

Fitting rate constants to Hyperpolarized [1-13C]Pyruvate (HP C13) MRI data is a promising approach for quantifying metabolism in vivo. Current methods typically fit each voxel of the dataset using a least-squares objective. With these methods, each voxel is considered independently, and the spatial relationships are not considered during fitting. In this work, we use a convolutional neural network, a U-Net, with convolutions across the 2D spatial dimensions to estimate pyruvate-to-lactate conversion rate, kPL, maps from dynamic HP C13 datasets. We designed a framework for creating simulated anatomically accurate brain data that matches typical HP C13 characteristics to provide large amounts of data for training with ground truth results. The U-Net is initially trained with the digital phantom data and then further trained with in vivo datasets for regularization. In simulation where ground-truth kPL maps are available, the U-Net outperforms voxel-wise fitting with and without spatiotemporal denoising, particularly for low SNR data. In vivo data was evaluated qualitatively, as no ground truth is available, and before regularization the U-Net predicted kPL maps appear oversmoothed. After further training with in vivo data, the resulting kPL maps appear more realistic. This study demonstrates how to use a U-Net to estimate rate constant maps for HP C13 data, including a comprehensive framework for generating a large amount of anatomically realistic simulated data and an approach for regularization. This simulation and architecture provide a foundation that can be built upon in the future for improved performance.

Electrical impedance tomography meets reduced order modelling: a framework for faster and more reliable electrical conductivity estimations

Objective.Inclusion of individualised electrical conductivities of head tissues is crucial for the accuracy of electrical source imaging techniques based on electro/magnetoencephalography and the efficacy of transcranial electrical stimulation. Parametric electrical impedance tomography (pEIT) is a method to cheaply and non-invasively estimate them using electrode arrays on the scalp to apply currents and measure the resulting potential distribution. Conductivities are then estimated by iteratively fitting a forward model to the measurements, incurring a prohibitive computational cost that is generally lowered at the expense of accuracy. Reducing the computational cost associated with the forward solutions would improve the accessibility of this method and unlock new capabilities.Approach.We introduce reduced order modelling (ROM) to massively speed up the calculations of these solutions for arbitrary conductivity values.Main results.We demonstrate this new ROM-pEIT framework using a realistic head model with six tissue compartments, with minimal errors in both the approximated numerical solutions and conductivity estimations. We show that the computational complexity required to reach a multi-parameter estimation with a negligible relative error is reduced by more than an order of magnitude when using this framework. Furthermore, we illustrate the benefits of this new framework in a number of practical cases, including its application to real pEIT data from three subjects.Significance.Results suggest that this framework can transform the use of pEIT for seeking personalised head conductivities, making it a valuable tool for researchers and clinicians.

Prior Knowledge-Guided Triple-Domain Transformer-GAN for Direct PET Reconstruction From Low-Count Sinograms

To obtain high-quality positron emission tomography (PET) images while minimizing radiation exposure, numerous methods have been dedicated to acquiring standard-count PET (SPET) from low-count PET (LPET). However, current methods have failed to take full advantage of the different emphasized information from multiple domains, i.e., the sinogram, image, and frequency domains, resulting in the loss of crucial details. Meanwhile, they overlook the unique inner-structure of the sinograms, thereby failing to fully capture its structural characteristics and relationships. To alleviate these problems, in this paper, we proposed a prior knowledge-guided transformer-GAN that unites triple domains of sinogram, image, and frequency to directly reconstruct SPET images from LPET sinograms, namely PK-TriDo. Our PK-TriDo consists of a Sinogram Inner-Structure-based Denoising Transformer (SISD-Former) to denoise the input LPET sinogram, a Frequency-adapted Image Reconstruction Transformer (FaIR-Former) to reconstruct high-quality SPET images from the denoised sinograms guided by the image domain prior knowledge, and an Adversarial Network (AdvNet) to further enhance the reconstruction quality via adversarial training. Specifically tailored for the PET imaging mechanism, we injected a sinogram embedding module that partitions the sinograms by rows and columns to obtain 1D sequences of angles and distances to faithfully preserve the inner-structure of the sinograms. Moreover, to mitigate high-frequency distortions and enhance reconstruction details, we integrated global-local frequency parsers (GLFPs) into FaIR-Former to calibrate the distributions and proportions of different frequency bands, thus compelling the network to preserve high-frequency details. Evaluations on three datasets with different dose levels and imaging scenarios demonstrated that our PK-TriDo outperforms the state-of-the-art methods.

POSE: POSition Encoding for accelerated quantitative MRI

Quantitative MRI utilizes multiple acquisitions with varying sequence parameters to sufficiently characterize a biophysical model of interest, resulting in undesirable scan times. Here we propose, validate and demonstrate a new general strategy for accelerating MRI using subvoxel shifting as a source of encoding called POSition Encoding (POSE). The POSE framework applies unique subvoxel shifts along the acquisition parameter dimension, thereby creating an extra source of encoding. Combining with a biophysical signal model of interest, accelerated and enhanced resolution maps of biophysical parameters are obtained. This has been validated and demonstrated through numerical Bloch equation simulations, phantom experiments and in vivo experiments using the variable flip angle signal model in 3D acquisitions as an application example. Monte Carlo simulations were performed using in vivo data to investigate our method's noise performance. POSE quantification results from numerical Bloch equation simulations of both a numerical phantom and realistic digital brain phantom concur well with the reference method, validating our method both theoretically and for realistic situations. NIST phantom experiment results show excellent overall agreement with the reference method, confirming our method's applicability for a wide range of T1 values. In vivo results not only exhibit good agreement with the reference method, but also show g-factors that significantly outperforms conventional parallel imaging methods with identical acceleration. Furthermore, our results show that POSE can be combined with parallel imaging to further accelerate while maintaining superior noise performance over parallel imaging that uses lower acceleration factors.

Modular GAN: positron emission tomography image reconstruction using two generative adversarial networks

Introduction

The reconstruction of PET images involves converting sinograms, which represent the measured counts of radioactive emissions using detector rings encircling the patient, into meaningful images. However, the quality of PET data acquisition is impacted by physical factors, photon count statistics and detector characteristics, which affect the signal-to-noise ratio, resolution and quantitative accuracy of the resulting images. To address these influences, correction methods have been developed to mitigate each of these issues separately. Recently, generative adversarial networks (GANs) based on machine learning have shown promise in learning the complex mapping between acquired PET data and reconstructed tomographic images. This study aims to investigate the properties of training images that contribute to GAN performance when non-clinical images are used for training. Additionally, we describe a method to correct common PET imaging artefacts without relying on patient-specific anatomical images.

Methods

The modular GAN framework includes two GANs. Module 1, resembling Pix2pix architecture, is trained on non-clinical sinogram-image pairs. Training data are optimised by considering image properties defined by metrics. The second module utilises adaptive instance normalisation and style embedding to enhance the quality of images from Module 1. Additional perceptual and patch-based loss functions are employed in training both modules. The performance of the new framework was compared with that of existing methods, (filtered backprojection (FBP) and ordered subset expectation maximisation (OSEM) without and with point spread function (OSEM-PSF)) with respect to correction for attenuation, patient motion and noise in simulated, NEMA phantom and human imaging data. Evaluation metrics included structural similarity (SSIM), peak-signal-to-noise ratio (PSNR), relative root mean squared error (rRMSE) for simulated data, and contrast-to-noise ratio (CNR) for NEMA phantom and human data.

Results

For simulated test data, the performance of the proposed framework was both qualitatively and quantitatively superior to that of FBP and OSEM. In the presence of noise, Module 1 generated images with a SSIM of 0.48 and higher. These images exhibited coarse structures that were subsequently refined by Module 2, yielding images with an SSIM higher than 0.71 (at least 22% higher than OSEM). The proposed method was robust against noise and motion. For NEMA phantoms, it achieved higher CNR values than OSEM. For human images, the CNR in brain regions was significantly higher than that of FBP and OSEM (p < 0.05, paired t-test). The CNR of images reconstructed with OSEM-PSF was similar to those reconstructed using the proposed method.

Conclusion

The proposed image reconstruction method can produce PET images with artefact correction.

An EEG-based marker of functional connectivity: detection of major depressive disorder

Major depressive disorder (MDD) is a prevalent psychiatric disorder globally. There are many assays for MDD, but rapid and reliable detection remains a pressing challenge. In this study, we present a fusion feature called P-MSWC, as a novel marker to construct brain functional connectivity matrices and utilize the convolutional neural network (CNN) to identify MDD based on electroencephalogram (EEG) signal. Firstly, we combine synchrosqueezed wavelet transform and coherence theory to get synchrosqueezed wavelet coherence. Then, we obtain the fusion feature by incorporating synchrosqueezed wavelet coherence value and phase-locking value, which outperforms conventional functional connectivity markers by comprehensively capturing the original EEG signal's information and demonstrating notable noise-resistance capabilities. Finally, we propose a lightweight CNN model that effectively utilizes the high-dimensional connectivity matrix of the brain, constructed using our novel marker, to enable more accurate and efficient detection of MDD. The proposed method achieves 99.92% accuracy on a single dataset and 97.86% accuracy on a combined dataset. Moreover, comparison experiments have shown that the performance of the proposed method is superior to traditional machine learning methods. Furthermore, visualization experiments reveal differences in the distribution of brain connectivity between MDD patients and healthy subjects, including decreased connectivity in the T7, O1, F8, and C3 channels of the gamma band. The results of the experiments indicate that the fusion feature can be utilized as a new marker for constructing functional brain connectivity, and the combination of deep learning and functional connectivity matrices can provide more help for the detection of MDD.

Brain MR image simulation for deep learning based medical image analysis networks

BACKGROUND AND OBJECTIVE

As large sets of annotated MRI data are needed for training and validating deep learning based medical image analysis algorithms, the lack of sufficient annotated data is a critical problem. A possible solution is the generation of artificial data by means of physics-based simulations. Existing brain simulation data is limited in terms of anatomical models, tissue classes, fixed tissue characteristics, MR sequences and overall realism.

METHODS

We propose a realistic simulation framework by incorporating patient-specific phantoms and Bloch equations-based analytical solutions for fast and accurate MRI simulations. A large number of labels are derived from open-source high-resolution T1w MRI data using a fully automated brain classification tool. The brain labels are taken as ground truth (GT) on which MR images are simulated using our framework. Moreover, we demonstrate that the T1w MR images generated from our framework along with GT annotations can be utilized directly to train a 3D brain segmentation network. To evaluate our model further on larger set of real multi-source MRI data without GT, we compared our model to existing brain segmentation tools, FSL-FAST and SynthSeg.

RESULTS

Our framework generates 3D brain MRI for variable anatomy, sequence, contrast, SNR and resolution. The brain segmentation network for WM/GM/CSF trained only on T1w simulated data shows promising results on real MRI data from MRBrainS18 challenge dataset with a Dice scores of 0.818/0.832/0.828. On OASIS data, our model exhibits a close performance to FSL, both qualitatively and quantitatively with a Dice scores of 0.901/0.939/0.937.

CONCLUSIONS

Our proposed simulation framework is the initial step towards achieving truly physics-based MRI image generation, providing flexibility to generate large sets of variable MRI data for desired anatomy, sequence, contrast, SNR, and resolution. Furthermore, the generated images can effectively train 3D brain segmentation networks, mitigating the reliance on real 3D annotated data.

BrainAGE: Revisited and reframed machine learning workflow

Since the introduction of the BrainAGE method, novel machine learning methods for brain age prediction have continued to emerge. The idea of estimating the chronological age from magnetic resonance images proved to be an interesting field of research due to the relative simplicity of its interpretation and its potential use as a biomarker of brain health. We revised our previous BrainAGE approach, originally utilising relevance vector regression (RVR), and substituted it with Gaussian process regression (GPR), which enables more stable processing of larger datasets, such as the UK Biobank (UKB). In addition, we extended the global BrainAGE approach to regional BrainAGE, providing spatially specific scores for five brain lobes per hemisphere. We tested the performance of the new algorithms under several different conditions and investigated their validity on the ADNI and schizophrenia samples, as well as on a synthetic dataset of neocortical thinning. The results show an improved performance of the reframed global model on the UKB sample with a mean absolute error (MAE) of less than 2 years and a significant difference in BrainAGE between healthy participants and patients with Alzheimer's disease and schizophrenia. Moreover, the workings of the algorithm show meaningful effects for a simulated neocortical atrophy dataset. The regional BrainAGE model performed well on two clinical samples, showing disease-specific patterns for different levels of impairment. The results demonstrate that the new improved algorithms provide reliable and valid brain age estimations.

A three-dimensional Magnetic Resonance Spin Tomography in Time-domain protocol for high-resolution multiparametric quantitative magnetic resonance imaging

Magnetic Resonance Spin TomogrAphy in Time-domain (MR-STAT) is a multiparametric quantitative MR framework, which allows for simultaneously acquiring quantitative tissue parameters such as T1, T2, and proton density from one single short scan. A typical two-dimensional (2D) MR-STAT acquisition uses a gradient-spoiled, gradient-echo sequence with a slowly varying RF flip-angle train and Cartesian readouts, and the quantitative tissue maps are reconstructed by an iterative, model-based optimization algorithm. In this work, we design a three-dimensional (3D) MR-STAT framework based on previous 2D work, in order to achieve better image signal-to-noise ratio, higher though-plane resolution, and better tissue characterization. Specifically, we design a 7-min, high-resolution 3D MR-STAT sequence, and the corresponding two-step reconstruction algorithm for the large-scale dataset. To reduce the long acquisition time, Cartesian undersampling strategies such as SENSE are adopted in our transient-state quantitative framework. To reduce the computational burden, a data-splitting scheme is designed for decoupling the 3D reconstruction problem into independent 2D reconstructions. The proposed 3D framework is validated by numerical simulations, phantom experiments, and in vivo experiments. High-quality knee quantitative maps with 0.8 × 0.8 × 1.5 mm3 resolution and bilateral lower leg maps with 1.6 mm isotropic resolution can be acquired using the proposed 7-min acquisition sequence and the 3-min-per-slice decoupled reconstruction algorithm. The proposed 3D MR-STAT framework could have wide clinical applications in the future.

ParaPET: non-invasive deep learning method for direct parametric brain PET reconstruction using histoimages

BACKGROUND

The indirect method for generating parametric images in positron emission tomography (PET) involves the acquisition and reconstruction of dynamic images and temporal modelling of tissue activity given a measured arterial input function. This approach is not robust, as noise in each dynamic image leads to a degradation in parameter estimation. Direct methods incorporate into the image reconstruction step both the kinetic and noise models, leading to improved parametric images. These methods require extensive computational time and large computing resources. Machine learning methods have demonstrated significant potential in overcoming these challenges. But they are limited by the requirement of a paired training dataset. A further challenge within the existing framework is the use of state-of-the-art arterial input function estimation via temporal arterial blood sampling, which is an invasive procedure, or an additional magnetic resonance imaging (MRI) scan for selecting a region where arterial blood signal can be measured from the PET image. We propose a novel machine learning approach for reconstructing high-quality parametric brain images from histoimages produced from time-of-flight PET data without requiring invasive arterial sampling, an MRI scan, or paired training data from standard field-of-view scanners.

RESULT

The proposed is tested on a simulated phantom and five oncological subjects undergoing an 18F-FDG-PET scan of the brain using Siemens Biograph Vision Quadra. Kinetic parameters set in the brain phantom correlated strongly with the estimated parameters (K1, k2 and k3, Pearson correlation coefficient of 0.91, 0.92 and 0.93) and a mean squared error of less than 0.0004. In addition, our method significantly outperforms (p < 0.05, paired t-test) the conventional nonlinear least squares method in terms of contrast-to-noise ratio. At last, the proposed method was found to be 37% faster than the conventional method.

CONCLUSION

We proposed a direct non-invasive DL-based reconstruction method and produced high-quality parametric maps of the brain. The use of histoimages holds promising potential for enhancing the estimation of parametric images, an area that has not been extensively explored thus far. The proposed method can be applied to subject-specific dynamic PET data alone.

CAT: a computational anatomy toolbox for the analysis of structural MRI data

A large range of sophisticated brain image analysis tools have been developed by the neuroscience community, greatly advancing the field of human brain mapping. Here we introduce the Computational Anatomy Toolbox (CAT)-a powerful suite of tools for brain morphometric analyses with an intuitive graphical user interface but also usable as a shell script. CAT is suitable for beginners, casual users, experts, and developers alike, providing a comprehensive set of analysis options, workflows, and integrated pipelines. The available analysis streams-illustrated on an example dataset-allow for voxel-based, surface-based, and region-based morphometric analyses. Notably, CAT incorporates multiple quality control options and covers the entire analysis workflow, including the preprocessing of cross-sectional and longitudinal data, statistical analysis, and the visualization of results. The overarching aim of this article is to provide a complete description and evaluation of CAT while offering a citable standard for the neuroscience community.

3D multi-modality Transformer-GAN for high-quality PET reconstruction

Positron emission tomography (PET) scans can reveal abnormal metabolic activities of cells and provide favorable information for clinical patient diagnosis. Generally, standard-dose PET (SPET) images contain more diagnostic information than low-dose PET (LPET) images but higher-dose scans can also bring higher potential radiation risks. To reduce the radiation risk while acquiring high-quality PET images, in this paper, we propose a 3D multi-modality edge-aware Transformer-GAN for high-quality SPET reconstruction using the corresponding LPET images and T1 acquisitions from magnetic resonance imaging (T1-MRI). Specifically, to fully excavate the metabolic distributions in LPET and anatomical structural information in T1-MRI, we first use two separate CNN-based encoders to extract local spatial features from the two modalities, respectively, and design a multimodal feature integration module to effectively integrate the two kinds of features given the diverse contributions of features at different locations. Then, as CNNs can describe local spatial information well but have difficulty in modeling long-range dependencies in images, we further apply a Transformer-based encoder to extract global semantic information in the input images and use a CNN decoder to transform the encoded features into SPET images. Finally, a patch-based discriminator is applied to ensure the similarity of patch-wise data distribution between the reconstructed and real images. Considering the importance of edge information in anatomical structures for clinical disease diagnosis, besides voxel-level estimation error and adversarial loss, we also introduce an edge-aware loss to retain more edge detail information in the reconstructed SPET images. Experiments on the phantom dataset and clinical dataset validate that our proposed method can effectively reconstruct high-quality SPET images and outperform current state-of-the-art methods in terms of qualitative and quantitative metrics.

UNesT: Local spatial representation learning with hierarchical transformer for efficient medical segmentation

Transformer-based models, capable of learning better global dependencies, have recently demonstrated exceptional representation learning capabilities in computer vision and medical image analysis. Transformer reformats the image into separate patches and realizes global communication via the self-attention mechanism. However, positional information between patches is hard to preserve in such 1D sequences, and loss of it can lead to sub-optimal performance when dealing with large amounts of heterogeneous tissues of various sizes in 3D medical image segmentation. Additionally, current methods are not robust and efficient for heavy-duty medical segmentation tasks such as predicting a large number of tissue classes or modeling globally inter-connected tissue structures. To address such challenges and inspired by the nested hierarchical structures in vision transformer, we proposed a novel 3D medical image segmentation method (UNesT), employing a simplified and faster-converging transformer encoder design that achieves local communication among spatially adjacent patch sequences by aggregating them hierarchically. We extensively validate our method on multiple challenging datasets, consisting of multiple modalities, anatomies, and a wide range of tissue classes, including 133 structures in the brain, 14 organs in the abdomen, 4 hierarchical components in the kidneys, inter-connected kidney tumors and brain tumors. We show that UNesT consistently achieves state-of-the-art performance and evaluate its generalizability and data efficiency. Particularly, the model achieves whole brain segmentation task complete ROI with 133 tissue classes in a single network, outperforming prior state-of-the-art method SLANT27 ensembled with 27 networks. Our model performance increases the mean DSC score of the publicly available Colin and CANDI dataset from 0.7264 to 0.7444 and from 0.6968 to 0.7025, respectively. Code, pre-trained models, and use case pipeline are available at: https://github.com/MASILab/UNesT.

High resolution 0.5mm isotropic T1-weighted and diffusion tensor templates of the brain of non-demented older adults in a common space for the MIITRA atlas

High quality, high resolution T1-weighted (T1w) and diffusion tensor imaging (DTI) brain templates located in a common space can enhance the sensitivity and precision of template-based neuroimaging studies. However, such multimodal templates have not been constructed for the older adult brain. The purpose of this work which is part of the MIITRA atlas project was twofold: (A) to develop 0.5 mm isotropic resolution T1w and DTI templates that are representative of the brain of non-demented older adults and are located in the same space, using advanced multimodal template construction techniques and principles of super resolution on data from a large, diverse, community cohort of 400 non-demented older adults, and (B) to systematically compare the new templates to other standardized templates. It was demonstrated that the new MIITRA-0.5mm T1w and DTI templates are well-matched in space, exhibit good definition of brain structures, including fine structures, exhibit higher image sharpness than other standardized templates, and are free of artifacts. The MIITRA-0.5mm T1w and DTI templates allowed higher intra-modality inter-subject spatial normalization precision as well as higher inter-modality intra-subject spatial matching of older adult T1w and DTI data compared to other available templates. Consequently, MIITRA-0.5mm templates allowed detection of smaller inter-group differences for older adult data compared to other templates. The MIITRA-0.5mm templates were also shown to be most representative of the brain of non-demented older adults compared to other templates with submillimeter resolution. The new templates constructed in this work constitute two of the final products of the MIITRA atlas project and are anticipated to have important implications for the sensitivity and precision of studies on older adults.

Differential cortical network engagement during states of un/consciousness in humans

What happens in the human brain when we are unconscious? Despite substantial work, we are still unsure which brain regions are involved and how they are impacted when consciousness is disrupted. Using intracranial recordings and direct electrical stimulation, we mapped global, network, and regional involvement during wake vs. arousable unconsciousness (sleep) vs. non-arousable unconsciousness (propofol-induced general anesthesia). Information integration and complex processing we`re reduced, while variability increased in any type of unconscious state. These changes were more pronounced during anesthesia than sleep and involved different cortical engagement. During sleep, changes were mostly uniformly distributed across the brain, whereas during anesthesia, the prefrontal cortex was the most disrupted, suggesting that the lack of arousability during anesthesia results not from just altered overall physiology but from a disconnection between the prefrontal and other brain areas. These findings provide direct evidence for different neural dynamics during loss of consciousness compared with loss of arousability.

Joint radial trajectory correction for accelerated T2 * mapping on an MR-Linac

BACKGROUND

T2 * mapping can characterize tumor hypoxia, which may be associated with resistance to therapy. Acquiring T2 * maps during MR-guided radiotherapy could inform treatment adaptation by, for example, escalating the dose to resistant sub-volumes.

PURPOSE

The purpose of this work is to demonstrate the feasibility of the accelerated T2 * mapping technique using model-based image reconstruction with integrated trajectory auto-correction (TrACR) for MR-guided radiotherapy on an MR-Linear accelerator (MR-Linac).

MATERIALS AND METHODS

The proposed method was validated in a numerical phantom, where two T2 * mapping approaches (sequential and joint) were compared for different noise levels (0,0.1,0.5,1) and gradient delays ([1, -1] and [1, -2] in units of dwell time for x- and y-axis, respectively). Fully sampled k-space was retrospectively undersampled using two different undersampling patterns. Root mean square errors (RMSEs) were calculated between reconstructed T2 * maps and ground truth. In vivo data was acquired twice weekly in one prostate and one head and neck cancer patient undergoing treatment on a 1.5 T MR-Linac. Data were retrospectively undersampled and T2 * maps reconstructed, with and without trajectory corrections were compared.

RESULTS

Numerical simulations demonstrated that, for all noise levels, T2 * maps reconstructed with a joint approach demonstrated less error compared to an uncorrected and sequential approach. For a noise level of 0.1, uniform undersampling and gradient delay [1, -1] (in units of dwell time for x- and y-axis, respectively), RMSEs for sequential and joint approaches were 13.01 and 9.32 ms, respectively, which reduced to 10.92 and 5.89 ms for a gradient delay of [1, 2]. Similarly, for alternate undersampling and gradient delay [1, -1], RMSEs for sequential and joint approaches were 9.80 and 8.90 ms, respectively, which reduced to 9.10 and 5.40 ms for gradient delay [1, 2]. For in vivo data, T2 * maps reconstructed with our proposed approach resulted in less artifacts and improved visual appearance compared to the uncorrected approach. For both prostate and head and neck cancer patients, T2 * maps reconstructed from different treatment fractions showed changes within the planning target volume (PTV).

CONCLUSION

Using the proposed approach, a retrospective data-driven gradient delay correction can be performed, which is particularly relevant for hybrid devices, where full information on the machine configuration is not available for image reconstruction. T2 * maps were acquired in under 5 min and can be integrated into MR-guided radiotherapy treatment workflows, which minimizes patient burden and leaves time for additional imaging for online adaptive radiotherapy on an MR-Linac.

VirtMRI: A Tool for Teaching MRI

Magnetic resonance image formation is not trivial and remains a difficult subject for teaching. Therefore, we saw an urgent need to facilitate teaching by developing a practical and easily accessible MR image generator. Due to the increasing interest in X-nuclei MRI, sodium image generation is also offered. The tool is implemented as a web application that is compatible with all standard desktop browsers and is open source. The user interface focuses on the parameters needed for the creation and display of the resulting images. Available MR sequences range from the standard Spin Echo and Inversion Recovery over steady-state to conventional sodium and more advanced single and triple quantum sequences. Additionally, the user interface has parameters to alter the resolution, the noise, and the k-space sampling. Our software is free to use and specifically suited for teaching purposes.

ROP-GAN: an image synthesis method for retinopathy of prematurity based on generative adversarial network

Objective. Training data with annotations are scarce in the intelligent diagnosis of retinopathy of prematurity (ROP), and existing typical data augmentation methods cannot generate data with a high degree of diversity. In order to increase the sample size and the generalization ability of the classification model, we propose a method called ROP-GAN for image synthesis of ROP based on a generative adversarial network.Approach. To generate a binary vascular network from color fundus images, we first design an image segmentation model based on U2-Net that can extract multi-scale features without reducing the resolution of the feature map. The vascular network is then fed into an adversarial autoencoder for reconstruction, which increases the diversity of the vascular network diagram. Then, we design an ROP image synthesis algorithm based on a generative adversarial network, in which paired color fundus images and binarized vascular networks are input into the image generation model to train the generator and discriminator, and attention mechanism modules are added to the generator to improve its detail synthesis ability.Main results. Qualitative and quantitative evaluation indicators are applied to evaluate the proposed method, and experiments demonstrate that the proposed method is superior to the existing ROP image synthesis methods, as it can synthesize realistic ROP fundus images.Significance. Our method effectively alleviates the problem of data imbalance in ROP intelligent diagnosis, contributes to the implementation of ROP staging tasks, and lays the foundation for further research. In addition to classification tasks, our synthesized images can facilitate tasks that require large amounts of medical data, such as detecting lesions and segmenting medical images.

KomaMRI.jl: An open-source framework for general MRI simulations with GPU acceleration

PURPOSE

To develop an open-source, high-performance, easy-to-use, extensible, cross-platform, and general MRI simulation framework (Koma).

METHODS

Koma was developed using the Julia programming language. Like other MRI simulators, it solves the Bloch equations with CPU and GPU parallelization. The inputs are the scanner parameters, the phantom, and the pulse sequence that is Pulseq-compatible. The raw data is stored in the ISMRMRD format. For the reconstruction, MRIReco.jl is used. A graphical user interface utilizing web technologies was also designed. Two types of experiments were performed: one to compare the quality of the results and the execution speed, and the second to compare its usability. Finally, the use of Koma in quantitative imaging was demonstrated by simulating Magnetic Resonance Fingerprinting (MRF) acquisitions.

RESULTS

Koma was compared to two well-known open-source MRI simulators, JEMRIS and MRiLab. Highly accurate results (with mean absolute differences below 0.1% compared to JEMRIS) and better GPU performance than MRiLab were demonstrated. In an experiment with students, Koma was proved to be easy to use, eight times faster on personal computers than JEMRIS, and 65% of test subjects recommended it. The potential for designing acquisition and reconstruction techniques was also shown through the simulation of MRF acquisitions, with conclusions that agree with the literature.

CONCLUSIONS

Koma's speed and flexibility have the potential to make simulations more accessible for education and research. Koma is expected to be used for designing and testing novel pulse sequences before implementing them in the scanner with Pulseq files, and for creating synthetic data to train machine learning models.

Cartesian vs radial MR-STAT: An efficiency and robustness study

MR Spin TomogrAphy in Time-domain ("MR-STAT") is quantitative MR technique in which multiple quantitative parameters are estimated from a single short scan by solving a large-scale non-linear optimization problem. In this work we extended the MR-STAT framework to non-Cartesian gradient trajectories. Cartesian MR-STAT and radial MR-STAT were compared in terms of time-efficiency and robustness in simulations, gel phantom measurements and in vivo measurements. In simulations, we observed that both Cartesian and radial MR-STAT are highly robust against undersampling. Radial MR-STAT does have a lower spatial encoding power because the outer corners of k-space are never sampled. However, especially in T2, this is compensated by a higher dynamic encoding power that comes from sampling the k-space center with each readout. In gel phantom measurements, Cartesian MR-STAT was observed to be robust against overfitting whereas radial MR-STAT suffered from high-frequency artefacts in the parameter maps at later iterations. These artefacts are hypothesized to be related to hardware imperfections and were (partially) suppressed with image filters. The time-efficiencies were higher for Cartesian MR-STAT in all vials. In-vivo, the radial reconstruction again suffered from overfitting artefacts. The robustness of Cartesian MR-STAT over the entire range of experiments may make it preferable in a clinical setting, despite radial MR-STAT resulting in a higher T1 time-efficiency in white matter.

A calibrated SVM based on weighted smooth GL1/2 for Alzheimer’s disease prediction

Alzheimer's disease (AD) is currently one of the mainstream senile diseases in the world. It is a key problem predicting the early stage of AD. Low accuracy recognition of AD and high redundancy brain lesions are the main obstacles. Traditionally, Group Lasso method can achieve good sparseness. But, redundancy inside group is ignored. This paper proposes an improved smooth classification framework which combines the weighted smooth GL_1/2 (wSGL_1/2) as feature selection method and a calibrated support vector machine (cSVM) as the classifier. wSGL_1/2 can make intra-group and inner-group features sparse, in which the group weights can further improve the efficiency of the model. cSVM can enhance the speed and stability of model by adding calibrated hinge function. Before feature selecting, an anatomical boundary-based clustering, called as ac-SLIC-AAL, is designed to make adjacent similar voxels into one group for accommodating the overall differences of all data. The cSVM model is fast convergence speed, high accuracy and good interpretability on AD classification, AD early diagnosis and MCI transition prediction. In experiments, all steps are tested respectively, including classifiers' comparison, feature selection verification, generalization verification and comparing with state-of-the-art methods. The results are supportive and satisfactory. The superior of the proposed model are verified globally. At the same time, the algorithm can point out the important brain areas in the MRI, which has important reference value for the doctor's predictive work. The source code and data is available at http://github.com/Hu-s-h/c-SVMForMRI.

Evolution of cortical geometry and its link to function, behaviour and ecology

Studies in comparative neuroanatomy and of the fossil record demonstrate the influence of socio-ecological niches on the morphology of the cerebral cortex, but have led to oftentimes conflicting theories about its evolution. Here, we study the relationship between the shape of the cerebral cortex and the topography of its function. We establish a joint geometric representation of the cerebral cortices of ninety species of extant Euarchontoglires, including commonly used experimental model organisms. We show that variability in surface geometry relates to species' ecology and behaviour, independent of overall brain size. Notably, ancestral shape reconstruction of the cortical surface and its change during evolution enables us to trace the evolutionary history of localised cortical expansions, modal segregation of brain function, and their association to behaviour and cognition. We find that individual cortical regions follow different sequences of area increase during evolutionary adaptations to dynamic socio-ecological niches. Anatomical correlates of this sequence of events are still observable in extant species, and relate to their current behaviour and ecology. We decompose the deep evolutionary history of the shape of the human cortical surface into spatially and temporally conscribed components with highly interpretable functional associations, highlighting the importance of considering the evolutionary history of cortical regions when studying their anatomy and function.

Brain-Mimicking Phantom for Photoablation and Visualization

While the use of tissue-mimicking (TM) phantoms has been ubiquitous in surgical robotics, the translation of technology from laboratory experiments to equivalent intraoperative tissue conditions has been a challenge. The increasing use of lasers for surgical tumor resection has introduced the need to develop a modular, low-cost, functionally relevant TM phantom to model the complex laser-tissue interaction. In this paper, a TM phantom with mechanically and thermally similar properties as human brain tissue suited for photoablation studies and subsequent visualization is developed. The proposed study demonstrates the tuned phantom response to laser ablation for fixed laser power, time, and angle. Additionally, the ablated crater profile is visualized using optical coherence tomography (OCT), enabling high-resolution surface profile generation.

BigBrain-MR: a new digital phantom with anatomically-realistic magnetic resonance properties at 100-µm resolution for magnetic resonance methods development

The benefits, opportunities and growing availability of ultra-high field magnetic resonance imaging (MRI) for humans have prompted an expansion in research and development efforts towards increasingly more advanced high-resolution imaging techniques. To maximize their effectiveness, these efforts need to be supported by powerful computational simulation platforms that can adequately reproduce the biophysical characteristics of MRI, with high spatial resolution. In this work, we have sought to address this need by developing a novel digital phantom with realistic anatomical detail up to 100-µm resolution, including multiple MRI properties that affect image generation. This phantom, termed BigBrain-MR, was generated from the publicly available BigBrain histological dataset and lower-resolution in-vivo 7T-MRI data, using a newly-developed image processing framework that allows mapping the general properties of the latter into the fine anatomical scale of the former. Overall, the mapping framework was found to be effective and robust, yielding a diverse range of realistic "in-vivo-like" MRI contrasts and maps at 100-µm resolution. BigBrain-MR was then tested in three imaging applications (motion effects and interpolation, super-resolution imaging, and parallel imaging reconstruction) to investigate its properties, value and validity as a simulation platform. The results consistently showed that BigBrain-MR can closely approximate the behavior of real in-vivo data, more realistically and with more extensive features than a more classic option such as the Shepp-Logan phantom. Its flexibility in simulating different contrast mechanisms and artifacts may also prove valuable for educational applications. BigBrain-MR is therefore deemed a favorable choice to support methodological development and demonstration in brain MRI, and has been made freely available to the community.

Analysis of changes in brain morphological structure of taekwondo athletes by diffusion tensor imaging

OBJECTIVE

Taekwondo, which is the most preferred sport among the martial arts, is known to improve individuals physically, spiritually and mentally. The aim of this study is to reveal the effect of teakwondo sport on the brain and brain structures. DESIGN;: 30 taekwondo athletes and 15 control groups were included in this study. Diffusion tensor MR images of each participant were taken. The information was obtained by the self-declaration of the athletes, whether they were sports years, amateur or elite.

METHOD

Total brain volume and volumes of white matter, gray matter, frontal lobe, precentral gyrus, corticospinal tract, basal nuclei, postcentral gyrus, hippocampus and amigdala and the ratio of these volumes to total brain volume were evaluated statistically between the groups using MriCloud software and ROIEditor program.

RESULTS

An increase in total brain volume, gray matter, frontal lobe and precentral gyrus volume in athletes was associated with taekwondo training. When the ratio of brain parts to total brain volume was examined, it was determined that there was a difference in the ratio of gray matter, white matter volumes in amateur athletes, right frontal lobe, left corticospinal tract, right postcentral gyrus volumes in elite athletes, and left postcentral gyrus volumes of both athletes compared to sedentary individuals.

CONCLUSIONS

The increase in the volume of gray matter, frontal lobe, postcentral gyrus and corticospinal tract together with the brain volume shows that taekwondo exercise contributes to physical, spiritual and mental development.

Acceleration Strategies for MR-STAT: Achieving High-Resolution Reconstructions on a Desktop PC Within 3 Minutes

MR-STAT is an emerging quantitative magnetic resonance imaging technique which aims at obtaining multi-parametric tissue parameter maps from single short scans. It describes the relationship between the spatial-domain tissue parameters and the time-domain measured signal by using a comprehensive, volumetric forward model. The MR-STAT reconstruction solves a large-scale nonlinear problem, thus is very computationally challenging. In previous work, MR-STAT reconstruction using Cartesian readout data was accelerated by approximating the Hessian matrix with sparse, banded blocks, and can be done on high performance CPU clusters with tens of minutes. In the current work, we propose an accelerated Cartesian MR-STAT algorithm incorporating two different strategies: firstly, a neural network is trained as a fast surrogate to learn the magnetization signal not only in the full time-domain but also in the compressed low-rank domain; secondly, based on the surrogate model, the Cartesian MR-STAT problem is re-formulated and split into smaller sub-problems by the alternating direction method of multipliers. The proposed method substantially reduces the computational requirements for runtime and memory. Simulated and in-vivo balanced MR-STAT experiments show similar reconstruction results using the proposed algorithm compared to the previous sparse Hessian method, and the reconstruction times are at least 40 times shorter. Incorporating sensitivity encoding and regularization terms is straightforward, and allows for better image quality with a negligible increase in reconstruction time. The proposed algorithm could reconstruct both balanced and gradient-spoiled in-vivo data within 3 minutes on a desktop PC, and could thereby facilitate the translation of MR-STAT in clinical settings.

Accuracy and repeatability of joint sparsity multi-component estimation in MR Fingerprinting

MR fingerprinting (MRF) is a promising method for quantitative characterization of tissues. Often, voxel-wise measurements are made, assuming a single tissue-type per voxel. Alternatively, the Sparsity Promoting Iterative Joint Non-negative least squares Multi-Component MRF method (SPIJN-MRF) facilitates tissue parameter estimation for identified components as well as partial volume segmentations. The aim of this paper was to evaluate the accuracy and repeatability of the SPIJN-MRF parameter estimations and partial volume segmentations. This was done (1) through numerical simulations based on the BrainWeb phantoms and (2) using in vivo acquired MRF data from 5 subjects that were scanned on the same week-day for 8 consecutive weeks. The partial volume segmentations of the SPIJN-MRF method were compared to those obtained by two conventional methods: SPM12 and FSL. SPIJN-MRF showed higher accuracy in simulations in comparison to FSL- and SPM12-based segmentations: Fuzzy Tanimoto Coefficients (FTC) comparing these segmentations and Brainweb references were higher than 0.95 for SPIJN-MRF in all the tissues and between 0.6 and 0.7 for SPM12 and FSL in white and gray matter and between 0.5 and 0.6 in CSF. For the in vivo MRF data, the estimated relaxation times were in line with literature and minimal variation was observed. Furthermore, the coefficient of variation (CoV) for estimated tissue volumes with SPIJN-MRF were 10.5% for the myelin water, 6.0% for the white matter, 5.6% for the gray matter, 4.6% for the CSF and 1.1% for the total brain volume. CoVs for CSF and total brain volume measured on the scanned data for SPIJN-MRF were in line with those obtained with SPM12 and FSL. The CoVs for white and gray matter volumes were distinctively higher for SPIJN-MRF than those measured with SPM12 and FSL. In conclusion, the use of SPIJN-MRF provides accurate and precise tissue relaxation parameter estimations taking into account intrinsic partial volume effects. It facilitates obtaining tissue fraction maps of prevalent tissues including myelin water which can be relevant for evaluating diseases affecting the white matter.

An Anthropomorphic Digital Reference Object (DRO) for Simulation and Analysis of Breast DCE MRI Techniques

Advances in accelerated magnetic resonance imaging (MRI) continue to push the bounds on achievable spatial and temporal resolution while maintaining a clinically acceptable image quality. Validation tools, including numerical simulations, are needed to characterize the repeatability and reproducibility of such methods for use in quantitative imaging applications. We describe the development of a simulation framework for analyzing and optimizing accelerated MRI acquisition and reconstruction techniques used in dynamic contrast enhanced (DCE) breast imaging. The simulation framework, in the form of a digital reference object (DRO), consists of four modules that control different aspects of the simulation, including the appearance and physiological behavior of the breast tissue as well as the MRI acquisition settings, to produce simulated k-space data for a DCE breast exam. The DRO design and functionality are described along with simulation examples provided to show potential applications of the DRO. The included simulation results demonstrate the ability of the DRO to simulate a variety of effects including the creation of simulated lesions, tissue enhancement modeled by the generalized kinetic model, T1-relaxation, fat signal precession and saturation, acquisition SNR, and changes in temporal resolution.

Development and evaluation of a high resolution 0.5mm isotropic T1-weighted template of the older adult brain

Investigating the structure of the older adult brain at high spatial resolution is of high significance, and a dedicated older adult structural brain template with sub-millimeter resolution is currently lacking. Therefore, the purpose of this work was twofold: (A) to develop a 0.5mm isotropic resolution standardized T1-weighted template of the older adult brain by applying principles of super resolution to high quality MRI data from 222 older adults (65-95 years of age), and (B) to systematically compare the new template to other standardized and study-specific templates in terms of image quality and performance when used as a reference for alignment of older adult data. The new template exhibited higher spatial resolution and improved visualization of fine structural details of the older adult brain compared to a template constructed using a conventional template building approach and the same data. In addition, the new template exhibited higher image sharpness and did not contain image artifacts observed in some of the other templates considered in this work. Due to the above enhancements, the new template provided higher inter-subject spatial normalization precision for older adult data compared to the other templates, and consequently enabled detection of smaller inter-group morphometric differences in older adult data. Finally, the new template was among those that were most representative of older adult brain data. Overall, the new template constructed here is an important resource for studies of aging, and the findings of the present work have important implications in template selection for investigations on older adults.

Local and distant cortical responses to single pulse intracranial stimulation in the human brain are differentially modulated by specific stimulation parameters

BACKGROUND

Electrical neuromodulation via direct electrical stimulation (DES) is an increasingly common therapy for a wide variety of neuropsychiatric diseases. Unfortunately, therapeutic efficacy is inconsistent, likely due to our limited understanding of the relationship between the massive stimulation parameter space and brain tissue responses.

OBJECTIVE

To better understand how different parameters induce varied neural responses, we systematically examined single pulse-induced cortico-cortico evoked potentials (CCEP) as a function of stimulation amplitude, duration, brain region, and whether grey or white matter was stimulated.

METHODS

We measured voltage peak amplitudes and area under the curve (AUC) of intracranially recorded stimulation responses as a function of distance from the stimulation site, pulse width, current injected, location relative to grey and white matter, and brain region stimulated (N = 52, n = 719 stimulation sites).

RESULTS

Increasing stimulation pulse width increased responses near the stimulation location. Increasing stimulation amplitude (current) increased both evoked amplitudes and AUC nonlinearly. Locally (<15 mm), stimulation at the boundary between grey and white matter induced larger responses. In contrast, for distant sites (>15 mm), white matter stimulation consistently produced larger responses than stimulation in or near grey matter. The stimulation location-response curves followed different trends for cingulate, lateral frontal, and lateral temporal cortical stimulation.

CONCLUSION

These results demonstrate that a stronger local response may require stimulation in the grey-white boundary while stimulation in the white matter could be needed for network activation. Thus, stimulation parameters tailored for a specific anatomical-functional outcome may be key to advancing neuromodulatory therapy.

Unsupervised arterial spin labeling image super-resolution via multi-scale generative adversarial network

PURPOSE

Arterial spin labeling (ASL) magnetic resonance imaging (MRI) is an advanced non-invasive imaging technology that can measure cerebral blood flow (CBF) quantitatively without a contrast agent injection or radiation exposure. However, because of the weak labeling, conventional ASL images usually suffer from low signal-to-noise ratio (SNR), poor spatial resolution, and long acquisition time. Therefore, a method that can simultaneously improve the spatial resolution and SNR is needed.

METHODS

In this work, we proposed an unsupervised super-resolution (SR) method to improve ASL image resolution based on a pyramid of generative adversarial networks (GAN). Through layer-by-layer training, the generators can learn features from the coarsest to the finest. The last layer's generator which contains fine details and textures was used to generate the final SR ASL images. In our proposed framework, the corresponding T1-weighted MR image was supplied as a second-channel input of the generators to provide high-resolution prior information. In addition, a low-pass-filter loss term was included to suppress the noise of the original ASL images. To evaluate the performance of the proposed framework, a simulation study and two real-patient experiments based on the in vivo datasets obtained from 3 healthy subjects on a 3T MR scanner were conducted, regarding the low-resolution (LR) to normal-resolution (NR) and the NR-to-SR tasks. The proposed method was compared to the nearest neighbor interpolation, trilinear interpolation, 3rd order B-splines interpolation methods, and deep image prior (DIP) with the peak signal-to-noise ratio (PSNR) and structural similarity index (SSIM) as the quantification metrics. The averaged ASL images acquired with 44 min acquisition time were used as the ground truth for real-patient LR-to-NR study. The ablation studies of low-pass-filter loss term and T1-weighted MR image were performed based on simulation data.

RESULTS

For the simulation study, results show that the proposed method achieved significantly higher PSNR (p-value < 0.05) and SSIM (p-value < 0.05) than the nearest neighbor interpolation, trilinear interpolation, 3rd order B-splines interpolation, and DIP methods. For the real-patient LR-to-NR experiment, results show that the proposed method can generate high-quality SR ASL images with clearer structure boundaries and low noise levels, and has the highest mean PSNR and SSIM. For real-patient NR-to-SR tasks, the structure of the results using the proposed method is sharper and clearer, which are the most similar to the structure of the reference 44 min acquisition image than other methods. The proposed method also shows the ability to remove artifacts in the NR image while super-resolution. The ablation study verified that the low-pass-filter loss term and T1-weighted MR image are necessary for the proposed method.

CONCLUSIONS

The proposed unsupervised multi-scale GAN framework can simultaneously improve spatial resolution and reduce image noise. Experiment results from simulation data and 3 healthy subjects show that the proposed method achieves better performance than the nearest neighbor interpolation, the trilinear interpolation, the 3rd order B-splines interpolation, and DIP methods. This article is protected by copyright. All rights reserved.

Adaptive rectification based adversarial network with spectrum constraint for high-quality PET image synthesis

Positron emission tomography (PET) is a typical nuclear imaging technique, which can provide crucial functional information for early brain disease diagnosis. Generally, clinically acceptable PET images are obtained by injecting a standard-dose radioactive tracer into human body, while on the other hand the cumulative radiation exposure inevitably raises concerns about potential health risks. However, reducing the tracer dose will increase the noise and artifacts of the reconstructed PET image. For the purpose of acquiring high-quality PET images while reducing radiation exposure, in this paper, we innovatively present an adaptive rectification based generative adversarial network with spectrum constraint, named AR-GAN, which uses low-dose PET (LPET) image to synthesize standard-dose PET (SPET) image of high-quality. Specifically, considering the existing differences between the synthesized SPET image by traditional GAN and the real SPET image, an adaptive rectification network (AR-Net) is devised to estimate the residual between the preliminarily predicted image and the real SPET image, based on the hypothesis that a more realistic rectified image can be obtained by incorporating both the residual and the preliminarily predicted PET image. Moreover, to address the issue of high-frequency distortions in the output image, we employ a spectral regularization term in the training optimization objective to constrain the consistency of the synthesized image and the real image in the frequency domain, which further preserves the high-frequency detailed information and improves synthesis performance. Validations on both the phantom dataset and the clinical dataset show that the proposed AR-GAN can estimate SPET images from LPET images effectively and outperform other state-of-the-art image synthesis approaches.

Impact of skull sutures, spongiform bone distribution, and aging skull conductivities on the EEG forward and inverse problems

Source imaging is a principal objective for electroencephalography (EEG), the solutions of which require forward problem (FP) computations characterising the electric potential distribution on the scalp due to known sources. Additionally, the EEG-FP is dependent upon realistic, anatomically correct volume conductors and accurate tissue conductivities, where the skull is particularly important. Skull conductivity, however, deviates according to bone composition and the presence of adult sutures. The presented study therefore analyses the effect the presence of adult sutures and differing bone composition have on the EEG-FP and inverse problem (IP) solutions. Utilising a well-established head atlas, detailed head models were generated including compact and spongiform bone and adult sutures. The true skull conductivity was considered as inhomogeneous according to spongiform bone proportion and sutures. The EEG-FP and EEG-IP were solved and compared to results employing homogeneous skull models, with varying conductivities and omitting sutures, as well as using a hypothesised aging skull conductivity model. Significant localised FP errors, with relative error up to 85%, were revealed, particularly evident along suture lines and directly related to the proportion of spongiform bone. This remained evident at various ages. Similar EEG-IP inaccuracies were found, with the largest (maximum 4.14 cm) across suture lines. It is concluded that modelling the skull as an inhomogeneous layer that varies according to spongiform bone proportion and includes differing suture conductivity is imperative for accurate EEG-FP and source localisation calculations. Their omission can result in significant errors, relevant for EEG research and clinical diagnosis.

Automated design of pulse sequences for magnetic resonance fingerprinting using physics-inspired optimization

Magnetic resonance fingerprinting (MRF) is a method to extract quantitative tissue properties such as [Formula: see text] and [Formula: see text] relaxation rates from arbitrary pulse sequences using conventional MRI hardware. MRF pulse sequences have thousands of tunable parameters, which can be chosen to maximize precision and minimize scan time. Here, we perform de novo automated design of MRF pulse sequences by applying physics-inspired optimization heuristics. Our experimental data suggest that systematic errors dominate over random errors in MRF scans under clinically relevant conditions of high undersampling. Thus, in contrast to prior optimization efforts, which focused on statistical error models, we use a cost function based on explicit first-principles simulation of systematic errors arising from Fourier undersampling and phase variation. The resulting pulse sequences display features qualitatively different from previously used MRF pulse sequences and achieve fourfold shorter scan time than prior human-designed sequences of equivalent precision in [Formula: see text] and [Formula: see text] Furthermore, the optimization algorithm has discovered the existence of MRF pulse sequences with intrinsic robustness against shading artifacts due to phase variation.

An in silico validation framework for quantitative DCE-MRI techniques based on a dynamic digital phantom

Quantitative evaluation of an image processing method to perform as designed is central to both its utility and its ability to guide the data acquisition process. Unfortunately, these tasks can be quite challenging due to the difficulty of experimentally obtaining the "ground truth" data to which the output of a given processing method must be compared. One way to address this issue is via "digital phantoms", which are numerical models that provide known biophysical properties of a particular object of interest.  In this contribution, we propose an in silico validation framework for dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) acquisition and analysis methods that employs a novel dynamic digital phantom. The phantom provides a spatiotemporally-resolved representation of blood-interstitial flow and contrast agent delivery, where the former is solved by a 1D-3D coupled computational fluid dynamic system, and the latter described by an advection-diffusion equation. Furthermore, we establish a virtual simulator which takes as input the digital phantom, and produces realistic DCE-MRI data with controllable acquisition parameters. We assess the performance of a simulated standard-of-care acquisition (Protocol A) by its ability to generate contrast-enhanced MR images that separate vasculature from surrounding tissue, as measured by the contrast-to-noise ratio (CNR). We find that the CNR significantly decreases as the spatial resolution (SRA, where the subscript indicates Protocol A) or signal-to-noise ratio (SNRA) decreases. Specifically, with an SNRA / SRA = 75 dB / 30 μm, the median CNR is 77.30, whereas an SNRA / SRA = 5 dB / 300 μm reduces the CNR to 6.40. Additionally, we assess the performance of simulated ultra-fast acquisition (Protocol B) by its ability to generate DCE-MR images that capture contrast agent pharmacokinetics, as measured by error in the signal-enhancement ratio (SER) compared to ground truth (PESER). We find that PESER significantly decreases the as temporal resolution (TRB) increases. Similar results are reported for the effects of spatial resolution and signal-to-noise ratio on PESER. For example, with an SNRB / SRB / TRB = 5 dB / 300 μm / 10 s, the median PESER is 21.00%, whereas an SNRB / SRB / TRB = 75 dB / 60 μm / 1 s, yields a median PESER of 0.90%. These results indicate that our in silico framework can generate virtual MR images that capture effects of acquisition parameters on the ability of generated images to capture morphological or pharmacokinetic features. This validation framework is not only useful for investigations of perfusion-based MRI techniques, but also for the systematic evaluation and optimization new MRI acquisition, reconstruction, and image processing techniques.

Automated Data Quality Control in FDOPA brain PET Imaging using Deep Learning

INTRODUCTION

With biomedical imaging research increasingly using large datasets, it becomes critical to find operator-free methods to quality control the data collected and the associated analysis. Attempts to use artificial intelligence (AI) to perform automated quality control (QC) for both single-site and multi-site datasets have been explored in some neuroimaging techniques (e.g. EEG or MRI), although these methods struggle to find replication in other domains. The aim of this study is to test the feasibility of an automated QC pipeline for brain [¹⁸F]-FDOPA PET imaging as a biomarker for the dopamine system.

METHODS

Two different Convolutional Neural Networks (CNNs) were used and combined to assess spatial misalignment to a standard template and the signal-to-noise ratio (SNR) relative to 200 static [¹⁸F]-FDOPA PET images that had been manually quality controlled from three different PET/CT scanners. The scans were combined with an additional 400 scans, in which misalignment (200 scans) and low SNR (200 scans) were simulated. A cross-validation was performed, where 80% of the data were used for training and 20% for validation. Two additional datasets of [¹⁸F]-FDOPA PET images (50 and 100 scans respectively with at least 80% of good quality images) were used for out-of-sample validation.

RESULTS

The CNN performance was excellent in the training dataset (accuracy for motion: 0.86 ± 0.01, accuracy for SNR: 0.69 ± 0.01), leading to 100% accurate QC classification when applied to the two out-of-sample datasets. Data dimensionality reduction affected the generalizability of the CNNs, especially when the classifiers were applied to the out-of-sample data from 3D to 1D datasets.

CONCLUSIONS

This feasibility study shows that it is possible to perform automatic QC of [¹⁸F]-FDOPA PET imaging with CNNs. The approach has the potential to be extended to other PET tracers in both brain and non-brain applications, but it is dependent on the availability of large datasets necessary for the algorithm training.

HybraPD atlas: Towards precise subcortical nuclei segmentation using multimodality medical images in patients with Parkinson disease

Human brain atlases are essential for research and surgical treatment of Parkinson's disease (PD). For example, deep brain stimulation for PD often requires human brain atlases for brain structure identification. However, few atlases can provide disease-specific subcortical structures for PD, and most of them are based on T1w and T2w images. In this work, we construct a HybraPD atlas using fused quantitative susceptibility mapping (QSM) and T1w images from 87 patients with PD. The constructed HybraPD atlas provides a series of templates, that is, T1w, GRE magnitude, QSM, R2*, and brain tissue probabilistic maps. Then, we manually delineate a parcellation map with 12 bilateral subcortical nuclei, which are highly related to PD pathology, such as sub-regions in globus pallidus and substantia nigra. Furthermore, we build a whole-brain parcellation map by combining existing cortical parcellation and white-matter segmentation with the proposed subcortical nuclei map. Considering the multimodality of the HybraPD atlas, the segmentation accuracy of each nucleus is evaluated using T1w and QSM templates, respectively. The results show that the HybraPD atlas provides more accurate segmentation than existing atlases. Moreover, we analyze the metabolic difference in subcortical nuclei between PD patients and healthy control subjects by applying the HybraPD atlas to calculate uptake values of contrast agents on positron emission tomography (PET) images. The atlas-based analysis generates accurate disease-related brain nuclei segmentation on PET images. The newly developed HybraPD atlas could serve as an efficient template to study brain pathological alterations in subcortical regions for PD research.

A dynamic susceptibility contrast MRI digital reference object for testing software with leakage correction: Effect of background simulation

PURPOSE

Dynamic susceptibility contrast (DSC)-MRI is a perfusion imaging technique from which useful quantitative imaging biomarkers can be derived. Relative cerebral blood volume (rCBV) is such a biomarker commonly used for evaluating brain tumors. To account for the extravasation of contrast agents in tumors, post-processing leakage correction is often applied to improve rCBV accuracy. Digital reference objects (DRO) are ideal for testing the post-processing software, because the biophysical model used to generate the DRO can be matched to the one that the software uses. This study aims to develop DROs to validate the leakage correction of software using Weisskoff model and to examine the effect of background signal time curves that are required by the model.

METHODS

Three DROs were generated using the Weisskoff model, each composed of nine foreground lesion objects with combinations of different levels of rCBV and contrast leakage parameter (K2). Three types of background were implemented for these DROs: (1) a multi-compartment brain-like background, (2) a sphere background with a constant signal time curve, and (3) a sphere background with signal time curve identical to that of the brain-like DRO's white matter (WM). The DROs were then analyzed with an FDA-cleared software with and without leakage correction. Leakage correction was tested with and without brain segmentation.

RESULTS

Accuracy of leakage correction was able to be verified using the brain-like phantom and the sphere phantom with WM background. The sphere with constant background did not perform well with leakage correction with or without brain segmentation. The DROs were able to verify that for the particular software tested, leakage correction with brain segmentation achieved the lowest error.

CONCLUSIONS

DSC-MRI DROs with biophysical model matched to that of the post-processing software can be well used for the software's validation, provided that the background signals are also properly simulated for generating the reference time curve required by the model. Care needs to be taken to consider the interaction of the design of the DRO with the software's implementation of brain segmentation to extract the reference time curve.

Technical note: A preliminary study of dual-tracer PET image reconstruction guided by FDG and/or MR kernels

PURPOSE

Clinically, single radiotracer positron emission tomography (PET) imaging is a commonly used examination method; however, since each radioactive tracer reflects the information of only one kind of cell, it easily causes false negatives or false positives in disease diagnosis. Therefore, reasonably combining two or more radiotracers is recommended to improve the accuracy of diagnosis and the sensitivity and specificity of the disease when conditions permit.

METHODS

This paper proposes incorporating ¹⁸ F-fluorodeoxyglucose (FDG) as a higher-quality PET image to guide the reconstruction of other lower-count ¹¹ C-methionine (MET) PET datasets to compensate for the lower image quality by a popular kernel algorithm. Specifically, the FDG prior is needed to extract kernel features, and these features were used to build a kernel matrix using a k-nearest-neighbor (kNN) search for MET image reconstruction. We created a 2-D brain phantom to validate the proposed method by simulating sinogram data containing Poisson random noise and quantitatively compared the performance of the proposed FDG-guided kernelized expectation maximization (KEM) method with the performance of Gaussian and non-local means (NLM) smoothed maximum likelihood expectation maximization (MLEM), MR-guided KEM, and multi-guided-S KEM algorithms. Mismatch experiments between FDG/MR and MET data were also carried out to investigate the outcomes of possible clinical situations.

RESULTS

In the simulation study, the proposed method outperformed the other algorithms by at least 3.11% in the signal-to-noise ratio (SNR) and 0.68% in the contrast recovery coefficient (CRC), and it reduced the mean absolute error (MAE) by 8.07%. Regarding the tumor in the reconstructed image, the proposed method contained more pathological information. Furthermore, the proposed method was still superior to the MR-guided KEM method in the mismatch experiments.

CONCLUSIONS

The proposed FDG-guided KEM algorithm can effectively utilize and compensate for the tissue metabolism information obtained from dual-tracer PET to maximize the advantages of PET imaging.

Optimal design of on-scalp electromagnetic sensor arrays for brain source localisation

Optically pumped magnetometers (OPMs) are quickly widening the scopes of noninvasive neurophysiological imaging. The possibility of placing these magnetic field sensors on the scalp allows not only to acquire signals from people in movement, but also to reduce the distance between the sensors and the brain, with a consequent gain in the signal‐to‐noise ratio. These advantages make the technique particularly attractive to characterise sources of brain activity in demanding populations, such as children and patients with epilepsy. However, the technology is currently in an early stage, presenting new design challenges around the optimal sensor arrangement and their complementarity with other techniques as electroencephalography (EEG). In this article, we present an optimal array design strategy focussed on minimising the brain source localisation error. The methodology is based on the Cramér‐Rao bound, which provides lower error bounds on the estimation of source parameters regardless of the algorithm used. We utilise this framework to compare whole head OPM arrays with commercially available electro/magnetoencephalography (E/MEG) systems for localising brain signal generators. In addition, we study the complementarity between EEG and OPM‐based MEG, and design optimal whole head systems based on OPMs only and a combination of OPMs and EEG electrodes for characterising deep and superficial sources alike. Finally, we show the usefulness of the approach to find the nearly optimal sensor positions minimising the estimation error bound in a given cortical region when a limited number of OPMs are available. This is of special interest for maximising the performance of small scale systems to ad hoc neurophysiological experiments, a common situation arising in most OPM labs.

Fast and accurate modeling of transient-state, gradient-spoiled sequences by recurrent neural networks

Fast and accurate modeling of MR signal responses are typically required for various quantitative MRI applications, such as MR fingerprinting. This work uses a new extended phase graph (EPG)-Bloch model for accurate simulation of transient-state, gradient-spoiled MR sequences, and proposes a recurrent neural network (RNN) as a fast surrogate of the EPG-Bloch model for computing large-scale MR signals and derivatives. The computational efficiency of the RNN model is demonstrated by comparisons with other existing models, showing one to three orders of acceleration compared with the latest GPU-accelerated, open-source EPG package. By using numerical and in vivo brain data, two used cases, namely, MRF dictionary generation and optimal experimental design, are also provided. Results show that the RNN surrogate model can be efficiently used for computing large-scale dictionaries of transient-state signals and derivatives within tens of seconds, resulting in several orders of magnitude acceleration with respect to state-of-the-art implementations. The practical application of transient-state quantitative techniques can therefore be substantially facilitated.

Myelo- and cytoarchitectonic microstructural and functional human cortical atlases reconstructed in common MRI space

The parcellation of the brain's cortical surface into anatomically and/or functionally distinct areas is a topic of ongoing investigation and interest. We provide digital versions of six classical human brain atlases in common MRI space. The cortical atlases represent a range of modalities, including cyto- and myeloarchitecture (Campbell, Smith, Brodmann and Von Economo), myelogenesis (Flechsig), and mappings of symptomatic information in relation to the spatial location of brain lesions (Kleist). Digital reconstructions of these important cortical atlases widen the range of modalities for which cortex-wide imaging atlases are currently available and offer the opportunity to compare and combine microstructural and lesion-based functional atlases with in-vivo imaging-based atlases.

SUPFUNSIM: Spatial Filtering Toolbox for EEG

Brain activity pattern recognition from EEG or MEG signal analysis is one of the most important method in cognitive neuroscience. The supFunSim library is a new Matlab toolbox which generates accurate EEG forward model and implements a collection of spatial filters for EEG source reconstruction, including the linearly constrained minimum-variance (LCMV), eigenspace LCMV, nulling (NL), and minimum-variance pseudo-unbiased reduced-rank (MV-PURE) filters in various versions. It also enables source-level directed connectivity analysis using partial directed coherence (PDC) measure. The supFunSim library is based on the well-known FieldTrip toolbox for EEG and MEG analysis and is written using object-oriented programming paradigm. The resulting modularity of the toolbox enables its simple extensibility. This paper gives a complete overview of the toolbox from both developer and end-user perspectives, including description of the installation process and use cases.

Biomimetic phantom with anatomical accuracy for evaluating brain volumetric measurements with magnetic resonance imaging

Purpose: Brain image volumetric measurements (BVM) methods have been used to quantify brain tissue volumes using magnetic resonance imaging (MRI) when investigating abnormalities. Although BVM methods are widely used, they need to be evaluated to quantify their reliability. Currently, the gold-standard reference to evaluate a BVM is usually manual labeling measurement. Manual volume labeling is a time-consuming and expensive task, but the confidence level ascribed to this method is not absolute. We describe and evaluate a biomimetic brain phantom as an alternative for the manual validation of BVM. Methods: We printed a three-dimensional (3D) brain mold using an MRI of a three-year-old boy diagnosed with Sturge-Weber syndrome. Then we prepared three different mixtures of styrene-ethylene/butylene-styrene gel and paraffin to mimic white matter (WM), gray matter (GM), and cerebrospinal fluid (CSF). The mold was filled by these three mixtures with known volumes. We scanned the brain phantom using two MRI scanners, 1.5 and 3.0 Tesla. Our suggestion is a new challenging model to evaluate the BVM which includes the measured volumes of the phantom compartments and its MRI. We investigated the performance of an automatic BVM, i.e., the expectation-maximization (EM) method, to estimate its accuracy in BVM. Results: The automatic BVM results using the EM method showed a relative error (regarding the phantom volume) of 0.08, 0.03, and 0.13 ( ± 0.03 uncertainty) percentages of the GM, CSF, and WM volume, respectively, which was in good agreement with the results reported using manual segmentation. Conclusions: The phantom can be a potential quantifier for a wide range of segmentation methods.

Registration quality filtering improves robustness of voxel-wise analyses to the choice of brain template

Motivation:

Many clinical and scientific conclusions that rely on voxel-wise analyses of neuroimaging depend on the accurate comparison of corresponding anatomical regions. Such comparisons are made possible by registration of the images of subjects of interest onto a common brain template, such as the Johns Hopkins University (JHU) template. However, current image registration algorithms are prone to errors that are distributed in a template-dependent manner. Therefore, the results of voxel-wise analyses can be sensitive to template choice. Despite this problem, the issue of appropriate template choice for voxel-wise analyses is not generally addressed in contemporary neuroimaging studies, which may lead to the reporting of spurious results.

Results:

We present a novel approach to determine the suitability of a brain template for voxel-wise analysis. The approach is based on computing a “distance” between automatically-generated atlases of the subjects of interest and templates that is indicative of the extent of subject-to-template registration errors. This allows for the filtering of subjects and candidate templates based on a quantitative measure of registration quality. We benchmark our approach by evaluating alternative templates for a voxel-wise analysis that reproduces the well-known decline in fractional anisotropy (FA) with age. Our results show that filtering registrations minimizes errors and decreases the sensitivity of voxel-wise analysis to template choice. In addition to carrying important implications for future neuroimaging studies, the developed framework of template induction can be used to evaluate robustness of data analysis methods to template choice.

Accelerated MR-STAT Reconstructions Using Sparse Hessian Approximations

MR-STAT is a quantitative magnetic resonance imaging framework for obtaining multi-parametric quantitative tissue parameter maps using data from single short scans. A large-scale optimization problem is solved in which spatial localization of signal and estimation of tissue parameters are performed simultaneously by directly fitting a Bloch-based volumetric signal model to measured time-domain data. In previous work, a highly parallelized, matrix-free Gauss-Newton reconstruction algorithm was presented that can solve the large-scale optimization problem for high-resolution scans. The main computational bottleneck in this matrix-free method is solving a linear system involving (an approximation to) the Hessian matrix at each iteration. In the current work, we analyze the structure of the Hessian matrix in relation to the dynamics of the spin system and derive conditions under which the (approximate) Hessian admits a sparse structure. In the case of Cartesian sampling patterns with smooth RF trains we demonstrate how exploiting this sparsity can reduce MR-STAT reconstruction times by approximately an order of magnitude.

BISON: Brain tissue segmentation pipeline using T1 -weighted magnetic resonance images and a random forest classifier

PURPOSE

Tissue segmentation from T₁ -weighted (T1W) MRI is a critical requirement in many neuroscience and clinical applications. However, accurate tissue segmentation is challenging because of the variabilities in tissue intensity profiles caused by differences in scanner models, acquisition protocols, and age. In addition, many methods assume healthy anatomy and fail in the presence of pathology such as white matter hyperintensities (WMHs). We present BISON (Brain tISsue segmentatiON), a new pipeline for tissue segmentation using a random forest classifier and a set of intensity and location priors based on T1W MRI.

METHODS

BISON was developed and cross-validated using multiscanner manual labels of 72 subjects aged 5 to 96 years. We also assessed the test-retest reliability of BISON on two data sets: 20 subjects with scan/rescan MR images and manual segmentations and 90 scans from a single individual. The results were compared against Atropos, a state-of-the-art commonly used tissue classification method from advanced normalization tools (ANTs).

RESULTS

BISON cross-validation dice kappa values against manual segmentations of 72 MRI volumes yielded κ_GM = 0.88, κ_WM = 0.85, κ_CSF = 0.77, outperforming Atropos (κ_GM = 0.79, κ_WM = 0.84, κ_CSF = 0.64), test-retest values on 20 subjects of κ_GM = 0.94, κ_WM = 0.92, κ_CSF = 0.77 outperforming both manual (κ_GM = 0.92, κ_WM = 0.91, κ_CSF =0.74) and Atropos (κ_GM = 0.87, κ_WM = 0.92, κ_CSF = 0.79). Finally, BISON outperformed Atropos, FAST (fast automated segmentation tool) from the FMRIB (Functional Magnetic Resonance Imaging of the Brain) Software Library, and SPM12 (statistical parametric mapping 12) in the presence of WMHs.

CONCLUSION

BISON can provide accurate and robust segmentations in data from various age ranges and scanner models, making it ideal for performing tissue classification in large multicenter and multiscanner databases.

The data representativeness criterion: Predicting the performance of supervised classification based on data set similarity

In a broad range of fields it may be desirable to reuse a supervised classification algorithm and apply it to a new data set. However, generalization of such an algorithm and thus achieving a similar classification performance is only possible when the training data used to build the algorithm is similar to new unseen data one wishes to apply it to. It is often unknown in advance how an algorithm will perform on new unseen data, being a crucial reason for not deploying an algorithm at all. Therefore, tools are needed to measure the similarity of data sets. In this paper, we propose the Data Representativeness Criterion (DRC) to determine how representative a training data set is of a new unseen data set. We present a proof of principle, to see whether the DRC can quantify the similarity of data sets and whether the DRC relates to the performance of a supervised classification algorithm. We compared a number of magnetic resonance imaging (MRI) data sets, ranging from subtle to severe difference is acquisition parameters. Results indicate that, based on the similarity of data sets, the DRC is able to give an indication as to when the performance of a supervised classifier decreases. The strictness of the DRC can be set by the user, depending on what one considers to be an acceptable underperformance.