Automated quantification of myocardial tissue characteristics from native T1 mapping using neural networks with uncertainty-based quality-control

Development and performance evaluation of fully automated deep learning-based models for myocardial segmentation on T1 mapping MRI data

To develop a deep learning-based model capable of segmenting the left ventricular (LV) myocardium on native T1 maps from cardiac MRI in both long-axis and short-axis orientations. Models were trained on native myocardial T1 maps from 50 healthy volunteers and 75 patients using manual segmentation as the reference standard. Based on a U-Net architecture, we systematically optimized the model design using two different training metrics (Sørensen-Dice coefficient = DSC and Intersection-over-Union = IOU), two different activation functions (ReLU and LeakyReLU) and various numbers of training epochs. Training with DSC metric and a ReLU activation function over 35 epochs achieved the highest overall performance (mean error in T1 10.6 ± 17.9 ms, mean DSC 0.88 ± 0.07). Limits of agreement between model results and ground truth were from -35.5 to + 36.1 ms. This was superior to the agreement between two human raters (-34.7 to + 59.1 ms). Segmentation was as accurate for long-axis views (mean error T1: 6.77 ± 8.3 ms, mean DSC: 0.89 ± 0.03) as for short-axis images (mean error ΔT1: 11.6 ± 19.7 ms, mean DSC: 0.88 ± 0.08). Fully automated segmentation and quantitative analysis of native myocardial T1 maps is possible in both long-axis and short-axis orientations with very high accuracy.

Improved Robustness for Deep Learning-based Segmentation of Multi-Center Myocardial Perfusion MRI Datasets Using Data Adaptive Uncertainty-guided Space-time Analysis

BACKGROUND

Fully automatic analysis of myocardial perfusion MRI datasets enables rapid and objective reporting of stress/rest studies in patients with suspected ischemic heart disease. Developing deep learning techniques that can analyze multi-center datasets despite limited training data and variations in software (pulse sequence) and hardware (scanner vendor) is an ongoing challenge.

METHODS

Datasets from 3 medical centers acquired at 3T (n = 150 subjects; 21,150 first-pass images) were included: an internal dataset (inD; n = 95) and two external datasets (exDs; n = 55) used for evaluating the robustness of the trained deep neural network (DNN) models against differences in pulse sequence (exD-1) and scanner vendor (exD-2). A subset of inD (n = 85) was used for training/validation of a pool of DNNs for segmentation, all using the same spatiotemporal U-Net architecture and hyperparameters but with different parameter initializations. We employed a space-time sliding-patch analysis approach that automatically yields a pixel-wise "uncertainty map" as a byproduct of the segmentation process. In our approach, dubbed Data Adaptive Uncertainty-Guided Space-time (DAUGS) analysis, a given test case is segmented by all members of the DNN pool and the resulting uncertainty maps are leveraged to automatically select the "best" one among the pool of solutions. For comparison, we also trained a DNN using the established approach with the same settings (hyperparameters, data augmentation, etc.).

RESULTS

The proposed DAUGS analysis approach performed similarly to the established approach on the internal dataset (Dice score for the testing subset of inD: 0.896 ± 0.050 vs. 0.890 ± 0.049; p = n.s.) whereas it significantly outperformed on the external datasets (Dice for exD-1: 0.885 ± 0.040 vs. 0.849 ± 0.065, p < 0.005; Dice for exD-2: 0.811 ± 0.070 vs. 0.728 ± 0.149, p < 0.005). Moreover, the number of image series with "failed" segmentation (defined as having myocardial contours that include bloodpool or are noncontiguous in ≥1 segment) was significantly lower for the proposed vs. the established approach (4.3% vs. 17.1%, p < 0.0005).

CONCLUSIONS

The proposed DAUGS analysis approach has the potential to improve the robustness of deep learning methods for segmentation of multi-center stress perfusion datasets with variations in the choice of pulse sequence, site location or scanner vendor.

Improved Robustness for Deep Learning-based Segmentation of Multi-Center Myocardial Perfusion MRI Datasets Using Data Adaptive Uncertainty-guided Space-time Analysis

Background

Fully automatic analysis of myocardial perfusion MRI datasets enables rapid and objective reporting of stress/rest studies in patients with suspected ischemic heart disease. Developing deep learning techniques that can analyze multi-center datasets despite limited training data and variations in software (pulse sequence) and hardware (scanner vendor) is an ongoing challenge.

Methods

Datasets from 3 medical centers acquired at 3T (n = 150 subjects; 21,150 first-pass images) were included: an internal dataset (inD; n = 95) and two external datasets (exDs; n = 55) used for evaluating the robustness of the trained deep neural network (DNN) models against differences in pulse sequence (exD-1) and scanner vendor (exD-2). A subset of inD (n = 85) was used for training/validation of a pool of DNNs for segmentation, all using the same spatiotemporal U-Net architecture and hyperparameters but with different parameter initializations. We employed a space-time sliding-patch analysis approach that automatically yields a pixel-wise "uncertainty map" as a byproduct of the segmentation process. In our approach, dubbed Data Adaptive Uncertainty-Guided Space-time (DAUGS) analysis, a given test case is segmented by all members of the DNN pool and the resulting uncertainty maps are leveraged to automatically select the "best" one among the pool of solutions. For comparison, we also trained a DNN using the established approach with the same settings (hyperparameters, data augmentation, etc.).

Results

The proposed DAUGS analysis approach performed similarly to the established approach on the internal dataset (Dice score for the testing subset of inD: 0.896 ± 0.050 vs. 0.890 ± 0.049; p = n.s.) whereas it significantly outperformed on the external datasets (Dice for exD-1: 0.885 ± 0.040 vs. 0.849 ± 0.065, p < 0.005; Dice for exD-2: 0.811 ± 0.070 vs. 0.728 ± 0.149, p < 0.005). Moreover, the number of image series with "failed" segmentation (defined as having myocardial contours that include bloodpool or are noncontiguous in ≥1 segment) was significantly lower for the proposed vs. the established approach (4.3% vs. 17.1%, p < 0.0005).

Conclusions

The proposed DAUGS analysis approach has the potential to improve the robustness of deep learning methods for segmentation of multi-center stress perfusion datasets with variations in the choice of pulse sequence, site location or scanner vendor.

Advanced Myocardial MRI Tissue Characterization Combining Contrast Agent-Free T1-Rho Mapping With Fully Automated Analysis

BACKGROUND

Myocardial T1-rho (T1ρ) mapping is a promising method for identifying and quantifying myocardial injuries without contrast agents, but its clinical use is hindered by the lack of dedicated analysis tools.

PURPOSE

To explore the feasibility of clinically integrated artificial intelligence-driven analysis for efficient and automated myocardial T1ρ mapping.

STUDY TYPE

Retrospective.

POPULATION

Five hundred seventy-three patients divided into a training (N = 500) and a test set (N = 73) including ischemic and nonischemic cases.

FIELD STRENGTH/SEQUENCE

Single-shot bSSFP T1ρ mapping sequence at 1.5 T.

ASSESSMENT

The automated process included: left ventricular (LV) wall segmentation, right ventricular insertion point detection and creation of a 16-segment model for segmental T1ρ value analysis. Two radiologists (20 and 7 years of MRI experience) provided ground truth annotations. Interobserver variability and segmentation quality were assessed using the Dice coefficient with manual segmentation as reference standard. Global and segmental T1ρ values were compared. Processing times were measured.

STATISTICAL TESTS

Intraclass correlation coefficients (ICCs) and Bland-Altman analysis (bias ±2SD); Paired Student's t-tests and one-way ANOVA. A P value <0.05 was considered significant.

RESULTS

The automated approach significantly reduced processing time (3 seconds vs. 1 minute 51 seconds ± 22 seconds). In the test set, automated LV wall segmentation closely matched manual results (Dice 81.9% ± 9.0) and closely aligned with interobserver segmentation (Dice 82.2% ± 6.5). Excellent ICCs were achieved on a patient basis (0.94 [95% CI: 0.91 to 0.96]) with bias of -0.93 cm2 ± 6.60. There was no significant difference in global T1ρ values between manual (54.9 msec ± 4.6; 95% CI: 53.8 to 56.0 msec, range: 46.6-70.9 msec) and automated processing (55.4 msec ± 5.1; 95% CI: 54.2 to 56.6 msec; range: 46.4-75.1 msec; P = 0.099). The pipeline demonstrated a high level of agreement with manual-derived T1ρ values at the patient level (ICC = 0.85; bias +0.52 msec ± 5.18). No significant differences in myocardial T1ρ values were found between methods across the 16 segments (P = 0.75).

DATA CONCLUSION

Automated myocardial T1ρ mapping shows promise for the rapid and noninvasive assessment of heart disease.

EVIDENCE LEVEL

3 TECHNICAL EFFICACY: Stage 1.

Improving the efficiency and accuracy of cardiovascular magnetic resonance with artificial intelligence-review of evidence and proposition of a roadmap to clinical translation

BACKGROUND

Cardiovascular magnetic resonance (CMR) is an important imaging modality for the assessment of heart disease; however, limitations of CMR include long exam times and high complexity compared to other cardiac imaging modalities. Recently advancements in artificial intelligence (AI) technology have shown great potential to address many CMR limitations. While the developments are remarkable, translation of AI-based methods into real-world CMR clinical practice remains at a nascent stage and much work lies ahead to realize the full potential of AI for CMR.

METHODS

Herein we review recent cutting-edge and representative examples demonstrating how AI can advance CMR in areas such as exam planning, accelerated image reconstruction, post-processing, quality control, classification and diagnosis.

RESULTS

These advances can be applied to speed up and simplify essentially every application including cine, strain, late gadolinium enhancement, parametric mapping, 3D whole heart, flow, perfusion and others. AI is a unique technology based on training models using data. Beyond reviewing the literature, this paper discusses important AI-specific issues in the context of CMR, including (1) properties and characteristics of datasets for training and validation, (2) previously published guidelines for reporting CMR AI research, (3) considerations around clinical deployment, (4) responsibilities of clinicians and the need for multi-disciplinary teams in the development and deployment of AI in CMR, (5) industry considerations, and (6) regulatory perspectives.

CONCLUSIONS

Understanding and consideration of all these factors will contribute to the effective and ethical deployment of AI to improve clinical CMR.

Trustworthy clinical AI solutions: A unified review of uncertainty quantification in Deep Learning models for medical image analysis

The full acceptance of Deep Learning (DL) models in the clinical field is rather low with respect to the quantity of high-performing solutions reported in the literature. End users are particularly reluctant to rely on the opaque predictions of DL models. Uncertainty quantification methods have been proposed in the literature as a potential solution, to reduce the black-box effect of DL models and increase the interpretability and the acceptability of the result by the final user. In this review, we propose an overview of the existing methods to quantify uncertainty associated with DL predictions. We focus on applications to medical image analysis, which present specific challenges due to the high dimensionality of images and their variable quality, as well as constraints associated with real-world clinical routine. Moreover, we discuss the concept of structural uncertainty, a corpus of methods to facilitate the alignment of segmentation uncertainty estimates with clinical attention. We then discuss the evaluation protocols to validate the relevance of uncertainty estimates. Finally, we highlight the open challenges for uncertainty quantification in the medical field.

Quality assurance of late gadolinium enhancement cardiac magnetic resonance images: a deep learning classifier for confidence in the presence or absence of abnormality with potential to prompt real-time image optimization

BACKGROUND

Late gadolinium enhancement (LGE) of the myocardium has significant diagnostic and prognostic implications, with even small areas of enhancement being important. Distinguishing between definitely normal and definitely abnormal LGE images is usually straightforward, but diagnostic uncertainty arises when reporters are not sure whether the observed LGE is genuine or not. This uncertainty might be resolved by repetition (to remove artifact) or further acquisition of intersecting images, but this must take place before the scan finishes. Real-time quality assurance by humans is a complex task requiring training and experience, so being able to identify which images have an intermediate likelihood of LGE while the scan is ongoing, without the presence of an expert is of high value. This decision-support could prompt immediate image optimization or acquisition of supplementary images to confirm or refute the presence of genuine LGE. This could reduce ambiguity in reports.

METHODS

Short-axis, phase-sensitive inversion recovery late gadolinium images were extracted from our clinical cardiac magnetic resonance (CMR) database and shuffled. Two, independent, blinded experts scored each individual slice for "LGE likelihood" on a visual analog scale, from 0 (absolute certainty of no LGE) to 100 (absolute certainty of LGE), with 50 representing clinical equipoise. The scored images were split into two classes-either "high certainty" of whether LGE was present or not, or "low certainty." The dataset was split into training, validation, and test sets (70:15:15). A deep learning binary classifier based on the EfficientNetV2 convolutional neural network architecture was trained to distinguish between these categories. Classifier performance on the test set was evaluated by calculating the accuracy, precision, recall, F1-score, and area under the receiver operating characteristics curve (ROC AUC). Performance was also evaluated on an external test set of images from a different center.

RESULTS

One thousand six hundred and forty-five images (from 272 patients) were labeled and split at the patient level into training (1151 images), validation (247 images), and test (247 images) sets for the deep learning binary classifier. Of these, 1208 images were "high certainty" (255 for LGE, 953 for no LGE), and 437 were "low certainty". An external test comprising 247 images from 41 patients from another center was also employed. After 100 epochs, the performance on the internal test set was accuracy = 0.94, recall = 0.80, precision = 0.97, F1-score = 0.87, and ROC AUC = 0.94. The classifier also performed robustly on the external test set (accuracy = 0.91, recall = 0.73, precision = 0.93, F1-score = 0.82, and ROC AUC = 0.91). These results were benchmarked against a reference inter-expert accuracy of 0.86.

CONCLUSION

Deep learning shows potential to automate quality control of late gadolinium imaging in CMR. The ability to identify short-axis images with intermediate LGE likelihood in real-time may serve as a useful decision-support tool. This approach has the potential to guide immediate further imaging while the patient is still in the scanner, thereby reducing the frequency of recalls and inconclusive reports due to diagnostic indecision.

Temporal Uncertainty Localization to Enable Human-in-the-Loop Analysis of Dynamic Contrast-Enhanced Cardiac MRI Datasets

Dynamic contrast-enhanced (DCE) cardiac magnetic resonance imaging (CMRI) is a widely used modality for diagnosing myocardial blood flow (perfusion) abnormalities. During a typical free-breathing DCE-CMRI scan, close to 300 time-resolved images of myocardial perfusion are acquired at various contrast "wash in/out" phases. Manual segmentation of myocardial contours in each time-frame of a DCE image series can be tedious and time-consuming, particularly when non-rigid motion correction has failed or is unavailable. While deep neural networks (DNNs) have shown promise for analyzing DCE-CMRI datasets, a "dynamic quality control" (dQC) technique for reliably detecting failed segmentations is lacking. Here we propose a new space-time uncertainty metric as a dQC tool for DNN-based segmentation of free-breathing DCE-CMRI datasets by validating the proposed metric on an external dataset and establishing a human-in-the-loop framework to improve the segmentation results. In the proposed approach, we referred the top 10% most uncertain segmentations as detected by our dQC tool to the human expert for refinement. This approach resulted in a significant increase in the Dice score (p < 0.001) and a notable decrease in the number of images with failed segmentation (16.2% to 11.3%) whereas the alternative approach of randomly selecting the same number of segmentations for human referral did not achieve any significant improvement. Our results suggest that the proposed dQC framework has the potential to accurately identify poor-quality segmentations and may enable efficient DNN-based analysis of DCE-CMRI in a human-in-the-loop pipeline for clinical interpretation and reporting of dynamic CMRI datasets.

An artificial intelligence tool for automated analysis of large-scale unstructured clinical cine cardiac magnetic resonance databases

Aims

Artificial intelligence (AI) techniques have been proposed for automating analysis of short-axis (SAX) cine cardiac magnetic resonance (CMR), but no CMR analysis tool exists to automatically analyse large (unstructured) clinical CMR datasets. We develop and validate a robust AI tool for start-to-end automatic quantification of cardiac function from SAX cine CMR in large clinical databases.

Methods and results

Our pipeline for processing and analysing CMR databases includes automated steps to identify the correct data, robust image pre-processing, an AI algorithm for biventricular segmentation of SAX CMR and estimation of functional biomarkers, and automated post-analysis quality control to detect and correct errors. The segmentation algorithm was trained on 2793 CMR scans from two NHS hospitals and validated on additional cases from this dataset (n = 414) and five external datasets (n = 6888), including scans of patients with a range of diseases acquired at 12 different centres using CMR scanners from all major vendors. Median absolute errors in cardiac biomarkers were within the range of inter-observer variability: <8.4 mL (left ventricle volume), <9.2 mL (right ventricle volume), <13.3 g (left ventricular mass), and <5.9% (ejection fraction) across all datasets. Stratification of cases according to phenotypes of cardiac disease and scanner vendors showed good performance across all groups.

Conclusion

We show that our proposed tool, which combines image pre-processing steps, a domain-generalizable AI algorithm trained on a large-scale multi-domain CMR dataset and quality control steps, allows robust analysis of (clinical or research) databases from multiple centres, vendors, and cardiac diseases. This enables translation of our tool for use in fully automated processing of large multi-centre databases.

Automatic three-dimensional nasal and pharyngeal airway subregions identification via Vision Transformer

OBJECTIVES

Upper airway assessment requires a fully-automated segmentation system for complete or sub-regional identification. This study aimed to develop a novel Deep Learning (DL) model for accurate segmentation of the upper airway and achieve entire and subregional identification.

METHODS

Fifty cone-beam computed tomography (CBCT) scans, including 24,502 slices, were labelled as the ground truth by one orthodontist and two otorhinolaryngologists. A novel model, a lightweight multitask network based on the Swin Transformer and U-Net, was built for automatic segmentation of the entire upper airway and subregions. Segmentation performance was evaluated using Precision, Recall, Dice similarity coefficient (DSC) and Intersection over union (IoU). The clinical implications of the precision errors were quantitatively analysed, and comparisons between the AI model and Dolphin software were conducted.

RESULTS

Our model achieved good performance with a precision of 85.88-94.25%, recall of 93.74-98.44%, DSC of 90.95-96.29%, IoU of 83.68-92.85% in the overall and subregions of three-dimensional (3D) upper airway, and a precision of 91.22-97.51%, recall of 90.70-97.62%, DSC of 90.92-97.55%, and IoU of 83.41-95.29% in the subregions of two-dimensional (2D) crosssections. Discrepancies in volume and area caused by precision errors did not affect clinical outcomes. Both our AI model and the Dolphin software provided clinically acceptable consistency for pharyngeal airway assessments.

CONCLUSION

The novel DL model not only achieved segmentation of the entire upper airway, including the nasal cavity and subregion identification, but also performed exceptionally well, making it well suited for 3D upper airway assessment from the nasal cavity to the hypopharynx, especially for intricate structures.

CLINICAL SIGNIFICANCE

This system provides insights into the aetiology, risk, severity, treatment effect, and prognosis of dentoskeletal deformities and obstructive sleep apnea. It achieves rapid assessment of the entire upper airway and its subregions, making airway management-an integral part of orthodontic treatment, orthognathic surgery, and ENT surgery-easier.

Environmental and genetic predictors of human cardiovascular ageing

Cardiovascular ageing is a process that begins early in life and leads to a progressive change in structure and decline in function due to accumulated damage across diverse cell types, tissues and organs contributing to multi-morbidity. Damaging biophysical, metabolic and immunological factors exceed endogenous repair mechanisms resulting in a pro-fibrotic state, cellular senescence and end-organ damage, however the genetic architecture of cardiovascular ageing is not known. Here we use machine learning approaches to quantify cardiovascular age from image-derived traits of vascular function, cardiac motion and myocardial fibrosis, as well as conduction traits from electrocardiograms, in 39,559 participants of UK Biobank. Cardiovascular ageing is found to be significantly associated with common or rare variants in genes regulating sarcomere homeostasis, myocardial immunomodulation, and tissue responses to biophysical stress. Ageing is accelerated by cardiometabolic risk factors and we also identify prescribed medications that are potential modifiers of ageing. Through large-scale modelling of ageing across multiple traits our results reveal insights into the mechanisms driving premature cardiovascular ageing and reveal potential molecular targets to attenuate age-related processes.

Estimating Uncertainty in Neural Networks for Cardiac MRI Segmentation: A Benchmark Study

OBJECTIVE

Convolutional neural networks (CNNs) have demonstrated promise in automated cardiac magnetic resonance image segmentation. However, when using CNNs in a large real-world dataset, it is important to quantify segmentation uncertainty and identify segmentations which could be problematic. In this work, we performed a systematic study of Bayesian and non-Bayesian methods for estimating uncertainty in segmentation neural networks.

METHODS

We evaluated Bayes by Backprop, Monte Carlo Dropout, Deep Ensembles, and Stochastic Segmentation Networks in terms of segmentation accuracy, probability calibration, uncertainty on out-of-distribution images, and segmentation quality control.

RESULTS

We observed that Deep Ensembles outperformed the other methods except for images with heavy noise and blurring distortions. We showed that Bayes by Backprop is more robust to noise distortions while Stochastic Segmentation Networks are more resistant to blurring distortions. For segmentation quality control, we showed that segmentation uncertainty is correlated with segmentation accuracy for all the methods. With the incorporation of uncertainty estimates, we were able to reduce the percentage of poor segmentation to 5% by flagging 31-48% of the most uncertain segmentations for manual review, substantially lower than random review without using neural network uncertainty (reviewing 75-78% of all images).

CONCLUSION

This work provides a comprehensive evaluation of uncertainty estimation methods and showed that Deep Ensembles outperformed other methods in most cases.

SIGNIFICANCE

Neural network uncertainty measures can help identify potentially inaccurate segmentations and alert users for manual review.

Genetics of myocardial interstitial fibrosis in the human heart and association with disease

Myocardial interstitial fibrosis is associated with cardiovascular disease and adverse prognosis. Here, to investigate the biological pathways that underlie fibrosis in the human heart, we developed a machine learning model to measure native myocardial T1 time, a marker of myocardial fibrosis, in 41,505 UK Biobank participants who underwent cardiac magnetic resonance imaging. Greater T1 time was associated with diabetes mellitus, renal disease, aortic stenosis, cardiomyopathy, heart failure, atrial fibrillation, conduction disease and rheumatoid arthritis. Genome-wide association analysis identified 11 independent loci associated with T1 time. The identified loci implicated genes involved in glucose transport (SLC2A12), iron homeostasis (HFE, TMPRSS6), tissue repair (ADAMTSL1, VEGFC), oxidative stress (SOD2), cardiac hypertrophy (MYH7B) and calcium signaling (CAMK2D). Using a transforming growth factor β1-mediated cardiac fibroblast activation assay, we found that 9 of the 11 loci consisted of genes that exhibited temporal changes in expression or open chromatin conformation supporting their biological relevance to myofibroblast cell state acquisition. By harnessing machine learning to perform large-scale quantification of myocardial interstitial fibrosis using cardiac imaging, we validate associations between cardiac fibrosis and disease, and identify new biologically relevant pathways underlying fibrosis.

Incident Clinical and Mortality Associations of Myocardial Native T1 in the UK Biobank

BACKGROUND

Cardiac magnetic resonance native T1-mapping provides noninvasive, quantitative, and contrast-free myocardial characterization. However, its predictive value in population cohorts has not been studied.

OBJECTIVES

The associations of native T1 with incident events were evaluated in 42,308 UK Biobank participants over 3.17 ± 1.53 years of prospective follow-up.

METHODS

Native T1-mapping was performed in 1 midventricular short-axis slice using the Shortened Modified Look-Locker Inversion recovery technique (WIP780B) in 1.5-T scanners (Siemens Healthcare). Global myocardial T1 was calculated using an automated tool. Associations of T1 with: 1) prevalent risk factors (eg, diabetes, hypertension, and high cholesterol); 2) prevalent and incident diseases (eg, any cardiovascular disease [CVD], any brain disease, valvular heart disease, heart failure, nonischemic cardiomyopathies, cardiac arrhythmias, atrial fibrillation [AF], myocardial infarction, ischemic heart disease [IHD], and stroke); and 3) mortality (eg, all-cause, CVD, and IHD) were examined. Results are reported as odds ratios (ORs) or HRs per SD increment of T1 value with 95% CIs and corrected P values, from logistic and Cox proportional hazards regression models.

RESULTS

Higher myocardial T1 was associated with greater odds of a range of prevalent conditions (eg, any CVD, brain disease, heart failure, nonischemic cardiomyopathies, AF, stroke, and diabetes). The strongest relationships were with heart failure (OR: 1.41 [95% CI: 1.26-1.57]; P = 1.60 × 10-9) and nonischemic cardiomyopathies (OR: 1.40 [95% CI: 1.16-1.66]; P = 2.42 × 10-4). Native T1 was positively associated with incident AF (HR: 1.25 [95% CI: 1.10-1.43]; P = 9.19 × 10-4), incident heart failure (HR: 1.47 [95% CI: 1.31-1.65]; P = 4.79 × 10-11), all-cause mortality (HR: 1.24 [95% CI: 1.12-1.36]; P = 1.51 × 10-5), CVD mortality (HR: 1.40 [95% CI: 1.14-1.73]; P = 0.0014), and IHD mortality (HR: 1.36 [95% CI: 1.03-1.80]; P = 0.0310).

CONCLUSIONS

This large population study demonstrates the utility of myocardial native T1-mapping for disease discrimination and outcome prediction.

Cardiovascular magnetic resonance for evaluation of cardiac involvement in COVID-19: recommendations by the Society for Cardiovascular Magnetic Resonance

Coronavirus disease 2019 (COVID-19) is an ongoing global pandemic that has affected nearly 600 million people to date across the world. While COVID-19 is primarily a respiratory illness, cardiac injury is also known to occur. Cardiovascular magnetic resonance (CMR) imaging is uniquely capable of characterizing myocardial tissue properties in-vivo, enabling insights into the pattern and degree of cardiac injury. The reported prevalence of myocardial involvement identified by CMR in the context of COVID-19 infection among previously hospitalized patients ranges from 26 to 60%. Variations in the reported prevalence of myocardial involvement may result from differing patient populations (e.g. differences in severity of illness) and the varying intervals between acute infection and CMR evaluation. Standardized methodologies in image acquisition, analysis, interpretation, and reporting of CMR abnormalities across would likely improve concordance between studies. This consensus document by the Society for Cardiovascular Magnetic Resonance (SCMR) provides recommendations on CMR imaging and reporting metrics towards the goal of improved standardization and uniform data acquisition and analytic approaches when performing CMR in patients with COVID-19 infection.

Evaluating semi-supervision methods for medical image segmentation: applications in cardiac magnetic resonance imaging

Purpose

Neural networks have potential to automate medical image segmentation but require expensive labeling efforts. While methods have been proposed to reduce the labeling burden, most have not been thoroughly evaluated on large, clinical datasets or clinical tasks. We propose a method to train segmentation networks with limited labeled data and focus on thorough network evaluation.

Approach

We propose a semi-supervised method that leverages data augmentation, consistency regularization, and pseudolabeling and train four cardiac magnetic resonance (MR) segmentation networks. We evaluate the models on multiinstitutional, multiscanner, multidisease cardiac MR datasets using five cardiac functional biomarkers, which are compared to an expert's measurements using Lin's concordance correlation coefficient (CCC), the within-subject coefficient of variation (CV), and the Dice coefficient.

Results

The semi-supervised networks achieve strong agreement using Lin's CCC ( > 0.8 ), CV similar to an expert, and strong generalization performance. We compare the error modes of the semi-supervised networks against fully supervised networks. We evaluate semi-supervised model performance as a function of labeled training data and with different types of model supervision, showing that a model trained with 100 labeled image slices can achieve a Dice coefficient within 1.10% of a network trained with 16,000+ labeled image slices.

Conclusion

We evaluate semi-supervision for medical image segmentation using heterogeneous datasets and clinical metrics. As methods for training models with little labeled data become more common, knowledge about how they perform on clinical tasks, how they fail, and how they perform with different amounts of labeled data is useful to model developers and users.

Automatic uncertainty-based quality controlled T1 mapping and ECV analysis from native and post-contrast cardiac T1 mapping images using Bayesian vision transformer

Deep learning-based methods for cardiac MR segmentation have achieved state-of-the-art results. However, these methods can generate incorrect segmentation results which can lead to wrong clinical decisions in the downstream tasks. Automatic and accurate analysis of downstream tasks, such as myocardial tissue characterization, is highly dependent on the quality of the segmentation results. Therefore, it is of paramount importance to use quality control methods to detect the failed segmentations before further analysis. In this work, we propose a fully automatic uncertainty-based quality control framework for T1 mapping and extracellular volume (ECV) analysis. The framework consists of three parts. The first one focuses on segmentation of cardiac structures from a native and post-contrast T1 mapping dataset (n=295) using a Bayesian Swin transformer-based U-Net. In the second part, we propose a novel uncertainty-based quality control (QC) to detect inaccurate segmentation results. The QC method utilizes image-level uncertainty features as input to a random forest-based classifier/regressor to determine the quality of the segmentation outputs. The experimental results from four different types of segmentation results show that the proposed QC method achieves a mean area under the ROC curve (AUC) of 0.927 on binary classification and a mean absolute error (MAE) of 0.021 on Dice score regression, significantly outperforming other state-of-the-art uncertainty based QC methods. The performance gap is notably higher in predicting the segmentation quality from poor-performing models which shows the robustness of our method in detecting failed segmentations. After the inaccurate segmentation results are detected and rejected by the QC method, in the third part, T1 mapping and ECV values are computed automatically to characterize the myocardial tissues of healthy and cardiac pathological cases. The native myocardial T1 and ECV values computed from automatic and manual segmentations show an excellent agreement yielding Pearson coefficients of 0.990 and 0.975 (on the combined validation and test sets), respectively. From the results, we observe that the automatically computed myocardial T1 and ECV values have the ability to characterize myocardial tissues of healthy and cardiac diseases like myocardial infarction, amyloidosis, Tako-Tsubo syndrome, dilated cardiomyopathy, and hypertrophic cardiomyopathy.

Introduction of a cascaded segmentation pipeline for parametric T1 mapping in cardiovascular magnetic resonance to improve segmentation performance

The manual and often time-consuming segmentation of the myocardium in cardiovascular magnetic resonance is increasingly automated using convolutional neural networks (CNNs). This study proposes a cascaded segmentation (CASEG) approach to improve automatic image segmentation quality. First, an object detection algorithm predicts a bounding box (BB) for the left ventricular myocardium whose 1.5 times enlargement defines the region of interest (ROI). Then, the ROI image section is fed into a U-Net based segmentation. Two CASEG variants were evaluated: one using the ROI cropped image solely (cropU) and the other using a 2-channel-image additionally containing the original BB image section (crinU). Both were compared to a classical U-Net segmentation (refU). All networks share the same hyperparameters and were tested on basal and midventricular slices of native and contrast enhanced (CE) MOLLI T1 maps. Dice Similarity Coefficient improved significantly (p < 0.05) in cropU and crinU compared to refU (81.06%, 81.22%, 72.79% for native and 80.70%, 79.18%, 71.41% for CE data), while no significant improvement (p < 0.05) was achieved in the mean absolute error of the T1 time (11.94 ms, 12.45 ms, 14.22 ms for native and 5.32 ms, 6.07 ms, 5.89 ms for CE data). In conclusion, CASEG provides an improved geometric concordance but needs further improvement in the quantitative outcome.

Automated Inline Myocardial Segmentation of Joint T1 and T2 Mapping Using Deep Learning

Purpose

To develop an artificial intelligence (AI) solution for automated segmentation and analysis of joint cardiac MRI short-axis T1 and T2 mapping.

Materials and Methods

In this retrospective study, a joint T1 and T2 mapping sequence was used to acquire 4240 maps from 807 patients across two hospitals between March and November 2020. Five hundred nine maps from 94 consecutive patients were assigned to a holdout testing set. A convolutional neural network was trained to segment the endocardial and epicardial contours with use of an edge probability estimation approach. Training labels were segmented by an expert cardiologist. Predicted contours were processed to yield mapping values for each of the 16 American Heart Association segments. Network segmentation performance and segment-wise measurements on the testing set were compared with those of two experts on the holdout testing set. The AI model was fully integrated using open-source software to run on MRI scanners.

Results

A total of 3899 maps (92%) were deemed artifact-free and suitable for human segmentation. AI segmentation closely matched that of each expert (mean Dice coefficient, 0.82 ± 0.07 [SD] vs expert 1 and 0.86 ± 0.06 vs expert 2) and compared favorably with interexpert agreement (Dice coefficient, 0.84 ± 0.06 for expert 1 vs expert 2). AI-derived segment-wise values for native T1, postcontrast T1, and T2 mapping correlated with expert-derived values (R 2 = 0.96, 0.98, and 0.87, respectively, vs expert 1, and 0.97, 0.99, and 0.92 vs expert 2) and fell within the range of interexpert reproducibility (R 2 = 0.97, 0.99, and 0.90, respectively). The AI model has since been deployed at two hospitals, enabling automated inline analysis.

Conclusion

Automated inline analysis of joint T1 and T2 mapping allows accurate segment-wise tissue characterization, with performance equivalent to that of human experts.Keywords: MRI, Neural Networks, Cardiac, Heart Supplemental material is available for this article. © RSNA, 2022.

Automated Measurement of Native T1 and Extracellular Volume Fraction in Cardiac Magnetic Resonance Imaging Using a Commercially Available Deep Learning Algorithm

OBJECTIVE

T1 mapping provides valuable information regarding cardiomyopathies. Manual drawing is time consuming and prone to subjective errors. Therefore, this study aimed to test a DL algorithm for the automated measurement of native T1 and extracellular volume (ECV) fractions in cardiac magnetic resonance (CMR) imaging with a temporally separated dataset.

MATERIALS AND METHODS

CMR images obtained for 95 participants (mean age ± standard deviation, 54.5 ± 15.2 years), including 36 left ventricular hypertrophy (12 hypertrophic cardiomyopathy, 12 Fabry disease, and 12 amyloidosis), 32 dilated cardiomyopathy, and 27 healthy volunteers, were included. A commercial deep learning (DL) algorithm based on 2D U-net (Myomics-T1 software, version 1.0.0) was used for the automated analysis of T1 maps. Four radiologists, as study readers, performed manual analysis. The reference standard was the consensus result of the manual analysis by two additional expert readers. The segmentation performance of the DL algorithm and the correlation and agreement between the automated measurement and the reference standard were assessed. Interobserver agreement among the four radiologists was analyzed.

RESULTS

DL successfully segmented the myocardium in 99.3% of slices in the native T1 map and 89.8% of slices in the post-T1 map with Dice similarity coefficients of 0.86 ± 0.05 and 0.74 ± 0.17, respectively. Native T1 and ECV showed strong correlation and agreement between DL and the reference: for T1, r = 0.967 (95% confidence interval [CI], 0.951-0.978) and bias of 9.5 msec (95% limits of agreement [LOA], -23.6-42.6 msec); for ECV, r = 0.987 (95% CI, 0.980-0.991) and bias of 0.7% (95% LOA, -2.8%-4.2%) on per-subject basis. Agreements between DL and each of the four radiologists were excellent (intraclass correlation coefficient [ICC] of 0.98-0.99 for both native T1 and ECV), comparable to the pairwise agreement between the radiologists (ICC of 0.97-1.00 and 0.99-1.00 for native T1 and ECV, respectively).

CONCLUSION

The DL algorithm allowed automated T1 and ECV measurements comparable to those of radiologists.

Accelerated cardiac T1 mapping with recurrent networks and cyclic, model-based loss

BACKGROUND

Using the spin-lattice relaxation time (T1) as a biomarker, the myocardium can be quantitatively characterized using cardiac T1 mapping. The modified Look-Locker inversion (MOLLI) recovery sequences have become the standard clinical method for cardiac T1 mapping. However, the MOLLI sequences require an 11-heartbeat breath-hold that can be difficult for subjects, particularly during exercise or pharmacologically induced stress. Although shorter cardiac T1 mapping sequences have been proposed, these methods suffer from reduced precision. As such, there is an unmet need for accelerated cardiac T1 mapping.

PURPOSE

To accelerate cardiac T1 mapping MOLLI sequences by using neural networks to estimate T1 maps using a reduced number of T1-weighted images and their corresponding inversion times.

MATERIALS AND METHODS

In this retrospective study, 911 pre-contrast T1 mapping datasets from 202 subjects (128 males, 56 ± 15 years; 74 females, 54 ± 17 years) and 574 T1 mapping post-contrast datasets from 193 subjects (122 males, 57 ± 15 years; 71 females, 54 ± 17 years) were acquired using the MOLLI-5(3)3 sequence and the MOLLI-4(1)3(1)2 sequence, respectively. All acquisition protocols used similar scan parameters:T R = 2.2 ms $TR\; = \;2.2\;{\rm{ms}}$ ,T E = 1.12 ms $TE\; = \;1.12\;{\rm{ms}}$ , andF A = 35 ∘ $FA\; = \;35^\circ $ , gadoteridol (ProHance, Bracco Diagnostics) dose∼ 0.075 mmol / kg $\sim 0.075\;\;{\rm{mmol/kg}}$ . A bidirectional multilayered long short-term memory (LSTM) network with fully connected output and cyclic model-based loss was used to estimate T1 maps from the first three T1-weighted images and their corresponding inversion times for pre- and post-contrast T1 mapping. The performance of the proposed architecture was compared to the three-parameter T1 recovery model using the same reduction of the number of T1-weighted images and inversion times. Reference T1 maps were generated from the scanner using the full MOLLI sequences and the three-parameter T1 recovery model. Correlation and Bland-Altman plots were used to evaluate network performance in which each point represents averaged regions of interest in the myocardium corresponding to the standard American Heart Association 16-segment model. The precision of the network was examined using consecutively repeated scans. Stress and rest pre-contrast MOLLI studies as well as various disease test cases, including amyloidosis, hypertrophic cardiomyopathy, and sarcoidosis were also examined. Paired t-tests were used to determine statistical significance withp < 0.05 $p < 0.05$ .

RESULTS

Our proposed network demonstrated similar T1 estimations to the standard MOLLI sequences (pre-contrast:1260 ± 94 ms $1260 \pm 94\;{\rm{ms}}$ vs.1254 ± 91 ms $1254 \pm 91\;{\rm{ms}}$ withp = 0.13 $p\; = \;0.13$ ; post-contrast:484 ± 92 ms $484 \pm 92\;{\rm{ms}}$ vs.493 ± 91 ms $493 \pm 91\;{\rm{ms}}$ withp = 0.07 $p\; = \;0.07$ ). The precision of standard MOLLI sequences was well preserved with the proposed network architecture (24 ± 28 ms $24 \pm 28\;\;{\rm{ms}}$ vs.18 ± 13 ms $18 \pm 13\;{\rm{ms}}$ ). Network-generated T1 reactivities are similar to stress and rest pre-contrast MOLLI studies (5.1 ± 4.0 % $5.1 \pm 4.0\;\% $ vs.4.9 ± 4.4 % $4.9 \pm 4.4\;\% $ withp = 0.84 $p\; = \;0.84$ ). Amyloidosis T1 maps generated using the proposed network are also similar to the reference T1 maps (pre-contrast:1243 ± 140 ms $1243 \pm 140\;\;{\rm{ms}}$ vs.1231 ± 137 ms $1231 \pm 137\;{\rm{ms}}$ withp = 0.60 $p\; = \;0.60$ ; post-contrast:348 ± 26 ms $348 \pm 26\;{\rm{ms}}$ vs.346 ± 27 ms $346 \pm 27\;{\rm{ms}}$ withp = 0.89 $p\; = \;0.89$ ).

CONCLUSIONS

A bidirectional multilayered LSTM network with fully connected output and cyclic model-based loss was used to generate high-quality pre- and post-contrast T1 maps using the first three T1-weighted images and their corresponding inversion times. This work demonstrates that combining deep learning with cardiac T1 mapping can potentially accelerate standard MOLLI sequences from 11 to 3 heartbeats.

A Deep Learning Segmentation Pipeline for Cardiac T1 Mapping Using MRI Relaxation-based Synthetic Contrast Augmentation

PURPOSE

To design and evaluate an automated deep learning method for segmentation and analysis of cardiac MRI T1 maps with use of synthetic T1-weighted images for MRI relaxation-based contrast augmentation.

MATERIALS AND METHODS

This retrospective study included MRI scans acquired between 2016 and 2019 from 100 patients (mean age ± SD, 55 years ± 13; 72 men) across various clinical abnormalities with use of a modified Look-Locker inversion recovery, or MOLLI, sequence to quantify native T1 (T1_native), postcontrast T1 (T1_post), and extracellular volume (ECV). Data were divided into training (n = 60) and internal (n = 40) test subsets. "Synthetic" T1-weighted images were generated from the T1 exponential inversion-recovery signal model at a range of optimal inversion times, yielding high blood-myocardium contrast, and were used for contrast-based image augmentation during training and testing of a convolutional neural network for myocardial segmentation. Automated segmentation, T1, and ECV were compared with experts with use of Dice similarity coefficients (DSCs), correlation coefficients, and Bland-Altman analysis. An external test dataset (n = 147) was used to assess model generalization.

RESULTS

Internal testing showed high myocardial DSC relative to experts (0.81 ± 0.08), which was similar to interobserver DSC (0.81 ± 0.08). Automated segmental measurements strongly correlated with experts (T1_native, R = 0.87; T1_post, R = 0.91; ECV, R = 0.92), which were similar to interobserver correlation (T1_native, R = 0.86; T1_post, R = 0.94; ECV, R = 0.95). External testing showed strong DSC (0.80 ± 0.09) and T1_native correlation (R = 0.88) between automatic and expert analysis.

CONCLUSION

This deep learning method leveraging synthetic contrast augmentation may provide accurate automated T1 and ECV analysis for cardiac MRI data acquired across different abnormalities, centers, scanners, and T1 sequences.Keywords: MRI, Cardiac, Tissue Characterization, Segmentation, Convolutional Neural Network, Deep Learning Algorithms, Machine Learning Algorithms, Supervised Learning Supplemental material is available for this article. © RSNA, 2022.

The Road Toward Reproducibility of Parametric Mapping of the Heart: A Technical Review

Parametric mapping of the heart has become an essential part of many cardiovascular magnetic resonance imaging exams, and is used for tissue characterization and diagnosis in a broad range of cardiovascular diseases. These pulse sequences are used to quantify the myocardial T₁, T₂, T2*, and T_1ρ relaxation times, which are unique surrogate indices of fibrosis, edema and iron deposition that can be used to monitor a disease over time or to compare patients to one another. Parametric mapping is now well-accepted in the clinical setting, but its wider dissemination is hindered by limited inter-center reproducibility and relatively long acquisition times. Recently, several new parametric mapping techniques have appeared that address both of these problems, but substantial hurdles remain for widespread clinical adoption. This review serves both as a primer for newcomers to the field of parametric mapping and as a technical update for those already well at home in it. It aims to establish what is currently needed to improve the reproducibility of parametric mapping of the heart. To this end, we first give an overview of the metrics by which a mapping technique can be assessed, such as bias and variability, as well as the basic physics behind the relaxation times themselves and what their relevance is in the prospect of myocardial tissue characterization. This is followed by a summary of routine mapping techniques and their variations. The problems in reproducibility and the sources of bias and variability of these techniques are reviewed. Subsequently, novel fast, whole-heart, and multi-parametric techniques and their merits are treated in the light of their reproducibility. This includes state of the art segmentation techniques applied to parametric maps, and how artificial intelligence is being harnessed to solve this long-standing conundrum. We finish up by sketching an outlook on the road toward inter-center reproducibility, and what to expect in the future.

From Accuracy to Reliability and Robustness in Cardiac Magnetic Resonance Image Segmentation: A Review

Since the rise of deep learning (DL) in the mid-2010s, cardiac magnetic resonance (CMR) image segmentation has achieved state-of-the-art performance. Despite achieving inter-observer variability in terms of different accuracy performance measures, visual inspections reveal errors in most segmentation results, indicating a lack of reliability and robustness of DL segmentation models, which can be critical if a model was to be deployed into clinical practice. In this work, we aim to bring attention to reliability and robustness, two unmet needs of cardiac image segmentation methods, which are hampering their translation into practice. To this end, we first study the performance accuracy evolution of CMR segmentation, illustrate the improvements brought by DL algorithms and highlight the symptoms of performance stagnation. Afterwards, we provide formal definitions of reliability and robustness. Based on the two definitions, we identify the factors that limit the reliability and robustness of state-of-the-art deep learning CMR segmentation techniques. Finally, we give an overview of the current set of works that focus on improving the reliability and robustness of CMR segmentation, and we categorize them into two families of methods: quality control methods and model improvement techniques. The first category corresponds to simpler strategies that only aim to flag situations where a model may be incurring poor reliability or robustness. The second one, instead, directly tackles the problem by bringing improvements into different aspects of the CMR segmentation model development process. We aim to bring the attention of more researchers towards these emerging trends regarding the development of reliable and robust CMR segmentation frameworks, which can guarantee the safe use of DL in clinical routines and studies.

Cardiac MR: From Theory to Practice

Cardiovascular disease (CVD) is the leading single cause of morbidity and mortality, causing over 17. 9 million deaths worldwide per year with associated costs of over $800 billion. Improving prevention, diagnosis, and treatment of CVD is therefore a global priority. Cardiovascular magnetic resonance (CMR) has emerged as a clinically important technique for the assessment of cardiovascular anatomy, function, perfusion, and viability. However, diversity and complexity of imaging, reconstruction and analysis methods pose some limitations to the widespread use of CMR. Especially in view of recent developments in the field of machine learning that provide novel solutions to address existing problems, it is necessary to bridge the gap between the clinical and scientific communities. This review covers five essential aspects of CMR to provide a comprehensive overview ranging from CVDs to CMR pulse sequence design, acquisition protocols, motion handling, image reconstruction and quantitative analysis of the obtained data. (1) The basic MR physics of CMR is introduced. Basic pulse sequence building blocks that are commonly used in CMR imaging are presented. Sequences containing these building blocks are formed for parametric mapping and functional imaging techniques. Commonly perceived artifacts and potential countermeasures are discussed for these methods. (2) CMR methods for identifying CVDs are illustrated. Basic anatomy and functional processes are described to understand the cardiac pathologies and how they can be captured by CMR imaging. (3) The planning and conduct of a complete CMR exam which is targeted for the respective pathology is shown. Building blocks are illustrated to create an efficient and patient-centered workflow. Further strategies to cope with challenging patients are discussed. (4) Imaging acceleration and reconstruction techniques are presented that enable acquisition of spatial, temporal, and parametric dynamics of the cardiac cycle. The handling of respiratory and cardiac motion strategies as well as their integration into the reconstruction processes is showcased. (5) Recent advances on deep learning-based reconstructions for this purpose are summarized. Furthermore, an overview of novel deep learning image segmentation and analysis methods is provided with a focus on automatic, fast and reliable extraction of biomarkers and parameters of clinical relevance.

The Role of AI in Characterizing the DCM Phenotype

Dilated Cardiomyopathy is conventionally defined by left ventricular dilatation and dysfunction in the absence of coronary disease. Emerging evidence suggests many patients remain vulnerable to major adverse outcomes despite clear therapeutic success of modern evidence-based heart failure therapy. In this era of personalized medical care, the conventional assessment of left ventricular ejection fraction falls short in fully predicting evolution and risk of outcomes in this heterogenous group of heart muscle disease, as such, a more refined means of phenotyping this disease appears essential. Cardiac MRI (CMR) is well-placed in this respect, not only for its diagnostic utility, but the wealth of information captured in global and regional function assessment with the addition of unique tissue characterization across different disease states and patient cohorts. Advanced tools are needed to leverage these sensitive metrics and integrate with clinical, genetic and biochemical information for personalized, and more clinically useful characterization of the dilated cardiomyopathy phenotype. Recent advances in artificial intelligence offers the unique opportunity to impact clinical decision making through enhanced precision image-analysis tasks, multi-source extraction of relevant features and seamless integration to enhance understanding, improve diagnosis, and subsequently clinical outcomes. Focusing particularly on deep learning, a subfield of artificial intelligence, that has garnered significant interest in the imaging community, this paper reviews the main developments that could offer more robust disease characterization and risk stratification in the Dilated Cardiomyopathy phenotype. Given its promising utility in the non-invasive assessment of cardiac diseases, we firstly highlight the key applications in CMR, set to enable comprehensive quantitative measures of function beyond the standard of care assessment. Concurrently, we revisit the added value of tissue characterization techniques for risk stratification, showcasing the deep learning platforms that overcome limitations in current clinical workflows and discuss how they could be utilized to better differentiate at-risk subgroups of this phenotype. The final section of this paper is dedicated to the allied clinical applications to imaging, that incorporate artificial intelligence and have harnessed the comprehensive abundance of data from genetics and relevant clinical variables to facilitate better classification and enable enhanced risk prediction for relevant outcomes.

Deep Learning for Classification and Selection of Cine CMR Images to Achieve Fully Automated Quality-Controlled CMR Analysis From Scanner to Report

Introduction: Deep learning demonstrates great promise for automated analysis of CMR. However, existing limitations, such as insufficient quality control and selection of target acquisitions from the full CMR exam, are holding back the introduction of deep learning tools in the clinical environment. This study aimed to develop a framework for automated detection and quality-controlled selection of standard cine sequences images from clinical CMR exams, prior to analysis of cardiac function.

Materials and Methods: Retrospective study of 3,827 subjects that underwent CMR imaging. We used a total of 119,285 CMR acquisitions, acquired with scanners of different magnetic field strengths and from different vendors (1.5T Siemens and 1.5T and 3.0T Phillips). We developed a framework to select one good acquisition for each conventional cine class. The framework consisted of a first pre-processing step to exclude still acquisitions; two sequential convolutional neural networks (CNN), the first (CNN_class) to classify acquisitions in standard cine views (2/3/4-chamber and short axis), the second (CNN_QC) to classify acquisitions according to image quality and orientation; a final algorithm to select one good acquisition of each class. For each CNN component, 7 state-of-the-art architectures were trained for 200 epochs, with cross entropy loss and data augmentation. Data were divided into 80% for training, 10% for validation, and 10% for testing.

Results: CNN_class selected cine CMR acquisitions with accuracy ranging from 0.989 to 0.998. Accuracy of CNN_QC reached 0.861 for 2-chamber, 0.806 for 3-chamber, and 0.859 for 4-chamber. The complete framework was presented with 379 new full CMR studies, not used for CNN training/validation/testing, and selected one good 2-, 3-, and 4-chamber acquisition from each study with sensitivity to detect erroneous cases of 89.7, 93.2, and 93.9%, respectively.

Conclusions: We developed an accurate quality-controlled framework for automated selection of cine acquisitions prior to image analysis. This framework is robust and generalizable as it was developed on multivendor data and could be used at the beginning of a pipeline for automated cine CMR analysis to obtain full automatization from scanner to report.