1
|
Govil S, Crabb BT, Deng Y, Dal Toso L, Puyol-Antón E, Pushparajah K, Hegde S, Perry JC, Omens JH, Hsiao A, Young AA, McCulloch AD. A deep learning approach for fully automated cardiac shape modeling in tetralogy of Fallot. J Cardiovasc Magn Reson 2023; 25:15. [PMID: 36849960 PMCID: PMC9969707 DOI: 10.1186/s12968-023-00924-1] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2022] [Accepted: 01/25/2023] [Indexed: 03/01/2023] Open
Abstract
BACKGROUND Cardiac shape modeling is a useful computational tool that has provided quantitative insights into the mechanisms underlying dysfunction in heart disease. The manual input and time required to make cardiac shape models, however, limits their clinical utility. Here we present an end-to-end pipeline that uses deep learning for automated view classification, slice selection, phase selection, anatomical landmark localization, and myocardial image segmentation for the automated generation of three-dimensional, biventricular shape models. With this approach, we aim to make cardiac shape modeling a more robust and broadly applicable tool that has processing times consistent with clinical workflows. METHODS Cardiovascular magnetic resonance (CMR) images from a cohort of 123 patients with repaired tetralogy of Fallot (rTOF) from two internal sites were used to train and validate each step in the automated pipeline. The complete automated pipeline was tested using CMR images from a cohort of 12 rTOF patients from an internal site and 18 rTOF patients from an external site. Manually and automatically generated shape models from the test set were compared using Euclidean projection distances, global ventricular measurements, and atlas-based shape mode scores. RESULTS The mean absolute error (MAE) between manually and automatically generated shape models in the test set was similar to the voxel resolution of the original CMR images for end-diastolic models (MAE = 1.9 ± 0.5 mm) and end-systolic models (MAE = 2.1 ± 0.7 mm). Global ventricular measurements computed from automated models were in good agreement with those computed from manual models. The average mean absolute difference in shape mode Z-score between manually and automatically generated models was 0.5 standard deviations for the first 20 modes of a reference statistical shape atlas. CONCLUSIONS Using deep learning, accurate three-dimensional, biventricular shape models can be reliably created. This fully automated end-to-end approach dramatically reduces the manual input required to create shape models, thereby enabling the rapid analysis of large-scale datasets and the potential to deploy statistical atlas-based analyses in point-of-care clinical settings. Training data and networks are available from cardiacatlas.org.
Collapse
Affiliation(s)
- Sachin Govil
- Department of Bioengineering, University of California San Diego, 9500 Gilman Drive, MC 0412, La Jolla, CA 92093-0412 USA
| | - Brendan T. Crabb
- Department of Bioengineering, University of California San Diego, 9500 Gilman Drive, MC 0412, La Jolla, CA 92093-0412 USA
| | - Yu Deng
- Department of Biomedical Engineering, King’s College London, London, UK
| | - Laura Dal Toso
- Department of Biomedical Engineering, King’s College London, London, UK
| | | | | | - Sanjeet Hegde
- Department of Pediatrics, University of California San Diego, La Jolla, CA USA
- Division of Cardiology, Rady Children’s Hospital San Diego, San Diego, CA USA
| | - James C. Perry
- Department of Pediatrics, University of California San Diego, La Jolla, CA USA
- Division of Cardiology, Rady Children’s Hospital San Diego, San Diego, CA USA
| | - Jeffrey H. Omens
- Department of Bioengineering, University of California San Diego, 9500 Gilman Drive, MC 0412, La Jolla, CA 92093-0412 USA
| | - Albert Hsiao
- Department of Radiology, University of California San Diego, La Jolla, CA USA
| | - Alistair A. Young
- Department of Biomedical Engineering, King’s College London, London, UK
| | - Andrew D. McCulloch
- Department of Bioengineering, University of California San Diego, 9500 Gilman Drive, MC 0412, La Jolla, CA 92093-0412 USA
| |
Collapse
|
2
|
Martínez Carrillo F, Moreno Tarazona A, Guayacán Chaparro LC, Bautista Rozo LX, Pico JA. A fast right ventricle segmentation in cine-MRI from a dense hough representation. REVISTA POLITÉCNICA 2022. [DOI: 10.33571/rpolitec.v18n35a6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022] Open
Abstract
Segmentation of the right ventricle (RV) is essential for the diagnosis of multiple cardiac pathologies and conditions. However, its manual delineation is a tedious task and computational support is complex due to geometric and dynamic variability. This work introduces a dense Hough transform and representation (HT) that allows a nonparametric characterization of the shape, encoding each voxel by its curvature and orientation. This representation is integrated into a bayesian tracking approach, which efficiently segments the RV structure throughout the cardiac cycle. The proposed approach was evaluated on a public dataset, with 16 patients, achieving a Sørensen-Dice coefficient of 0.87 and 0.92, for complete volumes and basal structures, respectively. These results evidence an adequate fit of the proposed model with respect to RV shape throughout the entire cardiac cycle.
La segmentación del Ventrículo Derecho (VD) es esencial para el diagnóstico de múltiples patologías y condiciones cardiacas. Sin embargo, su delineación manual es una tarea tediosa y el soporte computacional resulta complejo debido a la variabilidad geométrica y dinámica. Este trabajo introduce una transformación y representación densa de Hough (TH) que permite una caracterización no paramétrica de la forma, codificando cada vóxel por su curvatura y orientación. Esta representación es integrada en un enfoque de seguimiento bayesiano, que logra de forma eficiente segmentar la estructura del VD, a lo largo del ciclo cardíaco. El enfoque propuesto fue evaluado en un conjunto de datos públicos, con 16 pacientes, logrando un coeficiente Sørensen-Dice de 0,87 y 0,92, para volúmenes completos y estructuras basales, respectivamente. Estos resultados evidencian una adecuada adaptación del modelo propuesto respecto a la forma del VD a lo largo de todo el ciclo cardíaco.
Collapse
|
3
|
Forsch N, Govil S, Perry JC, Hegde S, Young AA, Omens JH, McCulloch AD. Computational analysis of cardiac structure and function in congenital heart disease: Translating discoveries to clinical strategies. JOURNAL OF COMPUTATIONAL SCIENCE 2021; 52:101211. [PMID: 34691293 PMCID: PMC8528218 DOI: 10.1016/j.jocs.2020.101211] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Increased availability and access to medical image data has enabled more quantitative approaches to clinical diagnosis, prognosis, and treatment planning for congenital heart disease. Here we present an overview of long-term clinical management of tetralogy of Fallot (TOF) and its intersection with novel computational and data science approaches to discovering biomarkers of functional and prognostic importance. Efforts in translational medicine that seek to address the clinical challenges associated with cardiovascular diseases using personalized and precision-based approaches are then discussed. The considerations and challenges of translational cardiovascular medicine are reviewed, and examples of digital platforms with collaborative, cloud-based, and scalable design are provided.
Collapse
Affiliation(s)
- Nickolas Forsch
- Department of Bioengineering, University of California San Diego, La Jolla, CA, USA
| | - Sachin Govil
- Department of Bioengineering, University of California San Diego, La Jolla, CA, USA
| | - James C Perry
- Department of Bioengineering, University of California San Diego, La Jolla, CA, USA
- Department of Pediatrics, University of California San Diego, La Jolla, CA, USA
| | - Sanjeet Hegde
- Department of Pediatrics, University of California San Diego, La Jolla, CA, USA
| | - Alistair A Young
- Department of Biomedical Engineering, King’s College London, London, UK
- Department of Anatomy and Medical Imaging, University of Auckland, Auckland, NZ
| | - Jeffrey H Omens
- Department of Bioengineering, University of California San Diego, La Jolla, CA, USA
- Deparment of Medicine, University of California San Diego, La Jolla, CA, USA
| | - Andrew D McCulloch
- Department of Bioengineering, University of California San Diego, La Jolla, CA, USA
- Deparment of Medicine, University of California San Diego, La Jolla, CA, USA
| |
Collapse
|
4
|
Zou H, Leng S, Xi C, Zhao X, Koh AS, Gao F, Tan JL, Tan RS, Allen JC, Lee LC, Genet M, Zhong L. Three-dimensional biventricular strains in pulmonary arterial hypertension patients using hyperelastic warping. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2020; 189:105345. [PMID: 31982668 PMCID: PMC7198336 DOI: 10.1016/j.cmpb.2020.105345] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/16/2019] [Revised: 01/16/2020] [Accepted: 01/16/2020] [Indexed: 06/10/2023]
Abstract
BACKGROUND AND OBJECTIVE Evaluation of biventricular function is an essential component of clinical management in pulmonary arterial hypertension (PAH). This study aims to examine the utility of biventricular strains derived from a model-to-image registration technique in PAH patients in comparison to age- and gender-matched normal controls. METHODS A three-dimensional (3D) model was reconstructed from cine short- and long-axis cardiac magnetic resonance (CMR) images and subsequently partitioned into right ventricle (RV), left ventricle (LV) and septum. The hyperelastic warping method was used to register the meshed biventricular finite element model throughout the cardiac cycle and obtain the corresponding biventricular circumferential, longitudinal and radial strains. RESULTS Intra- and inter-observer reproducibility of biventricular strains was excellent with all intra-class correlation coefficients > 0.84. 3D biventricular longitudinal, circumferential and radial strains for RV, LV and septum were significantly decreased in PAH patients compared with controls. Receiver operating characteristic (ROC) analysis showed that the 3D biventricular strains were better early markers (Area under the ROC curve = 0.96 for RV longitudinal strain) of ventricular dysfunction than conventional parameters such as two-dimensional strains and ejection fraction. CONCLUSIONS Our highly reproducible methodology holds potential for extending CMR imaging to characterize 3D biventricular strains, eventually leading to deeper understanding of biventricular mechanics in PAH.
Collapse
Affiliation(s)
- Hua Zou
- National Heart Research Institute Singapore, National Heart Centre Singapore, Singapore
| | - Shuang Leng
- National Heart Research Institute Singapore, National Heart Centre Singapore, Singapore
| | - Ce Xi
- Department of Mechanical Engineering, Michigan State University, MI, United States
| | - Xiaodan Zhao
- National Heart Research Institute Singapore, National Heart Centre Singapore, Singapore
| | - Angela S Koh
- National Heart Research Institute Singapore, National Heart Centre Singapore, Singapore; Duke-NUS Medical School, Singapore
| | - Fei Gao
- National Heart Research Institute Singapore, National Heart Centre Singapore, Singapore
| | - Ju Le Tan
- National Heart Research Institute Singapore, National Heart Centre Singapore, Singapore; Duke-NUS Medical School, Singapore
| | - Ru-San Tan
- National Heart Research Institute Singapore, National Heart Centre Singapore, Singapore; Duke-NUS Medical School, Singapore
| | | | - Lik Chuan Lee
- Department of Mechanical Engineering, Michigan State University, MI, United States
| | - Martin Genet
- Mechanics Department & Solid Mechanics Laboratory, École Polytechnique (Paris-Saclay University), Palaiseau, France; M3DISIM research team, INRIA (Paris-Saclay University), Palaiseau, France
| | - Liang Zhong
- National Heart Research Institute Singapore, National Heart Centre Singapore, Singapore; Duke-NUS Medical School, Singapore.
| |
Collapse
|
5
|
Atlas-Based Computational Analysis of Heart Shape and Function in Congenital Heart Disease. J Cardiovasc Transl Res 2018; 11:123-132. [PMID: 29294215 DOI: 10.1007/s12265-017-9778-5] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/19/2017] [Accepted: 12/18/2017] [Indexed: 12/18/2022]
Abstract
Approximately 1% of all babies are born with some form of congenital heart defect. Many serious forms of CHD can now be surgically corrected after birth, which has led to improved survival into adulthood. However, many patients require serial monitoring to evaluate progression of heart failure and determine timing of interventions. Accurate multidimensional quantification of regional heart shape and function is required for characterizing these patients. A computational atlas of single ventricle and biventricular heart shape and function enables quantification of remodeling in terms of z scores in relation to specific reference populations. Progression of disease can then be monitored effectively by longitudinal evaluation of z scores. A biomechanical analysis of cardiac function in relation to population variation enables investigation of the underlying mechanisms for developing pathology. Here, we summarize recent progress in this field, with examples in single ventricle and biventricular congenital pathologies.
Collapse
|
6
|
4D modelling for rapid assessment of biventricular function in congenital heart disease. Int J Cardiovasc Imaging 2017; 34:407-417. [PMID: 28856524 DOI: 10.1007/s10554-017-1236-6] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/27/2017] [Accepted: 08/20/2017] [Indexed: 10/19/2022]
Abstract
Although more patients with congenital heart disease (CHD) are now living longer due to better surgical interventions, they require regular imaging to monitor cardiac performance. There is a need for robust clinical tools which can accurately assess cardiac function of both the left and right ventricles in these patients. We have developed methods to rapidly quantify 4D (3D + time) biventricular function from standard cardiac MRI examinations. A finite element model was interactively customized to patient images using guide-point modelling. Computational efficiency and ability to model large deformations was improved by predicting cardiac motion for the left ventricle and epicardium with a polar model. In addition, large deformations through the cycle were more accurately modeled using a Cartesian deformation penalty term. The model was fitted to user-defined guide points and image feature tracking displacements throughout the cardiac cycle. We tested the methods in 60 cases comprising a variety of congenital heart diseases and showed good correlation with the gold standard manual analysis, with acceptable inter-observer error. The algorithm was considerably faster than standard analysis and shows promise as a clinical tool for patients with CHD.
Collapse
|