1
|
Meng Q, Bai W, O’Regan DP, Rueckert D. DeepMesh: Mesh-Based Cardiac Motion Tracking Using Deep Learning. IEEE TRANSACTIONS ON MEDICAL IMAGING 2024; 43:1489-1500. [PMID: 38064325 PMCID: PMC7615801 DOI: 10.1109/tmi.2023.3340118] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/22/2024]
Abstract
3D motion estimation from cine cardiac magnetic resonance (CMR) images is important for the assessment of cardiac function and the diagnosis of cardiovascular diseases. Current state-of-the art methods focus on estimating dense pixel-/voxel-wise motion fields in image space, which ignores the fact that motion estimation is only relevant and useful within the anatomical objects of interest, e.g., the heart. In this work, we model the heart as a 3D mesh consisting of epi- and endocardial surfaces. We propose a novel learning framework, DeepMesh, which propagates a template heart mesh to a subject space and estimates the 3D motion of the heart mesh from CMR images for individual subjects. In DeepMesh, the heart mesh of the end-diastolic frame of an individual subject is first reconstructed from the template mesh. Mesh-based 3D motion fields with respect to the end-diastolic frame are then estimated from 2D short- and long-axis CMR images. By developing a differentiable mesh-to-image rasterizer, DeepMesh is able to leverage 2D shape information from multiple anatomical views for 3D mesh reconstruction and mesh motion estimation. The proposed method estimates vertex-wise displacement and thus maintains vertex correspondences between time frames, which is important for the quantitative assessment of cardiac function across different subjects and populations. We evaluate DeepMesh on CMR images acquired from the UK Biobank. We focus on 3D motion estimation of the left ventricle in this work. Experimental results show that the proposed method quantitatively and qualitatively outperforms other image-based and mesh-based cardiac motion tracking methods.
Collapse
Affiliation(s)
- Qingjie Meng
- The Biomedical Image Analysis Group, Department of Computing, Imperial College London, SW7 2AZ, UK
| | - Wenjia Bai
- The Biomedical Image Analysis Group, Department of Computing, Imperial College London, SW7 2AZ, UK; Department of Brain Sciences, Imperial College London
| | - Declan P O’Regan
- The MRC London Institute of Medical Sciences, Imperial College London, W12 0HS, UK
| | - Daniel Rueckert
- The Biomedical Image Analysis Group, Department of Computing, Imperial College London, SW7 2AZ, UK; Klinikum rechts der Isar, Technical University Munich, Germany
| |
Collapse
|
2
|
van Harten LD, Stoker J, Isgum I. Robust Deformable Image Registration Using Cycle-Consistent Implicit Representations. IEEE TRANSACTIONS ON MEDICAL IMAGING 2024; 43:784-793. [PMID: 37782589 DOI: 10.1109/tmi.2023.3321425] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/04/2023]
Abstract
Recent works in medical image registration have proposed the use of Implicit Neural Representations, demonstrating performance that rivals state-of-the-art learning-based methods. However, these implicit representations need to be optimized for each new image pair, which is a stochastic process that may fail to converge to a global minimum. To improve robustness, we propose a deformable registration method using pairs of cycle-consistent Implicit Neural Representations: each implicit representation is linked to a second implicit representation that estimates the opposite transformation, causing each network to act as a regularizer for its paired opposite. During inference, we generate multiple deformation estimates by numerically inverting the paired backward transformation and evaluating the consensus of the optimized pair. This consensus improves registration accuracy over using a single representation and results in a robust uncertainty metric that can be used for automatic quality control. We evaluate our method with a 4D lung CT dataset. The proposed cycle-consistent optimization method reduces the optimization failure rate from 2.4% to 0.0% compared to the current state-of-the-art. The proposed inference method improves landmark accuracy by 4.5% and the proposed uncertainty metric detects all instances where the registration method fails to converge to a correct solution. We verify the generalizability of these results to other data using a centerline propagation task in abdominal 4D MRI, where our method achieves a 46% improvement in propagation consistency compared with single-INR registration and demonstrates a strong correlation between the proposed uncertainty metric and registration accuracy.
Collapse
|
3
|
Hu P, Tong X, Lin L, Wang LV. Data-driven system matrix manipulation enabling fast functional imaging and intra-image nonrigid motion correction in tomography. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.01.07.574504. [PMID: 38260429 PMCID: PMC10802502 DOI: 10.1101/2024.01.07.574504] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/24/2024]
Abstract
Tomographic imaging modalities are described by large system matrices. Sparse sampling and tissue motion degrade system matrix and image quality. Various existing techniques improve the image quality without correcting the system matrices. Here, we compress the system matrices to improve computational efficiency (e.g., 42 times) using singular value decomposition and fast Fourier transform. Enabled by the efficiency, we propose (1) fast sparsely sampling functional imaging by incorporating a densely sampled prior image into the system matrix, which maintains the critical linearity while mitigating artifacts and (2) intra-image nonrigid motion correction by incorporating the motion as subdomain translations into the system matrix and reconstructing the translations together with the image iteratively. We demonstrate the methods in 3D photoacoustic computed tomography with significantly improved image qualities and clarify their applicability to X-ray CT and MRI or other types of imperfections due to the similarities in system matrices.
Collapse
Affiliation(s)
- Peng Hu
- Caltech Optical Imaging Laboratory, Andrew and Peggy Cherng Department of Medical Engineering, Department of Electrical Engineering, California Institute of Technology, Pasadena, CA 91125, USA
| | - Xin Tong
- Caltech Optical Imaging Laboratory, Andrew and Peggy Cherng Department of Medical Engineering, Department of Electrical Engineering, California Institute of Technology, Pasadena, CA 91125, USA
| | - Li Lin
- Caltech Optical Imaging Laboratory, Andrew and Peggy Cherng Department of Medical Engineering, Department of Electrical Engineering, California Institute of Technology, Pasadena, CA 91125, USA
- Present address: College of Biomedical Engineering and Instrument Science, Zhejiang University, Hangzhou 310027, China
| | - Lihong V. Wang
- Caltech Optical Imaging Laboratory, Andrew and Peggy Cherng Department of Medical Engineering, Department of Electrical Engineering, California Institute of Technology, Pasadena, CA 91125, USA
| |
Collapse
|
4
|
Alkassar M, Engelhardt S, Abu-Tair T, Ojeda E, Treffer PC, Weyand M, Rompel O. Comparative Study of 2D-Cine and 3D-wh Volumetry: Revealing Systemic Error of 2D-Cine Volumetry. Diagnostics (Basel) 2023; 13:3162. [PMID: 37891983 PMCID: PMC10605840 DOI: 10.3390/diagnostics13203162] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2023] [Revised: 09/28/2023] [Accepted: 10/06/2023] [Indexed: 10/29/2023] Open
Abstract
This study investigates the crucial factors influencing the end-systolic and end-diastolic volumes in MRI volumetry and their direct effects on the derived functional parameters. Through the simultaneous acquisition of 2D-cine and 3D whole-heart slices in end-diastole and end-systole, we present a novel direct comparison of the volumetric measurements from both methods. A prospective study was conducted with 18 healthy participants. Both 2D-cine and 3D whole-heart sequences were obtained. Despite the differences in the creation of 3D volumes and trigger points, the impact on the LV volume was minimal (134.9 mL ± 16.9 mL vs. 136.6 mL ± 16.6 mL, p < 0.01 for end-diastole; 50.6 mL ± 11.0 mL vs. 51.6 mL ± 11.2 mL, p = 0.03 for end-systole). In our healthy patient cohort, a systematic underestimation of the end-systolic volume resulted in a significant overestimation of the SV (5.6 mL ± 2.6 mL, p < 0.01). The functional calculations from the 3D whole-heart method proved to be highly accurate and correlated well with function measurements from the phase-contrast sequences. Our study is the first to demonstrate the superiority of 3D whole-heart volumetry over 2D-cine volumetry and sheds light on the systematic error inherent in 2D-cine measurements.
Collapse
Affiliation(s)
- Muhnnad Alkassar
- Department of Cardiac Surgery, Friedrich-Alexander-Universität Erlangen-Nürnberg, 91054 Erlangen, Germany; (S.E.); (M.W.)
- Department of Pediatrics, Paracelsus Medical School, General Hospital of Nuremberg, 90419 Nuremberg, Germany
| | - Sophia Engelhardt
- Department of Cardiac Surgery, Friedrich-Alexander-Universität Erlangen-Nürnberg, 91054 Erlangen, Germany; (S.E.); (M.W.)
| | - Tariq Abu-Tair
- Department of Congenital Heart Disease, Centre for Diseases in Childhood and Adolescence, University Medicine Mainz, 55131 Mainz, Germany;
| | - Efren Ojeda
- Siemens Healtineers, 91052 Erlangen, Germany; (E.O.); (P.C.T.)
| | | | - Michael Weyand
- Department of Cardiac Surgery, Friedrich-Alexander-Universität Erlangen-Nürnberg, 91054 Erlangen, Germany; (S.E.); (M.W.)
| | - Oliver Rompel
- Institute of Radiology, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg, 91054 Erlangen, Germany;
| |
Collapse
|
5
|
V Graves C, Rebelo MFS, Moreno RA, Dantas-Jr RN, Assunção-Jr AN, Nomura CH, Gutierrez MA. Siamese pyramidal deep learning network for strain estimation in 3D cardiac cine-MR. Comput Med Imaging Graph 2023; 108:102283. [PMID: 37562136 DOI: 10.1016/j.compmedimag.2023.102283] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2023] [Revised: 07/26/2023] [Accepted: 07/27/2023] [Indexed: 08/12/2023]
Abstract
Strain represents the quantification of regional tissue deformation within a given area. Myocardial strain has demonstrated considerable utility as an indicator for the assessment of cardiac function. Notably, it exhibits greater sensitivity in detecting subtle myocardial abnormalities compared to conventional cardiac function indices, like left ventricle ejection fraction (LVEF). Nonetheless, the estimation of strain poses considerable challenges due to the necessity for precise tracking of myocardial motion throughout the complete cardiac cycle. This study introduces a novel deep learning-based pipeline, designed to automatically and accurately estimate myocardial strain from three-dimensional (3D) cine-MR images. Consequently, our investigation presents a comprehensive pipeline for the precise quantification of local and global myocardial strain. This pipeline incorporates a supervised Convolutional Neural Network (CNN) for accurate segmentation of the cardiac muscle and an unsupervised CNN for robust left ventricle motion tracking, enabling the estimation of strain in both artificial phantoms and real cine-MR images. Our investigation involved a comprehensive comparison of our findings with those obtained from two commonly utilized commercial software in this field. This analysis encompassed the examination of both intra- and inter-user variability. The proposed pipeline exhibited demonstrable reliability and reduced divergence levels when compared to alternative systems. Additionally, our approach is entirely independent of previous user data, effectively eliminating any potential user bias that could influence the strain analyses.
Collapse
Affiliation(s)
- Catharine V Graves
- Instituto do Coracao HCFMUSP, Faculdade de Medicina, Universidade de Sao Paulo, Sao Paulo, SP, Brazil; Escola Politecnica da Universidade de Sao Paulo, Sao Paulo, SP, Brazil.
| | - Marina F S Rebelo
- Instituto do Coracao HCFMUSP, Faculdade de Medicina, Universidade de Sao Paulo, Sao Paulo, SP, Brazil
| | - Ramon A Moreno
- Instituto do Coracao HCFMUSP, Faculdade de Medicina, Universidade de Sao Paulo, Sao Paulo, SP, Brazil
| | - Roberto N Dantas-Jr
- Instituto do Coracao HCFMUSP, Faculdade de Medicina, Universidade de Sao Paulo, Sao Paulo, SP, Brazil
| | - Antonildes N Assunção-Jr
- Instituto do Coracao HCFMUSP, Faculdade de Medicina, Universidade de Sao Paulo, Sao Paulo, SP, Brazil
| | - Cesar H Nomura
- Instituto do Coracao HCFMUSP, Faculdade de Medicina, Universidade de Sao Paulo, Sao Paulo, SP, Brazil
| | - Marco A Gutierrez
- Instituto do Coracao HCFMUSP, Faculdade de Medicina, Universidade de Sao Paulo, Sao Paulo, SP, Brazil; Escola Politecnica da Universidade de Sao Paulo, Sao Paulo, SP, Brazil
| |
Collapse
|
6
|
Upendra RR, Simon R, Shontz SM, Linte CA. Deformable Image Registration Using Vision Transformers for Cardiac Motion Estimation from Cine Cardiac MRI Images. FUNCTIONAL IMAGING AND MODELING OF THE HEART : ... INTERNATIONAL WORKSHOP, FIMH ..., PROCEEDINGS. FIMH 2023; 13958:375-383. [PMID: 39391840 PMCID: PMC11466156 DOI: 10.1007/978-3-031-35302-4_39] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/12/2024]
Abstract
Accurate cardiac motion estimation is a crucial step in assessing the kinematic and contractile properties of the cardiac chambers, thereby directly quantifying the regional cardiac function, which plays an important role in understanding myocardial diseases and planning their treatment. Since the cine cardiac magnetic resonance imaging (MRI) provides dynamic, high-resolution 3D images of the heart that depict cardiac motion throughout the cardiac cycle, cardiac motion can be estimated by finding the optical flow representation between the consecutive 3D volumes from a 4D cine cardiac MRI dataset, thereby formulating it as an image registration problem. Therefore, we propose a hybrid convolutional neural network (CNN) and Vision Transformer (ViT) architecture for deformable image registration of 3D cine cardiac MRI images for consistent cardiac motion estimation. We compare the image registration results of our proposed method with those of the VoxelMorph CNN model and conventional B-spline free form deformation (FFD) non-rigid image registration algorithm. We conduct all our experiments on the open-source Automated Cardiac Diagnosis Challenge (ACDC) dataset. Our experiments show that the deformable image registration results obtained using the proposed method outperform the CNN model and the traditional FFD image registration method.
Collapse
Affiliation(s)
- Roshan Reddy Upendra
- Center for Imaging Science, Rochester Institute of Technology, Rochester, NY, USA
| | - Richard Simon
- Biomedical Engineering, Rochester Institute of Technology, Rochester, NY, USA
| | - Suzanne M Shontz
- Electrical Engineering and Computer Science, University of Kansas, Lawrence, KS, USA
- Bioengineering Program, University of Kansas, Lawrence, KS, USA
- Institute for Information Sciences, University of Kansas, Lawrence, KS, USA
| | - Cristian A Linte
- Center for Imaging Science, Rochester Institute of Technology, Rochester, NY, USA
- Biomedical Engineering, Rochester Institute of Technology, Rochester, NY, USA
| |
Collapse
|
7
|
Lu J, Jin R, Wang M, Song E, Ma G. A bidirectional registration neural network for cardiac motion tracking using cine MRI images. Comput Biol Med 2023; 160:107001. [PMID: 37187138 DOI: 10.1016/j.compbiomed.2023.107001] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2022] [Revised: 03/15/2023] [Accepted: 05/02/2023] [Indexed: 05/17/2023]
Abstract
Using cine magnetic resonance imaging (cine MRI) images to track cardiac motion helps users to analyze the myocardial strain, and is of great importance in clinical applications. At present, most of the automatic deep learning-based motion tracking methods compare two images without considering temporal information between MRI frames, which easily leads to the lack of consistency of the generated motion fields. Even though a small number of works take into account the temporal factor, they are usually computationally intensive or have limitations on image length. To solve this problem, we propose a bidirectional convolution neural network for motion tracking of cardiac cine MRI images. This network leverages convolutional blocks to extract spatial features from three-dimensional (3D) image registration pairs, and models the temporal relations through a bidirectional recurrent neural network to obtain the Lagrange motion field between the reference image and other images. Compared with previous pairwise registration methods, the proposed method can automatically learn spatiotemporal information from multiple images with fewer parameters. We evaluated our model on three public cardiac cine MRI datasets. The experimental results demonstrated that the proposed method can significantly improve the motion tracking accuracy. The average Dice coefficient between estimated segmentation and manual segmentation has reached almost 0.85 on the widely used Automatic Cardiac Diagnostic Challenge (ACDC) dataset.
Collapse
Affiliation(s)
- Jiayi Lu
- School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan, Hubei, 430074, China
| | - Renchao Jin
- School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan, Hubei, 430074, China.
| | - Manyang Wang
- School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan, Hubei, 430074, China
| | - Enmin Song
- School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan, Hubei, 430074, China
| | - Guangzhi Ma
- School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan, Hubei, 430074, China
| |
Collapse
|
8
|
Ogier AC, Rapacchi S, Bellemare ME. Four-dimensional reconstruction and characterization of bladder deformations. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 237:107569. [PMID: 37186971 DOI: 10.1016/j.cmpb.2023.107569] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/14/2022] [Revised: 03/31/2023] [Accepted: 04/24/2023] [Indexed: 05/17/2023]
Abstract
BACKGROUND AND OBJECTIVE Pelvic floor disorders are prevalent diseases and patient care remains difficult as the dynamics of the pelvic floor remains poorly understood. So far, only 2D dynamic observations of straining exercises at excretion are available in the clinics and 3D mechanical defects of pelvic organs are not well studied. In this context, we propose a complete methodology for the 3D representation of non-reversible bladder deformations during exercises, combined with a 3D representation of the location of the highest strain areas on the organ surface. METHODS Novel image segmentation and registration approaches have been combined with three geometrical configurations of up-to-date rapid dynamic multi-slice MRI acquisitions for the reconstruction of real-time dynamic bladder volumes. RESULTS For the first time, we proposed real-time 3D deformation fields of the bladder under strain from in-bore forced breathing exercises. The potential of our method was assessed on eight control subjects undergoing forced breathing exercises. We obtained average volume deviations of the reconstructed dynamic volume of bladders around 2.5% and high registration accuracy with mean distance values of 0.4 ± 0.3 mm and Hausdorff distance values of 2.2 ± 1.1 mm. CONCLUSIONS The proposed framework provides proper 3D+t spatial tracking of non-reversible bladder deformations. This has immediate applicability in clinical settings for a better understanding of pelvic organ prolapse pathophysiology. This work can be extended to patients with cavity filling or excretion problems to better characterize the severity of pelvic floor pathologies or to be used for preoperative surgical planning.
Collapse
Affiliation(s)
- Augustin C Ogier
- Aix Marseille Univ, Universite de Toulon, CNRS, LIS, Marseille, France.
| | | | | |
Collapse
|
9
|
Tuna EE, Franson D, Seiberlich N, Çavuşoğlu MC. Deformable cardiac surface tracking by adaptive estimation algorithms. Sci Rep 2023; 13:1387. [PMID: 36697497 PMCID: PMC9877032 DOI: 10.1038/s41598-023-28578-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2022] [Accepted: 01/20/2023] [Indexed: 01/26/2023] Open
Abstract
This study presents a particle filter based framework to track cardiac surface from a time sequence of single magnetic resonance imaging (MRI) slices with the future goal of utilizing the presented framework for interventional cardiovascular magnetic resonance procedures, which rely on the accurate and online tracking of the cardiac surface from MRI data. The framework exploits a low-order parametric deformable model of the cardiac surface. A stochastic dynamic system represents the cardiac surface motion. Deformable models are employed to introduce shape prior to control the degree of the deformations. Adaptive filters are used to model complex cardiac motion in the dynamic model of the system. Particle filters are utilized to recursively estimate the current state of the system over time. The proposed method is applied to recover biventricular deformations and validated with a numerical phantom and multiple real cardiac MRI datasets. The algorithm is evaluated with multiple experiments using fixed and varying image slice planes at each time step. For the real cardiac MRI datasets, the average root-mean-square tracking errors of 2.61 mm and 3.42 mm are reported respectively for the fixed and varying image slice planes. This work serves as a proof-of-concept study for modeling and tracking the cardiac surface deformations via a low-order probabilistic model with the future goal of utilizing this method for the targeted interventional cardiac procedures under MR image guidance. For the real cardiac MRI datasets, the presented method was able to track the points-of-interests located on different sections of the cardiac surface within a precision of 3 pixels. The analyses show that the use of deformable cardiac surface tracking algorithm can pave the way for performing precise targeted intracardiac ablation procedures under MRI guidance. The main contributions of this work are twofold. First, it presents a framework for the tracking of whole cardiac surface from a time sequence of single image slices. Second, it employs adaptive filters to incorporate motion information in the tracking of nonrigid cardiac surface motion for temporal coherence.
Collapse
Affiliation(s)
- E Erdem Tuna
- Department of Electrical, Computer, and Systems Engineering, Case Western Reserve University, Cleveland, OH, 44106, USA.
| | - Dominique Franson
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, 44106, USA
| | - Nicole Seiberlich
- Department of Radiology, Michigan Medicine, University of Michigan, Ann-Anbor, MI, 48109, USA
| | - M Cenk Çavuşoğlu
- Department of Electrical, Computer, and Systems Engineering, Case Western Reserve University, Cleveland, OH, 44106, USA
| |
Collapse
|
10
|
Abstract
PURPOSE OF REVIEW Heart failure results in the high incidence and mortality all over the world. Mechanical properties of myocardium are critical determinants of cardiac function, with regional variations in myocardial contractility demonstrated within infarcted ventricles. Quantitative assessment of cardiac contractile function is therefore critical to identify myocardial infarction for the early diagnosis and therapeutic intervention. RECENT FINDINGS Current advancement of cardiac functional assessments is in pace with the development of imaging techniques. The methods tailored to advanced imaging have been widely used in cardiac magnetic resonance, echocardiography, and optical microscopy. In this review, we introduce fundamental concepts and applications of representative methods for each imaging modality used in both fundamental research and clinical investigations. All these methods have been designed or developed to quantify time-dependent 2-dimensional (2D) or 3D cardiac mechanics, holding great potential to unravel global or regional myocardial deformation and contractile function from end-systole to end-diastole. Computational methods to assess cardiac contractile function provide a quantitative insight into the analysis of myocardial mechanics during cardiac development, injury, and remodeling.
Collapse
|
11
|
Graves CV, Rebelo MFS, Moreno RA, Nomura CH, Gutierrez MA. Automatic myocardium strain quantification in MR synthetic images with Deep Leaning. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2022; 2022:545-548. [PMID: 36086491 DOI: 10.1109/embc48229.2022.9871516] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Accurate quantification of myocardium strain in magnetic resonance images is important to correctly diagnose and monitor cardiac diseases. Currently, available methods to estimate motion are based on tracking brightness pattern differences between images. In cine-MR images, the myocardium interior presents an inhered homogeneity, which reduces the accuracy in estimated motion, and consequently strain. Neural networks have recently been shown to be an important tool for a variety of applications, including motion estimation. In this work, we investigate the feasibility of quantifying myocardium strain in cardiac resonance synthetic images using motion generated by a compact and powerful network called Pyramid, Warping, and Cost Volume (PWC). Using the motion generated by the neural network, the radial myocardium strain obtained presents a mean average error of 12.30% +- 6.50%, and in the circumferential direction 1.20% +-0.61 %, better than the two classical methods evaluated. Clinical Relevance- This work demonstrates the feasibility of estimating myocardium strain using motion estimated by a convolutional neural network.
Collapse
|
12
|
Alenezi F, Covington TA, Mukherjee M, Mathai SC, Yu PB, Rajagopal S. Novel Approaches to Imaging the Pulmonary Vasculature and Right Heart. Circ Res 2022; 130:1445-1465. [PMID: 35482838 PMCID: PMC9060389 DOI: 10.1161/circresaha.121.319990] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/17/2023]
Abstract
There is an increased appreciation for the importance of the right heart and pulmonary circulation in several disease states across the spectrum of pulmonary hypertension and left heart failure. However, assessment of the structure and function of the right heart and pulmonary circulation can be challenging, due to the complex geometry of the right ventricle, comorbid pulmonary airways and parenchymal disease, and the overlap of hemodynamic abnormalities with left heart failure. Several new and evolving imaging modalities interrogate the right heart and pulmonary circulation with greater diagnostic precision. Echocardiographic approaches such as speckle-tracking and 3-dimensional imaging provide detailed assessments of regional systolic and diastolic function and volumetric assessments. Magnetic resonance approaches can provide high-resolution views of cardiac structure/function, tissue characterization, and perfusion through the pulmonary vasculature. Molecular imaging with positron emission tomography allows an assessment of specific pathobiologically relevant targets in the right heart and pulmonary circulation. Machine learning analysis of high-resolution computed tomographic lung scans permits quantitative morphometry of the lung circulation without intravenous contrast. Inhaled magnetic resonance imaging probes, such as hyperpolarized 129Xe magnetic resonance imaging, report on pulmonary gas exchange and pulmonary capillary hemodynamics. These approaches provide important information on right ventricular structure and function along with perfusion through the pulmonary circulation. At this time, the majority of these developing technologies have yet to be clinically validated, with few studies demonstrating the utility of these imaging biomarkers for diagnosis or monitoring disease. These technologies hold promise for earlier diagnosis and noninvasive monitoring of right heart failure and pulmonary hypertension that will aid in preclinical studies, enhance patient selection and provide surrogate end points in clinical trials, and ultimately improve bedside care.
Collapse
Affiliation(s)
- Fawaz Alenezi
- Division of Cardiology, Department of Medicine, Duke University Medical Center, Durham, NC
| | | | | | - Steve C. Mathai
- Johns Hopkins Division of Pulmonary and Critical Care Medicine, Baltimore, MD
| | - Paul B. Yu
- Cardiovascular Research Center, Massachusetts General Hospital, Boston, MA
| | - Sudarshan Rajagopal
- Division of Cardiology, Department of Medicine, Duke University Medical Center, Durham, NC
| |
Collapse
|
13
|
Yassine IA, Ghanem AM, Metwalli NS, Hamimi A, Ouwerkerk R, Matta JR, Solomon MA, Elinoff JM, Gharib AM, Abd-Elmoniem KZ. Native-resolution myocardial principal Eulerian strain mapping using convolutional neural networks and Tagged Magnetic Resonance Imaging. Comput Biol Med 2022; 141:105041. [PMID: 34836627 PMCID: PMC8900530 DOI: 10.1016/j.compbiomed.2021.105041] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2021] [Revised: 11/12/2021] [Accepted: 11/13/2021] [Indexed: 02/03/2023]
Abstract
BACKGROUND Assessment of regional myocardial function at native pixel-level resolution can play a crucial role in recognizing the early signs of the decline in regional myocardial function. Extensive data processing in existing techniques limits the effective resolution and accuracy of the generated strain maps. The purpose of this study is to compute myocardial principal strain maps εp1 and εp2 from tagged MRI (tMRI) at the native image resolution using deep-learning local patch convolutional neural network (CNN) models (DeepStrain). METHODS For network training, validation, and testing, realistic tMRI datasets were generated and consisted of 53,606 cine images simulating the heart, the liver, blood pool, and backgrounds, including ranges of shapes, positions, motion patterns, noise, and strain. In addition, 102 in-vivo image datasets from three healthy subjects, and three Pulmonary Arterial Hypertension patients, were acquired and used to assess the network's in-vivo performance. Four convolutional neural networks were trained for mapping input tagging patterns to corresponding ground-truth principal strains using different cost functions. Strain maps using harmonic phase analysis (HARP) were obtained with various spectral filtering settings for comparison. CNN and HARP strain maps were compared at the pixel level versus the ground-truth and versus the least-loss in-vivo maps using Pearson correlation coefficients (R) and the median error and Inter-Quartile Range (IQR) histograms. RESULTS CNN-based local patch DeepStrain maps at a phantom resolution of 1.1mm × 1.1 mm and in-vivo resolution of 2.1mm × 1.6 mm were artifact-free with multiple fold improvement with εp1 ground-truth median error of 0.009(0.007) vs. 0.32(0.385) using HARP and εp2 ground-truth error of 0.016(0.021) vs. 0.181(0.08) using HARP. CNN-based strain maps showed substantially higher agreement with the ground-truth maps with correlation coefficients R > 0.91 for εp1 and εp2 compared to R < 0.21 and R < 0.82 for HARP-generated maps, respectively. CONCLUSION CNN-generated Eulerian strain mapping permits artifact-free visualization of myocardial function at the native image resolution.
Collapse
Affiliation(s)
- Inas A. Yassine
- Systems and Biomedical Engineering Department, Faculty of Engineering, Cairo University, Egypt
| | - Ahmed M. Ghanem
- Biomedical and Metabolic Imaging Branch, National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK), National Institutes of Health, Bethesda, MD, USA
| | - Nader S. Metwalli
- Biomedical and Metabolic Imaging Branch, National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK), National Institutes of Health, Bethesda, MD, USA
| | - Ahmed Hamimi
- Biomedical and Metabolic Imaging Branch, National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK), National Institutes of Health, Bethesda, MD, USA
| | - Ronald Ouwerkerk
- Biomedical and Metabolic Imaging Branch, National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK), National Institutes of Health, Bethesda, MD, USA
| | - Jatin R. Matta
- Biomedical and Metabolic Imaging Branch, National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK), National Institutes of Health, Bethesda, MD, USA
| | - Michael A. Solomon
- Cardiovascular Branch of the National Heart, Lung, and Blood Institute (NHLBI), NIH, Bethesda, MD, USA.,Critical Care Medicine Department, NIH Clinical Center, Bethesda, MD, USA
| | - Jason M. Elinoff
- Critical Care Medicine Department, NIH Clinical Center, Bethesda, MD, USA
| | - Ahmed M. Gharib
- Biomedical and Metabolic Imaging Branch, National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK), National Institutes of Health, Bethesda, MD, USA
| | - Khaled Z. Abd-Elmoniem
- Biomedical and Metabolic Imaging Branch, National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK), National Institutes of Health, Bethesda, MD, USA,Corresponding author: Khaled Z Abd-Elmoniem, PhD, MHS, Biomedical and Metabolic Imaging Branch, National Institute of Diabetes and Digestive and Kidney Diseases, National Institutes of Health, 10 Center Drive, Bldg. 10, CRC, Rm. 3-5340, Bethesda, MD 20892, Tel: 301-451-8982/Fax: 301-480-3166,
| |
Collapse
|
14
|
Xing F, Liu X, Reese TG, Stone M, Wedeen VJ, Prince JL, El Fakhri G, Woo J. Measuring Strain in Diffusion-Weighted Data Using Tagged Magnetic Resonance Imaging. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2022; 12032:1203205. [PMID: 36777787 PMCID: PMC9911263 DOI: 10.1117/12.2610989] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
Accurate strain measurement in a deforming organ has been essential in motion analysis using medical images. In recent years, internal tissue's in vivo motion and strain computation has been mostly achieved through dynamic magnetic resonance (MR) imaging. However, such data lack information on tissue's intrinsic fiber directions, preventing computed strain tensors from being projected onto a direction of interest. Although diffusion-weighted MR imaging excels at providing fiber tractography, it yields static images unmatched with dynamic MR data. This work reports an algorithm workflow that estimates strain values in the diffusion MR space by matching corresponding tagged dynamic MR images. We focus on processing a dataset of various human tongue deformations in speech. The geometry of tongue muscle fibers is provided by diffusion tractography, while spatiotemporal motion fields are provided by tagged MR analysis. The tongue's deforming shapes are determined by segmenting a synthetic cine dynamic MR sequence generated from tagged data using a deep neural network. Estimated motion fields are transformed into the diffusion MR space using diffeomorphic registration, eventually leading to strain values computed in the direction of muscle fibers. The method was tested on 78 time volumes acquired during three sets of specific tongue deformations including both speech and protrusion motion. Strain in the line of action of seven internal tongue muscles was extracted and compared both intra- and inter-subject. Resulting compression and stretching patterns of individual muscles revealed the unique behavior of individual muscles and their potential activation pattern.
Collapse
Affiliation(s)
- Fangxu Xing
- Department of Radiology, Massachusetts General Hospital/Harvard Medical School, Boston, MA, US 02114
| | - Xiaofeng Liu
- Department of Radiology, Massachusetts General Hospital/Harvard Medical School, Boston, MA, US 02114
| | - Timothy G. Reese
- Department of Radiology, Massachusetts General Hospital/Harvard Medical School, Boston, MA, US 02114
| | - Maureen Stone
- Department of Neural and Pain Sciences, University of Maryland School of Dentistry, Baltimore, MD, US 21201
| | - Van J. Wedeen
- Department of Radiology, Massachusetts General Hospital/Harvard Medical School, Boston, MA, US 02114
| | - Jerry L. Prince
- Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD, US 21218
| | - Georges El Fakhri
- Department of Radiology, Massachusetts General Hospital/Harvard Medical School, Boston, MA, US 02114
| | - Jonghye Woo
- Department of Radiology, Massachusetts General Hospital/Harvard Medical School, Boston, MA, US 02114
| |
Collapse
|
15
|
Direct pixel to pixel principal strain mapping from tagging MRI using end to end deep convolutional neural network (DeepStrain). Sci Rep 2021; 11:23021. [PMID: 34836988 PMCID: PMC8626490 DOI: 10.1038/s41598-021-02279-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2021] [Accepted: 10/26/2021] [Indexed: 11/08/2022] Open
Abstract
Regional soft tissue mechanical strain offers crucial insights into tissue's mechanical function and vital indicators for different related disorders. Tagging magnetic resonance imaging (tMRI) has been the standard method for assessing the mechanical characteristics of organs such as the heart, the liver, and the brain. However, constructing accurate artifact-free pixelwise strain maps at the native resolution of the tagged images has for decades been a challenging unsolved task. In this work, we developed an end-to-end deep-learning framework for pixel-to-pixel mapping of the two-dimensional Eulerian principal strains [Formula: see text] and [Formula: see text] directly from 1-1 spatial modulation of magnetization (SPAMM) tMRI at native image resolution using convolutional neural network (CNN). Four different deep learning conditional generative adversarial network (cGAN) approaches were examined. Validations were performed using Monte Carlo computational model simulations, and in-vivo datasets, and compared to the harmonic phase (HARP) method, a conventional and validated method for tMRI analysis, with six different filter settings. Principal strain maps of Monte Carlo tMRI simulations with various anatomical, functional, and imaging parameters demonstrate artifact-free solid agreements with the corresponding ground-truth maps. Correlations with the ground-truth strain maps were R = 0.90 and 0.92 for the best-proposed cGAN approach compared to R = 0.12 and 0.73 for the best HARP method for [Formula: see text] and [Formula: see text], respectively. The proposed cGAN approach's error was substantially lower than the error in the best HARP method at all strain ranges. In-vivo results are presented for both healthy subjects and patients with cardiac conditions (Pulmonary Hypertension). Strain maps, obtained directly from their corresponding tagged MR images, depict for the first time anatomical, functional, and temporal details at pixelwise native high resolution with unprecedented clarity. This work demonstrates the feasibility of using the deep learning cGAN for direct myocardial and liver Eulerian strain mapping from tMRI at native image resolution with minimal artifacts.
Collapse
|
16
|
Berberoğlu E, Stoeck CT, Moireau P, Kozerke S, Genet M. In-silico study of accuracy and precision of left-ventricular strain quantification from 3D tagged MRI. PLoS One 2021; 16:e0258965. [PMID: 34739495 PMCID: PMC8570486 DOI: 10.1371/journal.pone.0258965] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2021] [Accepted: 10/08/2021] [Indexed: 11/18/2022] Open
Abstract
Cardiac Magnetic Resonance Imaging (MRI) allows quantifying myocardial tissue deformation and strain based on the tagging principle. In this work, we investigate accuracy and precision of strain quantification from synthetic 3D tagged MRI using equilibrated warping. To this end, synthetic biomechanical left-ventricular tagged MRI data with varying tag distance, spatial resolution and signal-to-noise ratio (SNR) were generated and processed to quantify errors in radial, circumferential and longitudinal strains relative to ground truth. Results reveal that radial strain is more sensitive to image resolution and noise than the other strain components. The study also shows robustness of quantifying circumferential and longitudinal strain in the presence of geometrical inconsistencies of 3D tagged data. In conclusion, our study points to the need for higher-resolution 3D tagged MRI than currently available in practice in order to achieve sufficient accuracy of radial strain quantification.
Collapse
Affiliation(s)
- Ezgi Berberoğlu
- Institute for Biomedical Engineering, University and ETH Zurich, Zurich, Switzerland
| | - Christian T. Stoeck
- Institute for Biomedical Engineering, University and ETH Zurich, Zurich, Switzerland
| | - Philippe Moireau
- MΞDISIM team, Inria, Palaiseau, France
- Laboratoire de Mécanique des Solides (LMS), École Polytechnique, C.N.R.S., Institut Polytechnique de Paris, Palaiseau, France
| | - Sebastian Kozerke
- Institute for Biomedical Engineering, University and ETH Zurich, Zurich, Switzerland
| | - Martin Genet
- MΞDISIM team, Inria, Palaiseau, France
- Laboratoire de Mécanique des Solides (LMS), École Polytechnique, C.N.R.S., Institut Polytechnique de Paris, Palaiseau, France
- * E-mail:
| |
Collapse
|
17
|
Maso Talou GD, Babarenda Gamage TP, Nash MP. Efficient Ventricular Parameter Estimation Using AI-Surrogate Models. Front Physiol 2021; 12:732351. [PMID: 34721062 PMCID: PMC8551833 DOI: 10.3389/fphys.2021.732351] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2021] [Accepted: 09/17/2021] [Indexed: 12/02/2022] Open
Abstract
The onset and progression of pathological heart conditions, such as cardiomyopathy or heart failure, affect its mechanical behaviour due to the remodelling of the myocardial tissues to preserve its functional response. Identification of the constitutive properties of heart tissues could provide useful biomarkers to diagnose and assess the progression of disease. We have previously demonstrated the utility of efficient AI-surrogate models to simulate passive cardiac mechanics. Here, we propose the use of this surrogate model for the identification of myocardial mechanical properties and intra-ventricular pressure by solving an inverse problem with two novel AI-based approaches. Our analysis concluded that: (i) both approaches were robust toward Gaussian noise when the ventricle data for multiple loading conditions were combined; and (ii) estimates of one and two parameters could be obtained in less than 9 and 18 s, respectively. The proposed technique yields a viable option for the translation of cardiac mechanics simulations and biophysical parameter identification methods into the clinic to improve the diagnosis and treatment of heart pathologies. In addition, the proposed estimation techniques are general and can be straightforwardly translated to other applications involving different anatomical structures.
Collapse
Affiliation(s)
- Gonzalo D Maso Talou
- Auckland Bioengineering Institute, University of Auckland, Auckland, New Zealand
| | | | - Martyn P Nash
- Auckland Bioengineering Institute, University of Auckland, Auckland, New Zealand.,Department of Engineering Science, University of Auckland, Auckland, New Zealand
| |
Collapse
|
18
|
Loecher M, Perotti LE, Ennis DB. Using synthetic data generation to train a cardiac motion tag tracking neural network. Med Image Anal 2021; 74:102223. [PMID: 34555661 DOI: 10.1016/j.media.2021.102223] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2021] [Revised: 07/15/2021] [Accepted: 09/01/2021] [Indexed: 11/28/2022]
Abstract
A CNN based method for cardiac MRI tag tracking was developed and validated. A synthetic data simulator was created to generate large amounts of training data using natural images, a Bloch equation simulation, a broad range of tissue properties, and programmed ground-truth motion. The method was validated using both an analytical deforming cardiac phantom and in vivo data with manually tracked reference motion paths. In the analytical phantom, error was investigated relative to SNR, and accurate results were seen for SNR>10 (displacement error <0.3 mm). Excellent agreement was seen in vivo for tag locations (mean displacement difference = -0.02 pixels, 95% CI [-0.73, 0.69]) and calculated cardiac circumferential strain (mean difference = 0.006, 95% CI [-0.012, 0.024]). Automated tag tracking with a CNN trained on synthetic data is both accurate and precise.
Collapse
Affiliation(s)
| | - Luigi E Perotti
- Department of Mechanical and Aerospace Engineering, University of Central Florida, USA
| | - Daniel B Ennis
- Department of Radiology, Stanford University, USA; Cardiovascular Institute, Stanford University, USA; Center for Artificial Intelligence in Medicine & Imaging, Stanford University, USA
| |
Collapse
|
19
|
Wu J, Yang X, Gan Z. Left ventricle motion estimation for cine MR images using sparse representation with shape constraint. Phys Med 2021; 87:49-64. [PMID: 34116317 DOI: 10.1016/j.ejmp.2021.05.026] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/10/2020] [Revised: 05/12/2021] [Accepted: 05/17/2021] [Indexed: 11/17/2022] Open
Abstract
PURPOSE To propose a left ventricle (LV) motion estimation method based on sparse representation, in order to handle the spatial-varying intensity distortions caused by tissue deformation. METHODS For each myocardial landmark, an adaptive dictionary was generated by learning transformations from a training dataset. Then the landmark was tracked using sparse representation. Next, a point distribution model was applied to the overall tracking results. Finally, the dense displacement field of the LV myocardium was estimated based on the correspondence between each landmark. Using the dense displacement field estimated, the circumferential strain was calculated to assess the myocardial function. The performance of the proposed method was quantified by the average perpendicular distance (APD), the Dice metric, and the mean symmetric contour distance (SCD). RESULTS Comparing to the state-of-the-art techniques, the smallest value of APD and SCD, and the highest value of Dice can be obtained using the proposed method, for three public cardiac datasets. Moreover, the mean value of strain difference between the proposed method and the commercial software Medis Suite MR was -0.01, while the intraclass correlation coefficient between these two methods was 0.91. CONCLUSIONS The proposed method could estimate the dense displacement field of the LV accurately, which outperforms other state-of-the-art techniques. The circumferential strain derived from the proposed method was in excellent agreement with that derived from the Medis Suite MR software, while segmental strain abnormalities were detected for most of the subjects with heart diseases, which indicates the potential of the proposed method for clinical usage.
Collapse
Affiliation(s)
- Junhao Wu
- Department of Computer Science, Shantou University, Shantou, Guangdong, China.
| | - Xuan Yang
- College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, Guangdong, China.
| | - Ziyu Gan
- College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, Guangdong, China
| |
Collapse
|
20
|
Mella H, Mura J, Wang H, Taylor MD, Chabiniok R, Tintera J, Sotelo J, Uribe S. HARP-I: A Harmonic Phase Interpolation Method for the Estimation of Motion From Tagged MR Images. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:1240-1252. [PMID: 33434127 DOI: 10.1109/tmi.2021.3051092] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
We proposed a novel method called HARP-I, which enhances the estimation of motion from tagged Magnetic Resonance Imaging (MRI). The harmonic phase of the images is unwrapped and treated as noisy measurements of reference coordinates on a deformed domain, obtaining motion with high accuracy using Radial Basis Functions interpolations. Results were compared against Shortest Path HARP Refinement (SP-HR) and Sine-wave Modeling (SinMod), two harmonic image-based techniques for motion estimation from tagged images. HARP-I showed a favorable similarity with both methods under noise-free conditions, whereas a more robust performance was found in the presence of noise. Cardiac strain was better estimated using HARP-I at almost any motion level, giving strain maps with less artifacts. Additionally, HARP-I showed better temporal consistency as a new method was developed to fix phase jumps between frames. In conclusion, HARP-I showed to be a robust method for the estimation of motion and strain under ideal and non-ideal conditions.
Collapse
|
21
|
Qu YY, Paul J, Li H, Ma GS, Buckert D, Rasche V. Left ventricular myocardial strain quantification with two- and three-dimensional cardiovascular magnetic resonance based tissue tracking. Quant Imaging Med Surg 2021; 11:1421-1436. [PMID: 33816179 DOI: 10.21037/qims-20-635] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
Abstract
Background Cardiovascular magnetic resonance based tissue tracking (CMR-TT) was reported to provide detailed insight into left ventricular (LV) contractile function and deformation with both of two- and three-dimensional (2/3D) algorithms. This study was designed to investigate the feasibility and reproducibility of these two techniques for measuring LV global and segmental strain, and establish gender- and age-related reference values of global multi-dimensional peak strains among large healthy population. Methods We retrospectively recruited 150 healthy volunteers (75 males/females) and divided them into three age groups (G20-40, G41-60 and G61-80). LV global mean and peak strains as well as segmental strains in radial, circumferential and longitudinal directions were derived from post-hoc 2/3D CMR-TT analysis of standard steady-state free precession (SSFP) cine images acquired at 1.5T field strength. Results Both 2D and 3D CMR-TT modalities enable the tracking of LV myocardial tissues and generate global and segmental strain data. By comparison, 3D CMR-TT was more feasible in measuring segmental deformation since it could generate values at all segments. The amplitudes of LV 3D global peak strain were the smallest among those of 2/3D corresponding global mean or peak strains except in the radial direction, and was highly correlated with 2D global mean strains (correlation coefficient r=0.71-0.90), 2D global peak strains (r=0.75-0.89) and 3D global mean strains (all r=0.99). In healthy cohort, LV 3D global peak values were 44.4%±13.0% for radial, -17.0%±2.7% for circumferential and -15.4%±2.3% for longitudinal strain. Females showed significantly larger amplitude of strains than males, especially in G61-80 (P<0.05). The subjects in G61-80 showed larger amplitude of strains than the volunteers in younger groups. The intra- and inter-observer agreement of 2/3D CMR-TT analysis in evaluating LV myocardial global deformation was better than segmental measurement. Conclusions CMR-TT is a feasible and reproducible technique for assessing LV myocardial deformation, especially at the global level. The establishment of specific reference values of LV global and segmental systolic strains and the investigation of dimension-, gender- and age-related differences provide a fundamental insight into the features of LV contraction and works as an essential step in clinical routine.
Collapse
Affiliation(s)
- Yang-Yang Qu
- Internal Medicine II, Ulm University Medical Center, Ulm, Germany.,Department of Cardiology, Zhongda Hospital, School of Medicine, Southeast University, Nanjing, China
| | - Jan Paul
- Internal Medicine II, Ulm University Medical Center, Ulm, Germany
| | - Hao Li
- Internal Medicine II, Ulm University Medical Center, Ulm, Germany
| | - Gen-Shan Ma
- Department of Cardiology, Zhongda Hospital, School of Medicine, Southeast University, Nanjing, China
| | - Dominik Buckert
- Internal Medicine II, Ulm University Medical Center, Ulm, Germany
| | - Volker Rasche
- Internal Medicine II, Ulm University Medical Center, Ulm, Germany
| |
Collapse
|
22
|
Brunet J, Pierrat B, Badel P. Review of Current Advances in the Mechanical Description and Quantification of Aortic Dissection Mechanisms. IEEE Rev Biomed Eng 2021; 14:240-255. [PMID: 31905148 DOI: 10.1109/rbme.2019.2950140] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
Aortic dissection is a life-threatening event associated with a very poor outcome. A number of complex phenomena are involved in the initiation and propagation of the disease. Advances in the comprehension of the mechanisms leading to dissection have been made these last decades, thanks to improvements in imaging and experimental techniques. However, the micro-mechanics involved in triggering such rupture events remains poorly described and understood. It constitutes the primary focus of the present review. Towards the goal of detailing the dissection phenomenon, different experimental and modeling methods were used to investigate aortic dissection, and to understand the underlying phenomena involved. In the last ten years, research has tended to focus on the influence of microstructure on initiation and propagation of the dissection, leading to a number of multiscale models being developed. This review brings together all these materials in an attempt to identify main advances and remaining questions.
Collapse
|
23
|
Wu J, Gan Z, Guo W, Yang X, Lin A. A fully convolutional network feature descriptor: Application to left ventricle motion estimation based on graph matching in short-axis MRI. Neurocomputing 2020. [DOI: 10.1016/j.neucom.2018.10.101] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/17/2023]
|
24
|
Zou H, Leng S, Xi C, Zhao X, Koh AS, Gao F, Tan JL, Tan RS, Allen JC, Lee LC, Genet M, Zhong L. Three-dimensional biventricular strains in pulmonary arterial hypertension patients using hyperelastic warping. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2020; 189:105345. [PMID: 31982668 PMCID: PMC7198336 DOI: 10.1016/j.cmpb.2020.105345] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/16/2019] [Revised: 01/16/2020] [Accepted: 01/16/2020] [Indexed: 06/10/2023]
Abstract
BACKGROUND AND OBJECTIVE Evaluation of biventricular function is an essential component of clinical management in pulmonary arterial hypertension (PAH). This study aims to examine the utility of biventricular strains derived from a model-to-image registration technique in PAH patients in comparison to age- and gender-matched normal controls. METHODS A three-dimensional (3D) model was reconstructed from cine short- and long-axis cardiac magnetic resonance (CMR) images and subsequently partitioned into right ventricle (RV), left ventricle (LV) and septum. The hyperelastic warping method was used to register the meshed biventricular finite element model throughout the cardiac cycle and obtain the corresponding biventricular circumferential, longitudinal and radial strains. RESULTS Intra- and inter-observer reproducibility of biventricular strains was excellent with all intra-class correlation coefficients > 0.84. 3D biventricular longitudinal, circumferential and radial strains for RV, LV and septum were significantly decreased in PAH patients compared with controls. Receiver operating characteristic (ROC) analysis showed that the 3D biventricular strains were better early markers (Area under the ROC curve = 0.96 for RV longitudinal strain) of ventricular dysfunction than conventional parameters such as two-dimensional strains and ejection fraction. CONCLUSIONS Our highly reproducible methodology holds potential for extending CMR imaging to characterize 3D biventricular strains, eventually leading to deeper understanding of biventricular mechanics in PAH.
Collapse
Affiliation(s)
- Hua Zou
- National Heart Research Institute Singapore, National Heart Centre Singapore, Singapore
| | - Shuang Leng
- National Heart Research Institute Singapore, National Heart Centre Singapore, Singapore
| | - Ce Xi
- Department of Mechanical Engineering, Michigan State University, MI, United States
| | - Xiaodan Zhao
- National Heart Research Institute Singapore, National Heart Centre Singapore, Singapore
| | - Angela S Koh
- National Heart Research Institute Singapore, National Heart Centre Singapore, Singapore; Duke-NUS Medical School, Singapore
| | - Fei Gao
- National Heart Research Institute Singapore, National Heart Centre Singapore, Singapore
| | - Ju Le Tan
- National Heart Research Institute Singapore, National Heart Centre Singapore, Singapore; Duke-NUS Medical School, Singapore
| | - Ru-San Tan
- National Heart Research Institute Singapore, National Heart Centre Singapore, Singapore; Duke-NUS Medical School, Singapore
| | | | - Lik Chuan Lee
- Department of Mechanical Engineering, Michigan State University, MI, United States
| | - Martin Genet
- Mechanics Department & Solid Mechanics Laboratory, École Polytechnique (Paris-Saclay University), Palaiseau, France; M3DISIM research team, INRIA (Paris-Saclay University), Palaiseau, France
| | - Liang Zhong
- National Heart Research Institute Singapore, National Heart Centre Singapore, Singapore; Duke-NUS Medical School, Singapore.
| |
Collapse
|
25
|
Verzhbinsky IA, Perotti LE, Moulin K, Cork TE, Loecher M, Ennis DB. Estimating Aggregate Cardiomyocyte Strain Using In Vivo Diffusion and Displacement Encoded MRI. IEEE TRANSACTIONS ON MEDICAL IMAGING 2020; 39:656-667. [PMID: 31398112 PMCID: PMC7325525 DOI: 10.1109/tmi.2019.2933813] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Changes in left ventricular (LV) aggregate cardiomyocyte orientation and deformation underlie cardiac function and dysfunction. As such, in vivo aggregate cardiomyocyte "myofiber" strain ( [Formula: see text]) has mechanistic significance, but currently there exists no established technique to measure in vivo [Formula: see text]. The objective of this work is to describe and validate a pipeline to compute in vivo [Formula: see text] from magnetic resonance imaging (MRI) data. Our pipeline integrates LV motion from multi-slice Displacement ENcoding with Stimulated Echoes (DENSE) MRI with in vivo LV microstructure from cardiac Diffusion Tensor Imaging (cDTI) data. The proposed pipeline is validated using an analytical deforming heart-like phantom. The phantom is used to evaluate 3D cardiac strains computed from a widely available, open-source DENSE Image Analysis Tool. Phantom evaluation showed that a DENSE MRI signal-to-noise ratio (SNR) ≥20 is required to compute [Formula: see text] with near-zero median strain bias and within a strain tolerance of 0.06. Circumferential and longitudinal strains are also accurately measured under the same SNR requirements, however, radial strain exhibits a median epicardial bias of -0.10 even in noise-free DENSE data. The validated framework is applied to experimental DENSE MRI and cDTI data acquired in eight ( N=8 ) healthy swine. The experimental study demonstrated that [Formula: see text] has decreased transmural variability compared to radial and circumferential strains. The spatial uniformity and mechanistic significance of in vivo [Formula: see text] make it a compelling candidate for characterization and early detection of cardiac dysfunction.
Collapse
|
26
|
Manohar A, Rossini L, Colvert G, Vigneault DM, Contijoch F, Chen MY, del Alamo JC, McVeigh ER. Regional dynamics of fractal dimension of the left ventricular endocardium from cine computed tomography images. J Med Imaging (Bellingham) 2019; 6:046002. [PMID: 31737745 PMCID: PMC6838603 DOI: 10.1117/1.jmi.6.4.046002] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2019] [Accepted: 10/14/2019] [Indexed: 11/14/2022] Open
Abstract
We present a method to leverage the high fidelity of computed tomography (CT) to quantify regional left ventricular function using topography variation of the endocardium as a surrogate measure of strain. 4DCT images of 10 normal and 10 abnormal subjects, acquired with standard clinical protocols, are used. The topography of the endocardium is characterized by its regional values of fractal dimension (F D ), computed using a box-counting algorithm developed in-house. The averageF D in each of the 16 American Heart Association segments is calculated for each subject as a function of time over the cardiac cycle. The normal subjects show a peak systolic percentage change inF D of 5.9 % ± 2 % in all free-wall segments, whereas the abnormal cohort experiences a change of 2 % ± 1.2 % ( p < 0.00001 ). Septal segments, being smooth, do not undergo large changes inF D . Additionally, a principal component analysis is performed on the temporal profiles ofF D to highlight the possibility for unsupervised classification of normal and abnormal function. The method developed is free from manual contouring and does not require any feature tracking or registration algorithms. TheF D values in the free-wall segments correlated well with radial strain and with endocardial regional shortening measurements.
Collapse
Affiliation(s)
- Ashish Manohar
- University of California San Diego, Department of Mechanical and Aerospace Engineering, La Jolla, California, United States
| | - Lorenzo Rossini
- University of California San Diego, Department of Mechanical and Aerospace Engineering, La Jolla, California, United States
| | - Gabrielle Colvert
- University of California San Diego, Department of Bioengineering, La Jolla, California, United States
| | - Davis M. Vigneault
- University of California San Diego, Department of Bioengineering, La Jolla, California, United States
| | - Francisco Contijoch
- University of California San Diego, Department of Bioengineering, La Jolla, California, United States
- University of California San Diego, Department of Radiology, La Jolla, California, United States
| | - Marcus Y. Chen
- National Heart, Lung, and Blood Institute, National Institutes of Health, Laboratory of Cardiac Energetics, Bethesda, Maryland, United States
| | - Juan C. del Alamo
- University of California San Diego, Department of Mechanical and Aerospace Engineering, La Jolla, California, United States
| | - Elliot R. McVeigh
- University of California San Diego, Department of Bioengineering, La Jolla, California, United States
- University of California San Diego, Department of Radiology, La Jolla, California, United States
- University of California San Diego, Cardiology Division, Department of Medicine, La Jolla, California, United States
| |
Collapse
|
27
|
Manohar A, Colvert GM, Schluchter A, Contijoch F, McVeigh ER. Anthropomorphic left ventricular mesh phantom: a framework to investigate the accuracy of SQUEEZ using Coherent Point Drift for the detection of regional wall motion abnormalities. J Med Imaging (Bellingham) 2019; 6:045001. [PMID: 31824981 PMCID: PMC6903427 DOI: 10.1117/1.jmi.6.4.045001] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2019] [Accepted: 11/18/2019] [Indexed: 11/14/2022] Open
Abstract
We present an anthropomorphically accurate left ventricular (LV) phantom derived from human computed tomography (CT) data to serve as the ground truth for the optimization and the spatial resolution quantification of a CT-derived regional strain metric (SQUEEZ) for the detection of regional wall motion abnormalities. Displacements were applied to the mesh points of a clinically derived end-diastolic LV mesh to create analytical end-systolic poses with physiologically accurate endocardial strains. Normal function and regional dysfunction of four sizes [1, 2/3, 1/2, and 1/3 American Heart Association (AHA) segments as core diameter], each exhibiting hypokinesia (70% reduction in strain) and subtle hypokinesia (40% reduction in strain), were simulated. Regional shortening (RS CT ) estimates were obtained by registering the end-diastolic mesh to each simulated end-systolic mesh condition using a nonrigid registration algorithm. Ground-truth models of normal function and of hypokinesia were used to identify the optimal parameters in the registration algorithm and to measure the accuracy of detecting regional dysfunction of varying sizes and severities. For normal LV function,RS CT values in all 16 AHA segments were accurate to within ± 5 % . For cases with regional dysfunction, the errors inRS CT around the dysfunctional region increased with decreasing size of dysfunctional tissue.
Collapse
Affiliation(s)
- Ashish Manohar
- University of California San Diego, Department of Mechanical and Aerospace Engineering, La Jolla, California, United States
| | - Gabrielle M. Colvert
- University of California San Diego, Department of Bioengineering, La Jolla, California, United States
| | - Andrew Schluchter
- University of California San Diego, Department of Bioengineering, La Jolla, California, United States
| | - Francisco Contijoch
- University of California San Diego, Department of Bioengineering, La Jolla, California, United States
- University of California San Diego, Department of Radiology, La Jolla, California, United States
| | - Elliot R. McVeigh
- University of California San Diego, Department of Bioengineering, La Jolla, California, United States
- University of California San Diego, Department of Radiology, La Jolla, California, United States
- University of California San Diego, Cardiology Division, Department of Medicine, La Jolla, California, United States
| |
Collapse
|
28
|
Bhalodiya JM, Palit A, Ferrante E, Tiwari MK, Bhudia SK, Arvanitis TN, Williams MA. Hierarchical Template Matching for 3D Myocardial Tracking and Cardiac Strain Estimation. Sci Rep 2019; 9:12450. [PMID: 31462651 PMCID: PMC6713749 DOI: 10.1038/s41598-019-48927-2] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2019] [Accepted: 08/14/2019] [Indexed: 11/09/2022] Open
Abstract
Myocardial tracking and strain estimation can non-invasively assess cardiac functioning using subject-specific MRI. As the left-ventricle does not have a uniform shape and functioning from base to apex, the development of 3D MRI has provided opportunities for simultaneous 3D tracking, and 3D strain estimation. We have extended a Local Weighted Mean (LWM) transformation function for 3D, and incorporated in a Hierarchical Template Matching model to solve 3D myocardial tracking and strain estimation problem. The LWM does not need to solve a large system of equations, provides smooth displacement of myocardial points, and adapt local geometric differences in images. Hence, 3D myocardial tracking can be performed with 1.49 mm median error, and without large error outliers. The maximum error of tracking is up to 24% reduced compared to benchmark methods. Moreover, the estimated strain can be insightful to improve 3D imaging protocols, and the computer code of LWM could also be useful for geo-spatial and manufacturing image analysis researchers.
Collapse
Affiliation(s)
- Jayendra M Bhalodiya
- Warwick Manufacturing Group (WMG), University of Warwick, CV4 7AL, Coventry, United Kingdom.
| | - Arnab Palit
- Warwick Manufacturing Group (WMG), University of Warwick, CV4 7AL, Coventry, United Kingdom
| | - Enzo Ferrante
- Instituto de Investigación en Señales, Sistemas e Inteligencia Computacional, sinc(i), FICH-UNL/CONICET, Santa Fe, Argentina
| | - Manoj K Tiwari
- Indian Institute of Technology Kharagpur, 721302, Kharagpur, West Bengal, India
| | - Sunil K Bhudia
- Royal Brompton and Harefield NHS Foundation Trust, SW3 6NP, London, United Kingdom
| | - Theodoros N Arvanitis
- Institute of Digital Healthcare, WMG, University of Warwick, CV4 7AL, Coventry, United Kingdom
| | - Mark A Williams
- Warwick Manufacturing Group (WMG), University of Warwick, CV4 7AL, Coventry, United Kingdom
| |
Collapse
|
29
|
Wang L, Clarysse P, Liu Z, Gao B, Liu W, Croisille P, Delachartre P. A gradient-based optical-flow cardiac motion estimation method for cine and tagged MR images. Med Image Anal 2019; 57:136-148. [PMID: 31302510 DOI: 10.1016/j.media.2019.06.016] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2017] [Revised: 06/27/2019] [Accepted: 06/27/2019] [Indexed: 11/25/2022]
Abstract
A new method is proposed to quantify the myocardial motion from both 2D C(ine)-MRI and T(agged)-MRI sequences. The tag pattern offers natural landmarks within the image that makes it possible to accurately quantify the motion within the myocardial wall. Therefore, several methods have been proposed for T-MRI. However, the lack of salient features within the cardiac wall in C-MRI hampers local motion estimation. Our method aims to ensure the local intensity and shape features invariance during motion through the iterative minimization of a cost function via a random walk scheme. The proposed approach is evaluated on realistic simulated C-MRI and T-MRI sequences. The results show more than 53% improvements on displacement estimation, and more than 24% on strain estimation for both C-MRI and T-MRI sequences, as compared to state-of-the-art cardiac motion estimators. Preliminary experiments on clinical data have shown a good ability of the proposed method to detect abnormal motion patterns related to pathology. If those results are confirmed on large databases, this would open up the possibility for more accurate diagnosis of cardiac function from standard C-MRI examinations and also the retrospective study of prior studies.
Collapse
Affiliation(s)
- Liang Wang
- Univ Lyon, INSA-Lyon, Université Lyon 1, UJM-Saint Etienne, CNRS, Inserm, CREATIS UMR 5220, U1206, F-69621, LYON, France.
| | - Patrick Clarysse
- Univ Lyon, INSA-Lyon, Université Lyon 1, UJM-Saint Etienne, CNRS, Inserm, CREATIS UMR 5220, U1206, F-69621, LYON, France
| | - Zhengjun Liu
- Metislab, LIA CNRS, Harbin Institute of Technology, Harbin 150001, People's Republic of China
| | - Bin Gao
- Metislab, LIA CNRS, Harbin Institute of Technology, Harbin 150001, People's Republic of China; College of data science and technology, Heilongjiang University, Harbin 150080, People's Republic of China
| | - Wanyu Liu
- Metislab, LIA CNRS, Harbin Institute of Technology, Harbin 150001, People's Republic of China
| | - Pierre Croisille
- Univ Lyon, INSA-Lyon, Université Lyon 1, UJM-Saint Etienne, CNRS, Inserm, CREATIS UMR 5220, U1206, F-69621, LYON, France; Department of Radiology, University Hospital of Saint-Etienne, Université Jean-Monnet, Saint-Etienne, France
| | - Philippe Delachartre
- Univ Lyon, INSA-Lyon, Université Lyon 1, UJM-Saint Etienne, CNRS, Inserm, CREATIS UMR 5220, U1206, F-69621, LYON, France
| |
Collapse
|
30
|
Regional Myocardial Strain and Function: From Novel Techniques to Clinical Applications. ACTA ACUST UNITED AC 2019. [DOI: 10.1007/978-1-4939-8841-9_5] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/19/2023]
|
31
|
Xu C, Xu L, Gao Z, Zhao S, Zhang H, Zhang Y, Du X, Zhao S, Ghista D, Liu H, Li S. Direct delineation of myocardial infarction without contrast agents using a joint motion feature learning architecture. Med Image Anal 2018; 50:82-94. [DOI: 10.1016/j.media.2018.09.001] [Citation(s) in RCA: 75] [Impact Index Per Article: 10.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2017] [Revised: 08/25/2018] [Accepted: 09/05/2018] [Indexed: 11/28/2022]
|
32
|
Queiros S, Morais P, Barbosa D, Fonseca JC, Vilaca JL, D'Hooge J. MITT: Medical Image Tracking Toolbox. IEEE TRANSACTIONS ON MEDICAL IMAGING 2018; 37:2547-2557. [PMID: 29993570 DOI: 10.1109/tmi.2018.2840820] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
Over the years, medical image tracking has gained considerable attention from both medical and research communities due to its widespread utility in a multitude of clinical applications, from functional assessment during diagnosis and therapy planning to structure tracking or image fusion during image-guided interventions. Despite the ever-increasing number of image tracking methods available, most still consist of independent implementations with specific target applications, lacking the versatility to deal with distinct end-goals without the need for methodological tailoring and/or exhaustive tuning of numerous parameters. With this in mind, we have developed the medical image tracking toolbox (MITT)-a software package designed to ease customization of image tracking solutions in the medical field. While its workflow principles make it suitable to work with 2-D or 3-D image sequences, its modules offer versatility to set up computationally efficient tracking solutions, even for users with limited programming skills. MITT is implemented in both C/C++ and MATLAB, including several variants of an object-based image tracking algorithm and allowing to track multiple types of objects (i.e., contours, multi-contours, surfaces, and multi-surfaces) with several customization features. In this paper, the toolbox is presented, its features discussed, and illustrative examples of its usage in the cardiology field provided, demonstrating its versatility, simplicity, and time efficiency.
Collapse
|
33
|
Genet M, Stoeck CT, von Deuster C, Lee LC, Kozerke S. Equilibrated warping: Finite element image registration with finite strain equilibrium gap regularization. Med Image Anal 2018; 50:1-22. [PMID: 30173000 DOI: 10.1016/j.media.2018.07.007] [Citation(s) in RCA: 28] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2017] [Revised: 07/21/2018] [Accepted: 07/24/2018] [Indexed: 01/30/2023]
Abstract
In this paper, we propose a novel continuum finite strain formulation of the equilibrium gap regularization for image registration. The equilibrium gap regularization essentially penalizes any deviation from the solution of a hyperelastic body in equilibrium with arbitrary loads prescribed at the boundary. It thus represents a regularization with strong mechanical basis, especially suited for cardiac image analysis. We describe the consistent linearization and discretization of the regularized image registration problem, in the framework of the finite elements method. The method is implemented using FEniCS & VTK, and distributed as a freely available python library. We show that the equilibrated warping method is effective and robust: regularization strength and image noise have minimal impact on motion tracking, especially when compared to strain-based regularization methods such as hyperelastic warping. We also show that equilibrated warping is able to extract main deformation features on both tagged and untagged cardiac magnetic resonance images.
Collapse
Affiliation(s)
- M Genet
- Laboratoire de Mécanique des Solides, École Polytechnique/C.N.R.S./Université Paris-Saclay, Palaiseau, France; M3DISIM team, Inria / Université Paris-Saclay, Palaiseau, France.
| | - C T Stoeck
- Institute for Biomedical Engineering, University and ETH Zurich, Switzerland
| | - C von Deuster
- Institute for Biomedical Engineering, University and ETH Zurich, Switzerland
| | - L C Lee
- Department of Mechanical Engineering, Michigan State University, East Lansing, USA
| | - S Kozerke
- Institute for Biomedical Engineering, University and ETH Zurich, Switzerland
| |
Collapse
|
34
|
Left ventricular MRI wall motion assessment by monogenic signal amplitude image computation. Magn Reson Imaging 2018; 54:109-118. [PMID: 30118827 DOI: 10.1016/j.mri.2018.08.004] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2017] [Revised: 07/24/2018] [Accepted: 08/14/2018] [Indexed: 11/22/2022]
Abstract
BACKGROUND Cardiac Magnetic Resonance Imaging (MRI) is the commonly used technique for the assessment of left ventricular (LV) function. Apart manually or semi-automatically contouring LV boundaries for quantification of By visual interpretation of cine images, assessment of regional wall motion is performed by visual interpretation of cine images, thus relying on an experience-dependent and subjective modality. OBJECTIVE The aim of this work is to describe a novel algorithm based on the computation of the monogenic amplitude image to be utilized in conjunction with conventional cine-MRI visualization to assess LV motion abnormalities and to validate it against gold standard expert visual interpretation. METHODS The proposed method uses a recent image processing tool called "monogenic signal" to decompose the MR images into features, which are relevant for motion estimation. Wall motion abnormalities are quantified locally by measuring the temporal variations of the monogenic signal amplitude. The new method was validated by two non-expert radiologists using a wall motion scoring without and with the computed image, and compared against the expert interpretation. The proposed approach was tested on a population of 40 patients, including 8 subjects with normal ventricular function and 32 pathological cases (20 with myocardial infarction, 9 with myocarditis, and 3 with dilated cardiomyopathy). RESULTS The results show that, for both radiologists, sensitivity, specificity and accuracy of cine-MRI alone were similar and around 59%, 77%, and 71%, respectively. Adding the proposed amplitude image while visualizing the cine MRI images significantly increased both sensitivity, specificity and accuracy up to 75%, 89%, and 84%, respectively. CONCLUSION Accuracy of wall motion interpretation adding amplitude image to conventional visualization was proven feasible and superior to standard image interpretation on the considered population, in inexperienced observers. Adding the amplitude images as a diagnostic tool in clinical routine is likely to improve the detection of myocardial segments presenting a cardiac dysfunction.
Collapse
|
35
|
McLeod K, Tondel K, Calvet L, Sermesant M, Pennec X. Cardiac Motion Evolution Model for Analysis of Functional Changes Using Tensor Decomposition and Cross-Sectional Data. IEEE Trans Biomed Eng 2018; 65:2769-2780. [PMID: 29993424 DOI: 10.1109/tbme.2018.2816519] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Cardiac disease can reduce the ability of the ventricles to function well enough to sustain long-term pumping efficiency. Recent advances in cardiac motion tracking have led to improvements in the analysis of cardiac function. We propose a method to study cohort effects related to age with respect to cardiac function. The proposed approach makes use of a recent method for describing cardiac motion of a given subject using a polyaffine model, which gives a compact parameterization that reliably and accurately describes the cardiac motion across populations. Using this method, a data tensor of motion parameters is extracted for a given population. The partial least squares method for higher order arrays is used to build a model to describe the motion parameters with respect to age, from which a model of motion given age is derived. Based on the cross-sectional statistical analysis with the data tensor of each subject treated as an observation along time, the left ventricular motion over time of Tetralogy of Fallot patients is analysed to understand the temporal evolution of functional abnormalities in this population compared to healthy motion dynamics.
Collapse
|
36
|
Ibrahim ESH, Stojanovska J, Hassanein A, Duvernoy C, Croisille P, Pop-Busui R, Swanson SD. Regional cardiac function analysis from tagged MRI images. Comparison of techniques: Harmonic-Phase (HARP) versus Sinusoidal-Modeling (SinMod) analysis. Magn Reson Imaging 2018; 54:271-282. [PMID: 29777821 DOI: 10.1016/j.mri.2018.05.008] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2017] [Revised: 04/19/2018] [Accepted: 05/15/2018] [Indexed: 11/29/2022]
Abstract
Cardiac MRI tagging is a valuable technique for evaluating regional heart function. Currently, there are a number of different techniques for analyzing the tagged images. Specifically, k-space-based analysis techniques showed to be much faster than image-based techniques, where harmonic-phase (HARP) and sine-wave modeling (SinMod) stand as two famous techniques of the former group, which are frequently used in clinical studies. In this study, we compared HARP and SinMod and studied inter-observer variability between the two techniques for evaluating myocardial strain and apical-to-base torsion in numerical phantom, nine healthy controls, and thirty diabetic patients. Based on the ground-truth numerical phantom measurements (strain = -20% and rotation angle = -4.4°), HARP and SinMod resulted in overestimation (in absolute value terms) of strain by 1% and 5% (strain values), and of rotation angle by 0.4° and 2.0°, respectively. For the in-vivo results, global strain and torsion ranges were -10.6% to -35.3% and 1.8°/cm to 12.7°/cm in patients, and -17.8% to -32.7% and 1.8°/cm to 12.3°/cm in volunteers. On average, SinMod overestimated strain measurements by 5.7% and 5.9% (strain values) in the patients and volunteers, respectively, compared to HARP, and overestimated torsion measurements by 2.9°/cm and 2.5°/cm in the patients and volunteers, respectively, compared to HARP. Location-wise, the ranges for basal, mid-ventricular, and apical strain in patients (volunteers) were -8.4% to -31.5% (-11.6% to -33.3%), -6.3% to -37.2% (-17.8% to -33.3%), and -5.2% to -38.4% (-20.0% to -33.2%), respectively. SinMod overestimated strain in the basal, mid-ventricular, and apical slices by 4.7% (5.7%), 5.9% (5.5%), and 8.9% (6.8%), respectively, compared to HARP in the patients (volunteers). Nevertheless, there existed good correlation between the HARP and SinMod measurements. Finally, there were no significant strain or torsion measurement differences between patients and volunteers. There existed good inter-observer agreement, as all measurement differences lied within the Bland-Altman ± 2 standard-deviation (SD) difference limits. In conclusion, despite the consistency of the results by either HARP or SinMod and acceptable agreement of the generated strain and torsion patterns by both techniques, SinMod systematically overestimated the measurements compared to HARP. Under current operating conditions, the measurements from HARP and SinMod cannot be used interchangeably.
Collapse
|
37
|
Nekooeimehr I, Lai-Yuen S, Bao P, Weitzenfeld A, Hart S. Automated contour tracking and trajectory classification of pelvic organs on dynamic MRI. J Med Imaging (Bellingham) 2018; 5:014008. [PMID: 29651450 DOI: 10.1117/1.jmi.5.1.014008] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2017] [Accepted: 03/12/2018] [Indexed: 11/14/2022] Open
Abstract
A method is presented to automatically track and segment pelvic organs on dynamic magnetic resonance imaging (MRI) followed by multiple-object trajectory classification to improve understanding of pelvic organ prolapse (POP). POP is a major health problem in women where pelvic floor organs fall from their normal position and bulge into the vagina. Dynamic MRI is presently used to analyze the organs' movements, providing complementary support for clinical examination. However, there is currently no automated or quantitative approach to measure the movement of the pelvic organs and their correlation with the severity of prolapse. In the proposed method, organs are first tracked and segmented using particle filters and [Formula: see text]-means clustering with prior information. Then, the trajectories of the pelvic organs are modeled using a coupled switched hidden Markov model to classify the severity of POP. Results demonstrate that the presented method can automatically track and segment pelvic organs with a Dice similarity index above 78% and Hausdorff distance of [Formula: see text] for 94 tested cases while demonstrating correlation between organ movement and POP. This work aims to enable automatic tracking and analysis of multiple deformable structures from images to improve understanding of medical disorders.
Collapse
Affiliation(s)
| | - Susana Lai-Yuen
- University of South Florida, Department of Industrial and Management Systems Engineering, Tampa, Florida, United States
| | - Paul Bao
- University of South Florida, Department of Computer Science and Engineering, Tampa, Florida, United States
| | - Alfredo Weitzenfeld
- University of South Florida, Department of Computer Science and Engineering, Tampa, Florida, United States
| | - Stuart Hart
- University of South Florida, Department of Obstetrics and Gynecology, Tampa, Florida, United States.,Medtronic, Tampa, Florida, United States
| |
Collapse
|
38
|
Gupta V, Lantz J, Henriksson L, Engvall J, Karlsson M, Persson A, Ebbers T. Automated three-dimensional tracking of the left ventricular myocardium in time-resolved and dose-modulated cardiac CT images using deformable image registration. J Cardiovasc Comput Tomogr 2018; 12:139-148. [DOI: 10.1016/j.jcct.2018.01.005] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/18/2017] [Revised: 01/12/2018] [Accepted: 01/22/2018] [Indexed: 12/27/2022]
|
39
|
Zhou Y, Giffard-Roisin S, De Craene M, Camarasu-Pop S, D'Hooge J, Alessandrini M, Friboulet D, Sermesant M, Bernard O. A Framework for the Generation of Realistic Synthetic Cardiac Ultrasound and Magnetic Resonance Imaging Sequences From the Same Virtual Patients. IEEE TRANSACTIONS ON MEDICAL IMAGING 2018; 37:741-754. [PMID: 28574344 DOI: 10.1109/tmi.2017.2708159] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
The use of synthetic sequences is one of the most promising tools for advanced in silico evaluation of the quantification of cardiac deformation and strain through 3-D ultrasound (US) and magnetic resonance (MR) imaging. In this paper, we propose the first simulation framework which allows the generation of realistic 3-D synthetic cardiac US and MR (both cine and tagging) image sequences from the same virtual patient. A state-of-the-art electromechanical (E/M) model was exploited for simulating groundtruth cardiac motion fields ranging from healthy to various pathological cases, including both ventricular dyssynchrony and myocardial ischemia. The E/M groundtruth along with template MR/US images and physical simulators were combined in a unified framework for generating synthetic data. We efficiently merged several warping strategies to keep the full control of myocardial deformations while preserving realistic image texture. In total, we generated 18 virtual patients, each with synthetic 3-D US, cine MR, and tagged MR sequences. The simulated images were evaluated both qualitatively by showing realistic textures and quantitatively by observing myocardial intensity distributions similar to real data. In particular, the US simulation showed a smoother myocardium/background interface than the state-of-the-art. We also assessed the mechanical properties. The pathological subjects were discriminated from the healthy ones by both global indexes (ejection fraction and the global circumferential strain) and regional strain curves. The synthetic database is comprehensive in terms of both pathology and modality, and has a level of realism sufficient for validation purposes. All the 90 sequences are made publicly available to the research community via an open-access database.
Collapse
|
40
|
Zhang H, Gao Z, Xu L, Yu X, Wong KCL, Liu H, Zhuang L, Shi P. A Meshfree Representation for Cardiac Medical Image Computing. IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE 2018; 6:1800212. [PMID: 29531867 PMCID: PMC5794334 DOI: 10.1109/jtehm.2018.2795022] [Citation(s) in RCA: 28] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/09/2017] [Revised: 12/14/2017] [Accepted: 01/09/2018] [Indexed: 12/25/2022]
Abstract
The prominent advantage of meshfree method, is the way to build the representation of computational domain, based on the nodal points without any explicit meshing connectivity. Therefore, meshfree method can conveniently process the numerical computation inside interested domains with large deformation or inhomogeneity. In this paper, we adopt the idea of meshfree representation into cardiac medical image analysis in order to overcome the difficulties caused by large deformation and inhomogeneous materials of the heart. In our implementation, as element-free Galerkin method can efficiently build a meshfree representation using its shape function with moving least square fitting, we apply this meshfree method to handle large deformation or inhomogeneity for solving cardiac segmentation and motion tracking problems. We evaluate the performance of meshfree representation on a synthetic heart data and an in-vivo cardiac MRI image sequence. Results showed that the error of our framework against the ground truth was 0.1189 ± 0.0672 while the error of the traditional FEM was 0.1793 ± 0.1166. The proposed framework has minimal consistency constraints, handling large deformation and material discontinuities are simple and efficient, and it provides a way to avoid the complicated meshing procedures while preserving the accuracy with a relatively small number of nodes.
Collapse
Affiliation(s)
- Heye Zhang
- Shenzhen Institutes of Advanced TechnologyChinese Academy of SciencesShenzhen518055China
| | - Zhifan Gao
- Shenzhen Institutes of Advanced TechnologyChinese Academy of SciencesShenzhen518055China
| | - Lin Xu
- Department of CardiologyGeneral Hospital of Guangzhou Military Command of PLAGuangzhou510000China
| | - Xingjian Yu
- State Key Laboratory of Modern Optical InstrumentationDepartment of Optical EngineeringZhejiang UniversityHangzhou310027China
| | - Ken C. L. Wong
- IBM Research – Almaden Research CenterSan JoseCA95120USA
| | - Huafeng Liu
- State Key Laboratory of Modern Optical InstrumentationDepartment of Optical EngineeringZhejiang UniversityHangzhou310027China
| | - Ling Zhuang
- Department of Radiation OncologyNorthwestern Lake forest HospitalLake forestIL60045USA
| | - Pengcheng Shi
- B. Thomas Golisano College of Computing and Information SciencesRochester Institute of TechnologyRochesterNY14623USA
| |
Collapse
|
41
|
Zhang Z, Yang X, Tan C, Guo W, Chen G. Surface structure feature matching algorithm for cardiac motion estimation. BMC Med Inform Decis Mak 2017; 17:172. [PMID: 29297330 PMCID: PMC5751426 DOI: 10.1186/s12911-017-0560-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022] Open
Abstract
Background Cardiac diseases represent the leading cause of sudden death worldwide. During the development of cardiac diseases, the left ventricle (LV) changes obviously in structure and function. LV motion estimation plays an important role for diagnosis and treatment of cardiac diseases. To estimate LV motion accurately for cine magnetic resonance (MR) cardiac images, we develop an algorithm by combining point set matching with surface structure features of myocardium. Methods The structure features of myocardial wall are described by estimating the normal directions of points locating on the myocardium contours using an approximation approach. The Gaussian mixture model (GMM) of structure features is used to represent LV structure feature distribution. A new cost function is defined to represent the differences between two Gaussian mixture models, which are the GMM of structure features and the GMM of positions of two point sets. To optimize the cost function, its gradient is derived to use the Quasi-Newton (QN). Furthermore, to resolve the dis-convergence issue of Quasi-Newton for high-dimensional parameter space, Stochastic Gradient Descent (SGD) is used and SGD gradient is derived. Finally, the new cost function is solved by optimization combining SGD with QN. With the closed form expression of gradient, this paper provided a computationally efficient registration algorithm. Results Three public datasets are employed to verify the performance of our algorithm, including cardiac MR image sequences acquired from 33 subjects, 14 inter-subject heart cases, and the data obtained in MICCAI 2009s 3D Segmentation Challenge for Clinical Applications. We compare our results with those of the other point set registration methods for LV motion estimation. The obtained results demonstrate that our algorithm shows inherent statistical robustness, due to the combination of SGD and Quasi-Newton optimization. Furthermore, our method is shown to outperform other point set matching methods in the registration accuracy. Conclusions We provide a novel effective algorithm for cardiac motion estimation by introducing LV surface structure feature to point set matching. A new cost function is defined to measure the discrepancy between GMMs of two point sets. The GMM of point positions and the GMM of surface structure descriptor are defined at the same time. Optimization by combining SGD and Quasi-Newton is performed to solve the cost function. We experimentally demonstrate that our algorithm shows improved registration accuracy, and is convergent when used in high-dimensional parameter space.
Collapse
Affiliation(s)
- Zhengrui Zhang
- College of Information Engineering, Shenzhen University, Shenzhen, 518060, China
| | - Xuan Yang
- College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, 518060, China.
| | - Cong Tan
- College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, 518060, China
| | - Wei Guo
- College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, 518060, China
| | - Guoliang Chen
- College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, 518060, China
| |
Collapse
|
42
|
Morais P, Queirós S, Heyde B, Engvall J, 'hooge JD, Vilaça JL. Fully automatic left ventricular myocardial strain estimation in 2D short-axis tagged magnetic resonance imaging. Phys Med Biol 2017; 62:6899-6919. [PMID: 28783715 DOI: 10.1088/1361-6560/aa7dc2] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/03/2023]
Abstract
Cardiovascular diseases are among the leading causes of death and frequently result in local myocardial dysfunction. Among the numerous imaging modalities available to detect these dysfunctional regions, cardiac deformation imaging through tagged magnetic resonance imaging (t-MRI) has been an attractive approach. Nevertheless, fully automatic analysis of these data sets is still challenging. In this work, we present a fully automatic framework to estimate left ventricular myocardial deformation from t-MRI. This strategy performs automatic myocardial segmentation based on B-spline explicit active surfaces, which are initialized using an annular model. A non-rigid image-registration technique is then used to assess myocardial deformation. Three experiments were set up to validate the proposed framework using a clinical database of 75 patients. First, automatic segmentation accuracy was evaluated by comparing against manual delineations at one specific cardiac phase. The proposed solution showed an average perpendicular distance error of 2.35 ± 1.21 mm and 2.27 ± 1.02 mm for the endo- and epicardium, respectively. Second, starting from either manual or automatic segmentation, myocardial tracking was performed and the resulting strain curves were compared. It is shown that the automatic segmentation adds negligible differences during the strain-estimation stage, corroborating its accuracy. Finally, segmental strain was compared with scar tissue extent determined by delay-enhanced MRI. The results proved that both strain components were able to distinguish between normal and infarct regions. Overall, the proposed framework was shown to be accurate, robust, and attractive for clinical practice, as it overcomes several limitations of a manual analysis.
Collapse
Affiliation(s)
- Pedro Morais
- Lab on Cardiovascular Imaging & Dynamics, Department of Cardiovascular Sciences, KULeuven-University of Leuven, Leuven, Belgium. ICVS/3B's-PT Government Associate Laboratory, Braga/Guimarães, Portugal. Instituto de Ciência e Inovação em Engenharia Mecânica e Engenharia Industrial, Faculdade de Engenharia, Universidade do Porto, Porto, Portugal
| | | | | | | | | | | |
Collapse
|
43
|
Chitiboi T, Axel L. Magnetic resonance imaging of myocardial strain: A review of current approaches. J Magn Reson Imaging 2017; 46:1263-1280. [PMID: 28471530 DOI: 10.1002/jmri.25718] [Citation(s) in RCA: 48] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2017] [Accepted: 03/14/2017] [Indexed: 11/07/2022] Open
Abstract
Contraction of the heart is central to its purpose of pumping blood around the body. While simple global function measures (such as the ejection fraction) are most commonly used in the clinical assessment of cardiac function, MRI also provides a range of approaches for quantitatively characterizing regional cardiac function, including the local deformation (or strain) within the heart wall. While they have been around for some years, these methods are still undergoing further technical development, and they have had relatively little clinical evaluation. However, they can provide potentially useful new ways to assess cardiac function, which may be able to contribute to better classification and treatment of heart disease. This article provides some basic background on the physical and physiological factors that determine the motion of the heart, in health and disease and then reviews some of the ways that MRI methods are being developed to image and quantify strain within the myocardium. LEVEL OF EVIDENCE 4 Technical Efficacy: Stage 2 J. Magn. Reson. Imaging 2017;46:1263-1280.
Collapse
Affiliation(s)
- Teodora Chitiboi
- NYU School of Medicine, Department of Radiology, New York, New York, USA
| | - Leon Axel
- NYU School of Medicine, Department of Radiology, New York, New York, USA
| |
Collapse
|
44
|
Rausch I, Quick HH, Cal-Gonzalez J, Sattler B, Boellaard R, Beyer T. Technical and instrumentational foundations of PET/MRI. Eur J Radiol 2017; 94:A3-A13. [PMID: 28431784 DOI: 10.1016/j.ejrad.2017.04.004] [Citation(s) in RCA: 24] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2017] [Accepted: 04/07/2017] [Indexed: 12/23/2022]
Abstract
This paper highlights the origins of combined positron emission tomography (PET) and magnetic resonance imaging (MRI) whole-body systems that were first introduced for applications in humans in 2010. This text first covers basic aspects of each imaging modality before describing the technical and methodological challenges of combining PET and MRI within a single system. After several years of development, combined and even fully-integrated PET/MRI systems have become available and made their way into the clinic. This multi-modality imaging system lends itself to the advanced exploration of diseases to support personalized medicine in a long run. To that extent, this paper provides an introduction to PET/MRI methodology and important technical solutions.
Collapse
Affiliation(s)
- Ivo Rausch
- Center for Medical Physics and Biomedical Engineering, Medical University Vienna, Vienna, Austria.
| | - Harald H Quick
- High Field and Hybrid MR Imaging, University Hospital Essen, Essen, Germany; Erwin L. Hahn Institute for MR Imaging, University of Duisburg-Essen, Essen, Germany
| | - Jacobo Cal-Gonzalez
- Center for Medical Physics and Biomedical Engineering, Medical University Vienna, Vienna, Austria
| | - Bernhard Sattler
- Department of Nuclear Medicine, University Hospital Leipzig, Leipzig, Germany
| | - Ronald Boellaard
- Department of Nuclear Medicine and Molecular Imaging, Academisch Ziekenhuis Groningen, Groningen, The Netherlands
| | - Thomas Beyer
- Center for Medical Physics and Biomedical Engineering, Medical University Vienna, Vienna, Austria
| |
Collapse
|
45
|
Parages FM, Denney TS, Gupta H, Lloyd SG, Dell'Italia LJ, Brankov JG. Estimation of Left Ventricular Motion from Cardiac Gated Tagged MRI Using an Image-Matching Deformable Mesh Model. IEEE TRANSACTIONS ON RADIATION AND PLASMA MEDICAL SCIENCES 2017. [DOI: 10.1109/tns.2017.2670619] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
46
|
Liu H, Wang T, Xu L, Shi P. Spatiotemporal Strategies for Joint Segmentation and Motion Tracking From Cardiac Image Sequences. IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE-JTEHM 2017; 5:1800219. [PMID: 28507825 PMCID: PMC5411259 DOI: 10.1109/jtehm.2017.2665496] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/28/2016] [Revised: 12/01/2016] [Accepted: 01/10/2017] [Indexed: 11/29/2022]
Abstract
Although accurate and robust estimations of the deforming cardiac geometry and kinematics from cine tomographic medical image sequences remain a technical challenge, they have significant clinical value. Traditionally, boundary or volumetric segmentation and motion estimation problems are considered as two sequential steps, even though the order of these processes can be different. In this paper, we present an integrated, spatiotemporal strategy for the simultaneous joint recovery of these two ill-posed problems. We use a mesh-free Galerkin formulation as the representation and computation platform, and adopt iterative procedures to solve the governing equations. Specifically, for each nodal point, the external driving forces are individually constructed through the integration of data-driven edginess measures, prior spatial distributions of myocardial tissues, temporal coherence of image-derived salient features, imaging/image-derived Eulerian velocity information, and cyclic motion model of myocardial behavior. The proposed strategy is accurate and very promising application results are shown from synthetic data, magnetic resonance (MR) phase contrast, tagging image sequences, and gradient echo cine MR image sequences.
Collapse
Affiliation(s)
- Huafeng Liu
- State Key Laboratory of Modern Optical InstrumentationZhejiang University
| | - Ting Wang
- State Key Laboratory of Modern Optical InstrumentationZhejiang University
| | - Lei Xu
- Department of RadiologyBeijing Anzhen HospitalCapital Medical University
| | - Pengcheng Shi
- B. Thomas Golisano College of Computing and Information SciencesRochester Institute of Technology
| |
Collapse
|
47
|
Interpretation of cardiac wall motion from cine-MRI combined with parametric imaging based on the Hilbert transform. MAGMA (NEW YORK, N.Y.) 2017; 30:347-357. [PMID: 28220266 DOI: 10.1007/s10334-017-0609-0] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/27/2016] [Revised: 01/29/2017] [Accepted: 02/02/2017] [Indexed: 12/19/2022]
Abstract
OBJECT The aim of this study was to test and validate the clinical impact of parametric amplitude images obtained using the Hilbert transform on the regional interpretation of cardiac wall motion abnormalities from cine-MR images by non-expert radiologists compared with expert consensus. MATERIALS AND METHODS Cine-MRI short-axis images obtained in 20 patients (10 with myocardial infarction, 5 with myocarditis and 5 with normal function) were processed to compute a parametric amplitude image for each using the Hilbert transform. Two expert radiologists blindly reviewed the cine-MR images to define a gold standard for wall motion interpretation for each left ventricular sector. Two non-expert radiologists reviewed and graded the same images without and in combination with parametric images. Grades assigned to each segment in the two separate sessions were compared with the gold standard. RESULTS According to expert interpretation, 264/320 (82.5%) segments were classified as normal and 56/320 (17.5%) were considered abnormal. The accuracy of the non-expert radiologists' grades compared to the gold standard was significantly improved by adding parametric images (from 87.2 to 94.6%) together with sensitivity (from 64.29 to 84.4%) and specificity (from 92 to 96.9%), also resulting in reduced interobserver variability (from 12.8 to 5.6%). CONCLUSION The use of parametric amplitude images based on the Hilbert transform in conjunction with cine-MRI was shown to be a promising technique for improvement of the detection of left ventricular wall motion abnormalities in less expert radiologists.
Collapse
|
48
|
Wong C, Chen S, Iyngkaran P. Cardiac Imaging in Heart Failure with Comorbidities. Curr Cardiol Rev 2017; 13:63-75. [PMID: 27492227 PMCID: PMC5324322 DOI: 10.2174/1573403x12666160803100928] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/30/2016] [Revised: 06/30/2016] [Accepted: 07/05/2016] [Indexed: 01/19/2023] Open
Abstract
Imaging modalities stand at the frontiers for progress in congestive heart failure (CHF) screening, risk stratification and monitoring. Advancements in echocardiography (ECHO) and Magnetic Resonance Imaging (MRI) have allowed for improved tissue characterizations, cardiac motion analysis, and cardiac performance analysis under stress. Common cardiac comorbidities such as hypertension, metabolic syndromes and chronic renal failure contribute to cardiac remodeling, sharing similar pathophysiological mechanisms starting with interstitial changes, structural changes and finally clinical CHF. These imaging techniques can potentially detect changes earlier. Such information could have clinical benefits for screening, planning preventive therapies and risk stratifying patients. Imaging reports have often focused on traditional measures without factoring these novel parameters. This review is aimed at providing a synopsis on how we can use this information to assess and monitor improvements for CHF with comorbidities.
Collapse
Affiliation(s)
- Chiew Wong
- Flinders University, NT Medical School, Darwin Australia
| | - Sylvia Chen
- Flinders University, NT Medical School, Darwin Australia
| | | |
Collapse
|
49
|
Zhang Y, Kwon D, Pohl KM. Computing group cardinality constraint solutions for logistic regression problems. Med Image Anal 2017; 35:58-69. [PMID: 27318592 PMCID: PMC5099121 DOI: 10.1016/j.media.2016.05.011] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2015] [Revised: 05/25/2016] [Accepted: 05/27/2016] [Indexed: 02/03/2023]
Abstract
We derive an algorithm to directly solve logistic regression based on cardinality constraint, group sparsity and use it to classify intra-subject MRI sequences (e.g. cine MRIs) of healthy from diseased subjects. Group cardinality constraint models are often applied to medical images in order to avoid overfitting of the classifier to the training data. Solutions within these models are generally determined by relaxing the cardinality constraint to a weighted feature selection scheme. However, these solutions relate to the original sparse problem only under specific assumptions, which generally do not hold for medical image applications. In addition, inferring clinical meaning from features weighted by a classifier is an ongoing topic of discussion. Avoiding weighing features, we propose to directly solve the group cardinality constraint logistic regression problem by generalizing the Penalty Decomposition method. To do so, we assume that an intra-subject series of images represents repeated samples of the same disease patterns. We model this assumption by combining series of measurements created by a feature across time into a single group. Our algorithm then derives a solution within that model by decoupling the minimization of the logistic regression function from enforcing the group sparsity constraint. The minimum to the smooth and convex logistic regression problem is determined via gradient descent while we derive a closed form solution for finding a sparse approximation of that minimum. We apply our method to cine MRI of 38 healthy controls and 44 adult patients that received reconstructive surgery of Tetralogy of Fallot (TOF) during infancy. Our method correctly identifies regions impacted by TOF and generally obtains statistically significant higher classification accuracy than alternative solutions to this model, i.e., ones relaxing group cardinality constraints.
Collapse
Affiliation(s)
- Yong Zhang
- Department of Psychiatry & Behavioral Sciences, Stanford University, Palo Alto, CA 94304, USA.
| | - Dongjin Kwon
- Department of Psychiatry & Behavioral Sciences, Stanford University, Palo Alto, CA 94304, USA; Center for Health Sciences, SRI International, Menlo Park, CA 94025, USA
| | - Kilian M Pohl
- Department of Psychiatry & Behavioral Sciences, Stanford University, Palo Alto, CA 94304, USA; Center for Health Sciences, SRI International, Menlo Park, CA 94025, USA
| |
Collapse
|
50
|
Prediction of myocardial infarction by assessing regional cardiac wall in CMR images through active mesh modeling. Comput Biol Med 2017; 80:56-64. [DOI: 10.1016/j.compbiomed.2016.11.004] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2016] [Revised: 11/08/2016] [Accepted: 11/09/2016] [Indexed: 11/22/2022]
|