1
|
Wang JM, Bell AJ, Ram S, Labaki WW, Hoff BA, Murray S, Kazerooni EA, Galban S, Hatt CR, Han MK, Galban CJ. Topologic Parametric Response Mapping Identifies Tissue Subtypes Associated with Emphysema Progression. Acad Radiol 2024; 31:1148-1159. [PMID: 37661554 DOI: 10.1016/j.acra.2023.08.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2023] [Revised: 07/25/2023] [Accepted: 08/03/2023] [Indexed: 09/05/2023]
Abstract
RATIONALE AND OBJECTIVES Small airways disease (SAD) and emphysema are significant components of chronic obstructive pulmonary disease (COPD), a heterogenous disease where predicting progression is difficult. SAD, a principal cause of airflow obstruction in mild COPD, has been identified as a precursor to emphysema. Parametric Response Mapping (PRM) of chest computed tomography (CT) can help distinguish SAD from emphysema. Specifically, topologic PRM can define local patterns of both diseases to characterize how and in whom COPD progresses. We aimed to determine if distribution of CT-based PRM of functional SAD (fSAD) is associated with emphysema progression. MATERIALS AND METHODS We analyzed paired inspiratory-expiratory chest CT scans at baseline and 5-year follow up in 1495 COPDGene subjects using topological analyses of PRM classifications. By spatially aligning temporal scans, we mapped local emphysema at year five to baseline lobar PRM-derived topological readouts. K-means clustering was applied to all observations. Subjects were subtyped based on predominant PRM cluster assignments and assessed using non-parametric statistical tests to determine differences in PRM values, pulmonary function metrics, and clinical measures. RESULTS We identified distinct lobar imaging patterns and classified subjects into three radiologic subtypes: emphysema-dominant (ED), fSAD-dominant (FD), and fSAD-transition (FT: transition from healthy lung to fSAD). Relative to year five emphysema, FT showed rapid local emphysema progression (-57.5% ± 1.1) compared to FD (-49.9% ± 0.5) and ED (-33.1% ± 0.4). FT consisted primarily of at-risk subjects (roughly 60%) with normal spirometry. CONCLUSION The FT subtype of COPD may allow earlier identification of individuals without spirometrically-defined COPD at-risk for developing emphysema.
Collapse
Affiliation(s)
- Jennifer M Wang
- Division of Pulmonary and Critical Care Medicine, University of Michigan, Ann Arbor, Michigan (J.M.W., W.W.L., M.K.H.)
| | - Alexander J Bell
- Department of Radiology, University of Michigan, Ann Arbor, Michigan (A.J.B., S.R., B.A.H., E.A.K., S.G., C.R.H., C.J.G.)
| | - Sundaresh Ram
- Department of Radiology, University of Michigan, Ann Arbor, Michigan (A.J.B., S.R., B.A.H., E.A.K., S.G., C.R.H., C.J.G.); Department of Biomedical Engineering, University of Michigan, Ann Arbor, Michigan (S.R.)
| | - Wassim W Labaki
- Division of Pulmonary and Critical Care Medicine, University of Michigan, Ann Arbor, Michigan (J.M.W., W.W.L., M.K.H.)
| | - Benjamin A Hoff
- Department of Radiology, University of Michigan, Ann Arbor, Michigan (A.J.B., S.R., B.A.H., E.A.K., S.G., C.R.H., C.J.G.)
| | - Susan Murray
- School of Public Health, University of Michigan, Ann Arbor, Michigan (S.M.)
| | - Ella A Kazerooni
- Department of Radiology, University of Michigan, Ann Arbor, Michigan (A.J.B., S.R., B.A.H., E.A.K., S.G., C.R.H., C.J.G.)
| | - Stefanie Galban
- Department of Radiology, University of Michigan, Ann Arbor, Michigan (A.J.B., S.R., B.A.H., E.A.K., S.G., C.R.H., C.J.G.)
| | - Charles R Hatt
- Department of Radiology, University of Michigan, Ann Arbor, Michigan (A.J.B., S.R., B.A.H., E.A.K., S.G., C.R.H., C.J.G.); Imbio, LLC, Minneapolis, Minnesota (C.R.H.)
| | - MeiLan K Han
- Division of Pulmonary and Critical Care Medicine, University of Michigan, Ann Arbor, Michigan (J.M.W., W.W.L., M.K.H.)
| | - Craig J Galban
- Department of Radiology, University of Michigan, Ann Arbor, Michigan (A.J.B., S.R., B.A.H., E.A.K., S.G., C.R.H., C.J.G.).
| |
Collapse
|
2
|
Bell AJ, Pal R, Labaki WW, Hoff BA, Wang JM, Murray S, Kazerooni EA, Galban S, Lynch DA, Humphries SM, Martinez FJ, Hatt CR, Han MK, Ram S, Galban CJ. Local heterogeneity of normal lung parenchyma and small airways disease are associated with COPD severity and progression. Respir Res 2024; 25:106. [PMID: 38419014 PMCID: PMC10903150 DOI: 10.1186/s12931-024-02729-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2024] [Accepted: 02/13/2024] [Indexed: 03/02/2024] Open
Abstract
BACKGROUND Small airways disease (SAD) is a major cause of airflow obstruction in COPD patients and has been identified as a precursor to emphysema. Although the amount of SAD in the lungs can be quantified using our Parametric Response Mapping (PRM) approach, the full breadth of this readout as a measure of emphysema and COPD progression has yet to be explored. We evaluated topological features of PRM-derived normal parenchyma and SAD as surrogates of emphysema and predictors of spirometric decline. METHODS PRM metrics of normal lung (PRMNorm) and functional SAD (PRMfSAD) were generated from CT scans collected as part of the COPDGene study (n = 8956). Volume density (V) and Euler-Poincaré Characteristic (χ) image maps, measures of the extent and coalescence of pocket formations (i.e., topologies), respectively, were determined for both PRMNorm and PRMfSAD. Association with COPD severity, emphysema, and spirometric measures were assessed via multivariable regression models. Readouts were evaluated as inputs for predicting FEV1 decline using a machine learning model. RESULTS Multivariable cross-sectional analysis of COPD subjects showed that V and χ measures for PRMfSAD and PRMNorm were independently associated with the amount of emphysema. Readouts χfSAD (β of 0.106, p < 0.001) and VfSAD (β of 0.065, p = 0.004) were also independently associated with FEV1% predicted. The machine learning model using PRM topologies as inputs predicted FEV1 decline over five years with an AUC of 0.69. CONCLUSIONS We demonstrated that V and χ of fSAD and Norm have independent value when associated with lung function and emphysema. In addition, we demonstrated that these readouts are predictive of spirometric decline when used as inputs in a ML model. Our topological PRM approach using PRMfSAD and PRMNorm may show promise as an early indicator of emphysema onset and COPD progression.
Collapse
Affiliation(s)
- Alexander J Bell
- Department of Radiology, University of Michigan, 109 Zina Pitcher Place BSRB A506, Ann Arbor, MI, 48109-2200, USA
| | - Ravi Pal
- Department of Radiology, University of Michigan, 109 Zina Pitcher Place BSRB A506, Ann Arbor, MI, 48109-2200, USA
| | - Wassim W Labaki
- Department of Internal Medicine, Division of Pulmonary and Critical Care Medicine, University of Michigan, Ann Arbor, MI, USA
| | - Benjamin A Hoff
- Department of Radiology, University of Michigan, 109 Zina Pitcher Place BSRB A506, Ann Arbor, MI, 48109-2200, USA
| | - Jennifer M Wang
- Department of Internal Medicine, Division of Pulmonary and Critical Care Medicine, University of Michigan, Ann Arbor, MI, USA
| | - Susan Murray
- School of Public Health, University of Michigan, Ann Arbor, MI, USA
| | - Ella A Kazerooni
- Department of Radiology, University of Michigan, 109 Zina Pitcher Place BSRB A506, Ann Arbor, MI, 48109-2200, USA
- Department of Internal Medicine, Division of Pulmonary and Critical Care Medicine, University of Michigan, Ann Arbor, MI, USA
| | - Stefanie Galban
- Department of Radiology, University of Michigan, 109 Zina Pitcher Place BSRB A506, Ann Arbor, MI, 48109-2200, USA
| | - David A Lynch
- Department of Radiology, National Jewish Health, Denver, CO, USA
| | | | | | | | - MeiLan K Han
- Department of Internal Medicine, Division of Pulmonary and Critical Care Medicine, University of Michigan, Ann Arbor, MI, USA
| | - Sundaresh Ram
- Department of Radiology, University of Michigan, 109 Zina Pitcher Place BSRB A506, Ann Arbor, MI, 48109-2200, USA.
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, USA.
| | - Craig J Galban
- Department of Radiology, University of Michigan, 109 Zina Pitcher Place BSRB A506, Ann Arbor, MI, 48109-2200, USA.
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, USA.
| |
Collapse
|
3
|
Bell AJ, Pal R, Labaki WW, Hoff BA, Wang JM, Murray S, Kazerooni EA, Galban S, Lynch DA, Humphries SM, Martinez FJ, Hatt CR, Han MK, Ram S, Galban CJ. Quantitative CT of Normal Lung Parenchyma and Small Airways Disease Topologies are Associated With COPD Severity and Progression. medRxiv 2023:2023.05.26.23290532. [PMID: 37333382 PMCID: PMC10274970 DOI: 10.1101/2023.05.26.23290532] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/20/2023]
Abstract
Objectives Small airways disease (SAD) is a major cause of airflow obstruction in COPD patients, and has been identified as a precursor to emphysema. Although the amount of SAD in the lungs can be quantified using our Parametric Response Mapping (PRM) approach, the full breadth of this readout as a measure of emphysema and COPD progression has yet to be explored. We evaluated topological features of PRM-derived normal parenchyma and SAD as surrogates of emphysema and predictors of spirometric decline. Materials and Methods PRM metrics of normal lung (PRMNorm) and functional SAD (PRMfSAD) were generated from CT scans collected as part of the COPDGene study (n=8956). Volume density (V) and Euler-Poincaré Characteristic (χ) image maps, measures of the extent and coalescence of pocket formations (i.e., topologies), respectively, were determined for both PRMNorm and PRMfSAD. Association with COPD severity, emphysema, and spirometric measures were assessed via multivariable regression models. Readouts were evaluated as inputs for predicting FEV1 decline using a machine learning model. Results Multivariable cross-sectional analysis of COPD subjects showed that V and χ measures for PRMfSAD and PRMNorm were independently associated with the amount of emphysema. Readouts χfSAD (β of 0.106, p<0.001) and VfSAD (β of 0.065, p=0.004) were also independently associated with FEV1% predicted. The machine learning model using PRM topologies as inputs predicted FEV1 decline over five years with an AUC of 0.69. Conclusions We demonstrated that V and χ of fSAD and Norm have independent value when associated with lung function and emphysema. In addition, we demonstrated that these readouts are predictive of spirometric decline when used as inputs in a ML model. Our topological PRM approach using PRMfSAD and PRMNorm may show promise as an early indicator of emphysema onset and COPD progression.
Collapse
Affiliation(s)
- Alexander J. Bell
- Department of Radiology, University of Michigan, Ann Arbor, MI, United States
| | - Ravi Pal
- Department of Radiology, University of Michigan, Ann Arbor, MI, United States
| | - Wassim W. Labaki
- Department of Internal Medicine, Division of Pulmonary and Critical Care Medicine, University of Michigan, Ann Arbor, MI, United States
| | - Benjamin A. Hoff
- Department of Radiology, University of Michigan, Ann Arbor, MI, United States
| | - Jennifer M. Wang
- Department of Internal Medicine, Division of Pulmonary and Critical Care Medicine, University of Michigan, Ann Arbor, MI, United States
| | - Susan Murray
- School of Public Health, University of Michigan, Ann Arbor, MI, United States
| | - Ella A. Kazerooni
- Department of Radiology, University of Michigan, Ann Arbor, MI, United States
- Department of Internal Medicine, Division of Pulmonary and Critical Care Medicine, University of Michigan, Ann Arbor, MI, United States
| | - Stefanie Galban
- Department of Radiology, University of Michigan, Ann Arbor, MI, United States
| | - David A. Lynch
- Department of Radiology, National Jewish Health, Denver, CO, United States
| | | | | | | | - MeiLan K. Han
- Department of Internal Medicine, Division of Pulmonary and Critical Care Medicine, University of Michigan, Ann Arbor, MI, United States
| | - Sundaresh Ram
- Department of Radiology, University of Michigan, Ann Arbor, MI, United States
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, United States
| | - Craig J. Galban
- Department of Radiology, University of Michigan, Ann Arbor, MI, United States
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, United States
| |
Collapse
|
4
|
Katakol S, Baker TJ, Bian Z, Lu Y, Spahlinger G, Hatt CR, Burris NS. Fully automated pipeline for measurement of the thoracic aorta using joint segmentation and localization neural network. J Med Imaging (Bellingham) 2023; 10:051810. [PMID: 37915405 PMCID: PMC10617550 DOI: 10.1117/1.jmi.10.5.051810] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2023] [Revised: 09/14/2023] [Accepted: 10/24/2023] [Indexed: 11/03/2023] Open
Abstract
Purpose Diagnosis and surveillance of thoracic aortic aneurysm (TAA) involves measuring the aortic diameter at various locations along the length of the aorta, often using computed tomography angiography (CTA). Currently, measurements are performed by human raters using specialized software for three-dimensional analysis, a time-consuming process, requiring 15 to 45 min of focused effort. Thus, we aimed to develop a convolutional neural network (CNN)-based algorithm for fully automated and accurate aortic measurements. Approach Using 212 CTA scans, we trained a CNN to perform segmentation and localization of key landmarks jointly. Segmentation mask and landmarks are subsequently used to obtain the centerline and cross-sectional diameters of the aorta. Subsequently, a cubic spline is fit to the aortic boundary at the sinuses of Valsalva to avoid errors related inclusions of coronary artery origins. Performance was evaluated on a test set of 60 scans with automated measurements compared against expert manual raters. Result Compared to training separate networks for each task, joint training yielded higher accuracy for segmentation, especially at the boundary (p < 0.001 ), but a marginally worse (0.2 to 0.5 mm) accuracy for landmark localization (p < 0.001 ). Mean absolute error between human and automated was ≤ 1 mm at six of nine standard clinical measurement locations. However, higher errors were noted in the aortic root and arch regions, ranging between 1.4 and 2.2 mm, although agreement of manual raters was also lower in these regions. Conclusion Fully automated aortic diameter measurements in TAA are feasible using a CNN-based algorithm. Automated measurements demonstrated low errors that are comparable in magnitude to those with manual raters; however, measurement error was highest in the aortic root and arch.
Collapse
Affiliation(s)
- Sudeep Katakol
- University of Michigan, Department of Electrical and Computer Engineering, Ann Arbor, Michigan, United States
- University of Michigan, Department of Radiology, Ann Arbor, Michigan, United States
| | - Timothy J. Baker
- University of Michigan, Department of Radiology, Ann Arbor, Michigan, United States
| | - Zhangxing Bian
- Johns Hopkins University, Department of Electrical and Computer Engineering, Baltimore, Maryland, United States
| | - Yanglong Lu
- University of Michigan, Department of Radiology, Ann Arbor, Michigan, United States
| | - Greg Spahlinger
- University of Michigan, Department of Radiology, Ann Arbor, Michigan, United States
| | | | - Nicholas S. Burris
- University of Michigan, Department of Radiology, Ann Arbor, Michigan, United States
| |
Collapse
|
5
|
Carey KJ, Hotvedt P, Mummy DG, Lee KE, Denlinger LC, Schiebler ML, Sorkness RL, Jarjour NN, Hatt CR, Galban CJ, Fain SB. Comparison of hyperpolarized 3He-MRI, CT based parametric response mapping, and mucus scores in asthmatics. Front Physiol 2023; 14:1178339. [PMID: 37593238 PMCID: PMC10431597 DOI: 10.3389/fphys.2023.1178339] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2023] [Accepted: 07/17/2023] [Indexed: 08/19/2023] Open
Abstract
Purpose: The purpose of this study was to anatomically correlate ventilation defects with regions of air trapping by whole lung, lung lobe, and airway segment in the context of airway mucus plugging in asthma. Methods: A total of 34 asthmatics [13M:21F, 13 mild/moderate, median age (range) of 49.5 (36.8-53.3) years and 21 severe, 56.1 (47.1-62.6) years] and 4 healthy subjects [1M:3F, 38.5 (26.6-52.2) years] underwent HP 3He MRI and CT imaging. HP 3He MRI was assessed for ventilation defects using a semi-automated k-means clustering algorithm. Inspiratory and expiratory CTs were analyzed using parametric response mapping (PRM) to quantify markers of emphysema and functional small airways disease (fSAD). Segmental and lobar lung masks were obtained from CT and registered to HP 3He MRI in order to localize ventilation defect percent (VDP), at the lobar and segmental level, to regions of fSAD and mucus plugging. Spearman's correlation was utilized to compare biomarkers on a global and lobar level, and a multivariate analysis was conducted to predict segmental fSAD given segmental VDP (sVDP) and mucus score as variables in order to further understand the functional relationships between regional measures of obstruction. Results: On a global level, fSAD was correlated with whole lung VDP (r = 0.65, p < 0.001), mucus score (r = 0.55, p < 0.01), and moderately correlated (-0.60 ≤ r ≤ -0.56, p < 0.001) to percent predicted (%p) FEV1, FEF25-75 and FEV1/FVC, and more weakly correlated to FVC%p (-0.38 ≤ r ≤ -0.35, p < 0.001) as expected from previous work. On a regional level, lobar VDP, mucus scores, and fSAD were also moderately correlated (r from 0.45-0.66, p < 0.01). For segmental colocalization, the model of best fit was a piecewise quadratic model, which suggests that sVDP may be increasing due to local airway obstruction that does not manifest as fSAD until more extensive disease is present. sVDP was more sensitive to the presence of a mucus plugs overall, but the prediction of fSAD using multivariate regression showed an interaction in the presence of a mucus plugs when sVDP was between 4% and 10% (p < 0.001). Conclusion: This multi-modality study in asthma confirmed that areas of ventilation defects are spatially correlated with air trapping at the level of the airway segment and suggests VDP and fSAD are sensitive to specific sources of airway obstruction in asthma, including mucus plugs.
Collapse
Affiliation(s)
- Katherine J. Carey
- Department of Medical Physics, University of Wisconsin—Madison, Madison, WI, United States
- Department of Radiology, University of Wisconsin—Madison, Madison, WI, United States
- Imbio LLC, Minneapolis, MN, United States
| | - Peter Hotvedt
- Department of Nuclear Engineering, University of Michigan—Ann Arbor, Ann Arbor, MI, United States
| | - David G. Mummy
- Center for In Vivo Microscopy, Department of Radiology, Duke University, Durham, NC, United States
- Center for In Vivo Microscopy, Duke University, Durham, NC, United States
| | - Kristine E. Lee
- Department of Biostatistics, University of Wisconsin—Madison, Madison, WI, United States
| | - Loren C. Denlinger
- Division of Allergy, Pulmonary, and Critical Care Medicine, University of Wisconsin—Madison, Madison, WI, United States
| | - Mark L. Schiebler
- Department of Radiology, University of Wisconsin—Madison, Madison, WI, United States
| | - Ronald L. Sorkness
- School of Pharmacy, University of Wisconsin—Madison, Madison, WI, United States
| | - Nizar N. Jarjour
- Division of Allergy, Pulmonary, and Critical Care Medicine, University of Wisconsin—Madison, Madison, WI, United States
| | - Charles R. Hatt
- Imbio LLC, Minneapolis, MN, United States
- Department of Radiology, University of Michigan, Ann Arbor, MI, United States
| | - Craig J. Galban
- Department of Radiology, University of Michigan, Ann Arbor, MI, United States
| | - Sean B. Fain
- Department of Radiology, University of Iowa, Iowa City, IA, United States
| |
Collapse
|
6
|
Ram S, Tang W, Bell AJ, Pal R, Spencer C, Buschhaus A, Hatt CR, diMagliano MP, Rehemtulla A, Rodríguez JJ, Galban S, Galban CJ. Lung cancer lesion detection in histopathology images using graph-based sparse PCA network. Neoplasia 2023; 42:100911. [PMID: 37269818 DOI: 10.1016/j.neo.2023.100911] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2023] [Accepted: 05/17/2023] [Indexed: 06/05/2023]
Abstract
Early detection of lung cancer is critical for improvement of patient survival. To address the clinical need for efficacious treatments, genetically engineered mouse models (GEMM) have become integral in identifying and evaluating the molecular underpinnings of this complex disease that may be exploited as therapeutic targets. Assessment of GEMM tumor burden on histopathological sections performed by manual inspection is both time consuming and prone to subjective bias. Therefore, an interplay of needs and challenges exists for computer-aided diagnostic tools, for accurate and efficient analysis of these histopathology images. In this paper, we propose a simple machine learning approach called the graph-based sparse principal component analysis (GS-PCA) network, for automated detection of cancerous lesions on histological lung slides stained by hematoxylin and eosin (H&E). Our method comprises four steps: 1) cascaded graph-based sparse PCA, 2) PCA binary hashing, 3) block-wise histograms, and 4) support vector machine (SVM) classification. In our proposed architecture, graph-based sparse PCA is employed to learn the filter banks of the multiple stages of a convolutional network. This is followed by PCA hashing and block histograms for indexing and pooling. The meaningful features extracted from this GS-PCA are then fed to an SVM classifier. We evaluate the performance of the proposed algorithm on H&E slides obtained from an inducible K-rasG12D lung cancer mouse model using precision/recall rates, Fβ-score, Tanimoto coefficient, and area under the curve (AUC) of the receiver operator characteristic (ROC) and show that our algorithm is efficient and provides improved detection accuracy compared to existing algorithms.
Collapse
Affiliation(s)
- Sundaresh Ram
- Departments of Radiology, and Biomedical Engineering, University of Michigan, Ann Arbor, MI 48109, USA.
| | - Wenfei Tang
- Department of Computer Science and Engineering, University of Michigan, Ann Arbor, MI 48109, USA
| | - Alexander J Bell
- Departments of Radiology, and Biomedical Engineering, University of Michigan, Ann Arbor, MI 48109, USA
| | - Ravi Pal
- Department of Radiology, University of Michigan, Ann Arbor, MI 48109, USA
| | - Cara Spencer
- Department of Computational Medicine and Bioinformatics, University of Michigan, Ann Arbor, MI 48109, USA
| | | | - Charles R Hatt
- Department of Radiology, University of Michigan, Ann Arbor, MI 48109, USA; Imbio LLC, Minneapolis, MN 55405, USA
| | - Marina Pasca diMagliano
- Departments of Surgery, and Cell and Developmental Biology, University of Michigan, Ann Arbor, MI 48109, USA
| | - Alnawaz Rehemtulla
- Departments of Radiology, and Radiation Oncology, University of Michigan, Ann Arbor, MI 48109, USA
| | - Jeffrey J Rodríguez
- Departments of Electrical and Computer Engineering, and Biomedical Engineering, The University of Arizona, Tucson, AZ 85721, USA
| | - Stefanie Galban
- Department of Radiology, University of Michigan, Ann Arbor, MI 48109, USA
| | - Craig J Galban
- Departments of Radiology, and Biomedical Engineering, University of Michigan, Ann Arbor, MI 48109, USA
| |
Collapse
|
7
|
Bian Z, Zhong J, Dominic J, Christensen GE, Hatt CR, Burris NS. Validation of a robust method for quantification of three-dimensional growth of the thoracic aorta using deformable image registration. Med Phys 2022; 49:2514-2530. [PMID: 35106769 PMCID: PMC9305918 DOI: 10.1002/mp.15496] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2021] [Revised: 12/14/2021] [Accepted: 01/10/2022] [Indexed: 11/06/2022] Open
Abstract
PURPOSE Accurate assessment of thoracic aortic aneurysm (TAA) growth is important for appropriate clinical management. Maximal aortic diameter is the primary metric that is used to assess growth, but it suffers from substantial measurement variability. A recently proposed technique, termed vascular deformation mapping (VDM), is able to quantify three-dimensional aortic growth using clinical computed tomography angiography (CTA) data using an approach based on deformable image registration (DIR). However, the accuracy and robustness of VDM remains undefined given the lack of ground truth from clinical CTA data, and, furthermore, the performance of VDM relative to standard manual diameter measurements is unknown. METHODS To evaluate the performance of the VDM pipeline for quantifying aortic growth, we developed a novel and systematic evaluation process to generate 76 unique synthetic CTA growth phantoms (based on 10 unique cases) with variable degrees and locations of aortic wall deformation. Aortic deformation was quantified using two metrics: area ratio (AR), defined as the ratio of surface area in triangular mesh elements and the magnitude of deformation in the normal direction (DiN) relative to the aortic surface. Using these phantoms, we further investigated the effects on VDM's measurement accuracy resulting from factors that influence the quality of clinical CTA data such as respiratory translations, slice thickness, and image noise. Lastly, we compare the measurement error of VDM TAA growth assessments against two expert raters performing standard diameter measurements of synthetic phantom images. RESULTS Across our population of 76 synthetic growth phantoms, the median absolute error was 0.063 (IQR: 0.073-0.054) for AR and 0.181 mm (interquartile range [IQR]: 0.214-0.143 mm) for DiN. Median relative error was 1.4% for AR and3.3 % $3.3\%$ for DiN at the highest tested noise level (contrast-to-noise ratio [CNR] = 2.66). Error in VDM output increased with slice thickness, with the highest median relative error of 1.5% for AR and 4.1% for DiN at a slice thickness of 2.0 mm. Respiratory motion of the aorta resulted in maximal absolute error of 3% AR and 0.6 mm in DiN, but bulk translations in aortic position had a very small effect on measured AR and DiN values (relative errors< 1 % $< 1\%$ ). VDM-derived measurements of magnitude and location of maximal diameter change demonstrated significantly high accuracy and lower variability compared to two expert manual raters (p < 0.03 $p<0.03$ across all comparisons). CONCLUSIONS VDM yields an accurate, three-dimensional assessment of aortic growth in TAA patients and is robust to factors such as image noise, respiration-induced translations, and differences in patient position. Further, VDM significantly outperformed two expert manual raters in assessing the magnitude and location of aortic growth despite optimized experimental measurement conditions. These results support validation of the VDM technique for accurate quantification of aortic growth in patients and highlight several important advantages over diameter measurements.
Collapse
Affiliation(s)
- Zhangxing Bian
- Department of RadiologyUniversity of MichiganAnn ArborMIUSA
- Department of Electrical Engineering and Computer ScienceUniversity of MichiganAnn ArborMIUSA
| | - Jiayang Zhong
- Department of RadiologyUniversity of MichiganAnn ArborMIUSA
- Department of Electrical Engineering and Computer ScienceUniversity of MichiganAnn ArborMIUSA
| | - Jeffrey Dominic
- Department of RadiologyUniversity of MichiganAnn ArborMIUSA
- Department of Electrical Engineering and Computer ScienceUniversity of MichiganAnn ArborMIUSA
| | - Gary E. Christensen
- Department of Electrical and Computer EngineeringUniversity of IowaIowa CityIowaUSA
| | - Charles R. Hatt
- Department of RadiologyUniversity of MichiganAnn ArborMIUSA
- ImbioLLCMinneapolisMinnesotaUSA
| | - Nicholas S. Burris
- Department of RadiologyUniversity of MichiganAnn ArborMIUSA
- Department of Biomedical EngineeringUniversity of MichignaAnn ArborMIUSA
| |
Collapse
|
8
|
Burris NS, Bian Z, Dominic J, Zhong J, Houben IB, van Bakel TMJ, Patel HJ, Ross BD, Christensen GE, Hatt CR. Vascular Deformation Mapping for CT Surveillance of Thoracic Aortic Aneurysm Growth. Radiology 2021; 302:218-225. [PMID: 34665030 PMCID: PMC8717815 DOI: 10.1148/radiol.2021210658] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/03/2023]
Abstract
Background Aortic diameter measurements in patients with a thoracic aortic aneurysm (TAA) show wide variation. There is no technique to quantify aortic growth in a three-dimensional (3D) manner. Purpose To validate a CT-based technique for quantification of 3D growth based on deformable registration in patients with TAA. Materials and Methods Patients with ascending and descending TAA with two or more CT angiography studies between 2006 and 2020 were retrospectively identified. The 3D aortic growth was quantified using vascular deformation mapping (VDM), a technique that uses deformable registration to warp a mesh constructed from baseline aortic anatomy. Growth assessments between VDM and clinical CT diameter measurements were compared. Aortic growth was quantified as the ratio of change in surface area at each mesh element (area ratio). Manual segmentations were performed by independent raters to assess interrater reproducibility. Registration error was assessed using manually placed landmarks. Agreement between VDM and clinical diameter measurements was assessed using Pearson correlation and Cohen κ coefficients. Results A total of 38 patients (68 surveillance intervals) were evaluated (mean age, 69 years ± 9 [standard deviation]; 21 women), with TAA involving the ascending aorta (n = 26), descending aorta (n = 10), or both (n = 2). VDM was technically successful in 35 of 38 (92%) patients and 58 of 68 intervals (85%). Median registration error was 0.77 mm (interquartile range, 0.54-1.10 mm). Interrater agreement was high for aortic segmentation (Dice similarity coefficient = 0.97 ± 0.02) and VDM-derived area ratio (bias = 0.0, limits of agreement: -0.03 to 0.03). There was strong agreement (r = 0.85, P < .001) between peak area ratio values and diameter change. VDM detected growth in 14 of 58 (24%) intervals. VDM revealed growth outside the maximally dilated segment in six of 14 (36%) growth intervals, none of which were detected with diameter measurements. Conclusion Vascular deformation mapping provided reliable and comprehensive quantitative assessment of three-dimensional aortic growth and growth patterns in patients with thoracic aortic aneurysms undergoing CT surveillance. Published under a CC BY 4.0 license Online supplemental material is available for this article. See also the editorial by Wieben in this issue.
Collapse
|
9
|
Pompe E, Moore CM, Mohamed Hoesein FA, de Jong PA, Charbonnier JP, Han MK, Humphries SM, Hatt CR, Galbán CJ, Silverman EK, Crapo JD, Washko GR, Regan EA, Make B, Strand M, Lammers JWJ, van Rikxoort EM, Lynch DA. Progression of Emphysema and Small Airways Disease in Cigarette Smokers. Chronic Obstr Pulm Dis 2021; 8:198-212. [PMID: 33290645 PMCID: PMC8237975 DOI: 10.15326/jcopdf.2020.0140] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 11/19/2020] [Indexed: 11/21/2022]
Abstract
BACKGROUND Little is known about factors associated with emphysema progression in cigarette smokers. We evaluated factors associated with change in emphysema and forced expiratory volume in 1 second (FEV1) in participants with and without chronic obstructive pulmonary disease (COPD). METHODS This retrospective study included individuals participating in the COPD Genetic Epidemiology study who completed the 5-year follow-up, including inspiratory and expiratory computed tomography (CT) and spirometry. All paired CT scans were analyzed using micro-mapping, which classifies individual voxels as emphysema or functional small airway disease (fSAD). Presence and progression of emphysema and FEV1 were determined based on comparison to nonsmoker values. Logistic regression analyses were used to identify clinical parameters associated with disease progression. RESULTS A total of 3088 participants were included with a mean ± SD age of 60.7±8.9 years, including 72 nonsmokers. In all Global initiative for chronic Obstructive Lung Disease (GOLD) stages, the presence of emphysema at baseline was associated with emphysema progression (odds ratio [OR]: GOLD 0: 4.32; preserved ratio-impaired spirometry [PRISm]; 5.73; GOLD 1: 5.16; GOLD 2: 5.69; GOLD 3/4: 5.55; all p ≤0.01). If there was no emphysema at baseline, the amount of fSAD at baseline was associated with emphysema progression (OR for 1% increase: GOLD 0: 1.06; PRISm: 1.20; GOLD 1: 1.7; GOLD 3/4: 1.08; all p ≤ 0.03).In 1735 participants without spirometric COPD, progression in emphysema occurred in 105 (6.1%) participants and only 21 (1.2%) had progression in both emphysema and FEV1. CONCLUSIONS The presence of emphysema is an important predictor of emphysema progression. In patients without emphysema, fSAD is associated with the development of emphysema. In participants without spirometric COPD, emphysema progression occurred independently of FEV1 decline.
Collapse
Affiliation(s)
- Esther Pompe
- Imaging Department, University Medical Center Utrecht, Utrecht, the Netherlands
| | - Camille M. Moore
- Division of Biostatistics, Environment and Health, National Jewish Health, Denver, Colorado, United States
| | | | - Pim A. de Jong
- Department of Radiology, University Medical Center Utrecht, Utrecht, the Netherlands
| | - Jean-Paul Charbonnier
- Diagnostic Image Analysis Group, Radboud University Medical Center, Nijmegen, the Netherlands
| | - MeiLan K. Han
- Division of Pulmonary and Critical Care, University of Michigan Health System, Ann Arbor, Michigan, United States
| | - Steven M. Humphries
- Department of Radiology, National Jewish Health, Denver, Colorado, United States
| | | | - Craig J. Galbán
- Department of Radiology, University of Michigan, Ann Arbor, Michigan, United States
- Center for Molecular Imaging, University of Michigan, Ann Arbor, Michigan, United States
| | - Ed K. Silverman
- Channing Division of Network Medicine, Brigham and Women’s Hospital, Boston, Massachusetts, United States
- Division of Pulmonary and Critical Care Medicine, Department of Medicine, Brigham and Women’s Hospital, Boston, Massachusetts, United States
| | - James D. Crapo
- Division of Pulmonary, Critical Care and Sleep Medicine, Department of Medicine, National Jewish Health, Denver, Colorado, United States
| | - George R. Washko
- Division of Pulmonary and Critical Care Medicine, Department of Medicine, Brigham and Women’s Hospital, Boston, Massachusetts, United States
| | - Elisabeth A. Regan
- Division of Rheumatology, Department of Medicine, National Jewish Health, Denver, Colorado, United States
| | - Barry Make
- Division of Pulmonary, Critical Care and Sleep Medicine, Department of Medicine, National Jewish Health, Denver, Colorado, United States
| | - Matthew Strand
- Division of Biostatistics, Environment and Health, National Jewish Health, Denver, Colorado, United States
| | | | - Eva M. van Rikxoort
- Diagnostic Image Analysis Group, Radboud University Medical Center, Nijmegen, the Netherlands
| | - David A. Lynch
- Department of Radiology, National Jewish Health, Denver, Colorado, United States
| | - on behalf of the COPDGene® investigators
- Imaging Department, University Medical Center Utrecht, Utrecht, the Netherlands
- Division of Biostatistics, Environment and Health, National Jewish Health, Denver, Colorado, United States
- Department of Radiology, University Medical Center Utrecht, Utrecht, the Netherlands
- Diagnostic Image Analysis Group, Radboud University Medical Center, Nijmegen, the Netherlands
- Division of Pulmonary and Critical Care, University of Michigan Health System, Ann Arbor, Michigan, United States
- Department of Radiology, National Jewish Health, Denver, Colorado, United States
- Imbio LLC, Minneapolis, Minnesota, United States
- Department of Radiology, University of Michigan, Ann Arbor, Michigan, United States
- Center for Molecular Imaging, University of Michigan, Ann Arbor, Michigan, United States
- Channing Division of Network Medicine, Brigham and Women’s Hospital, Boston, Massachusetts, United States
- Division of Pulmonary and Critical Care Medicine, Department of Medicine, Brigham and Women’s Hospital, Boston, Massachusetts, United States
- Division of Pulmonary, Critical Care and Sleep Medicine, Department of Medicine, National Jewish Health, Denver, Colorado, United States
- Division of Rheumatology, Department of Medicine, National Jewish Health, Denver, Colorado, United States
| |
Collapse
|
10
|
Hatt CR, Oh AS, Obuchowski NA, Charbonnier JP, Lynch DA, Humphries SM. Comparison of CT Lung Density Measurements between Standard Full-Dose and Reduced-Dose Protocols. Radiol Cardiothorac Imaging 2021; 3:e200503. [PMID: 33969308 DOI: 10.1148/ryct.2021200503] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2020] [Revised: 01/31/2021] [Accepted: 02/09/2021] [Indexed: 11/11/2022]
Abstract
Purpose To evaluate the reproducibility and predicted clinical outcomes of CT-based quantitative lung density measurements using standard fixed-dose (FD) and reduced-dose (RD) scans. Materials and Methods In this retrospective analysis of prospectively acquired data, 1205 participants (mean age, 65 years ± 9 [standard deviation]; 618 men) enrolled in the COPDGene study who underwent FD and RD CT image acquisition protocols between November 2014 and July 2017 were included. Of these, the RD scans of 640 participants were also reconstructed using iterative reconstruction (IR). Median filtering was applied to the RD scans (RD-MF) to investigate an alternative noise reduction strategy. CT attenuation at the 15th percentile of the lung CT histogram (Perc15) was computed for all image types (FD, RD, RD-MF, and RD-IR). Reproducibility coefficients were calculated to quantify the measurement differences between FD and RD scans. The ability of Perc15 to predict chronic obstructive pulmonary disease (COPD) diagnosis and exacerbation frequency was investigated using receiver operating characteristic analysis. Results The Perc15 reproducibility coefficients with and without volume adjustment were as follows: RD, 29.43 HU ± 0.62 versus 32.81 HU ± 1.70; RD-MF, 7.42 HU ± 0.42 versus 19.40 HU ± 2.65; and RD-IR, 7.10 HU ± 0.52 versus 22.46 HU ± 3.91. Receiver operating characteristic curve analysis indicated that Perc15 on volume-adjusted FD and RD scans were both predictive for COPD diagnosis (area under the receiver operating characteristic curve [AUC]: FD, 0.724 ± 0.045; RD, 0.739 ± 0.045) and for having one or more exacerbation per year (AUCs: FD, 0.593 ± 0.068; RD, 0.589 ± 0.066). Similar trends were observed when volume adjustment was not applied. Conclusion A combination of volume adjustment and noise reduction filtering improved the reproducibility of lung density measurements computed using serial FD and RD CT scans.Supplemental material is available for this article.© RSNA, 2021.
Collapse
Affiliation(s)
- Charles R Hatt
- Imbio LLC, 1015 Glenwood Ave, Minneapolis, MN 55405 (C.R.H.); School of Medicine and Public Health, Division of Radiology, University of Michigan, Ann Arbor, Mich (C.R.H.); Department of Radiology, National Jewish Health, Denver, Colo (A.S.O., D.A.L., S.M.H.); Lerner Research Institute, Cleveland Clinic, Cleveland, Ohio (N.A.O.); and Thirona, Nijmegen, the Netherlands (J.P.C.)
| | - Andrea S Oh
- Imbio LLC, 1015 Glenwood Ave, Minneapolis, MN 55405 (C.R.H.); School of Medicine and Public Health, Division of Radiology, University of Michigan, Ann Arbor, Mich (C.R.H.); Department of Radiology, National Jewish Health, Denver, Colo (A.S.O., D.A.L., S.M.H.); Lerner Research Institute, Cleveland Clinic, Cleveland, Ohio (N.A.O.); and Thirona, Nijmegen, the Netherlands (J.P.C.)
| | - Nancy A Obuchowski
- Imbio LLC, 1015 Glenwood Ave, Minneapolis, MN 55405 (C.R.H.); School of Medicine and Public Health, Division of Radiology, University of Michigan, Ann Arbor, Mich (C.R.H.); Department of Radiology, National Jewish Health, Denver, Colo (A.S.O., D.A.L., S.M.H.); Lerner Research Institute, Cleveland Clinic, Cleveland, Ohio (N.A.O.); and Thirona, Nijmegen, the Netherlands (J.P.C.)
| | - Jean-Paul Charbonnier
- Imbio LLC, 1015 Glenwood Ave, Minneapolis, MN 55405 (C.R.H.); School of Medicine and Public Health, Division of Radiology, University of Michigan, Ann Arbor, Mich (C.R.H.); Department of Radiology, National Jewish Health, Denver, Colo (A.S.O., D.A.L., S.M.H.); Lerner Research Institute, Cleveland Clinic, Cleveland, Ohio (N.A.O.); and Thirona, Nijmegen, the Netherlands (J.P.C.)
| | - David A Lynch
- Imbio LLC, 1015 Glenwood Ave, Minneapolis, MN 55405 (C.R.H.); School of Medicine and Public Health, Division of Radiology, University of Michigan, Ann Arbor, Mich (C.R.H.); Department of Radiology, National Jewish Health, Denver, Colo (A.S.O., D.A.L., S.M.H.); Lerner Research Institute, Cleveland Clinic, Cleveland, Ohio (N.A.O.); and Thirona, Nijmegen, the Netherlands (J.P.C.)
| | - Stephen M Humphries
- Imbio LLC, 1015 Glenwood Ave, Minneapolis, MN 55405 (C.R.H.); School of Medicine and Public Health, Division of Radiology, University of Michigan, Ann Arbor, Mich (C.R.H.); Department of Radiology, National Jewish Health, Denver, Colo (A.S.O., D.A.L., S.M.H.); Lerner Research Institute, Cleveland Clinic, Cleveland, Ohio (N.A.O.); and Thirona, Nijmegen, the Netherlands (J.P.C.)
| |
Collapse
|
11
|
Ram S, Hoff BA, Bell AJ, Galban S, Fortuna AB, Weinheimer O, Wielpütz MO, Robinson TE, Newman B, Vummidi D, Chughtai A, Kazerooni EA, Johnson TD, Han MK, Hatt CR, Galban CJ. Improved detection of air trapping on expiratory computed tomography using deep learning. PLoS One 2021; 16:e0248902. [PMID: 33760861 PMCID: PMC7990199 DOI: 10.1371/journal.pone.0248902] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2020] [Accepted: 02/26/2021] [Indexed: 11/29/2022] Open
Abstract
BACKGROUND Radiologic evidence of air trapping (AT) on expiratory computed tomography (CT) scans is associated with early pulmonary dysfunction in patients with cystic fibrosis (CF). However, standard techniques for quantitative assessment of AT are highly variable, resulting in limited efficacy for monitoring disease progression. OBJECTIVE To investigate the effectiveness of a convolutional neural network (CNN) model for quantifying and monitoring AT, and to compare it with other quantitative AT measures obtained from threshold-based techniques. MATERIALS AND METHODS Paired volumetric whole lung inspiratory and expiratory CT scans were obtained at four time points (0, 3, 12 and 24 months) on 36 subjects with mild CF lung disease. A densely connected CNN (DN) was trained using AT segmentation maps generated from a personalized threshold-based method (PTM). Quantitative AT (QAT) values, presented as the relative volume of AT over the lungs, from the DN approach were compared to QAT values from the PTM method. Radiographic assessment, spirometric measures, and clinical scores were correlated to the DN QAT values using a linear mixed effects model. RESULTS QAT values from the DN were found to increase from 8.65% ± 1.38% to 21.38% ± 1.82%, respectively, over a two-year period. Comparison of CNN model results to intensity-based measures demonstrated a systematic drop in the Dice coefficient over time (decreased from 0.86 ± 0.03 to 0.45 ± 0.04). The trends observed in DN QAT values were consistent with clinical scores for AT, bronchiectasis, and mucus plugging. In addition, the DN approach was found to be less susceptible to variations in expiratory deflation levels than the threshold-based approach. CONCLUSION The CNN model effectively delineated AT on expiratory CT scans, which provides an automated and objective approach for assessing and monitoring AT in CF patients.
Collapse
Affiliation(s)
- Sundaresh Ram
- Department of Radiology, Michigan Medicine, University of Michigan, Ann Arbor, Michigan, United States of America
- Department of Biomedical Engineering, Michigan Medicine, University of Michigan, Ann Arbor, Michigan, United States of America
| | - Benjamin A. Hoff
- Department of Radiology, Michigan Medicine, University of Michigan, Ann Arbor, Michigan, United States of America
| | - Alexander J. Bell
- Department of Radiology, Michigan Medicine, University of Michigan, Ann Arbor, Michigan, United States of America
| | - Stefanie Galban
- Department of Radiology, Michigan Medicine, University of Michigan, Ann Arbor, Michigan, United States of America
| | - Aleksa B. Fortuna
- Department of Radiology, Michigan Medicine, University of Michigan, Ann Arbor, Michigan, United States of America
| | - Oliver Weinheimer
- Department of Diagnostic and Interventional Radiology, University Hospital of Heidelberg, Heidelberg, Germany
- Translational Lung Research Center, Heidelberg (TLRC), German Lung Research Center (DZL), Heidelberg, Germany
| | - Mark O. Wielpütz
- Department of Diagnostic and Interventional Radiology, University Hospital of Heidelberg, Heidelberg, Germany
- Translational Lung Research Center, Heidelberg (TLRC), German Lung Research Center (DZL), Heidelberg, Germany
| | - Terry E. Robinson
- Department of Pediatrics, Center of Excellence in Pulmonary Biology, Stanford University School of Medicine, Stanford, California, United States of America
| | - Beverley Newman
- Department of Pediatric Radiology, Lucile Packard Children’s Hospital at Stanford, Stanford, California, United States of America
| | - Dharshan Vummidi
- Department of Radiology, Michigan Medicine, University of Michigan, Ann Arbor, Michigan, United States of America
| | - Aamer Chughtai
- Department of Radiology, Michigan Medicine, University of Michigan, Ann Arbor, Michigan, United States of America
| | - Ella A. Kazerooni
- Department of Radiology, Michigan Medicine, University of Michigan, Ann Arbor, Michigan, United States of America
- Department of Internal Medicine, Michigan Medicine, University of Michigan, Ann Arbor, Michigan, United States of America
| | - Timothy D. Johnson
- Department of Biostatistics, University of Michigan, School of Public Health, Ann Arbor, Michigan, United States of America
| | - MeiLan K. Han
- Department of Internal Medicine, Michigan Medicine, University of Michigan, Ann Arbor, Michigan, United States of America
| | - Charles R. Hatt
- Department of Radiology, Michigan Medicine, University of Michigan, Ann Arbor, Michigan, United States of America
- Imbio LLC, Minneapolis, Minnesota, United States of America
| | - Craig J. Galban
- Department of Radiology, Michigan Medicine, University of Michigan, Ann Arbor, Michigan, United States of America
- Department of Biomedical Engineering, Michigan Medicine, University of Michigan, Ann Arbor, Michigan, United States of America
| |
Collapse
|
12
|
Ram S, Tang W, Bell AJ, Spencer C, Buschhuas A, Hatt CR, di Magliano MP, Galban S, Galban CJ. Abstract PO-086: Detection of cancer lesions in histopathological lung images using a sparse PCA network. Clin Cancer Res 2021. [DOI: 10.1158/1557-3265.adi21-po-086] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Abstract
Purpose: Lung cancer has been the leading cause of cancer-related deaths worldwide. To address the clinical need for efficacious treatments, genetically engineered mouse models (GEMMs) have become integral in identifying and evaluating unique pathways that may be exploited as therapeutic targets. Assessment of GEMM tumor burden on histopathological sections performed by manual inspection is both time consuming and prone to subjective bias. Therefore, an interplay of needs and challenges exists for computer aided detection tools, for the accurate and efficient analysis of these histopathology images. Our work demonstrates a simple machine learning approach called sparse principal component analysis (PCA) network, for automated detection of cancerous lesions on histological lung slides stained by hematoxylin and eosin (H&E). Methods: Our method comprises four steps: 1) cascaded sparse PCA; 2) graph-based PCA hashing; 3) block-wise histograms; and 4) support vector machine (SVM) classification. In our proposed architecture, sparse PCA is employed to learn the filter banks of the multiple stages. This is followed by a graph-based PCA hashing and block histograms for indexing and pooling. The meaningful features extracted from this sparse PCA are then fed to an SVM classifier. We tested the proposed sparse PCA network on H&E slides obtained from an inducible KrasG12D lung cancer mouse model. Our dataset consists of N = 21 whole slide histopathology lung images with 9 non-tumor bearing control mice and 12 mice with visible lung tumors. Tumor lesions from 12 lung images with visible tumors were visually identified by three trained individuals, which served as ground truth. The size of each image in our dataset is 2048 × 2048 pixels. Each image was divided into non-overlapping image patches of size 20 × 20 pixels consisting of a total of 12,361 cancer lesion patches and 207,839 non-cancer patches. We used 50% of the data for training and 50% of the data for testing our proposed sparse PCA network. We evaluated our algorithm using conventional metrics that have been used for evaluation of classification algorithms, namely precision (P), recall (R), and coverage measure (F-score). Results: The automatic cancer lesion detection results were compared with manually annotated ground truth. The proposed method achieves a cancer lesion detection accuracy of 97.98% with P = 0.8624, R = 0.9062 and F-score = 0.8790. The proposed method was found to take on average 17 minutes to train and learn a good representation for accurate and efficient classification of cancerous lesions within the images. Conclusion: We demonstrated a simple machine learning methodology for detection of cancerous lesions within histopathological lung images. Experimental results show that the proposed method is able to classify the regions of interest both efficiently and accurately. Future work will focus on feature extraction of individual tumors and tumor location within lungs.
Citation Format: Sundaresh Ram, Wenfei Tang, Alexander J. Bell, Cara Spencer, Alexander Buschhuas, Charles R. Hatt, Marina P. di Magliano, Stefanie Galban, Craig J. Galban. Detection of cancer lesions in histopathological lung images using a sparse PCA network [abstract]. In: Proceedings of the AACR Virtual Special Conference on Artificial Intelligence, Diagnosis, and Imaging; 2021 Jan 13-14. Philadelphia (PA): AACR; Clin Cancer Res 2021;27(5_Suppl):Abstract nr PO-086.
Collapse
|
13
|
Criner RN, Hatt CR, Galbán CJ, Kazerooni EA, Lynch DA, McCormack MC, Casaburi R, MacIntyre NR, Make BJ, Martinez FJ, Labaki WW, Curtis JL, Han MLK. Relationship between diffusion capacity and small airway abnormality in COPDGene. Respir Res 2019; 20:269. [PMID: 31791337 PMCID: PMC6889734 DOI: 10.1186/s12931-019-1237-1] [Citation(s) in RCA: 22] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2019] [Accepted: 11/08/2019] [Indexed: 12/26/2022] Open
Abstract
Abstract Impaired single breath carbon monoxide diffusing capacity (DLCO) is associated with emphysema. Small airways disease (SAD) may be a precursor lesion to emphysema, but the relationship between SAD and DLCO is undescribed. We hypothesized that in mild COPD, functional SAD (fSAD) defined by computed tomography (CT) and Parametric Response Mapping methodology would correlate with impaired DLCO. Using data from ever-smokers in the COPDGene cohort, we established that fSAD correlated significantly with lower DLCO among both non-obstructed and GOLD 1–2 subjects. The relationship between DLCO with CT-defined emphysema was present in all GOLD stages, but most prominent in severe disease. Trial registration NCT00608764. Registry: COPDGene. Registered 06 February 2008, retrospectively registered.
Collapse
Affiliation(s)
- Rachel N Criner
- Division of Pulmonary, Allergy and Critical Care, University of Pennsylvania, 839 West Gates Building, Philadelphia, PA, 19104, USA.
| | - Charles R Hatt
- Imbio, LLC, Minneapolis, MN, USA.,Department of Radiology, University of Michigan, Ann Arbor, MI, USA
| | - Craig J Galbán
- Department of Radiology, University of Michigan, Ann Arbor, MI, USA
| | - Ella A Kazerooni
- Department of Radiology, University of Michigan, Ann Arbor, MI, USA
| | - David A Lynch
- Department of Radiology, National Jewish Health, Denver, CO, USA
| | - Meredith C McCormack
- Division of Pulmonary & Critical Care Medicine, Johns Hopkins Medicine, Baltimore, MD, USA
| | - Richard Casaburi
- Rehabilitation Clinical Trials Center, Los Angeles Biomedical Research Institute at Harbor-UCLA Medical Center, Torrance, CA, USA
| | - Neil R MacIntyre
- Division of Pulmonary, Allergy and Critical Care Medicine, Duke University, Durham, NC, USA
| | - Barry J Make
- Division of Pulmonary, Critical Care, and Sleep Medicine, National Jewish, Denver, CO, USA
| | - Fernando J Martinez
- Division of Pulmonary & Critical Care Medicine, Weill Cornell Medical College, New York, NY, USA
| | - Wassim W Labaki
- Division of Pulmonary & Critical Care Medicine, University of Michigan, Ann Arbor, MI, USA
| | - Jeffrey L Curtis
- Division of Pulmonary & Critical Care Medicine, University of Michigan, Ann Arbor, MI, USA.,VA Ann Arbor Healthcare System, Ann Arbor, MI, USA
| | - Mei Lan K Han
- Division of Pulmonary & Critical Care Medicine, University of Michigan, Ann Arbor, MI, USA
| |
Collapse
|
14
|
Labaki WW, Gu T, Murray S, Hatt CR, Galbán CJ, Ross BD, Martinez CH, Curtis JL, Hoffman EA, Pompe E, Lynch DA, Kazerooni EA, Martinez FJ, Han MK. Reprint of: Voxel-Wise Longitudinal Parametric Response Mapping Analysis of Chest Computed Tomography in Smokers. Acad Radiol 2019; 26:306-312. [PMID: 30792137 DOI: 10.1016/j.acra.2019.02.003] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2017] [Revised: 05/01/2018] [Accepted: 05/19/2018] [Indexed: 11/17/2022]
Abstract
RATIONALE AND OBJECTIVES Chronic obstructive pulmonary disease is a heterogeneous disease characterized by small airway abnormality and emphysema. We hypothesized that a voxel-wise computed tomography analytic approach would identify patterns of disease progression in smokers. MATERIALS AND METHODS We analyzed 725 smokers in spirometric GOLD stages 0-4 with two chest CTs 5 years apart. Baseline inspiration, follow-up inspiration and follow-up expiration images were spatially registered to baseline expiration so that each voxel had correspondences across all time points and respiratory phases. Voxel-wise Parametric Response Mapping (PRM) was then generated for the baseline and follow-up scans. PRM classifies lung as normal, functional small airway disease (PRMfSAD), and emphysema (PRMEMPH). RESULTS Subjects with low baseline PRMfSAD and PRMEMPH predominantly had an increase in PRMfSAD on follow-up; those with higher baseline PRMfSAD and PRMEMPH mostly had increases in PRMEMPH. For GOLD 0 participants (n = 419), mean 5-year increases in PRMfSAD and PRMEMPH were 0.3% for both; for GOLD 1-4 participants (n = 306), they were 0.6% and 1.6%, respectively. Eighty GOLD 0 subjects (19.1%) had overall radiologic progression (30.0% to PRMfSAD, 52.5% to PRMEMPH, and 17.5% to both); 153 GOLD 1-4 subjects (50.0%) experienced progression (17.6% to PRMfSAD, 48.4% to PRMEMPH, and 34.0% to both). In a multivariable model, both baseline PRMfSAD and PRMEMPH were associated with development of PRMEMPH on follow-up, although this relationship was diminished at higher levels of baseline PRMEMPH. CONCLUSION A voxel-wise longitudinal PRM analytic approach can identify patterns of disease progression in smokers with and without chronic obstructive pulmonary disease.
Collapse
Affiliation(s)
- Wassim W Labaki
- Division of Pulmonary and Critical Care Medicine, University of Michigan, 3916 Taubman Center, 1500 E Medical Center Drive, Ann Arbor, MI
| | - Tian Gu
- Department of Biostatistics, University of Michigan, Ann Arbor, Michigan
| | - Susan Murray
- Department of Biostatistics, University of Michigan, Ann Arbor, Michigan
| | | | - Craig J Galbán
- Department of Radiology, University of Michigan, Ann Arbor, Michigan
| | - Brian D Ross
- Imbio LLC, Minneapolis, Minnesota; Department of Radiology, University of Michigan, Ann Arbor, Michigan
| | - Carlos H Martinez
- Division of Pulmonary and Critical Care Medicine, University of Michigan, 3916 Taubman Center, 1500 E Medical Center Drive, Ann Arbor, MI
| | - Jeffrey L Curtis
- Division of Pulmonary and Critical Care Medicine, University of Michigan, 3916 Taubman Center, 1500 E Medical Center Drive, Ann Arbor, MI; Medical Service, VA Ann Arbor Healthcare System, Ann Arbor, Michigan
| | - Eric A Hoffman
- Department of Radiology, University of Iowa, Iowa City, Iowa
| | - Esther Pompe
- Department of Respiratory Medicine, University Medical Center Utrecht, Utrecht, The Netherlands
| | - David A Lynch
- Department of Radiology, National Jewish Health, Denver, Colorado
| | - Ella A Kazerooni
- Department of Radiology, University of Michigan, Ann Arbor, Michigan
| | - Fernando J Martinez
- Division of Pulmonary and Critical Care Medicine, University of Michigan, 3916 Taubman Center, 1500 E Medical Center Drive, Ann Arbor, MI; Division of Pulmonary and Critical Care Medicine, Weill Cornell Medical College, New York, New York
| | - MeiLan K Han
- Division of Pulmonary and Critical Care Medicine, University of Michigan, 3916 Taubman Center, 1500 E Medical Center Drive, Ann Arbor, MI.
| |
Collapse
|
15
|
Labaki WW, Gu T, Murray S, Hatt CR, Galbán CJ, Ross BD, Martinez CH, Curtis JL, Hoffman EA, Pompe E, Lynch DA, Kazerooni EA, Martinez FJ, Han MK. Voxel-Wise Longitudinal Parametric Response Mapping Analysis of Chest Computed Tomography in Smokers. Acad Radiol 2019; 26:217-223. [PMID: 30055897 DOI: 10.1016/j.acra.2018.05.024] [Citation(s) in RCA: 48] [Impact Index Per Article: 9.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2017] [Revised: 05/01/2018] [Accepted: 05/19/2018] [Indexed: 12/31/2022]
Abstract
RATIONALE AND OBJECTIVES Chronic obstructive pulmonary disease is a heterogeneous disease characterized by small airway abnormality and emphysema. We hypothesized that a voxel-wise computed tomography analytic approach would identify patterns of disease progression in smokers. MATERIALS AND METHODS We analyzed 725 smokers in spirometric GOLD stages 0-4 with two chest CTs 5 years apart. Baseline inspiration, follow-up inspiration and follow-up expiration images were spatially registered to baseline expiration so that each voxel had correspondences across all time points and respiratory phases. Voxel-wise Parametric Response Mapping (PRM) was then generated for the baseline and follow-up scans. PRM classifies lung as normal, functional small airway disease (PRMfSAD), and emphysema (PRMEMPH). RESULTS Subjects with low baseline PRMfSAD and PRMEMPH predominantly had an increase in PRMfSAD on follow-up; those with higher baseline PRMfSAD and PRMEMPH mostly had increases in PRMEMPH. For GOLD 0 participants (n = 419), mean 5-year increases in PRMfSAD and PRMEMPH were 0.3% for both; for GOLD 1-4 participants (n = 306), they were 0.6% and 1.6%, respectively. Eighty GOLD 0 subjects (19.1%) had overall radiologic progression (30.0% to PRMfSAD, 52.5% to PRMEMPH, and 17.5% to both); 153 GOLD 1-4 subjects (50.0%) experienced progression (17.6% to PRMfSAD, 48.4% to PRMEMPH, and 34.0% to both). In a multivariable model, both baseline PRMfSAD and PRMEMPH were associated with development of PRMEMPH on follow-up, although this relationship was diminished at higher levels of baseline PRMEMPH. CONCLUSION A voxel-wise longitudinal PRM analytic approach can identify patterns of disease progression in smokers with and without chronic obstructive pulmonary disease.
Collapse
|
16
|
Wagner MG, Hatt CR, Dunkerley DAP, Bodart LE, Raval AN, Speidel MA. A dynamic model-based approach to motion and deformation tracking of prosthetic valves from biplane x-ray images. Med Phys 2018; 45:2583-2594. [PMID: 29659023 DOI: 10.1002/mp.12913] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2017] [Revised: 04/02/2018] [Accepted: 04/02/2018] [Indexed: 11/11/2022] Open
Abstract
PURPOSE Transcatheter aortic valve replacement (TAVR) is a minimally invasive procedure in which a prosthetic heart valve is placed and expanded within a defective aortic valve. The device placement is commonly performed using two-dimensional (2D) fluoroscopic imaging. Within this work, we propose a novel technique to track the motion and deformation of the prosthetic valve in three dimensions based on biplane fluoroscopic image sequences. METHODS The tracking approach uses a parameterized point cloud model of the valve stent which can undergo rigid three-dimensional (3D) transformation and different modes of expansion. Rigid elements of the model are individually rotated and translated in three dimensions to approximate the motions of the stent. Tracking is performed using an iterative 2D-3D registration procedure which estimates the model parameters by minimizing the mean-squared image values at the positions of the forward-projected model points. Additionally, an initialization technique is proposed, which locates clusters of salient features to determine the initial position and orientation of the model. RESULTS The proposed algorithms were evaluated based on simulations using a digital 4D CT phantom as well as experimentally acquired images of a prosthetic valve inside a chest phantom with anatomical background features. The target registration error was 0.12 ± 0.04 mm in the simulations and 0.64 ± 0.09 mm in the experimental data. CONCLUSIONS The proposed algorithm could be used to generate 3D visualization of the prosthetic valve from two projections. In combination with soft-tissue sensitive-imaging techniques like transesophageal echocardiography, this technique could enable 3D image guidance during TAVR procedures.
Collapse
Affiliation(s)
- Martin G Wagner
- Department of Medical Physics, University of Wisconsin-Madison, Madison, WI, USA.,Department of Radiology, University of Wisconsin-Madison, Madison, WI, USA
| | - Charles R Hatt
- Department of Medical Physics, University of Wisconsin-Madison, Madison, WI, USA
| | - David A P Dunkerley
- Department of Medical Physics, University of Wisconsin-Madison, Madison, WI, USA
| | - Lindsay E Bodart
- Department of Medical Physics, University of Wisconsin-Madison, Madison, WI, USA
| | - Amish N Raval
- Department of Medicine, University of Wisconsin-Madison, Madison, WI, USA
| | - Michael A Speidel
- Department of Medical Physics, University of Wisconsin-Madison, Madison, WI, USA.,Department of Medicine, University of Wisconsin-Madison, Madison, WI, USA
| |
Collapse
|
17
|
Fernández-Baldera A, Hatt CR, Murray S, Hoffman EA, Kazerooni EA, Martinez FJ, Han MK, Galbán CJ. Correcting Nonpathological Variation in Longitudinal Parametric Response Maps of CT Scans in COPD Subjects: SPIROMICS. Tomography 2017; 3:138-145. [PMID: 29457137 PMCID: PMC5812694 DOI: 10.18383/j.tom.2017.00013] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Small airways disease (SAD) is one of the leading causes of airflow limitations in patients diagnosed with chronic obstructive pulmonary disease (COPD). Parametric response mapping (PRM) of computed tomography (CT) scans allows for the quantification of this previously invisible COPD component. Although PRM is being investigated as a diagnostic tool for COPD, variability in the longitudinal measurements of SAD by PRM has been reported. Here, we show a method for correcting longitudinal PRM data because of non-pathological variations in serial CT scans. In this study, serial whole-lung high-resolution CT scans over a 30-day interval were obtained from 90 subjects with and without COPD accrued as part of SPIROMICS. It was assumed in all subjects that the COPD did not progress between examinations. CT scans were acquired at inspiration and expiration, spatially aligned to a single geometric frame, and analyzed using PRM. By modeling variability in longitudinal CT scans, our method could identify, at the voxel-level, shifts in PRM classification over the 30-day interval. In the absence of any correction, PRM generated serial percent volumes of functional SAD with differences as high as 15%. Applying the correction strategy significantly mitigated this effect with differences ~1%. At the voxel-level, significant differences were found between baseline PRM classifications and the follow-up map computed with and without correction (P <. 01 over GOLD). This strategy of accounting for nonpathological sources of variability in longitudinal PRM may improve the quantification of COPD phenotypes transitioning with disease progression.
Collapse
Affiliation(s)
| | | | - Susan Murray
- Department of Public Health, University of Michigan, Ann Arbor, MI
| | - Eric A. Hoffman
- Departments of Radiology and Biomedical Engineering, University of Iowa, IA
| | | | | | - MeiLan K. Han
- Department of Internal Medicine, University of Michigan, Ann Arbor, MI
| | - Craig J. Galbán
- Department of Radiology, University of Michigan, Ann Arbor, MI
| |
Collapse
|
18
|
Slagowski JM, Dunkerley DAP, Hatt CR, Speidel MA. Single-view geometric calibration for C-arm inverse geometry CT. J Med Imaging (Bellingham) 2017; 4:013506. [PMID: 28560241 PMCID: PMC5358550 DOI: 10.1117/1.jmi.4.1.013506] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2016] [Accepted: 03/06/2017] [Indexed: 11/30/2022] Open
Abstract
Accurate and artifact-free reconstruction of tomographic images requires precise knowledge of the imaging system geometry. A projection matrix-based calibration method to enable C-arm inverse geometry CT (IGCT) is proposed. The method is evaluated for scanning-beam digital x-ray (SBDX), a C-arm mounted inverse geometry fluoroscopic technology. A helical configuration of fiducials is imaged at each gantry angle in a rotational acquisition. For each gantry angle, digital tomosynthesis is performed at multiple planes and a composite image analogous to a cone-beam projection is generated from the plane stack. The geometry of the C-arm, source array, and detector array is determined at each angle by constructing a parameterized three-dimensional-to-two-dimensional projection matrix that minimizes the sum-of-squared deviations between measured and projected fiducial coordinates. Simulations were used to evaluate calibration performance with translations and rotations of the source and detector. The relative root-mean-square error in a reconstruction of a numerical thorax phantom was 0.4% using the calibration method versus 7.7% without calibration. In phantom studies, reconstruction of SBDX projections using the proposed method eliminated artifacts present in noncalibrated reconstructions. The proposed IGCT calibration method reduces image artifacts when uncertainties exist in system geometry.
Collapse
Affiliation(s)
- Jordan M Slagowski
- University of Wisconsin, Department of Medical Physics, Madison, Wisconsin, United States
| | - David A P Dunkerley
- University of Wisconsin, Department of Medical Physics, Madison, Wisconsin, United States
| | - Charles R Hatt
- University of Wisconsin, Department of Biomedical Engineering, Madison, Wisconsin, United States
| | - Michael A Speidel
- University of Wisconsin, Department of Medical Physics, Madison, Wisconsin, United States.,University of Wisconsin, Department of Medicine, Madison, Wisconsin, United States
| |
Collapse
|
19
|
Hatt CR, Tomkowiak MT, Dunkerley DAP, Slagowski JM, Funk T, Raval AN, Speidel MA. Depth-resolved registration of transesophageal echo to x-ray fluoroscopy using an inverse geometry fluoroscopy system. Med Phys 2016; 42:7022-33. [PMID: 26632057 DOI: 10.1118/1.4935534] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
PURPOSE Image registration between standard x-ray fluoroscopy and transesophageal echocardiography (TEE) has recently been proposed. Scanning-beam digital x-ray (SBDX) is an inverse geometry fluoroscopy system designed for cardiac procedures. This study presents a method for 3D registration of SBDX and TEE images based on the tomosynthesis and 3D tracking capabilities of SBDX. METHODS The registration algorithm utilizes the stack of tomosynthetic planes produced by the SBDX system to estimate the physical 3D coordinates of salient key-points on the TEE probe. The key-points are used to arrive at an initial estimate of the probe pose, which is then refined using a 2D/3D registration method adapted for inverse geometry fluoroscopy. A phantom study was conducted to evaluate probe pose estimation accuracy relative to the ground truth, as defined by a set of coregistered fiducial markers. This experiment was conducted with varying probe poses and levels of signal difference-to-noise ratio (SDNR). Additional phantom and in vivo studies were performed to evaluate the correspondence of catheter tip positions in TEE and x-ray images following registration of the two modalities. RESULTS Target registration error (TRE) was used to characterize both pose estimation and registration accuracy. In the study of pose estimation accuracy, successful pose estimates (3D TRE < 5.0 mm) were obtained in 97% of cases when the SDNR was 5.9 or higher in seven out of eight poses. Under these conditions, 3D TRE was 2.32 ± 1.88 mm, and 2D (projection) TRE was 1.61 ± 1.36 mm. Probe localization error along the source-detector axis was 0.87 ± 1.31 mm. For the in vivo experiments, mean 3D TRE ranged from 2.6 to 4.6 mm and mean 2D TRE ranged from 1.1 to 1.6 mm. Anatomy extracted from the echo images appeared well aligned when projected onto the SBDX images. CONCLUSIONS Full 6 DOF image registration between SBDX and TEE is feasible and accurate to within 5 mm. Future studies will focus on real-time implementation and application-specific analysis.
Collapse
Affiliation(s)
- Charles R Hatt
- Department of Biomedical Engineering, University of Wisconsin-Madison, Madison, Wisconsin 53705
| | - Michael T Tomkowiak
- Department of Medical Physics, University of Wisconsin-Madison, Madison, Wisconsin 53705
| | - David A P Dunkerley
- Department of Medical Physics, University of Wisconsin-Madison, Madison, Wisconsin 53705
| | - Jordan M Slagowski
- Department of Medical Physics, University of Wisconsin-Madison, Madison, Wisconsin 53705
| | - Tobias Funk
- Triple Ring Technologies, Inc., Newark, California 94560
| | - Amish N Raval
- Department of Medicine, University of Wisconsin-Madison, Madison, Wisconsin 53792
| | - Michael A Speidel
- Departments of Medical Physics and Medicine, University of Wisconsin-Madison, Madison, Wisconsin 53705
| |
Collapse
|
20
|
Hatt CR, Speidel MA, Raval AN. Real-time pose estimation of devices from x-ray images: Application to x-ray/echo registration for cardiac interventions. Med Image Anal 2016; 34:101-108. [PMID: 27179366 DOI: 10.1016/j.media.2016.04.008] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2016] [Revised: 04/08/2016] [Accepted: 04/23/2016] [Indexed: 11/18/2022]
Abstract
In recent years, registration between x-ray fluoroscopy (XRF) and transesophageal echocardiography (TEE) has been rapidly developed, validated, and translated to the clinic as a tool for advanced image guidance of structural heart interventions. This technology relies on accurate pose-estimation of the TEE probe via standard 2D/3D registration methods. It has been shown that latencies caused by slow registrations can result in errors during untracked frames, and a real-time ( > 15 hz) tracking algorithm is needed to minimize these errors. This paper presents two novel similarity metrics designed for accurate, robust, and extremely fast pose-estimation of devices from XRF images: Direct Splat Correlation (DSC) and Patch Gradient Correlation (PGC). Both metrics were implemented in CUDA C, and validated on simulated and clinical datasets against prior methods presented in the literature. It was shown that by combining DSC and PGC in a hybrid method (HYB), target registration errors comparable to previously reported methods were achieved, but at much higher speeds and lower failure rates. In simulated datasets, the proposed HYB method achieved a median projected target registration error (pTRE) of 0.33 mm and a mean registration frame-rate of 12.1 hz, while previously published methods produced median pTREs greater than 1.5 mm and mean registration frame-rates less than 4 hz. In clinical datasets, the HYB method achieved a median pTRE of 1.1 mm and a mean registration frame-rate of 20.5 hz, while previously published methods produced median pTREs greater than 1.3 mm and mean registration frame-rates less than 12 hz. The proposed hybrid method also had much lower failure rates than previously published methods.
Collapse
Affiliation(s)
- Charles R Hatt
- University of Wisconsin - Madison, Department of Medical Physics, 1111 Highland Ave, Rm 1005 Madison, WI, 53705, United States.
| | - Michael A Speidel
- University of Wisconsin - Madison, Department of Medical Physics, United States
| | - Amish N Raval
- University of Wisconsin - Madison, School of Medicine and Public Health, Division of Cardiovascular Medicine, United States
| |
Collapse
|
21
|
Slagowski JM, Dunkerley DAP, Hatt CR, Speidel MA. A geometric calibration method for inverse geometry computed tomography using P-matrices. Proc SPIE Int Soc Opt Eng 2016; 9783:978337. [PMID: 27375313 PMCID: PMC4925097 DOI: 10.1117/12.2216565] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
Accurate and artifact free reconstruction of tomographic images requires precise knowledge of the imaging system geometry. This work proposes a novel projection matrix (P-matrix) based calibration method to enable C-arm inverse geometry CT (IGCT). The method is evaluated for scanning-beam digital x-ray (SBDX), a C-arm mounted inverse geometry fluoroscopic technology. A helical configuration of fiducials is imaged at each gantry angle in a rotational acquisition. For each gantry angle, digital tomosynthesis is performed at multiple planes and a composite image analogous to a cone-beam projection is generated from the plane stack. The geometry of the C-arm, source array, and detector array is determined at each angle by constructing a parameterized 3D-to-2D projection matrix that minimizes the sum-of-squared deviations between measured and projected fiducial coordinates. Simulations were used to evaluate calibration performance with translations and rotations of the source and detector. In a geometry with 1 mm translation of the central ray relative to the axis-of-rotation and 1 degree yaw of the detector and source arrays, the maximum error in the recovered translational parameters was 0.4 mm and maximum error in the rotation parameter was 0.02 degrees. The relative root-mean-square error in a reconstruction of a numerical thorax phantom was 0.4% using the calibration method, versus 7.7% without calibration. Changes in source-detector-distance were the most challenging to estimate. Reconstruction of experimental SBDX data using the proposed method eliminated double contour artifacts present in a non-calibrated reconstruction. The proposed IGCT geometric calibration method reduces image artifacts when uncertainties exist in system geometry.
Collapse
Affiliation(s)
| | | | - Charles R Hatt
- Dept. of Biomedical Engineering, University of Wisconsin, Madison, WI, USA
| | - Michael A Speidel
- Dept. of Medical Physics, University of Wisconsin, Madison, WI, USA; Dept. of Medicine, University of Wisconsin, Madison, WI, USA
| |
Collapse
|
22
|
Hatt CR, Wagner M, Raval AN, Speidel MA. Dynamic tracking of prosthetic valve motion and deformation from bi-plane x-ray views: feasibility study. Proc SPIE Int Soc Opt Eng 2016; 9786:978604. [PMID: 28008211 PMCID: PMC5166601 DOI: 10.1117/12.2216588] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
Transcatheter aortic valve replacement (TAVR) requires navigation and deployment of a prosthetic valve within the aortic annulus under fluoroscopic guidance. To support improved device visualization in this procedure, this study investigates the feasibility of frame-by-frame 3D reconstruction of a moving and expanding prosthetic valve structure from simultaneous bi-plane x-ray views. In the proposed method, a dynamic 3D model of the valve is used in a 2D/3D registration framework to obtain a reconstruction of the valve. For each frame, valve model parameters describing position, orientation, expansion state, and deformation are iteratively adjusted until forward projections of the model match both bi-plane views. Simulated bi-plane imaging of a valve at different signal-difference-to-noise ratio (SDNR) levels was performed to test the approach. 20 image sequences with 50 frames of valve deployment were simulated at each SDNR. The simulation achieved a target registration error (TRE) of the estimated valve model of 0.93 ± 2.6 mm (mean ± S.D.) for the lowest SDNR of 2. For higher SDNRs (5 to 50) a TRE of 0.04 mm ± 0.23 mm was achieved. A tabletop phantom study was then conducted using a TAVR valve. The dynamic 3D model was constructed from high resolution CT scans and a simple expansion model. TRE was 1.22 ± 0.35 mm for expansion states varying from undeployed to fully deployed, and for moderate amounts of inter-frame motion. Results indicate that it is feasible to use bi-plane imaging to recover the 3D structure of deformable catheter devices.
Collapse
Affiliation(s)
- Charles R Hatt
- Dept. of Biomedical Engineering, University of Wisconsin, Madison, WI, USA
| | - Martin Wagner
- Dept. of Medical Physics, University of Wisconsin, Madison, WI, USA
| | - Amish N Raval
- Dept. of Medicine, University of Wisconsin, Madison, WI, USA ; Dept. of Biomedical Engineering, University of Wisconsin, Madison, WI, USA
| | - Michael A Speidel
- Dept. of Medical Physics, University of Wisconsin, Madison, WI, USA ; Dept. of Medicine, University of Wisconsin, Madison, WI, USA
| |
Collapse
|
23
|
Hatt CR, Jain AK, Parthasarathy V, Lang A, Raval AN. MRI-3D ultrasound-X-ray image fusion with electromagnetic tracking for transendocardial therapeutic injections: in-vitro validation and in-vivo feasibility. Comput Med Imaging Graph 2013; 37:162-73. [PMID: 23561056 DOI: 10.1016/j.compmedimag.2013.03.006] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2012] [Revised: 03/12/2013] [Accepted: 03/14/2013] [Indexed: 11/17/2022]
Abstract
Myocardial infarction (MI) is one of the leading causes of death in the world. Small animal studies have shown that stem-cell therapy offers dramatic functional improvement post-MI. An endomyocardial catheter injection approach to therapeutic agent delivery has been proposed to improve efficacy through increased cell retention. Accurate targeting is critical for reaching areas of greatest therapeutic potential while avoiding a life-threatening myocardial perforation. Multimodal image fusion has been proposed as a way to improve these procedures by augmenting traditional intra-operative imaging modalities with high resolution pre-procedural images. Previous approaches have suffered from a lack of real-time tissue imaging and dependence on X-ray imaging to track devices, leading to increased ionizing radiation dose. In this paper, we present a new image fusion system for catheter-based targeted delivery of therapeutic agents. The system registers real-time 3D echocardiography, magnetic resonance, X-ray, and electromagnetic sensor tracking within a single flexible framework. All system calibrations and registrations were validated and found to have target registration errors less than 5 mm in the worst case. Injection accuracy was validated in a motion enabled cardiac injection phantom, where targeting accuracy ranged from 0.57 to 3.81 mm. Clinical feasibility was demonstrated with in-vivo swine experiments, where injections were successfully made into targeted regions of the heart.
Collapse
Affiliation(s)
- Charles R Hatt
- University of Wisconsin - Madison, College of Engineering, Department of Biomedical Engineering, 1415 Engineering Drive, Madison, WI 53706, USA.
| | | | | | | | | |
Collapse
|
24
|
Hatt CR, Stanton D, Parthasarathy V, Jain AK, Raval AN. A method for measuring the accuracy of multi-modal image fusion system for catheter-based cardiac interventions using a novel motion enabled targeting phantom. Annu Int Conf IEEE Eng Med Biol Soc 2011; 2011:6260-6264. [PMID: 22255769 PMCID: PMC3594695 DOI: 10.1109/iembs.2011.6091545] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/31/2023]
Abstract
Targeted stem cell therapy offers great potential for the repair of infarcted cardiac tissue following heart attack. Safe delivery of stem-cells via catheter based interventions remains a challenge. A multi-modal image fusion approach has been considered for safe targeting of myocardial infarct border zones. In this paper we present an apparatus and method for measuring the accuracy of catheter-based injections using a multi-modal image fusion system. We also present results of the accuracy of our image fusion system under varying levels of cardio-respiratory motion.
Collapse
Affiliation(s)
- Charles R Hatt
- University of Wisconsin, Madison, WI 53792, USA. hatt@ wisc.edu
| | | | | | | | | |
Collapse
|
25
|
Hatt CR, Raval AN, Jain A, Parasarathy V. REAL-TIME 3D ULTRASOUND TO MR IMAGE FUSION CAN GUIDE CATHETER-BASED CARDIAC PROCEDURES. J Am Coll Cardiol 2010. [DOI: 10.1016/s0735-1097(10)60717-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|