1
|
Kaftan P, Heinrich MP, Hansen L, Rasche V, Kestler HA, Bigalke A. Sparse keypoint segmentation of lung fissures: efficient geometric deep learning for abstracting volumetric images. Int J Comput Assist Radiol Surg 2025; 20:465-473. [PMID: 39775630 PMCID: PMC11929708 DOI: 10.1007/s11548-024-03310-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2024] [Accepted: 12/11/2024] [Indexed: 01/11/2025]
Abstract
PURPOSE Lung fissure segmentation on CT images often relies on 3D convolutional neural networks (CNNs). However, 3D-CNNs are inefficient for detecting thin structures like the fissures, which make up a tiny fraction of the entire image volume. We propose to make lung fissure segmentation more efficient by using geometric deep learning (GDL) on sparse point clouds. METHODS We abstract image data with sparse keypoint (KP) clouds. We train GDL models to segment the point cloud, comparing three major paradigms of models (PointNets, graph convolutional networks (GCNs), and PointTransformers). From the sparse point segmentations, 3D meshes of the objects are reconstructed to obtain a dense surface. The state-of-the-art Poisson surface reconstruction (PSR) makes up most of the time in our pipeline. Therefore, we propose an efficient point cloud to mesh autoencoder (PC-AE) that deforms a template mesh to fit a point cloud in a single forward pass. Our pipeline is evaluated extensively and compared to the 3D-CNN gold standard nnU-Net on diverse clinical and pathological data. RESULTS GCNs yield the best trade-off between inference time and accuracy, being 21 × faster with only 1.4 × increased error over the nnU-Net. Our PC-AE also achieves a favorable trade-off, being 3 × faster at 1.5 × the error compared to the PSR. CONCLUSION We present a KP-based fissure segmentation pipeline that is more efficient than 3D-CNNs and can greatly speed up large-scale analyses. A novel PC-AE for efficient mesh reconstruction from sparse point clouds is introduced, showing promise not only for fissure segmentation. Source code is available on https://github.com/kaftanski/fissure-segmentation-IJCARS.
Collapse
Affiliation(s)
- Paul Kaftan
- Institute of Medical Systems Biology, Ulm University, Albert-Einstein-Allee 11, 89081, Ulm, Germany
- Institute of Medical Informatics, University of Lübeck, Ratzeburger Allee 160, 23562, Lübeck, Germany
- International Graduate School in Molecular Medicine, Ulm University, Albert-Einstein-Allee 11, 89081, Ulm, Germany
- MoMAN Center for Translational Imaging, Ulm University, Albert-Einstein-Allee 23, 89081, Ulm, Germany
| | - Mattias P Heinrich
- Institute of Medical Informatics, University of Lübeck, Ratzeburger Allee 160, 23562, Lübeck, Germany
| | - Lasse Hansen
- EchoScout GmbH, Maria-Goeppert-Str. 3, 23562, Lübeck, Germany
| | - Volker Rasche
- MoMAN Center for Translational Imaging, Ulm University, Albert-Einstein-Allee 23, 89081, Ulm, Germany
| | - Hans A Kestler
- Institute of Medical Systems Biology, Ulm University, Albert-Einstein-Allee 11, 89081, Ulm, Germany.
| | - Alexander Bigalke
- Institute of Medical Informatics, University of Lübeck, Ratzeburger Allee 160, 23562, Lübeck, Germany.
| |
Collapse
|
2
|
Fufin M, Makarov V, Alfimov VI, Ananev VV, Ananeva A. Pulmonary Fissure Segmentation in CT Images Using Image Filtering and Machine Learning. Tomography 2024; 10:1645-1664. [PMID: 39453038 PMCID: PMC11510873 DOI: 10.3390/tomography10100121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2024] [Revised: 09/24/2024] [Accepted: 09/30/2024] [Indexed: 10/26/2024] Open
Abstract
BACKGROUND Both lung lobe segmentation and lung fissure segmentation are useful in the clinical diagnosis and evaluation of lung disease. It is often of clinical interest to quantify each lobe separately because many diseases are associated with specific lobes. Fissure segmentation is important for a significant proportion of lung lobe segmentation methods, as well as for assessing fissure completeness, since there is an increasing requirement for the quantification of fissure integrity. METHODS We propose a method for the fully automatic segmentation of pulmonary fissures on lung computed tomography (CT) based on U-Net and PAN models using a Derivative of Stick (DoS) filter for data preprocessing. Model ensembling is also used to improve prediction accuracy. RESULTS Our method achieved an F1 score of 0.916 for right-lung fissures and 0.933 for left-lung fissures, which are significantly higher than the standalone DoS results (0.724 and 0.666, respectively). We also performed lung lobe segmentation using fissure segmentation. The lobe segmentation algorithm shows results close to those of state-of-the-art methods, with an average Dice score of 0.989. CONCLUSIONS The proposed method segments pulmonary fissures efficiently and have low memory requirements, which makes it suitable for further research in this field involving rapid experimentation.
Collapse
Affiliation(s)
- Mikhail Fufin
- Medical Informatics Laboratory, Yaroslav-the-Wise Novgorod State University, 41 B. St. Petersburgskaya, Veliky Novgorod 173003, Russia; (V.M.); (V.I.A.); (V.V.A.); (A.A.)
| | | | | | | | | |
Collapse
|
3
|
Wang C, Du J, Mei X, Guo L, Li F, Luo H, Li F. The Value of Effective Lung Ventilation Area Ratio Based on CT Image Analysis Is a New Index to Predict the Shorter Outcome of Anti-melanoma Differentiation-Associated Protein 5 Positive Dermatomyositis Associated Interstitial Lung Disease: A Single-Center Retrospective Study. Front Med (Lausanne) 2021; 8:728487. [PMID: 34692722 PMCID: PMC8529150 DOI: 10.3389/fmed.2021.728487] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2021] [Accepted: 09/13/2021] [Indexed: 11/13/2022] Open
Abstract
Background: Anti-melanoma differentiation-associated protein 5 (MDA5) positive dermatomyositis (MDA5+DM) patients have poor outcomes due to rapidly progressive interstitial lung disease (ILD). The accurate assessment of lung involvement is an urgent focus of research. Methods: A computer-aided lung interstitial image analysis technology has been developed, and a quantitative indicator named effective lung ventilation area ratio (ELVAR) that calculates the proportion of the area outside the lung interstitium in lung tissue has been established. 55 newly diagnosed MDA5+DM patients and 46 healthy individuals, matched for age and gender, were enrolled in this study. MDA5+DM patients were classified into early death group or early survival group according to their survival state within 3 months after diagnosis. Clinical characteristics, laboratory and immunological test results, lung involvement (including ELVAR value) and treatment were compared between early death group and early survival group to determine an index that can predict prognoses of patients with MDA5+DM. Results: There were significant differences between early death MDA5+DM patients and early survival MDA5+DM patients about 12 indices including age of onset, CRP, ferritin, albumin, and pulmonary involvement including severity of type I respiratory failure at diagnosis, P/F ratio, oxygen supplementation, values of ELVAR, FVC, and DLCO. The results of ROC analysis and correlation analysis showed the value of ELVAR had good diagnostic value and widely correlation with many clinical characteristics. Univariate analysis and Multivariate analysis showed four factors including age of onset, ferritin, value of ELVAR, and oxygen supplementation >4 L/min significantly value for poor prognosis in MDA5+DM patients. A cutoff value of 0.835 about ELVAR had good predictive power for mortality within 3 months in 54.2% of MDA5+DM patients. Conclusion: The value of ELVAR derived from computed tomography image analysis is a new index that can predict poor outcomes in MDA5+DM patients with rapidly progressive interstitial lung disease.
Collapse
Affiliation(s)
- Changjian Wang
- College of Computer, National University of Defense Technology, Changsha, China
| | - Jinfeng Du
- Department of Rheumatology and Immunology, The Second Xiangya Hospital of Central South University, Changsha, China
| | - Xilong Mei
- Department of Radiology, The Second Xiangya Hospital of Central South University, Changsha, China
| | - Lingchao Guo
- College of Computer, National University of Defense Technology, Changsha, China
| | - Fangzhao Li
- College of Computer, National University of Defense Technology, Changsha, China
| | - Hong Luo
- Department of Respiratory and Critical Care Medicine, The Second Xiangya Hospital of Central South University, Changsha, China
| | - Fen Li
- Department of Rheumatology and Immunology, The Second Xiangya Hospital of Central South University, Changsha, China
| |
Collapse
|
4
|
Synn AJ, Margerie-Mellon CD, Jeong SY, Rahaghi FN, Jhun I, Washko GR, Estépar RSJ, Bankier AA, Mittleman MA, VanderLaan PA, Rice MB. Vascular remodeling of the small pulmonary arteries and measures of vascular pruning on computed tomography. Pulm Circ 2021; 11:20458940211061284. [PMID: 34881020 PMCID: PMC8647266 DOI: 10.1177/20458940211061284] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/07/2021] [Accepted: 11/01/2021] [Indexed: 01/03/2023] Open
Abstract
Pulmonary hypertension is characterized histologically by intimal and medial thickening in the small pulmonary arteries, eventually resulting in vascular "pruning." Computed tomography (CT)-based quantification of pruning is associated with clinical measures of pulmonary hypertension, but it is not established whether CT-based pruning correlates with histologic arterial remodeling. Our sample consisted of 138 patients who underwent resection for early-stage lung adenocarcinoma. From histologic sections, we identified small pulmonary arteries and measured the relative area comprising the intima and media (VWA%), with higher VWA% representing greater histologic remodeling. From pre-operative CTs, we used image analysis algorithms to calculate the small vessel volume fraction (BV5/TBV) as a CT-based indicator of pruning (lower BV5/TBV represents greater pruning). We investigated relationships of CT pruning and histologic remodeling using Pearson correlation, simple linear regression, and multivariable regression with adjustment for age, sex, height, weight, smoking status, and total pack-years. We also tested for effect modification by sex and smoking status. In primary models, more severe CT pruning was associated with greater histologic remodeling. The Pearson correlation coefficient between BV5/TBV and VWA% was -0.41, and in linear regression models, VWA% was 3.13% higher (95% CI: 1.95-4.31%, p < 0.0001) per standard deviation lower BV5/TBV. This association persisted after multivariable adjustment. We found no evidence that these relationships differed by sex or smoking status. Among individuals who underwent resection for lung adenocarcinoma, more severe CT-based vascular pruning was associated with greater histologic arterial remodeling. These findings suggest CT imaging may be a non-invasive indicator of pulmonary vascular pathology.
Collapse
Affiliation(s)
- Andrew J. Synn
- Division of Pulmonary, Critical Care and Sleep Medicine, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
| | | | - Sun Young Jeong
- Department of Medicine, Beth Israel Deaconess Medical Center, Harvard Medical School,
Boston, MA, USA
| | - Farbod N. Rahaghi
- Pulmonary and Critical Care Division, Brigham and Women’s
Hospital, Harvard Medical School, Boston, MA, USA
| | - Iny Jhun
- Department of Pathology, Stanford University, Stanford, CA, USA
| | - George R. Washko
- Pulmonary and Critical Care Division, Brigham and Women’s
Hospital, Harvard Medical School, Boston, MA, USA
| | - Raúl San José Estépar
- Department of Radiology, Brigham and Women’s Hospital, Harvard
Medical School, Boston, MA, USA
| | - Alexander A. Bankier
- Department of Radiology, University of Massachusetts Medical
School, Worchester, MA, USA
| | - Murray A. Mittleman
- Department of Epidemiology, Harvard T.H. Chan School of Public
Health, Boston, MA, USA
| | - Paul A. VanderLaan
- Department of Pathology, Beth Israel Deaconess Medical Center, Harvard Medical School,
Boston, MA, USA
| | - Mary B. Rice
- Division of Pulmonary, Critical Care and Sleep Medicine, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
5
|
Minhas J, Nardelli P, Hassan SM, Al-Naamani N, Harder E, Ash S, Sánchez-Ferrero GV, Mason S, Hunsaker AR, Piazza G, Goldhaber SZ, Waxman AB, Kawut SM, Estépar RSJ, Washko GR, Rahaghi FN. Loss of Pulmonary Vascular Volume as a Predictor of Right Ventricular Dysfunction and Mortality in Acute Pulmonary Embolism. Circ Cardiovasc Imaging 2021; 14:e012347. [PMID: 34544259 PMCID: PMC8462092 DOI: 10.1161/circimaging.120.012347] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/19/2020] [Accepted: 06/30/2021] [Indexed: 11/16/2022]
Abstract
BACKGROUND In acute pulmonary embolism, chest computed tomography angiography derived metrics, such as the right ventricle (RV): left ventricle ratio are routinely used for risk stratification. Paucity of intraparenchymal blood vessels has previously been described, but their association with clinical biomarkers and outcomes has not been studied. We sought to determine if small vascular volumes measured on computed tomography scans were associated with an abnormal RV on echocardiography and mortality. We hypothesized that decreased small venous volume would be associated with greater RV dysfunction and increased mortality. METHODS A retrospective cohort of patients with intermediate risk pulmonary embolism admitted to Brigham and Women's Hospital between 2009 and 2017 was assembled, and clinical and radiographic data were obtained. We performed 3-dimensional reconstructions of vasculature to assess intraparenchymal vascular volumes. Statistical analyses were performed using multivariable regression and cox proportional hazards models, adjusting for age, sex, lung volume, and small arterial volume. RESULTS Seven hundred twenty-two subjects were identified of whom 573 had documented echocardiography. A 50% reduction in small venous volume was associated with an increased risk of RV dilation (relative risk: 1.38 [95% CI, 1.18-1.63], P<0.001), RV dysfunction (relative risk: 1.62 [95% CI, 1.36-1.95], P<0.001), and RV strain (relative risk: 1.67 [95% CI, 1.37-2.04], P<0.001); increased cardiac biomarkers, and higher 30-day and 90-day mortality (hazard ratio: 2.50 [95% CI, 1.33-4.67], P=0.004 and hazard ratio: 1.84 [95% CI, 1.11-3.04], P=0.019, respectively). CONCLUSIONS Loss of small venous volume quantified from computed tomography angiography is associated with increased risk of abnormal RV on echocardiography, abnormal cardiac biomarkers, and higher risk of 30- and 90-day mortality. Small venous volume may be a useful marker for assessing disease severity in acute pulmonary embolism.
Collapse
Affiliation(s)
- Jasleen Minhas
- Division of Pulmonary, Allergy and Critical Care (J.M., N.A.-N., S.M.K.), Brigham and Women's Hospital, Harvard Medical School, Boston
| | - Pietro Nardelli
- Department of Radiology (P.N., G.V.S.-F., A.R.H., R.S.J.E.), Brigham and Women's Hospital, Harvard Medical School, Boston
| | - Syed Moin Hassan
- University of Pennsylvania, Philadelphia. Division of Pulmonary and Critical Care Medicine (S.M.H., E.H., S.A., S.M., A.B.W., G.R.W., F.N.R.), Brigham and Women's Hospital, Harvard Medical School, Boston
| | - Nadine Al-Naamani
- Division of Pulmonary, Allergy and Critical Care (J.M., N.A.-N., S.M.K.), Brigham and Women's Hospital, Harvard Medical School, Boston
| | - Eileen Harder
- University of Pennsylvania, Philadelphia. Division of Pulmonary and Critical Care Medicine (S.M.H., E.H., S.A., S.M., A.B.W., G.R.W., F.N.R.), Brigham and Women's Hospital, Harvard Medical School, Boston
| | - Samuel Ash
- University of Pennsylvania, Philadelphia. Division of Pulmonary and Critical Care Medicine (S.M.H., E.H., S.A., S.M., A.B.W., G.R.W., F.N.R.), Brigham and Women's Hospital, Harvard Medical School, Boston
| | - Gonzalo Vegas Sánchez-Ferrero
- Department of Radiology (P.N., G.V.S.-F., A.R.H., R.S.J.E.), Brigham and Women's Hospital, Harvard Medical School, Boston
| | - Stefanie Mason
- University of Pennsylvania, Philadelphia. Division of Pulmonary and Critical Care Medicine (S.M.H., E.H., S.A., S.M., A.B.W., G.R.W., F.N.R.), Brigham and Women's Hospital, Harvard Medical School, Boston
| | - Andetta R Hunsaker
- Department of Radiology (P.N., G.V.S.-F., A.R.H., R.S.J.E.), Brigham and Women's Hospital, Harvard Medical School, Boston
| | - Gregory Piazza
- Division of Cardiovascular Medicine (G.P., S.Z.G.), Brigham and Women's Hospital, Harvard Medical School, Boston
| | - Samuel Z Goldhaber
- Division of Cardiovascular Medicine (G.P., S.Z.G.), Brigham and Women's Hospital, Harvard Medical School, Boston
| | - Aaron B Waxman
- University of Pennsylvania, Philadelphia. Division of Pulmonary and Critical Care Medicine (S.M.H., E.H., S.A., S.M., A.B.W., G.R.W., F.N.R.), Brigham and Women's Hospital, Harvard Medical School, Boston
| | - Steven M Kawut
- Division of Pulmonary, Allergy and Critical Care (J.M., N.A.-N., S.M.K.), Brigham and Women's Hospital, Harvard Medical School, Boston
| | - Raúl San José Estépar
- Department of Radiology (P.N., G.V.S.-F., A.R.H., R.S.J.E.), Brigham and Women's Hospital, Harvard Medical School, Boston
| | - George R Washko
- University of Pennsylvania, Philadelphia. Division of Pulmonary and Critical Care Medicine (S.M.H., E.H., S.A., S.M., A.B.W., G.R.W., F.N.R.), Brigham and Women's Hospital, Harvard Medical School, Boston
| | - Farbod N Rahaghi
- University of Pennsylvania, Philadelphia. Division of Pulmonary and Critical Care Medicine (S.M.H., E.H., S.A., S.M., A.B.W., G.R.W., F.N.R.), Brigham and Women's Hospital, Harvard Medical School, Boston
| |
Collapse
|
6
|
Pistenmaa CL, Nardelli P, Ash SY, Come CE, Diaz AA, Rahaghi FN, Barr RG, Young KA, Kinney GL, Simmons JP, Wade RC, Wells JM, Hokanson JE, Washko GR, San José Estépar R. Pulmonary Arterial Pruning and Longitudinal Change in Percent Emphysema and Lung Function: The Genetic Epidemiology of COPD Study. Chest 2021; 160:470-480. [PMID: 33607083 PMCID: PMC8411454 DOI: 10.1016/j.chest.2021.01.084] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2020] [Revised: 12/28/2020] [Accepted: 01/23/2021] [Indexed: 12/15/2022] Open
Abstract
BACKGROUND Pulmonary endothelial damage has been shown to precede the development of emphysema in animals, and vascular changes in humans have been observed in COPD and emphysema. RESEARCH QUESTION Is intraparenchymal vascular pruning associated with longitudinal progression of emphysema on CT imaging or decline in lung function over 5 years? STUDY DESIGN AND METHODS The Genetic Epidemiology of COPD Study enrolled ever smokers with and without COPD from 2008 through 2011. The percentage of emphysema-like lung, or "percent emphysema," was assessed at baseline and after 5 years on noncontrast CT imaging as the percentage of lung voxels < -950 Hounsfield units. An automated CT imaging-based tool assessed and classified intrapulmonary arteries and veins. Spirometry measures are postbronchodilator. Pulmonary arterial pruning was defined as a lower ratio of small artery volume (< 5 mm2 cross-sectional area) to total lung artery volume. Mixed linear models included demographics, anthropomorphics, smoking, and COPD, with emphysema models also adjusting for CT imaging scanner and lung function models adjusting for clinical center and baseline percent emphysema. RESULTS At baseline, the 4,227 participants were 60 ± 9 years of age, 50% were women, 28% were Black, 47% were current smokers, and 41% had COPD. Median percent emphysema was 2.1 (interquartile range, 0.6-6.3) and progressed 0.24 percentage points/y (95% CI, 0.22-0.26 percentage points/y) over 5.6 years. Mean FEV1 to FVC ratio was 68.5 ± 14.2% and declined 0.26%/y (95% CI, -0.30 to -0.23%/y). Greater pulmonary arterial pruning was associated with more rapid progression of percent emphysema (0.11 percentage points/y per 1-SD increase in arterial pruning; 95% CI, 0.09-0.16 percentage points/y), including after adjusting for baseline percent emphysema and FEV1. Arterial pruning also was associated with a faster decline in FEV1 to FVC ratio (-0.04%/y per 1-SD increase in arterial pruning; 95% CI, -0.008 to -0.001%/y). INTERPRETATION Pulmonary arterial pruning was associated with faster progression of percent emphysema and more rapid decline in FEV1 to FVC ratio over 5 years in ever smokers, suggesting that pulmonary vascular differences may be relevant in disease progression. TRIAL REGISTRY ClinicalTrials.gov; No.: NCT00608764; URL: www.clinicaltrials.gov.
Collapse
Affiliation(s)
| | - P Nardelli
- Department of Radiology, Brigham and Women's Hospital, Boston, MA
| | - S Y Ash
- Department of Medicine, Brigham and Women's Hospital, Boston, MA
| | - C E Come
- Department of Medicine, Brigham and Women's Hospital, Boston, MA
| | - A A Diaz
- Department of Medicine, Brigham and Women's Hospital, Boston, MA
| | - F N Rahaghi
- Department of Medicine, Brigham and Women's Hospital, Boston, MA
| | - R G Barr
- Departments of Medicine and Epidemiology, Columbia University, New York, NY
| | - K A Young
- Department of Epidemiology, Colorado School of Public Health, University of Colorado, Denver, CO
| | - G L Kinney
- Department of Epidemiology, Colorado School of Public Health, University of Colorado, Denver, CO
| | - J P Simmons
- Department of Medicine, University of Alabama at Birmingham, Birmingham, AL
| | - R C Wade
- Department of Medicine, University of Alabama at Birmingham, Birmingham, AL
| | - J M Wells
- Department of Medicine, University of Alabama at Birmingham, Birmingham, AL
| | - J E Hokanson
- Department of Epidemiology, Colorado School of Public Health, University of Colorado, Denver, CO
| | - G R Washko
- Department of Medicine, Brigham and Women's Hospital, Boston, MA
| | | |
Collapse
|
7
|
Rahaghi FN, Nardelli P, Harder E, Singh I, Sanchez-Ferrero GV, Ross JC, San José Estépar R, Ash SY, Hunsaker AR, Maron BA, Leopold JA, Waxman AB, San José Estépar R, Washko GR. Quantification of Arterial and Venous Morphological Markers in Pulmonary Arterial Hypertension Using Computed Tomography. Chest 2021; 160:2220-2231. [PMID: 34270966 PMCID: PMC8692106 DOI: 10.1016/j.chest.2021.06.069] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2021] [Revised: 05/25/2021] [Accepted: 06/25/2021] [Indexed: 11/24/2022] Open
Abstract
Background Pulmonary hypertension is a heterogeneous disease, and a significant portion of patients at risk for it have CT imaging available. Advanced automated processing techniques could be leveraged for early detection, screening, and development of quantitative phenotypes. Pruning and vascular tortuosity have been previously described in pulmonary arterial hypertension (PAH), but the extent of these phenomena in arterial vs venous pulmonary vasculature and in exercise pulmonary hypertension (ePH) have not been described. Research Question What are the arterial and venous manifestations of pruning and vascular tortuosity using CT imaging in PAH, and do they also occur in ePH? Study Design and Methods A cohort of patients with PAH and ePH and control subjects with available CT angiograms were retrospectively identified to examine the differential arterial and venous presence of pruning and tortuosity in patients with precapillary pulmonary hypertension not confounded by lung or thromboembolic disease. The pulmonary vasculature was reconstructed, and an artificial intelligence method was used to separate arteries and veins and to compute arterial and venous vascular volumes and tortuosity. Results A total of 42 patients with PAH, 12 patients with ePH, and 37 control subjects were identified. There was relatively lower (median [interquartile range]) arterial small vessel volume in subjects with PAH (PAH 14.7 [11.7-16.5; P < .0001]) vs control subjects (16.9 [15.6-19.2]) and venous small vessel volume in subjects with PAH and ePH (PAH 8.0 [6.5-9.6; P < .0001]; ePH, 7.8 [7.5-11.4; P = .004]) vs control subjects (11.5 [10.6-12.2]). Higher large arterial volume, however, was only observed in the pulmonary arteries (PAH 17.1 [13.6-23.4; P < .0001] vs control subjects 11.4 [8.1-15.4]). Similarly, tortuosity was higher in the pulmonary arteries in the PAH group (PAH 3.5 [3.3-3.6; P = .0002] vs control 3.2 [3.2-3.3]). Interpretation Lower small distal pulmonary vascular volume, higher proximal arterial volume, and higher arterial tortuosity were observed in PAH. These can be quantified by using automated techniques from clinically acquired CT scans of patients with ePH and resting PAH.
Collapse
Affiliation(s)
- Farbod N Rahaghi
- Pulmonary and Critical Care Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA/US.
| | - Pietro Nardelli
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA/US
| | - Eileen Harder
- Pulmonary and Critical Care Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA/US
| | - Inderjit Singh
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA/US
| | | | - James C Ross
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA/US
| | - Rubén San José Estépar
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA/US
| | - Samuel Y Ash
- Pulmonary and Critical Care Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA/US
| | - Andetta R Hunsaker
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA/US
| | - Bradley A Maron
- Division of Cardiovascular Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA/US
| | - Jane A Leopold
- Division of Cardiovascular Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA/US
| | - Aaron B Waxman
- Pulmonary and Critical Care Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA/US
| | - Raúl San José Estépar
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA/US
| | - George R Washko
- Pulmonary and Critical Care Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA/US
| |
Collapse
|
8
|
Goldin JG. The Emerging Role of Quantification of Imaging for Assessing the Severity and Disease Activity of Emphysema, Airway Disease, and Interstitial Lung Disease. Respiration 2021; 100:277-290. [PMID: 33621969 DOI: 10.1159/000513642] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2020] [Accepted: 12/02/2020] [Indexed: 11/19/2022] Open
Abstract
There has been an explosion of use for quantitative image analysis in the setting of lung disease due to advances in acquisition protocols and postprocessing technology, including machine and deep learning. Despite the plethora of published papers, it is important to understand which approach has clinical validation and can be used in clinical practice. This paper provides an introduction to quantitative image analysis techniques being used in the investigation of lung disease and focusses on the techniques that have a reasonable clinical validation for being used in clinical trials and patient care.
Collapse
Affiliation(s)
- Jonathan Gerald Goldin
- Department of Radiological Sciences, David Geffen School of Medicine at UCLA, University of California, Los Angeles, California, USA,
| |
Collapse
|
9
|
Ross JC, Nardelli P, Onieva J, Gerard SE, Harmouche R, Okajima Y, Diaz AA, Washko G, San José Estépar R. An open-source framework for pulmonary fissure completeness assessment. Comput Med Imaging Graph 2020; 83:101712. [PMID: 32115275 PMCID: PMC7363554 DOI: 10.1016/j.compmedimag.2020.101712] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2019] [Revised: 12/02/2019] [Accepted: 02/17/2020] [Indexed: 11/20/2022]
Abstract
We present an open-source framework for pulmonary fissure completeness assessment. Fissure incompleteness has been shown to associate with emphysema treatment outcomes, motivating the development of tools that facilitate completeness estimation. Generally, the task of fissure completeness assessment requires accurate detection of fissures and definition of the boundary surfaces separating the lung lobes. The framework we describe acknowledges a) the modular nature of fissure detection and lung lobe segmentation (lobe boundary detection), and b) that methods to address these challenges are varied and continually developing. It is designed to be readily deployable on existing lung lobe segmentation and fissure detection data sets. The framework consists of multiple components: a flexible quality control module that enables rapid assessment of lung lobe segmentations, an interactive lobe segmentation tool exposed through 3D Slicer for handling challenging cases, a flexible fissure representation using particles-based sampling that can handle fissure feature-strength or binary fissure detection images, and a module that performs fissure completeness estimation using voxel counting and a novel surface area estimation approach. We demonstrate the usage of the proposed framework by deploying on 100 cases exhibiting various levels of fissure completeness. We compare the two completeness level approaches and also compare to visual reads. The code is available to the community via github as part of the Chest Imaging Platform and a 3D Slicer extension module.
Collapse
Affiliation(s)
- James C Ross
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, United States.
| | - Pietro Nardelli
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, United States
| | - Jorge Onieva
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, United States; Biomedical Image Technologies Laboratory (BIT), ETSI Telecomunicación, Universidad Politécnica de Madrid and CIBER-BBN, Madrid, Spain
| | - Sarah E Gerard
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, United States
| | - Rola Harmouche
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, United States
| | - Yuka Okajima
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, United States
| | - Alejandro A Diaz
- Division of Pulmonary and Critical Care Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, United States
| | - George Washko
- Division of Pulmonary and Critical Care Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, United States
| | - Raúl San José Estépar
- Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, United States
| |
Collapse
|
10
|
Stojanov P, Gong M, Carbonell JG, Zhang K. Data-Driven Approach to Multiple-Source Domain Adaptation. PROCEEDINGS OF MACHINE LEARNING RESEARCH 2019; 89:3487-3496. [PMID: 31497777 PMCID: PMC6730632] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
A key problem in domain adaptation is determining what to transfer across different domains. We propose a data-driven method to represent these changes across multiple source domains and perform unsupervised domain adaptation. We assume that the joint distributions follow a specific generating process and have a small number of identifiable changing parameters, and develop a data-driven method to identify the changing parameters by learning low-dimensional representations of the changing class-conditional distributions across multiple source domains. The learned low-dimensional representations enable us to reconstruct the target-domain joint distribution from unlabeled target-domain data, and further enable predicting the labels in the target domain. We demonstrate the efficacy of this method by conducting experiments on synthetic and real datasets.
Collapse
Affiliation(s)
| | - Mingming Gong
- University of Pittsburgh, Carnegie Mellon University
| | | | - Kun Zhang
- Philosophy Department, Carnegie Mellon University
| |
Collapse
|
11
|
Guy CL, Weiss E, Che S, Jan N, Zhao S, Rosu-Bubulac M. Evaluation of Image Registration Accuracy for Tumor and Organs at Risk in the Thorax for Compliance With TG 132 Recommendations. Adv Radiat Oncol 2018; 4:177-185. [PMID: 30706026 PMCID: PMC6349597 DOI: 10.1016/j.adro.2018.08.023] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2018] [Revised: 06/22/2018] [Accepted: 08/29/2018] [Indexed: 11/16/2022] Open
Abstract
Purpose To evaluate accuracy for 2 deformable image registration methods (in-house B-spline and MIM freeform) using image pairs exhibiting changes in patient orientation and lung volume and to assess the appropriateness of registration accuracy tolerances proposed by the American Association of Physicists in Medicine Task Group 132 under such challenging conditions via assessment by expert observers. Methods and Materials Four-dimensional computed tomography scans for 12 patients with lung cancer were acquired with patients in prone and supine positions. Tumor and organs at risk were delineated by a physician on all data sets: supine inhale (SI), supine exhale, prone inhale, and prone exhale. The SI image was registered to the other images using both registration methods. All SI contours were propagated using the resulting transformations and compared with physician delineations using Dice similarity coefficient, mean distance to agreement, and Hausdorff distance. Additionally, propagated contours were anonymized along with ground-truth contours and rated for quality by physician-observers. Results Averaged across all patients, the accuracy metrics investigated remained within tolerances recommended by Task Group 132 (Dice similarity coefficient >0.8, mean distance to agreement <3 mm). MIM performed better with both complex (vertebrae) and low-contrast (esophagus) structures, whereas the in-house method performed better with lungs (whole and individual lobes). Accuracy metrics worsened but remained within tolerances when propagating from supine to prone; however, the Jacobian determinant contained regions with negative values, indicating localized nonphysiologic deformations. For MIM and in-house registrations, 50% and 43.8%, respectively, of propagated contours were rated acceptable as is and 8.2% and 11.0% as clinically unacceptable. Conclusions The deformable image registration methods performed reliably and met recommended tolerances despite anatomically challenging cases exceeding typical interfraction variability. However, additional quality assurance measures are necessary for complex applications (eg, dose propagation). Human review rather than unsupervised implementation should always be part of the clinical registration workflow.
Collapse
Affiliation(s)
- Christopher L Guy
- Department of Radiation Oncology, Virginia Commonwealth University, Richmond, Virginia
| | - Elisabeth Weiss
- Department of Radiation Oncology, Virginia Commonwealth University, Richmond, Virginia
| | - Shaomin Che
- Department of Radiation Oncology, The 1st Affiliated Hospital of Xi'an Jiaotong University, Xi'an, Shaanxi Province, China
| | - Nuzhat Jan
- Department of Radiation Oncology, Virginia Commonwealth University, Richmond, Virginia
| | - Sherry Zhao
- Department of Radiation Oncology, Virginia Commonwealth University, Richmond, Virginia
| | - Mihaela Rosu-Bubulac
- Department of Radiation Oncology, Virginia Commonwealth University, Richmond, Virginia
| |
Collapse
|
12
|
Peng Y, Xiao C. An oriented derivative of stick filter and post-processing segmentation algorithms for pulmonary fissure detection in CT images. Biomed Signal Process Control 2018. [DOI: 10.1016/j.bspc.2018.03.013] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
13
|
Onieva JO, Serrano GG, Young TP, Washko GR, Carbayo MJL, Estépar RSJ. Multiorgan structures detection using deep convolutional neural networks. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2018; 10574. [PMID: 30122800 DOI: 10.1117/12.2293761] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
Many automatic image analysis algorithms in medical imaging require a good initialization to work properly. A similar problem occurs in many imaging-based clinical workflows, which depend on anatomical landmarks. The localization of anatomic structures based on a defined context provides with a solution to that problem, which turns out to be more challenging in medical imaging where labeled images are difficult to obtain. We propose a two-stage process to detect and regress 2D bounding boxes of predefined anatomical structures based on a 2D surrounding context. First, we use a deep convolutional neural network (DCNN) architecture to detect the optimal slice where an anatomical structure is present, based on relevant landmark features. After this detection, we employ a similar architecture to perform a 2D regression with the aim of proposing a bounding box where the structure is encompassed. We trained and tested our system for 57 anatomical structures defined in axial, sagittal and coronal planes with a dataset of 504 labeled Computed Tomography (CT) scans. We compared our method with a well-known object detection algorithm (Viola Jones) and with the inter-rater error for two human experts. Despite the relatively small number of scans and the exhaustive number of structures analyzed, our method obtained promising and consistent results, which proves our architecture very generalizable to other anatomical structures.
Collapse
Affiliation(s)
- Jorge Onieva Onieva
- Applied Chest Imaging Laboratory, Dept. of Radiology, Brigham and Women's Hospital, 1249 Boylston St, Boston, MA USA
| | - Germán González Serrano
- Applied Chest Imaging Laboratory, Dept. of Radiology, Brigham and Women's Hospital, 1249 Boylston St, Boston, MA USA
| | - Thomas P Young
- Applied Chest Imaging Laboratory, Dept. of Radiology, Brigham and Women's Hospital, 1249 Boylston St, Boston, MA USA
| | - George R Washko
- Division of Pulmonary and Critical Care, Dept. of Medicine, Brigham and Women's Hospital, 72 Francis St, Boston, MA USA
| | - María Jesús Ledesma Carbayo
- Biomedical Image Technologies Laboratory (BIT), ETSI Telecomunicación, Universidad Politécnica de Madrid and CIBER-BBN, Madrid, Spain
| | - Raúl San José Estépar
- Applied Chest Imaging Laboratory, Dept. of Radiology, Brigham and Women's Hospital, 1249 Boylston St, Boston, MA USA
| |
Collapse
|
14
|
Bauer C, Eberlein M, Beichel RR. Pulmonary lobe separation in expiration chest CT scans based on subject-specific priors derived from inspiration scans. J Med Imaging (Bellingham) 2018; 5:014003. [PMID: 29487878 DOI: 10.1117/1.jmi.5.1.014003] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2017] [Accepted: 01/11/2018] [Indexed: 11/14/2022] Open
Abstract
Segmentation of pulmonary lobes in inspiration and expiration chest CT scan pairs is an important prerequisite for lobe-based quantitative disease assessment. Conventional methods process each CT scan independently, resulting typically in lower segmentation performance at expiration compared to inspiration. To address this issue, we present an approach, which utilizes CT scans at both respiratory states. It consists of two main parts: a base method that processes a single CT scan and an extended method that utilizes the segmentation result obtained on the inspiration scan as a subject-specific prior for segmentation of the expiration scan. We evaluated the methods on a diverse set of 40 CT scan pairs. In addition, we compare the performance of our method to a registration-based approach. On inspiration scans, the base method achieved an average distance error of 0.59, 0.64, and 0.91 mm for the left oblique, right oblique, and right horizontal fissures, respectively, when compared with expert-based reference tracings. On expiration scans, the base method's errors were 1.54, 3.24, and 3.34 mm, respectively. In comparison, utilizing proposed subject-specific priors for segmentation of expiration scans allowed decreasing average distance errors to 0.82, 0.79, and 1.04 mm, which represents a significant improvement ([Formula: see text]) compared with all other methods investigated.
Collapse
Affiliation(s)
- Christian Bauer
- University of Iowa, Department of Electrical and Computer Engineering, Iowa City, Iowa, United States
| | - Michael Eberlein
- University of Iowa, Carver College of Medicine, Iowa City, Iowa, United States
| | - Reinhard R Beichel
- University of Iowa, Department of Electrical and Computer Engineering, Iowa City, Iowa, United States.,University of Iowa, Carver College of Medicine, Iowa City, Iowa, United States
| |
Collapse
|
15
|
Boueiz A, Chang Y, Cho MH, Washko GR, San José Estépar R, Bowler RP, Crapo JD, DeMeo DL, Dy JG, Silverman EK, Castaldi PJ. Lobar Emphysema Distribution Is Associated With 5-Year Radiological Disease Progression. Chest 2017; 153:65-76. [PMID: 28943279 DOI: 10.1016/j.chest.2017.09.022] [Citation(s) in RCA: 32] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2017] [Revised: 07/13/2017] [Accepted: 09/06/2017] [Indexed: 01/06/2023] Open
Abstract
BACKGROUND Emphysema has considerable variability in its regional distribution. Craniocaudal emphysema distribution is an important predictor of the response to lung volume reduction. However, there is little consensus regarding how to define upper lobe-predominant and lower lobe-predominant emphysema subtypes. Consequently, the clinical and genetic associations with these subtypes are poorly characterized. METHODS We sought to identify subgroups characterized by upper-lobe or lower-lobe emphysema predominance and comparable amounts of total emphysema by analyzing data from 9,210 smokers without alpha-1-antitrypsin deficiency in the Genetic Epidemiology of COPD (COPDGene) cohort. CT densitometric emphysema was measured in each lung lobe. Random forest clustering was applied to lobar emphysema variables after regressing out the effects of total emphysema. Clusters were tested for association with clinical and imaging outcomes at baseline and at 5-year follow-up. Their associations with genetic variants were also compared. RESULTS Three clusters were identified: minimal emphysema (n = 1,312), upper lobe-predominant emphysema (n = 905), and lower lobe-predominant emphysema (n = 796). Despite a similar amount of total emphysema, the lower-lobe group had more severe airflow obstruction at baseline and higher rates of metabolic syndrome compared with subjects with upper-lobe predominance. The group with upper-lobe predominance had greater 5-year progression of emphysema, gas trapping, and dyspnea. Differential associations with known COPD genetic risk variants were noted. CONCLUSIONS Subgroups of smokers defined by upper-lobe or lower-lobe emphysema predominance exhibit different functional and radiological disease progression rates, and the upper-lobe predominant subtype shows evidence of association with known COPD genetic risk variants. These subgroups may be useful in the development of personalized treatments for COPD.
Collapse
Affiliation(s)
- Adel Boueiz
- Channing Division of Network Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA; Pulmonary and Critical Care Medicine Division, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA
| | - Yale Chang
- Department of Electrical and Computer Engineering, Northeastern University, Boston, MA
| | - Michael H Cho
- Pulmonary and Critical Care Medicine Division, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA
| | - George R Washko
- Pulmonary and Critical Care Medicine Division, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA
| | - Raul San José Estépar
- Surgical Planning Laboratory, Laboratory of Mathematics in Imaging, Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA
| | - Russell P Bowler
- Division of Pulmonary Medicine, Department of Medicine, National Jewish Health, Denver, CO
| | - James D Crapo
- Division of Pulmonary Medicine, Department of Medicine, National Jewish Health, Denver, CO
| | - Dawn L DeMeo
- Channing Division of Network Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA; Pulmonary and Critical Care Medicine Division, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA
| | - Jennifer G Dy
- Department of Electrical and Computer Engineering, Northeastern University, Boston, MA
| | - Edwin K Silverman
- Channing Division of Network Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA; Pulmonary and Critical Care Medicine Division, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA
| | - Peter J Castaldi
- Channing Division of Network Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA; Division of General Medicine and Primary Care, Brigham and Women's Hospital, Harvard Medical School, Boston, MA.
| | | |
Collapse
|
16
|
Bragman FJS, McClelland JR, Jacob J, Hurst JR, Hawkes DJ. Pulmonary Lobe Segmentation With Probabilistic Segmentation of the Fissures and a Groupwise Fissure Prior. IEEE TRANSACTIONS ON MEDICAL IMAGING 2017; 36:1650-1663. [PMID: 28436850 PMCID: PMC5547024 DOI: 10.1109/tmi.2017.2688377] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/23/2023]
Abstract
A fully automated, unsupervised lobe segmentation algorithm is presented based on a probabilistic segmentation of the fissures and the simultaneous construction of a populationmodel of the fissures. A two-class probabilistic segmentation segments the lung into candidate fissure voxels and the surrounding parenchyma. This was combined with anatomical information and a groupwise fissure prior to drive non-parametric surface fitting to obtain the final segmentation. The performance of our fissure segmentation was validated on 30 patients from the chronic obstructive pulmonary disease COPDGene cohort, achieving a high median F1 -score of 0.90 and showed general insensitivity to filter parameters. We evaluated our lobe segmentation algorithm on the Lobe and Lung Analysis 2011 dataset, which contains 55 cases at varying levels of pathology. We achieved the highest score of 0.884 of the automated algorithms. Our method was further tested quantitatively and qualitatively on 80 patients from the COPDgene study at varying levels of functional impairment. Accurate segmentation of the lobes is shown at various degrees of fissure incompleteness for 96% of all cases. We also show the utility of including a groupwise prior in segmenting the lobes in regions of grossly incomplete fissures.
Collapse
|
17
|
Lassen-Schmidt BC, Kuhnigk JM, Konrad O, van Ginneken B, van Rikxoort EM. Fast interactive segmentation of the pulmonary lobes from thoracic computed tomography data. Phys Med Biol 2017; 62:6649-6665. [PMID: 28570264 DOI: 10.1088/1361-6560/aa7674] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
Automated lung lobe segmentation methods often fail for challenging and clinically relevant cases with incomplete fissures or substantial amounts of pathology. We present a fast and intuitive method to interactively correct a given lung lobe segmentation or to quickly create a lobe segmentation from scratch based on a lung mask. A given lobar boundary is converted into a mesh by principal component analysis of 3D lobar boundary markers to obtain a plane where nodes correspond to the position of the markers. An observer can modify the mesh by drawing on 2D slices in arbitrary orientations. After each drawing, the mesh is immediately adapted in a 3D region around the user interaction. For evaluation we participated in the international lung lobe segmentation challenge LObe and lung analysis 2011 (LOLA11). Two observers applied the method to correct a given lung lobe segmentation obtained by a fully automatic method for all 55 CT scans of LOLA11. On average observer 1/2 required 8 ± 4/25 ± 12 interactions per case and took 1:30 ± 0:34/3:19 ± 1:29 min. The average distances to the reference segmentation were improved from an initial 2.68 ± 14.71 mm to 0.89 ± 1.63/0.74 ± 1.51 mm. In addition, one observer applied the proposed method to create a segmentation from scratch. This took 3:44 ± 0:58 minutes on average per case, applying an average of 20 ± 3 interactions to reach an average distance to the reference of 0.77 ± 1.14 mm. Thus, both the interactive corrections and the creation of a segmentation from scratch were feasible in a short time with excellent results and only little interaction. Since the mesh adaptation is independent of image features, the method can successfully handle patients with severe pathologies, provided that the human operator is capable of correctly indicating the lobar boundaries.
Collapse
|
18
|
Sedlackova Z, Ctvrtlik F, Miroslav H. Prevalence of incomplete interlobar fissures of the lung. Biomed Pap Med Fac Univ Palacky Olomouc Czech Repub 2016; 160:491-494. [PMID: 27829688 DOI: 10.5507/bp.2016.049] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2016] [Accepted: 09/21/2016] [Indexed: 11/23/2022] Open
Abstract
BACKGROUND Some patients benefit from accurate integrity assessment of pulmonary fissures. There are a number of methods for the assessment of incomplete interlobar fissures: imaging techniques, endobronchial methods measuring collateral air flow, a perioperative view, and autopsies used in research into pulmonary anatomy. METHODS AND RESULTS We performed a computerized advanced search for primary evidence in the PubMed (Public/Publisher MEDLINE) and Google Scholar electronic databases using the following terms: incomplete and fissure. The search was not restricted to the English literature, nor limited by publication time. The bibliographic search was then extended to the "Related Articles" links and to the list of literature references of each article. CONCLUSION Publications have consistently shown that interlobar fissures exhibit high variability and that preoperative or at least detailed perioperative assessment can influence the effect of treatment.
Collapse
Affiliation(s)
- Zuzana Sedlackova
- Department of Radiology, Faculty of Medicine and Dentistry, Palacky University Olomouc and University Hospital Olomouc, Czech Republic
| | - Filip Ctvrtlik
- Department of Radiology, Faculty of Medicine and Dentistry, Palacky University Olomouc and University Hospital Olomouc, Czech Republic
| | - Herman Miroslav
- Department of Radiology, Faculty of Medicine and Dentistry, Palacky University Olomouc and University Hospital Olomouc, Czech Republic
| |
Collapse
|
19
|
Xiao C, Stoel BC, Bakker ME, Peng Y, Stolk J, Staring M. Pulmonary Fissure Detection in CT Images Using a Derivative of Stick Filter. IEEE TRANSACTIONS ON MEDICAL IMAGING 2016; 35:1488-1500. [PMID: 26766371 DOI: 10.1109/tmi.2016.2517680] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
Pulmonary fissures are important landmarks for recognition of lung anatomy. In CT images, automatic detection of fissures is complicated by factors like intensity variability, pathological deformation and imaging noise. To circumvent this problem, we propose a derivative of stick (DoS) filter for fissure enhancement and a post-processing pipeline for subsequent segmentation. Considering a typical thin curvilinear shape of fissure profiles inside 2D cross-sections, the DoS filter is presented by first defining nonlinear derivatives along a triple stick kernel in varying directions. Then, to accommodate pathological abnormality and orientational deviation, a [Formula: see text] cascading and multiple plane integration scheme is adopted to form a shape-tuned likelihood for 3D surface patches discrimination. During the post-processing stage, our main contribution is to isolate the fissure patches from adhering clutters by introducing a branch-point removal algorithm, and a multi-threshold merging framework is employed to compensate for local intensity inhomogeneity. The performance of our method was validated in experiments with two clinical CT data sets including 55 publicly available LOLA11 scans as well as separate left and right lung images from 23 GLUCOLD scans of COPD patients. Compared with manually delineating interlobar boundary references, our method obtained a high segmentation accuracy with median F1-scores of 0.833, 0.885, and 0.856 for the LOLA11, left and right lung images respectively, whereas the corresponding indices for a conventional Wiemker filtering method were 0.687, 0.853, and 0.841. The good performance of our proposed method was also verified by visual inspection and demonstration on abnormal and pathological cases, where typical deformations were robustly detected together with normal fissures.
Collapse
|