1
|
Tada DK, Teng P, Vyapari K, Banola A, Foster G, Diaz E, Kim GHJ, Goldin JG, Abtin F, McNitt-Gray M, Brown MS. Quantifying lung fissure integrity using a three-dimensional patch-based convolutional neural network on CT images for emphysema treatment planning. J Med Imaging (Bellingham) 2024; 11:034502. [PMID: 38817711 PMCID: PMC11135203 DOI: 10.1117/1.jmi.11.3.034502] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2023] [Revised: 04/19/2024] [Accepted: 05/03/2024] [Indexed: 06/01/2024] Open
Abstract
Purpose Evaluation of lung fissure integrity is required to determine whether emphysema patients have complete fissures and are candidates for endobronchial valve (EBV) therapy. We propose a deep learning (DL) approach to segment fissures using a three-dimensional patch-based convolutional neural network (CNN) and quantitatively assess fissure integrity on CT to evaluate it in subjects with severe emphysema. Approach From an anonymized image database of patients with severe emphysema, 129 CT scans were used. Lung lobe segmentations were performed to identify lobar regions, and the boundaries among these regions were used to construct approximate interlobar regions of interest (ROIs). The interlobar ROIs were annotated by expert image analysts to identify voxels where the fissure was present and create a reference ROI that excluded non-fissure voxels (where the fissure is incomplete). A CNN configured by nnU-Net was trained using 86 CT scans and their corresponding reference ROIs to segment the ROIs of left oblique fissure (LOF), right oblique fissure (ROF), and right horizontal fissure (RHF). For an independent test set of 43 cases, fissure integrity was quantified by mapping the segmented fissure ROI along the interlobar ROI. A fissure integrity score (FIS) was then calculated as the percentage of labeled fissure voxels divided by total voxels in the interlobar ROI. Predicted FIS (p-FIS) was quantified from the CNN output, and statistical analyses were performed comparing p-FIS and reference FIS (r-FIS). Results The absolute percent error mean (±SD) between r-FIS and p-FIS for the test set was 4.0% (± 4.1 % ), 6.0% (± 9.3 % ), and 12.2% (± 12.5 % ) for the LOF, ROF, and RHF, respectively. Conclusions A DL approach was developed to segment lung fissures on CT images and accurately quantify FIS. It has potential to assist in the identification of emphysema patients who would benefit from EBV treatment.
Collapse
Affiliation(s)
- Dallas K. Tada
- The University of California, Los Angeles (UCLA), David Geffen School of Medicine at UCLA, Center for Computer Vision and Imaging Biomarkers, Department of Radiological Sciences, Los Angeles, California, United States
| | - Pangyu Teng
- The University of California, Los Angeles (UCLA), David Geffen School of Medicine at UCLA, Center for Computer Vision and Imaging Biomarkers, Department of Radiological Sciences, Los Angeles, California, United States
| | - Kalyani Vyapari
- The University of California, Los Angeles (UCLA), David Geffen School of Medicine at UCLA, Center for Computer Vision and Imaging Biomarkers, Department of Radiological Sciences, Los Angeles, California, United States
| | - Ashley Banola
- The University of California, Los Angeles (UCLA), David Geffen School of Medicine at UCLA, Center for Computer Vision and Imaging Biomarkers, Department of Radiological Sciences, Los Angeles, California, United States
| | - George Foster
- The University of California, Los Angeles (UCLA), David Geffen School of Medicine at UCLA, Center for Computer Vision and Imaging Biomarkers, Department of Radiological Sciences, Los Angeles, California, United States
| | - Esteban Diaz
- The University of California, Los Angeles (UCLA), David Geffen School of Medicine at UCLA, Center for Computer Vision and Imaging Biomarkers, Department of Radiological Sciences, Los Angeles, California, United States
| | - Grace Hyun J. Kim
- The University of California, Los Angeles (UCLA), David Geffen School of Medicine at UCLA, Center for Computer Vision and Imaging Biomarkers, Department of Radiological Sciences, Los Angeles, California, United States
| | - Jonathan G. Goldin
- The University of California, Los Angeles (UCLA), David Geffen School of Medicine at UCLA, Center for Computer Vision and Imaging Biomarkers, Department of Radiological Sciences, Los Angeles, California, United States
| | - Fereidoun Abtin
- The University of California, Los Angeles (UCLA), David Geffen School of Medicine at UCLA, Center for Computer Vision and Imaging Biomarkers, Department of Radiological Sciences, Los Angeles, California, United States
| | - Michael McNitt-Gray
- The University of California, Los Angeles (UCLA), David Geffen School of Medicine at UCLA, Center for Computer Vision and Imaging Biomarkers, Department of Radiological Sciences, Los Angeles, California, United States
| | - Matthew S. Brown
- The University of California, Los Angeles (UCLA), David Geffen School of Medicine at UCLA, Center for Computer Vision and Imaging Biomarkers, Department of Radiological Sciences, Los Angeles, California, United States
| |
Collapse
|
2
|
Goldin JG. The Emerging Role of Quantification of Imaging for Assessing the Severity and Disease Activity of Emphysema, Airway Disease, and Interstitial Lung Disease. Respiration 2021; 100:277-290. [PMID: 33621969 DOI: 10.1159/000513642] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2020] [Accepted: 12/02/2020] [Indexed: 11/19/2022] Open
Abstract
There has been an explosion of use for quantitative image analysis in the setting of lung disease due to advances in acquisition protocols and postprocessing technology, including machine and deep learning. Despite the plethora of published papers, it is important to understand which approach has clinical validation and can be used in clinical practice. This paper provides an introduction to quantitative image analysis techniques being used in the investigation of lung disease and focusses on the techniques that have a reasonable clinical validation for being used in clinical trials and patient care.
Collapse
Affiliation(s)
- Jonathan Gerald Goldin
- Department of Radiological Sciences, David Geffen School of Medicine at UCLA, University of California, Los Angeles, California, USA,
| |
Collapse
|
3
|
An Efficient Method for the Detection of Oblique Fissures from Computed Tomography images of Lungs. J Med Syst 2019; 43:252. [PMID: 31254114 DOI: 10.1007/s10916-019-1396-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2019] [Accepted: 06/18/2019] [Indexed: 10/26/2022]
Abstract
Detection of a pulmonary fissure in lungs is difficult due to its anatomical changeability among humans and it is essential in the clinical environment for accurate localizing and treating the lung abnormalities on a lobe level in human lungs. In this work, an algorithmic approach is proposed to detect the lung oblique fissures from lung computed tomography (CT) images. In the preprocessing module of our approach, the lung structures are enhanced using morphological operation and lung images are de-noised using Wiener filter. In the second module, lung regions are segmented using techniques, namely, thresholding and background subtraction. In the third module of our algorithm, initially, fissure regions are segmented using the active contour model, then by applying the rule based approach on the fissure regions, the oblique fissures are segmented. The proposed algorithm has been tested on 50 images collected from Lung Image Database Consortium (LIDC) and 30 images obtained from Early Lung Cancer Action Program (ELCAP).
Collapse
|
4
|
Tenda ED, Ridge CA, Shen M, Yang GZ, Shah PL. Role of Quantitative Computed Tomographic Scan Analysis in Lung Volume Reduction for Emphysema. Respiration 2019; 98:86-94. [PMID: 31067563 DOI: 10.1159/000498949] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2018] [Accepted: 02/15/2019] [Indexed: 11/19/2022] Open
Abstract
Recent advances in bronchoscopic lung volume reduction (BLVR) offer new therapeutic alternatives for patients with emphysema and hyperinflation. Endobronchial valves and coils are 2 potential BLVR techniques which have been shown to improve pulmonary function and the quality of life in patients with emphysema. Current patient selection for LVR procedures relies on 3 main inclusion criteria: low attenuation area (in %), also known as emphysema score, heterogeneity score, and fissure integrity score. Volumetric analysis in combination with densitometric analysis of the affected lung lobe or segment with quantitative CT to determine emphysema severity play an important role in treatment planning and post-operative assessment. Due to the variations in lung anatomy, manual corrections are often required to ensure successful and accurate lobe segmentation for pathological and post-treatment CT scan analysis. The advanced development and utilisation of quantitative CT do not simply represent regional changes in pulmonary function but aids in analysis for better patient selection with severe emphysema who are most likely to benefit from BLVR.
Collapse
Affiliation(s)
- Eric Daniel Tenda
- National Heart and Lung Institute, Imperial College, London, United Kingdom.,Royal Brompton Hospital, Royal Brompton and Harefield NHS Foundation Trust, London, United Kingdom.,The Hamlyn Centre for Robotic Surgery, Imperial College London, London, United Kingdom.,Division of Pulmonology, Department of Internal Medicine, National General Hospital of Dr. Cipto Mangunkusumo, and Faculty of Medicine, Universitas Indonesia, Jakarta, Indonesia
| | - Carole A Ridge
- Royal Brompton Hospital, Royal Brompton and Harefield NHS Foundation Trust, London, United Kingdom
| | - Mali Shen
- The Hamlyn Centre for Robotic Surgery, Imperial College London, London, United Kingdom
| | - Guang-Zhong Yang
- The Hamlyn Centre for Robotic Surgery, Imperial College London, London, United Kingdom
| | - Pallav L Shah
- National Heart and Lung Institute, Imperial College, London, United Kingdom, .,Royal Brompton Hospital, Royal Brompton and Harefield NHS Foundation Trust, London, United Kingdom,
| |
Collapse
|
6
|
Xiao C, Stoel BC, Bakker ME, Peng Y, Stolk J, Staring M. Pulmonary Fissure Detection in CT Images Using a Derivative of Stick Filter. IEEE TRANSACTIONS ON MEDICAL IMAGING 2016; 35:1488-1500. [PMID: 26766371 DOI: 10.1109/tmi.2016.2517680] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
Pulmonary fissures are important landmarks for recognition of lung anatomy. In CT images, automatic detection of fissures is complicated by factors like intensity variability, pathological deformation and imaging noise. To circumvent this problem, we propose a derivative of stick (DoS) filter for fissure enhancement and a post-processing pipeline for subsequent segmentation. Considering a typical thin curvilinear shape of fissure profiles inside 2D cross-sections, the DoS filter is presented by first defining nonlinear derivatives along a triple stick kernel in varying directions. Then, to accommodate pathological abnormality and orientational deviation, a [Formula: see text] cascading and multiple plane integration scheme is adopted to form a shape-tuned likelihood for 3D surface patches discrimination. During the post-processing stage, our main contribution is to isolate the fissure patches from adhering clutters by introducing a branch-point removal algorithm, and a multi-threshold merging framework is employed to compensate for local intensity inhomogeneity. The performance of our method was validated in experiments with two clinical CT data sets including 55 publicly available LOLA11 scans as well as separate left and right lung images from 23 GLUCOLD scans of COPD patients. Compared with manually delineating interlobar boundary references, our method obtained a high segmentation accuracy with median F1-scores of 0.833, 0.885, and 0.856 for the LOLA11, left and right lung images respectively, whereas the corresponding indices for a conventional Wiemker filtering method were 0.687, 0.853, and 0.841. The good performance of our proposed method was also verified by visual inspection and demonstration on abnormal and pathological cases, where typical deformations were robustly detected together with normal fissures.
Collapse
|
7
|
Yu M, Liu H, Gong J, Jin R, Han P, Song E. Automatic segmentation of pulmonary fissures in computed tomography images using 3D surface features. J Digit Imaging 2013; 27:58-67. [PMID: 23982119 DOI: 10.1007/s10278-013-9632-5] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Pulmonary interlobar fissures are important anatomic structures in human lungs and are useful in locating and classifying lung abnormalities. Automatic segmentation of fissures is a difficult task because of their low contrast and large variability. We developed a fully automatic training-free approach for fissure segmentation based on the local bending degree (LBD) and the maximum bending index (MBI). The LBD is determined by the angle between the eigenvectors of two Hessian matrices for a pair of adjacent voxels. It is used to construct a constraint to extract the candidate surfaces in three-dimensional (3D) space. The MBI is a measure to discriminate cylindrical surfaces from planar surfaces in 3D space. Our approach for segmenting fissures consists of five steps, including lung segmentation, plane-like structure enhancement, surface extraction with LBD, initial fissure identification with MBI, and fissure extension based on local plane fitting. When applying our approach to 15 chest computed tomography (CT) scans, the mean values of the positive predictive value, the sensitivity, the root-mean square (RMS) distance, and the maximal RMS are 91 %, 88 %, 1.01 ± 0.99 mm, and 11.56 mm, respectively, which suggests that our algorithm can efficiently segment fissures in chest CT scans.
Collapse
Affiliation(s)
- Mali Yu
- School of Computer Science and Technology, Huazhong University of Science and Technology, 1037 Luoyu Road, Wuhan, Hubei, 430074, China
| | | | | | | | | | | |
Collapse
|