Suppression of translucent elongated structures: applications in chest radiography

Efficient labeling for fine-tuning chest X-ray bone-suppression networks for pediatric patients

BACKGROUND

Pneumonia, a major infectious cause of morbidity and mortality among children worldwide, is typically diagnosed using low-dose pediatric chest X-ray [CXR (chest radiography)]. In pediatric CXR images, bone occlusion leads to a risk of missed diagnosis. Deep learning-based bone-suppression networks relying on training data have enabled considerable progress to be achieved in bone suppression in adult CXR images; however, these networks have poor generalizability to pediatric CXR images because of the lack of labeled pediatric CXR images (i.e., bone images vs. soft-tissue images). Dual-energy subtraction imaging approaches are capable of producing labeled adult CXR images; however, their application is limited because they require specialized equipment, and they are infrequently employed in pediatric settings. Traditional image processing-based models can be used to label pediatric CXR images, but they are semiautomatic and have suboptimal performance.

PURPOSE

We developed an efficient labeling approach for fine-tuning pediatric CXR bone-suppression networks capable of automatically suppressing bone structures in CXR images for pediatric patients without the need for specialized equipment and technologist training.

METHODS

Three steps were employed to label pediatric CXR images and fine-tune pediatric bone-suppression networks: distance transform-based bone-edge detection, traditional image processing-based bone suppression, and fully automated pediatric bone suppression. In distance transform-based bone-edge detection, bone edges were automatically detected by predicting bone-edge distance-transform images, which were then used as inputs in traditional image processing. In this processing, pediatric CXR images were labeled by obtaining bone images through a series of traditional image processing techniques. Finally, the pediatric bone-suppression network was fine-tuned using the labeled pediatric CXR images. This network was initially pretrained on a public adult dataset comprising 240 adult CXR images (A240) and then fine-tuned and validated on 40 pediatric CXR images (P260_40labeled) from our customized dataset (named P260) through five-fold cross-validation; finally, the network was tested on 220 pediatric CXR images (P260_220unlabeled dataset).

RESULTS

The distance transform-based bone-edge detection network achieved a mean boundary distance of 1.029. Moreover, the traditional image processing-based bone-suppression model obtained bone images exhibiting a relative Weber contrast of 93.0%. Finally, the fully automated pediatric bone-suppression network achieved a relative mean absolute error of 3.38%, a peak signal-to-noise ratio of 35.5 dB, a structural similarity index measure of 98.1%, and a bone-suppression ratio of 90.1% on P260_40labeled.

CONCLUSIONS

The proposed fully automated pediatric bone-suppression network, together with the proposed distance transform-based bone-edge detection network, can automatically acquire bone and soft-tissue images solely from CXR images for pediatric patients and has the potential to help diagnose pneumonia in children.

An Efficient and Robust Method for Chest X-ray Rib Suppression That Improves Pulmonary Abnormality Diagnosis

BACKGROUND

Suppression of thoracic bone shadows on chest X-rays (CXRs) can improve the diagnosis of pulmonary disease. Previous approaches can be categorized as either unsupervised physical models or supervised deep learning models. Physical models can remove the entire ribcage and preserve the morphological lung details but are impractical due to the extremely long processing time. Machine learning (ML) methods are computationally efficient but are limited by the available ground truth (GT) for effective and robust training, resulting in suboptimal results.

PURPOSE

To improve bone shadow suppression, we propose a generalizable yet efficient workflow for CXR rib suppression by combining physical and ML methods.

MATERIALS AND METHOD

Our pipeline consists of two stages: (1) pair generation with GT bone shadows eliminated by a physical model in spatially transformed gradient fields; and (2) a fully supervised image denoising network trained on stage-one datasets for fast rib removal from incoming CXRs. For stage two, we designed a densely connected network called SADXNet, combined with a peak signal-to-noise ratio and a multi-scale structure similarity index measure as the loss function to suppress the bony structures. SADXNet organizes the spatial filters in a U shape and preserves the feature map dimension throughout the network flow.

RESULTS

Visually, SADXNet can suppress the rib edges near the lung wall/vertebra without compromising the vessel/abnormality conspicuity. Quantitively, it achieves an RMSE of ~0 compared with the physical model generated GTs, during testing with one prediction in <1 s. Downstream tasks, including lung nodule detection as well as common lung disease classification and localization, are used to provide task-specific evaluations of our rib suppression mechanism. We observed a 3.23% and 6.62% AUC increase, as well as 203 (1273 to 1070) and 385 (3029 to 2644) absolute false positive decreases for lung nodule detection and common lung disease localization, respectively.

CONCLUSION

Through learning from image pairs generated from the physical model, the proposed SADXNet can make a robust sub-second prediction without losing fidelity. Quantitative outcomes from downstream validation further underpin the superiority of SADXNet and the training ML-based rib suppression approaches from the physical model yielded dataset. The training images and SADXNet are provided in the manuscript.

Bone suppression of lateral chest x-rays with imperfect and limited dual-energy subtraction images

Bone suppression is to suppress the superimposed bone components over the soft tissues within the lung area of Chest X-ray (CXR), which is potentially useful for the subsequent lung disease diagnosis for radiologists, as well as computer-aided systems. Despite bone suppression methods for frontal CXRs being well studied, it remains challenging for lateral CXRs due to the limited and imperfect DES dataset containing paired lateral CXR and soft-tissue/bone images and more complex anatomical structures in the lateral view. In this work, we propose a bone suppression method for lateral CXRs by leveraging a two-stage distillation learning strategy and a specific data correction method. Specifically, a primary model is first trained on a real DES dataset with limited samples. The bone-suppressed results on a relatively large lateral CXR dataset produced by the primary model are improved by a designed gradient correction method. Secondly, the corrected results serve as training samples to train the distillated model. By automatically learning knowledge from both the primary model and the extra correction procedure, our distillated model is expected to promote the performance of the primary model while omitting the tedious correction procedure. We adopt an ensemble model named MsDd-MAP for the primary and distillated models, which learns the complementary information of Multi-scale and Dual-domain (i.e., intensity and gradient) and fuses them in a maximum-a-posteriori (MAP) framework. Our method is evaluated on a two-exposure lateral DES dataset consisting of 46 subjects and a lateral CXR dataset consisting of 240 subjects. The experimental results suggest that our method is superior to other competing methods regarding the quantitative evaluation metrics. Furthermore, the subjective evaluation by three experienced radiologists also indicates that the distillated model can produce more visually appealing soft-tissue images than the primary model, even comparable to real DES imaging for lateral CXRs.

Bone suppression on pediatric chest radiographs via a deep learning-based cascade model

BACKGROUND AND OBJECTIVE

Bone suppression images (BSIs) of chest radiographs (CXRs) have been proven to improve diagnosis of pulmonary diseases. To acquire BSIs, dual-energy subtraction (DES) or a deep-learning-based model trained with DES-based BSIs have been used. However, neither technique could be applied to pediatric patients owing to the harmful effects of DES. In this study, we developed a novel method for bone suppression in pediatric CXRs.

METHODS

First, a model using digitally reconstructed radiographs (DRRs) of adults, which were used to generate pseudo-CXRs from computed tomography images, was developed by training a 2-channel contrastive-unpaired-image-translation network. Second, this model was applied to 129 pediatric DRRs to generate the paired training data of pseudo-pediatric CXRs. Finally, by training a U-Net with these paired data, a bone suppression model for pediatric CXRs was developed.

RESULTS

The evaluation metrics were peak signal to noise ratio, root mean absolute error and structural similarity index measure at soft-tissue and bone region of the lung. In addition, an expert radiologist scored the effectiveness of BSIs on a scale of 1-5. The obtained result of 3.31 ± 0.48 indicates that the BSIs show homogeneous bone removal despite subtle residual bone shadow.

CONCLUSION

Our method shows that the pixel intensity at soft-tissue regions was preserved, and bones were well subtracted; this can be useful for detecting early pulmonary disease in pediatric CXRs.

Deep learning-based bone suppression in chest radiographs using CT-derived features: a feasibility study

Background

Bone suppression of chest X-ray holds the potential to improve the accuracy of target localization in image-guided radiation therapy (IGRT). However, the training dataset for bone suppression is limited because of the scarcity of bone-free radiographs. This study aims to develop a deep learning-based bone suppression method using CT-derived features to reduce the reliance on the bone-free dataset.

Methods

In this study, 59 high-resolution lung CT scans were processed to generate the lung digital radiographs (DRs), bone DRs, and bone-free DRs, for the training and internal validation of the proposed cascade convolutional neural network (CCNN). A three-stage image processing framework (CT segmentation, DR simulation, and feature expansion) was developed to expand simulated lung DRs with different weightings of bone intensity. The CCNN consists of a bone detection network and a bone suppression network. In external validation, the trained CCNN was evaluated using 30 chest radiographs. The synthesized bone-suppressed radiographs were compared with the bone-suppressed reference in terms of peak signal-to-noise ratio (PSNR), mean absolute error (MAE), structural similarity index measure (SSIM), and Spearman's correlation coefficient. Furthermore, the effectiveness of the proposed feature expansion method and CCNN model were assessed via the ablation experiment and replacement experiment, respectively.

Results

Evaluation on real chest radiographs showed that the bone-suppressed chest radiographs closely matched with the bone-suppressed reference, achieving an accuracy of MAE =0.0087±0.0030, SSIM =0.8458±0.0317, correlation of 0.9554±0.0170, and PNSR of 20.86±1.60. After removing the feature expansion from the CCNN model, the performance decreased in terms of MAE (0.0294±0.0093, -237.9%), SSIM (0.7747±0.0.0416, -8.4%), correlation (0.8772±0.0271, -8.2%), and PSNR (15.53±1.42, -25.5%) metrics.

Conclusions

We successfully demonstrated a novel deep learning-based bone suppression method using CT-derived features to reduce the reliance on the bone-free dataset. Implementation of the feature expansion procedures resulted in a remarkable reinforcement of the model performance. For the application of target localization in IGRT, the clinical testing of the proposed method in the context of radiation therapy is a necessary procedure to move from theory into practice.

Chest X-ray Bone Suppression for Improving Classification of Tuberculosis-Consistent Findings

Chest X-rays (CXRs) are the most commonly performed diagnostic examination to detect cardiopulmonary abnormalities. However, the presence of bony structures such as ribs and clavicles can obscure subtle abnormalities, resulting in diagnostic errors. This study aims to build a deep learning (DL)-based bone suppression model that identifies and removes these occluding bony structures in frontal CXRs to assist in reducing errors in radiological interpretation, including DL workflows, related to detecting manifestations consistent with tuberculosis (TB). Several bone suppression models with various deep architectures are trained and optimized using the proposed combined loss function and their performances are evaluated in a cross-institutional test setting using several metrics such as mean absolute error (MAE), peak signal-to-noise ratio (PSNR), structural similarity index measure (SSIM), and multiscale structural similarity measure (MS-SSIM). The best-performing model (ResNet-BS) (PSNR = 34.0678; MS-SSIM = 0.9828) is used to suppress bones in the publicly available Shenzhen and Montgomery TB CXR collections. A VGG-16 model is pretrained on a large collection of publicly available CXRs. The CXR-pretrained model is then fine-tuned individually on the non-bone-suppressed and bone-suppressed CXRs of Shenzhen and Montgomery TB CXR collections to classify them as showing normal lungs or TB manifestations. The performances of these models are compared using several performance metrics such as accuracy, the area under the curve (AUC), sensitivity, specificity, precision, F-score, and Matthews correlation coefficient (MCC), analyzed for statistical significance, and their predictions are qualitatively interpreted through class-selective relevance maps (CRMs). It is observed that the models trained on bone-suppressed CXRs (Shenzhen: AUC = 0.9535 ± 0.0186; Montgomery: AUC = 0.9635 ± 0.0106) significantly outperformed (p < 0.05) the models trained on the non-bone-suppressed CXRs (Shenzhen: AUC = 0.8991 ± 0.0268; Montgomery: AUC = 0.8567 ± 0.0870).. Models trained on bone-suppressed CXRs improved detection of TB-consistent findings and resulted in compact clustering of the data points in the feature space signifying that bone suppression improved the model sensitivity toward TB classification.

High-Resolution Chest X-Ray Bone Suppression Using Unpaired CT Structural Priors

There is clinical evidence that suppressing the bone structures in Chest X-rays (CXRs) improves diagnostic value, either for radiologists or computer-aided diagnosis. However, bone-free CXRs are not always accessible. We hereby propose a coarse-to-fine CXR bone suppression approach by using structural priors derived from unpaired computed tomography (CT) images. In the low-resolution stage, we use the digitally reconstructed radiograph (DRR) image that is computed from CT as a bridge to connect CT and CXR. We then perform CXR bone decomposition by leveraging the DRR bone decomposition model learned from unpaired CTs and domain adaptation between CXR and DRR. To further mitigate the domain differences between CXRs and DRRs and speed up the learning convergence, we perform all the aboved operations in Laplacian of Gaussian (LoG) domain. After obtaining the bone decomposition result in DRR, we upsample it to a high resolution, based on which the bone region in the original high-resolution CXR is cropped and processed to produce a high-resolution bone decomposition result. Finally, such a produced bone image is subtracted from the original high-resolution CXR to obtain the bone suppression result. We conduct experiments and clinical evaluations based on two benchmarking CXR databases to show that (i) the proposed method outperforms the state-of-the-art unsupervised CXR bone suppression approaches; (ii) the CXRs with bone suppression are instrumental to radiologists for reducing their false-negative rate of lung diseases from 15% to 8%; and (iii) state-of-the-art disease classification performances are achieved by learning a deep network that takes the original CXR and its bone-suppressed image as inputs.

Automatic delineation of ribs and clavicles in chest radiographs using fully convolutional DenseNets

BACKGROUND AND OBJECTIVE

In chest radiographs (CXRs), all bones and soft tissues are overlapping with each other, which raises issues for radiologists to read and interpret CXRs. Delineating the ribs and clavicles is helpful for suppressing them from chest radiographs so that their effects can be reduced for chest radiography analysis. However, delineating ribs and clavicles automatically is difficult by methods without deep learning models. Moreover, few of methods without deep learning models can delineate the anterior ribs effectively due to their faint rib edges in the posterior-anterior (PA) CXRs.

METHODS

In this work, we present an effective deep learning method for delineating posterior ribs, anterior ribs and clavicles automatically using a fully convolutional DenseNet (FC-DenseNet) as pixel classifier. We consider a pixel-weighted loss function to mitigate the uncertainty issue during manually delineating for robust prediction.

RESULTS

We conduct a comparative analysis with two other fully convolutional networks for edge detection and the state-of-the-art method without deep learning models. The proposed method significantly outperforms these methods in terms of quantitative evaluation metrics and visual perception. The average recall, precision and F-measure are 0.773 ± 0.030, 0.861 ± 0.043 and 0.814 ± 0.023 respectively, and the mean boundary distance (MBD) is 0.855 ± 0.642 pixels of the proposed method on the test dataset. The proposed method also performs well on JSRT and NIH Chest X-ray datasets, indicating its generalizability across multiple databases. Besides, a preliminary result of suppressing the bone components of CXRs has been produced by using our delineating system.

CONCLUSIONS

The proposed method can automatically delineate ribs and clavicles in CXRs and produce accurate edge maps.

Soft Tissue/Bone Decomposition of Conventional Chest Radiographs Using Nonparametric Image Priors

Background and Objective

When radiologists diagnose lung diseases in chest radiography, they can miss some lung nodules overlapped with ribs or clavicles. Dual-energy subtraction (DES) imaging performs well because it can produce soft tissue images, in which the bone components in chest radiography were almost suppressed but the visibility of nodules and lung vessels was still maintained. However, most routinely available X-ray machines do not possess the DES function. Thus, we presented a data-driven decomposition model to perform virtual DES function for decomposing a single conventional chest radiograph into soft tissue and bone images.

Methods

For a given chest radiograph, similar chest radiographs with corresponding DES soft tissue and bone images are selected from the training database as exemplars for decomposition. The corresponding fields between the observed chest radiograph and the exemplars are solved by a hierarchically dense matching algorithm. Then, nonparametric priors of soft tissue and bone components are constructed by sampling image patches from the selected soft tissue and bone images according to the corresponding fields. Finally, these nonparametric priors are integrated into our decomposition model, the energy function of which is efficiently optimized by an iteratively reweighted least-squares scheme (IRLS).

Results

The decomposition method is evaluated on a data set of posterior-anterior DES radiography (503 cases), as well as on the JSRT data set. The proposed method can produce soft tissue and bone images similar to those produced by the actual DES system.

Conclusions

The proposed method can markedly reduce the visibility of bony structures in chest radiographs and shows potential to enhance diagnosis.

Fifty years of computer analysis in chest imaging: rule-based, machine learning, deep learning

Half a century ago, the term "computer-aided diagnosis" (CAD) was introduced in the scientific literature. Pulmonary imaging, with chest radiography and computed tomography, has always been one of the focus areas in this field. In this study, I describe how machine learning became the dominant technology for tackling CAD in the lungs, generally producing better results than do classical rule-based approaches, and how the field is now rapidly changing: in the last few years, we have seen how even better results can be obtained with deep learning. The key differences among rule-based processing, machine learning, and deep learning are summarized and illustrated for various applications of CAD in the chest.

Enhancement of chest radiographs obtained in the intensive care unit through bone suppression and consistent processing

Portable chest radiographs (CXRs) are commonly used in the intensive care unit (ICU) to detect subtle pathological changes. However, exposure settings or patient and apparatus positioning deteriorate image quality in the ICU. Chest x-rays of patients in the ICU are often hazy and show low contrast and increased noise. To aid clinicians in detecting subtle pathological changes, we proposed a consistent processing and bone structure suppression method to decrease variations in image appearance and improve the diagnostic quality of images. We applied a region of interest-based look-up table to process original ICU CXRs such that they appeared consistent with each other and the standard CXRs. Then, an artificial neural network was trained by standard CXRs and the corresponding dual-energy bone images for the generation of a bone image. Once the neural network was trained, the real dual-energy image was no longer necessary, and the trained neural network was applied to the consistent processed ICU CXR to output the bone image. Finally, a gray level-based morphological method was applied to enhance the bone image by smoothing other structures on this image. This enhanced image was subtracted from the consistent, processed ICU CXR to produce a soft tissue image. This method was tested for 20 patients with a total of 87 CXRs. The findings indicated that our method suppressed bone structures on ICU CXRs and standard CXRs, simultaneously maintaining subtle pathological changes.

A novel bone suppression method that improves lung nodule detection : Suppressing dedicated bone shadows in radiographs while preserving the remaining signal

PURPOSE

Suppressing thoracic bone shadows in chest radiographs has been previously reported to improve the detection rates for solid lung nodules, however at the cost of increased false detection rates. These bone suppression methods are based on an artificial neural network that was trained using dual-energy subtraction images in order to mimic their appearance.

METHOD

Here, a novel approach is followed where all bone shadows crossing the lung field are suppressed sequentially leaving the intercostal space unaffected. Given a contour delineating a bone, its image region is spatially transferred to separate normal image gradient components from tangential component. Smoothing the normal partial gradient along the contour results in a reconstruction of the image representing the bone shadow only, because all other overlaid signals tend to cancel out each other in this representation.

RESULTS

The method works even with highly contrasted overlaid objects such as a pacemaker. The approach was validated in a reader study with two experienced chest radiologists, and these images helped improving both the sensitivity and the specificity of the readers for the detection and localization of solid lung nodules. The AUC improved significantly from 0.596 to 0.655 on a basis of 146 images from patients and normals with a total of 123 confirmed lung nodules.

CONCLUSION

Subtracting all reconstructed bone shadows from the original image results in a soft image where lung nodules are no longer obscured by bone shadows. Both the sensitivity and the specificity of experienced radiologists increased.

Cavity contour segmentation in chest radiographs using supervised learning and dynamic programming

PURPOSE

Efficacy of tuberculosis (TB) treatment is often monitored using chest radiography. Monitoring size of cavities in pulmonary tuberculosis is important as the size predicts severity of the disease and its persistence under therapy predicts relapse. The authors present a method for automatic cavity segmentation in chest radiographs.

METHODS

A two stage method is proposed to segment the cavity borders, given a user defined seed point close to the center of the cavity. First, a supervised learning approach is employed to train a pixel classifier using texture and radial features to identify the border pixels of the cavity. A likelihood value of belonging to the cavity border is assigned to each pixel by the classifier. The authors experimented with four different classifiers:k-nearest neighbor (kNN), linear discriminant analysis (LDA), GentleBoost (GB), and random forest (RF). Next, the constructed likelihood map was used as an input cost image in the polar transformed image space for dynamic programming to trace the optimal maximum cost path. This constructed path corresponds to the segmented cavity contour in image space.

RESULTS

The method was evaluated on 100 chest radiographs (CXRs) containing 126 cavities. The reference segmentation was manually delineated by an experienced chest radiologist. An independent observer (a chest radiologist) also delineated all cavities to estimate interobserver variability. Jaccard overlap measure Ω was computed between the reference segmentation and the automatic segmentation; and between the reference segmentation and the independent observer's segmentation for all cavities. A median overlap Ω of 0.81 (0.76 ± 0.16), and 0.85 (0.82 ± 0.11) was achieved between the reference segmentation and the automatic segmentation, and between the segmentations by the two radiologists, respectively. The best reported mean contour distance and Hausdorff distance between the reference and the automatic segmentation were, respectively, 2.48 ± 2.19 and 8.32 ± 5.66 mm, whereas these distances were 1.66 ± 1.29 and 5.75 ± 4.88 mm between the segmentations by the reference reader and the independent observer, respectively. The automatic segmentations were also visually assessed by two trained CXR readers as "excellent," "adequate," or "insufficient." The readers had good agreement in assessing the cavity outlines and 84% of the segmentations were rated as "excellent" or "adequate" by both readers.

CONCLUSIONS

The proposed cavity segmentation technique produced results with a good degree of overlap with manual expert segmentations. The evaluation measures demonstrated that the results approached the results of the experienced chest radiologists, in terms of overlap measure and contour distance measures. Automatic cavity segmentation can be employed in TB clinics for treatment monitoring, especially in resource limited settings where radiologists are not available.