Lung segmentation in chest radiographs using anatomical atlases with nonrigid registration

An automatic method for lung segmentation and reconstruction in chest X-ray using deep neural networks

BACKGROUND AND OBJECTIVE

Chest X-ray (CXR) is one of the most used imaging techniques for detection and diagnosis of pulmonary diseases. A critical component in any computer-aided system, for either detection or diagnosis in digital CXR, is the automatic segmentation of the lung field. One of the main challenges inherent to this task is to include in the segmentation the lung regions overlapped by dense abnormalities, also known as opacities, which can be caused by diseases such as tuberculosis and pneumonia. This specific task is difficult because opacities frequently reach high intensity values which can be incorrectly interpreted by an automatic method as the lung boundary, and as a consequence, this creates a challenge in the segmentation process, because the chances of incomplete segmentations are increased considerably. The purpose of this work is to propose a method for automatic segmentation of lungs in CXR that addresses this problem by reconstructing the lung regions "lost" due to pulmonary abnormalities.

METHODS

The proposed method, which features two deep convolutional neural network models, consists of four steps main steps: (1) image acquisition, (2) initial segmentation, (3) reconstruction and (4) final segmentation.

RESULTS

The proposed method was experimented on 138 Chest X-ray images from Montgomery County's Tuberculosis Control Program, and has achieved as best result an average sensitivity of 97.54%, an average specificity of 96.79%, an average accuracy of 96.97%, an average Dice coefficient of 94%, and an average Jaccard index of 88.07%.

CONCLUSIONS

We demonstrate in our lung segmentation method that the problem of dense abnormalities in Chest X-rays can be efficiently addressed by performing a reconstruction step based on a deep convolutional neural network model.

dp-BREATH: Heat maps and probabilistic classification assisting the analysis of abnormal lung regions

BACKGROUND AND OBJECTIVE

Identifying abnormalities in chest CT scans is an important and challenging task, demanding time and effort from specialists. Different parts of a single lung image may present both normal and abnormal characteristics. Thus, detecting a single lung as healthy (normal) or not is inaccurate.

METHODS

In this work we propose dp-BREATH, a method capable of detecting abnormalities in pulmonary tissue regions and directing the specialist's attention to the lung region containing them. It starts by highlighting regions that may indicate pulmonary abnormalities based on the healthy pulmonary tissue behavior using a superpixel-based approach and a heat map visualization. This is achieved by modeling regions of healthy tissue using a statistical model. All regions considered abnormal are modeled and classified according to their probability of containing each of the studied abnormalities. Further, dp-BREATH provides a better recognition of radiological patterns, with the likelihood of a selected lung region to contain abnormalities.

RESULTS

We validate the statistical model of healthy and abnormal detection using a representative dataset of chest CT scans. The model has shown almost no overlap between healthy and abnormal regions, and the detection of abnormalities presented precision higher than 86%, for all recall values. Additionally, the fitted models describing pulmonary radiological patterns present precision of up to 87%, with a high separation for three of five radiological patterns.

CONCLUSIONS

dp-BREATH's heat map representation and its list of radiological patterns probabilities provided are intuitive methods to assist physicians during diagnosis.

A review on lung boundary detection in chest X-rays

PURPOSE

Chest radiography is the most common imaging modality for pulmonary diseases. Due to its wide usage, there is a rich literature addressing automated detection of cardiopulmonary diseases in digital chest X-rays (CXRs). One of the essential steps for automated analysis of CXRs is localizing the relevant region of interest, i.e., isolating lung region from other less relevant parts, for applying decision-making algorithms there. This article provides an overview of the recent literature on lung boundary detection in CXR images.

METHODS

We review the leading lung segmentation algorithms proposed in period 2006-2017. First, we present a review of articles for posterior-anterior view CXRs. Then, we mention studies which operate on lateral views. We pay particular attention to works that focus their efforts on deformed lungs and pediatric cases. We also highlight the radiographic measures extracted from lung boundary and their use in automatically detecting cardiopulmonary abnormalities. Finally, we identify challenges in dataset curation and expert delineation process, and we listed publicly available CXR datasets.

RESULTS

(1) We classified algorithms into four categories: rule-based, pixel classification-based, model-based, hybrid, and deep learning-based algorithms. Based on the reviewed articles, hybrid methods and deep learning-based methods surpass the algorithms in other classes and have segmentation performance as good as inter-observer performance. However, they require long training process and pose high computational complexity. (2) We found that most of the algorithms in the literature are evaluated on posterior-anterior view adult CXRs with a healthy lung anatomy appearance without considering challenges in abnormal CXRs. (3) We also found that there are limited studies for pediatric CXRs. The lung appearance in pediatrics, especially in infant cases, deviates from adult lung appearance due to the pediatric development stages. Moreover, pediatric CXRs are noisier than adult CXRs due to interference by other objects, such as someone holding the child's arms or the child's body, and irregular body pose. Therefore, lung boundary detection algorithms developed on adult CXRs may not perform accurately in pediatric cases and need additional constraints suitable for pediatric CXR imaging characteristics. (4) We have also stated that one of the main challenges in medical image analysis is accessing the suitable datasets. We listed benchmark CXR datasets for developing and evaluating the lung boundary algorithms. However, the number of CXR images with reference boundaries is limited due to the cumbersome but necessary process of expert boundary delineation.

CONCLUSIONS

A reliable computer-aided diagnosis system would need to support a greater variety of lung and background appearance. To our knowledge, algorithms in the literature are evaluated on posterior-anterior view adult CXRs with a healthy lung anatomy appearance, without considering ambiguous lung silhouettes due to pathological deformities, anatomical alterations due to misaligned body positioning, patient's development stage and gross background noises such as holding hands, jewelry, patient's head and legs in CXR. Considering all the challenges which are not very well addressed in the literature, developing lung boundary detection algorithms that are robust to such interference remains a challenging task. We believe that a broad review of lung region detection algorithms would be useful for researchers working in the field of automated detection/diagnosis algorithms for lung/heart pathologies in CXRs.

Active Contour Based Segmentation and Classification for Pleura Diseases Based on Otsu’s Thresholding and Support Vector Machine (SVM)

Objective: Generally, lung cancer is the abnormal growth of cells that originates in one or both lungs. Finding the pulmonary nodule helps in the diagnosis of lung cancer in early stage and also increase the lifetime of the individual. Accurate segmentation of normal and abnormal portion in segmentation is challenging task in computer-aided diagnostics. Methods: The article proposes an innovative method to spot the cancer portion using Otsu’s segmentation algorithm. It is followed by a Support Vector Machine (SVM) classifier to classify the abnormal portion of the lung image. Results: The suggested methods use the Otsu’s thresholding and active contour based segmentation techniques to locate the affected lung nodule of CT images. The segmentation is followed by an SVM classifier in order to categorize the affected portion is normal or abnormal. The proposed method is suitable to provide good and accurate segmentation and classification results for complex images. Conclusion: The comparative analysis between the two segmentation methods along with SVM classifier was performed. A classification process based on active contour and SVM techniques provides better than Otsu’s segmentation for complex lung images.

Extraction of Aortic Knuckle Contour in Chest Radiographs Using Deep Learning

In this paper, we aim to extract the aortic knuckle (AK) contour in chest radiographs, an anatomical structure rarely being addressed in the literature. Since the AK structure is small and thin, simply adopting the deep network methods that are successful for large organ segmentation is inadequate for achieving good pixel-level accuracy and resolving local ambiguities. To address this challenge, we propose a new coarse-to-fine segmentation approach which focuses on global and local information contexts, respectively. Two convolutional networks are used. For the coarse segmentation, we use FasterRCNN; for the fine segmentation, we use U-Net. Our evaluation uses the publicly available JSRT dataset; the results are promising. Besides presenting these results, we analyze issues such as the imprecision of manual contour marking, and automatic generation of the coarse segmentation ground-truth mask used for deep network training. Our approach is general and can be applied to extract other curve-like objects-of-interest.

Segmentation of lung fields from chest radiographs-a radiomic feature-based approach

Precisely segmented lung fields restrict the region-of-interest from which radiological patterns are searched, and is thus an indispensable prerequisite step in any chest radiographic CADx system. Recently, a number of deep learning-based approaches have been proposed to implement this step. However, deep learning has its own limitations and cannot be used in resource-constrained settings. Medical systems generally have limited RAM, computational power, storage, and no GPUs. They are thus not always suited for running deep learning-based models. Shallow learning-based models with appropriately selected features give comparable performance but with modest resources. The present paper thus proposes a shallow learning-based method that makes use of 40 radiomic features to segment lung fields from chest radiographs. A distance regularized level set evolution (DRLSE) method along with other post-processing steps are used to refine its output. The proposed method is trained and tested using publicly available JSRT dataset. The testing results indicate that the performance of the proposed method is comparable to the state-of-the-art deep learning-based lung field segmentation (LFS) methods and better than other LFS methods.

Inter-Patient Modelling of 2D Lung Variations from Chest X-Ray Imaging via Fourier Descriptors

Detailed knowledge of anatomical lung variation is very important in medical image processing. Normal variations of lung consistent with the maintenance of pulmonary health and abnormal lung variations can be as a result of a pulmonary disease. Inter-patient lung variations can be due to the several factors such as sex, age, height, weight and type of disease. This study tries to show the inter-patient lung variations by using one of the shape-based descriptions techniques which is called Fourier descriptors. Shape-based description is an important approach to construct an object according to its parametric values. A different types of techniques are reported in the literature that aim to represent objects based on their shapes; each of these techniques has its cons and pros. Fourier descriptors, a simple yet powerful technique, has interesting properties such as rotational, scale, and translational invariance and these are powerful features for the recognition of two-dimensional connected shapes. In this paper, we use 380 CXR (Chest X-ray) images as a training set to construct the statistical mean model of lung contour. For modelling, the first step is evaluation of lung contour approximation and characterization to get the good spatial and frequency resolution. In the second step, all of the lung contours registered to show the variation and make a mean shape (i.e. lungs). And the final step is calculating the dispersion (i.e. covariance matrix) and analyzing by principle components. The proposed technique used to create the inter-patient statistical model and provide statistical parameters for application in segmentation, classification, 2D atlas based registration, etc. In this paper, we presented an approach for creating 2D modelling of human lungs from CXR image archives and reported some interesting statistical parameters to analysis the left and the right lung shape.

Detecting drug-resistant tuberculosis in chest radiographs

Purpose

Tuberculosis is a major global health threat claiming millions of lives each year. While the total number of tuberculosis cases has been decreasing over the last years, the rise of drug-resistant tuberculosis has reduced the chance of controlling the disease. The purpose is to implement a timely diagnosis of drug-resistant tuberculosis, which is essential to administering adequate treatment regimens and stopping the further transmission of drug-resistant tuberculosis.

Methods

A main tool for diagnosing tuberculosis is the conventional chest X-ray. We are investigating the possibility of discriminating automatically between drug-resistant and drug-sensitive tuberculosis in chest X-rays by means of image analysis and machine learning methods.

Results

For discriminating between drug-sensitive and drug-resistant tuberculosis, we achieve an area under the receiver operating characteristic curve (AUC) of up to 66%, using an artificial neural network in combination with a set of shape and texture features. We did not observe any significant difference in the results when including follow-up X-rays for each patient.

Conclusion

Our results suggest that a chest X-ray contains information about the likelihood of a drug-resistant tuberculosis infection, which can be exploited computationally. We therefore suggest to repeat the experiments of our pilot study on a larger set of chest X-rays.

Visualization and Interpretation of Convolutional Neural Network Predictions in Detecting Pneumonia in Pediatric Chest Radiographs

Pneumonia affects 7% of the global population, resulting in 2 million pediatric deaths every year. Chest X-ray (CXR) analysis is routinely performed to diagnose the disease. Computer-aided diagnostic (CADx) tools aim to supplement decision-making. These tools process the handcrafted and/or convolutional neural network (CNN) extracted image features for visual recognition. However, CNNs are perceived as black boxes since their performance lack explanations. This is a serious bottleneck in applications involving medical screening/diagnosis since poorly interpreted model behavior could adversely affect the clinical decision. In this study, we evaluate, visualize, and explain the performance of customized CNNs to detect pneumonia and further differentiate between bacterial and viral types in pediatric CXRs. We present a novel visualization strategy to localize the region of interest (ROI) that is considered relevant for model predictions across all the inputs that belong to an expected class. We statistically validate the models' performance toward the underlying tasks. We observe that the customized VGG16 model achieves 96.2% and 93.6% accuracy in detecting the disease and distinguishing between bacterial and viral pneumonia respectively. The model outperforms the state-of-the-art in all performance metrics and demonstrates reduced bias and improved generalization.

Computer-aided detection in chest radiography based on artificial intelligence: a survey

As the most common examination tool in medical practice, chest radiography has important clinical value in the diagnosis of disease. Thus, the automatic detection of chest disease based on chest radiography has become one of the hot topics in medical imaging research. Based on the clinical applications, the study conducts a comprehensive survey on computer-aided detection (CAD) systems, and especially focuses on the artificial intelligence technology applied in chest radiography. The paper presents several common chest X-ray datasets and briefly introduces general image preprocessing procedures, such as contrast enhancement and segmentation, and bone suppression techniques that are applied to chest radiography. Then, the CAD system in the detection of specific disease (pulmonary nodules, tuberculosis, and interstitial lung diseases) and multiple diseases is described, focusing on the basic principles of the algorithm, the data used in the study, the evaluation measures, and the results. Finally, the paper summarizes the CAD system in chest radiography based on artificial intelligence and discusses the existing problems and trends.

An Ensemble SSL Algorithm for Efficient Chest X-Ray Image Classification

A critical component in the computer-aided medical diagnosis of digital chest X-rays is the automatic detection of lung abnormalities, since the effective identification at an initial stage constitutes a significant and crucial factor in patient’s treatment. The vigorous advances in computer and digital technologies have ultimately led to the development of large repositories of labeled and unlabeled images. Due to the effort and expense involved in labeling data, training datasets are of a limited size, while in contrast, electronic medical record systems contain a significant number of unlabeled images. Semi-supervised learning algorithms have become a hot topic of research as an alternative to traditional classification methods, exploiting the explicit classification information of labeled data with the knowledge hidden in the unlabeled data for building powerful and effective classifiers. In the present work, we evaluate the performance of an ensemble semi-supervised learning algorithm for the classification of chest X-rays of tuberculosis. The efficacy of the presented algorithm is demonstrated by several experiments and confirmed by the statistical nonparametric tests, illustrating that reliable and robust prediction models could be developed utilizing a few labeled and many unlabeled data.

A novel stacked generalization of models for improved TB detection in chest radiographs

Chest x-ray (CXR) analysis is a common part of the protocol for confirming active pulmonary Tuberculosis (TB). However, many TB endemic regions are severely resource constrained in radiological services impairing timely detection and treatment. Computer-aided diagnosis (CADx) tools can supplement decision-making while simultaneously addressing the gap in expert radiological interpretation during mobile field screening. These tools use hand-engineered and/or convolutional neural networks (CNN) computed image features. CNN, a class of deep learning (DL) models, has gained research prominence in visual recognition. It has been shown that Ensemble learning has an inherent advantage of constructing non-linear decision making functions and improve visual recognition. We create a stacking of classifiers with hand-engineered and CNN features toward improving TB detection in CXRs. The results obtained are highly promising and superior to the state-of-the-art.

Feature Selection for Automatic Tuberculosis Screening in Frontal Chest Radiographs

To detect pulmonary abnormalities such as Tuberculosis (TB), an automatic analysis and classification of chest radiographs can be used as a reliable alternative to more sophisticated and technologically demanding methods (e.g. culture or sputum smear analysis). In target areas like Kenya TB is highly prevalent and often co-occurring with HIV combined with low resources and limited medical assistance. In these regions an automatic screening system can provide a cost-effective solution for a large rural population. Our completely automatic TB screening system is processing the incoming CXRs (chest X-ray) by applying image preprocessing techniques to enhance the image quality followed by an adaptive segmentation based on model selection. The delineated lung regions are described by a multitude of image features. These characteristics are than optimized by a feature selection strategy to provide the best description for the classifier, which will later decide if the analyzed image is normal or abnormal. Our goal is to find the optimal feature set from a larger pool of generic image features, -used originally for problems such as object detection, image retrieval, etc. For performance evaluation measures such as under the curve (AUC) and accuracy (ACC) were considered. Using a neural network classifier on two publicly available data collections, -namely the Montgomery and the Shenzhen dataset, we achieved the maximum area under the curve and accuracy of 0.99 and 97.03%, respectively. Further, we compared our results with existing state-of-the-art systems and to radiologists' decision.

Automated chest screening based on a hybrid model of transfer learning and convolutional sparse denoising autoencoder

Objective

In this paper, we aim to investigate the effect of computer-aided triage system, which is implemented for the health checkup of lung lesions involving tens of thousands of chest X-rays (CXRs) that are required for diagnosis. Therefore, high accuracy of diagnosis by an automated system can reduce the radiologist’s workload on scrutinizing the medical images.

Method

We present a deep learning model in order to efficiently detect abnormal levels or identify normal levels during mass chest screening so as to obtain the probability confidence of the CXRs. Moreover, a convolutional sparse denoising autoencoder is designed to compute the reconstruction error. We employ four publicly available radiology datasets pertaining to CXRs, analyze their reports, and utilize their images for mining the correct disease level of the CXRs that are to be submitted to a computer aided triaging system. Based on our approach, we vote for the final decision from multi-classifiers to determine which three levels of the images (i.e. normal, abnormal, and uncertain cases) that the CXRs fall into.

Results

We only deal with the grade diagnosis for physical examination and propose multiple new metric indices. Combining predictors for classification by using the area under a receiver operating characteristic curve, we observe that the final decision is related to the threshold from reconstruction error and the probability value. Our method achieves promising results in terms of precision of 98.7 and 94.3% based on the normal and abnormal cases, respectively.

Conclusion

The results achieved by the proposed framework show superiority in classifying the disease level with high accuracy. This can potentially save the radiologists time and effort, so as to allow them to focus on higher-level risk CXRs.

Automated Chest X-Ray Screening: Can Lung Region Symmetry Help Detect Pulmonary Abnormalities?

Our primary motivator is the need for screening HIV+ populations in resource-constrained regions for exposure to Tuberculosis, using posteroanterior chest radiographs (CXRs). The proposed method is motivated by the observation that radiological examinations routinely conduct bilateral comparisons of the lung field. In addition, the abnormal CXRs tend to exhibit changes in the lung shape, size, and content (textures), and in overall, reflection symmetry between them. We analyze the lung region symmetry using multi-scale shape features, and edge plus texture features. Shape features exploit local and global representation of the lung regions, while edge and texture features take internal content, including spatial arrangements of the structures. For classification, we have performed voting-based combination of three different classifiers: Bayesian network, multilayer perception neural networks, and random forest. We have used three CXR benchmark collections made available by the U.S. National Library of Medicine and the National Institute of Tuberculosis and Respiratory Diseases, India, and have achieved a maximum abnormality detection accuracy (ACC) of 91.00% and area under the ROC curve (AUC) of 0.96. The proposed method outperforms the previously reported methods by more than 5% in ACC and 3% in AUC.

Lung field segmentation using weighted sparse shape composition with robust initialization

PURPOSE

Lung field segmentation for chest radiography is critical to pulmonary disease diagnosis. In this paper, we propose a new deformable model using weighted sparse shape composition with robust initialization to achieve robust and accurate lung field segmentation.

METHODS

Our method consists of three steps: initialization, deformation and regularization. The steps of deformation and regularization are iteratively employed until convergence. First, since a deformable model is sensitive to the initial shape, a robust initialization is obtained by using a novel voting strategy, which allows the reliable patches on the image to vote for each landmark of the initial shape. Then, each point of the initial shape independently deforms to the lung boundary under the guidance of the appearance model, which can distinguish lung tissues from nonlung tissues near the boundary. Finally, the deformed shape is regularized by weighted sparse shape composition (SSC) model, which is constrained by both boundary information and the correlations between each point of the deformed shape.

RESULTS

Our method has been evaluated on 247 chest radiographs from well-known dataset Japanese Society of Radiological Technology (JSRT) and achieved high overlap scores (0.955 ± 0.021).

CONCLUSIONS

The experimental results show that the proposed deformable segmentation model is more robust and accurate than the traditional appearance and shape model on the JSRT database. Our method also shows higher accuracy than most state-of-the-art methods.

Pre-trained convolutional neural networks as feature extractors for tuberculosis detection

It is estimated that in 2015, approximately 1.8 million people infected by tuberculosis died, most of them in developing countries. Many of those deaths could have been prevented if the disease had been detected at an earlier stage, but the most advanced diagnosis methods are still cost prohibitive for mass adoption. One of the most popular tuberculosis diagnosis methods is the analysis of frontal thoracic radiographs; however, the impact of this method is diminished by the need for individual analysis of each radiography by properly trained radiologists. Significant research can be found on automating diagnosis by applying computational techniques to medical images, thereby eliminating the need for individual image analysis and greatly diminishing overall costs. In addition, recent improvements on deep learning accomplished excellent results classifying images on diverse domains, but its application for tuberculosis diagnosis remains limited. Thus, the focus of this work is to produce an investigation that will advance the research in the area, presenting three proposals to the application of pre-trained convolutional neural networks as feature extractors to detect the disease. The proposals presented in this work are implemented and compared to the current literature. The obtained results are competitive with published works demonstrating the potential of pre-trained convolutional networks as medical image feature extractors.

Lung Field Segmentation in Chest Radiographs From Boundary Maps by a Structured Edge Detector

Lung field segmentation in chest radiographs (CXRs) is an essential preprocessing step in automatically analyzing such images. We present a method for lung field segmentation that is built on a high-quality boundary map detected by an efficient modern boundary detector, namely a structured edge detector (SED). A SED is trained beforehand to detect lung boundaries in CXRs with manually outlined lung fields. Then, an ultrametric contour map (UCM) is transformed from the masked and marked boundary map. Finally, the contours with the highest confidence level in the UCM are extracted as lung contours. Our method is evaluated using the public Japanese Society of Radiological Technology database of scanned films. The average Jaccard index of our method is 95.2%, which is comparable with those of other state-of-the-art methods (95.4%). The computation time of our method is less than 0.1 s for a CXR when executed on an ordinary laptop. Our method is also validated on CXRs acquired with different digital radiography units. The results demonstrate the generalization of the trained SED model and the usefulness of our method.

Atlas-based rib-bone detection in chest X-rays

This paper investigates using rib-bone atlases for automatic detection of rib-bones in chest X-rays (CXRs). We built a system that takes patient X-ray and model atlases as input and automatically computes the posterior rib borders with high accuracy and efficiency. In addition to conventional atlas, we propose two alternative atlases: (i) automatically computed rib bone models using Computed Tomography (CT) scans, and (ii) dual energy CXRs. We test the proposed approach with each model on 25 CXRs from the Japanese Society of Radiological Technology (JSRT) dataset and another 25 CXRs from the National Library of Medicine CXR dataset. We achieve an area under the ROC curve (AUC) of about 95% for Montgomery and 91% for JSRT datasets. Using the optimal operating point of the ROC curve, we achieve a segmentation accuracy of 88.91±1.8% for Montgomery and 85.48±3.3% for JSRT datasets. Our method produces comparable results with the state-of-the-art algorithms. The performance of our method is also excellent on challenging X-rays as it successfully addressed the rib-shape variance between patients and number of visible rib-bones due to patient respiration.

Edge map analysis in chest X-rays for automatic pulmonary abnormality screening

PURPOSE

Our particular motivator is the need for screening HIV+ populations in resource-constrained regions for the evidence of tuberculosis, using posteroanterior chest radiographs (CXRs).

METHOD

The proposed method is motivated by the observation that abnormal CXRs tend to exhibit corrupted and/or deformed thoracic edge maps. We study histograms of thoracic edges for all possible orientations of gradients in the range [Formula: see text] at different numbers of bins and different pyramid levels, using five different regions-of-interest selection.

RESULTS

We have used two CXR benchmark collections made available by the U.S. National Library of Medicine and have achieved a maximum abnormality detection accuracy (ACC) of 86.36 % and area under the ROC curve (AUC) of 0.93 at 1 s per image, on average.

CONCLUSION

We have presented an automatic method for screening pulmonary abnormalities using thoracic edge map in CXR images. The proposed method outperforms previously reported state-of-the-art results.

Lung Lesion Extraction Using a Toboggan Based Growing Automatic Segmentation Approach

The accurate segmentation of lung lesions from computed tomography (CT) scans is important for lung cancer research and can offer valuable information for clinical diagnosis and treatment. However, it is challenging to achieve a fully automatic lesion detection and segmentation with acceptable accuracy due to the heterogeneity of lung lesions. Here, we propose a novel toboggan based growing automatic segmentation approach (TBGA) with a three-step framework, which are automatic initial seed point selection, multi-constraints 3D lesion extraction and the final lesion refinement. The new approach does not require any human interaction or training dataset for lesion detection, yet it can provide a high lesion detection sensitivity (96.35%) and a comparable segmentation accuracy with manual segmentation (P > 0.05), which was proved by a series assessments using the LIDC-IDRI dataset (850 lesions) and in-house clinical dataset (121 lesions). We also compared TBGA with commonly used level set and skeleton graph cut methods, respectively. The results indicated a significant improvement of segmentation accuracy . Furthermore, the average time consumption for one lesion segmentation was under 8 s using our new method. In conclusion, we believe that the novel TBGA can achieve robust, efficient and accurate lung lesion segmentation in CT images automatically.

Combination of texture and shape features to detect pulmonary abnormalities in digital chest X-rays

PURPOSE

To improve detection of pulmonary and pleural abnormalities caused by pneumonia or tuberculosis (TB) in digital chest X-rays (CXRs).

METHODS

A method was developed and tested by combining shape and texture features to classify CXRs into two categories: TB and non-TB cases. Based on observation that radiologist interpretation is typically comparative: between left and right lung fields, the algorithm uses shape features to describe the overall geometrical characteristics of the lung fields and texture features to represent image characteristics inside them.

RESULTS

Our algorithm was evaluated on two different datasets containing tuberculosis and pneumonia cases.

CONCLUSIONS

Using our proposed algorithm, we were able to increase the overall performance, measured as area under the (ROC) curve (AUC) by 2.4 % over our previous work.

Detecting Disease in Radiographs with Intuitive Confidence

This paper argues in favor of a specific type of confidence for use in computer-aided diagnosis and disease classification, namely, sine/cosine values of angles represented by points on the unit circle. The paper shows how this confidence is motivated by Chinese medicine and how sine/cosine values are directly related with the two forces Yin and Yang. The angle for which sine and cosine are equal (45°) represents the state of equilibrium between Yin and Yang, which is a state of nonduality that indicates neither normality nor abnormality in terms of disease classification. The paper claims that the proposed confidence is intuitive and can be readily understood by physicians. The paper underpins this thesis with theoretical results in neural signal processing, stating that a sine/cosine relationship between the actual input signal and the perceived (learned) input is key to neural learning processes. As a practical example, the paper shows how to use the proposed confidence values to highlight manifestations of tuberculosis in frontal chest X-rays.

Localized Energy-Based Normalization of Medical Images: Application to Chest Radiography

Automated quantitative analysis systems for medical images often lack the capability to successfully process images from multiple sources. Normalization of such images prior to further analysis is a possible solution to this limitation. This work presents a general method to normalize medical images and thoroughly investigates its effectiveness for chest radiography (CXR). The method starts with an energy decomposition of the image in different bands. Next, each band's localized energy is scaled to a reference value and the image is reconstructed. We investigate iterative and local application of this technique. The normalization is applied iteratively to the lung fields on six datasets from different sources, each comprising 50 normal CXRs and 50 abnormal CXRs. The method is evaluated in three supervised computer-aided detection tasks related to CXR analysis and compared to two reference normalization methods. In the first task, automatic lung segmentation, the average Jaccard overlap significantly increased from 0.72±0.30 and 0.87±0.11 for both reference methods to with normalization. The second experiment was aimed at segmentation of the clavicles. The reference methods had an average Jaccard index of 0.57±0.26 and 0.53±0.26; with normalization this significantly increased to . The third experiment was detection of tuberculosis related abnormalities in the lung fields. The average area under the Receiver Operating Curve increased significantly from 0.72±0.14 and 0.79±0.06 using the reference methods to with normalization. We conclude that the normalization can be successfully applied in chest radiography and makes supervised systems more generally applicable to data from different sources.

Multi-atlas segmentation of biomedical images: A survey

Multi-atlas segmentation (MAS), first introduced and popularized by the pioneering work of Rohlfing, et al. (2004), Klein, et al. (2005), and Heckemann, et al. (2006), is becoming one of the most widely-used and successful image segmentation techniques in biomedical applications. By manipulating and utilizing the entire dataset of "atlases" (training images that have been previously labeled, e.g., manually by an expert), rather than some model-based average representation, MAS has the flexibility to better capture anatomical variation, thus offering superior segmentation accuracy. This benefit, however, typically comes at a high computational cost. Recent advancements in computer hardware and image processing software have been instrumental in addressing this challenge and facilitated the wide adoption of MAS. Today, MAS has come a long way and the approach includes a wide array of sophisticated algorithms that employ ideas from machine learning, probabilistic modeling, optimization, and computer vision, among other fields. This paper presents a survey of published MAS algorithms and studies that have applied these methods to various biomedical problems. In writing this survey, we have three distinct aims. Our primary goal is to document how MAS was originally conceived, later evolved, and now relates to alternative methods. Second, this paper is intended to be a detailed reference of past research activity in MAS, which now spans over a decade (2003-2014) and entails novel methodological developments and application-specific solutions. Finally, our goal is to also present a perspective on the future of MAS, which, we believe, will be one of the dominant approaches in biomedical image segmentation.

Lung segmentation on standard and mobile chest radiographs using oriented Gaussian derivatives filter

Background

Unsupervised lung segmentation method is one of the mandatory processes in order to develop a Content Based Medical Image Retrieval System (CBMIRS) of CXR. The purpose of the study is to present a robust solution for lung segmentation of standard and mobile chest radiographs using fully automated unsupervised method.

Methods

The novel method is based on oriented Gaussian derivatives filter with seven orientations, combined with Fuzzy C-Means (FCM) clustering and thresholding to refine the lung region. In addition, a new algorithm to automatically generate a threshold value for each Gaussian response is also proposed. The algorithms are applied to both PA and AP chest radiographs from both public JSRT dataset and our private datasets from collaborative hospital. Two pre-processing blocks are introduced to standardize the images from different machines. Comparisons with the previous works found in the literature on JSRT dataset shows that our method gives a reasonably good result. We also compare our algorithm with other unsupervised methods to provide fairly comparative measures on the performances for all datasets.

Results

Performance measures (accuracy, F-score, precision, sensitivity and specificity) for the segmentation of lung in public JSRT dataset are above 0.90 except for the overlap measure is 0.87. The standard deviations for all measures are very low, from 0.01 to 0.06. The overlap measure for the private image database is 0.81 (images from standard machine) and 0.69 (images from two mobile machines). The algorithm is fully automated and fast, with the average execution time of 12.5 s for 512 by 512 pixels resolution.

Conclusions

Our proposed method is fully automated, unsupervised, with no training or learning stage is necessary to segment the lungs taken using both a standard machine and two different mobile machines. The proposed pre-processing blocks are significantly useful to standardize the radiographs from mobile machines. The algorithm gives good performance measures, robust, and fast for the application of the CBMIRS.

Automatically Detecting Rotation in Chest Radiographs Using Principal Rib-Orientation Measure for Quality Control

We present a novel method for detecting rotated lungs in chest radiographs for quality control and augmenting automated abnormality detection. The method computes a principal rib-orientation measure using a generalized line histogram technique for quality control, and therefore augmenting automated abnormality detection. To compute the line histogram, we use line seed filters as kernels to convolve with edge images, and extract a set of lines from the posterior rib-cage. After convolving kernels in all possible orientations in the range [0°, 180°), we measure the angle with maximum magnitude in the line histogram. This measure provides an approximation of the principal chest rib-orientation for each lung. A chest radiograph is upright if the difference between the orientation angles of both lungs with respect to the horizontal axis is negligible. We validate our method on sets of normal and abnormal images and argue that rib orientation can be used for rotation detection in chest radiographs as an aid in quality control during image acquisition. It can also be used for training and testing data sets for computer aided diagnosis research, for example. In our experiments, we achieve a maximum accuracy of approximately 90%.

Severity quantification of pediatric viral respiratory illnesses in chest X-ray images

Accurate assessment of severity of viral respiratory illnesses (VRIs) allows early interventions to prevent morbidity and mortality in young children. This paper proposes a novel imaging biomarker framework with chest X-ray image for assessing VRI's severity in infants, developed specifically to meet the distinct challenges for pediatric population. The proposed framework integrates three novel technical contributions: a) lung segmentation using weighted partitioned active shape model, b) obtrusive object removal using graph cut segmentation with asymmetry constraint, and c) severity quantification using information-theoretic heterogeneity measures. This paper presents our pilot experimental results with a dataset of 148 images and the ground-truth severity scores given by a board-certified pediatric pulmonologist, demonstrating the effectiveness and clinical relevance of the presented framework.

Two public chest X-ray datasets for computer-aided screening of pulmonary diseases

The U.S. National Library of Medicine has made two datasets of postero-anterior (PA) chest radiographs available to foster research in computer-aided diagnosis of pulmonary diseases with a special focus on pulmonary tuberculosis (TB). The radiographs were acquired from the Department of Health and Human Services, Montgomery County, Maryland, USA and Shenzhen No. 3 People's Hospital in China. Both datasets contain normal and abnormal chest X-rays with manifestations of TB and include associated radiologist readings.