Computer-aided detection of interstitial abnormalities in chest radiographs using a reference standard based on computed tomography

Clinician and computer: a study on doctors' perceptions of artificial intelligence in skeletal radiography

BACKGROUND

Traumatic musculoskeletal injuries are a common presentation to emergency care, the first-line investigation often being plain radiography. The interpretation of this imaging frequently falls to less experienced clinicians despite well-established challenges in reporting. This study presents novel data of clinicians' confidence in interpreting trauma radiographs, their perception of AI in healthcare, and their support for the development of systems applied to skeletal radiography.

METHODS

A novel questionnaire was distributed through a network of collaborators to clinicians across the Southeast of England. Over a three-month period, responses were compiled into a database before undergoing statistical review.

RESULTS

The responses of 297 participants were included. The mean self-assessed knowledge of AI in healthcare was 3.68 out of ten, with significantly higher knowledge reported by the most senior doctors (Specialty Trainee/Specialty Registrar or above = 4.88). 13.8% of participants reported an awareness of AI in their clinical practice. Overall, participants indicated substantial favourability towards AI in healthcare (7.87) and in AI applied to skeletal radiography (7.75). There was a preference for a hypothetical system indicating positive findings rather than ruling as negative (7.26 vs 6.20).

CONCLUSIONS

This study identifies clear support, amongst a cross section of student and qualified doctors, for both the general use of AI technology in healthcare and in its application to skeletal radiography for trauma. The development of systems to address this demand appear well founded and popular. The engagement of a small but reticent minority should be sought, along with improving the wider education of doctors on AI.

Computerized Classification of Pneumoconiosis on Digital Chest Radiography Artificial Neural Network with Three Stages

It is difficult for radiologists to classify pneumoconiosis from category 0 to category 3 on chest radiographs. Therefore, we have developed a computer-aided diagnosis (CAD) system based on a three-stage artificial neural network (ANN) method for classification based on four texture features. The image database consists of 36 chest radiographs classified as category 0 to category 3. Regions of interest (ROIs) with a matrix size of 32 × 32 were selected from chest radiographs. We obtained a gray-level histogram, histogram of gray-level difference, gray-level run-length matrix (GLRLM) feature image, and gray-level co-occurrence matrix (GLCOM) feature image in each ROI. For ROI-based classification, the first ANN was trained with each texture feature. Next, the second ANN was trained with output patterns obtained from the first ANN. Finally, we obtained a case-based classification for distinguishing among four categories with the third ANN method. We determined the performance of the third ANN by receiver operating characteristic (ROC) analysis. The areas under the ROC curve (AUC) of the highest category (severe pneumoconiosis) case and the lowest category (early pneumoconiosis) case were 0.89 ± 0.09 and 0.84 ± 0.12, respectively. The three-stage ANN with four texture features showed the highest performance for classification among the four categories. Our CAD system would be useful for assisting radiologists in classification of pneumoconiosis from category 0 to category 3.

Advances in Optimal Detection of Cancer by Image Processing; Experience with Lung and Breast Cancers

Clinicians should looking for techniques that helps to early diagnosis of cancer, because early cancer detection is critical to increase survival and cost effectiveness of treatment, and as a result decrease mortality rate. Medical images are the most important tools to provide assistance. However, medical images have some limitations for optimal detection of some neoplasias, originating either from the imaging techniques themselves, or from human visual or intellectual capacity. Image processing techniques are allowing earlier detection of abnormalities and treatment monitoring. Because the time is a very important factor in cancer treatment, especially in cancers such as the lung and breast, imaging techniques are used to accelerate diagnosis more than with other cancers. In this paper, we outline experience in use of image processing techniques for lung and breast cancer diagnosis. Looking at the experience gained will help specialists to choose the appropriate technique for optimization of diagnosis through medical imaging.

Automatic Detection of Tuberculosis in Chest Radiographs Using a Combination of Textural, Focal, and Shape Abnormality Analysis

Tuberculosis (TB) is a common disease with high mortality and morbidity rates worldwide. Automatic systems to detect TB on chest radiographs (CXRs) can improve the efficiency of diagnostic algorithms for pulmonary TB. The diverse manifestation of TB on CXRs from different populations requires a system that can be adapted to deal with different types of abnormalities. A computer aided detection (CAD) system was developed which combines several subscores of supervised subsystems detecting textural, shape, and focal abnormalities into one TB score. A general framework was developed to combine an arbitrary number of subscores: subscores were normalized, collected in a feature vector and then combined using a supervised classifier into one combined score. The method was evaluated on two databases, both consisting of 200 digital CXRs, from: (A) Western high-risk group screening, (B) TB suspect screening in Africa. The subscores and combined score were compared to (1) an external, non-radiological, reference and (2) a radiological reference determined by a human expert. Performance was measured using Receiver Operator Characteristic (ROC) analysis. Different subscores performed best in the two databases. The combined TB score performed better than the individual subscores, except for the external reference in database B. The performances of the independent observer were slightly higher than the combined TB score. Compared to the external reference, differences in performance between the combined TB score and the independent observer were not significant in both databases. Supervised combination to compute an overall TB score allows for a necessary adaptation of the CAD system to different settings or different operational requirements.

Application of phase congruency for discriminating some lung diseases using chest radiograph

A novel procedure using phase congruency is proposed for discriminating some lung disease using chest radiograph. Phase congruency provides information about transitions between adjacent pixels. Abrupt changes of phase congruency values between pixels may suggest a possible boundary or another feature that may be used for discrimination. This property of phase congruency may have potential for deciding between disease present and disease absent where the regions of infection on the images have no obvious shape, size, or configuration. Five texture measures calculated from phase congruency and Gabor were shown to be normally distributed. This gave good indicators of discrimination errors in the form of the probability of Type I Error (δ) and the probability of Type II Error (β). However, since 1 -  δ is the true positive fraction (TPF) and β is the false positive fraction (FPF), an ROC analysis was used to decide on the choice of texture measures. Given that features are normally distributed, for the discrimination between disease present and disease absent, energy, contrast, and homogeneity from phase congruency gave better results compared to those using Gabor. Similarly, for the more difficult problem of discriminating lobar pneumonia and lung cancer, entropy and homogeneity from phase congruency gave better results relative to Gabor.

Computer-supported diagnosis for endotension cases in endovascular aortic aneurysm repair evolution

An abdominal aortic aneurysm (AAA) is a localized abnormal enlargement of the abdominal aorta with fatal consequences if not treated on time. The endovascular aneurysm repair (EVAR) is a minimal invasive therapy that reduces recovery times and improves survival rates in AAA cases. Nevertheless, post-operation difficulties can appear influencing the evolution of treatment. The objective of this work is to develop a pilot computer-supported diagnosis system for an automated characterization of EVAR progression from CTA images. The system is based on the extraction of texture features from post-EVAR thrombus aneurysm samples and on posterior classification. Three conventional texture-analysis methods, namely the gray level co-occurrence matrix (GLCM), the gray level run length matrix (GLRLM), the gray level difference method (GLDM), and a new method proposed by the authors, the run length matrix of local co-occurrence matrices (RLMLCM), were applied to each sample. Several classification schemes were experimentally evaluated. The ensembles of a k-nearest neighbor (k-NN), a multilayer perceptron neural network (MLP-NN), and a support vector machine (SVM) classifier fed with a reduced version of texture features resulted in a better performance (Az=94.35±0.30), as compared to the classification performance of the other alternatives.

Suppression of translucent elongated structures: applications in chest radiography

Projection images, such as those routinely acquired in radiological practice, are difficult to analyze because multiple 3-D structures superimpose at a single point in the 2-D image. Removal of particular superimposed structures may improve interpretation of these images, both by humans and by computers. This work therefore presents a general method to isolate and suppress structures in 2-D projection images. The focus is on elongated structures, which allows an intensity model of a structure of interest to be extracted using local information only. The model is created from profiles sampled perpendicular to the structure. Profiles containing other structures are detected and removed to reduce the influence on the model. Subspace filtering, using blind source separation techniques, is applied to separate the structure to be suppressed from other structures. By subtracting the modeled structure from the original image a structure suppressed image is created. The method is evaluated in four experiments. In the first experiment ribs are suppressed in 20 artificial radiographs simulated from 3-D lung computed tomography (CT) images. The proposed method with blind source separation and outlier detection shows superior suppression of ribs in simulated radiographs, compared to a simplified approach without these techniques. Additionally, the ability of three observers to discriminate between patches containing ribs and containing no ribs, as measured by the area under the receiver operating characteristic curve (AUC), reduced from 0.99-1.00 on original images to 0.75-0.84 on suppressed images. In the second experiment clavicles are suppressed in 253 chest radiographs. The effect of suppression on clavicle visibility is evaluated using the clavicle contrast and border response, showing a reduction of 78% and 34%, respectively. In the third experiment nodules extracted from CT were simulated close to the clavicles in 100 chest radiographs. It was found that after suppression contrast of the nodules was higher than of the clavicles (1.35 and 0.55, respectively) than on original images (1.83 and 2.46, respectively). In the fourth experiment catheters were suppressed in chest radiographs. The ability of three observers to discriminate between patches originating from 36 images with and 21 images without catheters, as measured by the AUC, reduced from 0.98-0.99 on original images to 0.64-0.74 on suppressed images. We conclude that the presented method can markedly reduce the visibility of elongated structures in chest radiographs and shows potential to enhance diagnosis.

Quantitative computed tomography imaging of interstitial lung diseases

PURPOSE

High-resolution chest computed tomography (HRCT) is essential in the characterization of interstitial lung disease. The HRCT features of some diseases can be diagnostic. Longitudinal monitoring with HRCT can assess progression of interstitial lung disease; however, subtle changes in the volume and character of abnormalities can be difficult to assess. Accuracy of diagnosis can be dependent on expertise and experience of the radiologist, pathologist, or clinician. Quantitative analysis of thoracic HRCT has the potential to determine the extent of disease reproducibly, classify the types of abnormalities, and automate the diagnostic process.

MATERIALS AND METHODS

Novel software that utilizes histogram signatures to characterize pulmonary parenchyma was used to analyze chest HRCT data, including retrospective processing of clinical CT scans and research data from the Lung Tissue Research Consortium. Additional information including physiological, pathologic, and semiquantitative radiologist assessment was available to allow comparison of quantitative results, with visual estimates of the disease, physiological parameters, and measures of disease outcome.

RESULTS

Quantitative analysis results were provided in regional volumetric quantities for statistical analysis and a graphical representation. These results suggest that quantitative HRCT analysis can serve as a biomarker with physiological, pathologic, and prognostic significance.

CONCLUSIONS

It is likely that quantitative analysis of HRCT can be used in clinical practice as a means to aid in identifying a probable diagnosis, stratifying prognosis in early disease, and consistently determining progression of the disease or response to therapy. Further optimization of quantitative techniques and longitudinal analysis of well-characterized subjects would be helpful in validating these methods.

Foreign object detection and removal to improve automated analysis of chest radiographs

PURPOSE

Chest radiographs commonly contain projections of foreign objects, such as buttons, brassier clips, jewellery, or pacemakers and wires. The presence of these structures can substantially affect the output of computer analysis of these images. An automated method is presented to detect, segment, and remove foreign objects from chest radiographs.

METHODS

Detection is performed using supervised pixel classification with a kNN classifier, resulting in a probability estimate per pixel to belong to a projected foreign object. Segmentation is performed by grouping and post-processing pixels with a probability above a certain threshold. Next, the objects are replaced by texture inpainting.

RESULTS

The method is evaluated in experiments on 257 chest radiographs. The detection at pixel level is evaluated with receiver operating characteristic analysis on pixels within the unobscured lung fields and an Az value of 0.949 is achieved. Free response operator characteristic analysis is performed at the object level, and 95.6% of objects are detected with on average 0.25 false positive detections per image. To investigate the effect of removing the detected objects through inpainting, a texture analysis system for tuberculosis detection is applied to images with and without pathology and with and without foreign object removal. Unprocessed, the texture analysis abnormality score of normal images with foreign objects is comparable to those with pathology. After removing foreign objects, the texture score of normal images with and without foreign objects is similar, while abnormal images, whether they contain foreign objects or not, achieve on average higher scores.

CONCLUSIONS

The authors conclude that removal of foreign objects from chest radiographs is feasible and beneficial for automated image analysis.

Potential of computer-aided diagnosis to improve CT lung cancer screening

The development of low-dose spiral computed tomography (CT) has rekindled hope that effective lung cancer screening might yet be found. Screening is justified when there is evidence that it will extend lives at reasonable cost and acceptable levels of risk. A screening test should detect all extant cancers while avoiding unnecessary workups. Thus optimal screening modalities have both high sensitivity and specificity. Due to the present state of technology, radiologists must opt to increase sensitivity and rely on follow-up diagnostic procedures to rule out the incurred false positives. There is evidence in published reports that computer-aided diagnosis technology may help radiologists alter the benefit-cost calculus of CT sensitivity and specificity in lung cancer screening protocols. This review will provide insight into the current discussion of the effectiveness of lung cancer screening and assesses the potential of state-of-the-art computer-aided design developments.

A computerized method for automated identification of erect posteroanterior and supine anteroposterior chest radiographs

A computerized scheme was developed for automated identification of erect posteroanterior (PA) and supine anteroposterior (AP) chest radiographs. The method was based on three features, the tilt angle of the scapula superior border, the tilt angle of the clavicle and the extent of radiolucence in lung fields, to identify the view of a chest radiograph. The three indices A(scapula), A(clavicle) and C(lung) were determined from a chest image for the three features. Linear discriminant analysis was used to classify PA and AP chest images based on the three indices. The performance of the method was evaluated by receiver operating characteristic analysis. The proposed method was evaluated using a database of 600 PA and 600 AP chest radiographs. The discriminant performances Az of A(scapula), A(clavicle) and C(lung) were 0.878 ± 0.010, 0.683 ± 0.015 and 0.962 ± 0.006, respectively. The combination of the three indices obtained an Az value of 0.979 ± 0.004. The results indicate that the combination of the three indices could yield high discriminant performance. The proposed method could provide radiologists with information about the view of chest radiographs for interpretation or could be used as a preprocessing step for analyzing chest images.

Computer-assisted detection of infectious lung diseases: a review

Respiratory tract infections are a leading cause of death and disability worldwide. Although radiology serves as a primary diagnostic method for assessing respiratory tract infections, visual analysis of chest radiographs and computed tomography (CT) scans is restricted by low specificity for causal infectious organisms and a limited capacity to assess severity and predict patient outcomes. These limitations suggest that computer-assisted detection (CAD) could make a valuable contribution to the management of respiratory tract infections by assisting in the early recognition of pulmonary parenchymal lesions, providing quantitative measures of disease severity and assessing the response to therapy. In this paper, we review the most common radiographic and CT features of respiratory tract infections, discuss the challenges of defining and measuring these disorders with CAD, and propose some strategies to address these challenges.

Computer-aided detection of early interstitial lung diseases using low-dose CT images

This study aims to develop a new computer-aided detection (CAD) scheme to detect early interstitial lung disease (ILD) using low-dose computed tomography (CT) examinations. The CAD scheme classifies each pixel depicted on the segmented lung areas into positive or negative groups for ILD using a mesh-grid-based region growth method and a multi-feature-based artificial neural network (ANN). A genetic algorithm was applied to select optimal image features and the ANN structure. In testing each CT examination, only pixels selected by the mesh-grid region growth method were analyzed and classified by the ANN to improve computational efficiency. All unselected pixels were classified as negative for ILD. After classifying all pixels into the positive and negative groups, CAD computed a detection score based on the ratio of the number of positive pixels to all pixels in the segmented lung areas, which indicates the likelihood of the test case being positive for ILD. When applying to an independent testing dataset of 15 positive and 15 negative cases, the CAD scheme yielded the area under receiver operating characteristic curve (AUC = 0.884 ± 0.064) and 80.0% sensitivity at 85.7% specificity. The results demonstrated the feasibility of applying the CAD scheme to automatically detect early ILD using low-dose CT examinations.

Modified Chrispin-Norman chest radiography score for cystic fibrosis: observer agreement and correlation with lung function

Objective

To test observer agreement and two strategies for possible improvement (consensus meeting and reference images) for the modified Chrispin-Norman score for children with cystic fibrosis (CF).

Methods

Before and after a consensus meeting and after developing reference images three observers scored sets of 25 chest radiographs from children with CF. Observer agreement was tested for line, ring, mottled and large soft shadows, for overinflation and for the composite modified Chrispin-Norman score. Correlation with lung function was assessed.

Results

Before the consensus meeting agreement between observers 1 and 2 was moderate-good, but with observer 3 agreement was poor-fair. Scores correlated significantly with spirometry for observers 1 and 2 (−0.72<R<−0.42, P < 0.05), but not for observer 3. Agreement with observer 3 improved after the consensus meeting. Reference images improved agreement for overinflation and mottled and large shadows and correlation with lung function, but agreement for the modified Chrispin-Norman score did not improve further.

Conclusion

Consensus meetings and reference images improve among-observer agreement for the modified Chrispin-Norman score, but good agreement was not achieved among all observers for the modified Chrispin-Norman score and for bronchial line and ring shadows.

Simulation of nodules and diffuse infiltrates in chest radiographs using CT templates

A method is proposed to simulate nodules and diffuse infiltrates in chest radiographs. This allows creation of large annotated databases for training of both radiologists and computer aided diagnosis systems. Realistic nodules and diffuse infiltrates were generated from three-dimensional templates segmented from CT data. These templates are rescaled, rotated, projected and superimposed on a radiograph. This method was compared, in an observer study, to a previously published method that simulates pulmonary nodules as perfectly spherical objects. Results show that it is hard for human observers to distinguish real and simulated nodules when using templates (AUC-values do not significantly differ from .5, p > .05 for all observers). The method that produced spherical nodules performed slightly worse (AUC of one observer differs significantly from .5, p = .011). Simulation of diffuse infiltrates is challenging but also feasible (AUC = 0.67 for one observer).

A hybrid knowledge-guided detection technique for screening of infectious pulmonary tuberculosis from chest radiographs

Tuberculosis (TB) is a deadly infectious disease and the presence of cavities in the upper lung zones is a strong indicator that the disease has developed into a highly infectious state. Currently, the detection of TB cavities is mainly conducted by clinicians observing chest radiographs. Diagnoses performed by radiologists are labor intensive and very often there is insufficient healthcare personnel available, especially in remote communities. After assessing existing approaches, we propose an automated segmentation technique which takes a hybrid knowledge-based Bayesian classification approach to detect TB cavities automatically. We apply gradient inverse coefficient of variation (GICOV) and circularity measures to classify detected features and confirm true TB cavities. By comparing with non hybrid approaches and the classical active contour techniques for feature extraction in medical images, experimental results demonstrate that our approach achieves high accuracy with a low false positive rate in detecting TB cavities.

Effect of finite sample size on feature selection and classification: a simulation study

PURPOSE

The small number of samples available for training and testing is often the limiting factor in finding the most effective features and designing an optimal computer-aided diagnosis (CAD) system. Training on a limited set of samples introduces bias and variance in the performance of a CAD system relative to that trained with an infinite sample size. In this work, the authors conducted a simulation study to evaluate the performances of various combinations of classifiers and feature selection techniques and their dependence on the class distribution, dimensionality, and the training sample size. The understanding of these relationships will facilitate development of effective CAD systems under the constraint of limited available samples.

METHODS

Three feature selection techniques, the stepwise feature selection (SFS), sequential floating forward search (SFFS), and principal component analysis (PCA), and two commonly used classifiers, Fisher's linear discriminant analysis (LDA) and support vector machine (SVM), were investigated. Samples were drawn from multidimensional feature spaces of multivariate Gaussian distributions with equal or unequal covariance matrices and unequal means, and with equal covariance matrices and unequal means estimated from a clinical data set. Classifier performance was quantified by the area under the receiver operating characteristic curve Az. The mean Az values obtained by resubstitution and hold-out methods were evaluated for training sample sizes ranging from 15 to 100 per class. The number of simulated features available for selection was chosen to be 50, 100, and 200.

RESULTS

It was found that the relative performance of the different combinations of classifier and feature selection method depends on the feature space distributions, the dimensionality, and the available training sample sizes. The LDA and SVM with radial kernel performed similarly for most of the conditions evaluated in this study, although the SVM classifier showed a slightly higher hold-out performance than LDA for some conditions and vice versa for other conditions. PCA was comparable to or better than SFS and SFFS for LDA at small samples sizes, but inferior for SVM with polynomial kernel. For the class distributions simulated from clinical data, PCA did not show advantages over the other two feature selection methods. Under this condition, the SVM with radial kernel performed better than the LDA when few training samples were available, while LDA performed better when a large number of training samples were available.

CONCLUSIONS

None of the investigated feature selection-classifier combinations provided consistently superior performance under the studied conditions for different sample sizes and feature space distributions. In general, the SFFS method was comparable to the SFS method while PCA may have an advantage for Gaussian feature spaces with unequal covariance matrices. The performance of the SVM with radial kernel was better than, or comparable to, that of the SVM with polynomial kernel under most conditions studied.

Computerized detection of diffuse lung disease in MDCT: the usefulness of statistical texture features

Accurate detection of diffuse lung disease is an important step for computerized diagnosis and quantification of this disease. It is also a difficult clinical task for radiologists. We developed a computerized scheme to assist radiologists in the detection of diffuse lung disease in multi-detector computed tomography (CT). Two radiologists selected 31 normal and 37 abnormal CT scans with ground glass opacity, reticular, honeycombing and nodular disease patterns based on clinical reports. The abnormal cases in our database must contain at least an abnormal area with a severity of moderate or severe level that was subjectively rated by the radiologists. Because statistical texture features may lack the power to distinguish a nodular pattern from a normal pattern, the abnormal cases that contain only a nodular pattern were excluded. The areas that included specific abnormal patterns in the selected CT images were then delineated as reference standards by an expert chest radiologist. The lungs were first segmented in each slice by use of a thresholding technique, and then divided into contiguous volumes of interest (VOIs) with a 64 x 64 x 64 matrix size. For each VOI, we determined and employed statistical texture features, such as run-length and co-occurrence matrix features, to distinguish abnormal from normal lung parenchyma. In particular, we developed new run-length texture features with clear physical meanings to considerably improve the accuracy of our detection scheme. A quadratic classifier was employed for distinguishing between normal and abnormal VOIs by the use of a leave-one-case-out validation scheme. A rule-based criterion was employed to further determine whether a case was normal or abnormal. We investigated the impact of new and conventional texture features, VOI size and the dimensionality for regions of interest on detecting diffuse lung disease. When we employed new texture features for 3D VOIs of 64 x 64 x 64 voxels, our system achieved the highest performance level: a sensitivity of 86% and a specificity of 90% for the detection of abnormal VOIs, and a sensitivity of 89% and a specificity of 90% for the detection of abnormal cases. Our computerized scheme would be useful for assisting radiologists in the diagnosis of diffuse lung disease.

Computer-aided diagnosis in chest radiography: beyond nodules

Chest radiographs are the most common exam in radiology. They are essential for the management of various diseases associated with high mortality and morbidity and display a wide range of findings, many of them subtle. In this survey we identify a number of areas beyond pulmonary nodules that could benefit from computer-aided detection and diagnosis (CAD) in chest radiography. These include interstitial infiltrates, catheter tip detection, size measurements, detection of pneumothorax and detection and quantification of emphysema. Recent work in these areas is surveyed, but we conclude that the amount of research devoted to these topics is modest. Reasons for the slow pace of CAD development in chest radiography beyond nodules are discussed.