Minimal shape and intensity cost path segmentation

Lung Field Segmentation in Chest X-ray Images Using Superpixel Resizing and Encoder–Decoder Segmentation Networks

Lung segmentation of chest X-ray (CXR) images is a fundamental step in many diagnostic applications. Most lung field segmentation methods reduce the image size to speed up the subsequent processing time. Then, the low-resolution result is upsampled to the original high-resolution image. Nevertheless, the image boundaries become blurred after the downsampling and upsampling steps. It is necessary to alleviate blurred boundaries during downsampling and upsampling. In this paper, we incorporate the lung field segmentation with the superpixel resizing framework to achieve the goal. The superpixel resizing framework upsamples the segmentation results based on the superpixel boundary information obtained from the downsampling process. Using this method, not only can the computation time of high-resolution medical image segmentation be reduced, but also the quality of the segmentation results can be preserved. We evaluate the proposed method on JSRT, LIDC-IDRI, and ANH datasets. The experimental results show that the proposed superpixel resizing framework outperforms other traditional image resizing methods. Furthermore, combining the segmentation network and the superpixel resizing framework, the proposed method achieves better results with an average time score of 4.6 s on CPU and 0.02 s on GPU.

Multi-label segmentation and detection of COVID-19 abnormalities from chest radiographs using deep learning

Due to COVID-19, demand for Chest Radiographs (CXRs) have increased exponentially. Therefore, we present a novel fully automatic modified Attention U-Net (CXAU-Net) multi-class segmentation deep model that can detect common findings of COVID-19 in CXR images. The architectural design of this model includes three novelties: first, an Attention U-net model with channel and spatial attention blocks is designed that precisely localize multiple pathologies; second, dilated convolution applied improves the sensitivity of the model to foreground pixels with additional receptive fields valuation, and third a newly proposed hybrid loss function combines both area and size information for optimizing model. The proposed model achieves average accuracy, DSC, and Jaccard index scores of 0.951, 0.993, 0.984, and 0.921, 0.985, 0.973 for image-based and patch-based approaches respectively for multi-class segmentation on Chest X-ray 14 dataset. Also, average DSC and Jaccard index scores of 0.998, 0.989 are achieved for binary-class segmentation on the Japanese Society of Radiological Technology (JSRT) CXR dataset. These results illustrate that the proposed model outperformed the state-of-the-art segmentation methods.

Computer-Assisted System in Stress Radiography for Anterior Cruciate Ligament Injury with Correspondent Evaluation of Relevant Diagnostic Factors

We sought to design a computer-assisted system measuring the anterior tibial translation in stress radiography, evaluate its diagnostic performance for an anterior cruciate ligament (ACL) tear, and assess factors affecting the diagnostic accuracy. Retrospective research for patients with both knee stress radiography and magnetic resonance imaging (MRI) at our institution was performed. A complete ACL rupture was confirmed on an MRI. The anterior tibial translations with four different methods were measured in 249 patients by the designed algorithm. The diagnostic accuracy of each method in patients with all successful measurements was evaluated. Univariate logistic regression analysis for factors affecting diagnostic accuracy of method four was performed. In the inclusive 249 patients, 177 patients (129 with completely torn ACLs) were available for analysis. Mean anterior tibial translations were significantly increased in the patients with a completely torn ACL by all four methods, with diagnostic accuracies ranging from 66.7% to 75.1%. The diagnostic accuracy of method four was negatively associated with the time interval between stress radiography and MRI as well as force-joint distance on stress view, and not significantly associated with age, gender, flexion angle, intercondylar distance, and force-joint angle. A computer-assisted system measuring the anterior tibial translation in stress radiography showed acceptable diagnostic performance of complete ACL injury. A shorter time interval between stress radiography and MRI as well as shorter force-joint distance were associated with higher diagnostic accuracy.

Lung X-ray Segmentation using Deep Convolutional Neural Networks on Contrast-Enhanced Binarized Images

Automatically locating the lung regions effectively and efficiently in digital chest X-ray (CXR) images is important in computer-aided diagnosis. In this paper, we propose an adaptive pre-processing approach for segmenting the lung regions from CXR images using convolutional neural networks-based (CNN-based) architectures. It is comprised of three steps. First, a contrast enhancement method specifically designed for CXR images is adopted. Second, adaptive image binarization is applied to CXR images to separate the image foreground and background. Third, CNN-based architectures are trained on the binarized images for image segmentation. The experimental results show that the proposed pre-processing approach is applicable and effective to various CNN-based architectures and can achieve comparable segmentation accuracy to that of state-of-the-art methods while greatly expediting the model training by up to 20.74 % and reducing storage space for CRX image datasets by down to 94.6 % on average.

Image-to-Images Translation for Multi-Task Organ Segmentation and Bone Suppression in Chest X-Ray Radiography

Chest X-ray radiography is one of the earliest medical imaging technologies and remains one of the most widely-used for diagnosis, screening, and treatment follow up of diseases related to lungs and heart. The literature in this field of research reports many interesting studies dealing with the challenging tasks of bone suppression and organ segmentation but performed separately, limiting any learning that comes with the consolidation of parameters that could optimize both processes. This study, and for the first time, introduces a multitask deep learning model that generates simultaneously the bone-suppressed image and the organ-segmented image, enhancing the accuracy of tasks, minimizing the number of parameters needed by the model and optimizing the processing time, all by exploiting the interplay between the network parameters to benefit the performance of both tasks. The architectural design of this model, which relies on a conditional generative adversarial network, reveals the process on how the wellestablished pix2pix network (image-to-image network) is modified to fit the need for multitasking and extending it to the new image-to-images architecture. The developed source code of this multitask model is shared publicly on Github as the first attempt for providing the two-task pix2pix extension, a supervised/paired/aligned/registered image-to-images translation which would be useful in many multitask applications. Dilated convolutions are also used to improve the results through a more effective receptive field assessment. The comparison with state-of-the-art al-gorithms along with ablation study and a demonstration video1 are provided to evaluate the efficacy and gauge the merits of the proposed approach.

Contour-aware multi-label chest X-ray organ segmentation

PURPOSE

Segmentation of organs from chest X-ray images is an essential task for an accurate and reliable diagnosis of lung diseases and chest organ morphometry. In this study, we investigated the benefits of augmenting state-of-the-art deep convolutional neural networks (CNNs) for image segmentation with organ contour information and evaluated the performance of such augmentation on segmentation of lung fields, heart, and clavicles from chest X-ray images.

METHODS

Three state-of-the-art CNNs were augmented, namely the UNet and LinkNet architecture with the ResNeXt feature extraction backbone, and the Tiramisu architecture with the DenseNet. All CNN architectures were trained on ground-truth segmentation masks and additionally on the corresponding contours. The contribution of such contour-based augmentation was evaluated against the contour-free architectures, and 20 existing algorithms for lung field segmentation.

RESULTS

The proposed contour-aware segmentation improved the segmentation performance, and when compared against existing algorithms on the same publicly available database of 247 chest X-ray images, the UNet architecture with the ResNeXt50 encoder combined with the contour-aware approach resulted in the best overall segmentation performance, achieving a Jaccard overlap coefficient of 0.971, 0.933, and 0.903 for the lung fields, heart, and clavicles, respectively.

CONCLUSION

In this study, we proposed to augment CNN architectures for CXR segmentation with organ contour information and were able to significantly improve segmentation accuracy and outperform all existing solution using a public chest X-ray database.

A review on lung boundary detection in chest X-rays

PURPOSE

Chest radiography is the most common imaging modality for pulmonary diseases. Due to its wide usage, there is a rich literature addressing automated detection of cardiopulmonary diseases in digital chest X-rays (CXRs). One of the essential steps for automated analysis of CXRs is localizing the relevant region of interest, i.e., isolating lung region from other less relevant parts, for applying decision-making algorithms there. This article provides an overview of the recent literature on lung boundary detection in CXR images.

METHODS

We review the leading lung segmentation algorithms proposed in period 2006-2017. First, we present a review of articles for posterior-anterior view CXRs. Then, we mention studies which operate on lateral views. We pay particular attention to works that focus their efforts on deformed lungs and pediatric cases. We also highlight the radiographic measures extracted from lung boundary and their use in automatically detecting cardiopulmonary abnormalities. Finally, we identify challenges in dataset curation and expert delineation process, and we listed publicly available CXR datasets.

RESULTS

(1) We classified algorithms into four categories: rule-based, pixel classification-based, model-based, hybrid, and deep learning-based algorithms. Based on the reviewed articles, hybrid methods and deep learning-based methods surpass the algorithms in other classes and have segmentation performance as good as inter-observer performance. However, they require long training process and pose high computational complexity. (2) We found that most of the algorithms in the literature are evaluated on posterior-anterior view adult CXRs with a healthy lung anatomy appearance without considering challenges in abnormal CXRs. (3) We also found that there are limited studies for pediatric CXRs. The lung appearance in pediatrics, especially in infant cases, deviates from adult lung appearance due to the pediatric development stages. Moreover, pediatric CXRs are noisier than adult CXRs due to interference by other objects, such as someone holding the child's arms or the child's body, and irregular body pose. Therefore, lung boundary detection algorithms developed on adult CXRs may not perform accurately in pediatric cases and need additional constraints suitable for pediatric CXR imaging characteristics. (4) We have also stated that one of the main challenges in medical image analysis is accessing the suitable datasets. We listed benchmark CXR datasets for developing and evaluating the lung boundary algorithms. However, the number of CXR images with reference boundaries is limited due to the cumbersome but necessary process of expert boundary delineation.

CONCLUSIONS

A reliable computer-aided diagnosis system would need to support a greater variety of lung and background appearance. To our knowledge, algorithms in the literature are evaluated on posterior-anterior view adult CXRs with a healthy lung anatomy appearance, without considering ambiguous lung silhouettes due to pathological deformities, anatomical alterations due to misaligned body positioning, patient's development stage and gross background noises such as holding hands, jewelry, patient's head and legs in CXR. Considering all the challenges which are not very well addressed in the literature, developing lung boundary detection algorithms that are robust to such interference remains a challenging task. We believe that a broad review of lung region detection algorithms would be useful for researchers working in the field of automated detection/diagnosis algorithms for lung/heart pathologies in CXRs.

Review: On Segmentation of Nodules from Posterior and Anterior Chest Radiographs

Lung cancer is one of the major types of cancer in the world. Survival rate can be increased if the disease can be identified early. Posterior and anterior chest radiography and computerized tomography scans are the most used diagnosis techniques for detecting tumor from lungs. Posterior and anterior chest radiography requires less radiation dose and is available in most of the diagnostic centers and it costs less compared to the remaining diagnosis techniques. So PA chest radiography became the most commonly used technique for lung cancer detection. Because of superimposed anatomical structures present in the image, sometimes radiologists cannot find abnormalities from the image. To help radiologists in diagnosing tumor from PA chest radiographic images range of CAD scheme has been developed for the past three decades. These computerized tools may be used by radiologists as a second opinion in detecting tumor. Literature survey on detecting tumors from chest graphs is presented in this paper.

Fully Convolutional Architectures for Multiclass Segmentation in Chest Radiographs

The success of deep convolutional neural networks (NNs) on image classification and recognition tasks has led to new applications in very diversified contexts, including the field of medical imaging. In this paper, we investigate and propose NN architectures for automated multiclass segmentation of anatomical organs in chest radiographs (CXRs), namely for lungs, clavicles, and heart. We address several open challenges including model overfitting, reducing number of parameters, and handling of severely imbalanced data in CXR by fusing recent concepts in convolutional networks and adapting them to the segmentation problem task in CXR. We demonstrate that our architecture combining delayed subsampling, exponential linear units, highly restrictive regularization, and a large number of high-resolution low-level abstract features outperforms state-of-the-art methods on all considered organs, as well as the human observer on lungs and heart. The models use a multiclass configuration with three target classes and are trained and tested on the publicly available Japanese Society of Radiological Technology database, consisting of 247 X-ray images the ground-truth masks for which are available in the segmentation in CXR database. Our best performing model, trained with the loss function based on the Dice coefficient, reached mean Jaccard overlap scores of 95% for lungs, 86.8% for clavicles, and 88.2% for heart. This architecture outperformed the human observer results for lungs and heart.

Segmentation of Pathological Structures by Landmark-Assisted Deformable Models

Computerized segmentation of pathological structures in medical images is challenging, as, in addition to unclear image boundaries, image artifacts, and traces of surgical activities, the shape of pathological structures may be very different from the shape of normal structures. Even if a sufficient number of pathological training samples are collected, statistical shape modeling cannot always capture shape features of pathological samples as they may be suppressed by shape features of a considerably larger number of healthy samples. At the same time, landmarking can be efficient in analyzing pathological structures but often lacks robustness. In this paper, we combine the advantages of landmark detection and deformable models into a novel supervised multi-energy segmentation framework that can efficiently segment structures with pathological shape. The framework adopts the theory of Laplacian shape editing, that was introduced in the field of computer graphics, so that the limitations of statistical shape modeling are avoided. The performance of the proposed framework was validated by segmenting fractured lumbar vertebrae from 3-D computed tomography images, atrophic corpora callosa from 2-D magnetic resonance (MR) cross-sections and cancerous prostates from 3D MR images, resulting respectively in a Dice coefficient of 84.7 ± 5.0%, 85.3 ± 4.8% and 78.3 ± 5.1%, and boundary distance of 1.14 ± 0.49mm, 1.42 ± 0.45mm and 2.27 ± 0.52mm. The obtained results were shown to be superior in comparison to existing deformable model-based segmentation algorithms.

Lung Field Segmentation in Chest Radiographs From Boundary Maps by a Structured Edge Detector

Lung field segmentation in chest radiographs (CXRs) is an essential preprocessing step in automatically analyzing such images. We present a method for lung field segmentation that is built on a high-quality boundary map detected by an efficient modern boundary detector, namely a structured edge detector (SED). A SED is trained beforehand to detect lung boundaries in CXRs with manually outlined lung fields. Then, an ultrametric contour map (UCM) is transformed from the masked and marked boundary map. Finally, the contours with the highest confidence level in the UCM are extracted as lung contours. Our method is evaluated using the public Japanese Society of Radiological Technology database of scanned films. The average Jaccard index of our method is 95.2%, which is comparable with those of other state-of-the-art methods (95.4%). The computation time of our method is less than 0.1 s for a CXR when executed on an ordinary laptop. Our method is also validated on CXRs acquired with different digital radiography units. The results demonstrate the generalization of the trained SED model and the usefulness of our method.

Localized Energy-Based Normalization of Medical Images: Application to Chest Radiography

Automated quantitative analysis systems for medical images often lack the capability to successfully process images from multiple sources. Normalization of such images prior to further analysis is a possible solution to this limitation. This work presents a general method to normalize medical images and thoroughly investigates its effectiveness for chest radiography (CXR). The method starts with an energy decomposition of the image in different bands. Next, each band's localized energy is scaled to a reference value and the image is reconstructed. We investigate iterative and local application of this technique. The normalization is applied iteratively to the lung fields on six datasets from different sources, each comprising 50 normal CXRs and 50 abnormal CXRs. The method is evaluated in three supervised computer-aided detection tasks related to CXR analysis and compared to two reference normalization methods. In the first task, automatic lung segmentation, the average Jaccard overlap significantly increased from 0.72±0.30 and 0.87±0.11 for both reference methods to with normalization. The second experiment was aimed at segmentation of the clavicles. The reference methods had an average Jaccard index of 0.57±0.26 and 0.53±0.26; with normalization this significantly increased to . The third experiment was detection of tuberculosis related abnormalities in the lung fields. The average area under the Receiver Operating Curve increased significantly from 0.72±0.14 and 0.79±0.06 using the reference methods to with normalization. We conclude that the normalization can be successfully applied in chest radiography and makes supervised systems more generally applicable to data from different sources.

Structured patch model for a unified automatic and interactive segmentation framework

We present a novel interactive segmentation framework incorporating a priori knowledge learned from training data. The knowledge is learned as a structured patch model (StPM) comprising sets of corresponding local patch priors and their pairwise spatial distribution statistics which represent the local shape and appearance along its boundary and the global shape structure, respectively. When successive user annotations are given, the StPM is appropriately adjusted in the target image and used together with the annotations to guide the segmentation. The StPM reduces the dependency on the placement and quantity of user annotations with little increase in complexity since the time-consuming StPM construction is performed offline. Furthermore, a seamless learning system can be established by directly adding the patch priors and the pairwise statistics of segmentation results to the StPM. The proposed method was evaluated on three datasets, respectively, of 2D chest CT, 3D knee MR, and 3D brain MR. The experimental results demonstrate that within an equal amount of time, the proposed interactive segmentation framework outperforms recent state-of-the-art methods in terms of accuracy, while it requires significantly less computing and editing time to obtain results with comparable accuracy.

The sensitivity and specificity of using a computer aided diagnosis program for automatically scoring chest X-rays of presumptive TB patients compared with Xpert MTB/RIF in Lusaka Zambia

Objective

To determine the sensitivity and specificity of a Computer Aided Diagnosis (CAD) program for scoring chest x-rays (CXRs) of presumptive tuberculosis (TB) patients compared to Xpert MTB/RIF (Xpert).

Method

Consecutive presumptive TB patients with a cough of any duration were offered digital CXR, and opt out HIV testing. CXRs were electronically scored as normal (CAD score ≤60) or abnormal (CAD score>60) using a CAD program. All patients regardless of CAD score were requested to submit a spot sputum sample for testing with Xpert and a spot and morning sample for testing with LED Fluorescence Microscopy-(FM).

Results

Of 350 patients with evaluable data, 291 (83.1%) had an abnormal CXR score by CAD. The sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) of CXR compared to Xpert were 100% (95%CI 96.2–100), 23.2% (95%CI 18.2–28.9), 33.0% (95%CI 27.6–38.7) and 100% (95% 93.9–100), respectively. The area under the receiver operator curve (AUC) for CAD was 0.71 (95%CI 0.66–0.77). CXR abnormality correlated with smear grade (r = 0.30, p<0.0001) and with Xpert C_T(r = 0.37, p<0.0001).

Conclusions

To our knowledge this is the first time that a CAD program for TB has been successfully tested in a real world setting. The study shows that the CAD program had high sensitivity but low specificity and PPV. The use of CAD with digital CXR has the potential to increase the use and availability of chest radiography in screening for TB where trained human resources are scarce.

Shape representation for efficient landmark-based segmentation in 3-d

In this paper, we propose a novel approach to landmark-based shape representation that is based on transportation theory, where landmarks are considered as sources and destinations, all possible landmark connections as roads, and established landmark connections as goods transported via these roads. Landmark connections, which are selectively established, are identified through their statistical properties describing the shape of the object of interest, and indicate the least costly roads for transporting goods from sources to destinations. From such a perspective, we introduce three novel shape representations that are combined with an existing landmark detection algorithm based on game theory. To reduce computational complexity, which results from the extension from 2-D to 3-D segmentation, landmark detection is augmented by a concept known in game theory as strategy dominance. The novel shape representations, game-theoretic landmark detection and strategy dominance are combined into a segmentation framework that was evaluated on 3-D computed tomography images of lumbar vertebrae and femoral heads. The best shape representation yielded symmetric surface distance of 0.75 mm and 1.11 mm, and Dice coefficient of 93.6% and 96.2% for lumbar vertebrae and femoral heads, respectively. By applying strategy dominance, the computational costs were further reduced for up to three times.

Lung segmentation in chest radiographs using anatomical atlases with nonrigid registration

The National Library of Medicine (NLM) is developing a digital chest X-ray (CXR) screening system for deployment in resource constrained communities and developing countries worldwide with a focus on early detection of tuberculosis. A critical component in the computer-aided diagnosis of digital CXRs is the automatic detection of the lung regions. In this paper, we present a nonrigid registration-driven robust lung segmentation method using image retrieval-based patient specific adaptive lung models that detects lung boundaries, surpassing state-of-the-art performance. The method consists of three main stages: 1) a content-based image retrieval approach for identifying training images (with masks) most similar to the patient CXR using a partial Radon transform and Bhattacharyya shape similarity measure, 2) creating the initial patient-specific anatomical model of lung shape using SIFT-flow for deformable registration of training masks to the patient CXR, and 3) extracting refined lung boundaries using a graph cuts optimization approach with a customized energy function. Our average accuracy of 95.4% on the public JSRT database is the highest among published results. A similar degree of accuracy of 94.1% and 91.7% on two new CXR datasets from Montgomery County, MD, USA, and India, respectively, demonstrates the robustness of our lung segmentation approach.

Automatic tuberculosis screening using chest radiographs

Tuberculosis is a major health threat in many regions of the world. Opportunistic infections in immunocompromised HIV/AIDS patients and multi-drug-resistant bacterial strains have exacerbated the problem, while diagnosing tuberculosis still remains a challenge. When left undiagnosed and thus untreated, mortality rates of patients with tuberculosis are high. Standard diagnostics still rely on methods developed in the last century. They are slow and often unreliable. In an effort to reduce the burden of the disease, this paper presents our automated approach for detecting tuberculosis in conventional posteroanterior chest radiographs. We first extract the lung region using a graph cut segmentation method. For this lung region, we compute a set of texture and shape features, which enable the X-rays to be classified as normal or abnormal using a binary classifier. We measure the performance of our system on two datasets: a set collected by the tuberculosis control program of our local county's health department in the United States, and a set collected by Shenzhen Hospital, China. The proposed computer-aided diagnostic system for TB screening, which is ready for field deployment, achieves a performance that approaches the performance of human experts. We achieve an area under the ROC curve (AUC) of 87% (78.3% accuracy) for the first set, and an AUC of 90% (84% accuracy) for the second set. For the first set, we compare our system performance with the performance of radiologists. When trying not to miss any positive cases, radiologists achieve an accuracy of about 82% on this set, and their false positive rate is about half of our system's rate.

Suppression of translucent elongated structures: applications in chest radiography

Projection images, such as those routinely acquired in radiological practice, are difficult to analyze because multiple 3-D structures superimpose at a single point in the 2-D image. Removal of particular superimposed structures may improve interpretation of these images, both by humans and by computers. This work therefore presents a general method to isolate and suppress structures in 2-D projection images. The focus is on elongated structures, which allows an intensity model of a structure of interest to be extracted using local information only. The model is created from profiles sampled perpendicular to the structure. Profiles containing other structures are detected and removed to reduce the influence on the model. Subspace filtering, using blind source separation techniques, is applied to separate the structure to be suppressed from other structures. By subtracting the modeled structure from the original image a structure suppressed image is created. The method is evaluated in four experiments. In the first experiment ribs are suppressed in 20 artificial radiographs simulated from 3-D lung computed tomography (CT) images. The proposed method with blind source separation and outlier detection shows superior suppression of ribs in simulated radiographs, compared to a simplified approach without these techniques. Additionally, the ability of three observers to discriminate between patches containing ribs and containing no ribs, as measured by the area under the receiver operating characteristic curve (AUC), reduced from 0.99-1.00 on original images to 0.75-0.84 on suppressed images. In the second experiment clavicles are suppressed in 253 chest radiographs. The effect of suppression on clavicle visibility is evaluated using the clavicle contrast and border response, showing a reduction of 78% and 34%, respectively. In the third experiment nodules extracted from CT were simulated close to the clavicles in 100 chest radiographs. It was found that after suppression contrast of the nodules was higher than of the clavicles (1.35 and 0.55, respectively) than on original images (1.83 and 2.46, respectively). In the fourth experiment catheters were suppressed in chest radiographs. The ability of three observers to discriminate between patches originating from 36 images with and 21 images without catheters, as measured by the AUC, reduced from 0.98-0.99 on original images to 0.64-0.74 on suppressed images. We conclude that the presented method can markedly reduce the visibility of elongated structures in chest radiographs and shows potential to enhance diagnosis.

A game-theoretic framework for landmark-based image segmentation

A novel game-theoretic framework for landmark-based image segmentation is presented. Landmark detection is formulated as a game, in which landmarks are players, landmark candidate points are strategies, and likelihoods that candidate points represent landmarks are payoffs, determined according to the similarity of image intensities and spatial relationships between the candidate points in the target image and their corresponding landmarks in images from the training set. The solution of the formulated game-theoretic problem is the equilibrium of candidate points that represent landmarks in the target image and is obtained by a novel iterative scheme that solves the segmentation problem in polynomial time. The object boundaries are finally extracted by applying dynamic programming to the optimal path searching problem between the obtained adjacent landmarks. The performance of the proposed framework was evaluated for segmentation of lung fields from chest radiographs and heart ventricles from cardiac magnetic resonance cross sections. The comparison to other landmark-based segmentation techniques shows that the results obtained by the proposed game-theoretic framework are highly accurate and precise in terms of mean boundary distance and area overlap. Moreover, the framework overcomes several shortcomings of the existing techniques, such as sensitivity to initialization and convergence to local optima.

Multifeature landmark-free active appearance models: application to prostate MRI segmentation

Active shape models (ASMs) and active appearance models (AAMs) are popular approaches for medical image segmentation that use shape information to drive the segmentation process. Both approaches rely on image derived landmarks (specified either manually or automatically) to define the object's shape, which require accurate triangulation and alignment. An alternative approach to modeling shape is the levelset representation, defined as a set of signed distances to the object's surface. In addition, using multiple image derived attributes (IDAs) such as gradient information has previously shown to offer improved segmentation results when applied to ASMs, yet little work has been done exploring IDAs in the context of AAMs. In this work, we present a novel AAM methodology that utilizes the levelset implementation to overcome the issues relating to specifying landmarks, and locates the object of interest in a new image using a registration based scheme. Additionally, the framework allows for incorporation of multiple IDAs. Our multifeature landmark-free AAM (MFLAAM) utilizes an efficient, intuitive, and accurate algorithm for identifying those IDAs that will offer the most accurate segmentations. In this paper, we evaluate our MFLAAM scheme for the problem of prostate segmentation from T2-w MRI volumes. On a cohort of 108 studies, the levelset MFLAAM yielded a mean Dice accuracy of 88% ± 5%, and a mean surface error of 1.5 mm ±.8 mm with a segmentation time of 150/s per volume. In comparison, a state of the art AAM yielded mean Dice and surface error values of 86% ± 9% and 1.6 mm ± 1.0 mm, respectively. The differences with respect to our levelset-based MFLAAM model are statistically significant . In addition, our results were in most cases superior to several recent state of the art prostate MRI segmentation methods.

Clavicle segmentation in chest radiographs

Automated delineation of anatomical structures in chest radiographs is difficult due to superimposition of multiple structures. In this work an automated technique to segment the clavicles in posterior-anterior chest radiographs is presented in which three methods are combined. Pixel classification is applied in two stages and separately for the interior, the border and the head of the clavicle. This is used as input for active shape model segmentation. Finally dynamic programming is employed with an optimized cost function that combines appearance information of the interior of the clavicle, the border, the head and shape information derived from the active shape model. The method is compared with a number of previously described methods and with independent human observers on a large database. This database contains both normal and abnormal images and will be made publicly available. The mean contour distance of the proposed method on 249 test images is 1.1±1.6mm and the intersection over union is 0.86±0.10.

Automated lung segmentation in digital chest tomosynthesis

PURPOSE

The purpose of this study was to develop an automated lung segmentation method for computerized detection of lung nodules in digital chest tomosynthesis.

METHODS

The authors collected 45 digital tomosynthesis scans and manually segmented reference lung regions in each scan to assess the performance of the method. The authors automated the technique by calculating the edge gradient in an original image for enhancing lung outline and transforming the edge gradient image to polar coordinate space. The authors then employed a dynamic programming technique to delineate outlines of the unobscured lungs in the transformed edge gradient image. The lung outlines were converted back to the original image to provide the final segmentation result. The above lung segmentation algorithm was first applied to the central reconstructed tomosynthesis slice because of the absence of ribs overlapping lung structures. The segmented lung in the central slice was then used to guide lung segmentation in noncentral slices. The authors evaluated the segmentation method by using (1) an overlap rate of lung regions, (2) a mean absolute distance (MAD) of lung borders, (3) a Hausdorff distance of lung borders between the automatically segmented lungs and manually segmented reference lungs, and (4) the fraction of nodules included in the automatically segmented lungs.

RESULTS

The segmentation method achieved mean overlap rates of 85.7%, 88.3%, and 87.0% for left lungs, right lungs, and entire lungs, respectively; mean MAD of 4.8, 3.9, and 4.4 mm for left lungs, right lungs, and entire lungs, respectively; and mean Hausdorrf distance of 25.0 mm, 25.5 mm, and 30.1 mm for left lungs, right lungs, and entire lungs, respectively. All of the nodules inside the reference lungs were correctly included in the segmented lungs obtained with the lung segmentation method.

CONCLUSIONS

The method achieved relatively high accuracy for lung segmentation and will be useful for computer-aided detection of lung nodules in digital tomosynthesis.

Development and evaluation of a computer-aided diagnostic scheme for lung nodule detection in chest radiographs by means of two-stage nodule enhancement with support vector classification

PURPOSE

To develop a computer-aided detection (CADe) scheme for nodules in chest radiographs (CXRs) with a high sensitivity and a low false-positive (FP) rate.

METHODS

The authors developed a CADe scheme consisting of five major steps, which were developed for improving the overall performance of CADe schemes. First, to segment the lung fields accurately, the authors developed a multisegment active shape model. Then, a two-stage nodule-enhancement technique was developed for improving the conspicuity of nodules. Initial nodule candidates were detected and segmented by using the clustering watershed algorithm. Thirty-one shape-, gray-level-, surface-, and gradient-based features were extracted from each segmented candidate for determining the feature space, including one of the new features based on the Canny edge detector to eliminate a major FP source caused by rib crossings. Finally, a nonlinear support vector machine (SVM) with a Gaussian kernel was employed for classification of the nodule candidates.

RESULTS

To evaluate and compare the scheme to other published CADe schemes, the authors used a publicly available database containing 140 nodules in 140 CXRs and 93 normal CXRs. The CADe scheme based on the SVM classifier achieved sensitivities of 78.6% (110/140) and 71.4% (100/140) with averages of 5.0 (1165/233) FPs/image and 2.0 (466/233) FPs/image, respectively, in a leave-one-out cross-validation test, whereas the CADe scheme based on a linear discriminant analysis classifier had a sensitivity of 60.7% (85/140) at an FP rate of 5.0 FPs/image. For nodules classified as "very subtle" and "extremely subtle," a sensitivity of 57.1% (24/42) was achieved at an FP rate of 5.0 FPs/image. When the authors used a database developed at the University of Chicago, the sensitivities was 83.3% (40/48) and 77.1% (37/48) at an FP rate of 5.0 (240/48) FPs/image and 2.0 (96/48) FPs/image, respectively.

CONCLUSIONS

These results compare favorably to those described for other commercial and non-commercial CADe nodule detection systems.

Accurate prostate volume estimation using multifeature active shape models on T2-weighted MRI

RATIONALE AND OBJECTIVES

Accurate prostate volume estimation is useful for calculating prostate-specific antigen density and in evaluating posttreatment response. In the clinic, prostate volume estimation involves modeling the prostate as an ellipsoid or a spheroid from transrectal ultrasound, or T2-weighted magnetic resonance imaging (MRI). However, this requires some degree of manual intervention, and may not always yield accurate estimates. In this article, we present a multifeature active shape model (MFA) based segmentation scheme for estimating prostate volume from in vivo T2-weighted MRI.

MATERIALS AND METHODS

We aim to automatically determine the location of the prostate boundary on in vivo T2-weighted MRI, and subsequently determine the area of the prostate on each slice. The resulting planimetric areas are aggregated to yield the volume of the prostate for a given patient. Using a set of training images, the MFA learns the most discriminating statistical texture descriptors of the prostate boundary via a forward feature selection algorithm. After identification of the optimal image features, the MFA is deformed to accurately fit the prostate border. An expert radiologist segmented the prostate boundary on each slice and the planimetric aggregation of the enclosed areas yielded the ground truth prostate volume estimate. The volume estimation obtained via the MFA was then compared against volume estimations obtained via the ellipsoidal, Myschetzky, and prolated spheroids models.

RESULTS

We evaluated our MFA volume estimation method on a total 45 T2-weighted in vivo MRI studies, corresponding to both 1.5 Tesla and 3.0 Tesla field strengths. The results revealed that the ellipsoidal, Myschetzky, and prolate spheroid models overestimated prostate volumes, with volume fractions of 1.14, 1.53, and 1.96, respectively. By comparison, the MFA yielded a mean volume fraction of 1.05, evaluated using a fivefold cross-validation scheme. A correlation with the ground truth volume estimations showed that the MFA had an r(2) value of 0.82, whereas the clinical volume estimation schemes had a maximum value of 0.70.

CONCLUSIONS

Our MFA scheme involves minimal user intervention, is computationally efficient and results in volume estimations more accurate than state of the art clinical models.

Fusion of local and global detection systems to detect tuberculosis in chest radiographs

Automatic detection of tuberculosis (TB) on chest radiographs is a difficult problem because of the diverse presentation of the disease. A combination of detection systems for abnormalities and normal anatomy is used to improve detection performance. A textural abnormality detection system operating at the pixel level is combined with a clavicle detection system to suppress false positive responses. The output of a shape abnormality detection system operating at the image level is combined in a next step to further improve performance by reducing false negatives. Strategies for combining systems based on serial and parallel configurations were evaluated using the minimum, maximum, product, and mean probability combination rules. The performance of TB detection increased, as measured using the area under the ROC curve, from 0.67 for the textural abnormality detection system alone to 0.86 when the three systems were combined. The best result was achieved using the sum and product rule in a parallel combination of outputs.

A magnetic resonance spectroscopy driven initialization scheme for active shape model based prostate segmentation

Segmentation of the prostate boundary on clinical images is useful in a large number of applications including calculation of prostate volume pre- and post-treatment, to detect extra-capsular spread, and for creating patient-specific anatomical models. Manual segmentation of the prostate boundary is, however, time consuming and subject to inter- and intra-reader variability. T2-weighted (T2-w) magnetic resonance (MR) structural imaging (MRI) and MR spectroscopy (MRS) have recently emerged as promising modalities for detection of prostate cancer in vivo. MRS data consists of spectral signals measuring relative metabolic concentrations, and the metavoxels near the prostate have distinct spectral signals from metavoxels outside the prostate. Active Shape Models (ASM's) have become very popular segmentation methods for biomedical imagery. However, ASMs require careful initialization and are extremely sensitive to model initialization. The primary contribution of this paper is a scheme to automatically initialize an ASM for prostate segmentation on endorectal in vivo multi-protocol MRI via automated identification of MR spectra that lie within the prostate. A replicated clustering scheme is employed to distinguish prostatic from extra-prostatic MR spectra in the midgland. The spatial locations of the prostate spectra so identified are used as the initial ROI for a 2D ASM. The midgland initializations are used to define a ROI that is then scaled in 3D to cover the base and apex of the prostate. A multi-feature ASM employing statistical texture features is then used to drive the edge detection instead of just image intensity information alone. Quantitative comparison with another recent ASM initialization method by Cosio showed that our scheme resulted in a superior average segmentation performance on a total of 388 2D MRI sections obtained from 32 3D endorectal in vivo patient studies. Initialization of a 2D ASM via our MRS-based clustering scheme resulted in an average overlap accuracy (true positive ratio) of 0.60, while the scheme of Cosio yielded a corresponding average accuracy of 0.56 over 388 2D MR image sections. During an ASM segmentation, using no initialization resulted in an overlap of 0.53, using the Cosio based methodology resulted in an overlap of 0.60, and using the MRS-based methodology resulted in an overlap of 0.67, with a paired Student's t-test indicating statistical significance to a high degree for all results. We also show that the final ASM segmentation result is highly correlated (as high as 0.90) to the initialization scheme.

Fast, accurate, and robust automatic marker detection for motion correction based on oblique kV or MV projection image pairs

PURPOSE

A robust and accurate method that allows the automatic detection of fiducial markers in MV and kV projection image pairs is proposed. The method allows to automatically correct for inter or intrafraction motion.

METHODS

Intratreatment MV projection images are acquired during each of five treatment beams of prostate cancer patients with four implanted fiducial markers. The projection images are first preprocessed using a series of marker enhancing filters. 2D candidate marker locations are generated for each of the filtered projection images and 3D candidate marker locations are reconstructed by pairing candidates in subsequent projection images. The correct marker positions are retrieved in 3D by the minimization of a cost function that combines 2D image intensity and 3D geometric or shape information for the entire marker configuration simultaneously. This optimization problem is solved using dynamic programming such that the globally optimal configuration for all markers is always found. Translational interfraction and intrafraction prostate motion and the required patient repositioning is assessed from the position of the centroid of the detected markers in different MV image pairs. The method was validated on a phantom using CT as ground-truth and on clinical data sets of 16 patients using manual marker annotations as ground-truth.

RESULTS

The entire setup was confirmed to be accurate to around 1 mm by the phantom measurements. The reproducibility of the manual marker selection was less than 3.5 pixels in the MV images. In patient images, markers were correctly identified in at least 99% of the cases for anterior projection images and 96% of the cases for oblique projection images. The average marker detection accuracy was 1.4 +/- 1.8 pixels in the projection images. The centroid of all four reconstructed marker positions in 3D was positioned within 2 mm of the ground-truth position in 99.73% of all cases. Detecting four markers in a pair of MV images takes a little less than a second where most time is spent on the image preprocessing.

CONCLUSIONS

The authors have developed a method to automatically detect multiple markers in a pair of projection images that is robust, accurate, and sufficiently fast for clinical use. It can be used for kV, MV, or mixed image pairs and can cope with limited motion between the projection images.

Computer-aided diagnosis in chest radiography: beyond nodules

Chest radiographs are the most common exam in radiology. They are essential for the management of various diseases associated with high mortality and morbidity and display a wide range of findings, many of them subtle. In this survey we identify a number of areas beyond pulmonary nodules that could benefit from computer-aided detection and diagnosis (CAD) in chest radiography. These include interstitial infiltrates, catheter tip detection, size measurements, detection of pneumothorax and detection and quantification of emphysema. Recent work in these areas is surveyed, but we conclude that the amount of research devoted to these topics is modest. Reasons for the slow pace of CAD development in chest radiography beyond nodules are discussed.

Multi-attribute non-initializing texture reconstruction based active shape model (MANTRA)

In this paper we present MANTRA (Multi-Attribute, Non-Initializing, Texture Reconstruction Based Active Shape Model) which incorporates a number of features that improve on the the popular Active Shape Model (ASM) algorithm. MANTRA has the following advantages over the traditional ASM model. (1) It does not rely on image intensity information alone, as it incorporates multiple statistical texture features for boundary detection. (2) Unlike traditional ASMs, MANTRA finds the border by maximizing a higher dimensional version of mutual information (MI) called combined MI (CMI), which is estimated from kNN entropic graphs. The use of CMI helps to overcome limitations of the Mahalanobis distance, and allows multiple texture features to be intelligently combined. (3) MANTRA does not rely on the mean pixel intensity values to find the border; instead, it reconstructs potential image patches, and the image patch with the best reconstruction based on CMI is considered the object border. Our algorithm was quantitatively evaluated against expert ground truth on almost 230 clinical images (128 1.5 Tesla (T) T2 weighted in vivo prostate magnetic resonance (MR) images, 78 dynamic contrast enhanced breast MR images, and 21 3T in vivo T1-weighted prostate MR images) via 6 different quantitative metrics. Results from the more difficult prostate segmentation task (in which a second expert only had a 0.850 mean overlap with the first expert) show that the traditional ASM method had a mean overlap of 0.668, while the MANTRA model had a mean overlap of 0.840.

Model-based segmentation using graph representations

A generic supervised segmentation approach is presented. The object is described as a graph where the vertices correspond to landmarks points and the edges define the landmark relations. Instead of building one single global shape model, a priori shape information is represented as a concatenation of local shape models that consider only local dependencies between connected landmarks. The objective function is obtained from a maximum a posteriori criterion and is build up of localized energies of both shape and landmark intensity information. The optimization problem is discretized by searching candidates for each landmark using individual landmark intensity descriptors. The discrete optimization problem is then solved using mean field annealing or dynamic programming techniques. The algorithm is validated for hand bone segmentation from RX datasets and for 3D liver segmentation from contrast enhanced CT images.