Automated segmentation refinement of small lung nodules in CT scans by local shape analysis

Improved lung nodule segmentation with a squeeze excitation dilated attention based residual UNet

The diverse types and sizes, proximity to non-nodule structures, identical shape characteristics, and varying sizes of nodules make them challenging for segmentation methods. Although many efforts have been made in automatic lung nodule segmentation, most of them have not sufficiently addressed the challenges related to the type and size of nodules, such as juxta-pleural and juxta-vascular nodules. The current research introduces a Squeeze-Excitation Dilated Attention-based Residual U-Net (SEDARU-Net) with a robust intensity normalization technique to address the challenges related to different types and sizes of lung nodules and to achieve an improved lung nodule segmentation. After preprocessing the images with the intensity normalization method and extracting the Regions of Interest by YOLOv3, they are fed into the SEDARU-Net with dilated convolutions in the encoder part. Then, the extracted features are given to the decoder part, which involves transposed convolutions, Squeeze-Excitation Dilated Residual blocks, and skip connections equipped with an Attention Gate, to decode the feature maps and construct the segmentation mask. The proposed model was evaluated using the publicly available Lung Nodule Analysis 2016 (LUNA16) dataset, achieving a Dice Similarity Coefficient of 97.86%, IoU of 96.40%, sensitivity of 96.54%, and precision of 98.84%. Finally, it was shown that each added component to the U-Net's structure and the intensity normalization technique increased the Dice Similarity Coefficient by more than 2%. The proposed method suggests a potential clinical tool to address challenges related to the segmentation of lung nodules with different types located in the proximity of non-nodule structures.

Combining Multistaged Filters and Modified Segmentation Network for Improving Lung Nodules Classification

Advancements in computational technology have led to a shift towards automated detection processes in lung cancer screening, particularly through nodule segmentation techniques. These techniques employ thresholding to distinguish between soft and firm tissues, including cancerous nodules. The challenge of accurately detecting nodules close to critical lung structures such as blood vessels, bronchi, and the pleura highlights the necessity for more sophisticated methods to enhance diagnostic accuracy. This paper proposed combined processing filters for data preparation before using one of the modified Convolutional Neural Networks (CNNs) as the classifier. With refined filters, the nodule targets are solid, semi-solid, and ground glass, ranging from low-stage cancer (cancer screening data) to high-stage cancer. Furthermore, two additional works were added to address juxta-pleural nodules while the pre-processing end and classification are done in a 3-dimensional domain in opposition to the usual image classification. The accuracy output indicates that even using a simple Segmentation Network if modified correctly, can improve the classification result compared to the other eight models. The proposed sequence total accuracy reached 99.7%, with 99.71% cancer class accuracy and 99.82% non-cancer accuracy, much higher than any previous research, which can improve the detection efforts of the radiologist.

SaraNet: Semantic aggregation reverse attention network for pulmonary nodule segmentation

Accurate segmentation of pulmonary nodule is essential for subsequent pathological analysis and diagnosis. However, current U-Net architectures often rely on a simple skip connection scheme, leading to the fusion of feature maps with different semantic information, which can have a negative impact on the segmentation model. In response to this challenge, this study introduces a novel U-shaped model specifically designed for pulmonary nodule segmentation. The proposed model incorporates features such as the U-Net backbone, semantic aggregation feature pyramid module, and reverse attention module. The semantic aggregation module combines semantic information with multi-scale features, addressing the semantic gap between the encoder and decoder. The reverse attention module explores missing object parts and captures intricate details by erasing the currently predicted salient regions from side-output features. The proposed model is evaluated using the LIDC-IDRI dataset. Experimental results reveal that the proposed method achieves a dice similarity coefficient of 89.11%and a sensitivity of 90.73 %, outperforming state-of-the-art approaches comprehensively.

MRUNet-3D: A multi-stride residual 3D UNet for lung nodule segmentation

Obtaining an accurate segmentation of the pulmonary nodules in computed tomography (CT) images is challenging. This is due to: (1) the heterogeneous nature of the lung nodules; (2) comparable visual characteristics between the nodules and their surroundings. A robust multi-scale feature extraction mechanism that can effectively obtain multi-scale representations at a granular level can improve segmentation accuracy. As the most commonly used network in lung nodule segmentation, UNet, its variants, and other image segmentation methods lack this robust feature extraction mechanism. In this study, we propose a multi-stride residual 3D UNet (MRUNet-3D) to improve the segmentation accuracy of lung nodules in CT images. It incorporates a multi-slide Res2Net block (MSR), which replaces the simple sequence of convolution layers in each encoder stage to effectively extract multi-scale features at a granular level from different receptive fields and resolutions while conserving the strengths of 3D UNet. The proposed method has been extensively evaluated on the publicly available LUNA16 dataset. Experimental results show that it achieves competitive segmentation performance with an average dice similarity coefficient of 83.47 % and an average surface distance of 0.35 mm on the dataset. More notably, our method has proven to be robust to the heterogeneity of lung nodules. It has also proven to perform better at segmenting small lung nodules. Ablation studies have shown that the proposed MSR and RFIA modules are fundamental to improving the performance of the proposed model.

Classification of Chest CT Lung Nodules Using Collaborative Deep Learning Model

Background

Early detection of lung cancer through accurate diagnosis of malignant lung nodules using chest CT scans offers patients the highest chance of successful treatment and survival. Despite advancements in computer vision through deep learning algorithms, the detection of malignant nodules faces significant challenges due to insufficient training datasets.

Methods

This study introduces a model based on collaborative deep learning (CDL) to differentiate between cancerous and non-cancerous nodules in chest CT scans with limited available data. The model dissects a nodule into its constituent parts using six characteristics, allowing it to learn detailed features of lung nodules. It utilizes a CDL submodel that incorporates six types of feature patches to fine-tune a network previously trained with ResNet-50. An adaptive weighting method learned through error backpropagation enhances the process of identifying lung nodules, incorporating these CDL submodels for improved accuracy.

Results

The CDL model demonstrated a high level of performance in classifying lung nodules, achieving an accuracy of 93.24%. This represents a significant improvement over current state-of-the-art methods, indicating the effectiveness of the proposed approach.

Conclusion

The findings suggest that the CDL model, with its unique structure and adaptive weighting method, offers a promising solution to the challenge of accurately detecting malignant lung nodules with limited data. This approach not only improves diagnostic accuracy but also contributes to the early detection and treatment of lung cancer, potentially saving lives.

Lung Nodule Segmentation and Uncertain Region Prediction With an Uncertainty-Aware Attention Mechanism

Radiologists possess diverse training and clinical experiences, leading to variations in the segmentation annotations of lung nodules and resulting in segmentation uncertainty. Conventional methods typically select a single annotation as the learning target or attempt to learn a latent space comprising multiple annotations. However, these approaches fail to leverage the valuable information inherent in the consensus and disagreements among the multiple annotations. In this paper, we propose an Uncertainty-Aware Attention Mechanism (UAAM) that utilizes consensus and disagreements among multiple annotations to facilitate better segmentation. To this end, we introduce the Multi-Confidence Mask (MCM), which combines a Low-Confidence (LC) Mask and a High-Confidence (HC) Mask. The LC mask indicates regions with low segmentation confidence, where radiologists may have different segmentation choices. Following UAAM, we further design an Uncertainty-Guide Multi-Confidence Segmentation Network (UGMCS-Net), which contains three modules: a Feature Extracting Module that captures a general feature of a lung nodule, an Uncertainty-Aware Module that produces three features for the annotations' union, intersection, and annotation set, and an Intersection-Union Constraining Module that uses distances between the three features to balance the predictions of final segmentation and MCM. To comprehensively demonstrate the performance of our method, we propose a Complex-Nodule Validation on LIDC-IDRI, which tests UGMCS-Net's segmentation performance on lung nodules that are difficult to segment using common methods. Experimental results demonstrate that our method can significantly improve the segmentation performance on nodules that are difficult to segment using conventional methods.

Segmentation of lung nodules based on a refined segmentation network

BACKGROUND

Accurate segmentation of lung nodules is of great significance for early screening and diagnosis of lung cancer.

PURPOSE

However, the heterogeneity of lung nodules and the similarities between them and other lung tissues make it difficult to accurately segment these nodules. As regards the use of deep learning to segment lung nodules, convolutional neural networks would gradually lead to errors accumulating at the network layer due to the presence of multiple upsampling and downsampling layers, resulting in poor segmentation results.

METHODS

In this study, we developed a refined segmentation network (RS-Net) for lung nodule segmentation to solve this problem. Accordingly, the proposed RS-Net was first used to locate the core region of the lung nodules and to gradually refine the segmentation results of the core region. In addition, to solve the problem of misdetection of small-sized nodules owing to the imbalance of positive and negative samples, we devised an average dice-loss function computed on nodule level. By calculating the loss of each nodule sample to measure the overall loss, the network can address the misdetection problem of lung nodules with smaller diameters more efficiently.

RESULTS

Our method was evaluated based on 1055 lung nodules from Lung Image Database Consortium data and a set of 120 lung nodules collected from Shanghai Chest Hospital for additional validation. The segmentation dice coefficients of RS-Net on these two datasets were 85.90% and 81.13%, respectively. The analysis of the segmentation effect of different properties and sizes of nodules indicates that RS-Net yields a stable segmentation effect.

CONCLUSIONS

The results show that the segmentation strategy based on gradual refinement can considerably improve the segmentation of lung nodules.

Lung Cancer Screening with Low-Dose CT: What We Have Learned in Two Decades of ITALUNG and What Is Yet to Be Addressed

The ITALUNG trial started in 2004 and compared lung cancer (LC) and other-causes mortality in 55-69 years-aged smokers and ex-smokers who were randomized to four annual chest low-dose CT (LDCT) or usual care. ITALUNG showed a lower LC and cardiovascular mortality in the screened subjects after 13 years of follow-up, especially in women, and produced many ancillary studies. They included recruitment results of a population-based mimicking approach, development of software for computer-aided diagnosis (CAD) and lung nodules volumetry, LDCT assessment of pulmonary emphysema and coronary artery calcifications (CAC) and their relevance to long-term mortality, results of a smoking-cessation intervention, assessment of the radiations dose associated with screening LDCT, and the results of biomarkers assays. Moreover, ITALUNG data indicated that screen-detected LCs are mostly already present at baseline LDCT, can present as lung cancer associated with cystic airspaces, and can be multiple. However, several issues of LC screening are still unaddressed. They include the annual vs. biennial pace of LDCT, choice between opportunistic or population-based recruitment. and between uni or multi-centre screening, implementation of CAD-assisted reading, containment of false positive and negative LDCT results, incorporation of emphysema. and CAC quantification in models of personalized LC and mortality risk, validation of ultra-LDCT acquisitions, optimization of the smoking-cessation intervention. and prospective validation of the biomarkers.

A Bi-FPN-Based Encoder-Decoder Model for Lung Nodule Image Segmentation

Early detection and analysis of lung cancer involve a precise and efficient lung nodule segmentation in computed tomography (CT) images. However, the anonymous shapes, visual features, and surroundings of the nodules as observed in the CT images pose a challenging and critical problem to the robust segmentation of lung nodules. This article proposes a resource-efficient model architecture: an end-to-end deep learning approach for lung nodule segmentation. It incorporates a Bi-FPN (bidirectional feature network) between an encoder and a decoder architecture. Furthermore, it uses the Mish activation function and class weights of masks with the aim of enhancing the efficiency of the segmentation. The proposed model was extensively trained and evaluated on the publicly available LUNA-16 dataset consisting of 1186 lung nodules. To increase the probability of the suitable class of each voxel in the mask, a weighted binary cross-entropy loss of each sample of training was utilized as network training parameter. Moreover, on the account of further evaluation of robustness, the proposed model was evaluated on the QIN Lung CT dataset. The results of the evaluation show that the proposed architecture outperforms existing deep learning models such as U-Net with a Dice Similarity Coefficient of 82.82% and 81.66% on both datasets.

DEHA-Net: A Dual-Encoder-Based Hard Attention Network with an Adaptive ROI Mechanism for Lung Nodule Segmentation

Measuring pulmonary nodules accurately can help the early diagnosis of lung cancer, which can increase the survival rate among patients. Numerous techniques for lung nodule segmentation have been developed; however, most of them either rely on the 3D volumetric region of interest (VOI) input by radiologists or use the 2D fixed region of interest (ROI) for all the slices of computed tomography (CT) scan. These methods only consider the presence of nodules within the given VOI, which limits the networks' ability to detect nodules outside the VOI and can also encompass unnecessary structures in the VOI, leading to potentially inaccurate segmentation. In this work, we propose a novel approach for 3D lung nodule segmentation that utilizes the 2D region of interest (ROI) inputted from a radiologist or computer-aided detection (CADe) system. Concretely, we developed a two-stage lung nodule segmentation technique. Firstly, we designed a dual-encoder-based hard attention network (DEHA-Net) in which the full axial slice of thoracic computed tomography (CT) scan, along with an ROI mask, were considered as input to segment the lung nodule in the given slice. The output of DEHA-Net, the segmentation mask of the lung nodule, was inputted to the adaptive region of interest (A-ROI) algorithm to automatically generate the ROI masks for the surrounding slices, which eliminated the need for any further inputs from radiologists. After extracting the segmentation along the axial axis, at the second stage, we further investigated the lung nodule along sagittal and coronal views by employing DEHA-Net. All the estimated masks were inputted into the consensus module to obtain the final volumetric segmentation of the nodule. The proposed scheme was rigorously evaluated on the lung image database consortium and image database resource initiative (LIDC/IDRI) dataset, and an extensive analysis of the results was performed. The quantitative analysis showed that the proposed method not only improved the existing state-of-the-art methods in terms of dice score but also showed significant robustness against different types, shapes, and dimensions of the lung nodules. The proposed framework achieved the average dice score, sensitivity, and positive predictive value of 87.91%, 90.84%, and 89.56%, respectively.

Lung_PAYNet: a pyramidal attention based deep learning network for lung nodule segmentation

Accurate and reliable lung nodule segmentation in computed tomography (CT) images is required for early diagnosis of lung cancer. Some of the difficulties in detecting lung nodules include the various types and shapes of lung nodules, lung nodules near other lung structures, and similar visual aspects. This study proposes a new model named Lung_PAYNet, a pyramidal attention-based architecture, for improved lung nodule segmentation in low-dose CT images. In this architecture, the encoder and decoder are designed using an inverted residual block and swish activation function. It also employs a feature pyramid attention network between the encoder and decoder to extract exact dense features for pixel classification. The proposed architecture was compared to the existing UNet architecture, and the proposed methodology yielded significant results. The proposed model was comprehensively trained and validated using the LIDC-IDRI dataset available in the public domain. The experimental results revealed that the Lung_PAYNet delivered remarkable segmentation with a Dice similarity coefficient of 95.7%, mIOU of 91.75%, sensitivity of 92.57%, and precision of 96.75%.

Hybrid U-Net-based deep learning model for volume segmentation of lung nodules in CT images

OBJECTIVE

Accurate segmentation of the lung nodule in computed tomography images is a critical component of a computer-assisted lung cancer detection/diagnosis system. However, lung nodule segmentation is a challenging task due to the heterogeneity of nodules. This study is to develop a hybrid deep learning (H-DL) model for the segmentation of lung nodules with a wide variety of sizes, shapes, margins, and opacities.

MATERIALS AND METHODS

A dataset collected from Lung Image Database Consortium image collection containing 847 cases with lung nodules manually annotated by at least two radiologists with nodule diameters greater than 7 mm and less than 45 mm was randomly split into 683 training/validation and 164 independent test cases. The 50% consensus consolidation of radiologists' annotation was used as the reference standard for each nodule. We designed a new H-DL model combining two deep convolutional neural networks (DCNNs) with different structures as encoders to increase the learning capabilities for the segmentation of complex lung nodules. Leveraging the basic symmetric U-shaped architecture of U-Net, we redesigned two new U-shaped deep learning (U-DL) models that were expanded to six levels of convolutional layers. One U-DL model used a shallow DCNN structure containing 16 convolutional layers adapted from the VGG-19 as the encoder, and the other used a deep DCNN structure containing 200 layers adapted from DenseNet-201 as the encoder, while the same decoder with only one convolutional layer at each level was used in both U-DL models, and we referred to them as the shallow and deep U-DL models. Finally, an ensemble layer was used to combine the two U-DL models into the H-DL model. We compared the effectiveness of the H-DL, the shallow U-DL and the deep U-DL models by deploying them separately to the test set. The accuracy of volume segmentation for each nodule was evaluated by the 3D Dice coefficient and Jaccard index (JI) relative to the reference standard. For comparison, we calculated the median and minimum of the 3D Dice and JI over the individual radiologists who segmented each nodule, referred to as M-Dice, min-Dice, M-JI, and min-JI.

RESULTS

For the 164 test cases with 327 nodules, our H-DL model achieved an average 3D Dice coefficient of 0.750 ± 0.135 and an average JI of 0.617 ± 0.159. The radiologists' average M-Dice was 0.778 ± 0.102, and the average M-JI was 0.651 ± 0.127; both were significantly higher than those achieved by the H-DL model (p < 0.05). The radiologists' average min-Dice (0.685 ± 0.139) and the average min-JI (0.537 ± 0.153) were significantly lower than those achieved by the H-DL model (p < 0.05). The results indicated that the H-DL model approached the average performance of radiologists and was superior to the radiologist whose manual segmentation had the min-Dice and min-JI. Moreover, the average Dice and average JI achieved by the H-DL model were significantly higher than those achieved by the individual shallow U-DL model (Dice of 0.745 ± 0.139, JI of 0.611 ± 0.161; p < 0.05) or the individual deep U-DL model alone (Dice of 0.739 ± 0.145, JI of 0.604 ± 0.163; p < 0.05).

CONCLUSION

Our newly developed H-DL model outperformed the individual shallow or deep U-DL models. The H-DL method combining multilevel features learned by both the shallow and deep DCNNs could achieve segmentation accuracy comparable to radiologists' segmentation for nodules with wide ranges of image characteristics.

An Automatic Random Walker Algorithm for Segmentation of Ground Glass Opacity Pulmonary Nodules

Automatic and accurate segmentation of ground glass opacity (GGO) nodules still remains challenging due to inhomogeneous interiors, irregular shapes, and blurred boundaries from different patients. Despite successful applications in the image processing domains, the random walk has some limitations for segmentation of GGO pulmonary nodules. In this paper, an improved random walker method is proposed for the segmentation of GGO nodules. To calculate a new affinity matrix, intensity, spatial, and texture features are incorporated. It strengthens discriminative power between two adjacent nodes on the graph. To address the problem of robustness in seed acquisition, the geodesic distance is introduced and a novel local search strategy is presented to automatically acquire reliable seeds. For segmentation, a label constraint term is introduced to the energy function of original random walker, which alleviates the accumulation of errors caused by the initial seeds acquisition. Massive experiments conducted on Lung Images Dataset Consortium (LIDC) demonstrate that the proposed method achieves visually satisfactory results without user interactions. Both qualitative and quantitative evaluations also demonstrate that the proposed method obtains better performance compared with conventional random walker method and state-of-the-art segmentation methods in terms of the overlap score and F-measure.

An Efficient DA-Net Architecture for Lung Nodule Segmentation

A typical growth of cells inside tissue is normally known as a nodular entity. Lung nodule segmentation from computed tomography (CT) images becomes crucial for early lung cancer diagnosis. An issue that pertains to the segmentation of lung nodules is homogenous modular variants. The resemblance among nodules as well as among neighboring regions is very challenging to deal with. Here, we propose an end-to-end U-Net-based segmentation framework named DA-Net for efficient lung nodule segmentation. This method extracts rich features by integrating compactly and densely linked rich convolutional blocks merged with Atrous convolutions blocks to broaden the view of filters without dropping loss and coverage data. We first extract the lung’s ROI images from the whole CT scan slices using standard image processing operations and k-means clustering. This reduces the search space of the model to only lungs where the nodules are present instead of the whole CT scan slice. The evaluation of the suggested model was performed through utilizing the LIDC-IDRI dataset. According to the results, we found that DA-Net showed good performance, achieving an 81% Dice score value and 71.6% IOU score.

Optimal Deep Belief Network with Opposition based Pity Beetle Algorithm for Lung Cancer Classification: A DBNOPBA Approach

BACKGROUND AND OBJECTIVE

This research proposes a successful method of extracting Gray-Level Co-occurrence Matrix (GLCM) picture handling models to classify low-and high-metastatic cancer organisms with five prevalent cancer cell line pairs, coupled with the scanning laser picture projection technique and the typical textural function, i.e. contrast, correlation, power, temperature and homogeneity. The most significant level of disease for highly metastatic cancer cells are the degree of disturbance, contrast as well as entropy refers to the energy and homogeneity. A texture classification scheme to quantify the emphysema in Computed Tomography (CT) pictures is performed. Local binary models (LBP) are used to characterize areas of concern as texture characteristics and intensity histograms. A wavelet filter is used to acquire the informative matrix of each picture and decrease the dimensionality of the function space in the suggested method. A four-layer profound creed network is also used to obtain characteristics of elevated stage. Local Tangent Space Alignment (LTSA) is then used to compress the multi-domain defect characteristics into low dimensional vectors as a dimension reduction method. An unmonitored deep-belief network (DBN) is intended for the second phase to learn the unmarked characteristics. The strategy suggested uses Opposition Based Teaching (OBL), Position Clamping (PC) and the Cauchy Mutation (CM) to improve the fundamental PBA efficiency.

METHODS

This research presents a fresh meta-heuristic algorithm called Opposition-Based Pity Beetle Algorithm (OPBA), which assesses effectiveness against state-of-the-art algorithms. OBL speeds up the convergence of the technique as both PC and CM assist OPBA with escaping local optima. The suggested algorithm was motivated by the behaviour of the beetle, which had been named six-toothed spruce bark beetle to aggregate nests and meals. This beetle can be found and harvested from weakened trees ' bark in a forest, while its populace can also infest healthy and robust trees when it exceeds the specified threshold.

RESULTS & CONCLUSION

The methodology has been evaluated on CT imagery from the Lung Image Database Consortium and Image Resources Initiative (LIDC-IDRI), with a maximum sensitivity of 96.86%, precision of 97.24%, and an accuracy of 97.92%.

Volumetric lung nodule segmentation using adaptive ROI with multi-view residual learning

Accurate quantification of pulmonary nodules can greatly assist the early diagnosis of lung cancer, enhancing patient survival possibilities. A number of nodule segmentation techniques, which either rely on a radiologist-provided 3-D volume of interest (VOI) or use the constant region of interests (ROIs) for all the slices, are proposed; however, these techniques can only investigate the presence of nodule voxels within the given VOI. Such approaches restrain the solutions to freely investigate the nodule presence outside the given VOI and also include the redundant structures (non-nodule) into VOI, which limits the segmentation accuracy. In this work, a novel semi-automated approach for 3-D segmentation of lung nodule in computerized tomography scans, has been proposed. The technique is segregated into two stages. In the first stage, a 2-D ROI containing the nodule is provided as an input to perform a patch-wise exploration along the axial axis using a novel adaptive ROI algorithm. This strategy enables the dynamic selection of the ROI in the surrounding slices to investigate the presence of nodules using a Deep Residual U-Net architecture. This stage provides the initial estimation of the nodule utilized to extract the VOI. In the second stage, the extracted VOI is further explored along the coronal and sagittal axes, in patchwise fashion, with Residual U-Nets. All the estimated masks are then fed into a consensus module to produce a final volumetric segmentation of the nodule. The algorithm is rigorously evaluated on LIDC–IDRI dataset, which is the largest publicly available dataset. The proposed approach achieved the average dice score of 87.5%, which is significantly higher than the existing state-of-the-art techniques.

Segmentation of small ground glass opacity pulmonary nodules based on Markov random field energy and Bayesian probability difference

BACKGROUND

Image segmentation is an important part of computer-aided diagnosis (CAD), the segmentation of small ground glass opacity (GGO) pulmonary nodules is beneficial for the early detection of lung cancer. For the segmentation of small GGO pulmonary nodules, an integrated active contour model based on Markov random field energy and Bayesian probability difference (IACM_MRFEBPD) is proposed in this paper.

METHODS

First, the Markov random field (MRF) is constructed on the computed tomography (CT) images, then the MRF energy is calculated. The MRF energy is used to construct the region term. It can not only enhance the contrast between pulmonary nodule and the background region, but also solve the problem of intensity inhomogeneity using local spatial correlation information between neighboring pixels in the image. Second, the Gaussian mixture model is used to establish the probability model of the image, and the model parameters are estimated by the expectation maximization (EM) algorithm. So the Bayesian posterior probability difference of each pixel can be calculated. The probability difference is used to construct the boundary detection term, which is 0 at the boundary. Therefore, the blurred boundary problem can be solved. Finally, under the framework of the level set, the integrated active contour model is constructed.

RESULTS

To verify the effectiveness of the proposed method, the public data of the lung image database consortium and image database resource initiative (LIDC-IDRI) and the clinical data of the Affiliated Jiangmen Hospital of Sun Yat-sen University are used to perform experiments, and the intersection over union (IOU) score is used to evaluate the segmentation methods. Compared with other methods, the proposed method achieves the best results with the highest average IOU of 0.7444, 0.7503, and 0.7450 for LIDC-IDRI test set, clinical test set, and all test sets, respectively.

CONCLUSIONS

The experiment results show that the proposed method can segment various small GGO pulmonary nodules more accurately and robustly, which is helpful for the accurate evaluation of medical imaging.

A novel algorithm for refining cerebral vascular measurements in infants and adults

BACKGROUND

Comprehensive quantification of intracranial vascular characteristics by vascular tracing provides an objective clinical assessment of vascular structure. However, weak signal or low contrast in small distal arteries, artifacts due to volitional motion, and vascular pulsation are challenges for accurate vessel tracing from 3D time-of-flight (3D-TOF) magnetic resonance angiography (MRA) images.

NEW METHOD

A vascular measurement refinement algorithm is developed and validated for robust quantification of intracranial vasculature from 3D-TOF MRA. After automated vascular tracing, centerline positions, lumen radii and centerline deviations are jointly optimized to restrict traces to within vascular regions in the straightened curved planar reformation (CPR) views. The algorithm is validated on simulated vascular images and on repeat 3D-TOF MRA acquired from infants and adults.

RESULTS

The refinement algorithm can reliably estimate vascular radius and correct deviated centerlines. For the simulated vascular image with noise level of 1 and deviation of centerline of 3, the mean radius difference is below 15.3 % for scan-rescan reliability. Vascular features from repeated clinical scans show significantly improved measurement agreement, with intra-class correlation coefficient (ICC) improvement from 0.55 to 0.7 for infants and from 0.59 to 0.92 for adults.

COMPARISON WITH EXISTING METHODS

The refinement algorithm is novel because it utilizes straightened CPR views that incorporate information from the entire artery. In addition, the optimization corrects centerline positions, lumen radii and centerline deviations simultaneously.

CONCLUSIONS

Intracranial vasculature quantification using a novel refinement algorithm for vascular tracing improves the reliability of vascular feature measurements in both infants and adults.

Feature-shared adaptive-boost deep learning for invasiveness classification of pulmonary subsolid nodules in CT images

PURPOSE

In clinical practice, invasiveness is an important reference indicator for differentiating the malignant degree of subsolid pulmonary nodules. These nodules can be classified as atypical adenomatous hyperplasia (AAH), adenocarcinoma in situ (AIS), minimally invasive adenocarcinoma (MIA), or invasive adenocarcinoma (IAC). The automatic determination of a nodule's invasiveness based on chest CT scans can guide treatment planning. However, it is challenging, owing to the insufficiency of training data and their interclass similarity and intraclass variation. To address these challenges, we propose a two-stage deep learning strategy for this task: prior-feature learning followed by adaptive-boost deep learning.

METHODS

The adaptive-boost deep learning is proposed to train a strong classifier for invasiveness classification of subsolid nodules in chest CT images, using multiple 3D convolutional neural network (CNN)-based weak classifiers. Because ensembles of multiple deep 3D CNN models have a huge number of parameters and require large computing resources along with more training and testing time, the prior-feature learning is proposed to reduce the computations by sharing the CNN layers between all weak classifiers. Using this strategy, all weak classifiers can be integrated into a single network.

RESULTS

Tenfold cross validation of binary classification was conducted on a total of 1357 nodules, including 765 noninvasive (AAH and AIS) and 592 invasive nodules (MIA and IAC). Ablation experimental results indicated that the proposed binary classifier achieved an accuracy of 73.4 \% ± 1.4 with an AUC of 81.3 \% ± 2.2 . These results are superior compared to those achieved by three experienced chest imaging specialists who achieved an accuracy of 69.1 \% , 69.3 \% , and 67.9 \% , respectively. About 200 additional nodules were also collected. These nodules covered 50 cases for each category (AAH, AIS, MIA, and IAC, respectively). Both binary and multiple classifications were performed on these data and the results demonstrated that the proposed method definitely achieves better performance than the performance achieved by nonensemble deep learning methods.

CONCLUSIONS

It can be concluded that the proposed adaptive-boost deep learning can significantly improve the performance of invasiveness classification of pulmonary subsolid nodules in CT images, while the prior-feature learning can significantly reduce the total size of deep models. The promising results on clinical data show that the trained models can be used as an effective lung cancer screening tool in hospitals. Moreover, the proposed strategy can be easily extended to other similar classification tasks in 3D medical images.

Knowledge-based Collaborative Deep Learning for Benign-Malignant Lung Nodule Classification on Chest CT

The accurate identification of malignant lung nodules on chest CT is critical for the early detection of lung cancer, which also offers patients the best chance of cure. Deep learning methods have recently been successfully introduced to computer vision problems, although substantial challenges remain in the detection of malignant nodules due to the lack of large training data sets. In this paper, we propose a multi-view knowledge-based collaborative (MV-KBC) deep model to separate malignant from benign nodules using limited chest CT data. Our model learns 3-D lung nodule characteristics by decomposing a 3-D nodule into nine fixed views. For each view, we construct a knowledge-based collaborative (KBC) submodel, where three types of image patches are designed to fine-tune three pre-trained ResNet-50 networks that characterize the nodules' overall appearance, voxel, and shape heterogeneity, respectively. We jointly use the nine KBC submodels to classify lung nodules with an adaptive weighting scheme learned during the error back propagation, which enables the MV-KBC model to be trained in an end-to-end manner. The penalty loss function is used for better reduction of the false negative rate with a minimal effect on the overall performance of the MV-KBC model. We tested our method on the benchmark LIDC-IDRI data set and compared it to the five state-of-the-art classification approaches. Our results show that the MV-KBC model achieved an accuracy of 91.60% for lung nodule classification with an AUC of 95.70%. These results are markedly superior to the state-of-the-art approaches.

Pulmonary nodule segmentation with CT sample synthesis using adversarial networks

PURPOSE

Segmentation of pulmonary nodules is critical for the analysis of nodules and lung cancer diagnosis. We present a novel framework of segmentation for various types of nodules using convolutional neural networks (CNNs).

METHODS

The proposed framework is composed of two major parts. The first part is to increase the variety of samples and build a more balanced dataset. A conditional generative adversarial network (cGAN) is employed to produce synthetic CT images. Semantic labels are generated to impart spatial contextual knowledge to the network. Nine attribute scoring labels are combined as well to preserve nodule features. To refine the realism of synthesized samples, reconstruction error loss is introduced into cGAN. The second part is to train a nodule segmentation network on the extended dataset. We build a three-dimensional (3D) CNN model that exploits heterogeneous maps including edge maps and local binary pattern maps. The incorporation of these maps informs the model of texture patterns and boundary information of nodules, which assists high-level feature learning for segmentation. Residual unit, which learns to reduce residual error, is adopted to accelerate training and improve accuracy.

RESULTS

Validation on LIDC-IDRI dataset demonstrates that the generated samples are realistic. The mean squared error and average cosine similarity between real and synthesized samples are 1.55 × 10 - 2 and 0.9534, respectively. The Dice coefficient, positive predicted value, sensitivity, and accuracy are, respectively, 0.8483, 0.8895, 0.8511, and 0.9904 for the segmentation results.

CONCLUSIONS

The proposed 3D CNN segmentation framework, based on the use of synthesized samples and multiple maps with residual learning, achieves more accurate nodule segmentation compared to existing state-of-the-art methods. The proposed CT image synthesis method can not only output samples close to real images but also allow for stochastic variation in image diversity.

Robust Pulmonary Nodule Segmentation in CT Image for Juxta-pleural and Juxta-vascular Case

Background:

Lung cancer is a greatest threat to people's health and life. CT image leads to unclear boundary segmentation. Segmentation of irregular nodules and complex structure, boundary information is not well considered and lung nodules have always been a hot topic.

Objective:

In this study, the pulmonary nodule segmentation is accomplished with the new graph cut algorithm. The problem of segmenting the juxta-pleural and juxta-vascular nodules was investigated which is based on graph cut algorithm.

Methods:

Firstly, the inflection points by the curvature was decided. Secondly, we used kernel graph cut to segment the nodules for the initial edge. Thirdly, the seeds points based on cast raying method is performed; lastly, a novel geodesic distance function is proposed to improve the graph cut algorithm and applied in lung nodules segmentation.

Results:

The new algorithm has been tested on total 258 nodules. Table 1 summarizes the morphologic features of all the nodules and given the results between the successful segmentation group and the poor/failed segmentation group. Figure 1 to Fig. (12) shows segmentation effect of Juxta-vascular nodules, Juxta-pleural nodules, and comparted with the other interactive segmentation methods.

Conclusion:

The experimental verification shows better results with our algorithm, the results will measure the volume numerical approach to nodule volume. The results of lung nodules segmentation in this study are as good as the results obtained by the other methods.

Lung Lesion Detection in CT Scan Images Using the Fuzzy Local Information Cluster Means (FLICM) Automatic Segmentation Algorithm and Back Propagation Network Classification

Lung cancer is a frequently lethal disease often causing death of human beings at an early age because of uncontrolled cell growth in the lung tissues. The diagnostic methods available are less than effective for detection of cancer. Therefore an automatic lesion segmentation method with computed tomography (CT) scans has been developed. However it is very difficult to perform automatic identification and segmentation of lung tumours with good accuracy because of the existence of variation in lesions. This paper describes the application of a robust lesion detection and segmentation technique to segment every individual cell from pathological images to extract the essential features. The proposed technique based on the FLICM (Fuzzy Local Information Cluster Means) algorithm used for segmentation, with reduced false positives in detecting lung cancers. The back propagation network used to classify cancer cells is based on computer aided diagnosis (CAD).

Central focused convolutional neural networks: Developing a data-driven model for lung nodule segmentation

Accurate lung nodule segmentation from computed tomography (CT) images is of great importance for image-driven lung cancer analysis. However, the heterogeneity of lung nodules and the presence of similar visual characteristics between nodules and their surroundings make it difficult for robust nodule segmentation. In this study, we propose a data-driven model, termed the Central Focused Convolutional Neural Networks (CF-CNN), to segment lung nodules from heterogeneous CT images. Our approach combines two key insights: 1) the proposed model captures a diverse set of nodule-sensitive features from both 3-D and 2-D CT images simultaneously; 2) when classifying an image voxel, the effects of its neighbor voxels can vary according to their spatial locations. We describe this phenomenon by proposing a novel central pooling layer retaining much information on voxel patch center, followed by a multi-scale patch learning strategy. Moreover, we design a weighted sampling to facilitate the model training, where training samples are selected according to their degree of segmentation difficulty. The proposed method has been extensively evaluated on the public LIDC dataset including 893 nodules and an independent dataset with 74 nodules from Guangdong General Hospital (GDGH). We showed that CF-CNN achieved superior segmentation performance with average dice scores of 82.15% and 80.02% for the two datasets respectively. Moreover, we compared our results with the inter-radiologists consistency on LIDC dataset, showing a difference in average dice score of only 1.98%.

Ziehl-Neelsen sputum smear microscopy image database: a resource to facilitate automated bacilli detection for tuberculosis diagnosis

Ziehl-Neelsen stained microscopy is a crucial bacteriological test for tuberculosis detection, but its sensitivity is poor. According to the World Health Organization (WHO) recommendation, 300 viewfields should be analyzed to augment sensitivity, but only a few viewfields are examined due to patient load. Therefore, tuberculosis diagnosis through automated capture of the focused image (autofocusing), stitching of viewfields to form mosaics (autostitching), and automatic bacilli segmentation (grading) can significantly improve the sensitivity. However, the lack of unified datasets impedes the development of robust algorithms in these three domains. Therefore, the Ziehl-Neelsen sputum smear microscopy image database (ZNSM iDB) has been developed, and is freely available. This database contains seven categories of diverse datasets acquired from three different bright-field microscopes. Datasets related to autofocusing, autostitching, and manually segmenting bacilli can be used for developing algorithms, whereas the other four datasets are provided to streamline the sensitivity and specificity. All three categories of datasets were validated using different automated algorithms. As images available in this database have distinctive presentations with high noise and artifacts, this referral resource can also be used for the validation of robust detection algorithms. The ZNSM-iDB also assists for the development of methods in automated microscopy.

A Segmentation Framework of Pulmonary Nodules in Lung CT Images

Accurate segmentation of pulmonary nodules is a prerequisite for acceptable performance of computer-aided detection (CAD) system designed for diagnosis of lung cancer from lung CT images. Accurate segmentation helps to improve the quality of machine level features which could improve the performance of the CAD system. The well-circumscribed solid nodules can be segmented using thresholding, but segmentation becomes difficult for part-solid, non-solid, and solid nodules attached with pleura or vessels. We proposed a segmentation framework for all types of pulmonary nodules based on internal texture (solid/part-solid and non-solid) and external attachment (juxta-pleural and juxta-vascular). In the proposed framework, first pulmonary nodules are categorized into solid/part-solid and non-solid category by analyzing intensity distribution in the core of the nodule. Two separate segmentation methods are developed for solid/part-solid and non-solid nodules, respectively. After determining the category of nodule, the particular algorithm is set to remove attached pleural surface and vessels from the nodule body. The result of segmentation is evaluated in terms of four contour-based metrics and six region-based metrics for 891 pulmonary nodules from Lung Image Database Consortium and Image Database Resource Initiative (LIDC/IDRI) public database. The experimental result shows that the proposed segmentation framework is reliable for segmentation of various types of pulmonary nodules with improved accuracy compared to existing segmentation methods.

A novel approach to CAD system for the detection of lung nodules in CT images

Detection of pulmonary nodule plays a significant role in the diagnosis of lung cancer in early stage that improves the chances of survival of an individual. In this paper, a computer aided nodule detection method is proposed for the segmentation and detection of challenging nodules like juxtavascular and juxtapleural nodules. Lungs are segmented from computed tomography (CT) images using intensity thresholding; brief analysis of CT image histogram is done to select a suitable threshold value for better segmentation results. Simple morphological closing is used to include juxtapleural nodules in segmented lung regions. K-means clustering is applied for the initial detection and segmentation of potential nodules; shape specific morphological opening is implemented to refine segmentation outcomes. These segmented potential nodules are then divided into six groups on the basis of their thickness and percentage connectivity with lung walls. Grouping not only helped in improving system's efficiency but also reduced computational time, otherwise consumed in calculating and analyzing unnecessary features for all nodules. Different sets of 2D and 3D features are extracted from nodules in each group to eliminate false positives. Small size nodules are differentiated from false positives (FPs) on the basis of their salient features; sensitivity of the system for small nodules is 83.33%. SVM classifier is used for the classification of large nodules, for which the sensitivity of the proposed system is 93.8% applying 10-fold cross-validation. Receiver Operating Characteristic (ROC) curve is used for the analysis of CAD system. Overall sensitivity of the system is 91.65% with 3.19 FPs per case, and accuracy is 96.22%. The system took 3.8 seconds to analyze each image.

Novel and powerful 3D adaptive crisp active contour method applied in the segmentation of CT lung images

The World Health Organization estimates that 300 million people have asthma, 210 million people have Chronic Obstructive Pulmonary Disease (COPD), and, according to WHO, COPD will become the third major cause of death worldwide in 2030. Computational Vision systems are commonly used in pulmonology to address the task of image segmentation, which is essential for accurate medical diagnoses. Segmentation defines the regions of the lungs in CT images of the thorax that must be further analyzed by the system or by a specialist physician. This work proposes a novel and powerful technique named 3D Adaptive Crisp Active Contour Method (3D ACACM) for the segmentation of CT lung images. The method starts with a sphere within the lung to be segmented that is deformed by forces acting on it towards the lung borders. This process is performed iteratively in order to minimize an energy function associated with the 3D deformable model used. In the experimental assessment, the 3D ACACM is compared against three approaches commonly used in this field: the automatic 3D Region Growing, the level-set algorithm based on coherent propagation and the semi-automatic segmentation by an expert using the 3D OsiriX toolbox. When applied to 40 CT scans of the chest the 3D ACACM had an average F-measure of 99.22%, revealing its superiority and competency to segment lungs in CT images.

Segmentation of pulmonary nodules using adaptive local region energy with probability density function-based similarity distance and multi-features clustering

BACKGROUND

Pulmonary nodules in computerized tomography (CT) images are potential manifestations of lung cancer. Segmentation of potential nodule objects is the first necessary and crucial step in computer-aided detection system of pulmonary nodules. The segmentation of various types of nodules, especially for ground-glass opacity (GGO) nodules and juxta-vascular nodules, present various challenges. The nodule with GGO characteristic possesses typical intensity inhomogeneity and weak edges, which is difficult to define the boundary; the juxta-vascular nodule is connected to a vessel, and they have very similar intensities. Traditional segmentation methods may result in the problems of boundary leakage and a small volume over-segmentation. This paper deals with the above mentioned problems.

METHODS

A novel segmentation method for pulmonary nodules is proposed, which uses an adaptive local region energy model with probability density function (PDF)-based similarity distance and multi-features dynamic clustering refinement method. Our approach has several novel aspects: (1) in the proposed adaptive local region energy model, the local domain for local energy model is selected adaptively based on k-nearest-neighbour (KNN) estimate method, and measurable distances between probability density functions of multi-dimension features with high class separability are used to build the cost function. (2) A multi-features dynamic clustering method is used for the segmentation refinement of juxta-vascular nodules, which is based on the nodule segmentation using active contour model (ACM) with adaptive local region energy and vessel segmentation using flow direction feature (FDF)-based region growing method. (3) it handles various types of nodules under a united framework.

RESULTS

The proposed method has been validated on a clinical dataset of 113 chest CT scans that contain 157 nodules determined by a ground truth reading process, and evaluating the algorithm on the provided data leads to an average Tanimoto/Jaccard error of 0.17, 0.20 and 0.24 for GGO, juxta-vascular and GGO juxta-vascular nodules, respectively.

CONCLUSIONS

Experimental results show desirable performances of the proposed method. The proposed segmentation method outperforms the traditional methods.

Segmentation and Image Analysis of Abnormal Lungs at CT: Current Approaches, Challenges, and Future Trends

The computer-based process of identifying the boundaries of lung from surrounding thoracic tissue on computed tomographic (CT) images, which is called segmentation, is a vital first step in radiologic pulmonary image analysis. Many algorithms and software platforms provide image segmentation routines for quantification of lung abnormalities; however, nearly all of the current image segmentation approaches apply well only if the lungs exhibit minimal or no pathologic conditions. When moderate to high amounts of disease or abnormalities with a challenging shape or appearance exist in the lungs, computer-aided detection systems may be highly likely to fail to depict those abnormal regions because of inaccurate segmentation methods. In particular, abnormalities such as pleural effusions, consolidations, and masses often cause inaccurate lung segmentation, which greatly limits the use of image processing methods in clinical and research contexts. In this review, a critical summary of the current methods for lung segmentation on CT images is provided, with special emphasis on the accuracy and performance of the methods in cases with abnormalities and cases with exemplary pathologic findings. The currently available segmentation methods can be divided into five major classes: (a) thresholding-based, (b) region-based, (c) shape-based, (d) neighboring anatomy-guided, and (e) machine learning-based methods. The feasibility of each class and its shortcomings are explained and illustrated with the most common lung abnormalities observed on CT images. In an overview, practical applications and evolving technologies combining the presented approaches for the practicing radiologist are detailed.

Lung Lesion Extraction Using a Toboggan Based Growing Automatic Segmentation Approach

The accurate segmentation of lung lesions from computed tomography (CT) scans is important for lung cancer research and can offer valuable information for clinical diagnosis and treatment. However, it is challenging to achieve a fully automatic lesion detection and segmentation with acceptable accuracy due to the heterogeneity of lung lesions. Here, we propose a novel toboggan based growing automatic segmentation approach (TBGA) with a three-step framework, which are automatic initial seed point selection, multi-constraints 3D lesion extraction and the final lesion refinement. The new approach does not require any human interaction or training dataset for lesion detection, yet it can provide a high lesion detection sensitivity (96.35%) and a comparable segmentation accuracy with manual segmentation (P > 0.05), which was proved by a series assessments using the LIDC-IDRI dataset (850 lesions) and in-house clinical dataset (121 lesions). We also compared TBGA with commonly used level set and skeleton graph cut methods, respectively. The results indicated a significant improvement of segmentation accuracy . Furthermore, the average time consumption for one lesion segmentation was under 8 s using our new method. In conclusion, we believe that the novel TBGA can achieve robust, efficient and accurate lung lesion segmentation in CT images automatically.

Automated system for lung nodules classification based on wavelet feature descriptor and support vector machine

Background

Lung cancer is a leading cause of death worldwide; it refers to the uncontrolled growth of abnormal cells in the lung. A computed tomography (CT) scan of the thorax is the most sensitive method for detecting cancerous lung nodules. A lung nodule is a round lesion which can be either non-cancerous or cancerous. In the CT, the lung cancer is observed as round white shadow nodules. The possibility to obtain a manually accurate interpretation from CT scans demands a big effort by the radiologist and might be a fatiguing process. Therefore, the design of a computer-aided diagnosis (CADx) system would be helpful as a second opinion tool.

Methods

The stages of the proposed CADx are: a supervised extraction of the region of interest to eliminate the shape differences among CT images. The Daubechies db1, db2, and db4 wavelet transforms are computed with one and two levels of decomposition. After that, 19 features are computed from each wavelet sub-band. Then, the sub-band and attribute selection is performed. As a result, 11 features are selected and combined in pairs as inputs to the support vector machine (SVM), which is used to distinguish CT images containing cancerous nodules from those not containing nodules.

Results

The clinical data set used for experiments consists of 45 CT scans from ELCAP and LIDC. For the training stage 61 CT images were used (36 with cancerous lung nodules and 25 without lung nodules). The system performance was tested with 45 CT scans (23 CT scans with lung nodules and 22 without nodules), different from that used for training. The results obtained show that the methodology successfully classifies cancerous nodules with a diameter from 2 mm to 30 mm. The total preciseness obtained was 82%; the sensitivity was 90.90%, whereas the specificity was 73.91%.

Conclusions

The CADx system presented is competitive with other literature systems in terms of sensitivity. The system reduces the complexity of classification by not performing the typical segmentation stage of most CADx systems. Additionally, the novelty of the algorithm is the use of a wavelet feature descriptor.

Computerized segmentation of pulmonary nodules depicted in CT examinations using freehand sketches

PURPOSE

To aid a consistent segmentation of pulmonary nodules, the authors describe a novel computerized scheme that utilizes a freehand sketching technique and an improved break-and-repair strategy.

METHODS

This developed scheme consists of two primary parts. The first part is freehand sketch analysis, where the freehand sketching not only serves a natural way of specifying the location of a nodule, but also provides a mechanism for inferring adaptive information (e.g., the mass center, the density, and the size) in regard to the nodule. The second part is an improved break-and-repair strategy. The improvement avoids the time-consuming ray-triangle intersections using spherical bins and replaces the original global implicit surface reconstruction with a local implicit surface fitting and blending scheme. The performance of this scheme, including accuracy and consistence, was assessed using 50 CT examinations in the Lung Image Database Consortium (LIDC). For each of these examinations, a single nodule was selected under the aid of a publically available tool to assure these nodules were diverse in size, location, and density. Two radiologists were asked to use the developed tool to segment these nodules twice at different times (at least three months apart). A Hausdorff distance based method was used to assess the discrepancies (agreements) between the computerized results and the results by the four radiologists in the LIDC as well as the inter- and intrareader agreements in freehand sketching.

RESULTS

The maximum and mean discrepancies in boundary outlines between the computerized scheme and the radiologists were 2.73 ± 1.32 mm and 1.01 ± 0.47 mm, respectively. When the nodules were classified (binned) into different size ranges, the maximum errors ranged from 1.91 to 4.13 mm; but smaller nodules had larger percentage discrepancies in term of size. Under the aid of the developed scheme, the inter- and intrareader variability in averaged maximum discrepancy across all types of pulmonary nodules were consistently smaller than 0.15 ± 0.07 mm. The computational cost in time of segmenting a pulmonary nodule ranged from 0.4 to 2.3 s with an average of 1.1 s for a typical desktop computer.

CONCLUSIONS

The experiments showed that this scheme could achieve a reasonable performance in nodule segmentation and demonstrated the merits of incorporating freehand sketching into pulmonary nodule segmentation.

The normal mode analysis shape detection method for automated shape determination of lung nodules

Surface morphology and shape in general are important predictors for the behavior of solid-type lung nodules detected on CT. More broadly, shape analysis is useful in many areas of computer-aided diagnosis and essentially all scientific and engineering disciplines. Automated methods for shape detection have all previously, to the author's knowledge, relied on some sort of geometric measure. I introduce Normal Mode Analysis Shape Detection (NMA-SD), an approach that measures shape indirectly via the motion it would undergo if one imagined the shape to be a pseudomolecule. NMA-SD allows users to visualize internal movements in the imaging object and thereby develop an intuition for which motions are important, and which geometric features give rise to them. This can guide the identification of appropriate classification features to distinguish among classes of interest. I employ normal mode analysis (NMA) to animate pseudomolecules representing simulated lung nodules. Doing so, I am able to assign a testing set of nodules into the classes circular, elliptical, and irregular with roughly 97 % accuracy. This represents a proof-of-principle that one can obtain shape information by treating voxels as pseudoatoms in a pseudomolecule, and analyzing the pseudomolecule's predicted motion.

A novel approach for lung nodules segmentation in chest CT using level sets

A new variational level set approach is proposed for lung nodule segmentation in lung CT scans. A general lung nodule shape model is proposed using implicit spaces as a signed distance function. The shape model is fused with the image intensity statistical information in a variational segmentation framework. The nodule shape model is mapped to the image domain by a global transformation that includes inhomogeneous scales, rotation, and translation parameters. A matching criteria between the shape model and the image implicit representations is employed to handle the alignment process. Transformation parameters evolve through gradient descent optimization to handle the shape alignment process and hence mark the boundaries of the nodule “head.” The embedding process takes into consideration the image intensity as well as prior shape information. A nonparametric density estimation approach is employed to handle the statistical intensity representation of the nodule and background regions. The proposed technique does not depend on nodule type or location. Exhaustive experimental and validation results are demonstrated on 742 nodules obtained from four different CT lung databases, illustrating the robustness of the approach.

AN IMPROVED RANDOM WALK SEGMENTATION ON THE LUNG NODULES

In this paper, we proposed a semi-automatic technique with a marker indicating the target to locate and segment nodules. For the lung nodule detection, we develop a Gabor texture feature by FCM (Fuzzy C Means) segmentation. Given a marker indicating a rough location of the nodules, a decision process is followed by applying an ellipse fitting algorithm. From the ellipse mask, the foreground and background seeds for the random walk segmentation can be automatically obtained. Finally, the edge of the nodules is obtained by the random walk algorithm. The feasibility and effectiveness of the proposed method are evaluated with the various types of the nodules to identify the edges, so that it can be used to locate the nodule edge and its growth rate.

Multimodal sparse representation-based classification for lung needle biopsy images

Lung needle biopsy image classification is a critical task for computer-aided lung cancer diagnosis. In this study, a novel method, multimodal sparse representation-based classification (mSRC), is proposed for classifying lung needle biopsy images. In the data acquisition procedure of our method, the cell nuclei are automatically segmented from the images captured by needle biopsy specimens. Then, features of three modalities (shape, color, and texture) are extracted from the segmented cell nuclei. After this procedure, mSRC goes through a training phase and a testing phase. In the training phase, three discriminative subdictionaries corresponding to the shape, color, and texture information are jointly learned by a genetic algorithm guided multimodal dictionary learning approach. The dictionary learning aims to select the topmost discriminative samples and encourage large disagreement among different subdictionaries. In the testing phase, when a new image comes, a hierarchical fusion strategy is applied, which first predicts the labels of the cell nuclei by fusing three modalities, then predicts the label of the image by majority voting. Our method is evaluated on a real image set of 4372 cell nuclei regions segmented from 271 images. These cell nuclei regions can be divided into five classes: four cancerous classes (corresponding to four types of lung cancer) plus one normal class (no cancer). The results demonstrate that the multimodal information is important for lung needle biopsy image classification. Moreover, compared to several state-of-the-art methods (LapRLS, MCMI-AB, mcSVM, ESRC, KSRC), the proposed mSRC can achieve significant improvement (mean accuracy of 88.1%, precision of 85.2%, recall of 92.8%, etc.), especially for classifying different cancerous types.

Detection of pulmonary nodules in CT images based on fuzzy integrated active contour model and hybrid parametric mixture model

The segmentation and detection of various types of nodules in a Computer-aided detection (CAD) system present various challenges, especially when (1) the nodule is connected to a vessel and they have very similar intensities; (2) the nodule with ground-glass opacity (GGO) characteristic possesses typical weak edges and intensity inhomogeneity, and hence it is difficult to define the boundaries. Traditional segmentation methods may cause problems of boundary leakage and “weak” local minima. This paper deals with the above mentioned problems. An improved detection method which combines a fuzzy integrated active contour model (FIACM)-based segmentation method, a segmentation refinement method based on Parametric Mixture Model (PMM) of juxta-vascular nodules, and a knowledge-based C-SVM (Cost-sensitive Support Vector Machines) classifier, is proposed for detecting various types of pulmonary nodules in computerized tomography (CT) images. Our approach has several novel aspects: (1) In the proposed FIACM model, edge and local region information is incorporated. The fuzzy energy is used as the motivation power for the evolution of the active contour. (2) A hybrid PMM Model of juxta-vascular nodules combining appearance and geometric information is constructed for segmentation refinement of juxta-vascular nodules. Experimental results of detection for pulmonary nodules show desirable performances of the proposed method.