Automatic Lung Segmentation With Juxta-Pleural Nodule Identification Using Active Contour Model and Bayesian Approach

Fully automatic deep learning-based lung parenchyma segmentation and boundary correction in thoracic CT scans

PURPOSE

The proposed work aims to develop an algorithm to precisely segment the lung parenchyma in thoracic CT scans. To achieve this goal, the proposed technique utilized a combination of deep learning and traditional image processing algorithms. The initial step utilized a trained convolutional neural network (CNN) to generate preliminary lung masks, followed by the proposed post-processing algorithm for lung boundary correction.

METHODS

First, the proposed method trained an improved 2D U-Net CNN model with Inception-ResNet-v2 as its backbone. The model was trained on 32 CT scans from two different sources: one from the VESSEL12 grand challenge and the other from AIIMS Delhi. Further, the model's performance was evaluated on a test dataset of 16 CT scans with juxta-pleural nodules obtained from AIIMS Delhi and the LUNA16 challenge. The model's performance was assessed using evaluation metrics such as average volumetric dice coefficient (DSCavg), average IoU score (IoUavg), and average F1 score (F1avg). Finally, the proposed post-processing algorithm was implemented to eliminate false positives from the model's prediction and to include juxta-pleural nodules in the final lung masks.

RESULTS

The trained model reported a DSCavg of 0.9791 ± 0.008, IoUavg of 0.9624 ± 0.007, and F1avg of 0.9792 ± 0.004 on the test dataset. Applying the post-processing algorithm to the predicted lung masks obtained a DSCavg of 0.9713 ± 0.007, IoUavg of 0.9486 ± 0.007, and F1avg of 0.9701 ± 0.008. The post-processing algorithm successfully included juxta-pleural nodules in the final lung mask.

CONCLUSIONS

Using a CNN model, the proposed method for lung parenchyma segmentation produced precise segmentation results. Furthermore, the post-processing algorithm addressed false positives and negatives in the model's predictions. Overall, the proposed approach demonstrated promising results for lung parenchyma segmentation. The method has the potential to be valuable in the advancement of computer-aided diagnosis (CAD) systems for automatic nodule detection.

InstrumentNet: An integrated model for real-time segmentation of intracranial surgical instruments

In robot-assisted surgery, precise surgical instrument segmentation technology can provide accurate location and pose data for surgeons, helping them perform a series of surgical operations efficiently and safely. However, there are still some interfering factors, such as surgical instruments being covered by tissue, multiple surgical instruments interlacing with each other, and instrument shaking during surgery. To better address these issues, an effective surgical instrument segmentation network called InstrumentNet is proposed, which adopts YOLOv7 as the object detection framework to achieve a real-time detection solution. Specifically, a multiscale feature fusion network is constructed, which aims to avoid problems such as feature redundancy and feature loss and enhance the generalization ability. Furthermore, an adaptive feature-weighted fusion mechanism is introduced to regulate network learning and convergence. Finally, a semantic segmentation head is introduced to integrate the detection and segmentation functions, and a multitask learning loss function is specifically designed to optimize the surgical instrument segmentation performance. The proposed segmentation model is validated on a dataset of intracranial surgical instruments provided by seven experts from Beijing Tiantan Hospital and achieved an mAP score of 93.5 %, Dice score of 82.49 %, and MIoU score of 85.48 %, demonstrating its universality and superiority. The experimental results demonstrate that the proposed model achieves good segmentation performance on surgical instruments compared to other advanced models and can provide a reference for developing intelligent medical robots.

A survey and taxonomy of 2.5D approaches for lung segmentation and nodule detection in CT images

CAD systems for lung cancer diagnosis and detection can significantly offer unbiased, infatiguable diagnostics with minimal variance, decreasing the mortality rate and the five-year survival rate. Lung segmentation and lung nodule detection are critical steps in the lung cancer CAD system pipeline. Literature on lung segmentation and lung nodule detection mostly comprises techniques that process 3-D volumes or 2-D slices and surveys. However, surveys that highlight 2.5D techniques for lung segmentation and lung nodule detection still need to be included. This paper presents a background and discussion on 2.5D methods to fill this gap. Further, this paper also gives a taxonomy of 2.5D approaches and a detailed description of the 2.5D approaches. Based on the taxonomy, various 2.5D techniques for lung segmentation and lung nodule detection are clustered into these 2.5D approaches, which is followed by possible future work in this direction.

Factors influencing the outcome of volumetry tools for pulmonary nodule analysis: a systematic review and attempted meta-analysis

Health systems worldwide are implementing lung cancer screening programmes to identify early-stage lung cancer and maximise patient survival. Volumetry is recommended for follow-up of pulmonary nodules and outperforms other measurement methods. However, volumetry is known to be influenced by multiple factors. The objectives of this systematic review (PROSPERO CRD42022370233) are to summarise the current knowledge regarding factors that influence volumetry tools used in the analysis of pulmonary nodules, assess for significant clinical impact, identify gaps in current knowledge and suggest future research. Five databases (Medline, Scopus, Journals@Ovid, Embase and Emcare) were searched on the 21st of September, 2022, and 137 original research studies were included, explicitly testing the potential impact of influencing factors on the outcome of volumetry tools. The summary of these studies is tabulated, and a narrative review is provided. A subset of studies (n = 16) reporting clinical significance were selected, and their results were combined, if appropriate, using meta-analysis. Factors with clinical significance include the segmentation algorithm, quality of the segmentation, slice thickness, the level of inspiration for solid nodules, and the reconstruction algorithm and kernel in subsolid nodules. Although there is a large body of evidence in this field, it is unclear how to apply the results from these studies in clinical practice as most studies do not test for clinical relevance. The meta-analysis did not improve our understanding due to the small number and heterogeneity of studies testing for clinical significance. CRITICAL RELEVANCE STATEMENT: Many studies have investigated the influencing factors of pulmonary nodule volumetry, but only 11% of these questioned their clinical relevance in their management. The heterogeneity among these studies presents a challenge in consolidating results and clinical application of the evidence. KEY POINTS: • Factors influencing the volumetry of pulmonary nodules have been extensively investigated. • Just 11% of studies test clinical significance (wrongly diagnosing growth). • Nodule size interacts with most other influencing factors (especially for smaller nodules). • Heterogeneity among studies makes comparison and consolidation of results challenging. • Future research should focus on clinical applicability, screening, and updated technology.

[Corona virus disease 2019 lesion segmentation network based on an adaptive joint loss function]

Corona virus disease 2019 (COVID-19) is an acute respiratory infectious disease with strong contagiousness, strong variability, and long incubation period. The probability of misdiagnosis and missed diagnosis can be significantly decreased with the use of automatic segmentation of COVID-19 lesions based on computed tomography images, which helps doctors in rapid diagnosis and precise treatment. This paper introduced the level set generalized Dice loss function (LGDL) in conjunction with the level set segmentation method based on COVID-19 lesion segmentation network and proposed a dual-path COVID-19 lesion segmentation network (Dual-SAUNet++) to address the pain points such as the complex symptoms of COVID-19 and the blurred boundaries that are challenging to segment. LGDL is an adaptive weight joint loss obtained by combining the generalized Dice loss of the mask path and the mean square error of the level set path. On the test set, the model achieved Dice similarity coefficient of (87.81 ± 10.86)%, intersection over union of (79.20 ± 14.58)%, sensitivity of (94.18 ± 13.56)%, specificity of (99.83 ± 0.43)% and Hausdorff distance of 18.29 ± 31.48 mm. Studies indicated that Dual-SAUNet++ has a great anti-noise capability and it can segment multi-scale lesions while simultaneously focusing on their area and border information. The method proposed in this paper assists doctors in judging the severity of COVID-19 infection by accurately segmenting the lesion, and provides a reliable basis for subsequent clinical treatment.

A semantic segmentation of the lung nodules using a shape attention-guided contextual residual network

Objective. The early diagnosis of lung cancer depends on the precise segmentation of lung nodules. However, the variable size, uneven intensity, and blurred borders of lung nodules bring many challenges to the precise segmentation of lung nodules.Approach.We propose a shape attention-guided contextual residual network to address the difficult problem in lung nodule segmentation. Firstly, we establish a selective kernel convolution residual module to replace the original encoder and decoder. This module incorporates selective kernel convolution, which automatically selects convolutions with different receptive fields to acquire multi-scale spatial features. Secondly, we construct a multi-scale contextual attention module to assist the network in extracting multi-scale contextual features of local feature maps. Finally, we develop a shape attention-guided module to assist the network to restore details such as the boundary and shape of lung nodules during the upsampling phase.Main results.The proposed network is comprehensively analyzed using the publicly available LUNA16 data set, and an ablation experiment is designed to validate the effectiveness of each individual component. Ultimately, the dice similarity coefficient of the experimental results reaches 87.39% on the test set. Compared to other state-of-the-art segmentation methods, the proposed network achieves superior performance in lung nodule segmentation.Significance.Our proposed network improves the accuracy of lung nodule segmentation, which provides an important support for physicians to subsequently develop treatment plans.

SIFT-GVF-based lung edge correction method for correcting the lung region in CT images

Juxtapleural nodules were excluded from the segmented lung region in the Hounsfield unit threshold-based segmentation method. To re-include those regions in the lung region, a new approach was presented using scale-invariant feature transform and gradient vector flow models in this study. First, the scale-invariant feature transform method was utilized to detect all scale-invariant points in the binary lung region. The boundary points in the neighborhood of a scale-invariant point were collected to form the supportive boundary lines. Then, we utilized a Fourier descriptor to obtain a character representation of each supportive boundary line. Spectrum energy recognizes supportive boundaries that must be corrected. Third, the gradient vector flow-snake method was presented to correct the recognized supportive borders with a smooth profile curve, giving an ideal correction edge in those regions. Finally, the performance of the proposed method was evaluated through experiments on multiple authentic computed tomography images. The perfect results and robustness proved that the proposed method could correct the juxtapleural region precisely.

A Systematic Review of Automated Segmentation Methods and Public Datasets for the Lung and its Lobes and Findings on Computed Tomography Images

OBJECTIVES

Automated computational segmentation of the lung and its lobes and findings in X-Ray based computed tomography (CT) images is a challenging problem with important applications, including medical research, surgical planning, and diagnostic decision support. With the increase in large imaging cohorts and the need for fast and robust evaluation of normal and abnormal lungs and their lobes, several authors have proposed automated methods for lung assessment on CT images. In this paper we intend to provide a comprehensive summarization of these methods.

METHODS

We used a systematic approach to perform an extensive review of automated lung segmentation methods. We chose Scopus, PubMed, and Scopus to conduct our review and included methods that perform segmentation of the lung parenchyma, lobes or internal disease related findings. The review was not limited by date, but rather by only including methods providing quantitative evaluation.

RESULTS

We organized and classified all 234 included articles into various categories according to methodological similarities among them. We provide summarizations of quantitative evaluations, public datasets, evaluation metrics, and overall statistics indicating recent research directions of the field.

CONCLUSIONS

We noted the rise of data-driven models in the last decade, especially due to the deep learning trend, increasing the demand for high-quality data annotation. This has instigated an increase of semi-supervised and uncertainty guided works that try to be less dependent on human annotation. In addition, the question of how to evaluate the robustness of data-driven methods remains open, given that evaluations derived from specific datasets are not general.

Present and future of extraoral maxillofacial prosthodontics: Cancer rehabilitation

Historically, facial prosthetics have successfully rehabilitated individuals with acquired or congenital anatomical deficiencies of the face. This history includes extensive efforts in research and development to explore best practices in materials, methods, and artisanal techniques. Presently, extraoral maxillofacial rehabilitation is managed by a multiprofessional team that has evolved with a broadened scope of knowledge, skills, and responsibility. This includes the mandatory integration of different professional specialists to cover the bio-psycho-social needs of the patient, systemic health and pathology surveillance, and advanced restorative techniques, which may include 3D technologies. In addition, recent digital workflows allow us to optimize this multidisciplinary integration and reduce the active time of both patients and clinicians, as well as improve the cost-efficiency of the care system, promoting its access to both patients and health systems. This paper discusses factors that affect extraoral maxillofacial rehabilitation's present and future opportunities from teamwork consolidation, techniques utilizing technology, and health systems opportunities.

CardioNet: Automatic Semantic Segmentation to Calculate the Cardiothoracic Ratio for Cardiomegaly and Other Chest Diseases

Semantic segmentation for diagnosing chest-related diseases like cardiomegaly, emphysema, pleural effusions, and pneumothorax is a critical yet understudied tool for identifying the chest anatomy. A dangerous disease among these is cardiomegaly, in which sudden death is a high risk. An expert medical practitioner can diagnose cardiomegaly early using a chest radiograph (CXR). Cardiomegaly is a heart enlargement disease that can be analyzed by calculating the transverse cardiac diameter (TCD) and the cardiothoracic ratio (CTR). However, the manual estimation of CTR and other chest-related diseases requires much time from medical experts. Based on their anatomical semantics, artificial intelligence estimates cardiomegaly and related diseases by segmenting CXRs. Unfortunately, due to poor-quality images and variations in intensity, the automatic segmentation of the lungs and heart with CXRs is challenging. Deep learning-based methods are being used to identify the chest anatomy segmentation, but most of them only consider the lung segmentation, requiring a great deal of training. This work is based on a multiclass concatenation-based automatic semantic segmentation network, CardioNet, that was explicitly designed to perform fine segmentation using fewer parameters than a conventional deep learning scheme. Furthermore, the semantic segmentation of other chest-related diseases is diagnosed using CardioNet. CardioNet is evaluated using the JSRT dataset (Japanese Society of Radiological Technology). The JSRT dataset is publicly available and contains multiclass segmentation of the heart, lungs, and clavicle bones. In addition, our study examined lung segmentation using another publicly available dataset, Montgomery County (MC). The experimental results of the proposed CardioNet model achieved acceptable accuracy and competitive results across all datasets.

How AI Can Help in the Diagnostic Dilemma of Pulmonary Nodules

Simple Summary

Pulmonary nodules are considered a sign of bronchogenic carcinoma, detecting them early will reduce their progression and can save lives. Lung cancer is the second most common type of cancer in both men and women. This manuscript discusses the current applications of artificial intelligence (AI) in lung segmentation as well as pulmonary nodule segmentation and classification using computed tomography (CT) scans, published in the last two decades, in addition to the limitations and future prospects in the field of AI.

Abstract

Pulmonary nodules are the precursors of bronchogenic carcinoma, its early detection facilitates early treatment which save a lot of lives. Unfortunately, pulmonary nodule detection and classification are liable to subjective variations with high rate of missing small cancerous lesions which opens the way for implementation of artificial intelligence (AI) and computer aided diagnosis (CAD) systems. The field of deep learning and neural networks is expanding every day with new models designed to overcome diagnostic problems and provide more applicable and simply used models. We aim in this review to briefly discuss the current applications of AI in lung segmentation, pulmonary nodule detection and classification.

Computer-aided detection of pulmonary nodules based on convolutional neural networks: a review

Computer-aided detection (CADe) technology has been proven to increase the detection rate of pulmonary nodules that has important clinical significance for the early diagnosis of lung cancer. In this study, we systematically review the latest techniques in pulmonary nodule CADe based on deep learning models with convolutional neural networks in computed tomography images. First, the brief descriptions and popular architecture of convolutional neural networks are introduced. Second, several common public databases and evaluation metrics are briefly described. Third, state-of-the-art approaches with excellent performances are selected. Subsequently, we combine the clinical diagnostic process and the traditional four steps of pulmonary nodule CADe into two stages, namely, data preprocessing and image analysis. Further, the major optimizations of deep learning models and algorithms are highlighted according to the progressive evaluation effect of each method, and some clinical evidence is added. Finally, various methods are summarized and compared. The innovative or valuable contributions of each method are expected to guide future research directions. The analyzed results show that deep learning-based methods significantly transformed the detection of pulmonary nodules, and the design of these methods can be inspired by clinical imaging diagnostic procedures. Moreover, focusing on the image analysis stage will result in improved returns. In particular, optimal results can be achieved by optimizing the steps of candidate nodule generation and false positive reduction. End-to-end methods, with greater operating speeds and lower computational consumptions, are superior to other methods in CADe of pulmonary nodules.

Optimized Deformable Model-based Segmentation and Deep Learning for Lung Cancer Classification

Lung cancer is one of the life taking disease and causes more deaths worldwide. Early detection and treatment is necessary to save life. It is very difficult for doctors to interpret and identify diseases using imaging modalities alone. Therefore computer aided diagnosis can assist doctors for the early detection of cancer very accurately. In the proposed work, optimized deformable models and deep learning techniques are applied for the detection and classification of lung cancer. This method involves pre-processing, lung lobe segmentation, lung cancer segmentation, Data augmentation and lung cancer classification. The median filtering is considered for pre-processing and the Bayesian fuzzy clustering is applied for segmenting the lung lobes. The lung cancer segmentation is carried out using Water Cycle Sea Lion Optimization (WSLnO) based deformable model. The data augmentation process is used to augment the size of segmented region in order to perform better classification. The lung cancer classification is done effectively using Shepard Convolutional Neural Network (ShCNN), which is trained by WSLnO algorithm. The proposed WSLnO algorithm is designed by incorporating Water cycle algorithm (WCA) and Sea Lion Optimization (SLnO) algorithm. The performance of the proposed technique is analyzed with various performance metrics and attained the better results in terms of accuracy, sensitivity, specificity and average segmentation accuracy of 0.9303, 0.9123, 0.9133 and 0.9091 respectively. J. Med. Invest. 69 : 244-255, August, 2022.

Artificial Intelligence Systems for Diagnosis and Clinical Classification of COVID-19

Objectives: COVID-19 is highly infectious and has been widely spread worldwide, with more than 159 million confirmed cases and more than 3 million deaths as of May 11, 2021. It has become a serious public health event threatening people's lives and safety. Due to the rapid transmission and long incubation period, shortage of medical resources would easily occur in the short term of discovering disease cases. Therefore, we aimed to construct an artificial intelligent framework to rapidly distinguish patients with COVID-19 from common pneumonia and non-pneumonia populations based on computed tomography (CT) images. Furthermore, we explored artificial intelligence (AI) algorithms to integrate CT features and laboratory findings on admission to predict the clinical classification of COVID-19. This will ease the burden of doctors in this emergency period and aid them to perform timely and appropriate treatment on patients. Methods: We collected all CT images and clinical data of novel coronavirus pneumonia cases in Inner Mongolia, including domestic cases and those imported from abroad; then, three models based on transfer learning to distinguish COVID-19 from other pneumonia and non-pneumonia population were developed. In addition, CT features and laboratory findings on admission were combined to predict clinical types of COVID-19 using AI algorithms. Lastly, Spearman's correlation test was applied to study correlations of CT characteristics and laboratory findings. Results: Among three models to distinguish COVID-19 based on CT, vgg19 showed excellent diagnostic performance, with area under the curve (AUC) of the receiver operating characteristic (ROC) curve at 95%. Together with laboratory findings, we were able to predict clinical types of COVID-19 with AUC of the ROC curve at 90%. Furthermore, biochemical markers, such as C-reactive protein (CRP), LYM, and lactic dehydrogenase (LDH) were identified and correlated with CT features. Conclusion: We developed an AI model to identify patients who were positive for COVID-19 according to the results of the first CT examination after admission and predict the progression combined with laboratory findings. In addition, we obtained important clinical characteristics that correlated with the CT image features. Together, our AI system could rapidly diagnose COVID-19 and predict clinical types to assist clinicians perform appropriate clinical management.

[Research progress in lung parenchyma segmentation based on computed tomography]

Lung diseases such as lung cancer and COVID-19 seriously endanger human health and life safety, so early screening and diagnosis are particularly important. computed tomography (CT) technology is one of the important ways to screen lung diseases, among which lung parenchyma segmentation based on CT images is the key step in screening lung diseases, and high-quality lung parenchyma segmentation can effectively improve the level of early diagnosis and treatment of lung diseases. Automatic, fast and accurate segmentation of lung parenchyma based on CT images can effectively compensate for the shortcomings of low efficiency and strong subjectivity of manual segmentation, and has become one of the research hotspots in this field. In this paper, the research progress in lung parenchyma segmentation is reviewed based on the related literatures published at domestic and abroad in recent years. The traditional machine learning methods and deep learning methods are compared and analyzed, and the research progress of improving the network structure of deep learning model is emphatically introduced. Some unsolved problems in lung parenchyma segmentation were discussed, and the development prospect was prospected, providing reference for researchers in related fields.

An adaptive morphology based segmentation technique for lung nodule detection in thoracic CT image

Lung cancer is one of the most life-threatening cancers mostly indicated by the presence of nodules in the lung. Doctors and radiological experts use High-Resolution Computed Tomography (HRCT) images for nodule detection and further decision making from visual inspection. Manual detection of lung nodules is a time-consuming process. Therefore, Computer-aided detection (CADe) systems have been developed for accurate nodule detection and segmentation. CADe-based systems assist radiologists to detect lung nodules with greater confidence and a lesser amount of time and have a significant impact on the accurate, uniform, and early-stage diagnosis of lung cancer. In this research work, an adaptive morphology-based segmentation technique (AMST) has been introduced by designing an adaptive morphological filter for improved segmentation of the lung nodule region. The adaptive morphological filter detects candidate nodule regions by employing adaptive structuring element (ASE) and at the same time improves nodule detection accuracy by reducing false positives (FPs) from the Computed Tomography (CT) slices. The detected nodule candidate regions are then processed for feature extraction. In this study, morphological, texture and intensity-based features have been used with support vector machine (SVM) classifier for lung nodule detection. The performance of the proposed framework has been evaluated by incorporating a 10-fold cross-validation technique on Lung Image Database Consortium-Image Database Resource Initiative (LIDC/IDRI) dataset and on a private dataset, collected from a consultant radiologist. It has been observed that the proposed automated computer-aided detection system has achieved overall classification performance indices with 94.88% sensitivity, 93.45% specificity and 94.27% detection accuracy with 1.8 FPs/scan on LIDC/IDRI dataset and 91.43% sensitivity, 90.45% specificity, 92.83% accuracy with 3.2 FPs/scan on a private dataset. The results show that the proposed CADe system presented in this paper outperforms the other state-of-the-art methods for automatic nodule detection from the HRCT image.

COVID-19 Pneumonia Diagnosis Using a Simple 2D Deep Learning Framework With a Single Chest CT Image: Model Development and Validation

BACKGROUND

Coronavirus disease (COVID-19) has spread explosively worldwide since the beginning of 2020. According to a multinational consensus statement from the Fleischner Society, computed tomography (CT) is a relevant screening tool due to its higher sensitivity for detecting early pneumonic changes. However, physicians are extremely occupied fighting COVID-19 in this era of worldwide crisis. Thus, it is crucial to accelerate the development of an artificial intelligence (AI) diagnostic tool to support physicians.

OBJECTIVE

We aimed to rapidly develop an AI technique to diagnose COVID-19 pneumonia in CT images and differentiate it from non-COVID-19 pneumonia and nonpneumonia diseases.

METHODS

A simple 2D deep learning framework, named the fast-track COVID-19 classification network (FCONet), was developed to diagnose COVID-19 pneumonia based on a single chest CT image. FCONet was developed by transfer learning using one of four state-of-the-art pretrained deep learning models (VGG16, ResNet-50, Inception-v3, or Xception) as a backbone. For training and testing of FCONet, we collected 3993 chest CT images of patients with COVID-19 pneumonia, other pneumonia, and nonpneumonia diseases from Wonkwang University Hospital, Chonnam National University Hospital, and the Italian Society of Medical and Interventional Radiology public database. These CT images were split into a training set and a testing set at a ratio of 8:2. For the testing data set, the diagnostic performance of the four pretrained FCONet models to diagnose COVID-19 pneumonia was compared. In addition, we tested the FCONet models on an external testing data set extracted from embedded low-quality chest CT images of COVID-19 pneumonia in recently published papers.

RESULTS

Among the four pretrained models of FCONet, ResNet-50 showed excellent diagnostic performance (sensitivity 99.58%, specificity 100.00%, and accuracy 99.87%) and outperformed the other three pretrained models in the testing data set. In the additional external testing data set using low-quality CT images, the detection accuracy of the ResNet-50 model was the highest (96.97%), followed by Xception, Inception-v3, and VGG16 (90.71%, 89.38%, and 87.12%, respectively).

CONCLUSIONS

FCONet, a simple 2D deep learning framework based on a single chest CT image, provides excellent diagnostic performance in detecting COVID-19 pneumonia. Based on our testing data set, the FCONet model based on ResNet-50 appears to be the best model, as it outperformed other FCONet models based on VGG16, Xception, and Inception-v3.

Segmentation of pulmonary nodules in CT images based on 3D-UNET combined with three-dimensional conditional random field optimization

PURPOSE

Pulmonary nodules are a potential manifestation of lung cancer. In computer-aided diagnosis (CAD) of lung cancer, it is of great significance to extract the complete boundary of the pulmonary nodules in the computed tomography (CT) scans accurately. It can provide doctors with important information such as tumor size and density, which assist doctors in subsequent diagnosis and treatment. In addition to this, in the molecular subtype and radiomics of lung cancer, segmentation of lung nodules also plays a pivotal role. Existing methods are difficult to use only one model to simultaneously treat the boundaries of multiple types of lung nodules in CT images.

METHOD

In order to solve the problem, this paper proposed a three-dimensional (3D)-UNET network model optimized by a 3D conditional random field (3D-CRF) to segment pulmonary nodules. On the basis of 3D-UNET, the 3D-CRF is used to optimize the sample output of the training set, so as to update the network weights in training process, reduce the model training time, and reduce the loss rate of the model. We selected 936 sets of pulmonary nodule data for the lung image database consortium and image database resource initiative (LIDC-IDRI)¹ database to train and test the model. What's more, we used clinical data from partner hospitals for additional validation.

RESULTS AND CONCLUSIONS

The results show that our method is accurate and effective. Particularly, it shows more significance for the optimization of the segmentation of adhesive pulmonary nodules (the juxta-pleural and juxta-vascular nodules) and ground glass pulmonary nodules (GGNs).

Artificial Intelligence-Based Diagnosis of Cardiac and Related Diseases

Automatic chest anatomy segmentation plays a key role in computer-aided disease diagnosis, such as for cardiomegaly, pleural effusion, emphysema, and pneumothorax. Among these diseases, cardiomegaly is considered a perilous disease, involving a high risk of sudden cardiac death. It can be diagnosed early by an expert medical practitioner using a chest X-Ray (CXR) analysis. The cardiothoracic ratio (CTR) and transverse cardiac diameter (TCD) are the clinical criteria used to estimate the heart size for diagnosing cardiomegaly. Manual estimation of CTR and other diseases is a time-consuming process and requires significant work by the medical expert. Cardiomegaly and related diseases can be automatically estimated by accurate anatomical semantic segmentation of CXRs using artificial intelligence. Automatic segmentation of the lungs and heart from the CXRs is considered an intensive task owing to inferior quality images and intensity variations using nonideal imaging conditions. Although there are a few deep learning-based techniques for chest anatomy segmentation, most of them only consider single class lung segmentation with deep complex architectures that require a lot of trainable parameters. To address these issues, this study presents two multiclass residual mesh-based CXR segmentation networks, X-RayNet-1 and X-RayNet-2, which are specifically designed to provide fine segmentation performance with a few trainable parameters compared to conventional deep learning schemes. The proposed methods utilize semantic segmentation to support the diagnostic procedure of related diseases. To evaluate X-RayNet-1 and X-RayNet-2, experiments were performed with a publicly available Japanese Society of Radiological Technology (JSRT) dataset for multiclass segmentation of the lungs, heart, and clavicle bones; two other publicly available datasets, Montgomery County (MC) and Shenzhen X-Ray sets (SC), were evaluated for lung segmentation. The experimental results showed that X-RayNet-1 achieved fine performance for all datasets and X-RayNet-2 achieved competitive performance with a 75% parameter reduction.

Cloud-Based Automated Clinical Decision Support System for Detection and Diagnosis of Lung Cancer in Chest CT

Lung cancer is a major cause for cancer-related deaths. The detection of pulmonary cancer in the early stages can highly increase survival rate. Manual delineation of lung nodules by radiologists is a tedious task. We developed a novel computer-aided decision support system for lung nodule detection based on a 3D Deep Convolutional Neural Network (3DDCNN) for assisting the radiologists. Our decision support system provides a second opinion to the radiologists in lung cancer diagnostic decision making. In order to leverage 3-dimensional information from Computed Tomography (CT) scans, we applied median intensity projection and multi-Region Proposal Network (mRPN) for automatic selection of potential region-of-interests. Our Computer Aided Diagnosis (CAD) system has been trained and validated using LUNA16, ANODE09, and LIDC-IDR datasets; the experiments demonstrate the superior performance of our system, attaining sensitivity, specificity, AUROC, accuracy, of 98.4%, 92%, 96% and 98.51% with 2.1 FPs per scan. We integrated cloud computing, trained and validated our Cloud-Based 3DDCNN on the datasets provided by Shanghai Sixth People's Hospital, as well as LUNA16, ANODE09, and LIDC-IDR. Our system outperformed the state-of-the-art systems and obtained an impressive 98.7% sensitivity at 1.97 FPs per scan. This shows the potentials of deep learning, in combination with cloud computing, for accurate and efficient lung nodule detection via CT imaging, which could help doctors and radiologists in treating lung cancer patients.

Lung segmentation method with dilated convolution based on VGG-16 network

Lung cancer has become one of the life-threatening killers. Lung disease need to be assisted by CT images taken doctor's diagnosis, and the segmented CT image of the lung parenchyma is the first step to help doctor diagnosis. For the problem of accurately segmenting the lung parenchyma, this paper proposes a segmentation method based on the combination of VGG-16 and dilated convolution. First of all, we use the first three parts of VGG-16 network structure to convolution and pooling the input image. Secondly, using multiple sets of dilated convolutions make the network has a large enough receptive field. Finally, the multi-scale convolution features are fused, and each pixel is predicted using MLP to segment the parenchymal region. Experimental results were produced over state of the art on 137 images which key metrics Dice similarity coefficient (DSC) is 0.9867. Experimental results show that this method can effectively segment the lung parenchymal area, and compared to other conventional methods better.