Segmentation of lung parenchyma in CT images using CNN trained with the clustering algorithm generated dataset

Artificial intelligence in COPD CT images: identification, staging, and quantitation

Chronic obstructive pulmonary disease (COPD) stands as a significant global health challenge, with its intricate pathophysiological manifestations often demanding advanced diagnostic strategies. The recent applications of artificial intelligence (AI) within the realm of medical imaging, especially in computed tomography, present a promising avenue for transformative changes in COPD diagnosis and management. This review delves deep into the capabilities and advancements of AI, particularly focusing on machine learning and deep learning, and their applications in COPD identification, staging, and imaging phenotypes. Emphasis is laid on the AI-powered insights into emphysema, airway dynamics, and vascular structures. The challenges linked with data intricacies and the integration of AI in the clinical landscape are discussed. Lastly, the review casts a forward-looking perspective, highlighting emerging innovations in AI for COPD imaging and the potential of interdisciplinary collaborations, hinting at a future where AI doesn't just support but pioneers breakthroughs in COPD care. Through this review, we aim to provide a comprehensive understanding of the current state and future potential of AI in shaping the landscape of COPD diagnosis and management.

Study on lung CT image segmentation algorithm based on threshold-gradient combination and improved convex hull method

Lung images often have the characteristics of strong noise, uneven grayscale distribution, and complex pathological structures, which makes lung image segmentation a challenging task. To solve this problems, this paper proposes an initial lung mask extraction algorithm that combines threshold and gradient. The gradient used in the algorithm is obtained by the time series feature extraction method based on differential memory (TFDM), which is obtained by the grayscale threshold and image grayscale features. At the same time, we also proposed a lung contour repair algorithm based on the improved convex hull method to solve the contour loss caused by solid nodules and other lesions. Experimental results show that on the COVID-19 CT segmentation dataset, the advanced lung segmentation algorithm proposed in this article achieves better segmentation results and greatly improves the consistency and accuracy of lung segmentation. Our method can obtain more lung information, resulting in ideal segmentation effects with improved accuracy and robustness.

Segmenting and classifying lung diseases with M-Segnet and Hybrid Squeezenet-CNN architecture on CT images

Diagnosing lung diseases accurately and promptly is essential for effectively managing this significant public health challenge on a global scale. This paper introduces a new framework called Modified Segnet-based Lung Disease Segmentation and Severity Classification (MSLDSSC). The MSLDSSC model comprises four phases: "preprocessing, segmentation, feature extraction, and classification." Initially, the input image undergoes preprocessing using an improved Wiener filter technique. This technique estimates the power spectral density of the noisy and original images and computes the SNR assisted by PSNR to evaluate image quality. Next, the preprocessed image undergoes Segmentation to identify and separate the RoI from the background objects in the lung image. We employ a Modified Segnet mechanism that utilizes a proposed hard tanh-Softplus activation function for effective Segmentation. Following Segmentation, features such as MLDN, entropy with MRELBP, shape features, and deep features are extracted. Following the feature extraction phase, the retrieved feature set is input into a hybrid severity classification model. This hybrid model comprises two classifiers: SDPA-Squeezenet and DCNN. These classifiers train on the retrieved feature set and effectively classify the severity level of lung diseases.

The global research of artificial intelligence in lung cancer: a 20-year bibliometric analysis

Background

Lung cancer (LC) is the second-highest incidence and the first-highest mortality cancer worldwide. Early screening and precise treatment of LC have been the research hotspots in this field. Artificial intelligence (AI) technology has advantages in many aspects of LC and widely used such as LC early diagnosis, LC differential classification, treatment and prognosis prediction.

Objective

This study aims to analyze and visualize the research history, current status, current hotspots, and development trends of artificial intelligence in the field of lung cancer using bibliometric methods, and predict future research directions and cutting-edge hotspots.

Results

A total of 2931 articles published between 2003 and 2023 were included, contributed by 15,848 authors from 92 countries/regions. Among them, China (40%) with 1173 papers,USA (24.80%) with 727 papers and the India(10.2%) with 299 papers have made outstanding contributions in this field, accounting for 75% of the total publications. The primary research institutions were Shanghai Jiaotong University(n=66),Chinese Academy of Sciences (n=63) and Harvard Medical School (n=52).Professor Qian Wei(n=20) from Northeastern University in China were ranked first in the top 10 authors while Armato SG(n=458 citations) was the most co-cited authors. Frontiers in Oncology(121 publications; IF 2022,4.7; Q2) was the most published journal. while Radiology (3003 citations; IF 2022, 19.7; Q1) was the most co-cited journal. different countries and institutions should further strengthen cooperation between each other. The most common keywords were lung cancer, classification, cancer, machine learning and deep learning. Meanwhile, The most cited papers was Nicolas Coudray et al.2018.NAT MED(1196 Total Citations).

Conclusions

Research related to AI in lung cancer has significant application prospects, and the number of scholars dedicated to AI-related research on lung cancer is continually growing. It is foreseeable that non-invasive diagnosis and precise minimally invasive treatment through deep learning and machine learning will remain a central focus in the future. Simultaneously, there is a need to enhance collaboration not only among various countries and institutions but also between high-quality medical and industrial entities.

Tumor segmentation via enhanced area growth algorithm for lung CT images

BACKGROUND

Since lung tumors are in dynamic conditions, the study of tumor growth and its changes is of great importance in primary diagnosis.

METHODS

Enhanced area growth (EAG) algorithm is introduced to segment the lung tumor in 2D and 3D modes on 60 patients CT images from four different databases by MATLAB software. The contrast augmentation, color intensity and maximum primary tumor radius determination, thresholding, start and neighbor points' designation in an array, and then modifying the points in the braid on average are the early steps of the proposed algorithm. To determine the new tumor boundaries, the maximum distance from the color-intensity center point of the primary tumor to the modified points is appointed via considering a larger target region and new threshold. The tumor center is divided into different subsections and then all previous stages are repeated from new designated points to define diverse boundaries for the tumor. An interpolation between these boundaries creates a new tumor boundary. The intersections with the tumor boundaries are firmed for edge correction phase, after drawing diverse lines from the tumor center at relevant angles. Each of the new regions is annexed to the core region to achieve a segmented tumor surface by meeting certain conditions.

RESULTS

The multipoint-growth-starting-point grouping fashioned a desired consequence in the precise delineation of the tumor. The proposed algorithm enhanced tumor identification by more than 16% with a reasonable accuracy acceptance rate. At the same time, it largely assurances the independence of the last outcome from the starting point. By significance difference of p < 0.05, the dice coefficients were 0.80 ± 0.02 and 0.92 ± 0.03, respectively, for primary and enhanced algorithms. Lung area determination alongside automatic thresholding and also starting from several points along with edge improvement may reduce human errors in radiologists' interpretation of tumor areas and selection of the algorithm's starting point.

CONCLUSIONS

The proposed algorithm enhanced tumor detection by more than 18% with a sufficient acceptance ratio of accuracy. Since the enhanced algorithm is independent of matrix size and image thickness, it is very likely that it can be easily applied to other contiguous tumor images.

TRIAL REGISTRATION

PAZHOUHAN, PAZHOUHAN98000032. Registered 4 January 2021, http://pazhouhan.gerums.ac.ir/webreclist/view.action?webreclist_code=19300.

Recent Advancements in Computed Tomography Assessment of Fibrotic Interstitial Lung Diseases

Interstitial lung disease (ILD) is a heterogeneous group of disorders with complex and varied imaging manifestations and prognosis. High-resolution computed tomography (HRCT) is the current standard-of-care imaging tool for ILD assessment. However, visual evaluation of HRCT is limited by interobserver variation and poor sensitivity for subtle changes. Such challenges have led to tremendous recent research interest in objective and reproducible methods to examine ILDs. Computer-aided CT analysis to include texture analysis and machine learning methods have recently been shown to be viable supplements to traditional visual assessment through improved characterization and quantification of ILDs. These quantitative tools have not only been shown to correlate well with pulmonary function tests and patient outcomes but are also useful in disease diagnosis, surveillance and management. In this review, we provide an overview of recent computer-aided tools in diagnosis, prognosis, and longitudinal evaluation of fibrotic ILDs, while outlining some of the pitfalls and challenges that have precluded further advancement of these tools as well as potential solutions and further endeavors.

Semi-automated micro-computed tomography lung segmentation and analysis in mouse models

Computed Tomography (CT) is a standard clinical tool utilized to diagnose known lung pathologies based on established grading methods. However, for preclinical trials and toxicity investigations in animal models, more comprehensive datasets are typically needed to determine discriminative features between experimental treatments, which oftentimes require analysis of multiple images and their associated differential quantification using manual segmentation methods. Furthermore, for manual segmentation of image data, three or more readers is the gold standard of analysis, but this requirement can be time-consuming and inefficient, depending on variability due to reader bias. In previous papers, microCT image manual segmentation was a valuable tool for assessment of lung pathology in several animal models; however, the manual segmentation approach and the commercial software used was typically a major rate-limiting step. To improve the efficiency, the semi-manual segmentation method was streamlined, and a semi-automated segmentation process was developed to produce:•Quantifiable segmentations: using manual and semi-automated analysis methods for assessing experimental injury and toxicity models,•Deterministic results and efficiency through automation in an unbiased and parameter free process, thereby reducing reader variance, user time, and increases throughput in data analysis,•Cost-Effectiveness: portable with low computational resource demand, based on a cross-platform open-source ImageJ program.

Deep learning-based recognition and segmentation of intracranial aneurysms under small sample size

The manual identification and segmentation of intracranial aneurysms (IAs) involved in the 3D reconstruction procedure are labor-intensive and prone to human errors. To meet the demands for routine clinical management and large cohort studies of IAs, fast and accurate patient-specific IA reconstruction becomes a research Frontier. In this study, a deep-learning-based framework for IA identification and segmentation was developed, and the impacts of image pre-processing and convolutional neural network (CNN) architectures on the framework's performance were investigated. Three-dimensional (3D) segmentation-dedicated architectures, including 3D UNet, VNet, and 3D Res-UNet were evaluated. The dataset used in this study included 101 sets of anonymized cranial computed tomography angiography (CTA) images with 140 IA cases. After the labeling and image pre-processing, a training set and test set containing 112 and 28 IA lesions were used to train and evaluate the convolutional neural network mentioned above. The performances of three convolutional neural networks were compared in terms of training performance, segmentation performance, and segmentation efficiency using multiple quantitative metrics. All the convolutional neural networks showed a non-zero voxel-wise recall (V-Recall) at the case level. Among them, 3D UNet exhibited a better overall segmentation performance under the relatively small sample size. The automatic segmentation results based on 3D UNet reached an average V-Recall of 0.797 ± 0.140 (3.5% and 17.3% higher than that of VNet and 3D Res-UNet), as well as an average dice similarity coefficient (DSC) of 0.818 ± 0.100, which was 4.1%, and 11.7% higher than VNet and 3D Res-UNet. Moreover, the average Hausdorff distance (HD) of the 3D UNet was 3.323 ± 3.212 voxels, which was 8.3% and 17.3% lower than that of VNet and 3D Res-UNet. The three-dimensional deviation analysis results also showed that the segmentations of 3D UNet had the smallest deviation with a max distance of +1.4760/-2.3854 mm, an average distance of 0.3480 mm, a standard deviation (STD) of 0.5978 mm, a root mean square (RMS) of 0.7269 mm. In addition, the average segmentation time (AST) of the 3D UNet was 0.053s, equal to that of 3D Res-UNet and 8.62% shorter than VNet. The results from this study suggested that the proposed deep learning framework integrated with 3D UNet can provide fast and accurate IA identification and segmentation.

Two-dimensional reciprocal cross entropy multi-threshold combined with improved firefly algorithm for lung parenchyma segmentation of COVID-19 CT image

The lesions of COVID-19 CT image show various kinds of ground-glass opacity and consolidation, which are distributed in left lung, right lung or both lungs. The lung lobes are uneven and it have similar gray value to the surrounding arteries, veins, and bronchi. The lesions of COVID-19 have different sizes and shapes in different periods. Accurate segmentation of lung parenchyma in CT image is a key step in COVID-19 detection and diagnosis. Aiming at the unideal effect of traditional image segmentation methods on lung parenchyma segmentation in CT images, a lung parenchyma segmentation method based on two-dimensional reciprocal cross entropy multi-threshold combined with improved firefly algorithm is proposed. Firstly, the optimal threshold method is used to realize the initial segmentation of the lung, so that the segmentation threshold can change adaptively according to the detailed information of lung lobes, trachea, bronchi and ground-glass opacity. Then the lung parenchyma is further processed to obtain the lung parenchyma template, and then the defective template is repaired combined with the improved Freeman chain code and Bezier curve. Finally, the lung parenchyma is extracted by multiplying the template with the lung CT image. The accuracy of lung parenchyma segmentation has been improved in the contrast clarity of CT image and the consistency of lung parenchyma regional features, with an average segmentation accuracy rate of 97.4%. The experimental results show that for COVID-19 and suspected cases, the method has an ideal segmentation effect, and it has good accuracy and robustness.

Radiomics: a primer on high-throughput image phenotyping

Radiomics is a high-throughput approach to image phenotyping. It uses computer algorithms to extract and analyze a large number of quantitative features from radiological images. These radiomic features collectively describe unique patterns that can serve as digital fingerprints of disease. They may also capture imaging characteristics that are difficult or impossible to characterize by the human eye. The rapid development of this field is motivated by systems biology, facilitated by data analytics, and powered by artificial intelligence. Here, as part of Abdominal Radiology's special issue on Quantitative Imaging, we provide an introduction to the field of radiomics. The technique is formally introduced as an advanced application of data analytics, with illustrating examples in abdominal radiology. Artificial intelligence is then presented as the main driving force of radiomics, and common techniques are defined and briefly compared. The complete step-by-step process of radiomic phenotyping is then broken down into five key phases. Potential pitfalls of each phase are highlighted, and recommendations are provided to reduce sources of variation, non-reproducibility, and error associated with radiomics.

Intelligent tuberculosis activity assessment system based on an ensemble of neural networks

This article proposes a novel approach to assess the degree of activity of pulmonary tuberculosis by active tuberculoma foci. It includes the development of a new method for processing lung CT images using an ensemble of deep convolutional neural networks using such special algorithms: an optimized algorithm for preliminary segmentation and selection of informative scans, a new algorithm for refining segmented masks to improve the final accuracy, an efficient fuzzy inference system for more weighted activity assessment. The approach also includes the use of medical classification of disease activity based on densitometric measures of tuberculomas. The selection and markup of the training sample images were performed manually by qualified pulmonologists from a base of approximately 9,000 CT lung scans of patients who had been enrolled in the dispensary for 15 years. The first basic step of the proposed approach is the developed algorithm for preprocessing CT lung scans. It consists in segmentation of intrapulmonary regions, which contain vessels, bronchi, lung walls to detect complex cases of ingrown tuberculomas. To minimize computational cost, the proposed approach includes a new method for selecting informative lung scans, i.e., those that potentially contain tuberculomas. The main processing step is binary segmentation of tuberculomas, which is proposed to be performed optimally by a certain ensemble of neural networks. Optimization of the ensemble size and its composition is achieved by using an algorithm for calculating individual contributions. A modification of this algorithm using new effective heuristic metrics has been proposed which improves the performance of the algorithm for this problem. A special algorithm was developed for post-processing of tuberculoma masks obtained during the segmentation step. The goal of this step is to refine the calculated mask for the physical placement of the tuberculoma. The algorithm consists in cleaning the mask from noisy formations on the scan, as well as expanding the mask area to maximize the capture of the tuberculoma location area. A simplified fuzzy inference system was developed to provide a more accurate final calculation of the degree of disease activity, which reflects data from current medical studies. The accuracy of the system was also tested on a test sample of independent patients, showing more than 96% correct calculations of disease activity, confirming the effectiveness and feasibility of introducing the system into clinical practice.

Lung Volume Calculation in Preclinical MicroCT: A Fast Geometrical Approach

In this study, we present a time-efficient protocol for thoracic volume calculation as a proxy for total lung volume. We hypothesize that lung volume can be calculated indirectly from this thoracic volume. We compared the measured thoracic volume with manually segmented and automatically thresholded lung volumes, with manual segmentation as the gold standard. A linear regression formula was obtained and used for calculating the theoretical lung volume. This volume was compared with the gold standard volumes. In healthy animals, thoracic volume was 887.45 mm³, manually delineated lung volume 554.33 mm³ and thresholded aerated lung volume 495.38 mm³ on average. Theoretical lung volume was 554.30 mm³. Finally, the protocol was applied to three animal models of lung pathology (lung metastasis and transgenic primary lung tumor and fungal infection). In confirmed pathologic animals, thoracic volumes were: 893.20 mm³, 860.12 and 1027.28 mm³. Manually delineated volumes were 640.58, 503.91 and 882.42 mm³, respectively. Thresholded lung volumes were 315.92 mm³, 408.72 and 236 mm³, respectively. Theoretical lung volume resulted in 635.28, 524.30 and 863.10.42 mm³. No significant differences were observed between volumes. This confirmed the potential use of this protocol for lung volume calculation in pathologic models.

COVID-19 CT Scan Lung Segmentation: How We Do It

The National Health Systems have been severely stressed out by the COVID-19 pandemic because 14% of patients require hospitalization and oxygen support, and 5% require admission to an Intensive Care Unit (ICU). Relationship between COVID-19 prognosis and the extent of alterations on chest CT obtained by both visual and software-based quantification that expresses objective evaluations of the percentage of ventilated lung parenchyma compared to the affected one has been proven. While commercial applications for automatic medical image computing and visualization are expensive and limited in their spread, the open-source systems are characterized by not enough standardization and time-consuming troubles. We analyzed chest CT exams on 246 patients suspected of COVID-19 performed in the Emergency Department CT room. The lung parenchyma segmentation was obtained by a threshold-based method using the open-source 3D Slicer software and software tools called "Segment Editor" and "Segment Quantification." For the three main characteristics analyzed on lungs affected by COVID-19 pneumonia, a specifical densitometry value range was defined: from - 950 to - 700 HU for well-aerated parenchyma; from - 700 to - 250 HU for interstitial lung disease; from - 250 to 250 HU for parenchymal consolidation. For the well-aerated parenchyma and the interstitial alterations, the procedure was semi-automatic with low time consumption, whereas consolidations' analysis needed manual interventions by the operator. After the chest CT, 13% of the sample was admitted to intensive care, while 34% of them to the sub-intensive care. In patients moved to intensive care, the parenchyma analysis reported a higher crazy paving presentation. The quantitative analysis of the alterations affecting the lung parenchyma of patients with COVID-19 pneumonia can be performed by threshold method segmentation on 3D Slicer. The segmentation could have an important role in the quantification in different COVID-19 pneumonia presentations, allowing to help the clinician in the correct management of patients.

Artificial Intelligence Radiotherapy Planning: Automatic Segmentation of Human Organs in CT Images Based on a Modified Convolutional Neural Network

Objective:

Precise segmentation of human organs and anatomic structures (especially organs at risk, OARs) is the basis and prerequisite for the treatment planning of radiation therapy. In order to ensure rapid and accurate design of radiotherapy treatment planning, an automatic organ segmentation technique was investigated based on deep learning convolutional neural network.

Method

A deep learning convolutional neural network (CNN) algorithm called BCDU-Net has been modified and developed further by us. Twenty two thousand CT images and the corresponding organ contours of 17 types delineated manually by experienced physicians from 329 patients were used to train and validate the algorithm. The CT images randomly selected were employed to test the modified BCDU-Net algorithm. The weight parameters of the algorithm model were acquired from the training of the convolutional neural network.

Result

The average Dice similarity coefficient (DSC) of the automatic segmentation and manual segmentation of the human organs of 17 types reached 0.8376, and the best coefficient reached up to 0.9676. It took 1.5–2 s and about 1 h to automatically segment the contours of an organ in an image of the CT dataset for a patient and the 17 organs for the CT dataset with the method developed by us, respectively.

Conclusion

The modified deep neural network algorithm could be used to automatically segment human organs of 17 types quickly and accurately. The accuracy and speed of the method meet the requirements of its application in radiotherapy.

Characteristics of Computed Tomography Images for Patients with Acute Liver Injury Caused by Sepsis under Deep Learning Algorithm

This study was aimed at exploring the application of image segmentation based on full convolutional neural network (FCN) in liver computed tomography (CT) image segmentation and analyzing the clinical features of acute liver injury caused by sepsis. The Sigmoid function, encoder-decoder, and weighted cross entropy loss function were introduced and optimized based on FCN. The Dice value, precision, recall rate, volume overlap error (VOE), relative volume difference (RVD), and root mean square error (RMSE) values of the optimized algorithms were compared and analyzed. 92 patients with sepsis were selected as the research objects, and they were divided into a nonacute liver injury group (50 cases) and acute liver injury group (42 cases) based on whether they had acute liver injury. The differences in the proportion of patients with different disease histories, the proportion of patients with different infection sites, the number of organ failure, and the time of admission to intensive care unit (ICU) were compared between the two groups. It was found that the optimized window CT image Dice value after preprocessing (0.704 ± 0.06) was significantly higher than the other two methods (P < 0.05). The Dice value, precision, and recall rate of the optimized-FCN algorithm were (0.826 ± 0.06), (0.91 ± 0.08), and (0.88 ± 0.09), respectively, which were significantly higher than other algorithms (P < 0.05). The VOE, RVD, and RMSE values were (21.19 ± 1.97), (10.45 ± 1.02), and (0.25 ± 0.02), respectively, which were significantly lower than other algorithms (P < 0.05). The proportion of patients with a history of drinking in the nonacute liver injury group was lower than that in the acute liver injury group (P < 0.05), and the proportion of patients with a history of hypotension was greatly higher than that in the nonacute liver injury group (P < 0.01). CT images of sepsis patients with acute liver injury showed that large areas of liver parenchyma mixed with high-density hematoma, the number of organ failures, and the length of stay in ICU were significantly higher than those in the nonacute liver injury group (P < 0.05). It showed that the optimization algorithm based on FCN greatly improved the performance of CT image segmentation. Long-term drinking, low blood pressure, number of organ failures, and length of stay in ICU were all related to sepsis and acute liver injury. Conclusion in this study could provide a reference basis for the diagnosis and prognosis of acute liver injury caused by sepsis.

Deep learning in structural and functional lung image analysis

The recent resurgence of deep learning (DL) has dramatically influenced the medical imaging field. Medical image analysis applications have been at the forefront of DL research efforts applied to multiple diseases and organs, including those of the lungs. The aims of this review are twofold: (i) to briefly overview DL theory as it relates to lung image analysis; (ii) to systematically review the DL research literature relating to the lung image analysis applications of segmentation, reconstruction, registration and synthesis. The review was conducted following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. 479 studies were initially identified from the literature search with 82 studies meeting the eligibility criteria. Segmentation was the most common lung image analysis DL application (65.9% of papers reviewed). DL has shown impressive results when applied to segmentation of the whole lung and other pulmonary structures. DL has also shown great potential for applications in image registration, reconstruction and synthesis. However, the majority of published studies have been limited to structural lung imaging with only 12.9% of reviewed studies employing functional lung imaging modalities, thus highlighting significant opportunities for further research in this field. Although the field of DL in lung image analysis is rapidly expanding, concerns over inconsistent validation and evaluation strategies, intersite generalisability, transparency of methodological detail and interpretability need to be addressed before widespread adoption in clinical lung imaging workflow.

Sports Action Recognition Based on Deep Learning and Clustering Extraction Algorithm

This paper constructs a sports action recognition model based on deep learning (DL) and clustering extraction algorithm. For the input detection image frame, athletes' movements are detected through DL network, and then athletes' sports movements are fused. Moreover, it expands new knowledge and improves learning ability through automatic learning training set. The neural network (NN) is applied to the sample set containing images of nonathletes, and the negative training sample set is iteratively enhanced according to the generated false positives, and the results are optimized by clustering method. Simulation experiments show that compared with other algorithms, the clustering extraction algorithm in this paper has achieved superior performance in recognition rate and false alarm rate, and the recognition speed is faster. The aim is to extract the athletes' training postures through the analysis of sports movements, so as to assist coaches to train athletes more professionally and provide some reference for sports movement recognition.

A Few-Shot Learning-Based Retinal Vessel Segmentation Method for Assisting in the Central Serous Chorioretinopathy Laser Surgery

BACKGROUND

The location of retinal vessels is an important prerequisite for Central Serous Chorioretinopathy (CSC) Laser Surgery, which does not only assist the ophthalmologist in marking the location of the leakage point (LP) on the fundus color image but also avoids the damage of the laser spot to the vessel tissue, as well as the low efficiency of the surgery caused by the absorption of laser energy by retinal vessels. In acquiring an excellent intra- and cross-domain adaptability, the existing deep learning (DL)-based vessel segmentation scheme must be driven by big data, which makes the densely annotated work tedious and costly.

METHODS

This paper aims to explore a new vessel segmentation method with a few samples and annotations to alleviate the above problems. Firstly, a key solution is presented to transform the vessel segmentation scene into the few-shot learning task, which lays a foundation for the vessel segmentation task with a few samples and annotations. Then, we improve the existing few-shot learning framework as our baseline model to adapt to the vessel segmentation scenario. Next, the baseline model is upgraded from the following three aspects: (1) A multi-scale class prototype extraction technique is designed to obtain more sufficient vessel features for better utilizing the information from the support images; (2) The multi-scale vessel features of the query images, inferred by the support image class prototype information, are gradually fused to provide more effective guidance for the vessel extraction tasks; and (3) A multi-scale attention module is proposed to promote the consideration of the global information in the upgraded model to assist vessel localization. Concurrently, the integrated framework is further conceived to appropriately alleviate the low performance of a single model in the cross-domain vessel segmentation scene, enabling to boost the domain adaptabilities of both the baseline and the upgraded models.

RESULTS

Extensive experiments showed that the upgraded operation could further improve the performance of vessel segmentation significantly. Compared with the listed methods, both the baseline and the upgraded models achieved competitive results on the three public retinal image datasets (i.e., CHASE_DB, DRIVE, and STARE). In the practical application of private CSC datasets, the integrated scheme partially enhanced the domain adaptabilities of the two proposed models.

Automated segmentation of lung, liver, and liver tumors from Tc-99m MAA SPECT/CT images for Y-90 radioembolization using convolutional neural networks

PURPOSE

90 Y selective internal radiation therapy (SIRT) has become a safe and effective treatment option for liver cancer. However, segmentation of target and organ-at-risks is labor-intensive and time-consuming in 90 Y SIRT planning. In this study, we developed a convolutional neural network (CNN)-based method for automated lungs, liver, and tumor segmentation on 99m Tc-MAA SPECT/CT images for 90 Y SIRT planning.

METHODS

99m Tc-MAA SPECT/CT images and corresponding clinical segmentations were retrospectively collected from 56 patients who underwent 90 Y SIRT. The collected data were used to train three CNN-based segmentation algorithms for lungs, liver, and tumor segmentation. Segmentation performance was evaluated using the Dice similarity coefficient (DSC), surface DSC, and average symmetric surface distance (ASSD). Dosimetric parameters (volume, counts, and lung shunt fraction) were measured from the segmentation results and were compared with clinical reference segmentations.

RESULTS

The evaluation results show that the method can accurately segment lungs, liver, and tumor with median [interquartile range] DSCs of 0.98 [0.97-0.98], 0.91 [0.83-0.93], and 0.85 [0.71-0.88]; surface DSCs of 0.99 [0.97-0.99], 0.86 [0.77-0.93], and 0.85 [0.62-0.93], and ASSDs of 0.91 [0.69-1.5], 4.8 [2.6-8.4], and 4.7 [3.5-9.2] mm, respectively. Dosimetric parameters from the three segmentation networks show relationship with those from the reference segmentations. The overall segmentation took about 1 min per patient on an NVIDIA RTX-2080Ti GPU.

CONCLUSION

This work presents CNN-based algorithms to segment lungs, liver, and tumor from 99m Tc-MAA SPECT/CT images. The results demonstrated the potential of the proposed CNN-based segmentation method for assisting 90 Y SIRT planning while drastically reducing operator time.

Automatic segmentation of paravertebral muscles in abdominal CT scan by U-Net: The application of data augmentation technique to increase the Jaccard ratio of deep learning

ABSTRACT

Sarcopenia, characterized by a decline of skeletal muscle mass, has emerged as an important prognostic factor for cancer patients. Trunk computed tomography (CT) is a commonly used modality for assessment of cancer disease extent and treatment outcome. CT images can also be used to analyze the skeletal muscle mass filtered by the appropriate range of Hounsfield scale. However, a manual depiction of skeletal muscle in CT scan images for assessing skeletal muscle mass is labor-intensive and unrealistic in clinical practice. In this paper, we propose a novel U-Net based segmentation system for CT scan of paravertebral muscles in the third and fourth lumbar spines. Since the number of training samples is limited (i.e., 1024 CT images only), it is well-known that the performance of the deep learning approach is restricted due to overfitting. A data augmentation strategy to enlarge the diversity of the training set to boost the performance further is employed. On the other hand, we also discuss how the number of features in our U-Net affects the performance of the semantic segmentation. The efficacies of the proposed methodology based on w/ and w/o data augmentation and different feature maps are compared in the experiments. We show that the Jaccard score is approximately 95.0% based on the proposed data augmentation method with only 16 feature maps used in U-Net. The stability and efficiency of the proposed U-Net are verified in the experiments in a cross-validation manner.

Detection of Trees on Street-View Images Using a Convolutional Neural Network

Real-time detection of possible deforestation of urban landscapes is an essential task for many urban forest monitoring services. Computational methods emerge as a rapid and efficient solution to evaluate bird's-eye-view images taken by satellites, drones, or even street-view photos captured at the ground level of the urban scenery. Identifying unhealthy trees requires detecting the tree itself and its constituent parts to evaluate certain aspects that may indicate unhealthiness, being street-level images a cost-effective and feasible resource to support the fieldwork survey. This paper proposes detecting trees and their specific parts on street-view images through a Convolutional Neural Network model based on the well-known You Only Look Once network with a MobileNet as the backbone for feature extraction. Essentially, from a photo taken from the ground, the proposed method identifies trees, isolates them through their bounding boxes, identifies the crown and stem, and then estimates the height of the trees by using a specific handheld object as a reference in the images. Experiment results demonstrate the effectiveness of the proposed method.

Lung computed tomography image segmentation based on U-Net network fused with dilated convolution

PURPOSE

In order to solve the problem of accurate and effective segmentation of the patient's lung computed tomography (CT) images, so as to improve the efficiency of treating lung cancer.

METHOD

We propose a U-Net network (DC-U-Net) fused with dilated convolution, and compare the results of segmented lung CT with DC-U-Net, Otsu and region growth. We use Intersection over Union (IOU), Dice coefficient, Precision and Recall to evaluate the performance of the three algorithms.

RESULTS

Compared with the common segmentation algorithm Otsu and region growing, the segmented image of DC-U-Net is closer to the Ground truth. The IOU of DC-U-Net is 0.9627, and the Dice coefficient is 0.9743, which is close to 1 and much higher than the other two algorithms.

CONCLUSION

We propose that the model can directly segment the original image automatically, and the segmentation effect is good. This model speeds up the segmentation, simplifies the steps of medical image segmentation, and provides better segmentation for subsequent lung blood vessels, trachea and other tissues.

Three-stage segmentation of lung region from CT images using deep neural networks

BACKGROUND

Lung region segmentation is an important stage of automated image-based approaches for the diagnosis of respiratory diseases. Manual methods executed by experts are considered the gold standard, but it is time consuming and the accuracy is dependent on radiologists' experience. Automated methods are relatively fast and reproducible with potential to facilitate physician interpretation of images. However, these benefits are possible only after overcoming several challenges. The traditional methods that are formulated as a three-stage segmentation demonstrate promising results on normal CT data but perform poorly in the presence of pathological features and variations in image quality attributes. The implementation of deep learning methods that can demonstrate superior performance over traditional methods is dependent on the quantity, quality, cost and the time it takes to generate training data. Thus, efficient and clinically relevant automated segmentation method is desired for the diagnosis of respiratory diseases.

METHODS

We implement each of the three stages of traditional methods using deep learning methods trained on five different configurations of training data with ground truths obtained from the 3D Image Reconstruction for Comparison of Algorithm Database (3DIRCAD) and the Interstitial Lung Diseases (ILD) database. The data was augmented with the Lung Image Database Consortium (LIDC-IDRI) image collection and a realistic phantom. A convolutional neural network (CNN) at the preprocessing stage classifies the input into lung and none lung regions. The processing stage was implemented using a CNN-based U-net while the postprocessing stage utilize another U-net and CNN for contour refinement and filtering out false positives, respectively.

RESULTS

The performance of the proposed method was evaluated on 1230 and 1100 CT slices from the 3DIRCAD and ILD databases. We investigate the performance of the proposed method on five configurations of training data and three configurations of the segmentation system; three-stage segmentation and three-stage segmentation without a CNN classifier and contrast enhancement, respectively. The Dice-score recorded by the proposed method range from 0.76 to 0.95.

CONCLUSION

The clinical relevance and segmentation accuracy of deep learning models can improve though deep learning-based three-stage segmentation, image quality evaluation and enhancement as well as augmenting the training data with large volume of cheap and quality training data. We propose a new and novel deep learning-based method of contour refinement.

Measuring pulmonary function in COPD using quantitative chest computed tomography analysis

COPD is diagnosed and evaluated by pulmonary function testing (PFT). Chest computed tomography (CT) primarily serves a descriptive role for diagnosis and severity evaluation. CT densitometry-based emphysema quantification and lobar fissure integrity assessment are most commonly used, mainly for lung volume reduction purposes and scientific efforts.

A shift towards a more quantitative role for CT to assess pulmonary function is a logical next step, since more, currently underutilised, information is present in CT images. For instance, lung volumes such as residual volume and total lung capacity can be extracted from CT; these are strongly correlated to lung volumes measured by PFT.

This review assesses the current evidence for use of quantitative CT as a proxy for PFT in COPD and discusses challenges in the movement towards CT as a more quantitative modality in COPD diagnosis and evaluation. To better understand the relevance of the traditional PFT measurements and the role CT might play in the replacement of these parameters, COPD pathology and traditional PFT measurements are discussed.

CT may be used as a proxy for lung function in COPD diagnosis and evaluation, particularly for the hyperinflation markershttps://bit.ly/2RrGAZf

[Research progress in lung parenchyma segmentation based on computed tomography]

Lung diseases such as lung cancer and COVID-19 seriously endanger human health and life safety, so early screening and diagnosis are particularly important. computed tomography (CT) technology is one of the important ways to screen lung diseases, among which lung parenchyma segmentation based on CT images is the key step in screening lung diseases, and high-quality lung parenchyma segmentation can effectively improve the level of early diagnosis and treatment of lung diseases. Automatic, fast and accurate segmentation of lung parenchyma based on CT images can effectively compensate for the shortcomings of low efficiency and strong subjectivity of manual segmentation, and has become one of the research hotspots in this field. In this paper, the research progress in lung parenchyma segmentation is reviewed based on the related literatures published at domestic and abroad in recent years. The traditional machine learning methods and deep learning methods are compared and analyzed, and the research progress of improving the network structure of deep learning model is emphatically introduced. Some unsolved problems in lung parenchyma segmentation were discussed, and the development prospect was prospected, providing reference for researchers in related fields.

A narrative review on characterization of acute respiratory distress syndrome in COVID-19-infected lungs using artificial intelligence

COVID-19 has infected 77.4 million people worldwide and has caused 1.7 million fatalities as of December 21, 2020. The primary cause of death due to COVID-19 is Acute Respiratory Distress Syndrome (ARDS). According to the World Health Organization (WHO), people who are at least 60 years old or have comorbidities that have primarily been targeted are at the highest risk from SARS-CoV-2. Medical imaging provides a non-invasive, touch-free, and relatively safer alternative tool for diagnosis during the current ongoing pandemic. Artificial intelligence (AI) scientists are developing several intelligent computer-aided diagnosis (CAD) tools in multiple imaging modalities, i.e., lung computed tomography (CT), chest X-rays, and lung ultrasounds. These AI tools assist the pulmonary and critical care clinicians through (a) faster detection of the presence of a virus, (b) classifying pneumonia types, and (c) measuring the severity of viral damage in COVID-19-infected patients. Thus, it is of the utmost importance to fully understand the requirements of for a fast and successful, and timely lung scans analysis. This narrative review first presents the pathological layout of the lungs in the COVID-19 scenario, followed by understanding and then explains the comorbid statistical distributions in the ARDS framework. The novelty of this review is the approach to classifying the AI models as per the by school of thought (SoTs), exhibiting based on segregation of techniques and their characteristics. The study also discusses the identification of AI models and its extension from non-ARDS lungs (pre-COVID-19) to ARDS lungs (post-COVID-19). Furthermore, it also presents AI workflow considerations of for medical imaging modalities in the COVID-19 framework. Finally, clinical AI design considerations will be discussed. We conclude that the design of the current existing AI models can be improved by considering comorbidity as an independent factor. Furthermore, ARDS post-processing clinical systems must involve include (i) the clinical validation and verification of AI-models, (ii) reliability and stability criteria, and (iii) easily adaptable, and (iv) generalization assessments of AI systems for their use in pulmonary, critical care, and radiological settings.

Extracting Lungs from CT Images via Deep Convolutional Neural Network Based Segmentation and Two-Pass Contour Refinement

Lung segmentation is a key step of thoracic computed tomography (CT) image processing, and it plays an important role in computer-aided pulmonary disease diagnostics. However, the presence of image noises, pathologies, vessels, individual anatomical varieties, and so on makes lung segmentation a complex task. In this paper, we present a fully automatic algorithm for segmenting lungs from thoracic CT images accurately. An input image is first spilt into a set of non-overlapping fixed-sized image patches, and a deep convolutional neural network model is constructed to extract initial lung regions by classifying image patches. Superpixel segmentation is then performed on the preprocessed thoracic CT image, and the lung contours are locally refined according to corresponding superpixel contours with our adjacent point statistics method. Segmented lung contours are further globally refined by an edge direction tracing technique for the inclusion of juxta-pleural lesions. Our algorithm is tested on a group of thoracic CT scans with interstitial lung diseases. Experiments show that our algorithm creates an average Dice similarity coefficient of 97.95% and Jaccard's similarity index of 94.48%, with 2.8% average over-segmentation rate and 3.3% under-segmentation rate compared with manually segmented results. Meanwhile, it shows better performance compared with several feature-based machine learning methods and current methods on lung segmentation.

Strengths, Weaknesses, Opportunities, and Threats Analysis of Artificial Intelligence and Machine Learning Applications in Radiology

Currently, the use of artificial intelligence (AI) in radiology, particularly machine learning (ML), has become a reality in clinical practice. Since the end of the last century, several ML algorithms have been introduced for a wide range of common imaging tasks, not only for diagnostic purposes but also for image acquisition and postprocessing. AI is now recognized to be a driving initiative in every aspect of radiology. There is growing evidence of the advantages of AI in radiology creating seamless imaging workflows for radiologists or even replacing radiologists. Most of the current AI methods have some internal and external disadvantages that are impeding their ultimate implementation in the clinical arena. As such, AI can be considered a portion of a business trying to be introduced in the health care market. For this reason, this review analyzes the current status of AI, and specifically ML, applied to radiology from the scope of strengths, weaknesses, opportunities, and threats (SWOT) analysis.

Scoring pleurisy in slaughtered pigs using convolutional neural networks

Diseases of the respiratory system are known to negatively impact the profitability of the pig industry, worldwide. Considering the relatively short lifespan of pigs, lesions can be still evident at slaughter, where they can be usefully recorded and scored. Therefore, the slaughterhouse represents a key check-point to assess the health status of pigs, providing unique and valuable feedback to the farm, as well as an important source of data for epidemiological studies. Although relevant, scoring lesions in slaughtered pigs represents a very time-consuming and costly activity, thus making difficult their systematic recording. The present study has been carried out to train a convolutional neural network-based system to automatically score pleurisy in slaughtered pigs. The automation of such a process would be extremely helpful to enable a systematic examination of all slaughtered livestock. Overall, our data indicate that the proposed system is well able to differentiate half carcasses affected with pleurisy from healthy ones, with an overall accuracy of 85.5%. The system was better able to recognize severely affected half carcasses as compared with those showing less severe lesions. The training of convolutional neural networks to identify and score pneumonia, on the one hand, and the achievement of trials in large capacity slaughterhouses, on the other, represent the natural pursuance of the present study. As a result, convolutional neural network-based technologies could provide a fast and cheap tool to systematically record lesions in slaughtered pigs, thus supplying an enormous amount of useful data to all stakeholders in the pig industry.

Automatic Detection of Pulmonary Nodules using Three-dimensional Chain Coding and Optimized Random Forest

The detection of pulmonary nodules on computed tomography scans provides a clue for the early diagnosis of lung cancer. Manual detection mandates a heavy radiological workload as it identifies nodules slice-by-slice. This paper presents a fully automated nodule detection with three significant contributions. First, an automated seeded region growing is designed to segment the lung regions from the tomography scans. Second, a three-dimensional chain code algorithm is implemented to refine the border of the segmented lungs. Lastly, nodules inside the lungs are detected using an optimized random forest classifier. The experiments for our proposed detection are conducted using 888 scans from a public dataset, and achieves a favorable result of 93.11% accuracy, 94.86% sensitivity, and 91.37% specificity, with only 0.0863 false positives per exam.

An effective approach for CT lung segmentation using mask region-based convolutional neural networks

Computer vision systems have numerous tools to assist in various medical fields, notably in image diagnosis. Computed tomography (CT) is the principal imaging method used to assist in the diagnosis of diseases such as bone fractures, lung cancer, heart disease, and emphysema, among others. Lung cancer is one of the four main causes of death in the world. The lung regions in the CT images are marked manually by a specialist as this initial step is a significant challenge for computer vision techniques. Once defined, the lung regions are segmented for clinical diagnoses. This work proposes an automatic segmentation of the lungs in CT images, using the Convolutional Neural Network (CNN) Mask R-CNN, to specialize the model for lung region mapping, combined with supervised and unsupervised machine learning methods (Bayes, Support Vectors Machine (SVM), K-means and Gaussian Mixture Models (GMMs)). Our approach using Mask R-CNN with the K-means kernel produced the best results for lung segmentation reaching an accuracy of 97.68 ± 3.42% and an average runtime of 11.2 s. We compared our results against other works for validation purposes, and our approach had the highest accuracy and was faster than some state-of-the-art methods.

Deep learning-based CAD schemes for the detection and classification of lung nodules from CT images: A survey

BACKGROUND

Lung cancer is the most common cancer in the world. Computed tomography (CT) is the standard medical imaging modality for early lung nodule detection and diagnosis that improves patient's survival rate. Recently, deep learning algorithms, especially convolutional neural networks (CNNs), have become a preferred methodology for developing computer-aided detection and diagnosis (CAD) schemes of lung CT images.

OBJECTIVE

Several CNN-based research projects have been initiated to design robust and efficient CAD schemes for the detection and classification of lung nodules. This paper reviews the recent works in this area and gives an insight into technical progress.

METHODS

First, a brief overview of CNN models and their basic structures is presented in this investigation. Then, we provide an analytic comparison of the existing approaches to discover recent trend and upcoming challenges. We also introduce an objective description of both handcrafted and deep learning features, as well as the types of nodules, the medical imaging modalities, the widely used databases, and related works in the last three years. The articles presented in this work were selected from various databases. About 57% of reviewed articles published in the last year.

RESULTS

Our analysis reveals that several methods achieved promising performance with high sensitivity rates ranging from 66% to 100% under the false-positive rates ranging from 1 to 15 per CT scan. It can be noted that CNN models have contributed to the accurate detection and early diagnosis of lung nodules.

CONCLUSIONS

From the critical discussion and an outline for prospective directions, this survey provide researchers valuable information to master the deep learning concepts and to deepen their knowledge of the trend and latest techniques in developing CAD schemes of lung CT images.

Quantitative Assessment of Parenchymal Involvement Using 3D Lung Model in Adolescent With Covid-19 Interstitial Pneumonia

Background: Amount of parenchymal involvement in patients with interstitial pneumonia Covid-19 related, seems to be associated with a worse prognosis. Nowadays 3D reconstruction imaging is expanding its role in clinical medical practice. We aimed to use 3D lung reconstruction of a young lady affected by Sars-CoV2 infection and interstitial pneumonia, to better visualize, and quantitatively assess the parenchymal involvement. Methods: Volumetric Chest CT scan was performed in a 15 years old girl with interstitial lung pneumonia, Sars-CoV2 infection related. 3D modeling of the lungs, with differentiation of healthy and affected parenchymal area were obtained by using multiple software. Results: 3D reconstruction imaging allowed us to quantify the lung parenchyma involved, Self-explaining 3D images, useful for the understanding, and discussion of the clinical case were also obtained. Conclusions: Quantitative Assessment of Parenchymal Involvement Using 3D Lung Model in Covid-19 Infection is feasible and it provides information which could play a role in the management and risk stratification of these patients.

Deep CNN models for pulmonary nodule classification: Model modification, model integration, and transfer learning

BACKGROUND

Deep learning has made spectacular achievements in analysing natural images, but it faces challenges for medical applications partly due to inadequate images.

OBJECTIVE

Aiming to classify malignant and benign pulmonary nodules using CT images, we explore different strategies to utilize the state-of-the-art deep convolutional neural networks (CNN).

METHODS

Experiments are conducted using the Lung Image Database Consortium image collection (LIDC-IDRI), which is a public database containing 1018 cases. Three strategies are implemented including to 1) modify some state-of-the-art CNN architectures, 2) integrate different CNNs and 3) adopt transfer learning. Totally, 11 deep CNN models are compared using the same dataset.

RESULTS

Study demonstrates that, for the model modification scheme, a concise CifarNet performs better than the other modified CNNs with more complex architectures, achieving an area under ROC curve of AUC = 0.90. Integrated CNN models do not significantly improve the classification performance, but the model complexity is reduced. Transfer learning outperforms the other two schemes and ResNet with fine-tuning leads to the best performance with an AUC = 0.94, as well as the sensitivity of 91% and an overall accuracy of 88%.

CONCLUSIONS

Model modification, model integration, and transfer learning can play important roles to identify and generate optimal deep CNN models in classifying pulmonary nodules based on CT images efficiently. Transfer learning is preferred when applying deep learning to medical imaging applications.