Lung parenchyma parameters measure of rats from pulmonary window computed tomography images based on ResU-Net model for medical respiratory researches

Three-stage registration pipeline for dynamic lung field of chest X-ray images based on convolutional neural networks

Background

The anatomically constrained registration network (AC-RegNet), which yields anatomically plausible results, has emerged as the state-of-the-art registration architecture for chest X-ray (CXR) images. Nevertheless, accurate lung field registration results may be more favored and exciting than the registration results of the entire CXR images and hold promise for dynamic lung field analysis in clinical practice.

Objective

Based on the above, a registration model of the dynamic lung field of CXR images based on AC-RegNet and static CXR images is urgently developed to register these dynamic lung fields for clinical quantitative analysis.

Methods

This paper proposes a fully automatic three-stage registration pipeline for the dynamic lung field of CXR images. First, the dynamic lung field mask images are generated from a pre-trained standard lung field segmentation model with the dynamic CXR images. Then, a lung field abstraction model is designed to generate the dynamic lung field images based on the dynamic lung field mask images and their corresponding CXR images. Finally, we propose a three-step registration training method to train the AC-RegNet, obtaining the registration network of the dynamic lung field images (AC-RegNet_V3).

Results

The proposed AC-RegNet_V3 with the four basic segmentation networks achieve the mean dice similarity coefficient (DSC) of 0.991, 0.993, 0.993, and 0.993, mean Hausdorff distance (HD) of 12.512, 12.813, 12.449, and 13.661, mean average symmetric surface distance (ASSD) of 0.654, 0.550, 0.572, and 0.564, and mean squared distance (MSD) of 559.098, 577.797, 548.189, and 559.652, respectively. Besides, compared to the dynamic CXR images, the mean DSC of these four basic segmentation networks with AC-RegNet has been significantly improved by 7.2, 7.4, 7.4, and 7.4% (p-value < 0.0001). Meanwhile, the mean HD has been significantly improved by 8.994, 8.693, 9.057, and 7.845 (p-value < 0.0001). Similarly, the mean ASSD has significantly improved by 4.576, 4.680, 4.658, and 4.658 (p-value < 0.0001). Last, the mean MSD has significantly improved by 508.936, 519.776, 517.904, and 520.626 (p-value < 0.0001).

Conclusion

Our proposed three-stage registration pipeline has demonstrated its effectiveness in dynamic lung field registration. Therefore, it could become a powerful tool for dynamic lung field analysis in clinical practice, such as pulmonary airflow detection and air trapping location.

Automatic cardiothoracic ratio calculation based on lung fields abstracted from chest X-ray images without heart segmentation

Introduction

The cardiothoracic ratio (CTR) based on postero-anterior chest X-rays (P-A CXR) images is one of the most commonly used cardiac measurement methods and an indicator for initially evaluating cardiac diseases. However, the hearts are not readily observable on P-A CXR images compared to the lung fields. Therefore, radiologists often manually determine the CTR's right and left heart border points of the adjacent left and right lung fields to the heart based on P-A CXR images. Meanwhile, manual CTR measurement based on the P-A CXR image requires experienced radiologists and is time-consuming and laborious.

Methods

Based on the above, this article proposes a novel, fully automatic CTR calculation method based on lung fields abstracted from the P-A CXR images using convolutional neural networks (CNNs), overcoming the limitations to heart segmentation and avoiding errors in heart segmentation. First, the lung field mask images are abstracted from the P-A CXR images based on the pre-trained CNNs. Second, a novel localization method of the heart's right and left border points is proposed based on the two-dimensional projection morphology of the lung field mask images using graphics.

Results

The results show that the mean distance errors at the x-axis direction of the CTR's four key points in the test sets T1 (21 × 512 × 512 static P-A CXR images) and T2 (13 × 512 × 512 dynamic P-A CXR images) based on various pre-trained CNNs are 4.1161 and 3.2116 pixels, respectively. In addition, the mean CTR errors on the test sets T1 and T2 based on four proposed models are 0.0208 and 0.0180, respectively.

Discussion

Our proposed model achieves the equivalent performance of CTR calculation as the previous CardioNet model, overcomes heart segmentation, and takes less time. Therefore, our proposed method is practical and feasible and may become an effective tool for initially evaluating cardiac diseases.

Hemi-diaphragm detection of chest X-ray images based on convolutional neural network and graphics

BACKGROUND

Chest X-rays (CXR) are widely used to facilitate the diagnosis and treatment of critically ill and emergency patients in clinical practice. Accurate hemi-diaphragm detection based on postero-anterior (P-A) CXR images is crucial for the diaphragm function assessment of critically ill and emergency patients to provide precision healthcare for these vulnerable populations.

OBJECTIVE

Therefore, an effective and accurate hemi-diaphragm detection method for P-A CXR images is urgently developed to assess these vulnerable populations' diaphragm function.

METHODS

Based on the above, this paper proposes an effective hemi-diaphragm detection method for P-A CXR images based on the convolutional neural network (CNN) and graphics. First, we develop a robust and standard CNN model of pathological lungs trained by human P-A CXR images of normal and abnormal cases with multiple lung diseases to extract lung fields from P-A CXR images. Second, we propose a novel localization method of the cardiophrenic angle based on the two-dimensional projection morphology of the left and right lungs by graphics for detecting the hemi-diaphragm.

RESULTS

The mean errors of the four key hemi-diaphragm points in the lung field mask images abstracted from static P-A CXR images based on five different segmentation models are 9.05, 7.19, 7.92, 7.27, and 6.73 pixels, respectively. Besides, the results also show that the mean errors of these four key hemi-diaphragm points in the lung field mask images abstracted from dynamic P-A CXR images based on these segmentation models are 5.50, 7.07, 4.43, 4.74, and 6.24 pixels,respectively.

CONCLUSION

Our proposed hemi-diaphragm detection method can effectively perform hemi-diaphragm detection and may become an effective tool to assess these vulnerable populations' diaphragm function for precision healthcare.

Multi-Layer Perceptron Classifier with the Proposed Combined Feature Vector of 3D CNN Features and Lung Radiomics Features for COPD Stage Classification

Computed tomography (CT) has been regarded as the most effective modality for characterizing and quantifying chronic obstructive pulmonary disease (COPD). Therefore, chest CT images should provide more information for COPD diagnosis, such as COPD stage classification. This paper proposes a features combination strategy by concatenating three-dimension (3D) CNN features and lung radiomics features for COPD stage classification based on the multi-layer perceptron (MLP) classifier. First, 465 sets of chest HRCT images are automatically segmented by a trained ResU-Net, obtaining the lung images with the Hounsfield unit. Second, the 3D CNN features are extracted from the lung region images based on a truncated transfer learning strategy. Then, the lung radiomics features are extracted from the lung region images by PyRadiomics. Third, the MLP classifier with the best classification performance is determined by the 3D CNN features and the lung radiomics features. Finally, the proposed combined feature vector is used to improve the MLP classifier's performance. The results show that compared with CNN models and other ML classifiers, the MLP classifier with the best classification performance is determined. The MLP classifier with the proposed combined feature vector has achieved accuracy, mean precision, mean recall, mean F1-score, and AUC of 0.879, 0.879, 0.879, 0.875, and 0.971, respectively. Compared to the MLP classifier with the 3D CNN features selected by Lasso, our method based on the MLP classifier has improved the classification performance by 5.8% (accuracy), 5.3% (mean precision), 5.8% (mean recall), 5.4% (mean F1-score), and 2.5% (AUC). Compared to the MLP classifier with lung radiomics features selected by Lasso, our method based on the MLP classifier has improved the classification performance by 5.0% (accuracy), 5.1% (mean precision), 5.0% (mean recall), 5.1% (mean F1-score), and 2.1% (AUC). Therefore, it is concluded that our method is effective in improving the classification performance for COPD stage classification.

Multi-modal data combination strategy based on chest HRCT images and PFT parameters for intelligent dyspnea identification in COPD

Introduction

Because of persistent airflow limitation in chronic obstructive pulmonary disease (COPD), patients with COPD often have complications of dyspnea. However, as a leading symptom of COPD, dyspnea in COPD deserves special consideration regarding treatment in this fragile population for pre-clinical health management in COPD. Methods: Based on the above, this paper proposes a multi-modal data combination strategy by combining the local and global features for dyspnea identification in COPD based on the multi-layer perceptron (MLP) classifier.

Methods

First, lung region images are automatically segmented from chest HRCT images for extracting the original 1,316 lung radiomics (OLR, 1,316) and 13,824 3D CNN features (O3C, 13,824). Second, the local features, including five selected pulmonary function test (PFT) parameters (SLF, 5), 28 selected lung radiomics (SLR, 28), and 22 selected 3D CNN features (S3C, 22), are respectively selected from the original 11 PFT parameters (OLF, 11), 1,316 OLR, and 13,824 O3C by the least absolute shrinkage and selection operator (Lasso) algorithm. Meantime, the global features, including two fused PFT parameters (FLF, 2), six fused lung radiomics (FLR, 6), and 34 fused 3D CNN features (F3C, 34), are respectively fused by 11 OLF, 1,316 OLR, and 13,824 O3C using the principal component analysis (PCA) algorithm. Finally, we combine all the local and global features (SLF + FLF + SLR + FLR + S3C + F3C, 5+ 2 + 28 + 6 + 22 + 34) for dyspnea identification in COPD based on the MLP classifier.

Results

Our proposed method comprehensively improves classification performance. The MLP classifier with all the local and global features achieves the best classification performance at 87.7% of accuracy, 87.7% of precision, 87.7% of recall, 87.7% of F1-scorel, and 89.3% of AUC, respectively.

Discussion

Compared with single-modal data, the proposed strategy effectively improves the classification performance for dyspnea identification in COPD, providing an objective and effective tool for COPD management.

Lung Radiomics Features Selection for COPD Stage Classification Based on Auto-Metric Graph Neural Network

Chronic obstructive pulmonary disease (COPD) is a preventable, treatable, progressive chronic disease characterized by persistent airflow limitation. Patients with COPD deserve special consideration regarding treatment in this fragile population for preclinical health management. Therefore, this paper proposes a novel lung radiomics combination vector generated by a generalized linear model (GLM) and Lasso algorithm for COPD stage classification based on an auto-metric graph neural network (AMGNN) with a meta-learning strategy. Firstly, the parenchyma images were segmented from chest high-resolution computed tomography (HRCT) images by ResU-Net. Second, lung radiomics features are extracted from the parenchyma images by PyRadiomics. Third, a novel lung radiomics combination vector (3 + 106) is constructed by the GLM and Lasso algorithm for determining the radiomics risk factors (K = 3) and radiomics node features (d = 106). Last, the COPD stage is classified based on the AMGNN. The results show that compared with the convolutional neural networks and machine learning models, the AMGNN based on constructed novel lung radiomics combination vector performs best, achieving an accuracy of 0.943, precision of 0.946, recall of 0.943, F1-score of 0.943, and ACU of 0.984. Furthermore, it is found that our method is effective for COPD stage classification.

Lung radiomics features for characterizing and classifying COPD stage based on feature combination strategy and multi-layer perceptron classifier

Computed tomography (CT) has been the most effective modality for characterizing and quantifying chronic obstructive pulmonary disease (COPD). Radiomics features extracted from the region of interest in chest CT images have been widely used for lung diseases, but they have not yet been extensively investigated for COPD. Therefore, it is necessary to understand COPD from the lung radiomics features and apply them for COPD diagnostic applications, such as COPD stage classification. Lung radiomics features are used for characterizing and classifying the COPD stage in this paper. First, 19 lung radiomics features are selected from 1316 lung radiomics features per subject by using Lasso. Second, the best performance classifier (multi-layer perceptron classifier, MLP classifier) is determined. Third, two lung radiomics combination features, Radiomics-FIRST and Radiomics-ALL, are constructed based on 19 selected lung radiomics features by using the proposed lung radiomics combination strategy for characterizing the COPD stage. Lastly, the 19 selected lung radiomics features with Radiomics-FIRST/Radiomics-ALL are used to classify the COPD stage based on the best performance classifier. The results show that the classification ability of lung radiomics features based on machine learning (ML) methods is better than that of the chest high-resolution CT (HRCT) images based on classic convolutional neural networks (CNNs). In addition, the classifier performance of the 19 lung radiomics features selected by Lasso is better than that of the 1316 lung radiomics features. The accuracy, precision, recall, F1-score and AUC of the MLP classifier with the 19 selected lung radiomics features and Radiomics-ALL were 0.83, 0.83, 0.83, 0.82 and 0.95, respectively. It is concluded that, for the chest HRCT images, compared to the classic CNN, the ML methods based on lung radiomics features are more suitable and interpretable for COPD classification. In addition, the proposed lung radiomics combination strategy for characterizing the COPD stage effectively improves the classifier performance by 12% overall (accuracy: 3%, precision: 3%, recall: 3%, F1-score: 2% and AUC: 1%).

Early COPD Risk Decision for Adults Aged From 40 to 79 Years Based on Lung Radiomics Features

Background

Chronic obstructive pulmonary disease (COPD), a preventable lung disease, has the highest prevalence in the elderly and deserves special consideration regarding earlier warnings in this fragile population. The impact of age on COPD is well known, but the COPD risk of the aging process in the lungs remains unclear. Therefore, it is necessary to understand the COPD risk of the aging process in the lungs, providing an early COPD risk decision for adults.

Methods

COPD risk is evaluated for adults to make an early COPD risk decision from the perspective of lung radiomics features. First, the subjects are divided into four groups according to the COPD stages. Their ages are divided into eight equal age intervals in each group. Second, four survival Cox models are established based on the lung radiomics features to evaluate the risk probability from COPD stage 0 to suffering COPD and COPD stages. Finally, four risk ranks are defined by equally dividing the COPD risk probability from 0 to 1. Subsequently, the COPD risk at different stages is evaluated with varying age intervals to provide an early COPD risk decision.

Results

The evaluation metrics area under the curve (AUC)/C index of four survival Cox models are 0.87/0.94, 0.84/0.83, 0.94/0.89, and 0.97/0.86, respectively, showing the effectiveness of the models. The risk rank levels up every 5 years for the subjects who had suffered COPD after 60. For the subjects with COPD stage 0, the risk rank of suffering COPD stage I levels up every 5 years after the age of 65 years, and the risk rank of suffering COPD stages II and III &amp; IV levels up every 5 years after the age of 70 years.

Conclusion

Once the age is above 60 years, the patients with COPD need to take action to prevent the progress and deterioration of COPD. Once the age is above 65 years, the patients with COPD stage 0 need to take precautions against COPD.

Kidney Tumor Segmentation Based on FR2PAttU-Net Model

The incidence rate of kidney tumors increases year by year, especially for some incidental small tumors. It is challenging for doctors to segment kidney tumors from kidney CT images. Therefore, this paper proposes a deep learning model based on FR2PAttU-Net to help doctors process many CT images quickly and efficiently and save medical resources. FR2PAttU-Net is not a new CNN structure but focuses on improving the segmentation effect of kidney tumors, even when the kidney tumors are not clear. Firstly, we use the R2Att network in the "U" structure of the original U-Net, add parallel convolution, and construct FR2PAttU-Net model, to increase the width of the model, improve the adaptability of the model to the features of different scales of the image, and avoid the failure of network deepening to learn valuable features. Then, we use the fuzzy set enhancement algorithm to enhance the input image and construct the FR2PAttU-Net model to make the image obtain more prominent features to adapt to the model. Finally, we used the KiTS19 data set and took the size of the kidney tumor as the category judgment standard to enhance the small sample data set to balance the sample data set. We tested the segmentation effect of the model at different convolution and depths, and we got scored a 0.948 kidney Dice and a 0.911 tumor Dice results in a 0.930 composite score, showing a good segmentation effect.

A novel lung radiomics feature for characterizing resting heart rate and COPD stage evolution based on radiomics feature combination strategy

The resting HR is an upward trend with the development of chronic obstructive pulmonary disease (COPD) severity. Chest computed tomography (CT) has been regarded as the most effective modality for characterizing and quantifying COPD. Therefore, CT images should provide more information to analyze the lung and heart relationship. The relationship between HR variability and PFT or/and COPD has been fully revealed, but the relationship between resting HR variability and COPD radiomics features remains unclear. 231 sets of chest high-resolution CT (HRCT) images from "COPD patients" (at risk of COPD and stage I to IV) are segmented by the trained lung region segmentation model (ResU-Net). Based on the chest HRCT images and lung segmentation images, 231 sets of the original lung parenchyma images are obtained. 1316 COPD radiomics features of each subject are calculated by the original lung parenchyma images and its derived lung parenchyma images. The 13 selected COPD radiomics features related to the resting HR are generated from the Lasso model. A COPD radiomics features combination strategy is proposed to satisfy the significant change of the lung radiomics feature among the different COPD stages. Results show no significance between COPD stage Ⅰ and COPD stage Ⅱ of the 13 selected COPD radiomics features, and the lung radiomics feature Y1-Y4 (P > 0.05). The lung radiomics feature F2 with the dominant selected COPD radiomics features based on the proposed COPD radiomics features combination significantly increases with the development of COPD stages (P < 0.05). It is concluded that the lung radiomics feature F2 with the dominant selected COPD radiomics features not only can characterize the resting HR but also can characterize the COPD stage evolution.