Application of nnU-Net for Automatic Segmentation of Lung Lesions on CT Images and Its Implication for Radiomic Models

Systematic review and meta-analysis of deep learning applications in computed tomography lung cancer segmentation

BACKGROUND

Accurate segmentation of lung tumors on chest computed tomography (CT) scans is crucial for effective diagnosis and treatment planning. Deep Learning (DL) has emerged as a promising tool in medical imaging, particularly for lung cancer segmentation. However, its efficacy across different clinical settings and tumor stages remains variable.

METHODS

We conducted a comprehensive search of PubMed, Embase, and Web of Science until November 7, 2023. We assessed the quality of these studies by using the Checklist for Artificial Intelligence in Medical Imaging and the Quality Assessment of Diagnostic Accuracy Studies-2 tools. This analysis included data from various clinical settings and stages of lung cancer. Key performance metrics, such as the Dice similarity coefficient, were pooled, and factors affecting algorithm performance, such as clinical setting, algorithm type, and image processing techniques, were examined.

RESULTS

Our analysis of 37 studies revealed a pooled Dice score of 79 % (95 % CI: 76 %-83 %), indicating moderate accuracy. Radiotherapy studies had a slightly lower score of 78 % (95 % CI: 74 %-82 %). A temporal increase was noted, with recent studies (post-2022) showing improvement from 75 % (95 % CI: 70 %-81 %). to 82 % (95 % CI: 81 %-84 %). Key factors affecting performance included algorithm type, resolution adjustment, and image cropping. QUADAS-2 assessments identified ambiguous risks in 78 % of studies due to data interval omissions and concerns about generalizability in 8 % due to nodule size exclusions, and CLAIM criteria highlighted areas for improvement, with an average score of 27.24 out of 42.

CONCLUSION

This meta-analysis demonstrates DL algorithms' promising but varied efficacy in lung cancer segmentation, particularly higher efficacy noted in early stages. The results highlight the critical need for continued development of tailored DL models to improve segmentation accuracy across diverse clinical settings, especially in advanced cancer stages with greater challenges. As recent studies demonstrate, ongoing advancements in algorithmic approaches are crucial for future applications.

Automatic liver segmentation and assessment of liver fibrosis using deep learning with MR T1-weighted images in rats

OBJECTIVES

To validate the performance of nnU-Net in segmentation and CNN in classification for liver fibrosis using T1-weighted images.

MATERIALS AND METHODS

In this prospective study, animal models of liver fibrosis were induced by injecting subcutaneously a mixture of Carbon tetrachloride and olive oil. A total of 99 male Wistar rats were successfully induced and underwent MR scanning with no contrast agent to get T1-weighted images. The regions of interest (ROIs) of the whole liver were delineated layer by layer along the liver edge by 3D Slicer. For segmentation task, all T1-weighted images were randomly divided into training and test cohorts in a ratio of 7:3. For classification, images containing the hepatic maximum diameter of every rat were selected and 80% images of no liver fibrosis (NLF), early liver fibrosis (ELF) and progressive liver fibrosis (PLF) stages were randomly selected for training, while the rest were used for testing. Liver segmentation was performed by the nnU-Net model. The convolutional neural network (CNN) was used for classification task of liver fibrosis stages. The Dice similarity coefficient was used to evaluate the segmentation performance of nnU-Net. Confusion matrix, ROC curve and accuracy were used to show the classification performance of CNN.

RESULTS

A total of 2628 images were obtained from 99 Wistar rats by MR scanning. For liver segmentation by nnU-Net, the Dice similarity coefficient in the test set was 0.8477. The accuracies of CNN in staging NLF, ELF and PLF were 0.73, 0.89 and 0.84, respectively. The AUCs were 0.76, 0.88 and 0.79, respectively.

CONCLUSION

The nnU-Net architecture is of high accuracy for liver segmentation and CNN for assessment of liver fibrosis with T1-weighted images.

Implementing a deep learning model for automatic tongue tumour segmentation in ex-vivo 3-dimensional ultrasound volumes

Three-dimensional (3D) ultrasound can assess the margins of resected tongue carcinoma during surgery. Manual segmentation (MS) is time-consuming, labour-intensive, and subject to operator variability. This study aims to investigate use of a 3D deep learning model for fast intraoperative segmentation of tongue carcinoma in 3D ultrasound volumes. Additionally, it investigates the clinical effect of automatic segmentation. A 3D No New U-Net (nnUNet) was trained on 113 manually annotated ultrasound volumes of resected tongue carcinoma. The model was implemented on a mobile workstation and clinically validated on 16 prospectively included tongue carcinoma patients. Different prediction settings were investigated. Automatic segmentations with multiple islands were adjusted by selecting the best-representing island. The final margin status (FMS) based on automatic, semi-automatic, and manual segmentation was computed and compared with the histopathological margin. The standard 3D nnUNet resulted in the best-performing automatic segmentation with a mean (SD) Dice volumetric score of 0.65 (0.30), Dice surface score of 0.73 (0.26), average surface distance of 0.44 (0.61) mm, Hausdorff distance of 6.65 (8.84) mm, and prediction time of 8 seconds. FMS based on automatic segmentation had a low correlation with histopathology (r = 0.12, p = 0.67); MS resulted in a moderate but insignificant correlation with histopathology (r = 0.4, p = 0.12, n = 16). Implementing the 3D nnUNet yielded fast, automatic segmentation of tongue carcinoma in 3D ultrasound volumes. Correlation between FMS and histopathology obtained from these segmentations was lower than the moderate correlation between MS and histopathology.

Segmentation method of magnetic resonance imaging brain tumor images based on improved UNet network

Background

Glioma is a primary malignant craniocerebral tumor commonly found in the central nervous system. According to research, preoperative diagnosis of glioma and a full understanding of its imaging features are very significant. Still, the traditional segmentation methods of image dispensation and machine wisdom are not acceptable in glioma segmentation. This analysis explores the potential of magnetic resonance imaging (MRI) brain tumor images as an effective segmentation method of glioma.

Methods

This study used 200 MRI images from the affiliated hospital and applied the 2-dimensional residual block UNet (2DResUNet). Features were extracted from input images using a 2×2 kernel size (64-kernel) 1-step 2D convolution (Conv) layer. The 2DDenseUNet model implemented in this study incorporates a ResBlock mechanism within the UNet architecture, as well as a Gaussian noise layer for data augmentation at the input stage, and a pooling layer for replacing the conventional 2D convolutional layers. Finally, the performance of the proposed protocol and its effective measures in glioma segmentation were verified.

Results

The outcomes of the 5-fold cross-validation evaluation show that the proposed 2DResUNet and 2DDenseUNet structure has a high sensitivity despite the slightly lower evaluation result on the Dice score. At the same time, compared with other models used in the experiment, the DM-DA-UNet model proposed in this paper was significantly improved in various indicators, increasing the reliability of the model and providing a reference and basis for the accurate formulation of clinical treatment strategies. The method used in this study showed stronger feature extraction ability than the UNet model. In addition, our findings demonstrated that using generalized die harm and prejudiced cross entropy as loss functions in the training process effectively alleviated the class imbalance of glioma data and effectively segmented glioma.

Conclusions

The method based on the improved UNet network has obvious advantages in the MRI brain tumor portrait segmentation procedure. The result showed that we developed a 2D residual block UNet, which can improve the incorporation of glioma segmentation into the clinical process.

Association between Contrast-Enhanced Computed Tomography Radiomic Features, Genomic Alterations and Prognosis in Advanced Lung Adenocarcinoma Patients

Non-invasive methods to assess mutational status, as well as novel prognostic biomarkers, are warranted to foster therapy personalization of patients with advanced non-small cell lung cancer (NSCLC). This study investigated the association of contrast-enhanced Computed Tomography (CT) radiomic features of lung adenocarcinoma lesions, alone or integrated with clinical parameters, with tumor mutational status (EGFR, KRAS, ALK alterations) and Overall Survival (OS). In total, 261 retrospective and 48 prospective patients were enrolled. A Radiomic Score (RS) was created with LASSO-Logistic regression models to predict mutational status. Radiomic, clinical and clinical-radiomic models were trained on retrospective data and tested (Area Under the Curve, AUC) on prospective data. OS prediction models were trained and tested on retrospective data with internal cross-validation (C-index). RS significantly predicted each alteration at training (radiomic and clinical-radiomic AUC 0.95-0.98); validation performance was good for EGFR (AUC 0.86), moderate for KRAS and ALK (AUC 0.61-0.65). RS was also associated with OS at univariate and multivariable analysis, in the latter with stage and type of treatment. The validation C-index was 0.63, 0.79, and 0.80 for clinical, radiomic, and clinical-radiomic models. The study supports the potential role of CT radiomics for non-invasive identification of gene alterations and prognosis prediction in patients with advanced lung adenocarcinoma, to be confirmed with independent studies.