ACTIVE LEARNING GUIDED INTERACTIONS FOR CONSISTENT IMAGE SEGMENTATION WITH REDUCED USER INTERACTIONS

Volumetric analysis of IDH-mutant lower-grade glioma: a natural history study of tumor growth rates before and after treatment

BACKGROUND

Lower-grade gliomas (LGGs) with isocitrate dehydrogenase 1 and/or 2 (IDH1/2) mutations have long survival times, making evaluation of treatment efficacy difficult. We investigated the volumetric growth rate of IDH mutant gliomas before and after treatment with established glioma therapies to determine whether a significant change in growth rate could be documented and perhaps be used in the future to evaluate treatment response to investigational agents in LGG trials.

METHODS

In this multicenter retrospective study, 230 adult patients with IDH1/2 mutated LGGs (World Health Organization grade II or III) undergoing surgery, radiation, or chemotherapy for progressive non-enhancing tumor were identified. Subjects were required to have 3 MRI scans containing T2/fluid attenuated inversion recovery imaging spanning a minimum of 6 months prior to treatment. A mixed-effect model was used to estimate tumor growth prior to treatment. A subset of 95 patients who received chemotherapy, radiotherapy, or chemoradiotherapy and had 2 posttreatment imaging time points available were evaluated for change in pre- and posttreatment volumetric growth rates using a piecewise mixed model.

RESULTS

The pretreatment volumetric growth rate across all 230 patients was 27.37%/180 days (95% CI: [23.36%, 31.51%]). In the 95 patients with both pre- and posttreatment scans available, there was a significant difference in volumetric growth rates before (26.63%/180 days, 95% CI: [19.31%, 34.40%]) and after treatment (-15.24% /180 days, 95% CI: [-21.37%, -8.62%]) (P < 0.0001). The growth rates for patient subgroup with 1p/19q codeletion (N = 118) was significantly slower than the rate of the 1p/19q non-codeleted group (N = 68) (22.84% vs 35.49%, P = 0.0108).

CONCLUSION

In this study, we evaluated the growth rates of IDH mutant gliomas before and after standard therapy. Further study is needed to establish whether a change in growth rate is associated with patient survival and its use as a surrogate endpoint in clinical trials for IDH mutant LGGs.

Intelligent Labeling Based on Fisher Information for Medical Image Segmentation Using Deep Learning

Deep convolutional neural networks (CNN) have recently achieved superior performance at the task of medical image segmentation compared to classic models. However, training a generalizable CNN requires a large amount of training data, which is difficult, expensive, and time-consuming to obtain in medical settings. Active Learning (AL) algorithms can facilitate training CNN models by proposing a small number of the most informative data samples to be annotated to achieve a rapid increase in performance. We proposed a new active learning method based on Fisher information (FI) for CNNs for the first time. Using efficient backpropagation methods for computing gradients together with a novel low-dimensional approximation of FI enabled us to compute FI for CNNs with a large number of parameters. We evaluated the proposed method for brain extraction with a patch-wise segmentation CNN model in two different learning scenarios: universal active learning and active semi-automatic segmentation. In both scenarios, an initial model was obtained using labeled training subjects of a source data set and the goal was to annotate a small subset of new samples to build a model that performs well on the target subject(s). The target data sets included images that differed from the source data by either age group (e.g. newborns with different image contrast) or underlying pathology that was not available in the source data. In comparison to several recently proposed AL methods and brain extraction baselines, the results showed that FI-based AL outperformed the competing methods in improving the performance of the model after labeling a very small portion of target data set (<0.25%).

Reliability of tumor segmentation in glioblastoma: Impact on the robustness of MRI-radiomic features

PURPOSE

The use of radiomic features as biomarkers of treatment response and outcome or as correlates to genomic variations requires that the computed features are robust and reproducible. Segmentation, a crucial step in radiomic analysis, is a major source of variability in the computed radiomic features. Therefore, we studied the impact of tumor segmentation variability on the robustness of MRI radiomic features.

METHOD

Fluid-attenuated inversion recovery (FLAIR) and contrast-enhanced T1-weighted (T1WI_CE ) MRI of 90 patients diagnosed with glioblastoma were segmented using a semiautomatic algorithm and an interactive segmentation with two different raters. We analyzed the robustness of 108 radiomic features from five categories (intensity histogram, gray-level co-occurrence matrix, gray-level size-zone matrix (GLSZM), edge maps, and shape) using intra-class correlation coefficient (ICC) and Bland and Altman analysis.

RESULTS

Our results show that both segmentation methods are reliable with ICC ≥ 0.96 and standard deviation (SD) of mean differences between the two raters (SD_diffs ) ≤ 30%. Features computed from the histogram and co-occurrence matrices were found to be the most robust (ICC ≥ 0.8 and SD_diffs  ≤ 30% for most features in these groups). Features from GLSZM were shown to have mixed robustness. Edge, shape, and GLSZM features were the most impacted by the choice of segmentation method with the interactive method resulting in more robust features than the semiautomatic method. Finally, features computed from T1WI_CE and FLAIR images were found to have similar robustness when computed with the interactive segmentation method.

CONCLUSION

Semiautomatic and interactive segmentation methods using two raters are both reliable. The interactive method produced more robust features than the semiautomatic method. We also found that the robustness of radiomic features varied by categories. Therefore, this study could help motivate segmentation methods and feature selection in MRI radiomic studies.

Preoperative MRI-radiomics features improve prediction of survival in glioblastoma patients over MGMT methylation status alone

BACKGROUND

Glioblastoma (GBM) is the most common malignant central nervous system tumor, and MGMT promoter hypermethylation in this tumor has been shown to be associated with better prognosis. We evaluated the capacity of radiomics features to add complementary information to MGMT status, to improve the ability to predict prognosis.

METHODS

159 patients with untreated GBM were included in this study and divided into training and independent test sets. 286 radiomics features were extracted from the magnetic resonance images acquired prior to any treatments. A least absolute shrinkage selection operator (LASSO) selection followed by Kaplan-Meier analysis was used to determine the prognostic value of radiomics features to predict overall survival (OS). The combination of MGMT status with radiomics was also investigated and all results were validated on the independent test set.

RESULTS

LASSO analysis identified 8 out of the 286 radiomic features to be relevant which were then used for determining association to OS. One feature (edge descriptor) remained significant on the external validation cohort after multiple testing (p=0.04) and the combination with MGMT identified a group of patients with the best prognosis with a survival probability of 0.61 after 43 months (p=0.0005).

CONCLUSION

Our results suggest that combining radiomics with MGMT is more accurate in stratifying patients into groups of different survival risks when compared to with using these predictors in isolation. We identified two subgroups within patients who have methylated MGMT: one with a similar survival to unmethylated MGMT patients and the other with a significantly longer OS.

Multiple Resolution Residually Connected Feature Streams for Automatic Lung Tumor Segmentation From CT Images

Volumetric lung tumor segmentation and accurate longitudinal tracking of tumor volume changes from computed tomography images are essential for monitoring tumor response to therapy. Hence, we developed two multiple resolution residually connected network (MRRN) formulations called incremental-MRRN and dense-MRRN. Our networks simultaneously combine features across multiple image resolution and feature levels through residual connections to detect and segment the lung tumors. We evaluated our method on a total of 1210 non-small cell (NSCLC) lung tumors and nodules from three data sets consisting of 377 tumors from the open-source Cancer Imaging Archive (TCIA), 304 advanced stage NSCLC treated with anti- PD-1 checkpoint immunotherapy from internal institution MSKCC data set, and 529 lung nodules from the Lung Image Database Consortium (LIDC). The algorithm was trained using 377 tumors from the TCIA data set and validated on the MSKCC and tested on LIDC data sets. The segmentation accuracy compared to expert delineations was evaluated by computing the dice similarity coefficient, Hausdorff distances, sensitivity, and precision metrics. Our best performing incremental-MRRN method produced the highest DSC of 0.74 ± 0.13 for TCIA, 0.75±0.12 for MSKCC, and 0.68±0.23 for the LIDC data sets. There was no significant difference in the estimations of volumetric tumor changes computed using the incremental-MRRN method compared with the expert segmentation. In summary, we have developed a multi-scale CNN approach for volumetrically segmenting lung tumors which enables accurate, automated identification of and serial measurement of tumor volumes in the lung.

Appearance Constrained Semi-Automatic Segmentation from DCE-MRI is Reproducible and Feasible for Breast Cancer Radiomics: A Feasibility Study

We present a segmentation approach that combines GrowCut (GC) with cancer-specific multi-parametric Gaussian Mixture Model (GCGMM) to produce accurate and reproducible segmentations. We evaluated GCGMM using a retrospectively collected 75 invasive ductal carcinoma with ERPR+ HER2− (n = 15), triple negative (TN) (n = 9), and ER-HER2+ (n = 57) cancers with variable presentation (mass and non-mass enhancement) and background parenchymal enhancement (mild and marked). Expert delineated manual contours were used to assess the segmentation performance using Dice coefficient (DSC), mean surface distance (mSD), Hausdorff distance, and volume ratio (VR). GCGMM segmentations were significantly more accurate than GrowCut (GC) and fuzzy c-means clustering (FCM). GCGMM’s segmentations and the texture features computed from those segmentations were the most reproducible compared with manual delineations and other analyzed segmentation methods. Finally, random forest (RF) classifier trained with leave-one-out cross-validation using features extracted from GCGMM segmentation resulted in the best accuracy for ER-HER2+ vs. ERPR+/TN (GCGMM 0.95, expert 0.95, GC 0.90, FCM 0.92) and for ERPR + HER2− vs. TN (GCGMM 0.92, expert 0.91, GC 0.77, FCM 0.83).

Vision 20/20: perspectives on automated image segmentation for radiotherapy

Due to rapid advances in radiation therapy (RT), especially image guidance and treatment adaptation, a fast and accurate segmentation of medical images is a very important part of the treatment. Manual delineation of target volumes and organs at risk is still the standard routine for most clinics, even though it is time consuming and prone to intra- and interobserver variations. Automated segmentation methods seek to reduce delineation workload and unify the organ boundary definition. In this paper, the authors review the current autosegmentation methods particularly relevant for applications in RT. The authors outline the methods' strengths and limitations and propose strategies that could lead to wider acceptance of autosegmentation in routine clinical practice. The authors conclude that currently, autosegmentation technology in RT planning is an efficient tool for the clinicians to provide them with a good starting point for review and adjustment. Modern hardware platforms including GPUs allow most of the autosegmentation tasks to be done in a range of a few minutes. In the nearest future, improvements in CT-based autosegmentation tools will be achieved through standardization of imaging and contouring protocols. In the longer term, the authors expect a wider use of multimodality approaches and better understanding of correlation of imaging with biology and pathology.

4D ACTIVE CUT: AN INTERACTIVE TOOL FOR PATHOLOGICAL ANATOMY MODELING

4D pathological anatomy modeling is key to understanding complex pathological brain images. It is a challenging problem due to the difficulties in detecting multiple appearing and disappearing lesions across time points and estimating dynamic changes and deformations between them. We propose a novel semi-supervised method, called 4D active cut, for lesion recognition and deformation estimation. Existing interactive segmentation methods passively wait for user to refine the segmentations which is a difficult task in 3D images that change over time. 4D active cut instead actively selects candidate regions for querying the user, and obtains the most informative user feedback. A user simply answers 'yes' or 'no' to a candidate object without having to refine the segmentation slice by slice. Compared to single-object detection of the existing methods, our method also detects multiple lesions with spatial coherence using Markov random fields constraints. Results show improvement on the lesion detection, which subsequently improves deformation estimation.

3D Slicer as an image computing platform for the Quantitative Imaging Network

Quantitative analysis has tremendous but mostly unrealized potential in healthcare to support objective and accurate interpretation of the clinical imaging. In 2008, the National Cancer Institute began building the Quantitative Imaging Network (QIN) initiative with the goal of advancing quantitative imaging in the context of personalized therapy and evaluation of treatment response. Computerized analysis is an important component contributing to reproducibility and efficiency of the quantitative imaging techniques. The success of quantitative imaging is contingent on robust analysis methods and software tools to bring these methods from bench to bedside. 3D Slicer is a free open-source software application for medical image computing. As a clinical research tool, 3D Slicer is similar to a radiology workstation that supports versatile visualizations but also provides advanced functionality such as automated segmentation and registration for a variety of application domains. Unlike a typical radiology workstation, 3D Slicer is free and is not tied to specific hardware. As a programming platform, 3D Slicer facilitates translation and evaluation of the new quantitative methods by allowing the biomedical researcher to focus on the implementation of the algorithm and providing abstractions for the common tasks of data communication, visualization and user interface development. Compared to other tools that provide aspects of this functionality, 3D Slicer is fully open source and can be readily extended and redistributed. In addition, 3D Slicer is designed to facilitate the development of new functionality in the form of 3D Slicer extensions. In this paper, we present an overview of 3D Slicer as a platform for prototyping, development and evaluation of image analysis tools for clinical research applications. To illustrate the utility of the platform in the scope of QIN, we discuss several use cases of 3D Slicer by the existing QIN teams, and we elaborate on the future directions that can further facilitate development and validation of imaging biomarkers using 3D Slicer.