Appearance Constrained Semi-Automatic Segmentation from DCE-MRI is Reproducible and Feasible for Breast Cancer Radiomics: A Feasibility Study

Machine Learning Model for Predicting Axillary Lymph Node Metastasis in Clinically Node Positive Breast Cancer Based on Peritumoral Ultrasound Radiomics and SHAP Feature Analysis

OBJECTIVE

This study seeks to construct a machine learning model that merges clinical characteristics with ultrasound radiomic analysis-encompassing both the intratumoral and peritumoral-to predict the status of axillary lymph nodes in patients with early-stage breast cancer.

METHODS

The study employed retrospective methods, collecting clinical information, ultrasound data, and postoperative pathological results from 321 breast cancer patients (including 224 in the training group and 97 in the validation group). Through correlation analysis, univariate analysis, and Lasso regression analysis, independent risk factors related to axillary lymph node metastasis in breast cancer were identified from conventional ultrasound and immunohistochemical indicators, and a clinical feature model was constructed. Additionally, features were extracted from ultrasound images of the intratumoral and its 1-5 mm peritumoral to establish a radiomics feature formula. Furthermore, by combining clinical features and ultrasound radiomics features, six machine learning models (Logistic Regression, Decision Tree, Support Vector Machine, Extreme Gradient Boosting, Random Forest, and K-Nearest Neighbors) were compared for diagnostic efficacy, and constructing a joint prediction model based on the optimal ML algorithm. The use of Shapley Additive Explanations (SHAP) enhanced the visualization and interpretability of the model during the diagnostic process.

RESULTS

Among the 321 breast cancer patients, 121 had axillary lymph node metastasis, and 200 did not. The clinical feature model had an AUC of 0.779 and 0.777 in the training and validation groups, respectively. Radiomics model analysis showed that the model including the Intratumor +3 mm peritumor area had the best diagnostic performance, with AUCs of 0.847 and 0.844 in the training and validation groups, respectively. The joint prediction model based on the XGBoost algorithm reached AUCs of 0.917 and 0.905 in the training and validation groups, respectively. SHAP analysis indicated that the Rad Score had the highest weight in the prediction model, playing a significant role in predicting axillary lymph node metastasis in breast cancer.

CONCLUSION

The predictive model, which integrates clinical features and radiomic characteristics using the XGBoost algorithm, demonstrates significant diagnostic value for axillary lymph node metastasis in breast cancer. This model can provide significant references for preoperative surgical strategy selection and prognosis evaluation for breast cancer patients, helping to reduce postoperative complications and improve long-term survival rates. Additionally, the utilization of SHAP enhancing the global and local interpretability of the model.

The Convergence of Radiology and Genomics: Advancing Breast Cancer Diagnosis with Radiogenomics

Despite significant progress in the prevention, screening, diagnosis, prognosis, and therapy of breast cancer (BC), it remains a highly prevalent and life-threatening disease affecting millions worldwide. Molecular subtyping of BC is crucial for predictive and prognostic purposes due to the diverse clinical behaviors observed across various types. The molecular heterogeneity of BC poses uncertainties in its impact on diagnosis, prognosis, and treatment. Numerous studies have highlighted genetic and environmental differences between patients from different geographic regions, emphasizing the need for localized research. International studies have revealed that patients with African heritage are often diagnosed at a more advanced stage and exhibit poorer responses to treatment and lower survival rates. Despite these global findings, there is a dearth of in-depth studies focusing on communities in the African region. Early diagnosis and timely treatment are paramount to improving survival rates. In this context, radiogenomics emerges as a promising field within precision medicine. By associating genetic patterns with image attributes or features, radiogenomics has the potential to significantly improve early detection, prognosis, and diagnosis. It can provide valuable insights into potential treatment options and predict the likelihood of survival, progression, and relapse. Radiogenomics allows for visual features and genetic marker linkage that promises to eliminate the need for biopsy and sequencing. The application of radiogenomics not only contributes to advancing precision oncology and individualized patient treatment but also streamlines clinical workflows. This review aims to delve into the theoretical underpinnings of radiogenomics and explore its practical applications in the diagnosis, management, and treatment of BC and to put radiogenomics on a path towards fully integrated diagnostics.

Volumetric measurement of paranasal sinuses and its clinical significance in pituitary neuroendocrine tumors operated using an endoscopic endonasal approach

Objective

Endoscopic endonasal surgery (EES) for deep intracranial lesions has gained popularity following recent developments in endoscopic technology. The operability of invasive pituitary neuroendocrine tumors (PitNETs) depends on the anatomy of the nasal cavity and paranasal sinus. This study aimed to establish a simple volume reconstruction algorithm of the nasal cavity and paranasal sinus. Additionally, this is the first study to demonstrate the relationship between the segmentation method and the clinical significance in patients with PitNET.

Methods

Pre-and postoperative tumor volumes were analyzed in 106 patients with primary (new-onset) PitNETs (80 nonfunctioning and 26 functioning) who underwent EES. The efficiency and accuracy of the semiautomatic segmentation with manual adjustments (SSMA) method was compared with other established segmentation methods for volumetric analysis in the nasal cavity and paranasal sinuses. Correlations between the measured nasal cavity and paranasal sinus volumes and the extent of tumor removal were evaluated.

Results

The SSMA method yielded accurate and time-saving results following the volumetric analyses of nasal cavity and paranasal sinuses with complex structures. Alternatively, the manual and semiautomatic segmentation methods proved time-consuming and inaccurate, respectively. The sphenoid sinus volume measured by SSMA was significantly correlated with the extent of tumor removal in patients with nonfunctioning Knosp grade 3 and 4 PitNET (r = 0.318; p = 0.015).

Conclusion

The volume of sphenoid sinus potentially could predict the extent of resection due to better visualization of the tumor for PitNETs with CS invasion.

Application of Deep Learning in Histopathology Images of Breast Cancer: A Review

With the development of artificial intelligence technology and computer hardware functions, deep learning algorithms have become a powerful auxiliary tool for medical image analysis. This study was an attempt to use statistical methods to analyze studies related to the detection, segmentation, and classification of breast cancer in pathological images. After an analysis of 107 articles on the application of deep learning to pathological images of breast cancer, this study is divided into three directions based on the types of results they report: detection, segmentation, and classification. We introduced and analyzed models that performed well in these three directions and summarized the related work from recent years. Based on the results obtained, the significant ability of deep learning in the application of breast cancer pathological images can be recognized. Furthermore, in the classification and detection of pathological images of breast cancer, the accuracy of deep learning algorithms has surpassed that of pathologists in certain circumstances. Our study provides a comprehensive review of the development of breast cancer pathological imaging-related research and provides reliable recommendations for the structure of deep learning network models in different application scenarios.

Radiogenomics, Breast Cancer Diagnosis and Characterization: Current Status and Future Directions

Breast cancer (BC) is a heterogeneous disease, affecting millions of women every year. Early diagnosis is crucial to increasing survival. The clinical workup of BC diagnosis involves diagnostic imaging and bioptic characterization. In recent years, technical advances in image processing allowed for the application of advanced image analysis (radiomics) to clinical data. Furthermore, -omics technologies showed their potential in the characterization of BC. Combining information provided by radiomics with -omics data can be important to personalize diagnostic and therapeutic work up in a clinical context for the benefit of the patient. In this review, we analyzed the recent literature, highlighting innovative approaches to combine imaging and biochemical/biological data, with the aim of identifying recent advances in radiogenomics applied to BC. The results of radiogenomic studies are encouraging approaches in a clinical setting. Despite this, as radiogenomics is an emerging area, the optimal approach has to face technical limitations and needs to be applied to large cohorts including all the expression profiles currently available for BC subtypes (e.g., besides markers from transcriptomics, proteomics and miRNomics, also other non-coding RNA profiles).

Deep learning-based auto-segmentation of clinical target volumes for radiotherapy treatment of cervical cancer

Objectives

Because radiotherapy is indispensible for treating cervical cancer, it is critical to accurately and efficiently delineate the radiation targets. We evaluated a deep learning (DL)‐based auto‐segmentation algorithm for automatic contouring of clinical target volumes (CTVs) in cervical cancers.

Methods

Computed tomography (CT) datasets from 535 cervical cancers treated with definitive or postoperative radiotherapy were collected. A DL tool based on VB‐Net was developed to delineate CTVs of the pelvic lymph drainage area (dCTV1) and parametrial area (dCTV2) in the definitive radiotherapy group. The training/validation/test number is 157/20/23. CTV of the pelvic lymph drainage area (pCTV1) was delineated in the postoperative radiotherapy group. The training/validation/test number is 272/30/33. Dice similarity coefficient (DSC), mean surface distance (MSD), and Hausdorff distance (HD) were used to evaluate the contouring accuracy. Contouring times were recorded for efficiency comparison.

Results

The mean DSC, MSD, and HD values for our DL‐based tool were 0.88/1.32 mm/21.60 mm for dCTV1, 0.70/2.42 mm/22.44 mm for dCTV2, and 0.86/1.15 mm/20.78 mm for pCTV1. Only minor modifications were needed for 63.5% of auto‐segmentations to meet the clinical requirements. The contouring accuracy of the DL‐based tool was comparable to that of senior radiation oncologists and was superior to that of junior/intermediate radiation oncologists. Additionally, DL assistance improved the performance of junior radiation oncologists for dCTV2 and pCTV1 contouring (mean DSC increases: 0.20 for dCTV2, 0.03 for pCTV1; mean contouring time decrease: 9.8 min for dCTV2, 28.9 min for pCTV1).

Conclusions

DL‐based auto‐segmentation improves CTV contouring accuracy, reduces contouring time, and improves clinical efficiency for treating cervical cancer.

Background Parenchymal Enhancement on Breast MRI: Assessment and Clinical Implications

Purpose of Review

To present recent literature regarding the assessment and clinical implications of background parenchymal enhancement on breast MRI.

Recent Findings

The qualitative assessment of BPE remains variable within the literature, as well as in clinical practice. Several different quantitative approaches have been investigated in recent years, most commonly region of interest-based and segmentation-based assessments. However, quantitative assessment has not become standard in clinical practice to date. Numerous studies have demonstrated a clear association between higher BPE and future breast cancer risk. While higher BPE does not appear to significantly impact cancer detection, it may result in a higher abnormal interpretation rate. BPE is also likely a marker of pathologic complete response after neoadjuvant chemotherapy, with decreases in BPE during and after neoadjuvant chemotherapy correlated with pCR. In contrast, pre-treatment BPE does not appear to be predictive of pCR. The association between BPE and prognosis is less clear, with heterogeneous results in the literature.

Summary

Assessment of BPE continues to evolve, with heterogeneity in approaches to both qualitative and quantitative assessment. The level of BPE has important clinical implications, with associations with future breast cancer risk and treatment response. BPE may also be an imaging marker of prognosis, but future research is needed on this topic.

Radiomics Analysis in Ovarian Cancer: A Narrative Review

Ovarian cancer (OC) is the second most common gynecological malignancy, accounting for about 14,000 deaths in 2020 in the US. The recognition of tools for proper screening, early diagnosis, and prognosis of OC is still lagging. The application of methods such as radiomics to medical images such as ultrasound scan (US), computed tomography (CT), magnetic resonance imaging (MRI), or positron emission tomography (PET) in OC may help to realize so-called “precision medicine” by developing new quantification metrics linking qualitative and/or quantitative data imaging to achieve clinical diagnostic endpoints. This narrative review aims to summarize the applications of radiomics as a support in the management of a complex pathology such as ovarian cancer. We give an insight into the current evidence on radiomics applied to different imaging methods.

Radiomics and radiogenomics in ovarian cancer: a literature review

Ovarian cancer remains one of the most lethal gynecological cancers in the world despite extensive progress in the areas of chemotherapy and surgery. Many studies have postulated that this is because of the profound heterogeneity that underpins response to therapy and prognosis. Standard imaging evaluation using CT or MRI does not take into account this tumoral heterogeneity especially in advanced stages with peritoneal carcinomatosis. As such, newly emergent fields in the assessment of tumor heterogeneity have been proposed using radiomics to evaluate the whole tumor burden heterogeneity as opposed to single biopsy sampling. This review provides an overview of radiomics, radiogenomics, and proteomics and examines the use of these newly emergent fields in assessing tumor heterogeneity and its implications in ovarian cancer.

Using Deep Learning to Improve Nonsystematic Viewing of Breast Cancer on MRI

OBJECTIVE

To investigate the feasibility of using deep learning to identify tumor-containing axial slices on breast MRI images.

METHODS

This IRB-approved retrospective study included consecutive patients with operable invasive breast cancer undergoing pretreatment breast MRI between January 1, 2014, and December 31, 2017. Axial tumor-containing slices from the first postcontrast phase were extracted. Each axial image was subdivided into two subimages: one of the ipsilateral cancer-containing breast and one of the contralateral healthy breast. Cases were randomly divided into training, validation, and testing sets. A convolutional neural network was trained to classify subimages into "cancer" and "no cancer" categories. Accuracy, sensitivity, and specificity of the classification system were determined using pathology as the reference standard. A two-reader study was performed to measure the time savings of the deep learning algorithm using descriptive statistics.

RESULTS

Two hundred and seventy-three patients with unilateral breast cancer met study criteria. On the held-out test set, accuracy of the deep learning system for tumor detection was 92.8% (648/706; 95% confidence interval: 89.7%-93.8%). Sensitivity and specificity were 89.5% and 94.3%, respectively. Readers spent 3 to 45 seconds to scroll to the tumor-containing slices without use of the deep learning algorithm.

CONCLUSION

In breast MR exams containing breast cancer, deep learning can be used to identify the tumor-containing slices. This technology may be integrated into the picture archiving and communication system to bypass scrolling when viewing stacked images, which can be helpful during nonsystematic image viewing, such as during interdisciplinary tumor board meetings.

Radiomics feature robustness as measured using an MRI phantom

Radiomics involves high-throughput extraction of large numbers of quantitative features from medical images and analysis of these features to predict patients’ outcome and support clinical decision-making. However, radiomics features are sensitive to several factors, including scanning protocols. The purpose of this study was to investigate the robustness of magnetic resonance imaging (MRI) radiomics features with various MRI scanning protocol parameters and scanners using an MRI radiomics phantom. The variability of the radiomics features with different scanning parameters and repeatability measured using a test–retest scheme were evaluated using the coefficient of variation and intraclass correlation coefficient (ICC) for both T1- and T2-weighted images. For variability measures, the features were categorized into three groups: large, intermediate, and small variation. For repeatability measures, the average T1- and T2-weighted image ICCs for the phantom (0.963 and 0.959, respectively) were higher than those for a healthy volunteer (0.856 and 0.849, respectively). Our results demonstrated that various radiomics features are dependent on different scanning parameters and scanners. The radiomics features with a low coefficient of variation and high ICC for both the phantom and volunteer can be considered good candidates for MRI radiomics studies. The results of this study will assist current and future MRI radiomics studies.

The Era of Radiogenomics in Precision Medicine: An Emerging Approach to Support Diagnosis, Treatment Decisions, and Prognostication in Oncology

With the rapid development of new technologies, including artificial intelligence and genome sequencing, radiogenomics has emerged as a state-of-the-art science in the field of individualized medicine. Radiogenomics combines a large volume of quantitative data extracted from medical images with individual genomic phenotypes and constructs a prediction model through deep learning to stratify patients, guide therapeutic strategies, and evaluate clinical outcomes. Recent studies of various types of tumors demonstrate the predictive value of radiogenomics. And some of the issues in the radiogenomic analysis and the solutions from prior works are presented. Although the workflow criteria and international agreed guidelines for statistical methods need to be confirmed, radiogenomics represents a repeatable and cost-effective approach for the detection of continuous changes and is a promising surrogate for invasive interventions. Therefore, radiogenomics could facilitate computer-aided diagnosis, treatment, and prediction of the prognosis in patients with tumors in the routine clinical setting. Here, we summarize the integrated process of radiogenomics and introduce the crucial strategies and statistical algorithms involved in current studies.

Nomogram based on radiomics analysis of primary breast cancer ultrasound images: prediction of axillary lymph node tumor burden in patients

OBJECTIVES

To establish a prediction model for evaluating the axillary lymph node (ALN) status of patients with T1/T2 invasive breast cancer based on radiomics analysis of US images of primary breast lesions.

METHODS

Between August 2016 and November 2018, a total of 343 patients with histologically proven malignant breast tumors were included in this study and randomly assigned to the training and validation groups at a ratio of 7:3. ALN tumor burden was defined as low (< 3 metastatic ALNs) or high (≥ 3 metastatic ALNs). Radiomics features were obtained using the PyRadiomics package, and the radiomics score was established by least absolute shrinkage and selection operator regression. A nomogram combining the breast cancer US radiomics score with patient age and lesion size was generated based on the multivariate logistic regression results.

RESULTS

In the training and validation cohorts, 29.1% (69/237) and 32.08% (34/106) of patients were pathologically diagnosed with more than 2 metastatic ALNs, respectively. The radiomics score consisted of 16 US features, and patient age and lesion diameter identified by US were included to construct the model. The AUC of the model was 0.846 (95% CI, 0.790-0.902) for the training cohort and 0.733 (95% CI, 0.613-0.852) for the validation cohort. The calibration curves showed good agreement between the predictions and observations.

CONCLUSIONS

Our novel nomogram demonstrates high accuracy in predicting ALN tumor burden in breast cancer patients. We also suggest further development of PyRadiomics to improve US radiomics.

KEY POINTS

• A nomogram based on US was developed to predict ALN tumor burden (low, < 3 metastatic ALNs; high, ≥ 3 metastatic ALNs). • The nomogram could assist clinicians in evaluating treatment strategies for T1/T2 invasive breast cancer.

MRI radiomic features are associated with survival in melanoma brain metastases treated with immune checkpoint inhibitors

BACKGROUND

Melanoma brain metastases historically portend a dismal prognosis, but recent advances in immune checkpoint inhibitors (ICIs) have been associated with durable responses in some patients. There are no validated imaging biomarkers associated with outcomes in patients with melanoma brain metastases receiving ICIs. We hypothesized that radiomic analysis of magnetic resonance images (MRIs) could identify higher-order features associated with survival.

METHODS

Between 2010 and 2019, we retrospectively reviewed patients with melanoma brain metastases who received ICI. After volumes of interest were drawn, several texture and edge descriptors, including first-order, Haralick, Gabor, Sobel, and Laplacian of Gaussian (LoG) features were extracted. Progression was determined using Response Assessment in Neuro-Oncology Brain Metastases. Univariate Cox regression was performed for each radiomic feature with adjustment for multiple comparisons followed by Lasso regression and multivariate analysis.

RESULTS

Eighty-eight patients with 196 total brain metastases were identified. Median age was 63.5 years (range, 19-91 y). Ninety percent of patients had Eastern Cooperative Oncology Group performance status of 0 or 1 and 35% had elevated lactate dehydrogenase. Sixty-three patients (72%) received ipilimumab, 11 patients (13%) received programmed cell death protein 1 blockade, and 14 patients (16%) received nivolumab plus ipilimumab. Multiple features were associated with increased overall survival (OS), and LoG edge features best explained the variation in outcome (hazard ratio: 0.68, P = 0.001). In multivariate analysis, a similar trend with LoG was seen, but no longer significant with OS. Findings were confirmed in an independent cohort.

CONCLUSION

Higher-order MRI radiomic features in patients with melanoma brain metastases receiving ICI were associated with a trend toward improved OS.

Radiomics in medical imaging-"how-to" guide and critical reflection

Radiomics is a quantitative approach to medical imaging, which aims at enhancing the existing data available to clinicians by means of advanced mathematical analysis. Through mathematical extraction of the spatial distribution of signal intensities and pixel interrelationships, radiomics quantifies textural information by using analysis methods from the field of artificial intelligence. Various studies from different fields in imaging have been published so far, highlighting the potential of radiomics to enhance clinical decision-making. However, the field faces several important challenges, which are mainly caused by the various technical factors influencing the extracted radiomic features.The aim of the present review is twofold: first, we present the typical workflow of a radiomics analysis and deliver a practical "how-to" guide for a typical radiomics analysis. Second, we discuss the current limitations of radiomics, suggest potential improvements, and summarize relevant literature on the subject.

A machine learning model that classifies breast cancer pathologic complete response on MRI post-neoadjuvant chemotherapy

Background

For breast cancer patients undergoing neoadjuvant chemotherapy (NAC), pathologic complete response (pCR; no invasive or in situ) cannot be assessed non-invasively so all patients undergo surgery. The aim of our study was to develop and validate a radiomics classifier that classifies breast cancer pCR post-NAC on MRI prior to surgery.

Methods

This retrospective study included women treated with NAC for breast cancer from 2014 to 2016 with (1) pre- and post-NAC breast MRI and (2) post-NAC surgical pathology report assessing response. Automated radiomics analysis of pre- and post-NAC breast MRI involved image segmentation, radiomics feature extraction, feature pre-filtering, and classifier building through recursive feature elimination random forest (RFE-RF) machine learning. The RFE-RF classifier was trained with nested five-fold cross-validation using (a) radiomics only (model 1) and (b) radiomics and molecular subtype (model 2). Class imbalance was addressed using the synthetic minority oversampling technique.

Results

Two hundred seventy-three women with 278 invasive breast cancers were included; the training set consisted of 222 cancers (61 pCR, 161 no-pCR; mean age 51.8 years, SD 11.8), and the independent test set consisted of 56 cancers (13 pCR, 43 no-pCR; mean age 51.3 years, SD 11.8). There was no significant difference in pCR or molecular subtype between the training and test sets. Model 1 achieved a cross-validation AUROC of 0.72 (95% CI 0.64, 0.79) and a similarly accurate (P = 0.1) AUROC of 0.83 (95% CI 0.71, 0.94) in both the training and test sets. Model 2 achieved a cross-validation AUROC of 0.80 (95% CI 0.72, 0.87) and a similar (P = 0.9) AUROC of 0.78 (95% CI 0.62, 0.94) in both the training and test sets.

Conclusions

This study validated a radiomics classifier combining radiomics with molecular subtypes that accurately classifies pCR on MRI post-NAC.

Radiomics in breast cancer classification and prediction

Breast Cancer (BC) is the common form of cancer in women. Its diagnosis and screening are usually performed through different imaging modalities such as mammography, magnetic resonance imaging and ultrasound. However, mammography and ultrasound-imaging techniques have limited sensitivity and specificity both in identifying lesions and in differentiating malign from benign lesions, especially in presence of dense breast parenchyma. Due to the higher resolution of magnetic resonance images, MRI represents the method with the higher specificity and sensitivity among all the available tools, in both lesions' identification and diagnosis. However, especially for diagnosis, even MRI has limitations that are only partially solved if combined with mammography. Unfortunately, due to the limits of all these imaging tools, in order to have a certain diagnosis, patients often receive painful and costly bioptics procedures. In this context, several computational approaches have been developed to increase sensitivity, while maintaining the same specificity, in BC diagnosis and screening. Amongst these, radiomics has been increasingly gaining ground in oncology to improve cancer diagnosis, prognosis and treatment. Radiomics derives multiple quantitative features from single or multiple medical imaging modalities, highlighting image traits which are not visible to the naked eye and hence significantly augmenting the discriminatory and predictive potential of medical imaging. This review article aims to summarize the state of the art in radiomics-based BC research. The dominating evidence extracted from the literature points towards a high potential of radiomics in disentangling malignant from benign breast lesions, classifying BC types and grades and also in predicting treatment response and recurrence risk. In the era of personalized medicine, radiomics has the potential to improve diagnosis, prognosis, prediction, monitoring, image-based intervention, and assessment of therapeutic response in BC.

Dynamic multiatlas selection-based consensus segmentation of head and neck structures from CT images

PURPOSE

Manual delineation of head and neck (H&N) organ-at-risk (OAR) structures for radiation therapy planning is time consuming and highly variable. Therefore, we developed a dynamic multiatlas selection-based approach for fast and reproducible segmentation.

METHODS

Our approach dynamically selects and weights the appropriate number of atlases for weighted label fusion and generates segmentations and consensus maps indicating voxel-wise agreement between different atlases. Atlases were selected for a target as those exceeding an alignment weight called dynamic atlas attention index. Alignment weights were computed at the image level and called global weighted voting (GWV) or at the structure level and called structure weighted voting (SWV) by using a normalized metric computed as the sum of squared distances of computed tomography (CT)-radiodensity and modality-independent neighborhood descriptors (extracting edge information). Performance comparisons were performed using 77 H&N CT images from an internal Memorial Sloan-Kettering Cancer Center dataset (N = 45) and an external dataset (N = 32) using Dice similarity coefficient (DSC), Hausdorff distance (HD), 95th percentile of HD, median of maximum surface distance, and volume ratio error against expert delineation. Pairwise DSC accuracy comparisons of proposed (GWV, SWV) vs single best atlas (BA) or majority voting (MV) methods were performed using Wilcoxon rank-sum tests.

RESULTS

Both SWV and GWV methods produced significantly better segmentation accuracy than BA (P < 0.001) and MV (P < 0.001) for all OARs within both datasets. SWV generated the most accurate segmentations with DSC of: 0.88 for oral cavity, 0.85 for mandible, 0.84 for cord, 0.76 for brainstem and parotids, 0.71 for larynx, and 0.60 for submandibular glands. SWV's accuracy exceeded GWV's for submandibular glands (DSC = 0.60 vs 0.52, P = 0.019).

CONCLUSIONS

The contributed SWV and GWV methods generated more accurate automated segmentations than the other two multiatlas-based segmentation techniques. The consensus maps could be combined with segmentations to visualize voxel-wise consensus between atlases within OARs during manual review.

AI-based applications in hybrid imaging: how to build smart and truly multi-parametric decision models for radiomics

INTRODUCTION

The quantitative imaging features (radiomics) that can be obtained from the different modalities of current-generation hybrid imaging can give complementary information with regard to the tumour environment, as they measure different morphologic and functional imaging properties. These multi-parametric image descriptors can be combined with artificial intelligence applications into predictive models. It is now the time for hybrid PET/CT and PET/MRI to take the advantage offered by radiomics to assess the added clinical benefit of using multi-parametric models for the personalized diagnosis and prognosis of different disease phenotypes.

OBJECTIVE

The aim of the paper is to provide an overview of current challenges and available solutions to translate radiomics into hybrid PET-CT and PET-MRI imaging for a smart and truly multi-parametric decision model.

Expression of PCNA, Ki-67 and COX-2 in breast cancer based on DCE-MRI image information

In order to explore the application value of DCE-MRI in clinical diagnosis and treatment, guide early clinical diagnosis, evaluate prognosis, guide clinical selection of treatment options and improve medical level, the expression of adenocarcinoma, its relationship with clinicopathology, and the significance of co-expression of the proliferating cell nuclear antigen (PCNA), Ki67 protein and cyclooxygenase 2 (COX-2) in breast cancer are analyzed. The results show that the positive expression rates of ki67, PCNA, and COX-2 in breast cancer patients are significantly higher than those in breast cancer patients (P<0.05). Positive expressions of ki67, PCNA, and COX-2 in breast cancer patients are not correlated with age, tumor size and clinical stage (P>0.05). There is no significant difference (P>0.05) between the pathological types of breast cancer and positive expressions of ki67, PCNA and COX-2 in all the samples studied. Therefore, there is a correlation between DCE-MRI imaging features and prognostic indicators in breast cancer.

Reliability of tumor segmentation in glioblastoma: Impact on the robustness of MRI-radiomic features

PURPOSE

The use of radiomic features as biomarkers of treatment response and outcome or as correlates to genomic variations requires that the computed features are robust and reproducible. Segmentation, a crucial step in radiomic analysis, is a major source of variability in the computed radiomic features. Therefore, we studied the impact of tumor segmentation variability on the robustness of MRI radiomic features.

METHOD

Fluid-attenuated inversion recovery (FLAIR) and contrast-enhanced T1-weighted (T1WI_CE ) MRI of 90 patients diagnosed with glioblastoma were segmented using a semiautomatic algorithm and an interactive segmentation with two different raters. We analyzed the robustness of 108 radiomic features from five categories (intensity histogram, gray-level co-occurrence matrix, gray-level size-zone matrix (GLSZM), edge maps, and shape) using intra-class correlation coefficient (ICC) and Bland and Altman analysis.

RESULTS

Our results show that both segmentation methods are reliable with ICC ≥ 0.96 and standard deviation (SD) of mean differences between the two raters (SD_diffs ) ≤ 30%. Features computed from the histogram and co-occurrence matrices were found to be the most robust (ICC ≥ 0.8 and SD_diffs  ≤ 30% for most features in these groups). Features from GLSZM were shown to have mixed robustness. Edge, shape, and GLSZM features were the most impacted by the choice of segmentation method with the interactive method resulting in more robust features than the semiautomatic method. Finally, features computed from T1WI_CE and FLAIR images were found to have similar robustness when computed with the interactive segmentation method.

CONCLUSION

Semiautomatic and interactive segmentation methods using two raters are both reliable. The interactive method produced more robust features than the semiautomatic method. We also found that the robustness of radiomic features varied by categories. Therefore, this study could help motivate segmentation methods and feature selection in MRI radiomic studies.

Task-based assessment of a convolutional neural network for segmenting breast lesions for radiomic analysis

PURPOSE

Radiomics allows for powerful data-mining and feature extraction techniques to guide clinical decision making. Image segmentation is a necessary step in such pipelines and different techniques can significantly affect results. We demonstrate that a convolutional neural network (CNN) segmentation method performs comparably to expert manual segmentations in an established radiomics pipeline.

METHODS

Using the manual regions of interest (ROIs) of an expert radiologist (R1), a CNN was trained to segment breast lesions from dynamic contrast-enhanced MRI (DCE-MRI). Following network training, we segmented lesions for the testing set of a previously established radiomics pipeline for predicting lymph node metastases using DCE-MRI of breast cancer. Prediction accuracy of CNN segmentations relative to manual segmentations by R1 from the original study, a resident (R2), and another expert radiologist (R3) were determined. We then retrained the CNN and radiomics model using R3's manual segmentations to determine the effects of different expert observers on end-to-end prediction.

RESULTS

Using R1's ROIs, the CNN achieved a mean Dice coefficient of 0.71 ± 0.16 in the testing set. When input to our previously published radiomics pipeline, these CNN segmentations achieved comparable prediction performance to R1's manual ROIs, and superior performance to those of the other radiologists. Similar results were seen when training the CNN and radiomics model using R3's ROIs.

CONCLUSION

A CNN architecture is able to provide DCE-MRI breast lesion segmentations which are suitable for input to our radiomics model. Moreover, the previously established radiomics model and CNN can be accurately trained end-to-end using ground truth data provided by distinct experts.

Multiple Resolution Residually Connected Feature Streams for Automatic Lung Tumor Segmentation From CT Images

Volumetric lung tumor segmentation and accurate longitudinal tracking of tumor volume changes from computed tomography images are essential for monitoring tumor response to therapy. Hence, we developed two multiple resolution residually connected network (MRRN) formulations called incremental-MRRN and dense-MRRN. Our networks simultaneously combine features across multiple image resolution and feature levels through residual connections to detect and segment the lung tumors. We evaluated our method on a total of 1210 non-small cell (NSCLC) lung tumors and nodules from three data sets consisting of 377 tumors from the open-source Cancer Imaging Archive (TCIA), 304 advanced stage NSCLC treated with anti- PD-1 checkpoint immunotherapy from internal institution MSKCC data set, and 529 lung nodules from the Lung Image Database Consortium (LIDC). The algorithm was trained using 377 tumors from the TCIA data set and validated on the MSKCC and tested on LIDC data sets. The segmentation accuracy compared to expert delineations was evaluated by computing the dice similarity coefficient, Hausdorff distances, sensitivity, and precision metrics. Our best performing incremental-MRRN method produced the highest DSC of 0.74 ± 0.13 for TCIA, 0.75±0.12 for MSKCC, and 0.68±0.23 for the LIDC data sets. There was no significant difference in the estimations of volumetric tumor changes computed using the incremental-MRRN method compared with the expert segmentation. In summary, we have developed a multi-scale CNN approach for volumetrically segmenting lung tumors which enables accurate, automated identification of and serial measurement of tumor volumes in the lung.