A Rapid Segmentation-Insensitive "Digital Biopsy" Method for Radiomic Feature Extraction: Method and Pilot Study Using CT Images of Non-Small Cell Lung Cancer

Promoting the application of pediatric radiomics via an integrated medical engineering approach

Radiomics is widely used in adult tumors but has been rarely applied to the field of pediatrics. Promoting the application of radiomics in pediatric diseases, especially in the early diagnosis and stratified treatment of tumors, is of great value to the realization of the WHO 2030 “Global Initiative for Childhood Cancer.” This paper discusses the general characteristics of radiomics, the particularity of its application to pediatric diseases, and the current status and prospects of pediatric radiomics. Radiomics is a data‐driven science, and the combination of medicine and engineering plays a decisive role in improving data quality, data diversity, and sample size. Compared with adult radiomics, pediatric radiomics is significantly different in data type, disease spectrum, disease staging, and progression. Some progress has been made in the identification, classification, stratification, survival prediction, and prognosis of tumor diseases. In the future, big data applications from multiple centers and cross‐talent training should be strengthened to improve the benefits for clinical workers and children.

Performance of alternative manual and automated deep learning segmentation techniques for the prediction of benign and malignant lung nodules

Purpose

We aim to evaluate the performance of radiomic biopsy (RB), best-fit bounding box (BB), and a deep-learning-based segmentation method called no-new-U-Net (nnU-Net), compared to the standard full manual (FM) segmentation method for predicting benign and malignant lung nodules using a computed tomography (CT) radiomic machine learning model.

Materials and Methods

A total of 188 CT scans of lung nodules from 2 institutions were used for our study. One radiologist identified and delineated all 188 lung nodules, whereas a second radiologist segmented a subset (n = 20 ) of these nodules. Both radiologists employed FM and RB segmentation methods. BB segmentations were generated computationally from the FM segmentations. The nnU-Net, a deep-learning-based segmentation method, performed automatic nodule detection and segmentation. The time radiologists took to perform segmentations was recorded. Radiomic features were extracted from each segmentation method, and models to predict benign and malignant lung nodules were developed. The Kruskal-Wallis and DeLong tests were used to compare segmentation times and areas under the curve (AUC), respectively.

Results

For the delineation of the FM, RB, and BB segmentations, the two radiologists required a median time (IQR) of 113 (54 to 251.5), 21 (9.25 to 38), and 16 (12 to 64.25) s, respectively (p = 0.04 ). In dataset 1, the mean AUC (95% CI) of the FM, RB, BB, and nnU-Net model were 0.964 (0.96 to 0.968), 0.985 (0.983 to 0.987), 0.961 (0.956 to 0.965), and 0.878 (0.869 to 0.888). In dataset 2, the mean AUC (95% CI) of the FM, RB, BB, and nnU-Net model were 0.717 (0.705 to 0.729), 0.919 (0.913 to 0.924), 0.699 (0.687 to 0.711), and 0.644 (0.632 to 0.657).

Conclusion

Radiomic biopsy-based models outperformed FM and BB models in prediction of benign and malignant lung nodules in two independent datasets while deep-learning segmentation-based models performed similarly to FM and BB. RB could be a more efficient segmentation method, but further validation is needed.

Research progress on deep learning in magnetic resonance imaging-based diagnosis and treatment of prostate cancer: a review on the current status and perspectives

Multiparametric magnetic resonance imaging (mpMRI) has emerged as a first-line screening and diagnostic tool for prostate cancer, aiding in treatment selection and noninvasive radiotherapy guidance. However, the manual interpretation of MRI data is challenging and time-consuming, which may impact sensitivity and specificity. With recent technological advances, artificial intelligence (AI) in the form of computer-aided diagnosis (CAD) based on MRI data has been applied to prostate cancer diagnosis and treatment. Among AI techniques, deep learning involving convolutional neural networks contributes to detection, segmentation, scoring, grading, and prognostic evaluation of prostate cancer. CAD systems have automatic operation, rapid processing, and accuracy, incorporating multiple sequences of multiparametric MRI data of the prostate gland into the deep learning model. Thus, they have become a research direction of great interest, especially in smart healthcare. This review highlights the current progress of deep learning technology in MRI-based diagnosis and treatment of prostate cancer. The key elements of deep learning-based MRI image processing in CAD systems and radiotherapy of prostate cancer are briefly described, making it understandable not only for radiologists but also for general physicians without specialized imaging interpretation training. Deep learning technology enables lesion identification, detection, and segmentation, grading and scoring of prostate cancer, and prediction of postoperative recurrence and prognostic outcomes. The diagnostic accuracy of deep learning can be improved by optimizing models and algorithms, expanding medical database resources, and combining multi-omics data and comprehensive analysis of various morphological data. Deep learning has the potential to become the key diagnostic method in prostate cancer diagnosis and treatment in the future.

A Comprehensive Survey on the Progress, Process, and Challenges of Lung Cancer Detection and Classification

Lung cancer is the primary reason of cancer deaths worldwide, and the percentage of death rate is increasing step by step. There are chances of recovering from lung cancer by detecting it early. In any case, because the number of radiologists is limited and they have been working overtime, the increase in image data makes it hard for them to evaluate the images accurately. As a result, many researchers have come up with automated ways to predict the growth of cancer cells using medical imaging methods in a quick and accurate way. Previously, a lot of work was done on computer-aided detection (CADe) and computer-aided diagnosis (CADx) in computed tomography (CT) scan, magnetic resonance imaging (MRI), and X-ray with the goal of effective detection and segmentation of pulmonary nodule, as well as classifying nodules as malignant or benign. But still, no complete comprehensive review that includes all aspects of lung cancer has been done. In this paper, every aspect of lung cancer is discussed in detail, including datasets, image preprocessing, segmentation methods, optimal feature extraction and selection methods, evaluation measurement matrices, and classifiers. Finally, the study looks into several lung cancer-related issues with possible solutions.

Multiplexed imaging in oncology

In oncology, technologies for clinical molecular imaging are used to diagnose patients, establish the efficacy of treatments and monitor the recurrence of disease. Multiplexed methods increase the number of disease-specific biomarkers that can be detected simultaneously, such as the overexpression of oncogenic proteins, aberrant metabolite uptake and anomalous blood perfusion. The quantitative localization of each biomarker could considerably increase the specificity and the accuracy of technologies for clinical molecular imaging to facilitate granular diagnoses, patient stratification and earlier assessments of the responses to administered therapeutics. In this Review, we discuss established techniques for multiplexed imaging and the most promising emerging multiplexing technologies applied to the imaging of isolated tissues and cells and to non-invasive whole-body imaging. We also highlight advances in radiology that have been made possible by multiplexed imaging.

Role of CT Images in the Diagnosis of Common Acute Abdominal Diseases in General Surgery

Acute abdomen is a clinical emergency disease with acute abdominal pain as the main prominent feature. Through severe disease changes in intra-abdominal, extrapelvic, and retroperitoneal tissues and organs, symptoms and clinical signs led by abdominal pain are formed. This article mainly explores the role of CT imaging diagnosis in common acute abdominal diseases in general surgery. In this paper, the use of computer-aided CT scan imaging technology in pulmonary nodules was firstly investigated, and the image segmentation algorithms based on CT images were given, including the spatial domain fuzzy C-mean clustering separation algorithm and the spatial domain fuzzy clustering level set semiautomatic separation algorithm, then the treatment of acute abdomen under the concept of ERAS was explored, and the treatment of ERAS under CT images of the acute abdomen was analyzed and studied. The empirical research results show that the ERAS's concept is guided by the undergoing national nutritional support with the traditional perioperative management. Compared to 12.9% of complications in traditional CPM groups, the recall rate of complications after ERAS group was only 6.01%, the improvement was obvious and the results were statistically significant (P < 0.05). Postoperative hospitalization time was also 4.62 days from 7.93 days, thus controlling the clinical risks of perioperative periods, providing a benefit to patient life.

Radiomics feature reliability assessed by intraclass correlation coefficient: a systematic review

Radiomics research is rapidly growing in recent years, but more concerns on radiomics reliability are also raised. This review attempts to update and overview the current status of radiomics reliability research in the ever expanding medical literature from the perspective of a single reliability metric of intraclass correlation coefficient (ICC). To conduct this systematic review, Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines were followed. After literature search and selection, a total of 481 radiomics studies using CT, PET, or MRI, covering a wide range of subject and disease types, were included for review. In these highly heterogeneous studies, feature reliability to image segmentation was much more investigated than reliability to other factors, such as image acquisition, reconstruction, post-processing, and feature quantification. The reported ICCs also suggested high radiomics feature reliability to image segmentation. Image acquisition was found to introduce much more feature variability than image segmentation, in particular for MRI, based on the reported ICC values. Image post-processing and feature quantification yielded different levels of radiomics reliability and might be used to mitigate image acquisition-induced variability. Some common flaws and pitfalls in ICC use were identified, and suggestions on better ICC use were given. Due to the extremely high study heterogeneities and possible risks of bias, the degree of radiomics feature reliability that has been achieved could not yet be safely synthesized or derived in this review. More future researches on radiomics reliability are warranted.

Quantitative image features from radiomic biopsy differentiate oncocytoma from chromophobe renal cell carcinoma

Purpose: To differentiate oncocytoma and chromophobe renal cell carcinoma (RCC) using radiomics features computed from spherical samples of image regions of interest, "radiomic biopsies" (RBs). Approach: In a retrospective cohort study of 102 CT cases [68 males (67%), 34 females (33%); mean age ± SD, 63 ± 12    years ], we pathology-confirmed 42 oncocytomas (41%) and 60 chromophobes (59%). A board-certified radiologist performed two RB rounds. From each RB round, we computed radiomics features and compared the performance of a random forest and AdaBoost binary classifier trained from the features. To control for overfitting, we performed 10 rounds of 70% to 30% train-test splits with feature-selection, cross-validation, and hyperparameter-optimization on each split. We evaluated the performance with test ROC AUC. We tested models on data from the other RB round and compared with the same round testing with the DeLong test. We clustered important features for each round and measured a bootstrapped adjusted Rand index agreement. Results: Our best classifiers achieved an average AUC of 0.71 ± 0.024 . We found no evidence of an effect for RB round ( p = 1 ). We also found no evidence for a decrease in model performance when tested on the other RB round ( p = 0.85 ). Feature clustering produced seven clusters in each RB round with high agreement ( Rand index = 0.981 ± 0.002 , p < 0.00001 ). Conclusions: A consistent radiomic signature can be derived from RBs and could help distinguish oncocytoma and chromophobe RCC.

Multisite Technical and Clinical Performance Evaluation of Quantitative Imaging Biomarkers from 3D FDG PET Segmentations of Head and Neck Cancer Images

Quantitative imaging biomarkers (QIBs) provide medical image-derived intensity, texture, shape, and size features that may help characterize cancerous tumors and predict clinical outcomes. Successful clinical translation of QIBs depends on the robustness of their measurements. Biomarkers derived from positron emission tomography images are prone to measurement errors owing to differences in image processing factors such as the tumor segmentation method used to define volumes of interest over which to calculate QIBs. We illustrate a new Bayesian statistical approach to characterize the robustness of QIBs to different processing factors. Study data consist of 22 QIBs measured on 47 head and neck tumors in 10 positron emission tomography/computed tomography scans segmented manually and with semiautomated methods used by 7 institutional members of the NCI Quantitative Imaging Network. QIB performance is estimated and compared across institutions with respect to measurement errors and power to recover statistical associations with clinical outcomes. Analysis findings summarize the performance impact of different segmentation methods used by Quantitative Imaging Network members. Robustness of some advanced biomarkers was found to be similar to conventional markers, such as maximum standardized uptake value. Such similarities support current pursuits to better characterize disease and predict outcomes by developing QIBs that use more imaging information and are robust to different processing factors. Nevertheless, to ensure reproducibility of QIB measurements and measures of association with clinical outcomes, errors owing to segmentation methods need to be reduced.

Artificial Intelligence in Lung Cancer: Bridging the Gap Between Computational Power and Clinical Decision-Making

Lung cancer remains the most common cause of cancer death worldwide. Recent advances in lung cancer screening, radiotherapy, surgical techniques, and systemic therapy have led to increasing complexity in diagnosis, treatment decision-making, and assessment of recurrence. Artificial intelligence (AI)-based prediction models are being developed to address these issues and may have a future role in screening, diagnosis, treatment selection, and decision-making around salvage therapy. Imaging plays an essential role in all components of lung cancer management and has the potential to play a key role in AI applications. Artificial intelligence has demonstrated value in prognostic biomarker discovery in lung cancer diagnosis, treatment, and response assessment, putting it at the forefront of the next phase of personalized medicine. However, although exploratory studies demonstrate potential utility, there is a need for rigorous validation and standardization before AI can be utilized in clinical decision-making. In this review, we will provide a summary of the current literature implementing AI for outcome prediction in lung cancer. We will describe the anticipated impact of AI on the management of patients with lung cancer and discuss the challenges of clinical implementation of these techniques.

ePAD: An Image Annotation and Analysis Platform for Quantitative Imaging

Medical imaging is critical for assessing the response of patients to new cancer therapies. Quantitative lesion assessment on images is time-consuming, and adopting new promising quantitative imaging biomarkers of response in clinical trials is challenging. The electronic Physician Annotation Device (ePAD) is a freely available web-based zero-footprint software application for viewing, annotation, and quantitative analysis of radiology images designed to meet the challenges of quantitative evaluation of cancer lesions. For imaging researchers, ePAD calculates a variety of quantitative imaging biomarkers that they can analyze and compare in ePAD to identify potential candidates as surrogate endpoints in clinical trials. For clinicians, ePAD provides clinical decision support tools for evaluating cancer response through reports summarizing changes in tumor burden based on different imaging biomarkers. As a workflow management and study oversight tool, ePAD lets clinical trial project administrators create worklists for users and oversee the progress of annotations created by research groups. To support interoperability of image annotations, ePAD writes all image annotations and results of quantitative imaging analyses in standardized file formats, and it supports migration of annotations from various propriety formats. ePAD also provides a plugin architecture supporting MATLAB server-side modules in addition to client-side plugins, permitting the community to extend the ePAD platform in various ways for new cancer use cases. We present an overview of ePAD as a platform for medical image annotation and quantitative analysis. We also discuss use cases and collaborations with different groups in the Quantitative Imaging Network and future directions.

Assessment of Stability and Discrimination Capacity of Radiomic Features on Apparent Diffusion Coefficient Images

The objectives of the study are to develop a new way to assess stability and discrimination capacity of radiomic features without the need of test-retest or multiple delineations and to use information obtained to perform a preliminary feature selection. Apparent diffusion coefficient (ADC) maps were computed from diffusion-weighted magnetic resonance images (DW-MRI) of two groups of patients: 18 with soft tissue sarcomas (STS) and 18 with oropharyngeal cancers (OPC). Sixty-nine radiomic features were computed, using three different histogram discretizations (16, 32, and 64 bins). Geometrical transformations (translations) of increasing entity were applied to the regions of interest (ROIs), and the intra-class correlation coefficient (ICC) was used to compare the features computed on the original and modified ROIs. The distribution of ICC values for minimal and maximal entity translations (ICC₁₀ and ICC₁₀₀, respectively) was used to adjust thresholds of ICC (ICC_min and ICC_max) used to discriminate between good, unstable (ICC₁₀ < ICC_min), and non-discriminative features (ICC₁₀₀ > ICC_max). Fifty-four and 59 radiomic features passed the stability-based selection for all the three histogram discretizations for the OPC and STS datasets, respectively. The excluded features were similar across the different histogram discretizations (Jaccard’s index 0.77 ± 0.13 and 0.9 ± 0.1 for OPC and STS, respectively) but different between datasets (Jaccard’s index 0.19 ± 0.02). The results suggest that the observed radiomic features are mainly stable and discriminative, but the stability depends on the region of the body under observation. The method provides a way to assess stability without the need of test-retest or multiple delineations.

Quantitative Image Feature Engine (QIFE): an Open-Source, Modular Engine for 3D Quantitative Feature Extraction from Volumetric Medical Images

The aim of this study was to develop an open-source, modular, locally run or server-based system for 3D radiomics feature computation that can be used on any computer system and included in existing workflows for understanding associations and building predictive models between image features and clinical data, such as survival. The QIFE exploits various levels of parallelization for use on multiprocessor systems. It consists of a managing framework and four stages: input, pre-processing, feature computation, and output. Each stage contains one or more swappable components, allowing run-time customization. We benchmarked the engine using various levels of parallelization on a cohort of CT scans presenting 108 lung tumors. Two versions of the QIFE have been released: (1) the open-source MATLAB code posted to Github, (2) a compiled version loaded in a Docker container, posted to DockerHub, which can be easily deployed on any computer. The QIFE processed 108 objects (tumors) in 2:12 (h/mm) using 1 core, and 1:04 (h/mm) hours using four cores with object-level parallelization. We developed the Quantitative Image Feature Engine (QIFE), an open-source feature-extraction framework that focuses on modularity, standards, parallelism, provenance, and integration. Researchers can easily integrate it with their existing segmentation and imaging workflows by creating input and output components that implement their existing interfaces. Computational efficiency can be improved by parallelizing execution at the cost of memory usage. Different parallelization levels provide different trade-offs, and the optimal setting will depend on the size and composition of the dataset to be processed.

NCTN Assessment on Current Applications of Radiomics in Oncology

Radiomics is a fast-growing research area based on converting standard-of-care imaging into quantitative minable data and building subsequent predictive models to personalize treatment. Radiomics has been proposed as a study objective in clinical trial concepts and a potential biomarker for stratifying patients across interventional treatment arms. In recognizing the growing importance of radiomics in oncology, a group of medical physicists and clinicians from NRG Oncology reviewed the current status of the field and identified critical issues, providing a general assessment and early recommendations for incorporation in oncology studies.

A review of automatic lung tumour segmentation in the era of 4DCT

Aim

To review the literature on auto-contouring methods of lung tumour volumes on four-dimensional computed tomography (4DCT).

Background

Manual delineation of lung tumour on 4DCT has been the gold standard in clinical practice. However, it is resource intensive due to the high volume of data which results in longer contouring duration and uncertainties in defining target. Auto-contouring may present as an attractive alternative by decreasing manual inputs required, thus improving the contouring process. This review aims to assess the accuracy, variability and contouring duration of automatic contouring compared with manual contouring in lung cancer on 4DCT datasets.

Materials and methods

A search and review of literature were conducted to identify studies regarding lung tumour contouring on 4DCT. Manual and auto-contours were assessed and compared based on accuracy, variability and contouring duration.

Results

Thirteen studies were included in this review and their results were compared. Accuracy of auto-contours was found to be comparable to manual contours. Auto-contouring resulted in lesser inter-observer variation when compared to manual contouring, however there was no significant reduction in intra-observer variability. Additionally, contouring duration was reduced with auto-contouring although long computation time could present as a bottleneck.

Conclusion

Auto-contouring is reliable and efficient, producing accurate contours with better consistency compared to manual contours. However, manual inputs would still be required both before and after auto-propagation.

A Comparative Texture Analysis Based on NECT and CECT Images to Differentiate Lung Adenocarcinoma from Squamous Cell Carcinoma

The purpose of the study was to compare the texture based discriminative performances between non-contrast enhanced computed tomography (NECT) and contrast-enhanced computed tomography (CECT) images in differentiating lung adenocarcinoma (ADC) from squamous cell carcinoma (SCC) patients. Eighty-seven lung cancer subjects were enrolled in the study, including pathologically proved 47 ADC patients and 40 SCC patients, and 261 texture features were extracted from the manually delineated region of interests on CECT and NECT images respectively. Fisher score was then used to select the effective discriminative texture features between groups, and the selected texture features were adopted to differentiate ADC from SCC using Support Vector Machine and Leave-one-out cross-validation. Both NECT and CECT images could achieve the same best classification accuracy of 95.4%, and most of the informative features were from the gray-level co-occurrence matrix. In addition, CECT images were found with enhanced texture features compared with NECT images, and combining texture features of CECT and NECT images together could further improve the prediction accuracy. Besides the texture feature, the tumor location information also contributed to the differential diagnosis between ADC and SCC.

Quantitative imaging of cancer in the postgenomic era: Radio(geno)mics, deep learning, and habitats

Although cancer often is referred to as "a disease of the genes," it is indisputable that the (epi)genetic properties of individual cancer cells are highly variable, even within the same tumor. Hence, preexisting resistant clones will emerge and proliferate after therapeutic selection that targets sensitive clones. Herein, the authors propose that quantitative image analytics, known as "radiomics," can be used to quantify and characterize this heterogeneity. Virtually every patient with cancer is imaged radiologically. Radiomics is predicated on the beliefs that these images reflect underlying pathophysiologies, and that they can be converted into mineable data for improved diagnosis, prognosis, prediction, and therapy monitoring. In the last decade, the radiomics of cancer has grown from a few laboratories to a worldwide enterprise. During this growth, radiomics has established a convention, wherein a large set of annotated image features (1-2000 features) are extracted from segmented regions of interest and used to build classifier models to separate individual patients into their appropriate class (eg, indolent vs aggressive disease). An extension of this conventional radiomics is the application of "deep learning," wherein convolutional neural networks can be used to detect the most informative regions and features without human intervention. A further extension of radiomics involves automatically segmenting informative subregions ("habitats") within tumors, which can be linked to underlying tumor pathophysiology. The goal of the radiomics enterprise is to provide informed decision support for the practice of precision oncology.

Digital liver biopsy: Bio-imaging of fatty liver for translational and clinical research

The rapidly growing field of functional, molecular and structural bio-imaging is providing an extraordinary new opportunity to overcome the limits of invasive liver biopsy and introduce a "digital biopsy" for in vivo study of liver pathophysiology. To foster the application of bio-imaging in clinical and translational research, there is a need to standardize the methods of both acquisition and the storage of the bio-images of the liver. It can be hoped that the combination of digital, liquid and histologic liver biopsies will provide an innovative synergistic tri-dimensional approach to identifying new aetiologies, diagnostic and prognostic biomarkers and therapeutic targets for the optimization of personalized therapy of liver diseases and liver cancer. A group of experts of different disciplines (Special Interest Group for Personalized Hepatology of the Italian Association for the Study of the Liver, Institute for Biostructures and Bio-imaging of the National Research Council and Bio-banking and Biomolecular Resources Research Infrastructure) discussed criteria, methods and guidelines for facilitating the requisite application of data collection. This manuscript provides a multi-Author review of the issue with special focus on fatty liver.

Translational Radiomics: Defining the Strategy Pipeline and Considerations for Application-Part 2: From Clinical Implementation to Enterprise

Enterprise imaging has channeled various technological innovations to the field of clinical radiology, ranging from advanced imaging equipment and postacquisition iterative reconstruction tools to image analysis and computer-aided detection tools. More recently, the advancement in the field of quantitative image analysis coupled with machine learning-based data analytics, classification, and integration has ushered in the era of radiomics, a paradigm shift that holds tremendous potential in clinical decision support as well as drug discovery. However, there are important issues to consider to incorporate radiomics into a clinically applicable system and a commercially viable solution. In this two-part series, we offer insights into the development of the translational pipeline for radiomics from methodology to clinical implementation (Part 1) and from that point to enterprise development (Part 2). In Part 2 of this two-part series, we study the components of the strategy pipeline, from clinical implementation to building enterprise solutions.