Texture Feature Extraction and Analysis for Polyp Differentiation via Computed Tomography Colonography

Lesion Classification by Model-Based Feature Extraction: A Differential Affine Invariant Model of Soft Tissue Elasticity in CT Images

The elasticity of soft tissues has been widely considered a characteristic property for differentiation of healthy and lesions and, therefore, motivated the development of several elasticity imaging modalities, for example, ultrasound elastography, magnetic resonance elastography, and optical coherence elastography to directly measure the tissue elasticity. This paper proposes an alternative approach of modeling the elasticity for prior knowledge-based extraction of tissue elastic characteristic features for machine learning (ML) lesion classification using computed tomography (CT) imaging modality. The model describes a dynamic non-rigid (or elastic) soft tissue deformation in differential manifold to mimic the tissues' elasticity under wave fluctuation in vivo. Based on the model, a local deformation invariant is formulated using the 1st and 2nd order derivatives of the lesion volumetric CT image and used to generate elastic feature map of the lesion volume. From the feature map, tissue elastic features are extracted and fed to ML to perform lesion classification. Two pathologically proven image datasets of colon polyps and lung nodules were used to test the modeling strategy. The outcomes reached the score of area under the curve of receiver operating characteristics of 94.2% for the polyps and 87.4% for the nodules, resulting in an average gain of 5 to 20% over several existing state-of-the-art image feature-based lesion classification methods. The gain demonstrates the importance of extracting tissue characteristic features for lesion classification, instead of extracting image features, which can include various image artifacts and may vary for different protocols in image acquisition and different imaging modalities.

Abnormal Brachial Plexus Differentiation from Routine Magnetic Resonance Imaging: An AI-based Approach

Automatic abnormality identification of brachial plexus (BP) from normal magnetic resonance imaging to localize and identify a neurologic injury in clinical practice (MRI) is still a novel topic in brachial plexopathy. This study developed and evaluated an approach to differentiate abnormal BP with artificial intelligence (AI) over three commonly used MRI sequences, i.e. T1, FLUID sensitive and post-gadolinium sequences. A BP dataset was collected by radiological experts and a semi-supervised artificial intelligence method was used to segment the BP (based on nnU-net). Hereafter, a radiomics method was utilized to extract 107 shape and texture features from these ROIs. From various machine learning methods, we selected six widely recognized classifiers for training our Brachial plexus (BP) models and assessing their efficacy. To optimize these models, we introduced a dynamic feature selection approach aimed at discarding redundant and less informative features. Our experimental findings demonstrated that, in the context of identifying abnormal BP cases, shape features displayed heightened sensitivity compared to texture features. Notably, both the Logistic classifier and Bagging classifier outperformed other methods in our study. These evaluations illuminated the exceptional performance of our model trained on FLUID-sensitive sequences, which notably exceeded the results of both T1 and post-gadolinium sequences. Crucially, our analysis highlighted that both its classification accuracies and AUC score (area under the curve of receiver operating characteristics) over FLUID-sensitive sequence exceeded 90%. This outcome served as a robust experimental validation, affirming the substantial potential and strong feasibility of integrating AI into clinical practice.

Application of Nanoparticles in the Diagnosis and Treatment of Colorectal Cancer

Colorectal cancer is a common malignant tumor with high morbidity and mortality rates, imposing a huge burden on both patients and the healthcare system. Traditional treatments such as surgery, chemotherapy and radiotherapy have limitations, so finding more effective diagnostic and therapeutic tools is critical to improving the survival and quality of life of colorectal cancer patients. While current tumor targeting research mainly focuses on exploring the function and mechanism of molecular targets and screening for excellent drug targets, it is crucial to test the efficacy and mechanism of tumor cell therapy that targets these molecular targets. Selecting the appropriate drug carrier is a key step in effectively targeting tumor cells. In recent years, nanoparticles have gained significant interest as gene carriers in the field of colorectal cancer diagnosis and treatment due to their low toxicity and high protective properties. Nanoparticles, synthesized from natural or polymeric materials, are NM-sized particles that offer advantages such as low toxicity, slow release, and protection of target genes during delivery. By modifying nanoparticles, they can be targeted towards specific cells for efficient and safe targeting of tumor cells. Numerous studies have demonstrated the safety, efficiency, and specificity of nanoparticles in targeting tumor cells, making them a promising gene carrier for experimental and clinical studies. This paper aims to review the current application of nanoparticles in colorectal cancer diagnosis and treatment to provide insights for targeted therapy for colorectal cancer while also highlighting future prospects for nanoparticle development.

MM-GLCM-CNN: A multi-scale and multi-level based GLCM-CNN for polyp classification

Distinguishing malignant from benign lesions has significant clinical impacts on both early detection and optimal management of those early detections. Convolutional neural network (CNN) has shown great potential in medical imaging applications due to its powerful feature learning capability. However, it is very challenging to obtain pathological ground truth, addition to collected in vivo medical images, to construct objective training labels for feature learning, leading to the difficulty of performing lesion diagnosis. This is contrary to the requirement that CNN algorithms need a large number of datasets for the training. To explore the ability to learn features from small pathologically-proven datasets for differentiation of malignant from benign polyps, we propose a Multi-scale and Multi-level based Gray-level Co-occurrence Matrix CNN (MM-GLCM-CNN). Specifically, instead of inputting the lesions' medical images, the GLCM, which characterizes the lesion heterogeneity in terms of image texture characteristics, is fed into the MM-GLCN-CNN model for the training. This aims to improve feature extraction by introducing multi-scale and multi-level analysis into the construction of lesion texture characteristic descriptors (LTCDs). To learn and fuse multiple sets of LTCDs from small datasets for lesion diagnosis, we further propose an adaptive multi-input CNN learning framework. Furthermore, an Adaptive Weight Network is used to highlight important information and suppress redundant information after the fusion of the LTCDs. We evaluated the performance of MM-GLCM-CNN by the area under the receiver operating characteristic curve (AUC) merit on small private lesion datasets of colon polyps. The AUC score reaches 93.99% with a gain of 1.49% over current state-of-the-art lesion classification methods on the same dataset. This gain indicates the importance of incorporating lesion characteristic heterogeneity for the prediction of lesion malignancy using small pathologically-proven datasets.

Classification of Glaucoma Stages Using Image Empirical Mode Decomposition from Fundus Images

One of the most prevalent causes of visual loss and blindness is glaucoma. Conventionally, instrument-based tools are employed for glaucoma screening. However, they are inefficient, time-consuming, and manual. Hence, computerized methodologies are needed for fast and accurate diagnosis of glaucoma. Therefore, we proposed a Computer-Aided Diagnosis (CAD) method for the classification of glaucoma stages using Image Empirical Mode decomposition (IEMD). In this study, IEMD is applied to decompose the preprocessed fundus photographs into different Intrinsic Mode Functions (IMFs) to capture the pixel variations. Then, the significant texture-based descriptors have been computed from the IMFs. A dimensionality reduction approach called Principal Component Analysis (PCA) has been employed to pick the robust descriptors from the retrieved feature set. We used the Analysis of Variance (ANOVA) test for feature ranking. Finally, the LS-SVM classifier has been employed to classify glaucoma stages. The proposed CAD system achieved a classification accuracy of 94.45% for the binary classification on the RIM-ONE r12 database. Our approach demonstrated better glaucoma classification performance than the existing automated systems.

Vector textures derived from higher order derivative domains for classification of colorectal polyps

Textures have become widely adopted as an essential tool for lesion detection and classification through analysis of the lesion heterogeneities. In this study, higher order derivative images are being employed to combat the challenge of the poor contrast across similar tissue types among certain imaging modalities. To make good use of the derivative information, a novel concept of vector texture is firstly introduced to construct and extract several types of polyp descriptors. Two widely used differential operators, i.e., the gradient operator and Hessian operator, are utilized to generate the first and second order derivative images. These derivative volumetric images are used to produce two angle-based and two vector-based (including both angle and magnitude) textures. Next, a vector-based co-occurrence matrix is proposed to extract texture features which are fed to a random forest classifier to perform polyp classifications. To evaluate the performance of our method, experiments are implemented over a private colorectal polyp dataset obtained from computed tomographic colonography. We compare our method with four existing state-of-the-art methods and find that our method can outperform those competing methods over 4%-13% evaluated by the area under the receiver operating characteristics curves.

Grading of soft tissues sarcomas using radiomics models: Choice of imaging methods and comparison with conventional visual analysis

Purpose

To determine which combination of imaging modalities/contrast, radiomics models, and how many features provides the best diagnostic performance for the differentiation between low- and high-grade soft tissue sarcomas (STS) using a radiomics approach.

Methods

MRI and CT from 39 patients with a histologically confirmed STS were prospectively analyzed. Images were evaluated both quantitatively by radiomics models and qualitatively by visual evaluation (used as reference) for grading (low-grade vs high-grade). In radiomics analysis, 120 radiomic features were extracted and contributed into three models: least absolute shrinkage and selection operator with logistic regression(LASSO-LR), recursive feature elimination and cross-validation (RFECV-SVC) and analysis of variance with SVC (ANOVA-SVC). Those were applied to different combinations of imaging modalities acquisition, with and without contrast medium administration, as well as selected number of features.

Results

Fat-saturated T2w (FS-T2w) MR images using RFECV-SVC radiomic models involving five features yielded the best results with mean sensitivity, specificity, and accuracy of 92% ± 10%, 78% ± 30%, and 89% ± 12%, respectively. The performance of radiomics was better than that of conventional analysis (67% accuracy) for STS grading. Combination of multiple contrast or imaging modalities did not increase the diagnostic performance.

Conclusion

FS-T2w MR images alone with a five-feature radiomics analysis usingh REFCV-SVC model may be able to provide sufficient diagnositic performance compared to conventional visual evaluation with multiple MRI contrast and CT imaging.

An Adaptive Learning Model for Multiscale Texture Features in Polyp Classification via Computed Tomographic Colonography

Objective: As an effective lesion heterogeneity depiction, texture information extracted from computed tomography has become increasingly important in polyp classification. However, variation and redundancy among multiple texture descriptors render a challenging task of integrating them into a general characterization. Considering these two problems, this work proposes an adaptive learning model to integrate multi-scale texture features. Methods: To mitigate feature variation, the whole feature set is geometrically split into several independent subsets that are ranked by a learning evaluation measure after preliminary classifications. To reduce feature redundancy, a bottom-up hierarchical learning framework is proposed to ensure monotonic increase of classification performance while integrating these ranked sets selectively. Two types of classifiers, traditional (random forest + support vector machine)- and convolutional neural network (CNN)-based, are employed to perform the polyp classification under the proposed framework with extended Haralick measures and gray-level co-occurrence matrix (GLCM) as inputs, respectively. Experimental results are based on a retrospective dataset of 63 polyp masses (defined as greater than 3 cm in largest diameter), including 32 adenocarcinomas and 31 benign adenomas, from adult patients undergoing first-time computed tomography colonography and who had corresponding histopathology of the detected masses. Results: We evaluate the performance of the proposed models by the area under the curve (AUC) of the receiver operating characteristic curve. The proposed models show encouraging performances of an AUC score of 0.925 with the traditional classification method and an AUC score of 0.902 with CNN. The proposed adaptive learning framework significantly outperforms nine well-established classification methods, including six traditional methods and three deep learning ones with a large margin. Conclusions: The proposed adaptive learning model can combat the challenges of feature variation through a multiscale grouping of feature inputs, and the feature redundancy through a hierarchal sorting of these feature groups. The improved classification performance against comparative models demonstrated the feasibility and utility of this adaptive learning procedure for feature integration.

Artificial intelligence for the early detection of colorectal cancer: A comprehensive review of its advantages and misconceptions

Colorectal cancer (CRC) was the second-ranked worldwide type of cancer during 2020 due to the crude mortality rate of 12.0 per 100000 inhabitants. It can be prevented if glandular tissue (adenomatous polyps) is detected early. Colonoscopy has been strongly recommended as a screening test for both early cancer and adenomatous polyps. However, it has some limitations that include the high polyp miss rate for smaller (< 10 mm) or flat polyps, which are easily missed during visual inspection. Due to the rapid advancement of technology, artificial intelligence (AI) has been a thriving area in different fields, including medicine. Particularly, in gastroenterology AI software has been included in computer-aided systems for diagnosis and to improve the assertiveness of automatic polyp detection and its classification as a preventive method for CRC. This article provides an overview of recent research focusing on AI tools and their applications in the early detection of CRC and adenomatous polyps, as well as an insightful analysis of the main advantages and misconceptions in the field.

Identification of oral precancerous and cancerous tissue by swept source optical coherence tomography

BACKGROUND AND OBJECTIVES

Distinguishing cancer from precancerous lesions is critical and challenging in oral medicine. As a noninvasive method, optical coherence tomography (OCT) has the advantages of real-time, in vivo, and large-depth imaging. Texture information hidden in OCT images can provide an important auxiliary effect for improving diagnostic accuracy. The aim of this study is to explore a reliable and accurate OCT-based method for the screening and diagnosis of human oral diseases, especially oral cancer.

MATERIALS AND METHODS

Fresh ex vivo oral tissues including normal mucosa, leukoplakia with epithelial hyperplasia (LEH), and oral squamous cell carcinoma (OSCC) were imaged intraoperatively by a homemade OCT system, and 58 texture features were extracted to create computational models of these tissues. A principal component analysis algorithm was employed to optimize the combination of texture feature vectors. The identification based on artificial neural network (ANN) was proposed and the sensitivity/specificity was calculated statistically to evaluate the classification performance.

RESULTS

A total of 71 sites of three types of oral tissues were measured, and 5176 OCT images of three types of oral tissues were used in this study. The superior classification result based on ANN was obtained with an average accuracy of 98.17%. The sensitivity and specificity of normal mucosa, LEH, and OSCC are 98.17% / 98.38%, 93.81% / 98.54%, and 98.11% / 99.04%, respectively.

CONCLUSION

It is demonstrated from the high accuracies, sensitivities, and specificities that texture-based analysis can be used to identify oral precancerous and cancerous tissue in OCT images, and it has the potential to help surgeons in diseases screening and diagnosis effectively.

Role of CT colonography in differentiating sigmoid cancer from chronic diverticular disease

PURPOSE

To evaluate the accuracy of computed tomography colonography (CTC) in differentiating chronic diverticular disease from colorectal cancer (CRC), using morphological and textural parameters.

MATERIALS AND METHODS

We included 95 consecutive patients with histologically proven chronic diverticular disease (n = 53) or CRC (n = 42) who underwent CTC. One radiologist, unaware of histological findings, evaluated CTC studies for the presence of potential discriminators including: maximum thickness, involved segment length, shouldering phenomenon, growth pattern, diverticula, fascia thickening, fat tissue edema, loco-regional lymph nodes, mucosal pattern. Another radiologist performed volumetric texture analysis on the involved segment.

RESULTS

Several qualitative imaging parameters resulted to significantly correlated with colorectal cancer, including absence of diverticula in the affected segment, straightened growth pattern and shouldering phenomenon. A maximum wall thickness/involved segment length ratio < 0.1 had 98% specificity and 47% sensitivity in identifying diverticular disease. Regarding first-order texture analysis parameters, kurtosis resulted to be significantly different between the two groups.

CONCLUSIONS

Absence of diverticula, straightened growth pattern and shouldering phenomenon are significantly associated with CRC (71-91% sensitivity; 82-91%).

A multiparametric MRI-based CAD system for accurate diagnosis of bladder cancer staging

Appropriate treatment of bladder cancer (BC) is widely based on accurate and early BC staging. In this paper, a multiparametric computer-aided diagnostic (MP-CAD) system is developed to differentiate between BC staging, especially T1 and T2 stages, using T2-weighted (T2W) magnetic resonance imaging (MRI) and diffusion-weighted (DW) MRI. Our framework starts with the segmentation of the bladder wall (BW) and localization of the whole BC volume (Vt) and its extent inside the wall (Vw). Our segmentation framework is based on a fully connected convolution neural network (CNN) and utilized an adaptive shape model followed by estimating a set of functional, texture, and morphological features. The functional features are derived from the cumulative distribution function (CDF) of the apparent diffusion coefficient. Texture features are radiomic features estimated from T2W-MRI, and morphological features are used to describe the tumors' geometric. Due to the significant texture difference between the wall and bladder lumen cells, Vt is parcelled into a set of nested equidistance surfaces (i.e., iso-surfaces). Finally, features are estimated for individual iso-surfaces, which are then augmented and used to train and test machine learning (ML) classifier based on neural networks. The system has been evaluated using 42 data sets, and a leave-one-subject-out approach is employed. The overall accuracy, sensitivity, specificity, and area under the receiver operating characteristics (ROC) curve (AUC) are 95.24%, 95.24%, 95.24%, and 0.9864, respectively. The advantage of fusion multiparametric iso-features is highlighted by comparing the diagnostic accuracy of individual MRI modality, which is confirmed by the ROC analysis. Moreover, the accuracy of our pipeline is compared against other statistical ML classifiers (i.e., random forest (RF) and support vector machine (SVM)). Our CAD system is also compared with other techniques (e.g., end-to-end convolution neural networks (i.e., ResNet50).

A Survey on Machine Learning and Deep Learning-based Computer-Aided Methods for Detection of Polyps in CT Colonography

BACKGROUND

Colon cancer generally begins as a neoplastic growth of tissue, called polyps, originating from the inner lining of the colon wall. Most colon polyps are considered harmless but over the time, they can evolve into colon cancer, which, when diagnosed in later stages, is often fatal. Hence, time is of the essence in the early detection of polyps and the prevention of colon cancer.

METHODS

To aid this endeavor, many computer-aided methods have been developed, which use a wide array of techniques to detect, localize and segment polyps from CT Colonography images. In this paper, a comprehensive state-of-the-art method is proposed and categorize this work broadly using the available classification techniques using Machine Learning and Deep Learning.

CONCLUSION

The performance of each of the proposed approach is analyzed with existing methods and also how they can be used to tackle the timely and accurate detection of colon polyps.

A dynamic lesion model for differentiation of malignant and benign pathologies

Malignant lesions have a high tendency to invade their surrounding environment compared to benign ones. This paper proposes a dynamic lesion model and explores the 2nd order derivatives at each image voxel, which reflect the rate of change of image intensity, as a quantitative measure of the tendency. The 2nd order derivatives at each image voxel are usually represented by the Hessian matrix, but it is difficult to quantify a matrix field (or image) through the lesion space as a measure of the tendency. We conjecture that the three eigenvalues contain important information of the Hessian matrix and are chosen as the surrogate representation of the Hessian matrix. By treating the three eigenvalues as a vector, called Hessian vector, which is defined in a local coordinate formed by three orthogonal Hessian eigenvectors and further adapting the gray level occurrence computing method to extract the vector texture descriptors (or measures) from the Hessian vector, a quantitative presentation for the dynamic lesion model is completed. The vector texture descriptors were applied to differentiate malignant from benign lesions from two pathologically proven datasets: colon polyps and lung nodules. The classification results not only outperform four state-of-the-art methods but also three radiologist experts.

Characterization of tissue-specific pre-log Bayesian CT reconstruction by texture-dose relationship

PURPOSE

Tissue textures have been recognized as biomarkers for various clinical tasks. In computed tomography (CT) image reconstruction, it is important but challenging to preserve the texture when lowering x-ray exposure from full- toward low-/ultra-low dose level. Therefore, this paper aims to explore the texture-dose relationship within one tissue-specific pre-log Bayesian CT reconstruction algorithm.

METHODS

To enhance the texture in ultra-low dose CT (ULdCT) reconstruction, this paper presents a Bayesian type algorithm. A shifted Poisson model is adapted to describe the statistical properties of pre-log data, and a tissue-specific Markov random field prior (MRFt) is used to incorporate tissue texture from previous full-dose CT, thus called SP-MRFt algorithm. Utilizing the SP-MRFt algorithm, we investigated tissue texture degradation as a function of x-ray dose levels from full dose (100 mAs/120 kVp) to ultralow dose (1 mAs/120 kVp) by using quantitative texture-based evaluation metrics.

RESULTS

Experimental results show the SP-MRFt algorithm outperforms conventional filtered back projection (FBP) and post-log domain penalized weighted least square MRFt (PWLS-MRFt) in terms of noise suppression and texture preservation. Comparable results are also obtained with shifted Poisson model with 7 × 7 Huber MRF weights (SP-Huber7). The investigation on texture-dose relationship shows that the quantified texture measures drop monotonically as dose level decreases, and interestingly a turning point is observed on the texture-dose response curve.

CONCLUSIONS

This important observation implies that there exists a minimum dose level, at which a given CT scanner (hardware configuration and image reconstruction software) can achieve without compromising clinical tasks. Moreover, the experiment results show that the variance of electronic noise has higher impact than the mean to the texture-dose relationship.

Feasibility of computed tomography texture analysis of hepatic fibrosis using dual-energy spectral detector computed tomography

PURPOSE

To evaluate feasibility of computer tomography texture analysis (CTTA) at different energy level using dual-energy spectral detector CT for liver fibrosis.

MATERIALS AND METHODS

Eighty-seven patients who underwent a spectral CT examination and had a reference standard of liver fibrosis (histopathologic findings, n = 61, or clinical findings for normal, n = 26) were included. Mean gray-level intensity, mean number of positive pixels (MPP), entropy, skewness, and kurtosis using commercially available software (TexRAD) were compared at different energy levels. Optimal CTTA parameter cutoffs to diagnose liver fibrosis were evaluated. CTTA parameters at different energy levels correlated with liver fibrosis. The association of CTTA parameters with energy level was evaluated.

RESULTS

Mean gray-level intensity, skewness, kurtosis, and entropy showed significant differences between patients with and without clinically significant hepatic fibrosis (P < 0.05). Mean gray-level intensity at 50 keV was significantly positively correlated with liver fibrosis (ρ = 0.502, P < 0.001). To diagnose stages F2-F4, entropy and mean gray-level intensity at low keV level showed the largest area under the curve (AUC; 0.79 and 0.79). Estimated marginal means (EMMs) of mean gray-level intensity showed prominent differences at low energy levels.

CONCLUSION

CTTA parameters from different keV levels demonstrated meaningful accuracy for diagnosis of liver fibrosis or clinically significant hepatic fibrosis.

A Task-dependent Investigation on Dose and Texture in CT Image Reconstruction

Localizing and characterizing clinically-significant lung nodules, a potential precursor to lung cancer, at the lowest achievable radiation dose is demanded to minimize the stochastic radiation effects from x-ray computed tomography (CT). A minimal dose level is heavily dependent on the image reconstruction algorithms and clinical task, in which the tissue texture always plays an important role. This study aims to investigate the dependence through a task-based evaluation at multiple dose levels and variable textures in reconstructions with prospective patient studies. 133 patients with a suspicious pulmonary nodule scheduled for biopsy were recruited and the data was acquired at120kVp with three different dose levels of 100, 40 and 20mAs. Three reconstruction algorithms were implemented: analytical filtered back-projection (FBP) with optimal noise filtering; statistical Markov random field (MRF) model with optimal Huber weighting (MRF-H) for piecewise smooth reconstruction; and tissue-specific texture model (MRF-T) for texture preserved statistical reconstruction. Experienced thoracic radiologists reviewed and scored all images at random, blind to the CT dose and reconstruction algorithms. The radiologists identified the nodules in each image including the 133 biopsy target nodules and 66 other non-target nodules. For target nodule characterization, only MRF-T at 40mAs showed no statistically significant difference from FBP at 100mAs. For localizing both the target nodules and the non-target nodules, some as small as 3mm, MRF-T at 40 and 20mAs levels showed no statistically significant difference from FBP at 100mAs, respectively. MRF-H and FBP at 40 and 20mAs levels performed statistically differently from FBP at 100mAs. This investigation concluded that (1) the textures in the MRF-T reconstructions improves both the tasks of localizing and characterizing nodules at low dose CT and (2) the task of characterizing nodules is more challenging than the task of localizing nodules and needs more dose or enhanced textures from reconstruction.

3D-GLCM CNN: A 3-Dimensional Gray-Level Co-Occurrence Matrix-Based CNN Model for Polyp Classification via CT Colonography

Accurately classifying colorectal polyps, or differentiating malignant from benign ones, has a significant clinical impact on early detection and identifying optimal treatment of colorectal cancer. Convolution neural network (CNN) has shown great potential in recognizing different objects (e.g. human faces) from multiple slice (or color) images, a task similar to the polyp differentiation, given a large learning database. This study explores the potential of CNN learning from multiple slice (or feature) images to differentiate malignant from benign polyps from a relatively small database with pathological ground truth, including 32 malignant and 31 benign polyps represented by volumetric computed tomographic (CT) images. The feature image in this investigation is the gray-level co-occurrence matrix (GLCM). For each volumetric polyp, there are 13 GLCMs, computed from each of the 13 directions through the polyp volume. For comparison purpose, the CNN learning is also applied to the multi-slice CT images of the volumetric polyps. The comparison study is further extended to include Random Forest (RF) classification of the Haralick texture features (derived from the GLCMs). From the relatively small database, this study achieved scores of 0.91/0.93 (two-fold/leave-one-out evaluations) AUC (area under curve of the receiver operating characteristics) by using the CNN on the GLCMs, while the RF reached 0.84/0.86 AUC on the Haralick features and the CNN rendered 0.79/0.80 AUC on the multiple-slice CT images. The presented CNN learning from the GLCMs can relieve the challenge associated with relatively small database, improve the classification performance over the CNN on the raw CT images and the RF on the Haralick features, and have the potential to perform the clinical task of differentiating malignant from benign polyps with pathological ground truth.

Constructing a tissue-specific texture prior by machine learning from previous full-dose scan for Bayesian reconstruction of current ultralow-dose CT images

Purpose: Bayesian theory provides a sound framework for ultralow-dose computed tomography (ULdCT) image reconstruction with two terms for modeling the data statistical property and incorporating a priori knowledge for the image that is to be reconstructed. We investigate the feasibility of using a machine learning (ML) strategy, particularly the convolutional neural network (CNN), to construct a tissue-specific texture prior from previous full-dose computed tomography. Approach: Our study constructs four tissue-specific texture priors, corresponding with lung, bone, fat, and muscle, and integrates the prior with the prelog shift Poisson (SP) data property for Bayesian reconstruction of ULdCT images. The Bayesian reconstruction was implemented by an algorithm called SP-CNN-T and compared with our previous Markov random field (MRF)-based tissue-specific texture prior algorithm called SP-MRF-T. Results: In addition to conventional quantitative measures, mean squared error and peak signal-to-noise ratio, structure similarity index, feature similarity, and texture Haralick features were used to measure the performance difference between SP-CNN-T and SP-MRF-T algorithms in terms of the structure and tissue texture preservation, demonstrating the feasibility and the potential of the investigated ML approach. Conclusions: Both training performance and image reconstruction results showed the feasibility of constructing CNN texture prior model and the potential of improving the structure preservation of the nodule comparing to our previous regional tissue-specific MRF texture prior model.

The feasibility of differentiating colorectal cancer from normal and inflammatory thickening colon wall using CT texture analysis

To investigate the diagnostic value of texture analysis (TA) for differentiating between colorectal cancer (CRC), colonic lesions caused by inflammatory bowel disease (IBD), and normal thickened colon wall (NTC) on computed tomography (CT) and assess which scanning phase has the highest differential diagnostic value. In all, 107 patients with CRC, 113 IBD patients with colonic lesions, and 96 participants with NTC were retrospectively enrolled. All subjects underwent multiphase CT examination, including pre-contrast phase (PCP), arterial phase (AP), and portal venous phase (PVP) scans. Based on these images, classification by TA and visual classification by radiologists were performed to discriminate among the three tissue types. The performance of TA and visual classification was compared. Precise TA classification results (error, 2.03–12.48%) were acquired by nonlinear discriminant analysis for CRC, IBD and NTC, regardless of phase or feature selection. PVP images showed a better ability to discriminate the three tissues by comprising the three scanning phases. TA showed significantly better performance in discriminating CRC, IBD and NTC than visual classification for residents, but there was no significant difference in classification between TA and experienced radiologists. TA could provide useful quantitative information for the differentiation of CRC, IBD and NTC on CT, particularly in PVP images.

Multilayer feature selection method for polyp classification via computed tomographic colonography

Polyp classification is a feature selection and clustering process. Picking the most effective features from multiple polyp descriptors without redundant information is a great challenge in this procedure. We propose a multilayer feature selection method to construct an optimized descriptor for polyp classification with a feature-grouping strategy in a hierarchical framework. First, the proposed method makes good use of image metrics, such as intensity, gradient, and curvature, to divide their corresponding polyp descriptors into several feature groups, which are the preliminary units of this method. Then each preliminary unit generates two ranked descriptors, i.e., their optimized variable groups (OVGs) and preliminary classification measurements. Next, a feature dividing-merging (FDM) algorithm is designed to perform feature merging operation hierarchically and iteratively. Unlike traditional feature selection methods, the proposed FDM algorithm includes two steps for feature dividing and feature merging. At each layer, feature dividing selects the OVG with the highest area under the receiver operating characteristic curve (AUC) as the baseline while other descriptors are treated as its complements. In the fusion step, the FDM merges some variables with gains into the baseline from the complementary descriptors iteratively on every layer until the final descriptor is obtained. This proposed model (including the forward step algorithm and the FDM algorithm) is a greedy method that guarantees clustering monotonicity of all OVGs from the bottom to the top layer. In our experiments, all the selected results from each layer are reported by both graphical illustration and data analysis. Performance of the proposed method is compared to five existing classification methods by a polyp database of 63 samples with pathological reports. The experimental results show that our proposed method outperforms other methods by 4% to 23% gains in terms of AUC scores.

Multi-scale characterizations of colon polyps via computed tomographic colonography

Texture features have played an essential role in the field of medical imaging for computer-aided diagnosis. The gray-level co-occurrence matrix (GLCM)-based texture descriptor has emerged to become one of the most successful feature sets for these applications. This study aims to increase the potential of these features by introducing multi-scale analysis into the construction of GLCM texture descriptor. In this study, we first introduce a new parameter - stride, to explore the definition of GLCM. Then we propose three multi-scaling GLCM models according to its three parameters, (1) learning model by multiple displacements, (2) learning model by multiple strides (LMS), and (3) learning model by multiple angles. These models increase the texture information by introducing more texture patterns and mitigate direction sparsity and dense sampling problems presented in the traditional Haralick model. To further analyze the three parameters, we test the three models by performing classification on a dataset of 63 large polyp masses obtained from computed tomography colonoscopy consisting of 32 adenocarcinomas and 31 benign adenomas. Finally, the proposed methods are compared to several typical GLCM-texture descriptors and one deep learning model. LMS obtains the highest performance and enhances the prediction power to 0.9450 with standard deviation 0.0285 by area under the curve of receiver operating characteristics score which is a significant improvement.

Energy enhanced tissue texture in spectral computed tomography for lesion classification

Tissue texture reflects the spatial distribution of contrasts of image voxel gray levels, i.e., the tissue heterogeneity, and has been recognized as important biomarkers in various clinical tasks. Spectral computed tomography (CT) is believed to be able to enrich tissue texture by providing different voxel contrast images using different X-ray energies. Therefore, this paper aims to address two related issues for clinical usage of spectral CT, especially the photon counting CT (PCCT): (1) texture enhancement by spectral CT image reconstruction, and (2) spectral energy enriched tissue texture for improved lesion classification. For issue (1), we recently proposed a tissue-specific texture prior in addition to low rank prior for the individual energy-channel low-count image reconstruction problems in PCCT under the Bayesian theory. Reconstruction results showed the proposed method outperforms existing methods of total variation (TV), low-rank TV and tensor dictionary learning in terms of not only preserving texture features but also suppressing image noise. For issue (2), this paper will investigate three models to incorporate the enriched texture by PCCT in accordance with three types of inputs: one is the spectral images, another is the co-occurrence matrices (CMs) extracted from the spectral images, and the third one is the Haralick features (HF) extracted from the CMs. Studies were performed on simulated photon counting data by introducing attenuation-energy response curve to the traditional CT images from energy integration detectors. Classification results showed the spectral CT enriched texture model can improve the area under the receiver operating characteristic curve (AUC) score by 7.3%, 0.42% and 3.0% for the spectral images, CMs and HFs respectively on the five-energy spectral data over the original single energy data only. The CM- and HF-inputs can achieve the best AUC of 0.934 and 0.927. This texture themed study shows the insight that incorporating clinical important prior information, e.g., tissue texture in this paper, into the medical imaging, such as the upstream image reconstruction, the downstream diagnosis, and so on, can benefit the clinical tasks.

An investigation of CNN models for differentiating malignant from benign lesions using small pathologically proven datasets

Cancer has been one of the most threatening diseases to human health. There have been many efforts devoted to the advancement of radiology and transformative tools (e.g. non-invasive computed tomographic or CT imaging) to detect cancer in early stages. One of the major goals is to identify malignant from benign lesions. In recent years, machine deep learning (DL), e.g. convolutional neural network (CNN), has shown encouraging classification performance on medical images. However, DL algorithms always need large datasets with ground truth. Yet in the medical imaging field, especially for cancer imaging, it is difficult to collect such large volume of images with pathological information. Therefore, strategies are needed to learn effectively from small datasets via CNN models. To forward that goal, this paper explores two CNN models by focusing extensively on expansion of training samples from two small pathologically proven datasets (colorectal polyp dataset and lung nodule dataset) and then differentiating malignant from benign lesions. Experimental outcomes indicate that even in very small datasets of less than 70 subjects, malignance can be successfully differentiated from benign via the proposed CNN models, the average AUCs (area under the receiver operating curve) of differentiating colorectal polyps and pulmonary nodules are 0.86 and 0.71, respectively. Our experiments further demonstrate that for these two small datasets, instead of only studying the original raw CT images, feeding additional image features, such as the local binary pattern of the lesions, into the CNN models can significantly improve classification performance. In addition, we find that our explored voxel level CNN model has better performance when facing the small and unbalanced datasets.

A Feasibility Study of Extracting Tissue Textures From a Previous Full-Dose CT Database as Prior Knowledge for Bayesian Reconstruction of Current Low-Dose CT Images

Markov random field (MRF) has been widely used to incorporate a priori knowledge as penalty or regularizer to preserve edge sharpness while smoothing the region enclosed by the edge for pieces-wise smooth image reconstruction. In our earlier study, we proposed a type of MRF reconstruction method for low-dose CT (LdCT) scans using tissue-specific textures extracted from the same patient's previous full-dose CT (FdCT) scans as prior knowledge. It showed advantages in clinical applications. This paper aims to remove the constraint of using previous data of the same patient. We investigated the feasibility of extracting the tissue-specific MRF textures from an FdCT database to reconstruct a LdCT image of another patient. This feasibility study was carried out by experiments designed as follows. We constructed a tissue-specific MRF-texture database from 3990 FdCT scan slices of 133 patients who were scheduled for lung nodule biopsy. Each patient had one FdCT scan (120 kVp/100 mAs) and one LdCT scan (120 kVp/20 mAs) prior to biopsy procedure. When reconstructing the LdCT image of one patient among the 133 patients, we ranked the closeness of the MRF-textures from the other 132 patients saved in the database and used them as the a prior knowledge. Then, we evaluated the reconstructed image quality using Haralick texture measures. For any patient within our database, we found more than eighteen patients' FdCT MRF texures can be used without noticeably changing the Haralick texture measures on the lung nodules (to be biopsied). These experimental outcomes indicate it is promising that a sizable FdCT texture database could be used to enhance Bayesian reconstructions of any incoming LdCT scans.

Machine learning for computer-aided polyp detection using wavelets and content-based image

The continuous growing of machine learning techniques, their capabilities improvements and the availability of data being continuously collected, recorded and updated, can enhance diagnosis stages by making it faster and more accurate than human diagnosis. In lower endoscopies procedures, most of the diagnosis relies on the capabilities and expertise of the physician. During medical training, physicians can be benefited from the assistance of algorithms able to automatically detect polyps, thus enhancing their diagnosis. In this paper, we propose a machine learning approach trained to detect polyps in lower endoscopies recordings with high accuracy and sensitivity, previously processed using wavelet transform for feature extraction. The propose system is validated using available datasets. From a set of 1132 images, our system showed a 97.9% of accuracy in diagnosing polyps, around 10% more efficient than other approaches using techniques with a low computational requirement previously published. In addition, the false positive rate was 0.03. This encouraging result can be also extended to other diagnosis.

Use of Precision Imaging in the Evaluation of Pancreas Cancer

Pancreas cancer is an aggressive and fatal disease that will become one of the leading causes of cancer mortality by 2030. An all-out effort is underway to better understand the basic biologic mechanisms of this disease ranging from early development to metastatic disease. In order to change the course of this disease, diagnostic radiology imaging may play a vital role in providing a precise, noninvasive method for early diagnosis and assessment of treatment response. Recent progress in combining medical imaging, advanced image analysis and artificial intelligence, termed radiomics, can offer an innovate approach in detecting the earliest changes of tumor development as well as a rapid method for the detection of response. In this chapter, we introduce the principles of radiomics and demonstrate how it can provide additional information into tumor biology, early detection, and response assessments advancing the goals of precision imaging to deliver the right treatment to the right person at the right time.

Analysis of Perceptual Expertise in Radiology - Current Knowledge and a New Perspective

Radiologists rely principally on visual inspection to detect, describe, and classify findings in medical images. As most interpretive errors in radiology are perceptual in nature, understanding the path to radiologic expertise during image analysis is essential to educate future generations of radiologists. We review the perceptual tasks and challenges in radiologic diagnosis, discuss models of radiologic image perception, consider the application of perceptual learning methods in medical training, and suggest a new approach to understanding perceptional expertise. Specific principled enhancements to educational practices in radiology promise to deepen perceptual expertise among radiologists with the goal of improving training and reducing medical error.

Volumetric Textural Analysis of Colorectal Masses at CT Colonography: Differentiating Benign versus Malignant Pathology and Comparison with Human Reader Performance

RATIONALE AND OBJECTIVES

To (1) apply a quantitative volumetric textural analysis (VTA) to colorectal masses at CT colonography (CTC) for the differentiation of malignant and benign lesions and to (2) compare VTA with human performance.

MATERIALS AND METHODS

A validated, quantitative VTA method was applied to 63 pathologically proven colorectal masses (mean size, 4.2 cm; range, 3-8 cm) at noncontrast CTC in 59 adults (mean age, 66.5 years; range, 45.9-91.6 years). Fifty-one percent (32/63) of the masses were invasive adenocarcinoma, and the remaining 49% (31/63) were large benign adenomas. Three readers with CTC experience independently assessed the likelihood of malignancy using a 5-point scale (1 = definitely benign, 2 = probably benign, 3 = indeterminate, 4 = probably malignant, 5 = definitely malignant). Areas under the curve (AUCs) and accuracy levels were compared.

RESULTS

VTA achieved optimal sensitivity of 83.6% vs 91.7% for human readers (P = .034), with specificities of 87.5% and 77.4%, respectively (P = .007). No significant difference in overall accuracy was seen between VTA and human readers (85.5% vs 84.7%, P = .753). The AUC for differentiating benign and malignant lesions was 0.936 for VTA and 0.917 for human readers. Intraclass correlation coefficient among the human readers was 0.76, indicating good to excellent agreement.

CONCLUSION

VTA demonstrates excellent performance for distinguishing benign from malignant colorectal masses (≥3 cm) at CTC, comparable yet potentially complementary to experienced human performance.

Expert knowledge-infused deep learning for automatic lung nodule detection

BACKGROUND

Computer aided detection (CADe) of pulmonary nodules from computed tomography (CT) is crucial for early diagnosis of lung cancer. Self-learned features obtained by training datasets via deep learning have facilitated CADe of the nodules. However, the complexity of CT lung images renders a challenge of extracting effective features by self-learning only. This condition is exacerbated for limited size of datasets. On the other hand, the engineered features have been widely studied.

OBJECTIVE

We proposed a novel nodule CADe which aims to relieve the challenge by the use of available engineered features to prevent convolution neural networks (CNN) from overfitting under dataset limitation and reduce the running-time complexity of self-learning.

METHODS

The CADe methodology infuses adequately the engineered features, particularly texture features, into the deep learning process.

RESULTS

The methodology was validated on 208 patients with at least one juxta-pleural nodule from the public LIDC-IDRI database. Results demonstrated that the methodology achieves a sensitivity of 88% with 1.9 false positives per scan and a sensitivity of 94.01% with 4.01 false positives per scan.

CONCLUSIONS

The methodology shows high performance compared with the state-of-the-art results, in terms of accuracy and efficiency, from both existing CNN-based approaches and engineered feature-based classifications.

The Natural History of Colorectal Polyps: Overview of Predictive Static and Dynamic Features

For decades, colorectal screening strategies have been largely driven by static features, particularly polyp size. Although cross-sectional features of polyp size, morphology, and location are important determinants of clinical relevance before histology, they lack any dynamic information on polyp growth rates. Computed tomography colonography allows for in vivo surveillance of colorectal polyps, providing volumetric growth rates that are providing new insights into tumorigenesis. In this article, existing cross-sectional and longitudinal data on colorectal polyps are reviewed, with an emphasis on how these features may affect clinical relevance and patient management.

A two-stage classification method for borehole-wall images with support vector machine

Analyzing geological drilling hole images acquired by Axial View Panoramic Borehole Televiewer (APBT) is a key step to explore the geological structure in a geological exploration. Conventionally, the borehole images are examined by technicians, which is inefficient and subjective. In this paper, three dominant types of borehole-wall images on coal-rock mass structure, namely, border images, fracture images and intact rock mass images are mainly studied. The traditional image classification methods based on unified feature extraction algorithm and single classifier is not effect for the borehole images. Therefore, this paper proposes a novel two-stage classification approach to improve the classification performance of borehole images. In the first-stage classification, the border images are identified from three kinds of images based on texture features and gray-scale histograms features. For the remaining two types of images, in the second-stage classification, Gabor filter is first applied to segment the region of interest (ROI) (such as microfracture, absciss layer and horizontal cracks, etc.) and the central interference region. Then, using the same feature vector after eliminating the central interference region, fracture images are separated from intact rock mass images. We test our two-stage classification system with real borehole images. The results of experimental show that the two-stage classification method can effectively classify three major borehole-wall images with the correction rate of 95.55% in the first stage and 95% in the second stage.

Wheat Ears Counting in Field Conditions Based on Multi-Feature Optimization and TWSVM

The number of wheat ears in the field is very important data for predicting crop growth and estimating crop yield and as such is receiving ever-increasing research attention. To obtain such data, we propose a novel algorithm that uses computer vision to accurately recognize wheat ears in a digital image. First, red-green-blue images acquired by a manned ground vehicle are selected based on light intensity to ensure that this method is robust with respect to light intensity. Next, the selected images are cut to ensure that the target can be identified in the remaining parts. The simple linear iterative clustering method, which is based on superpixel theory, is then used to generate a patch from the selected images. After manually labeling each patch, they are divided into two categories: wheat ears and background. The color feature "Color Coherence Vectors," the texture feature "Gray Level Co-Occurrence Matrix," and a special image feature "Edge Histogram Descriptor" are then exacted from these patches to generate a high-dimensional matrix called the "feature matrix." Because each feature plays a different role in the classification process, a feature-weighting fusion based on kernel principal component analysis is used to redistribute the feature weights. Finally, a twin-support-vector-machine segmentation (TWSVM-Seg) model is trained to understand the differences between the two types of patches through the features, and the TWSVM-Seg model finally achieves the correct classification of each pixel from the testing sample and outputs the results in the form of binary image. This process thus segments the image. Next, we use a statistical function in Matlab to get the exact a precise number of ears. To verify these statistical numerical results, we compare them with field measurements of the wheat plots. The result of applying the proposed algorithm to ground-shooting image data sets correlates strongly (with a precision of 0.79-0.82) with the data obtained by manual counting. An average running time of 0.1 s is required to successfully extract the correct number of ears from the background, which shows that the proposed algorithm is computationally efficient. These results indicate that the proposed method provides accurate phenotypic data on wheat seedlings.

CT Texture Analysis: Definitions, Applications, Biologic Correlates, and Challenges

This review discusses potential oncologic and nononcologic applications of CT texture analysis ( CTTA CT texture analysis ), an emerging area of "radiomics" that extracts, analyzes, and interprets quantitative imaging features. CTTA CT texture analysis allows objective assessment of lesion and organ heterogeneity beyond what is possible with subjective visual interpretation and may reflect information about the tissue microenvironment. CTTA CT texture analysis has shown promise in lesion characterization, such as differentiating benign from malignant or more biologically aggressive lesions. Pretreatment CT texture features are associated with histopathologic correlates such as tumor grade, tumor cellular processes such as hypoxia or angiogenesis, and genetic features such as KRAS or epidermal growth factor receptor (EGFR) mutation status. In addition, and likely as a result, these CT texture features have been linked to prognosis and clinical outcomes in some tumor types. CTTA CT texture analysis has also been used to assess response to therapy, with decreases in tumor heterogeneity generally associated with pathologic response and improved outcomes. A variety of nononcologic applications of CTTA CT texture analysis are emerging, particularly quantifying fibrosis in the liver and lung. Although CTTA CT texture analysis seems to be a promising imaging biomarker, there is marked variability in methods, parameters reported, and strength of associations with biologic correlates. Before CTTA CT texture analysis can be considered for widespread clinical implementation, standardization of tumor segmentation and measurement techniques, image filtration and postprocessing techniques, and methods for mathematically handling multiple tumors and time points is needed, in addition to identification of key texture parameters among hundreds of potential candidates, continued investigation and external validation of histopathologic correlates, and structured reporting of findings. ^©RSNA, 2017.

Preoperative prediction of muscular invasiveness of bladder cancer with radiomic features on conventional MRI and its high-order derivative maps

PURPOSE

To determine radiomic features which are capable of reflecting muscular invasiveness of bladder cancer (BC) and propose a non-invasive strategy for the differentiation of muscular invasiveness preoperatively.

METHODS

Sixty-eight patients with clinicopathologically confirmed BC were included in this retrospective study. A total of 118 cancerous volumes of interest (VOI) were segmented from patients' T2 weighted MR images (T2WI), including 34 non-muscle invasive bladder carcinomas (NMIBCs, stage <T2) and 84 muscle invasive ones (MIBCs, stage ≥T2). The radiomic features quantifying tumor signal intensity and textures were extracted from each VOI and its high-order derivative maps to characterize heterogeneity of tumor tissues. Statistical analysis was used to build radiomic signatures with significant inter-group differences of NMIBCs and MIBCs. The synthetic minority oversampling technique (SMOTE) and a support vector machine (SVM)-based feature selection and classification strategy were proposed to first rebalance the imbalanced sample size and then further select the most predictive and compact signature subset to verify its differentiation capability.

RESULTS

From each tumor VOI, a total of 63 radiomic features were derived and 30 of them showed significant inter-group differences (P ≤ 0.01). By using the SVM-based feature selection algorithm with rebalanced samples, an optimal subset including 13 radiomic signatures was determined. The area under receiver operating characteristic curve and Youden index were improved to 0.8610 and 0.7192, respectively.

CONCLUSION

3D radiomic signatures derived from T2WI and its high-order derivative maps could reflect muscular invasiveness of bladder cancer, and the proposed strategy can be used to facilitate the preoperative prediction of muscular invasiveness in patients with bladder cancer.

Three-dimensional texture features from intensity and high-order derivative maps for the discrimination between bladder tumors and wall tissues via MRI

PURPOSE

This study aims to determine the three-dimensional (3D) texture features extracted from intensity and high-order derivative maps that could reflect textural differences between bladder tumors and wall tissues, and propose a noninvasive, image-based strategy for bladder tumor differentiation preoperatively.

METHODS

A total of 62 cancerous and 62 wall volumes of interest (VOI) were extracted from T2-weighted MRI datasets of 62 patients with pathologically confirmed bladder cancer. To better reflect heterogeneous distribution of tumor tissues, 3D high-order derivative maps (the gradient and curvature maps) were calculated from each VOI. Then 3D Haralick features based on intensity and high-order derivative maps and Tamura features based on intensity maps were extracted from each VOI. Statistical analysis and recursive feature elimination-based support vector machine classifier (RFE-SVM) was proposed to first select the features with significant differences and then obtain a more predictive and compact feature subset to verify its differentiation performance.

RESULTS

From each VOI, a total of 58 texture features were derived. Among them, 37 features showed significant inter-class differences ([Formula: see text]). With 29 optimal features selected by RFE-SVM, the classification results namely the sensitivity, specificity, accuracy and area under the curve (AUC) of the receiver operating characteristics were 0.9032, 0.8548, 0.8790 and 0.9045, respectively. By using synthetic minority oversampling technique to augment the sample number of each group to 200, the sensitivity, specificity, accuracy an AUC value of the feature selection-based classification were improved to 0.8967, 0.8780, 0.8874 and 0.9416, respectively.

CONCLUSIONS

Our results suggest that 3D texture features derived from intensity and high-order derivative maps can better reflect heterogeneous distribution of cancerous tissues. Texture features optimally selected together with sample augmentation could improve the performance on differentiating bladder carcinomas from wall tissues, suggesting a potential way for tumor noninvasive staging of bladder cancer preoperatively.