Histogram-Based Features Selection and Volume of Interest Ranking for Brain PET Image Classification

Role of Machine Learning in Precision Oncology: Applications in Gastrointestinal Cancers

Gastrointestinal (GI) cancers, consisting of a wide spectrum of pathologies, have become a prominent health issue globally. Despite medical imaging playing a crucial role in the clinical workflow of cancers, standard evaluation of different imaging modalities may provide limited information. Accurate tumor detection, characterization, and monitoring remain a challenge. Progress in quantitative imaging analysis techniques resulted in "radiomics", a promising methodical tool that helps to personalize diagnosis and treatment optimization. Radiomics, a sub-field of computer vision analysis, is a bourgeoning area of interest, especially in this era of precision medicine. In the field of oncology, radiomics has been described as a tool to aid in the diagnosis, classification, and categorization of malignancies and to predict outcomes using various endpoints. In addition, machine learning is a technique for analyzing and predicting by learning from sample data, finding patterns in it, and applying it to new data. Machine learning has been increasingly applied in this field, where it is being studied in image diagnosis. This review assesses the current landscape of radiomics and methodological processes in GI cancers (including gastric, colorectal, liver, pancreatic, neuroendocrine, GI stromal, and rectal cancers). We explain in a stepwise fashion the process from data acquisition and curation to segmentation and feature extraction. Furthermore, the applications of radiomics for diagnosis, staging, assessment of tumor prognosis and treatment response according to different GI cancer types are explored. Finally, we discussed the existing challenges and limitations of radiomics in abdominal cancers and investigate future opportunities.

Discriminating Aging Cognitive Decline Spectrum Using PET and Magnetic Resonance Image Features

Background: The population aging increased the prevalence of brain diseases, like Alzheimer’s disease (AD), and early identification of individuals with higher odds of cognitive decline is essential to maintain quality of life. Imaging evaluation of individuals at risk of cognitive decline includes biomarkers extracted from brain positron emission tomography (PET) and structural magnetic resonance imaging (MRI). Objective: We propose investigating ensemble models to classify groups in the aging cognitive decline spectrum by combining features extracted from single imaging modalities and combinations of imaging modalities (FDG+AMY+MRI, and a PET ensemble). Methods: We group imaging data of 131 individuals into four classes related to the individuals’ cognitive assessment in baseline and follow-up: stable cognitive non-impaired; individuals converting to mild cognitive impairment (MCI) syndrome; stable MCI; and Alzheimer’s clinical syndrome. We assess the performance of four algorithms using leave-one-out cross-validation: decision tree classifier, random forest (RF), light gradient boosting machine (LGBM), and categorical boosting (CAT). The performance analysis of models is evaluated using balanced accuracy before and after using Shapley Additive exPlanations with recursive feature elimination (SHAP-RFECV) method. Results: Our results show that feature selection with CAT or RF algorithms have the best overall performance in discriminating early cognitive decline spectrum mainly using MRI imaging features. Conclusion: Use of CAT or RF algorithms with SHAP-RFECV shows good discrimination of early stages of aging cognitive decline, mainly using MRI image features. Further work is required to analyze the impact of selected brain regions and their correlation with cognitive decline spectrum.

Multi-scale discriminative regions analysis in FDG-PET imaging for early diagnosis of Alzheimer's disease

OBJECTIVE

Alzheimer's disease (AD) is a degenerative brain disorder, one of the main causes of death in elderly people, so early diagnosis of AD is vital to prompt access to medication and medical care. Fluorodeoxyglucose positron emission tomography (FDG-PET) proves to be effective to help understand neurological changes via measuring glucose uptake. Our aim is to explore information-rich regions of FDG-PET imaging, which enhance the accuracy and interpretability of AD-related diagnosis.

APPROACH

We develop a novel method for early diagnosis of AD based on multi-scale discriminative regions in FDG-PET imaging, which considers the diagnosis interpretability. Specifically, a multi-scale region localization (MSRL) module is discussed to automatically identify disease-related discriminative regions in full-volume FDG-PET images in an unsupervised manner, upon which a confidence score is designed to evaluate the prioritization of regions according to the density distribution of anomalies. Then, the proposed multi-scale region classification (MSRC) module adaptively fuses multi-scale region representations and makes decision fusion, which not only reduces useless information but also offers complementary information. Most of previous methods concentrate on discriminating AD from cognitively normal (CN), while mild cognitive impairment (MCI), a transitional state, facilitates early diagnosis. Therefore, our method is further applied to multiple AD-related diagnosis tasks, not limited to AD vs. CN.

MAIN RESULTS

Experimental results on the ADNI dataset show that the proposed method achieves superior performance over state-of-the-art FDG-PET-based approaches. Besides, some cerebral cortices highlighted by extracted regions cohere with medical research, further demonstrating the superiority.

SIGNIFICANCE

This work offers an effective method to achieve AD diagnosis and detect disease-affected regions in FDG-PET imaging. Our results could be beneficial for providing an additional opinion on the clinical diagnosis.

Alzheimer's Disease Diagnosis and Biomarker Analysis Using Resting-State Functional MRI Functional Brain Network With Multi-Measures Features and Hippocampal Subfield and Amygdala Volume of Structural MRI

Accurate diagnosis of the initial phase of Alzheimer's disease (AD) is essential and crucial. The objective of this research was to employ efficient biomarkers for the diagnostic analysis and classification of AD based on combining structural MRI (sMRI) and resting-state functional MRI (rs-fMRI). So far, several anatomical MRI imaging markers for AD diagnosis have been identified. The use of cortical and subcortical volumes, the hippocampus, and amygdala volume, as well as genetic patterns, has proven to be beneficial in distinguishing patients with AD from the healthy population. The fMRI time series data have the potential for specific numerical information as well as dynamic temporal information. Voxel and graphical analyses have gained popularity for analyzing neurodegenerative diseases, such as Alzheimer's and its prodromal phase, mild cognitive impairment (MCI). So far, these approaches have been utilized separately for the diagnosis of AD. In recent studies, the classification of cases of MCI into those that are not converted for a certain period as stable MCI (MCIs) and those that converted to AD as MCIc has been less commonly reported with inconsistent results. In this study, we verified and validated the potency of a proposed diagnostic framework to identify AD and differentiate MCIs from MCIc by utilizing the efficient biomarkers obtained from sMRI, along with functional brain networks of the frequency range .01-.027 at the resting state and the voxel-based features. The latter mainly included default mode networks (amplitude of low-frequency fluctuation [ALFF], fractional ALFF [ALFF], and regional homogeneity [ReHo]), degree centrality (DC), and salience networks (SN). Pearson's correlation coefficient for measuring fMRI functional networks has proven to be an efficient means for disease diagnosis. We applied the graph theory to calculate nodal features (nodal degree [ND], nodal path length [NL], and between centrality [BC]) as a graphical feature and analyzed the connectivity link between different brain regions. We extracted three-dimensional (3D) patterns to calculate regional coherence and then implement a univariate statistical t-test to access a 3D mask that preserves voxels showing significant changes. Similarly, from sMRI, we calculated the hippocampal subfield and amygdala nuclei volume using Freesurfer (version 6). Finally, we implemented and compared the different feature selection algorithms to integrate the structural features, brain networks, and voxel features to optimize the diagnostic identifications of AD using support vector machine (SVM) classifiers. We also compared the performance of SVM with Random Forest (RF) classifiers. The obtained results demonstrated the potency of our framework, wherein a combination of the hippocampal subfield, the amygdala volume, and brain networks with multiple measures of rs-fMRI could significantly enhance the accuracy of other approaches in diagnosing AD. The accuracy obtained by the proposed method was reported for binary classification. More importantly, the classification results of the less commonly reported MCIs vs. MCIc improved significantly. However, this research involved only the AD Neuroimaging Initiative (ADNI) cohort to focus on the diagnosis of AD advancement by integrating sMRI and fMRI. Hence, the study's primary disadvantage is its small sample size. In this case, the dataset we utilized did not fully reflect the whole population. As a result, we cannot guarantee that our findings will be applicable to other populations.

Comparing Methods of Feature Extraction of Brain Activities for Octave Illusion Classification Using Machine Learning

The aim of this study was to find an efficient method to determine features that characterize octave illusion data. Specifically, this study compared the efficiency of several automatic feature selection methods for automatic feature extraction of the auditory steady-state responses (ASSR) data in brain activities to distinguish auditory octave illusion and nonillusion groups by the difference in ASSR amplitudes using machine learning. We compared univariate selection, recursive feature elimination, principal component analysis, and feature importance by testifying the results of feature selection methods by using several machine learning algorithms: linear regression, random forest, and support vector machine. The univariate selection with the SVM as the classification method showed the highest accuracy result, 75%, compared to 66.6% without using feature selection. The received results will be used for future work on the explanation of the mechanism behind the octave illusion phenomenon and creating an algorithm for automatic octave illusion classification.

Computer-Aided Diagnosis System for Alzheimer's Disease Using Positron Emission Tomography Images

Alzheimer's disease (AD) is a kind of neurological brain disease. It is an irretrievable, neurodegenerative brain disorder. There are no pills or drugs to cure AD. Therefore, an early diagnosis may help the physician to make accurate analysis and to provide better treatment. With the advent of computational intelligence techniques, machine learning models have made tremendous progress in brain images analysis using MRI, SPECT and PEI. However, accurate analysis of brain scans is an extremely challenging task. The main focus of this paper is to design a Computer Aided Diagnosis (CAD) system using Long-Term Short Memory (LSTM) to improve classification rate and determine suitable attributes that can differentiate AD from Healthy Control (HC) subjects. First, 3D PET images are preprocessed, converted into many groups of 2D images and then grouped into many subsets at certain interval. Subsequently, different features including first order statistical, Gray Level Co-occurrence Matrix and wavelet energy of all sub-bands are extracted from each group, combined and taken as feature vectors. LSTM is designed and employed for classifying PET brain images into HC and AD subjects based on the feature vectors. Finally, the developed system is validated on 18FDG-PET images collected from 188 subjects including 105 HC and 83 AD subjects from ADNI database. Efficacy of the developed CAD system is analyzed using different features. Numerical results revealed that the developed CAD system yields classification accuracy of 98.9% when using combined features, showing outstanding performance.

A New Descriptor for Smile Classification Based on Cascade Classifier in Unconstrained Scenarios

In the development of human–machine interfaces, facial expression analysis has attracted considerable attention, as it provides a natural and efficient way of communication. Congruence between facial and behavioral inference in face processing is considered a serious challenge that needs to be solved in the near future. Automatic facial expression is a difficult classification issue because of the high interclass variability caused by the significant interdependence of the environmental conditions on the face appearance caused by head pose, scale, and illumination occlusions from their variances. In this paper, an adaptive model for smile classification is suggested that integrates a row-transform-based feature extraction algorithm and a cascade classifier to increase the precision of facial recognition. We suggest a histogram-based cascade smile classification method utilizing different facial features. The candidate feature set was designed based on the first-order histogram probability, and a cascade classifier with a variety of parameters was used at the classification stage. Row transformation is used to exclude any unnecessary coefficients in a vector, thereby enhancing the discriminatory capacity of the extracted features and reducing the sophistication of the calculations. Cascading gives the opportunity to train an extremely precise classification by taking a weighted average of poor learners’ decisions. Through accumulating positive and negative images of a single object, this algorithm can build a complete classifier capable of classifying different smiles in a limited amount of time (near real time) and with a high level of precision (92.2–98.8%) as opposed to other algorithms by large margins (5% compared with traditional neural network and 2% compared with Deep Neural Network based methods).

Artificial intelligence for molecular neuroimaging

In recent years, artificial intelligence (AI) or the study of how computers and machines can gain intelligence, has been increasingly applied to problems in medical imaging, and in particular to molecular imaging of the central nervous system. Many AI innovations in medical imaging include improving image quality, segmentation, and automating classification of disease. These advances have led to an increased availability of supportive AI tools to assist physicians in interpreting images and making decisions affecting patient care. This review focuses on the role of AI in molecular neuroimaging, primarily applied to positron emission tomography (PET) and single photon emission computed tomography (SPECT). We emphasize technical innovations such as AI in computed tomography (CT) generation for the purposes of attenuation correction and disease localization, as well as applications in neuro-oncology and neurodegenerative diseases. Limitations and future prospects for AI in molecular brain imaging are also discussed. Just as new equipment such as SPECT and PET revolutionized the field of medical imaging a few decades ago, AI and its related technologies are now poised to bring on further disruptive changes. An understanding of these new technologies and how they work will help physicians adapt their practices and succeed with these new tools.

Aggregation of Region-based and Boundary-based Knowledge Biased Segmentation for Osteoporosis Detection from X-Ray, Dual X-Ray and CT Images

BACKGROUND

Osteoporosis is a term used to represent the reduced bone density, which is caused by insufficient bone tissue production to balance the old bone tissue removal. Medical Imaging procedures such as X-Ray, Dual X-Ray and Computed Tomography (CT) scans are used widely in osteoporosis diagnosis. There are several existing procedures in practice to assist osteoporosis diagnosis, which can operate using a single imaging method.

OBJECTIVE

The purpose of this proposed work is to introduce a framework to assist the diagnosis of osteoporosis based on consenting all these X-Ray, Dual X-Ray and CT scan imaging techniques. The proposed work named "Aggregation of Region-based and Boundary-based Knowledge biased Segmentation for Osteoporosis Detection from X-Ray, Dual X-Ray and CT images" (ARBKSOD) is the integration of three functional modules.

METHODS

Fuzzy Histogram Medical Image Classifier (FHMIC), Log-Gabor Transform based ANN Training for osteoporosis detection (LGTAT) and Knowledge biased Osteoporosis Analyzer (KOA).

RESULTS

Together, all these three modules make the proposed method ARBKSOD scored the maximum accuracy of 93.11%, the highest precision value of 93.91% while processing the 6th image batch, the highest sensitivity of 92.93%, the highest specificity of 93.79% is observed during the experiment by ARBKSOD while processing the 6th image batch. The best average processing time of 10244 mS is achieved by ARBKSOD while processing the 7th image batch.

CONCLUSION

Together, all these three modules make the proposed method ARBKSOD to produce a better result.

PET Imaging of Tau Pathology and Amyloid-β, and MRI for Alzheimer's Disease Feature Fusion and Multimodal Classification

BACKGROUND

Machine learning is a promising tool for biomarker-based diagnosis of Alzheimer's disease (AD). Performing multimodal feature selection and studying the interaction between biological and clinical AD can help to improve the performance of the diagnosis models.

OBJECTIVE

This study aims to formulate a feature ranking metric based on the mutual information index to assess the relevance and redundancy of regional biomarkers and improve the AD classification accuracy.

METHODS

From the Alzheimer's Disease Neuroimaging Initiative (ADNI), 722 participants with three modalities, including florbetapir-PET, flortaucipir-PET, and MRI, were studied. The multivariate mutual information metric was utilized to capture the redundancy and complementarity of the predictors and develop a feature ranking approach. This was followed by evaluating the capability of single-modal and multimodal biomarkers in predicting the cognitive stage.

RESULTS

Although amyloid-β deposition is an earlier event in the disease trajectory, tau PET with feature selection yielded a higher early-stage classification F1-score (65.4%) compared to amyloid-β PET (63.3%) and MRI (63.2%). The SVC multimodal scenario with feature selection improved the F1-score to 70.0% and 71.8% for the early and late-stage, respectively. When age and risk factors were included, the scores improved by 2 to 4%. The Amyloid-Tau-Neurodegeneration [AT(N)] framework helped to interpret the classification results for different biomarker categories.

CONCLUSION

The results underscore the utility of a novel feature selection approach to reduce the dimensionality of multimodal datasets and enhance model performance. The AT(N) biomarker framework can help to explore the misclassified cases by revealing the relationship between neuropathological biomarkers and cognition.

Machine Learning Based Automated Segmentation and Hybrid Feature Analysis for Diabetic Retinopathy Classification Using Fundus Image

The object of this study was to demonstrate the ability of machine learning (ML) methods for the segmentation and classification of diabetic retinopathy (DR). Two-dimensional (2D) retinal fundus (RF) images were used. The datasets of DR-that is, the mild, moderate, non-proliferative, proliferative, and normal human eye ones-were acquired from 500 patients at Bahawal Victoria Hospital (BVH), Bahawalpur, Pakistan. Five hundred RF datasets (sized 256 × 256) for each DR stage and a total of 2500 (500 × 5) datasets of the five DR stages were acquired. This research introduces the novel clustering-based automated region growing framework. For texture analysis, four types of features-histogram (H), wavelet (W), co-occurrence matrix (COM) and run-length matrix (RLM)-were extracted, and various ML classifiers were employed, achieving 77.67%, 80%, 89.87%, and 96.33% classification accuracies, respectively. To improve classification accuracy, a fused hybrid-feature dataset was generated by applying the data fusion approach. From each image, 245 pieces of hybrid feature data (H, W, COM, and RLM) were observed, while 13 optimized features were selected after applying four different feature selection techniques, namely Fisher, correlation-based feature selection, mutual information, and probability of error plus average correlation. Five ML classifiers named sequential minimal optimization (SMO), logistic (Lg), multi-layer perceptron (MLP), logistic model tree (LMT), and simple logistic (SLg) were deployed on selected optimized features (using 10-fold cross-validation), and they showed considerably high classification accuracies of 98.53%, 99%, 99.66%, 99.73%, and 99.73%, respectively.

Multiscale spatial gradient features for 18F-FDG PET image-guided diagnosis of Alzheimer's disease

BACKGROUND AND OBJECTIVE

¹⁸F-FluoroDeoxyGlucose Positron Emission Tomography (¹⁸F-FDG PET) is one of the imaging biomarkers to diagnose Alzheimer's Disease (AD). In ¹⁸F-FDG PET images, the changes of voxels' intensities reflect the differences of glucose rates, therefore voxel intensity is usually used as a feature to distinguish AD from Normal Control (NC), or at earlier stage to distinguish between progressive and stable Mild Cognitive Impairment (pMCI and sMCI). In this paper, ¹⁸F-FDG PET images are characterized in an alternative way-the spatial gradient, which is motivated by the observation that the changes of ¹⁸F-FDG rates also cause gradient changes.

METHODS

We improve Histogram of Oriented Gradient (HOG) descriptor to quantify spatial gradients, thereby achieving the goal of diagnosing AD. First, the spatial gradient of ¹⁸F-FDG PET image is computed, and then each subject is segmented into different regions by using an anatomical atlas. Second, two types of improved HOG features are extracted from each region, namely Small Scale HOG and Large Scale HOG, then some relevant regions are selected based on a classifier fed with spatial gradient features. Last, an ensemble classification framework is designed to make a decision, which considers the performance of both individual and concatenated selected regions.

RESULTS

the evaluation is done on ADNI dataset. The proposed method outperforms other state-of-the-art ¹⁸F-FDG PET-based algorithms for AD vs. NC with an accuracy, a sensitivity and a specificity values of 93.65%, 91.22% and 96.25%, respectively. For the case of pMCI vs. sMCI, the three metrics are 75.38%, 74.84% and 77.11%, which is significantly better than most existing methods. Besides, promising results are also achieved for multiple classifications under ¹⁸F-FDG PET modality.

CONCLUSIONS

¹⁸F-FDG PET images can be characterized by spatial gradient features for diagnosing AD and its early stage, and the proposed ensemble framework can enhance the classification performance.