Time series classification using diversified Ensemble Deep Random Vector Functional Link and Resnet features

Multimodal Alzheimer's disease classification through ensemble deep random vector functional link neural network

Alzheimer's disease (AD) is a condition with a complex pathogenesis, sometimes hereditary, characterized by the loss of neurons and synapses, along with the presence of senile plaques and neurofibrillary tangles. Early detection, particularly among individuals at high risk, is critical for effective treatment or prevention, yet remains challenging due to data variability and incompleteness. Most current research relies on single data modalities, potentially limiting comprehensive staging of AD. This study addresses this gap by integrating multimodal data-including clinical and genetic information-using deep learning (DL) models, with a specific focus on random vector functional link (RVFL) networks, to enhance early detection of AD and mild cognitive impairment (MCI). Our findings demonstrate that ensemble deep RVFL (edRVFL) models, when combined with effective data imputation techniques such as Winsorized-mean (Wmean), achieve superior performance in detecting early stages of AD. Notably, the edRVFL model achieved an accuracy of 98.8%, precision of 98.3%, recall of 98.4%, and F1-score of 98.2%, outperforming traditional machine learning models like support vector machines, random forests, and decision trees. This underscores the importance of integrating advanced imputation strategies and deep learning techniques in AD diagnosis.

Ensemble Deep Random Vector Functional Link Network Using Privileged Information for Alzheimer's Disease Diagnosis

Alzheimer's disease (AD) is a progressive brain disorder. Machine learning models have been proposed for the diagnosis of AD at early stage. Recently, deep learning architectures have received quite a lot attention. Most of the deep learning architectures suffer from the issues of local minima, slow convergence and sensitivity to learning rate. To overcome these issues, non-iterative learning based deep randomized models especially random vector functional link network (RVFL) with direct links have proven to be successful. However, deep RVFL and its ensemble models are trained only on normal samples. In this paper, deep RVFL and its ensembles are enabled to incorporate privileged information, as the standard RVFL model and its deep models are unable to use privileged information. To fill this gap, we have incorporated learning using privileged information (LUPI) in deep RVFL model, and propose deep RVFL with LUPI framework (dRVFL+). Privileged information is available while training the models. As RVFL is an unstable classifier, we propose ensemble deep RVFL+ with LUPI framework (edRVFL+) which exploits the LUPI as well as the diversity among the base leaners for better classification. Unlike traditional ensemble approach wherein multiple base learners are trained, the proposed edRVFL+ model optimises a single network and generates an ensemble via optimization at different levels of random projections of the data. Both dRVFL+ and edRVFL+ efficiently utilise the privileged information which results in better generalization performance. In LUPI framework, half of the available features are used as normal features and rest as the privileged features. However, we propose a novel approach for generating the privileged information. We utilise different activation functions while processing the normal and privileged information in the proposed deep architectures. To the best of our knowledge, this is first time that a separate privileged information is generated. The proposed dRVFL+ and edRVFL+ models are employed for the diagnosis of Alzheimer's disease. Experimental results demonstrate the superiority of the proposed dRVFL+ and edRVFL+ models over baseline models. Thus, the proposed edRVFL+ model can be utilised in clinical setting for the diagnosis of AD.

Graph Embedded Ensemble Deep Randomized Network for Diagnosis of Alzheimer's Disease

Randomized shallow/deep neural networks with closed form solution avoid the shortcomings that exist in the back propagation (BP) based trained neural networks. Ensemble deep random vector functional link (edRVFL) network utilize the strength of two growing fields, i.e., deep learning and ensemble learning. However, edRVFL model doesn't consider the geometrical relationship of the data while calculating the final output parameters corresponding to each layer considered as base model. In the literature, graph embedded frameworks have been successfully used to describe the geometrical relationship within data. In this paper, we propose an extended graph embedded RVFL (EGERVFL) model that, unlike standard RVFL, employs both intrinsic and penalty subspace learning (SL) criteria under the graph embedded framework in its optimization process to calculate the model's output parameters. The proposed shallow EGERVFL model has only single hidden layer and hence, has less representation learning. Therefore, we further develop an ensemble deep EGERVFL (edEGERVFL) model that can be considered a variant of edRVFL model. Unlike edRVFL, the proposed edEGERVFL model solves graph embedded based optimization problem in each layer and hence, has better generalization performance than edRVFL model. We evaluated the proposed approaches for the diagnosis of Alzheimer's disease and furthermore on UCI datasets. The experimental results demonstrate that the proposed models perform better than baseline models. The source code of the proposed models is available at https://github.com/mtanveer1/.

Distinguish different sensorimotor performance of the hand between the individuals with diabetes mellitus and chronic kidney disease through deep learning models

Diabetes mellitus and chronic kidney disease represent escalating global epidemics with comorbidities akin to neuropathies, resulting in various neuromuscular symptoms that impede daily performance. Interestingly, previous studies indicated differing sensorimotor functions within these conditions. If assessing sensorimotor features can effectively distinguish between diabetes mellitus and chronic kidney disease, it could serve as a valuable and non-invasive indicator for early detection, swift screening, and ongoing monitoring, aiding in the differentiation between these diseases. This study classified diverse diagnoses based on motor performance using a novel pinch-holding-up-activity test and machine learning models based on deep learning. Dataset from 271 participants, encompassing 3263 hand samples across three cohorts (healthy adults, diabetes mellitus, and chronic kidney disease), formed the basis of analysis. Leveraging convolutional neural networks, three deep learning models were employed to classify healthy adults, diabetes mellitus, and chronic kidney disease based on pinch-holding-up-activity data. Notably, the testing set displayed accuracies of 95.3% and 89.8% for the intra- and inter-participant comparisons, respectively. The weighted F1 scores for these conditions reached 0.897 and 0.953, respectively. The study findings underscore the adeptness of the dilation convolutional neural networks model in distinguishing sensorimotor performance among individuals with diabetes mellitus, chronic kidney disease, and healthy adults. These outcomes suggest discernible differences in sensorimotor performance across the diabetes mellitus, chronic kidney disease, and healthy cohorts, pointing towards the potential of rapid screening based on these parameters as an innovative clinical approach.