Ensemble Support Vector Recurrent Neural Network for Brain Signal Detection

A stacking classifier for distinguishing stages of Alzheimer's disease from a subnetwork perspective

Accurately distinguishing stages of Alzheimer's disease (AD) is crucial for diagnosis and treatment. In this paper, we introduce a stacking classifier method that combines six single classifiers into a stacking classifier. Using brain network models and network metrics, we employ t-tests to identify abnormal brain regions, from which we construct a subnetwork and extract its features to form the training dataset. Our method is then applied to the ADNI (Alzheimer's Disease Neuroimaging Initiative) datasets, categorizing the stages into four categories: Alzheimer's disease, mild cognitive impairment (MCI), mixed Alzheimer's mild cognitive impairment (ADMCI), and healthy controls (HCs). We investigate four classification groups: AD-HCs, AD-MCI, HCs-ADMCI, and HCs-MCI. Finally, we compare the classification accuracy between a single classifier and our stacking classifier, demonstrating superior accuracy with our stacking classifier from a subnetwork-based viewpoint.

Design and Implementation of Pavlovian Associative Memory Based on DNA Neurons

In the field of biocomputing and neural networks, deoxyribonucleic acid (DNA) strand displacement (DSD) technology performs well in computation, programming, and information processing. In this article, the multiplication gate, addition gate, and threshold gate based on DSD are used to cascade into a single DNA neuron. Multiple DNA neurons can be cascaded to form different neural networks. The DNA neural networks are designed to implement seven classical conditioned reflexes from Pavlovian associative memory experiments. A classical conditioned reflex is a combination of a conditioned stimulus (CS) and another un CS with a reward or punishment. So that the individual develops a conditioned reflex that is similar to an unconditioned reflex in the use of CS alone. The seven classical conditioned reflexes include acquisition and forgetting, interstimulus interval effect, blocking, conditioned inhibition, overshadowing, generation, and differentiation. The simulations are verified by the software visual DSD. This article provides a direction for the integration of biology and psychology.

Memristor-Based Neural Network Circuit of Associative Memory With Overshadowing and Emotion Congruent Effect

Most memristor-based neural network circuits consider only a single pattern of overshadowing or emotion, but the relationship between overshadowing and emotion is ignored. In this article, a memristor-based neural network circuit of associative memory with overshadowing and emotion congruent effect is designed, and overshadowing under multiple emotions is taken into account. The designed circuit mainly consists of an emotion module, a memory module, an inhibition module, and a feedback module. The generation and recovery of different emotions are realized by the emotion module. The functions of overshadowing under different emotions and recovery from overshadowing are achieved by the inhibition module and the memory module. Finally, the blocking caused by long-term overshadowing is implemented by the feedback module. The proposed circuit can be applied to bionic emotional robots and offers some references for brain-like systems.

Multiple Mittag-Leffler Stability of Almost Periodic Solutions for Fractional-Order Delayed Neural Networks: Distributed Optimization Approach

This article proposes new theoretical results on the multiple Mittag-Leffler stability of almost periodic solutions (APOs) for fractional-order delayed neural networks (FDNNs) with nonlinear and nonmonotonic activation functions. Profited from the superior geometrical construction of activation function, the considered FDNNs have multiple APOs with local Mittag-Leffler stability under given algebraic inequality conditions. To solve the algebraic inequality conditions, especially in high-dimensional cases, a distributed optimization (DOP) model and a corresponding neurodynamic solving approach are employed. The conclusions in this article generalize the multiple stability of integer- or fractional-order NNs. Besides, the consideration of the DOP approach can ameliorate the excessive consumption of computational resources when utilizing the LMI toolbox to deal with high-dimensional complex NNs. Finally, a simulation example is presented to confirm the accuracy of the theoretical conclusions obtained, and an experimental example of associative memories is shown.

Multivariate Modelling and Prediction of High-Frequency Sensor-Based Cerebral Physiologic Signals: Narrative Review of Machine Learning Methodologies

Monitoring cerebral oxygenation and metabolism, using a combination of invasive and non-invasive sensors, is vital due to frequent disruptions in hemodynamic regulation across various diseases. These sensors generate continuous high-frequency data streams, including intracranial pressure (ICP) and cerebral perfusion pressure (CPP), providing real-time insights into cerebral function. Analyzing these signals is crucial for understanding complex brain processes, identifying subtle patterns, and detecting anomalies. Computational models play an essential role in linking sensor-derived signals to the underlying physiological state of the brain. Multivariate machine learning models have proven particularly effective in this domain, capturing intricate relationships among multiple variables simultaneously and enabling the accurate modeling of cerebral physiologic signals. These models facilitate the development of advanced diagnostic and prognostic tools, promote patient-specific interventions, and improve therapeutic outcomes. Additionally, machine learning models offer great flexibility, allowing different models to be combined synergistically to address complex challenges in sensor-based data analysis. Ensemble learning techniques, which aggregate predictions from diverse models, further enhance predictive accuracy and robustness. This review explores the use of multivariate machine learning models in cerebral physiology as a whole, with an emphasis on sensor-derived signals related to hemodynamics, cerebral oxygenation, metabolism, and other modalities such as electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) where applicable. It will detail the operational principles, mathematical foundations, and clinical implications of these models, providing a deeper understanding of their significance in monitoring cerebral function.

Design, Analysis, and Application of a Discrete Error Redefinition Neural Network for Time-Varying Quadratic Programming

Time-varying quadratic programming (TV-QP) is widely used in artificial intelligence, robotics, and many other fields. To solve this important problem, a novel discrete error redefinition neural network (D-ERNN) is proposed. By redefining the error monitoring function and discretization, the proposed neural network is superior to some traditional neural networks in terms of convergence speed, robustness, and overshoot. Compared with the continuous ERNN, the proposed discrete neural network is more suitable for computer implementation. Unlike continuous neural networks, this article also analyzes and proves how to select the parameters and step size of the proposed neural networks to ensure the reliability of the network. Moreover, how to achieve the discretization of the ERNN is presented and discussed. The convergence of the proposed neural network without disturbance is proven, and bounded time-varying disturbances can be resisted in theory. Furthermore, the comparison results with other related neural networks show that the proposed D-ERNN has a faster convergence speed, better antidisturbance ability, and lower overshoot.

An FPGA-Implemented Antinoise Fuzzy Recurrent Neural Network for Motion Planning of Redundant Robot Manipulators

When a robot completes end-effector tasks, internal error noises always exist. To resist internal error noises of robots, a novel fuzzy recurrent neural network (FRNN) is proposed, designed, and implemented on field-programmable gated array (FPGA). The implementation is pipeline-based, which guarantees the order of overall operations. The data processing is based on across-clock domain, which is beneficial for computing units' acceleration. Compared with traditional gradient-based neural networks (NNs) and zeroing neural networks (ZNNs), the proposed FRNN has faster convergence rate and higher correctness. Practical experiments on a 3 degree-of-freedom (DOs) planar robot manipulator show that the proposed fuzzy RNN coprocessor needs 496 lookup table random access memories (LUTRAMs), 205.5 block random access memories (BRAMs), 41384 lookup tables (LUTs), and 16743 flip-flops (FFs) of the Xilinx XCZU9EG chip.

Self-supervised contrastive learning for EEG-based cross-subject motor imagery recognition

Objective. The extensive application of electroencephalography (EEG) in brain-computer interfaces (BCIs) can be attributed to its non-invasive nature and capability to offer high-resolution data. The acquisition of EEG signals is a straightforward process, but the datasets associated with these signals frequently exhibit data scarcity and require substantial resources for proper labeling. Furthermore, there is a significant limitation in the generalization performance of EEG models due to the substantial inter-individual variability observed in EEG signals.Approach. To address these issues, we propose a novel self-supervised contrastive learning framework for decoding motor imagery (MI) signals in cross-subject scenarios. Specifically, we design an encoder combining convolutional neural network and attention mechanism. In the contrastive learning training stage, the network undergoes training with the pretext task of data augmentation to minimize the distance between pairs of homologous transformations while simultaneously maximizing the distance between pairs of heterologous transformations. It enhances the amount of data utilized for training and improves the network's ability to extract deep features from original signals without relying on the true labels of the data.Main results. To evaluate our framework's efficacy, we conduct extensive experiments on three public MI datasets: BCI IV IIa, BCI IV IIb, and HGD datasets. The proposed method achieves cross-subject classification accuracies of 67.32%, 82.34%, and 81.13%on the three datasets, demonstrating superior performance compared to existing methods.Significance. Therefore, this method has great promise for improving the performance of cross-subject transfer learning in MI-based BCI systems.

A Deep Ensemble Dynamic Learning Network for Corona Virus Disease 2019 Diagnosis

Corona virus disease 2019 is an extremely fatal pandemic around the world. Intelligently recognizing X-ray chest radiography images for automatically identifying corona virus disease 2019 from other types of pneumonia and normal cases provides clinicians with tremendous conveniences in diagnosis process. In this article, a deep ensemble dynamic learning network is proposed. After a chain of image preprocessing steps and the division of image dataset, convolution blocks and the final average pooling layer are pretrained as a feature extractor. For classifying the extracted feature samples, two-stage bagging dynamic learning network is trained based on neural dynamic learning and bagging algorithms, which diagnoses the presence and types of pneumonia successively. Experimental results manifest that using the proposed deep ensemble dynamic learning network obtains 98.7179% diagnosis accuracy, which indicates more excellent diagnosis effect than existing state-of-the-art models on the open image dataset. Such accurate diagnosis effects provide convincing evidences for further detections and treatments.

The Dichotomy of Neural Networks and Cryptography: War and Peace

In recent years, neural networks and cryptographic schemes have come together in war and peace; a cross-impact that forms a dichotomy deserving a comprehensive review study. Neural networks can be used against cryptosystems; they can play roles in cryptanalysis and attacks against encryption algorithms and encrypted data. This side of the dichotomy can be interpreted as a war declared by neural networks. On the other hand, neural networks and cryptographic algorithms can mutually support each other. Neural networks can help improve the performance and the security of cryptosystems, and encryption techniques can support the confidentiality of neural networks. The latter side of the dichotomy can be referred to as the peace. There are, to the best of our knowledge, no current surveys that take a comprehensive look at the many ways neural networks are currently interacting with cryptography. This survey aims to fill that niche by providing an overview on the state of the cross-impact between neural networks and cryptography systems. To this end, this paper will highlight the current areas where progress is being made as well as the aspects where there is room for future research to be conducted.