An Attention-Aware Long Short-Term Memory-Like Spiking Neural Model for Sentiment Analysis

Global-Local Feature Fusion Network Based on Nonlinear Spiking Neural Convolutional Model for MRI Brain Tumor Segmentation

Due to the differences in size, shape, and location of brain tumors, brain tumor segmentation differs greatly from that of other organs. The purpose of brain tumor segmentation is to accurately locate and segment tumors from MRI images to assist doctors in diagnosis, treatment planning and surgical navigation. NSNP-like convolutional model is a new neural-like convolutional model inspired by nonlinear spiking mechanism of nonlinear spiking neural P (NSNP) systems. Therefore, this paper proposes a global-local feature fusion network based on NSNP-like convolutional model for MRI brain tumor segmentation. To this end, we have designed three characteristic modules that take full advantage of the NSNP-like convolution model: dilated SNP module (DSNP), multi-path dilated SNP pooling module (MDSP) and Poolformer module. The DSNP and MDSP modules are employed to construct the encoders. These modules help address the issue of feature loss and enable the fusion of more high-level features. On the other hand, the Poolformer module is used in the decoder. It processes features that contain global context information and facilitates the interaction between local and global features. In addition, channel spatial attention (CSA) module is designed at the skip connection between encoder and decoder to establish the long-range dependence between the same layers, thereby enhancing the relationship between channels and making the model have global modeling capabilities. In the experiments, our model achieves Dice coefficients of 85.71[Formula: see text], 92.32[Formula: see text], 87.75[Formula: see text] for ET, WT, and TC, respectively, on the N-BraTS2021 dataset. Moreover, our model achieves Dice coefficients of 83.91[Formula: see text], 91.96[Formula: see text], 90.14[Formula: see text] and 85.05[Formula: see text], 92.30[Formula: see text], 90.31[Formula: see text] on the BraTS2018 and BraTS2019 datasets respectively. Experimental results also indicate that our model not only achieves good brain tumor segmentation performance, but also has good generalization ability. The code is already available on GitHub: https://github.com/Li-JJ-1/NSNP-brain-tumor-segmentation.

Toward a Biologically Plausible SNN-Based Associative Memory with Context-Dependent Hebbian Connectivity

In this paper, we propose a spiking neural network model with Hebbian connectivity for implementing energy-efficient associative memory, whose activity is determined by input stimuli. The model consists of three interacting layers of Hodgkin-Huxley-Mainen spiking neurons with excitatory and inhibitory synaptic connections. Information patterns are stored in memory using a symmetric Hebbian matrix and can be retrieved in response to a specific stimulus pattern. Binary images are encoded using in-phase and anti-phase oscillations relative to a global clock signal. Utilizing the phase-locking effect allows for cluster synchronization of neurons (both on the input and output layers). Interneurons in the intermediate layer filter signal propagation pathways depending on the context of the input layer, effectively engaging only a portion of the synaptic connections within the Hebbian matrix for recognition. The stability of the oscillation phase is investigated for both in-phase and anti-phase synchronization modes when recognizing direct and inverse images. This context-dependent effect opens promising avenues for the development of analog hardware circuits for energy-efficient neurocomputing applications, potentially leading to breakthroughs in artificial intelligence and cognitive computing.

Exploring the Versatility of Spiking Neural Networks: Applications Across Diverse Scenarios

In the last few decades, Artificial Neural Networks have become more and more important, evolving into a powerful tool to implement learning algorithms. Spiking neural networks represent the third generation of Artificial Neural Networks; they have earned growing significance due to their remarkable achievements in pattern recognition, finding extensive utility across diverse domains such as e.g. diagnostic medicine. Usually, Spiking Neural Networks are slightly less accurate than other Artificial Neural Networks, but they require a reduced amount of energy to perform calculations; this amount of energy further reduces in a very significant manner if they are implemented on hardware specifically designed for them, like neuromorphic hardware. In this work, we focus on exploring the versatility of Spiking Neural Networks and their potential applications across a range of scenarios by exploiting their adaptability and dynamic processing capabilities, which make them suitable for various tasks. A first rough network is designed based on the dataset's general attributes; the network is then refined through an extensive grid search algorithm to identify the optimal values for hyperparameters. This dual-step process ensures that the Spiking Neural Network can be tailored to diverse and potentially very different situations in a direct and intuitive manner. We test this by considering three different scenarios: epileptic seizure detection, both considering binary and multi-classification tasks, as well as wine classification. The proposed methodology turned out to be highly effective in binary class scenarios: the Spiking Neural Networks models achieved significantly lower energy consumption compared to Artificial Neural Networks while approaching nearly 100% accuracy. In the case of multi-class classification, the model achieved an accuracy of approximately 90%, thus indicating that it can still be further improved.

Model design and exponential state estimation for discrete-time delayed memristive spiking neural P systems

This paper investigates the exponential state estimation of the discrete-time memristive spiking neural P system (MSNPS). The spiking neural P system (SNPS) offers algorithmic support for neural morphology computation and AI chips, boasting advantages such as high performance and efficiency. As a new type of information device, memristors have efficient computing characteristics that integrate memory and computation, and can serve as synapses in SNPS. Therefore, to leverage the combined benefits of SNPS and memristors, this study introduces an innovative MSNPS circuit design, where memristors substitute resistors in the SNPS framework. Meanwhile, MSNPS mathematical model is constructed based on circuit model. In order to be more practical, the time delays in the system are analyzed in addition to the discretization of the continuous MSNPS. Moreover, some sufficient conditions for exponential state estimation are established by utilizing a Lyapunov functional to MSNPS. Finally, a numerical simulation example is constructed to validate the main findings.

A Federated Learning Protocol for Spiking Neural Membrane Systems

Although deep learning models have shown promising results in solving problems related to image recognition or natural language processing, they do not match how the biological brain works. Some of the differences include the amount of energy consumed, the way neurons communicate, or the way they learn. To close the gap between artificial neural networks and biological ones, researchers proposed the spiking neural network. Layered Spiking Neural P systems (LSN P systems) are networks of spiking neurons used to solve various classification problems. In this paper, we study the LSN P systems in the context of a federated learning client-server architecture over horizontally partitioned data. We analyze the privacy implications of pre-trained LSN P systems through membership inference attacks. We also perform experiments to assess the performance of an LSN P system trained in the federated learning setup. Our findings suggest that LSN P systems demonstrate higher accuracy and faster convergence compared to federated algorithms based on either perceptron or spiking neural networks.

Referring Image Segmentation with Multi-Modal Feature Interaction and Alignment Based on Convolutional Nonlinear Spiking Neural Membrane Systems

Referring image segmentation aims to accurately align image pixels and text features for object segmentation based on natural language descriptions. This paper proposes NSNPRIS (convolutional nonlinear spiking neural P systems for referring image segmentation), a novel model based on convolutional nonlinear spiking neural P systems. NSNPRIS features NSNPFusion and Language Gate modules to enhance feature interaction during encoding, along with an NSNPDecoder for feature alignment and decoding. Experimental results on RefCOCO, RefCOCO[Formula: see text], and G-Ref datasets demonstrate that NSNPRIS performs better than mainstream methods. Our contributions include advances in the alignment of pixel and textual features and the improvement of segmentation accuracy.

Asynchronous Numerical Spiking Neural Membrane Systems with Local Synchronization

Since the spiking neural P system (SN P system) was proposed in 2006, it has become a research hotspot in the field of membrane computing. The SN P system performs computations through the encoding, processing, and transmission of spiking information and can be regarded as a third-generation neural network. As a variant of the SN P system, the global asynchronous numerical spiking neural P system (ANSN P system) is adaptable to a broader range of application scenarios. However, in biological neuroscience, some neurons work synchronously within a community to perform specific functions in the brain. Inspired by this, our work investigates a global asynchronous spiking neural P system (ANSN P system) that incorporates certain local synchronous neuron sets. Within these local synchronous sets, neurons must execute their production functions simultaneously, thereby reducing dependence on thresholds and enhancing control uncertainty in ANSN P systems. By analyzing the ADD, SUB, and FIN modules in the generating mode, as well as the INPUT and ADD modules in the accepting mode, this paper demonstrates the novel system's computational capacity as both a generator and an acceptor. Additionally, this paper compares each module to those in other SN P systems, considering the maximum number of neurons and rules per neuron. The results show that this new ANSN P system is at least as effective as the existing SN P systems.

Multi-level feature interaction image super-resolution network based on convolutional nonlinear spiking neural model

Image super-resolution (ISR) is designed to recover lost detail information from low-resolution images, resulting in high-quality and high-definition high-resolution images. In the existing single ISR (SISR) methods based on convolutional neural networks (CNN), however, most of the models cannot effectively combine global and local information and are also easy to ignore the correlation between different hierarchical feature information. To address these problems, this study proposes a multi-level feature interactive image super-resolution network, which is constructed by the convolutional units inspired by nonlinear spiking mechanism in nonlinear spiking neural P systems, including shallow feature processing, deep feature extraction and fusion, and reconstruction modules. The different omni domain self-attention blocks are introduced to extract global information in the deep feature extraction and fusion stage and formed a feature enhancement module having a Transformer structure using a novel convolutional unit for extracting local information. Furthermore, to adaptively fuse features between different hierarchies, we design a multi-level feature fusion module, which not only can adaptively fuse features between different hierarchies, but also can better interact with contextual information. The proposed model is compared with 16 state-of-the-art or baseline models on five benchmark datasets. The experimental results show that the proposed model not only achieves good reconstruction performance, but also strikes a good balance between model parameters and performance.

An Optimization Numerical Spiking Neural Membrane System with Adaptive Multi-Mutation Operators for Brain Tumor Segmentation

Magnetic Resonance Imaging (MRI) is an important diagnostic technique for brain tumors due to its ability to generate images without tissue damage or skull artifacts. Therefore, MRI images are widely used to achieve the segmentation of brain tumors. This paper is the first attempt to discuss the use of optimization spiking neural P systems to improve the threshold segmentation of brain tumor images. To be specific, a threshold segmentation approach based on optimization numerical spiking neural P systems with adaptive multi-mutation operators (ONSNPSamos) is proposed to segment brain tumor images. More specifically, an ONSNPSamo with a multi-mutation strategy is introduced to balance exploration and exploitation abilities. At the same time, an approach combining the ONSNPSamo and connectivity algorithms is proposed to address the brain tumor segmentation problem. Our experimental results from CEC 2017 benchmarks (basic, shifted and rotated, hybrid, and composition function optimization problems) demonstrate that the ONSNPSamo is better than or close to 12 optimization algorithms. Furthermore, case studies from BraTS 2019 show that the approach combining the ONSNPSamo and connectivity algorithms can more effectively segment brain tumor images than most algorithms involved.

Seizure Detection of EEG Signals Based on Multi-Channel Long- and Short-Term Memory-Like Spiking Neural Model

Seizure is a common neurological disorder that usually manifests itself in recurring seizure, and these seizures can have a serious impact on a person's life and health. Therefore, early detection and diagnosis of seizure is crucial. In order to improve the efficiency of early detection and diagnosis of seizure, this paper proposes a new seizure detection method, which is based on discrete wavelet transform (DWT) and multi-channel long- and short-term memory-like spiking neural P (LSTM-SNP) model. First, the signal is decomposed into 5 levels by using DWT transform to obtain the features of the components at different frequencies, and a series of time-frequency features in wavelet coefficients are extracted. Then, these different features are used to train a multi-channel LSTM-SNP model and perform seizure detection. The proposed method achieves a high seizure detection accuracy on the CHB-MIT dataset: 98.25% accuracy, 98.22% specificity and 97.59% sensitivity. This indicates that the proposed epilepsy detection method can show competitive detection performance.

Multiple-in-Single-Out Object Detector Leveraging Spiking Neural Membrane Systems and Multiple Transformers

Most existing multi-scale object detectors depend on multi-level feature maps. The Feature Pyramid Networks (FPN) is a significant architecture for object detection that utilizes these multi-level feature maps. However, the use of FPN also increases the detector's complexity. For object detection methods that only use a single-level feature map, the detection performance is limited to some extent because the single-level feature map cannot balance deep semantic information and shallow detail information. We introduce a novel detector - the Spiking Neural P Multiple-in-Single-out (SNPMiSo) detector to address these challenges. The SNPMiSo detector is constructed based on SNP-like neurons. In SNPMiSo, we employ two kinds of Transformers to boost the important features across different-level feature maps separately. After enhancing the features, we use an incremental upsampling module to upsample and merge the two feature maps. This combined feature map is input into the NAF dilated residual module and the NAF dual-branch detection head. This process allows us to extract multi-scale features and carry out detection tasks. Our tests show promising results: On the COCO dataset, SNPMiSo attains an Average Precision (AP) of 38.7, an improvement of 1.0 AP over YOLOF. In addition, SNPMiSo demonstrates a quicker detection speed, outperforming some advanced multi-level and single-level object detectors.

Sparse Spiking Neural-Like Membrane Systems on Graphics Processing Units

The parallel simulation of Spiking Neural P systems is mainly based on a matrix representation, where the graph inherent to the neural model is encoded in an adjacency matrix. The simulation algorithm is based on a matrix-vector multiplication, which is an operation efficiently implemented on parallel devices. However, when the graph of a Spiking Neural P system is not fully connected, the adjacency matrix is sparse and hence, lots of computing resources are wasted in both time and memory domains. For this reason, two compression methods for the matrix representation were proposed in a previous work, but they were not implemented nor parallelized on a simulator. In this paper, they are implemented and parallelized on GPUs as part of a new Spiking Neural P system with delays simulator. Extensive experiments are conducted on high-end GPUs (RTX2080 and A100 80GB), and it is concluded that they outperform other solutions based on state-of-the-art GPU libraries when simulating Spiking Neural P systems.

Multitask Adversarial Networks Based on Extensive Nonlinear Spiking Neuron Models

Deep learning technology has been successfully used in Chest X-ray (CXR) images of COVID-19 patients. However, due to the characteristics of COVID-19 pneumonia and X-ray imaging, the deep learning methods still face many challenges, such as lower imaging quality, fewer training samples, complex radiological features and irregular shapes. To address these challenges, this study first introduces an extensive NSNP-like neuron model, and then proposes a multitask adversarial network architecture based on ENSNP-like neurons for chest X-ray images of COVID-19, called MAE-Net. The MAE-Net serves two tasks: (i) converting low-quality CXR images to high-quality images; (ii) classifying CXR images of COVID-19. The adversarial architecture of MAE-Net uses two generators and two discriminators, and two new loss functions have been introduced to guide the optimization of the network. The MAE-Net is tested on four benchmark COVID-19 CXR image datasets and compared them with eight deep learning models. The experimental results show that the proposed MAE-Net can enhance the conversion quality and the accuracy of image classification results.

Modular Spiking Neural Membrane Systems for Image Classification

A variant of membrane computing models called Spiking Neural P systems (SNP systems) closely mimics the structure and behavior of biological neurons. As third-generation neural networks, SNP systems have flexible architectures allowing the design of bio-inspired machine learning algorithms. This paper proposes Modular Spiking Neural P (MSNP) systems to solve image classification problems, a novel SNP system to be applied in scenarios where hundreds or even thousands of different classes are considered. A main issue to face in such situations is related to the structural complexity of the network. MSNP systems devised in this work allow to approach the general classification problem by dividing it in smaller parts, that are then faced by single entities of the network. As a benchmark dataset, the Oxford Flowers 102 dataset is considered, consisting of more than 8000 pictures of flowers belonging to the 102 species commonly found in the UK. These classes sometimes present large variations within them, may be also very similar to one another, and different images of the same subject may differ a lot. The work describes the architecture of the MSNP system, based on modules focusing on a specific class, their training phase, and the evaluation of the model both concerning result accuracy as well as energy consumption. Experimental results on image classification problems show that the model achieves good results, but is strongly connected to image quality, mainly depending on the frequency of images, remarkable changes of pose, images not centered, and subject mostly not shown.

Entropy-Weighted Numerical Gradient Optimization Spiking Neural System for Biped Robot Control

The optimization of robot controller parameters is a crucial task for enhancing robot performance, yet it often presents challenges due to the complexity of multi-objective, multi-dimensional multi-parameter optimization. This paper introduces a novel approach aimed at efficiently optimizing robot controller parameters to enhance its motion performance. While spiking neural P systems have shown great potential in addressing optimization problems, there has been limited research and validation concerning their application in continuous numerical, multi-objective, and multi-dimensional multi-parameter contexts. To address this research gap, our paper proposes the Entropy-Weighted Numerical Gradient Optimization Spiking Neural P System, which combines the strengths of entropy weighting and spiking neural P systems. First, the introduction of entropy weighting eliminates the subjectivity of weight selection, enhancing the objectivity and reproducibility of the optimization process. Second, our approach employs parallel gradient descent to achieve efficient multi-dimensional multi-parameter optimization searches. In conclusion, validation results on a biped robot simulation model show that our method markedly enhances walking performance compared to traditional approaches and other optimization algorithms. We achieved a velocity mean absolute error at least 35% lower than other methods, with a displacement error two orders of magnitude smaller. This research provides an effective new avenue for performance optimization in the field of robotics.

Spiking Neural Membrane Systems with Adaptive Synaptic Time Delay

Spiking neural membrane systems (or spiking neural P systems, SNP systems) are a new type of computation model which have attracted the attention of plentiful scholars for parallelism, time encoding, interpretability and extensibility. The original SNP systems only consider the time delay caused by the execution of rules within neurons, but not caused by the transmission of spikes via synapses between neurons and its adaptive adjustment. In view of the importance of time delay for SNP systems, which are a time encoding computation model, this study proposes SNP systems with adaptive synaptic time delay (ADSNP systems) based on the dynamic regulation mechanism of synaptic transmission delay in neural systems. In ADSNP systems, besides neurons, astrocytes that can generate adenosine triphosphate (ATP) are introduced. After receiving spikes, astrocytes convert spikes into ATP and send ATP to the synapses controlled by them to change the synaptic time delays. The Turing universality of ADSNP systems in number generating and accepting modes is proved. In addition, a small universal ADSNP system using 93 neurons and astrocytes is given. The superiority of the ADSNP system is demonstrated by comparison with the six variants. Finally, an ADSNP system is constructed for credit card fraud detection, which verifies the feasibility of the ADSNP system for solving real-world problems. By considering the adaptive synaptic delay, ADSNP systems better restore the process of information transmission in biological neural networks, and enhance the adaptability of SNP systems, making the control of time more accurate.

Analysis of employee diligence and mining of behavioral patterns based on portrait portrayal

With the deepening of enterprise digital construction, the portrait portrayal based on employee behaviors has gradually become a research focus. Currently, the employee's portrait portrayal mostly has the problems of simple means, low efficiency, limited solving ability, etc., making the results more one-sided. Therefore, a data mining-based employee portrait portrayal model is proposed. The content of employee portrait portrayal is deeply analyzed, and the overall framework of the model is designed. A diligence analysis model (DAM) based on improved GAN is constructed, and the diligence evaluation of employees is clarified to realize the diligence evaluation. The results of diligence analysis of DAM have high accuracy (80.39%) and outperform SA (70.24%), K-means (51.79%) and GAN (67.25%). The Kappa coefficient of DAM reaches 0.7384, which is highly consistent and higher than SA (0.6075), K-means (0.3711) and GAN (0.5661). The Local Outlier Factor (LOF) and Isolation Forest (IF) are used to detect abnormal behaviors on the employees, and mine the abnormal behavior patterns on different granularity time. The LSTM model (Att-LSTM) based on the attention mechanism is used to complete the prediction of employees' software usage behaviors, and analyze and summarize the characteristics of employee's behaviors from multiple perspectives. Att-LSTM predicts the best with an RMSE of 0.82983, which is better than LSTM (0.90833) and SA (0.97767); AM-LSTM has a MAPE of 0.80323, which is better than LSTM (0.86233) and SA (0.92223). The results show that the data mining-based employee portrait portrayal method can better solve the problem of enterprise employees' digital construction, and provide a new way of thinking for the construction of enterprise-level employees' digital portrait model and the analysis of employee behavior.

A Parallel Convolutional Network Based on Spiking Neural Systems

Deep convolutional neural networks have shown advanced performance in accurately segmenting images. In this paper, an SNP-like convolutional neuron structure is introduced, abstracted from the nonlinear mechanism in nonlinear spiking neural P (NSNP) systems. Then, a U-shaped convolutional neural network named SNP-like parallel-convolutional network, or SPC-Net, is constructed for segmentation tasks. The dual-convolution concatenate (DCC) and dual-convolution addition (DCA) network blocks are designed, respectively, in the encoder and decoder stages. The two blocks employ parallel convolution with different kernel sizes to improve feature representation ability and make full use of spatial detail information. Meanwhile, different feature fusion strategies are used to fuse their features to achieve feature complementarity and augmentation. Furthermore, a dual-scale pooling (DSP) module in the bottleneck is designed to improve the feature extraction capability, which can extract multi-scale contextual information and reduce information loss while extracting salient features. The SPC-Net is applied in medical image segmentation tasks and is compared with several recent segmentation methods on the GlaS and CRAG datasets. The proposed SPC-Net achieves 90.77% DICE coefficient, 83.76% IoU score and 83.93% F1 score, 86.33% ObjDice coefficient, 135.60 Obj-Hausdorff distance, respectively. The experimental results show that the proposed model can achieve good segmentation performance.