Generative and Discriminative Fuzzy Restricted Boltzmann Machine Learning for Text and Image Classification

Sparse non-convex regularization based explainable DBN in the analysis of brain abnormalities in schizophrenia

Deep belief networks have been widely used in medical image analysis. However, the high-dimensional but small-sample-size characteristic of medical image data makes the model prone to dimensional disaster and overfitting. Meanwhile, the traditional DBN is driven by performance and ignores the explainability which is important for medical image analysis. In this paper, a sparse non-convex based explainable deep belief network is proposed by combining DBN with non-convex sparsity learning. For sparsity, the non-convex regularization and Kullback-Leibler divergence penalty are embedded into DBN to obtain the sparse connection and sparse response representation of the network. It effectively reduces the complexity of the model and improves the generalization ability of the model. Considering explainability, the crucial features for decision-making are selected through the feature back-selection based on the row norm of each layer's weight after network training. We apply the model to schizophrenia data and demonstrate it achieves the best performance among several typical feature selection models. It reveals 28 functional connections highly correlated with schizophrenia, which provides an effective foundation for the treatment and prevention of schizophrenia and methodological assurance for similar brain disorders.

Multiview Graph Restricted Boltzmann Machines

Recently, the restricted Boltzmann machine (RBM) has aroused considerable interest in the multiview learning field. Although effectiveness is observed, like many existing multiview learning models, multiview RBM ignores the local manifold structure of multiview data. In this article, we first propose a novel graph RBM model, which preserves the data manifold structure and is amenable to Gibbs sampling. Then, we develop a multiview graph RBM model on the basis of the graph RBM, which performs local structural learning and multiview representation learning simultaneously. The proposed multiview model has the following merits: 1) it preserves the data manifold structure for multiview classification and 2) it performs view-consistent representation learning and view-specific representation learning simultaneously. The experimental results show that the proposed multiview model outperforms other state-of-the-art multiview classification algorithms.

Fuzzy Adaptive Switching Control for Stochastic Systems With Finite-Time Prescribed Performance

The issue of fuzzy adaptive switching control for stochastic systems with arbitrary switching signal and finite-time prescribed performance is investigated in this article. A piecewise function is adopted to characterize finite-time prescribed performance, and the error signal is converted to a new state variable via the tangent function. Unknown functions are approximated via fuzzy-logic systems (FLSs). Based on the stochastic stability theory and common Lyapunov function, a fuzzy adaptive switching control scheme is presented. The control law is proposed for the stochastic switched closed-loop system so that not only all the signals are ensured to be semiglobally uniformly ultimately bounded (SGUUB) in probability but also a residual error related to the finite-time prescribed performance bound is guaranteed. Eventually, simulation studies for a practical system are given to show the effectiveness of the presented fuzzy adaptive switching control scheme.

Parameterized Luenberger-Type H∞ State Estimator for Delayed Static Neural Networks

This article proposes a new Luenberger-type state estimator that has parameterized observer gains dependent on the activation function, to improve the H_∞ state estimation performance of the static neural networks with time-varying delay. The nonlinearity of the activation function has a significant impact on stability analysis and robustness/performance. In the proposed state estimator, a parameter-dependent estimator gain is reconstructed by using the properties of the sector nonlinearity of the activation functions that are represented as linear combinations of weighting parameters. In the reformulated form, the constraints of the parameters for the activation function are considered in terms of linear matrix inequalities. Based on the Lyapunov-Krasovskii function and the improved reciprocally convex inequality, enhanced conditions for designing a new state estimator that guarantees H_∞ performance are derived through a parameterization technique. The compared results with recent studies demonstrate the superiority and effectiveness of the presented method.

Identifying Autism Spectrum Disorder From Resting-State fMRI Using Deep Belief Network

With the increasing prevalence of autism spectrum disorder (ASD), it is important to identify ASD patients for effective treatment and intervention, especially in early childhood. Neuroimaging techniques have been used to characterize the complex biomarkers based on the functional connectivity anomalies in the ASD. However, the diagnosis of ASD still adopts the symptom-based criteria by clinical observation. The existing computational models tend to achieve unreliable diagnostic classification on the large-scale aggregated data sets. In this work, we propose a novel graph-based classification model using the deep belief network (DBN) and the Autism Brain Imaging Data Exchange (ABIDE) database, which is a worldwide multisite functional and structural brain imaging data aggregation. The remarkable connectivity features are selected through a graph extension of K -nearest neighbors and then refined by a restricted path-based depth-first search algorithm. Thanks to the feature reduction, lower computational complexity could contribute to the shortening of the training time. The automatic hyperparameter-tuning technique is introduced to optimize the hyperparameters of the DBN by exploring the potential parameter space. The simulation experiments demonstrate the superior performance of our model, which is 6.4% higher than the best result reported on the ABIDE database. We also propose to use the data augmentation and the oversampling technique to identify further the possible subtypes within the ASD. The interpretability of our model enables the identification of the most remarkable autistic neural correlation patterns from the data-driven outcomes.