Deep Fuzzy Min-Max Neural Network: Analysis and Design

Fuzzy min-max neural network (FMNN) is one kind of three-layer models based on hyperboxes that are constructed in a sequential way. Such a sequential mechanism inevitably leads to the input order and overlap region problem. In this study, we propose a deep FMNN (DFMNN) based on initialization and optimization operation to overcome these limitations. Initialization operation that can solve the input order problem is to design hyperboxes in a simultaneous way, and side parameters have been proposed to control the size of hyperboxes. Optimization operation that can eliminate overlap region problem is realized by means of deep layers, where the number of layers is immediately determined when the overlap among hyperboxes is eliminated. In the optimization process, each layer consists of three sections, namely, the partition section, combination section, and union section. The partition section aims to divide the hyperboxes into a nonoverlapping hyperbox set and an overlapping hyperbox set. The combination section eliminates the overlap problem of overlapping hyperbox set. The union section obtains the optimized hyperbox set in the current layer. DFMNN is evaluated based on a series of benchmark datasets. A comparative analysis illustrates that the proposed DFMNN model outperforms several models previously reported in the literature.

AI Therapist Realizing Expert Verbal Cues for Effective Robot-Assisted Gait Training

Repetitive and specific verbal cues by a therapist are essential in aiding a patient's motivation and improving the motor learning process. The verbal cues comprise various expressions, sentences, volumes, and timings, depending on the therapist's proficiency. This paper proposes an AI therapist (AI-T) that implements the verbal cues of professional therapists having extensive experience with robot-assisted gait training using the SUBAR for stroke patients. The AI-T was developed using a neuro-fuzzy system, a machine learning technique leveraging the benefits of fuzzy logic and artificial neural networks. The AI-T was trained with the professional therapist's verbal cue data, as well as clinical and robotic data collected from robot-assisted gait training with real stroke patients. Ten clinical data and 16 robotic data are input variables, and six verbal cues are output variables. Fifty-eight stroke patients wore the SUBAR, a gait training robot, and participated in the robot-assisted gait training. A total of 9059 verbal cue data, 580 clinical data of stroke patients, and 144 944 robotic data were collected from 693 training sessions. Test results show that the trained AI-T can implement six types of verbal cues with 93.7% accuracy for the 1812 verbal cue data of the professional therapist. Currently, the trained AI-T is deployed in the SUBAR and provides six verbal cues to stroke patients in robot-assisted gait training.

Adaptive Elastic Echo State Network for Multivariate Time Series Prediction

Echo state network (ESN) is a new kind of recurrent neural network with a randomly generated reservoir structure and an adaptable linear readout layer. It has been widely employed in the field of time series prediction. However, when high-dimensional reservoirs are utilized to predict multivariate time series, there may be a collinearity problem. In this paper, to overcome the collinearity problem and obtain a sparse solution, we propose a new model-adaptive elastic ESN, in which adaptive elastic net algorithm is used to calculate the unknown weights. It combines the strengths of the quadratic regularization and the adaptively weighted lasso shrinkage. Hence, the proposed model can deal with the collinearity problem and enjoy the oracle property with an unbiased estimation. We exhibit the merits of our model on two benchmark multivariate chaotic datasets and two real-world applications. Experimental results substantiate the effectiveness and characteristics of the proposed model.

An enhanced fuzzy min-max neural network for pattern classification

An enhanced fuzzy min-max (EFMM) network is proposed for pattern classification in this paper. The aim is to overcome a number of limitations of the original fuzzy min-max (FMM) network and improve its classification performance. The key contributions are three heuristic rules to enhance the learning algorithm of FMM. First, a new hyperbox expansion rule to eliminate the overlapping problem during the hyperbox expansion process is suggested. Second, the existing hyperbox overlap test rule is extended to discover other possible overlapping cases. Third, a new hyperbox contraction rule to resolve possible overlapping cases is provided. Efficacy of EFMM is evaluated using benchmark data sets and a real medical diagnosis task. The results are better than those from various FMM-based models, support vector machine-based, Bayesian-based, decision tree-based, fuzzy-based, and neural-based classifiers. The empirical findings show that the newly introduced rules are able to realize EFMM as a useful model for undertaking pattern classification problems.

Online motor fault detection and diagnosis using a hybrid FMM-CART model

In this brief, a hybrid model combining the fuzzy min-max (FMM) neural network and the classification and regression tree (CART) for online motor detection and diagnosis tasks is described. The hybrid model, known as FMM-CART, exploits the advantages of both FMM and CART for undertaking data classification and rule extraction problems. To evaluate the applicability of the proposed FMM-CART model, an evaluation with a benchmark data set pertaining to electrical motor bearing faults is first conducted. The results obtained are equivalent to those reported in the literature. Then, a laboratory experiment for detecting and diagnosing eccentricity faults in an induction motor is performed. In addition to producing accurate results, useful rules in the form of a decision tree are extracted to provide explanation and justification for the predictions from FMM-CART. The experimental outcome positively shows the potential of FMM-CART in undertaking online motor fault detection and diagnosis tasks.

Lagrange stability of memristive neural networks with discrete and distributed delays

Memristive neuromorphic system is a good candidate for creating artificial brain. In this paper, a general class of memristive neural networks with discrete and distributed delays is introduced and studied. Some Lagrange stability criteria dependent on the network parameters are derived via nonsmooth analysis and control theory. In particular, several succinct criteria are provided to ascertain the Lagrange stability of memristive neural networks with and without delays. The proposed Lagrange stability criteria are the improvement and extension of the existing results in the literature. Three numerical examples are given to show the superiority of theoretical results.

Multi-level fuzzy min-max neural network classifier

In this paper a multi-level fuzzy min-max neural network classifier (MLF), which is a supervised learning method, is described. MLF uses basic concepts of the fuzzy min-max (FMM) method in a multi-level structure to classify patterns. This method uses separate classifiers with smaller hyperboxes in different levels to classify the samples that are located in overlapping regions. The final output of the network is formed by combining the outputs of these classifiers. MLF is capable of learning nonlinear boundaries with a single pass through the data. According to the obtained results, the MLF method, compared to the other FMM networks, has the highest performance and the lowest sensitivity to maximum size of the hyperbox parameter (θ), with a training accuracy of 100% in most cases.

Learning in the model space for cognitive fault diagnosis

The emergence of large sensor networks has facilitated the collection of large amounts of real-time data to monitor and control complex engineering systems. However, in many cases the collected data may be incomplete or inconsistent, while the underlying environment may be time-varying or unformulated. In this paper, we develop an innovative cognitive fault diagnosis framework that tackles the above challenges. This framework investigates fault diagnosis in the model space instead of the signal space. Learning in the model space is implemented by fitting a series of models using a series of signal segments selected with a sliding window. By investigating the learning techniques in the fitted model space, faulty models can be discriminated from healthy models using a one-class learning algorithm. The framework enables us to construct a fault library when unknown faults occur, which can be regarded as cognitive fault isolation. This paper also theoretically investigates how to measure the pairwise distance between two models in the model space and incorporates the model distance into the learning algorithm in the model space. The results on three benchmark applications and one simulated model for the Barcelona water distribution network confirm the effectiveness of the proposed framework.

Network-based high level data classification

Traditional supervised data classification considers only physical features (e.g., distance or similarity) of the input data. Here, this type of learning is called low level classification. On the other hand, the human (animal) brain performs both low and high orders of learning and it has facility in identifying patterns according to the semantic meaning of the input data. Data classification that considers not only physical attributes but also the pattern formation is, here, referred to as high level classification. In this paper, we propose a hybrid classification technique that combines both types of learning. The low level term can be implemented by any classification technique, while the high level term is realized by the extraction of features of the underlying network constructed from the input data. Thus, the former classifies the test instances by their physical features or class topologies, while the latter measures the compliance of the test instances to the pattern formation of the data. Our study shows that the proposed technique not only can realize classification according to the pattern formation, but also is able to improve the performance of traditional classification techniques. Furthermore, as the class configuration's complexity increases, such as the mixture among different classes, a larger portion of the high level term is required to get correct classification. This feature confirms that the high level classification has a special importance in complex situations of classification. Finally, we show how the proposed technique can be employed in a real-world application, where it is capable of identifying variations and distortions of handwritten digit images. As a result, it supplies an improvement in the overall pattern recognition rate.