Batch process fault detection for multi-stage broad learning system

Robust noise-aware algorithm for randomized neural network and its convergence properties

The concept of randomized neural networks (RNNs), such as the random vector functional link network (RVFL) and extreme learning machine (ELM), is a widely accepted and efficient network method for constructing single-hidden layer feedforward networks (SLFNs). Due to its exceptional approximation capabilities, RNN is being extensively used in various fields. While the RNN concept has shown great promise, its performance can be unpredictable in imperfect conditions, such as weight noises and outliers. Thus, there is a need to develop more reliable and robust RNN algorithms. To address this issue, this paper proposes a new objective function that addresses the combined effect of weight noise and training data outliers for RVFL networks. Based on the half-quadratic optimization method, we then propose a novel algorithm, named noise-aware RNN (NARNN), to optimize the proposed objective function. The convergence of the NARNN is also theoretically validated. We also discuss the way to use the NARNN for ensemble deep RVFL (edRVFL) networks. Finally, we present an extension of the NARNN to concurrently address weight noise, stuck-at-fault, and outliers. The experimental results demonstrate that the proposed algorithm outperforms a number of state-of-the-art robust RNN algorithms.

Industrial Process Monitoring Based on Dynamic Overcomplete Broad Learning Network

Most industrial processes feature high nonlinearity, non-Gaussianity, and time correlation. Models based on overcomplete broad learning system (OBLS) have been successfully applied in the fault monitoring realm, which may relatively deal with the nonlinear and non-Gaussian characteristics. However, these models barely take time correlation into full consideration, hindering the further improvement of the monitoring accuracy of the network. Therefore, an effective dynamic overcomplete broad learning system (DOBLS) based on matrix extension is proposed, which extends the raw data in the batch process with the idea of "time lag" in this article. Subsequently, the OBLS monitoring network is employed to continue the analysis of the extended dynamic input data. Finally, a monitoring model is established to tackle the coexistence of nonlinearity, non-Gaussianity, and time correlation in process data. To illustrate the superiority and feasibility, the proposed model is conducted on the penicillin fermentation simulation platform, the experimental result of which illustrates that the model can extract the feature of process data more comprehensively and be self-updated more efficiently. With shorter training time and higher monitoring accuracy, the proposed model can witness an improvement of average monitoring accuracy by 3.69% and 1.26% in 26 process fault types compared to the state-of-the-art fault monitoring methods BLS and OBLS, respectively.

MPGE and RootRank: A sufficient root cause characterization and quantification framework for industrial process faults

Root cause diagnosis can locate abnormalities of industrial processes, ensuring production safety and manufacturing efficiency. However, existing root cause diagnosis models only consider pairwise direct causality and ignore the multi-level fault propagation, which may lead to incomplete root cause descriptions and ambiguous root cause candidates. To address the above issue, a novel framework, named multi-level predictive graph extraction (MPGE) and RootRank scoring, is proposed and applied to the root cause diagnosis for industrial processes. In this framework, both direct and indirect Granger causalities are characterized by multi-level predictive relationships to provide a sufficient characterization of root cause variables. First, a predictive graph structure with a sparse constrained adjacency matrix is constructed to describe the information transmission between variables. The information of variables is deeply fused according to the adjacency matrix to consider multi-level fault propagation. Then, a hierarchical adjacency pruning (HAP) mechanism is designed to automatically capture vital predictive relationships through adjacency redistribution. In this way, the multi-level causalities between variables are extracted to fully describe both direct and indirect fault propagation and highlight the root cause. Further, a RootRank scoring algorithm is proposed to analyze the predictive graph and quantify the fault propagation contribution of each variable, thereby giving definite root cause identification results. Three examples are adopted to verify the diagnostic performance of the proposed framework, including a numerical example, the Tennessee Eastman benchmark process, and a real cut-made process of cigarette. Both theoretical analysis and experimental verification show the high interpretability and reliability of the proposed framework.

LSTMED: An uneven dynamic process monitoring method based on LSTM and Autoencoder neural network

Due to the complicated production mechanism in multivariate industrial processes, different dynamic features of variables raise challenges to traditional data-driven process monitoring methods which assume the process data is static or dynamically consistent. To tackle this issue, this paper proposes a novel process monitoring method based on the long short-term memory (LSTM) and Autoencoder neural network (called LSTMED) for multivariate process monitoring with uneven dynamic features. First, the LSTM units are arranged in the encoder-decoder form to construct an end-to-end model. Then, the constructed model is trained in an unsupervised manner to capture long-term time dependency within variables and dominant representation of high dimensional process data. Afterward, the kernel density estimation (KDE) method is performed to determine the control limit only based on the reconstruction error from historical normal data. Finally, effective online monitoring for uneven dynamic process can be achieved. The performance and advantage of the process monitoring method proposed are explained through typical cases, including the numerical simulation and Tennessee Eastman (TE) benchmark process, and comparative experimental analysis with state-of-the-art methods.

Employability in the public sector: The impact of individual and organizational determinants

Introduction

The importance of employability within organizations is increasing, due to various developments that initiate organizational changes. This study focuses on the employability in the public sector. While there seems to be a clear need for an employable public sector workforce, up until now there is little empirical research into the employability of workers in this sector, and into which specific individual and organizational characteristics influence it.

Methods

We conducted structural equation modeling, using data from Dutch public sector employees (n = 13.471).

Results

Our outcomes show that public sector employees consider themselves to be reasonably employable internally, and that they rate their external employability slightly higher. Moreover, it was found that both individual (personality and risk-taking behavior) and organizational characteristics (transformational leadership and red tape) influence their employability.

Discussion

These results underline the dual responsibility of the employee and the organization in influencing workers' employability within the public sector.

Examining the role of employability as a mediator in the relationship between psychological capital and objective career success amongst occupational psychology professionals

Employability is core to our understanding of career sustainability, and at an individual level, identifying the personal resources that support employability in the achievement of career success is warranted. This study builds on the conservation of resources theory, examining the role of employability as a mediator in the relationship between psychological capital and objective career success. To test our hypotheses, we utilised a context-specific practitioner sample of 135 individuals with UK-accredited occupational psychology qualifications. Employability was conceptualised using the competence-based model, underpinned by occupational expertise. Psychological capital and employability were measured using self-report questionnaires, whilst career success was determined via gross annual salary and practitioner status, ensuring objective measures of this outcome variable. Structural equation modelling identified that the relationship between psychological capital and objective career success was fully mediated by employability. These novel findings have important theoretical and practical implications for the role of psychological capital as a personal resource in achieving career success via its influence on employability.

Type-2 Fuzzy Broad Learning System

The broad learning system (BLS) has been identified as an important research topic in machine learning. However, the typical BLS suffers from poor robustness for uncertainties because of its characteristic of the deterministic representation. To overcome this problem, a type-2 fuzzy BLS (FBLS) is designed and analyzed in this article. First, a group of interval type-2 fuzzy neurons was used to replace the feature neurons of BLS. Then, the representation of BLS can be improved to obtain good robustness. Second, a fuzzy pseudoinverse learning algorithm was designed to adjust the parameter of type-2 FBLS. Then, the proposed type-2 FBLS was able to maintain the fast computational nature of BLS. Third, a theoretical analysis on the convergence of type-2 FBLS was given to show the computational efficiency. Finally, some benchmark and practical problems were used to test the merits of type-2 FBLS. The experimental results indicated that the proposed type-2 FBLS can achieve outstanding performance.

Research Review for Broad Learning System: Algorithms, Theory, and Applications

In recent years, the appearance of the broad learning system (BLS) is poised to revolutionize conventional artificial intelligence methods. It represents a step toward building more efficient and effective machine-learning methods that can be extended to a broader range of necessary research fields. In this survey, we provide a comprehensive overview of the BLS in data mining and neural networks for the first time, focusing on summarizing various BLS methods from the aspects of its algorithms, theories, applications, and future open research questions. First, we introduce the basic pattern of BLS manifestation, the universal approximation capability, and essence from the theoretical perspective. Furthermore, we focus on BLS's various improvements based on the current state of the theoretical research, which further improves its flexibility, stability, and accuracy under general or specific conditions, including classification, regression, semisupervised, and unsupervised tasks. Due to its remarkable efficiency, impressive generalization performance, and easy extendibility, BLS has been applied in different domains. Next, we illustrate BLS's practical advances, such as computer vision, biomedical engineering, control, and natural language processing. Finally, the future open research problems and promising directions for BLSs are pointed out.