1
|
Xu S, Wang L, Dai H, Wang H, Chen H, Chai Y, Xing Zheng W. A Segmented Iterative Learning Scheme-Based Distributed Fault Estimation for Switched Interconnected Nonlinear Systems. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2025; 36:6612-6626. [PMID: 38700965 DOI: 10.1109/tnnls.2024.3394570] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/05/2024]
Abstract
In this article, a distributed fault estimation (DFE) approach for switched interconnected nonlinear systems (SINSs) with time delays and external disturbances is proposed using a novel segmented iterative learning scheme (SILS). First, through the utilization of interrelated information among subsystems, a distributed iterative learning observer is developed to enhance the accuracy of fault estimation results, which can realize the fault estimation of all subsystems under time delays and external disturbances. Simultaneously, to facilitate rapid fault information tracking and significantly reduce sensitivity to interference, a new SILS-based fault estimation law is constructed by combining the idea of segmented design with the method of variable gain. Then, an assessment of the convergence of the established fault estimation methodology is conducted, and the configurations of observer gain matrices and iterative learning gain matrices are duly accomplished. Finally, simulation results are showcased to demonstrate the superiority and feasibility of the developed fault estimation approach.
Collapse
|
2
|
Wu Y, Du S, Wu G, Guo X, Wu J, Zhao R, Ma C. Minimum maximum regularized multiscale convolutional neural network and its application in intelligent fault diagnosis of rotary machines. ISA TRANSACTIONS 2025; 159:1-21. [PMID: 39947955 DOI: 10.1016/j.isatra.2025.01.044] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/15/2024] [Revised: 01/15/2025] [Accepted: 01/24/2025] [Indexed: 04/05/2025]
Abstract
Convolutional neural networks (CNN) have achieved significant advancements in intelligent fault diagnosis of rotary machines. However, the limitations of using a single scale convolution kernel in convolutional layer and the exclusive focus on classification accuracy by the cross-entropy loss function during model training result in suboptimal diagnostic performance and generalization ability of CNNs in environments with strong background noise and imbalanced data. To address these challenges, a fault recognition method for rotary machines utilizing a minimum maximum regularized multiscale CNN (MMRMCNN) is proposed. A multiscale feature extraction module is devised, which uses convolutional layers with diverse scale kernels to capture multiscale features form input data. Additionally, a minimum maximum regularized objective function is introduced to augment the original cross-entropy loss function. This modification enables the model to consider not only recognition accuracy but also the compactness within classes and separation between classes of learning features during network training. The proposed approach effectively narrows the intra class margin of device health status features while widening the inter class margin, thereby mitigating the impact of noise and data imbalance on the mapping of health status relationship. Performance evaluation of the MMRMCNN is conducted using a measured dataset, the PU bearing dataset, and a rotor dataset. We found that the fault recognition accuracy of the proposed method exceeds 97.79 %, and the accuracy of fault recognition under noisy background and unbalanced data conditions is also above 94.81 % and 94.72 %, respectively. This demonstrate the superior fault recognition capabilities of the proposed method in scenarios characterized by strong background noise and data imbalance. Overall, the results attest to the exceptional performances of the developed MMRMCNN in fault recognition under challenging conditions, underscoring its potential in advancing the field of in Telligent fault diagnosis for rotary machines.
Collapse
Affiliation(s)
- Yaochun Wu
- School of Mechanical Engineering, Anyang Institute of Technology, Anyang 455000, China.
| | - Shaohua Du
- School of Mechanical Engineering, Anyang Institute of Technology, Anyang 455000, China.
| | - Guijun Wu
- School of Mechanics and Industrial Engineering, Kyrgyz State Technical University named after I.Razzakov, Aitmatov av., 66, Bishkek 720044, Kyrgyzstan.
| | - Xiaobo Guo
- School of Mechanical Engineering, Anyang Institute of Technology, Anyang 455000, China.
| | - Jie Wu
- School of Mechanical Engineering, Anyang Institute of Technology, Anyang 455000, China.
| | - Rongzheng Zhao
- School of Mechanical and Electrical Engineering, Lanzhou University of Technology, Lanzhou 730000, China; School of Mechanical and Electrical Engineering, Jiuquan Vocational and Technical College, Jiuquan 735000, China.
| | - Chi Ma
- School of Mechanical and Electrical Engineering, Jiuquan Vocational and Technical College, Jiuquan 735000, China.
| |
Collapse
|
3
|
Chen D, Xie Z, Liu R, Yu W, Hu Q, Li X, Ding SX. Bayesian Hierarchical Graph Neural Networks With Uncertainty Feedback for Trustworthy Fault Diagnosis of Industrial Processes. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:18635-18648. [PMID: 37843997 DOI: 10.1109/tnnls.2023.3319468] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/18/2023]
Abstract
Deep learning (DL) methods have been widely applied to intelligent fault diagnosis of industrial processes and achieved state-of-the-art performance. However, fault diagnosis with point estimate may provide untrustworthy decisions. Recently, Bayesian inference shows to be a promising approach to trustworthy fault diagnosis by quantifying the uncertainty of the decisions with a DL model. The uncertainty information is not involved in the training process, which does not help the learning of highly uncertain samples and has little effect on improving the fault diagnosis performance. To address this challenge, we propose a Bayesian hierarchical graph neural network (BHGNN) with an uncertainty feedback mechanism, which formulates a trustworthy fault diagnosis on the Bayesian DL (BDL) framework. Specifically, BHGNN captures the epistemic uncertainty and aleatoric uncertainty via a variational dropout approach and utilizes the uncertainty information of each sample to adjust the strength of the temporal consistency (TC) constraint for robust feature learning. Meanwhile, the BHGNN method models the process data as a hierarchical graph (HG) by leveraging the interaction-aware module and physical topology knowledge of the industrial process, which integrates data with domain knowledge to learn fault representation. Moreover, the experiments on a three-phase flow facility (TFF) and secure water treatment (SWaT) show superior and competitive performance in fault diagnosis and verify the trustworthiness of the proposed method.
Collapse
|
4
|
Li R, Wu J, Li Y, Cheng Y. PeriodNet: Noise-Robust Fault Diagnosis Method Under Varying Speed Conditions. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:14045-14059. [PMID: 37216236 DOI: 10.1109/tnnls.2023.3274290] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/24/2023]
Abstract
Rolling bearings are critical components in modern mechanical systems and have been extensively equipped in various rotating machinery. However, their operating conditions are becoming increasingly complex due to diverse working requirements, dramatically increasing their failure risks. Worse still, the interference of strong background noises and the modulation of varying speed conditions make intelligent fault diagnosis very challenging for conventional methods with limited feature extraction capability. To this end, this study proposes a periodic convolutional neural network (PeriodNet), which is an intelligent end-to-end framework for bearing fault diagnosis. The proposed PeriodNet is constructed by inserting a periodic convolutional module (PeriodConv) before a backbone network. PeriodConv is developed based on the generalized short-time noise resist correlation (GeSTNRC) method, which can effectively capture features from noisy vibration signals collected under varying speed conditions. In PeriodConv, GeSTNRC is extended to the weighted version through deep learning (DL) techniques, whose parameters can be optimized during training. Two open-source datasets collected under constant and varying speed conditions are adopted to assess the proposed method. Case studies demonstrate that PeriodNet has excellent generalizability and is effective under varying speed conditions. Experiments adding noise interference further reveal that PeriodNet is highly robust in noisy environments.
Collapse
|
5
|
Xu Z, Liu T, Xia Z, Fan Y, Yan M, Dang X. SSG-Net: A Multi-Branch Fault Diagnosis Method for Scroll Compressors Using Swin Transformer Sliding Window, Shallow ResNet, and Global Attention Mechanism (GAM). SENSORS (BASEL, SWITZERLAND) 2024; 24:6237. [PMID: 39409277 PMCID: PMC11478940 DOI: 10.3390/s24196237] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/22/2024] [Revised: 09/20/2024] [Accepted: 09/25/2024] [Indexed: 10/20/2024]
Abstract
The reliable operation of scroll compressors is crucial for the efficiency of rotating machinery and refrigeration systems. To address the need for efficient and accurate fault diagnosis in scroll compressor technology under varying operating states, diverse failure modes, and different operating conditions, a multi-branch convolutional neural network fault diagnosis method (SSG-Net) has been developed. This method is based on the Swin Transformer, the Global Attention Mechanism (GAM), and the ResNet architecture. Initially, the one-dimensional time-series signal is converted into a two-dimensional image using the Short-Time Fourier Transform, thereby enriching the feature set for deep learning analysis. Subsequently, the method integrates the window attention mechanism of the Swin Transformer, the 2D convolution of GAM attention, and the shallow ResNet's two-dimensional convolution feature extraction branch network. This integration further optimizes the feature extraction process, enhancing the accuracy of fault feature recognition and sensitivity to data variability. Consequently, by combining the global and local features extracted from these three branch networks, the model significantly improves feature representation capability and robustness. Finally, experimental results on scroll compressor datasets and the CWRU dataset demonstrate diagnostic accuracies of 97.44% and 99.78%, respectively. These results surpass existing comparative models and confirm the model's superior recognition precision and rapid convergence capabilities in complex fault environments.
Collapse
Affiliation(s)
| | - Tao Liu
- School of Mechanical and Electrical Engineering, Lanzhou University of Technology, Lanzhou 730070, China; (Z.X.); (Z.X.); (Y.F.); (M.Y.); (X.D.)
| | | | | | | | | |
Collapse
|
6
|
Li Y, Zhou Z, Sun C, Chen X, Yan R. Variational Attention-Based Interpretable Transformer Network for Rotary Machine Fault Diagnosis. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:6180-6193. [PMID: 36094988 DOI: 10.1109/tnnls.2022.3202234] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Deep learning technology provides a promising approach for rotary machine fault diagnosis (RMFD), where vibration signals are commonly utilized as input of a deep network model to reveal the internal state of machinery. However, most existing methods fail to mine association relationships within signals. Unlike deep neural networks, transformer networks are capable of capturing association relationships through the global self-attention mechanism to enhance feature representations from vibration signals. Despite this, transformer networks cannot explicitly establish the causal association between signal patterns and fault types, resulting in poor interpretability. To tackle these problems, an interpretable deep learning model named the variational attention-based transformer network (VATN) is proposed for RMFD. VATN is improved from transformer encoder to mine the association relationships within signals. To embed the prior knowledge of the fault type, which can be recognized based on several key features of vibration signals, a sparse constraint is designed for attention weights. Variational inference is employed to force attention weights to samples from Dirichlet distributions, and Laplace approximation is applied to realize reparameterization. Finally, two experimental studies conducted on bevel gear and bearing datasets demonstrate the effectiveness of VATN to other comparison methods, and the heat map of attention weights illustrates the causal association between fault types and signal patterns.
Collapse
|
7
|
Yang X, Bi F, Cheng J, Tang D, Shen P, Bi X. A Multiple Attention Convolutional Neural Networks for Diesel Engine Fault Diagnosis. SENSORS (BASEL, SWITZERLAND) 2024; 24:2708. [PMID: 38732814 PMCID: PMC11086139 DOI: 10.3390/s24092708] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/02/2024] [Revised: 04/16/2024] [Accepted: 04/19/2024] [Indexed: 05/13/2024]
Abstract
Fault diagnosis can improve the safety and reliability of diesel engines. An end-to-end method based on a multi-attention convolutional neural network (MACNN) is proposed for accurate and efficient diesel engine fault diagnosis. By optimizing the arrangement and kernel size of the channel and spatial attention modules, the feature extraction capability is improved, and an improved convolutional block attention module (ICBAM) is obtained. Vibration signal features are acquired using a feature extraction model alternating between the convolutional neural network (CNN) and ICBAM. The feature map is recombined to reconstruct the sequence order information. Next, the self-attention mechanism (SAM) is applied to learn the recombined sequence features directly. A Swish activation function is introduced to solve "Dead ReLU" and improve the accuracy. A dynamic learning rate curve is designed to improve the convergence ability of the model. The diesel engine fault simulation experiment is carried out to simulate three kinds of fault types (abnormal valve clearance, abnormal rail pressure, and insufficient fuel supply), and each kind of fault varies in different degrees. The comparison results show that the accuracy of MACNN on the eight-class fault dataset at different speeds is more than 97%. The testing time of the MACNN is much less than the machine running time (for one work cycle). Therefore, the proposed end-to-end fault diagnosis method has a good application prospect.
Collapse
Affiliation(s)
- Xiao Yang
- State Key Laboratory of Engines, Tianjin University, Tianjin 300350, China; (X.Y.); (F.B.); (J.C.); (D.T.); (P.S.)
| | - Fengrong Bi
- State Key Laboratory of Engines, Tianjin University, Tianjin 300350, China; (X.Y.); (F.B.); (J.C.); (D.T.); (P.S.)
| | - Jiangang Cheng
- State Key Laboratory of Engines, Tianjin University, Tianjin 300350, China; (X.Y.); (F.B.); (J.C.); (D.T.); (P.S.)
| | - Daijie Tang
- State Key Laboratory of Engines, Tianjin University, Tianjin 300350, China; (X.Y.); (F.B.); (J.C.); (D.T.); (P.S.)
| | - Pengfei Shen
- State Key Laboratory of Engines, Tianjin University, Tianjin 300350, China; (X.Y.); (F.B.); (J.C.); (D.T.); (P.S.)
| | - Xiaoyang Bi
- State Key Laboratory of Reliability and Intelligence Electrical Equipment, Hebei University of Technology, Tianjin 300130, China
| |
Collapse
|
8
|
Miao D, Feng K, Xiao Y, Li Z, Gao J. Gas Turbine Anomaly Detection under Time-Varying Operation Conditions Based on Spectra Alignment and Self-Adaptive Normalization. SENSORS (BASEL, SWITZERLAND) 2024; 24:941. [PMID: 38339657 PMCID: PMC10856833 DOI: 10.3390/s24030941] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/04/2024] [Revised: 01/24/2024] [Accepted: 01/26/2024] [Indexed: 02/12/2024]
Abstract
Gas turbine vibration data may exhibit considerable differences under time-varying conditions, which poses challenges for neural network anomaly detection. We first propose a framework for a gas turbine vibration frequency spectra process under time-varying operation conditions, assisting neural networks' ability to capture weak information. The framework involves scaling spectra for aligning all frequency components related to rotational speed and normalizing frequency amplitude in a self-adaptive way. Degressive beta variational autoencoder is employed for learning spectra characteristics and anomaly detection, while a multi-category anomaly index is proposed to accommodate various operating conditions. Finally, a dataset of blade Foreign Object Damage (FOD) fault occurring under time-varying operating conditions was used to validate the framework and anomaly detection. The results demonstrate that the proposed method can effectively reduce the spectra differences under time-varying conditions, and also detect FOD fault during operation, which are challenging to identify using conventional methods.
Collapse
Affiliation(s)
| | - Kun Feng
- State Key Laboratory of High-End Compressor and System Technology, Beijing University of Chemical Technology, Beijing 100029, China
| | - Yuan Xiao
- State Key Laboratory of High-End Compressor and System Technology, Beijing University of Chemical Technology, Beijing 100029, China
| | | | | |
Collapse
|
9
|
Wang Q, Sun Z, Zhu Y, Song C, Li D. Intelligent fault diagnosis algorithm of rolling bearing based on optimization algorithm fusion convolutional neural network. MATHEMATICAL BIOSCIENCES AND ENGINEERING : MBE 2023; 20:19963-19982. [PMID: 38052632 DOI: 10.3934/mbe.2023884] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/07/2023]
Abstract
As an essential component of mechanical equipment, the fault diagnosis of rolling bearings may not only guarantee the systematic operation of the equipment, but also minimize any financial losses caused by equipment shutdowns. Fault diagnosis algorithms based on convolutional neural networks (CNN) have been widely used. However, traditional CNNs have limited feature representation capabilities, thereby making it challenging to determine their hyperparameters. This paper proposes a fault diagnosis method that combines a 1D-CNN with an attention mechanism and hyperparameter optimization to overcome the aforementioned limitations; this method improves the search speed for optimal hyperparameters of CNN models, improves the diagnostic accuracy, and enhances the representation of fault feature information in CNNs. First, the 1D-CNN is improved by combining it with an attention mechanism to enhance the fault feature information. Second, a swarm intelligence algorithm based on Differential Evolution (DE) and Grey Wolf Optimization (GWO) is proposed, which not only improves the convergence accuracy, but also increases the search efficiency. Finally, the improved 1D-CNN alongside hyperparameters optimization are used to diagnose the faults of rolling bearings. By using the Case Western Reserve University (CWRU) and Jiangnan University (JNU) datasets, when compared to other common diagnosis models, the results demonstrate the usefulness and dependability of the DE-GWO-CNN algorithm in fault diagnosis applications by demonstrating the increased diagnostic accuracy and superior anti-noise capabilities of the proposed method. The fault diagnosis methodology presented in this paper can accurately identify faults and provide dependable fault classification, thereby assisting technicians in promptly resolving faults and minimizing equipment failures and operational instabilities.
Collapse
Affiliation(s)
- Qiushi Wang
- Key Laboratory of Networked Control Systems, Chinese Academy of Sciences, Shenyang 110016, China
- Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China
| | - Zhicheng Sun
- Key Laboratory of Networked Control Systems, Chinese Academy of Sciences, Shenyang 110016, China
- Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China
| | - Yueming Zhu
- Key Laboratory of Networked Control Systems, Chinese Academy of Sciences, Shenyang 110016, China
- Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China
| | - Chunhe Song
- State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China No.114 Nanta Street, Shenyang, Liaoning Province, China
- Key Laboratory of Networked Control Systems, Chinese Academy of Sciences, Shenyang 110016, China
- Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences, Shenyang 110169, China
| | - Dong Li
- State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China No.114 Nanta Street, Shenyang, Liaoning Province, China
- Key Laboratory of Networked Control Systems, Chinese Academy of Sciences, Shenyang 110016, China
- Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences, Shenyang 110169, China
| |
Collapse
|
10
|
Huo D, Kang Y, Wang B, Feng G, Zhang J, Zhang H. Gear Fault Diagnosis Method Based on Multi-Sensor Information Fusion and VGG. ENTROPY (BASEL, SWITZERLAND) 2022; 24:1618. [PMID: 36359708 PMCID: PMC9689517 DOI: 10.3390/e24111618] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/29/2022] [Revised: 10/27/2022] [Accepted: 11/01/2022] [Indexed: 06/16/2023]
Abstract
The gearbox is an important component in the mechanical transmission system and plays a key role in aerospace, wind power and other fields. Gear failure is one of the main causes of gearbox failure, and therefore it is very important to accurately diagnose the type of gear failure under different operating conditions. Aiming at the problem that it is difficult to effectively identify the fault types of gears using traditional methods under complex and changeable working conditions, a fault diagnosis method based on multi-sensor information fusion and Visual Geometry Group (VGG) is proposed. First, the power spectral density is calculated with the raw frequency domain signal collected by multiple sensors before being transformed into a power spectral density energy map after information fusion. Second, the obtained energy map is combined with VGG to obtain the fault diagnosis model of the gear. Finally, two datasets are used to verify the effectiveness and generalization ability of the method. The experimental results show that the accuracy of the method can reach 100% at most on both datasets.
Collapse
Affiliation(s)
- Dongyue Huo
- School of Information Science and Engineering, Linyi University, Linyi 276000, China
| | - Yuyun Kang
- School of Logistics, Linyi University, Linyi 276000, China
| | - Baiyang Wang
- School of Information Science and Engineering, Linyi University, Linyi 276000, China
| | - Guifang Feng
- School of Life Science, Linyi University, Linyi 276000, China
- International College, Philippine Christian University, Manila 1004, Philippines
| | - Jiawei Zhang
- Linyi Trade Logistics Science and Technology Industry Research Institute, Linyi 276000, China
| | - Hongrui Zhang
- School of Mechanical and Vehicle Engineering, Linyi University, Linyi 276000, China
| |
Collapse
|
11
|
Transmission Line Fault Classification of Multi-Dataset Using CatBoost Classifier. SIGNALS 2022. [DOI: 10.3390/signals3030027] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
Abstract
Transmission line fault classification forms the basis of fault protection management in power systems. Because faults have adverse effects on transmission lines, adequate measures must be implemented to avoid power outages. This paper focuses on using the categorical boosting (CatBoost) algorithm classifier to analyse and train multiple voltage and current data from a 330 kV and 500 km-long simulated faulty transmission line model designed using Matlab/Simulink. From it, 93,340 fault data sizes were extracted. The CatBoost classifier was employed to classify the faults after different machine learning algorithms were used to train the same data with different parameters. The trainer achieved the best accuracy of 99.54%, with an error of 0.46% for 748 iterations out of 1000. The algorithm was selected for its high performance in classifying faults based on accuracy, precision and speed. In addition, it is easy to use and handles multiple data-sets. In contrast, a support vector machine and an artificial neural network each has a longer training time than the proposed method’s 58.5 s. Proper fault classification techniques assist in the effective fault management and planning of power system control thereby preventing energy waste and providing high performance.
Collapse
|