1
|
Chen Y, Shen Z, Li D, Zhong P, Chen Y. Heterogeneous Domain Adaptation With Generalized Similarity and Dissimilarity Regularization. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2025; 36:5006-5019. [PMID: 38466601 DOI: 10.1109/tnnls.2024.3372004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/13/2024]
Abstract
Heterogeneous domain adaptation (HDA) aims to address the transfer learning problems where the source domain and target domain are represented by heterogeneous features. The existing HDA methods based on matrix factorization have been proven to learn transferable features effectively. However, these methods only preserve the original neighbor structure of samples in each domain and do not use the label information to explore the similarity and separability between samples. This would not eliminate the cross-domain bias of samples and may mix cross-domain samples of different classes in the common subspace, misleading the discriminative feature learning of target samples. To tackle the aforementioned problems, we propose a novel matrix factorization-based HDA method called HDA with generalized similarity and dissimilarity regularization (HGSDR). Specifically, we propose a similarity regularizer by establishing the cross-domain Laplacian graph with label information to explore the similarity between cross-domain samples from the identical class. And we propose a dissimilarity regularizer based on the inner product strategy to expand the separability of cross-domain labeled samples from different classes. For unlabeled target samples, we keep their neighbor relationship to preserve the similarity and separability between them in the original space. Hence, the generalized similarity and dissimilarity regularization is built by integrating the above regularizers to facilitate cross-domain samples to form discriminative class distributions. HGSDR can more efficiently match the distributions of the two domains both from the global and sample viewpoints, thereby learning discriminative features for target samples. Extensive experiments on the benchmark datasets demonstrate the superiority of the proposed method against several state-of-the-art methods.
Collapse
|
2
|
Jin L, Zhao J, Chen L, Li S. Collective Neural Dynamics for Sparse Motion Planning of Redundant Manipulators Without Hessian Matrix Inversion. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2025; 36:4326-4335. [PMID: 38379233 DOI: 10.1109/tnnls.2024.3363241] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/22/2024]
Abstract
Redundant manipulators have been widely used in various industries whose applications not only improve production efficiency and reduce manual labor but also promote innovation in robotics and artificial intelligence. Kinematic control plays a fundamental and crucial role in robot control. Over the past few decades, numerous motion control schemes have been proposed and applied to trajectory tracking tasks. However, most of these schemes do not consider the introduction of sparsity into the motion control of redundant manipulators, resulting in excessive joint movements, which not only consume extra energy but also increase the risk of unexpected collisions in complex environments. To solve this problem, we transform the issue of increasing the sparsity into a nonconvex optimization problem. Furthermore, a collective neural dynamics for sparse motion planning (CNDSMP) scheme for motion planning of redundant manipulators is proposed. By incorporating sparsity into the control scheme, the excessive joint movements are minimized, leading to improved efficiency and reduced collision risks. Through simulations, comparisons, and physical experiments, the effectiveness and superiority of the proposed scheme are demonstrated.
Collapse
|
3
|
Yang C, Huang J, Wu S, Liu Q. Neural-network-based practical specified-time resilient formation maneuver control for second-order nonlinear multi-robot systems under FDI attacks. Neural Netw 2025; 186:107288. [PMID: 40020307 DOI: 10.1016/j.neunet.2025.107288] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2024] [Revised: 12/03/2024] [Accepted: 02/13/2025] [Indexed: 03/03/2025]
Abstract
This paper presents a specified-time resilient formation maneuver control approach for second-order nonlinear multi-robot systems under false data injection (FDI) attacks, incorporating an offline neural network. Building on existing works in integrated distributed localization and specified-time formation maneuver, the proposed approach introduces a hierarchical topology framework based on (d+1)-reachability theory to achieve downward decoupling, ensuring that each robot in a given layer remains unaffected by attacks on lower-layer robots. The framework enhances resilience by restricting the flow of follower information to the current and previous layers and the leader, thereby improving distributed relative localization accuracy. An offline radial basis function neural network (RBFNN) is employed to mitigate unknown nonlinearities and FDI attacks, enabling the control protocol to achieve specified time convergence while reducing system errors compared to traditional finite-time and fixed-time methods. Simulation results validate the effectiveness of the method with enhanced robustness and reduced error under adversarial conditions.
Collapse
Affiliation(s)
- Chuanhai Yang
- School of Cyber Science and Engineering, Southeast University, Nanjing 210096, China.
| | - Jingyi Huang
- School of Mathematics, Southeast University, Nanjing 210096, China.
| | - Shuang Wu
- School of Mathematics, Southeast University, Nanjing 210096, China.
| | - Qingshan Liu
- School of Mathematics, Southeast University, Nanjing 210096, China; Purple Mountain Laboratories, Nanjing 211111, China.
| |
Collapse
|
4
|
Luo X, Li Z, Yue W, Li S. A Calibrator Fuzzy Ensemble for Highly-Accurate Robot Arm Calibration. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2025; 36:2169-2181. [PMID: 38277247 DOI: 10.1109/tnnls.2024.3354080] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/28/2024]
Abstract
The absolute positioning accuracy of an industrial robot arm is vital for advancing manufacturing-related applications like automatic assembly, which can be improved via the data-driven approaches to robot arm calibration. Existing data-driven calibrators have illustrated their efficiency in addressing the issue of robot arm calibration. However, they mostly are single learning models that can be easily affected by the insufficient representation of the solution space, therefore, suffering from the calibration accuracy loss. To address this issue, this study proposes a calibrator fuzzy ensemble (CFE) with twofold ideas: 1) implementing eight data-driven calibrators relying on different sophisticated machine learning algorithms for an industrial robot arm, which guarantees the accuracy of individual base models and 2) innovatively developing a fuzzy ensemble of the obtained eight diversified calibrators to obtain impressively high calibration accuracy for an industrial robot arm. Extensive experiments on an ABB IRB120 industrial robot implemented with MATLAB demonstrate that compared with state-of-the-art calibrators, CFE decreases the maximum error at 8.59%. Hence, it has great potential for real applications.
Collapse
|
5
|
Lu Y, Xiao M, Wu X, Karimi HR, Xie X, Cao J, Zheng WX. Tipping prediction of a class of large-scale radial-ring neural networks. Neural Netw 2025; 181:106820. [PMID: 39490026 DOI: 10.1016/j.neunet.2024.106820] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2024] [Revised: 09/23/2024] [Accepted: 10/13/2024] [Indexed: 11/05/2024]
Abstract
Understanding the emergence and evolution of collective dynamics in large-scale neural networks remains a complex challenge. This paper seeks to address this gap by applying dynamical systems theory, with a particular focus on tipping mechanisms. First, we introduce a novel (n+mn)-scale radial-ring neural network and employ Coates' flow graph topological approach to derive the characteristic equation of the linearized network. Second, through deriving stability conditions and predicting the tipping point using an algebraic approach based on the integral element concept, we identify critical factors such as the synaptic transmission delay, the self-feedback coefficient, and the network topology. Finally, we validate the methodology's effectiveness in predicting the tipping point. The findings reveal that increased synaptic transmission delay can induce and amplify periodic oscillations. Additionally, the self-feedback coefficient and the network topology influence the onset of tipping points. Moreover, the selection of activation function impacts both the number of equilibrium solutions and the convergence speed of the neural network. Lastly, we demonstrate that the proposed large-scale radial-ring neural network exhibits stronger robustness compared to lower-scale networks with a single topology. The results provide a comprehensive depiction of the dynamics observed in large-scale neural networks under the influence of various factor combinations.
Collapse
Affiliation(s)
- Yunxiang Lu
- College of Automation & College of Artificial Intelligence, Nanjing University of Posts and Telecommunications, Nanjing 210023, China.
| | - Min Xiao
- College of Automation & College of Artificial Intelligence, Nanjing University of Posts and Telecommunications, Nanjing 210023, China.
| | - Xiaoqun Wu
- College of Computer Science and Software Engineering, Shen Zhen University, Shen Zhen 518060, China.
| | - Hamid Reza Karimi
- Department of Mechanical Engineering, Politecnico di Milano, Milan 20156, Italy.
| | - Xiangpeng Xie
- Institute of Advanced Technology, Nanjing University of Posts and Telecommunications, Nanjing 210023, China.
| | - Jinde Cao
- School of Mathematics, Southeast University, Nanjing 210096, China.
| | - Wei Xing Zheng
- School of Computer, Data and Mathematical Sciences, Western Sydney University, Sydney, NSW 2751, Australia.
| |
Collapse
|
6
|
Dong B, Zhu X, An T, Jiang H, Ma B. Barrier-critic-disturbance approximate optimal control of nonzero-sum differential games for modular robot manipulators. Neural Netw 2025; 181:106880. [PMID: 39546873 DOI: 10.1016/j.neunet.2024.106880] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2024] [Revised: 10/23/2024] [Accepted: 10/29/2024] [Indexed: 11/17/2024]
Abstract
In this paper, for addressing the safe control problem of modular robot manipulators (MRMs) system with uncertain disturbances, an approximate optimal control scheme of nonzero-sum (NZS) differential games is proposed based on the control barrier function (CBF). The dynamic model of the manipulator system integrates joint subsystems through the utilization of joint torque feedback (JTF) technique, incorporating interconnected dynamic coupling (IDC) effects. By integrating the cost functions relevant to each player with the CBF, the evolution of system states is ensured to remain within the safe region. Subsequently, the optimal tracking control problem for the MRM system is reformulated as an NZS game involving multiple joint subsystems. Based on the adaptive dynamic programming (ADP) algorithm, a cost function approximator for solving Hamilton-Jacobi (HJ) equation using only critic neural networks (NN) is established, which promotes the feasible derivation of the approximate optimal control strategy. The Lyapunov theory is utilized to demonstrate that the tracking error is uniformly ultimately bounded (UUB). Utilizing the CBF's state constraint mechanism prevents the robot from deviating from the safe region, and the application of the NZS game approach ensures that the subsystems of the MRM reach a Nash equilibrium. The proposed control method effectively addresses the problem of safe and approximate optimal control of MRM system under uncertain disturbances. Finally, the effectiveness and superiority of the proposed method are verified through simulations and experiments.
Collapse
Affiliation(s)
- Bo Dong
- Department of Control Science and Engineering, Changchun University of Technology, Changchun, 130012, Jilin, China
| | - Xinye Zhu
- Department of Control Science and Engineering, Changchun University of Technology, Changchun, 130012, Jilin, China
| | - Tianjiao An
- Department of Control Science and Engineering, Changchun University of Technology, Changchun, 130012, Jilin, China.
| | - Hucheng Jiang
- Department of Control Science and Engineering, Changchun University of Technology, Changchun, 130012, Jilin, China
| | - Bing Ma
- Department of Control Science and Engineering, Changchun University of Technology, Changchun, 130012, Jilin, China
| |
Collapse
|
7
|
Kowsalya P, Kathiresan S, Kashkynbayev A, Rakkiyappan R. Fixed-time synchronization of delayed multiple inertial neural network with reaction-diffusion terms under cyber-physical attacks using distributed control and its application to multi-image encryption. Neural Netw 2024; 180:106743. [PMID: 39326190 DOI: 10.1016/j.neunet.2024.106743] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2024] [Revised: 08/22/2024] [Accepted: 09/14/2024] [Indexed: 09/28/2024]
Abstract
This study examines the fixed-time synchronization (FXTS) problem of delayed multiple inertial neural networks (MINNs) against cyber-physical attacks (CPA) execute an uncertain impulse, using reaction-diffusion (RD) terms. Using fixed-time stability theory, the paper derives innovative and practical criteria for FXTS. It also introduces a MINNs to counteract CPA by executing uncertain impulses with RD terms. Designing security control laws for MINNS with RD terms poses significant challenges, particularly when these networks are tasked with cooperative functions in the presence of failures or attacks. A distributed control strategy is introduced to attain FXTS for the delayed MINNs incorporating RD terms. To examine the consequences of CPA, we will build a Lyapunov function and combine it with some M-matrix properties. Additionally, a security control law is provided to guarantee the FXTS of the consider NN system. The demonstrated settling time (ST) of the designated MINNs is provided. From an algorithmic perspective, it is notable that the security framework and control algorithm are designed to select parameters for the feedback gain matrix and coupling strength to achieve synchronization. A numerical model is provided to support the obtained theoretical findings. Finally, our proposition of a multi-image encryption algorithm, utilizing MINNs and secured by robust security protocols, serves to uphold the integrity of electronic healthcare systems, ensuring the safeguarding of sensitive medical data.
Collapse
Affiliation(s)
- P Kowsalya
- Department of Mathematics, Bharathiar University, Coimbatore 641 046, Tamilnadu, India
| | - S Kathiresan
- Department of Mathematics, School of Sciences and Humanities, Nazarbayev University, Astana 010000, Kazakhstan
| | - Ardak Kashkynbayev
- Department of Mathematics, School of Sciences and Humanities, Nazarbayev University, Astana 010000, Kazakhstan
| | - R Rakkiyappan
- Department of Mathematics, Bharathiar University, Coimbatore 641 046, Tamilnadu, India.
| |
Collapse
|
8
|
Jiang J, Huang H. Complex-valued soft-log threshold reweighting for sparsity of complex-valued convolutional neural networks. Neural Netw 2024; 180:106664. [PMID: 39217863 DOI: 10.1016/j.neunet.2024.106664] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2024] [Revised: 07/14/2024] [Accepted: 08/23/2024] [Indexed: 09/04/2024]
Abstract
Complex-valued convolutional neural networks (CVCNNs) have been demonstrated effectiveness in classifying complex signals and synthetic aperture radar (SAR) images. However, due to the introduction of complex-valued parameters, CVCNNs tend to become redundant with heavy floating-point operations. Model sparsity is emerged as an efficient method of removing the redundancy without much loss of performance. Currently, there are few studies on the sparsity problem of CVCNNs. Therefore, a complex-valued soft-log threshold reweighting (CV-SLTR) algorithm is proposed for the design of sparse CVCNN to reduce the number of weight parameters and simplify the structure of CVCNN. On one hand, considering the difference between complex and real numbers, we redefine and derive the complex-valued log-sum threshold method. On the other hand, by considering the distinctive characteristics of complex-valued convolutional (CConv) layers and complex-valued fully connected (CFC) layers of CVCNNs, the complex-valued soft and log-sum threshold methods are respectively developed to prune the weights of different layers during the forward propagation, and the sparsity thresholds are optimized during the backward propagation by inducing a sparsity budget. Furthermore, different optimizers can be integrated with CV-SLTR. When stochastic gradient descent (SGD) is used, the convergence of CV-SLTR is proved if Lipschitzian continuity is satisfied. Experiments on the RadioML 2016.10A and S1SLC-CVDL datasets show that the proposed algorithm is efficient for the sparsity of CVCNNs. It is worth noting that the proposed algorithm has fast sparsity speed while maintaining high classification accuracy. These demonstrate the feasibility and potential of the CV-SLTR algorithm.
Collapse
Affiliation(s)
- Jingwei Jiang
- School of Electronics and Information Engineering, Soochow University, Suzhou 215006, PR China.
| | - He Huang
- School of Electronics and Information Engineering, Soochow University, Suzhou 215006, PR China.
| |
Collapse
|
9
|
Qin Z, Fu Q, Peng J. A computationally efficient and robust looming perception model based on dynamic neural field. Neural Netw 2024; 179:106502. [PMID: 38996688 DOI: 10.1016/j.neunet.2024.106502] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2024] [Revised: 06/18/2024] [Accepted: 06/29/2024] [Indexed: 07/14/2024]
Abstract
There are primarily two classes of bio-inspired looming perception visual systems. The first class employs hierarchical neural networks inspired by well-acknowledged anatomical pathways responsible for looming perception, and the second maps nonlinear relationships between physical stimulus attributes and neuronal activity. However, even with multi-layered structures, the former class is sometimes fragile in looming selectivity, i.e., the ability to well discriminate between approaching and other categories of movements. While the latter class leaves qualms regarding how to encode visual movements to indicate physical attributes like angular velocity/size. Beyond those, we propose a novel looming perception model based on dynamic neural field (DNF). The DNF is a brain-inspired framework that incorporates both lateral excitation and inhibition within the field through instant feedback, it could be an easily-built model to fulfill the looming sensitivity observed in biological visual systems. To achieve our target of looming perception with computational efficiency, we introduce a single-field DNF with adaptive lateral interactions and dynamic activation threshold. The former mechanism creates antagonism to translating motion, and the latter suppresses excitation during receding. Accordingly, the proposed model exhibits the strongest response to moving objects signaling approaching over other types of external stimuli. The effectiveness of the proposed model is supported by relevant mathematical analysis and ablation study. The computational efficiency and robustness of the model are verified through systematic experiments including on-line collision-detection tasks in micro-mobile robots, at success rate of 93% compared with state-of-the-art methods. The results demonstrate its superiority over the model-based methods concerning looming perception.
Collapse
Affiliation(s)
- Ziyan Qin
- Machine Life and Intelligence Research Centre, School of Mathematics and Information Science, Guangzhou University, Guangzhou, 510006, China.
| | - Qinbing Fu
- Machine Life and Intelligence Research Centre, School of Mathematics and Information Science, Guangzhou University, Guangzhou, 510006, China.
| | - Jigen Peng
- Machine Life and Intelligence Research Centre, School of Mathematics and Information Science, Guangzhou University, Guangzhou, 510006, China.
| |
Collapse
|
10
|
Yang M, Zhang Y, Hu H. Inverse-Free DZNN Models for Solving Time-Dependent Linear System via High-Precision Linear Six-Step Method. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:8597-8608. [PMID: 37015638 DOI: 10.1109/tnnls.2022.3230898] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
Time-dependent linear system (TDLS) is usually encountered in scientific research, which is the mathematical formulation of many practical applications. Different from conventional inverse-need models, by utilizing zeroing neural network (ZNN) method twice, an inverse-free continuous ZNN (CZNN) model is developed for solving TDLS. For conveniently practical use, a discrete model is naturally desired. Superior to conventional discretization methods, a general linear six-step (LSS) method with the seventh-order precision and five variable parameters is proposed for the first time. Constraints about five variable parameters are theoretically analyzed to guarantee the efficacy of the general LSS method. Within constraints, 12 specific LSS methods are further developed. Aided with the general LSS method, an inverse-free discrete ZNN (DZNN) is proposed and termed DZNN-LSS model, and its precision is greatly improved compared with conventional discrete models. For comparison, three conventional discretization methods are also utilized to generate DZNN models. Detailed theoretical analyses are provided to prove the efficacy of relevant models. In addition, a specific TDLS example is considered to show the effectiveness and superiority of the DZNN-LSS model. More than that, applications to manipulator control and sound source localization are conducted to illustrate the applicability of the DZNN-LSS model.
Collapse
|
11
|
Liu J, Deng Y, Liu Y, Chen L, Hu Z, Wei P, Li Z. A logistic-tent chaotic mapping Levenberg Marquardt algorithm for improving positioning accuracy of grinding robot. Sci Rep 2024; 14:9649. [PMID: 38671074 PMCID: PMC11053121 DOI: 10.1038/s41598-024-60402-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2024] [Accepted: 04/23/2024] [Indexed: 04/28/2024] Open
Abstract
The precision of workpiece machining is critically influenced by the geometric errors in the kinematics of grind robots, which directly affect their absolute positioning accuracy. To tackle this challenge, this paper introduces a logistic-tent chaotic mapping Levenberg Marquardt algorithm designed to accurately identify and compensate for this geometric error. the approach begins with the construction of a forward kinematic model and an error model specific to the robot. Then the algorithm is adopted to identify and compensate for the geometric error. The method establishes a mapping interval around the initial candidate solutions derived from iterative applications of the Levenberg Marquardt algorithm. Within this interval, the logistic-tent chaotic mapping method generates a diverse set of candidate solutions. These candidates are evaluated based on their fitness values, with the optimal solution selected for subsequent iterations. Empirical compensation experiments have validated the proposed method's precision and effectiveness, demonstrating a 6% increase in compensation accuracy and a 47.68% improvement in efficiency compared to existing state-of-the-art approaches. This process not only minimizes the truncation error inherent in the Levenberg Marquardt algorithm but also significantly enhances solution efficiency. Moreover, simulation experiments on grind processes further validate the method's ability to significantly improve the quality of workpiece machining.
Collapse
Affiliation(s)
- Jian Liu
- School of Economics and Management, Chengdu Technological University, Chengdu, 611730, Sichuan, China
- Sichuan Institute of Industrial Big-Data Applications, Chengdu, 611730, China
| | - Yonghong Deng
- School of Economics and Management, Chengdu Technological University, Chengdu, 611730, Sichuan, China.
- Sichuan Institute of Industrial Big-Data Applications, Chengdu, 611730, China.
| | - Yulin Liu
- Sichuan Institute of Industrial Big-Data Applications, Chengdu, 611730, China
| | - Linlin Chen
- School of Software Engineering, Chengdu University of Information Technology, Chengdu, 610225, China
| | - Zhenzhen Hu
- College of Communication Engineering, Chengdu University of Information Technology, Chengdu, 610225, China.
| | - Peiyang Wei
- School of Software Engineering, Chengdu University of Information Technology, Chengdu, 610225, China
- School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, 400065, China
| | - Zhibin Li
- School of Software Engineering, Chengdu University of Information Technology, Chengdu, 610225, China
| |
Collapse
|
12
|
Adaptive DBN Using Hybrid Bayesian Lichtenberg Optimization for Intelligent Task Allocation. Neural Process Lett 2023. [DOI: 10.1007/s11063-022-11071-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/12/2023]
|
13
|
Martin J, Elster C. Aleatoric Uncertainty for Errors-in-Variables Models in Deep Regression. Neural Process Lett 2022. [DOI: 10.1007/s11063-022-11066-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
AbstractA Bayesian treatment of deep learning allows for the computation of uncertainties associated with the predictions of deep neural networks. We show how the concept of Errors-in-Variables can be used in Bayesian deep regression to also account for the uncertainty associated with the input of the employed neural network. The presented approach thereby exploits a relevant, but generally overlooked, source of uncertainty and yields a decomposition of the predictive uncertainty into an aleatoric and epistemic part that is more complete and, in many cases, more consistent from a statistical perspective. We discuss the approach along various simulated and real examples and observe that using an Errors-in-Variables model leads to an increase in the uncertainty while preserving the prediction performance of models without Errors-in-Variables. For examples with known regression function we observe that this ground truth is substantially better covered by the Errors-in-Variables model, indicating that the presented approach leads to a more reliable uncertainty estimation.
Collapse
|
14
|
Li Z, Li S, Luo X. Using Quadratic Interpolated Beetle Antennae Search to Enhance Robot Arm Calibration Accuracy. IEEE Robot Autom Lett 2022. [DOI: 10.1109/lra.2022.3211776] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Affiliation(s)
- Zhibin Li
- School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, China
| | - Shuai Li
- Faculty of Science and Engineering, and also affiliated to Zienkiewicz Centre for Computational Engineering, Swansea University, Swansea, U.K
| | - Xin Luo
- School of Computer Science and Technology, Dongguan University of Technology, Dongguan, Guangdong, China
| |
Collapse
|
15
|
Li J, Hu J, Zhao G, Huang S, Liu Y. Tensor based stacked fuzzy neural network for efficient data regression. Soft comput 2022; 27:1-30. [PMID: 35992191 PMCID: PMC9382627 DOI: 10.1007/s00500-022-07402-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/29/2022] [Indexed: 11/26/2022]
Abstract
Random vector functional link and extreme learning machine have been extended by the type-2 fuzzy sets with vector stacked methods, this extension leads to a new way to use tensor to construct learning structure for the type-2 fuzzy sets-based learning framework. In this paper, type-2 fuzzy sets-based random vector functional link, type-2 fuzzy sets-based extreme learning machine and Tikhonov-regularized extreme learning machine are fused into one network, a tensor way of stacking data is used to incorporate the nonlinear mappings when using type-2 fuzzy sets. In this way, the network could learn the sub-structure by three sub-structures' algorithms, which are merged into one tensor structure via the type-2 fuzzy mapping results. To the stacked single fuzzy neural network, the consequent part parameters learning is implemented by unfolding tensor-based matrix regression. The newly proposed stacked single fuzzy neural network shows a new way to design the hybrid fuzzy neural network with the higher order fuzzy sets and higher order data structure. The effective of the proposed stacked single fuzzy neural network are verified by the classical testing benchmarks and several statistical testing methods.
Collapse
Affiliation(s)
- Jie Li
- College of Electronic Information Engineering, Inner Mongolia University, Hohhot, 010021 China
| | - Jiale Hu
- College of Electronic Information Engineering, Inner Mongolia University, Hohhot, 010021 China
| | - Guoliang Zhao
- College of Electronic Information Engineering, Inner Mongolia University, Hohhot, 010021 China
- State Key Laboratory of Reproductive Regulation and Breeding of Grassland Livestock, Inner Mongolia University, Hohhot, 010021 China
| | - Sharina Huang
- College of Science, Inner Mongolia Agricultural University, Hohhot, 010018 China
| | - Yang Liu
- College of Electronic Information Engineering, Inner Mongolia University, Hohhot, 010021 China
| |
Collapse
|
16
|
Neural Network Based Forecasting Technique for Wireless Sensor Networks. Neural Process Lett 2022. [DOI: 10.1007/s11063-022-10903-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|