1
|
Yang X, Ju X, Shi P, Wen G. Two Novel Noise-Suppression Projection Neural Networks With Fixed-Time Convergence for Variational Inequalities and Applications. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2025; 36:1707-1718. [PMID: 37819816 DOI: 10.1109/tnnls.2023.3321761] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/13/2023]
Abstract
This article proposes two novel projection neural networks (PNNs) with fixed-time ( ) convergence to deal with variational inequality problems (VIPs). The remarkable features of the proposed PNNs are convergence and more accurate upper bounds for arbitrary initial conditions. The robustness of the proposed PNNs under bounded noises is further studied. In addition, the proposed PNNs are applied to deal with absolute value equations (AVEs), noncooperative games, and sparse signal reconstruction problems (SSRPs). The upper bounds of the settling time for the proposed PNNs are tighter than the bounds in the existing neural networks. The effectiveness and advantages of the proposed PNNs are confirmed by numerical examples.
Collapse
|
2
|
Hu Q, Zheng B. A novel two-layer fuzzy neural network for solving inequality-constrained ℓ 1-minimization problem with applications. Neural Netw 2024; 178:106491. [PMID: 38972131 DOI: 10.1016/j.neunet.2024.106491] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2023] [Revised: 04/15/2024] [Accepted: 06/24/2024] [Indexed: 07/09/2024]
Abstract
In this paper, we propose a novel two-layer fuzzy neural network model (TLFNN) for solving the inequality-constrained ℓ1-minimization problem. The stability and global convergence of the proposed TLFNN model are detailedly analyzed using the Lyapunov theory. Compared with the existing three-layer neural network model (TLNN) recently designed by Yang et al., the proposed TLFNN model possesses less storage, stronger robustness, faster convergence rate and higher convergence accuracy. These advantages are illustrated by some numerical experiments, where it is shown that the TLFNN model can achieve a convergence accuracy of 10-13 within 5s while the TLNN model can only acquire 10-6 in 105s when some random coefficient matrices are applied. Since the linear equality-constrained conditions can be equivalently transformed into double inequality-constrained ones, some simulation experiments for sparse signal reconstruction show that the proposed TLFNN model also has less convergence time and stronger robustness than the existing state-of-the-art neural network models for the equality-constrained ℓ1-minimization problem.
Collapse
Affiliation(s)
- Qing Hu
- School of Mathematics and Statistics, Lanzhou University, Lanzhou, 730000, China.
| | - Bing Zheng
- School of Mathematics and Statistics, Lanzhou University, Lanzhou, 730000, China.
| |
Collapse
|
3
|
Zheng J, Ju X, Zhang N, Xu D. A novel predefined-time neurodynamic approach for mixed variational inequality problems and applications. Neural Netw 2024; 174:106247. [PMID: 38518707 DOI: 10.1016/j.neunet.2024.106247] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2023] [Revised: 02/20/2024] [Accepted: 03/15/2024] [Indexed: 03/24/2024]
Abstract
In this paper, we propose a novel neurodynamic approach with predefined-time stability that offers a solution to address mixed variational inequality problems. Our approach introduces an adjustable time parameter, thereby enhancing flexibility and applicability compared to conventional fixed-time stability methods. By satisfying certain conditions, the proposed approach is capable of converging to a unique solution within a predefined-time, which sets it apart from fixed-time stability and finite-time stability approaches. Furthermore, our approach can be extended to address a wide range of mathematical optimization problems, including variational inequalities, nonlinear complementarity problems, sparse signal recovery problems, and nash equilibria seeking problems in noncooperative games. We provide numerical simulations to validate the theoretical derivation and showcase the effectiveness and feasibility of our proposed method.
Collapse
Affiliation(s)
- Jinlan Zheng
- Key Laboratory for Applied Statistics of MOE, School of Mathematics and Statistics, Northeast Normal University, Changchun 130024, China
| | - Xingxing Ju
- College of Electronics and Information Engineering, Sichuan University, Chengdu 610065, China; Shaanxi Key Laboratory of Information Communication Network and Security, Xi'an University of Posts and Telecommunications, Xi'an, Shaanxi 710121, China
| | - Naimin Zhang
- College of Mathematics and Physics, Wenzhou University, Wenzhou 325035, China
| | - Dongpo Xu
- Key Laboratory for Applied Statistics of MOE, School of Mathematics and Statistics, Northeast Normal University, Changchun 130024, China.
| |
Collapse
|
4
|
Xu J, He X. Distributed continuous-time accelerated neurodynamic approaches for sparse recovery via smooth approximation to L 1-minimization. Neural Netw 2024; 172:106123. [PMID: 38232419 DOI: 10.1016/j.neunet.2024.106123] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2023] [Revised: 11/18/2023] [Accepted: 01/09/2024] [Indexed: 01/19/2024]
Abstract
This paper develops two continuous-time distributed accelerated neurodynamic approaches for solving sparse recovery via smooth approximation to L1-norm minimization problem. First, the L1-norm minimization problem is converted into a distributed smooth optimization problem by utilizing multiagent consensus theory and smooth approximation. Then, a distributed primal-dual accelerated neurodynamic approach is designed by using Karush-Kuhn-Tucker (KKT) condition and Nesterov's accelerated method. Furthermore, in order to reduce the structure complexity of the presented neurodynamic approach, based on the projection matrix, we eliminate a dual variable in the KKT condition and propose a distributed accelerated neurodynamic approach with a simpler structure. It is proved that the two proposed distributed neurodynamic approaches both achieve O(1t2) convergence rate. Finally, the simulation results of sparse recovery are given to demonstrate the effectiveness of the proposed approaches.
Collapse
Affiliation(s)
- Junpeng Xu
- Chongqing Key Laboratory of Nonlinear Circuits and Intelligent Information Processing, School of Electronic and Information Engineering, Southwest University, Chongqing 400715, China.
| | - Xing He
- Chongqing Key Laboratory of Nonlinear Circuits and Intelligent Information Processing, School of Electronic and Information Engineering, Southwest University, Chongqing 400715, China.
| |
Collapse
|
5
|
Wen H, Qu Y, He X, Sun S, Yang H, Li T, Zhou F. First/second-order predefined-time convergent ZNN models for time-varying quadratic programming and robotic manipulator application. ISA TRANSACTIONS 2024; 146:42-49. [PMID: 38129244 DOI: 10.1016/j.isatra.2023.12.020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/20/2023] [Revised: 12/15/2023] [Accepted: 12/16/2023] [Indexed: 12/23/2023]
Abstract
Zeroing neural network (ZNN) model, an important class of recurrent neural network, has been widely applied in the field of computation and optimization. In this paper, two ZNN models with predefined-time convergence are proposed for the time-varying quadratic programming (TVQP) problem. First, in the framework of the traditional ZNN model, the first-order predefined-time convergent ZNN (FPTZNN) model is proposed in combination with a predefined-time controller. Compared with the existing ZNN models, the proposed ZNN model is error vector combined with sliding mode control technique. Then, the FPTZNN model is further extended and the second-order predefined-time convergent ZNN (SPTZNN) model is developed. Combined with the Lyapunov method and the concept of predefined-time stability, it is shown that the proposed FPTZNN and SPTZNN models have the properties of predefined-time convergence, and their convergence time can be flexibly adjusted by predefined-time control parameters. Finally, the proposed FPTZNN and SPTZNN models are compared with the existing ZNN models for the TVQP problem in simulation experiment, and the simulation experiment results verify the effectiveness and superior performance of the proposed FPTZNN and SPTZNN models. In addition, the proposed FPTZNN model for robot motion planning problem is applied and successfully implemented to verify the practicality of the model.
Collapse
Affiliation(s)
- Hongsong Wen
- Chongqing Key Laboratory of Nonlinear Circuits and Intelligent Information Processing, College of Electronic and Information Engineering, Southwest University, 400715, China.
| | - Youran Qu
- Chongqing Key Laboratory of Nonlinear Circuits and Intelligent Information Processing, College of Electronic and Information Engineering, Southwest University, 400715, China.
| | - Xing He
- Chongqing Key Laboratory of Nonlinear Circuits and Intelligent Information Processing, College of Electronic and Information Engineering, Southwest University, 400715, China.
| | - Shiying Sun
- State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China.
| | - Hongjun Yang
- State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China.
| | - Tao Li
- Department of Critical Care Medicine, the First Medical Centre, Chinese PLA General Hospital, Beijing 100853, China; Medical Engineering Laboratory of Chinese PLA General Hospital, Beijing 100853, China.
| | - Feihu Zhou
- Department of Critical Care Medicine, the First Medical Centre, Chinese PLA General Hospital, Beijing 100853, China; Medical Engineering Laboratory of Chinese PLA General Hospital, Beijing 100853, China.
| |
Collapse
|
6
|
Zheng J, Chen J, Ju X. Fixed-time stability of projection neurodynamic network for solving pseudomonotone variational inequalities. Neurocomputing 2022. [DOI: 10.1016/j.neucom.2022.07.034] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
|
7
|
Liu N, Su Z, Chai Y, Qin S. Feedback Neural Network for Constrained Bi-objective Convex Optimization. Neurocomputing 2022. [DOI: 10.1016/j.neucom.2022.09.120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/14/2022]
|
8
|
Sparse signal reconstruction via recurrent neural networks with hyperbolic tangent function. Neural Netw 2022; 153:1-12. [DOI: 10.1016/j.neunet.2022.05.022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2021] [Revised: 05/21/2022] [Accepted: 05/24/2022] [Indexed: 11/22/2022]
|
9
|
Zhao Y, Liao X, He X. Fixed-Time Stable Neurodynamic Flow to Sparse Signal Recovery via Nonconvex L1-β2-Norm. Neural Comput 2022; 34:1727-1755. [PMID: 35798330 DOI: 10.1162/neco_a_01508] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2021] [Accepted: 02/27/2022] [Indexed: 11/04/2022]
Abstract
This letter develops a novel fixed-time stable neurodynamic flow (FTSNF) implemented in a dynamical system for solving the nonconvex, nonsmooth model L1-β2, β∈[0,1] to recover a sparse signal. FTSNF is composed of many neuron-like elements running in parallel. It is very efficient and has provable fixed-time convergence. First, a closed-form solution of the proximal operator to model L1-β2, β∈[0,1] is presented based on the classic soft thresholding of the L1-norm. Next, the proposed FTSNF is proven to have a fixed-time convergence property without additional assumptions on the convexity and strong monotonicity of the objective functions. In addition, we show that FTSNF can be transformed into other proximal neurodynamic flows that have exponential and finite-time convergence properties. The simulation results of sparse signal recovery verify the effectiveness and superiority of the proposed FTSNF.
Collapse
Affiliation(s)
- You Zhao
- Key Laboratory of Dependable Services Computing in Cyber Physical Society-Ministry of Education, College of Computer Science, Chongqing University, Chongqing 400044, China
| | - Xiaofeng Liao
- IEEE Fellow, and Key Laboratory of Dependable Services Computing in Cyber Physical Society-Ministry of Education, College of Computer Science, Chongqing University, Chongqing 400044, China
| | - Xing He
- Chongqing Key Laboratory of Nonlinear Circuits and Intelligent Information Processing, College of Electronics and Information Engineering, Southwest University, Chongqing 400715, China
| |
Collapse
|
10
|
An Effective Clustering Algorithm Using Adaptive Neighborhood and Border Peeling Method. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2021; 2021:6785580. [PMID: 34804147 PMCID: PMC8598334 DOI: 10.1155/2021/6785580] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/28/2021] [Accepted: 10/13/2021] [Indexed: 11/23/2022]
Abstract
Traditional clustering methods often cannot avoid the problem of selecting neighborhood parameters and the number of clusters, and the optimal selection of these parameters varies among different shapes of data, which requires prior knowledge. To address the above parameter selection problem, we propose an effective clustering algorithm based on adaptive neighborhood, which can obtain satisfactory clustering results without setting the neighborhood parameters and the number of clusters. The core idea of the algorithm is to first iterate adaptively to a logarithmic stable state and obtain neighborhood information according to the distribution characteristics of the dataset, and then mark and peel the boundary points according to this neighborhood information, and finally cluster the data clusters with the core points as the centers. We have conducted extensive comparative experiments on datasets of different sizes and different distributions and achieved satisfactory experimental results.
Collapse
|