1
|
El-Hussieny H. Real-time deep learning-based model predictive control of a 3-DOF biped robot leg. Sci Rep 2024; 14:16243. [PMID: 39004665 PMCID: PMC11247096 DOI: 10.1038/s41598-024-66104-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2024] [Accepted: 06/27/2024] [Indexed: 07/16/2024] Open
Abstract
Our research utilized deep learning to enhance the control of a 3 Degrees of Freedom biped robot leg. We created a dynamic model based on a detailed joint angles and actuator torques dataset. This model was then integrated into a Model Predictive Control (MPC) framework, allowing for precise trajectory tracking without the need for traditional analytical dynamic models. By incorporating specific constraints within the MPC, we met operational and safety standards. The experimental results demonstrate the effectiveness of deep learning models in improving robotic control, leading to precise trajectory tracking and suggesting potential for further integration of deep learning into robotic system control. This approach not only outperforms traditional control methods in accuracy and efficiency but also opens the way for new research in robotics, highlighting the potential of utilizing deep learning models in predictive control techniques.
Collapse
Affiliation(s)
- Haitham El-Hussieny
- Department of Mechatronics and Robotics Engineering, Egypt-Japan University of Science and Technology, E-JUST, Alexandria, 21934, Egypt.
| |
Collapse
|
2
|
On generalization error of neural network models and its application to predictive control of nonlinear processes. Chem Eng Res Des 2023. [DOI: 10.1016/j.cherd.2022.12.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
|
3
|
Lu Y, Maftouni M, Yang T, Zheng P, Young D, Kong ZJ, Li Z. A novel disassembly process of end-of-life lithium-ion batteries enhanced by online sensing and machine learning techniques. JOURNAL OF INTELLIGENT MANUFACTURING 2022; 34:2463-2475. [PMID: 35462703 PMCID: PMC9018251 DOI: 10.1007/s10845-022-01936-x] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/03/2021] [Accepted: 03/09/2022] [Indexed: 06/14/2023]
Abstract
UNLABELLED An effective lithium-ion battery (LIB) recycling infrastructure is of great importance to alleviate the concerns over the disposal of waste LIBs and the sustainability of critical elements for producing LIB components. The End-of-life (EOL) LIBs are in various sizes and shapes, which create significant challenges to automate a few unit operations (e.g., disassembly at the cell level) of the recycling process. Meanwhile, hazardous and flammable materials are contained in LIBs, posing great threats to the human exposure. Therefore, it is difficult to dismantle the LIBs safely and efficiently to recover critical materials. Automation has become a competitive solution in manufacturing world, which allows for mass production at outstanding speeds and with great repeatability or quality. It is imperative to develop automatic disassembly solution to effectively disassemble the LIBs while safeguarding human workers against the hazards environment. In this work, we demonstrate an automatic battery disassembly platform enhanced by online sensing and machine learning technologies. The computer vision is used to classify different types of batteries based on their brands and sizes. The real-time temperature data is captured from a thermal camera. A data-driven model is built to predict the cutting temperature pattern and the temperature spike can be mitigated by the close-loop control system. Furthermore, quality control is conducted using a neural network model to detect and mitigate the cutting defects. The integrated disassembly platform can realize the real-time diagnosis and closed-loop control of the cutting process to optimize the cutting quality and improve the safety. SUPPLEMENTARY INFORMATION The online version contains supplementary material available at 10.1007/s10845-022-01936-x.
Collapse
Affiliation(s)
- Yingqi Lu
- Department of Mechanical Engineering, Virginia Tech, Blacksburg, USA
| | - Maede Maftouni
- Department of Industrial and Systems Engineering, Virginia Tech, Blacksburg, USA
| | - Tairan Yang
- Department of Mechanical Engineering, Virginia Tech, Blacksburg, USA
| | | | | | - Zhenyu James Kong
- Department of Industrial and Systems Engineering, Virginia Tech, Blacksburg, USA
| | - Zheng Li
- Department of Mechanical Engineering, Virginia Tech, Blacksburg, USA
| |
Collapse
|
4
|
Papadimitrakis M, Stogiannos M, Sarimveis H, Alexandridis A. Multi-Ship Control and Collision Avoidance Using MPC and RBF-Based Trajectory Predictions. SENSORS 2021; 21:s21216959. [PMID: 34770266 PMCID: PMC8588155 DOI: 10.3390/s21216959] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/03/2021] [Revised: 09/28/2021] [Accepted: 10/16/2021] [Indexed: 11/16/2022]
Abstract
The field of automatic collision avoidance for surface vessels has been an active field of research in recent years, aiming for the decision support of officers in conventional vessels, or for the creation of autonomous vessel controllers. In this paper, the multi-ship control problem is addressed using a model predictive controller (MPC) that makes use of obstacle ship trajectory prediction models built on the RBF framework and is trained on real AIS data sourced from an open-source database. The usage of such sophisticated trajectory prediction models enables the controller to correctly infer the existence of a collision risk and apply evasive control actions in a timely manner, thus accounting for the slow dynamics of a large vessel, such as container ships, and enhancing the cooperation between controlled vessels. The proposed method is evaluated on a real-life case from the Miami port area, and its generated trajectories are assessed in terms of safety, economy, and COLREG compliance by comparison with an identical MPC controller utilizing straight-line predictions for the obstacle vessel.
Collapse
Affiliation(s)
- Myron Papadimitrakis
- Department of Electrical and Electronic Engineering, University of West Attica, 12241 Aigaleo, Greece; (M.P.); (M.S.)
| | - Marios Stogiannos
- Department of Electrical and Electronic Engineering, University of West Attica, 12241 Aigaleo, Greece; (M.P.); (M.S.)
| | - Haralambos Sarimveis
- School of Chemical Engineering, National Technical University of Athens, 15780 Zografou, Greece;
| | - Alex Alexandridis
- Department of Electrical and Electronic Engineering, University of West Attica, 12241 Aigaleo, Greece; (M.P.); (M.S.)
- Correspondence: ; Tel.: +30-210-5381571
| |
Collapse
|
5
|
Dodhia A, Wu Z, Christofides PD. Machine learning-based model predictive control of diffusion-reaction processes. Chem Eng Res Des 2021. [DOI: 10.1016/j.cherd.2021.07.005] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/21/2023]
|
6
|
Statistical Machine Learning in Model Predictive Control of Nonlinear Processes. MATHEMATICS 2021. [DOI: 10.3390/math9161912] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/30/2022]
Abstract
Recurrent neural networks (RNNs) have been widely used to model nonlinear dynamic systems using time-series data. While the training error of neural networks can be rendered sufficiently small in many cases, there is a lack of a general framework to guide construction and determine the generalization accuracy of RNN models to be used in model predictive control systems. In this work, we employ statistical machine learning theory to develop a methodological framework of generalization error bounds for RNNs. The RNN models are then utilized to predict state evolution in model predictive controllers (MPC), under which closed-loop stability is established in a probabilistic manner. A nonlinear chemical process example is used to investigate the impact of training sample size, RNN depth, width, and input time length on the generalization error, along with the analyses of probabilistic closed-loop stability through the closed-loop simulations under Lyapunov-based MPC.
Collapse
|
7
|
Wang G, Jia QS, Qiao J, Bi J, Zhou M. Deep Learning-Based Model Predictive Control for Continuous Stirred-Tank Reactor System. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2021; 32:3643-3652. [PMID: 32903185 DOI: 10.1109/tnnls.2020.3015869] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
A continuous stirred-tank reactor (CSTR) system is widely applied in wastewater treatment processes. Its control is a challenging industrial-process-control problem due to great difficulty to achieve accurate system identification. This work proposes a deep learning-based model predictive control (DeepMPC) to model and control the CSTR system. The proposed DeepMPC consists of a growing deep belief network (GDBN) and an optimal controller. First, GDBN can automatically determine its size with transfer learning to achieve high performance in system identification, and it serves just as a predictive model of a controlled system. The model can accurately approximate the dynamics of the controlled system with a uniformly ultimately bounded error. Second, quadratic optimization is conducted to obtain an optimal controller. This work analyzes the convergence and stability of DeepMPC. Finally, the DeepMPC is used to model and control a second-order CSTR system. In the experiments, DeepMPC shows a better performance in modeling, tracking, and antidisturbance than the other state-of-the-art methods.
Collapse
|
8
|
|
9
|
Abdelrahim EM. Binary particle swarm optimization-based T-S fuzzy predictive controller for nonlinear automotive application. Neural Comput Appl 2021. [DOI: 10.1007/s00521-020-05132-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
10
|
Cao W, Yang Q. Online sequential extreme learning machine based adaptive control for wastewater treatment plant. Neurocomputing 2020. [DOI: 10.1016/j.neucom.2019.05.109] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
|
11
|
Ferdaus MM, Pratama M, Anavatti SG, Garratt MA, Lughofer E. PAC: A novel self-adaptive neuro-fuzzy controller for micro aerial vehicles. Inf Sci (N Y) 2020. [DOI: 10.1016/j.ins.2019.10.001] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
|
12
|
Wu Z, Tran A, Rincon D, Christofides PD. Machine learning‐based predictive control of nonlinear processes. Part I: Theory. AIChE J 2019. [DOI: 10.1002/aic.16729] [Citation(s) in RCA: 33] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
Affiliation(s)
- Zhe Wu
- Department of Chemical and Biomolecular Engineering University of California Los Angeles California
| | - Anh Tran
- Department of Chemical and Biomolecular Engineering University of California Los Angeles California
| | - David Rincon
- Department of Chemical and Biomolecular Engineering University of California Los Angeles California
| | - Panagiotis D. Christofides
- Department of Chemical and Biomolecular Engineering University of California Los Angeles California
- Department of Electrical and Computer Engineering University of California Los Angeles California
| |
Collapse
|
13
|
Han H, Wu X, Zhang L, Tian Y, Qiao J. Self-Organizing RBF Neural Network Using an Adaptive Gradient Multiobjective Particle Swarm Optimization. IEEE TRANSACTIONS ON CYBERNETICS 2019; 49:69-82. [PMID: 29990097 DOI: 10.1109/tcyb.2017.2764744] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
One of the major obstacles in using radial basis function (RBF) neural networks is the convergence toward local minima instead of the global minima. For this reason, an adaptive gradient multiobjective particle swarm optimization (AGMOPSO) algorithm is designed to optimize both the structure and parameters of RBF neural networks in this paper. First, the AGMOPSO algorithm, based on a multiobjective gradient method and a self-adaptive flight parameters mechanism, is developed to improve the computation performance. Second, the AGMOPSO-based self-organizing RBF neural network (AGMOPSO-SORBF) can optimize the parameters (centers, widths, and weights), as well as determine the network size. The goal of AGMOPSO-SORBF is to find a tradeoff between the accuracy and the complexity of RBF neural networks. Third, the convergence analysis of AGMOPSO-SORBF is detailed to ensure the prerequisite of any successful applications. Finally, the merits of our proposed approach are verified on multiple numerical examples. The results indicate that the proposed AGMOPSO-SORBF achieves much better generalization capability and compact network structure than some other existing methods.
Collapse
|
14
|
Adaptive lasso echo state network based on modified Bayesian information criterion for nonlinear system modeling. Neural Comput Appl 2018. [DOI: 10.1007/s00521-018-3420-6] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
|
15
|
Han HG, Lu W, Hou Y, Qiao JF. An Adaptive-PSO-Based Self-Organizing RBF Neural Network. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2018; 29:104-117. [PMID: 28113788 DOI: 10.1109/tnnls.2016.2616413] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
In this paper, a self-organizing radial basis function (SORBF) neural network is designed to improve both accuracy and parsimony with the aid of adaptive particle swarm optimization (APSO). In the proposed APSO algorithm, to avoid being trapped into local optimal values, a nonlinear regressive function is developed to adjust the inertia weight. Furthermore, the APSO algorithm can optimize both the network size and the parameters of an RBF neural network simultaneously. As a result, the proposed APSO-SORBF neural network can effectively generate a network model with a compact structure and high accuracy. Moreover, the analysis of convergence is given to guarantee the successful application of the APSO-SORBF neural network. Finally, multiple numerical examples are presented to illustrate the effectiveness of the proposed APSO-SORBF neural network. The results demonstrate that the proposed method is more competitive in solving nonlinear problems than some other existing SORBF neural networks.
Collapse
|
16
|
Jia ZJ, Song YD. Barrier Function-Based Neural Adaptive Control With Locally Weighted Learning and Finite Neuron Self-Growing Strategy. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2017; 28:1439-1451. [PMID: 28534753 DOI: 10.1109/tnnls.2016.2551294] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
This paper presents a new approach to construct neural adaptive control for uncertain nonaffine systems. By integrating locally weighted learning with barrier Lyapunov function (BLF), a novel control design method is presented to systematically address the two critical issues in neural network (NN) control field: one is how to fulfill the compact set precondition for NN approximation, and the other is how to use varying rather than a fixed NN structure to improve the functionality of NN control. A BLF is exploited to ensure the NN inputs to remain bounded during the entire system operation. To account for system nonlinearities, a neuron self-growing strategy is proposed to guide the process for adding new neurons to the system, resulting in a self-adjustable NN structure for better learning capabilities. It is shown that the number of neurons needed to accomplish the control task is finite, and better performance can be obtained with less number of neurons as compared with traditional methods. The salient feature of the proposed method also lies in the continuity of the control action everywhere. Furthermore, the resulting control action is smooth almost everywhere except for a few time instants at which new neurons are added. Numerical example illustrates the effectiveness of the proposed approach.
Collapse
|
17
|
Development of adaptive p-step RBF network model with recursive orthogonal least squares training. Neural Comput Appl 2016. [DOI: 10.1007/s00521-016-2669-x] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
18
|
Li F, Qiao J, Han H, Yang C. A self-organizing cascade neural network with random weights for nonlinear system modeling. Appl Soft Comput 2016. [DOI: 10.1016/j.asoc.2016.01.028] [Citation(s) in RCA: 53] [Impact Index Per Article: 5.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
19
|
Li Z, Xia Y, Wang D, Zhai DH, Su CY, Zhao X. Neural Network-Based Control of Networked Trilateral Teleoperation With Geometrically Unknown Constraints. IEEE TRANSACTIONS ON CYBERNETICS 2016; 46:1051-1064. [PMID: 25956001 DOI: 10.1109/tcyb.2015.2422785] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2023]
Abstract
Most studies on bilateral teleoperation assume known system kinematics and only consider dynamical uncertainties. However, many practical applications involve tasks with both kinematics and dynamics uncertainties. In this paper, trilateral teleoperation systems with dual-master-single-slave framework are investigated, where a single robotic manipulator constrained by an unknown geometrical environment is controlled by dual masters. The network delay in the teleoperation system is modeled as Markov chain-based stochastic delay, then asymmetric stochastic time-varying delays, kinematics and dynamics uncertainties are all considered in the force-motion control design. First, a unified dynamical model is introduced by incorporating unknown environmental constraints. Then, by exact identification of constraint Jacobian matrix, adaptive neural network approximation method is employed, and the motion/force synchronization with time delays are achieved without persistency of excitation condition. The neural networks and parameter adaptive mechanism are combined to deal with the system uncertainties and unknown kinematics. It is shown that the system is stable with the strict linear matrix inequality-based controllers. Finally, the extensive simulation experiment studies are provided to demonstrate the performance of the proposed approach.
Collapse
|
20
|
Han HG, Zhang L, Hou Y, Qiao JF. Nonlinear Model Predictive Control Based on a Self-Organizing Recurrent Neural Network. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2016; 27:402-415. [PMID: 26336152 DOI: 10.1109/tnnls.2015.2465174] [Citation(s) in RCA: 45] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
A nonlinear model predictive control (NMPC) scheme is developed in this paper based on a self-organizing recurrent radial basis function (SR-RBF) neural network, whose structure and parameters are adjusted concurrently in the training process. The proposed SR-RBF neural network is represented in a general nonlinear form for predicting the future dynamic behaviors of nonlinear systems. To improve the modeling accuracy, a spiking-based growing and pruning algorithm and an adaptive learning algorithm are developed to tune the structure and parameters of the SR-RBF neural network, respectively. Meanwhile, for the control problem, an improved gradient method is utilized for the solution of the optimization problem in NMPC. The stability of the resulting control system is proved based on the Lyapunov stability theory. Finally, the proposed SR-RBF neural network-based NMPC (SR-RBF-NMPC) is used to control the dissolved oxygen (DO) concentration in a wastewater treatment process (WWTP). Comparisons with other existing methods demonstrate that the SR-RBF-NMPC can achieve a considerably better model fitting for WWTP and a better control performance for DO concentration.
Collapse
|
21
|
Huang HC, Chiang CH. An Evolutionary Radial Basis Function Neural Network with Robust Genetic-Based Immunecomputing for Online Tracking Control of Autonomous Robots. Neural Process Lett 2015. [DOI: 10.1007/s11063-015-9452-3] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
22
|
Constrained Fuzzy Predictive Control Using Particle Swarm Optimization. APPLIED COMPUTATIONAL INTELLIGENCE AND SOFT COMPUTING 2015. [DOI: 10.1155/2015/437943] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
Abstract
A fuzzy predictive controller using particle swarm optimization (PSO) approach is proposed. The aim is to develop an efficient algorithm that is able to handle the relatively complex optimization problem with minimal computational time. This can be achieved using reduced population size and small number of iterations. In this algorithm, instead of using the uniform distribution as in the conventional PSO algorithm, the initial particles positions are distributed according to the normal distribution law, within the area around the best position. The radius limiting this area is adaptively changed according to the tracking error values. Moreover, the choice of the initial best position is based on prior knowledge about the search space landscape and the fact that in most practical applications the dynamic optimization problem changes are gradual. The efficiency of the proposed control algorithm is evaluated by considering the control of the model of a 4 × 4 Multi-Input Multi-Output industrial boiler. This model is characterized by being nonlinear with high interactions between its inputs and outputs, having a nonminimum phase behaviour, and containing instabilities and time delays. The obtained results are compared to those of the control algorithms based on the conventional PSO and the linear approach.
Collapse
|