Adaptive Iterative Learning Control for Linear Systems With Binary-Valued Observations

Adaptive fuzzy iterative learning control based neurostimulation system and in-silico evaluation

Closed-loop neural stimulation has been an effective treatment for epilepsy patients. Currently, most closed-loop neural stimulation strategies are designed based on accurate neural models. However, the uncertainty and complexity of the neural system make it difficult to build an accurate neural model, which poses a significant challenge to the design of the controller. This paper proposes an Adaptive Fuzzy Iterative Learning Control (AFILC) framework for closed-loop neural stimulation, which can realize neuromodulation with no model or model uncertainty. Recognizing the periodic characteristics of neural stimulation and neuronal firing, Iterative Learning Control (ILC) is employed as the primary controller. Furthermore, a fuzzy optimization module is established to update the internal parameters of the ILC controller in real-time. This module enhances the anti-interference ability of the control system and reduces the influence of initial controller parameters on the control process. The efficacy of this strategy is evaluated using a neural computational model. The simulation results validate the capability of the AFILC strategy to suppress epileptic states. Compared with ILC-based closed-loop neurostimulation schemes, the AFILC-based neurostimulation strategy has faster convergence speed and stronger anti-interference ability. Moreover, the control algorithm is implemented based on a digital signal processor, and the hardware-in-the-loop experimental platform is implemented. The experimental results show that the control method has good control performance and computational efficiency, which provides the possibility for future application in clinical research.

A Novel Accelerated Multistage Learning Control Mechanism via Virtual Performance Reduction

This study uses a multistage learning mechanism concept to investigate the accelerated learning control for stochastic systems. In this mechanism, the learning iterations are divided into successive stages, with each stage comprising several iterations. The learning gain is constant in each stage to accelerate the learning process and decreases it from one stage to another to eliminate the noise effect asymptotically. The critical issue is determining the switching iteration when a new stage starts. This study resolves this issue by calculating a virtual performance index of the mean-squared input error and its estimated upper bound. Specifically, the ideal, practical, and improved multistage learning control schemes are proposed to determine the switching iteration and generate the learning gain sequence. The ideal scheme achieves the best performance at the cost of a large computation burden, and the practical scheme saves computation cost, but the performance is not excellent. The improved scheme significantly approximates the best performance by introducing additional stretching parameters to the performance index. Illustrative simulations are provided to verify the theoretical results.

A survey of methods for handling initial state shifts in iterative learning control

This paper introduces three types of controllers: a PID-type iterative learning controller, an adaptive iterative learning controller, and an optimal iterative learning controller, and reviews the history and research status of initial shifts rectifying algorithms. Initial state shifts have attracted research attention because they affect both the tracking performance and system stability. This study focuses on the current common initial shifts rectifying methods and analyzes the underlying mechanism in detail. To verify the effectiveness of the presented initial shifts rectifying algorithms, we simulated those using ideal first- and second-order systems. Finally, directions for the future development of iterative learning control (ILC) and some challenging topics related to initial shifts rectifying for ILC are presented. This article aims to introduce recent developments and advances in initial shifts rectifying algorithms and discuss the directions for their further exploration.

Backstepping Technology-Based Adaptive Boundary ILC for an Input-Output-Constrained Flexible Beam

This article focuses on vibration suppression of an Euler-Bernoulli beam which is subject to external disturbance. By integrating backstepping technique, an adaptive boundary iterative learning control (ABILC) is put forward to suppressing vibration. The adaptive law is proposed for handing the parameter uncertainty and the iterative learning term is designed to deal with periodic disturbance. An auxiliary system is utilized to compensate the effect of input nonlinearity. In addition, a barrier Lyapunov function is adopted to deal with asymmetric output constraint. With the proposed control strategy, the stability of the closed-loop system is proven based on rigorous Lyapunov analysis. In the end, the effectiveness of the proposed control is illustrated through numerical simulation results.

Iterative learning control for piecewise arc path tracking with validation on a gantry robot manufacturing platform

The piecewise arc path tracking problem is a common feature of manufacturing systems operating in a repetitive mode, e.g. assembly production lines. Here, the system end-effector must follow a spatial path without any specific temporal tracking constraints, which makes the temporal profile not fixed a priori. The technique of iterative learning control (ILC) is well-suited to handle this problem, since compared to classical feedback control methods, ILC is capable of learning from previous trial information to minimize the tracking error over repeated trials. This paper extends the ILC task description to address piecewise arc path tracking tasks, and further formulates a more general design framework than existing spatial ILC approaches. A comprehensive ILC algorithm is designed to handle this class of piecewise arc path tracking problems, and practical implementation instructions are provided. Validation is conducted on a gantry robot manufacturing testbed to confirm its feasibility and efficiency in practice with a comparison to existing methods showing its higher path tracking accuracy.

A Probabilistically Quantized Learning Control Framework for Networked Linear Systems

In this article, we consider quantized learning control for linear networked systems with additive channel noise. Our objective is to achieve high tracking performance while reducing the communication burden on the communication network. To address this problem, we propose an integrated framework consisting of two modules: a probabilistic quantizer and a learning scheme. The employed probabilistic quantizer is developed by employing a Bernoulli distribution driven by the quantization errors. Three learning control schemes are studied, namely, a constant gain, a decreasing gain sequence satisfying certain conditions, and an optimal gain sequence that is recursively generated based on a performance index. We show that the control with a constant gain can only ensure the input error sequence to converge to a bounded sphere in a mean-square sense, where the radius of this sphere is proportional to the constant gain. On the contrary, we show that the control that employs any of the two proposed gain sequences drives the input error to zero in the mean-square sense. In addition, we show that the convergence rate associated with the constant gain is exponential, whereas the rate associated with the proposed gain sequences is not faster than a specific exponential trend. Illustrative simulations are provided to demonstrate the convergence rate properties and steady-state tracking performance associated with each gain, and their robustness against modeling uncertainties.

Iterative Learning Control for Output Tracking of Nonlinear Systems With Unavailable State Information

This work presents a novel design framework of adaptive iterative learning control (ILC) approach for a class of uncertain nonlinear systems. By using the closed-loop reference model that can be viewed as an observer, the proposed adaptive ILC approach can be adapted to deal with the output tracking problem of nonlinear systems with unavailable system states. In the systems considered, two classes of uncertainties are taken into account, including parametric input disturbances and input distribution uncertainties. To facilitate the controller design and convergence analysis, the composite energy function (CEF) methodology is employed. The design framework in this brief is novel and widely applicable, which extends the CEF-based ILC approach to output tracking control of nonlinear systems without requiring full knowledge of state information and complicated observer design process. To show the effectiveness of the proposed design framework and control algorithms, two numerical examples are illustrated.

The Convergence of Data-Driven Optimal Iterative Learning Control for Linear Multi-Phase Batch Processes

For multi-phase batch processes with different dimensions whose dynamics can be described as a linear discrete-time-invariant system in each phase, a data-driven optimal ILC was explored using multi-operation input and output data that subordinate a tracking performance criterion. An iterative learning identification was constructed to estimate the system Markov parameters by minimizing the evaluation criterion that consists of the residual of the real outputs from the predicted outputs and two adjacent identifications. Meanwhile, the estimated Markov parameters matrix was embedded into the learning control process in the form of an interaction. By virtue of inner product theory, the monotonic descent of the estimation error was derived, which does not restrict the weighting factor at all. Furthermore, algebraic derivation demonstrates that the tracking is strictly monotonically convergent if the estimation error falls within an appropriate domain. Numerical simulations were carried out to illustrate the validity and the effectiveness of the proposed method.

Accelerated Learning Control for Point-to-Point Tracking Systems

In this study, we investigate the accelerated learning control schemes for point-to-point tracking systems (PTSs) with measurement noise. The asymptotic convergence of the generated input sequence has been a long-standing open issue for point-to-point tracking problems because there are infinite possible input candidates that can drive the system dynamics to track the desired reference at specified time instants. An accelerated gradient algorithm and its generalized version with a novel direction regulation matrix are proposed, with the learning gain is adaptively triggered by the practical tracking errors. The learning gain remains constant at the early stage and begins to decrease after a certain number of iterations. The input sequence generated by the proposed scheme converges to a specified limit for any fixed initial input, with the limit being closest to the initial input, in a certain sense. Numerical simulations are provided to verify the theoretical results.

Zero-Error Tracking Control Under Unified Quantized Iterative Learning Framework via Encoding-Decoding Method

This article considers the zero-error tracking problem of quantized iterative learning control for a general networked structure where the data are quantized and transmitted through limited communication channels at both measurement and actuator sides. An encoding and decoding mechanism is introduced into a simple uniform quantizer. The system output is first encoded and quantized and then transmitted to the controller. When the data are received, they are decoded and applied to generate the input for the next iteration. After that, the generated input is transmitted following the same procedure as the output transmission, that is, encoding, quantizing, transmitting, and decoding. For this learning tracking framework, the asymptotic zero-error tracking performance is strictly proved for both infinite- and finite-level uniform quantizers. For practical implementation, a promising selection of the scaling sequences and the associated quantization level for the finite-level case is explicitly defined. Simulations are provided to demonstrate the effectiveness of the proposed schemes.

Learning Tracking Over Unknown Fading Channels Based on Iterative Estimation

With fast developments in communication technologies, a large number of practical systems adopt the networked control structure. For this structure, the fading problem is an emerging issue among other network problems. It has not been extensively investigated how to guarantee superior control performance in the presence of unknown fading channels. This article presents a learning strategy for gradually improving the tracking performance. To this end, an iterative estimation mechanism is first introduced to provide necessary statistical information such that the biased signals after transmission can be corrected before being utilized. Then, learning control algorithms incorporating with a decreasing step-size sequence are designed for both output and input fading cases. The convergence in both mean-square and almost-sure senses of the proposed schemes is strictly proved under mild conditions. Illustrative simulations verify the effectiveness of the entire learning framework.

Neural-Network-Based Iterative Learning Control for Multiple Tasks

Iterative learning control (ILC) can synthesize the feedforward control signal for the trajectory tracking control of a repetitive task, even when the system has strong nonlinear dynamics. This makes ILC be one of the most popular methods for trajectory tracking control. Restriction on a repetitive task, however, limits its application to multiple trajectories. This article proposes a neural-network-based ILC (NN-ILC) to deal with nonrepetitive tasks very effectively. A position-based ILC is designed to compensate the tracking error, based on which the multiple outputs of the ILC (ILC outputs) for multiple tasks are expressed as a function of the reference position, velocity, and acceleration. The proposed NN-ILC divides the ILC outputs of multiple tasks into two parts: the linear and nonlinear portions. The first part is expressed by a linear function, which is the linear portion of the function of the ILC outputs. The second part is expressed by a nonlinear function, which is estimated by complementary neural networks including a general neural network and a switching neural network. Finally, the two parts are combined and the ILC outputs of multiple tasks are expressed as a neural-network-based function. Two advantages of the proposed NN-ILC are emphasized. First, the ILC outputs of multiple tasks are compressed into a function by the proposed method, and thus, the memories can be saved. Second, in terms of generalizability, the neural-network-based function of the ILC outputs can easily predict position compensation for multiple tasks without extra iterative learning processes. Experimental results on a robot arm show that the proposed NN-ILC method can easily realize the ILC of multiple tasks. It can save memory comparing with the method of storing the data of multiple tasks and can predict the ILC output of any task, which can accelerate the iterative learning process.

Convergence Analysis of Robust Iterative Learning Control Against Nonrepetitive Uncertainties: System Equivalence Transformation

This article is concerned with the robust convergence analysis of iterative learning control (ILC) against nonrepetitive uncertainties, where the contradiction between convergence conditions for the output tracking error and the input signal (or error) is addressed. A system equivalence transformation (SET) is proposed for robust ILC such that given any desired reference trajectories, the output tracking problems for general nonsquare multi-input, multi-output (MIMO) systems can be equivalently transformed into those for the specific class of square MIMO systems with the same input and output numbers. As a benefit of SET, a unified condition is only needed to guarantee both the uniform boundedness of all system signals and the robust convergence of the output tracking error, which avoids causing the condition contradiction problem in implementing the double-dynamics analysis approach to ILC. Simulation examples are included to demonstrate the validity of our established robust ILC results.

Iterative Learning Model Predictive Control Based on Iterative Data-Driven Modeling

Iterative learning model predictive control (ILMPC) has been recognized as an effective approach to realize high-precision tracking for batch processes with repetitive nature because of its excellent learning ability and closed-loop stability property. However, as a model-based strategy, ILMPC suffers from the unavailability of accurate first principal model in many complex nonlinear batch systems. On account of the abundant process data, nonlinear dynamics of batch systems can be identified precisely along the trials by neural network (NN), making it enforceable to design a data-driven ILMPC. In this article, by using a control-affine feedforward neural network (CAFNN), the features in the process data of the former batch are extracted to form a nonlinear affine model for the controller design in the current batch. Based on the CAFNN model, the ILMPC is formulated in a tube framework to attenuate the influence of modeling errors and track the reference trajectory with sustained accuracy. Due to the control-affine structure, the gradients of the objective function can be analytically computed offline, so as to improve the online computational efficiency and optimization feasibility of the tube ILMPC. The robust stability and the convergence of the data-driven ILMPC system are analyzed theoretically. The simulation on a typical batch reactor verifies the effectiveness of the proposed control method.

Multilayered Sampled-Data Iterative Learning Tracking for Discrete Systems With Cooperative-Antagonistic Interactions

The tracking for discrete systems is discussed by designing two kinds of multilayered iterative learning schemes with cooperative-antagonistic interactions in this paper. The definition of the signed graph is presented and iterative learning schemes are then designed to be multilayered and have cooperative-antagonistic interactions. Moreover, considering the limited bandwidth of information storage, the state information of these controllers is updated in light of previous learning iterations but not just dependent on the last iteration. Two simple criteria are addressed to discuss the tracking of discrete systems with multilayered and cooperative-antagonistic iterative schemes. The simulation results are shown to demonstrate the validity of the given criteria.

Convergence Analysis of Saturated Iterative Learning Control Systems With Locally Lipschitz Nonlinearities

In this article, the robust trajectory tracking problem of iterative learning control (ILC) for uncertain nonlinear systems is considered, and the effects from locally Lipschitz nonlinearities, input saturations, and nonzero system relative degrees are treated. A saturated ILC algorithm is given, with the convergence analysis exploited using a composite energy function-based approach. It is shown that the tracking error can be guaranteed to converge both pointwisely and uniformly. Furthermore, the input updating signal can be ensured to eventually satisfy the input saturation requirements with increasing iterations. Two examples are given to demonstrate the validity of saturated ILC for systems with the relative degree of one, input saturation, and locally Lipschitz nonlinearity.

Fractional-order modeling of lithium-ion batteries using additive noise assisted modeling and correlative information criterion

•

Present an integrative modeling method regarding structure, parameters and states.

•

Parameterization by using online/offline EIS and iterative learning optimization.

•

Introduce 1/f noise to reveal correlations among parameters and eigen-voltages.

•

Provide the correlative information criterion to evaluate various battery models.

•

Present the strong negative correlation of ohmic resistance and state of health.

In this paper, the fractional-order modeling of multiple groups of lithium-ion batteries with different states is discussed referring to electrochemical impedance spectroscopy (EIS) analysis and iterative learning identification method. The structure and parameters of the presented fractional-order equivalent circuit model (FO-ECM) are determined by EIS from electrochemical test. Based on the working condition test, a P-type iterative learning algorithm is applied to optimize certain selected model parameters in FO-ECM affected by polarization effect. What’s more, considering the reliability of structure and adaptiveness of parameters in FO-ECM, a pre-tested nondestructive 1/f noise is superimposed to the input current, and the correlative information criterion (CIC) is proposed by means of multiple correlations of each parameter and confidence eigen-voltages from weighted co-expression network analysis method. The tested batteries with different state of health (SOH) can be successfully simulated by FO-ECM with rarely need of calibration when excluding polarization effect. Particularly, the small value of CICα indicates that the fractional-order α is constant over time for the purpose of SOH estimation. Meanwhile, the time-varying ohmic resistance R0 in FO-ECM can be regarded as a wind vane of SOH due to the large value of CICR0. The above analytically found parameter-state relations are highly consistent with the existing literature and empirical conclusions, which indicates the broad application prospects of this paper.

Echo State Network-Based Backstepping Adaptive Iterative Learning Control for Strict-Feedback Systems: An Error-Tracking Approach

In this article, an echo state network (ESN)-based backstepping adaptive iterative learning control scheme is proposed for nonlinear strict-feedback systems performing the same operation repeatedly over a finite-time interval. Different from most of the output tracking approaches, an error-tracking approach is presented using the backstepping technique, such that the tracking error can follow a prespecified error trajectory without any requirement on the initial value of system states. Then, a novel Lyapunov function is constructed to deal with the unknown state-dependent gain function of the controller design. The uncertain nonlinearities are approximated by employing ESNs with simple feedback structures, and the weight update laws are developed by combining the parameter adaptation in the time domain and iteration domain. Moreover, the proposed control scheme is further extended to handle the strict-feedback systems with input saturations. Through the Lyapunov-like synthesis, the closed-loop stability and error convergence of the proposed error-tracking control scheme are analyzed in the presence of the approximation errors. Numerical simulations are provided to verify the effectiveness of the proposed scheme.

RBFNN-Based Data-Driven Predictive Iterative Learning Control for Nonaffine Nonlinear Systems

In this paper, a novel data-driven predictive iterative learning control (DDPILC) scheme based on a radial basis function neural network (RBFNN) is proposed for a class of repeatable nonaffine nonlinear discrete-time systems subjected to nonrepetitive external disturbances. First, by utilizing the dynamic linearization technique (DLT) with a newly introduced and unknown system parameter pseudopartial derivative (PPD) and designing a new RBFNN estimation algorithm along the iterative learning axis for addressing the unknown PPD and the unknown nonrepetitive external disturbances, a data-driven prediction model is established. It is theoretically shown that by constructing a composite energy function (CEF) with respect to the modeling error for the first time, the convergence of the modeling error via the proposed DLT-based RBFNN modeling method can be guaranteed, and the convergence speed is tunable. Then, a DDPILC with a disturbance compensation term is designed, and the convergence of the tracking control error is analyzed. Finally, simulations of a train operation system reveal that even if the train suffers from randomly varying load disturbances and nonlinear running resistance, the proposed scheme can make both the modeling error and the tracking control error decrease successively with increasing operation number.

Performance Enhancement of Learning Tracking Systems Over Fading Channels With Multiplicative and Additive Randomness

This paper applies learning control to repetitive systems over fading channels at both output and input sides to improve tracking performance without applying restrictive fading conditions. Both multiplicative and additive randomness of the fading channel are addressed, and the effects of fading communication on the data are carefully analyzed. A decreasing gain sequence and a moving-average operator are introduced to modify the generic learning control algorithm to reduce the fading effect and improve control system performance. Results reveal that the tracking error converges to zero in the mean-square sense as the iteration number increases. Illustrative simulations are presented to verify the theoretical results.

HONN-Based Adaptive ILC for Pure-Feedback Nonaffine Discrete-Time Systems With Unknown Control Directions

Nearly all adaptive control techniques require that the control directions of dynamical systems are known in advance. In this paper, for a class of pure-feedback nonaffine discrete-time systems with unknown control directions (UCDs), a high-order neural network (HONN)-based adaptive iterative learning control (ILC) approach is presented to address a repetitive tracking control issue. The implicit function theorem is adopted to cope with the difficulty resulting from the nonaffine structure of control input. Employing a discrete Nussbaum-type function in the neural network weight adaptation law to suit the UCD, an HONN is used to iteratively estimate the ideal control signals. In addition, a novel dead-zone method is developed in the HONN-based adaptive ILC algorithm to enhance its robustness against nonrepetitive desired trajectories and random uncertainties in iterative initial errors and external disturbance. Consequently, the system output, except at the initial n time instants, is demonstrated to asymptotically converge to an adjustable range of the desired trajectory along the iteration axis, while all of the system signals remain bounded during the entire ILC process. Two simulation examples show the feasibility of the adaptive ILC approach.

Fault Tolerant Nonrepetitive Trajectory Tracking for MIMO Output Constrained Nonlinear Systems Using Iterative Learning Control

Most works on iterative learning control (ILC) assume identical reference trajectories for the system state over the iteration domain. This fundamental assumption may not always hold in practice, where the desired trajectories or control objectives may be iteration dependent. In this paper, we relax this fundamental assumption, by introducing a new way of modifying the reference trajectories. The concept of modifier functions has been introduced for the first time in the ILC literature. This proposed approach is also a unified framework that can handle other common types of initial conditions in ILC. Multi-input multi-output nonlinear systems are considered, which can be subject to the actuator faults. Time and iteration dependent constraint requirements on the system output can be effectively handled. Backstepping design and composite energy function approach are used in the analysis. We show that in the closed loop analysis, the proposed control scheme can guarantee uniform convergence on the full state tracking error over the iteration domain, beyond a small initial time interval in each iteration, while the constraint requirements on the system output are never violated. In the end two simulation examples are shown to illustrate the efficacy of the proposed ILC algorithm.

Convergence Conditions for Solving Robust Iterative Learning Control Problems Under Nonrepetitive Model Uncertainties

Learning from saved measurement and control data to refine the performance of output tracking is the core feature of iterative learning control (ILC). Even though this implementation process of ILC does not need any model knowledge, ILC typically requires the strict repetitiveness of the control systems, especially on the plant models of them. The questions of interest in this paper are: 1) whether and how can robust ILC problems be solved with respect to the nonrepetitive (or iteration-dependent) model uncertainties and 2) can convergence conditions be developed with the effective contraction mapping (CM)-based approach to ILC? The answers to these questions are affirmative, and the CM-based approach is applicable to robust ILC that accommodates certain nonrepetitive uncertainties, especially in the plant models. In particular, an H_∞ -norm condition is proposed to ensure the robust ILC convergence, which can be solved to determine learning gain matrices. Simulation tests are performed to illustrate the validity of our presented H_∞ -based analysis results.

Adaptive Learning Control for Nonlinear Systems With Randomly Varying Iteration Lengths

This paper proposes adaptive iterative learning control (ILC) schemes for continuous-time parametric nonlinear systems with iteration lengths that randomly vary. As opposed to the existing ILC works that feature nonuniform trial lengths, this paper is applicable to nonlinear systems that do not satisfy the globally Lipschitz continuous condition. In addition, this paper introduces a novel composite energy function based on newly defined virtual tracking error information for proving the asymptotical convergence. Both an original update algorithm and a projection-based update algorithm for estimating the unknown parameters are proposed. Extensions to cases with unknown input gains, iteration-varying tracking references, nonparametric uncertainty, high-order nonlinear systems, and multi-input-multi-output systems are all elaborated upon. Illustrative simulations are provided to verify the theoretical results.

Deterministic Convergence for Learning Control Systems Over Iteration-Dependent Tracking Intervals

This brief addresses the iterative learning control (ILC) problems for discrete-time systems subject to iteration-dependent tracking time intervals. A modified class of P-type ILC algorithms is proposed by properly defining an available modified output, for which robust convergence analysis is performed with an inductive approach. It is shown that if a persistent full-learning property is ensured, then a necessary and sufficient convergence condition of ILC can be derived to reach the perfect output tracking objective though the tracking time interval is iteration-dependent. That is, the tracking of ILC for iteration-dependent time intervals can be guaranteed in the same deterministic (not stochastic) convergence way as that of traditional ILC over a fixed time interval. Furthermore, the developed tracking results can be extended to admit iteration-dependent uncertainties in initial state and external disturbances. Simulation tests are also included to demonstrate the effectiveness of the modified P-type ILC.

Data-Driven Learning Control for Stochastic Nonlinear Systems: Multiple Communication Constraints and Limited Storage

This paper proposes a data-driven learning control method for stochastic nonlinear systems under random communication conditions, including data dropouts, communication delays, and packet transmission disordering. A renewal mechanism is added to the buffer to regulate the arrived packets, and a recognition mechanism is introduced to the controller for the selection of suitable update packets. Both intermittent and successive update schemes are proposed based on the conventional P-type iterative learning control algorithm, and are shown to converge to the desired input with probability one. The convergence and effectiveness of the proposed algorithms are verified by means of illustrative simulations.