MACOP modular architecture with control primitives

Controlling chaotic maps using next-generation reservoir computing

In this work, we combine nonlinear system control techniques with next-generation reservoir computing, a best-in-class machine learning approach for predicting the behavior of dynamical systems. We demonstrate the performance of the controller in a series of control tasks for the chaotic Hénon map, including controlling the system between unstable fixed points, stabilizing the system to higher order periodic orbits, and to an arbitrary desired state. We show that our controller succeeds in these tasks, requires only ten data points for training, can control the system to a desired trajectory in a single iteration, and is robust to noise and modeling error.

How does the CNS control arm reaching movements? Introducing a hierarchical nonlinear predictive control organization based on the idea of muscle synergies

In this study, we introduce a hierarchical and modular computational model to explain how the CNS (Central Nervous System) controls arm reaching movement (ARM) in the frontal plane and under different conditions. The proposed hierarchical organization was established at three levels: 1) motor planning, 2) command production, and 3) motor execution. Since in this work we are not discussing motion learning, no learning procedure was considered in the model. Previous models mainly assume that the motor planning level produces the desired trajectories of the joints and feeds it to the next level to be tracked. In the proposed model, the motion control is described based on a regulatory control policy, that is, the output of the motor planning level is a step function defining the initial and final desired position of the hand. For the command production level, a nonlinear predictive model was developed to explain how the time-invariant muscle synergies (MSs) are recruited. We used the same computational model to explain the arm reaching motion for a combined ARM task. The combined ARM is defined as two successive ARM such that it starts from point A and reaches to point C via point B. To develop the model, kinematic and kinetic data from six subjects were recorded and analyzed during ARM task performance. The subjects used a robotic manipulator while moving their hand in the frontal plane. The EMG data of 15 muscles were also recorded. The MSs used in the model were extracted from the recorded EMG data. The proposed model explains two aspects of the motor control system by a novel computational approach: 1) the CNS reduces the dimension of the control space using the notion of MSs and thereby, avoids immense computational loads; 2) at the level of motor planning, the CNS generates the desired position of the hand at the starting, via and the final points, and this amounts to a regulatory and non-tracking structure.

On learning navigation behaviors for small mobile robots with reservoir computing architectures

This paper proposes a general reservoir computing (RC) learning framework that can be used to learn navigation behaviors for mobile robots in simple and complex unknown partially observable environments. RC provides an efficient way to train recurrent neural networks by letting the recurrent part of the network (called reservoir) be fixed while only a linear readout output layer is trained. The proposed RC framework builds upon the notion of navigation attractor or behavior that can be embedded in the high-dimensional space of the reservoir after learning. The learning of multiple behaviors is possible because the dynamic robot behavior, consisting of a sensory-motor sequence, can be linearly discriminated in the high-dimensional nonlinear space of the dynamic reservoir. Three learning approaches for navigation behaviors are shown in this paper. The first approach learns multiple behaviors based on the examples of navigation behaviors generated by a supervisor, while the second approach learns goal-directed navigation behaviors based only on rewards. The third approach learns complex goal-directed behaviors, in a supervised way, using a hierarchical architecture whose internal predictions of contextual switches guide the sequence of basic navigation behaviors toward the goal.