Establishing metrics and control laws for the learning process: ball and beam balancing

Predictive Strategies for the Control of Complex Motor Skills: Recent Insights into Individual and Joint Actions

Humans perform exquisite sensorimotor skills, both individually and in teams, from athletes performing rhythmic gymnastics to everyday tasks like carrying a cup of coffee. The "predictive brain" framework suggests that mastering these skills relies on predictive mechanisms, raising the question of how we deploy predictions for real-time control and coordination. This review highlights two research lines, showing that during the control of complex objects people make the interaction with 'tools' predictable; and that during dyadic coordination people make their behavior predictable and legible for their partners. These studies demonstrate that to achieve sophisticated motor skills, we play "prediction tricks": we select subspaces of predictable solutions and make sensorimotor interactions more predictable and legible by and for others. This synthesis underscores the critical role of predictability in optimizing control strategies across contexts. Furthermore, it emphasizes the need for novel studies on the scope and limits of predictive mechanisms in motor control.

Simplified internal models in human control of complex objects

Humans are skillful at manipulating objects that possess nonlinear underactuated dynamics, such as clothes or containers filled with liquids. Several studies suggested that humans implement a predictive model-based strategy to control such objects. However, these studies only considered unconstrained reaching without any object involved or, at most, linear mass-spring systems with relatively simple dynamics. It is not clear what internal model humans develop of more complex objects, and what level of granularity is represented. To answer these questions, this study examined a task where participants physically interacted with a nonlinear underactuated system mimicking a cup of sloshing coffee: a cup with a ball rolling inside. The cup and ball were simulated in a virtual environment and subjects interacted with the system via a haptic robotic interface. Participants were instructed to move the system and arrive at a target region with both cup and ball at rest, 'zeroing out' residual oscillations of the ball. This challenging task affords a solution known as 'input shaping', whereby a series of pulses moves the dynamic object to the target leaving no residual oscillations. Since the timing and amplitude of these pulses depend on the controller's internal model of the object, input shaping served as a tool to identify the subjects' internal representation of the cup-and-ball. Five simulations with different internal models were compared against the human data. Results showed that the features in the data were correctly predicted by a simple internal model that represented the cup-and-ball as a single rigid mass coupled to the hand impedance. These findings provide evidence that humans use simplified internal models along with mechanical impedance to manipulate complex objects.

Human performance in virtual stabilization of a fractional-order system with reaction delay

Virtual balancing tasks facilitate the study of human motion control: human reaction to the change of artificially introduced parameters can be studied in a computer environment. In this article, the dynamics of human stick balancing are generalized using fractional-order derivatives. Reaction delay sets a strong limitation on the length of the shortest stick that human subjects can balance. Human processing of visual input also exhibits a memory effect, which can be modelled by fractional-order derivatives. Therefore, we hypothesize a delayed fractional-order PD control of the unstable fractional-order process. The resulting equation of motion is investigated in a dimensionless framework, and stabilizability limits are determined as a function of the dynamics's order. These theoretical limits are then compared with the results of a systematic series of virtual balancing tests performed by 18 subjects. The comparison shows that the theoretical stabilizability limits for controllers with fixed fractional order correspond to the measured data points. The best fit is obtained if the fractional order of the underlying control law is 0.475.

Motor control beyond reach-how humans hit a target with a whip

Humans are strikingly adept at manipulating complex objects, from tying shoelaces to cracking a bullwhip. These motor skills have highly nonlinear interactive dynamics that defy reduction into parts. Yet, despite advances in data recording and processing, experiments in motor neuroscience still prioritize experimental reduction over realistic complexity. This study embraced the fully unconstrained behaviour of hitting a target with a 1.6-m bullwhip, both in rhythmic and discrete fashion. Adopting an object-centered approach to test the hypothesis that skilled movement simplifies the whip dynamics, the whip's evolution was characterized in relation to performance error and hand speed. Despite widely differing individual strategies, both discrete and rhythmic styles featured a cascade-like unfolding of the whip. Whip extension and orientation at peak hand speed predicted performance error, at least in the rhythmic style, suggesting that humans accomplished the task by setting initial conditions. These insights may inform further studies on human and robot control of complex objects.

Response to perturbation during quiet standing resembles delayed state feedback optimized for performance and robustness

Postural sway is a result of a complex action–reaction feedback mechanism generated by the interplay between the environment, the sensory perception, the neural system and the musculation. Postural oscillations are complex, possibly even chaotic. Therefore fitting deterministic models on measured time signals is ambiguous. Here we analyse the response to large enough perturbations during quiet standing such that the resulting responses can clearly be distinguished from the local postural sway. Measurements show that typical responses very closely resemble those of a critically damped oscillator. The recovery dynamics are modelled by an inverted pendulum subject to delayed state feedback and is described in the space of the control parameters. We hypothesize that the control gains are tuned such that (H1) the response is at the border of oscillatory and nonoscillatory motion similarly to the critically damped oscillator; (H2) the response is the fastest possible; (H3) the response is a result of a combined optimization of fast response and robustness to sensory perturbations. Parameter fitting shows that H1 and H3 are accepted while H2 is rejected. Thus, the responses of human postural balance to “large” perturbations matches a delayed feedback mechanism that is optimized for a combination of performance and robustness.

Rolling balance board of adjustable geometry as a tool to assess balancing skill and to estimate reaction time delay

The relation between balancing performance and reaction time is investigated for human subjects balancing on rolling balance board of adjustable physical parameters: adjustable rolling radius R and adjustable board elevation h. A well-defined measure of balancing performance is whether a subject can or cannot balance on balance board with a given geometry (R, h). The balancing ability is linked to the stabilizability of the underlying two-degree-of-freedom mechanical model subject to a delayed proportional-derivative feedback control. Although different sensory perceptions involve different reaction times at different hierarchical feedback loops, their effect is modelled as a single lumped reaction time delay. Stabilizability is investigated in terms of the time delay in the mechanical model: if the delay is larger than a critical value (critical delay), then no stabilizing feedback control exists. Series of balancing trials by 15 human subjects show that it is more difficult to balance on balance board configuration associated with smaller critical delay, than on balance boards associated with larger critical delay. Experiments verify the feature of the mechanical model that a change in the rolling radius R results in larger change in the difficulty of the task than the same change in the board elevation h does. The rolling balance board characterized by the two well-defined parameters R and h can therefore be a useful device to assess human balancing skill and to estimate the corresponding lumped reaction time delay.

Postural instability via a loss of intermittent control in elderly and patients with Parkinson's disease: A model-based and data-driven approach

Postural instability is one of the major symptoms of Parkinson's disease. Here, we assimilated a model of intermittent delay feedback control during quiet standing into postural sway data from healthy young and elderly individuals as well as patients with Parkinson's disease to elucidate the possible mechanisms of instability. Specifically, we estimated the joint probability distribution of a set of parameters in the model using the Bayesian parameter inference such that the model with the inferred parameters can best-fit sway data for each individual. It was expected that the parameter values for three populations would distribute differently in the parameter space depending on their balance capability. Because the intermittent control model is parameterized by a parameter associated with the degree of intermittency in the control, it can represent not only the intermittent model but also the traditional continuous control model with no intermittency. We showed that the inferred parameter values for the three groups of individuals are classified into two major groups in the parameter space: one represents the intermittent control mostly for healthy people and patients with mild postural symptoms and the other the continuous control mostly for some elderly and patients with severe postural symptoms. The results of this study may be interpreted by postulating that increased postural instability in most Parkinson's patients and some elderly persons might be characterized as a dynamical disease.