Acceleration feedback improves balancing against reflex delay

Biochemical implementation of acceleration sensing and PIDA control

This work introduces a realization of a proportional-integral-derivative-acceleration control scheme as a chemical reaction network governed by mass action kinetics. A central feature of this architecture is a speed and acceleration biosensing mechanism integrated into a feedback configuration. Our control scheme provides enhanced dynamic performance and robust steady-state tracking. In addition to our theoretical analysis, this is practically highlighted in-silico in both the deterministic and stochastic settings.

Torque modulation mechanism of the knee joint during balance recovery

Exploring the torque modulation mechanisms of human joints is critical for analyzing the human balance control system and developing natural human-machine interactions for balance support. However, the knee joint is often overlooked in biomechanical models because of its limited range of motion during balance recovery. This poses a challenge in establishing mathematical models for the knee joint's torque modulation mechanisms using computer simulations based on the inverted pendulum model. This study aims to provide a simplified linear feedback model inspired by sensorimotor transformation theory to reveal the torque modulation mechanism of the knee joint. The model was validated using data from experiments involving support-surface translation perturbations. The goodness-of-fit metrics of the model, including R2 values and root mean square errors (RMSE), demonstrated strong explanatory power (R2 ranged from 0.77 to 0.90) and low error (RMSE ranging from 0.035 to 0.072) across different perturbation magnitudes and directions. Through pooling samples across various perturbation conditions and conducting multiple fits, this model revealed that knee torque is modulated using a direction-specific strategy with adaptable feedback gains. These results suggest that the proposed simplified linear model can be used to develop assistive systems and retrieve insights on balance recovery mechanisms.

Increased velocity feedback gains in the presence of sensory noise can explain paradoxical changes in trunk motor control related to back pain

Literature reports paradoxical findings regarding effects of low-back pain (LBP) on trunk motor control. Compared to healthy individuals, patients with LBP, especially those with high pain-related anxiety, showed stronger trunk extensor reflexes and more resistance against perturbations. On the other hand, LBP patients and especially those with high pain-related anxiety showed decreased precision in unperturbed trunk movement and posture. These paradoxical effects might be explained by arousal potentially increasing average and variance of muscle spindle firing rates. Increased average firing rates could increase resistance against perturbations, but increased variance could decrease precision. We performed a simulation study to test this hypothesis. We modeled the trunk as a 2D inverted pendulum, stabilized by two antagonistic Hill-type muscles, based on their open-loop muscle activation dependent intrinsic stiffness and damping and through 25 ms-delayed, noisy contractile element length and velocity feedback. Reference feedback gains and sensory noise levels were tuned based on previously reported experimental data. We assessed the effect of increasing feedback gains on precision of trunk orientation at different perturbation magnitudes and assessed sensitivity of the effects to open-loop muscle stimulation and noise levels. At low perturbation magnitudes, increasing reflex gains consistently caused an increase in the variance of trunk orientation. At larger perturbation magnitudes, increasing reflex gains consistently caused a decrease in the variance of trunk orientation. Our results support the notion that LBP and related anxiety may increase reflex gains, resulting in an increase in the average and variance of spindle afference, which in turn increase resistance against perturbations and decrease movement precision.

Optimal controllers resembling postural sway during upright stance

The human postural control system can maintain our balance in an upright stance. A simplified control model that can mimic the mechanisms of this complex system and adapt to the changes due to aging and injuries is a significant problem that can be used in clinical applications. While the Intermittent Proportional Derivative (IPD) is commonly used as a postural sway model in the upright stance, it does not consider the predictability and adaptability behavior of the human postural control system and the physical limitations of the human musculoskeletal system. In this article, we studied the methods based on optimization algorithms that can mimic the performance of the postural sway controller in the upright stance. First, we compared three optimal methods (Model Predictive Control (MPC), COP-Based Controller (COP-BC) and Momentum-Based Controller (MBC)) in simulation by considering a feedback structure of the dynamic of the skeletal body as a double link inverted pendulum while taking into account sensory noise and neurological time delay. Second, we evaluated the validity of these methods by the postural sway data of ten subjects in quiet stance trials. The results revealed that the optimal methods could mimic the postural sway with higher accuracy and less energy consumption in the joints compared to the IPD method. Among optimal approaches, COP-BC and MPC show promising results to mimic the human postural sway. The choice of controller weights and parameters is a trade-off between the consumption of energy in the joints and the prediction accuracy. Therefore, the capability and (dis)advantage of each method reviewed in this article can navigate the usage of each controller in different applications of postural sway, from clinical assessments to robotic applications.

Motor control beyond reach-how humans hit a target with a whip

Humans are strikingly adept at manipulating complex objects, from tying shoelaces to cracking a bullwhip. These motor skills have highly nonlinear interactive dynamics that defy reduction into parts. Yet, despite advances in data recording and processing, experiments in motor neuroscience still prioritize experimental reduction over realistic complexity. This study embraced the fully unconstrained behaviour of hitting a target with a 1.6-m bullwhip, both in rhythmic and discrete fashion. Adopting an object-centered approach to test the hypothesis that skilled movement simplifies the whip dynamics, the whip's evolution was characterized in relation to performance error and hand speed. Despite widely differing individual strategies, both discrete and rhythmic styles featured a cascade-like unfolding of the whip. Whip extension and orientation at peak hand speed predicted performance error, at least in the rhythmic style, suggesting that humans accomplished the task by setting initial conditions. These insights may inform further studies on human and robot control of complex objects.

Preparing to move: Setting initial conditions to simplify interactions with complex objects

Humans dexterously interact with a variety of objects, including those with complex internal dynamics. Even in the simple action of carrying a cup of coffee, the hand not only applies a force to the cup, but also indirectly to the liquid, which elicits complex reaction forces back on the hand. Due to underactuation and nonlinearity, the object's dynamic response to an action sensitively depends on its initial state and can display unpredictable, even chaotic behavior. With the overarching hypothesis that subjects strive for predictable object-hand interactions, this study examined how subjects explored and prepared the dynamics of an object for subsequent execution of the target task. We specifically hypothesized that subjects find initial conditions that shorten the transients prior to reaching a stable and predictable steady state. Reaching a predictable steady state is desirable as it may reduce the need for online error corrections and facilitate feed forward control. Alternative hypotheses were that subjects seek to reduce effort, increase smoothness, and reduce risk of failure. Motivated by the task of 'carrying a cup of coffee', a simplified cup-and-ball model was implemented in a virtual environment. Human subjects interacted with this virtual object via a robotic manipulandum that provided force feedback. Subjects were encouraged to first explore and prepare the cup-and-ball before initiating a rhythmic movement at a specified frequency between two targets without losing the ball. Consistent with the hypotheses, subjects increased the predictability of interaction forces between hand and object and converged to a set of initial conditions followed by significantly decreased transients. The three alternative hypotheses were not supported. Surprisingly, the subjects' strategy was more effortful and less smooth, unlike the observed behavior in simple reaching movements. Inverse dynamics of the cup-and-ball system and forward simulations with an impedance controller successfully described subjects' behavior. The initial conditions chosen by the subjects in the experiment matched those that produced the most predictable interactions in simulation. These results present first support for the hypothesis that humans prepare the object to minimize transients and increase stability and, overall, the predictability of hand-object interactions.

Response to perturbation during quiet standing resembles delayed state feedback optimized for performance and robustness

Postural sway is a result of a complex action–reaction feedback mechanism generated by the interplay between the environment, the sensory perception, the neural system and the musculation. Postural oscillations are complex, possibly even chaotic. Therefore fitting deterministic models on measured time signals is ambiguous. Here we analyse the response to large enough perturbations during quiet standing such that the resulting responses can clearly be distinguished from the local postural sway. Measurements show that typical responses very closely resemble those of a critically damped oscillator. The recovery dynamics are modelled by an inverted pendulum subject to delayed state feedback and is described in the space of the control parameters. We hypothesize that the control gains are tuned such that (H1) the response is at the border of oscillatory and nonoscillatory motion similarly to the critically damped oscillator; (H2) the response is the fastest possible; (H3) the response is a result of a combined optimization of fast response and robustness to sensory perturbations. Parameter fitting shows that H1 and H3 are accepted while H2 is rejected. Thus, the responses of human postural balance to “large” perturbations matches a delayed feedback mechanism that is optimized for a combination of performance and robustness.

Rolling balance board of adjustable geometry as a tool to assess balancing skill and to estimate reaction time delay

The relation between balancing performance and reaction time is investigated for human subjects balancing on rolling balance board of adjustable physical parameters: adjustable rolling radius R and adjustable board elevation h. A well-defined measure of balancing performance is whether a subject can or cannot balance on balance board with a given geometry (R, h). The balancing ability is linked to the stabilizability of the underlying two-degree-of-freedom mechanical model subject to a delayed proportional-derivative feedback control. Although different sensory perceptions involve different reaction times at different hierarchical feedback loops, their effect is modelled as a single lumped reaction time delay. Stabilizability is investigated in terms of the time delay in the mechanical model: if the delay is larger than a critical value (critical delay), then no stabilizing feedback control exists. Series of balancing trials by 15 human subjects show that it is more difficult to balance on balance board configuration associated with smaller critical delay, than on balance boards associated with larger critical delay. Experiments verify the feature of the mechanical model that a change in the rolling radius R results in larger change in the difficulty of the task than the same change in the board elevation h does. The rolling balance board characterized by the two well-defined parameters R and h can therefore be a useful device to assess human balancing skill and to estimate the corresponding lumped reaction time delay.

The effects of sensory quantization and control torque saturation on human balance control

The effect of reaction delay, temporal sampling, sensory quantization, and control torque saturation is investigated numerically for a single-degree-of-freedom model of postural sway with respect to stability, stabilizability, and control effort. It is known that reaction delay has a destabilizing effect on the balancing process: the later one reacts to a perturbation, the larger the possibility of falling. If the delay is larger than a critical value, then stabilization is not even possible. In contrast, numerical analysis showed that quantization and control torque saturation have a stabilizing effect: the region of stabilizing control gains is greater than that of the linear model. Control torque saturation allows the application of larger control gains without overcontrol while sensory quantization plays a role of a kind of filter when sensory noise is present. These beneficial effects are reflected in the energy demand of the control process. On the other hand, neither control torque saturation nor sensory quantization improves stabilizability properties. In particular, the critical delay cannot be increased by adding saturation and/or sensory quantization.

Human control of complex objects: Towards more dexterous robots

Manipulation of objects with underactuated dynamics remains a challenge for robots. In contrast, humans excel at 'tool use' and more insight into human control strategies may inform robotic control architectures. We examined human control of objects that exhibit complex - underactuated, nonlinear, and potentially chaotic dynamics, such as transporting a cup of coffee. Simple control strategies appropriate for unconstrained movements, such as maximizing smoothness, fail as interaction forces have to be compensated or preempted. However, predictive control based on internal models appears daunting when the objects have nonlinear and unpredictable dynamics. We hypothesized that humans learn strategies that make these interactions predictable. Using a virtual environment subjects interacted with a virtual cup and rolling ball using a robotic visual and haptic interface. Two different metrics quantified predictability: stability or contraction, and mutual information between controller and object. In point-to-point displacements subjects exploited the contracting regions of the object dynamics to safely navigate perturbations. Control contraction metrics showed that subjects used a controller that exponentially stabilized trajectories. During continuous cup-and-ball displacements subjects developed predictable solutions sacrificing smoothness and energy efficiency. These results may stimulate control strategies for dexterous robotic manipulators and human-robot interaction.

Force accuracy rather than high stiffness is associated with faster learning and reduced falls in human balance

Balance requires the centre of mass to be maintained within the base of support. This can be achieved by minimising position sway (stiffness control: SC) or minimising force error (force accuracy control: FAC). Minimising sway reduces exploration of system properties, whereas minimising force error maximizes accurate mapping of the force vs position. We hypothesise that (i) FAC is associated with faster learning and fewer falls whereas (ii) SC is not. Fifteen participants used myoelectric signals from their legs to maintain balance of an actuated, inverted pendulum, to which they were strapped. Using challenging perturbations, participants were trained to maintain balance without falling within five sessions and tested before (PRE) and after (POST) training. We quantified FAC as 'change (POST-PRE) in correlation of force with position' and SC as 'change in sway'. PRE training, five measures (sway, acceleration, co-contraction, effort, falls) showed no correlation with either FAC or SC. POST training, reduced fall rate, effort and acceleration correlated with FAC metric. SC correlated only with reduced sway. Unlike sway minimisation, development of force accuracy was associated with learning and reduced falls. These results support that accurate force estimation allowing movement is more relevant than stiffness to improve balance and prevent falls.

Virtual stick balancing: sensorimotor uncertainties related to angular displacement and velocity

Sensory uncertainties and imperfections in motor control play important roles in neural control and Bayesian approaches to neural encoding. However, it is difficult to estimate these uncertainties experimentally. Here, we show that magnitude of the uncertainties during the generation of motor control force can be measured for a virtual stick balancing task by varying the feedback delay, τ. It is shown that the shortest stick length that human subjects are able to balance is proportional to τ  2. The proportionality constant can be related to a combined effect of the sensory uncertainties and the error in the realization of the control force, based on a delayed proportional-derivative (PD) feedback model of the balancing task. The neural reaction delay of the human subjects was measured by standard reaction time tests and by visual blank-out tests. Experimental observations provide an estimate for the upper boundary of the average sensorimotor uncertainty associated either with angular position or with angular velocity. Comparison of balancing trials with 27 human subjects to the delayed PD model suggests that the average uncertainty in the control force associated purely with the angular position is at most 14% while that associated purely with the angular velocity is at most 40%. In the general case when both uncertainties are present, the calculations suggest that the allowed uncertainty in angular velocity will always be greater than that in angular position.

Yank: the time derivative of force is an important biomechanical variable in sensorimotor systems

The derivative of force with respect to time does not have a standard term in physics. As a consequence, the quantity has been given a variety of names, the most closely related being 'rate of force development'. The lack of a proper name has made it difficult to understand how different structures and processes within the sensorimotor system respond to and shape the dynamics of force generation, which is critical for survival in many species. We advocate that ∂[Formula: see text]/∂t be termed 'yank', a term that has previously been informally used and never formally defined. Our aim in this Commentary is to establish the significance of yank in how biological motor systems are organized, evolve and adapt. Further, by defining the quantity in mathematical terms, several measurement variables that are commonly reported can be clarified and unified. In this Commentary, we first detail the many types of motor function that are affected by the magnitude of yank generation, especially those related to time-constrained activities. These activities include escape, prey capture and postural responses to perturbations. Next, we describe the multi-scale structures and processes of the musculoskeletal system that influence yank and can be modified to increase yank generation. Lastly, we highlight recent studies showing that yank is represented in the sensory feedback system, and discuss how this information is used to enhance postural stability and facilitate recovery from postural perturbations. Overall, we promote an increased consideration of yank in studying biological motor and sensory systems.

Acting together, destabilizing influences can stabilize human balance

The causes of falling in the elderly are multi-factorial. Three factors that influence balance stability are the time delay, a sensory dead zone and the maximum ankle torque that can be generated by muscular contraction. Here, the effects of these contributions are evaluated in the context of a model of an inverted pendulum stabilized by time-delayed proportional-derivative (PD) feedback. The effect of the sensory dead zone is to produce a hybrid type of control in which the PD feedback is switched ON or OFF depending on whether or not the controlled variable is larger or smaller than the detection threshold, Π. It is shown that, as Π increases, the region in the plane of control parameters where the balance time (BT) is greater than 60 s is increased slightly. However, when maximum ankle torque is also limited, there is a dramatic increase in the parameter region associated with BTs greater than 60 s. This increase is due to the effects of a torque limitation on over-control associated with bang-bang type switching controllers. These observations show that acting together influences, which are typically thought to destabilize balance, can actually stabilize balance. This article is part of the theme issue 'Nonlinear dynamics of delay systems'.

Saturation limits the contribution of acceleration feedback to balancing against reaction delay

A nonlinear model for human balancing subjected to a saturated delayed proportional-derivative-acceleration (PDA) feedback is analysed. Compared to the proportional-derivative (PD) controller, it is confirmed that the PDA controller improves local stability even for large feedback delays. However, it is shown that the saturated PDA controller typically introduces subcritical Hopf bifurcation into the system, which can also lead to falling for large enough perturbations. The subcriticality becomes stronger as the acceleration feedback gain increases or the saturation torque limit decreases. These explain some features of human balancing failure related to the increased reaction delay of inactive elderly people.

Stabilization of a Cart Inverted Pendulum: Improving the Intermittent Feedback Strategy to Match the Limits of Human Performance

Stabilization of the CIP (Cart Inverted Pendulum) is an analogy to stick balancing on a finger and is an example of unstable tasks that humans face in everyday life. The difficulty of the task grows exponentially with the decrease of the length of the stick and a stick length of 32 cm is considered as a human limit even for well-trained subjects. Moreover, there is a cybernetic limit related to the delay of the multimodal sensory feedback (about 230 ms) that supports a feedback stabilization strategy. We previously demonstrated that an intermittent-feedback control paradigm, originally developed for modeling the stabilization of upright standing, can be applied with success also to the CIP system, but with values of the critical parameters far from the limiting ones (stick length 50 cm and feedback delay 100 ms). The intermittent control paradigm is based on the alternation of on-phases, driven by a proportional/derivative delayed feedback controller, and off-phases, where the feedback is switched off and the motion evolves according to the intrinsic dynamics of the CIP. In its standard formulation, the switching mechanism consists of a simple threshold operator: the feedback control is switched off if the current (delayed) state vector is closer to the stable than to the unstable manifold of the off-phase and is switched on in the opposite case. Although this simple formulation is effective for explaining upright standing as well as CIP balancing, it fails in the most challenging configuration of the CIP. In this work we propose a modification of the standard intermittent control policy that focuses on the explicit selection of switching times and is based on the phase reset of the estimated state vector at each switching time and on the simulation of an approximated internal model of CIP dynamics. We demonstrate, by simulating the modified intermittent control policy, that it can match the limits of human performance, while operating near the edge of instability.

A Neuro-Musculo-Skeletal Model of Human Standing Combining Muscle-Reflex Control and Virtual Model Control

While neuro-musculo-skeletal models are a common tool in theoretical studies on human gait, they are rarely used for studying human motor control of standing balance. As a result, it is difficult to assess whether proposed control strategies of standing balance can be realized by the human neuromuscular structure. Nor is it clear how the human control of standing balance interacts with that of walking. Motivated by these two shortcomings, we here develop a neuro-musculo-skeletal model of human bipedal standing whose control combines spinal muscle reflexes suggested to be important in walking with a virtual model control mimicking the supraspinal regulation of balance. We show in computer simulations that the model can reproduce several aspects of human standing balance observed in experiments on postural sway. Although control improvements are necessary to capture more aspects, the model may serve as a starting for studying the combined control of standing and walking.

A Tutorial for the Analysis of the Piecewise-Smooth Dynamics of a Constrained Multibody Model of Vertical Hopping

Contradictory demands are present in the dynamic modeling and analysis of legged locomotion: on the one hand, the high degrees-of-freedom (DoF) descriptive models are geometrically accurate, but the analysis of self-stability and motion pattern generation is extremely challenging; on the other hand, low DoF models of locomotion are thoroughly analyzed in the literature; however, these models do not describe the geometry accurately. We contribute by narrowing the gap between the two modeling approaches. Our goal is to develop a dynamic analysis methodology for the study of self-stable controlled multibody models of legged locomotion. An efficient way of modeling multibody systems is to use geometric constraints among the rigid bodies. It is especially effective when closed kinematic loops are present, such as in the case of walking models, when both legs are in contact with the ground. The mathematical representation of such constrained systems is the differential algebraic equation (DAE). We focus on the mathematical analysis methods of piecewise-smooth dynamic systems and we present their application for constrained multibody models of self-stable locomotion represented by DAE. Our numerical approach is demonstrated on a linear model of hopping and compared with analytically obtained reference results.

Predictability, force, and (anti)resonance in complex object control

Manipulation of complex objects as in tool use is ubiquitous and has given humans an evolutionary advantage. This study examined the strategies humans choose when manipulating an object with underactuated internal dynamics, such as a cup of coffee. The dynamics of the object renders the temporal evolution complex, possibly even chaotic, and difficult to predict. A cart-and-pendulum model, loosely mimicking coffee sloshing in a cup, was implemented in a virtual environment with a haptic interface. Participants rhythmically manipulated the virtual cup containing a rolling ball; they could choose the oscillation frequency, whereas the amplitude was prescribed. Three hypotheses were tested: 1) humans decrease interaction forces between hand and object; 2) humans increase the predictability of the object dynamics; and 3) humans exploit the resonances of the coupled object-hand system. Analysis revealed that humans chose either a high-frequency strategy with antiphase cup-and-ball movements or a low-frequency strategy with in-phase cup-and-ball movements. Counter to hypothesis 1, they did not decrease interaction force; instead, they increased the predictability of the interaction dynamics, quantified by mutual information, supporting hypothesis 2. To address hypothesis 3, frequency analysis of the coupled hand-object system revealed two resonance frequencies separated by an antiresonance frequency. The low-frequency strategy exploited one resonance, whereas the high-frequency strategy afforded more choice, consistent with the frequency response of the coupled system; both strategies avoided the antiresonance. Hence, humans did not prioritize small interaction forces but rather strategies that rendered interactions predictable. These findings highlight that physical interactions with complex objects pose control challenges not present in unconstrained movements. NEW & NOTEWORTHY Daily actions involve manipulation of complex nonrigid objects, which present a challenge since humans have no direct control of the whole object. We used a virtual-reality experiment and simulations of a cart-and-pendulum system coupled to hand movements with impedance to analyze the manipulation of this underactuated object. We showed that participants developed strategies that increased the predictability of the object behavior by exploiting the resonance structure of the object but did not minimize the hand-object interaction force.

A Sensitivity Analysis of an Inverted Pendulum Balance Control Model

Balance control models are used to describe balance behavior in health and disease. We identified the unique contribution and relative importance of each parameter of a commonly used balance control model, the Independent Channel (IC) model, to identify which parameters are crucial to describe balance behavior. The balance behavior was expressed by transfer functions (TFs), representing the relationship between sensory perturbations and body sway as a function of frequency, in terms of amplitude (i.e., magnitude) and timing (i.e., phase). The model included an inverted pendulum controlled by a neuromuscular system, described by several parameters. Local sensitivity of each parameter was determined for both the magnitude and phase using partial derivatives. Both the intrinsic stiffness and proportional gain shape the magnitude at low frequencies (0.1–1 Hz). The derivative gain shapes the peak and slope of the magnitude between 0.5 and 0.9 Hz. The sensory weight influences the overall magnitude, and does not have any effect on the phase. The effect of the time delay becomes apparent in the phase above 0.6 Hz. The force feedback parameters and intrinsic stiffness have a small effect compared with the other parameters. All parameters shape the TF magnitude and phase and therefore play a role in the balance behavior. The sensory weight, time delay, derivative gain, and the proportional gain have a unique effect on the TFs, while the force feedback parameters and intrinsic stiffness contribute less. More insight in the unique contribution and relative importance of all parameters shows which parameters are crucial and critical to identify underlying differences in balance behavior between different patient groups.

Stabilizing skateboard speed-wobble with reflex delay

A simple mechanical model of the skateboard-skater system is analysed, in which the effect of human control is considered by means of a linear proportional-derivative (PD) controller with delay. The equations of motion of this non-holonomic system are neutral delay-differential equations. A linear stability analysis of the rectilinear motion is carried out analytically. It is shown how to vary the control gains with respect to the speed of the skateboard to stabilize the uniform motion. The critical reflex delay of the skater is determined as the function of the speed. Based on this analysis, we present an explanation for the linear instability of the skateboard-skater system at high speed. Moreover, the advantages of standing ahead of the centre of the board are demonstrated from the viewpoint of reflex delay and control gain sensitivity.

Control at stability's edge minimizes energetic costs: expert stick balancing

Stick balancing on the fingertip is a complex voluntary motor task that requires the stabilization of an unstable system. For seated expert stick balancers, the time delay is 0.23 s, the shortest stick that can be balanced for 240 s is 0.32 m and there is a [Formula: see text]° dead zone for the estimation of the vertical displacement angle in the saggital plane. These observations motivate a switching-type, pendulum-cart model for balance control which uses an internal model to compensate for the time delay by predicting the sensory consequences of the stick's movements. Numerical simulations using the semi-discretization method suggest that the feedback gains are tuned near the edge of stability. For these choices of the feedback gains, the cost function which takes into account the position of the fingertip and the corrective forces is minimized. Thus, expert stick balancers optimize control with a combination of quick manoeuvrability and minimum energy expenditures.

Intermittent muscle activity in the feedback loop of postural control system during natural quiet standing

The origin of continual body oscillation during quiet standing is a neural-muscular-skeletal closed feedback loop system that includes insufficient joint stiffness and a time delay. Thus, muscle activity and joint oscillations are nonlinear during quiet standing, making it difficult to demonstrate the muscular-skeletal relationship experimentally. Here we experimentally revealed this relationship using intermittent control theory, in which non-actuation works to stabilize the skeletal system towards equilibrium. We found that leg muscles were activated/inactivated when the state point was located in the opposite/same direction as the direction of anatomical action, which was associated with joint torque actuating the body towards equilibrium. The derivative values of stability index defined in the phase space approximately 200 ms before muscle inactivation were also larger than those before activation for some muscles. These results indicate that bipedal standing might be achieved by monitoring the rate of change of stability/instability components and generating joint torque to stabilize the body. In conclusion, muscles are likely to activate in an event-driven manner during quiet standing and a possible metric for on/off switching is SI dot, and our methodology of EMG processing could allows us to extract such event-driven intermittent muscle activities.

Force encoding in muscle spindles during stretch of passive muscle

Muscle spindle proprioceptive receptors play a primary role in encoding the effects of external mechanical perturbations to the body. During externally-imposed stretches of passive, i.e. electrically-quiescent, muscles, the instantaneous firing rates (IFRs) of muscle spindles are associated with characteristics of stretch such as length and velocity. However, even in passive muscle, there are history-dependent transients of muscle spindle firing that are not uniquely related to muscle length and velocity, nor reproduced by current muscle spindle models. These include acceleration-dependent initial bursts, increased dynamic response to stretch velocity if a muscle has been isometric, and rate relaxation, i.e., a decrease in tonic IFR when a muscle is held at a constant length after being stretched. We collected muscle spindle spike trains across a variety of muscle stretch kinematic conditions, including systematic changes in peak length, velocity, and acceleration. We demonstrate that muscle spindle primary afferents in passive muscle fire in direct relationship to muscle force-related variables, rather than length-related variables. Linear combinations of whole muscle-tendon force and the first time derivative of force (dF/dt) predict the entire time course of transient IFRs in muscle spindle Ia afferents during stretch (i.e., lengthening) of passive muscle, including the initial burst, the dynamic response to lengthening, and rate relaxation following lengthening. Similar to acceleration scaling found previously in postural responses to perturbations, initial burst amplitude scaled equally well to initial stretch acceleration or dF/dt, though later transients were only described by dF/dt. The transient increase in dF/dt at the onset of lengthening reflects muscle short-range stiffness due to cross-bridge dynamics. Our work demonstrates a critical role of muscle cross-bridge dynamics in history-dependent muscle spindle IFRs in passive muscle lengthening conditions relevant to the detection and sensorimotor response to mechanical perturbations to the body, and to previously-described history-dependence in perception of limb position.

Sensory contributions to stabilization of trunk posture in the sagittal plane

Trunk stabilization is required to control posture and movement during daily activities. Various sensory modalities, such as muscle spindles, Golgi tendon organs and the vestibular system, might contribute to trunk stabilization and our aim was to assess the contribution of these modalities to trunk stabilization. In 35 healthy subjects, upper-body sway was evoked by continuous unpredictable, force-controlled perturbations to the trunk in the anterior direction. Subjects were instructed to either 'maximally resist the perturbation' or to 'relax but remain upright' with eyes closed. Frequency response functions (FRFs) of admittance, the amount of movement per unit of force applied, and reflexes, the modulation of trunk extensor activity per unit of trunk displacement, were obtained. To these FRFs, we fitted physiological models, to estimate intrinsic trunk stiffness and damping, as well as feedback gains and delays. The different model versions were compared to assess which feedback loops contribute to trunk stabilization. Intrinsic stiffness and damping and muscle spindle (short-delay) feedback alone were sufficient to accurately describe trunk stabilization, but only with unrealistically low reflex delays. Addition of muscle spindle acceleration feedback or inhibitory Golgi tendon organ feedback yielded realistic delays and improved the model fit, with a significantly better model fit with acceleration feedback. Addition of vestibular feedback did not improve the model fit. In conclusion, muscle spindle feedback and intrinsic mechanical properties are sufficient to describe trunk stabilization in the sagittal plane under small mechanical perturbations, provided that muscle spindles encode acceleration in addition to velocity and position information.

Dynamic Determinants of the Uncontrolled Manifold during Human Quiet Stance

Human postural sway during stance arises from coordinated multi-joint movements. Thus, a sway trajectory represented by a time-varying postural vector in the multiple-joint-angle-space tends to be constrained to a low-dimensional subspace. It has been proposed that the subspace corresponds to a manifold defined by a kinematic constraint, such that the position of the center of mass (CoM) of the whole body is constant in time, referred to as the kinematic uncontrolled manifold (kinematic-UCM). A control strategy related to this hypothesis (CoM-control-strategy) claims that the central nervous system (CNS) aims to keep the posture close to the kinematic-UCM using a continuous feedback controller, leading to sway patterns that mostly occur within the kinematic-UCM, where no corrective control is exerted. An alternative strategy proposed by the authors (intermittent control-strategy) claims that the CNS stabilizes posture by intermittently suspending the active feedback controller, in such a way to allow the CNS to exploit a stable manifold of the saddle-type upright equilibrium in the state-space of the system, referred to as the dynamic-UCM, when the state point is on or near the manifold. Although the mathematical definitions of the kinematic- and dynamic-UCM are completely different, both UCMs play similar roles in the stabilization of multi-joint upright posture. The purpose of this study was to compare the dynamic performance of the two control strategies. In particular, we considered a double-inverted-pendulum-model of postural control, and analyzed the two UCMs defined above. We first showed that the geometric configurations of the two UCMs are almost identical. We then investigated whether the UCM-component of experimental sway could be considered as passive dynamics with no active control, and showed that such UCM-component mainly consists of high frequency oscillations above 1 Hz, corresponding to anti-phase coordination between the ankle and hip. We also showed that this result can be better characterized by an eigenfrequency associated with the dynamic-UCM. In summary, our analysis highlights the close relationship between the two control strategies, namely their ability to simultaneously establish small CoM variations and postural stability, but also make it clear that the intermittent control hypothesis better explains the spectral characteristics of sway.

Intermittent Feedback-Control Strategy for Stabilizing Inverted Pendulum on Manually Controlled Cart as Analogy to Human Stick Balancing

The stabilization of an inverted pendulum on a manually controlled cart (cart-inverted-pendulum; CIP) in an upright position, which is analogous to balancing a stick on a fingertip, is considered in order to investigate how the human central nervous system (CNS) stabilizes unstable dynamics due to mechanical instability and time delays in neural feedback control. We explore the possibility that a type of intermittent time-delayed feedback control, which has been proposed for human postural control during quiet standing, is also a promising strategy for the CIP task and stick balancing on a fingertip. Such a strategy hypothesizes that the CNS exploits transient contracting dynamics along a stable manifold of a saddle-type unstable upright equilibrium of the inverted pendulum in the absence of control by inactivating neural feedback control intermittently for compensating delay-induced instability. To this end, the motions of a CIP stabilized by human subjects were experimentally acquired, and computational models of the system were employed to characterize the experimental behaviors. We first confirmed fat-tailed non-Gaussian temporal fluctuation in the acceleration distribution of the pendulum, as well as the power-law distributions of corrective cart movements for skilled subjects, which was previously reported for stick balancing. We then showed that the experimental behaviors could be better described by the models with an intermittent delayed feedback controller than by those with the conventional continuous delayed feedback controller, suggesting that the human CNS stabilizes the upright posture of the pendulum by utilizing the intermittent delayed feedback-control strategy.

Predictability and Robustness in the Manipulation of Dynamically Complex Objects

Manipulation of complex objects and tools is a hallmark of many activities of daily living, but how the human neuromotor control system interacts with such objects is not well understood. Even the seemingly simple task of transporting a cup of coffee without spilling creates complex interaction forces that humans need to compensate for. Predicting the behavior of an underactuated object with nonlinear fluid dynamics based on an internal model appears daunting. Hence, this research tests the hypothesis that humans learn strategies that make interactions predictable and robust to inaccuracies in neural representations of object dynamics. The task of moving a cup of coffee is modeled with a cart-and-pendulum system that is rendered in a virtual environment, where subjects interact with a virtual cup with a rolling ball inside using a robotic manipulandum. To gain insight into human control strategies, we operationalize predictability and robustness to permit quantitative theory-based assessment. Predictability is quantified by the mutual information between the applied force and the object dynamics; robustness is quantified by the energy margin away from failure. Three studies are reviewed that show how with practice subjects develop movement strategies that are predictable and robust. Alternative criteria, common for free movement, such as maximization of smoothness and minimization of force, do not account for the observed data. As manual dexterity is compromised in many individuals with neurological disorders, the experimental paradigm and its analyses are a promising platform to gain insights into neurological diseases, such as dystonia and multiple sclerosis, as well as healthy aging.

An intermittent control model of flexible human gait using a stable manifold of saddle-type unstable limit cycle dynamics

Stability of human gait is the ability to maintain upright posture during walking against external perturbations. It is a complex process determined by a number of cross-related factors, including gait trajectory, joint impedance and neural control strategies. Here, we consider a control strategy that can achieve stable steady-state periodic gait while maintaining joint flexibility with the lowest possible joint impedance. To this end, we carried out a simulation study of a heel-toe footed biped model with hip, knee and ankle joints and a heavy head-arms-trunk element, working in the sagittal plane. For simplicity, the model assumes a periodic desired joint angle trajectory and joint torques generated by a set of feed-forward and proportional-derivative feedback controllers, whereby the joint impedance is parametrized by the feedback gains. We could show that a desired steady-state gait accompanied by the desired joint angle trajectory can be established as a stable limit cycle (LC) for the feedback controller with an appropriate set of large feedback gains. Moreover, as the feedback gains are decreased for lowering the joint stiffness, stability of the LC is lost only in a few dimensions, while leaving the remaining large number of dimensions quite stable: this means that the LC becomes saddle-type, with a low-dimensional unstable manifold and a high-dimensional stable manifold. Remarkably, the unstable manifold remains of low dimensionality even when the feedback gains are decreased far below the instability point. We then developed an intermittent neural feedback controller that is activated only for short periods of time at an optimal phase of each gait stride. We characterized the robustness of this design by showing that it can better stabilize the unstable LC with small feedback gains, leading to a flexible gait, and in particular we demonstrated that such an intermittent controller performs better if it drives the state point to the stable manifold, rather than directly to the LC. The proposed intermittent control strategy might have a high affinity for the inverted pendulum analogy of biped gait, providing a dynamic view of how the step-to-step transition from one pendular stance to the next can be achieved stably in a robust manner by a well-timed neural intervention that exploits the stable modes embedded in the unstable dynamics.

Rhythmic manipulation of objects with complex dynamics: predictability over chaos

The study of object manipulation has been largely confined to discrete tasks, where accuracy, mechanical effort, or smoothness were examined to explain subjects' preferred movements. This study investigated a rhythmic manipulation task, which involved continuous interaction with a nonlinear object that led to unpredictable object behavior. Using a simplified virtual version of the task of carrying a cup of coffee, we studied how this unpredictable object behavior affected the selected strategies. The experiment was conducted in a virtual set-up, where subjects moved a cup with a ball inside, modeled by cart-and-pendulum dynamics. Inverse dynamics calculations of the system showed that performing the task with different amplitudes and relative phases required different force profiles and rendered the object's dynamics with different degrees of predictability (quantified by Mutual Information between the applied force and the cup kinematics and its sensitivity). Subjects (n = 8) oscillated the virtual cup between two targets via a robotic manipulandum, paced by a metronome at 1 Hz for 50 trials, each lasting 45 s. They were free to choose their movement amplitude and relative phase between the ball and cup. Experimental results showed that subjects increased their movement amplitudes, which rendered the interactions with the object more predictable and with lower sensitivity to the execution variables. These solutions were associated with higher average exerted force and lower object smoothness, contradicting common expectations from studies on discrete object manipulation and unrestrained movements. Instead, the findings showed that humans selected strategies with higher predictability of interaction dynamics. This finding expressed that humans seek movement strategies where force and kinematics synchronize to repeatable patterns that may require less sensorimotor information processing.

Multiplicative-cascade dynamics in pole balancing

Pole balancing is a key task for probing the prospective control that organisms must engage in for purposeful action. The temporal structure of pole-balancing behaviors will reflect the on-line operation of control mechanisms needed to maintain an upright posture. In this study, signatures of multifractality are sought and found in time series of the vertical angle of a pole balanced on the fingertip. Comparisons to surrogate time series reveal multiplicative-cascade dynamics and interactivity across scales. In addition, simulations of a pole-balancing model generating on-off intermittency [J. L. Cabrera and J. G. Milton, Phys. Rev. Lett. 89, 158702 (2002)] were analyzed. Evidence of multifractality is also evident in simulations, though comparing simulated and participant series reveals a significantly greater contribution of cross-scale interactivity for the latter. These findings suggest that multiplicative-cascade dynamics are an extension of on-off intermittency and play a role in prospective coordination.

Auto-regressive moving average analysis of linear and discontinuous models of human balance during quiet standing

Linear Time Invariant (LTI) processes can be modelled by means of Auto-Regressive Moving Average (ARMA) model systems. In this paper, we examine whether an ARMA model can be fitted to a process characterised by switched nonlinearities. In particular, we conduct the following test: we generate data from known LTI and nonlinear (threshold/dead-zone) models of human balance and analyse the output using ARMA. We show that both these known systems can be fitted, according to standard criteria, with low order ARMA models. To check if there are some obvious effects of the dead-zone, we compare the power spectra of both systems with the power spectra of their ARMA models. We then examine spectral properties of three posturographic data sets and their ARMA models and compare them with the power spectra of our model systems. Finally, we examine the dynamics of our model systems in the absence of noise to determine what is the effect of the switching threshold (dead-zone) on the asymptotic dynamics.

Sensory uncertainty and stick balancing at the fingertip

The effects of sensory input uncertainty, [Formula: see text], on the stability of time-delayed human motor control are investigated by calculating the minimum stick length, [Formula: see text], that can be stabilized in the inverted position for a given time delay, [Formula: see text]. Five control strategies often discussed in the context of human motor control are examined: three time-invariant controllers [proportional-derivative, proportional-derivative-acceleration (PDA), model predictive (MP) controllers] and two time-varying controllers [act-and-wait (AAW) and intermittent predictive controllers]. The uncertainties of the sensory input are modeled as a multiplicative term in the system output. Estimates based on the variability of neural spike trains and neural population responses suggest that [Formula: see text]-13 %. It is found that for this range of uncertainty, a tapped delay-line type of MP controller is the most robust controller. In particular, this controller can stabilize inverted sticks of the length balanced by expert stick balancers (0.25-0.5 m when [Formula: see text] s). However, a PDA controller becomes more effective when [Formula: see text]. A comparison between [Formula: see text] for human stick balancing at the fingertip and balancing on the rubberized surface of a table tennis racket suggest that friction likely plays a role in balance control. Measurements of [Formula: see text], and a variability of the fluctuations in the vertical displacement angle, an estimate of [Formula: see text], may make it possible to study the changes in control strategy as motor skill develops.

Human stick balancing: an intermittent control explanation

There are two issues in balancing a stick pivoting on a finger tip (or mechanically on a moving cart): maintaining the stick angle near to vertical and maintaining the horizontal position within the bounds of reach or cart track. The (linearised) dynamics of the angle are second order (although driven by pivot acceleration), and so, as in human standing, control of the angle is not, by itself very difficult. However, once the angle is under control, the position dynamics are, in general, fourth order. This makes control quite difficult for humans (and even an engineering control system requires careful design). Recently, three of the authors have experimentally demonstrated that humans control the stick angle in a special way: the closed-loop inverted pendulum behaves as a non-inverted pendulum with a virtual pivot somewhere between the stick centre and tip and with increased gravity. Moreover, they suggest that the virtual pivot lies at the radius of gyration (about the mass centre) above the mass centre. This paper gives a continuous-time control-theoretical interpretation of the virtual-pendulum approach. In particular, by using a novel cascade control structure, it is shown that the horizontal control of the virtual pivot becomes a second-order problem which is much easier to solve than the generic fourth-order problem. Hence, the use of the virtual pivot approach allows the control problem to be perceived by the subject as two separate second-order problems rather than a single fourth-order problem, and the control problem is therefore simplified. The theoretical predictions are verified using the data previously presented by three of the authors and analysed using a standard parameter estimation method. The experimental data indicate that although all subjects adopt the virtual pivot approach, the less expert subjects exhibit larger amplitude angular motion and poorly controlled translational motion. It is known that human control systems are delayed and intermittent, and therefore, the continuous-time strategy cannot be correct. However, the model of intermittent control used in this paper is based on the virtual pivot continuous-time control scheme, handles time delays and moreover masquerades as the underlying continuous-time controller. In addition, the event-driven properties of intermittent control can explain experimentally observed variability.

Learning an intermittent control strategy for postural balancing using an EMG-based human-computer interface

It has been considered that the brain stabilizes unstable body dynamics by regulating co-activation levels of antagonist muscles. Here we critically reexamined this established theory of impedance control in a postural balancing task using a novel EMG-based human-computer interface, in which subjects were asked to balance a virtual inverted pendulum using visual feedback information on the pendulum's position. The pendulum was actuated by a pair of antagonist joint torques determined in real-time by activations of the corresponding pair of antagonist ankle muscles of subjects standing upright. This motor-task raises a frustrated environment; a large feedback time delay in the sensorimotor loop, as a source of instability, might favor adopting the non-reactive, preprogrammed impedance control, but the ankle muscles are relatively hard to co-activate, which hinders subjects from adopting the impedance control. This study aimed at discovering how experimental subjects resolved this frustrated environment through motor learning. One third of subjects adapted to the balancing task in a way of the impedance-like control. It was remarkable, however, that the majority of subjects did not adopt the impedance control. Instead, they acquired a smart and energetically efficient strategy, in which two muscles were inactivated simultaneously at a sequence of optimal timings, leading to intermittent appearance of periods of time during which the pendulum was not actively actuated. Characterizations of muscle inactivations and the pendulum¡Çs sway showed that the strategy adopted by those subjects was a type of intermittent control that utilizes a stable manifold of saddle-type unstable upright equilibrium that appeared in the state space of the pendulum when the active actuation was turned off.