Feedback delays can enhance anticipatory synchronization in human-machine interaction

Social and nonlinear dynamics unite: musical group synchrony

Synchronization, the human tendency to align behaviors in time with others, is necessary for many survival skills. The ability to synchronize actions with rhythmic (predictable) sound patterns is especially well developed in music making. Recent models of synchrony in musical ensembles rely on pairwise comparisons between group members. This pairwise approach to synchrony has hampered theory development, given current findings from social dynamics indicating shifts in members' influence within larger groups. We draw on social theory and nonlinear dynamics to argue that emergent properties and novel roles arise in musical group synchrony that differ from individual or pairwise behaviors. This transformational shift in defining synchrony sheds light on successful outcomes as well as on disruptions that cause negative behavioral outcomes.

Coordination tending towards an anti-phase relationship determines greater sway reduction during entrainment with a simulated partner

The increased risk of falls in the older aged population demands the development of assistive robotic devices capable of effective balance support. For the development and increased user acceptance of such devices, which provide balance support in a human-like way, it is important to understand the simultaneous occurrence of entrainment and sway reduction in human-human interaction. However, sway reduction has not been observed yet during a human touching an external, continuously moving reference, which rather increased human body sway. Therefore, we investigated in 15 healthy young adults (27.20±3.55 years, 6 females) how different simulated sway-responsive interaction partners with different coupling modes affect sway entrainment, sway reduction and relative interpersonal coordination, as well as how these human behaviours differ depending on the individual body schema accuracy. For this, participants were lightly touching a haptic device that either played back an average pre-recorded sway trajectory ("Playback") or moved based on the sway trajectory simulated by a single-inverted pendulum model with either a positive (Attractor) or negative (Repulsor) coupling to participant's body sway. We found that body sway reduced not only during the Repulsor-interaction, but also during the Playback-interaction. These interactions also showed a relative interpersonal coordination tending more towards an anti-phase relationship, especially the Repulsor. Moreover, the Repulsor led to the strongest sway entrainment. Finally, a better body schema contributed to a reduced body sway in both the "reliable" Repulsor and the "less reliable" Attractor mode. Consequently, a relative interpersonal coordination tending more towards an anti-phase relationship and an accurate body schema are important to facilitate sway reduction.

Social Interaction and Rate Effects in Models of Musical Synchronization

Important individual differences are observed in people’s abilities to synchronize their body movements with regular auditory rhythms. We investigate whether synchronizing with a regular auditory cue is affected by each person’s spontaneous production rate (SPR) and by hearing a partner’s synchronization in a social context. Musically trained and untrained participants synchronized their tapping with an auditory cue presented at different rates (their own SPR or their partner’s SPR) and in a Solo or Joint (turn-taking) condition. Linear and nonlinear oscillator models were fit to participants’ mean asynchronies (signed timing differences between the cued onsets and taps). In Joint turn-taking, participants’ synchrony was increased when the auditory signal was cued at the participant’s own SPR, compared with their partner’s SPR; in contrast, synchronization did not differ across rates in the Solo condition. Asynchronies in the Joint task became larger as the difference between partners’ spontaneous rates increased; the increased asynchronies were driven by the faster partner who did not slow down to match the rate of their slower partner. Nonlinear delay-coupled models (with time delay, coupling strength, and intrinsic frequency) outperformed linear models (intrinsic frequency only) in accounting for tappers’ synchronization adjustments. The nonlinear model’s coupling value increased for musically trained participants, relative to untrained participants. Overall, these findings suggest that both intrinsic differences in partners’ spontaneous rates and the social turn-taking context contribute to the range of synchrony in the general population. Delay-coupled models are capable of capturing the wide range of individual differences in auditory-motor synchronization.

Windowed multiscale synchrony: modeling time-varying and scale-localized interpersonal coordination dynamics

Social interactions are pervasive in human life with varying forms of interpersonal coordination emerging and spanning different modalities (e.g. behaviors, speech/language, and neurophysiology). However, during social interactions, as in any dynamical system, patterns of coordination form and dissipate at different scales. Historically, researchers have used aggregate measures to capture coordination over time. While those measures (e.g. mean relative phase, cross-correlation, coherence) have provided a wealth of information about coordination in social settings, some evidence suggests that multiscale coordination may change over the time course of a typical empirical observation. To address this gap, we demonstrate an underutilized method, windowed multiscale synchrony, that moves beyond quantifying aggregate measures of coordination by focusing on how the relative strength of coordination changes over time and the scales that comprise social interaction. This method involves using a wavelet transform to decompose time series into component frequencies (i.e. scales), preserving temporal information and then quantifying phase synchronization at each of these scales. We apply this method to both simulated and empirical interpersonal physiological and neuromechanical data. We anticipate that demonstrating this method will stimulate new insights on the mechanisms and functions of synchrony in interpersonal contexts using neurophysiological and behavioral measures.

Anticipated synchronization in human EEG data: Unidirectional causality with negative phase lag

Understanding the functional connectivity of the brain has become a major goal of neuroscience. In many situations the relative phase difference, together with coherence patterns, has been employed to infer the direction of the information flow. However, it has been recently shown in local field potential data from monkeys the existence of a synchronized regime in which unidirectionally coupled areas can present both positive and negative phase differences. During the counterintuitive regime, called anticipated synchronization (AS), the phase difference does not reflect the causality. Here we investigate coherence and causality at the alpha frequency band (f∼10 Hz) between pairs of electroencephalogram (EEG) electrodes in humans during a GO/NO-GO task. We show that human EEG signals can exhibit anticipated synchronization, which is characterized by a unidirectional influence from an electrode A to an electrode B, but the electrode B leads the electrode A in time. To the best of our knowledge, this is the first verification of AS in EEG signals and in the human brain. The usual delayed synchronization (DS) regime is also present between many pairs. DS is characterized by a unidirectional influence from an electrode A to an electrode B and a positive phase difference between A and B which indicates that the electrode A leads the electrode B in time. Moreover we show that EEG signals exhibit diversity in the phase relations: the pairs of electrodes can present in-phase, antiphase, or out-of-phase synchronization with a similar distribution of positive and negative phase differences.

Grip force anticipation of nonlinear, underactuated load force

Feedforward internal model-based control enabled by efference copies of motor commands is the prevailing theoretical account of motor anticipation. Grip force control during object manipulation-a paradigmatic example of motor anticipation-is a key line of evidence for that account. However, the internal model approach has not addressed the computational challenges faced by the act of manipulating mechanically complex objects with nonlinear, underactuated degrees of freedom. These objects exhibit complex and unpredictable load force dynamics which cannot be encoded by efference copies of underlying motor commands, leading to the prediction from the perspective of an efference copy-enabled feedforward control scheme that grip force should either lag or fail to coordinate with changes in load force. In contrast to that prediction, we found evidence for strong, precise, anticipatory grip force control during manipulations of a complex object. The results are therefore inconsistent with the internal forward model approach and suggest that efference copies of motor commands are not necessary to enable anticipatory control during active object manipulation.NEW & NOTEWORTHY From the perspective of feedforward internal model-based control, precise, anticipatory grip force (GF) control when manipulating a complex object should not be possible as the object's changing load forces (LFs) cannot be encoded by efference copies of the underlying movements. However, we observed that GF exhibited strong, precise, anticipatory coupling with LF during extended manipulations of a complex object. These findings suggest that an alternative theoretical framework is needed to account for anticipatory GF control.

Interactional synchrony: signals, mechanisms and benefits

Many group-living animals, humans included, occasionally synchronize their behavior with that of conspecifics. Social psychology and neuroscience have attempted to explain this phenomenon. Here we sought to integrate results around three themes: the stimuli, the mechanisms and the benefits of interactional synchrony. As regards stimuli, we asked what characteristics, apart from temporal regularity, prompt synchronization and found that stimulus modality and complexity are important. The high temporal resolution of the auditory system and the relevance of socio-emotional information endow auditory, multimodal, emotional and somewhat variable and adaptive sequences with particular synchronizing power. Looking at the mechanisms revealed that traditional perspectives emphasizing beat-based representations of others' signals conflict with more recent work investigating the perception of temporal regularity. Timing processes supported by striato-cortical loops represent any kind of repetitive interval sequence fairly automatically. Additionally, socio-emotional processes supported by posterior superior temporal cortex help endow such sequences with value motivating the extent of synchronizing. Synchronizing benefits arise from an increased predictability of incoming signals and include many positive outcomes ranging from basic information processing at the individual level to the bonding of dyads and larger groups.

Phase bistability between anticipated and delayed synchronization in neuronal populations

Two dynamical systems unidirectionally coupled in a sender-receiver configuration can synchronize with a nonzero phase lag. In particular, the system can exhibit anticipated synchronization (AS), which is characterized by a negative phase lag, if the receiver also receives a delayed negative self-feedback. Recently, AS was shown to occur between cortical-like neuronal populations in which the self-feedback is mediated by inhibitory synapses. In this biologically plausible scenario, a transition from the usual delayed synchronization (with positive phase lag) to AS can be mediated by the inhibitory conductances in the receiver population. Here we show that depending on the relation between excitatory and inhibitory synaptic conductances the system can also exhibit phase bistability between anticipated and delayed synchronization. Furthermore, we show that the amount of noise at the receiver and the synaptic conductances can mediate the transition from stable phase locking to a bistable regime and eventually to a phase drift. We suggest that our spiking neuronal populations model could be potentially useful to study phase bistability in cortical regions related to bistable perception.