Electrophysiological Activity from the Eye Muscles, Cerebellum and Cerebrum During Reflexive (Classical Pavlovian) Versus Voluntary (Ivanov-Smolensky) Eye-Blink Conditioning

We report an experiment to investigate the role of the cerebellum and cerebrum in motor learning of timed movements. Eleven healthy human subjects were recruited to perform two experiments, the first was a classical eye-blink conditioning procedure with an auditory tone as conditional stimulus (CS) and vestibular unconditional stimulus (US) in the form of a double head-tap. In the second experiment, subjects were asked to blink voluntarily in synchrony with the double head-tap US preceded by a CS, a form of Ivanov-Smolensky conditioning in which a command or instruction is associated with the US. Electrophysiological recordings were made of extra-ocular EMG and EOG at infra-ocular sites (IO1/2), EEG from over the frontal eye fields (C3'/C4') and from over the posterior fossa over the cerebellum for the electrocerebellogram (ECeG). The behavioural outcomes of the experiments showed weak reflexive conditioning for the first experiment despite the double tap but robust, well-synchronised voluntary conditioning for the second. Voluntary conditioned blinks were larger than the reflex ones. For the voluntary conditioning experiment, a contingent negative variation (CNV) was also present in the EEG leads prior to movement, and modulation of the high-frequency EEG occurred during movement. US-related cerebellar activity was prominent in the high-frequency ECeG for both experiments, while conditioned response-related cerebellar activity was additionally present in the voluntary conditioning experiment. These results demonstrate a role for the cerebellum in voluntary (Ivanov-Smolensky) as well as in reflexive (classical Pavlovian) conditioning.

A practical guide to EEG hyperscanning in joint action research: from motivation to implementation

Developments in cognitive neuroscience have led to the emergence of hyperscanning, the simultaneous measurement of brain activity from multiple people. Hyperscanning is useful for investigating social cognition, including joint action, because of its ability to capture neural processes that occur within and between people as they coordinate actions toward a shared goal. Here, we provide a practical guide for researchers considering using hyperscanning to study joint action and seeking to avoid frequently raised concerns from hyperscanning skeptics. We focus specifically on Electroencephalography (EEG) hyperscanning, which is widely available and optimally suited for capturing fine-grained temporal dynamics of action coordination. Our guidelines cover questions that are likely to arise when planning a hyperscanning project, ranging from whether hyperscanning is appropriate for answering one's research questions to considerations for study design, dependent variable selection, data analysis and visualization. By following clear guidelines that facilitate careful consideration of the theoretical implications of research design choices and other methodological decisions, joint action researchers can mitigate interpretability issues and maximize the benefits of hyperscanning paradigms.

Leadership dynamics in musical groups: Quantifying effects of musical structure on directionality of influence in concert performance videos

Music ensemble performance provides an ecologically valid context for investigating leadership dynamics in small group interactions. Musical texture, specifically the relative salience of simultaneously sounding ensemble parts, is a feature that can potentially alter leadership dynamics by introducing hierarchical relationships between individual parts. The present study extended previous work on quantifying interpersonal coupling in musical ensembles by examining the relationship between musical texture and leader-follower relations, operationalised as directionality of influence between co-performers' body motion in concert video recordings. It was hypothesised that the directionality of influence, indexed by Granger Causality, would be greater for 'homophonic' textures with a clear distinction between melody and accompaniment parts than for 'polyphonic' textures with less distinction between melody and accompaniment. This hypothesis was tested by using pose estimation algorithms to track instrumentalists' body movements in a string quartet and a clarinet quintet, and then applying Granger Causality analysis to their head motion to estimate directional influence between instrumentalist pairs for sections of the pieces that varied in texture. It was found that Granger Causality values were generally higher (indicating greater directionality of influence) for homophonic than polyphonic textures. Furthermore, considering melody and accompaniment instrument roles revealed more evidence for the melody instrument influencing accompanying instruments than vice versa, plus a high degree of directionality among accompanying instruments, in homophonic textures. These observed patterns of directional information flow in co-performer body motion are consistent with changing leader-follower relations depending on hierarchical relations between ensemble parts in terms of the relative salience of melodic material in the musical texture. The finding that automatic pose estimation can detect modulations of leadership dynamics in standard video recordings under naturalistic performance conditions has implications for investigating interpersonal coordination in large-scale music video datasets representing different cultural traditions, and for exploring nonverbal communication in group activities more generally.

A review of psychological and neuroscientific research on musical groove

When listening to music, we naturally move our bodies rhythmically to the beat, which can be pleasurable and difficult to resist. This pleasurable sensation of wanting to move the body to music has been called "groove." Following pioneering humanities research, psychological and neuroscientific studies have provided insights on associated musical features, behavioral responses, phenomenological aspects, and brain structural and functional correlates of the groove experience. Groove research has advanced the field of music science and more generally informed our understanding of bidirectional links between perception and action, and the role of the motor system in prediction. Activity in motor and reward-related brain networks during music listening is associated with the groove experience, and this neural activity is linked to temporal prediction and learning. This article reviews research on groove as a psychological phenomenon with neurophysiological correlates that link musical rhythm perception, sensorimotor prediction, and reward processing. Promising future research directions range from elucidating specific neural mechanisms to exploring clinical applications and socio-cultural implications of groove.

You, me, and us: Maintaining self-other distinction enhances coordination, agency, and affect

Coordinating our actions with others changes how we behave and feel. Here, we provide evidence that interacting with others rests on a balance between self-other integration and segregation. Using a group walking paradigm, participants were instructed to synchronize with a metronome while listening to the sounds of 8 virtual partners. By manipulating the similarity and synchronicity of the partners' steps to the participant's own, our novel auditory task disentangles the effects of synchrony and self-other similarity and examines their contribution to both collective and individual awareness. We measured temporal coordination (step timing regularity and synchrony with the metronome), gait patterns, and subjective reports about sense of self and group cohesion. The main findings show that coordination is best when participants hear distinct but synchronous virtual others, leading to greater subjective feelings of agency, strength, dominance, and happiness.

Sex-related communicative functions of voice spectral energy in human chorusing

Music is a human communicative art whose evolutionary origins may lie in capacities that support cooperation and/or competition. A mixed account favouring simultaneous cooperation and competition draws on analogous interactive displays produced by collectively signalling non-human animals (e.g. crickets and frogs). In these displays, rhythmically coordinated calls serve as a beacon whereby groups of males 'cooperatively' attract potential female mates, while the likelihood of each male competitively attracting an actual mate depends on the precedence of his signal. Human behaviour consistent with the mixed account was previously observed in a renowned boys choir, where the basses-the oldest boys with the deepest voices-boosted their acoustic prominence by increasing energy in a high-frequency band of the vocal spectrum when girls were in an otherwise male audience. The current study tested female and male sensitivity and preferences for this subtle vocal modulation in online listening tasks. Results indicate that while female and male listeners are similarly sensitive to enhanced high-spectral energy elicited by the presence of girls in the audience, only female listeners exhibit a reliable preference for it. Findings suggest that human chorusing is a flexible form of social communicative behaviour that allows simultaneous group cohesion and sexually motivated competition.

Extended source analysis of movement related potentials (MRPs) for self-paced hand and foot movements demonstrates opposing cerebral and cerebellar laterality: a preliminary study

The cerebellum is known to have extensive reciprocal connectivity with the cerebral cortex, including with prefrontal and posterior parietal cortex, which play an important role on the planning and execution of voluntary movement. In the present article we report an exploratory non-invasive electrophysiological study of the activity of the cerebellum and cerebrum during voluntary finger and foot movements. In a sample of five healthy adult subjects, we recorded EEG and the electro-cerebellogram (ECeG) with a 10% cerebellar extension montage during voluntary left and right index finger and foot movements. EMG was recorded from finger extensors and flexors and from the tibialis anterior and soleus muscles and was used to generate triggers for movement related averaging (-2000 to +2000 ms). Source analysis was conducted over five epochs defined relative to EMG onset: whole epoch (-1000 to +1000 ms), pre-move 1000 (-1000 to 0 ms), pre-move 500 (-500 to 0 ms), post-move 500 (0 to +500 ms) and post-move 1000 (0 to +1000 ms). This yielded a total of 123 cerebral and 65 cerebellar dipole clusters from across all epochs, including the pre-movement epochs, which were then subject to statistical analysis. These demonstrated predominantly contralateral dominance for the cerebral clusters, but predominantly ipsilateral dominance for the cerebellar clusters. In addition, both cerebral and cerebellar clusters showed evidence of a somatotopic gradient, medially (X-axis) for the cerebral clusters, and medially and dorso-ventrally (Z-axis) for the cerebellar clusters. These findings support the value of recording cerebellar ECeG and demonstrate its potential to contribute to understanding cerebellar function.

Infants show enhanced neural responses to musical meter frequencies beyond low-level features

Music listening often entails spontaneous perception and body movement to a periodic pulse-like meter. There is increasing evidence that this cross-cultural ability relates to neural processes that selectively enhance metric periodicities, even when these periodicities are not prominent in the acoustic stimulus. However, whether these neural processes emerge early in development remains largely unknown. Here, we recorded the electroencephalogram (EEG) of 20 healthy 5- to 6-month-old infants, while they were exposed to two rhythms known to induce the perception of meter consistently across Western adults. One rhythm contained prominent acoustic periodicities corresponding to the meter, whereas the other rhythm did not. Infants showed significantly enhanced representations of meter periodicities in their EEG responses to both rhythms. This effect is unlikely to reflect the tracking of salient acoustic features in the stimulus, as it was observed irrespective of the prominence of meter periodicities in the audio signals. Moreover, as previously observed in adults, the neural enhancement of meter was greater when the rhythm was delivered by low-pitched sounds. Together, these findings indicate that the endogenous enhancement of metric periodicities beyond low-level acoustic features is a neural property that is already present soon after birth. These high-level neural processes could set the stage for internal representations of musical meter that are critical for human movement coordination during rhythmic musical behavior. RESEARCH HIGHLIGHTS: 5- to 6-month-old infants were presented with auditory rhythms that induce the perception of a periodic pulse-like meter in adults. Infants showed selective enhancement of EEG activity at meter-related frequencies irrespective of the prominence of these frequencies in the stimulus. Responses at meter-related frequencies were boosted when the rhythm was conveyed by bass sounds. High-level neural processes that transform rhythmic auditory stimuli into internal meter templates emerge early after birth.

The Neuroscience of Dance: A Conceptual Framework and Systematic Review

Ancient and culturally universal, dance pervades many areas of life and has multiple benefits. In this article, we provide a conceptual framework and systematic review, as a guide for researching the neuroscience of dance. We identified relevant articles following PRISMA guidelines, and summarised and evaluated all original results. We identified avenues for future research in: the interactive and collective aspects of dance; groove; dance performance; dance observation; and dance therapy. Furthermore, the interactive and collective aspects of dance constitute a vital part of the field but have received almost no attention from a neuroscientific perspective so far. Dance and music engage overlapping brain networks, including common regions involved in perception, action, and emotion. In music and dance, rhythm, melody, and harmony are processed in an active, sustained pleasure cycle giving rise to action, emotion, and learning, led by activity in specific hedonic brain networks. The neuroscience of dance is an exciting field, which may yield information concerning links between psychological processes and behaviour, human flourishing, and the concept of eudaimonia.

Measuring rhythms of vocal interactions: a proof of principle in harbour seal pups

Rhythmic patterns in interactive contexts characterize human behaviours such as conversational turn-taking. These timed patterns are also present in other animals, and often described as rhythm. Understanding fine-grained temporal adjustments in interaction requires complementary quantitative methodologies. Here, we showcase how vocal interactive rhythmicity in a non-human animal can be quantified using a multi-method approach. We record vocal interactions in harbour seal pups (Phoca vitulina) under controlled conditions. We analyse these data by combining analytical approaches, namely categorical rhythm analysis, circular statistics and time series analyses. We test whether pups' vocal rhythmicity varies across behavioural contexts depending on the absence or presence of a calling partner. Four research questions illustrate which analytical approaches are complementary versus orthogonal. For our data, circular statistics and categorical rhythms suggest that a calling partner affects a pup's call timing. Granger causality suggests that pups predictively adjust their call timing when interacting with a real partner. Lastly, the ADaptation and Anticipation Model estimates statistical parameters for a potential mechanism of temporal adaptation and anticipation. Our analytical complementary approach constitutes a proof of concept; it shows feasibility in applying typically unrelated techniques to seals to quantify vocal rhythmic interactivity across behavioural contexts. This article is part of a discussion meeting issue 'Face2face: advancing the science of social interaction'.

Can rhythm-mediated reward boost learning, memory, and social connection? Perspectives for future research

Studies of rhythm processing and of reward have progressed separately, with little connection between the two. However, consistent links between rhythm and reward are beginning to surface, with research suggesting that synchronization to rhythm is rewarding, and that this rewarding element may in turn also boost this synchronization. The current mini review shows that the combined study of rhythm and reward can be beneficial to better understand their independent and combined roles across two central aspects of cognition: 1) learning and memory, and 2) social connection and interpersonal synchronization; which have so far been studied largely independently. From this basis, it is discussed how connections between rhythm and reward can be applied to learning and memory and social connection across different populations, taking into account individual differences, clinical populations, human development, and animal research. Future research will need to consider the rewarding nature of rhythm, and that rhythm can in turn boost reward, potentially enhancing other cognitive and social processes.

Cortico-cerebellar audio-motor regions coordinate self and other in musical joint action

Joint music performance requires flexible sensorimotor coordination between self and other. Cognitive and sensory parameters of joint action-such as shared knowledge or temporal (a)synchrony-influence this coordination by shifting the balance between self-other segregation and integration. To investigate the neural bases of these parameters and their interaction during joint action, we asked pianists to play on an MR-compatible piano, in duet with a partner outside of the scanner room. Motor knowledge of the partner's musical part and the temporal compatibility of the partner's action feedback were manipulated. First, we found stronger activity and functional connectivity within cortico-cerebellar audio-motor networks when pianists had practiced their partner's part before. This indicates that they simulated and anticipated the auditory feedback of the partner by virtue of an internal model. Second, we observed stronger cerebellar activity and reduced behavioral adaptation when pianists encountered subtle asynchronies between these model-based anticipations and the perceived sensory outcome of (familiar) partner actions, indicating a shift towards self-other segregation. These combined findings demonstrate that cortico-cerebellar audio-motor networks link motor knowledge and other-produced sounds depending on cognitive and sensory factors of the joint performance, and play a crucial role in balancing self-other integration and segregation.

Brain networks for temporal adaptation, anticipation, and sensory-motor integration in rhythmic human behavior

Human interaction often requires the precise yet flexible interpersonal coordination of rhythmic behavior, as in group music making. The present fMRI study investigates the functional brain networks that may facilitate such behavior by enabling temporal adaptation (error correction), prediction, and the monitoring and integration of information about 'self' and the external environment. Participants were required to synchronize finger taps with computer-controlled auditory sequences that were presented either at a globally steady tempo with local adaptations to the participants' tap timing (Virtual Partner task) or with gradual tempo accelerations and decelerations but without adaptation (Tempo Change task). Connectome-based predictive modelling was used to examine patterns of brain functional connectivity related to individual differences in behavioral performance and parameter estimates from the adaptation and anticipation model (ADAM) of sensorimotor synchronization for these two tasks under conditions of varying cognitive load. Results revealed distinct but overlapping brain networks associated with ADAM-derived estimates of temporal adaptation, anticipation, and the integration of self-controlled and externally controlled processes across task conditions. The partial overlap between ADAM networks suggests common hub regions that modulate functional connectivity within and between the brain's resting-state networks and additional sensory-motor regions and subcortical structures in a manner reflecting coordination skill. Such network reconfiguration might facilitate sensorimotor synchronization by enabling shifts in focus on internal and external information, and, in social contexts requiring interpersonal coordination, variations in the degree of simultaneous integration and segregation of these information sources in internal models that support self, other, and joint action planning and prediction.

Spatial and temporal (non)binding of audiovisual rhythms in sensorimotor synchronisation

Human movement synchronisation with moving objects strongly relies on visual input. However, auditory information also plays an important role, since real environments are intrinsically multimodal. We used electroencephalography (EEG) frequency tagging to investigate the selective neural processing and integration of visual and auditory information during motor tracking and tested the effects of spatial and temporal congruency between audiovisual modalities. EEG was recorded while participants tracked with their index finger a red flickering (rate f_V = 15 Hz) dot oscillating horizontally on a screen. The simultaneous auditory stimulus was modulated in pitch (rate f_A = 32 Hz) and lateralised between left and right audio channels to induce perception of a periodic displacement of the sound source. Audiovisual congruency was manipulated in terms of space in Experiment 1 (no motion, same direction or opposite direction), and timing in Experiment 2 (no delay, medium delay or large delay). For both experiments, significant EEG responses were elicited at f_V and f_A tagging frequencies. It was also hypothesised that intermodulation products corresponding to the nonlinear integration of visual and auditory stimuli at frequencies f_V ± f_A would be elicited, due to audiovisual integration, especially in Congruent conditions_. However, these components were not observed. Moreover, synchronisation and EEG results were not influenced by congruency manipulations, which invites further exploration of the conditions which may modulate audiovisual processing and the motor tracking of moving objects.

Electrophysiological activity from over the cerebellum and cerebrum during eye blink conditioning in human subjects

We report the results of an experiment in which electrophysiological activity was recorded from the human cerebellum and cerebrum in a sample of 14 healthy subjects before, during and after a classical eye blink conditioning procedure with an auditory tone as conditional stimulus and a maxillary nerve unconditional stimulus. The primary aim was to show changes in the cerebellum and cerebrum correlated with behavioral ocular responses. Electrodes recorded EMG and EOG at peri-ocular sites, EEG from over the frontal eye-fields and the electrocerebellogram (ECeG) from over the posterior fossa. Of the 14 subjects half strongly conditioned while the other half were resistant. We confirmed that conditionability was linked under our conditions to the personality dimension of extraversion-introversion. Inhibition of cerebellar activity was shown prior to the conditioned response, as predicted by Albus (1971). However, pausing in high frequency ECeG and the appearance of a contingent negative variation (CNV) in both central leads occurred in all subjects. These led us to conclude that while conditioned cerebellar pausing may be necessary, it is not sufficient alone to produce overt behavioral conditioning, implying the existence of another central mechanism. The outcomes of this experiment indicate the potential value of the noninvasive electrophysiology of the cerebellum.

Neural tracking of visual periodic motion

Periodicity is a fundamental property of biological systems, including human movement systems. Periodic movements support displacements of the body in the environment as well as interactions and communication between individuals. Here, we use electroencephalography (EEG) to investigate the neural tracking of visual periodic motion, and more specifically, the relevance of spatiotemporal information contained at and between their turning points. We compared EEG responses to visual sinusoidal oscillations versus nonlinear Rayleigh oscillations, which are both typical of human movements. These oscillations contain the same spatiotemporal information at their turning points but differ between turning points, with Rayleigh oscillations having an earlier peak velocity, shown to increase an individual's capacity to produce accurately synchronized movements. EEG analyses highlighted the relevance of spatiotemporal information between the turning points by showing that the brain precisely tracks subtle differences in velocity profiles, as indicated by earlier EEG responses for Rayleigh oscillations. The results suggest that the brain is particularly responsive to velocity peaks in visual periodic motion, supporting their role in conveying behaviorally relevant timing information at a neurophysiological level. The results also suggest key functions of neural oscillations in the Alpha and Beta frequency bands, particularly in the right hemisphere. Together, these findings provide insights into the neural mechanisms underpinning the processing of visual periodic motion and the critical role of velocity peaks in enabling proficient visuomotor synchronization.

Endogenous sources of interbrain synchrony in duetting pianists

When people interact with each other, their brains synchronize. However, it remains unclear whether interbrain synchrony (IBS) is functionally relevant for social interaction or stems from exposure of individual brains to identical sensorimotor information. To disentangle these views, the current dual-EEG study investigated amplitude-based IBS in pianists jointly performing duets containing a silent pause followed by a tempo change. First, we manipulated the similarity of the anticipated tempo change and measured IBS during the pause, hence, capturing the alignment of purely endogenous, temporal plans without sound or movement. Notably, right posterior gamma IBS was higher when partners planned similar tempi, it predicted whether partners' tempi matched after the pause, and it was modulated only in real, not in surrogate pairs. Second, we manipulated the familiarity with the partner's actions and measured IBS during joint performance with sound. Although sensorimotor information was similar across conditions, gamma IBS was higher when partners were unfamiliar with each other's part and had to attend more closely to the sound of the performance. These combined findings demonstrate that IBS is not merely an epiphenomenon of shared sensorimotor information but can also hinge on endogenous, cognitive processes crucial for behavioral synchrony and successful social interaction.

Lateralised dynamic modulations of corticomuscular coherence associated with bimanual learning of rhythmic patterns

Human movements are spontaneously attracted to auditory rhythms, triggering an automatic activation of the motor system, a central phenomenon to music perception and production. Cortico-muscular coherence (CMC) in the theta, alpha, beta and gamma frequencies has been used as an index of the synchronisation between cortical motor regions and the muscles. Here we investigated how learning to produce a bimanual rhythmic pattern composed of low- and high-pitch sounds affects CMC in the beta frequency band. Electroencephalography (EEG) and electromyography (EMG) from the left and right First Dorsal Interosseus and Flexor Digitorum Superficialis muscles were concurrently recorded during constant pressure on a force sensor held between the thumb and index finger while listening to the rhythmic pattern before and after a bimanual training session. During the training, participants learnt to produce the rhythmic pattern guided by visual cues by pressing the force sensors with their left or right hand to produce the low- and high-pitch sounds, respectively. Results revealed no changes after training in overall beta CMC or beta oscillation amplitude, nor in the correlation between the left and right sides for EEG and EMG separately. However, correlation analyses indicated that left- and right-hand beta EEG-EMG coherence were positively correlated over time before training but became uncorrelated after training. This suggests that learning to bimanually produce a rhythmic musical pattern reinforces lateralised and segregated cortico-muscular communication.

Neural Correlates of Listening to Varying Synchrony Between Beats in Samba Percussion and Relations to Feeling the Groove

Listening to samba percussion often elicits feelings of pleasure and the desire to move with the beat-an experience sometimes referred to as "feeling the groove"- as well as social connectedness. Here we investigated the effects of performance timing in a Brazilian samba percussion ensemble on listeners' experienced pleasantness and the desire to move/dance in a behavioral experiment, as well as on neural processing as assessed via functional magnetic resonance imaging (fMRI). Participants listened to different excerpts of samba percussion produced by multiple instruments that either were "in sync", with no additional asynchrony between instrumental parts other than what is usual in naturalistic recordings, or were presented "out of sync" by delaying the snare drums (by 28, 55, or 83 ms). Results of the behavioral experiment showed increasing pleasantness and desire to move/dance with increasing synchrony between instruments. Analysis of hemodynamic responses revealed stronger bilateral brain activity in the supplementary motor area, the left premotor area, and the left middle frontal gyrus with increasing synchrony between instruments. Listening to "in sync" percussion thus strengthens audio-motor interactions by recruiting motor-related brain areas involved in rhythm processing and beat perception to a higher degree. Such motor related activity may form the basis for "feeling the groove" and the associated desire to move to music. Furthermore, in an exploratory analysis we found that participants who reported stronger emotional responses to samba percussion in everyday life showed higher activity in the subgenual cingulate cortex, an area involved in prosocial emotions, social group identification and social bonding.

Lateral Prefrontal Cortex Is a Hub for Music Production from Structural Rules to Movements

Complex sequential behaviors, such as speaking or playing music, entail flexible rule-based chaining of single acts. However, it remains unclear how the brain translates abstract structural rules into movements. We combined music production with multimodal neuroimaging to dissociate high-level structural and low-level motor planning. Pianists played novel musical chord sequences on a muted MR-compatible piano by imitating a model hand on screen. Chord sequences were manipulated in terms of musical harmony and context length to assess structural planning, and in terms of fingers used for playing to assess motor planning. A model of probabilistic sequence processing confirmed temporally extended dependencies between chords, as opposed to local dependencies between movements. Violations of structural plans activated the left inferior frontal and middle temporal gyrus, and the fractional anisotropy of the ventral pathway connecting these two regions positively predicted behavioral measures of structural planning. A bilateral frontoparietal network was instead activated by violations of motor plans. Both structural and motor networks converged in lateral prefrontal cortex, with anterior regions contributing to musical structure building, and posterior areas to movement planning. These results establish a promising approach to study sequence production at different levels of action representation.

Mapping between sound, brain and behaviour: four-level framework for understanding rhythm processing in humans and non-human primates

Humans perceive and spontaneously move to one or several levels of periodic pulses (a meter, for short) when listening to musical rhythm, even when the sensory input does not provide prominent periodic cues to their temporal location. Here, we review a multi-levelled framework to understanding how external rhythmic inputs are mapped onto internally represented metric pulses. This mapping is studied using an approach to quantify and directly compare representations of metric pulses in signals corresponding to sensory inputs, neural activity and behaviour (typically body movement). Based on this approach, recent empirical evidence can be drawn together into a conceptual framework that unpacks the phenomenon of meter into four levels. Each level highlights specific functional processes that critically enable and shape the mapping from sensory input to internal meter. We discuss the nature, constraints and neural substrates of these processes, starting with fundamental mechanisms investigated in macaque monkeys that enable basic forms of mapping between simple rhythmic stimuli and internally represented metric pulse. We propose that human evolution has gradually built a robust and flexible system upon these fundamental processes, allowing more complex levels of mapping to emerge in musical behaviours. This approach opens promising avenues to understand the many facets of rhythmic behaviours across individuals and species. This article is part of the theme issue 'Synchrony and rhythm interaction: from the brain to behavioural ecology'.

Not all errors are alike: modulation of error-related neural responses in musical joint action

During joint action, the sense of agency enables interaction partners to implement corrective and adaptive behaviour in response to performance errors. When agency becomes ambiguous (e.g. when action similarity encourages perceptual self-other overlap), confusion as to who produced what may disrupt this process. The current experiment investigated how ambiguity of agency affects behavioural and neural responses to errors in a joint action domain where self-other overlap is common: musical duos. Pairs of pianists performed piano pieces in synchrony, playing either the same pitches (ambiguous agency) or different pitches (unambiguous agency) while electroencephalography (EEG) was recorded for each individual. Behavioural and event-related potential results showed no effects of the agency manipulation but revealed differences in how distinct error types are processed. Self-produced 'wrong note' errors (substitutions) were left uncorrected, showed post-error slowing and elicited an error-related negativity (ERN) peaking before erroneous keystrokes (pre-ERN). In contrast, self-produced 'extra note' errors (additions) exhibited pre-error slowing, error and post-error speeding, were rapidly corrected and elicited the ERN. Other-produced errors evoked a feedback-related negativity but no behavioural effects. Overall findings shed light upon how the nervous system supports fluent interpersonal coordination in real-time joint action by employing distinct mechanisms to manage different types of errors.

Dynamic Modulation of Beta Band Cortico-Muscular Coupling Induced by Audio-Visual Rhythms

Human movements often spontaneously fall into synchrony with auditory and visual environmental rhythms. Related behavioral studies have shown that motor responses are automatically and unintentionally coupled with external rhythmic stimuli. However, the neurophysiological processes underlying such motor entrainment remain largely unknown. Here, we investigated with electroencephalography (EEG) and electromyography (EMG) the modulation of neural and muscular activity induced by periodic audio and/or visual sequences. The sequences were presented at either 1 or 2 Hz, while participants maintained constant finger pressure on a force sensor. The results revealed that although there was no change of amplitude in participants' EMG in response to the sequences, the synchronization between EMG and EEG recorded over motor areas in the beta (12-40 Hz) frequency band was dynamically modulated, with maximal coherence occurring about 100 ms before each stimulus. These modulations in beta EEG-EMG motor coherence were found for the 2-Hz audio-visual sequences, confirming at a neurophysiological level the enhancement of motor entrainment with multimodal rhythms that fall within preferred perceptual and movement frequency ranges. Our findings identify beta band cortico-muscular coupling as a potential underlying mechanism of motor entrainment, further elucidating the nature of the link between sensory and motor systems in humans.

Simultaneous self-other integration and segregation support real-time interpersonal coordination in a musical joint action task

The ability to distinguish between an individual's own actions and those of another person is a requirement for successful joint action, particularly in domains such as group music making where precise interpersonal coordination ensures perceptual overlap in the effects of co-performers' actions. We tested the hypothesis that such coordination benefits from simultaneous integration and segregation of information about 'self' and 'other' in an experiment using a musical joint action paradigm. Sixteen pairs of individuals with little or no musical training performed a dyadic synchronization task on a pair of electronic music boxes. The relationship between pitches produced by paired participants (same vs. different) and the relationship between movement frequencies required to trigger synchronous tones (congruent vs. incongruent) were varied in a repeated measures design. The results indicate that interpersonal coordination was most accurate when sounds were different in pitch but movement frequency was congruent. Under other conditions, participants often drifted apart, resulting in poor coordination, especially with same sounds and incongruent movements across co-performers. These findings suggest that interpersonal coordination was facilitated when simultaneous self-other integration and segregation occurred across sensory modalities in an asymmetrical manner where pitch relations favoured segregation via auditory streaming while movement congruence favoured integration via visuo-motor coupling. Such self-other representational balance may enable co-performers to maintain autonomous control while attending, anticipating, and adapting to each other's timing when joint action requires precise temporal coordination.

Effects of Stimulus Intensity and Frequency on the Force and Timing of Sensorimotor Synchronisation

We report an experiment to investigate possible vestibular effects on finger tapping to an auditory anapaest rhythm. In a sample of 10 subjects, index finger acceleration and tapping force were recorded along with extensor/flexor activity and the associated electroencephalographic activity measured at central and cerebellar surface electrodes. In a prior session with a standard short air-conducted 500-Hz pip, vestibular evoked myogenic potential thresholds were measured and subsequently used to set the acoustic intensity. During the main experiment subjects were asked to synchronise tapping to the pips arranged in the anapaest at two different frequencies, 500 Hz vs 5 kHz, so that only the low-frequency high-intensity condition was a vestibular, as well as an auditory stimulus. We hypothesised that a vestibular effect would manifest in an interaction between the frequency and intensity factors for a range of dependent measures of tapping performance. No clear evidence was found for vestibular effects, but this was likely due to the confounding effects of an independent effect of intensity and the relative weakness of the acoustic vestibular stimulus. However, the data did show novel evidence for two distinct timing processes for the flexion and extension stages of a tap cycle and two distinct timing strategies, which we refer to as ‘staccato’ and ‘legato’, characterised by different profiles of force and extension.

Dynamic modulation of cortico-muscular coupling during real and imagined sensorimotor synchronisation

People have a natural and intrinsic ability to coordinate body movements with rhythms surrounding them, known as sensorimotor synchronisation. This can be observed in daily environments, when dancing or singing along with music, or spontaneously walking, talking or applauding in synchrony with one another. However, the neurophysiological mechanisms underlying accurately synchronised movement with selected rhythms in the environment remain unclear. Here we studied real and imagined sensorimotor synchronisation with interleaved auditory and visual rhythms using cortico-muscular coherence (CMC) to better understand the processes underlying the preparation and execution of synchronised movement. Electroencephalography (EEG), electromyography (EMG) from the finger flexors, and continuous force signals were recorded in 20 participants during tapping and imagined tapping with discrete stimulus sequences consisting of alternating auditory beeps and visual flashes. The results show that the synchronisation between cortical and muscular activity in the beta (14-38 Hz) frequency band becomes time-locked to the taps executed in synchrony with the visual and auditory stimuli. Dynamic modulation in CMC also occurred when participants imagined tapping with the visual stimuli, but with lower amplitude and a different temporal profile compared to real tapping. These results suggest that CMC does not only reflect changes related to the production of the synchronised movement, but also to its preparation, which appears heightened under higher attentional demands imposed when synchronising with the visual stimuli. These findings highlight a critical role of beta band neural oscillations in the cortical-muscular coupling underlying sensorimotor synchronisation.

Accent-induced Modulation of Neural and Movement Patterns during Spontaneous Synchronization to Auditory Rhythms

Human rhythmic movements spontaneously synchronize with auditory rhythms at various frequency ratios. The emergence of more complex relationships—for instance, frequency ratios of 1:2 and 1:3—is enhanced by adding a congruent accentuation pattern (binary for 1:2 and ternary for 1:3), resulting in a 1:1 movement–accentuation relationship. However, this benefit of accentuation on movement synchronization appears to be stronger for the ternary pattern than for the binary pattern. Here, we investigated whether this difference in accent-induced movement synchronization may be related to a difference in the neural tracking of these accentuation profiles. Accented and control unaccented auditory sequences were presented to participants who concurrently produced finger taps at their preferred frequency, and spontaneous movement synchronization was measured. EEG was recorded during passive listening to each auditory sequence. The results revealed that enhanced movement synchronization with ternary accentuation was accompanied by enhanced neural tracking of this pattern. Larger EEG responses at the accentuation frequency were found for the ternary pattern compared with the binary pattern. Moreover, the amplitude of accent-induced EEG responses was positively correlated with the magnitude of accent-induced movement synchronization across participants. Altogether, these findings show that the dynamics of spontaneous auditory–motor synchronization is strongly driven by the multi-time-scale sensory processing of auditory rhythms, highlighting the importance of considering neural responses to rhythmic sequences for understanding and enhancing synchronization performance.

The influence of a conductor and co-performer on auditory-motor synchronisation, temporal prediction, and ancillary entrainment in a musical drumming task

Interpersonal coordination is exemplified in ensemble musicians, who coordinate their actions deliberately in order to achieve temporal synchronisation in their performances. However, musicians also move parts of their bodies unintentionally or spontaneously, sometimes in ways that do not directly produce sound from their instruments. Musicians' movements-intentional or otherwise-provide visual signals to co-performers, which might facilitate temporal synchronisation. In large ensembles, a conductor also provides a visual cue, which has been shown to enhance synchronisation. In the present study, we tested how visual cues from a co-performer and a conductor affect processes of temporal anticipation, synchronisation, and ancillary movements in a sample of primarily non-musicians. We used a dyadic synchronisation drumming task, in which paired participants drummed to the beat of tempo-changing music. We manipulated visual access between partners and a virtual conductor. Results showed that the conductor improved synchronisation with the music, but synchrony with the music did not improve when partners could see each other. Temporal prediction was improved when partners saw the conductor, but not each other. Ancillary movements of the head were more synchronised between partners when they could see each other, and greater ancillary synchrony at beat-related frequencies of movement was associated with greater drumming synchrony. These results suggest that compatible audio-visual cues can improve intentional synchronisation, that ancillary movements are affected by seeing a partner, and that attended vs. incidental visual cues thus have partially dissociable effects on temporal coordination during joint action.

Neural and Behavioral Evidence for Frequency-Selective Context Effects in Rhythm Processing in Humans

When listening to music, people often perceive and move along with a periodic meter. However, the dynamics of mapping between meter perception and the acoustic cues to meter periodicities in the sensory input remain largely unknown. To capture these dynamics, we recorded the electroencephalography while nonmusician and musician participants listened to nonrepeating rhythmic sequences, where acoustic cues to meter frequencies either gradually decreased (from regular to degraded) or increased (from degraded to regular). The results revealed greater neural activity selectively elicited at meter frequencies when the sequence gradually changed from regular to degraded compared with the opposite. Importantly, this effect was unlikely to arise from overall gain, or low-level auditory processing, as revealed by physiological modeling. Moreover, the context effect was more pronounced in nonmusicians, who also demonstrated facilitated sensory-motor synchronization with the meter for sequences that started as regular. In contrast, musicians showed weaker effects of recent context in their neural responses and robust ability to move along with the meter irrespective of stimulus degradation. Together, our results demonstrate that brain activity elicited by rhythm does not only reflect passive tracking of stimulus features, but represents continuous integration of sensory input with recent context.

Neural multimodal integration underlying synchronization with a co-performer in music: Influences of motor expertise and visual information

Sensorimotor synchronization is a general skill that musicians have developed to the highest levels of performance, including synchronization in timing and articulation. This study investigated neurocognitive processes that enable such high levels of performance, specifically testing the relevance of 1) motor resonance and sharing high levels of motor expertise with the co-performer, and 2) the role of visual information in addition to auditory information. Musicians with varying levels of piano expertise (including non-pianists) performed on a single piano key with their right hand along with recordings of a pianist who performed simple melodies with the left hand, synchronizing timing and articulation. The prerecorded performances were presented as audio-only, audio-video, or audio-animation stimuli. Double pulse Transcranial Magnetic Stimulation (dTMS) was applied to test the contribution of the right dorsal premotor cortex (dPMC), an area implicated in motor resonance with observed (left-hand) actions, and the contribution of the right intraparietal sulcus (IPS), an area known for multisensory binding. Results showed effects of dTMS in the conditions that included visual information. IPS stimulation improved synchronization, although this effect was found to reverse in the video condition with higher levels of piano expertise. dPMC stimulation improved or worsened synchronization ability. Level of piano expertise was found to influence this direction in the video condition. These results indicate that high levels of relevant motor expertise are required to beneficially employ visual and motor information of a co-performer for sensorimotor synchronization, which may qualify the effects of dPMC and IPS involvement.

Tutorial and simulations with ADAM: an adaptation and anticipation model of sensorimotor synchronization

Interpersonal coordination of movements often involves precise synchronization of action timing, particularly in expert domains such as ensemble music performance. According to the adaptation and anticipation model (ADAM) of sensorimotor synchronization, precise yet flexible interpersonal coordination is supported by reactive error correction mechanisms and anticipatory mechanisms that exploit systematic patterns in stimulus timing to plan future actions. Here, we provide a tutorial introduction to the computational architecture of ADAM and present a series of single- and dual-virtual agent simulations that examine the model parameters that produce ideal synchronization performance in different tempo conditions. In the single-agent simulations, a virtual agent synchronized responses to steady tempo sequence or a sequence containing gradual tempo changes. Parameters controlling basic reactive error (phase) correction were sufficient for producing ideal synchronization performance at the steady tempo, whereas parameters controlling anticipatory mechanisms were necessary for ideal performance with a tempo-changing sequence. In the dual-agent simulations, two interacting virtual agents produced temporal sequences from either congruent or incongruent internal performance templates specifying a steady tempo or tempo changes. Ideal performance was achieved with reactive error correction alone when both agents implemented the same performance template (either steady tempo or tempo change). In contrast, anticipatory mechanisms played a key role when one agent implemented a steady tempo template and the other agent implemented a tempo change template. These findings have implications for understanding the interplay between reactive and anticipatory mechanisms when agents possess compatible versus incompatible representations of task goals during human-human and human-machine interaction.

Accent-induced stabilization of spontaneous auditory-motor synchronization

Humans spontaneously synchronize their movements with external auditory rhythms such as a metronome or music. Although such synchronization preferentially occurs toward a simple 1:1 movement-sound frequency ratio, the parameters facilitating spontaneous synchronization to more complex frequency ratios remain largely unclear. The present study investigates the dynamics of spontaneous auditory-motor synchronization at a range of frequency ratios between movement and sound, and examines the benefit of simple accentuation pattern on synchronization emergence and stability. Participants performed index finger oscillations at their preferred tempo while listening to a metronome presented at either their preferred tempo, or twice or three times faster (frequency ratios of 1:1, 1:2 or 1:3) with different patterns of accentuation (unaccented, binary or ternary accented), and no instruction to synchronize. Participants' movements were spontaneously entrained to the auditory stimuli in the three different frequency ratio conditions. Moreover, the emergence and stability of the modes of coordination were influenced by the interaction between frequency ratio and pattern of accentuation. Coherent patterns, such as a 1:3 frequency ratio supported by a ternary accentuation, facilitated the emergence and stability of the corresponding mode of coordination. Furthermore, ternary accentuation induced a greater gain in stability for the corresponding mode of coordination than was observed with binary accentuation. Together, these findings demonstrate the importance of matching accentuation pattern and movement tempo for enhanced synchronization, opening new perspectives for stabilizing complex rhythmic motor behaviors, such as running.

Preferred frequency ratios for spontaneous auditory-motor synchronization: Dynamical stability and hysteresis

Humans spontaneously synchronize their movements with external auditory rhythms such as a metronome or music. Although such synchronization preferentially occurs toward simple 1:1 movement-stimulus frequency ratio, the extent to which spontaneous synchronization can also occur toward more complex frequency ratios remains largely unclear. The present study investigates the occurrence and dynamical stability of spontaneous auditory-motor synchronization at multiple frequency ratios. Participants performed index finger oscillations at their preferred tempo while listening to auditory metronomes with frequency progressively increasing or decreasing between 1 Hz and 6 Hz. The results demonstrated that participants' movements were not only entrained toward the 1:1 frequency ratio but also toward the 1:2 ratio. The occurrence and stability of these ratios differed as a function of the direction of frequency change. Participants synchronized to the 1:2 ratio and transitioned to a 1:1 ratio in the descending condition. In the ascending condition only the 1:1 ratio was sustained, for a longer extent than in the descending condition. These results show that the initial coordination pattern influenced pattern transition, demonstrating the occurrence of a hysteresis effect that is typical of complex system dynamics. These findings provide new insight into the mechanisms underlying the occurrence and stability of spontaneous movement synchronization to auditory rhythms.

The influence of visual cues on temporal anticipation and movement synchronization with musical sequences

Music presents a complex case of movement timing, as one to several dozen musicians coordinate their actions at short time-scales. This process is often directed by a conductor who provides a visual beat and guides the ensemble through tempo changes. The current experiment tested the ways in which audio-motor coordination is influenced by visual cues from a conductor's gestures, and how this influence might manifest in two ways: movements used to produce sound related to the music, and movements of the upper-body that do not directly affect sound output. We designed a virtual conductor that was derived from morphed motion capture recordings of human conductors. Two groups of participants (29 musicians and 28 nonmusicians, to test the generalizability of visuo-motor synchronization to non-experts) were shown the virtual conductor, a simple visual metronome, or a stationary circle while completing a drumming task that required synchronization with tempo-changing musical sequences. We measured asynchronies and temporal anticipation in the drumming task, as well as participants' upper-body movement using motion capture. Drumming results suggest the conductor generally improves synchronization by facilitating anticipation of tempo changes in the music. Motion capture results showed that the conductor visual cue elicited more structured head movements than the other two visual cues for nonmusicians only. Multiple regression analysis showed that the nonmusicians with less rigid movement and high anticipation had lower asynchronies. Thus, the visual cues provided by a conductor might serve to facilitate temporal anticipation and more synchronous movement in the general population, but might also cause rigid ancillary movements in some non-experts.

Single (1:1) vs. double (1:2) metronomes for the spontaneous entrainment and stabilisation of human rhythmic movements

Rhythmic movements produced by humans become spontaneously entrained to auditory rhythms in the environment. Evidence suggests that synchronisation to external auditory rhythms can contribute to the stabilisation of movements in time and space, opening new perspectives for motor training and rehabilitation. Here we compared the effects of single (1:1) and double (1:2) metronomes (i.e., one or two stimulations per preferred movement cycle) on spontaneous movement entrainment and stabilisation. We examined the spontaneous entrainment of self-paced hand-held pendulum swinging when single or double metronomes were presented either at the participant's preferred tempo or slightly slower or faster (± 10%). The results showed that participants' movements spontaneously entrained to auditory rhythms, and that the strength of this entrainment was the same for single and double metronomes. However, double metronomes decreased movement tempo stability, whereas single metronomes increased movement tempo stability compared to a control condition without a stimulus. These effects preferentially occurred for metronomes presented at participants' preferred movement tempi and especially for participants whose movements were intrinsically more variable. Participants' movement amplitude stability was also modulated in such a way that the stability of participants who were intrinsically less stable increased, whereas the stability of intrinsically more stable participants decreased with auditory rhythms, an effect that was stronger with double than single metronomes. Moreover, movement stabilisation in time and space were positively correlated, suggesting that tempo and amplitude stabilisation depend on similar processes and may be complementary. These findings provide new insight into the processes underlying auditory-motor entrainment and how auditory rhythms can be used to improve movement stability in time and space.

Intentionality of a co-actor influences sensorimotor synchronisation with a virtual partner

Interpersonal sensorimotor synchronisation requires individuals to anticipate and adapt to their partner's movement timing. Research has demonstrated that the intentionality of a co-actor affects joint action planning, however, less is known about whether co-actor intentionality affects sensorimotor synchronisation. Explicit and implicit knowledge of a synchronisation partner's intentionality may influence coordination by modulating temporal anticipation and adaptation processes. We used a computer-controlled virtual partner (VP) consisting of tempo-changing auditory pacing sequences to simulate either an intentional or unintentional synchronisation partner. The VP was programmed to respond to the participant with low or moderate degrees of error correction, simulating a slightly or moderately adaptive human, respectively. In addition, task instructions were manipulated so that participants were told they were synchronising with either another person or a computer. Results indicated that synchronisation performance improved with the more adaptive VP. In addition, there was an influence of the explicit partner instruction, but this was dependent upon the degree of VP adaptivity and was modulated by subjective preferences for either the human or the computer partner. Beliefs about the intentionality of a synchronisation partner may thus influence interpersonal sensorimotor synchronisation in a manner that is modulated by preferences for interacting with intentional agents.

Effects of pitch and tempo of auditory rhythms on spontaneous movement entrainment and stabilisation

Human movements spontaneously entrain to auditory rhythms, which can help to stabilise movements in time and space. The properties of auditory rhythms supporting the occurrence of this phenomenon, however, remain largely unclear. Here, we investigate in two experiments the effects of pitch and tempo on spontaneous movement entrainment and stabilisation. We examined spontaneous entrainment of hand-held pendulum swinging in time with low-pitched (100 Hz) and high-pitched (1600 Hz) metronomes to test whether low pitch favours movement entrainment and stabilisation. To investigate whether stimulation and movement tempi moderate these effects of pitch, we manipulated (1) participants' preferred movement tempo by varying pendulum mechanical constraints (Experiment 1) and (2) stimulation tempo, which was either equal to, or slightly slower or faster (± 10%) than the participant's preferred movement tempo (Experiment 2). The results showed that participants' movements spontaneously entrained to auditory rhythms, and that this effect was stronger with low-pitched rhythms independently of stimulation and movement tempi. Results also indicated that auditory rhythms can lead to increased movement amplitude and stabilisation of movement tempo and amplitude, particularly when low-pitched. However, stabilisation effects were found to depend on intrinsic movement variability. Auditory rhythms decreased movement variability of individuals with higher intrinsic variability but increased movement variability of individuals with lower intrinsic variability. These findings provide new insights into factors that influence auditory-motor entrainment and how they may be optimised to enhance movement efficiency.

Optimal Tempo for Groove: Its Relation to Directions of Body Movement and Japanese nori

The tendency for groove-based music to induce body movements has been linked to multiple acoustical factors. However, it is unclear how or whether tempo affects groove, although tempo significantly affects other aspects of music perception. To address this issue, the present study investigated effects of tempo, specific rhythmic organizations of patterns, and syncopation on groove and the induction of the sensation of wanting to move. We focused on the directions of body movement in particular by taking into account nori, which is an indigenous Japanese musical term used not only synonymously with groove, but also as a spatial metaphor indicating vertical or horizontal movement directions. Thus, the present study explored how groove was felt and defined, as well as how musical factors induced the sensation of wanting to move in cross-cultural context. A listening experiment was conducted using drum breaks as stimuli. Stimuli consisted of various rhythm patterns at six tempi from 60 to 200 BPM. The main findings are that: (1) an optimal tempo for groove existed for drum breaks at around 100–120 BPM, (2) an optimal tempo existed for the sensation of wanting to move the body in specific directions (i.e., back-and-forth and side-to-side), (3) groove and nori shared a similar concept of wanting to move but differed on several points (i.e., association with sense of pulse and fast tempo). Overall, the present study suggests that there is an optimal tempo for body movement related to groove. This finding has implications for the use of music or rhythmic stimuli to induce smooth motion in rehabilitation, therapy, or dance.

Neural bases of rhythmic entrainment in humans: critical transformation between cortical and lower-level representations of auditory rhythm

The spontaneous ability to entrain to meter periodicities is central to music perception and production across cultures. There is increasing evidence that this ability involves selective neural responses to meter-related frequencies. This phenomenon has been observed in the human auditory cortex, yet it could be the product of evolutionarily older lower-level properties of brainstem auditory neurons, as suggested by recent recordings from rodent midbrain. We addressed this question by taking advantage of a new method to simultaneously record human EEG activity originating from cortical and lower-level sources, in the form of slow (< 20 Hz) and fast (> 150 Hz) responses to auditory rhythms. Cortical responses showed increased amplitudes at meter-related frequencies compared to meter-unrelated frequencies, regardless of the prominence of the meter-related frequencies in the modulation spectrum of the rhythmic inputs. In contrast, frequency-following responses showed increased amplitudes at meter-related frequencies only in rhythms with prominent meter-related frequencies in the input but not for a more complex rhythm requiring more endogenous generation of the meter. This interaction with rhythm complexity suggests that the selective enhancement of meter-related frequencies does not fully rely on subcortical auditory properties, but is critically shaped at the cortical level, possibly through functional connections between the auditory cortex and other, movement-related, brain structures. This process of temporal selection would thus enable endogenous and motor entrainment to emerge with substantial flexibility and invariance with respect to the rhythmic input in humans in contrast with non-human animals.

Shared periodic performer movements coordinate interactions in duo improvisations

Human interaction involves the exchange of temporally coordinated, multimodal cues. Our work focused on interaction in the visual domain, using music performance as a case for analysis due to its temporally diverse and hierarchical structures. We made use of two improvising duo datasets-(i) performances of a jazz standard with a regular pulse and (ii) non-pulsed, free improvizations-to investigate whether human judgements of moments of interaction between co-performers are influenced by body movement coordination at multiple timescales. Bouts of interaction in the performances were manually annotated by experts and the performers' movements were quantified using computer vision techniques. The annotated interaction bouts were then predicted using several quantitative movement and audio features. Over 80% of the interaction bouts were successfully predicted by a broadband measure of the energy of the cross-wavelet transform of the co-performers' movements in non-pulsed duos. A more complex model, with multiple predictors that captured more specific, interacting features of the movements, was needed to explain a significant amount of variance in the pulsed duos. The methods developed here have key implications for future work on measuring visual coordination in musical ensemble performances, and can be easily adapted to other musical contexts, ensemble types and traditions.

When the rhythm disappears and the mind keeps dancing: sustained effects of attentional entrainment

Research has demonstrated that the human cognitive system allocates attention most efficiently to a stimulus that occurs in synchrony with an established rhythmic background. However, our environment is dynamic and constantly changing. What happens when rhythms to which our cognitive system adapted disappear? We addressed this question using a visual categorization task comprising emotional and neutral faces. The task was split into three blocks of which the first and the last were completed in silence. The second block was accompanied by an acoustic background rhythm that, for one group of participants, was synchronous with face presentations, and for another group was asynchronous. Irrespective of group, performance improved with background stimulation. Importantly, improved performance extended into the third silent block for the synchronous, but not for the asynchronous group. These data suggest that attentional entrainment resulting from rhythmic environmental regularities disintegrates only gradually after the regularities disappear.

Working memory and auditory imagery predict sensorimotor synchronisation with expressively timed music

Sensorimotor synchronisation (SMS) is prevalent and readily studied in musical settings, as most people are able to perceive and synchronise with a beat (e.g., by finger tapping). We took an individual differences approach to understanding SMS to real music characterised by expressive timing (i.e., fluctuating beat regularity). Given the dynamic nature of SMS, we hypothesised that individual differences in working memory and auditory imagery-both fluid cognitive processes-would predict SMS at two levels: (1) mean absolute asynchrony (a measure of synchronisation error) and (2) anticipatory timing (i.e., predicting, rather than reacting to beat intervals). In Experiment 1, participants completed two working memory tasks, four auditory imagery tasks, and an SMS-tapping task. Hierarchical regression models were used to predict SMS performance, with results showing dissociations among imagery types in relation to mean absolute asynchrony, and evidence of a role for working memory in anticipatory timing. In Experiment 2, a new sample of participants completed an expressive timing perception task to examine the role of imagery in perception without action. Results suggest that imagery vividness is important for perceiving and control is important for synchronising with irregular but ecologically valid musical time series. Working memory is implicated in synchronising by anticipating events in the series.

Negotiating between individual and joint goals in ensemble musical performance

Successful joint action requires negotiation, especially in the event of goal incongruence. This article addresses goal incongruence in joint musical performance by manipulating the congruence of score instructions (congruent/incongruent) regarding tempo (speed) and dynamics (sound intensity) given to piano duos. The aim is to investigate how co-performers negotiate incongruent instructions for tempo and dynamics by balancing the prioritisation of individual goals versus the joint outcome and how this negotiation is modulated by musical expertise and personality (locus of control). In total, 14 pairs of pianists, who were not informed of the congruence manipulation, were placed back-to-back and were directed to achieve a successful performance over four repeated performances without verbal communication. Interpersonal coordination generally improved from the first to final performance in the congruent and incongruent conditions for both the tempo and dynamics tasks. Furthermore, in incongruent conditions, results suggest that performers prioritise the joint performance in the tempo task, but prioritise their own performance in the dynamics task. Although individual performance appears to be modulated by musical expertise, the balance of individual/joint performance across the duo is not influenced by musical part (melody vs accompaniment), expressive instruction, musical expertise or locus of control.

EEG Frequency-Tagging and Input-Output Comparison in Rhythm Perception

The combination of frequency-tagging with electroencephalography (EEG) has recently proved fruitful for understanding the perception of beat and meter in musical rhythm, a common behavior shared by humans of all cultures. EEG frequency-tagging allows the objective measurement of input-output transforms to investigate beat perception, its modulation by exogenous and endogenous factors, development, and neural basis. Recent doubt has been raised about the validity of comparing frequency-domain representations of auditory rhythmic stimuli and corresponding EEG responses, assuming that it implies a one-to-one mapping between the envelope of the rhythmic input and the neural output, and that it neglects the sensitivity of frequency-domain representations to acoustic features making up the rhythms. Here we argue that these elements actually reinforce the strengths of the approach. The obvious fact that acoustic features influence the frequency spectrum of the sound envelope precisely justifies taking into consideration the sounds used to generate a beat percept for interpreting neural responses to auditory rhythms. Most importantly, the many-to-one relationship between rhythmic input and perceived beat actually validates an approach that objectively measures the input-output transforms underlying the perceptual categorization of rhythmic inputs. Hence, provided that a number of potential pitfalls and fallacies are avoided, EEG frequency-tagging to study input-output relationships appears valuable for understanding rhythm perception.