Predictive coding of music – Brain responses to rhythmic incongruity

Beyond syncopation: The number of rhythmic layers shapes the pleasurable urge to move to music

People experience the strongest pleasurable urge to move to music (PLUMM) with rhythms of medium complexity, showing an inverted U-shaped relationship. Rhythmic complexity is typically defined by syncopation but likely interacts with the number and instrumentation of rhythmic layers (e.g., snare only vs snare and bass drum) in affecting PLUMM. This study investigated this interaction by comparing PLUMM ratings of rhythms with varying rhythmic layers and syncopation degrees. Two online studies (study 1, n = 108; study 2, n = 46) were conducted asking participants to rate how much they wanted to move and the pleasure they felt while listening to rhythms. Each study used 12 rhythms in four versions: 1) snare only (SN) in study I and bass drum only (BD) in study II; 2) snare and hi-hat (SN + HH) in study I and bass drum and hi-hat (BD + HH) in study II; 3) snare and bass drum (SN + BD) and 4) the original with snare, bass drum, and hi-hat (SN + BD + HH) in both studies, totaling 48 stimuli per study. We tested for linear and quadratic effects of syncopation and rhythmic layers on PLUMM ratings. Study I showed a significant interaction between syncopation and rhythmic layers. The SN + BD + HH versions exhibited the strongest inverted U as an effect of syncopation, followed by SN + BD and SN + HH, while SN showed a near-flat pattern of ratings as an effect of syncopation. Study II had similar findings, but differences between versions were smaller, and the interaction was mainly driven by differences between BD and BD + HH and between SN + BD and SN + BD + HH, especially at moderate syncopation levels. These findings suggest that the PLUMM response is shaped by the number of rhythmic layers, the roles that the different instruments play, and the way that they interact with each other and with syncopation, thus extending our understanding of the rhythmic features that drive the motor and hedonic responses to music.

Predictive coding in neuropsychiatric disorders: A systematic transdiagnostic review

The predictive coding framework postulates that the human brain continuously generates predictions about the environment, maximizing successes and minimizing failures based on prior experiences and beliefs. This PRISMA-compliant systematic review aims to comprehensively and transdiagnostically examine the differences in predictive coding between individuals with neuropsychiatric disorders and healthy controls. We included 72 articles including case-control studies investigating predictive coding as the primary outcome and reporting behavioral, neuroimaging, or electrophysiological findings. Thirty-three studies investigated predictive coding in the schizophrenia spectrum, 33 in neurodevelopmental disorders, 5 in mood disorders, 4 in neurocognitive disorders, 1 in post-traumatic stress disorder, and 1 in substance use disorders. Oddball and oddball-like paradigms were most frequently used to quantify predictive coding performance. Evidence showed heterogeneous impairments in the predictive coding abilities of the brain across neuropsychiatric disorders, particularly in schizophrenia and autism. Patients within the schizophrenia spectrum showed a consistent pattern of impaired non-social predictive coding. Conversely, predictive coding deficits were more selective for social cues in the autism spectrum. Predictive coding impairments were correlated with clinical symptom severity. These findings underscore the potential utility of predictive coding as a framework for understanding cognitive dysfunctions in the neuropsychiatric population, even though more evidence is needed on underexplored conditions, also considering potential confounders such as medication use and sex/gender. The potential role of predictive coding as a determinant of treatment response may also be considered to tailor personalized interventions.

Music reward sensitivity is associated with greater information transfer capacity within dorsal and motor white matter networks in musicians

There are pronounced differences in the degree to which individuals experience music-induced pleasure which are linked to variations in structural connectivity between auditory and reward areas. However, previous studies exploring the link between white matter structure and music reward sensitivity (MRS) have relied on standard diffusion tensor imaging methods, which present challenges in terms of anatomical accuracy and interpretability. Further, the link between MRS and connectivity in regions outside of auditory-reward networks, as well as the role of musical training, have yet to be investigated. Therefore, we investigated the relation between MRS and structural connectivity in a large number of directly segmented and anatomically verified white matter tracts in musicians (n = 24) and non-musicians (n = 23) using state-of-the-art tract reconstruction and fixel-based analysis. Using a manual tract-of-interest approach, we additionally tested MRS-white matter associations in auditory-reward networks seen in previous studies. Within the musician group, there was a significant positive relation between MRS and fiber density and cross section in the right middle longitudinal fascicle connecting auditory and inferior parietal cortices. There were also positive relations between MRS and fiber-bundle cross-section in tracts connecting the left thalamus to the ventral precentral gyrus and connecting the right thalamus to the right supplementary motor area, however, these did not survive FDR correction. These results suggest that, within musicians, dorsal auditory and motor networks are crucial to MRS, possibly via their roles in top-down predictive processing and auditory-motor transformations.

Null effect of perceived drum pattern complexity on the experience of groove

There is a broad consensus in groove research that the experience of groove, understood as a pleasurable urge to move in response to music, is to some extent related to the complexity of the rhythm. Specifically, music with medium rhythmic complexity has been found to motivate greater urge to move compared to low or high complexity music (inverted-U hypothesis). Studies that confirmed the inverted-U hypothesis usually based their measure of complexity on the rhythmic phenomenon of syncopation, where rhythms with more and/or stronger syncopation are considered to be more complex than less syncopated rhythms. However, syncopation is not the same as complexity and represents only one rhythmic device that makes music complex. This study attempts the verification of the inverted-U hypothesis independently from syncopation. It uses a new stimulus set of forty idiomatic popular music drum patterns whose perceptual complexity was measured experimentally in a previous study. The current study reports the results of a listening experiment with n = 179 participants, in which the inverted-U hypothesis was not confirmed. Complexity did not have any significant effect on listeners' urge to move (p = 834). Results are discussed in the context of the psychological model of musical groove, which offers a nuance to this null result: simple drum patterns motivate listeners to dance because they convey metric clarity; complex patterns invite dancing because they are interesting. Yet, overall, the urge to move does not seem to depend on complexity, at least in the case of idiomatic drum patterns that are typically encountered in the Western popular music repertoire.

Inhibitory control and working memory predict rhythm production abilities in patients with neurocognitive deficits

Deficits in rhythm perception and production have been reported in a variety of psychiatric, neurodevelopmental and neurologic disorders. Since correlations between rhythmic abilities and cognitive functions have been demonstrated in neurotypical individuals, we here investigate whether and how rhythmic abilities are associated with cognitive functions in 35 participants with neurocognitive deficits due to acquired brain lesions. We systematically assessed a diverse set of rhythm perception and production abilities including time and beat perception and finger-tapping tasks. Neuropsychological tests were applied to assess separable cognitive functions. Using multiple regression analyses we show that lower variability in aligning movements to a pacing sequence was predicted by better inhibitory control and better working memory performance. Working memory performance also predicted lower variability of rhythmic movements in the absence of an external pacing sequence and better anticipatory timing to sequences with gradual tempo changes. Importantly, these predictors remained significant for all regression models when controlling for other cognitive variables (i.e., cognitive flexibility, information processing speed, and verbal learning ability) and potential confounders (i.e., age, symptom strength of depression, manual dexterity, duration of illness, severity of cognitive impairment, and musical experience). Thus, all rhythm production abilities were significantly predicted by measures of executive functions. In contrast, rhythm perception abilities (time perception/beat perception) were not predicted by executive functions in this study. Our results, enhancing the understanding of cognitive underpinnings of rhythmic abilities in individuals with neurocognitive deficits, may be a first mandatory step to further potential therapeutic implications of rhythm-based interventions in neuropsychological rehabilitation.

Pleasantness makes a good time: musical consonance shapes interpersonal synchronization in dyadic joint action

Introduction

Music making is a process by which humans across cultures come together to create patterns of sounds that are aesthetically pleasing. What remains unclear is how this aesthetic outcome affects the sensorimotor interaction between participants.

Method

Here we approach this question using an interpersonal sensorimotor synchronization paradigm to test whether the quality of a jointly created chord (consonant vs. dissonant) affects movement coordination. We recruited non-musician participants in dyads to perform a dyadic synchronization-continuation task (dSCT): on each trial, participants first synchronized their movements to a metronome (synchronization phase) and then continued tapping together at the same tempo without the metronome (continuation phase). Each tap yielded a note and participants heard both their own and that of their partner, thus creating a chord that was varied to be either consonant (Perf5 or Maj6) or dissonant (Min2 or Maj2). For each trial, participants also rated the pleasure they felt in creating the sounds together. Additionally, they completed questionnaires about social closeness to the other participant, musical reward sensitivity and musical training.

Results

Results showed that participants' taps were closer in time when they jointly created consonant (high pleasure) vs. dissonant (low pleasure) chords, and that pleasure experienced by the dyad in each trial predicted interpersonal synchronization. However, consonance did not affect individual synchronization with the metronome or individual tapping when the metronome was discontinued. The effect of consonance on synchronization was greater in dyads who reported feeling less close prior to the task.

Discussion

Together, these results highlight the role of consonance in shaping the temporal coordination of our actions with others. More broadly, this work shows that the aesthetic outcome of what we create together affects joint behaviors.

Language experience shapes predictive coding of rhythmic sound sequences

Perceptual systems heavily rely on prior knowledge and predictions to make sense of the environment. Predictions can originate from multiple sources of information, including contextual short-term priors, based on isolated temporal situations, and context-independent long-term priors, arising from extended exposure to statistical regularities. While the effects of short-term predictions on auditory perception have been well-documented, how long-term predictions shape early auditory processing is poorly understood. To address this, we recorded magnetoencephalography data from native speakers of two languages with different word orders (Spanish: functor-initial vs Basque: functor-final) listening to simple sequences of binary sounds alternating in duration with occasional omissions. We hypothesized that, together with contextual transition probabilities, the auditory system uses the characteristic prosodic cues (duration) associated with the native language's word order as an internal model to generate long-term predictions about incoming non-linguistic sounds. Consistent with our hypothesis, we found that the amplitude of the mismatch negativity elicited by sound omissions varied orthogonally depending on the speaker's linguistic background and was most pronounced in the left auditory cortex. Importantly, listening to binary sounds alternating in pitch instead of duration did not yield group differences, confirming that the above results were driven by the hypothesized long-term 'duration' prior. These findings show that experience with a given language can shape a fundamental aspect of human perception - the neural processing of rhythmic sounds - and provides direct evidence for a long-term predictive coding system in the auditory cortex that uses auditory schemes learned over a lifetime to process incoming sound sequences.

Breaking (musical) boundaries by investigating brain dynamics of event segmentation during real-life music-listening

The perception of musical phrase boundaries is a critical aspect of human musical experience: It allows us to organize, understand, derive pleasure from, and remember music. Identifying boundaries is a prerequisite for segmenting music into meaningful chunks, facilitating efficient processing and storage while providing an enjoyable, fulfilling listening experience through the anticipation of upcoming musical events. Expanding on Sridharan et al.'s [Neuron 55, 521-532 (2007)] work on coarse musical boundaries between symphonic movements, we examined finer-grained boundaries. We measured the fMRI responses of 18 musicians and 18 nonmusicians during music listening. Using general linear model, independent component analysis, and Granger causality, we observed heightened auditory integration in anticipation to musical boundaries, and an extensive decrease within the fronto-temporal-parietal network during and immediately following boundaries. Notably, responses were modulated by musicianship. Findings uncover the intricate interplay between musical structure, expertise, and cognitive processing, advancing our knowledge of how the brain makes sense of music.

Rapid calibration to dynamic temporal contexts

The prediction of future events and the preparation of appropriate behavioural reactions rely on an accurate perception of temporal regularities. In dynamic environments, temporal regularities are subject to slow and sudden changes, and adaptation to these changes is an important requirement for efficient behaviour. Bayesian models have proven a useful tool to understand the processing of temporal regularities in humans; yet an open question pertains to the degree of flexibility of the prior that is required for optimal modelling of behaviour. Here we directly compare dynamic models (with continuously changing prior expectations) and static models (a stable prior for each experimental session) with their ability to describe regression effects in interval timing. Our results show that dynamic Bayesian models are superior when describing the responses to slow, continuous environmental changes, whereas static models are more suitable to describe responses to sudden changes. In time perception research, these results will be informative for the choice of adequate computational models and enhance our understanding of the neuronal computations underlying human timing behaviour.

Understanding music and aging through the lens of Bayesian inference

Bayesian inference has recently gained momentum in explaining music perception and aging. A fundamental mechanism underlying Bayesian inference is the notion of prediction. This framework could explain how predictions pertaining to musical (melodic, rhythmic, harmonic) structures engender action, emotion, and learning, expanding related concepts of music research, such as musical expectancies, groove, pleasure, and tension. Moreover, a Bayesian perspective of music perception may shed new insights on the beneficial effects of music in aging. Aging could be framed as an optimization process of Bayesian inference. As predictive inferences refine over time, the reliance on consolidated priors increases, while the updating of prior models through Bayesian inference attenuates. This may affect the ability of older adults to estimate uncertainties in their environment, limiting their cognitive and behavioral repertoire. With Bayesian inference as an overarching framework, this review synthesizes the literature on predictive inferences in music and aging, and details how music could be a promising tool in preventive and rehabilitative interventions for older adults through the lens of Bayesian inference.

Segmenting and Predicting Musical Phrase Structure Exploits Neural Gain Modulation and Phase Precession

Music, like spoken language, is often characterized by hierarchically organized structure. Previous experiments have shown neural tracking of notes and beats, but little work touches on the more abstract question: how does the brain establish high-level musical structures in real time? We presented Bach chorales to participants (20 females and 9 males) undergoing electroencephalogram (EEG) recording to investigate how the brain tracks musical phrases. We removed the main temporal cues to phrasal structures, so that listeners could only rely on harmonic information to parse a continuous musical stream. Phrasal structures were disrupted by locally or globally reversing the harmonic progression, so that our observations on the original music could be controlled and compared. We first replicated the findings on neural tracking of musical notes and beats, substantiating the positive correlation between musical training and neural tracking. Critically, we discovered a neural signature in the frequency range ∼0.1 Hz (modulations of EEG power) that reliably tracks musical phrasal structure. Next, we developed an approach to quantify the phrasal phase precession of the EEG power, revealing that phrase tracking is indeed an operation of active segmentation involving predictive processes. We demonstrate that the brain establishes complex musical structures online over long timescales (>5 s) and actively segments continuous music streams in a manner comparable to language processing. These two neural signatures, phrase tracking and phrasal phase precession, provide new conceptual and technical tools to study the processes underpinning high-level structure building using noninvasive recording techniques.

Decoding predicted musical notes from omitted stimulus potentials

Electrophysiological studies have investigated predictive processing in music by examining event-related potentials (ERPs) elicited by the violation of musical expectations. While several studies have reported that the predictability of stimuli can modulate the amplitude of ERPs, it is unclear how specific the representation of the expected note is. The present study addressed this issue by recording the omitted stimulus potentials (OSPs) to avoid contamination of bottom-up sensory processing with top-down predictive processing. Decoding of the omitted content was attempted using a support vector machine, which is a type of machine learning. ERP responses to the omission of four target notes (E, F, A, and C) at the same position in familiar and unfamiliar melodies were recorded from 25 participants. The results showed that the omission N1 were larger in the familiar melody condition than in the unfamiliar melody condition. The decoding accuracy of the four omitted notes was significantly higher in the familiar melody condition than in the unfamiliar melody condition. These results suggest that the OSPs contain discriminable predictive information, and the higher the predictability, the more the specific representation of the expected note is generated.

A review of psychological and neuroscientific research on musical groove

When listening to music, we naturally move our bodies rhythmically to the beat, which can be pleasurable and difficult to resist. This pleasurable sensation of wanting to move the body to music has been called "groove." Following pioneering humanities research, psychological and neuroscientific studies have provided insights on associated musical features, behavioral responses, phenomenological aspects, and brain structural and functional correlates of the groove experience. Groove research has advanced the field of music science and more generally informed our understanding of bidirectional links between perception and action, and the role of the motor system in prediction. Activity in motor and reward-related brain networks during music listening is associated with the groove experience, and this neural activity is linked to temporal prediction and learning. This article reviews research on groove as a psychological phenomenon with neurophysiological correlates that link musical rhythm perception, sensorimotor prediction, and reward processing. Promising future research directions range from elucidating specific neural mechanisms to exploring clinical applications and socio-cultural implications of groove.

Syncopation as structure bootstrapping: the role of asymmetry in rhythm and language

Syncopation - the occurrence of a musical event on a metrically weak position preceding a rest on a metrically strong position - represents an important challenge in the study of the mapping between rhythm and meter. In this contribution, we present the hypothesis that syncopation is an effective strategy to elicit the bootstrapping of a multi-layered, hierarchically organized metric structure from a linear rhythmic surface. The hypothesis is inspired by a parallel with the problem of linearization in natural language syntax, which is the problem of how hierarchically organized phrase-structure markers are mapped onto linear sequences of words. The hypothesis has important consequences for the role of meter in music perception and cognition and, more particularly, for its role in the relationship between rhythm and bodily entrainment.

Neural encoding of musical expectations in a non-human primate

The appreciation of music is a universal trait of humankind.1,2,3 Evidence supporting this notion includes the ubiquity of music across cultures4,5,6,7 and the natural predisposition toward music that humans display early in development.8,9,10 Are we musical animals because of species-specific predispositions? This question cannot be answered by relying on cross-cultural or developmental studies alone, as these cannot rule out enculturation.11 Instead, it calls for cross-species experiments testing whether homologous neural mechanisms underlying music perception are present in non-human primates. We present music to two rhesus monkeys, reared without musical exposure, while recording electroencephalography (EEG) and pupillometry. Monkeys exhibit higher engagement and neural encoding of expectations based on the previously seeded musical context when passively listening to real music as opposed to shuffled controls. We then compare human and monkey neural responses to the same stimuli and find a species-dependent contribution of two fundamental musical features-pitch and timing12-in generating expectations: while timing- and pitch-based expectations13 are similarly weighted in humans, monkeys rely on timing rather than pitch. Together, these results shed light on the phylogeny of music perception. They highlight monkeys' capacity for processing temporal structures beyond plain acoustic processing, and they identify a species-dependent contribution of time- and pitch-related features to the neural encoding of musical expectations.

Probing Beat Perception with Event-Related Potentials (ERPs) in Human Adults, Newborns, and Nonhuman Primates

The aim of this chapter is to give an overview of how the perception of rhythmic temporal regularity such as a regular beat in music can be studied in human adults, human newborns, and nonhuman primates using event-related brain potentials (ERPs). First, we discuss different aspects of temporal structure in general, and musical rhythm in particular, and we discuss the possible mechanisms underlying the perception of regularity (e.g., a beat) in rhythm. Additionally, we highlight the importance of dissociating beat perception from the perception of other types of structure in rhythm, such as predictable sequences of temporal intervals, ordinal structure, and rhythmic grouping. In the second section of the chapter, we start with a discussion of auditory ERPs elicited by infrequent and frequent sounds: ERP responses to regularity violations, such as mismatch negativity (MMN), N2b, and P3, as well as early sensory responses to sounds, such as P1 and N1, have been shown to be instrumental in probing beat perception. Subsequently, we discuss how beat perception can be probed by comparing ERP responses to sounds in regular and irregular sequences, and by comparing ERP responses to sounds in different metrical positions in a rhythm, such as on and off the beat or on strong and weak beats. Finally, we will discuss previous research that has used the aforementioned ERPs and paradigms to study beat perception in human adults, human newborns, and nonhuman primates. In doing so, we consider the possible pitfalls and prospects of the technique, as well as future perspectives.

Dopamine dysregulation in Parkinson's disease flattens the pleasurable urge to move to musical rhythms

The pleasurable urge to move to music (PLUMM) activates motor and reward areas of the brain and is thought to be driven by predictive processes. Dopamine in motor and limbic networks is implicated in beat-based timing and music-induced pleasure, suggesting a central role of basal ganglia (BG) dopaminergic systems in PLUMM. This study tested this hypothesis by comparing PLUMM in participants with Parkinson's disease (PD), age-matched controls, and young controls. Participants listened to musical sequences with varying rhythmic and harmonic complexity (low, medium and high), and rated their experienced pleasure and urge to move to the rhythm. In line with previous results, healthy younger participants showed an inverted U-shaped relationship between rhythmic complexity and ratings, with preference for medium complexity rhythms, while age-matched controls showed a similar, but weaker, inverted U-shaped response. Conversely, PD showed a significantly flattened response for both the urge to move and pleasure. Crucially, this flattened response could not be attributed to differences in rhythm discrimination and did not reflect an overall decrease in ratings. For harmonic complexity, PD showed a negative linear pattern for both the urge to move and pleasure while healthy age-matched controls showed the same pattern for pleasure and an inverted U for the urge to move. This contrasts with the pattern observed in young healthy controls in previous studies, suggesting that both healthy aging and PD also influence affective responses to harmonic complexity. Together, these results support the role of dopamine within cortico-striatal circuits in the predictive processes that form the link between the perceptual processing of rhythmic patterns and the affective and motor responses to rhythmic music.

The history of Danish neuroscience

The history of Danish neuroscience starts with an account of impressive contributions made at the 17th century. Thomas Bartholin was the first Danish neuroscientist, and his disciple Nicolaus Steno became internationally one of the most prominent neuroscientists in this period. From the start, Danish neuroscience was linked to clinical disciplines. This continued in the 19th and first half of the 20th centuries with new initiatives linking basic neuroscience to clinical neurology and psychiatry in the same scientific environment. Subsequently, from the middle of the 20th century, basic neuroscience was developing rapidly within the preclinical university sector. Clinical neuroscience continued and was even reinforced during this period with important translational research and a close co-operation between basic and clinical neuroscience. To distinguish 'history' from 'present time' is not easy, as many historical events continue in present time. Therefore, we decided to consider 'History' as new major scientific developments in Denmark, which were launched before the end of the 20th century. With this aim, scientists mentioned will have been born, with a few exceptions, no later than the early 1960s. However, we often refer to more recent publications in documenting the developments of initiatives launched before the end of the last century. In addition, several scientists have moved to Denmark after the beginning of the present century, and they certainly are contributing to the present status of Danish neuroscience-but, again, this is not the History of Danish neuroscience.

The Neuroscience of Dance: A Conceptual Framework and Systematic Review

Ancient and culturally universal, dance pervades many areas of life and has multiple benefits. In this article, we provide a conceptual framework and systematic review, as a guide for researching the neuroscience of dance. We identified relevant articles following PRISMA guidelines, and summarised and evaluated all original results. We identified avenues for future research in: the interactive and collective aspects of dance; groove; dance performance; dance observation; and dance therapy. Furthermore, the interactive and collective aspects of dance constitute a vital part of the field but have received almost no attention from a neuroscientific perspective so far. Dance and music engage overlapping brain networks, including common regions involved in perception, action, and emotion. In music and dance, rhythm, melody, and harmony are processed in an active, sustained pleasure cycle giving rise to action, emotion, and learning, led by activity in specific hedonic brain networks. The neuroscience of dance is an exciting field, which may yield information concerning links between psychological processes and behaviour, human flourishing, and the concept of eudaimonia.

Moderate associations between BDNF Val66Met gene polymorphism, musical expertise, and mismatch negativity

Auditory predictive processing relies on a complex interaction between environmental, neurophysiological, and genetic factors. In this view, the mismatch negativity (MMN) and intensive training on a musical instrument for several years have been used for studying environment-driven neural adaptations in audition. In addition, brain-derived neurotrophic factor (BDNF) has been shown crucial for both the neurogenesis and the later adaptation of the auditory system. The functional single-nucleotide polymorphism (SNP) Val66Met (rs6265) in the BDNF gene can affect BDNF protein levels, which are involved in neurobiological and neurophysiological processes such as neurogenesis and neuronal plasticity. In this study, we hypothesised that genetic variation within the BDNF gene would be associated with different levels of neuroplasticity of the auditory cortex in 74 musically trained participants. To achieve this goal, musicians and non-musicians were recruited and divided in Val/Val and Met- (Val/Met and Met/Met) carriers and their brain activity was measured with magnetoencephalography (MEG) while they listened to a regular auditory sequence eliciting different types of prediction errors. MMN responses indexing those prediction errors were overall enhanced in Val/Val carriers who underwent intensive musical training, compared to Met-carriers and non-musicians with either genotype. Although this study calls for replications with larger samples, our results provide a first glimpse of the possible role of gene-regulated neurotrophic factors in the neural adaptations of automatic predictive processing in the auditory domain after long-term training.

Can rhythm-mediated reward boost learning, memory, and social connection? Perspectives for future research

Studies of rhythm processing and of reward have progressed separately, with little connection between the two. However, consistent links between rhythm and reward are beginning to surface, with research suggesting that synchronization to rhythm is rewarding, and that this rewarding element may in turn also boost this synchronization. The current mini review shows that the combined study of rhythm and reward can be beneficial to better understand their independent and combined roles across two central aspects of cognition: 1) learning and memory, and 2) social connection and interpersonal synchronization; which have so far been studied largely independently. From this basis, it is discussed how connections between rhythm and reward can be applied to learning and memory and social connection across different populations, taking into account individual differences, clinical populations, human development, and animal research. Future research will need to consider the rewarding nature of rhythm, and that rhythm can in turn boost reward, potentially enhancing other cognitive and social processes.

A predictive coding approach to modelling the perceived complexity of popular music drum patterns

This study presents a method to estimate the complexity of popular music drum patterns based on a core idea from predictive coding. Specifically, it postulates that the complexity of a drum pattern depends on the quantity of surprisal it causes in the listener. Surprisal, according to predictive coding theory, is a numerical measure that takes large values when the perceiver's internal model of the surrounding world fails to predict the actual stream of sensory data (i.e. when the perception surprises the perceiver), and low values if model predictions and sensory data agree. The proposed new method first approximates a listener's internal model of a popular music drum pattern (using ideas on enculturation and a Bayesian learning process). It then quantifies the listener's surprisal evaluating the discrepancies between the predictions of the internal model and the actual drum pattern. It finally estimates drum pattern complexity from surprisal. The method was optimised and tested using a set of forty popular music drum patterns, for which empirical perceived complexity measurements are available. The new method provided complexity estimates that had a good fit with the empirical measurements ( R 2 = . 852 ). The method was implemented as an R script that can be used to estimate the complexity of popular music drum patterns in the future. Simulations indicate that we can expect the method to predict perceived complexity with a good fit ( R 2 ≥ . 709 ) in 99% of drum pattern sets randomly drawn from the Western popular music repertoire. These results suggest that surprisal indeed captures essential aspects of complexity, and that it may serve as a basis for a general theory of perceived complexity.

Worlds apart? Testing the cultural distance hypothesis in music perception of Chinese and Western listeners

According to the cultural distance hypothesis (CDH), individuals learn culture-specific statistical structures in music as internal stylistic models and use these models in predictive processing of music, with musical structures closer to their home culture being easier to predict. This cultural distance effect may be affected by domain-specific (musical ability) and domain-general individual characteristics (openness, implicit cultural bias). To test the CDH and its modulation by individual characteristics, we recruited Chinese and Western adults to categorize stylistically ambiguous and unambiguous Chinese and Western melodies by cultural origin. Categorization performance was better for unambiguous (low CD) than ambiguous melodies (high CD), and for in-culture melodies regardless of ambiguity for both groups, providing evidence for CDH. Musical ability, but not other traits, correlated positively with melody categorization, suggesting that musical ability refines internal stylistic models. Therefore, both cultures show musical enculturation in their home culture with a modulatory effect of individual musical ability.

The audio features of sleep music: Universal and subgroup characteristics

Throughout history, lullabies have been used to help children sleep, and today, with the increasing accessibility of recorded music, many people report listening to music as a tool to improve sleep. Nevertheless, we know very little about this common human habit. In this study, we elucidated the characteristics of music associated with sleep by extracting audio features from a large number of tracks (N = 225,626) retrieved from sleep playlists at the global streaming platform Spotify. Compared to music in general, we found that sleep music was softer and slower; it was more often instrumental (i.e. without lyrics) and played on acoustic instruments. Yet, a large amount of variation was present in sleep music, which clustered into six distinct subgroups. Strikingly, three of the subgroups included popular tracks that were faster, louder, and more energetic than average sleep music. The findings reveal previously unknown aspects of the audio features of sleep music and highlight the individual variation in the choice of music used for sleep. By using digital traces, we were able to determine the universal and subgroup characteristics of sleep music in a unique, global dataset, advancing our understanding of how humans use music to regulate their behaviour in everyday life.

Magnetoencephalography recordings reveal the spatiotemporal dynamics of recognition memory for complex versus simple auditory sequences

Auditory recognition is a crucial cognitive process that relies on the organization of single elements over time. However, little is known about the spatiotemporal dynamics underlying the conscious recognition of auditory sequences varying in complexity. To study this, we asked 71 participants to learn and recognize simple tonal musical sequences and matched complex atonal sequences while their brain activity was recorded using magnetoencephalography (MEG). Results reveal qualitative changes in neural activity dependent on stimulus complexity: recognition of tonal sequences engages hippocampal and cingulate areas, whereas recognition of atonal sequences mainly activates the auditory processing network. Our findings reveal the involvement of a cortico-subcortical brain network for auditory recognition and support the idea that stimulus complexity qualitatively alters the neural pathways of recognition memory.

Musicians show more integrated neural processing of contextually relevant acoustic features

Little is known about expertise-related plasticity of neural mechanisms for auditory feature integration. Here, we contrast two diverging hypotheses that musical expertise is associated with more independent or more integrated predictive processing of acoustic features relevant to melody perception. Mismatch negativity (MMNm) was recorded with magnetoencephalography (MEG) from 25 musicians and 25 non-musicians, exposed to interleaved blocks of a complex, melody-like multi-feature paradigm and a simple, oddball control paradigm. In addition to single deviants differing in frequency (F), intensity (I), or perceived location (L), double and triple deviants were included reflecting all possible feature combinations (FI, IL, LF, FIL). Following previous work, early neural processing overlap was approximated in terms of MMNm additivity by comparing empirical MMNms obtained with double and triple deviants to modeled MMNms corresponding to summed constituent single-deviant MMNms. Significantly greater subadditivity was found in musicians compared to non-musicians, specifically for frequency-related deviants in complex, melody-like stimuli. Despite using identical sounds, expertise effects were absent from the simple oddball paradigm. This novel finding supports the integrated processing hypothesis whereby musicians recruit overlapping neural resources facilitating more integrative representations of contextually relevant stimuli such as frequency (perceived as pitch) during melody perception. More generally, these specialized refinements in predictive processing may enable experts to optimally capitalize upon complex, domain-relevant, acoustic cues.

The sweet spot between predictability and surprise: musical groove in brain, body, and social interactions

Groove-defined as the pleasurable urge to move to a rhythm-depends on a fine-tuned interplay between predictability arising from repetitive rhythmic patterns, and surprise arising from rhythmic deviations, for example in the form of syncopation. The perfect balance between predictability and surprise is commonly found in rhythmic patterns with a moderate level of rhythmic complexity and represents the sweet spot of the groove experience. In contrast, rhythms with low or high complexity are usually associated with a weaker experience of groove because they are too boring to be engaging or too complex to be interpreted, respectively. Consequently, the relationship between rhythmic complexity and groove experience can be described by an inverted U-shaped function. We interpret this inverted U shape in light of the theory of predictive processing and provide perspectives on how rhythmic complexity and groove can help us to understand the underlying neural mechanisms linking temporal predictions, movement, and reward. A better understanding of these mechanisms can guide future approaches to improve treatments for patients with motor impairments, such as Parkinson's disease, and to investigate prosocial aspects of interpersonal interactions that feature music, such as dancing. Finally, we present some open questions and ideas for future research.

Time Perception for Musical Rhythms: Sensorimotor Perspectives on Entrainment, Simulation, and Prediction

Neural mechanisms supporting time perception in continuously changing sensory environments may be relevant to a broader understanding of how the human brain utilizes time in cognition and action. In this review, we describe current theories of sensorimotor engagement in the support of subsecond timing. We focus on musical timing due to the extensive literature surrounding movement with and perception of musical rhythms. First, we define commonly used but ambiguous concepts including neural entrainment, simulation, and prediction in the context of musical timing. Next, we summarize the literature on sensorimotor timing during perception and performance and describe current theories of sensorimotor engagement in the support of subsecond timing. We review the evidence supporting that sensorimotor engagement is critical in accurate time perception. Finally, potential clinical implications for a sensorimotor perspective of timing are highlighted.

Coordination of voice, hands and feet in rhythm and beat performance

Interlimb coordination is critical to the successful performance of simple activities in everyday life and it depends on precisely timed perception–action coupling. This is particularly true in music-making, where performers often use body-movements to keep the beat while playing more complex rhythmic patterns. In the current study, we used a musical rhythmic paradigm of simultaneous rhythm/beat performance to examine how interlimb coordination between voice, hands and feet is influenced by the inherent figure-ground relationship between rhythm and beat. Sixty right-handed participants—professional musicians, amateur musicians and non-musicians—performed three short rhythmic patterns while keeping the underlying beat, using 12 different combinations of voice, hands and feet. Results revealed a bodily hierarchy with five levels (1) left foot, (2) right foot, (3) left hand, (4) right hand, (5) voice, i.e., more precise task execution was observed when the rhythm was performed with an effector occupying a higher level in the hierarchy than the effector keeping the beat. The notion of a bodily hierarchy implies that the role assigned to the different effectors is key to successful interlimb coordination: the performance level of a specific effector combination differs considerably, depending on which effector holds the supporting role of the beat and which effector holds the conducting role of the rhythm. Although performance generally increased with expertise, the evidence of the hierarchy was consistent in all three expertise groups. The effects of expertise further highlight how perception influences action. We discuss the possibility that musicians’ more robust metrical prediction models make it easier for musicians to attenuate prediction errors than non-musicians. Overall, the study suggests a comprehensive bodily hierarchy, showing how interlimb coordination is influenced by hierarchical principles in both perception and action.

Music in the brain

Music is ubiquitous across human cultures - as a source of affective and pleasurable experience, moving us both physically and emotionally - and learning to play music shapes both brain structure and brain function. Music processing in the brain - namely, the perception of melody, harmony and rhythm - has traditionally been studied as an auditory phenomenon using passive listening paradigms. However, when listening to music, we actively generate predictions about what is likely to happen next. This enactive aspect has led to a more comprehensive understanding of music processing involving brain structures implicated in action, emotion and learning. Here we review the cognitive neuroscience literature of music perception. We show that music perception, action, emotion and learning all rest on the human brain's fundamental capacity for prediction - as formulated by the predictive coding of music model. This Review elucidates how this formulation of music perception and expertise in individuals can be extended to account for the dynamics and underlying brain mechanisms of collective music making. This in turn has important implications for human creativity as evinced by music improvisation. These recent advances shed new light on what makes music meaningful from a neuroscientific perspective.

Vocal melody and musical background are simultaneously processed by the brain for musical predictions

Musical pleasure is related to the capacity to predict and anticipate the music. By recording early cerebral responses of 16 participants with electroencephalography during periods of silence inserted in known and unknown songs, we aimed to measure the contribution of different musical attributes to musical predictions. We investigated the mismatch between past encoded musical features and the current sensory inputs when listening to lyrics associated with vocal melody, only background instrumental material, or both attributes grouped together. When participants were listening to chords and lyrics for known songs, the brain responses related to musical violation produced event-related potential responses around 150-200 ms that were of a larger amplitude than for chords or lyrics only. Microstate analysis also revealed that for chords and lyrics, the global field power had an increased stability and a longer duration. The source localization identified that the right superior temporal and frontal gyri and the inferior and medial frontal gyri were activated for a longer time for chords and lyrics, likely caused by the increased complexity of the stimuli. We conclude that grouped together, a broader integration and retrieval of several musical attributes at the same time recruit larger neuronal networks that lead to more accurate predictions.

Neural Correlates of Music Listening: Does the Music Matter?

The last decades have seen a proliferation of music and brain studies, with a major focus on plastic changes as the outcome of continuous and prolonged engagement with music. Thanks to the advent of neuroaesthetics, research on music cognition has broadened its scope by considering the multifarious phenomenon of listening in all its forms, including incidental listening up to the skillful attentive listening of experts, and all its possible effects. These latter range from objective and sensorial effects directly linked to the acoustic features of the music to the subjectively affective and even transformational effects for the listener. Of special importance is the finding that neural activity in the reward circuit of the brain is a key component of a conscious listening experience. We propose that the connection between music and the reward system makes music listening a gate towards not only hedonia but also eudaimonia, namely a life well lived, full of meaning that aims at realizing one's own "daimon" or true nature. It is argued, further, that music listening, even when conceptualized in this aesthetic and eudaimonic framework, remains a learnable skill that changes the way brain structures respond to sounds and how they interact with each other.

Switching perception of musical meters by listening to different acoustic cues of biphasic sound stimulus

Meter is one of the core features of music perception. It is the cognitive grouping of regular sound sequences, typically for every 2, 3, or 4 beats. Previous studies have suggested that one can not only passively perceive the meter from acoustic cues such as loudness, pitch, and duration of sound elements, but also actively perceive it by paying attention to isochronous sound events without any acoustic cues. Studying the interaction of top-down and bottom-up processing in meter perception leads to understanding the cognitive system’s ability to perceive the entire structure of music. The present study aimed to demonstrate that meter perception requires the top-down process (which maintains and switches attention between cues) as well as the bottom-up process for discriminating acoustic cues. We created a “biphasic” sound stimulus, which consists of successive tone sequences designed to provide cues for both the triple and quadruple meters in different sound attributes, frequency, and duration. Participants were asked to focus on either frequency or duration of the stimulus, and to answer how they perceived meters on a five-point scale (ranged from “strongly triple” to “strongly quadruple”). As a result, we found that participants perceived different meters by switching their attention to specific cues. This result adds evidence to the idea that meter perception involves the interaction between top-down and bottom-up processes.

Perceiving actions before they happen: psychological dimensions scaffold neural action prediction

The social world buzzes with action. People constantly walk, talk, eat, work, play, snooze and so on. To interact with others successfully, we need to both understand their current actions and predict their future actions. Here we used functional neuroimaging to test the hypothesis that people do both at the same time: when the brain perceives an action, it simultaneously encodes likely future actions. Specifically, we hypothesized that the brain represents perceived actions using a map that encodes which actions will occur next: the six-dimensional Abstraction, Creation, Tradition, Food(-relevance), Animacy and Spiritualism Taxonomy (ACT-FAST) action space. Within this space, the closer two actions are, the more likely they are to precede or follow each other. To test this hypothesis, participants watched a video featuring naturalistic sequences of actions while undergoing functional magnetic resonance imaging (fMRI) scanning. We first use a decoding model to demonstrate that the brain uses ACT-FAST to represent current actions. We then successfully predicted as-yet unseen actions, up to three actions into the future, based on their proximity to the current action's coordinates in ACT-FAST space. This finding suggests that the brain represents actions using a six-dimensional action space that gives people an automatic glimpse of future actions.

Music-based techniques and related devices in neurorehabilitation: a scoping review

Introduction:The music as a powerful, and versatile stimulus for the brain, is at the date sometimes used in neurorehabilitation and proposed as a promising complementary strategy provided in combination with other therapy in individuals with neurological disorders. Different techniques and devices have been developed in the field of the music-based neurorehabilitation.Areas covered:This scoping review analyzes the current scientific literature concerning the different techniques and devices used in the music-supported neurorehabilitation, also focusing on the devices used in music-based therapies in patients with neurological disorders: 46 studies met the inclusion criteria and were included.Expert opinion:Included studies, highlight the potentiality and the versatility of the music-based therapy in the rehabilitation of neurological disorders. The variety of existing techniques allow to applied the music-based therapy in different situations and conditions. Moreover, the wide range of used devices that ranging from the simple musical instruments to the more advanced technologies, allows to develop customized exercises based on the needs of the patient. This review may be considered as a starting point to better design future RCTs that would investigate the effectiveness of music therapy on neurological disorders.

Violation of rhythmic expectancies can elicit late frontal gamma activity nested in theta oscillations

Rhythm processing involves building expectations according to the hierarchical temporal structure of auditory events. Although rhythm processing has been addressed in the context of predictive coding, the properties of the oscillatory response in different cortical areas are still not clear. We explored the oscillatory properties of the neural response to rhythmic incongruence and the cross-frequency coupling between multiple frequencies to further investigate the mechanisms underlying rhythm perception. We designed an experiment to investigate the neural response to rhythmic deviations in which the tone either arrived earlier than expected or the tone in the same metrical position was omitted. These two manipulations modulate the rhythmic structure differently, with the former creating a larger violation of the general structure of the musical stimulus than the latter. Both deviations resulted in an MMN response, whereas only the rhythmic deviant resulted in a subsequent P3a. Rhythmic deviants due to the early occurrence of a tone, but not omission deviants, seemed to elicit a late high gamma response (60-80 Hz) at the end of the P3a over the left frontal region, which, interestingly, correlated with the P3a amplitude over the same region and was also nested in theta oscillations. The timing of the elicited high-frequency gamma oscillations related to rhythmic deviation suggests that it might be related to the update of the predictive neural model, corresponding to the temporal structure of the events in higher-level cortical areas.

Evidence and implications of abnormal predictive coding in dementia

The diversity of cognitive deficits and neuropathological processes associated with dementias has encouraged divergence in pathophysiological explanations of disease. Here, we review an alternative framework that emphasizes convergent critical features of cognitive pathophysiology. Rather than the loss of ‘memory centres’ or ‘language centres’, or singular neurotransmitter systems, cognitive deficits are interpreted in terms of aberrant predictive coding in hierarchical neural networks. This builds on advances in normative accounts of brain function, specifically the Bayesian integration of beliefs and sensory evidence in which hierarchical predictions and prediction errors underlie memory, perception, speech and behaviour. We describe how analogous impairments in predictive coding in parallel neurocognitive systems can generate diverse clinical phenomena, including the characteristics of dementias. The review presents evidence from behavioural and neurophysiological studies of perception, language, memory and decision-making. The reformulation of cognitive deficits in terms of predictive coding has several advantages. It brings diverse clinical phenomena into a common framework; it aligns cognitive and movement disorders; and it makes specific predictions on cognitive physiology that support translational and experimental medicine studies. The insights into complex human cognitive disorders from the predictive coding framework may therefore also inform future therapeutic strategies.

Listeners with congenital amusia are sensitive to context uncertainty in melodic sequences

In typical listeners, the perceptual salience of a surprising auditory event depends on the uncertainty of its context. For example, in melodies, pitch deviants are more easily detected and generate larger neural responses when the context is highly predictable than when it is less so. However, it is not known whether amusic listeners with abnormal pitch processing are sensitive to the degree of uncertainty of pitch sequences and, if so, whether they are to a different extent than typical non-musician listeners. To answer this question, we manipulated the uncertainty of short melodies while participants with and without congenital amusia underwent EEG recordings in a passive listening task. Uncertainty was manipulated by presenting melodies with different levels of complexity and familiarity, under the assumption that simpler and more familiar patterns would enhance pitch predictability. We recorded mismatch negativity (MMN) responses to pitch, intensity, timbre, location, and rhythm deviants as a measure of auditory surprise. In both participant groups, we observed reduced MMN amplitudes and longer peak latencies for all sound features with increasing levels of complexity, and putative familiarity effects only for intensity deviants. No significant group-by-complexity or group-by-familiarity interactions were detected. However, in contrast to previous studies, pitch MMN responses in amusics were disrupted in high complexity and unfamiliar melodies. The present results thus indicate that amusics are sensitive to the uncertainty of melodic sequences and that preattentive auditory change detection is greatly spared in this population across sound features and levels of predictability. However, our findings also hint at pitch-specific impairments in this population when uncertainty is high, thus suggesting that pitch processing under high uncertainty conditions requires an intact frontotemporal loop.

Musical Expertise Is Associated with Improved Neural Statistical Learning in the Auditory Domain

 

It is poorly known whether musical training is associated with improvements in general cognitive abilities, such as statistical learning (SL). In standard SL paradigms, musicians have shown better performances than nonmusicians. However, this advantage could be due to differences in auditory discrimination, in memory or truly in the ability to learn sequence statistics. Unfortunately, these different hypotheses make similar predictions in terms of expected results. To dissociate them, we developed a Bayesian model and recorded electroencephalography (EEG). Our results confirm that musicians perform approximately 15% better than nonmusicians at predicting items in auditory sequences that embed either low or high-order statistics. These higher performances are explained in the model by parameters governing the learning of high-order statistics and the selection stage noise. EEG recordings reveal a neural underpinning of the musician's advantage: the P300 amplitude correlates with the surprise elicited by each item, and so, more strongly for musicians. Finally, early EEG components correlate with the surprise elicited by low-order statistics, as opposed to late EEG components that correlate with the surprise elicited by high-order statistics and this effect is stronger for musicians. Overall, our results demonstrate that musical expertise is associated with improved neural SL in the auditory domain.

SIGNIFICANCE STATEMENT

It is poorly known whether musical training leads to improvements in general cognitive skills. One fundamental cognitive ability, SL, is thought to be enhanced in musicians, but previous studies have reported mixed results. This is because such musician's advantage can embrace very different explanations, such as improvement in auditory discrimination or in memory. To solve this problem, we developed a Bayesian model and recorded EEG to dissociate these explanations. Our results reveal that musical expertise is truly associated with an improved ability to learn sequence statistics, especially high-order statistics. This advantage is reflected in the electroencephalographic recordings, where the P300 amplitude is more sensitive to surprising items in musicians than in nonmusicians.

Predictive processing, cognitive control, and tonality stability of music: An fMRI study of chromatic harmony

The present study aimed at identifying the brain regions which preferentially responded to music with medium degrees of key stability. There were three types of auditory stimuli. Diatonic music based strictly on major and minor scales has the highest key stability, whereas atonal music has the lowest key stability. Between these two extremes, chromatic music is characterized by sophisticated uses of out-of-key notes, which challenge the internal model of musical pitch and lead to higher precision-weighted prediction error compared to diatonic and atonal music. The brain activity of 29 adults with excellent relative pitch was measured with functional magnetic resonance imaging while they listened to diatonic music, chromatic music, and atonal random note sequences. Several frontoparietal regions showed significantly greater response to chromatic music than to diatonic music and atonal sequences, including the pre-supplementary motor area (extending into the dorsal anterior cingulate cortex), dorsolateral prefrontal cortex, rostrolateral prefrontal cortex, intraparietal sulcus, and precuneus. We suggest that these frontoparietal regions may support working memory processes, hierarchical sequencing, and conflict resolution of remotely related harmonic elements during the predictive processing of chromatic music. This finding suggested a possible correlation between precision-weighted prediction error and the frontoparietal regions implicated in cognitive control.

Extracting human cortical responses to sound onsets and acoustic feature changes in real music, and their relation to event rate

Evoked cortical responses (ERs) have mainly been studied in controlled experiments using simplified stimuli. Though, an outstanding question is how the human cortex responds to the complex stimuli encountered in realistic situations. Few electroencephalography (EEG) studies have used Music Information Retrieval (MIR) tools to extract cortical P1/N1/P2 to acoustical changes in real music. However, less than ten events per music piece could be detected leading to ERs due to limitations in automatic detection of sound onsets. Also, the factors influencing a successful extraction of the ERs have not been identified. Finally, previous studies did not localize the sources of the cortical generators. This study is based on an EEG/MEG dataset from 48 healthy normal hearing participants listening to three real music pieces. Acoustic features were computed from the audio signal of the music with the MIR Toolbox. To overcome limits in automatic methods, sound onsets were also manually detected. The chance of obtaining detectable ERs based on ten randomly picked onset points was less than 1:10,000. For the first time, we show that naturalistic P1/N1/P2 ERs can be reliably measured across 100 manually identified sound onsets, substantially improving the signal-to-noise level compared to <10 trials. More ERs were measurable in musical sections with slow event rates (0.2 Hz-2.5 Hz) than with fast event rates (>2.5 Hz). Furthermore, during monophonic sections of the music only P1/P2 were measurable, and during polyphonic sections only N1. Finally, MEG source analysis revealed that naturalistic P2 is located in core areas of the auditory cortex.

Perceptual learning of tone patterns changes the effective connectivity between Heschl's gyrus and planum temporale

Learning of complex auditory sequences such as music can be thought of as optimizing an internal model of regularities through unpredicted events (or “prediction errors”). We used dynamic causal modeling (DCM) and parametric empirical Bayes on functional magnetic resonance imaging (fMRI) data to identify modulation of effective brain connectivity that takes place during perceptual learning of complex tone patterns. Our approach differs from previous studies in two aspects. First, we used a complex oddball paradigm based on tone patterns as opposed to simple deviant tones. Second, the use of fMRI allowed us to identify cortical regions with high spatial accuracy. These regions served as empirical regions‐of‐interest for the analysis of effective connectivity. Deviant patterns induced an increased blood oxygenation level‐dependent response, compared to standards, in early auditory (Heschl's gyrus [HG]) and association auditory areas (planum temporale [PT]) bilaterally. Within this network, we found a left‐lateralized increase in feedforward connectivity from HG to PT during deviant responses and an increase in excitation within left HG. In contrast to previous findings, we did not find frontal activity, nor did we find modulations of backward connections in response to oddball sounds. Our results suggest that complex auditory prediction errors are encoded by changes in feedforward and intrinsic connections, confined to superior temporal gyrus.

Insights into human cognition from intracranial EEG: A review of audition, memory, internal cognition, and causality

By recording neural activity directly from the human brain, researchers gain unprecedented insight into how neurocognitive processes unfold in real time. We first briefly discuss how intracranial electroencephalography (iEEG) recordings, performed for clinical practice, are used to study human cognition with the spatiotemporal and single-trial precision traditionally limited to non-human animal research. We then delineate how studies using iEEG have informed our understanding of issues fundamental to human cognition: auditory prediction, working and episodic memory, and internal cognition. We also discuss the potential of iEEG to infer causality through the manipulation or 'engineering' of neurocognitive processes via spatiotemporally precise electrical stimulation. We close by highlighting limitations of iEEG, potential of burgeoning techniques to further increase spatiotemporal precision, and implications for future research using intracranial approaches to understand, restore, and enhance human cognition.

Meter enhances the subcortical processing of speech sounds at a strong beat

The temporal structure of sound such as in music and speech increases the efficiency of auditory processing by providing listeners with a predictable context. Musical meter is a good example of a sound structure that is temporally organized in a hierarchical manner, with recent studies showing that meter optimizes neural processing, particularly for sounds located at a higher metrical position or strong beat. Whereas enhanced cortical auditory processing at times of high metric strength has been studied, there is to date no direct evidence showing metrical modulation of subcortical processing. In this work, we examined the effect of meter on the subcortical encoding of sounds by measuring human auditory frequency-following responses to speech presented at four different metrical positions. Results show that neural encoding of the fundamental frequency of the vowel was enhanced at the strong beat, and also that the neural consistency of the vowel was the highest at the strong beat. When comparing musicians to non-musicians, musicians were found, at the strong beat, to selectively enhance the behaviorally relevant component of the speech sound, namely the formant frequency of the transient part. Our findings indicate that the meter of sound influences subcortical processing, and this metrical modulation differs depending on musical expertise.

Rhythmic Synchrony with Artificial Agents and Its Effects on Frequency of Visual Illusions Seen in White Noise

Rhythmic synchrony among different individuals has often been observed in various religious rituals and it has been known to bring various psychological effects in human minds. This study investigated the effects of induced rhythmic synchrony with artificial agents in drumming on participants’ visual illusions. The participants completed a task with three cartoon agents on a computer screen beating drums taking turns. We then investigated whether participants were tended to find more meaningful shapes in displayed random dots (pareidolia) when rhythms of intervals between each agents’ drumbeats were in-sync rather than out-of-sync. We simultaneously compared an active condition, in which participants took the role as one of three agents to beat a drum, with a passive condition, in which they only observed three agents beating the drums. The results showed that pareidolia appeared strongly in participants where the drum rhythm was in sync, regardless of active and passive conditions.

Future thinking about social targets: The influence of prediction outcome on memory

Work on future thinking suggests that people use what they know about the world (e.g., contents of memory) to make predictions about events to come, which reflects an adaptive use of memory. Less work, however, has examined whether the outcomes of these predictions-whether the outcome is consistent or inconsistent with predictions-influences memory. In two experiments, participants learned trait information about social targets and used that information to predict which of two behaviors social targets would be most likely to engage in: one behavior consistent with previously learned trait information about the target and the other behavior inconsistent. Participants then learned which behavior the social target actually performed (outcome) and then judged whether or not they expected that outcome (expectancy). Across both studies, prediction-consistent outcomes were better remembered than inconsistent ones, suggesting that participants relied on their existing representations of social targets when making memory judgments rather than incorporating inconsistent information into memory. Further, there was a memory advantage for prediction-inconsistent outcomes, but only when participants subjectively rated these outcomes as unexpected. Overall, these findings extend understanding of future thinking and suggest a reliable memory advantage for outcomes that are consistent with predictions.

Neural Responses to Musical Rhythm in Chinese Children With Reading Difficulties

The perception of the musical rhythm has been suggested as one of the predicting factors for reading abilities. Several studies have demonstrated that children with reading difficulties (RD) show reduced neural sensitivity in musical rhythm perception. Despite this prior evidence, the association between music and reading in Chinese is still controversial. In the present study, we sought to answer the question of whether the musical rhythm perception of Chinese children with RD is intact or not, providing further clues on how reading and music might be interlinked across languages. Oddball paradigm was adapted for testing the difference of musical rhythm perception, including predictable and unpredictable omission, in elementary school children with RD and typically developing age-controlled children with magnetoencephalography (MEG). We used the cluster-based permutation tests to examine the statistical difference in neural responses. The event-related field (ERF) components, mismatch negativity (MMNm) and P3a(m), were elicited by the rhythmical patterns with omitted strong beats. Specifically, differential P3a(m) components were found smaller in children with RD when comparing the rhythmical patterns between predictable and unpredicted omission patterns. The results showed that brain responses to the omission in the strong beat of an unpredicted rhythmic pattern were significantly smaller in Chinese children with RD. This indicated that children with RD may be impaired in the auditory sensitivity of rhythmic beats. This also suggests that children with reading difficulties may have atypical neural representations of rhythm that could be one of the underlying factors in dysfluent reading development.

Timing Markers of Interaction Quality During Semi-Hocket Singing

Music is believed to work as a bio-social tool enabling groups of people to establish joint action and group bonding experiences. However, little is known about the quality of the group members' interaction needed to bring about these effects. To investigate the role of interaction quality, and its effect on joint action and bonding experience, we asked dyads (two singers) to perform music in medieval "hocket" style, in order to engage their co-regulatory activity. The music contained three relative inter-onset-interval (IOI) classes: quarter note, dotted quarter note and eight note, marking time intervals between successive onsets (generated by both singers). We hypothesized that singers co-regulated their activity by minimizing prediction errors in view of stable IOI-classes. Prediction errors were measured using a dynamic Bayesian inference approach that allows us to identify three different types of error called fluctuation (micro-timing errors measured in milliseconds), narration (omission errors or misattribution of an IOI to a wrong IOI class), and collapse errors (macro-timing errors that cause the breakdown of a performance). These three types of errors were correlated with the singers' estimated quality of the performance and the experienced sense of joint agency. We let the singers perform either while moving or standing still, under the hypothesis that the moving condition would have reduced timing errors and increased We-agency as opposed to Shared-agency (the former portraying a condition in which the performers blend into one another, the latter portraying a joint, but distinct, control of the performance). The results show that estimated quality correlates with fluctuation and narration errors, while agency correlates (to a lesser degree) with narration errors. Somewhat unexpectedly, there was a minor effect of movement, and it was beneficial only for good performers. Joint agency resulted in a "shared," rather than a "we," sense of joint agency. The methodology and findings open up promising avenues for future research on social embodied music interaction.