Rhythmic and melodic deviations in musical sequences recruit different cortical areas for mismatch detection

Beyond the ears: A review exploring the interconnected brain behind the hierarchical memory of music

Music is a ubiquitous element of daily life. Understanding how music memory is represented and expressed in the brain is key to understanding how music can influence human daily cognitive tasks. Current music-memory literature is built on data from very heterogeneous tasks for measuring memory, and the neural correlates appear to differ depending on different forms of memory function targeted. Such heterogeneity leaves many exceptions and conflicts in the data underexplained (e.g., hippocampal involvement in music memory is debated). This review provides an overview of existing neuroimaging results from music-memory related studies and concludes that although music is a special class of event in our lives, the memory systems behind it do in fact share neural mechanisms with memories from other modalities. We suggest that dividing music memory into different levels of a hierarchy (structural level and semantic level) helps understand overlap and divergence in neural networks involved. This is grounded in the fact that memorizing a piece of music recruits brain clusters that separately support functions including-but not limited to-syntax storage and retrieval, temporal processing, prediction versus reality comparison, stimulus feature integration, personal memory associations, and emotion perception. The cross-talk between frontal-parietal music structural processing centers and the subcortical emotion and context encoding areas explains why music is not only so easily memorable but can also serve as strong contextual information for encoding and retrieving nonmusic information in our lives.

Temporal hierarchies in the predictive processing of melody - From pure tones to songs

Listening to musical melodies is a complex task that engages perceptual and memoryrelated processes. The processes underlying melody cognition happen simultaneously on different timescales, ranging from milliseconds to minutes. Although attempts have been made, research on melody perception is yet to produce a unified framework of how melody processing is achieved in the brain. This may in part be due to the difficulty of integrating concepts such as perception, attention and memory, which pertain to different temporal scales. Recent theories on brain processing, which hold prediction as a fundamental principle, offer potential solutions to this problem and may provide a unifying framework for explaining the neural processes that enable melody perception on multiple temporal levels. In this article, we review empirical evidence for predictive coding on the levels of pitch formation, basic pitch-related auditory patterns,more complex regularity processing extracted from basic patterns and long-term expectations related to musical syntax. We also identify areas that would benefit from further inquiry and suggest future directions in research on musical melody perception.

Preterm neonates distinguish rhythm violation through a hierarchy of cortical processing

Rhythm is a fundamental component of the auditory world, present even during the prenatal life. While there is evidence that some auditory capacities are already present before birth, whether and how the premature neural networks process auditory rhythm is yet not known. We investigated the neural response of premature neonates at 30-34 weeks gestational age to violations from rhythmic regularities in an auditory sequence using high-resolution electroencephalography and event-related potentials. Unpredicted rhythm violations elicited a fronto-central mismatch response, indicating that the premature neonates detected the rhythmic regularities. Next, we examined the cortical effective connectivity underlying the elicited mismatch response using dynamic causal modeling. We examined the connectivity between cortical sources using a set of 16 generative models that embedded alternate hypotheses about the role of the frontal cortex as well as backward fronto-temporal connection. Our results demonstrated that the processing of rhythm violations was not limited to the primary auditory areas, and as in the case of adults, encompassed a hierarchy of temporo-frontal cortical structures. The result also emphasized the importance of top-down (backward) projections from the frontal cortex in explaining the mismatch response. Our findings demonstrate a sophisticated cortical structure underlying predictive rhythm processing at the onset of the thalamocortical and cortico-cortical circuits, two months before term.

Neural processing of poems and songs is based on melodic properties

The neural processing of speech and music is still a matter of debate. A long tradition that assumes shared processing capacities for the two domains contrasts with views that assume domain-specific processing. We here contribute to this topic by investigating, in a functional magnetic imaging (fMRI) study, ecologically valid stimuli that are identical in wording and differ only in that one group is typically spoken (or silently read), whereas the other is sung: poems and their respective musical settings. We focus on the melodic properties of spoken poems and their sung musical counterparts by looking at proportions of significant autocorrelations (PSA) based on pitch values extracted from their recordings. Following earlier studies, we assumed a bias of poem-processing towards the left and a bias for song-processing on the right hemisphere. Furthermore, PSA values of poems and songs were expected to explain variance in left- vs. right-temporal brain areas, while continuous liking ratings obtained in the scanner should modulate activity in the reward network. Overall, poem processing compared to song processing relied on left temporal regions, including the superior temporal gyrus, whereas song processing compared to poem processing recruited more right temporal areas, including Heschl's gyrus and the superior temporal gyrus. PSA values co-varied with activation in bilateral temporal regions for poems, and in right-dominant fronto-temporal regions for songs. Continuous liking ratings were correlated with activity in the default mode network for both poems and songs. The pattern of results suggests that the neural processing of poems and their musical settings is based on their melodic properties, supported by bilateral temporal auditory areas and an additional right fronto-temporal network known to be implicated in the processing of melodies in songs. These findings take a middle ground in providing evidence for specific processing circuits for speech and music in the left and right hemisphere, but simultaneously for shared processing of melodic aspects of both poems and their musical settings in the right temporal cortex. Thus, we demonstrate the neurobiological plausibility of assuming the importance of melodic properties in spoken and sung aesthetic language alike, along with the involvement of the default mode network in the aesthetic appreciation of these properties.

Vocal melody and musical background are simultaneously processed by the brain for musical predictions

Musical pleasure is related to the capacity to predict and anticipate the music. By recording early cerebral responses of 16 participants with electroencephalography during periods of silence inserted in known and unknown songs, we aimed to measure the contribution of different musical attributes to musical predictions. We investigated the mismatch between past encoded musical features and the current sensory inputs when listening to lyrics associated with vocal melody, only background instrumental material, or both attributes grouped together. When participants were listening to chords and lyrics for known songs, the brain responses related to musical violation produced event-related potential responses around 150-200 ms that were of a larger amplitude than for chords or lyrics only. Microstate analysis also revealed that for chords and lyrics, the global field power had an increased stability and a longer duration. The source localization identified that the right superior temporal and frontal gyri and the inferior and medial frontal gyri were activated for a longer time for chords and lyrics, likely caused by the increased complexity of the stimuli. We conclude that grouped together, a broader integration and retrieval of several musical attributes at the same time recruit larger neuronal networks that lead to more accurate predictions.

Decoding expectation and surprise in dementia: the paradigm of music

Making predictions about the world and responding appropriately to unexpected events are essential functions of the healthy brain. In neurodegenerative disorders, such as frontotemporal dementia and Alzheimer's disease, impaired processing of 'surprise' may underpin a diverse array of symptoms, particularly abnormalities of social and emotional behaviour, but is challenging to characterize. Here, we addressed this issue using a novel paradigm: music. We studied 62 patients (24 female; aged 53-88) representing major syndromes of frontotemporal dementia (behavioural variant, semantic variant primary progressive aphasia, non-fluent-agrammatic variant primary progressive aphasia) and typical amnestic Alzheimer's disease, in relation to 33 healthy controls (18 female; aged 54-78). Participants heard famous melodies containing no deviants or one of three types of deviant note-acoustic (white-noise burst), syntactic (key-violating pitch change) or semantic (key-preserving pitch change). Using a regression model that took elementary perceptual, executive and musical competence into account, we assessed accuracy detecting melodic deviants and simultaneously recorded pupillary responses and related these to deviant surprise value (information-content) and carrier melody predictability (entropy), calculated using an unsupervised machine learning model of music. Neuroanatomical associations of deviant detection accuracy and coupling of detection to deviant surprise value were assessed using voxel-based morphometry of patients' brain MRI. Whereas Alzheimer's disease was associated with normal deviant detection accuracy, behavioural and semantic variant frontotemporal dementia syndromes were associated with strikingly similar profiles of impaired syntactic and semantic deviant detection accuracy and impaired behavioural and autonomic sensitivity to deviant information-content (all P < 0.05). On the other hand, non-fluent-agrammatic primary progressive aphasia was associated with generalized impairment of deviant discriminability (P < 0.05) due to excessive false-alarms, despite retained behavioural and autonomic sensitivity to deviant information-content and melody predictability. Across the patient cohort, grey matter correlates of acoustic deviant detection accuracy were identified in precuneus, mid and mesial temporal regions; correlates of syntactic deviant detection accuracy and information-content processing, in inferior frontal and anterior temporal cortices, putamen and nucleus accumbens; and a common correlate of musical salience coding in supplementary motor area (all P < 0.05, corrected for multiple comparisons in pre-specified regions of interest). Our findings suggest that major dementias have distinct profiles of sensory 'surprise' processing, as instantiated in music. Music may be a useful and informative paradigm for probing the predictive decoding of complex sensory environments in neurodegenerative proteinopathies, with implications for understanding and measuring the core pathophysiology of these diseases.

Violation of rhythmic expectancies can elicit late frontal gamma activity nested in theta oscillations

Rhythm processing involves building expectations according to the hierarchical temporal structure of auditory events. Although rhythm processing has been addressed in the context of predictive coding, the properties of the oscillatory response in different cortical areas are still not clear. We explored the oscillatory properties of the neural response to rhythmic incongruence and the cross-frequency coupling between multiple frequencies to further investigate the mechanisms underlying rhythm perception. We designed an experiment to investigate the neural response to rhythmic deviations in which the tone either arrived earlier than expected or the tone in the same metrical position was omitted. These two manipulations modulate the rhythmic structure differently, with the former creating a larger violation of the general structure of the musical stimulus than the latter. Both deviations resulted in an MMN response, whereas only the rhythmic deviant resulted in a subsequent P3a. Rhythmic deviants due to the early occurrence of a tone, but not omission deviants, seemed to elicit a late high gamma response (60-80 Hz) at the end of the P3a over the left frontal region, which, interestingly, correlated with the P3a amplitude over the same region and was also nested in theta oscillations. The timing of the elicited high-frequency gamma oscillations related to rhythmic deviation suggests that it might be related to the update of the predictive neural model, corresponding to the temporal structure of the events in higher-level cortical areas.

Chinese and Western Musical Training Impacts the Circuit in Auditory and Reward Systems

Previous studies have provided evidence about the brain plasticity effects of musical training, however, the issue of how expertise in music styles induced by Chinese or Western musical training affects neuroplasticity and reward responses has been less considered, especially for subjects of Chinese origin. In this work, 16 musicians who trained in the Western music style (Western-trained musicians) and 18 musicians who trained in the Chinese music style (Chinese-trained musicians) were recruited as the musician group for the experiment, while 15 non-musicians were recruited as the control group. Using a paradigm that consisted of listening to Chinese and Western music and measurements using functional magnetic resonance imaging (fMRI) technology, we found that Chinese-trained musicians activated the bilateral superior temporal gyrus (STG) when listening to music, while Western-trained musicians activated the left STG. In addition, under the condition of listening to music with Chinese style, Chinese-trained musicians have a stronger functional connection in the circuit of the auditory and reward system than Western-trained musicians. The finding is opposite under the condition of listening to music with Western style. Interestingly, it seems that the circuit of Chinese-trained musicians is partial to the right STG, while Western-trained musicians show the opposite, i.e., a tendency toward the left STG. The influence of different music styles on experienced musicians is reflected by the functional activities and connections between the auditory system and the reward system. This outcome indicates that training in Chinese music style or Western music style affects the strategies of musicians when listening to music. Musical characteristics such as rhythm, melody and cultural attributes play an important role in this process. These findings, which provide evidence for functional neuroplasticity based on musical training, can enrich our insights into the musical brain.

Dysfunctional frontal activation of mismatch negativity in panic disorder: A magnetoencephalographic study

BACKGROUND

Mismatch negativity (MMN) or its magnetic counterpart (MMNm) is a neurophysiological signal to reflect the automatic change-detection ability. However, MMN studies in patients with panic disorder (PD) showed contrasting results using electroencephalographic (EEG) recordings. The present study attempted to overcome the limitations of EEG methodology by means of a whole-head magnetoencephalography (MEG) combined with the depth-weighted minimum norm estimate method to conduct an in-depth investigation on the MMNm at the cortical level in patients with PD.

METHODS

We recruited 22 healthy controls (HC) and 20 patients with PD to perform auditory oddball paradigm during MEG recordings. The cortical MMNm amplitudes and latencies in the superior temporal gyrus, inferior parietal lobule, and inferior frontal gyrus (IFG) were compared between the HC and PD groups. The correlations between MMNm responses and clinical measurement were also examined.

RESULTS

Compared with the HC group, the PD group demonstrated significantly reduced MMNm amplitudes in the IFG. Furthermore, higher trait scores of the State-Trait Anxiety Inventory were associated with lower MMNm amplitudes of the right IFG among patients with PD.

LIMITATIONS

Generalization of the current results to other settings or samples should be made cautiously due to the use of different medication regimens and presence of comorbidities in our patients.

CONCLUSIONS

Our data suggest dysfunctional pre-attentive change-detection ability in patients with PD, particularly in the IFG.

Arcuate fasciculus architecture is associated with individual differences in pre-attentive detection of unpredicted music changes

The mismatch negativity (MMN) is an event related brain potential (ERP) elicited by unpredicted sounds presented in a sequence of repeated auditory stimuli. The neural sources of the MMN have been previously attributed to a fronto-temporo-parietal network which crucially overlaps with the so-called auditory dorsal stream, involving inferior and middle frontal, inferior parietal, and superior and middle temporal regions. These cortical areas are structurally connected by the arcuate fasciculus (AF), a three-branch pathway supporting the feedback-feedforward loop involved in auditory-motor integration, auditory working memory, storage of acoustic templates, as well as comparison and update of those templates. Here, we characterized the individual differences in the white-matter macrostructural properties of the AF and explored their link to the electrophysiological marker of passive change detection gathered in a melodic multifeature MMN-EEG paradigm in 26 healthy young adults without musical training. Our results show that left fronto-temporal white-matter connectivity plays an important role in the pre-attentive detection of rhythm modulations within a melody. Previous studies have shown that this AF segment is also critical for language processing and learning. This strong coupling between structure and function in auditory change detection might be related to life-time linguistic (and possibly musical) exposure and experiences, as well as to timing processing specialization of the left auditory cortex. To the best of our knowledge, this is the first time in which the relationship between neurophysiological (EEG) and brain white-matter connectivity indexes using DTI-tractography are studied together. Thus, the present results, although still exploratory, add to the existing evidence on the importance of studying the constraints imposed on cognitive functions by the underlying structural connectivity.

A Comparison of Human and Computational Melody Prediction Through Familiarity and Expertise

Melody prediction is an important aspect of music listening. The success of prediction, i.e., whether the next note played in a song is the same as the one predicted by the listener, depends on various factors. In the paper, we present two studies, where we assess how music familiarity and music expertise influence melody prediction in human listeners, and, expressed in appropriate data/algorithmic ways, computational models. To gather data on human listeners, we designed a melody prediction user study, where familiarity was controlled by two different music collections, while expertise was assessed by adapting the Music Sophistication Index instrument to Slovenian language. In the second study, we evaluated the melody prediction accuracy of computational melody prediction models. We evaluated two models, the SymCHM and the Implication-Realization model, which differ substantially in how they approach melody prediction. Our results show that both music familiarity and expertise affect the prediction accuracy of human listeners, as well as of computational models.

Empirical Bayes evaluation of fused EEG-MEG source reconstruction: Application to auditory mismatch evoked responses

We here turn the general and theoretical question of the complementarity of EEG and MEG for source reconstruction, into a practical empirical one. Precisely, we address the challenge of evaluating multimodal data fusion on real data. For this purpose, we build on the flexibility of Parametric Empirical Bayes, namely for EEG-MEG data fusion, group level inference and formal hypothesis testing. The proposed approach follows a two-step procedure by first using unimodal or multimodal inference to derive a cortical solution at the group level; and second by using this solution as a prior model for single subject level inference based on either unimodal or multimodal data. Interestingly, for inference based on the same data (EEG, MEG or both), one can then formally compare, as alternative hypotheses, the relative plausibility of the two unimodal and the multimodal group priors. Using auditory data, we show that this approach enables to draw important conclusions, namely on (i) the superiority of multimodal inference, (ii) the greater spatial sensitivity of MEG compared to EEG, (iii) the ability of EEG data alone to source reconstruct temporal lobe activity, (iv) the usefulness of EEG to improve MEG based source reconstruction. Importantly, we largely reproduce those findings over two different experimental conditions. We here focused on Mismatch Negativity (MMN) responses for which generators have been extensively investigated with little homogeneity in the reported results. Our multimodal inference at the group level revealed spatio-temporal activity within the supratemporal plane with a precision which, to our knowledge, has never been achieved before with non-invasive recordings.

Te.M.P.O., an app for using temporal musical mismatch in post-stroke neurorehabilitation: A preliminary randomized controlled study

BACKGROUND: Recently, the potential rehabilitation value of music has been examined and music-based interventions and techniques such as the Negative Mismatch (MMN) have been increasingly investigated in the neurological rehabilitation context. OBJECTIVE: The aim of this study was to investigate the effectiveness of a negative mismatch-based therapy on the disability and quality of life in patients with stroke in sub-acute phase. METHODS: Thirty patients with a stroke diagnosis in sub-acute phase were randomly assigned to one of two groups: Mismatch (Mg) or Control (CTRLg) group. Both groups used an innovative Android application: Temporal Musical Patterns Organisation (Te.M.P.O). The Disability Rating Scale (DRS), the Modified Barthel Index (MBI) and the Stroke Specific Quality of Life scale (SSQoL) were used at the baseline (T0) and after four weeks of training (T1), in order to assess changes over time. RESULTS: Statistical analysis was performed using the data of 24 (Mg = 12, CTRLg = 12) subjects. The results show a major improvement of the Mg with respect to the CTRLg in all clinical scales score. CONCLUSION: The temporal negative mismatch-based therapy performed with the Te.M.P.O. application could be useful in improving the disability and the quality of life in stroke survivors in a sub-acute phase.

Functional connectivity of the frontotemporal network in preattentive detection of abstract changes: Perturbs and observes with transcranial magnetic stimulation and event-related optical signal

Current theories of automatic or preattentive change detection suggest a regularity or prediction violation mechanism involving functional connectivity between the inferior frontal cortex (IFC) and the superior temporal cortex (STC). By disrupting the IFC function with transcranial magnetic stimulation (TMS) and recording the later STC mismatch response with event-related optical signal (EROS), previous study demonstrated a causal IFC-to-STC functional connection in detecting a pitch or physical change. However, physical change detection can be achieved by memory comparison of the physical features and may not necessarily involve regularity/rule extraction and prediction. The current study investigated the IFC-STC functional connectivity in detecting rule violation (i.e., an abstract change). Frequent standard tone pairs with a constant relative pitch difference, but varying pitches, were presented to establish a pitch interval rule. This abstract rule was violated by deviants with reduced relative pitch intervals. The EROS STC mismatch response to the deviants was abolished by the TMS applied at the IFC 80 ms after deviance onset, but preserved in the spatial (TMS on vertex), auditory (TMS sound), and temporal (200 ms after deviance onset) control conditions. These results demonstrate the IFC-STC connection in preattentive abstract change detection and support the regularity or prediction violation account.

A Preliminary Study of the Effects of Attentive Music Listening on Cochlear Implant Users' Speech Perception, Quality of Life, and Behavioral and Objective Measures of Frequency Change Detection

Introduction

Most cochlear implant (CI) users have difficulty in listening tasks that rely strongly on perception of frequency changes (e.g., speech perception in noise, musical melody perception, etc.). Some previous studies using behavioral or subjective assessments have shown that short-term music training can benefit CI users’ perception of music and speech. Electroencephalographic (EEG) recordings may reveal the neural basis for music training benefits in CI users.

Objective

To examine the effects of short-term music training on CI hearing outcomes using a comprehensive test battery of subjective evaluation, behavioral tests, and EEG measures.

Design

Twelve adult CI users were recruited for a home-based music training program that focused on attentive listening to music genres and materials that have an emphasis on melody. The participants used a music streaming program (i.e., Pandora) downloaded onto personal electronic devices for training. The participants attentively listened to music through a direct audio cable or through Bluetooth streaming. The training schedule was 40 min/session/day, 5 days/week, for either 4 or 8 weeks. The pre-training and post-training tests included: hearing thresholds, Speech, Spatial and Qualities of Hearing Scale (SSQ12) questionnaire, psychoacoustic tests of frequency change detection threshold (FCDT), speech recognition tests (CNC words, AzBio sentences, and QuickSIN), and EEG responses to tones that contained different magnitudes of frequency changes.

Results

All participants except one finished the 4- or 8-week training, resulting in a dropout rate of 8.33%. Eleven participants performed all tests except for two who did not participate in EEG tests. Results showed a significant improvement in the FCDTs as well as performance on CNC and QuickSIN after training (p < 0.05), but no significant improvement in SSQ scores (p > 0.05). Results of the EEG tests showed larger post-training cortical auditory evoked potentials (CAEPs) in seven of the nine participants, suggesting a better cortical processing of both stimulus onset and within-stimulus frequency changes.

Conclusion

These preliminary data suggest that extensive, focused music listening can improve frequency perception and speech perception in CI users. Further studies that include a larger sample size and control groups are warranted to determine the efficacy of short-term music training in CI users.

The influence of pitch feedback on learning of motor -timing and sequencing: A piano study with novices

Audio-motor coordination is a fundamental requirement in the learning and execution of sequential actions such as music performance. Predictive motor control mechanisms determine the sequential content and timing of upcoming tones and thereby facilitate accurate performance. To study the role of auditory-motor predictions at early stages of acquiring piano performance skills, we conducted an experiment in which non-musicians learned to play a musical sequence on the piano in synchrony with a metronome. Three experimental conditions compared errors and timing. The first consisted of normal auditory feedback using conventional piano key-to-tone mappings. The second employed fixed-pitch auditory feedback consisting of a single tone that was given with each key stroke. In the third condition, for each key stroke a tone was randomly drawn from the set of tones associated with the normal sequence. The results showed that when auditory feedback tones were randomly assigned, participants produced more sequencing errors (i.e., a higher percentage of incorrect key strokes) compared to when auditory feedback was normal or consisted of a single tone of fixed pitch. Furthermore, synchronization with the metronome was most accurate in the fixed-pitch single-tone condition. These findings suggest that predictive motor control mechanisms support sequencing and timing, and that these sensorimotor processes are dissociable even at early stages of acquiring complex motor skills such as music performance.

Music Familiarity Affects EEG Entrainment When Little Attention Is Paid

To investigate the brain's response to music, many researchers have examined cortical entrainment in relation to periodic tunes, periodic beats, and music. Music familiarity is another factor that affects cortical entrainment, and electroencephalogram (EEG) studies have shown that stronger entrainment occurs while listening to unfamiliar music than while listening to familiar music. In the present study, we hypothesized that not only the level of familiarity but also the level of attention affects the level of entrainment. We simultaneously presented music and a silent movie to participants and we recorded an EEG while participants paid attention to either the music or the movie in order to investigate whether cortical entrainment is related to attention and music familiarity. The average cross-correlation function across channels, trials, and participants exhibited a pronounced positive peak at time lags around 130 ms and a negative peak at time lags around 260 ms. The statistical analysis of the two peaks revealed that the level of attention did not affect the level of entrainment, and, moreover, that in both the auditory-active and visual-active conditions, the entrainment level is stronger when listening to unfamiliar music than when listening to familiar music. This may indicate that the familiarity with music affects cortical activities when attention is not fully devoted to listening to music.

Influence of Musical Enculturation on Brain Responses to Metric Deviants

The ability to recognize metric accents is fundamental in both music and language perception. It has been suggested that music listeners prefer rhythms that follow simple binary meters, which are common in Western music. This means that listeners expect odd-numbered beats to be strong and even-numbered beats to be weak. In support of this, studies have shown that listeners exposed to Western music show stronger novelty and incongruity related P3 and irregularity detection related mismatch negativity (MMN) brain responses to attenuated odd- than attenuated even-numbered metric positions. Furthermore, behavioral evidence suggests that music listeners' preferences can be changed by long-term exposure to non-Western rhythms and meters, e.g., by listening to African or Balkan music. In our study, we investigated whether it might be possible to measure effects of music enculturation on neural responses to attenuated tones on specific metric positions. We compared the magnetic mismatch negativity (MMNm) to attenuated beats in a “Western group” of listeners (n = 12) mainly exposed to Western music and a “Bicultural group” of listeners (n = 13) exposed for at least 1 year to both Sub-Saharan African music in addition to Western music. We found that in the “Western group” the MMNm was higher in amplitude to deviant tones on odd compared to even metric positions, but not in the “Bicultural group.” In support of this finding, there was also a trend of the “Western group” to rate omitted beats as more surprising on odd than even metric positions, whereas the “Bicultural group” seemed to discriminate less between metric positions in terms of surprise ratings. Also, we observed that the overall latency of the MMNm was significantly shorter in the Bicultural group compared to the Western group. These effects were not biased by possible differences in rhythm perception ability or music training, measured with the Musical Ear Test (MET). Furthermore, source localization analyses suggest that auditory, inferior temporal, sensory-motor, superior frontal, and parahippocampal regions might be involved in eliciting the MMNm to the metric deviants. These findings suggest that effects of music enculturation can be measured on MMNm responses to attenuated tones on specific metric positions.

The right inferior frontal gyrus processes nested non-local dependencies in music

Complex auditory sequences known as music have often been described as hierarchically structured. This permits the existence of non-local dependencies, which relate elements of a sequence beyond their temporal sequential order. Previous studies in music have reported differential activity in the inferior frontal gyrus (IFG) when comparing regular and irregular chord-transitions based on theories in Western tonal harmony. However, it is unclear if the observed activity reflects the interpretation of hierarchical structure as the effects are confounded by local irregularity. Using functional magnetic resonance imaging (fMRI), we found that violations to non-local dependencies in nested sequences of three-tone musical motifs in musicians elicited increased activity in the right IFG. This is in contrast to similar studies in language which typically report the left IFG in processing grammatical syntax. Effects of increasing auditory working demands are moreover reflected by distributed activity in frontal and parietal regions. Our study therefore demonstrates the role of the right IFG in processing non-local dependencies in music, and suggests that hierarchical processing in different cognitive domains relies on similar mechanisms that are subserved by domain-selective neuronal subpopulations.

Functional neural changes associated with acquired amusia across different stages of recovery after stroke

Brain damage causing acquired amusia disrupts the functional music processing system, creating a unique opportunity to investigate the critical neural architectures of musical processing in the brain. In this longitudinal fMRI study of stroke patients (N = 41) with a 6-month follow-up, we used natural vocal music (sung with lyrics) and instrumental music stimuli to uncover brain activation and functional network connectivity changes associated with acquired amusia and its recovery. In the acute stage, amusic patients exhibited decreased activation in right superior temporal areas compared to non-amusic patients during instrumental music listening. During the follow-up, the activation deficits expanded to comprise a wide-spread bilateral frontal, temporal, and parietal network. The amusics showed less activation deficits to vocal music, suggesting preserved processing of singing in the amusic brain. Compared to non-recovered amusics, recovered amusics showed increased activation to instrumental music in bilateral frontoparietal areas at 3 months and in right middle and inferior frontal areas at 6 months. Amusia recovery was also associated with increased functional connectivity in right and left frontoparietal attention networks to instrumental music. Overall, our findings reveal the dynamic nature of deficient activation and connectivity patterns in acquired amusia and highlight the role of dorsal networks in amusia recovery.

Familiarity Affects Entrainment of EEG in Music Listening

Music perception involves complex brain functions. The relationship between music and brain such as cortical entrainment to periodic tune, periodic beat, and music have been well investigated. It has also been reported that the cerebral cortex responded more strongly to the periodic rhythm of unfamiliar music than to that of familiar music. However, previous works mainly used simple and artificial auditory stimuli like pure tone or beep. It is still unclear how the brain response is influenced by the familiarity of music. To address this issue, we analyzed electroencelphalogram (EEG) to investigate the relationship between cortical response and familiarity of music using melodies produced by piano sounds as simple natural stimuli. The cross-correlation function averaged across trials, channels, and participants showed two pronounced peaks at time lags around 70 and 140 ms. At the two peaks the magnitude of the cross-correlation values were significantly larger when listening to unfamiliar and scrambled music compared to those when listening to familiar music. Our findings suggest that the response to unfamiliar music is stronger than that to familiar music. One potential application of our findings would be the discrimination of listeners' familiarity with music, which provides an important tool for assessment of brain activity.

Classification of familiarity based on cross-correlation features between EEG and music

An approach to recognize the familiarity of a listener with music using both the electroencephalogram (EEG) signals and the music signal is proposed in this paper. Eight participants listened to melodies produced by piano sounds as simple natural stimuli. We classified the familiarity of each participant using cross-correlation values between EEG and the envelope of the music signal as features of the support vector machine (SVM) or neural network used. Here, we report that the maximum classification accuracy was 100% obtained by the SVM. These results suggest that the familiarity of music can be classified by cross-correlation values. The proposed approach can be used to recognize high-level brain states such as familiarity, preference, and emotion.

Pre-target neural oscillations predict variability in the detection of small pitch changes

Pitch discrimination is important for language or music processing. Previous studies indicate that auditory perception depends on pre-target neural activity. However, so far the pre-target electrophysiological conditions which enable the detection of small pitch changes are not well studied, but might yield important insights into pitch-processing. We used magnetoencephalography (MEG) source imaging to reveal the pre-target effects of successful auditory detection of small pitch deviations from a sequence of standard tones. Participants heard a sequence of four pure tones and had to determine whether the last target tone was different or identical to the first three standard sounds. We found that successful pitch change detection could be predicted from the amplitude of theta (4-8 Hz) oscillatory activity in the right inferior frontal gyrus (IFG) as well as beta (12-30 Hz) oscillatory activity in the right auditory cortex. These findings confirm and extend evidence for the involvement of theta as well as beta-band activity in auditory perception.

Shared Neural Mechanisms for the Prediction of Own and Partner Musical Sequences after Short-term Piano Duet Training

Predictive mechanisms in the human brain can be investigated using markers for prediction violations like the mismatch negativity (MMN). Short-term piano training increases the MMN for melodic and rhythmic deviations in the training material. This increase occurs only when the material is actually played, not when it is only perceived through listening, suggesting that learning predictions about upcoming musical events are derived from motor involvement. However, music is often performed in concert with others. In this case, predictions about upcoming actions from a partner are a crucial part of the performance. In the present experiment, we use magnetoencephalography (MEG) to measure MMNs to deviations in one's own and a partner's musical material after both engaged in musical duet training. Event-related field (ERF) results revealed that the MMN increased significantly for own and partner material suggesting a neural representation of the partner's part in a duet situation. Source analysis using beamforming revealed common activations in auditory, inferior frontal, and parietal areas, similar to previous results for single players, but also a pronounced contribution from the cerebellum. In addition, activation of the precuneus and the medial frontal cortex was observed, presumably related to the need to distinguish between own and partner material.

Interaction of Musicianship and Aging: A Comparison of Cortical Auditory Evoked Potentials

Objective. The goal of this study was to begin to explore whether the beneficial auditory neural effects of early music training persist throughout life and influence age-related changes in neurophysiological processing of sound. Design. Cortical auditory evoked potentials (CAEPs) elicited by harmonic tone complexes were examined, including P1-N1-P2, mismatch negativity (MMN), and P3a. Study Sample. Data from older adult musicians (n = 8) and nonmusicians (n = 8) (ages 55–70 years) were compared to previous data from young adult musicians (n = 40) and nonmusicians (n = 20) (ages 18–33 years). Results. P1-N1-P2 amplitudes and latencies did not differ between older adult musicians and nonmusicians; however, MMN and P3a latencies for harmonic tone deviances were earlier for older musicians than older nonmusicians. Comparisons of P1-N1-P2, MMN, and P3a components between older and young adult musicians and nonmusicians suggest that P1 and P2 latencies are significantly affected by age, but not musicianship, while MMN and P3a appear to be more sensitive to effects of musicianship than aging. Conclusions. Findings support beneficial influences of musicianship on central auditory function and suggest a positive interaction between aging and musicianship on the auditory neural system.

The Mismatch Negativity: An Indicator of Perception of Regularities in Music

This paper reviews music research using Mismatch Negativity (MMN). MMN is a deviation-specific component of auditory event-related potential (EPR), which detects a deviation between a sound and an internal representation (e.g., memory trace). Recent studies have expanded the notion and the paradigms of MMN to higher-order music processing such as those involving short melodies, harmony chord, and music syntax. In this vein, we firstly reviewed the evolution of MMN from sound to music and then mainly compared the differences of MMN features between musicians and nonmusicians, followed by the discussion of the potential roles of the training effect and the natural exposure in MMN. Since MMN can serve as an index of neural plasticity, it thus can be widely used in clinical and other applied areas, such as detecting music preference in newborns or assessing wholeness of central auditory system of hearing illness. Finally, we pointed out some open questions and further directions. Current music perception research using MMN has mainly focused on relatively low hierarchical structure of music perception. To fully understand the neural substrates underlying processing of regularities in music, it is important and beneficial to combine MMN with other experimental paradigms such as early right-anterior negativity (ERAN).

Clinical investigations of receptive and expressive musical functions after stroke

There is a long tradition of investigating various disorders of musical abilities after stroke. These impairments, associated with acquired amusia, can be highly selective, affecting only music perception (i.e., receptive abilities/functions) or expression (music production abilities), and some patients report that these may dramatically influence their emotional state. The aim of this study was to systematically test both the melodic and rhythmic domains of music perception and expression in left- and right-sided stroke patients compared to healthy subjects. Music perception was assessed using rhythmic and melodic discrimination tasks, while tests of expressive function involved the vocal or instrumental reproduction of rhythms and melodies. Our approach revealed deficits in receptive and expressive functions in stroke patients, mediated by musical expertise. Those patients who had experienced a short period of musical training in childhood and adolescence performed better in the receptive and expressive subtests compared to those without any previous musical training. While discrimination of specific musical patterns was unimpaired after a left-sided stroke, patients with a right-sided stroke had worse results for fine melodic and rhythmic analysis. In terms of expressive testing, the most consistent results were obtained from a test that required patients to reproduce sung melodies. This implies that the means of investigating production abilities can impact the identification of deficits.

White matter neuroanatomical differences in young children who stutter

The ability to express thoughts through fluent speech production is a most human faculty, one that is often taken for granted. Stuttering, which disrupts the smooth flow of speech, affects 5% of preschool-age children and 1% of the general population, and can lead to significant communication difficulties and negative psychosocial consequences throughout one's lifetime. Despite the fact that symptom onset typically occurs during early childhood, few studies have yet examined the possible neural bases of developmental stuttering during childhood. Here we present a diffusion tensor imaging study that examined white matter measures reflecting neuroanatomical connectivity (fractional anisotropy) in 77 children [40 controls (20 females), 37 who stutter (16 females)] between 3 and 10 years of age. We asked whether previously reported anomalous white matter measures in adults and older children who stutter that were found primarily in major left hemisphere tracts (e.g. superior longitudinal fasciculus) are also present in younger children who stutter. All children exhibited normal speech, language, and cognitive development as assessed through a battery of assessments. The two groups were matched in chronological age and socioeconomic status. Voxel-wise whole brain comparisons using tract-based spatial statistics and region of interest analyses of fractional anisotropy were conducted to examine white matter changes associated with stuttering status, age, sex, and stuttering severity. Children who stutter exhibited significantly reduced fractional anisotropy relative to controls in white matter tracts that interconnect auditory and motor structures, corpus callosum, and in tracts interconnecting cortical and subcortical areas. In contrast to control subjects, fractional anisotropy changes with age were either stagnant or showed dissociated development among major perisylvian brain areas in children who stutter. These results provide first glimpses into the neuroanatomical bases of early childhood stuttering, and possible white matter developmental changes that may lead to recovery versus persistent stuttering. The white matter changes point to possible structural connectivity deficits in children who stutter, in interrelated neural circuits that enable skilled movement control through efficient sensorimotor integration and timing of movements.

Synchronized tapping facilitates learning sound sequences as indexed by the P300

The purpose of the present study was to determine whether and how single finger tapping in synchrony with sound sequences contributed to the auditory processing of them. The participants learned two unfamiliar sound sequences via different methods. In the tapping condition, they learned an auditory sequence while they tapped in synchrony with each sound onset. In the no tapping condition, they learned another sequence while they kept pressing a key until the sequence ended. After these learning sessions, we presented the two melodies again and recorded event-related potentials (ERPs). During the ERP recordings, 10% of the tones within each melody deviated from the original tones. An analysis of the grand average ERPs showed that deviant stimuli elicited a significant P300 in the tapping but not in the no-tapping condition. In addition, the significance of the P300 effect in the tapping condition increased as the participants showed highly synchronized tapping behavior during the learning sessions. These results indicated that single finger tapping promoted the conscious detection and evaluation of deviants within the learned sequences. The effect was related to individuals’ musical ability to coordinate their finger movements along with external auditory events.

How does the extraction of local and global auditory regularities vary with context?

How does the human brain extract regularities from its environment? There is evidence that short range or ‘local’ regularities (within seconds) are automatically detected by the brain while long range or ‘global’ regularities (over tens of seconds or more) require conscious awareness. In the present experiment, we asked whether participants' attention was needed to acquire such auditory regularities, to detect their violation or both. We designed a paradigm in which participants listened to predictable sounds. Subjects could be distracted by a visual task at two moments: when they were first exposed to a regularity or when they detected violations of this regularity. MEG recordings revealed that early brain responses (100–130 ms) to violations of short range regularities were unaffected by visual distraction and driven essentially by local transitional probabilities. Based on global workspace theory and prior results, we expected that visual distraction would eliminate the long range global effect, but unexpectedly, we found the contrary, i.e. late brain responses (300–600 ms) to violations of long range regularities on audio-visual trials but not on auditory only trials. Further analyses showed that, in fact, visual distraction was incomplete and that auditory and visual stimuli interfered in both directions. Our results show that conscious, attentive subjects can learn the long range dependencies present in auditory stimuli even while performing a visual task on synchronous visual stimuli. Furthermore, they acquire a complex regularity and end up making different predictions for the very same stimulus depending on the context (i.e. absence or presence of visual stimuli). These results suggest that while short-range regularity detection is driven by local transitional probabilities between stimuli, the human brain detects and stores long-range regularities in a highly flexible, context dependent manner.

Mismatch negativity to acoustical illusion of beat: how and where the change detection takes place?

In case of binaural presentation of two tones with slightly different frequencies the structures of brainstem can no longer follow the interaural time differences (ITD) resulting in an illusionary perception of beat corresponding to frequency difference between the two prime tones. Hence, the beat-frequency does not exist in the prime tones presented to either ear. This study used binaural beats to explore the nature of acoustic deviance detection in humans by means of magnetoencephalography (MEG). Recent research suggests that the auditory change detection is a multistage process. To test this, we employed 26 Hz-binaural beats in a classical oddball paradigm. However, the prime tones (250 Hz and 276 Hz) were switched between the ears in the case of the deviant-beat. Consequently, when the deviant is presented, the cochleae and auditory nerves receive a "new afferent", although the standards and the deviants are heard identical (26 Hz-beats). This allowed us to explore the contribution of auditory periphery to change detection process, and furthermore, to evaluate its influence on beats-related auditory steady-state responses (ASSRs). LORETA-source current density estimates of the evoked fields in a typical mismatch negativity time-window (MMN) and the subsequent difference-ASSRs were determined and compared. The results revealed an MMN generated by a complex neural network including the right parietal lobe and the left middle frontal gyrus. Furthermore, difference-ASSR was generated in the paracentral gyrus. Additionally, psychophysical measures showed no perceptual difference between the standard- and deviant-beats when isolated by noise. These results suggest that the auditory periphery has an important contribution to novelty detection already at sub-cortical level. Overall, the present findings support the notion of hierarchically organized acoustic novelty detection system.

Structural changes induced by daily music listening in the recovering brain after middle cerebral artery stroke: a voxel-based morphometry study

Music is a highly complex and versatile stimulus for the brain that engages many temporal, frontal, parietal, cerebellar, and subcortical areas involved in auditory, cognitive, emotional, and motor processing. Regular musical activities have been shown to effectively enhance the structure and function of many brain areas, making music a potential tool also in neurological rehabilitation. In our previous randomized controlled study, we found that listening to music on a daily basis can improve cognitive recovery and improve mood after an acute middle cerebral artery stroke. Extending this study, a voxel-based morphometry (VBM) analysis utilizing cost function masking was performed on the acute and 6-month post-stroke stage structural magnetic resonance imaging data of the patients (n = 49) who either listened to their favorite music [music group (MG), n = 16] or verbal material [audio book group (ABG), n = 18] or did not receive any listening material [control group (CG), n = 15] during the 6-month recovery period. Although all groups showed significant gray matter volume (GMV) increases from the acute to the 6-month stage, there was a specific network of frontal areas [left and right superior frontal gyrus (SFG), right medial SFG] and limbic areas [left ventral/subgenual anterior cingulate cortex (SACC) and right ventral striatum (VS)] in patients with left hemisphere damage in which the GMV increases were larger in the MG than in the ABG and in the CG. Moreover, the GM reorganization in the frontal areas correlated with enhanced recovery of verbal memory, focused attention, and language skills, whereas the GM reorganization in the SACC correlated with reduced negative mood. This study adds on previous results, showing that music listening after stroke not only enhances behavioral recovery, but also induces fine-grained neuroanatomical changes in the recovering brain.

Action-based effects on music perception

The classical, disembodied approach to music cognition conceptualizes action and perception as separate, peripheral processes. In contrast, embodied accounts of music cognition emphasize the central role of the close coupling of action and perception. It is a commonly established fact that perception spurs action tendencies. We present a theoretical framework that captures the ways in which the human motor system and its actions can reciprocally influence the perception of music. The cornerstone of this framework is the common coding theory, postulating a representational overlap in the brain between the planning, the execution, and the perception of movement. The integration of action and perception in so-called internal models is explained as a result of associative learning processes. Characteristic of internal models is that they allow intended or perceived sensory states to be transferred into corresponding motor commands (inverse modeling), and vice versa, to predict the sensory outcomes of planned actions (forward modeling). Embodied accounts typically refer to inverse modeling to explain action effects on music perception (Leman, 2007). We extend this account by pinpointing forward modeling as an alternative mechanism by which action can modulate perception. We provide an extensive overview of recent empirical evidence in support of this idea. Additionally, we demonstrate that motor dysfunctions can cause perceptual disabilities, supporting the main idea of the paper that the human motor system plays a functional role in auditory perception. The finding that music perception is shaped by the human motor system and its actions suggests that the musical mind is highly embodied. However, we advocate for a more radical approach to embodied (music) cognition in the sense that it needs to be considered as a dynamical process, in which aspects of action, perception, introspection, and social interaction are of crucial importance.