A single dual-stream framework for syntactic computations in music and language

Choir singing is associated with enhanced structural connectivity across the adult lifespan

The global ageing of populations calls for effective, ecologically valid methods to support brain health across adult life. Previous evidence suggests that music can promote white matter (WM) microstructure and grey matter (GM) volume while supporting auditory and cognitive functioning and emotional well-being as well as counteracting age-related cognitive decline. Adding a social component to music training, choir singing is a popular leisure activity among older adults, but a systematic account of its potential to support healthy brain structure, especially with regard to ageing, is currently missing. The present study used quantitative anisotropy (QA)-based diffusion MRI connectometry and voxel-based morphometry to explore the relationship of lifetime choir singing experience and brain structure at the whole-brain level. Cross-sectional multiple regression analyses were carried out in a large, balanced sample (N = 95; age range 21-88) of healthy adults with varying levels of choir singing experience across the whole age range and within subgroups defined by age (young, middle-aged, and older adults). Independent of age, choir singing experience was associated with extensive increases in WM QA in commissural, association, and projection tracts across the brain. Corroborating previous work, these overlapped with language and limbic networks. Enhanced corpus callosum microstructure was associated with choir singing experience across all subgroups. In addition, choir singing experience was selectively associated with enhanced QA in the fornix in older participants. No associations between GM volume and choir singing were found. The present study offers the first systematic account of amateur-level choir singing on brain structure. While no evidence for counteracting GM atrophy was found, the present evidence of enhanced structural connectivity coheres well with age-typical structural changes. Corroborating previous behavioural studies, the present results suggest that regular choir singing holds great promise for supporting brain health across the adult life span.

Embodying Time in the Brain: A Multi-Dimensional Neuroimaging Meta-Analysis of 95 Duration Processing Studies

Time is an omnipresent aspect of almost everything we experience internally or in the external world. The experience of time occurs through such an extensive set of contextual factors that, after decades of research, a unified understanding of its neural substrates is still elusive. In this study, following the recent best-practice guidelines, we conducted a coordinate-based meta-analysis of 95 carefully-selected neuroimaging papers of duration processing. We categorized the included papers into 14 classes of temporal features according to six categorical dimensions. Then, using the activation likelihood estimation (ALE) technique we investigated the convergent activation patterns of each class with a cluster-level family-wise error correction at p < 0.05. The regions most consistently activated across the various timing contexts were the pre-SMA and bilateral insula, consistent with an embodied theory of timing in which abstract representations of duration are rooted in sensorimotor and interoceptive experience, respectively. Moreover, class-specific patterns of activation could be roughly divided according to whether participants were timing auditory sequential stimuli, which additionally activated the dorsal striatum and SMA-proper, or visual single interval stimuli, which additionally activated the right middle frontal and inferior parietal cortices. We conclude that temporal cognition is so entangled with our everyday experience that timing stereotypically common combinations of stimulus characteristics reactivates the sensorimotor systems with which they were first experienced.

Understanding the concept of a novel tool requires interaction of the dorsal and ventral streams

The left hemisphere tool-use network consists of the dorso-dorsal, ventro-dorsal, and ventral streams, each with distinct computational abilities. In the dual-loop model, the ventral pathway through the extreme capsule is associated with conceptual understanding. We performed a learning experiment with fMRI to investigate how these streams interact when confronted with novel tools. In session one, subjects observed pictures and video sequences in real world action of known and unknown tools and were asked whether they knew the tools and whether they understood their function. In session two, video sequences of unknown tools were presented again, followed again by the question of understanding their function. Different conditions were compared to each other and effective connectivity (EC) in the tool-use network was examined. During concept acquisition of an unknown tool, EC between dorsal and ventral streams was found posterior in fusiform gyrus and anterior in inferior frontal gyrus, with a functional interaction between BA44d and BA45. When previously unknown tools were presented for a second time, EC was prominent only between dorsal stream areas. Understanding the concept of a novel tool requires an interaction of the ventral stream with the dorsal streams. Once the concept is acquired, dorsal stream areas are sufficient.

Prediction errors arising from switches between major and minor modes in music: An fMRI study

The major and minor modes in Western music have positive and negative connotations, respectively. The present fMRI study examined listeners' neural responses to switches between major and minor modes. We manipulated the final chords of J. S. Bach's keyboard pieces so that each major-mode passage ended with either the major (Major-Major) or minor (Major-Minor) tonic chord, and each minor-mode passage ended with either the minor (Minor-Minor) or major (Minor-Major) tonic chord. If the final major and minor chords have positive and negative reward values respectively, the Major-Minor and Minor-Major stimuli would cause negative and positive reward prediction errors (RPEs) respectively in a listener's brain. We found that activity in a frontoparietal network was significantly higher for Major-Minor than for Major-Major. Based on previous research, these results support the idea that a major-to-minor switch causes negative RPE. The contrast of Minor-Major minus Minor-Minor yielded activation in the ventral insula and visual cortex, speaking against the idea that a minor-to-major switch causes positive RPE. We discuss our results in relation to executive functions and the emotional connotations of major versus minor modes.

A review of auditory processing and cognitive change during normal ageing, and the implications for setting hearing aids for older adults

Throughout our adult lives there is a decline in peripheral hearing, auditory processing and elements of cognition that support listening ability. Audiometry provides no information about the status of auditory processing and cognition, and older adults often struggle with complex listening situations, such as speech in noise perception, even if their peripheral hearing appears normal. Hearing aids can address some aspects of peripheral hearing impairment and improve signal-to-noise ratios. However, they cannot directly enhance central processes and may introduce distortion to sound that might act to undermine listening ability. This review paper highlights the need to consider the distortion introduced by hearing aids, specifically when considering normally-ageing older adults. We focus on patients with age-related hearing loss because they represent the vast majority of the population attending audiology clinics. We believe that it is important to recognize that the combination of peripheral and central, auditory and cognitive decline make older adults some of the most complex patients seen in audiology services, so they should not be treated as "standard" despite the high prevalence of age-related hearing loss. We argue that a primary concern should be to avoid hearing aid settings that introduce distortion to speech envelope cues, which is not a new concept. The primary cause of distortion is the speed and range of change to hearing aid amplification (i.e., compression). We argue that slow-acting compression should be considered as a default for some users and that other advanced features should be reconsidered as they may also introduce distortion that some users may not be able to tolerate. We discuss how this can be incorporated into a pragmatic approach to hearing aid fitting that does not require increased loading on audiology services.

The human language system, including its inferior frontal component in "Broca's area," does not support music perception

Language and music are two human-unique capacities whose relationship remains debated. Some have argued for overlap in processing mechanisms, especially for structure processing. Such claims often concern the inferior frontal component of the language system located within "Broca's area." However, others have failed to find overlap. Using a robust individual-subject fMRI approach, we examined the responses of language brain regions to music stimuli, and probed the musical abilities of individuals with severe aphasia. Across 4 experiments, we obtained a clear answer: music perception does not engage the language system, and judgments about music structure are possible even in the presence of severe damage to the language network. In particular, the language regions' responses to music are generally low, often below the fixation baseline, and never exceed responses elicited by nonmusic auditory conditions, like animal sounds. Furthermore, the language regions are not sensitive to music structure: they show low responses to both intact and structure-scrambled music, and to melodies with vs. without structural violations. Finally, in line with past patient investigations, individuals with aphasia, who cannot judge sentence grammaticality, perform well on melody well-formedness judgments. Thus, the mechanisms that process structure in language do not appear to process music, including music syntax.

Neural mechanisms of musical structure and tonality, and the effect of musicianship

Introduction

The neural basis for the processing of musical syntax has previously been examined almost exclusively in classical tonal music, which is characterized by a strictly organized hierarchical structure. Musical syntax may differ in different music genres caused by tonality varieties.

Methods

The present study investigated the neural mechanisms for processing musical syntax across genres varying in tonality - classical, impressionist, and atonal music - and, in addition, examined how musicianship modulates such processing.

Results

Results showed that, first, the dorsal stream, including the bilateral inferior frontal gyrus and superior temporal gyrus, plays a key role in the perception of tonality. Second, right frontotemporal regions were crucial in allowing musicians to outperform non-musicians in musical syntactic processing; musicians also benefit from a cortical-subcortical network including pallidum and cerebellum, suggesting more auditory-motor interaction in musicians than in non-musicians. Third, left pars triangularis carries out online computations independently of tonality and musicianship, whereas right pars triangularis is sensitive to tonality and partly dependent on musicianship. Finally, unlike tonal music, the processing of atonal music could not be differentiated from that of scrambled notes, both behaviorally and neurally, even among musicians.

Discussion

The present study highlights the importance of studying varying music genres and experience levels and provides a better understanding of musical syntax and tonality processing and how such processing is modulated by music experience.

Semantic violation in sentence reading and incongruence in chord sequence comprehension: An ERP study

To address the controversy on cognitive resources sharedness between language and music in semantic processing, two experiments were conducted via the interference paradigm using the Event-Related Potential (ERP) technique. In Experiment 1, a five-word sentence and a five-chord sequence were simultaneously presented in a trial. The sentence (e.g., '/*,' The policeman found a mobile phone/wallet) ended with a semantically acceptable or unacceptable number-classifier-noun collocation (NCN), and the final chord of the chord sequence was congruent or incongruent with the preceding chords in tone. The stimuli in Experiment 1 were adapted in Experiment 2: The particle '' was removed, and a three-word-long, object-gap relative clause was inserted ahead of the noun of the NCN in each sentence; two chords were inserted ahead of the third chord in each chord sequence. Both similarities and differences were revealed between Experiments 1 and 2, concerning the influences of the manipulated variables on the amplitude of the ERP component N400. In conclusion, the dissolution of semantic violation in sentence reading was likely to happen in parallel with music processing in chord sequence comprehension by non-musician Chinese native speakers, but interaction was observable between language and music in semantic processing when the sentences ended with long-distance NCNs.

Speaking in gestures: Left dorsal and ventral frontotemporal brain systems underlie communication in conducting

Conducting constitutes a well-structured system of signs anticipating information concerning the rhythm and dynamic of a musical piece. Conductors communicate the musical tempo to the orchestra, unifying the individual instrumental voices to form an expressive musical Gestalt. In a functional magnetic resonance imaging (fMRI) experiment, 12 professional conductors and 16 instrumentalists conducted real-time novel pieces with diverse complexity in orchestration and rhythm. For control, participants either listened to the stimuli or performed beat patterns, setting the time of a metronome or complex rhythms played by a drum. Activation of the left superior temporal gyrus (STG), supplementary and premotor cortex and Broca's pars opercularis (F3op) was shared in both musician groups and separated conducting from the other conditions. Compared to instrumentalists, conductors activated Broca's pars triangularis (F3tri) and the STG, which differentiated conducting from time beating and reflected the increase in complexity during conducting. In comparison to conductors, instrumentalists activated F3op and F3tri when distinguishing complex rhythm processing from simple rhythm processing. Fibre selection from a normative human connectome database, constructed using a global tractography approach, showed that the F3op and STG are connected via the arcuate fasciculus, whereas the F3tri and STG are connected via the extreme capsule. Like language, the anatomical framework characterising conducting gestures is located in the left dorsal system centred on F3op. This system reflected the sensorimotor mapping for structuring gestures to musical tempo. The ventral system centred on F3Tri may reflect the art of conductors to set this musical tempo to the individual orchestra's voices in a global, holistic way.

Optimal deep brain stimulation sites and networks for stimulation of the fornix in Alzheimer's disease

Deep brain stimulation (DBS) to the fornix is an investigational treatment for patients with mild Alzheimer's Disease. Outcomes from randomized clinical trials have shown that cognitive function improved in some patients but deteriorated in others. This could be explained by variance in electrode placement leading to differential engagement of neural circuits. To investigate this, we performed a post-hoc analysis on a multi-center cohort of 46 patients with DBS to the fornix (NCT00658125, NCT01608061). Using normative structural and functional connectivity data, we found that stimulation of the circuit of Papez and stria terminalis robustly associated with cognitive improvement (R = 0.53, p < 0.001). On a local level, the optimal stimulation site resided at the direct interface between these structures (R = 0.48, p < 0.001). Finally, modulating specific distributed brain networks related to memory accounted for optimal outcomes (R = 0.48, p < 0.001). Findings were robust to multiple cross-validation designs and may define an optimal network target that could refine DBS surgery and programming.

The dual-loop model for combining external and internal worlds in our brain

Intelligible communication with others as well as covert conscious thought requires us to combine a representation of the external world with inner abstract concepts. Interaction with the external world through sensory perception and motor execution is arranged as sequences in time and space, whereas abstract thought and invariant categories are independent of the moment. Using advanced MRI-based fibre tracking on high resolution data from 183 participants in the Human Connectome Project, we identified two large supramodal systems comprising specific cortical regions and their connecting fibre tracts; a dorsal one for processing of sequences in time and space, and a ventral one for concepts and categories. We found that two hub regions exist in the executive front and the perceptive back of the brain where these two cognitive processes converge, constituting a dual-loop model. The hubs are located in the onto- and phylogenetically youngest regions of the cortex. We propose that this hub feature serves as the neural substrate for the more abstract sense of syntax in humans, i.e. for the system populating sequences with content in all cognitive domains. The hubs bring together two separate systems (dorsal and ventral) at the front and the back of the brain and create a closed-loop. The closed-loop facilitates recursivity and forethought, which we use twice; namely, for communication with others about things that are not there and for covert thought.

Syntax Acquisition in Healthy Adults and Post-Stroke Individuals: The Intriguing Role of Grammatical Preference, Statistical Learning, and Education

Previous work has provided contrasting evidence on syntax acquisition. Syntax-internal factors, i.e., instinctive knowledge of the universals of grammar (UG) for finite-state grammar (FSG) and phrase-structure grammar (PSG) but also syntax-external factors such as language competence, working memory (WM) and demographic factors may affect syntax acquisition. This study employed an artificial grammar paradigm to identify which factors predicted syntax acquisition. Thirty-seven healthy individuals and forty-nine left-hemispheric stroke patients (fourteen with aphasia) read syllable sequences adhering to or violating FSG and PSG. They performed preference classifications followed by grammatical classifications (after training). Results showed the best classification accuracy for sequences adhering to UG, with performance predicted by syntactic competence and spatial WM. Classification of ungrammatical sequences improved after training and was predicted by verbal WM. Although accuracy on FSG was better than on PSG, generalization was fully possible only for PSG. Education was the best predictor of syntax acquisition, while aphasia and lesion volume were not predictors. This study shows a clear preference for UG, which is influenced by spatial and linguistic knowledge, but not by the presence of aphasia. Verbal WM supported the identification of rule violations. Moreover, the acquisition of FSG and PSG was related to partially different mechanisms, but both depended on education.

A methodological scoping review of the integration of fMRI to guide dMRI tractography. What has been done and what can be improved: A 20-year perspective

Combining MRI modalities is a growing trend in neurosciences. It provides opportunities to investigate the brain architecture supporting cognitive functions. Integrating fMRI activation to guide dMRI tractography offers potential advantages over standard tractography methods. A quick glimpse of the literature on this topic reveals that this technique is challenging, and no consensus or "best practices" currently exist, at least not within a single document. We present the first attempt to systematically analyze and summarize the literature of 80 studies that integrated task-based fMRI results to guide tractography, over the last two decades. We report 19 findings that cover challenges related to sample size, microstructure modelling, seeding methods, multimodal space registration, false negatives/positives, specificity/validity, gray/white matter interface and more. These findings will help the scientific community (1) understand the strengths and limitations of the approaches, (2) design studies using this integrative framework, and (3) motivate researchers to fill the gaps identified. We provide references toward best practices, in order to improve the overall result's replicability, sensitivity, specificity, and validity.

Lateral Prefrontal Cortex Is a Hub for Music Production from Structural Rules to Movements

Complex sequential behaviors, such as speaking or playing music, entail flexible rule-based chaining of single acts. However, it remains unclear how the brain translates abstract structural rules into movements. We combined music production with multimodal neuroimaging to dissociate high-level structural and low-level motor planning. Pianists played novel musical chord sequences on a muted MR-compatible piano by imitating a model hand on screen. Chord sequences were manipulated in terms of musical harmony and context length to assess structural planning, and in terms of fingers used for playing to assess motor planning. A model of probabilistic sequence processing confirmed temporally extended dependencies between chords, as opposed to local dependencies between movements. Violations of structural plans activated the left inferior frontal and middle temporal gyrus, and the fractional anisotropy of the ventral pathway connecting these two regions positively predicted behavioral measures of structural planning. A bilateral frontoparietal network was instead activated by violations of motor plans. Both structural and motor networks converged in lateral prefrontal cortex, with anterior regions contributing to musical structure building, and posterior areas to movement planning. These results establish a promising approach to study sequence production at different levels of action representation.

Resting-state language network neuroplasticity in post-stroke music listening: A randomized controlled trial

Recent evidence suggests that post-stroke vocal music listening can aid language recovery, but the network-level functional neuroplasticity mechanisms of this effect are unknown. Here, we sought to determine if improved language recovery observed after post-stroke listening to vocal music is driven by changes in longitudinal resting-state functional connectivity within the language network. Using data from a single-blind randomized controlled trial on stroke patients (N = 38), we compared the effects of daily listening to self-selected vocal music, instrumental music and audio books on changes of the resting-state functional connectivity within the language network and their correlation to improved language skills and verbal memory during the first 3 months post-stroke. From acute to 3-month stage, the vocal music and instrumental music groups increased functional connectivity between a cluster comprising the left inferior parietal areas and the language network more than the audio book group. However, the functional connectivity increase correlated with improved verbal memory only in the vocal music group cluster. This study shows that listening to vocal music post-stroke promotes recovery of verbal memory by inducing changes in longitudinal functional connectivity in the language network. Our results conform to the variable neurodisplacement theory underpinning aphasia recovery.

Dissociation of Connectivity for Syntactic Irregularity and Perceptual Ambiguity in Musical Chord Stimuli

Musical syntax has been studied mainly in terms of “syntactic irregularity” in harmonic/melodic sequences. However, “perceptual ambiguity” referring to the uncertainty of judgment/classification of presented stimuli can in addition be involved in our musical stimuli using three different chord sequences. The present study addresses how “syntactic irregularity” and “perceptual ambiguity” on musical syntax are dissociated, in terms of effective connectivity between the bilateral inferior frontal gyrus (IFGs) and superior temporal gyrus (STGs) by linearized time-delayed mutual information (LTDMI). Three conditions were of five-chord sequences with endings of dominant to tonic, dominant to submediant, and dominant to supertonic. The dominant to supertonic is most irregular, compared with the regular dominant to tonic. The dominant to submediant of the less irregular condition is the most ambiguous condition. In the LTDMI results, connectivity from the right to the left IFG (IFG-LTDMI) was enhanced for the most irregular condition, whereas that from the right to the left STG (STG-LTDMI) was enhanced for the most ambiguous condition (p = 0.024 in IFG-LTDMI, p < 0.001 in STG-LTDMI, false discovery rate (FDR) corrected). Correct rate was negatively correlated with STG-LTDMI, further reflecting perceptual ambiguity (p = 0.026). We found for the first time that syntactic irregularity and perceptual ambiguity coexist in chord stimulus testing musical syntax and that the two processes are dissociated in interhemispheric connectivities in the IFG and STG, respectively.

Hierarchical control as a shared neurocognitive mechanism for language and music

Although comparative research has made substantial progress in clarifying the relationship between language and music as neurocognitive systems from both a theoretical and empirical perspective, there is still no consensus about which mechanisms, if any, are shared and how they bring about different neurocognitive systems. In this paper, we tackle these two questions by focusing on hierarchical control as a neurocognitive mechanism underlying syntax in language and music. We put forward the Coordinated Hierarchical Control (CHC) hypothesis: linguistic and musical syntax rely on hierarchical control, but engage this shared mechanism differently depending on the current control demand. While linguistic syntax preferably engages the abstract rule-based control circuit, musical syntax rather employs the coordination of the abstract rule-based and the more concrete motor-based control circuits. We provide evidence for our hypothesis by reviewing neuroimaging as well as neuropsychological studies on linguistic and musical syntax. The CHC hypothesis makes a set of novel testable predictions to guide future work on the relationship between language and music.

German Language Adaptation of the NAVS (NAVS-G) and of the NAT (NAT-G): Testing Grammar in Aphasia

Grammar provides the framework for understanding and producing language. In aphasia, an acquired language disorder, grammatical deficits are diversified and widespread. However, the few assessments for testing grammar in the German language do not consider current linguistic, psycholinguistic, and functional imaging data, which have been shown to be crucial for effective treatment. This study developed German language versions of the Northwestern Assessment of Verbs and Sentences (NAVS-G) and the Northwestern Anagram Test (NAT-G) to examine comprehension and production of verbs, controlling for the number and optionality of verb arguments, and sentences with increasing syntactic complexity. The NAVS-G and NAT-G were tested in 27 healthy participants, 15 right hemispheric stroke patients without aphasia, and 15 stroke patients with mild to residual aphasia. Participants without aphasia showed near-perfect performance, with the exception of (object) relative sentences, where accuracy was associated with educational level. In each patient with aphasia, deficits in more than one subtest were observed. The within and between population-groups logistic mixed regression analyses identified significant impairments in processing syntactic complexity at the verb and sentence levels. These findings indicate that the NAVS-G and NAT-G have potential for testing grammatical competence in (German) stroke patients.

Frontotemporal dementia, music perception and social cognition share neurobiological circuits: A meta-analysis

Frontotemporal dementia (FTD) is a neurodegenerative disease that presents with profound changes in social cognition. Music might be a sensitive probe for social cognition abilities, but underlying neurobiological substrates are unclear. We performed a meta-analysis of voxel-based morphometry studies in FTD patients and functional MRI studies for music perception and social cognition tasks in cognitively normal controls to identify robust patterns of atrophy (FTD) or activation (music perception or social cognition). Conjunction analyses were performed to identify overlapping brain regions. In total 303 articles were included: 53 for FTD (n = 1153 patients, 42.5% female; 1337 controls, 53.8% female), 28 for music perception (n = 540, 51.8% female) and 222 for social cognition in controls (n = 5664, 50.2% female). We observed considerable overlap in atrophy patterns associated with FTD, and functional activation associated with music perception and social cognition, mostly encompassing the ventral language network. We further observed overlap across all three modalities in mesolimbic, basal forebrain and striatal regions. The results of our meta-analysis suggest that music perception and social cognition share neurobiological circuits that are affected in FTD. This supports the idea that music might be a sensitive probe for social cognition abilities with implications for diagnosis and monitoring.

Active listening

This paper introduces active listening, as a unified framework for synthesising and recognising speech. The notion of active listening inherits from active inference, which considers perception and action under one universal imperative: to maximise the evidence for our (generative) models of the world. First, we describe a generative model of spoken words that simulates (i) how discrete lexical, prosodic, and speaker attributes give rise to continuous acoustic signals; and conversely (ii) how continuous acoustic signals are recognised as words. The 'active' aspect involves (covertly) segmenting spoken sentences and borrows ideas from active vision. It casts speech segmentation as the selection of internal actions, corresponding to the placement of word boundaries. Practically, word boundaries are selected that maximise the evidence for an internal model of how individual words are generated. We establish face validity by simulating speech recognition and showing how the inferred content of a sentence depends on prior beliefs and background noise. Finally, we consider predictive validity by associating neuronal or physiological responses, such as the mismatch negativity and P300, with belief updating under active listening, which is greatest in the absence of accurate prior beliefs about what will be heard next.

Recursive music elucidates neural mechanisms supporting the generation and detection of melodic hierarchies

The ability to generate complex hierarchical structures is a crucial component of human cognition which can be expressed in the musical domain in the form of hierarchical melodic relations. The neural underpinnings of this ability have been investigated by comparing the perception of well-formed melodies with unexpected sequences of tones. However, these contrasts do not target specifically the representation of rules generating hierarchical structure. Here, we present a novel paradigm in which identical melodic sequences are generated in four steps, according to three different rules: The Recursive rule, generating new hierarchical levels at each step; The Iterative rule, adding tones within a fixed hierarchical level without generating new levels; and a control rule that simply repeats the third step. Using fMRI, we compared brain activity across these rules when participants are imagining the fourth step after listening to the third (generation phase), and when participants listened to a fourth step (test sound phase), either well-formed or a violation. We found that, in comparison with Repetition and Iteration, imagining the fourth step using the Recursive rule activated the superior temporal gyrus (STG). During the test sound phase, we found fronto-temporo-parietal activity and hippocampal de-activation when processing violations, but no differences between rules. STG activation during the generation phase suggests that generating new hierarchical levels from previous steps might rely on retrieving appropriate melodic hierarchy schemas. Previous findings highlighting the role of hippocampus and inferior frontal gyrus may reflect processing of unexpected melodic sequences, rather than hierarchy generation per se.

Recursive hierarchical embedding in vision is impaired by posterior middle temporal gyrus lesions

The generation of hierarchical structures is central to language, music and complex action. Understanding this capacity and its potential impairments requires mapping its underlying cognitive processes to the respective neuronal underpinnings. In language, left inferior frontal gyrus and left posterior temporal cortex (superior temporal sulcus/middle temporal gyrus) are considered hubs for syntactic processing. However, it is unclear whether these regions support computations specific to language or more generally support analyses of hierarchical structure. Here, we address this issue by investigating hierarchical processing in a non-linguistic task. We test the ability to represent recursive hierarchical embedding in the visual domain by contrasting a recursion task with an iteration task. The recursion task requires participants to correctly identify continuations of a hierarchy generating procedure, while the iteration task applies a serial procedure that does not generate new hierarchical levels. In a lesion-based approach, we asked 44 patients with left hemispheric chronic brain lesion to perform recursion and iteration tasks. We modelled accuracies and response times with a drift diffusion model and for each participant obtained parametric estimates for the velocity of information accumulation (drift rates) and for the amount of information accumulated before a decision (boundary separation). We then used these estimates in lesion-behaviour analyses to investigate how brain lesions affect specific aspects of recursive hierarchical embedding. We found that lesions in the posterior temporal cortex decreased drift rate in recursive hierarchical embedding, suggesting an impaired process of rule extraction from recursive structures. Moreover, lesions in inferior temporal gyrus decreased boundary separation. The latter finding does not survive conservative correction but suggests a shift in the decision criterion. As patients also participated in a grammar comprehension experiment, we performed explorative correlation-analyses and found that visual and linguistic recursive hierarchical embedding accuracies are correlated when the latter is instantiated as sentences with two nested embedding levels. While the roles of the inferior temporal gyrus and posterior temporal cortex in linguistic processes are well established, here we show that posterior temporal cortex lesions slow information accumulation (drift rate) in the visual domain. This suggests that posterior temporal cortex is essential to acquire the (knowledge) representations necessary to parse recursive hierarchical embedding in visual structures, a finding mimicking language acquisition in young children. On the contrary, inferior frontal gyrus lesions seem to affect recursive hierarchical embedding processing by interfering with more general cognitive control (boundary separation). This interesting separation of roles, rooted on a domain-general taxonomy, raises the question of whether such cognitive framing is also applicable to other domains.

Musicians use speech-specific areas when processing tones: The key to their superior linguistic competence?

It is known that musicians compared to non-musicians have some superior speech and language competence, yet the mechanisms how musical training leads to this advantage are not well specified. This event-related fMRI study confirmed that musicians outperformed non-musicians in processing not only of musical tones but also syllables and identified a network differentiating musicians from non-musicians during processing of linguistic sounds. Within this network, the activation of bilateral superior temporal gyrus was shared with all subjects during processing of the acoustically well-matched musical and linguistic sounds, and with the activation distinguishing tones with a complex harmonic spectrum (bowed tone) from a simpler one (plucked tone). These results confirm that better speech processing in musicians relies on improved cross-domain spectral analysis. Activation of left posterior superior temporal sulcus (pSTS), premotor cortex, inferior frontal and fusiform gyrus (FG) also distinguishing musicians from non-musicians during syllable processing overlapped with the activation segregating linguistic from musical sounds in all subjects. Since these brain-regions were not involved during tone processing in non-musicians, they could code for functions which are specialized for speech. Musicians recruited pSTS and FG during tone processing, thus these speech-specialized brain-areas processed musical sounds in the presence of musical training. This study shows that the linguistic advantage of musicians is linked not only to improved cross-domain spectral analysis, but also to the functional adaptation of brain resources that are specialized for speech, but accessible to the domain of music in the presence of musical training.

Resting state functional connectivity underlying musical creativity

While the behavior of "being musically creative"- improvising, composing, songwriting, etc.-is undoubtedly a complex and highly variable one, recent neuroscientific investigation has offered significant insight into the neural underpinnings of many of the creative processes contributing to such behavior. A previous study from our research group (Bashwiner et al., 2016), which examined two aspects of brain structure as a function of creative musical experience, found significantly increased cortical surface area or subcortical volume in regions of the default-mode network, a motor planning network, and a "limbic" network. The present study sought to determine how these regions coordinate with one another and with other regions of the brain in a large number of participants (n ​= ​218) during a task-neutral period, i.e., during the "resting state." Deriving from the previous study's results a set of eleven regions of interest (ROIs), the present study analyzed the resting-state functional connectivity (RSFC) from each of these seed regions as a function of creative musical experience (assessed via our Musical Creativity Questionnaire). Of the eleven ROIs investigated, nine showed significant correlations with a total of 22 clusters throughout the brain, the most significant being located in bilateral cerebellum, right inferior frontal gyrus, midline thalamus (particularly the mediodorsal nucleus), and medial premotor regions. These results support prior reports (by ourselves and others) implicating regions of the default-mode, executive, and motor-planning networks in musical creativity, while additionally-and somewhat unanticipatedly-including a potentially much larger role for the salience network than has been previously reported in studies of musical creativity.

Hierarchy processing in human neurobiology: how specific is it?

Although human and non-human animals share a number of perceptual and cognitive abilities, they differ in their ability to process hierarchically structured sequences. This becomes most evident in the human capacity to process natural language characterized by structural hierarchies. This capacity is neuroanatomically grounded in the posterior part of left Broca's area (Brodmann area (BA) 44), located in the inferior frontal gyrus, and its dorsal white matter fibre connection to the temporal cortex. Within this neural network, BA 44 itself subserves hierarchy building and the strength of its connection to the temporal cortex correlates with the processing of syntactically complex sentences. Whether these brain structures are also relevant for other human cognitive abilities is a current debate. Here, this question will be evaluated with respect to those human cognitive abilities that are assumed to require hierarchy building, such as music, mathematics and Theory of Mind. Rather than supporting a domain-general view, the data indicate domain-selective neural networks as the neurobiological basis for processing hierarchy in different cognitive domains. Recent cross-species white matter comparisons suggest that particular connections within the networks may make the crucial difference in the brain structure of human and non-human primates, thereby enabling cognitive functions specific to humans. This article is part of the theme issue 'What can animal communication teach us about human language?'

Neural architectures of music - Insights from acquired amusia

The ability to perceive and produce music is a quintessential element of human life, present in all known cultures. Modern functional neuroimaging has revealed that music listening activates a large-scale bilateral network of cortical and subcortical regions in the healthy brain. Even the most accurate structural studies do not reveal which brain areas are critical and causally linked to music processing. Such questions may be answered by analysing the effects of focal brain lesions in patients´ ability to perceive music. In this sense, acquired amusia after stroke provides a unique opportunity to investigate the neural architectures crucial for normal music processing. Based on the first large-scale longitudinal studies on stroke-induced amusia using modern multi-modal magnetic resonance imaging (MRI) techniques, such as advanced lesion-symptom mapping, grey and white matter morphometry, tractography and functional connectivity, we discuss neural structures critical for music processing, consider music processing in light of the dual-stream model in the right hemisphere, and propose a neural model for acquired amusia.

Tracking Training-Related Plasticity by Combining fMRI and DTI: The Right Hemisphere Ventral Stream Mediates Musical Syntax Processing

As a functional homolog for left-hemispheric syntax processing in language, neuroimaging studies evidenced involvement of right prefrontal regions in musical syntax processing, of which underlying white matter connectivity remains unexplored so far. In the current experiment, we investigated the underlying pathway architecture in subjects with 3 levels of musical expertise. Employing diffusion tensor imaging tractography, departing from seeds from our previous functional magnetic resonance imaging study on music syntax processing in the same participants, we identified a pathway in the right ventral stream that connects the middle temporal lobe with the inferior frontal cortex via the extreme capsule, and corresponds to the left hemisphere ventral stream, classically attributed to syntax processing in language comprehension. Additional morphometric consistency analyses allowed dissociating tract core from more dispersed fiber portions. Musical expertise related to higher tract consistency of the right ventral stream pathway. Specifically, tract consistency in this pathway predicted the sensitivity for musical syntax violations. We conclude that enduring musical practice sculpts ventral stream architecture. Our results suggest that training-related pathway plasticity facilitates the right hemisphere ventral stream information transfer, supporting an improved sound-to-meaning mapping in music.

Intracranial Recordings and Computational Modeling of Music Reveal the Time Course of Prediction Error Signaling in Frontal and Temporal Cortices

Prediction is held to be a fundamental process underpinning perception, action, and cognition. To examine the time course of prediction error signaling, we recorded intracranial EEG activity from nine presurgical epileptic patients while they listened to melodies whose information theoretical predictability had been characterized using a computational model. We examined oscillatory activity in the superior temporal gyrus (STG), the middle temporal gyrus (MTG), and the pars orbitalis of the inferior frontal gyrus, lateral cortical areas previously implicated in auditory predictive processing. We also examined activity in anterior cingulate gyrus (ACG), insula, and amygdala to determine whether signatures of prediction error signaling may also be observable in these subcortical areas. Our results demonstrate that the information content (a measure of unexpectedness) of musical notes modulates the amplitude of low-frequency oscillatory activity (theta to beta power) in bilateral STG and right MTG from within 100 and 200 msec of note onset, respectively. Our results also show this cortical activity to be accompanied by low-frequency oscillatory modulation in ACG and insula-areas previously associated with mediating physiological arousal. Finally, we showed that modulation of low-frequency activity is followed by that of high-frequency (gamma) power from approximately 200 msec in the STG, between 300 and 400 msec in the left insula, and between 400 and 500 msec in the ACG. We discuss these results with respect to models of neural processing that emphasize gamma activity as an index of prediction error signaling and highlight the usefulness of musical stimuli in revealing the wide-reaching neural consequences of predictive processing.

The language of music: Common neural codes for structured sequences in music and natural language

The ability to process structured sequences is a central feature of natural language but also characterizes many other domains of human cognition. In this fMRI study, we measured brain metabolic response in musicians as they generated structured and non-structured sequences in language and music. We employed a univariate and multivariate cross-classification approach to provide evidence that a common neural code underlies the production of structured sequences across the two domains. Crucially, the common substrate includes Broca's area, a region well known for processing structured sequences in language. These findings have several implications. First, they directly support the hypothesis that language and music share syntactic integration mechanisms. Second, they show that Broca's area is capable of operating supramodally across these two domains. Finally, these results dismiss the recent hypothesis that domain general processes of neighboring neural substrates explain the previously observed "overlap" between neuroimaging activations across the two domains.

The right inferior frontal gyrus processes nested non-local dependencies in music

Complex auditory sequences known as music have often been described as hierarchically structured. This permits the existence of non-local dependencies, which relate elements of a sequence beyond their temporal sequential order. Previous studies in music have reported differential activity in the inferior frontal gyrus (IFG) when comparing regular and irregular chord-transitions based on theories in Western tonal harmony. However, it is unclear if the observed activity reflects the interpretation of hierarchical structure as the effects are confounded by local irregularity. Using functional magnetic resonance imaging (fMRI), we found that violations to non-local dependencies in nested sequences of three-tone musical motifs in musicians elicited increased activity in the right IFG. This is in contrast to similar studies in language which typically report the left IFG in processing grammatical syntax. Effects of increasing auditory working demands are moreover reflected by distributed activity in frontal and parietal regions. Our study therefore demonstrates the role of the right IFG in processing non-local dependencies in music, and suggests that hierarchical processing in different cognitive domains relies on similar mechanisms that are subserved by domain-selective neuronal subpopulations.

Modulating transcallosal and intra-hemispheric brain connectivity with tDCS: Implications for interventions in Aphasia

BACKGROUND/OBJECTIVE

Transcranial direct current stimulation (tDCS) can enhance or diminish cortical excitability levels depending on the polarity of the stimulation. One application of non-invasive brain-stimulation has been to modulate a possible inter-hemispheric disinhibition after a stroke. This disinhibition model has been developed mainly for the upper extremity motor system, but it is not known whether the language/speech-motor system shows a similar inter-hemispheric interaction. We aimed to examine physiological evidence of inter- and intra-hemispheric connectivity changes induced by tDCS of the right inferior frontal gyrus (IFG) using arterial-spin labeling (ASL) MRI.

METHODS

Using an MR-compatible DC-Stimulator, we applied anodal stimulation to the right IFG region of nine healthy adults while undergoing non-invasive cerebral blood flow imaging with arterial-spin labeling (ASL) before, during, and after the stimulation. All ASL images were then normalized and timecourses were extracted in regions of interest (ROIs), which were the left and right IFG regions, and the right supramarginal gyrus (SMG) in the inferior parietal lobule. Two additional ROIs (the right occipital lobe and the left fronto-orbital region) were taken as control regions.

RESULTS

Using regional correlation coefficients as a surrogate marker of connectivity, we could show that inter-hemispheric connectivity (right IFG with left IFG) decreased significantly (p < 0.05; r-scores from 0.67 to 0.53) between baseline and post-stimulation, while the intra-hemispheric connectivity (right IFG with right SMG) increased significantly (p < 0.05;r-scores from 0.74 to 0.81). A 2 × 2 ANOVA found a significant main effect of HEMISPHERE (F(8) = 6.83, p < 0.01) and a significant HEMISPHERE-by-TIME interaction (F(8) = 4.24, p < 0.05) in connectivity changes. The correlation scores did not change significantly in the control region pairs (right IFG with right occipital and right IFG with left fronto-orbital) over time.

CONCLUSION

Using an MR-compatible DC stimulator we showed that ASL-MRI can detect tDCS-induced modulation of brain connectivity within and between hemispheres. These findings might affect trial designs focusing on modulating the non-dominant hemisphere to enhance language/speech-motor functions.

Dynamic Reconfiguration of the Supplementary Motor Area Network during Imagined Music Performance

The supplementary motor area (SMA) has been shown to be the center for motor planning and is active during music listening and performance. However, limited data exist on the role of the SMA in music. Music performance requires complex information processing in auditory, visual, spatial, emotional, and motor domains, and this information is integrated for the performance. We hypothesized that the SMA is engaged in multimodal integration of information, distributed across several regions of the brain to prepare for ongoing music performance. To test this hypothesis, functional networks involving the SMA were extracted from functional magnetic resonance imaging (fMRI) data that were acquired from musicians during imagined music performance and during the resting state. Compared with the resting condition, imagined music performance increased connectivity of the SMA with widespread regions in the brain including the sensorimotor cortices, parietal cortex, posterior temporal cortex, occipital cortex, and inferior and dorsolateral prefrontal cortex. Increased connectivity of the SMA with the dorsolateral prefrontal cortex suggests that the SMA is under cognitive control, while increased connectivity with the inferior prefrontal cortex suggests the involvement of syntax processing. Increased connectivity with the parietal cortex, posterior temporal cortex, and occipital cortex is likely for the integration of spatial, emotional, and visual information. Finally, increased connectivity with the sensorimotor cortices was potentially involved with the translation of thought planning into motor programs. Therefore, the reconfiguration of the SMA network observed in this study is considered to reflect the multimodal integration required for imagined and actual music performance. We propose that the SMA network construct “the internal representation of music performance” by integrating multimodal information required for the performance.

The parietal opercular auditory-sensorimotor network in musicians: A resting-state fMRI study

Auditory-sensorimotor coupling is critical for musical performance, during which auditory and somatosensory feedback signals are used to ensure desired outputs. Previous studies reported opercular activation in subjects performing or listening to music. A functional connectivity analysis suggested the parietal operculum (PO) as a connector hub that links auditory, somatosensory, and motor cortical areas. We therefore examined whether this PO network differs between musicians and non-musicians. We analyzed resting-state PO functional connectivity with Heschl's gyrus (HG), the planum temporale (PT), the precentral gyrus (preCG), and the postcentral gyrus (postCG) in 35 musicians and 35 non-musicians. In musicians, the left PO exhibited increased functional connectivity with the ipsilateral HG, PT, preCG, and postCG, whereas the right PO exhibited enhanced functional connectivity with the contralateral HG, preCG, and postCG and the ipsilateral postCG. Direct functional connectivity between an auditory area (the HG or PT) and a sensorimotor area (the preCG or postCG) did not significantly differ between the groups. The PO's functional connectivity with auditory and sensorimotor areas is enhanced in musicians relative to non-musicians. We propose that the PO network facilitates musical performance by mediating multimodal integration for modulating auditory-sensorimotor control.

Functional neural changes associated with acquired amusia across different stages of recovery after stroke

Brain damage causing acquired amusia disrupts the functional music processing system, creating a unique opportunity to investigate the critical neural architectures of musical processing in the brain. In this longitudinal fMRI study of stroke patients (N = 41) with a 6-month follow-up, we used natural vocal music (sung with lyrics) and instrumental music stimuli to uncover brain activation and functional network connectivity changes associated with acquired amusia and its recovery. In the acute stage, amusic patients exhibited decreased activation in right superior temporal areas compared to non-amusic patients during instrumental music listening. During the follow-up, the activation deficits expanded to comprise a wide-spread bilateral frontal, temporal, and parietal network. The amusics showed less activation deficits to vocal music, suggesting preserved processing of singing in the amusic brain. Compared to non-recovered amusics, recovered amusics showed increased activation to instrumental music in bilateral frontoparietal areas at 3 months and in right middle and inferior frontal areas at 6 months. Amusia recovery was also associated with increased functional connectivity in right and left frontoparietal attention networks to instrumental music. Overall, our findings reveal the dynamic nature of deficient activation and connectivity patterns in acquired amusia and highlight the role of dorsal networks in amusia recovery.

Verbal and musical short-term memory: Variety of auditory disorders after stroke

Auditory cognitive deficits after stroke may concern language and/or music processing, resulting in aphasia and/or amusia. The aim of the present study was to assess the potential deficits of auditory short-term memory for verbal and musical material after stroke and their underlying cerebral correlates with a Voxel-based Lesion Symptom Mapping approach (VLSM). Patients with an ischemic stroke in the right (N=10) or left (N=10) middle cerebral artery territory and matched control participants (N=14) were tested with a detailed neuropsychological assessment including global cognitive functions, music perception and language tasks. All participants then performed verbal and musical auditory short-term memory (STM) tasks that were implemented in the same way for both materials. Participants had to indicate whether series of four words or four tones presented in pairs, were the same or different. To detect domain-general STM deficits, they also had to perform a visual STM task. Behavioral results showed that patients had lower performance for the STM tasks in comparison with control participants, regardless of the material (words, tones, visual) and the lesion side. The individual patient data showed a double dissociation between some patients exhibiting verbal deficits without musical deficits or the reverse. Exploratory VLSM analyses suggested that dorsal pathways are involved in verbal (phonetic), musical (melodic), and visual STM, while the ventral auditory pathway is involved in musical STM.

Spoken word recognition in young tone language learners: Age-dependent effects of segmental and suprasegmental variation

The majority of the world's languages rely on both segmental (vowels, consonants) and suprasegmental (lexical tones) information to contrast the meanings of individual words. However, research on early language development has mostly focused on the acquisition of vowel-consonant languages. Developmental research comparing sensitivity to segmental and suprasegmental features in young tone learners is extremely rare. This study examined 2- and 3-year-old monolingual tone learners' sensitivity to vowels and tones. Experiment 1a tested the influence of vowel and tone variation on novel word learning. Vowel and tone variation hindered word recognition efficiency in both age groups. However, tone variation hindered word recognition accuracy only in 2-year-olds, while 3-year-olds were insensitive to tone variation. Experiment 1b demonstrated that 3-year-olds could use tones to learn new words when additional support was provided, and additionally, that Tone 3 words were exceptionally difficult to learn. Experiment 2 confirmed a similar pattern of results when children were presented with familiar words. This study is the first to show that despite the importance of tones in tone languages, vowels maintain primacy over tones in young children's word recognition and that tone sensitivity in word learning and recognition changes between 2 and 3years of age. The findings suggest that early lexical processes are more tightly constrained by variation in vowels than by tones.

Studying Musical and Linguistic Prediction in Comparable Ways: The Melodic Cloze Probability Method

Prediction or expectancy is thought to play an important role in both music and language processing. However, prediction is currently studied independently in the two domains, limiting research on relations between predictive mechanisms in music and language. One limitation is a difference in how expectancy is quantified. In language, expectancy is typically measured using the cloze probability task, in which listeners are asked to complete a sentence fragment with the first word that comes to mind. In contrast, previous production-based studies of melodic expectancy have asked participants to sing continuations following only one to two notes. We have developed a melodic cloze probability task in which listeners are presented with the beginning of a novel tonal melody (5-9 notes) and are asked to sing the note they expect to come next. Half of the melodies had an underlying harmonic structure designed to constrain expectations for the next note, based on an implied authentic cadence (AC) within the melody. Each such 'authentic cadence' melody was matched to a 'non-cadential' (NC) melody matched in terms of length, rhythm and melodic contour, but differing in implied harmonic structure. Participants showed much greater consistency in the notes sung following AC vs. NC melodies on average. However, significant variation in degree of consistency was observed within both AC and NC melodies. Analysis of individual melodies suggests that pitch prediction in tonal melodies depends on the interplay of local factors just prior to the target note (e.g., local pitch interval patterns) and larger-scale structural relationships (e.g., melodic patterns and implied harmonic structure). We illustrate how the melodic cloze method can be used to test a computational model of melodic expectation. Future uses for the method include exploring the interplay of different factors shaping melodic expectation, and designing experiments that compare the cognitive mechanisms of prediction in music and language.

Human emotions track changes in the acoustic environment

Emotional responses to biologically significant events are essential for human survival. Do human emotions lawfully track changes in the acoustic environment? Here we report that changes in acoustic attributes that are well known to interact with human emotions in speech and music also trigger systematic emotional responses when they occur in environmental sounds, including sounds of human actions, animal calls, machinery, or natural phenomena, such as wind and rain. Three changes in acoustic attributes known to signal emotional states in speech and music were imposed upon 24 environmental sounds. Evaluations of stimuli indicated that human emotions track such changes in environmental sounds just as they do for speech and music. Such changes not only influenced evaluations of the sounds themselves, they also affected the way accompanying facial expressions were interpreted emotionally. The findings illustrate that human emotions are highly attuned to changes in the acoustic environment, and reignite a discussion of Charles Darwin's hypothesis that speech and music originated from a common emotional signal system based on the imitation and modification of environmental sounds.

Music and Language Syntax Interact in Broca's Area: An fMRI Study

Instrumental music and language are both syntactic systems, employing complex, hierarchically-structured sequences built using implicit structural norms. This organization allows listeners to understand the role of individual words or tones in the context of an unfolding sentence or melody. Previous studies suggest that the brain mechanisms of syntactic processing may be partly shared between music and language. However, functional neuroimaging evidence for anatomical overlap of brain activity involved in linguistic and musical syntactic processing has been lacking. In the present study we used functional magnetic resonance imaging (fMRI) in conjunction with an interference paradigm based on sung sentences. We show that the processing demands of musical syntax (harmony) and language syntax interact in Broca’s area in the left inferior frontal gyrus (without leading to music and language main effects). A language main effect in Broca’s area only emerged in the complex music harmony condition, suggesting that (with our stimuli and tasks) a language effect only becomes visible under conditions of increased demands on shared neural resources. In contrast to previous studies, our design allows us to rule out that the observed neural interaction is due to: (1) general attention mechanisms, as a psychoacoustic auditory anomaly behaved unlike the harmonic manipulation, (2) error processing, as the language and the music stimuli contained no structural errors. The current results thus suggest that two different cognitive domains—music and language—might draw on the same high level syntactic integration resources in Broca’s area.