The nature of hemispheric specialization for linguistic and emotional prosodic perception: a meta-analysis of the lesion literature

Age-related increases in right hemisphere support for prosodic processing in children

Language comprehension is a complex process involving an extensive brain network. Brain regions responsible for prosodic processing have been studied in adults; however, much less is known about the neural bases of prosodic processing in children. Using magnetoencephalography (MEG), we mapped regions supporting speech envelope tracking (a marker of prosodic processing) in 80 typically developing children, ages 4-18 years, completing a stories listening paradigm. Neuromagnetic signals coherent with the speech envelope were localized using dynamic imaging of coherent sources (DICS). Across the group, we observed coherence in bilateral perisylvian cortex. We observed age-related increases in coherence to the speech envelope in the right superior temporal gyrus (r = 0.31, df = 78, p = 0.0047) and primary auditory cortex (r = 0.27, df = 78, p = 0.016); age-related decreases in coherence to the speech envelope were observed in the left superior temporal gyrus (r = - 0.25, df = 78, p = 0.026). This pattern may indicate a refinement of the networks responsible for prosodic processing during development, where language areas in the right hemisphere become increasingly specialized for prosodic processing. Altogether, these results reveal a distinct neurodevelopmental trajectory for the processing of prosodic cues, highlighting the presence of supportive language functions in the right hemisphere. Findings from this dataset of typically developing children may serve as a potential reference timeline for assessing children with neurodevelopmental hearing and speech disorders.

Speech prosody supports speaker selection and auditory stream segregation in a multi-talker situation

To process speech in a multi-talker environment, listeners need to segregate the mixture of incoming speech streams and focus their attention on one of them. Potentially, speech prosody could aid the segregation of different speakers, the selection of the desired speech stream, and detecting targets within the attended stream. For testing these issues, we recorded behavioral responses and extracted event-related potentials and functional brain networks from electroencephalographic signals recorded while participants listened to two concurrent speech streams, performing a lexical detection and a recognition memory task in parallel. Prosody manipulation was applied to the attended speech stream in one group of participants and to the ignored speech stream in another group. Naturally recorded speech stimuli were either intact, synthetically F0-flattened, or prosodically suppressed by the speaker. Results show that prosody - especially the parsing cues mediated by speech rate - facilitates stream selection, while playing a smaller role in auditory stream segmentation and target detection.

Perception of Prosody in Hearing-Impaired Individuals and Users of Hearing Assistive Devices: An Overview of Recent Advances

PURPOSE

Prosody perception is an essential component of speech communication and social interaction through which both linguistic and emotional information are conveyed. Considering the importance of the auditory system in processing prosody-related acoustic features, the aim of this review article is to review the effects of hearing impairment on prosody perception in children and adults. It also assesses the performance of hearing assistive devices in restoring prosodic perception.

METHOD

Following a comprehensive online database search, two lines of inquiry were targeted. The first summarizes recent attempts toward determining the effects of hearing loss and interacting factors such as age and cognitive resources on prosody perception. The second analyzes studies reporting beneficial or detrimental impacts of hearing aids, cochlear implants, and bimodal stimulation on prosodic abilities in people with hearing loss.

RESULTS

The reviewed studies indicate that hearing-impaired individuals vary widely in perceiving affective and linguistic prosody, depending on factors such as hearing loss severity, chronological age, and cognitive status. In addition, most of the emerging information points to limitations of hearing assistive devices in processing and transmitting the acoustic features of prosody.

CONCLUSIONS

The existing literature is incomplete in several respects, including the lack of a consensus on how and to what extent hearing prostheses affect prosody perception, especially the linguistic function of prosody, and a gap in assessing prosody under challenging listening situations such as noise. This review article proposes directions that future research could follow to provide a better understanding of prosody processing in those with hearing impairment, which may help health care professionals and designers of assistive technology to develop innovative diagnostic and rehabilitation tools.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.21809772.

Dysfunctional cerebello-cerebral network associated with vocal emotion recognition impairments

Vocal emotion recognition, a key determinant to analyzing a speaker's emotional state, is known to be impaired following cerebellar dysfunctions. Nevertheless, its possible functional integration in the large-scale brain network subtending emotional prosody recognition has yet to be explored. We administered an emotional prosody recognition task to patients with right versus left-hemispheric cerebellar lesions and a group of matched controls. We explored the lesional correlates of vocal emotion recognition in patients through a network-based analysis by combining a neuropsychological approach for lesion mapping with normative brain connectome data. Results revealed impaired recognition among patients for neutral or negative prosody, with poorer sadness recognition performances by patients with right cerebellar lesion. Network-based lesion-symptom mapping revealed that sadness recognition performances were linked to a network connecting the cerebellum with left frontal, temporal, and parietal cortices. Moreover, when focusing solely on a subgroup of patients with right cerebellar damage, sadness recognition performances were associated with a more restricted network connecting the cerebellum to the left parietal lobe. As the left hemisphere is known to be crucial for the processing of short segmental information, these results suggest that a corticocerebellar network operates on a fine temporal scale during vocal emotion decoding.

Aprosodia Following Focal Brain Damage: What's Right and What's Left?

PURPOSE

Hemispheric specialization for the comprehension and expression of linguistic and emotional prosody is typically attributed to the right hemisphere. This study used techniques adapted from meta-analysis to critically examine the strength of existing evidence for hemispheric lateralization of prosody following brain damage.

METHOD

Twenty-one databases were searched for articles published from 1970 to 2020 addressing differences in prosody performance between groups defined by right hemisphere damage and left hemisphere damage. Hedges's g effect sizes were calculated for all possible prosody comparisons. Primary analyses summarize effects for four types: linguistic production, linguistic comprehension, emotion comprehension, and emotion production. Within each primary analysis, Hedges's g values were averaged across comparisons (usually from a single article) based on the same sample of individuals. Secondary analyses explore more specific classifications of comparisons.

RESULTS

Out of the 113 articles investigating comprehension and production of emotional and linguistic prosody, 62 were deemed appropriate for data extraction, but only 21 met inclusion criteria, passed quality reviews, and provided sufficient information for analysis. Evidence from this review illustrates the heterogeneity of research methods and results from studies that have investigated aprosodia. This review provides inconsistent support for selective contribution of the two cerebral hemispheres to prosody comprehension and production; however, the strongest finding suggests that right hemisphere lesions disrupt emotional prosody comprehension more than left hemisphere lesions.

CONCLUSION

This review highlights the impoverished nature of the existing literature; offers suggestions for future research; and highlights relevant clinical implications for the prognostication, evaluation, and treatment of aprosodia.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.20334987.

Children's Neural Sensitivity to Prosodic Features of Natural Speech and Its Significance to Speech Development in Cochlear Implanted Children

Catchy utterances, such as proverbs, verses, and nursery rhymes (i.e., "No pain, no gain" in English), contain strong-prosodic (SP) features and are child-friendly in repeating and memorizing; yet the way those prosodic features encoded by neural activity and their influence on speech development in children are still largely unknown. Using functional near-infrared spectroscopy (fNIRS), this study investigated the cortical responses to the perception of natural speech sentences with strong/weak-prosodic (SP/WP) features and evaluated the speech communication ability in 21 pre-lingually deaf children with cochlear implantation (CI) and 25 normal hearing (NH) children. A comprehensive evaluation of speech communication ability was conducted on all the participants to explore the potential correlations between neural activities and children's speech development. The SP information evoked right-lateralized cortical responses across a broad brain network in NH children and facilitated the early integration of linguistic information, highlighting children's neural sensitivity to natural SP sentences. In contrast, children with CI showed significantly weaker cortical activation and characteristic deficits in speech perception with SP features, suggesting hearing loss at the early age of life, causing significantly impaired sensitivity to prosodic features of sentences. Importantly, the level of neural sensitivity to SP sentences was significantly related to the speech behaviors of all children participants. These findings demonstrate the significance of speech prosodic features in children's speech development.

Assessment tools and rehabilitation treatments for aprosodia following acquired brain injury: A scoping review

BACKGROUND

Acquired brain injury (ABI), especially to the right hemisphere, can result in difficulty using or understanding prosodic contours in speech. Prosody is used to convey emotional connotation or linguistic intent and includes pitch, loudness, rate, and voice quality. A disorder in the comprehension or production of prosody is known as aprosodia; despite the communication disability caused by prosodic disorders, the assessment and treatment of aprosodia following ABI has received scant attention.

AIMS

The aim of this scoping review is to gather and synthesise useful knowledge on aprosodia and provide therapists with an exhaustive document in order to guide clinical decision-making encouraging active identification and treatment of this disorder.

METHODS & PROCEDURES

This scoping review, conducted in accordance with PRISMA-ScR guidelines, investigated the existing literature concerning the assessment and treatments of linguistic and affective aprosodia in adult patients after ABI. A systematic search in four electronic databases (PubMed, CINAHL, Web of Science, ScienceDirect) was conducted for articles written in English, French, or Italian published between 1970 and 2020. After all evaluative criteria were applied, 15 articles were included for final review.

OUTCOMES & RESULTS

Results show the presence of six assessment tools for affective aprosodia and five evaluation tools targeting affective and linguistic prosody. Assessment of aprosodia is generally accomplished through acoustic and perceptual approaches. Current treatments for prosodic disorders focus on expressive aprosodia and have applied mostly two different approaches: imitative and cognitive-linguistic methods.

CONCLUSION & IMPLICATIONS

Findings suggest that aprosodia can be assessed by therapists through various techniques and may be amenable to behavioural treatments. Nevertheless, although there are several assessment tools available, no one currently offers a comprehensive assessment that incorporates an ecological dimension. It therefore seems necessary to continue research in this direction. The rehabilitation of receptive prosody abilities also remains to be explored.

WHAT THIS PAPER ADDS

What is already known on the subject Prosody has a fundamental role in communication and conveys speakers' intentions and emotions. Therefore, a deficit of prosody (aprosodia) after acquired brain injury can reduce social participation and engagement. Assessment tools and rehabilitation treatments are necessary in order to improve this disorder and patients' quality of life. What this paper adds to existing knowledge The evaluation tools currently available focuses mostly on affective aprosodia, whereas the linguistic prosody is less assessed. There exist two treatments for expressive aprosodia: motoric-imitative and cognitive-linguistic treatments; however, their efficacy is tested on small groups of patients. No treatments targeting receptive aprosodia were found. What are the potential or actual clinical implications of this work? We need more sensitive and reliable tools and systematic evaluations of all the components of prosody (affective and linguistic, receptive and expressive prosody). We need researches who analyse bigger samples of patients after right hemisphere brain injury and we identified the need of more well-designed studies and better understanding of the pathophysiology of aprosodia.

The Brain Dynamics of Syllable Duration and Semantic Predictability in Spanish

This study examines the neural dynamics underlying the prosodic (duration) and the semantic dimensions in Spanish sentence perception. Specifically, we investigated whether adult listeners are aware of changes in the duration of a pretonic syllable of words that were either semantically predictable or unpredictable from the preceding sentential context. Participants listened to the sentences with instructions to make prosodic or semantic judgments, while their EEG was recorded. For both accuracy and RTs, the results revealed an interaction between duration and semantics. ERP analysis exposed an interactive effect between task, duration and semantic, showing that both processes share neural resources. There was an enhanced negativity on semantic process (N400) and an extended positivity associated with anomalous duration. Source estimation for the N400 component revealed activations in the frontal gyrus for the semantic contrast and in the parietal postcentral gyrus for duration contrast in the metric task, while activation in the sub-lobar insula was observed for the semantic task. The source of the late positive components was located on posterior cingulate. Hence, the ERP data support the idea that semantic and prosodic levels are processed by similar neural networks, and the two linguistic dimensions influence each other during the decision-making stage in the metric and semantic judgment tasks.

What is Functional Communication? A Theoretical Framework for Real-World Communication Applied to Aphasia Rehabilitation

Aphasia is an impairment of language caused by acquired brain damage such as stroke or traumatic brain injury, that affects a person’s ability to communicate effectively. The aim of rehabilitation in aphasia is to improve everyday communication, improving an individual’s ability to function in their day-to-day life. For that reason, a thorough understanding of naturalistic communication and its underlying mechanisms is imperative. The field of aphasiology currently lacks an agreed, comprehensive, theoretically founded definition of communication. Instead, multiple disparate interpretations of functional communication are used. We argue that this makes it nearly impossible to validly and reliably assess a person’s communicative performance, to target this behaviour through therapy, and to measure improvements post-therapy. In this article we propose a structured, theoretical approach to defining the concept of functional communication. We argue for a view of communication as “situated language use”, borrowed from empirical psycholinguistic studies with non-brain damaged adults. This framework defines language use as: (1) interactive, (2) multimodal, and (3) contextual. Existing research on each component of the framework from non-brain damaged adults and people with aphasia is reviewed. The consequences of adopting this approach to assessment and therapy for aphasia rehabilitation are discussed. The aim of this article is to encourage a more systematic, comprehensive approach to the study and treatment of situated language use in aphasia.

OUP accepted manuscript

During conversations, speech prosody provides important clues about the speaker’s communicative intentions. In many languages, a rising vocal pitch at the end of a sentence typically expresses a question function, whereas a falling pitch suggests a statement. Here, the neurophysiological basis of intonation and speech act understanding were investigated with high-density electroencephalography (EEG) to determine whether prosodic features are reflected at the neurophysiological level. Already approximately 100 ms after the sentence-final word differing in prosody, questions, and statements expressed with the same sentences led to different neurophysiological activity recorded in the event-related potential. Interestingly, low-pass filtered sentences and acoustically matched nonvocal musical signals failed to show any neurophysiological dissociations, thus suggesting that the physical intonation alone cannot explain this modulation. Our results show rapid neurophysiological indexes of prosodic communicative information processing that emerge only when pragmatic and lexico-semantic information are fully expressed. The early enhancement of question-related activity compared with statements was due to sources in the articulatory-motor region, which may reflect the richer action knowledge immanent to questions, namely the expectation of the partner action of answering the question. The present findings demonstrate a neurophysiological correlate of prosodic communicative information processing, which enables humans to rapidly detect and understand speaker intentions in linguistic interactions.

Cascade process mediated by left hippocampus and left superior frontal gyrus affects relationship between aging and cognitive dysfunction

BACKGROUND

Cognitive function declines with age and has been shown to be associated with atrophy in some brain regions, including the prefrontal cortex. However, the details of the relationship between aging and cognitive dysfunction are not well understood.

METHODS

Across a wide range of ages (24- to 85-years-old), this research measured the gray matter volume of structural magnetic resonance imaging data in 39 participants, while some brain regions were set as mediator variables to assess the cascade process between aging and cognitive dysfunction in a path analysis.

RESULTS

Path analysis showed that age affected the left hippocampus, thereby directly affecting the left superior frontal gyrus. Furthermore, the gyrus directly affected higher order flexibility and maintenance abilities calculated as in the Wisconsin card sorting test, and the two abilities affected the assessment of general cognitive function.

CONCLUSION

Our finding suggests that a cascade process mediated by the left hippocampus and left superior frontal gyrus is involved in the relationship between aging and cognitive dysfunction.

Right ventral stream damage underlies both poststroke aprosodia and amusia

BACKGROUND AND PURPOSE

This study was undertaken to determine and compare lesion patterns and structural dysconnectivity underlying poststroke aprosodia and amusia, using a data-driven multimodal neuroimaging approach.

METHODS

Thirty-nine patients with right or left hemisphere stroke were enrolled in a cohort study and tested for linguistic and affective prosody perception and musical pitch and rhythm perception at subacute and 3-month poststroke stages. Participants listened to words spoken with different prosodic stress that changed their meaning, and to words spoken with six different emotions, and chose which meaning or emotion was expressed. In the music tasks, participants judged pairs of short melodies as the same or different in terms of pitch or rhythm. Structural magnetic resonance imaging data were acquired at both stages, and machine learning-based lesion-symptom mapping and deterministic tractography were used to identify lesion patterns and damaged white matter pathways giving rise to aprosodia and amusia.

RESULTS

Both aprosodia and amusia were behaviorally strongly correlated and associated with similar lesion patterns in right frontoinsular and striatal areas. In multiple regression models, reduced fractional anisotropy and lower tract volume of the right inferior fronto-occipital fasciculus were the strongest predictors for both disorders, over time.

CONCLUSIONS

These results highlight a common origin of aprosodia and amusia, both arising from damage and disconnection of the right ventral auditory stream integrating rhythmic-melodic acoustic information in prosody and music. Comorbidity of these disabilities may worsen the prognosis and affect rehabilitation success.

Supra-normal skills in processing of visuo-auditory prosodic information by cochlear-implanted deaf patients

Cochlear implanted (CI) adults with acquired deafness are known to depend on multisensory integration skills (MSI) for speech comprehension through the fusion of speech reading skills and their deficient auditory perception. But, little is known on how CI patients perceive prosodic information relating to speech content. Our study aimed to identify how CI patients use MSI between visual and auditory information to process paralinguistic prosodic information of multimodal speech and the visual strategies employed. A psychophysics assessment was developed, in which CI patients and hearing controls (NH) had to distinguish between a question and a statement. The controls were separated into two age groups (young and aged-matched) to dissociate any effect of aging. In addition, the oculomotor strategies used when facing a speaker in this prosodic decision task were recorded using an eye-tracking device and compared to controls. This study confirmed that prosodic processing is multisensory but it revealed that CI patients showed significant supra-normal audiovisual integration for prosodic information compared to hearing controls irrespective of age. This study clearly showed that CI patients had a visuo-auditory gain more than 3 times larger than that observed in hearing controls. Furthermore, CI participants performed better in the visuo-auditory situation through a specific oculomotor exploration of the face as they significantly fixate the mouth region more than young NH participants who fixate the eyes, whereas the aged-matched controls presented an intermediate exploration pattern equally reported between the eyes and mouth. To conclude, our study demonstrated that CI patients have supra-normal skills MSI when integrating visual and auditory linguistic prosodic information, and a specific adaptive strategy developed as it participates directly in speech content comprehension.

A novel beamformer-based imaging of phase-amplitude coupling (BIPAC) unveiling the inter-regional connectivity of emotional prosody processing in women with primary dysmenorrhea

Objective. Neural communication or the interactions of brain regions play a key role in the formation of functional neural networks. A type of neural communication can be measured in the form of phase-amplitude coupling (PAC), which is the coupling between the phase of low-frequency oscillations and the amplitude of high-frequency oscillations. This paper presents a beamformer-based imaging method, beamformer-based imaging of PAC (BIPAC), to quantify the strength of PAC between a seed region and other brain regions.Approach. A dipole is used to model the ensemble of neural activity within a group of nearby neurons and represents a mixture of multiple source components of cortical activity. From ensemble activity at each brain location, the source component with the strongest coupling to the seed activity is extracted, while unrelated components are suppressed to enhance the sensitivity of coupled-source estimation.Main results. In evaluations using simulation data sets, BIPAC proved advantageous with regard to estimation accuracy in source localization, orientation, and coupling strength. BIPAC was also applied to the analysis of magnetoencephalographic signals recorded from women with primary dysmenorrhea in an implicit emotional prosody experiment. In response to negative emotional prosody, auditory areas revealed strong PAC with the ventral auditory stream and occipitoparietal areas in the theta-gamma and alpha-gamma bands, which may respectively indicate the recruitment of auditory sensory memory and attention reorientation. Moreover, patients with more severe pain experience appeared to have stronger coupling between auditory areas and temporoparietal regions.Significance. Our findings indicate that the implicit processing of emotional prosody is altered by menstrual pain experience. The proposed BIPAC is feasible and applicable to imaging inter-regional connectivity based on cross-frequency coupling estimates. The experimental results also demonstrate that BIPAC is capable of revealing autonomous brain processing and neurodynamics, which are more subtle than active and attended task-driven processing.

Effects of Amateur Musical Experience on Categorical Perception of Lexical Tones by Native Chinese Adults: An ERP Study

Music impacting on speech processing is vividly evidenced in most reports involving professional musicians, while the question of whether the facilitative effects of music are limited to experts or may extend to amateurs remains to be resolved. Previous research has suggested that analogous to language experience, musicianship also modulates lexical tone perception but the influence of amateur musical experience in adulthood is poorly understood. Furthermore, little is known about how acoustic information and phonological information of lexical tones are processed by amateur musicians. This study aimed to provide neural evidence of cortical plasticity by examining categorical perception of lexical tones in Chinese adults with amateur musical experience relative to the non-musician counterparts. Fifteen adult Chinese amateur musicians and an equal number of non-musicians participated in an event-related potential (ERP) experiment. Their mismatch negativities (MMNs) to lexical tones from Mandarin Tone 2–Tone 4 continuum and non-speech tone analogs were measured. It was hypothesized that amateur musicians would exhibit different MMNs to their non-musician counterparts in processing two aspects of information in lexical tones. Results showed that the MMN mean amplitude evoked by within-category deviants was significantly larger for amateur musicians than non-musicians regardless of speech or non-speech condition. This implies the strengthened processing of acoustic information by adult amateur musicians without the need of focused attention, as the detection of subtle acoustic nuances of pitch was measurably improved. In addition, the MMN peak latency elicited by across-category deviants was significantly shorter than that by within-category deviants for both groups, indicative of the earlier processing of phonological information than acoustic information of lexical tones at the pre-attentive stage. The results mentioned above suggest that cortical plasticity can still be induced in adulthood, hence non-musicians should be defined more strictly than before. Besides, the current study enlarges the population demonstrating the beneficial effects of musical experience on perceptual and cognitive functions, namely, the effects of enhanced speech processing from music are not confined to a small group of experts but extend to a large population of amateurs.

Emotion recognition impairments and social well-being following right-hemisphere stroke

Accurately recognizing and responding to the emotions of others is essential for proper social communication and helps bind strong relationships that are particularly important for stroke survivors. Emotion recognition typically engages cortical areas that are predominantly right-lateralized including superior temporal and inferior frontal gyri - regions frequently impacted by right-hemisphere stroke. Since prior work already links right-hemisphere stroke to deficits in emotion recognition, this research aims to extend these findings to determine whether impaired emotion recognition after right-hemisphere stroke is associated with worse social well-being outcomes. Eighteen right-hemisphere stroke patients (≥6 months post-stroke) and 21 neurologically healthy controls completed a multimodal emotion recognition test (Geneva Emotion Recognition Test - Short) and reported engagement in social/non-social activities and levels of social support. Right-hemisphere stroke was associated with worse emotion recognition accuracy, though not all patients exhibited impairment. In line with hypotheses, emotion recognition impairments were associated with greater loss of social activities after stroke, an effect that could not be attributed to stroke severity or loss of non-social activities. Impairments were also linked to reduced patient-reported social support. Results implicate emotion recognition difficulties as a potential antecedent of social withdrawal after stroke and warrant future research to test emotion recognition training post-stroke.

A Review on Treatment-Related Brain Changes in Aphasia

Numerous studies have investigated brain changes associated with interventions targeting a range of language problems in patients with aphasia. We strive to integrate the results of these studies to examine (1) whether the focus of the intervention (i.e., phonology, semantics, orthography, syntax, or rhythmic-melodic) determines in which brain regions changes occur; and (2a) whether the most consistent changes occur within the language network or outside, and (2b) whether these are related to individual differences in language outcomes. The results of 32 studies with 204 unique patients were considered. Concerning (1), the location of treatment-related changes does not clearly depend on the type of language processing targeted. However, there is some support that rhythmic-melodic training has more impact on the right hemisphere than linguistic training. Concerning (2), we observed that language recovery is not only associated with changes in traditional language-related structures in the left hemisphere and homolog regions in the right hemisphere, but also with more medial and subcortical changes (e.g., precuneus and basal ganglia). Although it is difficult to draw strong conclusions, because there is a lack of systematic large-scale studies on this topic, this review highlights the need for an integrated approach to investigate how language interventions impact on the brain. Future studies need to focus on larger samples preserving subject-specific information (e.g., lesion effects) to cope with the inherent heterogeneity of stroke-induced aphasia. In addition, recovery-related changes in whole-brain connectivity patterns need more investigation to provide a comprehensive neural account of treatment-related brain plasticity and language recovery.

Mirrored brain organization: Statistical anomaly or reversal of hemispheric functional segregation bias?

Humans demonstrate a prototypical hemispheric functional segregation pattern, with language and praxis lateralizing to the left hemisphere and spatial attention, face recognition, and emotional prosody to the right hemisphere. In this study, we used fMRI to determine laterality for all five functions in each participant. Crucially, we recruited a sample of left-handers preselected for atypical (right) language dominance (n = 24), which allowed us to characterize hemispheric asymmetry of the other functions and compare their functional segregation pattern with that of left-handers showing typical language dominance (n = 39). Our results revealed that most participants with left language dominance display the prototypical pattern of functional hemispheric segregation (44%) or deviate from this pattern in only one function (35%). Similarly, the vast majority of right language dominant participants demonstrated a completely mirrored brain organization (50%) or a reversal for all but one cognitive function (32%). Participants deviating by more than one function from the standard segregation pattern showed poorer cognitive performance, in line with an oft-presumed biological advantage of hemispheric functional segregation.

Neural correlates of intonation and lexical tone in tonal and non-tonal language speakers

Intonation, the modulation of pitch in speech, is a crucial aspect of language that is processed in right‐hemispheric regions, beyond the classical left‐hemispheric language system. Whether or not this notion generalises across languages remains, however, unclear. Particularly, tonal languages are an interesting test case because of the dual linguistic function of pitch that conveys lexical meaning in form of tone, in addition to intonation. To date, only few studies have explored how intonation is processed in tonal languages, how this compares to tone and between tonal and non‐tonal language speakers. The present fMRI study addressed these questions by testing Mandarin and German speakers with Mandarin material. Both groups categorised mono‐syllabic Mandarin words in terms of intonation, tone, and voice gender. Systematic comparisons of brain activity of the two groups between the three tasks showed large cross‐linguistic commonalities in the neural processing of intonation in left fronto‐parietal, right frontal, and bilateral cingulo‐opercular regions. These areas are associated with general phonological, specific prosodic, and controlled categorical decision‐making processes, respectively. Tone processing overlapped with intonation processing in left fronto‐parietal areas, in both groups, but evoked additional activity in bilateral temporo‐parietal semantic regions and subcortical areas in Mandarin speakers only. Together, these findings confirm cross‐linguistic commonalities in the neural implementation of intonation processing but dissociations for semantic processing of tone only in tonal language speakers.

What you say versus how you say it: Comparing sentence comprehension and emotional prosody processing using fMRI

While language processing is often described as lateralized to the left hemisphere (LH), the processing of emotion carried by vocal intonation is typically attributed to the right hemisphere (RH) and more specifically, to areas mirroring the LH language areas. However, the evidence base for this hypothesis is inconsistent, with some studies supporting right-lateralization but others favoring bilateral involvement in emotional prosody processing. Here we compared fMRI activations for an emotional prosody task with those for a sentence comprehension task in 20 neurologically healthy adults, quantifying lateralization using a lateralization index. We observed right-lateralized frontotemporal activations for emotional prosody that roughly mirrored the left-lateralized activations for sentence comprehension. In addition, emotional prosody also evoked bilateral activation in pars orbitalis (BA47), amygdala, and anterior insula. These findings are consistent with the idea that analysis of the auditory speech signal is split between the hemispheres, possibly according to their preferred temporal resolution, with the left preferentially encoding phonetic and the right encoding prosodic information. Once processed, emotional prosody information is fed to domain-general emotion processing areas and integrated with semantic information, resulting in additional bilateral activations.

The depth and breadth of multiple perceptual asymmetries in right handers and non-right handers

Several non-verbal perceptual and attentional processes have been linked with specialization of the right cerebral hemisphere. Given that most people have a left hemispheric specialization for language, it is tempting to assume that functions of these two classes of dominance are related. Unfortunately, such models of complementarity are notoriously hard to test. Here we suggest a method which compares frequency of a particular perceptual asymmetry with known frequencies of left hemispheric language dominance in right-handed and non-right handed groups. We illustrate this idea using the greyscales and colourscales tasks, chimeric faces, emotional dichotic listening, and a consonant-vowel dichotic listening task. Results show a substantial "breadth" of leftward bias on the right hemispheric tasks and rightward bias on verbal dichotic listening. Right handers and non-right handers did not differ in terms of proportions of people who were left biased for greyscales/colourscales. Support for reduced typical biases in non-right handers was found for chimeric faces and for CV dichotic listening. Results are discussed in terms of complementary theories of cerebral asymmetries, and how this type of method could be used to create a taxonomy of lateralized functions, each categorized as related to speech and language dominance, or not.

Prosodic pitch processing is represented in delta-band EEG and is dissociable from the cortical tracking of other acoustic and phonetic features

Speech is central to communication among humans. Meaning is largely conveyed by the selection of linguistic units such as words, phrases and sentences. However, prosody, that is the variation of acoustic cues that tie linguistic segments together, adds another layer of meaning. There are various features underlying prosody, one of the most important being pitch and how it is modulated. Recent fMRI and ECoG studies have suggested that there are cortical regions for pitch which respond primarily to resolved harmonics and that high-gamma cortical activity encodes intonation as represented by relative pitch. Importantly, this latter result was shown to be independent of the cortical tracking of the acoustic energy of speech, a commonly used measure. Here, we investigate whether we can isolate low-frequency EEG indices of pitch processing of continuous narrative speech from those reflecting the tracking of other acoustic and phonetic features. Harmonic resolvability was found to contain unique predictive power in delta and theta phase, but it was highly correlated with the envelope and tracked even when stimuli were pitch-impoverished. As such, we are circumspect about whether its contribution is truly pitch-specific. Crucially however, we found a unique contribution of relative pitch to EEG delta-phase prediction, and this tracking was absent when subjects listened to pitch-impoverished stimuli. This finding suggests the possibility of a separate processing stream for prosody that might operate in parallel to acoustic-linguistic processing. Furthermore, it provides a novel neural index that could be useful for testing prosodic encoding in populations with speech processing deficits and for improving cognitively controlled hearing aids.

Mirroring the Social Aspects of Speech and Actions: The Role of the Insula

Action and speech may take different forms, being expressed, for example, gently or rudely. These aspects of social communication, named vitality forms, have been little studied in neuroscience. In the present functional magnetic resonance imaging study, we investigated the role of insula in processing action and speech vitality forms. In speech runs, participants were asked to listen or imaging themselves to pronounce action verbs gently or rudely. In action runs, they were asked to observe or imaging themselves to perform actions gently or rudely. The results showed that, relative to controls, there was an activation of the dorso-central insula in both tasks of speech and action runs. The insula sector specific for action vitality form was located slightly more dorsally than that of speech with a large overlap of their activations. The psycho-physiological interaction analysis showed that the insular sector involved in action vitality forms processing is connected with the left hemisphere areas controlling arm actions, whereas the sector involved in speech vitality forms processing is linked with right hemisphere areas related to speech prosody. We conclude that the central part of the insula is a key region for vitality forms processing regardless of the modality by which they are conveyed or expressed.

Towards a neural model of infant cry perception

Previous work suggests that infant cry perception is supported by an evolutionary old neural network consisting of the auditory system, the thalamocingulate circuit, the frontoinsular system, the reward pathway and the medial prefrontal cortex. Furthermore, gender and parenthood have been proposed to modulate processing of infant cries. The present meta-analysis (N = 350) confirmed involvement of the auditory system, the thalamocingulate circuit, the dorsal anterior insula, the pre-supplementary motor area and dorsomedial prefrontal cortex and the inferior frontal gyrus in infant cry perception, but not of the reward pathway. Structures related to motoric processing, possibly supporting the preparation of a parenting response, were also involved. Finally, females (more than males) and parents (more than non-parents) recruited a cortico-limbic sensorimotor integration network, offering a neural explanation for previously observed enhanced processing of infant cries in these sub-groups. Based on the results, an updated neural model of infant cry perception is presented.

Prosody perception and production by children with cochlear implants

The perception and production of emotional and linguistic (focus) prosody were compared in children with cochlear implants (CI) and normally hearing (NH) peers. Thirteen CI and thirteen hearing-age-matched school-aged NH children were tested, as baseline, on non-verbal emotion understanding, non-word repetition, and stimulus identification and naming. Main tests were verbal emotion discrimination, verbal focus position discrimination, acted emotion production, and focus production. Productions were evaluated by NH adult Dutch listeners. All scores between groups were comparable, except a lower score for the CI group for non-word repetition. Emotional prosody perception and production scores correlated weakly for CI children but were uncorrelated for NH children. In general, hearing age weakly predicted emotion production but not perception. Non-verbal emotional (but not linguistic) understanding predicted CI children's (but not controls') emotion perception and production. In conclusion, increasing time in sound might facilitate vocal emotional expression, possibly requiring independently maturing emotion perception skills.

White matter pathways for prosodic structure building: A case study

The relevance of left dorsal and ventral fiber pathways for syntactic and semantic comprehension is well established, while pathways for prosody are little explored. The present study examined linguistic prosodic structure building in a patient whose right arcuate/superior longitudinal fascicles and posterior corpus callosum were transiently compromised by a vasogenic peritumoral edema. Compared to ten matched healthy controls, the patient's ability to detect irregular prosodic structure significantly improved between pre- and post-surgical assessment. This recovery was accompanied by an increase in average fractional anisotropy (FA) in right dorsal and posterior transcallosal fiber tracts. Neither general cognitive abilities nor (non-prosodic) syntactic comprehension nor FA in right ventral and left dorsal fiber tracts showed a similar pre-post increase. Together, these findings suggest a contribution of right dorsal and inter-hemispheric pathways to prosody perception, including the right-dorsal tracking and structuring of prosodic pitch contours that is transcallosally informed by concurrent syntactic information.

Intonational speech prosody encoding in the human auditory cortex

Speakers of all human languages regularly use intonational pitch to convey linguistic meaning, such as to emphasize a particular word. Listeners extract pitch movements from speech and evaluate the shape of intonation contours independent of each speaker's pitch range. We used high-density electrocorticography to record neural population activity directly from the brain surface while participants listened to sentences that varied in intonational pitch contour, phonetic content, and speaker. Cortical activity at single electrodes over the human superior temporal gyrus selectively represented intonation contours. These electrodes were intermixed with, yet functionally distinct from, sites that encoded different information about phonetic features or speaker identity. Furthermore, the representation of intonation contours directly reflected the encoding of speaker-normalized relative pitch but not absolute pitch.

Power-up: A Reanalysis of 'Power Failure' in Neuroscience Using Mixture Modeling

Recently, evidence for endemically low statistical power has cast neuroscience findings into doubt. If low statistical power plagues neuroscience, then this reduces confidence in the reported effects. However, if statistical power is not uniformly low, then such blanket mistrust might not be warranted. Here, we provide a different perspective on this issue, analyzing data from an influential study reporting a median power of 21% across 49 meta-analyses (Button et al., 2013). We demonstrate, using Gaussian mixture modeling, that the sample of 730 studies included in that analysis comprises several subcomponents so the use of a single summary statistic is insufficient to characterize the nature of the distribution. We find that statistical power is extremely low for studies included in meta-analyses that reported a null result and that it varies substantially across subfields of neuroscience, with particularly low power in candidate gene association studies. Therefore, whereas power in neuroscience remains a critical issue, the notion that studies are systematically underpowered is not the full story: low power is far from a universal problem.SIGNIFICANCE STATEMENT Recently, researchers across the biomedical and psychological sciences have become concerned with the reliability of results. One marker for reliability is statistical power: the probability of finding a statistically significant result given that the effect exists. Previous evidence suggests that statistical power is low across the field of neuroscience. Our results present a more comprehensive picture of statistical power in neuroscience: on average, studies are indeed underpowered-some very seriously so-but many studies show acceptable or even exemplary statistical power. We show that this heterogeneity in statistical power is common across most subfields in neuroscience. This new, more nuanced picture of statistical power in neuroscience could affect not only scientific understanding, but potentially policy and funding decisions for neuroscience research.

Consequences of brain tumour resection on emotion recognition

Emotion processing impairments are common in patients undergoing brain surgery for fronto-temporal tumour resection, with potential consequences on social interactions. However, evidence is controversial concerning side and site of lesions causing such deficits. This study investigates visual and auditory emotion recognition in brain tumour patients with the aim of clarifying which lesion sites are related to impairments in emotion processing from different modalities. Thirty-four patients were evaluated, before and after surgery, on facial expression and emotional prosody recognition; voxel-based lesion-symptom mapping (VLSM) analyses were performed on patients' post-surgery MRI images. Results showed that patients' performance decreased after surgery in both visual and auditory modalities, but, in general, recovered 3 months after surgery. In facial expression recognition, left brain-damaged patients showed greater post-surgery deterioration than right brain-damaged ones, whose performance specifically decreased for sadness and fear. VLSM analysis revealed two segregated areas in the left hemisphere accounting for post-surgery scores for happy (fronto-temporo-insular region) and surprised (middle frontal gyrus and inferior fronto-occipital fasciculus) facial expressions. Our findings demonstrate that surgical removal of tumours in the fronto-temporal region produces impairment in facial emotion recognition with an overall recovery at 3 months, suggesting a partially different representation of positive and negative emotions in the left and right hemispheres for visually - but not auditory - presented emotions; moreover, we show that deficits in specific expression recognition are associated with discrete lesion locations.

Vocal emotion decoding in the subthalamic nucleus: An intracranial ERP study in Parkinson's disease

Using intracranial local field potential (LFP) recordings in patients with Parkinson's disease (PD) undergoing deep brain stimulation (DBS), we explored the electrophysiological activity of the subthalamic nucleus (STN) in response to emotional stimuli in the auditory modality. Previous studies focused on the influence of visual stimuli. To this end, we recorded LFPs within the STN in response to angry, happy, and neutral prosodies in 13 patients with PD who had just undergone implantation of DBS electrodes. We observed specific modulation of the right STN in response to anger and happiness, as opposed to neutral prosody, occurring at around 200-300ms post-onset, and later at around 850-950ms post-onset for anger and at around 3250-3350ms post-onset for happiness. Taken together with previous reports of modulated STN activity in response to emotional visual stimuli, the present results appear to confirm that the STN is involved in emotion processing irrespective of stimulus valence and sensory modality.

The perception of emotion and focus prosody with varying acoustic cues in cochlear implant simulations with varying filter slopes

This study aimed to find the optimal filter slope for cochlear implant simulations (vocoding) by testing the effect of a wide range of slopes on the discrimination of emotional and linguistic (focus) prosody, with varying availability of F0 and duration cues. Forty normally hearing participants judged if (non-)vocoded sentences were pronounced with happy or sad emotion, or with adjectival or nominal focus. Sentences were recorded as natural stimuli and manipulated to contain only emotion- or focus-relevant segmental duration or F0 information or both, and then noise-vocoded with 5, 20, 80, 120, and 160 dB/octave filter slopes. Performance increased with steeper slopes, but only up to 120 dB/octave, with bigger effects for emotion than for focus perception. For emotion, results with both cues most closely resembled results with F0, while for focus results with both cues most closely resembled those with duration, showing emotion perception relies primarily on F0, and focus perception on duration. This suggests that filter slopes affect focus perception less than emotion perception because for emotion, F0 is both more informative and more affected. The performance increase until extreme filter slope values suggests that much performance improvement in prosody perception is still to be gained for CI users.

Reception of Communicative Functions of Prosody in Hypokinetic Dysarthria due to Parkinson's Disease

BACKGROUND

Mapping adequacy of receptive prosodic abilities in speakers with hypokinetic dysarthria due to Parkinson's disease (PD) is useful, because therapy of disturbed production of prosody relies on adequate reception of prosody. There is evidence for a deficit of reception of emotional prosody in PD.

OBJECTIVE

The present study aims at presenting a comprehensive picture of the reception of various communicative functions of prosody in hypokinetic dysarthria due to PD.

METHODS

We assessed perception (using a discrimination task) and comprehension (using an identification task) of five communicative functions of Dutch prosody (lexical stress, boundary marking, focus, sentence mode, and emotional prosody) in a group of adults with hypokinetic dysarthria due to PD (n = 22) and a gender and age matched group of unimpaired adults (n = 22). We also investigated the relationship between age and global test score, and the effect of perception and comprehension subtest sequence on the global test score.

RESULTS

Between groups, no significant differences in receptive prosodic abilities were found. Within both groups, the comprehension subtest was significantly more difficult than the perception subtest, and there was a significant negative correlation between age and global test score. No subtest sequence effect could be demonstrated.

CONCLUSIONS

Considering that the older speakers with hypokinetic dysarthria due to PD had receptive prosodic skills inferior to those of the younger speakers, notwithstanding apparently intact cognition and hearing, the findings suggest that age is a factor to be reckoned with in prosody assessment and management in this population.

Vocal emotion processing deficits in HIV-infected individuals

We aimed to explore the brain imaging correlates of vocal emotion processing in a group of HIV+ individuals and to compare the vocal emotion processing of HIV+ individuals with a group of healthy adults. We conducted multiple linear regressions to determine the cerebral correlates of a newly designed vocal emotion processing test in a sub-group of HIV+ individuals who completed the cerebral magnetic resonance scan (n = 36). Separately, we test whether the association between our test scores and each cerebral measure persisted regardless of the presence of neurocognitive impairment. We also calculated differences in average test scores between the total HIV+ group (n = 100) and a healthy adult group (n = 46). We found a positive association between the test scores and several brain area volumes: right frontal, temporal and parietal lobes, bilateral thalamus, and left hippocampus. We found a negative association between inflammatory markers in frontal white matter and the test scores. After controlling by neurocognitive impairment, several brain area volumes remained positively associated to the prosody test scores. Moreover, the whole HIV+ sample had significantly poorer test scores than healthy adults, but only in the subset of HIV+ individuals with neurocognitive impairment. For the first time, our results suggest that cerebral dysfunctions in particular brain areas involved in the processing of emotional auditory stimuli may occur in HIV+ individuals. These results highlight the need for broad characterization of the neuropsychological consequence of HIV brain damages.

Multimodal integration of spontaneously produced representational co-speech gestures: an fMRI study

To examine whether more ecologically valid co-speech gesture stimuli elicit brain responses consistent with those found by studies that relied on scripted stimuli, we presented participants with spontaneously produced, meaningful co-speech gesture during fMRI scanning (n = 28). Speech presented with gesture (versus either presented alone) elicited heightened activity in bilateral posterior superior temporal, premotor, and inferior frontal regions. Within left temporal and premotor, but not inferior frontal regions, we identified small clusters with superadditive responses, suggesting that these discrete regions support both sensory and semantic integration. In contrast, surrounding areas and the inferior frontal gyrus may support either sensory or semantic integration. Reduced activation for speech with gesture in language-related regions indicates allocation of fewer neural resources when meaningful gestures accompany speech. Sign language experience did not affect co-speech gesture activation. Overall, our results indicate that scripted stimuli have minimal confounding influences; however, they may miss subtle superadditive effects.

The role of the right hemisphere in semantic control: A case-series comparison of right and left hemisphere stroke

Semantic control processes guide conceptual retrieval so that we are able to focus on non-dominant associations and features when these are required for the task or context, yet the neural basis of semantic control is not fully understood. Neuroimaging studies have emphasised the role of left inferior frontal gyrus (IFG) in controlled retrieval, while neuropsychological investigations of semantic control deficits have almost exclusively focussed on patients with left-sided damage (e.g., patients with semantic aphasia, SA). Nevertheless, activation in fMRI during demanding semantic tasks typically extends to right IFG. To investigate the role of the right hemisphere (RH) in semantic control, we compared nine RH stroke patients with 21 left-hemisphere SA patients, 11 mild SA cases and 12 healthy, aged-matched controls on semantic and executive tasks, plus experimental tasks that manipulated semantic control in paradigms particularly sensitive to RH damage. RH patients had executive deficits to parallel SA patients but they performed well on standard semantic tests. Nevertheless, multimodal semantic control deficits were found in experimental tasks involving facial emotions and the 'summation' of meaning across multiple items. On these tasks, RH patients showed effects similar to those in SA cases - multimodal deficits that were sensitive to distractor strength and cues and miscues, plus increasingly poor performance in cyclical matching tasks which repeatedly probed the same set of concepts. Thus, despite striking differences in single-item comprehension, evidence presented here suggests semantic control is bilateral, and disruption of this component of semantic cognition can be seen following damage to either hemisphere.

Abnormal degree centrality in Alzheimer's disease patients with depression: A resting-state functional magnetic resonance imaging study

Depression is common in Alzheimer's disease (AD) and occurs in AD patients with a prevalence of up to 40%. It reduces cognitive function and increases the burden on caregivers. Currently, there are very few medications that are useful for treating depression in AD patients. Therefore, understanding the brain abnormalities in AD patients with depression (D-AD) is crucial for developing effective interventions. The aim of this study was to investigate the intrinsic dysconnectivity pattern of whole-brain functional networks at the voxel level in D-AD patients based on degree centrality (DC) as measured by resting-state functional magnetic resonance imaging (R-fMRI). Our study included 32 AD patients. All patients were evaluated using the Neuropsychiatric Inventory and Hamilton Depression Rating Scale and further divided into two groups: 15 D-AD patients and 17 non-depressed AD (nD-AD) patients. R-fMRI datasets were acquired from these D-AD and nD-AD patients. First, we performed a DC analysis to identify voxels that showed altered whole brain functional connectivity (FC) with other voxels. We then further investigated FC using the abnormal DC regions to examine in more detail the connectivity patterns of the identified DC changes. D-AD patients had lower DC values in the right middle frontal, precentral, and postcentral gyrus than nD-AD patients. Seed-based analysis revealed decreased connectivity between the precentral and postcentral gyrus to the supplementary motor area and middle cingulum. FC also decreased in the right middle frontal, precentral, and postcentral gyrus. Thus, AD patients with depression fit a 'network dysfunction model' distinct from major depressive disorder and AD.

Emotional correlates of unirhinal odour identification

It seems self-evident that smell profoundly shapes emotion, but less clear is the nature of this interaction. Here, we sought to determine whether the ability to identify odours co-varies with self-reported feelings of empathy and emotional expression recognition, as predicted if the two capacities draw on common resource. Thirty-six neurotypical volunteers were administered the Alberta Smell Test, the Interpersonal Reactivity Index and an emotional expression recognition task. Statistical analyses indicated that feelings of emotional empathy positively correlated with odour discrimination in right nostril, while the recognition of happy and fearful facial expressions positively correlated with odour discrimination in left nostril. These results uncover new links between olfactory discrimination and emotion which, given the ipsilateral configuration of the olfactory projections, point towards intra- rather than inter-hemispheric interaction. The results also provide novel support for the proposed lateralization of emotional empathy and the recognition of facial expression, and give reason to further explore the diagnostic sensitivity of smell tests because reduced sensitivity to others' emotions can mark the onset of certain neurological diseases.

What Do You Mean by That?! An Electrophysiological Study of Emotional and Attitudinal Prosody

The use of prosody during verbal communication is pervasive in everyday language and whilst there is a wealth of research examining the prosodic processing of emotional information, much less is known about the prosodic processing of attitudinal information. The current study investigated the online neural processes underlying the prosodic processing of non-verbal emotional and attitudinal components of speech via the analysis of event-related brain potentials related to the processing of anger and sarcasm. To examine these, sentences with prosodic expectancy violations created by cross-splicing a prosodically neutral head (‘he has’) and a prosodically neutral, angry, or sarcastic ending (e.g., ‘a serious face’) were used. Task demands were also manipulated, with participants in one experiment performing prosodic classification and participants in another performing probe-verification. Overall, whilst minor differences were found across the tasks, the results suggest that angry and sarcastic prosodic expectancy violations follow a similar processing time-course underpinned by similar neural resources.

A possible functional localizer for identifying brain regions sensitive to sentence-level prosody

Investigations of how we produce and perceive prosodic patterns are not only interesting in their own right but can inform fundamental questions in language research. We here argue that functional magnetic resonance imaging (fMRI) in general - and the functional localization approach in particular (e.g., Kanwisher et al., 1997; Saxe et al., 2006; Fedorenko et al., 2010; Nieto-Castañon & Fedorenko, 2012) - has the potential to help address open research questions in prosody research and at the intersection of prosody and other domains. Critically, this approach can go beyond questions like "where in the brain does mental process x produce activation" and toward questions that probe the nature of the representations and computations that subserve different mental abilities. We describe one way to functionally define regions sensitive to sentence-level prosody in individual subjects. This or similar "localizer" contrasts can be used in future studies to test hypotheses about the precise contributions of prosody-sensitive brain regions to prosodic processing and cognition more broadly.