Cerebral processing of linguistic and emotional prosody: fMRI studies

Neural response to vocal emotional intensity in youth

Previous research has identified regions of the brain that are sensitive to emotional intensity in faces, with some evidence for developmental differences in this pattern of response. However, comparable understanding of how the brain tracks linear variations in emotional prosody is limited-especially in youth samples. The current study used novel stimuli (morphing emotional prosody from neutral to anger/happiness in linear increments) to investigate whether neural response to vocal emotion was parametrically modulated by emotional intensity and whether there were age-related changes in this effect. Participants aged 8-21 years (n = 56, 52% female) completed a vocal emotion recognition task, in which they identified the intended emotion in morphed recordings of vocal prosody, while undergoing functional magnetic resonance imaging. Parametric analyses of whole-brain response to morphed stimuli found that activation in the bilateral superior temporal gyrus (STG) scaled to emotional intensity in angry (but not happy) voices. Multivariate region-of-interest analyses revealed the same pattern in the right amygdala. Sensitivity to emotional intensity did not vary by participants' age. These findings provide evidence for the linear parameterization of emotional intensity in angry vocal prosody within the bilateral STG and right amygdala. Although findings should be replicated, the current results also suggest that this pattern of neural sensitivity may not be subject to strong developmental influences.

Web-Based Group Conversational Intervention on Cognitive Function and Comprehensive Functional Status Among Japanese Older Adults: Protocol for a 6-Month Randomized Controlled Trial

BACKGROUND

Social communication is a key factor in maintaining cognitive function and contributes to well-being in later life.

OBJECTIVE

This study will examine the effects of "Photo-Integrated Conversation Moderated by Application version 2" (PICMOA-2), which is a web-based conversational intervention, on cognitive performance, frailty, and social and psychological indicators among community-dwelling older adults.

METHODS

This study is a randomized controlled trial with an open-label, 2-parallel group trial and 1:1 allocation design. Community dwellers aged 65 years and older were enrolled in the trial and divided into the intervention and control groups. The intervention group receives the PICMOA-2 program, a web-based group conversation, once every 2 weeks for 6 months. The primary outcome is verbal fluency, including phonemic and semantic fluency. The secondary outcomes are other neuropsychiatric batteries, including the Mini-Mental State Examination, Logical Memory (immediate and delay), verbal paired associates, and comprehensive functional status evaluated by questionnaires, including frailty, social status, and well-being. The effect of the intervention will be examined using a mixed linear model. As a secondary aim, we will test whether the intervention effects vary with the covariates at baseline to examine the effective target attributes.

RESULTS

Recruitment was completed in July 2023. A total of 66 participants were randomly allocated to intervention or control groups. As of January 1, 2024, the intervention is ongoing. Participants are expected to complete the intervention at the end of February 2024, and the postintervention evaluation will be conducted in March 2024.

CONCLUSIONS

This protocol outlines the randomized controlled trial study design evaluating the effect of a 6-month intervention with PICMOA-2. This study will provide evidence on the effectiveness of social interventions on cognitive function and identify effective target images for remote social intervention.

TRIAL REGISTRATION

UMIN Clinical Trials UMIN000050877; https://tinyurl.com/5eahsy66.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/56608.

Speech prosody enhances the neural processing of syntax

Human language relies on the correct processing of syntactic information, as it is essential for successful communication between speakers. As an abstract level of language, syntax has often been studied separately from the physical form of the speech signal, thus often masking the interactions that can promote better syntactic processing in the human brain. However, behavioral and neural evidence from adults suggests the idea that prosody and syntax interact, and studies in infants support the notion that prosody assists language learning. Here we analyze a MEG dataset to investigate how acoustic cues, specifically prosody, interact with syntactic representations in the brains of native English speakers. More specifically, to examine whether prosody enhances the cortical encoding of syntactic representations, we decode syntactic phrase boundaries directly from brain activity, and evaluate possible modulations of this decoding by the prosodic boundaries. Our findings demonstrate that the presence of prosodic boundaries improves the neural representation of phrase boundaries, indicating the facilitative role of prosodic cues in processing abstract linguistic features. This work has implications for interactive models of how the brain processes different linguistic features. Future research is needed to establish the neural underpinnings of prosody-syntax interactions in languages with different typological characteristics.

Left-Hemisphere Cortical Language Regions Respond Equally to Observed Dialogue and Monologue

Much of the language we encounter in our everyday lives comes in the form of conversation, yet the majority of research on the neural basis of language comprehension has used input from only one speaker at a time. Twenty adults were scanned while passively observing audiovisual conversations using functional magnetic resonance imaging. In a block-design task, participants watched 20 s videos of puppets speaking either to another puppet (the dialogue condition) or directly to the viewer (the monologue condition), while the audio was either comprehensible (played forward) or incomprehensible (played backward). Individually functionally localized left-hemisphere language regions responded more to comprehensible than incomprehensible speech but did not respond differently to dialogue than monologue. In a second task, participants watched videos (1-3 min each) of two puppets conversing with each other, in which one puppet was comprehensible while the other's speech was reversed. All participants saw the same visual input but were randomly assigned which character's speech was comprehensible. In left-hemisphere cortical language regions, the time course of activity was correlated only among participants who heard the same character speaking comprehensibly, despite identical visual input across all participants. For comparison, some individually localized theory of mind regions and right-hemisphere homologues of language regions responded more to dialogue than monologue in the first task, and in the second task, activity in some regions was correlated across all participants regardless of which character was speaking comprehensibly. Together, these results suggest that canonical left-hemisphere cortical language regions are not sensitive to differences between observed dialogue and monologue.

Expressive Prosody in Patients With Focal Anterior Temporal Neurodegeneration

BACKGROUND AND OBJECTIVES

Progressive focal anterior temporal lobe (ATL) neurodegeneration has been historically called semantic dementia. More recently, semantic variant primary progressive aphasia (svPPA) and semantic behavioral variant frontotemporal dementia (sbvFTD) have been linked with predominant left and right ATL neurodegeneration, respectively. Nonetheless, clinical tools for an accurate diagnosis of sbvFTD are still lacking. Expressive prosody refers to the modulation of pitch, loudness, tempo, and quality of voice used to convey emotional and linguistic information and has been linked to bilateral but right-predominant frontotemporal functioning. Changes in expressive prosody can be detected with semiautomated methods and could represent a useful diagnostic marker of socioemotional functioning in sbvFTD.

METHODS

Participants underwent a comprehensive neuropsychological and language evaluation and a 3T MRI at the University of California San Francisco. Each participant provided a verbal description of the picnic scene from the Western Aphasia Battery. The fundamental frequency (f0) range, an acoustic measure of pitch variability, was extracted for each participant. We compared the f0 range between groups and investigated associations with an informant-rated measure of empathy, a facial emotion labeling task, and gray matter (GM) volumes using voxel-based morphometry.

RESULTS

Twenty-eight patients with svPPA, 18 with sbvFTD, and 18 healthy controls (HCs) were included. f0 range was significantly different across groups: patients with sbvFTD showed reduced f0 range in comparison with both patients with svPPA (mean difference of -1.4 ± 2.4 semitones; 95% CI -2.4 to -0.4]; p < 0.005) and HCs (mean difference of -1.9 ± 3.0 semitones; 95% CI -3.0 to -0.7]; p < 0.001). A higher f0 range was correlated with a greater informant-rated empathy (r = 0.355; p ≤ 0.05), but not facial emotion labeling. Finally, the lower f0 range was correlated with lower GM volume in the right superior temporal gyrus, encompassing anterior and posterior portions (p < 0.05 FWE cluster corrected).

DISCUSSION

Expressive prosody may be a useful clinical marker of sbvFTD. Reduced empathy is a core symptom in sbvFTD; the present results extend this to prosody, a core component of social interaction, at the intersection of speech and emotion. They also inform the long-standing debate on the lateralization of expressive prosody in the brain, highlighting the critical role of the right superior temporal lobe.

Neural decoding of emotional prosody in voice-sensitive auditory cortex predicts social communication abilities in children

During social interactions, speakers signal information about their emotional state through their voice, which is known as emotional prosody. Little is known regarding the precise brain systems underlying emotional prosody decoding in children and whether accurate neural decoding of these vocal cues is linked to social skills. Here, we address critical gaps in the developmental literature by investigating neural representations of prosody and their links to behavior in children. Multivariate pattern analysis revealed that representations in the bilateral middle and posterior superior temporal sulcus (STS) divisions of voice-sensitive auditory cortex decode emotional prosody information in children. Crucially, emotional prosody decoding in middle STS was correlated with standardized measures of social communication abilities; more accurate decoding of prosody stimuli in the STS was predictive of greater social communication abilities in children. Moreover, social communication abilities were specifically related to decoding sadness, highlighting the importance of tuning in to negative emotional vocal cues for strengthening social responsiveness and functioning. Findings bridge an important theoretical gap by showing that the ability of the voice-sensitive cortex to detect emotional cues in speech is predictive of a child's social skills, including the ability to relate and interact with others.

Neurocognitive Dynamics of Prosodic Salience over Semantics during Explicit and Implicit Processing of Basic Emotions in Spoken Words

How language mediates emotional perception and experience is poorly understood. The present event-related potential (ERP) study examined the explicit and implicit processing of emotional speech to differentiate the relative influences of communication channel, emotion category and task type in the prosodic salience effect. Thirty participants (15 women) were presented with spoken words denoting happiness, sadness and neutrality in either the prosodic or semantic channel. They were asked to judge the emotional content (explicit task) and speakers' gender (implicit task) of the stimuli. Results indicated that emotional prosody (relative to semantics) triggered larger N100, P200 and N400 amplitudes with greater delta, theta and alpha inter-trial phase coherence (ITPC) and event-related spectral perturbation (ERSP) values in the corresponding early time windows, and continued to produce larger LPC amplitudes and faster responses during late stages of higher-order cognitive processing. The relative salience of prosodic and semantics was modulated by emotion and task, though such modulatory effects varied across different processing stages. The prosodic salience effect was reduced for sadness processing and in the implicit task during early auditory processing and decision-making but reduced for happiness processing in the explicit task during conscious emotion processing. Additionally, across-trial synchronization of delta, theta and alpha bands predicted the ERP components with higher ITPC and ERSP values significantly associated with stronger N100, P200, N400 and LPC enhancement. These findings reveal the neurocognitive dynamics of emotional speech processing with prosodic salience tied to stage-dependent emotion- and task-specific effects, which can reveal insights into understanding language and emotion processing from cross-linguistic/cultural and clinical perspectives.

Decoding lexical tones and vowels in imagined tonal monosyllables using fNIRS signals

Objective.Speech is a common way of communication. Decoding verbal intent could provide a naturalistic communication way for people with severe motor disabilities. Active brain computer interaction (BCI) speller is one of the most commonly used speech BCIs. To reduce the spelling time of Chinese words, identifying vowels and tones that are embedded in imagined Chinese words is essential. Functional near-infrared spectroscopy (fNIRS) has been widely used in BCI because it is portable, non-invasive, safe, low cost, and has a relatively high spatial resolution.Approach.In this study, an active BCI speller based on fNIRS is presented by covertly rehearsing tonal monosyllables with vowels (i.e. /a/, /i/, /o/, and /u/) and four lexical tones in Mandarin Chinese (i.e. tones 1, 2, 3, and 4) for 10 s.Main results.fNIRS results showed significant differences in the right superior temporal gyrus between imagined vowels with tone 2/3/4 and those with tone 1 (i.e. more activations and stronger connections to other brain regions for imagined vowels with tones 2/3/4 than for those with tone 1). Speech-related areas for tone imagery (i.e. the right hemisphere) provided majority of information for identifying tones, while the left hemisphere had advantages in vowel identification. Having decoded both vowels and tones during the post-stimulus 15 s period, the average classification accuracies exceeded 40% and 70% in multiclass (i.e. four classes) and binary settings, respectively. To spell words more quickly, the time window size for decoding was reduced from 15 s to 2.5 s while the classification accuracies were not significantly reduced.Significance.For the first time, this work demonstrated the possibility of discriminating lexical tones and vowels in imagined tonal syllables simultaneously. In addition, the reduced time window for decoding indicated that the spelling time of Chinese words could be significantly reduced in the fNIRS-based BCIs.

Language and developmental plasticity after perinatal stroke

The mature human brain is lateralized for language, with the left hemisphere (LH) primarily responsible for sentence processing and the right hemisphere (RH) primarily responsible for processing suprasegmental aspects of language such as vocal emotion. However, it has long been hypothesized that in early life there is plasticity for language, allowing young children to acquire language in other cortical regions when LH areas are damaged. If true, what are the constraints on functional reorganization? Which areas of the brain can acquire language, and what happens to the functions these regions ordinarily perform? We address these questions by examining long-term outcomes in adolescents and young adults who, as infants, had a perinatal arterial ischemic stroke to the LH areas ordinarily subserving sentence processing. We compared them with their healthy age-matched siblings. All participants were tested on a battery of behavioral and functional imaging tasks. While stroke participants were impaired in some nonlinguistic cognitive abilities, their processing of sentences and of vocal emotion was normal and equal to that of their healthy siblings. In almost all, these abilities have both developed in the healthy RH. Our results provide insights into the remarkable ability of the young brain to reorganize language. Reorganization is highly constrained, with sentence processing almost always in the RH frontotemporal regions homotopic to their location in the healthy brain. This activation is somewhat segregated from RH emotion processing, suggesting that the two functions perform best when each has its own neural territory.

Brain activity changes with emotional words in different stages of psychosis

BACKGROUND

To date, a large number of functional magnetic resonance imaging (fMRI) studies have been conducted on psychosis. However, little is known about changes in brain functioning in psychotic patients using an emotional auditory paradigm at different stages of the disease. Such knowledge is important for advancing our understanding of the disorder and thus creating more targeted interventions. This study aimed to investigate whether individuals with first-episode psychosis (FEP) and chronic schizophrenia show abnormal brain responses to emotional auditory processing and to compare the responses between FEP and chronic schizophrenia.

METHODS

Patients with FEP (n = 31) or chronic schizophrenia (n = 23) and healthy controls (HCs, n = 31) underwent an fMRI scan while presented with both emotional and nonemotional words.

RESULTS

Using HC as a reference, patients with FEP showed decreased right temporal activation, while patients with chronic schizophrenia showed increased bilateral temporal activation. When comparing the patient groups, individuals with FEP showed lower frontal lobe activation.

CONCLUSION

To the best of our knowledge, this is the first study with an emotional auditory paradigm used in psychotic patients at different stages of the disease. Our results suggested that the temporal lobe might be a key issue in the physiopathology of psychosis, although abnormal activation could also be derived from a connectivity problem. There is lower activation in the early stage and evolution to greater activation when patients become chronic. This study highlights the relevance of using emotional paradigms to better understand brain activation at different stages of psychosis.

Enhanced salience of musical sounds in singers and instrumentalists

Music training has been linked to facilitated processing of emotional sounds. However, most studies have focused on speech, and less is known about musicians' brain responses to other emotional sounds and in relation to instrument-specific experience. The current study combined behavioral and EEG methods to address two novel questions related to the perception of auditory emotional cues: whether and how long-term music training relates to a distinct emotional processing of nonverbal vocalizations and music; and whether distinct training profiles (vocal vs. instrumental) modulate brain responses to emotional sounds from early to late processing stages. Fifty-eight participants completed an EEG implicit emotional processing task, in which musical and vocal sounds differing in valence were presented as nontarget stimuli. After this task, participants explicitly evaluated the same sounds regarding the emotion being expressed, their valence, and arousal. Compared with nonmusicians, musicians displayed enhanced salience detection (P2), attention orienting (P3), and elaborative processing (Late Positive Potential) of musical (vs. vocal) sounds in event-related potential (ERP) data. The explicit evaluation of musical sounds also was distinct in musicians: accuracy in the emotional recognition of musical sounds was similar across valence types in musicians, who also judged musical sounds to be more pleasant and more arousing than nonmusicians. Specific profiles of music training (singers vs. instrumentalists) did not relate to differences in the processing of vocal vs. musical sounds. Together, these findings reveal that music has a privileged status in the auditory system of long-term musically trained listeners, irrespective of their instrument-specific experience.

Brain mapping of emotional prosody in patients with drug-resistant temporal epilepsy: An indicator of plasticity

INTRODUCTION

Emotional prosody, a suprasegmental component of language, is predominantly processed by right temporo-frontal areas of the cerebral cortex. In temporal lobe epilepsy (TLE), brain disturbances affecting prosody processing frequently occur. This research assesses compensatory brain mechanisms of prosody processing in refractory TLE using fMRI.

METHODS

Patients with focal unilateral epilepsy, right (RTLE) (N = 19), left (LTLE) (N = 19), and healthy controls (CTRL) (N = 20) were evaluated during a prosody decoding fMRI task. The stimuli consisted in spoken numbers with different tones of voice (joy, fear, anger, neutral and silent trials). Participants were instructed to label the emotion with a keypad. "Joy" was removed from the analysis due to a high degree of variability. A lateralization index (LI) was used to see individual differences in the interhemispheric activations of each participant.

RESULTS

Behaviorally, The LTLE and RTLE groups did not differ significantly from each other neither from CTRL. In Negative Emotions versus Baseline contrast, the whole sample analysis showed extensive activations in bilateral superior temporal gyrus, bilateral precentral and post-central gyrus, right putamen, and left cerebellar vermis. Compared to the LTLE and CTRL, RTLE activated similar areas, but to a lesser extent. The LI analysis revealed significant differences in hemispheric laterality of the temporal lobe and the parietal lobe between RTLE compared to LTLE and CTRL, being the RTLE group lateralized towards the left, unlike the other two groups.

DISCUSSION

The LI indicated that, since the CTRL and the LTLE groups recruited putative prosodic regions, the RTLE lateralized prosody processing towards the left, recruiting contralateral nodes, homotopic to the putative areas of the prosody. Considering that the groups did not differ in prosody task performance, the findings suggest that, in the RTLE group, alternative brain nodes were recruited for the task, demonstrating plasticity.

Neural correlates of perceived emotions in human insula and amygdala for auditory emotion recognition

The emotional status of a speaker is an important non-linguistic cue carried by human voice and can be perceived by a listener in vocal communication. Understanding the neural circuits involved in processing emotions carried by human voice is crucial for understanding the neural basis of social interaction. Previous studies have shown that human insula and amygdala responded more selectively to emotional sounds than non-emotional sounds. However, it is not clear whether the neural selectivity to emotional sounds in these brain structures is determined by the emotion presented by a speaker which is associated with the acoustic properties of the sounds or by the emotion perceived by a listener. In this study, we recorded intracranial electroencephalography (iEEG) responses to emotional human voices while subjects performed emotion recognition tasks. We found that the iEEG responses of Heschl's gyrus (HG) and posterior insula were determined by the presented emotion, whereas the iEEG responses of anterior insula and amygdala were driven by the perceived emotion. These results suggest that the anterior insula and amygdala play a crucial role in conscious perception of emotions carried by human voice.

Characterization of Cognitive Function in Survivors of Diffuse Gliomas Using Morphometric Correlation Networks

This pilot study investigates structural alterations and their relationships with cognitive function in survivors of diffuse gliomas. Twenty-four survivors of diffuse gliomas (mean age 44.5 ± 11.5), from whom high-resolution T1-weighted images, neuropsychological tests, and self-report questionnaires were obtained, were analyzed. Patients were grouped by degree of cognitive impairment, and interregional correlations of cortical thickness were computed to generate morphometric correlation networks (MCNs). The results show that the cortical thickness of the right insula (R² = 0.3025, p = 0.0054) was negatively associated with time since the last treatment, and the cortical thickness of the left superior temporal gyrus (R² = 0.2839, p = 0.0107) was positively associated with cognitive performance. Multiple cortical regions in the default mode, salience, and language networks were identified as predominant nodes in the MCNs of survivors of diffuse gliomas. Compared to cognitively impaired patients, cognitively non-impaired patients tended to have higher network stability in network nodes removal analysis, especially when the fraction of removed nodes (among 66 nodes in total) exceeded 55%. These findings suggest that structural networks are altered in survivors of diffuse gliomas and that their cortical structures may also be adapting to support cognitive function during survivorship.

Functional patterns of neural activation during vocal emotion recognition in youth with and without refractory epilepsy

Epilepsy has been associated with deficits in the social cognitive ability to decode others' nonverbal cues to infer their emotional intent (emotion recognition). Studies have begun to identify potential neural correlates of these deficits, but have focused primarily on one type of nonverbal cue (facial expressions) to the detriment of other crucial social signals that inform the tenor of social interactions (e.g., tone of voice). Less is known about how individuals with epilepsy process these forms of social stimuli, with a particular gap in knowledge about representation of vocal cues in the developing brain. The current study compared vocal emotion recognition skills and functional patterns of neural activation to emotional voices in youth with and without refractory focal epilepsy. We made novel use of inter-subject pattern analysis to determine brain areas in which activation to emotional voices was predictive of epilepsy status. Results indicated that youth with epilepsy were comparatively less able to infer emotional intent in vocal expressions than their typically developing peers. Activation to vocal emotional expressions in regions of the mentalizing and/or default mode network (e.g., right temporo-parietal junction, right hippocampus, right medial prefrontal cortex, among others) differentiated youth with and without epilepsy. These results are consistent with emerging evidence that pediatric epilepsy is associated with altered function in neural networks subserving social cognitive abilities. Our results contribute to ongoing efforts to understand the neural markers of social cognitive deficits in pediatric epilepsy, in order to better tailor and funnel interventions to this group of youth at risk for poor social outcomes.

Longitudinal Change in Neural Response to Vocal Emotion in Adolescence

Adolescence is associated with maturation of function within neural networks supporting the processing of social information. Previous longitudinal studies have established developmental influences on youth’s neural response to facial displays of emotion. Given the increasing recognition of the importance of non-facial cues to social communication, we build on existing work by examining longitudinal change in neural response to vocal expressions of emotion in 8- to 19-year-old youth. Participants completed a vocal emotion recognition task at two timepoints (1 year apart) while undergoing functional magnetic resonance imaging. The right inferior frontal gyrus, right dorsal striatum and right precentral gyrus showed decreases in activation to emotional voices across timepoints, which may reflect focalization of response in these areas. Activation in the dorsomedial prefrontal cortex was positively associated with age but was stable across timepoints. In addition, the slope of change across visits varied as a function of participants’ age in the right temporo-parietal junction (TPJ): this pattern of activation across timepoints and age may reflect ongoing specialization of function across childhood and adolescence. Decreased activation in the striatum and TPJ across timepoints was associated with better emotion recognition accuracy. Findings suggest that specialization of function in social cognitive networks may support the growth of vocal emotion recognition skills across adolescence.

Reduced mother-child brain-to-brain synchrony during joint storytelling interaction interrupted by a media usage

Parent-child synchrony is related to the quality of parent and child interactions and child development. One very emotionally and cognitively beneficial interaction in early childhood is Dialogic Reading (DR). Screen exposure was previously related to decreased parent-child interaction. Using a hyperscanning Electroencephalogram (EEG) method, the current study examined the neurobiological correlates for mother-child DR vs. mobile phone-interrupted DR in twenty-four white toddlers (24-42 months old, 8 girls) and their mothers. The DR-interrupted condition was related to decreased mother-child neural synchrony between the mother's language-related brain regions (left hemisphere) and the child's comprehension-related regions (right hemisphere) compared to the uninterrupted DR. This is the first neural evidence of the negative effect of parental smartphone use on parent-child interaction quality.

Deficits in emotion perception and cognition in patients with parkinson's disease: A systematic review

Non-motor symptoms (NMS) are common among Parkinson's disease (PD) patients and have a significant impact on quality of life. NMS such as deficits in emotion perception are gaining due focus in the recent times. As emotion perception and cognitive functions share certain common neural substrates, it becomes pertinent to evaluate existing emotion perception deficits in view of underlying cognitive deficits. The current systematic review aimed at examining studies on emotion perception PD in the last decade. We carried out a systematic review of 44 studies from the PubMed database. We reviewed studies examining emotion perception and associated cognitive deficits, especially executive function and visuospatial function in PD. This review also examines how early and advanced PD differ in emotion perception deficits and how the presence of common neuropsychiatric conditions such as anxiety, apathy, and depression as well as neurosurgical procedure such as deep brain stimulation affect emotion perception. The need for future research employing a comprehensive evaluation of neurocognitive functions and emotion perception is underscored as it has a significant bearing on planning holistic intervention strategies.

"Hard to Say, Hard to Understand, Hard to Live": Possible Associations between Neurologic Language Impairments and Suicide Risk

In clinical practice, patients with language impairments often exhibit suicidal ideation (SI) and suicidal behavior (SB, covering the entire range from suicide attempts, SA, to completed suicides). However, only few studies exist regarding this subject. We conducted a mini-review on the possible associations between neurologic language impairment (on the motor, comprehension, and semantic sides) and SI/SB. Based on the literature review, we hypothesized that language impairments exacerbate psychiatric comorbidities, which, in turn, aggravate language impairments. Patients trapped in this vicious cycle can develop SI/SB. The so-called “affective prosody” provides some relevant insights concerning the interaction between the different language levels and the world of emotions. This hypothesis is illustrated in a clinical presentation, consisting of the case of a 74-year old woman who was admitted to a psychiatric emergency department (ED) after a failed SA. Having suffered an ischemic stroke two years earlier, she suffered from incomplete Broca’s aphasia and dysprosody. She also presented with generalized anxiety and depressive symptoms. We observed that her language impairments were both aggravated by the exacerbations of her anxiety and depressive symptoms. In this patient, who had deficits on the motor side, these exacerbations were triggered by her inability to express herself, her emotional status, and suffering. SI was fluctuant, and—one year after the SA—she completed suicide. Further studies are needed to ascertain possible reciprocal and interacting associations between language impairments, psychiatric comorbidities, and SI/SB. They could enable clinicians to better understand their patient’s specific suffering, as brought on by language impairment, and contribute to the refining of suicide risk detection in this sub-group of affected patients.

Dysgraphia and dysprosody in a patient with arteriovenous malformation: a case report

Arteriovenous malformation (AVM) results from development of abnormal connections between veins and arteries. This study reported anAVM case suffering from dysgraphia and dysprosody. According to the results after the trauma, the patient's handwriting was identified as macrographic and illegible, and written letters and verbs were neglected in free writing or dictation. Moreover, prosody of the patient's utterances was changed. Finally, an intervention was conducted to improve the writing impairments whereby they eventually enhanced. AVM can adversely affect communication opportunities and working life due to these impairments. Thus referring the patient to speech and language pathologists seems sensible and necessary.

Emotion recognition impairments and social well-being following right-hemisphere stroke

Accurately recognizing and responding to the emotions of others is essential for proper social communication and helps bind strong relationships that are particularly important for stroke survivors. Emotion recognition typically engages cortical areas that are predominantly right-lateralized including superior temporal and inferior frontal gyri - regions frequently impacted by right-hemisphere stroke. Since prior work already links right-hemisphere stroke to deficits in emotion recognition, this research aims to extend these findings to determine whether impaired emotion recognition after right-hemisphere stroke is associated with worse social well-being outcomes. Eighteen right-hemisphere stroke patients (≥6 months post-stroke) and 21 neurologically healthy controls completed a multimodal emotion recognition test (Geneva Emotion Recognition Test - Short) and reported engagement in social/non-social activities and levels of social support. Right-hemisphere stroke was associated with worse emotion recognition accuracy, though not all patients exhibited impairment. In line with hypotheses, emotion recognition impairments were associated with greater loss of social activities after stroke, an effect that could not be attributed to stroke severity or loss of non-social activities. Impairments were also linked to reduced patient-reported social support. Results implicate emotion recognition difficulties as a potential antecedent of social withdrawal after stroke and warrant future research to test emotion recognition training post-stroke.

Asymmetry of Auditory-Motor Speech Processing is Determined by Language Experience

Speech processing relies on interactions between auditory and motor systems and is asymmetrically organized in the human brain. The left auditory system is specialized for processing of phonemes, whereas the right is specialized for processing of pitch changes in speech affecting prosody. In speakers of tonal languages, however, processing of pitch (i.e., tone) changes that alter word meaning is left-lateralized indicating that linguistic function and language experience shape speech processing asymmetries. Here, we investigated the asymmetry of motor contributions to auditory speech processing in male and female speakers of tonal and non-tonal languages. We temporarily disrupted the right or left speech motor cortex using transcranial magnetic stimulation (TMS) and measured the impact of these disruptions on auditory discrimination (mismatch negativity; MMN) responses to phoneme and tone changes in sequences of syllables using electroencephalography (EEG). We found that the effect of motor disruptions on processing of tone changes differed between language groups: disruption of the right speech motor cortex suppressed responses to tone changes in non-tonal language speakers, whereas disruption of the left speech motor cortex suppressed responses to tone changes in tonal language speakers. In non-tonal language speakers, the effects of disruption of left speech motor cortex on responses to tone changes were inconclusive. For phoneme changes, disruption of left but not right speech motor cortex suppressed responses in both language groups. We conclude that the contributions of the right and left speech motor cortex to auditory speech processing are determined by the functional roles of acoustic cues in the listener's native language.SIGNIFICANCE STATEMENT The principles underlying hemispheric asymmetries of auditory speech processing remain debated. The asymmetry of processing of speech sounds is affected by low-level acoustic cues, but also by their linguistic function. By combining transcranial magnetic stimulation (TMS) and electroencephalography (EEG), we investigated the asymmetry of motor contributions to auditory speech processing in tonal and non-tonal language speakers. We provide causal evidence that the functional role of the acoustic cues in the listener's native language affects the asymmetry of motor influences on auditory speech discrimination ability [indexed by mismatch negativity (MMN) responses]. Lateralized top-down motor influences can affect asymmetry of speech processing in the auditory system.

Mental Simulations of Phonological Representations Are Causally Linked to Silent Reading of Direct Versus Indirect Speech

Embodied theories propose that language is understood via mental simulations of sensory states related to perception and action. Given that direct speech (e.g., She says, "It's a lovely day!") is perceived to be more vivid than indirect speech (e.g., She says (that) it's a lovely day) in perception, recent research shows in silent reading that more vivid speech representations are mentally simulated for direct speech than for indirect speech. This 'simulated' speech is found to contain suprasegmental prosodic representations (e.g., speech prosody) but its phonological detail and its causal role in silent reading of direct speech remain unclear. Here in three experiments, I explored the phonological aspect and the causal role of speech simulations in silent reading of tongue twisters in direct speech, indirect speech and non-speech sentences. The results demonstrated greater visual tongue-twister effects (phonemic interference) during silent reading (Experiment 1) but not oral reading (Experiment 2) of direct speech as compared to indirect speech and non-speech. The tongue-twister effects in silent reading of direct speech were selectively disrupted by phonological interference (concurrent articulation) as compared to manual interference (finger tapping) (Experiment 3). The results replicated more vivid speech simulations in silent reading of direct speech, and additionally extended them to the phonological dimension. Crucially, they demonstrated a causal role of phonological simulations in silent reading of direct speech, at least in tongue-twister reading. The findings are discussed in relation to multidimensionality and task dependence of mental simulation and its mechanisms.

Cortical Morphological Changes in Congenital Amusia: Surface-Based Analyses

Background: Congenital amusia (CA) is a rare disorder characterized by deficits in pitch perception, and many structural and functional magnetic resonance imaging studies have been conducted to better understand its neural bases. However, a structural magnetic resonance imaging analysis using a surface-based morphology method to identify regions with cortical features abnormalities at the vertex-based level has not yet been performed. Methods: Fifteen participants with CA and 13 healthy controls underwent structural magnetic resonance imaging. A surface-based morphology method was used to identify anatomical abnormalities. Then, the surface parameters' mean value of the identified clusters with statistically significant between-group differences were extracted and compared. Finally, Pearson's correlation analysis was used to assess the correlation between the Montreal Battery of Evaluation of Amusia (MBEA) scores and surface parameters. Results: The CA group had significantly lower MBEA scores than the healthy controls (p = 0.000). The CA group exhibited a significant higher fractal dimension in the right caudal middle frontal gyrus and a lower sulcal depth in the right pars triangularis gyrus (p < 0.05; false discovery rate-corrected at the cluster level) compared to healthy controls. There were negative correlations between the mean fractal dimension values in the right caudal middle frontal gyrus and MBEA score, including the mean MBEA score (r = -0.5398, p = 0.0030), scale score (r = -0.5712, p = 0.0015), contour score (r = -0.4662, p = 0.0124), interval score (r = -0.4564, p = 0.0146), rhythmic score (r = -0.5133, p = 0.0052), meter score (r = -0.3937, p = 0.0382), and memory score (r = -0.3879, p = 0.0414). There was a significant positive correlation between the mean sulcal depth in the right pars triangularis gyrus and the MBEA score, including the mean score (r = 0.5130, p = 0.0052), scale score (r = 0.5328, p = 0.0035), interval score (r = 0.4059, p = 0.0321), rhythmic score (r = 0.5733, p = 0.0014), meter score (r = 0.5061, p = 0.0060), and memory score (r = 0.4001, p = 0.0349). Conclusion: Individuals with CA exhibit cortical morphological changes in the right hemisphere. These findings may indicate that the neural basis of speech perception and memory impairments in individuals with CA is associated with abnormalities in the right pars triangularis gyrus and middle frontal gyrus, and that these cortical abnormalities may be a neural marker of CA.

Supramodal neural networks support top-down processing of social signals

The perception of facial and vocal stimuli is driven by sensory input and cognitive top‐down influences. Important top‐down influences are attentional focus and supramodal social memory representations. The present study investigated the neural networks underlying these top‐down processes and their role in social stimulus classification. In a neuroimaging study with 45 healthy participants, we employed a social adaptation of the Implicit Association Test. Attentional focus was modified via the classification task, which compared two domains of social perception (emotion and gender), using the exactly same stimulus set. Supramodal memory representations were addressed via congruency of the target categories for the classification of auditory and visual social stimuli (voices and faces). Functional magnetic resonance imaging identified attention‐specific and supramodal networks. Emotion classification networks included bilateral anterior insula, pre‐supplementary motor area, and right inferior frontal gyrus. They were pure attention‐driven and independent from stimulus modality or congruency of the target concepts. No neural contribution of supramodal memory representations could be revealed for emotion classification. In contrast, gender classification relied on supramodal memory representations in rostral anterior cingulate and ventromedial prefrontal cortices. In summary, different domains of social perception involve different top‐down processes which take place in clearly distinguishable neural networks.

Overt speech feasibility using continuous functional magnetic resonance imaging: Isolation of areas involved in phonology and prosody

To avoid motion artifacts, almost all speech-related functional magnetic resonance imagings (fMRIs) are performed covertly to detect language activations. This method may be difficult to execute, especially by patients with brain tumors, and does not allow the identification of phonological areas. Here, we aimed to evaluate overt task feasibility. Thirty-three volunteers participated in this study. They performed two functional sessions of covert and overt generation of a short sentence semantically linked with a word. Three main contrasts were performed: Covert and Overt for the isolation of language-activated areas, and Overt > Covert for the isolation of the motor cortical activation of speech. fMRI data preprocessing was performed with and without unwarping, and with and without regression of movement parameters as confounding variables. All types of results were compared to each other. For the Overt contrast, Dice coefficients showed strong overlap between each pair of types of results: 0.98 for the pair with and without unwarping, and 0.9 for the pair with and without movement parameter regression. The Overt > Covert contrast allowed isolation of motor laryngeal activations with high statistical reliability and revealed the right-lateralized temporal activity related to acoustic feedback. Overt speaking during magnetic resonance imaging induced few artifacts and did not significantly affect the results, allowing the identification of areas involved in primary motor control and prosodic regulation of speech. Unwarping and motion artifact regression in the postprocessing step, seem to not be necessary. Changes in lateralization of cortical activity by overt speech shall be explored before using these tasks for presurgical mapping.

Brain Lateralization: A Comparative Perspective

Comparative studies on brain asymmetry date back to the 19th century but then largely disappeared due to the assumption that lateralization is uniquely human. Since the reemergence of this field in the 1970s, we learned that left-right differences of brain and behavior exist throughout the animal kingdom and pay off in terms of sensory, cognitive, and motor efficiency. Ontogenetically, lateralization starts in many species with asymmetrical expression patterns of genes within the Nodal cascade that set up the scene for later complex interactions of genetic, environmental, and epigenetic factors. These take effect during different time points of ontogeny and create asymmetries of neural networks in diverse species. As a result, depending on task demands, left- or right-hemispheric loops of feedforward or feedback projections are then activated and can temporarily dominate a neural process. In addition, asymmetries of commissural transfer can shape lateralized processes in each hemisphere. It is still unclear if interhemispheric interactions depend on an inhibition/excitation dichotomy or instead adjust the contralateral temporal neural structure to delay the other hemisphere or synchronize with it during joint action. As outlined in our review, novel animal models and approaches could be established in the last decades, and they already produced a substantial increase of knowledge. Since there is practically no realm of human perception, cognition, emotion, or action that is not affected by our lateralized neural organization, insights from these comparative studies are crucial to understand the functions and pathologies of our asymmetric brain.

Uncovering electrophysiological and vascular signatures of implicit emotional prosody

The capability of differentiating between various emotional states in speech displays a crucial prerequisite for successful social interactions. The aim of the present study was to investigate neural processes underlying this differentiating ability by applying a simultaneous neuroscientific approach in order to gain both electrophysiological (via electroencephalography, EEG) and vascular (via functional near-infrared-spectroscopy, fNIRS) responses. Pseudowords conforming to angry, happy, and neutral prosody were presented acoustically to participants using a passive listening paradigm in order to capture implicit mechanisms of emotional prosody processing. Event-related brain potentials (ERPs) revealed a larger P200 and an increased late positive potential (LPP) for happy prosody as well as larger negativities for angry and neutral prosody compared to happy prosody around 500 ms. FNIRS results showed increased activations for angry prosody at right fronto-temporal areas. Correlation between negativity in the EEG and activation in fNIRS for angry prosody suggests analogous underlying processes resembling a negativity bias. Overall, results indicate that mechanisms of emotional and phonological encoding (P200), emotional evaluation (increased negativities) as well as emotional arousal and relevance (LPP) are present during implicit processing of emotional prosody.

Brain Networks of Emotional Prosody Processing

The processing of emotional nonlinguistic information in speech is defined as emotional prosody. This auditory nonlinguistic information is essential in the decoding of social interactions and in our capacity to adapt and react adequately by taking into account contextual information. An integrated model is proposed at the functional and brain levels, encompassing 5 main systems that involve cortical and subcortical neural networks relevant for the processing of emotional prosody in its major dimensions, including perception and sound organization; related action tendencies; and associated values that integrate complex social contexts and ambiguous situations.

Prosody Dominates Over Semantics in Emotion Word Processing: Evidence From Cross-Channel and Cross-Modal Stroop Effects

Purpose Emotional speech communication involves multisensory integration of linguistic (e.g., semantic content) and paralinguistic (e.g., prosody and facial expressions) messages. Previous studies on linguistic versus paralinguistic salience effects in emotional speech processing have produced inconsistent findings. In this study, we investigated the relative perceptual saliency of emotion cues in cross-channel auditory alone task (i.e., semantics-prosody Stroop task) and cross-modal audiovisual task (i.e., semantics-prosody-face Stroop task). Method Thirty normal Chinese adults participated in two Stroop experiments with spoken emotion adjectives in Mandarin Chinese. Experiment 1 manipulated auditory pairing of emotional prosody (happy or sad) and lexical semantic content in congruent and incongruent conditions. Experiment 2 extended the protocol to cross-modal integration by introducing visual facial expression during auditory stimulus presentation. Participants were asked to judge emotional information for each test trial according to the instruction of selective attention. Results Accuracy and reaction time data indicated that, despite an increase in cognitive demand and task complexity in Experiment 2, prosody was consistently more salient than semantic content for emotion word processing and did not take precedence over facial expression. While congruent stimuli enhanced performance in both experiments, the facilitatory effect was smaller in Experiment 2. Conclusion Together, the results demonstrate the salient role of paralinguistic prosodic cues in emotion word processing and congruence facilitation effect in multisensory integration. Our study contributes tonal language data on how linguistic and paralinguistic messages converge in multisensory speech processing and lays a foundation for further exploring the brain mechanisms of cross-channel/modal emotion integration with potential clinical applications.

Determination of Differences in Seed-Based Resting State Functional Magnetic Resonance Imaging Language Networks in Pediatric Patients with Left- and Right-Lateralized Language: A Pilot Study

Background and Purpose

The current tools available for localization of expressive language, including functional magnetic resonance imaging (fMRI) and cortical stimulation mapping (CSM), require that the patient remain stationary and follow language commands with precise timing. Many pediatric epilepsy patients, however, have intact language skills but are unable to participate in these tasks due to cognitive impairments or young age. In adult subjects, there is evidence that language laterality can be determined by resting state (RS) fMRI activity, however there are few studies on the use of RS to accurately predict language laterality in children.

Methods

A retrospective review of pediatric patients at Texas Children's Hospital was performed to identify patients who have undergone epilepsy surgical planning over 3 years with language localization using traditional methods of Wada testing, CSM, or task-based fMRI with calculated laterality index, as well as a 7-minute RS scan available without excessive motion or noise. We found the correlation between each subject's left and right Broca's region activity and each of 68 cortical regions.

Results

A group of nine patients with left-lateralized language were found to have greater voxel-wise correlations than a group of six patients with right-lateralized language between a left hemispheric Broca's region seed and the following six cortical regions: left inferior temporal, left lateral orbitofrontal, left pars triangularis, right lateral orbitofrontal, right pars orbitalis and right superior frontal regions.

Conclusions

In a cohort of children with epilepsy, we found that patients with left- and right-hemispheric language lateralization have different RS networks.

What you say versus how you say it: Comparing sentence comprehension and emotional prosody processing using fMRI

While language processing is often described as lateralized to the left hemisphere (LH), the processing of emotion carried by vocal intonation is typically attributed to the right hemisphere (RH) and more specifically, to areas mirroring the LH language areas. However, the evidence base for this hypothesis is inconsistent, with some studies supporting right-lateralization but others favoring bilateral involvement in emotional prosody processing. Here we compared fMRI activations for an emotional prosody task with those for a sentence comprehension task in 20 neurologically healthy adults, quantifying lateralization using a lateralization index. We observed right-lateralized frontotemporal activations for emotional prosody that roughly mirrored the left-lateralized activations for sentence comprehension. In addition, emotional prosody also evoked bilateral activation in pars orbitalis (BA47), amygdala, and anterior insula. These findings are consistent with the idea that analysis of the auditory speech signal is split between the hemispheres, possibly according to their preferred temporal resolution, with the left preferentially encoding phonetic and the right encoding prosodic information. Once processed, emotional prosody information is fed to domain-general emotion processing areas and integrated with semantic information, resulting in additional bilateral activations.

Deep Brain Stimulation of the Subthalamic Nucleus Influences Facial Emotion Recognition in Patients With Parkinson's Disease: A Review

Parkinson’s disease (PD) is a neurodegenerative disorder characterized by motor symptoms following dopaminergic depletion in the substantia nigra. Besides motor impairments, however, several non-motor detriments can have the potential to considerably impact subjectively perceived quality of life in patients. Particularly emotion recognition of facial expressions has been shown to be affected in PD, and especially the perception of negative emotions like fear, anger, or disgust is impaired. While emotion processing generally refers to automatic implicit as well as conscious explicit processing, the focus of most previous studies in PD was on explicit recognition of emotions only, while largely ignoring implicit processing deficits. Deep brain stimulation of the subthalamic nucleus (STN-DBS) is widely accepted as a therapeutic measure in the treatment of PD and has been shown to advantageously influence motor problems. Among various concomitant non-motor effects of STN-DBS, modulation of facial emotion recognition under subthalamic stimulation has been investigated in previous studies with rather heterogeneous results. Although there seems to be a consensus regarding the processing of disgust, which significantly deteriorates under STN stimulation, findings concerning emotions like fear or happiness report heterogeneous data and seem to depend on various experimental settings and measurements. In the present review, we summarized previous investigations focusing on STN-DBS influence on recognition of facial emotional expressions in patients suffering from PD. In a first step, we provide a synopsis of disturbances and problems in facial emotion processing observed in patients with PD. Second, we present findings of STN-DBS influence on facial emotion recognition and especially highlight different impacts of stimulation on implicit and explicit emotional processing.

Age-related differences in neural activation and functional connectivity during the processing of vocal prosody in adolescence

The ability to recognize others' emotions based on vocal emotional prosody follows a protracted developmental trajectory during adolescence. However, little is known about the neural mechanisms supporting this maturation. The current study investigated age-related differences in neural activation during a vocal emotion recognition (ER) task. Listeners aged 8 to 19 years old completed the vocal ER task while undergoing functional magnetic resonance imaging. The task of categorizing vocal emotional prosody elicited activation primarily in temporal and frontal areas. Age was associated with a) greater activation in regions in the superior, middle, and inferior frontal gyri, b) greater functional connectivity between the left precentral and inferior frontal gyri and regions in the bilateral insula and temporo-parietal junction, and c) greater fractional anisotropy in the superior longitudinal fasciculus, which connects frontal areas to posterior temporo-parietal regions. Many of these age-related differences in brain activation and connectivity were associated with better performance on the ER task. Increased activation in, and connectivity between, areas typically involved in language processing and social cognition may facilitate the development of vocal ER skills in adolescence.

Neural architectures of music - Insights from acquired amusia

The ability to perceive and produce music is a quintessential element of human life, present in all known cultures. Modern functional neuroimaging has revealed that music listening activates a large-scale bilateral network of cortical and subcortical regions in the healthy brain. Even the most accurate structural studies do not reveal which brain areas are critical and causally linked to music processing. Such questions may be answered by analysing the effects of focal brain lesions in patients´ ability to perceive music. In this sense, acquired amusia after stroke provides a unique opportunity to investigate the neural architectures crucial for normal music processing. Based on the first large-scale longitudinal studies on stroke-induced amusia using modern multi-modal magnetic resonance imaging (MRI) techniques, such as advanced lesion-symptom mapping, grey and white matter morphometry, tractography and functional connectivity, we discuss neural structures critical for music processing, consider music processing in light of the dual-stream model in the right hemisphere, and propose a neural model for acquired amusia.

Cognitive and neural mechanisms underlying the mnemonic effect of songs after stroke

Sung melody provides a mnemonic cue that can enhance the acquisition of novel verbal material in healthy subjects. Recent evidence suggests that also stroke patients, especially those with mild aphasia, can learn and recall novel narrative stories better when they are presented in sung than spoken format. Extending this finding, the present study explored the cognitive mechanisms underlying this effect by determining whether learning and recall of novel sung vs. spoken stories show a differential pattern of serial position effects (SPEs) and chunking effects in non-aphasic and aphasic stroke patients (N = 31) studied 6 months post-stroke. The structural neural correlates of these effects were also explored using voxel-based morphometry (VBM) and deterministic tractography (DT) analyses of structural MRI data. Non-aphasic patients showed more stable recall with reduced SPEs in the sung than spoken task, which was coupled with greater volume and integrity (indicated by fractional anisotropy, FA) of the left arcuate fasciculus. In contrast, compared to non-aphasic patients, the aphasic patients showed a larger recency effect (better recall of the last vs. middle part of the story) and enhanced chunking (larger units of correctly recalled consecutive items) in the sung than spoken task. In aphasics, the enhanced chunking and better recall on the middle verse in the sung vs. spoken task correlated also with better ability to perceive emotional prosody in speech. Neurally, the sung > spoken recency effect in aphasic patients was coupled with greater grey matter volume in a bilateral network of temporal, frontal, and parietal regions and also greater volume of the right inferior fronto-occipital fasciculus (IFOF). These results provide novel cognitive and neurobiological insight on how a repetitive sung melody can function as a verbal mnemonic aid after stroke.

•

Non-aphasic stroke patients show more stable recall of sung than spoken stories.

•

Aphasic patients show larger recency and chunking effects to sung vs. spoken stories.

•

The left dorsal pathway mediates better recall of sung stories in non-aphasics.

•

The right ventral pathway mediates better recall of sung stories in aphasics.

•

Large-scale bilateral cortical networks are linked to musical mnemonics in aphasia.

Emotional prosody Stroop effect in Hindi: An event related potential study

Prosody processing is an important aspect of language comprehension. Previous research on emotional word-prosody conflict has shown that participants are worse when emotional prosody and word meaning are incongruent. Studies with event-related potentials have shown a congruency effect in N400 component. There has been no study on emotional processing in Hindi language in the context of conflict between emotional word meaning and prosody. We used happy and angry words spoken using happy and angry prosody. Participants had to identify whether the word had a happy or angry word meaning. The results showed a congruency effect with worse performance in incongruent trials indicating an emotional Stroop effect in Hindi. The ERP results showed that prosody information is detected very early, which can be seen in the N1 component. In addition, there was a congruency effect in N400. The results show that prosody is processed very early and emotional meaning-prosody congruency effect is obtained with Hindi. Further studies would be needed to investigate similarities and differences in cognitive control associated with language processing.

Tuned to voices and faces: Cerebral responses linked to social anxiety

Voices and faces are the most common sources of threat in social anxiety (SA) where the fear of negative evaluation and social exclusion is the central element. SA itself is spectrally distributed among the general population and its clinical manifestation, termed social anxiety disorder, is one of the most common anxiety disorders. While heightened cerebral responses to angry or contemptuous facial or vocal expressions are well documented, it remains unclear if the brain of socially anxious individuals is generally more sensitive to voices and faces. Using functional magnetic resonance imaging, we investigated how SA affects the cerebral processing of voices and faces as compared to various other stimulus types in a study population with greatly varying SA (N = 50, 26 female). While cerebral voice-sensitivity correlated positively with SA in the left temporal voice area (TVA) and the left amygdala, an association of face-sensitivity and SA was observed in the right fusiform face area (FFA) and the face processing area of the right posterior superior temporal sulcus (pSTSFA). These results demonstrate that the increase of cerebral responses associated with social anxiety is not limited to facial or vocal expressions of social threat but that the respective sensory and emotion processing structures are also generally tuned to voices and faces.

Hierarchical deficits in auditory information processing in schizophrenia

Deficits in auditory processing contribute significantly to impaired functional outcome in schizophrenia (SZ), but mediating factors remain under investigation. Here we evaluated two hierarchical components of early auditory processing: pitch-change detection (i.e. identifying if 2 tones have "same" or "different" pitch), which is preferentially associated with early auditory cortex, and serial pitch-pattern detection (i.e. identifying if 3 tones have "same" or "different" pitch, and, if "different", which one differed from the others), which depends also on auditory association regions. Deficits in pitch-change detection deficits in SZ have been widely reported and correlated with higher auditory disturbances such as Auditory Emotion Recognition (AER). Deficits in serial pitch-pattern discrimination have been less studied. Here, we investigated both pitch perception components, along with integrity of AER in SZ patients vs. controls using behavioral paradigms. We hypothesized that the deficits could be viewed as hierarchically organized in SZ, with deficits in low-level function propagating sequentially through subsequent levels of processing. Participants included 27 SZ and 40 controls. The magnitude of the deficits in SZ participants was large in both the pitch-change (d = 1.15) and serial pitch-pattern tasks (d = 1.21) with no significant differential task effect. The effect size of the AER deficits was extremely large (d = 2.82). In the SZ group, performance in both pitch tasks correlated significantly with impaired AER performance. However, a mediation analysis showed that serial pitch-pattern detection mediated the relationship between simpler pitch-change detection and AER in patients. Findings are consistent with hierarchical models of cognitive dysfunction in SZ with deficits in early information processing contributing to higher level impairments. Furthermore, findings are consistent with recent neurophysiological results suggesting similar level impairments for processing of simple vs. more complex tonal dysfunction in SZ.

Altered attentional processing of happy prosody in schizophrenia

BACKGROUND

Abnormalities in emotional prosody processing have been consistently reported in schizophrenia. Emotionally salient changes in vocal expressions attract attention in social interactions. However, it remains to be clarified how attention and emotion interact during voice processing in schizophrenia. The current study addressed this question by examining the P3b event-related potential (ERP) component.

METHOD

The P3b was elicited with a modified oddball task, in which frequent (p = .84) neutral stimuli were intermixed with infrequent (p = .16) task-relevant emotional (happy or angry) targets. Prosodic speech was presented in two conditions - with intelligible (semantic content condition - SCC) or unintelligible semantic content (prosody-only condition - POC). Fifteen chronic schizophrenia patients and 15 healthy controls were instructed to silently count the target vocal sounds.

RESULTS

Compared to controls, P3b amplitude was specifically reduced for happy prosodic stimuli in schizophrenia, irrespective of semantic status. Groups did not differ in the processing of neutral standards or angry targets.

DISCUSSION

The selectively reduced P3b for happy prosody in schizophrenia suggests top-down attentional resources were less strongly engaged by positive relative to negative prosody, reflecting alterations in the evaluation of the emotional salience of the voice. These results highlight the role played by higher-order processes in emotional prosody dysfunction in schizophrenia.

Near-infrared spectroscopy reveals neural perception of vocal emotions in human neonates

Processing affective prosody, that is the emotional tone of a speaker, is fundamental to human communication and adaptive behaviors. Previous studies have mainly focused on adults and infants; thus the neural mechanisms underlying the processing of affective prosody in newborns remain unclear. Here, we used near-infrared spectroscopy to examine the ability of 0-to-4-day-old neonates to discriminate emotions conveyed by speech prosody in their maternal language and a foreign language. Happy, fearful, and angry prosodies enhanced neural activation in the right superior temporal gyrus relative to neutral prosody in the maternal but not the foreign language. Happy prosody elicited greater activation than negative prosody in the left superior frontal gyrus and the left angular gyrus, regions that have not been associated with affective prosody processing in infants or adults. These findings suggest that sensitivity to affective prosody is formed through prenatal exposure to vocal stimuli of the maternal language. Furthermore, the sensitive neural correlates appeared more distributed in neonates than infants, indicating a high-level of neural specialization between the neonatal stage and early infancy. Finally, neonates showed preferential neural responses to positive over negative prosody, which is contrary to the "negativity bias" phenomenon established in adult and infant studies.

Young children's neural processing of their mother's voice: An fMRI study

In addition to semantic content, human speech carries paralinguistic information that conveys important social cues such as a speaker's identity. For young children, their own mothers' voice is one of the most salient vocal inputs in their daily environment. Indeed, qualities of mothers' voices are shown to contribute to children's social development. Our knowledge of how the mother's voice is processed at the neural level, however, is limited. This study investigated whether the voice of a mother modulates activation in the network of regions activated by the human voice in young children differently than the voice of an unfamiliar mother. We collected fMRI data from 32 typically developing 7- and 8-year-olds as they listened to natural speech produced by their mother and another child's mother. We used emotionally-varied natural speech stimuli to approximate the range of children's day-to-day experience. We individually-defined functional ROIs in children's voice-sensitive neural network and then independently investigated the extent to which activation in these regions is modulated by speaker identity. The bilateral posterior auditory cortex, superior temporal gyrus (STG), and inferior frontal gyrus (IFG) exhibit enhanced activation in response to the voice of one's own mother versus that of an unfamiliar mother. The findings indicate that children process the voice of their own mother uniquely, and pave the way for future studies of how social information processing contributes to the trajectory of child social development.

Is the voice an auditory face? An ALE meta-analysis comparing vocal and facial emotion processing

This meta-analysis compares the brain structures and mechanisms involved in facial and vocal emotion recognition. Neuroimaging studies contrasting emotional with neutral (face: N = 76, voice: N = 34) and explicit with implicit emotion processing (face: N = 27, voice: N = 20) were collected to shed light on stimulus and goal-driven mechanisms, respectively. Activation likelihood estimations were conducted on the full data sets for the separate modalities and on reduced, modality-matched data sets for modality comparison. Stimulus-driven emotion processing engaged large networks with significant modality differences in the superior temporal (voice-specific) and the medial temporal (face-specific) cortex. Goal-driven processing was associated with only a small cluster in the dorsomedial prefrontal cortex for voices but not faces. Neither stimulus- nor goal-driven processing showed significant modality overlap. Together, these findings suggest that stimulus-driven processes shape activity in the social brain more powerfully than goal-driven processes in both the visual and the auditory domains. Yet, whereas faces emphasize subcortical emotional and mnemonic mechanisms, voices emphasize cortical mechanisms associated with perception and effortful stimulus evaluation (e.g. via subvocalization). These differences may be due to sensory stimulus properties and highlight the need for a modality-specific perspective when modeling emotion processing in the brain.

Validated automatic speech biomarkers in primary progressive aphasia

Objective

To automatically extract and quantify specific disease biomarkers of prosody from the acoustic properties of speech in patients with primary progressive aphasia.

Methods

We analyzed speech samples from 59 progressive aphasic patients (non‐fluent/agrammatic = 15, semantic = 21, logopenic = 23; ages 50–85 years) and 31 matched healthy controls (ages 54–89 years). Using a novel, automated speech analysis protocol, we extracted acoustic measurements of prosody, including fundamental frequency and speech and silent pause durations, and compared these between groups. We then examined their relationships with clinical tests, gray matter atrophy, and cerebrospinal fluid analytes.

Results

We found a narrowed range of fundamental frequency in patients with non‐fluent/agrammatic variant aphasia (mean 3.86 ± 1.15 semitones) compared with healthy controls (6.06 ± 1.95 semitones; P < 0.001) and patients with semantic variant aphasia (6.12 ± 1.77 semitones; P = 0.001). Mean pause rate was significantly increased in the non‐fluent/agrammatic group (mean 61.4 ± 20.8 pauses per minute) and the logopenic group (58.7 ± 16.4 pauses per minute) compared to controls. In an exploratory analysis, narrowed fundamental frequency range was associated with atrophy in the left inferior frontal cortex. Cerebrospinal level of phosphorylated tau was associated with an acoustic classifier combining fundamental frequency range and pause rate (r = 0.58, P = 0.007). Receiver operating characteristic analysis with this combined classifier distinguished non‐fluent/agrammatic speakers from healthy controls (AUC = 0.94) and from semantic variant patients (AUC = 0.86).

Interpretation

Restricted fundamental frequency range and increased pause rate are characteristic markers of speech in non‐fluent/agrammatic primary progressive aphasia. These can be extracted with automated speech analysis and are associated with left inferior frontal atrophy and cerebrospinal phosphorylated tau level.

Hugs and kisses - The role of motor preferences and emotional lateralization for hemispheric asymmetries in human social touch

Social touch is an important aspect of human social interaction - across all cultures, humans engage in kissing, cradling and embracing. These behaviors are necessarily asymmetric, but the factors that determine their lateralization are not well-understood. Because the hands are often involved in social touch, motor preferences may give rise to asymmetric behavior. However, social touch often occurs in emotional contexts, suggesting that biases might be modulated by asymmetries in emotional processing. Social touch may therefore provide unique insights into lateralized brain networks that link emotion and action. Here, we review the literature on lateralization of cradling, kissing and embracing with respect to motor and emotive bias theories. Lateral biases in all three forms of social touch are influenced, but not fully determined by handedness. Thus, motor bias theory partly explains side biases in social touch. However, emotional context also affects side biases, most strongly for embracing. Taken together, literature analysis reveals that side biases in social touch are most likely determined by a combination of motor and emotive biases.

The P300 component decreases in a bimodal oddball task in individuals with depression: An event-related potentials study

OBJECTIVE

In this study, we investigated auditory-visual stimulation-induced P300 and examined whether P300 was differentially modulated between individuals with clinical depression and healthy controls. We hypothesized that the P300 component would significantly differ between individuals with depression and healthy individuals Specifically, we predicted that the P300 component induced by the bimodal oddball task would be significantly different from that induced by the unimodal task.

METHODS

Forty-five individuals with depression and forty-five healthy controls participated in this study. All participants were instructed to complete three oddball tasks-auditory (A), visual (V), and bimodal (AV)-while their electroencephalographic signals were recorded.

RESULTS

Individuals with depression had a lower P300 amplitude and a longer latency than controls in the bimodal task. P300 amplitudes in the bimodal task were significantly higher than in the auditory or visual tasks in both groups. In the depression group, the P300 amplitude was negatively correlated with Hamilton Depression Rating Scale (HAM-D) scores in the bimodal task.

CONCLUSIONS

Our results, which agree with those reported previously, suggest that there is a heightened P300 amplitude sensitivity in the bimodal task in individuals with depression. Our data also suggest that P300 amplitudes in the bimodal task may reflect the severity of depression.

SIGNIFICANCE

The reduced task-related ERP response in individuals with depression suggests significant impairments in these individuals in stimulus integration and response functions.