1
|
Kao C, Zhang Y. Detecting Emotional Prosody in Real Words: Electrophysiological Evidence From a Modified Multifeature Oddball Paradigm. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2023; 66:2988-2998. [PMID: 37379567 DOI: 10.1044/2023_jslhr-22-00652] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/30/2023]
Abstract
PURPOSE Emotional voice conveys important social cues that demand listeners' attention and timely processing. This event-related potential study investigated the feasibility of a multifeature oddball paradigm to examine adult listeners' neural responses to detecting emotional prosody changes in nonrepeating naturally spoken words. METHOD Thirty-three adult listeners completed the experiment by passively listening to the words in neutral and three alternating emotions while watching a silent movie. Previous research documented preattentive change-detection electrophysiological responses (e.g., mismatch negativity [MMN], P3a) to emotions carried by fixed syllables or words. Given that the MMN and P3a have also been shown to reflect extraction of abstract regularities over repetitive acoustic patterns, this study employed a multifeature oddball paradigm to compare listeners' MMN and P3a to emotional prosody change from neutral to angry, happy, and sad emotions delivered with hundreds of nonrepeating words in a single recording session. RESULTS Both MMN and P3a were successfully elicited by the emotional prosodic change over the varying linguistic context. Angry prosody elicited the strongest MMN compared with happy and sad prosodies. Happy prosody elicited the strongest P3a in the centro-frontal electrodes, and angry prosody elicited the smallest P3a. CONCLUSIONS The results demonstrated that listeners were able to extract the acoustic patterns for each emotional prosody category over constantly changing spoken words. The findings confirm the feasibility of the multifeature oddball paradigm in investigating emotional speech processing beyond simple acoustic change detection, which may potentially be applied to pediatric and clinical populations.
Collapse
Affiliation(s)
- Chieh Kao
- Department of Speech-Language-Hearing Sciences, University of Minnesota, Twin Cities
- Center for Cognitive Sciences, University of Minnesota, Twin Cities
| | - Yang Zhang
- Department of Speech-Language-Hearing Sciences, University of Minnesota, Twin Cities
- Masonic Institute for the Developing Brain, University of Minnesota, Twin Cities
| |
Collapse
|
2
|
Tang E, Zhang M, Chen Y, Lin Y, Ding H. Recognition of affective prosody in bipolar and depressive conditions: A systematic review and meta-analysis. J Affect Disord 2022; 313:126-136. [PMID: 35780961 DOI: 10.1016/j.jad.2022.06.065] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/08/2021] [Revised: 05/16/2022] [Accepted: 06/23/2022] [Indexed: 11/20/2022]
Abstract
BACKGROUND Inconsistent results have been reported about the affective prosody recognition (APR) ability in patients with bipolar (BD) and depressive (DD) disorders. We aimed to (i) evaluate the magnitude of APR dysfunction in BD and DD patients, (ii) identify moderators for heterogeneous results, and (iii) highlight research trends in this field. METHODS A computerized literature search was conducted in five electronic databases from the inception to May 9th, 2022 to identify behavioural experiments that studied APR in BD or DD patients. Effect sizes were calculated using a random-effect model and recalculated after removing outliers and adjusting publication bias. RESULTS Twelve eligible articles totalling 16 studies were included in the meta-analysis, aggregating 612 patients and 809 healthy controls. Individual r2 ranged from 0.008 to 0.355, six of which reached a medium-to-large association strength. A medium-to-large pooled effect size (Hedges g = -0.58, 95 % CI -0.75 to -0.40, p < 0.001) for overall APR impairment in BD and DD patients was obtained. The Beck Depression Inventory score and answer option number were significant moderators. Neuropsychological mechanisms, multi-modal interaction and comorbidity effects have become primary research concerns. LIMITATIONS Extant statistics were insufficient for disorder-specific analysis. CONCLUSIONS Current findings demonstrate deficits of overall APR in BD and DD patients at a medium-to-large magnitude. APR can clinically serve for early screening and prognosis, but the depression severity, task complexity and confounding variables influence patients' APR performance. Future studies should incorporate neuroimaging approaches and investigate the effects of tonal language stimuli and clinical interventions.
Collapse
Affiliation(s)
- Enze Tang
- Speech-Language-Hearing Center, School of Foreign Languages, Shanghai Jiao Tong University, China
| | - Minyue Zhang
- Speech-Language-Hearing Center, School of Foreign Languages, Shanghai Jiao Tong University, China
| | - Yu Chen
- Speech-Language-Hearing Center, School of Foreign Languages, Shanghai Jiao Tong University, China
| | - Yi Lin
- Speech-Language-Hearing Center, School of Foreign Languages, Shanghai Jiao Tong University, China
| | - Hongwei Ding
- Speech-Language-Hearing Center, School of Foreign Languages, Shanghai Jiao Tong University, China.
| |
Collapse
|
3
|
Raggi A, Lanza G, Ferri R. Auditory mismatch negativity in bipolar disorder: a focused review. Rev Neurosci 2022; 33:17-30. [PMID: 33837681 DOI: 10.1515/revneuro-2021-0010] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2021] [Accepted: 03/22/2021] [Indexed: 02/07/2023]
Abstract
The auditory mismatch negativity, a component of the event-related potential elicited by an unexpected stimulus in a sequence of acoustic stimuli, provides an objective measure of the accuracy of the echoic information processing of the human brain in vivo. Auditory mismatch negativity is also a useful probe of cortical glutamatergic N-methyl-d-aspartate receptor activity and disturbance. Notably, auditory mismatch negativity is consistently impaired in schizophrenia. Because of the wide spectrum extending from bipolar affective illness and schizoaffective psychosis to typical schizophrenia, we examined the literature on auditory mismatch negativity in bipolar disorder with the aim to find any neurophysiological dysfunction concerning pre-attentive information processing shared by these clinical conditions. This focused review includes 26 original articles published in peer-reviewed journals and indexed in the National Institutes of Health National Library of Medicine (PubMed) search system. Overall, evidence is consistent with the finding that auditory mismatch negativity is impaired in bipolar disorder with psychotic features, even though to a lesser extent than in schizophrenia. It must be acknowledged that, in a few twin and family studies, mismatch negativity abnormalities were not specifically associated with bipolar disorder. In conclusion, auditory mismatch negativity research supports the involvement of the N-methyl-d-aspartate system in the pathophysiology of bipolar disorder, as previously assessed for schizophrenia, thus creating an intriguing trait d'union between these two mental illnesses and stimulating the development of novel therapeutic agents. With additional replication and validation, auditory mismatch negativity may be further considered as a correlate of a common psychopathology of schizophrenia and bipolar spectrum illnesses.
Collapse
Affiliation(s)
- Alberto Raggi
- Unit of Neurology, G.B. Morgagni - L. Pierantoni Hospital, Via Carlo Forlanini 34, 47121 Forlì, Italy
| | - Giuseppe Lanza
- Department of Surgery and Medical-Surgical Specialties, University of Catania, Via Santa Sofia 78, 95123 Catania, Italy
- Department of Neurology IC, Oasi Research Institute-IRCCS, Via Conte Ruggero 73, 94018 Troina, Italy
| | - Raffaele Ferri
- Department of Neurology IC, Oasi Research Institute-IRCCS, Via Conte Ruggero 73, 94018 Troina, Italy
| |
Collapse
|
4
|
Duville MM, Alonso-Valerdi LM, Ibarra-Zarate DI. Electroencephalographic Correlate of Mexican Spanish Emotional Speech Processing in Autism Spectrum Disorder: To a Social Story and Robot-Based Intervention. Front Hum Neurosci 2021; 15:626146. [PMID: 33716696 PMCID: PMC7952538 DOI: 10.3389/fnhum.2021.626146] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2020] [Accepted: 02/08/2021] [Indexed: 12/04/2022] Open
Abstract
Socio-emotional impairments are key symptoms of Autism Spectrum Disorders. This work proposes to analyze the neuronal activity related to the discrimination of emotional prosodies in autistic children (aged 9 to 11-year-old) as follows. Firstly, a database for single words uttered in Mexican Spanish by males, females, and children will be created. Then, optimal acoustic features for emotion characterization will be extracted, followed of a cubic kernel function Support Vector Machine (SVM) in order to validate the speech corpus. As a result, human-specific acoustic properties of emotional voice signals will be identified. Secondly, those identified acoustic properties will be modified to synthesize the recorded human emotional voices. Thirdly, both human and synthesized utterances will be used to study the electroencephalographic correlate of affective prosody processing in typically developed and autistic children. Finally, and on the basis of the outcomes, synthesized voice-enhanced environments will be created to develop an intervention based on social-robot and Social StoryTM for autistic children to improve affective prosodies discrimination. This protocol has been registered at BioMed Central under the following number: ISRCTN18117434.
Collapse
Affiliation(s)
- Mathilde Marie Duville
- Neuroengineering and Neuroacoustics Research Group, Tecnologico de Monterrey, Escuela de Ingeniería y Ciencias, Monterrey, Mexico
| | - Luz Maria Alonso-Valerdi
- Neuroengineering and Neuroacoustics Research Group, Tecnologico de Monterrey, Escuela de Ingeniería y Ciencias, Monterrey, Mexico
| | - David I Ibarra-Zarate
- Neuroengineering and Neuroacoustics Research Group, Tecnologico de Monterrey, Escuela de Ingeniería y Ciencias, Monterrey, Mexico
| |
Collapse
|
5
|
Daus H, Bloecher T, Egeler R, De Klerk R, Stork W, Backenstrass M. Development of an Emotion-Sensitive mHealth Approach for Mood-State Recognition in Bipolar Disorder. JMIR Ment Health 2020; 7:e14267. [PMID: 32618577 PMCID: PMC7367525 DOI: 10.2196/14267] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/05/2019] [Revised: 11/30/2019] [Accepted: 01/26/2020] [Indexed: 01/16/2023] Open
Abstract
Internet- and mobile-based approaches have become increasingly significant to psychological research in the field of bipolar disorders. While research suggests that emotional aspects of bipolar disorders are substantially related to the social and global functioning or the suicidality of patients, these aspects have so far not sufficiently been considered within the context of mobile-based disease management approaches. As a multiprofessional research team, we have developed a new and emotion-sensitive assistance system, which we have adapted to the needs of patients with bipolar disorder. Next to the analysis of self-assessments, third-party assessments, and sensor data, the new assistance system analyzes audio and video data of these patients regarding their emotional content or the presence of emotional cues. In this viewpoint, we describe the theoretical and technological basis of our emotion-sensitive approach and do not present empirical data or a proof of concept. To our knowledge, the new assistance system incorporates the first mobile-based approach to analyze emotional expressions of patients with bipolar disorder. As a next step, the validity and feasibility of our emotion-sensitive approach must be evaluated. In the future, it might benefit diagnostic, prognostic, or even therapeutic purposes and complement existing systems with the help of new and intuitive interaction models.
Collapse
Affiliation(s)
- Henning Daus
- Institute of Clinical Psychology, Centre for Mental Health, Klinikum Stuttgart, Stuttgart, Germany.,Faculty of Science, Eberhard-Karls-University Tübingen, Tübingen, Germany
| | - Timon Bloecher
- Embedded Systems and Sensors Engineering, Research Center for Information Technology, Karlsruhe, Germany
| | | | | | - Wilhelm Stork
- Institute for Information Processing Technologies, Karlsruhe Institute of Technology, Karlsruhe, Germany
| | - Matthias Backenstrass
- Institute of Clinical Psychology, Centre for Mental Health, Klinikum Stuttgart, Stuttgart, Germany.,Department of Clinical Psychology and Psychotherapy, Institute of Psychology, Ruprecht-Karls-University Heidelberg, Heidelberg, Germany
| |
Collapse
|
6
|
Videman M, Stjerna S, Wikström V, Nybo T, Roivainen R, Vanhatalo S, Huotilainen M, Gaily E. Prenatal exposure to antiepileptic drugs and early processing of emotionally relevant sounds. Epilepsy Behav 2019; 100:106503. [PMID: 31525552 DOI: 10.1016/j.yebeh.2019.106503] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/10/2019] [Revised: 08/10/2019] [Accepted: 08/14/2019] [Indexed: 10/26/2022]
Abstract
INTRODUCTION Prenatal exposure to antiepileptic drugs (AEDs) is associated with developmental compromises in verbal intelligence and social skills in childhood. Our aim was to evaluate whether a multifeature Mismatch Negativity (MMN) paradigm assessing semantic and emotional components of linguistic and emotional processing would be useful to detect possible alterations in early auditory processing of newborns with prenatal AED exposure. MATERIAL AND METHODS Data on AED exposure, pregnancy outcome, neuropsychological evaluation of the mothers, information on maternal epilepsy type, and a structured neurological examination of the newborn were collected prospectively. Blinded to AED exposure, we compared a cohort of 36 AED-exposed with 46 control newborns at the age of two weeks by measuring MMN with a multifeature paradigm with six linguistically relevant deviant sounds and three emotionally uttered sounds. RESULTS Frontal responses for the emotionally uttered stimulus Happy differed significantly in the exposed newborns compared with the control newborns. In addition, responses to sounds with or without emotional component differed in newborns exposed to multiple AEDs compared with control newborns or to newborns exposed to only one AED. CONCLUSIONS These preliminary findings suggest that prenatal AED exposure may alter early processing of emotionally and linguistically relevant sound information.
Collapse
Affiliation(s)
- Mari Videman
- Department of Pediatric Neurology, New Children's Hospital, University of Helsinki and Helsinki University Hospital, Finland.
| | - Susanna Stjerna
- Department of Children's Clinical Neurophysiology, HUS Medical Imaging Center and New Children's Hospital, Helsinki University Hospital and University of Helsinki, Finland
| | - Valtteri Wikström
- Cognitive Brain Research Unit, Department of Psychology and Logopedics, Faculty of Medicine, University of Helsinki, Finland
| | - Taina Nybo
- Clinical Neurosciences, University of Helsinki and Helsinki University Hospital, Finland
| | - Reina Roivainen
- Clinical Neurosciences, University of Helsinki and Helsinki University Hospital, Finland
| | - Sampsa Vanhatalo
- Department of Children's Clinical Neurophysiology, HUS Medical Imaging Center and New Children's Hospital, Helsinki University Hospital and University of Helsinki, Finland
| | - Minna Huotilainen
- Cognitive Brain Research Unit, Department of Psychology and Logopedics, Faculty of Medicine, University of Helsinki, Finland; CICERO Learning Network, Faculty of Educational Sciences, University of Helsinki, Finland; FinnBrain Birth Cohort Study, Turku Brain and Mind Center, Institute of Clinical Medicine, University of Turku, Finland
| | - Eija Gaily
- Department of Pediatric Neurology, New Children's Hospital, University of Helsinki and Helsinki University Hospital, Finland
| |
Collapse
|
7
|
Auditory mismatch detection, distraction, and attentional reorientation (MMN-P3a-RON) in neurological and psychiatric disorders: A review. Int J Psychophysiol 2019; 146:85-100. [PMID: 31654696 DOI: 10.1016/j.ijpsycho.2019.09.010] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2019] [Revised: 09/26/2019] [Accepted: 09/27/2019] [Indexed: 12/14/2022]
Abstract
Involuntary attention allows for the detection and processing of novel and potentially relevant stimuli that lie outside of cognitive focus. These processes comprise change detection in sensory contexts, automatic orientation toward this change, and the selection of adaptive responses, including reorientation to the original goal in cases when the detected change is not relevant for task demands. These processes have been studied using the Event-Related Potential (ERP) technique and have been associated to the Mismatch Negativity (MMN), the P3a, and the Reorienting Negativity (RON) electrophysiological components, respectively. This has allowed for the objective evaluation of the impact of different neuropsychiatric pathologies on involuntary attention. Additionally, these ERP have been proposed as alternative measures for the early detection of disease and the tracking of its progression. The objective of this review was to integrate the results reported to date about MMN, P3a, and RON in different neurological and psychiatric disorders. We included experimental studies with clinical populations that reported at least two of these three components in the same experimental paradigm. Overall, involuntary attention seems to reflect the state of cognitive integrity in different pathologies in adults. However, if the main goal for these ERP is to consider them as biomarkers, more research about their pathophysiological specificity in each disorder is needed, as well as improvement in the general experimental conditions under which these components are elicited. Nevertheless, these ERP represent a valuable neurophysiological tool for early detection and follow-up of diverse clinical populations.
Collapse
|
8
|
Zheng Y, Li R, Guo H, Li J, Zhang H, Liu X, Pang X, Zhang B, Shen H, Chang Y. Heightened sensitivity to panic-related sounds with reduced sensitivity to neutral sounds in preattentive processing among panic patients. J Affect Disord 2019; 250:204-209. [PMID: 30870769 DOI: 10.1016/j.jad.2019.03.019] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/29/2018] [Revised: 02/05/2019] [Accepted: 03/04/2019] [Indexed: 11/27/2022]
Abstract
BACKGROUND Hypervigilance to panic-related stimuli is believed to play a critical role in the pathogenesis of panic disorder. The current event-related potential study explored whether this hyperresponsivity occurred in the absence of focused attention. METHODS Mismatch negativity (MMN) responses to panic-related vs. neutral deviants were assessed in 15 medication-free panic patients without agoraphobia and 16 healthy controls using a reverse-standard-deviant paradigm. RESULTS Panic patients relative to healthy controls exhibited an enhanced MMN in response to panic-related sounds but a reduced MMN in response to neutral sounds. Furthermore, MMN responses were delayed in panic patients compared to healthy controls, irrespective of stimulus type. LIMITATION The sample size is relatively small. CONCLUSIONS Our data provide evidence that panic disorder was associated with an increased sensitivity to panic-related changes, accompanied by a reduced sensitivity to other acoustic changes as well as a general slow-down of cognitive processing during the preattentive processing stage.
Collapse
Affiliation(s)
- Ya Zheng
- Department of Psychology, Dalian Medical University, Dalian, China
| | - Ruiying Li
- Department of Neurology and Psychiatry, First Affiliated Hospital, Dalian Medical University, Dalian, China
| | - Han Guo
- Department of Neurology and Psychiatry, First Affiliated Hospital, Dalian Medical University, Dalian, China
| | - Jingxue Li
- Department of Neurology and Psychiatry, First Affiliated Hospital, Dalian Medical University, Dalian, China
| | - Huimin Zhang
- Department of Neurology and Psychiatry, First Affiliated Hospital, Dalian Medical University, Dalian, China
| | - Xiaowei Liu
- Department of Neurology and Psychiatry, First Affiliated Hospital, Dalian Medical University, Dalian, China
| | - Xiaomei Pang
- Department of Neurology and Psychiatry, First Affiliated Hospital, Dalian Medical University, Dalian, China
| | - Bingwei Zhang
- Department of Neurology and Psychiatry, First Affiliated Hospital, Dalian Medical University, Dalian, China
| | - Huijuan Shen
- Department of Psychology, Dalian Medical University, Dalian, China
| | - Yi Chang
- Department of Neurology and Psychiatry, First Affiliated Hospital, Dalian Medical University, Dalian, China.
| |
Collapse
|