Vocal emotion decoding in the subthalamic nucleus: An intracranial ERP study in Parkinson's disease

Uncovering the neurophysiology of mood, motivation and behavioral symptoms in Parkinson's disease through intracranial recordings

Neuropsychiatric mood and motivation symptoms (depression, anxiety, apathy, impulse control disorders) in Parkinson's disease (PD) are highly disabling, difficult to treat and exacerbated by current medications and deep brain stimulation therapies. High-resolution intracranial recording techniques have the potential to undercover the network dysfunction and cognitive processes that drive these symptoms, towards a principled re-tuning of circuits. We highlight intracranial recording as a valuable tool for mapping and desegregating neural networks and their contribution to mood, motivation and behavioral symptoms, via the ability to dissect multiplexed overlapping spatial and temporal neural components. This technique can be powerfully combined with behavioral paradigms and emerging computational techniques to model underlying latent behavioral states. We review the literature of intracranial recording studies investigating mood, motivation and behavioral symptomatology with reference to 1) emotional processing, 2) executive control 3) subjective valuation (reward & cost evaluation) 4) motor control and 5) learning and updating. This reveals associations between different frequency specific network activities and underlying cognitive processes of reward decision making and action control. If validated, these signals represent potential computational biomarkers of motivational and behavioural states and could lead to principled therapy development for mood, motivation and behavioral symptoms in PD.

Landscape and future directions of machine learning applications in closed-loop brain stimulation

Brain stimulation (BStim) encompasses multiple modalities (e.g., deep brain stimulation, responsive neurostimulation) that utilize electrodes implanted in deep brain structures to treat neurological disorders. Currently, BStim is primarily used to treat movement disorders such as Parkinson's, though indications are expanding to include neuropsychiatric disorders like depression and schizophrenia. Traditional BStim systems are "open-loop" and deliver constant electrical stimulation based on manually-determined parameters. Advancements in BStim have enabled development of "closed-loop" systems that analyze neural biomarkers (e.g., local field potentials in the sub-thalamic nucleus) and adjust electrical modulation in a dynamic, patient-specific, and energy efficient manner. These closed-loop systems enable real-time, context-specific stimulation adjustment to reduce symptom burden. Machine learning (ML) has emerged as a vital component in designing these closed-loop systems as ML models can predict / identify presence of disease symptoms based on neural activity and adaptively learn to modulate stimulation. We queried the US National Library of Medicine PubMed database to understand the role of ML in developing closed-loop BStim systems to treat epilepsy, movement disorders, and neuropsychiatric disorders. Both neural and non-neural network ML algorithms have successfully been leveraged to create closed-loop systems that perform comparably to open-loop systems. For disorders in which the underlying neural pathophysiology is relatively well understood (e.g., Parkinson's, essential tremor), most work has involved refining ML models that can classify neural signals as aberrant or normal. The same is seen for epilepsy, where most current research has focused on identifying optimal ML model design and integrating closed-loop systems into existing devices. For neuropsychiatric disorders, where the underlying pathologic neural circuitry is still being investigated, research is focused on identifying biomarkers (e.g., local field potentials from brain nuclei) that ML models can use to identify onset of symptoms and stratify severity of disease.

Crossed functional specialization between the basal ganglia and cerebellum during vocal emotion decoding: Insights from stroke and Parkinson’s disease

There is growing evidence that both the basal ganglia and the cerebellum play functional roles in emotion processing, either directly or indirectly, through their connections with cortical and subcortical structures. However, the lateralization of this complex processing in emotion recognition remains unclear. To address this issue, we investigated emotional prosody recognition in individuals with Parkinson’s disease (model of basal ganglia dysfunction) or cerebellar stroke patients, as well as in matched healthy controls (n = 24 in each group). We analysed performances according to the lateralization of the predominant brain degeneration/lesion. Results showed that a right (basal ganglia and cerebellar) hemispheric dysfunction was likely to induce greater deficits than a left one. Moreover, deficits following left hemispheric dysfunction were only observed in cerebellar stroke patients, and these deficits resembled those observed after degeneration of the right basal ganglia. Additional analyses taking disease duration / time since stroke into consideration revealed a worsening of performances in patients with predominantly right-sided lesions over time. These results point to the differential, but complementary, involvement of the cerebellum and basal ganglia in emotional prosody decoding, with a probable hemispheric specialization according to the level of cognitive integration.

Prefrontal Physiomarkers of Anxiety and Depression in Parkinson's Disease

Objective: Anxiety and depression are prominent non-motor symptoms of Parkinson’s disease (PD), but their pathophysiology remains unclear. We sought to understand their neurophysiological correlates from chronic invasive recordings of the prefrontal cortex (PFC).

Methods: We studied four patients undergoing deep brain stimulation (DBS) for their motor signs, who had comorbid mild to moderate anxiety and/or depressive symptoms. In addition to their basal ganglia leads, we placed a permanent prefrontal subdural 4-contact lead. These electrodes were attached to an investigational pulse generator with the capability to sense and store field potential signals, as well as deliver therapeutic neurostimulation. At regular intervals over 3–5 months, participants paired brief invasive neural recordings with self-ratings of symptoms related to depression and anxiety.

Results: Mean age was 61 ± 7 years, mean disease duration was 11 ± 8 years and a mean Unified Parkinson’s Disease Rating Scale, with part III (UPDRS-III) off medication score of 37 ± 13. Mean Beck Depression Inventory (BDI) score was 14 ± 5 and Beck Anxiety Index was 16.5 ± 5. Prefrontal cortex spectral power in the beta band correlated with patient self-ratings of symptoms of depression and anxiety, with r-values between 0.31 and 0.48. Mood scores showed negative correlation with beta spectral power in lateral locations, and positive correlation with beta spectral power in a mesial recording location, consistent with the dichotomous organization of reward networks in PFC.

Interpretation: These findings suggest a physiological basis for anxiety and depression in PD, which may be useful in the development of neurostimulation paradigms for these non-motor disease features.

The basal ganglia and the cerebellum in human emotion

The basal ganglia (BG) and the cerebellum historically have been relegated to a functional role in producing or modulating motor output. Recent research, however, has emphasized the importance of these subcortical structures in multiple functional domains, including affective processes such as emotion recognition, subjective feeling elicitation and reward valuation. The pathways through the thalamus that connect the BG and cerebellum directly to each other and with extensive regions of the cortex provide a structural basis for their combined influence on limbic function. By regulating cortical oscillations to guide learning and strengthening rewarded behaviors or thought patterns to achieve a desired goal state, these regions can shape the way an individual processes emotional stimuli. This review will discuss the basic structure and function of the BG and cerebellum and propose an updated view of their functional role in human affective processing.

Basal ganglia and cerebellum contributions to vocal emotion processing as revealed by high-resolution fMRI

Until recently, brain networks underlying emotional voice prosody decoding and processing were focused on modulations in primary and secondary auditory, ventral frontal and prefrontal cortices, and the amygdala. Growing interest for a specific role of the basal ganglia and cerebellum was recently brought into the spotlight. In the present study, we aimed at characterizing the role of such subcortical brain regions in vocal emotion processing, at the level of both brain activation and functional and effective connectivity, using high resolution functional magnetic resonance imaging. Variance explained by low-level acoustic parameters (fundamental frequency, voice energy) was also modelled. Wholebrain data revealed expected contributions of the temporal and frontal cortices, basal ganglia and cerebellum to vocal emotion processing, while functional connectivity analyses highlighted correlations between basal ganglia and cerebellum, especially for angry voices. Seed-to-seed and seed-to-voxel effective connectivity revealed direct connections within the basal ganglia—especially between the putamen and external globus pallidus—and between the subthalamic nucleus and the cerebellum. Our results speak in favour of crucial contributions of the basal ganglia, especially the putamen, external globus pallidus and subthalamic nucleus, and several cerebellar lobules and nuclei for an efficient decoding of and response to vocal emotions.

Brain Microstructural Properties Related to Subjective Well-Being: Diffusion Tensor Imaging Analysis

Although it is known that health is not merely the absence of disease, the positive aspects of mental health have been less comprehensively researched compared with its negative aspects. Subjective well-being (SWB) is one of the indicators of positive psychology, and high SWB is considered to benefit individuals in multiple ways. However, the neural mechanisms underlying individual differences in SWB remain unclear, particularly in terms of brain microstructural properties as detected by diffusion tensor imaging. The present study aimed to investigate the relationship between measurements of diffusion tensor imaging [mean diffusivity (MD) and fractional anisotropy] and the degree of SWB as measured using a questionnaire. Voxel-based analysis was used to investigate the association between MD and SWB scores in healthy young adults (age, 20.7 ± 1.8 years; 695 males and 514 females). Higher levels of SWB were found to be associated with lower MD in areas surrounding the right putamen, insula, globus pallidus, thalamus and caudate. These results indicated that individual SWB is associated with variability in brain microstructural properties.

Sensory contribution to vocal emotion deficit in patients with cerebellar stroke

In recent years, there has been increasing evidence of cerebellar involvement in emotion processing. Difficulties in the recognition of emotion from voices (i.e., emotional prosody) have been observed following cerebellar stroke. However, the interplay between sensory and higher-order cognitive dysfunction in these deficits, as well as possible hemispheric specialization for emotional prosody processing, has yet to be elucidated. We investigated the emotional prosody recognition performances of patients with right versus left cerebellar lesions, as well as of matched controls, entering the acoustic features of the stimuli in our statistical model. We also explored the cerebellar lesion-behavior relationship, using voxel-based lesion-symptom mapping. Results revealed impairment of vocal emotion recognition in both patient subgroups, particularly for neutral or negative prosody, with a higher number of misattributions in patients with right-hemispheric stroke. Voxel-based lesion-symptom mapping showed that some emotional misattributions correlated with lesions in the right Lobules VIIb and VIII and right Crus I and II. Furthermore, a significant proportion of the variance in this misattribution was explained by acoustic features such as pitch, loudness, and spectral aspects. These results point to bilateral posterior cerebellar involvement in both the sensory and cognitive processing of emotions.

Acute Time-Locked Alpha Frequency Subthalamic Stimulation Reduces Negative Emotional Bias in Parkinson's Disease

BACKGROUND

Emotional processing is a core cognitive process cutting across neuropsychiatric disorders. Understanding the neurophysiological features underlying depressive symptoms and their sensitivity to modulation is critical to modifying emotional bias. The subthalamic nucleus (STN), targeted in Parkinson's disease, shows a late alpha desynchronization to affective stimuli. We targeted this alpha desynchronization using a novel stimulation protocol asking if brief alpha (10 Hz) frequency stimulation time-locked to unpleasant imagery might influence subjective emotion.

METHODS

A total of 27 patients with Parkinson's disease were recruited. The first study tested patients (n = 16) on affective stimuli with STN local field potential recordings assessed bilaterally without stimulation. In the second study, patients (n = 24) were tested on two affective tasks comparing negative and neutral stimuli paired with acute right-STN stimulation, with one of the negative conditions stimulated briefly for 1 second at either 130 Hz or 10 Hz. The subjects rated valence and arousal of negative and neutral stimuli.

RESULTS

We confirmed greater alpha desynchronization in both negative and positive affect relative to neutral in the right STN. Using acute stimulation of the right STN, we show a critical interaction effect between ratings, stimulation, and frequency; alpha frequency stimulation increased the subjective pleasantness of negative imagery, particularly with ventromedial contacts. Higher depression scores were associated with a positive bias to 10-Hz but not 130-Hz stimulation.

CONCLUSIONS

We highlight the potential of brief alpha frequency subthalamic stimulation to reduce negative emotional bias. This finding provides mechanistic insights underlying subjective emotional valence and has implications for the management of depression using neuromodulation.

Subthalamic nucleus oscillations during vocal emotion processing are dependent of the motor asymmetry of Parkinson's disease

The subthalamic nucleus (STN) is involved in different aspects of emotional processes and more specifically in emotional prosody recognition. Recent studies on the behavioral effects of deep brain stimulation (DBS) in patients with Parkinson's disease (PD) have uncovered an asymmetry in vocal emotion decoding in PD, with left-onset PD patients showing deficits for the processing of happy voices. Whether and how PD asymmetry affects STN electrophysiological responses to emotional prosody, however, remains unknown. In the current study, local field potential activity was recorded from eight left- and six right-lateralized motor-onset PD patients (LOPD/ROPD) undergoing DBS electrodes implantation, while they listened to angry, happy and neutral voices. Time-frequency decomposition revealed that theta (2-6 Hz), alpha (6-12 Hz) and gamma (60-150 Hz) band responses to emotion were mostly bilateral with a differential pattern of response according to patient's sides-of onset. Conversely, beta-band (12-20 Hz and 20-30 Hz) emotional responses were mostly lateralized in the left STN for both patient groups. Furthermore, STN theta, alpha and gamma band responses to happiness were either absent (theta band) or reduced (alpha and gamma band) in the most affected STN hemisphere (contralateral to the side-of onset), while a late low-beta band left STN happiness-specific response was present in ROPD patients and did not occur in LOPD patients. Altogether, in this study, we demonstrate a complex pattern of oscillatory activity in the human STN in response to emotional voices and reveal a crucial influence of disease laterality on STN low-frequency oscillatory activity.

Deep brain stimulation and recordings: Insights into the contributions of subthalamic nucleus in cognition

Recent progress in targeted interrogation of basal ganglia structures and networks with deep brain stimulation in humans has provided insights into the complex functions the subthalamic nucleus (STN). Beyond the traditional role of the STN in modulating motor function, recognition of its role in cognition was initially fueled by side effects seen with STN DBS and later revealed with behavioral and electrophysiological studies. Anatomical, clinical, and electrophysiological data converge on the view that the STN is a pivotal node linking cognitive and motor processes. The goal of this review is to synthesize the literature to date that used DBS to examine the contributions of the STN to motor and non-motor cognitive functions and control. Multiple modalities of research have provided us with an enhanced understanding of the STN and reveal that it is critically involved in motor and non-motor inhibition, decision-making, motivation and emotion. Understanding the role of the STN in cognition can enhance the therapeutic efficacy and selectivity not only for existing applications of DBS, but also in the development of therapeutic strategies to stimulate aberrant circuits to treat non-motor symptoms of Parkinson's disease and other disorders.

Brain Networks of Emotional Prosody Processing

The processing of emotional nonlinguistic information in speech is defined as emotional prosody. This auditory nonlinguistic information is essential in the decoding of social interactions and in our capacity to adapt and react adequately by taking into account contextual information. An integrated model is proposed at the functional and brain levels, encompassing 5 main systems that involve cortical and subcortical neural networks relevant for the processing of emotional prosody in its major dimensions, including perception and sound organization; related action tendencies; and associated values that integrate complex social contexts and ambiguous situations.

Subthalamic nucleus activity in the processing of body and mental action verbs in people with Parkinson's disease

Local field potentials evoked by body action and mental action verbs were recorded in the subthalamic nucleus (STN) of 18 patients with Parkinson's disease through the electrodes implanted for deep brain stimulation. Compared with the medication on-condition, the medication off-condition showed a difference in activity in the early time segments, mainly in the right STN, with larger amplitudes for body action verbs. In the on-condition a similar pattern was detected in the left STN. These patterns of early differences in activity evoked by different types of verbs might indicate the potential of the STN to rapidly detect relevant behavioural clues in verbal content and to integrate these in subsequent cortico-subcortical interactions. In addition, these lateralizations allow speculations about shifts in processing activity correlating with dopaminergic denervation. Whether this detection relies on phonological, semantic or grammatical clues remains an open question.

Affective modulation of the associative-limbic subthalamic nucleus: deep brain stimulation in obsessive-compulsive disorder

Affective states underlie daily decision-making and pathological behaviours relevant to obsessive-compulsive disorders (OCD), mood disorders and addictions. Deep brain stimulation targeting the motor and associative-limbic subthalamic nucleus (STN) has been shown to be effective for Parkinson's disease (PD) and OCD, respectively. Cognitive and electrophysiological studies in PD showed responses of the motor STN to emotional stimuli, impairments in recognition of negative affective states and modulation of the intensity of subjective emotion. Here we studied whether the stimulation of the associative-limbic STN in OCD influences the subjective emotion to low-intensity positive and negative images and how this relates to clinical symptoms. We assessed 10 OCD patients with on and off STN DBS in a double-blind randomized manner by recording ratings of valence and arousal to low- and high-intensity positive and negative emotional images. STN stimulation increased positive ratings and decreased negative ratings to low-intensity positive and negative stimuli, respectively, relative to off stimulation. We also show that the change in severity of obsessive-compulsive symptoms pre- versus post-operatively interacts with both DBS and valence ratings. We show that stimulation of the associative-limbic STN might influence the negative cognitive bias in OCD and decreasing the negative appraisal of emotional stimuli with a possible relationship with clinical outcomes. That the effect is specific to low intensity might suggest a role of uncertainty or conflict related to competing interpretations of image intensity. These findings may have implications for the therapeutic efficacy of DBS.

Different effects of levodopa and subthalamic stimulation on emotional conflict in Parkinson's disease

Parkinson's disease impairs the decoding of emotional stimuli reflecting alterations of the limbic cortico-subcortical network. The objective of this study was to assess and compare the behavioral and electrophysiological effects of both levodopa and subthalamic stimulation on emotional processing in Parkinson's disease. Operated patients (n =16) and matched healthy subjects performed an emotional Stroop task, in which the emotion expressed by a face must be recognized while ignoring an emotional distractive word and that includes a neutral control sub-task. Patients were tested in the four possible treatment conditions (off stim/off med; on stim/off med; off stim/on med; and on stim/on med). High-resolution electroencephalography was recorded while performing the task. Patients made significantly more mistakes in facial emotion recognition than healthy subjects (p < .005). Untreated patients performed worse in the emotional trials than in the control sub-task (p < .05). Fearful faces induced significantly slower reaction times than happy faces in patients (p = .0002), but not in the healthy subjects. The emotional Stroop effect with levodopa was significantly higher than with subthalamic stimulation when fearful faces were assessed (p = .0243). Conversely, treatments did not modulate the Stroop effect of the control sub-task. EEG demonstrated that, compared with the untreated state, levodopa but not subthalamic stimulation significantly increases the amplitude of the event-related potential N170 (p = .002 vs. p = .1, respectively), an electrophysiological biomarker of early aspects of facial processing. The activity of the N170 cortical sources within the right fusiform gyrus was increased by levodopa (p < .05) but not by stimulation. While levodopa normalizes the recognition of emotional facial expression and early EEG markers of emotional processing, subthalamic stimulation does not. Thus, operated patients require dopaminergic medication in addition to stimulation to treat emotional symptoms of Parkinson's disease.

Brain Networks, Emotion Components, and Appraised Relevance

Modeling emotion processes remains a conceptual and methodological challenge in affective sciences. In responding to the other target articles in this special section on “Emotion and the Brain” and the comments on our article, we address the issue of potentially separate brain networks subserving the functions of the different emotion components. In particular, we discuss the suggested role of component synchronization in producing information integration for the dynamic emergence of a coherent emotion process, as well as the links between incentive salience (“wanting”) and concern-relevance in the elicitation of emotion.

Non-motor Characterization of the Basal Ganglia: Evidence From Human and Non-human Primate Electrophysiology

Although the basal ganglia have been implicated in a growing list of human behaviors, they include some of the least understood nuclei in the brain. For several decades studies have employed numerous methodologies to uncover evidence pointing to the basal ganglia as a hub of both motor and non-motor function. Recently, new electrophysiological characterization of the basal ganglia in humans has become possible through direct access to these deep structures as part of routine neurosurgery. Electrophysiological approaches for identifying non-motor function have the potential to unlock a deeper understanding of pathways that may inform clinical interventions and particularly neuromodulation. Various electrophysiological modalities can also be combined to reveal functional connections between the basal ganglia and traditional structures throughout the neocortex that have been linked to non-motor behavior. Several reviews have previously summarized evidence for non-motor function in the basal ganglia stemming from behavioral, clinical, computational, imaging, and non-primate animal studies; in this review, instead we turn to electrophysiological studies of non-human primates and humans. We begin by introducing common electrophysiological methodologies for basal ganglia investigation, and then we discuss studies across numerous non-motor domains–emotion, response inhibition, conflict, decision-making, error-detection and surprise, reward processing, language, and time processing. We discuss the limitations of current approaches and highlight the current state of the information.

Subthalamic deep brain stimulation influences complex emotional musical experience in Parkinson's disease

Subthalamic deep brain stimulation (STN DBS) is an effective treatment for reducing the motor symptoms of patients with Parkinson's disease (PD), but several side effects have been reported, concerning the processing of emotions. Music has been shown to evoke powerful emotional experiences - not only basic emotions, but also complex, so-called aesthetic experiences. The goal of the present study was therefore to investigate how STN DBS influences the experience of both basic and more complex musical emotions in patients with PD. In a three-group between-participants design, we compared healthy controls (HC), patients receiving STN DBS (PD-DBS), and patients who were candidates for STN DBS and receiving medication only (PD-MO) on their assessments of subjectively experienced musical emotions. Results showed that in general, the experience of musical emotions differed only marginally between the PD-MO, PD-DBS, and HC groups. Nonetheless, we were able to discern subtle but distinct effects of PD and STN DBS in the emotional responses. Happy music, for instance, seemed to induce a heightened experience of negative emotions (tension) in PD-MO patients. STN DBS appeared to normalize this particular effect, but increased nostalgic feelings - a rather complex affective experience - in response to the same emotional stimuli. This should not be taken as indicating a bias for nostalgia in the PD-DBS subgroup, as these patients found music inducing melancholy to be less nostalgic and more joyful than HC did. In conclusion, our study showed that music elicits slightly altered emotional experiences in patients with and without STN DBS. In particular, STN DBS seems to induce less distinct emotional responses, blurring the boundaries between complex musical emotions.