Perceiving blocks of emotional pictures and sounds: effects on physiological variables

Social support of virtual characters reduces pain perception

BACKGROUND

Psychosocial factors, such as social support, can reduce pain. Virtual reality (VR) is a powerful tool to decrease pain, but social factors in VR-based pain analgesia have rarely been studied. Specifically, it is unclear whether social support by virtual characters can reduce pain and whether the perceived control behind virtual characters (agency) and varying degrees of social cues impact pain perception.

METHODS

Healthy participants (N = 97) received heat pain stimulation while undergoing four within-subject conditions in immersive VR: (1) virtual character with a low number of social cues (virtual figure) provided verbal support, (2) virtual character with a high number of social cues (virtual human) provided verbal support, (3) no social support (hearing neutral words), (4) no social support. Perceived agency of the virtual characters served as between-subjects factor. Participants in the avatar group were led to believe that another participant controlled the virtual characters. Participants in the agent group were told they interacted with a computer. However, in both conditions, virtual characters were computer-controlled. Pain ratings, psychophysiological measurements and presence ratings were recorded.

RESULTS

Virtual social support decreased pain intensity and pain unpleasantness ratings but had no impact on electrodermal activity nor heart rate. A virtual character with a high number of social cues led to lower pain unpleasantness and higher feelings of presence. Agency had no significant impact.

CONCLUSIONS

Virtual characters providing social support can reduce pain independent of perceived agency. A more human visual appearance can have beneficial effects on social pain modulation by virtual characters.

SIGNIFICANCE

Social influences are important factors in pain modulation. The current study demonstrated analgesic effects through verbal support provided by virtual characters and investigated modulating factors. A more human appearance of a virtual character resulted in a higher reduction of pain unpleasantness. Importantly, agency of the virtual characters had no impact. Given the increasing use of digital health interventions, the findings suggest a positive impact of virtual characters for digital pain treatments.

Unravelling the influence of affective stimulation on functional neurological symptoms: a pilot experiment examining potential mechanisms

BACKGROUND

Differences in affective processing have previously been shown in functional neurological disorder (FND); however, the mechanistic relevance is uncertain. We tested the hypotheses that highly arousing affective stimulation would result in elevated subjective functional neurological symptoms (FNS), and this would be associated with elevated autonomic reactivity. The possible influence of cognitive detachment was also explored.

METHOD

Individuals diagnosed with FND (motor symptoms/seizures; n=14) and healthy controls (n=14) viewed Positive, Negative and Neutral images in blocks, while passively observing the stimuli ('Watch') or detaching themselves ('Distance'). The FND group rated their primary FNS, and all participants rated subjective physical (arousal, pain, fatigue) and psychological states (positive/negative affect, dissociation), immediately after each block. Skin conductance (SC) and heart rate (HR) were monitored continuously.

RESULTS

FNS ratings were higher after Negative compared with Positive and Neutral blocks in the FND group (p=0.002, ηp 2=0.386); however, this effect was diminished in the Distance condition relative to the Watch condition (p=0.018, ηp 2=0.267). SC and/or HR correlated with FNS ratings in the Negative-Watch and Neutral-Distance conditions (r values=0.527-0.672, p values=0.006-0.035). The groups did not differ in subjective affect or perceived arousal (p values=0.541-0.919, ηp 2=<0.001-0.015).

CONCLUSIONS

Emotionally significant events may exert an influence on FNS which is related to autonomic activation rather than altered subjective affect or perceived arousal. This influence may be modulated by cognitive detachment. Further work is needed to determine the relevance and neural bases of these processes in specific FND phenotypes.

Coherence and divergence in autonomic-subjective affective space

A central tenet of many theories of emotion is that emotional states are accompanied by distinct patterns of autonomic activity. However, experimental studies of coherence between subjective and autonomic responses during emotional states provide little evidence of coherence. Crucially, previous studies investigating coherence have either adopted univariate approaches or made limited use of multivariate analytic approaches by investigating subjective and autonomic responses separately. The current study addressed this question using a multivariate dimensional approach to build a common autonomic-subjective affective space incorporating subjective responses and three different autonomic signals (heart rate, skin conductance response, and pupil diameter), measured during an emotion-inducing task, in 51 participants. Results showed that autonomic and subjective responses could be adequately described in a two-dimensional affective space. The first dimension included contributions from subjective and autonomic responses, indicating coherence, while contributions to the second dimension were almost exclusively of autonomic covariance. Thus, while there was a degree of coherence between autonomic and subjective emotional responses, there was substantial structure in autonomic responses that did not covary with subjective emotional experience. This study, therefore, contributes new insights into the relationship between subjective and autonomic emotional responses, and provides a framework for future multimodal emotion research, enabling both hypothesis- and data-driven testing.

New insights on the correspondence between subjective affective experience and physiological responses from representational similarity analysis

Classical views suggest that experienced affect is related to a specific bodily response, whereas recent perspectives challenge this view postulating that similar affective experiences rather evoke different physiological responses. To further advance this debate in the field, we used representational similarity analysis to investigate the correspondence between subjective affect (arousal and valence ratings) and physiological reactions (skin conductance response [SCR], startle blink response, heart rate, and corrugator activity) across various emotion induction contexts (picture viewing task, sound listening task, and imagery task). Significant similarities were exclusively observed between SCR and arousal in the picture viewing task. However, none of the other physiological measures showed a significant relation with valence and arousal ratings in any of the tasks. These findings are discussed within the framework of the Populations hypothesis, suggesting that physiological responses do not depend on the experienced affect but are directly associated with the context in which they are evoked.

Physiological indicators of emotional arousal related to ANS activity in response to associative cards for psychotherapeutic PTSD treatment

SEE FAR CBT is an integrative treatment protocol for PTSD and anxiety disorders which combines CBT, body-mind (somatic experience) and imagery-based (fantastic reality; FR) methods. FR is introduced using associative therapeutic cards (COPE cards) to represent both "a pleasant/safe place" and the re-narrating process of the traumatic story. Although some preliminary evidence exists regarding the impact of COPE cards integration in psychotherapy, further validation is needed as to whether these cards can induce distinct arousal-affective states in the observer. The aim of this study was to examine whether exposure to COPE cards evoke different emotional-psychophysiological states using objective physiological measures reflecting autonomic nervous system responses; hence, to further validate its use as a potentially effective tool within the context of SEE FAR CBT therapeutic process. Ninety-five healthy under-graduate participants were first exposed to high-arousal, negatively-valenced cards and asked to put themselves in a state of emotional/physical arousal. Afterwards, they were exposed to low-arousal, positively-valenced cards and were asked to try to calm and relax to the best of their ability. Heart rate, blood pressure and heart rate variability (HRV) were measured at baseline, at the arousal phase and finally at the relaxation phase. It was found that exposure to arousing negative cards resulted in significant increase in blood pressure and a decrease in HRV, while exposure to relaxing positive cards resulted in significant decrease in blood pressure and an increase in HRV. These findings support the efficacy and utility of associative COPE cards in affecting psychophysiological arousal.

Validation of a Low-Cost Electrocardiography (ECG) System for Psychophysiological Research

BACKGROUND AND OBJECTIVE

The reliability of low-cost mobile systems for recording Electrocardiographic (ECG) data is mostly unknown, posing questions regarding the quality of the recorded data and the validity of the extracted physiological parameters. The present study compared the BITalino toolkit with an established medical-grade ECG system (BrainAmp-ExG).

METHODS

Participants underwent simultaneous ECG recordings with the two instruments while watching pleasant and unpleasant pictures of the "International Affective Picture System" (IAPS). Common ECG parameters were extracted and compared between the two systems. The Intraclass Correlation Coefficients (ICCs) and the Bland-Altman Limits of Agreement (LoA) method served as criteria for measurement agreement.

RESULTS

All but one parameter showed an excellent agreement (>80%) between both devices in the ICC analysis. No criteria for Bland-Altman LoA and bias were found in the literature regarding ECG parameters.

CONCLUSION

The results of the ICC and Bland-Altman methods demonstrate that the BITalino system can be considered as an equivalent recording device for stationary ECG recordings in psychophysiological experiments.

fNIRS-based functional connectivity estimation using semi-metric analysis to study decision making by nursing students and registered nurses

This study aims to investigate the generalizability of the semi-metric analysis of the functional connectivity (FC) for functional near-infrared spectroscopy (fNIRS) by applying it to detect the dichotomy in differential FC under affective and neutral emotional states in nursing students and registered nurses during decision making. The proposed method employs wavelet transform coherence to construct FC networks and explores semi-metric analysis to extract network redundancy features, which has not been considered in conventional fNIRS-based FC analyses. The trials of the proposed method were performed on 19 nursing students and 19 registered nurses via a decision-making task under different emotional states induced by affective and neutral emotional stimuli. The cognitive activities were recorded using fNIRS, and the emotional stimuli were adopted from the International Affective Digitized Sound System (IADS). The induction of emotional effects was validated by heart rate variability (HRV) analysis. The experimental results by the proposed method showed significant difference (FDR-adjusted p = 0.004) in the nursing students’ cognitive FC network under the two different emotional conditions, and the semi-metric percentage (SMP) of the right prefrontal cortex (PFC) was found to be significantly higher than the left PFC (FDR-adjusted p = 0.036). The benchmark method (a typical weighted graph theory analysis) gave no significant results. In essence, the results support that the semi-metric analysis can be generalized and extended to fNIRS-based functional connectivity estimation.

An Autonomous Alarm System for Personal Safety Assurance of Intimate Partner Violence Survivors Based on Passive Continuous Monitoring through Biosensors

Intimate Partner Violence (IPV) dramatically compromises the free and complete development of many women around the world, therefore leading to social asymmetry regarding the right to personal safety. In many cases, a woman who has reported her partner to police for gender-based violence needs to ensure her protection (either before the trial of the aggressor or after their freedom). Thus, it would be ideal if autonomous alarm systems could be developed in order to call the police if necessary. Up to now, many proposals have been presented in this regard, including solutions based on Information and Communication Technologies (ICT) but, unfortunately, these approaches usually rely on the active participation of the victims (survivors), who have to turn the system on by themselves if needed. Therefore, in order to overcome such limitations, in this work, a passive continuous monitoring system is proposed which uses biosensors attached to the survivor as well as machine learning techniques to infer if an abnormal situation related to gender-based violence is taking place, activating in this case an alarm. The monitoring structure of the system supervises a great deal of bio-signals according to the current status of technology of wearables and biomedical devices. The presented biosensors-based surveillance solution can also be manually disconnected for 30/60/90 min (on demand) in order to avoid false positives when a woman is, for example, practicing sports or carrying out other inoffensive activities that could incorrectly activate the alarm.

Funny kittens: Positive mood induced via short video-clips affects error processing but not conflict control

The interplay of performance monitoring functions and affective variables labeled as moods or emotions has been investigated within different theoretical frameworks including conflict adaptation and reinforcement learning. However, results regarding the electrophysiological underpinnings of performance monitoring such as the error-related negativity (ERN), the N200 or the error positivity (Pe) remain largely inconsistent. While some studies report ERN enhancements after positive mood induction, others find reductions due to positive affect. An additional source of complexity regards the manifold induction methods across studies. Here, we investigated whether performance-independent, blocked mood inductions via mini-clips alter electrophysiological markers of performance monitoring. Positive clips consisted of a pre-rated collection of human and animal funny/fail videos, while neutral clips showed natural scenes of humans and animals or sport events. The main task was a modified flanker paradigm. The effectivity of mood induction was confirmed via recorded skin conductance response (SCR), facial-muscle electromyogram (EMG) and intermittent subjective mood questionnaires. Regarding interference control neither reaction times nor error rates were influenced by mood induction, similarly no mood effects of the N2 component were observed. In contrast, we found enhanced ERN as well as Pe amplitudes in the positive compared to the neutral condition. Additional to post error slowing we found increased interference effects after errors in positive blocks on the behavioral level. The results suggest a specific receptiveness of evaluative control components to positive affect that will be discussed regarding their possible neuronal underpinnings.

Hyperalgesia when observing pain-related images is a genuine bias in perception and enhances autonomic responses

Observing pain in others can enhance our own pain. Two aspects of this effect remain unknown or controversial: first, whether it depends on the 'painfulness' of the visual stimulus; second, whether it reflects a genuine bias in perception or rather a bias in the memory encoding of the percept. Pain ratings and vegetative skin responses were recorded while 21 healthy volunteers received electric nociceptive shocks under three experimental conditions: (i) observing a painful contact between the body and a harmful object; (ii) observing a non-painful body contact, (iii) observing a control scene where the body and the object are not in contact. Pain reports and vegetative responses were enhanced exclusively when the subjects observed a painful body contact. The effect on perception was immediate, abated 3 sec after the shock, and positively correlated with the magnitude of vegetative arousal. This suggests that (a) hyperalgesia during observation of painful scenes was induced by their pain-related nature, and not by the simple body contact, and (b) hyperalgesia emerged from a very rapid bias in the perceptual encoding of the stimulus, and was not the result of a retrospective bias in memory recollection. Observing pain-depicting scenes can modify the processing of concomitant somatic stimuli, increasing their arousal value and shifting perception toward more painful levels.

Automatic detection of major depressive disorder using electrodermal activity

Major depressive disorder (MDD) is a common psychiatric disorder and the leading cause of disability worldwide. However, current methods used to diagnose depression mainly rely on clinical interviews and self-reported scales of depressive symptoms, which lack objectivity and efficiency. To address this challenge, we present a machine learning approach to screen for MDD using electrodermal activity (EDA). Participants included 30 patients with MDD and 37 healthy controls. Their EDA was measured during five experimental phases consisted of baseline, mental arithmetic task, recovery from the stress task, relaxation task, and recovery from the relaxation task, which elicited multiple alterations in autonomic activity. Selected EDA features were extracted from each phase, and differential EDA features between two distinct phases were evaluated. By using these features as input data and performing feature selection with SVM-RFE, 74% accuracy, 74% sensitivity, and 71% specificity could be achieved by our decision tree classifier. The most relevant features selected by SVM-RFE included differential EDA features and features from the stress and relaxation tasks. These findings suggest that automatic detection of depression based on EDA features is feasible and that monitoring changes in physiological signal when a subject is experiencing autonomic arousal and recovery may enhance discrimination power.

Effect of congruence between sound and video on heart rate and self-reported measures of emotion

Most studies of emotional responses have used unimodal stimuli (e.g., pictures or sounds) or congruent bimodal stimuli (e.g., video clips with sound), but little is known about the emotional response to incongruent bimodal stimuli. The aim of the present study was to evaluate the effect of congruence between auditory and visual bimodal stimuli on heart rate and self-reported measures of emotional dimension, valence and arousal. Subjects listened to pleasant, neutral, and unpleasant sounds, accompanied by videos with and without content congruence, and heart rate was recorded. Dimensions of valence and arousal of each bimodal stimulus were then self-reported. The results showed that heart rate depends of the valence of the sounds but not of the congruence of the bimodal stimuli. The valence and arousal scores changed depending on the congruence of the bimodal stimuli. These results suggest that the congruence of bimodal stimuli affects the subjective perception of emotion.

An Emotion Aware Task Automation Architecture Based on Semantic Technologies for Smart Offices

The evolution of the Internet of Things leads to new opportunities for the contemporary notion of smart offices, where employees can benefit from automation to maximize their productivity and performance. However, although extensive research has been dedicated to analyze the impact of workers’ emotions on their job performance, there is still a lack of pervasive environments that take into account emotional behaviour. In addition, integrating new components in smart environments is not straightforward. To face these challenges, this article proposes an architecture for emotion aware automation platforms based on semantic event-driven rules to automate the adaptation of the workplace to the employee’s needs. The main contributions of this paper are: (i) the design of an emotion aware automation platform architecture for smart offices; (ii) the semantic modelling of the system; and (iii) the implementation and evaluation of the proposed architecture in a real scenario.

An unpleasant emotional state reduces working memory capacity: electrophysiological evidence

Emotional states can guide the actions and decisions we make in our everyday life through their influence on cognitive processes such as working memory (WM). We investigated the long-lasting interference that an unpleasant emotional state had on goal-relevant WM representations from an electrophysiological perspective. Participants performed a change detection task that was preceded by the presentation of unpleasant or neutral task-irrelevant pictures in a blocked fashion. We focused on the contralateral delay activity (CDA), an event-related potential that is sensitive to the number of task-relevant items stored in WM. We found that the asymptotic limit for the CDA amplitude was lower during the unpleasant emotional state than during the neutral one; that is, an emotional state was capable of reducing how many task-relevant items the participants could hold in WM. Furthermore, both the individuals who experienced more intrusive thoughts and those who were dispositionally anxious were more susceptible to the influence of the emotional state. We provide evidence that an unpleasant emotional state diminished visual WM for task-relevant items, particularly in susceptible individuals. These results open new avenues to uncover the emotional-cognitive processing that underlies maladaptive WM representations and the role of such processing in the development of mental illness.

Using Time Perception to Explore Implicit Sensitivity to Emotional Stimuli in Autism Spectrum Disorder

Establishing whether implicit responses to emotional cues are intact in autism spectrum disorder (ASD) is fundamental to ascertaining why their emotional understanding is compromised. We used a temporal bisection task to assess for responsiveness to face and wildlife images that varied in emotional salience. There were no significant differences between an adult ASD and comparison group, with both showing implicit overestimation of emotional stimuli. Further, there was no correlation between overestimation of emotional stimuli and autistic traits in undergraduate students. These data do not suggest a fundamental insensitivity to the arousing content of emotional images in ASD, or in individuals with a high degree of autistic traits. The findings have implications for understanding how emotional stimuli are processed in ASD.

Hearing, Emotion, Amplification, Research, and Training Workshop: Current Understanding of Hearing Loss and Emotion Perception and Priorities for Future Research

The question of how hearing loss and hearing rehabilitation affect patients' momentary emotional experiences is one that has received little attention but has considerable potential to affect patients' psychosocial function. This article is a product from the Hearing, Emotion, Amplification, Research, and Training workshop, which was convened to develop a consensus document describing research on emotion perception relevant for hearing research. This article outlines conceptual frameworks for the investigation of emotion in hearing research; available subjective, objective, neurophysiologic, and peripheral physiologic data acquisition research methods; the effects of age and hearing loss on emotion perception; potential rehabilitation strategies; priorities for future research; and implications for clinical audiologic rehabilitation. More broadly, this article aims to increase awareness about emotion perception research in audiology and to stimulate additional research on the topic.

Emotion avoidance and fear bradycardia in patients with borderline personality disorder and healthy controls

BACKGROUND AND OBJECTIVES

Exaggerated emotional reactivity is supposed to be essential in the etiology of borderline personality disorder (BPD). More specifically, models of defensive behavior would predict reduced freezing behavior -indicated by fear bradycardia-in response to threat. This study examined automatic fear bradycardia responses in BPD versus healthy controls and the role of emotion dysregulation, more specifically tendencies to avoid emotions.

METHODS

Patients with BPD (n = 23) and healthy controls (n = 18) completed questionnaires and then watched neutral, pleasant and unpleasant pictures while heart rate was assessed.

RESULTS

Emotion avoidance interacted with group: it was associated with distinct autonomic responses in healthy controls but not in BPD patients. Controls with lower emotion avoidance tendencies showed bradycardia in response to unpleasant pictures, while controls with higher emotion avoidance tendencies did not. BPD patients showed no bradycardia, irrespective of their emotion avoidance tendencies.

LIMITATIONS

This study is limited by a small sample size. Comorbidity or medication intake were not controlled for.

CONCLUSIONS

The results may suggest impaired automatic defense responses in BPD. Further understanding of the regulation of distress and defense responses might improve BPD treatment.

Nencki Affective Picture System: Cross-Cultural Study in Europe and Iran

Although emotions have been assumed conventionally to be universal, recent studies have suggested that various aspects of emotions may be mediated by cultural background. The purpose of our research was to test these contradictory views, in the case of the subjective evaluation of visual affective stimuli. We also sought to validate the recently introduced Nencki Affective Picture System (NAPS) database on a different cultural group. Since there has been, to date, no attempt to compare the emotions of a culturally distinct sample of Iranians with those of Europeans, subjective ratings were collected from 40 Iranians and 39 Europeans. Each cultural group was asked separately to provide normative affective ratings and classify pictures according to discrete emotions. The results were analyzed to identify cultural differences in the ratings of individual images. One hundred and seventy NAPS pictures were rated with regard to the intensity of the basic emotions (happiness, sadness, fear, surprise, anger, and disgust) they elicited, as well as in terms of affective dimensions (valence and arousal). Contrary to previous studies using the International Affective Picture System, our results for Europeans and Iranians show that neither the ratings for affective dimensions nor for basic emotions differed across cultural groups. In both cultural groups, the relationship between valence and arousal ratings could be best described by a classical boomerang-shaped function. However, the content of the pictures (animals, faces, landscapes, objects, or people) had a significant effect on the ratings for valence and arousal. These findings indicate that further studies in cross-cultural affective research should control for the content of stimuli.

Bivariate autoregressive state-space modeling of psychophysiological time series data

Heart rate (HR) and electrodermal activity (EDA) are often used as physiological measures of psychological arousal in various neuropsychology experiments. In this exploratory study, we analyze HR and EDA data collected from four participants, each with a history of suicidal tendencies, during a cognitive task known as the Paced Auditory Serial Addition Test (PASAT). A central aim of this investigation is to guide future research by assessing heterogeneity in the population of individuals with suicidal tendencies. Using a state-space modeling approach to time series analysis, we evaluate the effect of an exogenous input, i.e., the stimulus presentation rate which was increased systematically during the experimental task. Participants differed in several parameters characterizing the way in which psychological arousal was experienced during the task. Increasing the stimulus presentation rate was associated with an increase in EDA in participants 2 and 4. The effect on HR was positive for participant 2 and negative for participants 3 and 4. We discuss future directions in light of the heterogeneity in the population indicated by these findings.

Repetitive Religious Chanting Modulates the Late-Stage Brain Response to Fear- and Stress-Provoking Pictures

Chanting and praying are among the most popular religious activities, which are said to be able to alleviate people’s negative emotions. However, the neural mechanisms underlying this mental exercise and its temporal course have hardly been investigated. Here, we used event-related potentials (ERPs) to explore the effects of chanting the name of a Buddha (Amitābha) on the brain’s response to viewing negative pictures that were fear- and stress-provoking. We recorded and analyzed electroencephalography (EEG) data from 21 Buddhists with chanting experience as they viewed negative and neutral pictures. Participants were instructed to chant the names of Amitābha or Santa Claus silently to themselves or simply remain silent (no-chanting condition) during picture viewing. To measure the physiological changes corresponding to negative emotions, electrocardiogram and galvanic skin response data were also collected. Results showed that viewing negative pictures (vs. neutral pictures) increased the amplitude of the N1 component in all the chanting conditions. The amplitude of late positive potential (LPP) also increased when the negative pictures were viewed under the no-chanting and the Santa Claus condition. However, increased LPP was not observed when chanting Amitābha. The ERP source analysis confirmed this finding and showed that increased LPP mainly originated from the central-parietal regions of the brain. In addition, the participants’ heart rates decreased significantly when viewing negative pictures in the Santa Claus condition. The no-chanting condition had a similar decreasing trend although not significant. However, while chanting Amitābha and viewing negative pictures participants’ heart rate did not differ significantly from that observed during neutral picture viewing. It is possible that the chanting of Amitābha might have helped the participants to develop a religious schema and neutralized the effect of the negative stimuli. These findings echo similar research findings on Christian religious practices and brain responses to negative stimuli. Hence, prayer/religious practices may have cross-cultural universality in emotion regulation. This study shows for the first time that Buddhist chanting, or in a broader sense, repetition of religious prayers will not modulate brain responses to negative stimuli during the early perceptual stage, but only during the late-stage emotional/cognitive processing.

Reduced Freezing in Posttraumatic Stress Disorder Patients while Watching Affective Pictures

Besides fight and flight responses, animals and humans may respond to threat with freezing, a response characterized by bradycardia and physical immobility. Risk assessment is proposed to be enhanced during freezing to promote optimal decision making. Indeed, healthy participants showed freezing-like responses to threat cues. Posttraumatic stress disorder (PTSD) patients are characterized by hypervigilance and increased threat responsiveness. We propose that threat responses will be characterized by decreased freezing in PTSD, eliminating possibilities for rejecting cognitive distortions, such as harm expectancy, and thereby contributing to the maintenance of the disorder. However, freezing responses have hardly been investigated in PTSD. Using a stabilometric platform to assess body sway as an indicator of freezing-like behavior, we examined whether veterans with PTSD would show diminished freezing responses to unpleasant versus neutral and pleasant pictures. Fourteen PTSD patients and 14 healthy matched controls watched the pictures, while body sway and heart rate (HR) were continuously assessed. Replicating previous findings, healthy controls showed decreased body sway and HR in response to unpleasant pictures, indicative of freezing-like behavior. In contrast, this response pattern was not observed in PTSD patients. The results may indicate a reduced freezing response in PTSD. As reduced freezing may hinder appropriate risk assessment, it may be an important factor in the maintenance of PTSD. Future research might clarify whether impaired freezing is a PTSD-specific or a transdiagnostic symptom, being present in threat-related disorders.

Examining the short term effects of emotion under an Adaptation Level Theory model of tinnitus perception

OBJECTIVES

Existing evidence suggests a strong relationship between tinnitus and emotion. The objective of this study was to examine the effects of short-term emotional changes along valence and arousal dimensions on tinnitus outcomes. Emotional stimuli were presented in two different modalities: auditory and visual. The authors hypothesized that (1) negative valence (unpleasant) stimuli and/or high arousal stimuli will lead to greater tinnitus loudness and annoyance than positive valence and/or low arousal stimuli, and (2) auditory emotional stimuli, which are in the same modality as the tinnitus, will exhibit a greater effect on tinnitus outcome measures than visual stimuli.

STUDY DESIGN

Auditory and visual emotive stimuli were administered to 22 participants (12 females and 10 males) with chronic tinnitus, recruited via email invitations send out to the University of Auckland Tinnitus Research Volunteer Database. Emotional stimuli used were taken from the International Affective Digital Sounds- Version 2 (IADS-2) and the International Affective Picture System (IAPS) (Bradley and Lang, 2007a, 2007b). The Emotion Regulation Questionnaire (Gross and John, 2003) was administered alongside subjective ratings of tinnitus loudness and annoyance, and psychoacoustic sensation level matches to external sounds.

RESULTS

Males had significantly different emotional regulation scores than females. Negative valence emotional auditory stimuli led to higher tinnitus loudness ratings in males and females and higher annoyance ratings in males only; loudness matches of tinnitus remained unchanged. The visual stimuli did not have an effect on tinnitus ratings. The results are discussed relative to the Adaptation Level Theory Model of Tinnitus.

CONCLUSIONS

The results indicate that the negative valence dimension of emotion is associated with increased tinnitus magnitude judgements and gender effects may also be present, but only when the emotional stimulus is in the auditory modality. Sounds with emotional associations may be used for sound therapy for tinnitus relief; it is of interest to determine whether the emotional component of sound treatments can play a role in reversing the negative responses discussed in this paper.

Assessing positive emotional states in dogs using heart rate and heart rate variability

Since most animal species have been recognized as sentient beings, emotional state may be a good indicator of welfare in animals. The goal of this study was to manipulate the environment of nine beagle research dogs to highlight physiological responses indicative of different emotional experiences. Stimuli were selected to be a more or a less positive food (meatball or food pellet) or social reward (familiar person or less familiar person). That all the stimuli were positive and of different reward value was confirmed in a runway motivation test. Dogs were tested individually while standing facing a display theatre where the different stimuli could be shown by lifting a shutter. The dogs approached and remained voluntarily in the test system. They were tested in four sessions (of 20s each) for each of the four stimuli. A test session consisted of four presentation phases (1st exposure to stimulus, post exposure, 2nd exposure, and access to reward). Heart rate (HR) and heart rate variability (HRV) responses were recorded during testing in the experimental room and also when lying resting in a quiet familiar room. A new method of 'stitching' short periods of HRV data together was used in the analysis. When testing different stimuli, no significant differences were observed in HR and LF:HF ratio (relative power in low frequency (LF) and the high-frequency (HF) range), implying that the sympathetic tone was activated similarly for all the stimuli and may suggest that dogs were in a state of positive arousal. A decrease of HF was associated with the meatball stimulus compared to the food pellet and the reward phase (interacting with the person or eating the food) was associated with a decrease in HF and RMSSD (root mean square of successive differences of inter-beat intervals) compared to the preceding phase (looking at the person or food). This suggests that parasympathetic deactivation is associated with a more positive emotional state in the dog. A similar reduction in HF and RMSSD was found in the test situation compared to the resting situation. This is congruent with the expected autonomic effects related to postural shift i.e. sympathetic activation and parasympathetic withdrawal, during standing versus lying, but it cannot explain the parasympathetic deactivation in response to the more positive stimuli since the dogs were always standing in the test situation. We discuss the systematic pattern of responses, which support that increased HR and LF:HF ratio are associated with emotional arousal, but add the new proposal that a combined decrease in RMSSD and HF may reflect a more positively valenced emotional state even when an individual is already in a positive psychological state.

Effects of mediated social touch on affective experiences and trust

This study investigated whether communication via mediated hand pressure during a remotely shared experience (watching an amusing video) can (1) enhance recovery from sadness, (2) enhance the affective quality of the experience, and (3) increase trust towards the communication partner. Thereto participants first watched a sad movie clip to elicit sadness, followed by a funny one to stimulate recovery from sadness. While watching the funny clip they signaled a hypothetical fellow participant every time they felt amused. In the experimental condition the participants responded by pressing a hand-held two-way mediated touch device (a Frebble), which also provided haptic feedback via simulated hand squeezes. In the control condition they responded by pressing a button and they received abstract visual feedback. Objective (heart rate, galvanic skin conductance, number and duration of joystick or Frebble presses) and subjective (questionnaires) data were collected to assess the emotional reactions of the participants. The subjective measurements confirmed that the sad movie successfully induced sadness while the funny movie indeed evoked more positive feelings. Although their ranking agreed with the subjective measurements, the physiological measurements confirmed this conclusion only for the funny movie. The results show that recovery from movie induced sadness, the affective experience of the amusing movie, and trust towards the communication partner did not differ between both experimental conditions. Hence, feedback via mediated hand touching did not enhance either of these factors compared to visual feedback. Further analysis of the data showed that participants scoring low on Extraversion (i.e., persons that are more introvert) or low on Touch Receptivity (i.e., persons who do not like to be touched by others) felt better understood by their communication partner when receiving mediated touch feedback instead of visual feedback, while the opposite was found for participants scoring high on these factors. The implications of these results for further research are discussed, and some suggestions for follow-up experiments are presented.

Using neurophysiological signals that reflect cognitive or affective state: six recommendations to avoid common pitfalls

Estimating cognitive or affective state from neurophysiological signals and designing applications that make use of this information requires expertise in many disciplines such as neurophysiology, machine learning, experimental psychology, and human factors. This makes it difficult to perform research that is strong in all its aspects as well as to judge a study or application on its merits. On the occasion of the special topic "Using neurophysiological signals that reflect cognitive or affective state" we here summarize often occurring pitfalls and recommendations on how to avoid them, both for authors (researchers) and readers. They relate to defining the state of interest, the neurophysiological processes that are expected to be involved in the state of interest, confounding factors, inadvertently "cheating" with classification analyses, insight on what underlies successful state estimation, and finally, the added value of neurophysiological measures in the context of an application. We hope that this paper will support the community in producing high quality studies and well-validated, useful applications.

Emotional pictures and sounds: a review of multimodal interactions of emotion cues in multiple domains

In everyday life, multiple sensory channels jointly trigger emotional experiences and one channel may alter processing in another channel. For example, seeing an emotional facial expression and hearing the voice’s emotional tone will jointly create the emotional experience. This example, where auditory and visual input is related to social communication, has gained considerable attention by researchers. However, interactions of visual and auditory emotional information are not limited to social communication but can extend to much broader contexts including human, animal, and environmental cues. In this article, we review current research on audiovisual emotion processing beyond face-voice stimuli to develop a broader perspective on multimodal interactions in emotion processing. We argue that current concepts of multimodality should be extended in considering an ecologically valid variety of stimuli in audiovisual emotion processing. Therefore, we provide an overview of studies in which emotional sounds and interactions with complex pictures of scenes were investigated. In addition to behavioral studies, we focus on neuroimaging, electro- and peripher-physiological findings. Furthermore, we integrate these findings and identify similarities or differences. We conclude with suggestions for future research.

Combining and comparing EEG, peripheral physiology and eye-related measures for the assessment of mental workload

While studies exist that compare different physiological variables with respect to their association with mental workload, it is still largely unclear which variables supply the best information about momentary workload of an individual and what is the benefit of combining them. We investigated workload using the n-back task, controlling for body movements and visual input. We recorded EEG, skin conductance, respiration, ECG, pupil size and eye blinks of 14 subjects. Various variables were extracted from these recordings and used as features in individually tuned classification models. Online classification was simulated by using the first part of the data as training set and the last part of the data for testing the models. The results indicate that EEG performs best, followed by eye related measures and peripheral physiology. Combining variables from different sensors did not significantly improve workload assessment over the best performing sensor alone. Best classification accuracy, a little over 90%, was reached for distinguishing between high and low workload on the basis of 2 min segments of EEG and eye related variables. A similar and not significantly different performance of 86% was reached using only EEG from single electrode location Pz.

Inference of human affective states from psychophysiological measurements extracted under ecologically valid conditions

Compared to standard laboratory protocols, the measurement of psychophysiological signals in real world experiments poses technical and methodological challenges due to external factors that cannot be directly controlled. To address this problem, we propose a hybrid approach based on an immersive and human accessible space called the eXperience Induction Machine (XIM), that incorporates the advantages of a laboratory within a life-like setting. The XIM integrates unobtrusive wearable sensors for the acquisition of psychophysiological signals suitable for ambulatory emotion research. In this paper, we present results from two different studies conducted to validate the XIM as a general-purpose sensing infrastructure for the study of human affective states under ecologically valid conditions. In the first investigation, we recorded and classified signals from subjects exposed to pictorial stimuli corresponding to a range of arousal levels, while they were free to walk and gesticulate. In the second study, we designed an experiment that follows the classical conditioning paradigm, a well-known procedure in the behavioral sciences, with the additional feature that participants were free to move in the physical space, as opposed to similar studies measuring physiological signals in constrained laboratory settings. Our results indicate that, by using our sensing infrastructure, it is indeed possible to infer human event-elicited affective states through measurements of psychophysiological signals under ecological conditions.

A new paradigm to induce mental stress: the Sing-a-Song Stress Test (SSST)

We here introduce a new experimental paradigm to induce mental stress in a quick and easy way while adhering to ethical standards and controlling for potential confounds resulting from sensory input and body movements. In our Sing-a-Song Stress Test, participants are presented with neutral messages on a screen, interleaved with 1-min time intervals. The final message is that the participant should sing a song aloud after the interval has elapsed. Participants sit still during the whole procedure. We found that heart rate and skin conductance during the 1-min intervals following the sing-a-song stress message are substantially higher than during intervals following neutral messages. The order of magnitude of the rise is comparable to that achieved by the Trier Social Stress Test. Skin conductance increase correlates positively with experienced stress level as reported by participants. We also simulated stress detection in real time. When using both skin conductance and heart rate, stress is detected for 18 out of 20 participants, approximately 10 s after onset of the sing-a-song message. In conclusion, the Sing-a-Song Stress Test provides a quick, easy, controlled and potent way to induce mental stress and could be helpful in studies ranging from examining physiological effects of mental stress to evaluating interventions to reduce stress.

Evidence for effects of task difficulty but not learning on neurophysiological variables associated with effort

Learning to master a task is expected to be accompanied by a decrease in effort during task execution. We examine the possibility to monitor learning using physiological measures that have been reported to reflect effort or workload. Thirty-five participants performed different difficulty levels of the n-back task while a range of physiological and performance measurements were recorded. In order to dissociate non-specific time-related effects from effects of learning, we used the easiest level as a baseline condition. This condition is expected to only reflect non-specific effects of time. Performance and subjective measures confirmed more learning for the difficult level than for the easy level. The difficulty levels affected physiological variables in the way as expected, therewith showing their sensitivity. However, while most of the physiological variables were also affected by time, time-related effects were generally the same for the easy and the difficult level. Thus, in a well-controlled experiment that enabled the dissociation of general time effects from learning we did not find physiological variables to indicate decreasing effort associated with learning. Theoretical and practical implications are discussed.