CARMA: Software for continuous affect rating and media annotation

Feelings as a currency of care: A role for agreeableness in emotional reactivity

OBJECTIVE AND BACKGROUND

The personality trait of agreeableness is linked to a number of core tendencies (e.g., empathy, warmth) that operate in a feeling-based manner. Following considerations of this type, it is proposed that the motivations and characteristics of agreeable individuals, relative to disagreeable individuals, should render them more receptive to emotional events and more responsive to them for this reason.

METHOD

Potential links between agreeableness and emotional reactivity were assessed in two studies involving four samples (total N = 517) in which participants continuously rated their feeling states in response to a variety of affective images.

RESULTS

Agreeableness did not predict the speed with which emotional reactions began, but agreeable individuals exhibited higher-magnitude peak intensities, regardless of whether stimuli were appetitive (pleasant) or aversive (unpleasant) in nature.

CONCLUSIONS

The findings provide novel insights into the personality trait of agreeableness, emotional reactivity phenomena, and the dynamic processes that link agreeableness to emotion.

The nonverbal expression of guilt in healthy adults

Guilt is a negative emotion elicited by realizing one has caused actual or perceived harm to another person. One of guilt's primary functions is to signal that one is aware of the harm that was caused and regrets it, an indication that the harm will not be repeated. Verbal expressions of guilt are often deemed insufficient by observers when not accompanied by nonverbal signals such as facial expression, gesture, posture, or gaze. Some research has investigated isolated nonverbal expressions in guilt, however none to date has explored multiple nonverbal channels simultaneously. This study explored facial expression, gesture, posture, and gaze during the real-time experience of guilt when response demands are minimal. Healthy adults completed a novel task involving watching videos designed to elicit guilt, as well as comparison emotions. During the video task, participants were continuously recorded to capture nonverbal behaviour, which was then analyzed via automated facial expression software. We found that while feeling guilt, individuals engaged less in several nonverbal behaviours than they did while experiencing the comparison emotions. This may reflect the highly social aspect of guilt, suggesting that an audience is required to prompt a guilt display, or may suggest that guilt does not have clear nonverbal correlates.

DynAMoS: The Dynamic Affective Movie Clip Database for Subjectivity Analysis

In this paper, we describe the design, collection, and validation of a new video database that includes holistic and dynamic emotion ratings from 83 participants watching 22 affective movie clips. In contrast to previous work in Affective Computing, which pursued a single "ground truth" label for the affective content of each moment of each video (e.g., by averaging the ratings of 2 to 7 trained participants), we embrace the subjectivity inherent to emotional experiences and provide the full distribution of all participants' ratings (with an average of 76.7 raters per video). We argue that this choice represents a paradigm shift with the potential to unlock new research directions, generate new hypotheses, and inspire novel methods in the Affective Computing community. We also describe several interdisciplinary use cases for the database: to provide dynamic norms for emotion elicitation studies (e.g., in psychology, medicine, and neuroscience), to train and test affective content analysis algorithms (e.g., for dynamic emotion recognition, video summarization, and movie recommendation), and to study subjectivity in emotional reactions (e.g., to identify moments of emotional ambiguity or ambivalence within movies, identify predictors of subjectivity, and develop personalized affective content analysis algorithms). The database is made freely available to researchers for noncommercial use at https://dynamos.mgb.org.

A psychological flexibility perspective on well-being: Emotional reactivity, adaptive choices, and daily experiences

According to psychological flexibility theory, fully experiencing one's emotions, even when they involve negative reactions, can enhance psychological well-being. In pursuit of this possibility, procedures capable of disentangling reaction intensities from reaction durations, in response to affective images, were developed and variations of this paradigm were applied in understanding variations in happiness and adaptive behavior. Consistent with psychological flexibility theory, three studies showed that more intense emotional reactions, irrespective of valence, were associated with higher levels of well-being. Two additional studies showed that happy individuals, relative to less happy individuals, exhibited more functional approach/avoidance behavior in behavior-focused tasks. Together, the results are consistent with the idea that adaptive emotion generation systems are those that flexibly adapt emotion output to concurrent emotion-related stimulation. The program of research adds to our understanding of the relationship between emotion reactivity and well-being while highlighting specific processes through which emotion and well-being interact. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Mean-level correspondence and moment-to-moment synchrony in adolescent and parent affect: Exploring associations with adolescent age and internalizing and externalizing symptoms

Interactions with parents are integral in shaping the development of children's emotional processes. Important aspects of these interactions are overall (mean level) affective experience and affective synchrony (linkages between parent and child affect across time). Respectively, mean-level affect and affective synchrony reflect aspects of the content and structure of dyadic interactions. Most research on parent-child affect during dyadic interactions has focused on infancy and early childhood; adolescence, however, is a key period for both normative emotional development and the emergence of emotional disorders. We examined affect in early to mid-adolescents (N = 55, Mage = 12.27) and their parents using a video-mediated recall task of 10-min conflict-topic discussions. Using multilevel modeling, we found evidence of significant level-2 effects (mean affect) and level-1 effects (affective synchrony) for parents and their adolescents. Level-2 and level-1 associations were differentially moderated by adolescent age and adolescent internalizing and externalizing symptoms. More specifically, parent-adolescent synchrony was stronger when adolescents were older and had more internalizing problems. Further, more positive adolescent mean affect was associated with more positive parent affect (and vice versa), but only for dyads with low adolescent externalizing problems. Results underscore the importance of additional research examining parent-child affect in adolescence.

The psychophysiology of guilt in healthy adults

Guilt is a negative emotion, elicited by realizing one has caused actual or perceived harm to another person. Anecdotally, guilt often is described as a visceral and physical experience. However, while the way that the body responds to and contributes to emotions is well known in basic emotions, little is known about the characteristics of guilt as generated by the autonomic nervous system. This study investigated the physiologic signature associated with guilt in adults with no history of psychological or autonomic disorder. Healthy adults completed a novel task, including an initial questionnaire about their habits and attitudes, followed by videos designed to elicit guilt, as well as the comparison emotions of amusement, disgust, sadness, pride, and neutral. During the video task, participants' swallowing rate, electrodermal activity, heart rate, respiration rate, and gastric activity rate were continuously recorded. Guilt was associated with alterations in gastric rhythms, electrodermal activity, and swallowing rate relative to some or all the comparison emotions. These findings suggest that there is a mixed pattern of sympathetic and parasympathetic activation during the experience of guilt. These results highlight potential therapeutic targets for modulation of guilt in neurologic and psychiatric disorders with deficient or elevated levels of guilt, such as frontotemporal dementia, posttraumatic stress disorder, and Obsessive-compulsive disorder.

Infant temperamental fear, pupil dilation, and gaze aversion from smiling strangers

In childhood, higher levels of temperamental fear-an early-emerging proclivity to distress in the face of novelty-are associated with lower social responsivity and greater social anxiety. While the early emergence of temperamental fear in infancy is poorly understood, it is theorized to be driven by individual differences in reactivity and self-regulation to novel stimuli. The current study used eye tracking to capture infants' (N = 124) reactions to a video of a smiling stranger-a common social encounter-including infant gaze aversions from the stranger's face (indexing arousal regulation) and pupil dilation (indexing physiological reactivity), longitudinally at 2, 4, 6, and 8 months of age. Multilevel mixed-effects models indicated that more fearful infants took more time to look away from a smiling stranger's face than less fearful infants, suggesting that high-fear infants may have slower arousal regulation. At 2 and 4 months, more fearful infants also exhibited greater and faster pupil dilation before gaze aversions, consistent with greater physiological reactivity. Together, these findings suggest that individual differences in infants' gaze aversions and pupil dilation can index the development of fearful temperament in early infancy, facilitating the identification of, and interventions for, risk factors to social disruptions.

Functional connectivity dynamics as a function of the fluctuation of tension during film watching

To advance the understanding of the dynamic relationship between brain activities and emotional experiences, we examined the neural patterns of tension, a unique emotion that highly depends on how an event unfolds. Specifically, the present study explored the temporal relationship between functional connectivity patterns within and between different brain functional modules and the fluctuation in tension during film watching. Due to the highly contextualized and time-varying nature of tension, we expected that multiple neural networks would be involved in the dynamic tension experience. Using the neuroimaging data of 546 participants, we conducted a dynamic brain analysis to identify the intra- and inter-module functional connectivity patterns that are significantly correlated with the fluctuation of tension over time. The results showed that the inter-module connectivity of cingulo-opercular network, fronto-parietal network, and default mode network is involved in the dynamic experience of tension. These findings demonstrate a close relationship between brain functional connectivity patterns and emotional dynamics, which supports the importance of functional connectivity dynamics in understanding our cognitive and emotional processes.

Emotion Recognition in a Multi-Componential Framework: The Role of Physiology

The Component Process Model is a well-established framework describing an emotion as a dynamic process with five highly interrelated components: cognitive appraisal, expression, motivation, physiology and feeling. Yet, few empirical studies have systematically investigated discrete emotions through this full multi-componential view. We therefore elicited various emotions during movie watching and measured their manifestations across these components. Our goal was to investigate the relationship between physiological measures and the theoretically defined components, as well as to determine whether discrete emotions could be predicted from the multicomponent response patterns. By deploying a data-driven computational approach based on multivariate pattern classification, our results suggest that physiological features are encoded within each component, supporting the hypothesis of a synchronized recruitment during an emotion episode. Overall, while emotion prediction was higher when classifiers were trained with all five components, a model without physiology features did not significantly reduce the performance. The findings therefore support a description of emotion as a multicomponent process, in which emotion recognition requires the integration of all the components. However, they also indicate that physiology per se is the least significant predictor for emotion classification among these five components.

Full throttle: Demonstrating the speed, accuracy, and validity of a new method for continuous two-dimensional self-report and annotation

Research on fine-grained dynamic psychological processes has increasingly come to rely on continuous self-report measures. Recent studies have extended continuous self-report methods to simultaneously collecting ratings on two dimensions of an experience. For all the variety of approaches, several limitations are inherent to most of them. First, current methods are primarily suited for bipolar, as opposed to unipolar, constructs. Second, respondents report on two dimensions using one hand, which may produce method driven error, including spurious relationships between the two dimensions. Third, two-dimensional reports have primarily been validated for consistency between reporters, rather than the predictive validity of idiosyncratic responses. In a series of tasks, the study reported here addressed these limitations by comparing a previously used method to a newly developed two-handed method, and by explicitly testing the validity of continuous two-dimensional responses. Results show that our new method is easier to use, faster, more accurate, with reduced method-driven dependence between the two dimensions, and preferred by participants. The validity of two-dimensional responding was also demonstrated in comparison to one-dimensional reporting, and in relation to post hoc ratings. Together, these findings suggest that our two-handed method for two-dimensional continuous ratings is a powerful and reliable tool for future research.

Concordance of mother-child respiratory sinus arrythmia is continually moderated by dynamic changes in emotional content of film stimuli

Evidence suggests that concordance between parent and child physiological states is an important marker of interpersonal interaction. However, studies have focused on individual differences in concordance, and we have limited understanding of how physiological concordance may vary dynamically based on the situational context. We examined whether mother-child physiological concordance was moderated by dynamic changes in emotional content of a film clip they viewed together. Second-by-second estimates of respiratory sinus arrythmia were obtained from mothers and children (N = 158, M_{child age} = 45.16 months) as they viewed a chase scene from a children's film. In addition, the film clip's negative emotional content was rated second-by-second. Results showed that mother-child dyads displayed positive physiological concordance only in seconds when there was an increase in the clip's negative emotional content. Thus, dynamic changes in mother-child physiological concordance may indicate dyadic responses to challenge.

Toward Emotion Recognition From Physiological Signals in the Wild: Approaching the Methodological Issues in Real-Life Data Collection

Emotion, mood, and stress recognition (EMSR) has been studied in laboratory settings for decades. In particular, physiological signals are widely used to detect and classify affective states in lab conditions. However, physiological reactions to emotional stimuli have been found to differ in laboratory and natural settings. Thanks to recent technological progress (e.g., in wearables) the creation of EMSR systems for a large number of consumers during their everyday activities is increasingly possible. Therefore, datasets created in the wild are needed to insure the validity and the exploitability of EMSR models for real-life applications. In this paper, we initially present common techniques used in laboratory settings to induce emotions for the purpose of physiological dataset creation. Next, advantages and challenges of data collection in the wild are discussed. To assess the applicability of existing datasets to real-life applications, we propose a set of categories to guide and compare at a glance different methodologies used by researchers to collect such data. For this purpose, we also introduce a visual tool called Graphical Assessment of Real-life Application-Focused Emotional Dataset (GARAFED). In the last part of the paper, we apply the proposed tool to compare existing physiological datasets for EMSR in the wild and to show possible improvements and future directions of research. We wish for this paper and GARAFED to be used as guidelines for researchers and developers who aim at collecting affect-related data for real-life EMSR-based applications.

Reflecting on Existential Threats Elicits Self-Reported Negative Affect but No Physiological Arousal

There is mixed evidence whether reflecting on an existential threat increases negative affect and thereby elicits subjective arousal and physiological activation. Additionally, it is debated whether different existential and non-existential threats elicit different arousal responses, although systematic comparisons are lacking. The current study explored affective, subjective, and physiological arousal responses while comparing several existential threats with a non-existential threat and with a control condition. One-hundred-and-seventy-one undergraduate students were randomly allocated to one of four existential threat conditions: mortality salience (MS), freedom restriction, uncontrollability, and uncertainty; or to the non-existential threat condition: social-evaluative threat (SET); or to a control condition (TV salience). Self-reported positive/negative affect was measured before and after reflection, while subjective arousal and physiological activation (electrodermal, cardiovascular, and respiratory) were measured on a high time-scale during baseline and reflection. Results showed larger increases in self-reported negative affect, as compared to the control condition, for all existential threat conditions, while there were no differences between the control condition and threat conditions regarding positive affect, subjective arousal, skin conductance, respiratory rate, and respiratory sinus arrythmia. There were subtle differences between existential and non-existential threat conditions, most notably in affective responses. Correlations showed positive associations between negative affect and subjective arousal and between trait avoidance and subjective arousal. This study is the first to systematically compare affective, subjective, and physiological changes in arousal due to reflecting on different existential threats, as well as one non-existential threat. We showed that, as compared to a control condition, reflecting on threats has a large impact on negative affect, but no significant impact on positive affect, subjective arousal, and physiological activation.

Development of Emotion Regulation Dynamics Across Early Childhood: a Multiple Time-Scale Approach

Children should become more effective at regulating emotion as they age. Longitudinal evidence of such change, however, is scarce. This study uses a multiple-time scale approach to test the hypothesis that the self-regulation of emotion-the engagement of executive processes to influence the dynamics of prepotent emotional responses-becomes more effective as children move through early childhood. Second-by-second time-series data obtained from behavioral observation of 120 children (46% female) during an 8-min frustration-eliciting wait task completed at four ages (24 months, 36 months, 48 months, 5 years) were modeled using bivariate coupled differential equation models designed to capture age-related changes in the intrinsic dynamics and bidirectional coupling of prepotent and executive processes. Results revealed indirect influences of executive processes on the intrinsic dynamics of children's desire and frustration increased with age but also revealed complex and non-linear age-related changes in how specific aspects of the dynamic interplay between prepotent responses and executive processes influence the effectiveness of regulation at different ages. The findings illustrate the utility of using a dynamics system approach to articulate and study how specific aspects of emotion regulation change with age.

Quiet Sleep Organization of Very Preterm Infants Is Correlated With Postnatal Maturation

Background: Sleep is an important determinant of brain development in preterm infants. Its temporal organization varies with gestational age (GA) and post-menstrual age (PMA) but little is known about how sleep develops in very preterm infants. The objective was to study the correlation between the temporal organization of quiet sleep (QS) and maturation in premature infants without severe complications during their neonatal hospitalization. Methods: Percentage of time spent in QS and average duration of time intervals (ADI) spent in QS were analyzed from a cohort of newborns with no severe complications included in the Digi-NewB prospective, multicentric, observational study in 2017-19. Three groups were analyzed according to GA: Group 1 (27-30 weeks), Group 2 (33-37 weeks), Group 3 (>39 weeks). Two 8-h video recordings were acquired in groups 1 and 2: after birth (T1) and before discharge from hospital (T2). The annotation of the QS phases was performed by analyzing video recordings together with heart rate and respiratory traces thanks to a dedicated software tool of visualization and annotation of multimodal long-time recordings, with a double expert reading. Results are expressed as median (interquartile range, IQR). Correlations were analyzed using a linear mixed model. Results: Five newborns were studied in each group (160 h of recording). Median time spent in QS increased from 13.0% [IQR: 13-20] to 28.8% [IQR: 27-30] and from 17.0% [IQR: 15-21] to 29.6% [IQR: 29.5-31.5] in Group 1 and 2, respectively. Median ADI increased from 54 [IQR: 53-54] to 288 s [IQR: 279-428] and from 90 [IQR: 84-96] to 258 s [IQR: 168-312] in Group 1 and 2. Both groups reach values similar to that of group 3, respectively 28.2% [IQR: 24.5-31.3] and 270 s [IQR: 210-402]. The correlation between PMA and time spent in QS or ADI were, respectively 0.73 (p < 10^-4) and 0.46 (p = 0.06). Multilinear analysis using temporal organization of QS gave an accurate estimate of PMA (r ² = 0.87, p < 0.001). Conclusion: The temporal organization of QS is correlated with PMA in newborns without severe complication. An automated standardized continuous behavioral quantification of QS could be interesting to monitor during the hospitalization stay in neonatal units.

Semi-Automated Data Labeling for Activity Recognition in Pervasive Healthcare

Activity recognition, a key component in pervasive healthcare monitoring, relies on classification algorithms that require labeled data of individuals performing the activity of interest to train accurate models. Labeling data can be performed in a lab setting where an individual enacts the activity under controlled conditions. The ubiquity of mobile and wearable sensors allows the collection of large datasets from individuals performing activities in naturalistic conditions. Gathering accurate data labels for activity recognition is typically an expensive and time-consuming process. In this paper we present two novel approaches for semi-automated online data labeling performed by the individual executing the activity of interest. The approaches have been designed to address two of the limitations of self-annotation: (i) The burden on the user performing and annotating the activity, and (ii) the lack of accuracy due to the user labeling the data minutes or hours after the completion of an activity. The first approach is based on the recognition of subtle finger gestures performed in response to a data-labeling query. The second approach focuses on labeling activities that have an auditory manifestation and uses a classifier to have an initial estimation of the activity, and a conversational agent to ask the participant for clarification or for additional data. Both approaches are described, evaluated in controlled experiments to assess their feasibility and their advantages and limitations are discussed. Results show that while both studies have limitations, they achieve 80% to 90% precision.

Splitting the affective atom: Divergence of valence and approach-avoidance motivation during a dynamic emotional experience

Valence and approach-avoidance motivation are two distinct but closely related components of affect. However, little is known about how these two processes evolve and covary in a dynamic affective context. We formulated several hypotheses based on the Motivational Dimensional Model of Affect. We expected that anger would be a unique approach-related rather than avoidance-related negative emotion. We also expected that high-approach positive emotions (e.g., desire) would differ from low-approach positive emotions (e.g., amusement) producing a stronger link between valence and approach-avoidance motivation. We also explored other dynamic properties of discrete emotions such as the difference between approach-avoidance motivation and valence as a marker of balance within affective components. We asked 69 participants to provide continuous ratings of valence and approach-avoidance motivation for eight standardized clips representing different discrete emotions. Using multilevel modeling, we established a significant relationship between valence and approach-avoidance motivation with high-approach emotions producing a stronger link between valence and approach-avoidance motivation compared to neutral states and low-approach emotions. Contrary to expectations, we observed that individuals exhibited an avoidance response during anger elicitation. Finally, we found that awe was a distinct positive emotion where approach motivation dominated over valence. These findings are relevant to the theory and research on diverging processes within the core structure of affect.

DARMA: Software for dual axis rating and media annotation

Continuous measurement systems provide a means of measuring dynamic behavioral and experiential processes as they play out over time. DARMA is a modernized continuous measurement system that synchronizes media playback and the continuous recording of two-dimensional measurements. These measurements can be observational or self-reported and are provided in real-time through the manipulation of a computer joystick. DARMA also provides tools for reviewing and comparing collected measurements and for customizing various settings. DARMA is a domain-independent software tool that was designed to aid researchers who are interested in gaining a deeper understanding of behavior and experience. It is especially well-suited to the study of affective and interpersonal processes, such as the perception and expression of emotional states and the communication of social signals. DARMA is open-source using the GNU General Public License (GPL) and is available for free download from http://darma.jmgirard.com .

General trust impedes perception of self-reported primary psychopathy in thin slices of social interaction

Little is known about people's ability to detect subclinical psychopathy from others' quotidian social behavior, or about the correlates of variation in this ability. This study sought to address these questions using a thin slice personality judgment paradigm. We presented 108 undergraduate judges (70.4% female) with 1.5 minute video thin slices of zero-acquaintance triadic conversations among other undergraduates (targets: n = 105, 57.1% female). Judges completed self-report measures of general trust, caution, and empathy. Target individuals had completed the Levenson Self-Report Psychopathy (LSRP) scale. Judges viewed the videos in one of three conditions: complete audio, silent, or audio from which semantic content had been removed using low-pass filtering. Using a novel other-rating version of the LSRP, judges' ratings of targets' primary psychopathy levels were significantly positively associated with targets' self-reports, but only in the complete audio condition. Judge general trust and target LSRP interacted, such that judges higher in general trust made less accurate judgments with respect to targets higher in primary and total psychopathy. Results are consistent with a scenario in which psychopathic traits are maintained in human populations by negative frequency dependent selection operating through the costs of detecting psychopathy in others.

A switch point in the molecular chaperone Hsp90 responding to client interaction

Heat shock protein 90 (Hsp90) is a dimeric molecular chaperone that undergoes large conformational changes during its functional cycle. It has been established that conformational switch points exist in the N-terminal (Hsp90-N) and C-terminal (Hsp90-C) domains of Hsp90, however information for switch points in the large middle-domain (Hsp90-M) is scarce. Here we report on a tryptophan residue in Hsp90-M as a new type of switch point. Our study shows that this conserved tryptophan senses the interaction of Hsp90 with a stringent client protein and transfers this information via a cation–π interaction with a neighboring lysine. Mutations at this position hamper the communication between domains and the ability of a client protein to affect the Hsp90 cycle. The residue thus allows Hsp90 to transmit information on the binding of a client from Hsp90-M to Hsp90-N which is important for progression of the conformational cycle and the efficient processing of client proteins.

The heat shock protein 90 (Hsp90) chaperone undergoes large conformational changes during its functional cycle. Here the authors combine in vivo, biochemical, biophysical and computational approaches and provide insights into the allosteric regulation of Hsp90 by identifying and characterizing a switch point in the Hsp90 middle domain.

A Primer on Observational Measurement

Observational measurement plays an integral role in a variety of scientific endeavors within biology, psychology, sociology, education, medicine, and marketing. The current article provides an interdisciplinary primer on observational measurement; in particular, it highlights recent advances in observational methodology and the challenges that accompany such growth. First, we detail the various types of instrument that can be used to standardize measurements across observers. Second, we argue for the importance of validity in observational measurement and provide several approaches to validation based on contemporary validity theory. Third, we outline the challenges currently faced by observational researchers pertaining to measurement drift, observer reactivity, reliability analysis, and time/expense. Fourth, we describe recent advances in computer-assisted measurement, fully automated measurement, and statistical data analysis. Finally, we identify several key directions for future observational research to explore.